Mage AI

06/04/2024

Master the magic of enhancing your data pipeline's using backfilling. 🧙‍♂️ ✨

Backfilling is a critical step in building a data pipeline. It completes the data pipeline process by integrating historical data with more recent data, and backfilling ensures the integrity of the data pipeline, acting as a contingency pipeline in case of failures in production.

Check the full article out below 👇

Mage is an open-source data pipeline tool for transforming and integrating data.

06/03/2024

🚨 Manifest your superhuman abilities with the X-Men release v0.9.71! ❌ 🧬
📡 Create streaming Oracle destination
👤 Support active project per user in multi-project platform
⚙️ Support job parameters in Kubernetes executor
🔑 Support OIDC_ROLES_MAPPING and user_roles
🐛 Bug fixes & more!

Details: https://github.com/mage-ai/mage-ai/releases/tag/0.9.71

01/19/2024

🚨 Killer features in the Yusuke Urameshi release 0.9.60! 🎇 👈
🌊 Google Cloud Storage Streaming Destination
👷‍♂️ Overwrite SQL types
👨‍💻 Command Center: Version Control, New File Explorer, and Terminal App
✏️ JSON Logging
🐛 Bug fixes & more!

Details: https://github.com/mage-ai/mage-ai/releases/tag/0.9.60

01/10/2024

🚨 Enter the Year of the Dragon release 0.9.59! 🐉
🎮 Multi-project Platform [BETA]
🚀 Command Center [BETA]
🪣 Atlassian Bitbucket Version Control
◔ Qdrant integration
🧱 dbt DX v2 + dbt Upgrade [BETA]
🐛 Bug fixes & more!

Details: https://github.com/mage-ai/mage-ai/releases/tag/0.9.59

12/21/2023

🥹 No more feeling like a cotton-headed n***y muggin! Dynamic blocks are here to optimize your pipelines and save the day! 🎁

Learn more: https://docs.mage.ai/design/blocks/dynamic-blocks

12/08/2023

👏 A big applause for Michael Freeman on his recent feat of seamlessly incorporating the NATS.io JetStream message broker into Mage as a streaming source. Michael's technical brilliance and dedication shine through, turning ideas into impactful reality.

Beyond his coding wizardry, Michael is a constant force in our community, generously sharing insights and fostering collaboration. Thank you for being a key player, an inspiration, and an invaluable part of our journey! 🙏

12/07/2023

🤝 Meet Chase.

⚡ In the fast-paced world of data engineering consultancy, success hinges on tools that deliver efficiency, reliability, and ease of use. For a solopreneur navigating the complexities of building end-to-end data solutions, Mage has proven to be the game-changer. 🧙

Full story: https://www.mage.ai/blog/legends-of-mage-user-success-stories

12/07/2023

🚨 Enter another world with The Boy and Heron release 0.9.48 🦤
⭐ Incremental data integration in batch pipelines
⭐ RabbitMQ streaming destination
⭐ Chroma integration
⭐ Bookmark overrides
⭐ SQL Block environment variable interpolation
⭐ Additional upstream dependencies for dynamic children
⭐ Support caching block output in memory
🐛 Bug fixes & more!

Details: https://github.com/mage-ai/mage-ai/releases/tag/0.9.48

11/22/2023

🚨 When you wish upon a star. Wish release 0.9.46 💫🐐
⚡️ Spark UI/UX 2.0 for AWS EMR
🌊 Streaming: ActiveMQ source
📁 Download Files & Pipelines via the UI
✨ Streaming: NATS JetStream source
🎏 Data integration: Kafka destination
🛟 Auto-save triggers in code
🐛 Bug fixes & more!

Details: https://github.com/mage-ai/mage-ai/releases/tag/0.9.46

11/21/2023

🎉 We've hit 1 million downloads! 🚀

A huge THANK YOU to our amazing community for making this milestone possible! 🙏

Here's to the next million and many more magical moments together! ✨