Y42

27/02/2024

𝐖𝐞'𝐫𝐞 𝐞𝐱𝐜𝐢𝐭𝐞𝐝 𝐭𝐨 𝐮𝐧𝐯𝐞𝐢𝐥 "𝐏𝐲𝐭𝐡𝐨𝐧 𝐈𝐧𝐠𝐞𝐬𝐭”, 𝐨𝐮𝐫 𝐥𝐚𝐭𝐞𝐬𝐭 𝐢𝐧𝐧𝐨𝐯𝐚𝐭𝐢𝐨𝐧 𝐝𝐞𝐬𝐢𝐠𝐧𝐞𝐝 𝐭𝐨 𝐞𝐧𝐡𝐚𝐧𝐜𝐞 𝐝𝐚𝐭𝐚 𝐢𝐧𝐠𝐞𝐬𝐭𝐢𝐨𝐧 𝐩𝐫𝐨𝐜𝐞𝐬𝐬𝐞𝐬.

With Python Ingest, you can:
🚀 implement custom ingestion logic,
🚀 remove boilerplate code to load data into your data warehouse, and
🚀 get standardized metadata, lineage, and documentation out of the box.

Read on in our announcement post:

While writing Python scripts locally to extract data might seem like a breeze, deploying, managing security, dependencies and infrastructure are not.

18/01/2024

As we embrace the challenges and opportunities of 2024, it's crucial to stay ahead in the data world. We sat together with Madison Schott to discuss key industry trends and make 5 data predictions for 2024. 🔮

Read on in our blog post: https://www.y42.com/blog/5-data-predictions-for-2024

30/11/2023

Every time you transform data, alter your schema, or updates happen upstream you are manipulating the state of the data asset. Thus, software engineers constantly aim to limit its side effects to reduce complexity. In the data space, managing state is not just unavoidable—it's the primary means to understanding the ever-changing world. Nevertheless, no mechanism has emerged to be the standard (and convenient) way to tackle this. Until today.

Today, we're introducing a new stateful and declarative approach to building data pipelines where practitioners focus on defining the desired end state of their pipelines, rather than individual steps to achieve it. This makes your code base more auditable, simpe, and standardized.

We have engineered a way to preserve every interaction with the data asset – be that when the asset moves through its lifecycle, new transformations are applied, new data comes in, or policy changes. By preserving the state of the data warehouse in sync with the codebase changes, you get full traceability of your data pipelines, and can instantly revert or deploy changes to production - with zero compute cost (by reusing assets at specific points in time).

Read on to dive deep into stateful declarative data pipelines:

With Y42, you only need to define the end state of your pipelines. Our system preserves every data asset interaction, from the development lifecycle transitions to data ransformations and policy updates. This sync between the data warehouse and the codebase ensures complete traceability and allows f...

28/11/2023

𝐁𝐞𝐬𝐭 𝐩𝐫𝐚𝐜𝐭𝐢𝐜𝐞𝐬 𝐟𝐨𝐫 𝐰𝐨𝐫𝐤𝐢𝐧𝐠 𝐰𝐢𝐭𝐡 𝐝𝐛𝐭 𝐚𝐧𝐝 𝐁𝐢𝐠𝐐𝐮𝐞𝐫𝐲 ⬢

Are you in the process of implementing a data warehouse like Google's BigQuery and dipping your toes into building data models with dbt Labs?

Hear from a practitioner who has worked with both tools and learn a few tricks that help you get the most out of both tools. We’ll discuss how to save valuable resources with specific BigQuery functions, clustering your tables, and choosing the right materialization strategy.

Read on here: https://lnkd.in/gW8CDyct

One of the benefits of dbt is the ability to harness BigQuery’s specific functionalities like timeouts, sample functions, partitioning, and clustering directly within your transformations.

27/03/2023

📖 Meet Giang, Customer Success & Support Manager at Y42. This is his story:

🇻🇳 Not long before I was born, my parents came to Germany from Vietnam. Until I was eight years old, we actually lived in an asylum (a so-called Asylheim). Munich was my home until I was 25.

🏫 I had a great childhood. I never lacked anything, but I was quite the rebel and didn’t have the best grades. However, through hard work, I moved up in school over time.

📊 When I finished high school, I enrolled to study economics and got a part-time job. Since I was living at home at the time, I could use the money I worked for to travel, and I really enjoyed the student life.

🧭 After graduating, I thought about doing a masters in Amsterdam. But, when I joined an ecommerce company in Berlin as an intern, I decided to move there instead.

☎️ At one point, Hung, who I’d met at university, called me up to talk about this new company he was starting. After a few meetups, I decided to join him, and I’m glad I did.

🙌 What I appreciate most at Y42 is the openness and honesty. We can’t solve issues if we don’t talk about them, and doing exactly that brings a lot of value to the job.

🛤️ Over the years, I learned that there’s no need to conform. I used to think I had to work as a banker or consultant because I studied economics. But in reality, you need to create your own path.

🚀 I’d also say that timing, dedication, diligence, and the right amount of luck are crucial for seizing opportunities, even if others are smarter than you.

➡️ Are you eager to create your own path? Check out who we are and what we stand for: https://hubs.li/Q01Jb27r0

of Y42

10/03/2023

📖 Meet Arpine, Senior Performance Marketing Manager at Y42. This is her story.

🇦🇲 Before moving to Berlin, I always lived in Yerevan, Armenia. That’s also where I got my master’s degree in business administration

👩‍💻 I worked in several industries, but over the years, I became more and more interested in digital marketing, which is also why I decided to join a startup. Working in a small team, I had the opportunity to learn fast by doing things myself.

🏡 After three years, I decided to make the switch to B2B because it seemed like a challenge I wanted to take. I joined a US-based company and worked fully remote from Armenia for almost six years.

👀 I applied at Y42 mainly out of curiosity — I wanted to learn more about the required skillset. This approach allowed me to stay quite relaxed throughout the application process.

🧳 When I eventually received an offer, I needed a couple of days to think about my options. Even though moving was something I always considered, Berlin was never on my list of places I wanted to move to.

🚀 Thinking it through, though, I realized I would probably regret it if I didn’t take this opportunity. It was a big decision, but I’m very happy about it. I moved almost immediately.

🇩🇪 For me, Berlin has proven to be a great city to navigate. Of course, I had to deal with some bureaucracy and finding an apartment was a challenge, but I like the city’s diversity and overall calm vibe.

🕯 Soon, it will be one year since I joined Y42, and honestly, that seems almost unbelievable. I guess all the changes that happened over the past months really made time fly by.

💆‍♀️ My main takeaway from this experience is that it always pays off to do big changes, even though it might seem scary at times. It’s true that adapting to a new life can be challenging, but stay patient with yourself.

🙌 I hope this inspires other people to make bold changes to their lives, even if these changes feel daunting at times.

➡️ Curious to learn more about Y42? Check out our team page: https://hubs.li/Q01FCY1q0

15/02/2023

📖 Meet Nic, Account Executive at Y42. This is his story:

🇿🇦 I grew up on South Africa’s East Coast with its relaxed beaches and surf culture. After high school, I decided to take a gap year to make up my mind about what I wanted to do.

🎓 My goal was to do something that would positively impact the world — something I loved. I majored in English and politics and did an honors degree in journalism.

✍️ I was very passionate about writing and I started doing internships while I studied. With time, the “battle for attention” and clickbait altered the world of journalism around me, which is why I decided to change course.

💼 I had to rethink what I was going to do, but I still had the same interests. I got the chance to start a scholarship in Belgium, studying international governance and development.

🇨🇬 This experience was eye-opening to me. It led me to an internship for WHO in Geneva, Switzerland, and Brazzaville, Congo, where I was part of the Strategic Planning Unit.

🇩🇪 At that point, I had been in a long-distance relationship for four years with my partner. We decided to get married and move to Berlin. I joined a health tech startup as a partnerships manager, focusing on B2B.

🐍 When the pandemic hit, instead of baking banana bread, I went deep into data. I was studying all the time, learning Python, cloud computing, and SQL. I wanted to be able to work more independently with data.

🚀 Having learned all these things, I decided to apply to Y42. They told me about this new and exciting opportunity, and that’s how I joined this rocket ship as an account executive.

🙌 What I have found here is a place to grow and learn. Performance is key, which is why I appreciate that we define ourselves as a sports team rather than a family. The talent is mind-blowing — I’m always impressed by the people I work with.

🧭 Looking back, one thing I learned is that change is constant and ever-present, both around us and within ourselves. The only things we can control are the values we live by, but they can also change. That’s why I believe if you know who you are and live in the present, life will always be gracious to you.

🗺 I tend to think that the four agreements (by Don Miguel Ruiz) can genuinely help you feel fulfilled: 1. Be impeccable with your word, 2. Don’t take anything personally, 3. Don’t make assumptions, and 4. Always do your best.

➡️ Curious to learn more about Y42? Check out our team page: https://www.y42.com/team/

10/02/2023

Here are 3 steps to follow if you want to implement within your organization.👇🏼

1️⃣ Get an overview of all your data assets by making an inventory
2️⃣ Determine domain experts per data asset
3️⃣ Implement a data catalog for better traceability

By implementing data ownership, you’re enabling data governance, easier cross-team collaboration, and accountability.

Do you prioritize clear data ownership? How do you enforce it? 🤔

06/02/2023

👇🏼 This is what you need to do to avoid not knowing when a data model failed. 👇🏼

Test intermediate and core models too! 💡

Analytics engineers tend to leave intermediate models out of the testing process, thinking that only the source data or end model require testing.

But you know what happens when you that? You let errors pass onto your final model and have to check all previous models to identify the culprit. 🫠

❌ This process wastes time, energy, and precious resources.

✅ So do yourself a favor, and make debugging less of a hassle by keeping and eye out on your intermediate data models too.

01/02/2023

Want to make sure your organization’s data is of high quality throughout its lifecycle?

Want to ensure this high-quality data is available, accessible, and usable by those who need it?

Then you need to have processes and technologies in place that will facilitate , as well assigned owners.

The combination of rules, processes, and policies that dictate your are known as a data governance framework.

There are 3 main types of governance frameworks:
✅ Command and control framework
✅ Traditional framework
✅ Non-invasive framework

Which one should you choose? That will depend on your company goals and team structure.

👇🏼 Check out the slides below to learn more. 👇🏼