Mission Control for Your Data Pipelines

Global
𝐖𝐞'𝐫𝐞 𝐞𝐱𝐜𝐢𝐭𝐞𝐝 𝐭𝐨 𝐮𝐧𝐯𝐞𝐢𝐥 "𝐏𝐲𝐭𝐡𝐨𝐧 𝐈𝐧𝐠𝐞𝐬𝐭”, 𝐨𝐮𝐫 𝐥𝐚𝐭𝐞𝐬𝐭 𝐢𝐧𝐧𝐨𝐯𝐚𝐭𝐢𝐨𝐧 𝐝𝐞𝐬𝐢𝐠𝐧𝐞𝐝 𝐭𝐨 𝐞𝐧𝐡𝐚𝐧𝐜𝐞 𝐝𝐚𝐭𝐚 𝐢𝐧𝐠𝐞𝐬𝐭𝐢𝐨𝐧 𝐩𝐫𝐨𝐜𝐞𝐬𝐬𝐞𝐬. With Python Ingest, you can: 🚀 implement custom ingestion logic, 🚀 remove boilerplate code to load data into your data warehouse, and 🚀 get standardized metadata, lineage, and documentation out of the box. Read on in our announcement post: y42.com/blog/announcing-pyth…
2
1
2
467
As we embrace the challenges and opportunities of 2024, it's crucial to stay ahead in the data world. We sat together with Madison Schott to discuss key industry trends and make 5 data predictions for 2024. 🔮 Read on in our blog post: y42.com/blog/5-data-predicti…
1
433
Sharing some best practices for working with dbt and BigQuery. Hands-on insights from a data practitioner. Discussing relevant BigQuery functions, table partitioning, and materialization strategies. Check it out: y42.com/blog/dbt-bigquery-be…
228
Calling all data enthusiasts! 🧑‍💻 Say hello to Virtual Data Builds by Y42! Unify logical changes via Git, materialize code changes, and handle operational changes in a single structure - environment management for Data simplified! 💜 Detailed announcement in the comments.
1
220
Data teams keep making the same mistakes over and over again. Why is that? 🤔 Here’s our guess: ❌ Lack of reflection and learning ❌ Ineffective collaboration ❌ Inadequate documentation ❌ Failure to adapt to change Learn more here: y42.com/blog/data-team-chall…
215
#Readoftheweek 🤓👇🏼 Poor data quality undermines all the time and effort you put into your work. ❌ Your systems don't matter ❌ How robust your pipelines are doesn't matter Learn more about the importance of #dataquality for #dataengineers here: y42.com/blog/data-quality-fo…
1
230
Want to improve your company's #datagovernance program this year? 👉🏼 Check out our #readoftheweek to learn how you can implement data governance best practices into your day-to-day work: y42.com/blog/data-governance…
157
Thank you to everyone who joined our #webinar with @redsift and @googlecloud on the benefits of automating your data pipelines. 👉🏼 If you missed out on the webinar, you can watch the recording here: y42.com/event/data-operation…
1
135
Part of a data team's responsibility is improving a company's overall #dataliteracy. Start sharing #datacontent with business users, beginner data analysts, or anyone in between. Here's our pick for their perfect #readoftheweek: y42.com/blog/data-pipeline/?…
96
Have we already mentioned that we have a #webinar coming up? 👀 ✅ Learn how to manage increasing data needs and requests. ✅ Learn how to automate your data infrastructure as your company grows. 👉🏼 Sign up here: y42.com/event/event-page-red…
2
133
Discover the power of automated #datapipelines! Join Eliott Sacau (@redsift ), Jelena Mijuskovic (@Google ) and Ba Khai Tran (@y42dotcom ) in our upcoming #webinar! 👉🏼 Sign up here: lnkd.in/eXMaE5Nx
1
126
Here’s a step-by-step guide on how to build production-ready #datapipelines. 👇🏼
1
1
662
Here are 3 steps to follow if you want to implement #dataownership within your organization.👇🏼 1️⃣ Get an overview of all your data assets by making an inventory 2️⃣ Determine domain experts per data asset 3️⃣ Implement a data catalog for better traceability
1
152
👇🏼 This is what you need to do to avoid not knowing when a data model failed. 👇🏼 Test intermediate and core models too! 💡 If you don't, you let errors pass onto your final model and have to check all previous models to identify the culprit. 🫠 #datatesting #datamodeling
1
1
554
Types of #datagovernance frameworks: ✅ Command and control framework ✅ Traditional framework  ✅ Non-invasive framework  Which one should you choose? That will depend on your company goals and team structure.
117
Here are the 6 key benefits of #datamonitoring.👇🏼 1️⃣ Faster debugging and minimized inconsistencies 2️⃣ Increased business efficiency 3️⃣ Stable and standardized data pipeline 4️⃣ Faster retrieval of actionable data 5️⃣ Reduced data preparation time 6️⃣ Cost-effectiveness
111