Automating data migrations and critical data engineering workflows to help data teams ship high-quality pipelines faster and more confidently.
- Tweets 337
- Following 89
- Followers 1,096
- Likes 283
Our team had the pleasure of speaking to seven leading data practitioners about their data migration experiences—the good, the bad, and the ugly.
Learn about their strategical and technical best practices for faster, less stressful data migrations 👇
get.datafold.com/x-dms-ryan
1
93
Every data migration has a hero…or a villain 👀
🏆 We talked to practitioners across the industry to learn from real-world successes (& disasters) in The Data Migration Universe—best practices, hard lessons & a readiness check.
get.datafold.com/x-dms
1
47
🦸♂️ Not all data engineers wear cape, but they should.
Migrations are high-stakes, high-risk, & full of villains (👋 misaligned timelines).
Enter The Data Migration Universe for real stories, best practices & a readiness check. Are you migration-ready?
get.datafold.com/x-dms
ALT The Data Migration Universe
2
61
Data-driven design… in cookie form! 🖤🍪 Our team's holiday baking activity was the perfect mix of innovation and fun with the Datafold logo as a 3D-printed cookie cutter!
2
152
We’ve heard the challenges data teams face—ensuring data integrity amidst scaling pipelines & growing complexity.
Today, we’re taking a big step to address those pains.
Introducing Monitors in Datafold: Data monitoring that starts upstream.
get.datafold.com/monitors-bl…
1
4
13
3,595
Ensuring high data quality during data deployment is crucial as it sets the foundation for downstream applications.
There are 4 common ways that practitioners have approached data quality testing during this stage. Learn more on how they rank:
datafold.com/data-quality-gu…
119
Getting data testing right is a moving target. Codebases grow in complexity over time, code diffs just don’t show the impact, and there are too many “unknown unknowns” that can’t be accounted for in custom tests.
1
1
166
☎ Calling all friends on GCP: Datafold is now available on Google Cloud Marketplace!
datafold.com/blog/datafold-i…
2
115
With workflows that make sense, checklists against errors, and an automated data quality system orchestrating everything, sit back and watch your developer velocity increase without sacrificing data quality:
1
53
A proactive data quality strategy is governed by 3 key principles:
1. Shifting data testing to the left: Test early and often during the development cycle.
1
21
#dbt v1.8 is out with new unit testing for dbt projects! Learn from @glebmm about its benefits over traditional assertion tests, when to use it, & implementation tips.
datafold.com/blog/dbt-unit-t…
237
It's been a busy month at Datafold! Check out some of our newest product updates, including:
- The new @dremio 🐬 integration in Datafold Cloud
- Sampling 👪 for cross-database diffs
- Consolidated Impact Preview 👀
datafold.com/changelog?utm_s…
1
3
504
🎉 Big news! Datafold + @dremio are teaming up to supercharge your data workflows! 🎉
🚀 Speed up your move to a modern lakehouse with cross-database diffing
🪴 Enhance your dbt project’s data quality with CI testing
🔗 get.datafold.com/dremio-twit…
1
5
458
It's January, which means: New Year, New Skills.
Join Datafold CEO @glebmm on Feb. 7th at @LindsayMurphy4 's Advanced dbt course where he'll cover #dbt testing best practices 💥
PS — Check the 🧵for a discount code to the course!
1
1
124
Announcing Datafold's new code repository integrations with Azure DevOps + Bitbucket, so you can run automatic data diffs for your dbt code changes—wherever your git repo is hosted.
get.datafold.com/ado-bitbuck…
73
2. Tableau assets that are potentially impacted by your dbt/transformation code changes are now visible in the Datafold CI comment.
Never let bad code and data into your prod database—or BI tool—again.
1
1
158
1. Tableau assets are now visible in Datafold Cloud's column-level lineage explorer.
From raw source data to BI dashboard—access greater visibility (& granularity) into how your data moves its way through your stack & bring order to your Tableau project.
1
1
174
Heeeey #dbtCoalesce London! Not too late to stop by the Datafold booth to talk all things data quality and data diffing 💥
3
336
It’s not too late—join us today at 10am PST / 1pm EST for our Datafold Cloud Demo Day! 💫💫
Register here 👉 bit.ly/3EVqYmc
Hope to see you 🔜!
176
That's right—we're back at #dbtCoalesce this year.
Come take a peek at what our team is looking forward to learning + experiencing at the conference for analytics engineers.
We can't wait to see y'all IRL again.
datafold.com/blog/coalesce-2…
3
783
Exciting news! Join us on Thursday, October 5th for our Datafold Cloud Demo Day 💃🕺
Discover how automated data testing can revolutionize your development, deployment, migration, and replication workflows 🤯
Register now 👉 bit.ly/3EVqYmc
#DatafoldCloudDemoDay
188
Why are data migrations a "draw 25" every time? We're talking common data migration challenges—and how Datafold's data diffing is filling some of those gaps—in our newest blog post.
datafold.com/blog/data-migra…
1
2
1,141
How has your week been? Any data issues arise? Wish you could’ve caught them before you shipped to production? 😭
You coulda…shoulda used Data Diff — but it’s not too late 🤓
Checkout our live Datafold Cloud Demo Day next week!
Register here: bit.ly/3EVqYmc
👋
1
127
@dbt_labs Coalesce 2023 is in a few weeks! Will you be there?
Whether you’ll be catching some surf in San Diego🌅, or have a London Calling🇬🇧 — we’ll be at both with some special guests!
🗓️Register here: bit.ly/46dZe8I
👋 Hope to see you there!
1
62
When was the last time you or your team accidentally shipped bad code? Frustrating right?😤
Join us on Thursday, October 5th for our Cloud Demo Day to discover the power of Data Diff through automating data testing across your workflows💪
Register here: bit.ly/3EVqYmc
140
Hello #BigDataLDN Day 2! 💂♂️ 🇬🇧
At Stand 552, Graham & Leo are having a lil debate over:
- The best pub in London?
- Manchester City vs Manchester United?
- Camden Market vs. Shoreditch?
Come join our chats! Oh, also: let’s talk about your data quality pains. 🫣
3
276
You asked, we listened.
Check out the new + improved Datafold Cloud CI printout: allowing you to find the differences that matter. Immediately.
Read the newest changelog for more details + product updates 👇
shorturl.at/vDI13
97
It’s Big Data London Day 1 — and we’re hyped to be here 😎 💂♂️
Graham and @leoebfolsom are here at Stand #552 ready to talk about:
😣 Your data quality pains
👨👩👧 How the data community has helped your team
❓Would you like free t-shirts or free drinks?
1
3
602
When was the last time you hoped & prayed that a code change wouldn’t adversely impact your data? 🙏
Come tell us at BDL - Stand #552, where we're talking all things data horror stories, and offering beverages plus a solution 😎🇬🇧
Registration is free 🎟️ bit.ly/3RgD4Op
144
If this is meme hits a little too close to home, let's talk about how Datafold is changing the way data teams test their data—and find data quality issues before they happen.
rb.gy/oqlzo
1
254
Coming to Big Data London on September 20-21? See you there 💯😎
We’ll be at Stand #552
Tickets are FREE - register here 🎟️ bit.ly/3RgD4Op
👋 See you there
#BigDataLDN
2
3
250
Join us live today at 10am PST / 1pm EST for our Datafold Cloud Demo Day 🚀
We'll discuss:
🔍 Data Diff, our CI integration & column-level lineage in action
👀 Our Looker integration
🌉 Real-life examples of Datafold Cloud at scale
Register here 🗓: bit.ly/3PcHiVU
👋
101
Today we're joining the virtual @getdbt Budapest Meetup to chat about all things:
🤓 Data diffing
⏩ Building dbt models with confidence & speed
✅ Validating your development, deployment & migration workflows
Register here 🗓️ bit.ly/3qS08YP
1
6
243
Join us at the next virtual Budapest @getdbt Meetup, where we’ll be talking about:
🤓 Data diffing
⏩ How to build dbt models with confidence & speed
✅ How diffing validates your development, deployment & migration workflows
Registration 👉 bit.ly/3qS08YP
👋
1
156
Do you understand the impact of code changes to your data? Have you wondered how to find data issues before they happen? 😅
Discover how Datafold Cloud enables data teams to implement automated dbt testing on Thursday September 7th 🚀
Register here 🗓️ bit.ly/3PcHiVU
199
ICYMI—we’re back with another live Datafold Cloud Demo ☁️
Come get all the 🫖 on our favorite features:🌳 Column-level lineage
🔢 Value-level diffing
📊 Looker integration
🚄 Deployment testing in CI
See you there! 👇
get.datafold.com/tw-registra…
201
Today is Datafold's Cloud Demo Day ☁ 🔥
Join us live at 10am PST / 1pm EST where our solutions engineers, @leoebfolsom & Sung Won Chung, will go over:
⏬ Value-level data diffing
🔍 Column-level lineage
🌉 CI integration
You can register here 👉 bit.ly/3KFjNSI
2
550
Datafold is all about helping developers put their best foot 🦶 forward, which is why we're excited to announce the Datafold VS Code Extension: bringing robust data quality testing—data diffing—directly in your dev space.
Start diffing with ease today ⤵️
get.datafold.com/blog/announ…
2
12
1,489
Tune in today at 9:00am PST / 12:00pm EST for our virtual Data Quality Meetup on 'Running data migrations for analytics' 💫
🗓 You can register here: app.livestorm.co/datafold/da…
See you soon 👋
1
138
At this week's Data Quality Meetup, @mammothgrowth's CTO Drew Beaupre will take the mic to talk about "Data Migrations: Level up to @getdbt" 🚀
🗓 You can register here: get.datafold.com/tw-registra…
See you soon 👋
1
111
Also joining the Data Quality Meetup next week is Rafay Aleem from @faire_wholesale 🙋♂️
He'll discuss Faire's great migration from Redshift to Snowflake, and how they did it 🚀
🗓 You can register here: get.datafold.com/tw-registra…
See you soon 👋
138
Our second speaker & panelist at next week's Data Quality Meetup is @outoftheverse from @twochairs 🙋♀️
She'll discuss "Migrating Money: A Data Migration Case Study"
🗓 You can register here: get.datafold.com/tw-registra…
See you soon 👋
1
3
278
At next week's Data Quality Meetup, Saurav Ganguli from @fitogramDE will give a lightning talk and panel discussion on "The Migration from
PostgreSQL to BigQuery" ... 👇
🗓 You can register here: get.datafold.com/tw-registra…
See you soon 👋
90
In 2 weeks, we're hosting our next Data Quality Meetup on "Running Data Migrations for Analytics 📈 "
We have some amazing speakers joining us from @fitogramDE , @twochairsMH , @faire_wholesale & @mammothgrowth💫
Register now 🗓 get.datafold.com/tw-registra…
88
How do you approach running data migrations for analytics?
We'll be discussing this at our next Data Quality Meetup 🤓 with @fitogramDE @faire_wholesale @twochairsMH @mammothgrowth
🗓️Register here: get.datafold.com/tw-registra…
105
Our next Data Quality Meetup is all about running data migrations for analytics (e.g. @redshift3d > @Snowflake or stored procedures > @getdbt) 🚀
🗓 Register here: get.datafold.com/tw-registra…
Joining us are speakers from @fitogramDE @faire_wholesale @twochairsMH @mammothgrowth 🌟
94
How do you manage data quality in your @getdbt project today? 🤔🫣 😤😰
We're co-hosting a webinar tomorrow on "Scaling Data Quality: Harnessing Automated Testing in dbt Projects" with @cityblockhealth and @SecodaHQ
🗓️Register here: linkedin.com/events/scalingd…
See you soon👋
1
181
On Tuesday, July 11th next week, join us for an exciting webinar on "Scaling Data Quality: Harnessing Automated Testing in @getdbt projects" 🚀
We'll be joined by @cityblockhealth and @SecodaHQ
You can register here 👉 get.datafold.com/twitter-reg…
See you soon 👋
1
118
Join @leoebfolsom today at 10:00am PST / 1:00pm EST for our bi-weekly virtual lab on automating dbt Labs testing with open source data-diff 🚀
Register here 👉 app.livestorm.co/datafold/vi…
2
128
Data Quality Meetup is back 🚨
Join us on Thursday, July 27 as we discuss running data migrations with some amazing speakers from @fitogramDE, @faire_wholesale, @twochairsMH and @mammothgrowth 🚀
Register here 👉 get.datafold.com/tw-registra…
80
"A hotfix made at 3AM led to our company's dashboards going down for 2 full days" 😡
For those who can't risk data quality, automate your @getdbt testing with open source data-diff
Join @leoebfolsom at our Virtual Lab to get started 🚀
Register here 👉 get.datafold.com/tw-register…
225
Join us on Tuesday, July 11th as we discuss "Scaling Data Quality: Harnessing Automated Testing in @getdbt Labs projects" with Grace Peace from @cityblockhealth, Lindsay Murphy from @CoRise & @SecodaHQ and our CEO @glebmm 🚀
🗓 👉 Register here: get.datafold.com/twitter-reg…
93
Confident your code change didn't impact the data? 🤔
Join our Virtual Lab today to understand how open source data-diff can proactively visualize & quantify the difference between any two tables in your database 😎
Register here 👉 get.datafold.com/tw-virtual-…
1
120