Data Engineer @PwC 🇩🇪 Building in public 👩‍💻 SQL • Python • AWS • Data Engineering Experiments, lessons, interview prep & tech thoughts

As a Data Engineer in Germany 🇩🇪 one thing I learned: companies care more about what you can BUILD than what you can list on a CV. If you’re serious about Data Engineering, build these 5 projects: Batch ETL Pipeline Real-time Kafka Pipeline Spark Data Processing Project Cloud Data Warehouse End-to-end Analytics Pipeline 5 strong projects > 50 certificates.
41
69
686
35,529
KOMAL👩‍💻 retweeted
CODING IS NO LONGER THE HARDEST PART OF SOFTWARE. So should coding interviews still decide who gets hired?
11
19
763
KOMAL👩‍💻 retweeted
I'm so mature that I can watch an entire movie without checking my phone… once.
35
75
152
1,606
Which AI feature changed everything?
6
6
394
KOMAL👩‍💻 retweeted
THE DATABASE CPU IS 12%. One query still takes 18 seconds. More powerful hardware won’t necessarily help. What would you check next?
7
1
10
1,194
KOMAL👩‍💻 retweeted
EVERYONE WANTS AN AI AGENT. What’s one task you would never let an agent handle alone?
18
2
22
878
KOMAL👩‍💻 retweeted
THE INTERNET GAVE US UNLIMITED INFORMATION. Why is finding the truth getting harder?
12
4
15
744
AI agents don’t just answer questions. They can choose tools and take actions. Is this bigger than the chatbot revolution?
2
1
5
359
KOMAL👩‍💻 retweeted
CHATGPT CAN ANSWER ALMOST ANY QUESTION. What do you still open Google for?
11
2
9
1,527
KOMAL👩‍💻 retweeted
Interviewer: AI generated a SQL query that is correct but extremely expensive. How would you optimize it without changing the result?
9
4
34
4,058
A simple AWS Data Engineering architecture: API / Database ↓ S3 ↓ Glue ↓ Athena / Redshift ↓ BI Now make it production-ready: → IAM permissions → Data quality checks → Partitioning → Incremental loads → Monitoring → Retry handling → Cost optimization Anyone can draw boxes. The engineering is in what happens when those boxes fail.
2
17
550
Interviewer: A SQL query returns correct results in isolation but wrong results under concurrent transactions. What would you investigate first?
7
2
18
1,223
ONE PERSON WITH AI CAN NOW DO MUCH MORE. Will teams become smaller or expectations become bigger?
7
6
785
AI knows what you ask. Social media knows what you watch. Who knows you better?
13
1
14
713
KOMAL👩‍💻 retweeted
ONE TRANSACTION LASTS 3 MINUTES. It spends only 200ms executing SQL. The connection stays open the entire time. What problems can this create?
12
3
19
945