Discussion: What are your challenges when learning data engineering?

Too may things? "AI can do everything, so I don't learn" or "I don't have big data"

Hi guys,

As you might know, besides writing articles, I also spent time creating tools to make learning data engineering more cost-efficient and fun:

• practice-spark: 65 LeetCode-style problems to practice Spark SQL/DataFrame

• learn-spark/dbt/airflow: CLI tools to master Spark/dbt/Airflow

btw, you need to be paid subscriper to access these tools.

I created these tools based on my own observations.

However, I realized the motivation behind them should come from you guys: the readers of this newsletter :d

So, I want to hear about your challenges.

Feel free to comment on anything that's preventing you from learning data engineering effectively. Here are a few examples to get you thinking:

• I don’t have “big” data

• Too many things to learn

• The platform X is too expensive

• AI can do anything; it demotivates me

• Fake data doesn’t reflect real-world scenarios

• …

Your sharing will help me sharpen the ideas for my next tools.

I don’t promise to solve all your problems with a ton of tools here, but at least I can ensure the next ones could actually solve real problems.

Have a nice weekend.

Vu Trinh