Why did Databricks build the Photon engine?

The Lakehouse, the motivation, and the difference between Photon and the existing engine.

My name is Vu Trinh, and I am a data engineer.

I’m trying to make my life less dull by spending time learning and researching “how it works“ in the data engineering field.

Here is a place where I share everything I’ve learned.

Not subscribe yet? Here you go:

Image created by the author.