If you're not doing real-time analytics, it's really hard to sell me on a true ELT (where you consume your transformation as output and you don't store it). The most common reality is ELTL (where you store your transformations so that you don't have to apply them again on the same data, generally).
Moreso this isn't new at all!
The first L is just a choice to have a persistent store. This has been true with mature / large scale data warehousing scenarios on small data (at least a semi-persistent store for enabling audit and troubleshooting when ETLs fail or are returning corrupt or unexpected outputs).
If you don't do the second L (especially in a modern world where you pay for your compute each time you use it) you're just wasting money and time! Dimensional models are the outputs of 90% of the Ts in ELTs and that means you don't have ELT ... You just have ELTL. For the remaining 10% it's probably an OBT output ... But rarely (and I mean rarely) is the transformation the actual output being consumed.
Markitecture (marketing architecture) is a real phenomenon.
Medallion isn't new ... Labels are all that's changed in many situations!
If you're not doing real-time analytics, it's really hard to sell me on a true ELT (where you consume your transformation as output and you don't store it). The most common reality is ELTL (where you store your transformations so that you don't have to apply them again on the same data, generally).
Moreso this isn't new at all!
The first L is just a choice to have a persistent store. This has been true with mature / large scale data warehousing scenarios on small data (at least a semi-persistent store for enabling audit and troubleshooting when ETLs fail or are returning corrupt or unexpected outputs).
If you don't do the second L (especially in a modern world where you pay for your compute each time you use it) you're just wasting money and time! Dimensional models are the outputs of 90% of the Ts in ELTs and that means you don't have ELT ... You just have ELTL. For the remaining 10% it's probably an OBT output ... But rarely (and I mean rarely) is the transformation the actual output being consumed.
Markitecture (marketing architecture) is a real phenomenon.
Medallion isn't new ... Labels are all that's changed in many situations!
Great blog! It really inspires me to get back to building fundamentals