Congratulations on the text! Very valuable to me. I have applied much of what you mention in your text to my stack and now I would like to direct efforts to get to know my data in depth and, therefore, I would like to know what profiling/observability tool you suggest that you have already used for BigQuery? Have you already used something that is not from GCP itself?
I am glad you found my article helpful! For BigQuery, I used native observability options such as the Execution Plan, Execution Details, and Monitoring from the Administration panel. I also leveraged INFORMATION_SCHEMA, Cloud Logging, and Cloud Monitoring. I worked with Redshift for six months, but the rest of my career has been tied to BigQuery. 😄 Which cloud data warehouse are you using?
Congratulations on the text! Very valuable to me. I have applied much of what you mention in your text to my stack and now I would like to direct efforts to get to know my data in depth and, therefore, I would like to know what profiling/observability tool you suggest that you have already used for BigQuery? Have you already used something that is not from GCP itself?
I am glad you found my article helpful! For BigQuery, I used native observability options such as the Execution Plan, Execution Details, and Monitoring from the Administration panel. I also leveraged INFORMATION_SCHEMA, Cloud Logging, and Cloud Monitoring. I worked with Redshift for six months, but the rest of my career has been tied to BigQuery. 😄 Which cloud data warehouse are you using?
I use Bigquery too ;)
This is an excellent, informative piece, Vu, thank you!
"Data modeling should be the first-class citizen." - Joe Reis is writing the book on "Practical Data Modeling", https://practicaldatamodeling.substack.com/?utm_source=global-search.