Lightning Talks
DEVLT-211
•
App Dev, Architecture, Data Analytics, Databases, Serverless
Supercharging ELT on Google Cloud with Dataform, dbt, and Airflow
In this talk, I’ll walk through a real ELT pipeline on Google Cloud using Airflow, Cloud Composer, and Dataform, built with Qatar FIFA World Cup data. I will then implement the same pipeline using dbt Core deployed on Cloud Run Jobs and compare the strengths and trade-offs of both approaches on GCP. The session also covers DevOps automation and ends with a Looker Studio dashboard to showcase the full data stack in action.
Read more