Data Engineering with dbt. A practical guide to building a cloud-based, pragmatic, and dependable data platform with SQL

Data Engineering with dbt. A practical guide to building a cloud-based, pragmatic, and dependable data platform with SQL - Opis

dbt Cloud helps professional analytics engineers automate the application of powerful and proven patterns to transform data from ingestion to delivery, enabling real DataOps.This book begins by introducing you to dbt and its role in the data stack, along with how it uses simple SQL to build your data platform, helping you and your team work better together. You’ll find out how to leverage data modeling, data quality, master data management, and more to build a simple-to-understand and future-proof solution. As you advance, you’ll explore the modern data stack, understand how data-related careers are changing, and see how dbt enables this transition into the emerging role of an analytics engineer. The chapters help you build a sample project using the free version of dbt Cloud, Snowflake, and GitHub to create a professional DevOps setup with continuous integration, automated deployment, ELT run, scheduling, and monitoring, solving practical cases you encounter in your daily work.By the end of this dbt book, you’ll be able to build an end-to-end pragmatic data platform by ingesting data exported from your source systems, coding the needed transformations, including master data and the desired business rules, and building well-formed dimensional models or wide tables that’ll enable you to build reports with the BI tool of your choice. Spis treści: 1. Basics of SQL to transform data2. Setting up your dbt Cloud development environment3. Data modelling for data engineering4. Analytics Engineering as the New Core of Data Engineering5. Transforming data with dbt6. Writing (...) więcej Maintainable Code7. Working with Dimensional Data8. Delivering Consistency In Your Code9. Delivering Reliability In Your Data10. Agile development11. Collaboration12. Deployment, Execution and Documentation Automation13. Moving beyond basics14. Enhancing Software Quality15. Patterns for frequent use cases O autorze: Roberto Zagni is a senior leader with extensive hands-on experience in data architecture, software development and agile methodologies. Roberto is an Electronic Engineer by training with a special interest in bringing software engineering best practices to cloud data platforms and growing great teams that enjoy what they do. He has been helping companies to better use their data, and now to transition to cloud based Data Automation with an agile mindset and proper SW engineering tools and processes, aka DataOps. Roberto also coaches data teams hands-on about practical data architecture and the use of patterns, testing, version control and agile collaboration. Since 2019 his go to tools are dbt, dbt Cloud and Snowflake or BigQuery. mniej