Data Integration with Cloud Data Fusion
In this 2-day course we’re taking a look at data integration on Google Cloud with Cloud Data Fusion.
Data Integration with Cloud Data Fusion starts with the challenges of data integration and the need for a data integration platform, then shows how Cloud Data Fusion helps you bring together data from many sources and formats. You will explore its architecture, core concepts and UI components, and learn how pipelines are represented as directed acyclic graphs and designed in Pipeline Studio. The course covers batch and real-time streaming pipelines with visual design, metadata and data lineage tracking, and deploying pipelines on different execution engines.
Over nine modules and eight labs you will create a Cloud Data Fusion instance, build, deploy and execute pipelines, and handle more complex ones with branching, merging, joins, macros, actions, notifications and error handling. You will use Wrangler for transformations, connectors for different sources and formats, and learn to configure the execution environment and monitor and troubleshoot pipeline runs.
The course is aimed at data engineers and data analysts. Completing Introduction to Data Engineering beforehand is expected.