Introduction to Data Engineering on Google Cloud
This 1-day course is an introduction to data engineering on Google Cloud.
Introduction to Data Engineering on Google Cloud explains the role and responsibilities of a data engineer and how they map to Google Cloud offerings, and shows ways to address typical data engineering challenges. Over six modules you will look at data sources and sinks, data formats, storage, metadata management and dataset sharing with Analytics Hub, followed by replication and migration, including the gcloud tool, Storage Transfer Service, Transfer Appliance and Datastream.
The course then covers how to create and deploy data pipelines of varying patterns and how to apply automation techniques on Google Cloud. The format combines videos, classroom activities, quizzes and seven hands-on labs, such as loading data into BigQuery and replicating PostgreSQL data with Datastream.
The course is aimed at data engineers, database administrators and system administrators. Participants should have prior fundamental-level Google Cloud experience with Cloud Shell and the console, basic SQL, experience with data modeling and ETL, and experience developing applications in a language such as Python. Detailed pipeline development, metadata management tools and automation practices are not covered in depth.