Overview

Design and implement data pipelines using GCP services such as Dataflow, Pub/Sub, and BigQuery. Ingest data from various sources, including relational databases, NoSQL databases, and log files. Transform and cleanse data to prepare it for analysis. Create and maintain data lakes and data warehouses. Develop and implement data curation processes to ensure data quality. Prepare data for analytics and machine learning. Develop and implement semantics layers to provide a consistent view of data.

Responsibilities

• Design and implement data pipelines using GCP services such as Dataflow, Pub/Sub, and BigQuery.
• Ingest data from various sources, including relational databases, NoSQL databases, and log files.
• Transform and cleanse data to prepare it for analysis.
• Create and maintain data lakes and data warehouses.
• Develop and implement data curation processes to ensure data quality.
• Prepare data for analytic...