Position Overview
Job Description
Experience Required - 6+ Years
Must Have Technical/Functional Skills
" Strong hands-on experience in Big Data technologies and distributed data processing frameworks.
" Proficiency in Python for data engineering, scripting, and performance optimization.
" Extensive experience with Apache Spark (PySpark/Spark SQL) for large-scale data transformation and processing.
" Solid experience in designing and developing ETL/ELT pipelines for batch and real-time data processing.
" Experience working with Google Cloud Platform (GCP) services such as BigQuery, Cloud Storage, Dataflow, Dataproc, Composer, and Pub/Sub.
" Strong understanding of data warehousing concepts, dimensional modeling, and data lake architectures.
" Experience with CI/CD pipelin...