Job Overview
We’re looking for a senior data engineer to lead the development of our Databricks-based data warehouse for investment data at ZIAG. You will design scalable architectures, build and maintain ETL pipelines, collaborate with data scientists, and ensure data quality and compliance.
Responsibilities
- Lead the technical development and continuous improvement of our Databricks-based data warehouse and data management platform.
- Design and build robust, scalable data architectures.
- Create and maintain automated ETL/ELT pipelines to ensure seamless data integration from diverse internal and external sources.
- Monitor system performance, proactively identifying and resolving bottlenecks to drive performance and optimize costs.
- Collaborate closely with data scientists and analysts across ZIAG to enable advanced analytics, reporting, and AI/ML initiatives.
- Implement and uphold strong data access c...