Job Description

KPI Partners is seeking a skilled Azure Data Engineer to join our dynamic team. In this role, you will be responsible for designing and implementing data solutions that leverage Azure technologies. You will work collaboratively with data scientists, analysts, and other stakeholders to develop scalable data pipelines, ensuring the integrity and availability of data for analysis and decision-making.

Key Responsibilities:

- Design, build, and maintain data pipelines and ETL processes using Azure services.

- Utilize SQL, Python, and Pyspark for data processing and transformation tasks.

- Implement data storage solutions using Azure Fabric and ensure efficient data retrieval.

- Collaborate with cross-functional teams to gather requirements and translate them into technical specifications.

- Optimize data workflows to enhance performance and scalability.

- Monitor and troubleshoot data pipeline issues, prov...