Launch into a dynamic role as a Data Engineer with a strong focus on Azure technologies such as Databricks and Azure SQL. This position demands expertise in data processing and warehouse solutions.
As part of the team, you will engage with Azure services including Data Factory and ADLS, leveraging your experience in PySpark and Delta Lake. You will tackle pipeline issues, optimize performance, and ensure efficient data ingestion patterns using established CI/CD practices with Azure DevOps.
Key Responsibilities:
• Develop data solutions using Databricks notebooks
• Implement ETL/ELT processes in Azure environments
• Resolve pipeline failures and performance bottlenecks
• Monitor data workflows with LOG Analytics
• Utilize Git version control in collaborative projects
Requirements:
• Advanced knowledge of Azure Data Factory and Azure SQL
• Practical familiarity with PySpark and Spark SQL
• Understanding of data warehousing concepts
• Experience with tr...