Lead complex data migrations as a Senior Data Bricks, Scala, and Spark Engineering Specialist in Montreal, QC. This hands-on contract role focuses on modernizing legacy reporting pipelines using Databricks and Snowflake.
In this 12-month contract, you will be responsible for designing and implementing production pipelines under strict compliance requirements. Your expertise in Scala, Spark, Databricks, and SQL will be crucial for ensuring seamless data flows. You will also leverage Azure and orchestration tools to build reliable data engineering solutions.
Key Responsibilities:
• Design and implement regulatory reporting pipelines
• Develop Spark applications in Scala to enhance performance
• Write and analyze complex SQL scripts for data extraction
• Manage Databricks features for cloud efficiency
• Conduct automated parity checks against legacy data
Requirements:
• Proven experience in Scala and Spark application development
• Strong SQL fluency for requ...