The Opportunity Join the team as a Senior Data Engineer for the bank's flagship risk data and reporting platform. You'll build and optimize data pipelines that process millions of records daily, managing terabytes of data that power critical risk calculations and regulatory reporting across the organization's global operations.
What You'll Do - Design and develop the robust data solutions on SQL Server, ensuring optimal performance through advanced query optimization, indexing strategies, and partition management.
- Design and optimize large-scale ETL pipelines using Apache Spark to process high-volume data from diverse sources across the bank.
- Ensure data quality and reliability across the platform through comprehensive validation frameworks and proactive monitoring.
- Collaborate with analytics teams using SAP BusinessObjects and other systems to deliver regulatory reports and business intelligen...