Join Tata Consultancy Services as a Lead Databricks Data Engineer, where you will spearhead data transformation initiatives. This role combines Databricks expertise with finance data modeling in a collaborative hybrid setting.
Your primary focus will be transitioning legacy Cloudera platforms to a cloud-based architecture. You will design enterprise-level data solutions that enhance reporting capabilities while ensuring compliance with data governance standards. Strong mentorship skills are crucial.
Key Responsibilities:
• Design scalable data ingest and transformation workflows
• Implement enterprise data governance and quality frameworks
• Optimize large-scale data pipelines using Delta Lake
• Define business metrics and reporting structures
• Support technical architecture decisions as a leader
Requirements:
• Extensive experience with Databricks and cloud technologies
• Hands-on skills in ELT pipelines and PySpark
• Strong understanding of financial...