Key Responsibilities

• Develop Test Strategy: Create a comprehensive test plan for the Lakehouse, focusing on Data Integrity, Accuracy, and Consistency.
• Automate Validation: Replace manual spot‑checking with automated Python test suites that run as part of the CI/CD pipeline.
• Defect Analysis: Identify and document data anomalies, working closely with Data Engineers to perform root‑cause analysis on Spark job failures.
• Regression Testing: Ensure that new PySpark code deployments do not impact existing Gold layer business logic or dashboard reporting.

Experience Requirements

• Total QA/Testing Experience: 5+ years.
• Data Testing Experience: 3+ years specifically in Big Data, Hadoop, or Cloud Data Warehouse environments.
• Good to have: Databricks Experience: 1+ years of experience testing pipelines within a Databricks environment.

Automation

Focus: Proven track recor...