Data Engineer – SC Cleared

Whitehall Resources are currently looking for a Data Engineer on a remote basis for an initial 5-month contract.

***MUST BE SC CLEARED***

***INSIDE IR35***

Job Spec:

Main responsibilities:

· Data engineering at scale in government or similarly complex domains, including performance tuning and data‑quality management

· Hands‑on expertise in AWS & Spark: Amazon EMR, S3, Lambda; strong PySpark/Python and SQL for large‑scale batch processing.

· CI/CD & DevOps: pipelines and IaC (e.g., Terraform), automated testing, and release governance.

· Version control & collaboration: Git/GitLab, code review, branching strategies, and trunk/PR workflows

· APIs & integration: building/consuming data services to mo...