Data engineer (Azure) – Synapse and Pyspark, Python, Datawarehouse and Azure Data Explorer, Azure Devops
Job Scope
• Design, review and development of Pyspark scripts. Testing, troubleshooting of data pipelines, orchestration.
• Designing and developing reports and dashboards in PowerBI,setting up access control with row level security DAX query experience.
• Establishing connections to source data systems such as on-prem databases, IOT devices, APIs.
• Managing the collected data in appropriate storage/data-base solutions e.g. file systems, S...