RESPONSIBILITY
. Design, develop and deploy data tables, views and marts in data warehouses, operational data store, data lake and data virtualization.
. Perform data extraction, cleaning, transformation, and flow. Web scraping may be also a part of the work scope in data extraction.
. Design, build, launch and maintain efficient and reliable large-scale batch and real-time data pipelines with data processing frameworks.
. Integrate and collate data silos in a manner which is both scalable and compliant.
. Collaborate with Project Manager, Data Architect, Business Analysts, Frontend Developers, Designers and Data Analyst to build scalable data driven products.
. Be responsible for developing backend APIs & working on databases to support the applications.
. Work in an Agile Environment that practices Continuous Integration and Delivery.
. Work closely with fellow developers through pair programming and code review process
REQUIREMENT
Proficient in general ...