Job Description
- Azure Data Engineer, will be responsible for expanding and optimizing's data and pipeline architectures, and for optimizing's data collection and flow across functional teams.
- Your responsibilities include assisting software developers, database architects, data analysts, and data scientists with data initiatives and ensuring a consistent data delivery architecture is put in place throughout ongoing projects.
Job Responsibilities
- Ensure data is cleansed, mapped, transformed, and optimized for storage and use
- Develop and maintain innovative Azure solutions
- Design solutions using Microsoft Azure services and other tools
- Automate tasks and deploy production-standard code with unit testing, continuous integration, versioning, etc.
- Load transformed data into various storage and reporting structures
- Build data pipelines to consolidate data
- Extract data, troubleshoot, and maintain data warehouse
- Tech Stack
- Python
- SQL and NoSQL databases
- Scala
- Spark-SQL
- Experience with Azure services: ADLS, Databricks, Stream Analytics, SQL DW, Cosmos DB, Analysis Services, Azure Functions, Serverless Architecture, ARM Templates
Location
Gurgaon, Haryana, India