Job Description & Responsibilities

Azure DevOps: Knowledge of Azure DevOps is valuable for implementing Continuous Integration and Continuous Deployment (CI/CD) pipelines for data engineering solutions
Monitoring and Optimization: Understanding how to monitor the performance of data engineering solutions and optimize them for better efficiency is crucial
Data Quality and Data Cleaning: Knowing how to ensure data quality and perform data cleaning operations to maintain reliable data is important for data engineers.
Data Modeling and ETL/ELT: You should be skilled in data modeling techniques and Extract, Transform, Load (ETL) or Extract, Load, Transform (ELT) processes for data integration.
Good to have Apache Hive: Knowledge of Hive, a data warehousing and SQL-like query language that provides an abstraction over Hadoop MapReduce
Good to have Apache Spark: Understanding of Spark and its various component

Azure Data Engineer|Pune|4+Yrs

Job Description & Responsibilities