DataBricks_ Shailja

Job Description : Data Engineer with Pyspark, Databricks skillset • 8+ years of experience Data Engineering with min 5+ years hands on experience in Pyspark for data transformations.

• Sound Knowledge on - Azure Data Bricks, Azure Data Lake.

Delta

Lake, Azure SQL and Azure blob storage, Azure logic apps, Azure Functions and Azure Synapse, Azure Purview.

• Extensive knowledge on big data concepts like Hive, and spark framework.
• Should be able to write complex SQL queries.
• Sound understanding of DWH concepts.
• Strong hands-on experience on Python or Scala.
• Hands on experience on SSMS tool related concepts such as Index, store procedure and triggers.
• Hands on experience on Azure Data Factory.
• Should be able to coordinate independently with business stake holders and understand the business requirements
• Knowledge on DevOps and Agile methodologies-based projects.
• Knowledge of version control tool such as Git/Bitbucket.
• Should have basic understanding on Batch Account configuration, various control and monitoring options