Senior Engineer-Data Engineer-Data Bricks

Strong experience in ADF( Azure data factory), Azure SQL, Synapse, Spark/Databricks= 5+ YrsExcellent written and verbal communication, intellectual curiosity, a passion to understand and solve problems, consulting & customer serviceStructured and conceptual mindset coupled with strong quantitative and analytical problem-solving aptitudeExceptional interpersonal and collaboration skills within a team environmentPySparkParquet filesBig data and modern data lakeDemonstrable experience in enterprise level data platforms involving implementation of end-to-end data pipelinesHands-on experience with AzureExperience with column-oriented database technologies (e.g., Synapse), NoSQL database technologies (e.g., DynamoDB, Cosmos DB, etc.) and traditional database systems (e.g., SQL Server, Oracle, MySQL)Experience in data pipelines and solutions for both streaming and batch integrations using tools/frameworks like Azure Data Factory, Azure functions and Stream analyticsMetadata definition and management via data catalogs, service catalogs, and stewardship tools such as OpenMetadata, and Azure PurviewTest, plan, creation and test programming using automated testing frameworks, data validation and quality frameworks, and data lineage frameworksData modeling, querying, and optimization for relational, NoSQL, timeseries, graph databases, data warehouses and data lakesData processing programming using SQL, Python, and similar toolsLogical programming in Python, Spark, PySpark, Java, Javascript, and/or ScalaCloud-native data platform design with a focus on streaming and event-driven architecturesParticipate in integrated validation and analysis sessions of components and subsystems on production serversData ingest, validation, and enrichment pipeline design and implementationSDLC optimization across workstreams within a solutionBachelor’s degree in Computer Science, Engineering, or related field

Liquid error: undefined method `public_fields' for nil:NilClass