Candidate's About
With 5 years of experience, I specialize in building robust big data pipelines, ingesting data from diverse sources like APIs, Mainframes, and RDBMS. Proficient in Hadoop ecosystem tools, AWS services, Python, SQL, and more, I enable efficient data engineering, streaming ingestion, and real-time/batch integration for valuable insights.
Work & Experience
SSenior Technology Consultant
Dec 21 - PRESENT
- Provide strategic technology consulting services to clients, focusing on digital transformation and technology innovation.
- Collaborate with client stakeholders to understand their business objectives and identify technology solutions to meet their needs.
- Conduct technology assessments and evaluations to identify gaps, risks, and opportunities for improvement.
- ...
Read More DData Engineer
Jul 20 - Dec 21
- Worked as part of the GDIA team, responsible for ingesting data from various sources into the Hadoop ecosystem for downstream teams.
- Utilized data ingestion tools such as Attinuity (QLIK) to extract, transform, and load data from different sources into the Hadoop ecosystem.
- Developed a Data Reconciliation framework using Pyspark to ensure the accuracy and integrity of data ...
Read More SSoftware Engineer
Mar 18 - Jul 20
- Was Part of the data migration team which aimed at creating new data repository for Payment Ruled Database. It involves Ingestion of data from MySQL source (existing database) into Hadoop Ecosystem using Sqoop
- Worked in data transformation team applying Business logic in HIVE tables using Spark SQL in Python language as per the client requirement.
- Created Data Pipeline to i...
Read More Education
BBTech
Bansal Institute of Science and Technology2013 - 2017