Still Struggling with Tech Hiring? Discover Olibr's Solution Now!

DHRUMIL SHAH

senior Data engineer

  • Ahmedabad, GJ
  • 7 years

Available From: Available

    Candidate's About

    Experienced IT professional with 7.2 years of expertise in Data Engineering, specializing in HDFS, Spark, Scala, and Python. Proficient in Airflow and AWS services like S3 and Lambda. Skilled in Hadoop and Spark architectures, performance tuning, and clean code writing. Familiar with deployment pipelines and Kafka. Strong team player with excellent communication skills and a track record of meeting organizational expectations and deadlines. Quick learner, problem-solver, and adaptable to different

    Work & Experience

    K

    Senior Data engineer

    KPI partners
    Jul 22 - PRESENT

    Technology

    • Icon
      Java
    • Icon
      Python
    • Icon
      Kafka
    • Icon
      AWS

    Tools

    • Icon
      Jira
    • Icon
      Visual-Studio
    • Icon
      Linux
    • Develop and maintain data pipelines using HDFS, Spark, Scala, and Python.
    • Optimize data processing performance through caching and broadcast techniques.
    • Collaborate with cross-functional teams to design and implement scalable data solutions.
    • Provide technical guidance and mentorship to junior team members.
    • Ensure timely delivery of high-quality data engineer...
    Read More
    L

    Data Engineer

    L&T InfoTech
    Jun 20 - Jul 22

    Technology

    • Icon
      AWS
    • Icon
      Kafka
    • Icon
      Python
    • Icon
      Java

    Tools

    • Icon
      Jira
    • Icon
      Linux
    • Icon
      Visual-Studio
    • Developed and maintained data pipelines using HDFS, Spark, Scala, and Python.
    • Optimized data processing performance through caching and broadcast techniques.
    • Collaborated with cross-functional teams to design and implement scalable data solutions.
    • Provided technical guidance and mentorship to junior team members.
    • Ensured timely delivery of high-quality data ...
    Read More
    T

    IT Analyst

    TCS
    Jun 18 - May 20

    Technology

    • Icon
      AWS
    • Icon
      Java
    • Icon
      Python
    • Icon
      Kafka

    Tools

    • Icon
      Jira
    • Icon
      Linux
    • Icon
      Visual-Studio
    • Analyzed IT systems, identified areas for improvement, and developed solutions.
    • Assisted in system design, configuration, and implementation.
    • Conducted testing and quality assurance to ensure system functionality.
    • Provided technical support and troubleshooting for end-users.
    • Collaborated with team members and stakeholders to gather requirements and deliver I...
    Read More
    S

    Software Engineer

    Sparsh Technology
    Jul 12 - Feb 15

    Technology

    • Icon
      AWS
    • Icon
      Java
    • Icon
      Kafka
    • Icon
      Python

    Tools

    • Icon
      Jira
    • Icon
      Visual-Studio
    • Icon
      Linux
    • Developed software solutions using various technologies such as Java, Python, and SQL.
    • Participated in the complete software development life cycle, including requirements gathering, design, coding, testing, and deployment.
    • Collaborated with cross-functional teams to deliver high-quality software products.
    • Conducted code reviews and provided technical guidance to ju...
    Read More

    Education

    G

    IT engineering

    Gujarat Technological University
    2008 - 2012