Still Struggling with Tech Hiring? Discover Olibr's Solution Now!
Login / RegisterDeveloperClient
Login/Register

Mrutyunjay Nayak

Data Engineer

  • Jajpur, OR
  • 5 years
Notice Period: 30 Days

    Candidate's About

    I am an experienced B.Tech professional with 5.3 years in IT and 3.7 years as a Data Engineer. Strong analytical skills and ability to explain motivations to team members. In-depth knowledge of SDLC. Experienced in Big Data solutions using Hadoop ecosystem (HDFS, Hive, Scala, Spark, PySpark, SQL). Comfortable working in a team and adapting to changing technical environments.

    Work & Experience

    D

    Data Engineer

    Oct 21 - Jan 23

    Technology

    • Icon
      SQL
    • Icon
      Python Intermediate

    Tools

    • Icon
      AWS-Cloud9
    • Icon
      Linux
    • Icon
      Jira
    • Icon
      Eclipse
    • Designed and implemented data pipelines for various data sources using Apache Spark and Python.
    • Worked with Apache Cassandra and MongoDB for NoSQL databases.
    • Performed data analysis, modeling, and exploration using Apache Spark and SQL.
    • Implemented data quality checks and worked with stakeholders to identify and resolve data quality issues.
    • Collaborated with...
    Read More

    VBP-RM

    Big Data Engineer

    • I was responsible for understanding stored procedures in MYSQL and converting them into Spark Scala code. 
    • I created dataflows by analyzing business logic and orchestrated them based on the frequency of data, executing the batch job monthly.
    • I created User-Defined Functions (UDFs) based on requirements and optimized the queries to save time and cost. 
    • I also defined partitions on file types, which optimized the process of Spark tasks across executors. 
    • I worked on pipeline orchestration on DATA ADVOCATE and provided data to the Superset team for display in the frontend. 
    • I performed transformations and calculations to display the data in the dashboard according to the business needs.
    • Spark
    • Scala
    • Spark-SQL
    • Python
    • AWS
    View Details
    S

    Senior Associate Developer

    Nov 19 - Oct 21

    Technology

    • Icon
      Apache Spark
    • Icon
      Hadoop
    • Icon
      Python
    • Worked on full software development life cycle (SDLC) from requirement gathering to deployment and maintenance
    • Involved in design, development, and implementation of various modules of the project
    • Conducted code reviews, bug fixing, and troubleshooting of the applications
    • Worked on Agile development methodologies
    • Mentored junior developers and provided techn...
    Read More

    DDL (Digitas Data Lake)

    Big Data Engineer

    •  I was responsible for performing import and export of data into HDFS and Hive using Sqoop. 
    • I was also responsible for managing the data within the environment. This involved creating Hive tables, loading data, and writing Hive queries. 
    • I was involved in working on Spark applications to process data sets. 
    • I managed Hive tables by creating child tables based on partitions, and was involved in data analysis, data quality, and data profiling to support the business team. These efforts helped the business team make informed decisions and improved their overall operations.
    • Hadoop
    • HDFS
    • SQL.
    • Scala
    • Spark
    • Sqoop
    View Details
    S

    Software Engineer

    Jul 17 - Sep 19
    • Designed, developed, and maintained software applications for clients using Python and Django framework
    • Worked with clients to gather requirements and provide technical solutions
    • Contributed to the development and implementation of software design patterns and best practices
    • Collaborated with cross-functional teams to troubleshoot and resolve software issues
      • Read More

    UDB(Ultratech Data Bridge)

    Data Engineer

    As a data engineer at UDB, my responsibilities included:

    • Designing and implementing data pipelines
    • Ensuring data quality, and supporting data-related projects. 
    • I utilized various tools such as Sqoop, Hive, and Spark to import and export data into HDFS and Hive. 
    • I was involved in creating Hive tables, loading data, and writing hive queries. 
    • I also managed Hive tables and created child tables based on partitions.
    • I played a crucial role in data analysis, data quality, and data profiling to support the business team. 
    • I was responsible for working on Spark applications to process data sets and helped to optimize query performance to save cost and time. 
    • I was a key player in ensuring data availability, reliability, and scalability for the organization.
    • SQL
    • Mysql
    • Sqoop
    • HBase
    • Hive
    • HDFS
    • Hadoop
    View Details

    Education

    S

    Bachelor of Engineering

    Silicon Institute of Technology
    2011 - 2015