Home/Job List/BigData Engineer
Global Infovision Private Limited

BigData Engineer

Global Infovision Private Limited

Chennai, Tamil Nadu, India
Full-Time
Posted 6 days ago

Job Description & Responsibilities

Job Title: BigData Engineer

Job Location: Chennai/Bengaluru

Job Type: Full-Time

Years of experience: 4-10years

Job Description

We are looking for skilled Data Engineers with strong experience in Python, PySpark, SQL, and Big Data technologies to design, develop, and maintain scalable data processing solutions.

The ideal candidate should have hands-on experience working with distributed data processing frameworks, Hadoop ecosystems, data pipelines, and modern data engineering platforms. Candidates with exposure to Kubernetes, CI/CD, REST APIs, and cloud-native data technologies will be preferred.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines using Python, PySpark, and Spark.
  • Work with Big Data technologies, including Hadoop and Hive, for large-scale data processing.
  • Develop and optimize SQL queries for data transformation and processing.
  • Build and maintain ETL/ELT workflows and data integration pipelines.
  • Work with REST APIs and GraphQL for data integration and application connectivity.
  • Implement and manage data workflows using Apache Airflow.
  • Perform data modelling, data warehousing, and data transformation activities.
  • Work with distributed computing frameworks and optimize Spark jobs.
  • Collaborate with DevOps teams for deployment, containerization, and CI/CD implementation.
  • Ensure data quality, reliability, scalability, and performance across data platforms.

Mandatory Skills

  • Strong programming experience in Python or Java or Scala.
  • Hands-on experience with Apache Spark / PySpark.
  • Strong understanding of Big Data technologies – Hadoop and Hive.
  • Good knowledge of SQL and database concepts.
  • Experience in building and maintaining data processing pipelines.
  • Understanding of REST API integration.
  • Exposure to Kubernetes, Docker, and CI/CD practices.

Good-to-Have Skills

  • Apache Airflow.
  • Apache Iceberg.
  • REST APIs and GraphQL.
  • Data Warehousing and Data Modelling.
  • Kubernetes and CI/CD implementation.
  • Apache Ranger and Trino.
  • RDBMS concepts.
  • Exposure to SAP FSDM / FPSL.
  • Experience with distributed data processing and modern Big Data architectures.

Required Skills

PythonJavaDockerKubernetesSQLCI/CDSAP

Job Details

Employment TypeFull-Time
Work ModeOn-Site
Experience4 – 10 years
Positions1

Posted by

N/A

Posted on:

11 Nov 2026

About Global Infovision Private Limited

More open roles

Browse all jobs →