BigData Engineer
Global Infovision Private Limited
Chennai, Tamil Nadu, India
Full-Time
Posted 6 days ago
Chennai, Tamil Nadu, India
Full-Time
Posted 6 days ago
Job Description & Responsibilities
Job Title: BigData Engineer
Job Location: Chennai/Bengaluru
Job Type: Full-Time
Years of experience: 4-10years
Job Description
We are looking for skilled Data Engineers with strong experience in Python, PySpark, SQL, and Big Data technologies to design, develop, and maintain scalable data processing solutions.
The ideal candidate should have hands-on experience working with distributed data processing frameworks, Hadoop ecosystems, data pipelines, and modern data engineering platforms. Candidates with exposure to Kubernetes, CI/CD, REST APIs, and cloud-native data technologies will be preferred.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Python, PySpark, and Spark.
- Work with Big Data technologies, including Hadoop and Hive, for large-scale data processing.
- Develop and optimize SQL queries for data transformation and processing.
- Build and maintain ETL/ELT workflows and data integration pipelines.
- Work with REST APIs and GraphQL for data integration and application connectivity.
- Implement and manage data workflows using Apache Airflow.
- Perform data modelling, data warehousing, and data transformation activities.
- Work with distributed computing frameworks and optimize Spark jobs.
- Collaborate with DevOps teams for deployment, containerization, and CI/CD implementation.
- Ensure data quality, reliability, scalability, and performance across data platforms.
Mandatory Skills
- Strong programming experience in Python or Java or Scala.
- Hands-on experience with Apache Spark / PySpark.
- Strong understanding of Big Data technologies – Hadoop and Hive.
- Good knowledge of SQL and database concepts.
- Experience in building and maintaining data processing pipelines.
- Understanding of REST API integration.
- Exposure to Kubernetes, Docker, and CI/CD practices.
Good-to-Have Skills
- Apache Airflow.
- Apache Iceberg.
- REST APIs and GraphQL.
- Data Warehousing and Data Modelling.
- Kubernetes and CI/CD implementation.
- Apache Ranger and Trino.
- RDBMS concepts.
- Exposure to SAP FSDM / FPSL.
- Experience with distributed data processing and modern Big Data architectures.
About Global Infovision Private Limited
Required Skills
PythonJavaDockerKubernetesSQLCI/CDSAP
Job Details
Employment TypeFull-Time
Work ModeOn-Site
Experience4 – 10 years
Positions1
Posted by
N/A
Posted on:
11 Nov 2026
About Global Infovision Private Limited
More open roles
- Reliability Engineer - Python, AWS, Kubernetes, LinuxQuest Global · Bengaluru, Karnataka, India
- Senior Automation Engineer - Incident, Infrastructure, PythonREIS Staffing & HR Services Pvt Ltd · India
- Staff Engineer (L1, L2, L3 Testing, NOS/SDK testing, Python Automation)Marvell Technology · Bengaluru, Karnataka, India
- AI ML Engineer - Machine Learning, Artificial Intelligence, PythonMEEDEN LABS PRIVATE LIMITED · Hyderabad, Telangana, India
- Senior Engineer, Platform Engineering ( Genesys Cloud, CI/CD, Python OR Node.js)Genesys · Bengaluru, Karnataka, India
- Specialist - PythonLinedata · India