Data Engineering, ETL, or Data Integration

Job Description: Key Responsibilities

Design, develop, and maintain scalable data ingestion and integration pipelines using Apache NiFi.

Build and optimize ETL workflows for structured and unstructured data from multiple source systems.

Integrate data from various databases, APIs, cloud storage, and enterprise applications.

Develop, optimize, and troubleshoot complex SQL queries, stored procedures, and database objects.

Monitor and optimize NiFi workflows for performance, scalability, and reliability.

Follow best practices for security, version control, documentation, and deployment.

Required Skills

5 7 years of experience in Data Engineering, ETL, or Data Integration.

Strong hands-on experience with Apache NiFi.

Excellent SQL programming and query optimization skills.

Strong understanding of ETL concepts and data integration methodologies.

Good knowledge of Data Warehousing concepts including dimensional modeling, star schema, and snowflake schema.

Hands-on experience with Snowflake.

Strong experience working with Oracle databases.

Experience with AWS cloud services (S3, EC2, Lambda, Glue, IAM, CloudWatch, etc.).

Preferred Skills

Experience with Apache Kafka or other streaming platforms.

Knowledge of Python, Shell scripting, or Java.

Experience with CI/CD pipelines.

Familiarity with Agile/Scrum methodologies.