Data Engineer - Vertica Database Specialist

Job Description

Job Summary

We are seeking an experienced Data Engineer with proven expertise in Vertica Database functionalities to design, develop, and optimize scalable data solutions. The ideal candidate will have a strong background in SQL, ETL processes, and data modelling, along with hands-on experience in managing large datasets and ensuring high-performance data systems.

Key Responsibilities

Design, implement, and maintain Vertica-based data solutions, ensuring scalability, reliability, and performance.

Develop and optimize ETL pipelines to integrate structured and unstructured data from multiple sources into Vertica.

Perform data modelling, schema design, and database optimization aligned with business requirements.

Conduct performance tuning, indexing, and query optimization for large-scale Vertica databases.

Collaborate with cross-functional teams including Data Analysts, Data Scientists, and Business Teams to deliver efficient data solutions.

Implement data quality checks, validation processes, and automation scripts for seamless data flow.

Manage and monitor data ingestion processes, ensuring consistency, integrity, and availability of data.

Document system processes, data models, and architecture diagrams.

Stay updated with emerging trends in big data, data warehousing, and cloud-based data solutions.

Technical Competencies

Bachelor's degree in Computer Science, Information Technology, or a related field.

Minimum 4+ years of experience as a Data Engineer or in a similar data-focused role.

Hands-on expertise in Vertica Database - data design, modelling, optimization, and performance tuning.

Strong proficiency in SQL and query optimization techniques.

In-depth understanding of ETL concepts, tools, and data integration workflows.

Experience with data warehousing concepts and best practices.

Familiarity with big data technologies such as Hadoop, Spark, etc.

Exposure to cloud platforms like AWS or Azure is a plus.

Experience with Linux environments and shell scripting for automation tasks.

Strong problem-solving, analytical, and debugging skills.

Excellent communication and teamwork skills.

Self-driven, with the ability to manage multiple projects independently.

Desirable Skills

Certification or advanced training in Vertica, SQL, or Data Engineering tools.

Knowledge of data visualization tools (e.g., Power BI, Tableau) and Python scripting for data manipulation.

Experience working in Agile or DevOps environments.