Still Struggling with Hiring? Discover Olibr's Solution Now!

Lead Data Engineer/Manager - AWS|Multiple|6+Yrs

  • HuQuo
  • Multiple
  • 6 - 10 Yrs

Job Description

  • 7-8 Years industry implementation experience with Data Engineering tools.
  • Broad experience of working within AWS and must be capable of working from infrastructure (VPC, EC2, Security groups, S3 etc.) to AWS data platforms (Redshift, RDS, Glue etc). In depth experience of Azure/GCP is also of interest.
  • Experience with database migrations to AWS Cloud
  • Design, deploy and support databases on Ec2, AWS RDS and VMware platform
  • Working Knowledge of infrastructure automation with Terraform.
  • Understanding of source control management and associated tools such as Git.
  • Manage and maintain database systems to ensure optimal performance, reliability, and security.
  • Design, develop, and deploy data pipelines and ETL processes for efficient data ingestion, transformation, and analysis.
  • Collaborate with cross-functional teams to understand data requirements and develop scalable data solutions.
  • Monitor database performance metrics and proactively address any performance or scalability issues.
  • Implement version control for database scripts and configurations using Git.
  • Utilize Jenkins for continuous integration and deployment of database changes.
  • Automate infrastructure provisioning and configuration using Terraform to enhance deployment efficiency.
  • Leverage AWS services such as S3, Lambda, VPC, and Security Groups to support data infrastructure.
  • Provide guidance on database security best practices, including access control and encryption.
  • Stay updated on emerging technologies and industry trends in data engineering and database administration.
  • 3-5 years of management experience required
  • 3-5 years consulting experience preferred
  • Bachelor's degree or equivalent experience, master's degree Preferred
  • Strong data warehousing, OLTP systems, data integration and SDLC
  • Understanding and experience with major Data Architecture philosophies (Dimensional, ODS, Data Vault, etc.)
  • Understanding of modern data warehouse capabilities and technologies such as real-time, cloud, Big Data.
  • Understanding of on premises and cloud infrastructure architectures (e.g. AWS, Azure, GCP)



Job Responsibilities

  • Should possess hands-on experience in working on some of the relational and non-relational databases (Oracle/SQL Server/DB2/PostgreSQL/MySQL/Golden Gate/Data Guard) on AWS and/or on-prem infrastructure.
  • 3+ years' Experience with AWS Services like AWS RDS, Aurora, EC2, S3, DMS, AWS Backups, and DynamoDB.
  • 3+ years' Experience with the Design and deployment of Amazon Machine Images (AMI) for Database.
  • Experience in database migrations from on-prem to AWS Cloud, replication technologies like Oracle Golden Gate/HVR
  • Manage and maintain database systems to ensure optimal performance, reliability, and security.
  • Design, develop, and deploy data pipelines and ETL processes for efficient data ingestion, transformation, and analysis.
  • Collaborate with cross-functional teams to understand data requirements and develop scalable data solutions.
  • Monitor database performance metrics and proactively address any performance or scalability issues.
  • Implement version control for database scripts and configurations using Git.
  • Utilize Jenkins for continuous integration and deployment of database changes.
  • Automate infrastructure provisioning and configuration using Terraform to enhance deployment efficiency.
  • Leverage AWS services such as S3, Lambda, VPC, and Security Groups to support data infrastructure.
  • Provide guidance on database security best practices, including access control and encryption.
  • Stay updated on emerging technologies and industry trends in data engineering and database administration.

Location

Gurgaon, Haryana, India

Bengaluru, Karnataka, India