Big Data Administrator

We are seeking a skilled Big Data Administrator to join our dynamic team. The ideal candidate will have extensive experience in managing and optimizing big data environments, ensuring high availability and performance of big data applications. As a Big Data Administrator, you will be responsible for the installation, configuration, and maintenance of big data technologies such as Hadoop, Spark, and associated tools. You will work closely with data engineers and data scientists to support data processing and analytics initiatives.

Key Responsibilities

• Manage and maintain Hadoop clusters, ensuring optimal performance and reliability.
• Configure and administer Spark environments for data processing tasks.
• Implement and manage data storage solutions using HDFS and Hive.
• Monitor system performance and troubleshoot issues related to big data applications.
• Collaborate with cross-functional teams to support data ingestion and processing workflows.
• Ensure data security and compliance by implementing tools like Ranger.
• Stay updated with the latest trends and technologies in big data and recommend improvements.

Required Skills

• Strong knowledge of Hadoop ecosystem components including HDFS, Hive, and Spark.
• Experience with data processing frameworks such as Trino and Starburst.
• Proficiency in Linux and RHEL environments.
• Familiarity with data security tools like Ranger.
• Excellent problem-solving skills and the ability to work in a fast-paced environment.
• Strong communication skills to collaborate effectively with team members and stakeholders.

If you are passionate about big data technologies and have the required skills and experience, we encourage you to apply for this exciting opportunity to contribute to our data-driven initiatives.