AI Engineer - Model Training, Evaluation & Automation
UpTye
Job Description & Responsibilities
AI Engineer - Model Training, Evaluation & Automation
Company: UpTye
Job Location: Gurugram, Haryana, India
Employment Type: Full-time
Experience Required: 2 - 5 years
Summary
We are looking for a skilled AI Engineer with hands-on experience in AI model evaluation, LLM-based applications, autonomous AI agents, and workflow automation. The candidate will be responsible for evaluating AI systems, developing intelligent automation solutions, and improving overall AI performance and reliability.
Key Responsibilities
Conduct AI model evaluation, benchmarking, testing, and quality assessments.
Develop and implement autonomous AI agents and automated workflows.
Build, integrate, and maintain AI-powered applications using Python.
Design LLM evaluation pipelines, prompt engineering workflows, and feedback mechanisms.
Automate AI training and evaluation processes to improve efficiency.
Troubleshoot technical issues, optimize AI systems, and maintain documentation.
Collaborate on AI development, testing, and continuous improvement.
Required Skills
Strong Python programming skills with experience in AI development.
Hands-on experience with LLMs, AI model evaluation, and benchmarking.
Experience developing AI agents using Lang Chain, Lang Graph, CrewAI, or similar frameworks.
Knowledge of prompt engineering, API integrations, and workflow automation.
Understanding of machine learning fundamentals, AI testing, and quality assurance.
Familiarity with Git and software development practices.
Preferred Skills
Experience with AI training and evaluation platforms.
Knowledge of RAG, vector databases, or model fine-tuning.
Experience building automated AI testing and evaluation pipelines.
Familiarity with cloud infrastructure and AI deployment.
Qualifications
Bachelor's degree in Computer Science, AI, Data Science, or a related field.25 years of relevant experience in AI/ML development, LLM applications, or AI automation. .
About UpTye
Required Skills
Job Details
Posted by
N/A
Posted on:
17 Nov 2026
About UpTye
More open roles
- Senior Software Engineer (Python/Node.JS , AWS)Autodesk · India
- IT Intern - Software Development, Python & AI/MLAI SAMRAT · India
- Ansible & Python Open-source Developer for GamingHartbridge Evergrove Placements · Farrukhabad, Uttar Pradesh, India
- Senior Full Stack Developer (Python, React.js & Azure, AI)Robert Bosch · India
- Specialist System Engineering (Devops Engineer, CICD, Kubernetes, containers, React, Python, API, Deployment + Development + Automation, GitHub PipelinesAT&T · Bengaluru, Karnataka, India
- Data Scientist (Python, ML, SQL) (Bhilai)Workers Town · Raipur, Chhattisgarh, India