LLM evaluation Lead- data Scientist

LLM Evaluation Lead (Applied Scientist) 8+ Years

Key Skills

• Deep understanding of LLM behavior & failure modes
• Prompt sensitivity, hallucination analysis, RAG failure modes
• Evaluation strategy ownership (offline & online)
• Tools: Ragas, DeepEval, TruLens
• Red-teaming & adversarial prompt design
• Vendor model comparison tracking
• Bridge between Data Science & Product