QA Tester – AI & LLM Platforms

Job Description

We are looking for a QA Tester / QA Engineer with experience in AI, Generative AI, and LLM-based applications. The candidate should have strong knowledge of manual testing, AI model testing, API testing, performance testing, and automation.

Responsibilities

• Perform functional, regression, smoke, sanity, integration, and exploratory testing.
• Test AI chat and LLM-based applications across multiple AI models.
• Validate AI-generated: Text, Images, Videos
• Test model switching and verify correct model responses.
• Validate conversation context and multi-turn interactions.
• Test regeneration, retry, error handling, and model failure scenarios.
• Validate AI response quality, accuracy, consistency, and relevance.
• Test AI credits, usage limits, and consumption calculations.
• Validate model-specific limits and rate limits.
• Test AI response time and performance.
• Verify handling of model timeouts, API failures, unavailable models, and unexpected responses.
• Test different prompt types and edge cases.
• Perform API testing using Postman.
• Perform basic database validation using SQL.
• Perform performance and load testing using JMeter or Locust.
• Create and execute detailed AI/LLM test cases and test scenarios.
• Identify, document, and track defects using JIRA.
• Perform cross-browser and mobile testing.
• Automate critical test scenarios using Playwright or Selenium.
• Collaborate with developers, product managers, and QA engineers in an Agile environment.

Required Skills

• Manual & Automation Testing
• AI / Generative AI / LLM Testing
• AI Chatbot Testing
• Text, Image & Video Generation Testing
• Multi-Model Testing
• API Testing – Postman
• SQL / Database Testing
• Playwright / Selenium
• JMeter / Locust
• JIRA & Git
• Good analytical and problem-solving skills

Preferred Experience

• 2–5 years of QA experience.
• Experience testing AI/LLM, Generative AI, chatbot, or AI-powered platforms.
• Understanding of AI model behavior, prompts, context handling, model switching, and response validation.
• Experience testing text, image, and video generation workflows.
• Experience with web and mobile application testing.