Senior Manual QA Engineer

Job Description

As a Senior Manual QA Engineer (AI / LLM & API Testing), become a part of a cross-functional development team engineering experiences of tomorrow. We are seeking a Senior Manual QA Engineer (AI / LLM & API Testing) with 6+ years of experience in QA engineering. The ideal candidate will have strong expertise in API testing, test automation frameworks, and CI pipeline integration, with added exposure to RAG/LLM output evaluation and multilingual testing. This role is central to ensuring quality across the platform, defining test strategies, and validating outputs across multiple systems and languages.

Responsibilities

Own quality assurance across the platform, including

Retrieval accuracy and relevance testing

Multilingual output validation across German, Italian, French, and Dutch

NICE sync and writeback verification with versioning and deprecation handling

API contract testing for the portal and Boost.ai consumers

Regression coverage for the agent triage surface

Define test strategy and acceptance criteria with the Business Analyst (BA) against the Phase 1 scope

Collaborate with engineering teams to integrate QA processes into CI/CD pipelines

Ensure consistent quality across multilingual environments and AI-driven outputs

Requirements

3+ years of experience in QA engineering

Hands-on experience with test automation frameworks (pytest or equivalent)

Strong API testing skills using Postman or REST-based tools

Experience with CI pipeline integration

Exposure to RAG or LLM output evaluation is a plus

Experience with multilingual testing (German, Italian, French, Dutch) is highly valued

Tech stack: test automation frameworks, API testing (Postman/REST), CI integration

Desirable

Strong analytical and problem-solving skills

Ability to define clear acceptance criteria and test strategies

Detail-oriented with a focus on accuracy and consistency

Collaborative mindset with the ability to work closely with BAs, developers, and leads

Passion for ensuring high-quality user experiences across diverse environments .