Quality Engineer Specialist – AI & LLM Solutions

We are looking for a

QA Engineer Specialist specializing in AI and LLM-based systems

to ensure the quality, reliability, and performance of AI products used across global media and marketing platforms. The role focuses on testing

LLMs, RAG pipelines, AI agents, and ML/data workflows , with a strong emphasis on

automation and AI-specific quality metrics .

Key Responsibilities
Own quality assurance for

AI products , including LLMs, RAG systems, agents, and ML pipelines.
Design and execute

AI-specific test strategies

(factuality, hallucinations, robustness, safety).
Validate

agent behaviors , AI outputs, and performance (latency, stability, quality).
Build and maintain

automated test suites

integrated into CI/CD pipelines.
Prevent regressions and assess the impact of

model, embedding, or prompt changes .
Col...