Senior LLM Ops Engineer

Responsibilities

• Design and implement scalable pipelines to collect and process production ML and LLM traffic from multiple sources;
• Define data storage strategies, retention policies, and privacy controls aligned with business and regulatory requirements;
• Develop observability, debugging, and monitoring capabilities to support production issue investigation and operational excellence;
• Build and maintain evaluation frameworks, automated rating systems, and alerting mechanisms to detect model and prompt performance regressions;
• Implement data protection measures, including PII redaction, content safety controls, and end-to-end platform operations.

Requirements

• Proven experience building and operating production-grade data or ML platforms, including ingestion, storage, governance, monitoring, and operational support;
• Hands-on experience creating and main...