Your mission:

• • LLM Performance Validation: Test model accuracy, consistency, and reliability across diverse use cases and input scenarios.
  • AI Safety & Ethics Testing: Validate AI outputs for bias, fairness, toxicity, and harmful content generation.
  • Prompt Engineering & Optimization: Design and test prompts for optimal AI performance and consistent outputs.
  • AI Application Integration Testing: Ensure seamless integration between LLMs and business applications.
  • Model Behavior Analysis: Identify and document AI model limitations, edge cases, and failure modes.

Technical Requirements:

Essential Skills (must-have)

• AI/ML Testing: Understanding of LLMs, Prompt Engineering, AI model evaluation metrics, and testing for bias & hallucinations.
• QA Foundation: Manual testing, test case design for non-deterministic systems, defect management, and regression testing.
• Programming & Automation: Python, API Testing (REST/GraphQL), JSON/XML, SQL, and Git.
• AI Application Testing: Experience testing conversational AI, content generation, RAG systems, and AI workflows.
• Languages: English B2+.

Highly Desirable Skills

• Advanced AI Validation: Testing fine-tuned models, A/B testing for AI, performance benchmarking, and safety red-teaming.
• Data & Analytics: Statistical analysis, data visualization, test data curation, and synthetic data generation.
• Specialized AI Testing: Validating reinforcement learning, AI-generated code, and domain-specific AI (e.g., finance, legal).

Nice-to-Have Skills

• Background: AI research experience.
• Tools & Platforms: Cloud AI services (AWS Bedrock, Azure OpenAI), MLOps tools (MLflow, etc.).
• Other Skills: AI-specific security testing and knowledge of regulatory compliance (GDPR, etc.).
• Languages: German or Danish B2+.

Benefits:

• • Access to diverse and exciting projects in industries such as banking, insurance, engineering, gaming, and automotive.
  • Internal AI workshops to stay ahead in the evolving world of AI in QA and testing.
  • Accredited MAIN Next, ISTQB trainings and other specialized courses to boost your technical and professional skills.
  • 13th and 14th salary (for full-time employment contracts).
  • Opportunity to participate in the Testing United conference, one of the leading QA events in Europe.
  • Flexible working hours.
  • 100% remote work or hybrid mode (we will find a way that will suit you)
  • Referral bonus for recommending new colleagues to join the team.
  • Supportive team culture – we share knowledge, inspire each other, and grow together.
  • Stable, long-term cooperation with opportunities to build deep expertise.