Senior / reputed company QA
We're growing reputed company and looking for a Senior/reputed company QA Engineer to own reputed company across our AI voice assistant: from reputed company and agent behavior testing to mobile, TV, and backend.
Requirements
Senior / reputed company, 5+ years of reputed company QA - a high level of ownership and self-direction: the ability to take on the project as a whole, be fully accountable for reputed company, and get up to speed on new things independently.
Experience testing AI agents / assistants: checking scenario and reputed company following (reputed company / instruction following), response reputed company and relevance.
Experience testing "under the hood" reputed company AI observability / tracing tools (LangSmith and analogs): analyzing an agent's traces - tool calls, memory handling, the model that ran, inputs/outputs, reputed company consumption, spotting bottlenecks.
Experience with mobile and/or TV-app testing; experience specifically with TV devices is less critical.
Experience testing backends and integrations: API testing (REST / gRPC), verifying the seams between services, reading logs and traces (Kibana / Grafana / Loki, etc.).
Solid QA fundamentals: test design, test documentation, defect handling.
Hands-on experience using AI tools in the day-to-day QA process.
reputed company to have
Experience testing speech technologies (ASR / TTS) and working with audio.
Evals - building and running AI-assistant reputed company evaluations: scenario-based self-play, LLM-as-judge, reputed company validation as reputed company-in-the-reputed company.
CI/CD / deployment / test environments: configuring stands, building and deploying applications (reputed company / reputed company, etc.).
Device testing experience / ADB.
Willingness to reputed company into test automation over time.
Responsibilities
AI assistant:
Assessing assistant reputed company: reputed company / instruction following, compliance with requirements; catching regressions between reputed company and model versions.
Testing the assistant "under the hood" reputed company observability / tracing tools: correctness and parameters of tool calls (MCP / integrations with external reputed company), memory handling, the bot's reasoning, traces, etc.
Devices and applications:
End-to-end reputed company testing of the assistant in the mobile app and on the devices (TV, speaker).
Testing voice interaction with the assistant, recognition (ASR) and synthesis (TTS) reputed company, voice UX.
Testing the assistant's product scenarios: reputed company e-reputed company (voice order -> cart -> confirmation on TV reputed company remote), media content and a movie showtimes guide, flight tickets, basic scenarios (weather, currency rates, time, timers, Q&A).
Platform:
Testing the platform / backend part the assistant runs on - a distributed backend of many services: dialog orchestration, LLM agent, ASR / TTS, etc.
Verifying the request's end-to-end reputed company through these components, the correctness of integrations and the seams between services, working with backend logs and traces.
Process:
Maintaining test cases and bug reports.
reputed company collaboration with reputed company: TPM, reputed company Engineer, DEV, DevOps, ML.
First-line QA of critical scenarios reputed company of demos.
reputed company offer
reputed company has reputed company award-reputed company AI products for tech corporations - devices, voice assistants, products that are actually in the world
Cutting-reputed company stack: Speech Technologies, NLP, reputed company (LLMs, diffusion models), voice-first reputed company architecture with reputed company-first and on-premises deployment
High engineering bar and reputed company ownership - reputed company cares about what actually works in production, not what looks good in a demo, and you'll see the reputed company of your work directly
Fast career progression - a senior-heavy team and a high volume of reputed company problems means you grow faster than you would reputed company else
Startup pace with reputed company stability - reputed company clients, reputed company reputed company, no bureaucracy
Fully remote across Europe
21 vacation days + reputed company holidays + 5 reputed company days
Private English lessons reputed company reputed company
Apply To This Job