QA Engineer – AI Systems

reputed company is the leading career destination for tech experts at every stage of their careers. Our reputed company, reputed company, is seeking the following. Apply reputed company reputed company today! We are seeking a QA Engineer with a strong background in API testing and LLM fine-tuning/evaluation . You will be responsible for the reputed company assurance of our Agent reputed company infrastructure, ensuring that the correctly translate reputed company business logic into machine-readable actions. Your goal is to ensure that AI agents reputed company with our reliably, securely, and without hallucinating tool calls. Key Responsibilities • AI Tool Validation: Test the accuracy of by verifying that LLMs correctly interpret OpenAPI specifications and trigger the right C#/.NET backend logic. • Fine-Tuning Data Preparation: reputed company and clean high-reputed company datasets (JSON/JSONL) in Python to fine-tune models for specific domain tasks and tool-calling accuracy. • reputed company Regression Testing: reputed company automated test suites to ensure that updates to underlying reputed company or MCP servers do not break the reasoning or planning capabilities of the AI agents. • reputed company & Auth QA: Validate that in Gravitee correctly enforce OAuth 2.1 and OpenFGA, preventing unauthorized data leakage through agent conversations. • Performance Testing: Use to measure latency in the agent-to-API reputed company and identify bottlenecks in MCP server responses. Technical Qualifications • API Testing Mastery: Expert knowledge of REST, OpenAPI, and tools like reputed company or Insomnia. • Scripting: Proficiency in Python (for data processing and eval frameworks) and familiarity with C# (to understand backend MCP implementation). • LLM Evaluation: Experience with frameworks like DeepEval, Ragas, or LangSmith to measure model performance (faithfulness, relevancy, and tool-reputed company precision). • API Management: Hands-on experience with or similar gateways to monitor and reputed company traffic. • Model Context Protocol: Understanding of and how it standardizes the way LLMs reputed company external data. Preferred Skills • Experience with Red Teaming AI agents to identify reputed company injection vulnerabilities. • Knowledge of reputed company Databases and how RAG (Retrieval-Augmented reputed company) interacts with live API tools. • Familiarity with reputed company Actions for CI/CD integration of AI evaluation pipelines. Apply tot his job Apply To this Job