QA for MCP server (10326)

Requisition ID 10326 - Posted 

QA Automation MCP Server

Job Brief

We are looking for a highly skilled QA Automation Engineer / SDET to spearhead the quality, security, and reliability of our Model Context Protocol (MCP) servers. In this role, you will not just test UI workflows; you will be validating the foundational API contracts, discovery schemas, and context-retrieval pipelines that power our AI agents and LLM ecosystems. You will act as the gatekeeper ensuring our MCP tools return deterministic evidence, prevent prompt injections, and respect strict security blast radiuses.

Key Responsibilities

Protocol & Schema Validation

• Verify JSON-RPC 2.0 wire formats and client-server initialization handshakes.
• Perform contract testing on MCP server discovery schemas and tool definitions.
• Ensure server-advertised tools correctly match expected TypeScript/JSON arguments.

Functional & Integration Testing

• Validate multi-turn agent journeys using local and remote LLM orchestrators.
• Execute protocol test benches utilizing the MCP Inspector to diagnose capability mismatches.
• Use frameworks like DeepEval to evaluate LLM behaviour following tool outputs.

Security & Negative Path Auditing

• Design and execute strict negative test cases targeting prompt-injection risks.
• Test file path traversals, rate limits, oversized JSON payloads, and tool-chaining.
• Audit permission boundaries across Read-Only, Write-with-Approval, and Blocked environments.

CI/CD & Observability

• Integrate automated MCP contract tests into Git pull-request workflows.
• Instrument centralized logging to track request IDs, error durations, and execution tracing.

Required Skills & Qualifications

Core Technical Skills

• Protocol Depth: Proficient with JSON-RPC 2.0, REST APIs, and structured data handling.
• Languages: Production experience with TypeScript/JavaScript or Python.
• Automation Tooling: Familiarity with Playwright, DeepEval, or Postman.
• AI Testing Literacy: Clear understanding of LLM contexts, token constraints, and prompt formatting.

Experience

• 3+ years in API Test Automation, SDET, or Backend Quality Engineering roles.
• Experience testing autonomous AI agents, RAG pipelines, or tool-calling models is highly preferred.
• Proven track record designing isolated mock environments for end-to-end integration testing.