About the role
Responsibilities Design and execute tests evaluating LLM-generated responses for accuracy and consistency Build and maintain AI-powered testing agents and test harnesses Test MCP tools and integrations, including error scenarios Develop test plans, regression suites, and manual testing checklists Design and maintain automated tests for web apps, APIs, and end-to-end workflows Test backend APIs, verify data integrity, and validate system integrations Reproduce, document, and triage defects with actionable evidence Partner with engineering and product teams to assess risks and improve release confidence Requirements Degree in computer science or mathematics Minimum 7 years of professional QA experience Hands-on AI/LLM testing experience Experience with Claude, ChatGPT, or similar AI tools for testing Experience with Playwright and MCP-based automation Working knowledge of REST APIs and SQL Familiarity with Jira, TestRail, Azure DevOps, or GitHub Understanding of Agile/Scrum methodologies English upper-intermediate or higher Preferred Qualifications Experience with GraphQL Experience with Postman Familiarity with Selenium or Cypress About the Company Sora Union is a professional services company specializing in brand design and engineering services, with a globally distributed team.