Junior AI QA Engineer, Senior Associate

Charles River Development, a State Street company, delivers enterprise investment management technology solutions. The Junior AI QA Engineer, Senior Associate will design and maintain scalable testing frameworks, validate AI-enabled product behavior, and collaborate with cross-functional teams to improve quality engineering for the CRIMS / State Street Alpha platform.

What you'll do:

• Develop and maintain automated and manual test frameworks that support validation of AI-enabled features across the CRIMS / Alpha platform
• Create test plans, test cases, and test data strategies for functional, integration, regression, and non-functional testing of AI-driven capabilities
• Validate product behavior for AI use cases, including quality of outputs, workflow integration, response accuracy, exception handling, and user experience impacts
• Design and execute tests for AI guardrails, probabilistic outputs, and response boundaries to ensure generated results are accurate, safe, consistent, and aligned with intended business outcomes
• Help define approaches for monitoring AI behavior in production, including drift detection, output quality trends, and feedback loops to confirm AI-enabled features continue learning and performing as expected over time
• Identify, document, and drive resolution of defects, with clear analysis of reproducibility, business impact, and root cause patterns
• Work with engineering teams to integrate automated testing into CI/CD pipelines and improve test coverage across the scrum team’s delivery scope
• Apply AI tools and techniques within the test lifecycle to improve productivity, accelerate coverage creation, and enhance defect discovery
• Collaborate with developers and product partners to define measurable acceptance criteria and quality gates for AI-related user stories and features
• Support risk-based testing and help prioritize test efforts across new development, regression areas, and high-impact client workflows
• Contribute to continuous improvement of QA standards, test assets, documentation, and team-level best practices for testing AI-enabled products
• Communicate testing progress, risks, and quality insights effectively within the scrum team and to broader stakeholders as needed

What they're looking for:

• 0-2 years of professional software testing or quality assurance experience
• Hands-on experience testing AI functionality embedded within a software product, including validation of generated outputs, model-driven behavior, workflow integration, and exception scenarios
• Understanding of AI-specific testing concepts beyond deterministic validation, including guardrail testing, probabilistic output assessment, accuracy evaluation, and monitoring for production drift or model behavior changes over time
• Strong understanding of QA methodologies, test strategy development, defect lifecycle management, and test automation best practices
• Experience building or extending test frameworks to support scalable, maintainable, and reusable testing practices
• Experience with API testing, integration testing, regression testing, and end-to-end validation in complex enterprise applications
• Working knowledge of test automation tools, scripting, and CI/CD integration
• Strong analytical, problem-solving, and communication skills, with the ability to work effectively across cross-functional teams
• Ability to translate ambiguous product behavior into clear test scenarios, acceptance criteria, and risk-based validation approaches
• Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field, or equivalent practical experience
• Preferably within agile or scrum-based product development teams
• Proven experience implementing AI capabilities within the software testing process, such as intelligent test generation, test optimization, defect analysis, or productivity acceleration

Benefits:

• Retirement savings plan (401K) with company match
• Insurance coverage including basic life, medical, dental, vision, long-term disability, and other optional additional coverages
• Paid time off including vacation, sick leave, short-term disability, and family care responsibilities
• Access to the Employee Assistance Program
• Eligibility for annual performance-based awards
• Eligibility for certain tax-advantaged savings plans
• Inclusive development opportunities
• Flexible work-life support
• Paid volunteer days
• Vibrant employee networks