Product Analyst

Dynamo AI is building a platform for trustworthy enterprise AI through real-time guardrails, redteaming, and observability. The Product Analyst will own the design and specification of complex analytical workstreams, including experimental design, evaluation, data analysis, benchmarking, and recommendations for AI safety and guardrail systems.

What you'll do:

• Guardrail training data: curate and design the data that trains an SLM guardrail (for example, a prompt injection detector), and keep labeling consistent as datasets grow
• Orchestration experiments: test different configurations of guardrails and controls against each other to find what performs best
• Synthetic data quality: assess whether synthetic training or eval data is faithful and diverse enough to trust
• New evaluations: research and scope new ways to evaluate guardrails and AI applications, then specify how they work
• Rapid tooling: build small custom tools with AI to validate a hypothesis or unblock the team
• Benchmarking: measure performance with standard classification metrics (FNR, FPR, precision, recall) and report what's working and what isn't

What they're looking for:

• A degree with strong quantitative or analytical content. We're especially interested in less common backgrounds (physics, information or data theory, business, and similar) alongside solid data-analysis experience
• A clear, demonstrated framework for thinking through problems
• Good instinct for data, ML concepts, and what makes an experiment or metric trustworthy
• Python and pandas for working with data
• Interest in AI security or safety and adversarial thinking
• Attention to detail and clear writing
• ML coursework
• Reading or working proficiency in Japanese, Chinese, or a European language
• Coursework or projects in stats or NLP
• SQL
• A habit of building small tools or scripts (including with AI assistants) to answer your own questions
• Exposure to LLMs, security tooling, experimental design, or annotation work