Job details
- Location
- Remote - Needham, MA +10
- Work type
- Remote
- Posted
- 5 days ago
- Apply on
- ascensushr.wd1.myworkdayjobs.com
About this role
Work at the cutting edge of enterprise AI, solving complex challenges and improving how intelligent systems perform at scale. In this role, you will troubleshoot AI behavior, partner with other engineers to fix root causes, and continuously enhance platform performance across LLMs, agent workflows, and backend systems.
This is not traditional support. You will play a hands-on role in shaping how AI is built, used, and experienced across the organization.
## Responsibilities
Technical Support & Triage
- Investigate and resolve issues reported by users of Agent Assist
- Reproduce issues and trace failures across LLM responses and prompts, agent workflows and orchestration, and tool/MCP calls and backend integrations (e.g., Salesforce and internal enterprise applications)
- Analyze logs, traces, and telemetry (e.g., Langfuse, NewRelic logs)
- Clearly document findings and partner with engineering on resolution leveraging Azure DevOpsAI System Debugging & Improvement
- Identify whether issues stem from prompting, retrieval (RAG), tool selection, or backend systems
- Propose improvements to agents, skills, prompts, and workflows
- Use AI-powered tools (e.g., Cursor) to accelerate debugging, analysis, and solutioning
- Contribute to continuous improvement of system reliability and response qualityUser Enablement & Evangelism
- Train internal users on how to effectively use Agent Assist
- Run targeted demos, onboarding sessions, and office hours
- Act as a trusted advisor to client-facing associates
- Drive adoption by helping users understand both capabilities and limitationsCross-Functional Collaboration
- Partner closely with engineering, product, and AI teams
- Translate user issues into clear, actionable tickets and improvements
- Identify recurring patterns and escalate systemic issuesGeneral
- Protect, secure, and properly handle all confidential data held by Ascensus to guard against unauthorized access, improper transmission, and unapproved disclosure
- Be guided by Ascensus Core Values of People Matter, Quality First and Integrity Always
## Qualifications
- Up to 3 years of experience in a Software Engineering, Software Support, QA, SDET, or engineering-adjacent role (including internships, co-ops, or academic projects)
- Bachelor's degree in Computer Science, Computer Information Systems, Business Information Systems, or a related technical field
- Demonstrated ability to troubleshoot and debug technical issues, focusing on root cause analysis
- Foundational experience or exposure to API testing (Postman or similar), reading logs and debugging application behavior, and basic SQL or data inspection
- Exposure to or strong interest in AI/LLM-based systems (prompting, chatbots, RAG, or agents) through coursework, projects, or hands-on experimentation
- Experience using or willingness to learn AI-powered development tools (e.g., Cursor, Claude Code)
- Strong communication skills with the ability to translate technical issues into clear explanations for non-technical users
- Demonstrated curiosity and ability to learn quickly in a fast-evolving technical environment
## Preferred Qualifications
- Experience supporting or building AI/agent-based applications
- Familiarity with Retrieval-Augmented Generation (RAG), tool/agent orchestration, and prompt engineering
Ready to apply to Ascensus?
ApplyBolt finds matching jobs, tailors your resume, and submits applications for you.