Software Engineer - Inference

Visionist, Inc. is hiring a Software Engineer - Inference to prepare inference models for release, maintain reliable inference services and pipelines, and support customer needs. The role also involves building service infrastructure and integrating LLM-powered tools in collaboration with internal teams and model vendors.

What you'll do:

• Procure, configure, and test new inference models, preparing them for release to our user base
• Develop in-house services and techniques to guarantee continual high-quality inference service for our customer
• Work with model vendor teams and representatives to create reliable pipelines for closed-source model usage
• Collaborate with teammates on surge efforts to support short-term, high-priority inference needs from our customer
• Engage with other teams in our organization to establish solid infrastructure for our services and integrate LLM-powered tools for user needs

What they're looking for:

• Active Top Secret (TS/SCI) clearance with polygraph is required
• Bachelor's degree in a technical discipline. (Additional 4 years of experience may substitute degree)
• Experience with Python and/or other modern programming languages
• Experience with Kubernetes/Helm
• Familiarity with Argo CD and/or other CI/CD frameworks
• Familiarity with AWS or other cloud service providers
• Strong communication skills and willingness to ask questions
• Ability to learn new technologies quickly
• U.S citizenship required (green card holders and permanent residents are not eligible)

Benefits:

• Annual merit increases
• Performance-based bonuses
• 4 weeks paid time off that is never “use or lose”
• 12 paid holidays
• Comp time
• Overtime
• Flexible work hours
• 80 hours of paid parental leave
• An additional $8,000 supplemental payment upon returning from maternity
• Medical, dental, & vision benefits for both individuals and families