Full-Time Engineer: AI Software Engineer

OpenInfer is seeking an AI Software Engineer to contribute to local AI inference systems and customer-facing software. The role focuses on developing and maintaining a Rust-based LLM inference engine, deploying it across client platforms, supporting integrations and infrastructure, and collaborating with product and AI teams on new features.

What you'll do:

• Develop and maintain LLM inference engine written in Rust
• Deploy Rust to all major client platforms (Windows, Linux, MacOS, Android, iOS)
• Maintain GitHub actions to build & release software
• Maintain end-to-end integrations with Rust across major customer development platforms (React.Native, Java/Kotlin, Swift, C/C++, Python)
• Debug and troubleshoot issues in our API and related infrastructure
• Collaborate with product and AI teams to integrate new features

What they're looking for:

• - Proficiency in async Rust and concurrent programming
• - Strong generalist comfortable with learning and growth attained by tackling out-of-expertise problems
• - Strong problem-solving skills and attention to detail
• - Ideally at least 1-3 years of experience with Rust (personal projects, coursework, or previous work)
• - Familiarity with Axum, Actix, or other Rust web frameworks
• - Understanding of containerization (Docker) and cloud services
• - Familiarity with GitHub Actions and CI/CD
• - 3 years experience in C++
• - Experience with Android NDK and integrating Rust into mobile applications
• - Working with LLMs and local inference engines like llama.cpp or Ollama
• - Familiarity with REST design and FFI integration into C, Python, etc

Benefits:

• Medical, Dental, and Vision benefits
• Flexible Paid Time Off, 10 days
• Parental Leave
• 401(k) Plan with company matching
• Snacks and coffee to keep you energized