Full-Time Engineer: AI Software Engineer
Back to All Positions
Full-Time Engineer: AI Software Engineer
Bay Area, CA
Full-time
Position Overview
We are looking for a Rust Software Developer to join our team and work on cutting-edge local AI inference. This role is ideal for someone eager to grow their Rust development skills while contributing to our API front-end and core systems. You will be contributing to the customer-facing codebase that is the vehicle for us delivering our improvements to LLM inference. If youre excited about Rust and AI, wed love to hear from you!
Key Responsibilities
Develop and maintain LLM inference engine written in Rust
Deploy Rust to all major client platforms (Windows, Linux, MacOS, Android, iOS)
Maintain GitHub actions to build & release software
Maintain end-to-end integrations with Rust across major customer development platforms (React.Native, Java/Kotlin, Swift, C/C++, Python)
Debug and troubleshoot issues in our API and related infrastructure
Collaborate with product and AI teams to integrate new features
Required Qualifications
Ideally at least 1-3 years of experience with Rust (personal projects, coursework, or previous work).
Proficiency in async Rust and concurrent programming
Strong generalist comfortable with learning and growth attained by tackling out-of-expertise problems.
Strong problem-solving skills and attention to detail
Nice to have Qualifications
Familiarity with Axum, Actix, or other Rust web frameworks
Understanding of containerization (Docker) and cloud services
Familiarity with GitHub Actions and CI/CD
3 years experience in C++
Experience with Android NDK and integrating Rust into mobile applications
Working with LLMs and local inference engines like llama.cpp or Ollama
Familiarity with REST design and FFI integration into C, Python, etc
What You'll Gain
Opportunity to work alongside industry experts in AI optimization, high-performance computing, and hardware acceleration.
Hands-on experience with cutting-edge technologies at the intersection of AI and hardware acceleration.
Exposure to open-source development and collaboration with a vibrant community.
Extensive experience building and maintaining a Rust codebase
Benefits We Offer
At OpenInfer we offer comprehensive benefits, some include:
Medical, Dental, and Vision benefits for you and your family
Flexible Paid Time Off, 10 days
Parental Leave
401(k) Plan with company matching
Snacks and coffee to keep you energized
These benefits are further detailed in OpenInfer policies and are subject to change at any time, consistent with the terms of any applicable compensation or benefits plans.
How to Apply
Please send your resume and a brief cover letter to [email protected]. Include examples of your work with large AI models, attention blocks, or open-source contributions where applicable.
Please contact us at [email protected]
Apply Now
Full-Time Engineer: AI Software Engineer
Bay Area, CA
Full-time
Position Overview
We are looking for a Rust Software Developer to join our team and work on cutting-edge local AI inference. This role is ideal for someone eager to grow their Rust development skills while contributing to our API front-end and core systems. You will be contributing to the customer-facing codebase that is the vehicle for us delivering our improvements to LLM inference. If youre excited about Rust and AI, wed love to hear from you!
Key Responsibilities
Develop and maintain LLM inference engine written in Rust
Deploy Rust to all major client platforms (Windows, Linux, MacOS, Android, iOS)
Maintain GitHub actions to build & release software
Maintain end-to-end integrations with Rust across major customer development platforms (React.Native, Java/Kotlin, Swift, C/C++, Python)
Debug and troubleshoot issues in our API and related infrastructure
Collaborate with product and AI teams to integrate new features
Required Qualifications
Ideally at least 1-3 years of experience with Rust (personal projects, coursework, or previous work).
Proficiency in async Rust and concurrent programming
Strong generalist comfortable with learning and growth attained by tackling out-of-expertise problems.
Strong problem-solving skills and attention to detail
Nice to have Qualifications
Familiarity with Axum, Actix, or other Rust web frameworks
Understanding of containerization (Docker) and cloud services
Familiarity with GitHub Actions and CI/CD
3 years experience in C++
Experience with Android NDK and integrating Rust into mobile applications
Working with LLMs and local inference engines like llama.cpp or Ollama
Familiarity with REST design and FFI integration into C, Python, etc
What You'll Gain
Opportunity to work alongside industry experts in AI optimization, high-performance computing, and hardware acceleration.
Hands-on experience with cutting-edge technologies at the intersection of AI and hardware acceleration.
Exposure to open-source development and collaboration with a vibrant community.
Extensive experience building and maintaining a Rust codebase
Benefits We Offer
At OpenInfer we offer comprehensive benefits, some include:
Medical, Dental, and Vision benefits for you and your family
Flexible Paid Time Off, 10 days
Parental Leave
401(k) Plan with company matching
Snacks and coffee to keep you energized
These benefits are further detailed in OpenInfer policies and are subject to change at any time, consistent with the terms of any applicable compensation or benefits plans.
How to Apply
Please send your resume and a brief cover letter to [email protected]. Include examples of your work with large AI models, attention blocks, or open-source contributions where applicable.
Please contact us at [email protected]
Apply Now