Software Development Engineer - AI / LLM Systems (Python Backend)

Company: Volga Partners Location: Fully Remote (Occasional office visits 1–2 times/year) C ompensation: ₹23–₹30 LPA (based on experience) J ob Type: Full-time Start Date: Urgently hiring — must be available to start within 1–2 weeks Work Hours: 8 AM – 5 PM IST or 9 AM – 6 PM IST (Collaboration with USA Pacific Time teams) About the Role Volga Partners is looking for a skilled Software Development Engineer with strong expertise in Python backend systems and AI/LLM applications. In this role, you will build and maintain production-grade AI-powered systems, integrating large language models into real-world workflows. You will work across backend services, orchestration layers, and data pipelines—ensuring that AI features are reliable, scalable, and performant. This is a hands-on engineering role requiring strong problem-solving, system design, and the ability to operate in fast-evolving AI environments. Key Responsibilities Build and maintain backend services and internal tools in Python for AI-powered applications. Integrate LLM APIs into production workflows, including prompt handling, response processing, validation, and retries. Design and implement scalable REST APIs, async workflows, and background job systems. Maintain and enhance components of a multi-language codebase (C#/C++, Python, web technologies) where applicable. Work with structured and unstructured data to prepare inputs, transform outputs, and support downstream systems. Develop systems for prompt management, model routing, response validation, and failure handling. Debug complex issues across backend logic, API integrations, and distributed services. Monitor system performance using telemetry tools and proactively identify and resolve bottlenecks. Automate recurring workflows related to data processing, evaluation, and reporting. Collaborate with cross-functional teams to turn ambiguous product ideas into production-ready features. Contribute to architecture decisions around scalability, performance, and safe use of AI systems. Write clean, testable, and maintainable code while helping establish engineering best practices for AI systems. What You Bring Education Bachelor’s degree in Computer Science or a related field. Experience 3+ years of professional experience in backend or systems engineering. Strong experience in Python development for production systems. Experience integrating LLM APIs or AI-driven services into real applications. Proven ability to work within large codebases and collaborative environments. Technical Skillset Core Skills Python (strong), backend system design, API development Async workflows, job queues, and service orchestration Debugging across APIs, services, and data pipelines Languages Python, C#, C/C++, JavaScript/TypeScript, SQL Frameworks & Libraries .NET Web API, ASP.NET (MVC & WebForms), Entity Framework React, Bootstrap, Ajax Testing frameworks (xUnit or similar) AI / LLM Systems Prompt design, response parsing, and guardrails Model integration patterns and failure handling Understanding of LLM limitations and production constraints Tools & Platforms Azure DevOps, Git, Docker, Terraform SQL Server or similar databases Elastic Stack, Postman, Swagger AWS or Azure cloud environments Architecture Microservices, distributed systems, modular architectures Operating Systems Windows, Linux Build Tools Make, Ninja (preferred) Nice to Have Experience with RAG, embeddings, vector databases, or retrieval systems Familiarity with agent workflows or multi-step orchestration Experience with model monitoring, prompt versioning, or evaluation systems Understanding of AI safety, privacy, and secure data handling Exposure to cloud-native deployments and scalable infrastructure Why Join Us Remote-first culture with minimal in-person requirements Work with global teams on cutting-edge AI systems Opportunity to build real-world LLM applications at scale High ownership, fast-moving environment with strong growth potential