Job Summary:
Accenture Federal Services is committed to helping the US federal government enhance national security and improve citizens' lives through technology. They are seeking a Senior AI Software Engineer to integrate AI-assisted development workflows within a large-scale enterprise Linux environment, focusing on practical AI applications in software engineering.
Responsibilities:
• Design, develop, and deploy scalable AI/ML and LLM-powered applications in production environments
• Build and optimize high-performance inference pipelines using technologies such as vLLM and modern GPU-serving frameworks
• Develop agentic AI workflows leveraging orchestration frameworks, tool calling, and retrieval-augmented generation (RAG)
• Integrate LLMs, vector databases, APIs, and enterprise systems into production applications
• Collaborate with software engineers, AI researchers, and platform teams to productionize AI prototypes and services
• Improve model performance, throughput, latency, scalability, and operational efficiency
• Implement monitoring, observability, evaluation, and testing frameworks for AI systems
• Develop APIs, backend services, and automation workflows supporting AI-driven products
• Evaluate emerging AI technologies, frameworks, and developer tooling including Open Code, OpenwebUI, Claude Code and modern AI coding assistants
• Contribute to AI platform architecture, deployment standards, and engineering best practices
Qualifications:
Required:
• 4 years of software development with experience in any of the following:
• Strong Linux experience (Red Hat / Enterprise Linux required)
• Experience with LLMs, RAG systems, embeddings, or AI-assisted tooling
• Advanced C/C++ experience
• Experience with GitLab workflows and CI/CD
• Strong Python development experience
• Experience with APIs, backend systems, and automation
• Strong understanding of software architecture and large-scale systems
• Must have an active secret federal security clearance
Preferred:
• GPU infrastructure experience
• Experience deploying or operating local/open-source models
• Experience with vector databases and semantic search
• Experience with developer tooling or IDE integrations
• Experience with AI evaluation/testing frameworks
• Experience with secure/offline AI environments
• Familiarity with code indexing and static analysis systems
• Ability to work independently and drive technical initiatives
• Strong debugging and problem-solving skills
• Experience working with legacy systems and modernization efforts
Company:
Accenture Federal Services is a leading US federal services company and subsidiary of Accenture. Founded in 1989, the company is headquartered in Arlington, USA, with a team of 10001+ employees. The company is currently Late Stage.