Experience with at least one backend technology stack: Node.js, Python (Django or Flask), or Java ... Hands-on experience building and deploying GenAI/LLM-powered solutions in client or production ...
Experience with at least one backend technology stack: Node.js, Python (Django or Flask), or Java ... Hands-on experience building and deploying GenAI/LLM-powered solutions in client or production ...
Hands-on experience utilizing Claude Code and modern LLM platforms (Anthropic Claude, OpenAI ... Extensive experience building backend services and APIs with Node.js or Python. * Track record of ...
Hands-on experience utilizing Claude Code and modern LLM platforms (Anthropic Claude, OpenAI ... Extensive experience building backend services and APIs with Node.js or Python. * Track record of ...
Llm Backend Engineer information
What is an LLM backend engineer?
LLM Backend Engineers are software engineers who specialize in designing, building, and optimizing the backend infrastructure that supports large language models (LLMs) like GPT-4. They focus on integrating LLMs into products and services, ensuring scalable APIs, managing data pipelines, and optimizing inference performance. Their work often involves deploying models in cloud environments, monitoring system reliability, and collaborating with AI researchers to bring advancements into production. LLM Backend Engineers play a critical role in making AI-powered applications robust, efficient, and accessible to end users.
What are the key skills and qualifications needed to thrive as an LLM backend engineer?
To thrive as an LLM Backend Engineer, you need a solid foundation in software engineering, backend architecture, and experience working with large language models, typically supported by a degree in computer science or a related field. Proficiency with programming languages like Python or Java, cloud platforms (AWS, GCP, Azure), and machine learning frameworks such as TensorFlow or PyTorch is essential, along with familiarity with APIs and containerization tools like Docker or Kubernetes. Strong problem-solving, collaboration, and communication skills distinguish top performers in this role. These skills ensure robust, scalable, and efficient deployment of LLM-powered applications while enabling effective teamwork and innovation.
What are some common challenges faced by LLM backend engineers when deploying large language models in production?
LLM Backend Engineers often encounter challenges such as optimizing inference latency, managing high resource consumption, and ensuring scalability for production workloads. Balancing model performance with cost efficiency requires careful selection of hardware, batching strategies, and model quantization techniques. Additionally, they must address security and privacy concerns associated with handling sensitive data processed by the models. Collaboration with data scientists and DevOps teams is essential to streamline model updates and monitor system health.
What are popular job titles related to Llm Backend Engineer jobs in Indiana?
For Llm Backend Engineer jobs in Indiana, the most frequently searched job titles are:
What job categories do people searching Llm Backend Engineer jobs in Indiana look for?
The top searched job categories for Llm Backend Engineer jobs in Indiana are:
- Internship Firearm Assembly
- Physical Design Engineer Intern
- Volunteer Finite Element Analysis
- Internship International Software Engineer
- Senior Federal Government Software Engineer
- Ai Programming Salary
- Intern Tcs Java Developer
- Senior Generative Ai Engineer
- Network Automation Engineer Intern
- Conversational Ai Developer
What cities in Indiana are hiring for Llm Backend Engineer jobs?
Cities in Indiana with the most Llm Backend Engineer job openings:
Full-time
Posted 20 days ago
Deloitte rating
8.2
Based on 92 frontline employees who took The Breakroom Quiz
45th of 151 rated financial services
Job description
Deloitte Cyber understands the unique challenges and opportunities businesses face in cybersecurity. Deloitte's Cyber team helps our clients navigate the ever-changing threat landscape. We simplify complexity, and enable businesses to operate with resilience, grow with confidence, and proactively manage their security posture.
Recruiting for this role ends on 12/31/2026.
The Team:
Deloitte's Cyber Engineering is a new team that is spearheading the buildout of Cybersecurity technology that will underpin the next generation of our Cybersecurity services. Join us as we work with technologies shaping the future of Cybersecurity to build future capabilities today.
Position Summary
You will be responsible for individually delivering high quality products within due timelines. Need-basis you will be mentoring and/or directing junior team members/liaising with onsite/offshore teams to understand the functional requirements.
Work you will do:
- Working closely with business, solution engineers, team members and leadership to understand business requirements and deliver high quality technical solutions
- Analyzing, implementing user requirements/business needs as new and/or enhanced product functionality
- Identifying key drivers of a problem and proposes technical solutions using analysis, experience, and decision making
- Developing solutions to client problems through application of methods and tools; validating solutions to SMEs
- Understanding the benefits of using state of the art methods and tools and their application on a particular engagement contributes to continuous development of methods and tools
- Demonstrating accountability and contributions to the successful realization of client goals
Required Qualifications
We require 10+ years of experience for all skill areas below:
- Hands-on experience in full stack software development across frontend and backend technologies.
- Experience designing, developing, deploying, implementing, or supporting AI, Generative AI, or Agentic AI solutions and architectures in enterprise applications on AWS, Azure, or GCP.
- Experience with object-oriented programming using languages such as Java, Python, or JavaScript/TypeScript.
- Experience with frontend development using Angular, React, or Next.js, and with JavaScript, TypeScript, HTML5, and CSS3 in production environments.
- Experience with at least one backend technology stack: Node.js, Python (Django or Flask), or Java (Spring Boot).
- Experience building and consuming REST APIs and microservices.
- Experience with relational databases such as MySQL, PostgreSQL, SQL Server, or Oracle, and with at least one NoSQL database such as MongoDB, Redis, Cassandra, or DynamoDB.
- Experience using Git and development lifecycle tools such as Azure DevOps.
- Experience with unit testing frameworks such as JUnit, Mockito, or equivalent, and with automated testing and CI/CD pipeline implementation.
- Experience deploying applications, APIs, or analytics workloads to AWS, Azure, or GCP.
- Experience working in Agile/Scrum delivery environments.
- Cloud certification in AWS, Azure, or GCP
- Bachelor's degree in computer science, Engineering, Information Technology, Data Science, Applied Mathematics, Physics, Statistics, or a related field.
- Limited immigration sponsorship may be available
Preferred Qualifications
- Experience with Docker, container-based application development, and serverless architectures.
- Experience with secure development practices or cybersecurity-focused application development.
- Hands-on experience building and deploying GenAI/LLM-powered solutions in client or production environments.
- Experience with one of the following Frontier GenAI Platforms: Anthropic, Google or Open AI, including hands on experience with one of the following key platforms/products; Claude API, Claude for Enterprise, tool use, extended thinking, Claude Code, Gemini API, Vertex AI Agent Builder, Grounding, Google Workspace integration, GPT-4o, Assistants API, Responses API, OpenAI Agents SDK.
- Experience contributing to project planning, estimation, or risk tracking.
- Experience mentoring junior or mid-level developers, leading code reviews, and providing development feedback.
- Experience partnering with product managers, designers, and business stakeholders to translate requirements into technical solutions.
- Strong written and verbal communication skills in cross-functional team environments.
- Cloud certification in AWS, Azure, or GCP.
- Familiarity with OpenSearch or Elasticsearch.
- Exposure to graph databases such as Neo4j or Memgraph.
- Familiarity with build tools such as Maven or Gradle.
- Experience with Bootstrap, jQuery, or JSP in legacy or mixed-technology environments.
- Familiarity with DevOps or DevSecOps practices.
- Knowledge of web security, GitOps, and Kubernetes customization.
- Basic understanding of AI/ML frameworks such as TensorFlow or PyTorch.
The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $171,600 to $338,300.
You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.
#CyberCtBEngg
Deloitte Cyber understands the unique challenges and opportunities businesses face in cybersecurity. Deloitte's Cyber team helps our clients navigate the ever-changing threat landscape. We simplify complexity, and enable businesses to operate with resilience, grow with confidence, and proactively manage their security posture.
Recruiting for this role ends on 12/31/2026.
The Team:
Deloitte's Cyber Engineering is a new team that is spearheading the buildout of Cybersecurity technology that will underpin the next generation of our Cybersecurity services. Join us as we work with technologies shaping the future of Cybersecurity to build future capabilities today.
Position Summary
You will be responsible for individually delivering high quality products within due timelines. Need-basis you will be mentoring and/or directing junior team members/liaising with onsite/offshore teams to understand the functional requirements.
Work you will do:
- Working closely with business, solution engineers, team members and leadership to understand business requirements and deliver high quality technical solutions
- Analyzing, implementing user requirements/business needs as new and/or enhanced product functionality
- Identifying key drivers of a problem and proposes technical solutions using analysis, experience, and decision making
- Developing solutions to client problems through application of methods and tools; validating solutions to SMEs
- Understanding the benefits of using state of the art methods and tools and their application on a particular engagement contributes to continuous development of methods and tools
- Demonstrating accountability and contributions to the successful realization of client goals
Required Qualifications
We require 10+ years of experience for all skill areas below:
- Hands-on experience in full stack software development across frontend and backend technologies.
- Experience designing, developing, deploying, implementing, or supporting AI, Generative AI, or Agentic AI solutions and architectures in enterprise applications on AWS, Azure, or GCP.
- Experience with object-oriented programming using languages such as Java, Python, or JavaScript/TypeScript.
- Experience with frontend development using Angular, React, or Next.js, and with JavaScript, TypeScript, HTML5, and CSS3 in production environments.
- Experience with at least one backend technology stack: Node.js, Python (Django or Flask), or Java (Spring Boot).
- Experience building and consuming REST APIs and microservices.
- Experience with relational databases such as MySQL, PostgreSQL, SQL Server, or Oracle, and with at least one NoSQL database such as MongoDB, Redis, Cassandra, or DynamoDB.
- Experience using Git and development lifecycle tools such as Azure DevOps.
- Experience with unit testing frameworks such as JUnit, Mockito, or equivalent, and with automated testing and CI/CD pipeline implementation.
- Experience deploying applications, APIs, or analytics workloads to AWS, Azure, or GCP.
- Experience working in Agile/Scrum delivery environments.
- Cloud certification in AWS, Azure, or GCP
- Bachelor's degree in computer science, Engineering, Information Technology, Data Science, Applied Mathematics, Physics, Statistics, or a related field.
- Limited immigration sponsorship may be available
Preferred Qualifications
- Experience with Docker, container-based application development, and serverless architectures.
- Experience with secure development practices or cybersecurity-focused application development.
- Hands-on experience building and deploying GenAI/LLM-powered solutions in client or production environments.
- Experience with one of the following Frontier GenAI Platforms: Anthropic, Google or Open AI, including hands on experience with one of the following key platforms/products; Claude API, Claude for Enterprise, tool use, extended thinking, Claude Code, Gemini API, Vertex AI Agent Builder, Grounding, Google Workspace integration, GPT-4o, Assistants API, Responses API, OpenAI Agents SDK.
- Experience contributing to project planning, estimation, or risk tracking.
- Experience mentoring junior or mid-level developers, leading code reviews, and providing development feedback.
- Experience partnering with product managers, designers, and business stakeholders to translate requirements into technical solutions.
- Strong written and verbal communication skills in cross-functional team environments.
- Cloud certification in AWS, Azure, or GCP.
- Familiarity with OpenSearch or Elasticsearch.
- Exposure to graph databases such as Neo4j or Memgraph.
- Familiarity with build tools such as Maven or Gradle.
- Experience with Bootstrap, jQuery, or JSP in legacy or mixed-technology environments.
- Familiarity with DevOps or DevSecOps practices.
- Knowledge of web security, GitOps, and Kubernetes customization.
- Basic understanding of AI/ML frameworks such as TensorFlow or PyTorch.
The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $171,600 to $338,300.
You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.
#CyberCtBEngg
About Deloitte
Sourced by ZipRecruiter
Industry
Finance and insurance and business management consulting
Company size
10,000+ Employees
Headquarters location
Orlando, FL, US