1

Llmops Jobs (NOW HIRING)

Experience building and maintaining MLOps/LLMOps platforms * Cloud expertise in Azure and/or Google Cloud Platform * CI/CD pipeline development and automation * Model deployment, monitoring, and ...

Cloud Platform Engineer

Charlotte, NC · On-site

$55.75 - $74/hr

GenAI Platforms / LLMs RAG (Retrieval Augmented Generation) MLOps / LLMOps pipelines Key Responsibilities (Keywords for Search): Build enterprise cloud platforms (GCP + Azure) Implement Terraform ...

Cloud Platform Engineer

Charlotte, NC · On-site

$55.75 - $74/hr

GenAI Platforms / LLMs RAG (Retrieval Augmented Generation) MLOps / LLMOps pipelines Key Responsibilities (Keywords for Search): Build enterprise cloud platforms (GCP + Azure) Implement Terraform ...

Applied AI Engineer

Manhattan, NY · On-site

$77.30 - $87/hr

Establish LLMOps practices: extraction accuracy, assistant reliability, prompts management, and audit monitoring. Design and implement controls for entitlements, PII handling within open-source ...

Lead AI Engineer (ML Ops)

Irving, TX · On-site

$95K - $125K/yr

High proficiency in MLOps and LLMOps platforms (e.g., MLflow, Kubeflow, Weights & Biases). * Strong DevOps background, including hands-on experience with containerization (Docker, Kubernetes) and CI ...

Senior AI Engineer

Boston, MA

$113K - $155K/yr

Stay current with emerging trends in AI, ML, GenAI, LLMOps, software engineering, cloud platforms, and financial services technology, and share relevant learnings with the team. * Mentor junior ...

Lead AI Engineer (ML Ops)

Stamford, CT · Hybrid

$109K - $143K/yr

High proficiency in MLOps and LLMOps platforms (e.g., MLflow, Kubeflow, Weights & Biases). * Strong DevOps background, including hands-on experience with containerization (Docker, Kubernetes) and CI ...

Senior AI Engineer

Dallas, TX · On-site

$121K - $160K/yr

Apply LLMOps/MLOps practices, including CI/CD pipelines, prompt/version management, automated testing, and monitoring of latency, cost, and response quality. * Develop systems leveraging embeddings ...

Senior AI Engineer

Boston, MA · On-site

$113K - $155K/yr

Stay current with emerging trends in AI, ML, GenAI, LLMOps, software engineering, cloud platforms, and financial services technology, and share relevant learnings with the team. * Mentor junior ...

Implement and manage LLMOps workflows, including deployment, monitoring, and scaling of Generative AI systems * Build and maintain agent-based workflows using frameworks like LangChain, CrewAI, or ...

next page

Showing results 1-20

Llmops information

What jobs can I do with LLM?

With expertise in large language models (LLMs), you can pursue roles such as NLP engineer, machine learning engineer, data scientist, or AI researcher. These jobs typically require skills in programming, deep learning frameworks, and understanding of natural language processing concepts.

What engineer makes $500,000 a year?

Senior machine learning engineers, including those working in Llmops or related AI fields, can earn $500,000 or more annually, especially with extensive experience, specialized skills, and working at top tech companies or in high-demand industries. Compensation often includes base salary, bonuses, and stock options, reflecting expertise in large language models, cloud platforms, and deployment tools.

What jobs make $3,000 a day?

In the context of Llmops, high-paying roles such as AI project managers, machine learning engineers, or data science consultants can earn around $3,000 daily, especially with specialized skills, certifications, and experience in deploying large language models. These roles often require advanced technical knowledge, experience with cloud platforms, and the ability to manage complex AI operations in a fast-paced environment.

What is the difference between Llmops vs Data Scientist?

AspectLlmopsData Scientist
Required credentialsKnowledge of machine learning, AI frameworks, cloud platformsStatistics, programming, data analysis skills
Work environmentAI/ML teams, cloud environments, deployment pipelinesData analysis, modeling, reporting in various industries
Employer usageTech companies, AI startups, research labsFinance, healthcare, tech, retail

While both roles involve working with data and machine learning, Llmops focuses on deploying and maintaining large language models in production environments, requiring expertise in AI infrastructure. Data Scientists primarily analyze data, build models, and generate insights. Llmops professionals ensure models operate efficiently at scale, whereas Data Scientists develop the models and interpret results.

What is a $900000 AI job?

A $900,000 AI job typically refers to a high-level position in artificial intelligence, such as senior machine learning engineer or AI research director, often requiring advanced skills in deep learning, data science, and programming. These roles usually involve leadership, strategic planning, and expertise with tools like TensorFlow or PyTorch, and may include performance-based bonuses or stock options. Such salaries are rare and generally found in top tech companies or specialized AI firms.
More about Llmops jobs
What cities are hiring for Llmops jobs? Cities with the most Llmops job openings:
What states have the most Llmops jobs? States with the most job openings for Llmops jobs include:
Infographic showing various Llmops job openings in the United States as of June 2026, with employment types broken down into 96% Full Time, and 4% Contract. Highlights an 79% Physical, 7% Hybrid, and 14% Remote job distribution.
Sr Principal - Agentic Architecture and LLMOps Engineering, VP III - State Street Investment Mana...

Sr Principal - Agentic Architecture and LLMOps Engineering, VP III - State Street Investment Mana...

State Street Global Advisors

Boston, MA • On-site

$120K - $217K/yr

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Posted yesterday


Job description

About the Role


State Street Investment Management's Data, Analytics & AI Services (DAAIS) team is seeking a Senior Principal (Vice President), Agentic Architecture and LLMOps Engineering. This role owns the architecture, engineering delivery, and operational excellence for modern AI ecosystem and its agentic AI capabilities supporting the Investment Management business. The successful candidate brings deep, hands-on expertise in agentic architecture, workflow design, AI agent implementation, protocol integration (e.g., A2A, MCP), and containerized services, along with proven leadership experience in financial services.

Key Responsibilities

  • Lead an agile agentic AI engineering team to deliver scalable solutions that meet evolving business and client needs.
  • Partner with global stakeholders to execute cross-border initiatives and continuously strengthen engineering standards and best practices.
  • Coach and mentor engineers, building a culture of continuous learning, accountability, and high performance.
  • Define and own the firm's agentic architecture and implementation, including agent workflows; agent enablement across platform components; and governance (registration, security, observability, and monitoring) for AI agents.
  • Design and lead the implementation of agentic AI capabilities, including architecture patterns, best practices, framework and tool selection, development, integration, and deployment.

Required Qualifications

  • Master's degree in Computer Science or a related engineering discipline.
  • 15+ years of technology experience in financial services, including senior-level engineering leadership.
  • Hands-on experience designing and implementing multi-agent workflows, including human-in-the-loop command center patterns and/or autonomous agentic workflows.
  • Hands-on experience designing and implementing modern, open-architecture AI platforms supporting ML/DL, GenAI, and agentic AI (Google Gemini Enterprise and Vertex AI preferred).
  • Extensive experience architecting and implementing enterprise LLMOps and agentic infrastructure pipelines, including networking, storage, security, FinOps, and capacity planning, using cloud-agnostic approaches across major providers (e.g., GCP, AWS, Azure).
  • Proficiency with modern AI platforms (e.g., Google Gemini Enterprise, AWS Bedrock) and programming languages (e.g., Python, SQL, Rust); familiarity with AI-assisted development tools (e.g., Anthropic Code, GitHub Copilot, Codex).
  • 4+ years of experience working with unstructured data sources (e.g., sales notes, 13F filings, news, social media).
  • Excellent written and verbal communication skills, with the ability to influence and align stakeholders across geographies.
  • Demonstrated ability to deliver results with strong attention to detail, sound judgment, and a direct, constructive approach.

Preferred Qualifications

  • Experience serving as an AI platform architect within a financial institution.
  • Experience implementing patterns and tooling for unstructured data.
  • CFA Level II completion (or equivalent certification).

Salary Range:

$120,000 - $217,500 Annual

The range quoted above applies to the role in the primary location specified. If the candidate would ultimately work outside of the primary location above, the applicable range could differ.

Employees are eligible to participate in State Street's comprehensive benefits program, which includes: our retirement savings plan (401K) with company match; insurance coverage including basic life, medical, dental, vision, long-term disability, and other optional additional coverages; paid-time off including vacation, sick leave, short term disability, and family care responsibilities; access to our Employee Assistance Program; incentive compensation including eligibility for annual performance-based awards (excluding certain sales roles subject to sales incentive plans); and, eligibility for certain tax advantaged savings plans.

For a full overview, visit https://hrportal.ehr.com/statestreet/Home.

About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.

We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you'll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.

As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.

Discover more information on jobs at StateStreet.com/careers

Read our CEO Statement

Job Application Disclosure:

It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.