1

Prompt Engineer Jobs in Columbus, OH (NOW HIRING)

Lead Prompt Engineering and Optimization: Design, develop, test, and continuously refine prompts and prompt templates for LLM-powered applications, establishing enterprise-wide prompt engineering ...

New

Lead AI Engineer

Columbus, OH · Remote

$152K - $190K/yr

We are seeking a Lead AI Engineer to partner ML Engineers, Prompt Engineers, and Product teams, ensuring alignment with organizational goals, operational excellence, and compliance standards. Key ...

Lead AI Engineer

Columbus, OH · On-site

$152K - $190K/yr

We are seeking a Lead AI Engineer to partner ML Engineers, Prompt Engineers, and Product teams, ensuring alignment with organizational goals, operational excellence, and compliance standards. Key ...

Lead AI Engineer

Columbus, OH · On-site

$152K - $229K/yr

We are seeking a Lead AI Engineer to partner ML Engineers, Prompt Engineers, and Product teams, ensuring alignment with organizational goals, operational excellence, and compliance standards. Key ...

Build and continuously improve the agentic engineering framework - automated test generation pipelines, AI-assisted code review workflows, prompt engineering standards, and agentic workflow runbooks ...

Build and continuously improve the agentic engineering framework - automated test generation pipelines, AI-assisted code review workflows, prompt engineering standards, and agentic workflow runbooks ...

Build and continuously improve the agentic engineering framework automated test generation pipelines, AI-assisted code review workflows, prompt engineering standards, and agentic workflow runbooks ...

Senior AI/ML Engineer

Columbus, OH · Remote

$90 - $100/hr

Build RAG pipelines, integrate vector databases, and apply prompt engineering with LangChain or LangGraph. * Develop end-to-end AI/ML/NLP plans compliant with cybersecurity policies. * Apply software ...

next page

Showing results 1-20

Prompt Engineer information

See Columbus, OH salary details

$9

$45

$84

How much do prompt engineer jobs pay per hour?

As of Jun 17, 2026, the average hourly pay for prompt engineer in Columbus, OH is $45.48, according to ZipRecruiter salary data. Most workers in this role earn between $34.62 and $58.75 per hour, depending on experience, location, and employer.

What are the key skills and qualifications needed to thrive in the Prompt Engineer position, and why are they important?

To thrive as a Prompt Engineer, you need a strong grasp of natural language processing (NLP), machine learning concepts, and experience crafting effective prompts for large language models, usually supported by a technical degree or relevant experience. Familiarity with tools such as OpenAI's API, Hugging Face, or other AI platforms, as well as knowledge of programming languages like Python, is highly valuable. Creative thinking, analytical problem-solving, and cross-functional communication skills help differentiate top candidates in this field. These abilities are crucial for optimizing AI outcomes and ensuring collaboration with both technical and non-technical teams.

What does a typical day look like for a Prompt Engineer?

A typical day for a Prompt Engineer involves designing, testing, and refining prompts to enhance the performance of AI language models, often collaborating closely with data scientists, software engineers, and product managers. You might analyze the results of model outputs, integrate user or stakeholder feedback, and iterate on prompt strategies to solve diverse business challenges. Your role will usually include documentation, troubleshooting, and keeping up with the latest advances in AI technologies. Expect a mix of independent work and regular team meetings in a dynamic, fast-evolving environment focused on innovation and improvement.

What engineers make $500,000?

Senior software engineers, especially those in specialized fields like AI, machine learning, or cybersecurity, can earn $500,000 or more annually with bonuses and stock options. High compensation often requires extensive experience, advanced skills, and working in competitive tech companies or leadership roles.

What is a Prompt Engineer job?

A Prompt Engineer is a professional who designs, refines, and optimizes prompts to improve interactions with AI models, such as ChatGPT. Their role involves understanding model behavior, crafting precise queries, and experimenting with phrasing to achieve desired outputs. They may work in AI research, software development, or content generation to maximize AI efficiency. Strong skills in language, logic, and sometimes coding are essential for success in this role.

Is prompt engineer still a thing?

Prompt engineering is an emerging role focused on designing effective prompts for AI language models. It is increasingly in demand as organizations seek to optimize AI interactions, often requiring skills in natural language processing and familiarity with AI tools. The role is expected to grow as AI adoption expands across industries.

What exactly is prompt engineer work?

A prompt engineer designs and optimizes prompts used to interact with AI language models, ensuring accurate and relevant outputs. The role requires understanding of AI systems, natural language processing, and often involves testing and refining prompts to improve model performance. Skills in programming, data analysis, and familiarity with AI tools are commonly needed.

Is prompt engineer salary?

Prompt engineers typically earn salaries comparable to other AI and machine learning specialists, with average annual pay ranging from $80,000 to $150,000 depending on experience, location, and industry. Skills in natural language processing, AI tools, and programming languages like Python can influence compensation. Entry-level positions may start lower, while experienced prompt engineers working in tech hubs tend to earn higher salaries.
What are the most commonly searched types of Prompt Engineer jobs in Columbus, OH? The most popular types of Prompt Engineer jobs in Columbus, OH are:
What job categories do people searching Prompt Engineer jobs in Columbus, OH look for? The top searched job categories for Prompt Engineer jobs in Columbus, OH are:
What cities near Columbus, OH are hiring for Prompt Engineer jobs? Cities near Columbus, OH with the most Prompt Engineer job openings:
Infographic showing various Prompt Engineer job openings in Columbus, OH as of June 2026, with employment types broken down into 100% Full Time. Highlights an 80% In-person, and 20% Remote job distribution, with an average salary of $94,600 per year, or $45.5 per hour.
AI / ML Platform Engineer

AI / ML Platform Engineer

Vertiv Co

Westerville, OH

Other

Posted 2 days ago


Vertiv rating

6.9

Company rating: 6.9 out of 10

Based on 60 frontline employees who took The Breakroom Quiz

305th of 418 rated machine equipment manufacturers


Job description

Job Summary

Vertiv is seeking a technically skilled and innovative AI / ML Platform Engineer to serve as the hands-on engineering lead for enterprise AI platform capabilities within Vertiv's Digital organization. This individual contributor role is responsible for supporting, administering, and extending Vertiv's production AI platforms - including Writer AI and Compass AI - while owning the development of prompt engineering standards, and AI governance frameworks that ensure responsible, compliant, and high-quality AI outputs across the enterprise. The AI / ML Platform Engineer will operate within the Digital organization and play a central role in advancing Vertiv's Operational Excellence and Customer Focus & Innovation strategic priorities by enabling scalable, governed, and production-grade generative AI capabilities that deliver measurable business value.

As an individual contributor in a lead capacity, this role extends beyond hands-on platform engineering to encompass the full lifecycle of LLM-based application delivery - from model evaluation and prompt optimization to LLMOps monitoring and cross-functional AI enablement. The AI / ML Platform Engineer will partner closely with technology and business stakeholders to define AI usage policies, evaluate emerging GenAI technologies, and ensure that all AI solutions are secure, observable, and aligned to Vertiv's enterprise architecture and data governance standards. 

This position is based onsite at Vertiv's Westerville, OH headquarters, with occasional domestic and international travel as needed.

Responsibilities:

  • Support and Administer Writer AI & Compass AI Platforms: Serve as the primary technical owner for Vertiv's Writer AI and Compass AI platform instances, managing configuration, tenant administration, integrations, user access controls, and platform health to ensure reliable, production-grade availability across the enterprise.
  • Lead Prompt Engineering and Optimization: Design, develop, test, and continuously refine prompts and prompt templates for LLM-powered applications, establishing enterprise-wide prompt engineering standards, libraries, and versioning practices that maximize model accuracy, consistency, and safety.
  • Build and Maintain RAG Pipelines: Architect and implement end-to-end Retrieval-Augmented Generation (RAG) pipelines - including document ingestion, chunking strategies, embedding generation, and vector search integration - to ground LLM outputs in authoritative Vertiv knowledge sources and reduce hallucination risk.
  • Drive AI Governance and Compliance: Define and enforce AI usage policies, content safety guardrails, data handling standards, and compliance controls across all GenAI platforms and applications, partnering with Legal, Compliance, IT Security, and NPDi teams to ensure responsible AI practices aligned to Vertiv's risk framework.
  • Operate LLMOps and Monitoring Frameworks: Implement and maintain LLMOps tooling for production AI systems, including prompt performance monitoring, output quality tracking, cost management, latency observability, and model drift detection, ensuring that AI applications remain performant, reliable, and cost-effective at scale.
  • Collaborate Cross-Functionally on AI Initiatives: Partner with technology and business stakeholders to translate requirements into technical AI solutions, provide platform consulting for new GenAI use cases, and serve as a technical subject matter expert on LLM capabilities, limitations, and integration patterns.
  • Design and Execute AI Evaluation Frameworks: Develop systematic evaluation frameworks and benchmarks for assessing LLM output quality, prompt effectiveness, RAG retrieval accuracy, and model behavior - enabling data-driven decisions on model selection, prompt iteration, and platform evolution.
  • Stay Current on GenAI Advancements: Continuously monitor advancements in generative AI, large language models, agentic AI frameworks, and enterprise AI platforms; evaluate emerging tools and techniques for applicability to Vertiv's AI roadmap and provide actionable recommendations to Digital leadership.

Requirements:

  • Bachelor's degree in Computer Science, Information Systems, Engineering, Data Science, or a related field; equivalent practical experience considered.
  • 5+ years of professional experience in software engineering, AI/ML engineering, or a related technical discipline.
  • 3+ years of hands-on experience building and deploying GenAI / LLM-based applications or platforms in a production enterprise environment.
  • Demonstrated experience with prompt engineering, RAG pipeline development, and LLM API integration in real-world production systems.
  • Experience with enterprise AI platform administration (e.g., Writer AI, Compass AI, or equivalent SaaS AI platforms) is strongly preferred.

Technical Skills

  • Proficiency in Python for AI/ML engineering, data processing, and pipeline development.
  • Hands-on experience with RAG architectures, vector search technologies (e.g., Pinecone, Weaviate, pgvector, OpenSearch), and embedding models.
  • Experience with LLM APIs and frameworks (e.g., OpenAI, Anthropic, LangChain, LlamaIndex, or equivalent) for building production AI applications.
  • Familiarity with AWS AI/ML services (SageMaker, Bedrock, or equivalent) and cloud-native deployment patterns.
  • Experience with CI/CD pipelines and DevOps tooling (Gitlab, Jenkins, GitHub Actions, Azure DevOps, or equivalent) for AI application delivery.
  • Working knowledge of prompt engineering best practices, prompt versioning, and LLMOps tooling (e.g., MLflow, LangSmith, Weights & Biases, or equivalent).

Preferred Qualifications

  • AWS AI/ML certifications (AWS Certified Machine Learning - Specialty, or AWS Certified AI Practitioner).
  • Direct hands-on experience with Writer AI and/or Compass AI platform administration and integration.
  • Familiarity with enterprise LLMOps tooling, AI observability platforms, and model evaluation frameworks.
  • Experience with Snowflake or other cloud data platforms for AI/ML data pipelines and feature engineering.
  • Exposure to AI governance frameworks, responsible AI principles, and enterprise AI policy development.
  • Experience working in Agile/Scrum delivery environments with cross-functional digital product teams.

The successful candidate will embrace Vertiv's Core Principals & Behaviors to help execute our Strategic Priorities. 

OUR CORE PRINCIPALSSafety.  Integrity.  Respect.  Teamwork.  Diversity & Inclusion.

OUR STRATEGIC PRIORITIES

  Customer Focus

  Operational Excellence

  High-Performance Culture

  Innovation

  Financial Strength

OUR BEHAVIORS

  Own It

  Act With Urgency

  Foster a Customer-First Mindset

  Think Big and Execute

  Lead by Example

  Drive Continuous Improvement

  Learn and Seek Out Development

About Vertiv

Vertiv is a $10.2 billion global critical infrastructure and data center technology company.  We ensure customers' vital applications run continuously by bringing together hardware, software, analytics and ongoing services.  Our portfolio includes power, cooling and IT infrastructure solutions and services that extends from the cloud to the edge of the network. Headquartered in Columbus, Ohio, USA, Vertiv employs around 34,000 people and does business in more than 130 countries. Visit Vertiv.com to learn more.   

Work Authorization

No calls or agencies please. Vertiv will only employ those who are legally authorized to work in the United States. This is not a position for which sponsorship will be provided. Individuals with temporary visas such as E, F-1, H-1, H-2, L, B, J, or TN or who need sponsorship for work authorization now or in the future, are not eligible for hire.

Equal Opportunity Employer

Vertiv is an Equal Opportunity/Affirmative Action employer. We promote equal opportunities for all with respect to hiring, terms of employment, mobility, training, compensation, and occupational health, without discrimination as to age, race, color, religion, creed, sex, pregnancy status (including childbirth, breastfeeding, or related medical conditions), marital status, sexual orientation, gender identity / expression (including transgender status or sexual stereotypes), genetic information, citizenship status, national origin, protected veteran status, political affiliation, or disability. If you have a disability and are having difficulty accessing or using this website to apply for a position, you can request help by sending an email to help.join@vertiv.com.

#LI-RB1

Work Authorization

No calls or agencies please. Vertiv will only employ those who are legally authorized to work in the United States. This is not a position for which sponsorship will be provided. Individuals with temporary visas such as E, F-1, H-1, H-2, L, B, J, or TN or who need sponsorship for work authorization now or in the future, are not eligible for hire.

Equal Opportunity Employer

We promote equal opportunities for all with respect to hiring, terms of employment, mobility, training, compensation, and occupational health, without discrimination as to age, race, color, religion, creed, sex, pregnancy status (including childbirth, breastfeeding, or related medical conditions), marital status, sexual orientation, gender identity / expression (including transgender status or sexual stereotypes), genetic information, citizenship status, national origin, protected veteran status, political affiliation, or disability.

What Vertiv employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom