1

Prompt Engineering Jobs in Columbus, OH (NOW HIRING)

Lead Prompt Engineering and Optimization: Design, develop, test, and continuously refine prompts and prompt templates for LLM-powered applications, establishing enterprise-wide prompt engineering ...

New

Lead AI Engineer

Columbus, OH · Remote

$152K - $190K/yr

Establishes engineering practices, coding standards, and technical processes for AI systems * Partners with ML Engineers, Prompt Engineers, and Product on cross-functional AI initiatives * Drives ...

Lead AI Engineer

Columbus, OH · On-site

$152K - $190K/yr

Establishes engineering practices, coding standards, and technical processes for AI systems * Partners with ML Engineers, Prompt Engineers, and Product on cross-functional AI initiatives * Drives ...

Lead AI Engineer

Columbus, OH · On-site

$152K - $229K/yr

Establishes engineering practices, coding standards, and technical processes for AI systems * Partners with ML Engineers, Prompt Engineers, and Product on cross-functional AI initiatives * Drives ...

Senior AI/ML Engineer

Columbus, OH · Remote

$90 - $100/hr

Build RAG pipelines, integrate vector databases, and apply prompt engineering with LangChain or LangGraph. * Develop end-to-end AI/ML/NLP plans compliant with cybersecurity policies. * Apply software ...

Build and continuously improve the agentic engineering framework - automated test generation pipelines, AI-assisted code review workflows, prompt engineering standards, and agentic workflow runbooks ...

Build and continuously improve the agentic engineering framework - automated test generation pipelines, AI-assisted code review workflows, prompt engineering standards, and agentic workflow runbooks ...

Build and continuously improve the agentic engineering framework automated test generation pipelines, AI-assisted code review workflows, prompt engineering standards, and agentic workflow runbooks ...

Deep knowledge of ChatGPT capabilities including prompt engineering, conversational AI interaction, content generation, code assistance, data analysis, creative writing applications, API integration ...

Agent Engineer

Marysville, OH · On-site +1

$140K - $164K/yr

Implement prompt engineering, guardrails, and evaluation pipelines to ensure agents meet quality, safety, and brand standards. Platform Mastery and Technical Leadership: * Become the in-house expert ...

Agent Engineer

Marysville, OH · On-site

$140K - $164K/yr

Implement prompt engineering, guardrails, and evaluation pipelines to ensure agents meet quality, safety, and brand standards. Platform Mastery and Technical Leadership: * Become the in-house expert ...

next page

Showing results 1-20

Prompt Engineering information

See Columbus, OH salary details

$31.4K

$60.8K

$92.2K

How much do prompt engineering jobs pay per year?

As of Jun 17, 2026, the average yearly pay for prompt engineering in Columbus, OH is $60,830.00, according to ZipRecruiter salary data. Most workers in this role earn between $45,400.00 and $69,500.00 per year, depending on experience, location, and employer.

What is a Prompt Engineering job?

A Prompt Engineering job involves designing, refining, and optimizing prompts to improve the performance of AI language models. Prompt engineers work with large language models (LLMs) to generate accurate, relevant, and high-quality responses. They experiment with different phrasing techniques, fine-tune AI outputs, and collaborate with developers to enhance model capabilities. This role is essential in ensuring AI systems provide reliable and useful responses for various applications.

What jobs pay $2000 a day?

In the field of prompt engineering, high-paying roles such as AI consultant or senior AI specialist can potentially earn $2000 or more per day, especially for freelancers or contractors with specialized skills in large language models and prompt design. These positions often require extensive experience, advanced knowledge of AI tools, and a strong portfolio of successful projects.

What are the key skills and qualifications needed to thrive in the Prompt Engineering position, and why are they important?

To excel in Prompt Engineering, a strong grasp of natural language processing (NLP), machine learning concepts, and analytical thinking is essential, often supported by a degree in computer science or a related field. Familiarity with AI platforms, code repositories (such as GitHub), and prompt development tools is typically required. Excellent problem-solving, creativity, and cross-functional communication skills help Prompt Engineers effectively collaborate and refine model outputs. These capabilities enable the creation of precise, effective prompts driving high-quality AI responses in rapidly evolving technical environments.

What do you do as a prompt engineer?

A prompt engineer designs and refines prompts to improve the performance of AI language models. They analyze model responses, experiment with prompt structures, and use tools like AI development platforms to ensure accurate and relevant outputs, often requiring skills in programming and understanding of natural language processing.

How much do prompt engineers make?

Prompt engineers typically earn between $80,000 and $150,000 annually, depending on experience, location, and industry. Senior roles or those with specialized skills in AI and machine learning can command higher salaries, especially in tech hubs or large organizations.

What are the most common challenges faced by Prompt Engineers in their daily work?

Prompt Engineers frequently encounter challenges such as ensuring the clarity and relevance of prompts to achieve accurate AI responses, troubleshooting inconsistent model behavior, and staying updated with evolving AI technologies. Balancing experimentation with efficiency is often essential, as iterative testing and refinement are core parts of the workflow. Collaboration with data scientists, product managers, and other engineers is common, requiring adaptability and strong communication skills. These challenges make the role dynamic and rewarding for professionals who enjoy problem-solving and innovation.

Which 3 jobs will survive AI?

Prompt engineering is a specialized role that involves designing effective prompts for AI systems, and it is expected to remain relevant as AI advances. Jobs requiring complex human judgment, creativity, and emotional intelligence—such as healthcare professionals, educators, and mental health counselors—are also likely to persist because they involve skills that AI cannot easily replicate. Additionally, roles in AI oversight, ethics, and policy development will continue to be important to ensure responsible AI use.
What are the most commonly searched types of Prompt Engineering jobs in Columbus, OH? The most popular types of Prompt Engineering jobs in Columbus, OH are:
What are popular job titles related to Prompt Engineering jobs in Columbus, OH? For Prompt Engineering jobs in Columbus, OH, the most frequently searched job titles are:
What cities near Columbus, OH are hiring for Prompt Engineering jobs? Cities near Columbus, OH with the most Prompt Engineering job openings:
AI / ML Platform Engineer

AI / ML Platform Engineer

Vertiv Co

Westerville, OH • On-site

Other

Posted yesterday


Vertiv rating

6.9

Company rating: 6.9 out of 10

Based on 60 frontline employees who took The Breakroom Quiz

305th of 418 rated machine equipment manufacturers


Job description

Job Summary

Vertiv is seeking a technically skilled and innovative AI / ML Platform Engineer to serve as the hands-on engineering lead for enterprise AI platform capabilities within Vertiv's Digital organization. This individual contributor role is responsible for supporting, administering, and extending Vertiv's production AI platforms - including Writer AI and Compass AI - while owning the development of prompt engineering standards, and AI governance frameworks that ensure responsible, compliant, and high-quality AI outputs across the enterprise. The AI / ML Platform Engineer will operate within the Digital organization and play a central role in advancing Vertiv's Operational Excellence and Customer Focus & Innovation strategic priorities by enabling scalable, governed, and production-grade generative AI capabilities that deliver measurable business value.

As an individual contributor in a lead capacity, this role extends beyond hands-on platform engineering to encompass the full lifecycle of LLM-based application delivery - from model evaluation and prompt optimization to LLMOps monitoring and cross-functional AI enablement. The AI / ML Platform Engineer will partner closely with technology and business stakeholders to define AI usage policies, evaluate emerging GenAI technologies, and ensure that all AI solutions are secure, observable, and aligned to Vertiv's enterprise architecture and data governance standards. 

This position is based onsite at Vertiv's Westerville, OH headquarters, with occasional domestic and international travel as needed.

Responsibilities:

  • Support and Administer Writer AI & Compass AI Platforms: Serve as the primary technical owner for Vertiv's Writer AI and Compass AI platform instances, managing configuration, tenant administration, integrations, user access controls, and platform health to ensure reliable, production-grade availability across the enterprise.
  • Lead Prompt Engineering and Optimization: Design, develop, test, and continuously refine prompts and prompt templates for LLM-powered applications, establishing enterprise-wide prompt engineering standards, libraries, and versioning practices that maximize model accuracy, consistency, and safety.
  • Build and Maintain RAG Pipelines: Architect and implement end-to-end Retrieval-Augmented Generation (RAG) pipelines - including document ingestion, chunking strategies, embedding generation, and vector search integration - to ground LLM outputs in authoritative Vertiv knowledge sources and reduce hallucination risk.
  • Drive AI Governance and Compliance: Define and enforce AI usage policies, content safety guardrails, data handling standards, and compliance controls across all GenAI platforms and applications, partnering with Legal, Compliance, IT Security, and NPDi teams to ensure responsible AI practices aligned to Vertiv's risk framework.
  • Operate LLMOps and Monitoring Frameworks: Implement and maintain LLMOps tooling for production AI systems, including prompt performance monitoring, output quality tracking, cost management, latency observability, and model drift detection, ensuring that AI applications remain performant, reliable, and cost-effective at scale.
  • Collaborate Cross-Functionally on AI Initiatives: Partner with technology and business stakeholders to translate requirements into technical AI solutions, provide platform consulting for new GenAI use cases, and serve as a technical subject matter expert on LLM capabilities, limitations, and integration patterns.
  • Design and Execute AI Evaluation Frameworks: Develop systematic evaluation frameworks and benchmarks for assessing LLM output quality, prompt effectiveness, RAG retrieval accuracy, and model behavior - enabling data-driven decisions on model selection, prompt iteration, and platform evolution.
  • Stay Current on GenAI Advancements: Continuously monitor advancements in generative AI, large language models, agentic AI frameworks, and enterprise AI platforms; evaluate emerging tools and techniques for applicability to Vertiv's AI roadmap and provide actionable recommendations to Digital leadership.

Requirements:

  • Bachelor's degree in Computer Science, Information Systems, Engineering, Data Science, or a related field; equivalent practical experience considered.
  • 5+ years of professional experience in software engineering, AI/ML engineering, or a related technical discipline.
  • 3+ years of hands-on experience building and deploying GenAI / LLM-based applications or platforms in a production enterprise environment.
  • Demonstrated experience with prompt engineering, RAG pipeline development, and LLM API integration in real-world production systems.
  • Experience with enterprise AI platform administration (e.g., Writer AI, Compass AI, or equivalent SaaS AI platforms) is strongly preferred.

Technical Skills

  • Proficiency in Python for AI/ML engineering, data processing, and pipeline development.
  • Hands-on experience with RAG architectures, vector search technologies (e.g., Pinecone, Weaviate, pgvector, OpenSearch), and embedding models.
  • Experience with LLM APIs and frameworks (e.g., OpenAI, Anthropic, LangChain, LlamaIndex, or equivalent) for building production AI applications.
  • Familiarity with AWS AI/ML services (SageMaker, Bedrock, or equivalent) and cloud-native deployment patterns.
  • Experience with CI/CD pipelines and DevOps tooling (Gitlab, Jenkins, GitHub Actions, Azure DevOps, or equivalent) for AI application delivery.
  • Working knowledge of prompt engineering best practices, prompt versioning, and LLMOps tooling (e.g., MLflow, LangSmith, Weights & Biases, or equivalent).

Preferred Qualifications

  • AWS AI/ML certifications (AWS Certified Machine Learning - Specialty, or AWS Certified AI Practitioner).
  • Direct hands-on experience with Writer AI and/or Compass AI platform administration and integration.
  • Familiarity with enterprise LLMOps tooling, AI observability platforms, and model evaluation frameworks.
  • Experience with Snowflake or other cloud data platforms for AI/ML data pipelines and feature engineering.
  • Exposure to AI governance frameworks, responsible AI principles, and enterprise AI policy development.
  • Experience working in Agile/Scrum delivery environments with cross-functional digital product teams.

The successful candidate will embrace Vertiv's Core Principals & Behaviors to help execute our Strategic Priorities. 

OUR CORE PRINCIPALSSafety.  Integrity.  Respect.  Teamwork.  Diversity & Inclusion.

OUR STRATEGIC PRIORITIES

  Customer Focus

  Operational Excellence

  High-Performance Culture

  Innovation

  Financial Strength

OUR BEHAVIORS

  Own It

  Act With Urgency

  Foster a Customer-First Mindset

  Think Big and Execute

  Lead by Example

  Drive Continuous Improvement

  Learn and Seek Out Development

About Vertiv

Vertiv is a $10.2 billion global critical infrastructure and data center technology company.  We ensure customers' vital applications run continuously by bringing together hardware, software, analytics and ongoing services.  Our portfolio includes power, cooling and IT infrastructure solutions and services that extends from the cloud to the edge of the network. Headquartered in Columbus, Ohio, USA, Vertiv employs around 34,000 people and does business in more than 130 countries. Visit Vertiv.com to learn more.   

Work Authorization

No calls or agencies please. Vertiv will only employ those who are legally authorized to work in the United States. This is not a position for which sponsorship will be provided. Individuals with temporary visas such as E, F-1, H-1, H-2, L, B, J, or TN or who need sponsorship for work authorization now or in the future, are not eligible for hire.

Equal Opportunity Employer

Vertiv is an Equal Opportunity/Affirmative Action employer. We promote equal opportunities for all with respect to hiring, terms of employment, mobility, training, compensation, and occupational health, without discrimination as to age, race, color, religion, creed, sex, pregnancy status (including childbirth, breastfeeding, or related medical conditions), marital status, sexual orientation, gender identity / expression (including transgender status or sexual stereotypes), genetic information, citizenship status, national origin, protected veteran status, political affiliation, or disability. If you have a disability and are having difficulty accessing or using this website to apply for a position, you can request help by sending an email to help.join@vertiv.com.

#LI-RB1

Work Authorization

No calls or agencies please. Vertiv will only employ those who are legally authorized to work in the United States. This is not a position for which sponsorship will be provided. Individuals with temporary visas such as E, F-1, H-1, H-2, L, B, J, or TN or who need sponsorship for work authorization now or in the future, are not eligible for hire.

Equal Opportunity Employer

We promote equal opportunities for all with respect to hiring, terms of employment, mobility, training, compensation, and occupational health, without discrimination as to age, race, color, religion, creed, sex, pregnancy status (including childbirth, breastfeeding, or related medical conditions), marital status, sexual orientation, gender identity / expression (including transgender status or sexual stereotypes), genetic information, citizenship status, national origin, protected veteran status, political affiliation, or disability.

What Vertiv employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom