2

Remote Prompt Engineering Jobs in Milwaukee, WI (NOW HIRING)

This is a hybrid/remote role that is flexible on location so long as there is flexibility to travel ... Implement RAG architectures, agentic workflows, and prompt engineering patterns for production ...

Remote Prompt Engineering information

See Milwaukee, WI salary details

$17

$32

$47

How much do remote prompt engineering jobs pay per hour?

As of Aug 27, 2026, the average hourly pay for remote prompt engineering in Milwaukee, WI is $32.57, according to ZipRecruiter salary data. Most workers in this role earn between $26.06 and $37.64 per hour, depending on experience, location, and employer.

What is remote prompt engineering?

Remote prompt engineering is the practice of designing and refining prompts for AI language models, such as ChatGPT, while working from a remote location. Prompt engineers craft instructions or questions to optimize the model’s responses for specific tasks or applications. This role typically involves understanding both the capabilities and limitations of AI systems, as well as the needs of end users or clients. Remote prompt engineers collaborate online with teams and may work for tech companies, research organizations, or as independent contractors.

What are the key skills and qualifications needed to thrive as a remote prompt engineer?

To thrive as a Remote Prompt Engineer, you need a strong background in natural language processing, programming (often Python), and an understanding of AI/ML concepts, typically supported by a relevant degree or industry experience. Familiarity with large language models (like OpenAI's GPT), prompt optimization tools, and version control systems such as Git is common. Creativity, problem-solving, and strong written communication are vital soft skills for designing effective prompts and collaborating remotely. These skills ensure the development of high-performing AI solutions and seamless teamwork in distributed environments.

What are some common challenges faced by remote prompt engineers, and how can they be addressed?

Remote prompt engineers often face challenges related to communication and collaboration, especially when working across time zones and with interdisciplinary teams. Staying updated on rapidly evolving AI technologies and understanding nuanced user requirements can also be demanding. To address these, prompt engineers can leverage collaborative tools, maintain clear documentation, and participate in regular team syncs. Building a habit of continuous learning and engaging in knowledge-sharing sessions helps keep skills relevant and fosters a sense of connection despite remote work.

What is the difference between Remote Prompt Engineering vs Remote Data Annotation Specialist?

AspectRemote Prompt EngineeringRemote Data Annotation Specialist
Required CredentialsBasic understanding of AI, NLP, and scripting skillsAttention to detail, familiarity with annotation tools, no formal certifications required
Work EnvironmentCollaborative with AI/ML teams, remote setupIndependent annotation tasks, remote or on-site
Industry UsageAI development, NLP projects, machine learningData labeling for AI training datasets
Search & Comparison IntentUnderstanding roles in AI development, job requirementsData labeling jobs, annotation tasks, related roles

Remote Prompt Engineering involves designing and refining prompts for AI models, requiring some technical skills and collaboration with AI teams. In contrast, Remote Data Annotation Specialists focus on labeling data to train AI systems, emphasizing attention to detail. Both roles are essential in AI development but differ in skills and daily tasks.

What are the most commonly searched types of Prompt Engineering jobs in Milwaukee, WI?

The most popular types of Prompt Engineering jobs in Milwaukee, WI are:

What are popular job titles related to Remote Prompt Engineering jobs in Milwaukee, WI?

For Remote Prompt Engineering jobs in Milwaukee, WI, the most frequently searched job titles are:

What cities near Milwaukee, WI are hiring for Remote Prompt Engineering jobs?

Cities near Milwaukee, WI with the most Remote Prompt Engineering job openings:

Infographic showing various Remote Prompt Engineering job openings in Milwaukee, WI as of August 2026, with employment types broken down into 88% Full Time, 7% Part Time, 4% Contract, and 1% Nights. Highlights an 87% Physical, 4% Hybrid, and 9% Remote job distribution, with an average salary of $67,745 per year, or $32.6 per hour.

AI Engineer

Johnson Controls

Glendale, WI • On-site, Remote

Full-time

Medical, Dental, Vision, Retirement, PTO

Re-posted 5 days ago


Johnson Controls rating

8.0

Company rating: 8.0 out of 10

Based on 412 frontline employees who took The Breakroom Quiz

137th of 544 rated manufacturers


Job description

Build your best future with the Johnson Controls team!

**We require candidates to be U.S. Citizens and/or permanent residents of the United States. Sponsorship is not available for this role.
** Professional fluency in English (written and spoken) is required, as this role involves regular communication with customers, business partners, and colleagues in English.

Who we are:

Johnson Controls is global leader in smart, healthy, and sustainable buildings. Our mission is to reimagine the performance of buildings to serve people, places, and the planet. Join a winning team that enables you to build your best future! Our teams are uniquely positioned to support a multitude of industries across the globe. You will have the opportunity to develop yourself through meaningful work projects and learning opportunities. We strive to provide our employees with an experience focused on supporting their physical, financial, and emotional wellbeing. Become a member of the Johnson Controls family and thrive in an empowering company culture where your voice and ideas will be heard - your next great opportunity is just a few clicks away!

What We Offer:

  • Competitive salary

  • Paid vacation/holidays/sick time

  • Comprehensive benefits package including 401K, medical, dental, and vision care.

  • On-the-job/cross-training opportunities

  • Encouraging and collaborative team environment

  • Dedication to safety through our Zero Harm policy

**This is a hybrid/remote role that is flexible on location so long as there is flexibility to travel to WI on a somewhat frequent basis.

About This Role

Johnson Controls is bringing AI into the way the world's most demanding buildings operate - from datacenters and hospitals to pharmaceutical facilities and commercial campuses. We are transforming our smart building products into AI-native platforms that can reason about building operations, assist operators intelligently, and accelerate how our engineering teams build and ship software.

This AI/ML Engineer role sits at the center of that transformation. You will do two things in roughly equal measure: build production AI/ML and GenAI capabilities directly into our smart building products, and raise the AI engineering capability of the broader Controls Software team so we can run more programs, faster, with AI embedded in how we work.

You will be embedded in a scrum team in Milwaukee, working hands-on with engineers, data scientists, and product managers. You will become a key technical voice on how AI is designed, built, and deployed across the Controls Software portfolio.

What You'll Do

Your work falls into two equally weighted pillars:

Pillar 1 - Build AI Products

Pillar 2 - Accelerate the Team

AI/ML & GenAI Engineering

  • Design, build, and deploy AI/ML models and GenAI capabilities into our smart building products across cloud, edge, and on-prem environments

  • Develop LLM-powered features including operator copilots, intelligent alarm management, and natural language interfaces for building operations

  • Build and maintain data pipelines, model integration layers, and inference infrastructure for real-time BAS use cases

  • Implement RAG architectures, agentic workflows, and prompt engineering patterns for production GenAI applications

  • Contribute to MLOps practices: model versioning, monitoring, evaluation, and continuous improvement pipelines

Team Capability & Velocity

  • Identify and implement AI-assisted developer tooling to accelerate product development - code generation, test automation, CI/CD intelligence, and review workflows

  • Mentor engineers on the team in AI/ML and GenAI engineering practices, elevating team capability over time

  • Define and document reusable AI engineering patterns, reference implementations, and best practices the team can build against

  • Partner with data scientists and architects to translate research and prototypes into production-ready systems

  • Contribute to roadmap and scoping conversations by bringing AI feasibility and complexity assessments grounded in hands-on experience

Required Qualifications

We are looking for a senior engineer who has shipped AI/ML and GenAI systems in production and can operate as a technical leader within a product scrum team.

AI/ML Engineering

  • 7+ years of software engineering experience, with at least 5 years building and deploying AI/ML systems in production

  • Hands-on experience with the full ML lifecycle: data preparation, model training, evaluation, deployment, monitoring, and retraining

  • Strong foundation in machine learning fundamentals - supervised/unsupervised learning, time-series modeling, anomaly detection, and predictive analytics

  • Proficiency in Python and relevant ML frameworks (PyTorch, TensorFlow, scikit-learn, or equivalent)

  • Experience with MLOps tooling: experiment tracking, model registries, deployment pipelines, and observability

GenAI & LLM Development

  • Hands-on experience building production applications across multiple LLM providers (e.g., Anthropic, OpenAI, AWS Bedrock, Azure OpenAI, and open-source models)

  • Working knowledge of RAG architectures, vector databases, embedding pipelines, and retrieval strategies

  • Experience with agentic frameworks, multi-agent orchestration, and tool-calling patterns - including emerging standards like Model Context Protocol (MCP) (e.g., LangGraph, CrewAI, LlamaIndex, or custom implementations)

  • Strong evaluation discipline: ability to design, run, and reason about LLM evaluation pipelines - including eval datasets, LLM-as-judge techniques, and regression testing for prompts and model behavior

  • Experience with LLM observability and tracing - instrumenting model calls, tool calls, and retrievals in production (e.g., LangSmith, LangFuse, or OpenTelemetry GenAI conventions)

Engineering Craft

  • Strong software engineering fundamentals: clean code, system design, API development, and distributed systems

  • Experience with cloud platforms (Azure preferred) and containerized deployment (Docker, Kubernetes)

  • Comfortable working in an agile scrum team - shipping iteratively, participating in design reviews, and writing code others can maintain

  • Ability to communicate technical concepts clearly to non-technical stakeholders and influence product decisions with data

Preferred Qualifications

  • Experience in industrial, OT, IoT, or building automation environments

  • Familiarity with time-series data platforms and protocols such as BACnet, MQTT, or OPC UA

  • Experience with edge AI deployment and latency-constrained inference environments

  • Background in energy systems, HVAC, fault detection & diagnostics, or predictive maintenance use cases

  • Experience mentoring engineers or leading technical initiatives within a product team

  • Familiarity with cybersecurity considerations in OT/IoT environments

  • Experience implementing AI safety guardrails, content filtering, and governance controls for production GenAI systems

  • Experience with LLM cost optimization - model selection, caching, token efficiency, and routing strategies

What Success Looks Like

  • AI/ML and GenAI features you build are shipping in our smart building products and delivering measurable value to customers

  • Developer tooling and AI-assisted workflows you introduce meaningfully reduce cycle time for the Controls SW team

  • Engineers you mentor are independently applying AI/ML and GenAI patterns to new problems

  • You are a trusted technical voice on the team - shaping how AI is designed, prioritized, and built across the roadmap

  • The team's capacity to run AI-powered programs grows directly because of your presence

Why Johnson Controls

  • Work on AI problems that have direct physical impact - buildings that use less energy, run more reliably, and operate more safely

  • Join a team that is actively investing in AI as a core product capability, not a side project

  • Collaborate with a multidisciplinary team of engineers, data scientists, product managers, and domain experts in building automation

  • Competitive compensation, benefits, and career growth within a global engineering organization

SALARY RANGE: $85,000 - $127,000 (Salary to be determined by the education, experience, knowledge, skills, and abilities of the applicant, internal equity, and alignment with market data.) This position includes a competitive benefits package. The posted salary range reflects the target compensation for this role. However, we recognize that exceptional candidates may bring unique skills and experiences that exceed the typical profile. If you believe your background warrants consideration beyond the stated range, we encourage you to apply. To support an efficient and fair hiring process, we may use technology assisted tools, including artificial intelligence (AI), to help identify and evaluate candidates. All hiring decisions are ultimately made by human reviewers. For details, please visit the About Us tab on the Johnson Controls Careers site at https://jobs.johnsoncontrols.com/about-us

Johnson Controls International plc. is an equal employment opportunity and affirmative action employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, protected veteran status, genetic information, sexual orientation, gender identity, status as a qualified individual with a disability or any other characteristic protected by law. To view more information about your equal opportunity and non-discrimination rights as a candidate, visit EEO is the Law. If you are an individual with a disability and you require an accommodation during the application process, please visit here.


What Johnson Controls employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


Johnson Controls logo

About Johnson Controls

Sourced by ZipRecruiter

Johnson Controls is a world leader in smart buildings, creating safe, healthy and sustainable spaces. For nearly 140 years, we’ve made buildings better and now we’re transforming them again with our award-winning digital technologies and services. We’re using artificial intelligence and data driven solutions to give you deeper insight into your building’s health, sustainability and performance. It’s changing the way we design, operate and maintain indoor environments and driving to a new era of autonomous buildings. We deliver the blueprint of the future for industries such as healthcare, schools, data centers, airports, stadiums, hotels, manufacturing and beyond through OpenBlue, our comprehensive suite of connected solutions. Johnson Controls offers the world’s largest portfolio of building technology, software and services. Supported by a team of more than 100,000 dedicated employees working across 150 countries, we’re helping customers achieve their sustainability goals and power their mission.

Industry

Machinery manufacturing, water transportation, public safety statistics centers and offices and manufacturing

Company size

10,000+ Employees

Headquarters location

Milwaukee, WI, US