Senior Remote Prompt Engineering Jobs in Milwaukee, WI

Required Qualifications

We are looking for a senior engineer who has shipped AI/ML and GenAI systems in production and can operate as a technical leader within a product scrum team.

AI/ML Engineering

• 7+ years of software engineering experience, with at least 5 years building and deploying AI/ML systems in production

• Hands-on experience with the full ML lifecycle: data preparation, model training, evaluation, deployment, monitoring, and retraining

• Strong foundation in machine learning fundamentals - supervised/unsupervised learning, time-series modeling, anomaly detection, and predictive analytics

• Proficiency in Python and relevant ML frameworks (PyTorch, TensorFlow, scikit-learn, or equivalent)

• Experience with MLOps tooling: experiment tracking, model registries, deployment pipelines, and observability

GenAI & LLM Development

• Hands-on experience building production applications across multiple LLM providers (e.g., Anthropic, OpenAI, AWS Bedrock, Azure OpenAI, and open-source models)

• Working knowledge of RAG architectures, vector databases, embedding pipelines, and retrieval strategies

• Experience with agentic frameworks, multi-agent orchestration, and tool-calling patterns - including emerging standards like Model Context Protocol (MCP) (e.g., LangGraph, CrewAI, LlamaIndex, or custom implementations)

• Strong evaluation discipline: ability to design, run, and reason about LLM evaluation pipelines - including eval datasets, LLM-as-judge techniques, and regression testing for prompts and model behavior

• Experience with LLM observability and tracing - instrumenting model calls, tool calls, and retrievals in production (e.g., LangSmith, LangFuse, or OpenTelemetry GenAI conventions)

Engineering Craft

• Strong software engineering fundamentals: clean code, system design, API development, and distributed systems

• Experience with cloud platforms (Azure preferred) and containerized deployment (Docker, Kubernetes)

• Comfortable working in an agile scrum team - shipping iteratively, participating in design reviews, and writing code others can maintain

• Ability to communicate technical concepts clearly to non-technical stakeholders and influence product decisions with data

Preferred Qualifications

• Experience in industrial, OT, IoT, or building automation environments

• Familiarity with time-series data platforms and protocols such as BACnet, MQTT, or OPC UA

• Experience with edge AI deployment and latency-constrained inference environments

• Background in energy systems, HVAC, fault detection & diagnostics, or predictive maintenance use cases

• Experience mentoring engineers or leading technical initiatives within a product team

• Familiarity with cybersecurity considerations in OT/IoT environments

• Experience implementing AI safety guardrails, content filtering, and governance controls for production GenAI systems

• Experience with LLM cost optimization - model selection, caching, token efficiency, and routing strategies

What Success Looks Like

• AI/ML and GenAI features you build are shipping in our smart building products and delivering measurable value to customers

• Developer tooling and AI-assisted workflows you introduce meaningfully reduce cycle time for the Controls SW team

• Engineers you mentor are independently applying AI/ML and GenAI patterns to new problems

• You are a trusted technical voice on the team - shaping how AI is designed, prioritized, and built across the roadmap

• The team's capacity to run AI-powered programs grows directly because of your presence

Why Johnson Controls

• Work on AI problems that have direct physical impact - buildings that use less energy, run more reliably, and operate more safely

• Join a team that is actively investing in AI as a core product capability, not a side project

• Collaborate with a multidisciplinary team of engineers, data scientists, product managers, and domain experts in building automation

• Competitive compensation, benefits, and career growth within a global engineering organization

SALARY RANGE: $85,000 - $127,000 (Salary to be determined by the education, experience, knowledge, skills, and abilities of the applicant, internal equity, and alignment with market data.) This position includes a competitive benefits package. The posted salary range reflects the target compensation for this role. However, we recognize that exceptional candidates may bring unique skills and experiences that exceed the typical profile. If you believe your background warrants consideration beyond the stated range, we encourage you to apply. To support an efficient and fair hiring process, we may use technology assisted tools, including artificial intelligence (AI), to help identify and evaluate candidates. All hiring decisions are ultimately made by human reviewers. For details, please visit the About Us tab on the Johnson Controls Careers site at https://jobs.johnsoncontrols.com/about-us