Prompt Engineer
The Aetna IT Delivery organization, part of CVS Healthโs Data, Digital, Analytics, Technology (DDAT) division, is seeking a skilled and innovative Prompt Engineer to join our AI development team. This role focuses on crafting and optimizing prompts for a conversational AI chatbot that supports healthcare members and providers in accessing accurate, timely information.
Key Responsibilities
- Develop and iterate on prompt strategies for LLM-based agents
- Ensure prompts are contextually accurate, domain-specific, and aligned with end user (member or provider) needs.
- Collaborate with healthcare SMEs, developers, and product teams to build effective conversational flows.
- Analyze chatbot performance and iterate on prompt strategies using user feedback and analytics.
- Maintain prompt libraries and documentation for healthcare use cases (e.g., benefits, claims, coverage).
- Ensure compliance with HIPAA and other healthcare data privacy regulations.
- Work closely with designers, engineers, and data scientists to align prompt design with conversational flows
- Conduct A/B testing and usability studies to enhance chatbot interactions.
Required Qualifications
- Bachelorโs or Masterโs degree in Computer Science, Linguistics, AI/ML, or related field.
- 2+ years of experience in working with LLMs, prompt engineering and tuning techniques
- Experience with IBM Watsonx or Google Dialogflow / Vertex AI.
- Strong understanding of healthcare terminology and workflows.
- Proficiency in Python and version control systems (e.g., Git).
- Excellent communication and analytical skills.
Preferred Qualifications & Programming Languages
- Experience with agentic AI architectures and multi-agent orchestration.
- Knowledge of retrieval-augmented generation (RAG) and vector databases.
- Experience in healthcare provider or payer environments.
- Familiarity with regulatory frameworks (HIPAA, HITECH).
- Experience with chatbot analytics and UX testing tools.
- Python โ for scripting, data analysis, and integration with AI platforms.
- JavaScript/TypeScript โ for chatbot front-end and middleware development.
- Node.js โ for backend services and API integration.
- Java โ especially for IBM Watson integrations.
- Go or Kotlin โ for scalable microservices (optional but beneficial).
Bachelorโs degree in Computer Science, Engineering, or related field, or equivalent experience required.