Senior Software Engineer โ AI / Java
Employment Type: Full-Time
Location: Boston MA- Hybrid
About BigRio
BigRio is a trusted data, analytics, AI, and cloud partner specializing in healthcare and life sciences. We help healthcare organizations modernize platforms, optimize revenue cycle operations, and deliver intelligent, AI-driven solutions at scale.
BigRio is partnering with a Leading Healthcare Technology Company on this full-time opportunity.
Role Overview
We are looking for a Senior Software Engineer โ AI / Java with exceptionally strong development fundamentals and deep LLM/GenAI experience to join the Leading Healthcare Technology Company Collector team.
The Collector team builds technology solutions that automate Revenue Cycle Management (RCM), implementing core medical back-office workflows to support complex claims processing and healthcare operations.
This is a hybrid role, with Friday as a required in-office day.
Key Responsibilities
- Design, develop, and deliver high-quality, production-grade Java backend services, integrated with LLM-powered and GenAI-driven components
- Build and maintain scalable, secure, and performant Java applications using Spring Boot, REST APIs, relational and NoSQL databases
- Architect and integrate AI-driven microservices and RAG-based systems using OpenAI, Azure OpenAI, Hugging Face, LangChain, and LlamaIndex
- Collaborate closely with AI engineers to implement vector databases (Pinecone, FAISS, ChromaDB) and advanced retrieval pipelines
- Develop and optimize LLM prompt engineering strategies, embedding pipelines, and AI-enhanced workflows for healthcare and RCM use cases
- Own backend performance considerations including model inference latency, API rate limits, scalability, and fault tolerance
- Participate actively in Agile ceremonies, sprint planning, technical design discussions, and rigorous code reviews
- Ensure adherence to AI governance, ethical AI practices, and security/compliance standards (HIPAA, GDPR, SOC2)
- Support AI model evaluation and benchmarking using metrics such as BLEU, ROUGE, cosine similarity, and custom domain metrics
- Partner cross-functionally with product, frontend, and data teams to deliver end-to-end AI-enabled features
Typical Qualifications
- 4+ years of hands-on software engineering experience, with very strong core development skills in enterprise/backend systems
- Proven, hands-on experience working with LLMs and AI/GenAI in production environments
- Bachelor's Degree (or equivalent experience) in Computer Science, Engineering, or a related field
- Strong proficiency in Java, Spring Boot, REST APIs, and relational & NoSQL databases
- Deep experience with LLM frameworks and APIs including OpenAI GPT, Azure OpenAI, Hugging Face Transformers, LangChain, and LlamaIndex
- Strong understanding of RAG architectures, embeddings, prompt engineering, and vector similarity search (Pinecone, FAISS, ChromaDB)
- Experience designing and optimizing AI-powered backend services with a focus on scalability, latency, and reliability
- Familiarity with CI/CD pipelines, Unix/Linux environments, and Agile development practices
- Nice to Have: Experience with React on the frontend to support full-stack collaboration
- Excellent problem-solving skills, strong communication abilities, and a collaborative mindset