Generative Ai Testing Jobs in Maryland (NOW HIRING)

Description

Leidos is seeking an experienced Senior AWS Generative AI Solution Engineer to design and implement the reasoning layer for a GenAI-enabled HUD FHA Resource Center. The selected candidate will lead development of a multi-agent solution using Amazon Bedrock, AgentCore Runtime, Knowledge Bases, Guardrails, OpenSearch Serverless, AWS Lambda, and Retrieval-Augmented Generation to support grounded voice and chat interactions.

Core Responsibilities:

• Design and implement Amazon Bedrock Agents, including a Supervisor Agent and domain-specific Sub-Agents.

• Develop Retrieval-Augmented Generation workflows using Amazon Bedrock Knowledge Bases and OpenSearch Serverless.

• Implement prompt engineering, agent routing, confidence logic, and low-confidence fallback behavior.

• Configure Bedrock Guardrails for PII redaction, prompt-injection detection, denied topics, content safety, and grounding evaluation.

• Build Lambda orchestration to connect Lex V2, Bedrock AgentCore, response generation, and human transfer decisions.

• Support session management, conversation context persistence, and cross-channel consistency for voice and chat.

• Integrate the GenAI stack with Amazon Connect, Salesforce, CloudWatch, DynamoDB, S3, SNS, IAM, and KMS.

• Lead AI testing, response quality tuning, grounding validation, and latency optimization across production-like scenarios.

Please Note: This is 100% telework/remote opportunity.  However, candidate must be/reside in the Gaithersburg, MD/Washington, DC metro area.

Required Qualifications:

• Bachelor’s degree and 8+ years of relevant experience OR Masters degree with 6+ years of relevant experience. Additional years of relevant experience may be considered and/or accepted in lieu of degree.

• 8+ years of software engineering OR cloud development experience. 

• At least 3 years of Generative AI OR LLM application development experience.

• Strong Python development skills and experience building production AWS solutions.

• Hands-on experience with Amazon Bedrock, RAG patterns, and vector-based retrieval.

• Experience with APIs, distributed systems, and secure cloud architecture.

• Ability to work effectively in a regulated government environment.

• Ability to obtain and maintain a Public Trust security clearance.

• US Citizen.

Preferred Qualifications:

• AWS certifications such as AI Practitioner, Machine Learning Specialty, OR Solutions Architect Professional.

• Experience with Amazon Bedrock Agents, AgentCore Runtime, Guardrails, and Knowledge Bases.

• Experience with Claude models, agent frameworks, or multi-agent orchestration patterns.

• Familiarity with FedRAMP environments and government AI governance requirements.

• Experience with LangChain, Strands Agents, or other agent development frameworks.

Success Measures:

• Supervisor Agent and Sub-Agents are implemented and tested across HUD service domains.

• Responses are grounded, accurate, and safely filtered through Guardrails.

• Confidence scoring and fallback behavior support reliable human escalation.

• The GenAI platform is production-ready, maintainable, and compliant with security and privacy requirements.

Target Technical Skills:  Highly Desired/Preferred Skills (Nice to Have):

• Amazon Bedrock, Bedrock Agents, Bedrock Guardrails, Bedrock Knowledge Bases, AgentCore Runtime.

• Retrieval-Augmented Generation, prompt engineering, multi-agent systems, vector search.

• AWS Lambda, Amazon Lex V2, Amazon Connect, CloudWatch.

• Python, REST APIs, JSON, CloudFormation or Terraform, CI/CD.

• OpenSearch Serverless, DynamoDB, S3, IAM, KMS.

Please Note:  The program budget salary for this role could fall anywhere between $130,000 to low/mid $150,000 with a slight wiggle room (no guarantees) based on relevant experience and assessment.  Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law. 

If you're looking for comfort, keep scrolling. At Leidos, we outthink, outbuild, and outpace the status quo — because the mission demands it. We're not hiring followers. We're recruiting the ones who disrupt, provoke, and refuse to fail. Step 10 is ancient history. We're already at step 30 — and moving faster than anyone else dares.

The Leidos pay range for this job level is a general guideline only and not a guarantee of compensation or salary. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law.

About Leidos

Leidos is an industry and technology leader serving government and commercial customers with smarter, more efficient digital and mission innovations. Headquartered in Reston, Virginia, with 47,000 global employees, Leidos reported annual revenues of approximately $16.7 billion for the fiscal year ended January 3, 2025. For more information, visit www.Leidos.com.

Pay and Benefits

Pay and benefits are fundamental to any career decision. That's why we craft compensation packages that reflect the importance of the work we do for our customers. Employment benefits include competitive compensation, Health and Wellness programs, Income Protection, Paid Leave and Retirement. More details are available at www.leidos.com/careers/pay-benefits.

Securing Your Data

Beware of fake employment opportunities using Leidos’ name. Leidos will never ask you to provide payment-related information during any part of the employment application process (i.e., ask you for money), nor will Leidos ever advance money as part of the hiring process (i.e., send you a check or money order before doing any work). Further, Leidos will only communicate with you through emails that are generated by the Leidos.com automated system – never from free commercial services (e.g., Gmail, Yahoo, Hotmail) or via WhatsApp, Telegram, etc. If you received an email purporting to be from Leidos that asks for payment-related information or any other personal information (e.g., about you or your previous employer), and you are concerned about its legitimacy, please make us aware immediately by emailing us at LeidosCareersFraud@leidos.com.

If you believe you are the victim of a scam, contact your local law enforcement and report the incident to the U.S. Federal Trade Commission.

Commitment to Non-Discrimination

All qualified applicants will receive consideration for employment without regard to sex, race, ethnicity, age, national origin, citizenship, religion, physical or mental disability, medical condition, genetic information, pregnancy, family structure, marital status, ancestry, domestic partner status, sexual orientation, gender identity or expression, veteran or military status, or any other basis prohibited by law. Leidos will also consider for employment qualified applicants with criminal histories consistent with relevant laws.

#Remote