Search Quality Rater Jobs in Gaithersburg, MD (NOW HIRING)

International Consulting Associates, Inc. is a rapidly growing company, located in the D.C./Metro area. We were founded in 2009 to assist government clients with evaluating and achieving their objectives. We have become a trusted advisor helping our clients by offering cutting‑edge innovation and solutions to complex projects. Our small company has grown significantly, and we're overjoyed at the opportunity to expand yet again!

We are results-focused and have a proven track record supporting federal agencies and large government services primes in three main areas: Research and Data Analysis, Advanced‑Data Science, and Strategic Services. We currently support multiple analytics and research programs across HHS.

At ICA, we believe our success starts with our people. We foster a collaborative \"one team\" environment where work-life balance isn't just talked about – it's prioritized. We're building dynamic, highly skilled teams in a welcoming and supportive atmosphere. If you're passionate about using your technical expertise to make a difference, we want to talk to you.

We are looking for a Senior Product Manager, Data & AI to join our growing team!

We are hiring a Senior Product Manager, Data & AI to own the product roadmap and priorities across the full document intelligence platform. You will translate customer and reviewer needs into clear, testable requirements and ensure problems are solved at the correct layer, whether that is the user experience, source data, extraction pipeline, model, search logic, thresholds, or business rules.

This role is well suited to a product leader who understands that AI products require measurable definitions of quality, including accuracy, false‑positive rates, reviewer effort, evidence requirements, and operational performance.

• Own the product roadmap and priorities across data engineering, data science, backend, search, and frontend teams.


• Lead discovery with clients and internal stakeholders using prototypes, demos, and working software.


• Translate business needs into product requirements, user stories, business rules, and measurable acceptance criteria.


• Define requirements for document processing, alerts, scoring, evidence presentation, search, review workflows, and source traceability.


• Partner with data scientists to define evaluation datasets, model metrics, confidence thresholds, and acceptable false‑positive and false‑negative rates.


• Work with data engineers on ingestion, normalization, metadata, lineage, processing completeness, and data‑quality requirements.


• Diagnose whether product issues originate in the UI, data, model, pipeline, search, thresholds, or business rules.


• Prioritize reusable platform capabilities over narrow, one‑off client customizations.


• Coordinate release readiness, client demonstrations, and structured feedback collection.


• Measure product performance using accuracy, completeness, reviewer effort, latency, reliability, adoption, and cost.


• Communicate priorities, tradeoffs, limitations, and delivery expectations clearly to clients and internal teams.

• Senior product management experience delivering AI/ML, data‑intensive, search, or workflow products.


• Experience prioritizing work across multiple engineering disciplines, including data, ML, backend, and frontend.


• Demonstrated success running prototype‑or demo‑driven product discovery.


• Ability to turn business needs into detailed, technical, and testable requirements.


• Experience defining measurable acceptance criteria for probabilistic features such as model outputs, alerts, recommendations, or rankings.


• Strong understanding of data pipelines, APIs, data quality, system dependencies, and model behavior.


• Experience working closely with data scientists, data engineers, software engineers, and UX teams.


• Strong stakeholder‑management, facilitation, written communication, and decision‑making skills.


• Must be authorized to work in the United States and have lived in the US for 3 or more consecutive years.


• Must be able and willing to obtain a Public Trust Clearance

• Experience with document intelligence, OCR, semantic search, vector retrieval, generative AI, or human‑in‑the‑loop workflows.


• Experience building products on AWS.


• Familiarity with services such as S3, DynamoDB, OpenSearch, Step Functions, SQS, EventBridge, Bedrock, SageMaker, or Textract.


• Experience with regulated, healthcare, medical‑device, or other high‑consequence products.


• Familiarity with model governance, explainability, evidence traceability, and reviewer workflows.


• Experience supporting multiple clients while maintaining a coherent, reusable product roadmap

All application materials must be your own original work, and interviews must be completed independently. Use of AI‑generated content in applications or AI assistance during interviews will result in disqualification.

We invest in our team members so you can live your best life professionally and personally, offering a competitive salary and benefits.

• Health Insurance -100% employer‑paid premiums – ICA covers the full cost of one of three offered medical plans


• Dental Insurance


• Vision insurance


• Health Spending Account


• Flexible Spending Account


• Life and Disability insurance


• 401(k) plan with company match


• Paid Time Off (Vacation, Sick Leave and Holidays)


• Education and Professional Development Assistance


• Remote work from anywhere within the continental United States

This is a remote position following Eastern Standard Time (EST). Candidates residing in the DMV area preferred.

ICA is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender, gender identity or expression, national origin, genetics, disability status, protected veteran status, age, or any other characteristic protected by state, federal or local laws.

This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.