1

Multimodal Learning Jobs in Virginia (NOW HIRING)

Multimodal learning * Reasoning models * Large language models (LLMs) * Computer vision or geospatial AI * Strong programming skills in Python , with experience using modern ML frameworks such as ...

Applied AI Scientist

Herndon, VA · On-site

$146K - $244K/yr

Multimodal learning * Reasoning models * Large language models (LLMs) * Computer vision or geospatial AI * Strong programming skills in Python , with experience using modern ML frameworks such as ...

... multimodal intelligence workflows. This role is execution-focused and suited for engineers with strong foundations in computer vision, image processing, and machine learning who want to apply their ...

Image & Computer Vision AI Engineer

Reston, VA · On-site

$119K - $143K/yr

... multimodal intelligence workflows. This role is execution-focused and suited for engineers with strong foundations in computer vision, image processing, and machine learning who want to apply their ...

Software Engineer II

Herndon, VA · On-site

$100K - $137K/yr

Develop and implement evaluation frameworks for multimodal model performance, including task ... Must be willing to work in SCIF daily or as needed * 5+ years of professional machine learning ...

Software Engineer II

Herndon, VA · On-site +1

$100K - $137K/yr

Develop and implement evaluation frameworks for multimodal model performance, including task ... Must be willing to work in SCIF daily or as needed * 5+ years of professional machine learning ...

AI Developer

Mclean, VA · On-site +1

$145K - $185K/yr

... multimodal solutions, and custom machine learning models. The AI Developer / Product SME will work closely with engineering, product, UX, evaluation, governance, and client leadership to define AI ...

AI Developer

Mclean, VA

$145K - $185K/yr

... multimodal solutions, and custom machine learning models. The AI Developer / Product SME will work closely with engineering, product, UX, evaluation, governance, and client leadership to define AI ...

next page

Showing results 1-20

Multimodal Learning information

What is multimodal learning?

Multimodal learning is an area of machine learning that involves integrating and processing information from multiple types of data, such as text, images, audio, and video. The goal is to create models that can understand and make predictions based on more than one data modality, similar to how humans use various senses. This approach is used in applications like speech recognition with visual cues, image captioning, and video analysis. By combining different data types, multimodal learning systems can achieve better accuracy and more robust understanding.

What is the difference between Multimodal Learning vs Data Scientist?

AspectMultimodal LearningData Scientist
Required CredentialsAdvanced degrees in AI, Machine Learning, or Computer ScienceBachelor's or Master's in Data Science, Statistics, or related fields
Work EnvironmentResearch labs, AI development teams, academiaBusiness, tech companies, analytics teams
Industry UsageAI research, multimedia applications, roboticsData analysis, predictive modeling, business insights

Multimodal Learning focuses on developing AI models that process and integrate multiple data types like images, text, and audio. Data Scientists analyze data to extract insights, build models, and support decision-making. While both roles involve data and algorithms, Multimodal Learning is specialized in AI model development for complex data integration, whereas Data Scientists work broadly across data analysis and interpretation.

What are the key skills and qualifications needed to thrive as a Multimodal Learning Specialist, and why are they important?

To excel as a Multimodal Learning Specialist, you need a solid background in machine learning, data science, and computer vision, often supported by an advanced degree in a related field. Familiarity with deep learning frameworks like TensorFlow or PyTorch, experience integrating data from diverse sources (e.g., text, audio, images), and knowledge of relevant algorithms are crucial. Strong problem-solving abilities, creativity, and effective collaboration are standout soft skills for this role. These competencies are vital for developing innovative models that can process and interpret complex, multi-source data to drive impactful AI solutions.

What are some common challenges faced by professionals working in multimodal learning roles, and how can they be addressed?

Professionals in multimodal learning frequently encounter challenges related to integrating and aligning data from multiple sources, such as text, images, audio, or video. Ensuring data quality and consistency across modalities can be complex, and developing models that effectively combine heterogeneous information often requires advanced technical skills and innovative thinking. Collaboration with domain experts and other data scientists is key to overcoming these obstacles, as is staying up to date with the latest research and tools in machine learning. Regular team meetings and cross-disciplinary workshops can help foster a collaborative environment and promote knowledge sharing.
What cities in Virginia are hiring for Multimodal Learning jobs? Cities in Virginia with the most Multimodal Learning job openings:

Senior Machine Learning Research Scientist - Frontier Lab

Carnegie Mellon University

Arlington, VA • On-site

$113K - $144K/yr

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Posted 3 days ago


Carnegie Mellon University rating

8.6

Company rating: 8.6 out of 10

Based on 24 frontline employees who took The Breakroom Quiz

53rd of 539 rated colleges and universities


Job description

What We Do

At the SEI AI Division, we conduct research in applied artificial intelligence and the engineering challenges related to building, deploying, and sustaining AI-enabled systems for high-impact government missions.

TheFrontier Labadvances AI engineering and transitions frontier AI capabilities to government stakeholders through applied research, rapid prototyping, short-cycle TEVV, and technical advisory.

Position Summary

As a Senior Machine Learning Research Scientist in the Frontier Lab, you will serve as a senior individual contributor and technical leader, shaping and executing applied research and prototype capability development for government andDoWmissions.This role spans the research-engineering spectrum: someSRMLRS hires may lean more research-heavy and others more engineering-heavy, but successful candidates collaborate effectively across both.

You willoperatewith high autonomy, represent technical work with customers and stakeholders, and help guide Frontier Lab research direction-whileremaininghands-on in development, evaluation, and delivery. Your work may span Frontier Lab focus areas such as:

  • Agentic AI for mission workflows (e.g., planning, analysis, decision support) where autonomous and human-guided agents interact with tools, data systems, and operators.

  • AI test, evaluation, verification, and validation (TEVV) to improve confidence in performance, robustness, uncertainty, and trustworthiness of ML-enabled systems.

  • Mission-tailored language models, including techniques to improve accuracy and reliability, reduce hallucinations, and integrate structured knowledge for operational tasks.

  • Mission modalities and multimodal learning, including sensor fusion and learning under noisy, sparse, or constrained data conditions (including synthetic data and weakly-/self-supervised approaches).

  • AI at the tactical edge, enabling capability under constrained compute/connectivity through efficient inference, compression, rapid adaptation, and update/redeploy patterns.

Key Responsibilities / Duties

Senior MLRS staff are expected tooperatewith a high degree of autonomy and technical ownership whileremaininghands-on in development, evaluation, and delivery.

  • Mission-context execution: Execute work within the operational context-understanding users, workflows, constraints, success criteria, and outcomes-so technical decisions are grounded in real mission needs.

  • Technical leadership / Tech lead: Lead technical execution by defining technical tasking, sequencing work into realistic milestones,maintainingdelivery quality, and delegating appropriately across the team.

  • Applied research and prototyping: Design and run studies, build convincingprototypesand reference implementations, and produce evidence-backed insights that can be matured and transitioned into operational settings.

  • Evaluation, assurance, and evidence:Establishcredible evaluation strategies and test pipelines that assess performance, robustness, reliability, and trustworthiness in mission-representative scenarios.

  • Customer-facing technical ownership: Serve as the primary technical interface whenappropriate; translate mission goals into measurable technical outcomes; communicate progress, decisions, and risks clearly to stakeholders.

  • Mentorship and talent development: Proactively mentor junior staff and teammates, raising the bar for research rigor, engineering practice, and delivery habits across project teams.

  • State-of-the-artawareness and agenda shaping:Maintainstrong awareness of frontier developments aligned to the Frontier Lab, share insights with the lab, and help shape research directions and future work selection.

  • Self-direction and time management: Manage multiple priorities effectively, sustain steady execution cadence, and resolve blockers with minimal oversight.

  • Community building (internal and external): Build a strong research culture through internal talks, reading groups, and workshops; and engage with external AI/ML communities (professional societies, consortiums, working groups, and conferences) to strengthen collaboration pathways and keep the lab connected to emerging practice.

Requirements

  • Education / Experience

  • BSin Computer Science, Electrical Engineering, Statistics, or related field with10 yearsof relevant experience; OR MSwith8 yearsof relevant experience;OR PhDwith5 yearsof relevant experience.

  • Deepexpertisein one or more Frontier Lab-aligned areas (agentic systems, LLM reliability/evaluation, CV evaluation, robustness/assurance, TEVV pipelines, multimodal learning, edge ML).

  • Strong engineering capability- canbuild andmaintainhigh-quality prototypes, evaluation infrastructure, and repeatable experimentation workflows.

  • Strong written and verbal communication skills; able torepresenttechnical work credibly to senior stakeholders.

  • Demonstrated ability to lead technical workstreams and coordinate multi-person execution.

Knowledge, Skills, & Abilities (KSAs)

  • Technical judgment:Makes sound architectural and methodological decisions; balances ambition with mission constraints.

  • Customer translation:Converts mission needs into tractable technical plans, measurable success criteria, and credible evaluation evidence.

  • Scientific leadership:Maintainsrigor;identifiesflawed assumptions; improves evaluation quality and research practices.

  • Mentorship & influence:Elevates team performance through hands-on guidance and strong technical standards.

  • Initiative:Proactivelyidentifiesrisks/opportunities, proposes new work, and creates alignment without directive management.

  • Self-direction and time management: Plans work effectively under ambiguity,maintainsexecution cadence, and escalates risks early.

Desired Experience

  • Leading applied research projects resulting ineffectiveprototypes, mission-relevant evaluation outcomes, or transitioned methods.

  • Publications at strong venues (e.g.,NeurIPS/ ICLR / ICML, relevant workshops, MLCON), and/or demonstrable impact through applied research artifacts (benchmarks, evaluation suites, open-source, technical reports).

  • Designing and operating TEVV efforts including evaluation pipelines, robustness analysis, calibration/uncertainty work, regression suites, and scenario-based evaluation protocols.

  • Building agentic capabilities integrated with tools, data systems, and human workflows (decision support, planning, analytic contexts).

  • Experience with secure or operational environments and delivery constraints typical of government settings.

  • Experience shaping a technical roadmap or research portfolio aligned to sponsor priorities and lab strategy.

Other Requirements

  • Flexible to travel to SEI offices inPittsburgh, PAandWashington, DC / Arlington, VA, sponsor sites, conferences, and offsite meetings (~10% travel).

  • You must be able and willing to work onsite at an SEI office in Pittsburgh, PA or Arlington, VA 5 days per week.

  • You will be subject to a background investigation and must be eligible to obtain andmaintaina Department of War)security clearance.

Joining the CMU team opens the door to an array of exceptional benefits.

Benefits eligible employees enjoy a wide array of benefits including comprehensive medical, prescription, dental, and vision insurance as well as a generous retirement savings program with employer contributions. Unlock your potential with tuition benefits, take well-deserved breaks with ample paid time off and observed holidays, and rest easy with life and accidental death and disability insurance.

Additional perks include a free Pittsburgh Regional Transit bus pass, access to our Family Concierge Team to help navigate childcare needs, fitness center access, and much more!

For a comprehensive overview of the benefits available, explore our Benefits page.

At Carnegie Mellon, we value the whole package when extending offers of employment. Beyond credentials, we evaluate the role and responsibilities, your valuable work experience, and the knowledge gained through education and training. We appreciate your unique skills and the perspective you bring. Your journey with us is about more than just a job; it's about finding the perfect fit for your professional growth and personal aspirations.

Are you interested in an exciting opportunity with an exceptional organization?! Apply today!

Location

Arlington, VA, Pittsburgh, PA

Job Function

Software/Applications Development/Engineering

Position Type

Staff - Regular

Full Time/Part time

Full time

Pay Basis

Salary

More Information:

  • Please visit "Why Carnegie Mellon" to learn more about becoming part of an institution inspiring innovations that change the world.

  • Click here to view a listing of employee benefits

  • Carnegie Mellon University is an Equal Opportunity Employer/Disability/Veteran.

  • Statement of Assurance


What Carnegie Mellon University employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom