1

Multimodal Learning Jobs in New York (NOW HIRING)

Explain multimodal modeling tradeoffs to Product and Creative stakeholders in terms of business impact, partnering with Data Science and Platform Engineering as co-owners, not handoff points

Explain multimodal modeling tradeoffs to Product and Creative stakeholders in terms of business impact, partnering with Data Science and Platform Engineering as co-owners, not handoff points

From visual perception and SLAM to multimodal sensor fusion and reinforcement learning, you'll be pushing the boundaries of what machines can perceive and do. If you are passionate about AI, robotics ...

next page

Showing results 1-20

Multimodal Learning information

What is multimodal learning?

Multimodal learning is an area of machine learning that involves integrating and processing information from multiple types of data, such as text, images, audio, and video. The goal is to create models that can understand and make predictions based on more than one data modality, similar to how humans use various senses. This approach is used in applications like speech recognition with visual cues, image captioning, and video analysis. By combining different data types, multimodal learning systems can achieve better accuracy and more robust understanding.

What is the difference between Multimodal Learning vs Data Scientist?

AspectMultimodal LearningData Scientist
Required CredentialsAdvanced degrees in AI, Machine Learning, or Computer ScienceBachelor's or Master's in Data Science, Statistics, or related fields
Work EnvironmentResearch labs, AI development teams, academiaBusiness, tech companies, analytics teams
Industry UsageAI research, multimedia applications, roboticsData analysis, predictive modeling, business insights

Multimodal Learning focuses on developing AI models that process and integrate multiple data types like images, text, and audio. Data Scientists analyze data to extract insights, build models, and support decision-making. While both roles involve data and algorithms, Multimodal Learning is specialized in AI model development for complex data integration, whereas Data Scientists work broadly across data analysis and interpretation.

What are the key skills and qualifications needed to thrive as a Multimodal Learning Specialist, and why are they important?

To excel as a Multimodal Learning Specialist, you need a solid background in machine learning, data science, and computer vision, often supported by an advanced degree in a related field. Familiarity with deep learning frameworks like TensorFlow or PyTorch, experience integrating data from diverse sources (e.g., text, audio, images), and knowledge of relevant algorithms are crucial. Strong problem-solving abilities, creativity, and effective collaboration are standout soft skills for this role. These competencies are vital for developing innovative models that can process and interpret complex, multi-source data to drive impactful AI solutions.

What are some common challenges faced by professionals working in multimodal learning roles, and how can they be addressed?

Professionals in multimodal learning frequently encounter challenges related to integrating and aligning data from multiple sources, such as text, images, audio, or video. Ensuring data quality and consistency across modalities can be complex, and developing models that effectively combine heterogeneous information often requires advanced technical skills and innovative thinking. Collaboration with domain experts and other data scientists is key to overcoming these obstacles, as is staying up to date with the latest research and tools in machine learning. Regular team meetings and cross-disciplinary workshops can help foster a collaborative environment and promote knowledge sharing.
What job categories do people searching Multimodal Learning jobs in New York look for? The top searched job categories for Multimodal Learning jobs in New York are:
What cities in New York are hiring for Multimodal Learning jobs? Cities in New York with the most Multimodal Learning job openings:
Infographic showing various Multimodal Learning job openings in New York as of July 2026, with employment types broken down into 64% Full Time, 18% Part Time, and 18% Contract. Highlights an 82% In-person, 9% Hybrid, and 9% Remote job distribution.
[EOI] Postdoctoral Associate in Multimodal AI| Professor Saining Xie

[EOI] Postdoctoral Associate in Multimodal AI| Professor Saining Xie

New York University

New York, NY • On-site

$62K - $125K/yr

Full-time

Posted 25 days ago


New York University rating

8.4

Company rating: 8.4 out of 10

Based on 45 frontline employees who took The Breakroom Quiz

97th of 612 rated colleges and universities


Job description

Description
We are seeking a highly motivated Postdoctoral Associate to work on cutting-edge research in multimodal artificial intelligence. The successful candidate will contribute to the development of models that integrate and reason across multiple data modalities, such as text, images, video, and audio.
Key responsibilities include:
  • Conducting original research in multimodal learning, including model design, training, and evaluation
  • Developing scalable methods for aligning and integrating diverse data modalities
  • Collaborating with interdisciplinary teams and contributing to ongoing research projects
  • Publishing research findings in top-tier conferences and journals
  • Mentoring graduate and undergraduate students as appropriate

In compliance with NYC's Pay Transparency Act, the annual base salary range for this position is $62,500 - $125,000. New York University considers factors such as (but not limited to) the specific grant funding and the terms of the research grant when extending an offer.
Qualifications
  • PhD in Computer Science, Electrical Engineering, or a related field (by start date)
  • Strong background in machine learning and deep learning
  • Experience with multimodal models, computer vision, natural language processing, or related areas
  • Proficiency in Python and deep learning frameworks such as PyTorch or TensorFlow
  • Strong publication record or demonstrated research potential
  • Excellent communication and collaboration skills

Application Instructions
Applicants should submit the following materials:
  • Curriculum Vitae (CV)

Equal Employment Opportunity Statement
For people in the EU, click here for information on your privacy rights under GDPR: www.nyu.edu/it/gdpr
NYU is an Equal Opportunity Employer and is committed to a policy of equal treatment and opportunity in every aspect of its recruitment and hiring process without regard to age, alienage, caregiver status, childbirth, citizenship status, color, creed, disability, domestic violence victim status, ethnicity, familial status, gender and/or gender identity or expression, marital status, military status, national origin, parental status, partnership status, predisposing genetic characteristics, pregnancy, race, religion, reproductive health decision making, sex, sexual orientation, unemployment status, veteran status, or any other legally protected basis. All interested persons are encouraged to apply for vacant positions at all levels.
Sustainability Statement
NYU aims to be among the greenest urban campuses in the country and carbon neutral by 2040. Learn more at nyu.edu/sustainability

What New York University employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


New York University logo

About New York University

Sourced by ZipRecruiter

Since its founding in 1831, NYU has been an innovator in higher education, reaching out to an emerging middle class, embracing an urban identity and professional focus, and promoting a global vision that informs its 20 schools and colleges. Today, that trailblazing spirit makes NYU one of the most prominent and respected research universities in the world, featuring top-ranked academic programs and accepting fewer than one in eight undergraduates. Anchored in New York City and with degree-granting campuses in Abu Dhabi and Shanghai as well as 12 study away sites throughout the world, NYU is a leader in global education, with more international students and more students studying abroad than any other US university.

Industry

Colleges, universities, and professional schools

Company size

10,000+ Employees

Headquarters location

New York, NY, US

Year founded

1831