1

Multimodal Learning Jobs in Minnesota (NOW HIRING)

Research Fellow - Digital Pathology

Rochester, MN · On-site

  • Medical

  • Dental

  • Vision

  • Retirement

... of multimodal and longitudinal clinical data needed to develop personalized diagnostic or ... Familiarity with deep learning technologies (e.g., CNNs, transformers) * Experience with Python and ...

Research Fellow - Digital Pathology

Rochester, MN · On-site

  • Medical

  • Dental

  • Vision

  • Retirement

... of multimodal and longitudinal clinical data needed to develop personalized diagnostic or ... Familiarity with deep learning technologies (e.g., CNNs, transformers) * Experience with Python and ...

Research Fellow - Digital Pathology

Rochester, MN · On-site

$64K - $74K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

... of multimodal and longitudinal clinical data needed to develop personalized diagnostic or ... Familiarity with deep learning technologies (e.g., CNNs, transformers) * Experience with Python and ...

Senior Data Science Analyst - DLMP

Rochester, MN · On-site

$78K - $99K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

Advance AI and machine learning solutions specifically for digital pathology and multimodal clinical data. * Work as part of an AI Operations team focused on moving AI models into clinically ...

Applied AI Scientist

Saint Paul, MN · On-site

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

... multimodal machinegenerated data - including logs, time series, traces, and events! We combine deep ... Large-scale graph representation learning and Graph Neural Networks (GNNs) (e.g., GCN/GAT/GraphSAGE ...

Applied AI Scientist

Minneapolis, MN · On-site

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

... multimodal machinegenerated data - including logs, time series, traces, and events! We combine deep ... Large-scale graph representation learning and Graph Neural Networks (GNNs) (e.g., GCN/GAT/GraphSAGE ...

Senior Data Science Analyst - DLMP

Rochester, MN · On-site

$78K - $99K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

Advance AI and machine learning solutions specifically for digital pathology and multimodal clinical data. * Work as part of an AI Operations team focused on moving AI models into clinically ...

Senior Data Science Analyst - DLMP

Rochester, MN · On-site

$87K - $110K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

Advance AI and machine learning solutions specifically for digital pathology and multimodal clinical data. * Work as part of an AI Operations team focused on moving AI models into clinically ...

AI/ML Engineer

Minneapolis, MN · On-site

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

This position will focus on designing, developing and developing machine learning (ML), artificial ... Automate workflows involving extraction of complex, multimodal unstructured content from variety of ...

Showing results 21-40

Multimodal Learning information

What is multimodal learning?

Multimodal learning is an area of machine learning that involves integrating and processing information from multiple types of data, such as text, images, audio, and video. The goal is to create models that can understand and make predictions based on more than one data modality, similar to how humans use various senses. This approach is used in applications like speech recognition with visual cues, image captioning, and video analysis. By combining different data types, multimodal learning systems can achieve better accuracy and more robust understanding.

What are the key skills and qualifications needed to thrive in multimodal learning, and why are they important?

To excel as a Multimodal Learning Specialist, you need a solid background in machine learning, data science, and computer vision, often supported by an advanced degree in a related field. Familiarity with deep learning frameworks like TensorFlow or PyTorch, experience integrating data from diverse sources (e.g., text, audio, images), and knowledge of relevant algorithms are crucial. Strong problem-solving abilities, creativity, and effective collaboration are standout soft skills for this role. These competencies are vital for developing innovative models that can process and interpret complex, multi-source data to drive impactful AI solutions.

What are some common challenges faced by professionals working in multimodal learning roles, and how can they be addressed?

Professionals in multimodal learning frequently encounter challenges related to integrating and aligning data from multiple sources, such as text, images, audio, or video. Ensuring data quality and consistency across modalities can be complex, and developing models that effectively combine heterogeneous information often requires advanced technical skills and innovative thinking. Collaboration with domain experts and other data scientists is key to overcoming these obstacles, as is staying up to date with the latest research and tools in machine learning. Regular team meetings and cross-disciplinary workshops can help foster a collaborative environment and promote knowledge sharing.

What is the difference between Multimodal Learning vs Data Scientist?

AspectMultimodal LearningData Scientist
Required CredentialsAdvanced degrees in AI, Machine Learning, or Computer ScienceBachelor's or Master's in Data Science, Statistics, or related fields
Work EnvironmentResearch labs, AI development teams, academiaBusiness, tech companies, analytics teams
Industry UsageAI research, multimedia applications, roboticsData analysis, predictive modeling, business insights

Multimodal Learning focuses on developing AI models that process and integrate multiple data types like images, text, and audio. Data Scientists analyze data to extract insights, build models, and support decision-making. While both roles involve data and algorithms, Multimodal Learning is specialized in AI model development for complex data integration, whereas Data Scientists work broadly across data analysis and interpretation.

What cities in Minnesota are hiring for Multimodal Learning jobs?

Cities in Minnesota with the most Multimodal Learning job openings:

KER Unit - Health Services Analyst - Supplemental

Mayo Clinic

Rochester, MN • On-site

Part-time

Medical, Dental, Vision, Retirement

Re-posted 11 days ago


Mayo Clinic rating

7.8

Company rating: 7.8 out of 10

Based on 699 frontline employees who took The Breakroom Quiz

127th of 888 rated healthcare providers


Job description

We are seeking a highly motivated researcher with experience in machine learning with Python to develop multimodal AI/ML models from healthcare conversations combined with other sources of data (e.g., scans and tabular data). The ideal candidate will have hands-on experience with textual (NLP), acoustic (speech), and visual data and the ability to integrate these modalities into state-of-the-art models for healthcare applications. The analyst assists with multidisciplinary research analysis using a variety of analytical, quantitative, qualitative, and programming skills. The analyst conducts comprehensive literature searches related to health services research initiatives and compiles and summarizes written and electronic data for research projects. Research funding sources and collects necessary documents for participating in external research collaborations. Writes draft reports that clearly and concisely summarize and illustrate projects findings, outcomes, and results. Drafts sections of grants, abstracts, and manuscripts. Collects and assists in designing data analysis strategies, evaluating data needs and methods of data collection. Implements the data collection protocol. Assists in reviewing study methods, statistical models, and sampling schemes. Trends data to identify potential areas of the investigation supported by graphical presentations. Evaluates the reliability of data sources to ensure data integrity. Coordinates multiple project assignments and is responsible for completing tasks in given timeline. Designs and maintains quantitative and qualitative databases including the management and updating of data.

Model Development & Optimization:

  • Build and deploy multimodal AI/ML models integrating textual, acoustic, and visual inputs from healthcare conversations and other sources of data (e.g., scans and tabular data)
  • Implement, train, and fine-tune models in Python using packages such as PyTorch, Transformers, OpenCV, torchvision, and torchaudio.
  • Apply prompting strategies, parallel computing, and GPU acceleration to optimize large-scale model training and inference.

Data Management & Analysis:

  • Collect, preprocess, and manage complex quantitative and qualitative datasets while ensuring data integrity and reproducibility.
  • Design and execute advanced data analysis strategies, including statistical modeling, sampling schemes, and evaluation of computational methods.

Research & Writing:

  • Conduct literature reviews on AI in healthcare and health services research.
  • Prepare clear and concise reports, visualizations, and presentations of project outcomes.
  • Draft sections of grants, abstracts, and manuscripts related to AI/ML in healthcare.
  • Identify external funding opportunities and contribute to multi-institutional research collaborations.

Project Coordination:

  • Manage multiple concurrent assignments, track milestones, and ensure timely project delivery.
  • Maintain and update internal quantitative and qualitative databases
Why Mayo Clinic

Mayo Clinic is top-ranked in more specialties than any other care provider according to U.S. News & World Report. As we work together to put the needs of the patient first, we are also dedicated to our employees, investing in competitive compensation and comprehensive benefit plans - to take care of you and your family, now and in the future. And with continuing education and advancement opportunities at every turn, you can build a long, successful career with Mayo Clinic.

Benefits Highlights
  • Medical: Multiple plan options.
  • Dental: Delta Dental or reimbursement account for flexible coverage.
  • Vision: Affordable plan with national network.
  • Pre-Tax Savings: HSA and FSAs for eligible expenses.
  • Retirement: Competitive retirement package to secure your future.
Just as our reputation has spread beyond our Minnesota roots, so have our locations. Today, our employees are located at our three major campuses in Phoenix/Scottsdale, Arizona, Jacksonville, Florida, Rochester, Minnesota, and at Mayo Clinic Health System campuses throughout Midwestern communities, and at our international locations. Each Mayo Clinic location is a special place where our employees thrive in both their work and personal lives. Learn more about what each unique Mayo Clinic campus has to offer, and where your best fit is. 

Equal Opportunity

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender identity, sexual orientation, national origin, protected veteran status or disability status. Learn more about the "EOE is the Law".  Mayo Clinic participates in E-Verify and may provide the Social Security Administration and, if necessary, the Department of Homeland Security with information from each new employee's Form I-9 to confirm work authorization.

Master's degree in Computer Science, Engineering, Data Science, Health Informatics, or related field, with substantive coursework in machine learning experience preferred (two years minimum) OR Bachelor's degree in the fields above with strong quantitative background and four years of experience (minimum) required. Research experience preferred. Experience with previous research projects with quantitative and/or qualitative focus. Competent to work independently in most phases of research analysis, requiring only general instructions and direction. Demonstrated proficiency in written communication and research methodology. Able to think logically and to systematically analyze alternative solutions in problem solving. Knowledgeable about a current health care delivery environment. Works with general supervision; develops procedures for performance of a variety of duties; performs complex duties within established guidelines.

Technical Skills:

  • Strong programming skills in Python, with proficiency in PyTorch, Transformers, and scikit-learn.
  • Experience in NLP, speech processing, and/or visual modeling evidenced through previous projects.
  • Familiarity with GPU computing, distributed training, and prompting strategies ( for large language models.
  • Familiarity with Bash scripting

Professional Skills:

  • Demonstrated ability to work independently and in multidisciplinary teams.
  • Excellent written and verbal communication skills, with experience drafting research reports and manuscripts.
  • Familiarity and interest with healthcare research and delivery contexts preferred.

Note: Visa sponsorship is not available for this position. Must be U.S. citizen, permanent resident, refugee or asylee. 


What Mayo Clinic employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


Mayo Clinic logo

About Mayo Clinic

Sourced by ZipRecruiter

Mayo Clinic is the largest integrated, not-for-profit medical group practice in the world. We're building the future, one where the best possible care is available to everyone — and more people can heal at home. Our relentless research turns into earlier diagnoses and new cures. That's how we inspire hope in those who need it most. At Mayo Clinic, experts work together to solve the most challenging unmet needs of patients. Our history of innovation dates back almost 150 years, when brothers Will and Charlie Mayo pioneered an integrated, team-based approach to medicine. Today, that trailblazing spirit drives innovations like Mayo Clinic Platform — which powers new technologies to change how care is delivered to all.

Industry

Hospitals

Company size

10,000+ Employees

Headquarters location

Rochester, MN, US

Year founded

1919