1

Multimodal Learning Jobs in Minnesota (NOW HIRING)

next page

Showing results 1-20

Multimodal Learning information

What is multimodal learning?

Multimodal learning is an area of machine learning that involves integrating and processing information from multiple types of data, such as text, images, audio, and video. The goal is to create models that can understand and make predictions based on more than one data modality, similar to how humans use various senses. This approach is used in applications like speech recognition with visual cues, image captioning, and video analysis. By combining different data types, multimodal learning systems can achieve better accuracy and more robust understanding.

What is the difference between Multimodal Learning vs Data Scientist?

AspectMultimodal LearningData Scientist
Required CredentialsAdvanced degrees in AI, Machine Learning, or Computer ScienceBachelor's or Master's in Data Science, Statistics, or related fields
Work EnvironmentResearch labs, AI development teams, academiaBusiness, tech companies, analytics teams
Industry UsageAI research, multimedia applications, roboticsData analysis, predictive modeling, business insights

Multimodal Learning focuses on developing AI models that process and integrate multiple data types like images, text, and audio. Data Scientists analyze data to extract insights, build models, and support decision-making. While both roles involve data and algorithms, Multimodal Learning is specialized in AI model development for complex data integration, whereas Data Scientists work broadly across data analysis and interpretation.

What are the key skills and qualifications needed to thrive as a Multimodal Learning Specialist, and why are they important?

To excel as a Multimodal Learning Specialist, you need a solid background in machine learning, data science, and computer vision, often supported by an advanced degree in a related field. Familiarity with deep learning frameworks like TensorFlow or PyTorch, experience integrating data from diverse sources (e.g., text, audio, images), and knowledge of relevant algorithms are crucial. Strong problem-solving abilities, creativity, and effective collaboration are standout soft skills for this role. These competencies are vital for developing innovative models that can process and interpret complex, multi-source data to drive impactful AI solutions.

What are some common challenges faced by professionals working in multimodal learning roles, and how can they be addressed?

Professionals in multimodal learning frequently encounter challenges related to integrating and aligning data from multiple sources, such as text, images, audio, or video. Ensuring data quality and consistency across modalities can be complex, and developing models that effectively combine heterogeneous information often requires advanced technical skills and innovative thinking. Collaboration with domain experts and other data scientists is key to overcoming these obstacles, as is staying up to date with the latest research and tools in machine learning. Regular team meetings and cross-disciplinary workshops can help foster a collaborative environment and promote knowledge sharing.
What cities in Minnesota are hiring for Multimodal Learning jobs? Cities in Minnesota with the most Multimodal Learning job openings:
Research Fellow PC - Radiation Oncology - Waddle lab

Research Fellow PC - Radiation Oncology - Waddle lab

Mayo Clinic

Rochester, MN • On-site

Full-time

Medical, Dental, Vision, Retirement

Posted 25 days ago


Mayo Clinic rating

7.8

Company rating: 7.8 out of 10

Based on 692 frontline employees who took The Breakroom Quiz

104th of 890 rated healthcare providers


Job description


The AI and Data Analytics (AIDA) team within the Department of Radiation Oncology at Mayo Clinic is hiring a Research Fellow to help advance the next generation of AI-enabled clinical research and cancer care: https://radonc-aida.github.io.
We are looking for an exceptional researcher who is intellectually curious, clinically engaged, technically capable, and motivated by real-world impact. Candidates with experience in LLM pipelines, digital pathology, computational pathology, multimodal AI, or the integration of pathology, imaging, and clinical data are especially encouraged to apply.
You will join a uniquely positioned institution. Mayo Clinic treats over 1.4 million patients annually and is consistently ranked among the most trusted names in medicine. Within this environment, AIDA operates as a fast-moving, high-impact team developing, evaluating, and translating AI tools into clinical and research workflows.
Our work sits at the intersection of clinical oncology, biomedical data science, digital pathology, medical imaging, and applied AI. Over the past year, several of our tools have moved beyond prototypes into active clinical use, supporting clinicians across multiple specialties. These tools have been recognized at institutional and national forums for their innovation, usability, and measurable impact on care delivery.
This is a rare opportunity to work on AI systems that are not only published, but used, evaluated, and iterated on in real clinical environments.
The Research Fellow will contribute to projects focused on understanding and extracting value from complex clinical data, including electronic health records, longitudinal oncology data, clinical notes, pathology reports, digitized pathology images, imaging-derived data, treatment information, and patient outcomes. A major emphasis of the role will be using AI, including large language models and multimodal learning methods, to support clinical data retrieval, cohort discovery, data abstraction, documentation workflows, decision support, biomarker discovery, and translational cancer research.
Whether it is identifying clinically meaningful patterns in cancer treatment data, using LLMs to retrieve and summarize relevant patient information, analyzing digital pathology or imaging data, building tools that support physician workflows, or designing studies that evaluate AI in real-world care settings, your work will span both rigorous research and practical clinical translation.
We are looking for someone who wants to work closely with physicians, physicists, pathologists, data scientists, engineers, and clinical teams to develop AI tools that matter to patients, clinicians, and the future of healthcare.
What You'll Do:
  • Advance clinically meaningful AI research: Design and execute research projects that use AI and data analytics to address important questions in radiation oncology, cancer care, digital pathology, and clinical operations.
  • Work with real-world clinical data: Analyze and interpret complex clinical datasets, including structured EHR data, clinical notes, pathology reports, digitized pathology images, treatment records, outcomes data, and longitudinal patient information.
  • Use LLMs for clinical data retrieval and abstraction: Apply large language models and related methods to retrieve, summarize, structure, and validate information from clinical records, pathology reports, and other healthcare data sources.
  • Contribute to multimodal clinical AI: Help develop methods that integrate multiple data types, such as clinical text, structured EHR data, pathology data, imaging data, treatment data, and outcomes.
  • Support digital pathology and image-based research: Contribute to AI-enabled analysis of pathology-related data, including whole-slide images, pathology reports, tumor characteristics, biomarkers, and clinicopathologic correlations.
  • Translate research into practice: Help move ideas from clinical need to research question, prototype, evaluation, and real-world implementation.
  • Develop and evaluate AI tools in clinical settings: Contribute to tools that support documentation, clinical workflow efficiency, cohort identification, decision support, quality improvement, and patient-centered research.
  • Collaborate across disciplines: Work closely with radiation oncologists, pathologists, medical physicists, informaticians, data scientists, engineers, and clinical staff to ensure that AI tools are clinically relevant, usable, and responsibly evaluated.
  • Measure real-world impact: Evaluate success not only through publications, but also through clinical usefulness, adoption, reliability, workflow integration, and measurable impact on care delivery.
    A Research Fellow at Mayo Clinic is a temporary position intended to provide training and education in research. Individuals will train in the research program of a Mayo Clinic principal investigator. Qualified individuals will demonstrate the potential for research as evidenced by their training and peer-reviewed publications and should become competitive for national research grants. Upon background check and CCATS Executive Committee approval, Research Fellow may have patient/research subject contact directly relating to and incidental to the original research program. Proof of English proficiency is required for J-1 Short-Term Scholars, Research Scholars, Professors, Specialists, and Student Interns sponsored by Mayo Clinic.

Qualifications
  • MD or PhD in Biomedical Informatics, Computer Science, Machine Learning, Engineering, Physics, Applied Mathematics, Statistics, Epidemiology, Health Data Science, Computational Pathology, Computational Biology, or a related field.
  • Strong interest in clinical research, translational AI, and improving cancer care.
  • Experience working with clinical, biomedical, imaging, pathology, or real-world healthcare data.
  • Experience working in cloud-based clinical data environments, ideally including Google Cloud Platform, BigQuery, and FHIR-based healthcare data resources, to support secure data retrieval, analysis, and translational research workflows.
  • Familiarity with machine learning, natural language processing, computer vision, large language models, multimodal AI, or related methods.
  • Ability to use AI tools, including LLMs, for tasks such as clinical data retrieval, summarization, abstraction, cohort identification, or workflow support.
  • Experience with Python and common data science or machine learning tools.
  • Ability to understand clinical context, ask clinically meaningful questions, and work closely with physicians and other healthcare professionals.
  • Strong communication skills, including the ability to explain technical concepts clearly to clinical and non-technical collaborators.
  • Self-motivated, collaborative, and comfortable working on open-ended problems in a multidisciplinary research environment.

About Us
Why Mayo Clinic
Mayo Clinic is top-ranked in more specialties than any other care provider according to U.S. News & World Report. As we work together to put the needs of the patient first, we are also dedicated to our employees, investing in competitive compensation and comprehensive benefit plans - to take care of you and your family, now and in the future. And with continuing education and advancement opportunities at every turn, you can build a long, successful career with Mayo Clinic.
Benefits Highlights
  • Medical: Multiple plan options.
  • Dental: Delta Dental or reimbursement account for flexible coverage.
  • Vision: Affordable plan with national network.
  • Pre-Tax Savings: HSA and FSAs for eligible expenses.
  • Retirement: Competitive retirement package to secure your future.

About the Team
Just as our reputation has spread beyond our Minnesota roots, so have our locations. Today, our employees are located at our three major campuses in Phoenix/Scottsdale, Arizona, Jacksonville, Florida, Rochester, Minnesota, and at Mayo Clinic Health System campuses throughout Midwestern communities, and at our international locations. Each Mayo Clinic location is a special place where our employees thrive in both their work and personal lives. Learn more about what each unique Mayo Clinic campus has to offer, and where your best fit is.
Equal Opportunity
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender identity, sexual orientation, national origin, protected veteran status or disability status. Learn more about the "EOE is the Law". Mayo Clinic participates in E-Verify and may provide the Social Security Administration and, if necessary, the Department of Homeland Security with information from each new employee's Form I-9 to confirm work authorization.

What Mayo Clinic employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


Mayo Clinic logo

About Mayo Clinic

Sourced by ZipRecruiter

Mayo Clinic is the largest integrated, not-for-profit medical group practice in the world. We're building the future, one where the best possible care is available to everyone — and more people can heal at home. Our relentless research turns into earlier diagnoses and new cures. That's how we inspire hope in those who need it most. At Mayo Clinic, experts work together to solve the most challenging unmet needs of patients. Our history of innovation dates back almost 150 years, when brothers Will and Charlie Mayo pioneered an integrated, team-based approach to medicine. Today, that trailblazing spirit drives innovations like Mayo Clinic Platform — which powers new technologies to change how care is delivered to all.

Industry

Hospitals

Company size

10,000+ Employees

Headquarters location

Rochester, MN, US

Year founded

1919