A major emphasis of the role will be using AI, including large language models and multimodal learning methods, to support clinical data retrieval, cohort discovery, data abstraction, documentation ...
A major emphasis of the role will be using AI, including large language models and multimodal learning methods, to support clinical data retrieval, cohort discovery, data abstraction, documentation ...
A major emphasis of the role will be using AI, including large language models and multimodal learning methods, to support clinical data retrieval, cohort discovery, data abstraction, documentation ...
A major emphasis of the role will be using AI, including large language models and multimodal learning methods, to support clinical data retrieval, cohort discovery, data abstraction, documentation ...
A major emphasis of the role will be using AI, including large language models and multimodal learning methods, to support clinical data retrieval, cohort discovery, data abstraction, documentation ...
A major emphasis of the role will be using AI, including large language models and multimodal learning methods, to support clinical data retrieval, cohort discovery, data abstraction, documentation ...
A major emphasis of the role will be using AI, including large language models and multimodal learning methods, to support clinical data retrieval, cohort discovery, data abstraction, documentation ...
A major emphasis of the role will be using AI, including large language models and multimodal learning methods, to support clinical data retrieval, cohort discovery, data abstraction, documentation ...
Principal Engineer, AI and Machine Learning Software
Saint Paul, MN · On-site +1
$140K - $160K/yr
Design and develop machine learning algorithms that analyze medical data (e.g., images, biosignals ... multimodal AI applications is a plus. * Proficiency in MATLAB, Linux, Python. * Experience with ...
Principal Engineer, AI and Machine Learning Software
Saint Paul, MN · On-site +1
$140K - $160K/yr
Design and develop machine learning algorithms that analyze medical data (e.g., images, biosignals ... multimodal AI applications is a plus. * Proficiency in MATLAB, Linux, Python. * Experience with ...
Principal Engineer, AI and Machine Learning Software
Saint Paul, MN · On-site
$140K - $160K/yr
Design and develop machine learning algorithms that analyze medical data (e.g., images, biosignals ... multimodal AI applications is a plus. * Proficiency in MATLAB, Linux, Python. * Experience with ...
Principal Engineer, AI and Machine Learning Software
Saint Paul, MN · On-site
$140K - $160K/yr
Design and develop machine learning algorithms that analyze medical data (e.g., images, biosignals ... multimodal AI applications is a plus. * Proficiency in MATLAB, Linux, Python. * Experience with ...
Principal Engineer, AI and Machine Learning Software
Saint Paul, MN · On-site +1
$140K - $160K/yr
Design and develop machine learning algorithms that analyze medical data (e.g., images, biosignals ... multimodal AI applications is a plus. * Proficiency in MATLAB, Linux, Python. * Experience with ...
Principal Engineer, AI and Machine Learning Software
Saint Paul, MN · On-site +1
$140K - $160K/yr
Design and develop machine learning algorithms that analyze medical data (e.g., images, biosignals ... multimodal AI applications is a plus. * Proficiency in MATLAB, Linux, Python. * Experience with ...
Own the design and operation of compliant data-quality and active-learning pipelines for multimodal clinical data, primarily medical images and metadata, on cloud infrastructure. Establish data ...
New
Own the design and operation of compliant data-quality and active-learning pipelines for multimodal clinical data, primarily medical images and metadata, on cloud infrastructure. Establish data ...
New
Demonstrated hands-on experience, portfolio work, publications, or research in prompt injection, jailbreak testing, model evaluation, adversarial machine learning, multimodal artificial intelligence ...
Demonstrated hands-on experience, portfolio work, publications, or research in prompt injection, jailbreak testing, model evaluation, adversarial machine learning, multimodal artificial intelligence ...
We are seeking a highly motivated researcher with experience in machine learning with Python to develop multimodal AI/ML models from healthcare conversations combined with other sources of data (e.g ...
We are seeking a highly motivated researcher with experience in machine learning with Python to develop multimodal AI/ML models from healthcare conversations combined with other sources of data (e.g ...
Develop, implement, and evaluate vision and multimodal transformers and task-specific models to ... Strong background in deep learning (e.g., CNNs, transformers) and familiarity with emerging ...
Develop, implement, and evaluate vision and multimodal transformers and task-specific models to ... Strong background in deep learning (e.g., CNNs, transformers) and familiarity with emerging ...
Remain up to date on technology and multimodal methods of teaching with technology * Maintain ... learning outcome objectives * Prepare, assist, or update content and materials used in course ...
Remain up to date on technology and multimodal methods of teaching with technology * Maintain ... learning outcome objectives * Prepare, assist, or update content and materials used in course ...
We are seeking a highly motivated researcher with experience in machine learning with Python to develop multimodal AI/ML models from healthcare conversations combined with other sources of data (e.g ...
We are seeking a highly motivated researcher with experience in machine learning with Python to develop multimodal AI/ML models from healthcare conversations combined with other sources of data (e.g ...
Develop, implement, and evaluate vision and multimodal transformers and task-specific models to ... Strong background in deep learning (e.g., CNNs, transformers) and familiarity with emerging ...
Develop, implement, and evaluate vision and multimodal transformers and task-specific models to ... Strong background in deep learning (e.g., CNNs, transformers) and familiarity with emerging ...
Develop, implement, and evaluate vision and multimodal transformers and task-specific models to ... Strong background in deep learning (e.g., CNNs, transformers) and familiarity with emerging ...
Develop, implement, and evaluate vision and multimodal transformers and task-specific models to ... Strong background in deep learning (e.g., CNNs, transformers) and familiarity with emerging ...
Responsibilities We are seeking a highly motivated researcher with experience in machine learning with Python to develop multimodal AI/ML models from healthcare conversations combined with other ...
Responsibilities We are seeking a highly motivated researcher with experience in machine learning with Python to develop multimodal AI/ML models from healthcare conversations combined with other ...
We are seeking a highly motivated researcher with experience in machine learning with Python to develop multimodal AI/ML models from healthcare conversations combined with other sources of data (e.g ...
We are seeking a highly motivated researcher with experience in machine learning with Python to develop multimodal AI/ML models from healthcare conversations combined with other sources of data (e.g ...
... of multimodal and longitudinal clinical data needed to develop personalized diagnostic or ... Familiarity with deep learning technologies (e.g., CNNs, transformers) * Experience with Python and ...
... of multimodal and longitudinal clinical data needed to develop personalized diagnostic or ... Familiarity with deep learning technologies (e.g., CNNs, transformers) * Experience with Python and ...
Research Fellow - Digital Pathology - AI
Rochester, MN · On-site
$68K - $80K/yr
Develop, implement, and evaluate vision and multimodal transformers and task-specific models to ... Strong background in deep learning (e.g., CNNs, transformers) and familiarity with emerging ...
Research Fellow - Digital Pathology - AI
Rochester, MN · On-site
$68K - $80K/yr
Develop, implement, and evaluate vision and multimodal transformers and task-specific models to ... Strong background in deep learning (e.g., CNNs, transformers) and familiarity with emerging ...
... of multimodal and longitudinal clinical data needed to develop personalized diagnostic or ... Familiarity with deep learning technologies (e.g., CNNs, transformers) * Experience with Python and ...
... of multimodal and longitudinal clinical data needed to develop personalized diagnostic or ... Familiarity with deep learning technologies (e.g., CNNs, transformers) * Experience with Python and ...
Multimodal Learning information
What is multimodal learning?
What is the difference between Multimodal Learning vs Data Scientist?
| Aspect | Multimodal Learning | Data Scientist |
|---|---|---|
| Required Credentials | Advanced degrees in AI, Machine Learning, or Computer Science | Bachelor's or Master's in Data Science, Statistics, or related fields |
| Work Environment | Research labs, AI development teams, academia | Business, tech companies, analytics teams |
| Industry Usage | AI research, multimedia applications, robotics | Data analysis, predictive modeling, business insights |
Multimodal Learning focuses on developing AI models that process and integrate multiple data types like images, text, and audio. Data Scientists analyze data to extract insights, build models, and support decision-making. While both roles involve data and algorithms, Multimodal Learning is specialized in AI model development for complex data integration, whereas Data Scientists work broadly across data analysis and interpretation.
What are the key skills and qualifications needed to thrive as a Multimodal Learning Specialist, and why are they important?
What are some common challenges faced by professionals working in multimodal learning roles, and how can they be addressed?
Full-time
Medical, Dental, Vision, Retirement
Posted 25 days ago
Mayo Clinic rating
7.8
Based on 692 frontline employees who took The Breakroom Quiz
104th of 890 rated healthcare providers
Job description
The AI and Data Analytics (AIDA) team within the Department of Radiation Oncology at Mayo Clinic is hiring a Research Fellow to help advance the next generation of AI-enabled clinical research and cancer care: https://radonc-aida.github.io.
We are looking for an exceptional researcher who is intellectually curious, clinically engaged, technically capable, and motivated by real-world impact. Candidates with experience in LLM pipelines, digital pathology, computational pathology, multimodal AI, or the integration of pathology, imaging, and clinical data are especially encouraged to apply.
You will join a uniquely positioned institution. Mayo Clinic treats over 1.4 million patients annually and is consistently ranked among the most trusted names in medicine. Within this environment, AIDA operates as a fast-moving, high-impact team developing, evaluating, and translating AI tools into clinical and research workflows.
Our work sits at the intersection of clinical oncology, biomedical data science, digital pathology, medical imaging, and applied AI. Over the past year, several of our tools have moved beyond prototypes into active clinical use, supporting clinicians across multiple specialties. These tools have been recognized at institutional and national forums for their innovation, usability, and measurable impact on care delivery.
This is a rare opportunity to work on AI systems that are not only published, but used, evaluated, and iterated on in real clinical environments.
The Research Fellow will contribute to projects focused on understanding and extracting value from complex clinical data, including electronic health records, longitudinal oncology data, clinical notes, pathology reports, digitized pathology images, imaging-derived data, treatment information, and patient outcomes. A major emphasis of the role will be using AI, including large language models and multimodal learning methods, to support clinical data retrieval, cohort discovery, data abstraction, documentation workflows, decision support, biomarker discovery, and translational cancer research.
Whether it is identifying clinically meaningful patterns in cancer treatment data, using LLMs to retrieve and summarize relevant patient information, analyzing digital pathology or imaging data, building tools that support physician workflows, or designing studies that evaluate AI in real-world care settings, your work will span both rigorous research and practical clinical translation.
We are looking for someone who wants to work closely with physicians, physicists, pathologists, data scientists, engineers, and clinical teams to develop AI tools that matter to patients, clinicians, and the future of healthcare.
What You'll Do:
- Advance clinically meaningful AI research: Design and execute research projects that use AI and data analytics to address important questions in radiation oncology, cancer care, digital pathology, and clinical operations.
- Work with real-world clinical data: Analyze and interpret complex clinical datasets, including structured EHR data, clinical notes, pathology reports, digitized pathology images, treatment records, outcomes data, and longitudinal patient information.
- Use LLMs for clinical data retrieval and abstraction: Apply large language models and related methods to retrieve, summarize, structure, and validate information from clinical records, pathology reports, and other healthcare data sources.
- Contribute to multimodal clinical AI: Help develop methods that integrate multiple data types, such as clinical text, structured EHR data, pathology data, imaging data, treatment data, and outcomes.
- Support digital pathology and image-based research: Contribute to AI-enabled analysis of pathology-related data, including whole-slide images, pathology reports, tumor characteristics, biomarkers, and clinicopathologic correlations.
- Translate research into practice: Help move ideas from clinical need to research question, prototype, evaluation, and real-world implementation.
- Develop and evaluate AI tools in clinical settings: Contribute to tools that support documentation, clinical workflow efficiency, cohort identification, decision support, quality improvement, and patient-centered research.
- Collaborate across disciplines: Work closely with radiation oncologists, pathologists, medical physicists, informaticians, data scientists, engineers, and clinical staff to ensure that AI tools are clinically relevant, usable, and responsibly evaluated.
- Measure real-world impact: Evaluate success not only through publications, but also through clinical usefulness, adoption, reliability, workflow integration, and measurable impact on care delivery.
A Research Fellow at Mayo Clinic is a temporary position intended to provide training and education in research. Individuals will train in the research program of a Mayo Clinic principal investigator. Qualified individuals will demonstrate the potential for research as evidenced by their training and peer-reviewed publications and should become competitive for national research grants. Upon background check and CCATS Executive Committee approval, Research Fellow may have patient/research subject contact directly relating to and incidental to the original research program. Proof of English proficiency is required for J-1 Short-Term Scholars, Research Scholars, Professors, Specialists, and Student Interns sponsored by Mayo Clinic.
Qualifications
- MD or PhD in Biomedical Informatics, Computer Science, Machine Learning, Engineering, Physics, Applied Mathematics, Statistics, Epidemiology, Health Data Science, Computational Pathology, Computational Biology, or a related field.
- Strong interest in clinical research, translational AI, and improving cancer care.
- Experience working with clinical, biomedical, imaging, pathology, or real-world healthcare data.
- Experience working in cloud-based clinical data environments, ideally including Google Cloud Platform, BigQuery, and FHIR-based healthcare data resources, to support secure data retrieval, analysis, and translational research workflows.
- Familiarity with machine learning, natural language processing, computer vision, large language models, multimodal AI, or related methods.
- Ability to use AI tools, including LLMs, for tasks such as clinical data retrieval, summarization, abstraction, cohort identification, or workflow support.
- Experience with Python and common data science or machine learning tools.
- Ability to understand clinical context, ask clinically meaningful questions, and work closely with physicians and other healthcare professionals.
- Strong communication skills, including the ability to explain technical concepts clearly to clinical and non-technical collaborators.
- Self-motivated, collaborative, and comfortable working on open-ended problems in a multidisciplinary research environment.
About Us
Why Mayo Clinic
Mayo Clinic is top-ranked in more specialties than any other care provider according to U.S. News & World Report. As we work together to put the needs of the patient first, we are also dedicated to our employees, investing in competitive compensation and comprehensive benefit plans - to take care of you and your family, now and in the future. And with continuing education and advancement opportunities at every turn, you can build a long, successful career with Mayo Clinic.
Benefits Highlights
- Medical: Multiple plan options.
- Dental: Delta Dental or reimbursement account for flexible coverage.
- Vision: Affordable plan with national network.
- Pre-Tax Savings: HSA and FSAs for eligible expenses.
- Retirement: Competitive retirement package to secure your future.
About the Team
Just as our reputation has spread beyond our Minnesota roots, so have our locations. Today, our employees are located at our three major campuses in Phoenix/Scottsdale, Arizona, Jacksonville, Florida, Rochester, Minnesota, and at Mayo Clinic Health System campuses throughout Midwestern communities, and at our international locations. Each Mayo Clinic location is a special place where our employees thrive in both their work and personal lives. Learn more about what each unique Mayo Clinic campus has to offer, and where your best fit is.
Equal Opportunity
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender identity, sexual orientation, national origin, protected veteran status or disability status. Learn more about the "EOE is the Law". Mayo Clinic participates in E-Verify and may provide the Social Security Administration and, if necessary, the Department of Homeland Security with information from each new employee's Form I-9 to confirm work authorization.
What Mayo Clinic employees say
Pay
Benefits
Hours and flexibility
Workplace
Get the full story on Breakroom
About Mayo Clinic
Sourced by ZipRecruiter
Mayo Clinic is the largest integrated, not-for-profit medical group practice in the world. We're building the future, one where the best possible care is available to everyone — and more people can heal at home. Our relentless research turns into earlier diagnoses and new cures. That's how we inspire hope in those who need it most. At Mayo Clinic, experts work together to solve the most challenging unmet needs of patients. Our history of innovation dates back almost 150 years, when brothers Will and Charlie Mayo pioneered an integrated, team-based approach to medicine. Today, that trailblazing spirit drives innovations like Mayo Clinic Platform — which powers new technologies to change how care is delivered to all.
Industry
Hospitals
Company size
10,000+ Employees
Headquarters location
Rochester, MN, US
Year founded
1919