Multimodal Learning Jobs in California (NOW HIRING)

Join the team building the next generation of Apple Intelligence! The System Intelligence Machine Learning (SIML) organization is looking for a Machine Learning Research Engineer in the domain of multi-modal perception and reasoning. This is an opportunity to work at the core of Apple Intelligence, working across modalities such as vision, language, gesture, gaze, touch, etc. to enable highly intuitive and personalized intelligence experiences across the Apple ecosystem.
This role requires experience in vision-language models, and ability to fine-tune/adapt/distill multi-modal LLMs. You will be part of a fast-paced, impact-driven Applied Research organization working on cutting-edge machine learning that is at the heart of the most loved features on Apple platforms, including Apple Intelligence, Camera, Photos, Visual Intelligence, and more!
Description
As a Machine Learning Research Engineer, you will help design and develop models and algorithms for multimodal perception and reasoning leveraging Vision-Language Models (VLMs) and Multimodal Large Language Models (MLLMs). You will collaborate with experienced researchers and engineers to explore new techniques, evaluate performance, and translate product needs into impactful ML solutions. Your work will contribute directly to user-facing features across billions of devices.
Your primary responsibilities include:
- Contribute to the development and adaptation of AI/ML models for multimodal perception and reasoning
- Innovate robust algorithms that integrate visual and language data for comprehensive understanding
- Collaborate closely with cross-functional teams to translate product requirements into effective ML solutions.
- Conduct hands-on experimentation, model training, and performance analysis
- Communicate research outcomes effectively to technical and non-technical stakeholders, providing actionable insights.
- Stay current with emerging methods in VLMs, MLLMs, and related areas
Preferred Qualifications
Proven track record of research contributions demonstrated through publications in top-tier conferences and journals.
Background in multi-modal reasoning, VLM, and MLLM research with impactful software projects.
Solid understanding of natural language processing (NLP) and computer vision fundamentals.
Minimum Qualifications
Master’s or Ph.D. in Computer Science, Artificial Intelligence, Machine Learning, or related field - or relevant industry experience
Proficiency in Python and deep learning frameworks such as PyTorch, or equivalent
Practical experience with training and evaluating neural networks
Familiarity with multimodal learning, vision-language models, or large language models
Strong problem-solving skills and ability to work in a collaborative, product-focused environment
Ability to communicate technical results clearly and concisely
Pay & Benefits
At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $150,400 and $277,600, and your base pay will depend on your skills, qualifications, experience, and location.
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.