Llm Annotation Jobs in California (NOW HIRING)

Responsibilities
About the Team The Safety Product team is at the forefront of building and optimizing content safety systems. With a focus on optimising and advancing content safety, we leverage advanced large language models to enhance review efficiency, risk control, and user trust. Working closely with business and technical stakeholders, we deliver scalable solutions that keep pace with rapid global growth. We are seeking a passionate and detail-oriented Search Safety PM Intern to join our team and play a pivotal role in safeguarding the health and security of our search business. Your core mission will be to support the development and training of next-generation large language models. In this role, you will work closely with the team to build high-quality training resources, design effective prompts, and generate large-scale labeled datasets that directly power model learning and performance. This position sits at the intersection of content understanding, language, and applied AI. You will leverage strong analytical thinking and language skills to transform complex real-world content into structured, high-quality training data for LLMs. Your work will play a foundational role in shaping model behavior, alignment, and real-world usability. We are looking for talented individuals to join us for an internship. Our internship program offers students hands-on experience, industry exposure, and opportunities to apply their knowledge to real-world challenges while building a strong foundation for personal and professional growth. Interns will gain practical experience, explore potential career paths, and participate in social events, learning programs, and development workshops alongside industry professionals. Candidates may apply to a maximum of two positions across Our Company and its affiliates globally. Applications will be considered in the order they are submitted. Applications are reviewed on a rolling basis, so we encourage you to apply early. Please clearly state your availability in your resume, including your start and end dates. Responsibilities LLM Training Data & Knowledge Base Development - Training Corpus Construction: Assist in building and maintaining high-quality datasets and knowledge bases for new LLM training initiatives, ensuring accuracy, diversity, and contextual richness. - Label System Design & Scaling: Help design labeling frameworks and taxonomies, and generate large-scale, high-consistency labeled datasets to support supervised and reinforcement learning workflows. - Data Generation & Curation: Produce, review, and refine large volumes of training data based on defined standards, use cases, and evaluation criteria. Prompt Design & Model Interaction - Prompt Writing & Optimization: Draft, iterate, and optimize prompts for different training and evaluation scenarios, ensuring clarity, coverage, and alignment with model objectives. - Model Behavior Analysis: Analyze model outputs to identify gaps, biases, or failure patterns, and translate insights into improved prompts or data requirements. - LLM Familiarity & Application: Apply a strong understanding of LLM capabilities and limitations to design data and prompts that meaningfully improve model performance. Content Understanding & Quality Assurance - Content Interpretation: Deeply understand complex content across domains, identify key signals, intent, and nuances, and convert them into structured training inputs. - Quality Control: Conduct quality reviews on datasets, labels, and prompts, ensuring consistency, logical soundness, and adherence to guidelines. - Iteration & Improvement: Continuously refine data standards and workflows based on model feedback and project needs.
Qualifications
Minimum Qualifications - Currently pursuing an Undergraduate/Master's in computer science, statistics, information management, data science or a related discipline. - Strong Content Sensitivity & Analytical Thinking: Excellent ability to understand, interpret, and structure complex textual content, with high attention to detail and nuance. - Outstanding English Proficiency: Exceptional English writing and communication skills, with the ability to produce clear, precise, and logically structured content at scale. - LLM Awareness & Learning Agility: Strong interest in large language models, with the ability to quickly learn AI-related concepts, tools, and workflows and apply them in practice. - Ownership & Execution Ability: Highly responsible, self-driven, and capable of handling large volumes of work with consistency and quality. Preferred Qualifications - Humanities / Social Sciences Background: Currently pursuing or recently completed a major in humanities, social sciences, foreign languages, international relations, or related fields. - Prior experience in content annotation, data labeling, research assistance, or AI-related operations. - Experience interacting with LLMs (e.g., prompt engineering, evaluation, or content generation projects).
Job Information
[For Pay Transparency]Compensation Description (Hourly) - Campus Intern
The hourly rate range for this position in the selected city is $25- $25.
Benefits may vary depending on the nature of employment and the country work location. Interns have day one access to health insurance, life insurance, wellbeing benefits and more. Interns also receive 10 paid holidays per year and paid sick time (56 hours if hired in first half of year, 40 if hired in second half of year). Interns who are not working 100% remote may also be eligible for housing allowance.
The Company reserves the right to modify or change these benefits programs at any time, with or without notice.
For Los Angeles County (unincorporated) Candidates:
Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:
1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;
2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and
3. Exercising sound judgment.
About TikTok
TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.
Why Join Us
Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect - and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.
We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.
Diversity & Inclusion
TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
TikTok Accommodation
TikTok is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at