Reinforcement Learning With Human Feedback Jobs in Arizona

Senior AI Model Fine-Tuning Engineer

A job at TSMC Arizona offers an opportunity to work at the most advanced semiconductor fab in the United States. TSMC Arizona's first fab will operate it's leading-edge semiconductor process technology (N4 process), starting production in the first half of 2025. The second fab will utilize its leading edge N3 and N2 process technology and be operational in 2028. The recently announced third fab will manufacture chips using 2nm or even more advanced process technology, with production starting by the end of the decade. America's leading technology companies are ready to rely on TSMC Arizona for the next generations of chips that will power the digital future.

As a Senior AI Model Fine-Tuning Engineer, you will work on adjusting the behavior and functional abilities of our AI models to make them more adaptable, intelligent, and aligned with real-world use cases.

You will use advanced techniques like prompt engineering, RLHF, and instruction tuning to ensure our models produce high-quality, context-aware responses.

Responsibilities:

• Lead the fine-tuning process for large pre-trained models, focusing on making models behave appropriately in different contexts (e.g., following instructions, answering questions, or performing tasks).
• Design and implement prompt engineering strategies to help the model produce more accurate, relevant, and coherent outputs.
• Apply Reinforcement Learning from Human Feedback (RLHF) and other behavioral fine-tuning methods to improve the model's alignment with user needs and ethical standards.
• Collaborate with data teams to integrate relevant data and continuously improve model behavior.
• Conduct model evaluations using various performance metrics (accuracy, bias detection, user feedback) to identify areas for improvement.
• Iterate and experiment with different fine-tuning methods to achieve optimal performance for specific use cases.
• Monitor model drift and ensure that models remain consistent, reliable, and safe over time.

Minimum Qualifications/Requirements:

Education: Minimum degree required: Bachelor's degree in Computer Science, Data Science, or a related field.

Technical Skills:

• 5+ years of experience working on fine-tuning large-scale models such as GPT, T5, or BERT, with a strong focus on behavior and functionality.
• Expertise in advanced tuning methods such as RLHF, prompt engineering, and zero-shot learning.
• Experience with popular transformer architectures and frameworks like Hugging Face, TensorFlow, or PyTorch.
• Deep understanding of LLM behaviors, including instruction-following, task completion, and ethical considerations in output.
• Proficiency in Python and experience with libraries for model fine-tuning (e.g., Transformers, DeepSpeed).
• Experience in evaluating model performance, including using metrics like BLEU, ROUGE, perplexity, and custom evaluation frameworks.
• Bonus: Experience with ethical AI and safety considerations, such as minimizing bias and handling adversarial inputs.
• Bonus: Experience with model deployment and real-time experimentation (A/B testing).

Interpersonal Skills:

• Communication
• Computer proficiency
• Presentation skills
• Listening
• Teamwork

Candidates must be willing and able to work on-site at our Phoenix Arizona facility.

As a valued member of the TSMC family, we place a significant focus on your health and well-being. When you are at your best-physically, mentally, and financially-our company is at its best. We offer a comprehensive and competitive benefits program that provides the resources you need to help you manage your health and achieve your goals across many areas of your life. This includes a variety of medical, dental and vision plan offerings you can choose from that best fit your and your family's needs. Additionally, TSMC provides income-protection programs to financially assist you should you experience an injury or illness, and a 401(k)-retirement savings plan to help you secure your financial future. TSMC also offers competitive paid time-off programs and paid holidays allowing you to recharge and spend time with your family and loved ones.

Work Location: 5088 W. Innovation Circle, Phoenix, AZ 85083

TSMC is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other protected characteristic. We encourage all qualified individuals to apply, and we welcome applications from individuals with diverse backgrounds and experiences. Candidates must be able to perform the essential functions of the job with or without a reasonable accommodation. If you need a reasonable accommodation as part of this application process, please contact P_LOA@tsmc.com.

#LI-Onsite