Anthropic
Anthropic

60 Anthropic Infrastructure Software Engineer Jobs Hiring Near You

About Anthropic Anthropic's mission is to create reliable, interpretable, and steerable AI systems ... As a Software Engineer on the Research Tools team, you'll build the infrastructure and applications ...

Showing results 21-40

Software Engineer, Safeguards

Anthropic

San Francisco, CA • On-site

Full-time

Re-posted 17 days ago


Job description

Job Summary:
Anthropic is a public benefit corporation focused on creating reliable and safe AI systems. They are seeking a Software Engineer for their Safeguards team to develop monitoring systems, build abuse detection mechanisms, and ensure user well-being through technical interventions.
Responsibilities:
• Develop monitoring systems to detect unwanted behaviors from our API partners and potentially take automated enforcement actions; surface these in internal dashboards to analysts for manual review
• Build abuse detection mechanisms and infrastructure
• Surface abuse patterns to our research teams to harden models at the training stage
• Build robust and reliable multi-layered defenses for real-time improvement of safety mechanisms that work at scale
• Analyze user reports of inappropriate content or accounts
Qualifications:
Required:
• Bachelor’s degree in Computer Science, Software Engineering or comparable experience
• 5-10+ years of experience in a software engineering position, preferably with a focus on integrity, spam, fraud, or abuse detection and mitigation
• Proficiency in Python and Typescript
• Ability to work across the stack
• Strong communication skills and ability to explain complex technical concepts to non-technical stakeholders
Preferred:
• Have experience building trust and safety detection mechanisms and intervention for AI/ML systems
• Have experience with prompt engineering, jailbreak attacks, and other adversarial inputs
• Have worked closely with operational teams to build custom internal tooling
Company:
Anthropic is an artificial intelligence company that develops large language models and AI systems for business and research use. Founded in 2021, the company is headquartered in San Francisco, USA, with a team of 501-1000 employees. The company is currently Late Stage.