Software Engineer II (P3) โ Production AI (Metrics & Analytics)
AgreeYa is a global Systems Integrator and is seeking an experienced Software Engineer II (P3) โ Production AI (Metrics & Analytics) to join our growing team. As a Software Engineer II on the Production AI team, you will focus on evolving and scaling our AI metrics and analytics ecosystem. You'll take ownership of an existing metrics pipelineโstabilizing, extending, and operationalizing itโwhile partnering closely with internal stakeholders and external vendors to ensure data quality, reliability, and usability.
Job Responsibilities:
- Own and evolve Production AI's metrics pipeline, improving reliability, scalability, and data quality
- Diagnose and resolve pipeline issues, coordinating with external tool vendors and internal partners to drive fixes and improvements
- Extend existing data pipelines to support new use cases, teams, and AI products
- Design and implement analytics and visualization solutions (dashboards, reporting tools, data access layers) for stakeholders
- Partner with product, engineering, and AI teams to define meaningful metrics and iterate on measurement strategies
- Ensure data is accessible, trustworthy, and actionable for technical and non-technical consumers
- Contribute to operational excellence through monitoring, alerting, and documentation of data systems
- Support additional AI Foundations teams with similar metrics and analytics needs as required
- Contribute to broader Production AI engineering efforts over time as domain knowledge grows
Required Skills & Experience:
- 3โ5 years of professional software engineering experience or equivalent
- Strong programming skills in Python, Typescript, or similar languages
- Experience building, maintaining, or operating data pipelines or backend services
- Experience working with APIs, data processing systems, and debugging production issues
- Familiarity with cloud environments (e.g., AWS, GCP) and modern data tooling
- Ability to independently own and deliver on moderately scoped projects
- Strong communication skills and ability to collaborate with cross-functional stakeholders
Preferred Skills & Experience:
- Experience with analytics, metrics systems, or data visualization tools (e.g., Tableau, Looker, Grafana)
- Familiarity with generative AI tools (e.g., ChatGPT, Claude, Gemini) and agentic workflows
- Experience working with third-party vendors or external platforms
- Knowledge of data modeling, ETL/ELT pipelines, and data quality best practices
- Experience building internal tools or platforms for developer or product teams
- Familiarity with observability and monitoring systems
Additional Information:
- Designing and scaling metrics systems for AI platforms at enterprise scale
- Applying AI/LLM systems in production environments and measuring their impact
- Partnering across a wide range of teams to shape how AI success is defined and tracked
- Expanding into broader AI platform and application development within Production AI
About AgreeYa:
AgreeYa is a global systems integrator delivering a competitive advantage for its customers through software, solutions, and services. Established in 1999, AgreeYa is headquartered in Folsom, California, with a global footprint and a team of more than 1,800+ professionals across offices. AgreeYa works with 550+ organizations ranging from Fortune 100 firms to small and large businesses across industries such as Telecom, Banking, Financial Services & Insurance, Healthcare, Utility & Energy, Technology, Public Sector, Pharma & Biotech, Retail, Client, and others. Please visit us at www.agreeya.com for more information. Equal Opportunity: AgreeYa is an equal opportunity employer. We evaluate qualified applicants without regard to race, color, religion, gender identity, sexual orientation, national origin, disability, veteran status or other protected characteristics. Visit our website at www.agreeya.com/career-culture to learn about our Career & Culture.