Machine Learning Engineer Software Engineer Jobs in New York, NY

Good Inside is seeking a Machine Learning Engineer to join our Engineering team. This is not a research or data science role - we're looking for a strong backend engineer who has hands-on experience shipping ML-powered features in production. You'll work at the intersection of backend systems and machine learning, building the infrastructure and services that bring personalized, intelligent experiences to our users.

You should be comfortable working with ML APIs, understanding core ML concepts, and integrating models into reliable, scalable backend systems. Your primary identity is as a software engineer - someone who writes clean, production-grade code - with the added ability to reason about ML systems and bring them to life in our product.

You will collaborate closely with cross-functional partners, including product, design, mobile, and data teams, to build high-quality features that serve our users' needs. Your ability to blend backend engineering excellence with practical ML knowledge will be essential as we continue to evolve and scale the Good Inside platform.

• Design, build, and maintain backend services and APIs that power ML-driven features across the Good Inside platform
• Integrate and orchestrate ML models and third-party ML APIs (e.g., LLM providers, recommendation engines, embeddings services) into production systems
• Build data pipelines and infrastructure to support model serving, feature storage, and real-time personalization
• Collaborate closely with product, mobile, and design teams to translate ML capabilities into user-facing features
• Own the reliability, performance, and scalability of ML-adjacent backend systems
• Develop clean, maintainable, and well-documented code aligned with defined project scope
• Provide clear documentation of architectural decisions, implementation details, and handoff materials upon project completion
• Provide input on feature scope and sequencing to support timely and successful delivery of project deliverables

• 5+ years of professional software engineering experience, with a strong focus on backend development
• Demonstrated experience shipping ML-powered features or products in a production environment
• Working knowledge of ML concepts (e.g., embeddings, classification, recommendation systems, LLMs) - you don't need to train models, but you need to understand how they work and when to use them
• Hands-on experience integrating ML APIs and services (e.g., OpenAI, Anthropic, ElevenLabs, HuggingFace, AWS SageMaker, or similar)
• Proficiency in Python and/or another backend language (Go, Java, TypeScript/Node, etc.)
• Experience with cloud infrastructure (AWS, GCP, or Azure) and containerized deployments
• Familiarity with data stores and pipelines relevant to ML workloads (e.g., vector databases, feature stores, streaming systems)
• Excellent interpersonal, verbal, and written communication skills
• Strong collaboration abilities and cross-functional relationship-building
• Self-starter with strong analytical and problem-solving skills
• Ability to stay organized and deliver results in a fast-paced, changing environment
• Computer Science degree or equivalent
• At least 2 years of experience in house as a ML Engineer 

• Startup Growth Experience: This isn't your first time helping a high-growth startup scale. You are excited by the challenge and love creating and learning from the bottom up.
• Experience with LLM Application Development: You've built applications on top of large language models - prompt engineering, RAG pipelines, conversational AI, or similar - and understand the practical challenges of shipping LLM-powered features.
• Infrastructure & DevOps Fluency: Experience with CI/CD, monitoring, observability, and production-readiness for ML systems.
• Prior experience with recommendation systems, personalization engines, or content ranking algorithms in a user-facing product.

• Competitive Compensation: base salary for this role will be $205k - $235k 
• Company Equity
• Comprehensive benefits package
• 401k + Company match
• Time off to recharge
• A high-ownership, high-performance, high-collaboration culture