ZipRecruiter

Log In

2

Remote Infrastructure Software Engineer Jobs in New York

Baseten

Software Engineer - Infrastructure

New York, NY · On-site +1

$165K - $330K/yr

THE ROLE As an Infrastructure Software Engineer at Baseten, you'll build and maintain components of our ML inference platform that powers production AI applications. You'll contribute to the core ...

De Circle

Steakhouse Finance - Senior Engineer

New York, NY · On-site +1

$114K - $157K/yr

Role Overview As a Senior Market Infrastructure Software Engineer, you will lead the development of ... Fully remote work with a global team * Competitive compensation with bonus and equity * Work-from ...

Anza

Senior Software Engineer, Generalist

New York, NY · On-site +1

$180K - $300K/yr

Senior Software Engineer, Generalist - Anza Who We Are Anza is a Solana R&D lab pushing the ... Develop, maintain, and enhance our technical infrastructure, focusing on the Agave client within ...

lightyear

Software Engineer

Manhattan, NY · Remote

This position will be full-time, fully remote, and salaried with competitive compensation and ... Comfortable with SQL databases, Docker, and cloud infrastructure (AWS preferred) * You write tests ...

Lightyear

Software Engineer

Manhattan, NY · Remote

$120K - $180K/yr

This position will be full-time, fully remote, and salaried with competitive compensation and ... Comfortable with SQL databases, Docker, and cloud infrastructure (AWS preferred) * You write tests ...

Anza

Senior Software Engineer, Consensus

New York, NY · On-site +1

$180K - $300K/yr

Software Engineer, Consensus - Anza Who We Are Anza is a Solana R&D lab pushing the boundaries of ... Your work will directly improve the efficiency and reliability of our blockchain infrastructure ...

Aquatic Capital Management

Software Engineer

New York, NY · On-site +1

$220K - $230K/yr

Build production trading systems and create automated infrastructure to accelerate delivery of new ... Remote working is permitted on occasion but office attendance is expected. Salary range: $220,000 ...

New

Cohere

Software Engineer, Data Infrastructure

Manhattan, NY · On-site +1

$126K - $151K/yr

As a Software Engineer, Data Infrastructure, you will: * Work directly on petabyte-scale storage ... Remote-flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co ...

Turnblock.io

Software Engineer Remote (Web3)

New York, NY · Remote

$200K - $250K/yr

Software Engineer Opportunity Our client is on crypto's cutting-edge technology, and we're looking ... infrastructure, and consensus model Architect, develop, and maintain the Solana blockchain platform ...

Amplify

Software Engineer

Brooklyn, NY · On-site +1

$120K - $129K/yr

Our fully remote engineering team builds elegant and flexible systems that can quickly respond to ... Cloud infrastructure: Experience in managing cloud-based infrastructure using tools like AWS ...

Modern Treasury

Software Engineer

New York, NY · On-site +1

$120K - $240K/yr

OVERVIEW This position can be based out of San Francisco, New York, or remote (we accept candidates ... You will contribute to APIs, banking infrastructure and financial workflows that ensure our ...

Stripe

Software Engineer

New York, NY · On-site +1

$156K - $235K/yr

Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of ... 50% remote work permitted. Multiple Positions Available. Additional benefits for this role may ...

Stripe

Software Engineer

Manhattan, NY · On-site +1

$156K - $235K/yr

Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of ... 50% remote work permitted. Multiple Positions Available. Additional benefits for this role may ...

c e r e m o n y

Software Engineer, Agent

Manhattan, NY · On-site +1

Vercel is the agentic infrastructure company. We free people and agents to ship what's next. For ... remote. For location-specific details, please connect with our recruiting team. What you will do:

next page

Showing results 1-20

All JobsInfrastructure Software Engineer JobsRemote Infrastructure Software Engineer JobsRemote Infrastructure Software Engineer Jobs in New York

Remote Infrastructure Software Engineer information

What are Remote Infrastructure Software Engineers?

Remote Infrastructure Software Engineers are professionals who design, build, and maintain the core systems and services that support an organization's IT infrastructure, all while working remotely. They focus on ensuring that networks, servers, cloud environments, and related software are secure, scalable, and reliable. Their responsibilities may include automating deployment processes, managing cloud resources, monitoring system performance, and troubleshooting issues. By working remotely, they leverage various collaboration tools to communicate with teams and manage critical infrastructure from anywhere.

How does a Remote Infrastructure Software Engineer typically collaborate with cross-functional teams in a distributed work environment?

Remote Infrastructure Software Engineers regularly work with DevOps, security, and development teams to ensure that infrastructure solutions are reliable and scalable. Collaboration often happens through daily stand-ups, code reviews, and shared documentation platforms, making strong communication skills essential. Tools like Slack, Jira, and Zoom are commonly used to bridge the distance and keep projects aligned. Successfully navigating time zone differences and asynchronous communication is a key part of the role, requiring proactive updates and flexibility.

What are the key skills and qualifications needed to thrive as a Remote Infrastructure Software Engineer, and why are they important?

To thrive as a Remote Infrastructure Software Engineer, you need a strong background in software engineering, computer networking, and distributed systems, typically supported by a degree in computer science or a related field. Familiarity with cloud platforms (such as AWS, Azure, or GCP), infrastructure-as-code tools (like Terraform or Ansible), and CI/CD systems is essential, along with relevant certifications like AWS Certified Solutions Architect. Excellent problem-solving, communication, and self-management skills are crucial for collaborating effectively across distributed teams and handling complex remote projects. These skills ensure secure, reliable, and scalable systems that support business goals in a remote work environment.
What are the most commonly searched types of Infrastructure Software Engineer jobs in New York? The most popular types of Infrastructure Software Engineer jobs in New York are:
What are popular job titles related to Remote Infrastructure Software Engineer jobs in New York? For Remote Infrastructure Software Engineer jobs in New York, the most frequently searched job titles are:
What job categories do people searching Remote Infrastructure Software Engineer jobs in New York look for? The top searched job categories for Remote Infrastructure Software Engineer jobs in New York are:
What cities in New York are hiring for Remote Infrastructure Software Engineer jobs? Cities in New York with the most Remote Infrastructure Software Engineer job openings:
Remote Infrastructure Software Engineer jobs near you
Software Engineer - Infrastructure

Software Engineer - Infrastructure

Baseten

New York, NY • On-site, Remote

$165K - $330K/yr

Full-time

Medical, Dental, Vision, Retirement, PTO

Posted 8 days ago

Job description

ABOUT BASETEN
Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $300M Series E, backed by investors including BOND, IVP, Spark Capital, Greylock, and Conviction. Join us and help build the platform engineers turn to to ship AI products.
THE ROLE
As an Infrastructure Software Engineer at Baseten, you'll build and maintain components of our ML inference platform that powers production AI applications. You'll contribute to the core infrastructure, enabling developers to deploy, scale, and monitor ML models with high performance.
EXAMPLE INITIATIVES
You'll get to work on these types of projects as part of our Infrastructure team:
  • Multi-cloud capacity management
  • Inference on B200 GPUs
  • Multi-node inference
  • Fractional H100 GPUs for efficient model serving

RESPONSIBILITIES
  • Develop infrastructure components for our ML inference platform using Python and Go
  • Implement and maintain Kubernetes deployments for model serving
  • Contribute to our inference orchestration layer for model deployments
  • Build and enhance monitoring systems for model performance metrics
  • Implement efficient resource management solutions for ML workloads
  • Support infrastructure automation to improve ML deployment workflows
  • Work closely with team members to implement technical solutions
  • Help balance performance optimization with system reliability
  • Participate in technical discussions around infrastructure improvements
  • Learn and apply infrastructure best practices

REQUIREMENTS
  • Bachelor's degree or higher in Computer Science or related field
  • Proficient coding abilities in one or more popular programming or scripting languages; Go proficiency is a plus
  • Working knowledge of Kubernetes and containerization
  • Basic understanding of machine learning concepts and model serving
  • Familiarity with distributed systems concepts
  • Experience with basic monitoring and logging tools
  • Interest in ML/AI infrastructure and willingness to learn
  • Strong collaboration and communication skills

BENEFITS
  • Competitive compensation, including meaningful equity.
  • 100% coverage of medical, dental, and vision insurance for employee and dependents
  • Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
  • Paid parental leave
  • Fertility and family-building stipend through Carrot
  • Company-facilitated 401(k)
  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

Apply