ZipRecruiter

Log In

1

Model Server Jobs in New York (NOW HIRING)

Ruby Tuesday

Server

Elizabeth, NJ

$5.62/hr

JOB SUMMARY The Server is responsible for always providing prompt and friendly food and beverage service to all guests following the CHARM service model. Responsible for meeting or exceeding sales ...

rubytuesday

Server

NJ · On-site

JOB SUMMARY The Server is responsible for always providing prompt and friendly food and beverage service to all guests following the CHARM service model. Responsible for meeting or exceeding sales ...

rubytuesday

Server

Elizabeth, NJ · On-site

JOB SUMMARY The Server is responsible for always providing prompt and friendly food and beverage service to all guests following the CHARM service model. Responsible for meeting or exceeding sales ...

Pyramid IT

Data Modeler - Short term contract

New York, NY · On-site

$60 - $77.75/hr

... S and Informatica. Created, documented and maintained logical and physical database models in ... Established and maintained comprehensive data model documentation including detailed descriptions ...

Apolis

Data Modeler

Jersey City, NJ · On-site

$60 - $77.75/hr

Required : • Strong knowledge of data modeling techniques (ER modeling, dimensional modeling) • Strong knowledge of database systems (Oracle, SQL Server, PostgreSQL, Snowflake) • Strong ...

Virtusa

SQL Server Database Developer

New York, NY

Familiarity with data modeling, normalization, and database design principles. Experience creating and maintaining SSRS reports and/or Power BI reports. Understanding of SQL Server security ...

previous pagenext page

Showing results 21-40

All JobsModel Server JobsModel Server Jobs in New York

Model Server information

What is a model server?

Model servers are specialized software systems designed to deploy, manage, and serve machine learning models in production environments. They allow developers and organizations to expose trained models via APIs, enabling real-time predictions or batch processing for various applications. Model servers handle incoming requests, manage model versions, and ensure scalability, reliability, and security when serving models. Common examples include TensorFlow Serving, TorchServe, and NVIDIA Triton Inference Server.

How does a model server typically collaborate with data scientists and engineers during model deployment?

Model Servers play a key role in bridging the gap between data science teams and engineering teams during model deployment. They are responsible for integrating trained machine learning models into production environments, ensuring scalability, reliability, and low-latency access. Collaboration often involves regular communication with data scientists to understand model requirements and with engineers to align on infrastructure, security, and monitoring needs. This teamwork helps ensure that deployed models perform well and can be efficiently maintained or updated as new versions are released.

What are the key skills and qualifications needed to thrive as a model server, and why are they important?

To thrive as a Model Server engineer, you need expertise in deploying, managing, and optimizing machine learning models, typically supported by a background in computer science or a related field. Familiarity with tools like TensorFlow Serving, TorchServe, Docker, Kubernetes, and cloud platforms such as AWS or GCP is essential, along with knowledge of REST or gRPC APIs. Strong problem-solving, communication, and collaboration skills help in troubleshooting issues and working with data scientists and DevOps teams. These abilities ensure reliable, scalable, and efficient delivery of machine learning services in production environments.

What is the difference between Model Server vs Data Scientist?

AspectModel ServerData Scientist
Required CredentialsTypically requires knowledge of machine learning deployment, programming, and sometimes certifications in cloud platformsRequires degrees in data science, statistics, or related fields; certifications are optional
Work EnvironmentWorks primarily in IT, cloud environments, or data infrastructure teamsWorks in research, analytics, or business teams, often in office settings
Employer & Industry UsageUsed in tech companies, AI firms, and organizations deploying machine learning modelsEmployed across industries like finance, healthcare, marketing, and tech for data analysis

The main difference is that Model Servers focus on deploying and maintaining machine learning models in production environments, while Data Scientists analyze data, develop models, and generate insights. Model Servers are essential for operationalizing models, whereas Data Scientists drive the creation and refinement of those models.

What are popular job titles related to Model Server jobs in New York?

For Model Server jobs in New York, the most frequently searched job titles are:

What job categories do people searching Model Server jobs in New York look for?

The top searched job categories for Model Server jobs in New York are:

Model Server jobs near you
Infographic showing various Model Server job openings in New York as of August 2026, with employment types broken down into 84% Full Time, and 16% Part Time. Highlights an 100% In-person job distribution.

Senior Specialist Field Engineer - Networking

CoreWeave

New York, NY

Full-time

Re-posted 28 days ago

CoreWeave rating

9.8

Company rating: 9.8 out of 10

Based on 7 frontline employees who took The Breakroom Quiz

1st of 224 rated it services

Job description

CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence. Trusted by leading AI labs, startups, and global enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate breakthroughs and turn compute into capability. Founded in 2017, CoreWeave became a publicly traded company (Nasdaq: CRWV) in March 2025. Learn more at www.coreweave.com.

What You'll Do:

The Customer Experience (CX) Organization at CoreWeave is dedicated to ensuring every client running AI workloads at scale has a seamless, reliable, and high-performance experience. This team supports the infrastructure that powers the AI revolution—working across data centers, hardware systems, and customer workloads to maintain the integrity of our cloud platform. The CX organization aligns closely with the internal and customer engineering teams, offering valuable insights from the field and having the chance to contribute to the CoreWeave product roadmap and development.

About the role:

As a Senior Specialist Field Engineer at CoreWeave, you will play a vital and dynamic role. You will have the opportunity to demonstrate thought leadership and engage hands-on throughout our customers' entire lifecycle. From establishing their Kubernetes environment to developing proofs of concept, onboarding, and optimizing workloads, you will lead innovation at every turn. If you're driven by innovation, thrilled by the possibilities of what specialized compute can enable, and eager to be part of a team that's shaping the future, then CoreWeave is the place for you. Join us and let's embark on this adventure together!

In this role, you will:

  • Serve as the primary technical point of contact for customers, establishing strong technical relationships and ensuring their success with CoreWeave's cloud infrastructure offerings, focusing on networking technologies within high-performance compute (HPC) environments
  • Collaborate closely with customers to understand their unique business needs and create, prototype, and deploy tailored solutions that align with their requirements.
  • Lead proof of concept initiatives to showcase the value and viability of CoreWeave's solutions within specific environments.
  • Drive technical leadership and direction during customer meetings, presentations, and workshops, addressing any technical queries or concerns that arise.
  • Act as a virtual member of CoreWeave's Networking product and engineering teams, identifying opportunities for product enhancement and collaborating with engineers to implement your suggestions.
  • Offer valuable insights on product features, functionality, and performance, contributing regularly to discussions about product strategy and architecture.
  • Conduct periodic technical reviews and assessments of customer workloads, pinpointing opportunities for workload optimization and suggesting suitable solutions.
  • Stay informed of the latest developments and trends in Kubernetes, cloud computing and infrastructure, sharing your thought leadership with customers and internal stakeholders.
  • Lead the prototyping and initiation of research and development efforts for emerging products and solutions, delivering prototypes and key insights for internal consumption.
  • Represent CoreWeave at conferences and industry events, with occasional travel as required.

Who You Are:

  • B.S. in Computer Science or a related technical discipline, or equivalent experience
  • 7+ years of proven experience as a Solutions Architect, Field Engineer, Engineer, Researcher, or Technical Account Manager in Cloud Infrastructure focusing on building distributed systems or HPC/cloud services, with an expertise focused on infrastructure networking.
  • Fluency in cloud computing concepts, architecture, and technologies with hands-on experience in designing and implementing cloud solutions
  • Proven track record with building customer relationships, communicating clearly and the ability to break down complex technical concepts to both technical and non-technical audiences
  • Expertise with a broad range of networking technologies and topics, with a familiarity to understand the needs and use cases is it relates to securing and enabling high performance networking engironments.
  • Experience with managing infrastructure networking, Kubernnetes CSI management, and private networking concepts
  • Familiar with NVIDIA GPUs typically used in AI/ML applications and associated technologies such as Infiniband and NVIDIA Collective Communications Library (NCCL)

Preferred:

  • Code contributions to open-source inference frameworks
  • Experience with scripting and automation related to network technologies
  • Experience with building solutions across multi-cloud environments
  • Client or customer-facing publications/talks on latency, optimization, or advanced model-server architectures

Wondering if you're a good fit? We believe in investing in our people, and value candidates who can bring their own diversified experiences to our teams – even if you aren't a 100% skill or experience match. Here are a few qualities we've found compatible with our team. If some of this describes you, we'd love to talk.

  • You love to help solve challenging technical problems
  • You're curious about the latest and greatest technologies in the AI space
  • You're an expert in managing conflict and achieving mutually beneficial technical outcomes

Why CoreWeave?

At CoreWeave, we work hard, have fun, and move fast! We're in an exciting stage of hyper-growth that you will not want to miss out on. We're not afraid of a little chaos, and we're constantly learning. Our team cares deeply about how we build our product and how we work together, which is represented through our core values:

  • Be Curious at Your Core
  • Act Like an Owner
  • Empower Employees
  • Deliver Best-in-Class Client Experiences
  • Achieve More Together

We support and encourage an entrepreneurial outlook and independent thinking. We foster an environment that encourages collaboration and provides the opportunity to develop innovative solutions to complex problems. As we get set for take off, the growth opportunities within the organization are constantly expanding. You will be surrounded by some of the best talent in the industry, who will want to learn from you, too. Come join us!

The base salary range for this role is $182,000 - $242,000. The starting salary will be determined based on job-related knowledge, skills, experience, and market location. We strive for both market alignment and internal equity when determining compensation. In addition to base salary, our total rewards package includes a discretionary bonus, equity awards, and a comprehensive benefits program (all based on eligibility).

What We Offer

The range we've posted represents the typical compensation range for this role. To determine actual compensation, we review the market rate for each candidate which can include a variety of factors. These include qualifications, experience, interview performance, and location.

In addition to a competitive salary, we offer a variety of benefits to support your needs. The benefits below reflect our US-based offerings for full-time employees; for roles in other locations, benefits vary and are shared during the hiring process. These include:

  • Medical, dental, and vision insurance - 100% paid for by CoreWeave
  • Company-paid Life Insurance
  • Voluntary supplemental life insurance
  • Short and long-term disability insurance
  • Flexible Spending Account
  • Health Savings Account
  • Tuition Reimbursement
  • Ability to Participate in Employee Stock Purchase Program (ESPP)
  • Mental Wellness Benefits through Spring Health
  • Family-Forming support provided by Carrot
  • Paid Parental Leave
  • Flexible, full-service childcare support with Kinside
  • 401(k) with a generous employer match
  • Flexible PTO
  • Catered lunch each day in our office and data center locations
  • A casual work environment
  • A work culture focused on innovative disruption

California Applicants

California Consumer Privacy Act

Equal Opportunity & Accommodations

CoreWeave is an equal opportunity employer, committed to fostering an inclusive and supportive workplace. All qualified applicants and candidates will receive consideration for employment without regard to race, color, religion, sex, disability, age, sexual orientation, gender identity, national origin, veteran status, or genetic information.

As part of this commitment and consistent with the Americans with Disabilities Act (ADA), CoreWeave will ensure that qualified applicants and candidates with disabilities are provided reasonable accommodations for the hiring process, unless such accommodation would cause an undue hardship. If reasonable accommodation is needed, please contact: careers@coreweave.com.

Export Control Compliance

This position requires access to export controlled information. To conform to U.S. Government export regulations applicable to that information, applicant must either be (A) a U.S. person, defined as a (i) U.S. citizen or national, (ii) U.S. lawful permanent resident (green card holder), (iii) refugee under 8 U.S.C. § 1157, or (iv) asylee under 8 U.S.C. § 1158, (B) eligible to access the export controlled information without a required export authorization, or (C) eligible and reasonably likely to obtain the required export authorization from the applicable U.S. government agency. CoreWeave may, for legitimate business reasons, decline to pursue any export licensing process.

What CoreWeave employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom