1

Model Server Jobs in New York (NOW HIRING)

Data Modeler

Warren, NJ · On-site

$56.75 - $73.75/hr

Experience with Netezza in support of the data warehouse modeling is preferred. Experience with ... server/Db2 in support of transactional systems modelling is preferred Experience with Erwin/any ...

Experience SSIS required Solid SQL, stored procedures, database triggers, views and other database ... data modeling and dimensional modeling Strong technical problem-solving skills and sound ...

Experience SSIS required Solid SQL, stored procedures, database triggers, views and other database ... data modeling and dimensional modeling Strong technical problem-solving skills and sound ...

Software Engineer, Backend

New York, NY · On-site

$200K - $250K/yr

Connect backend services with AI model servers, vector databases, and automation workflows. * Enable smooth data exchange between AI agents and enterprise systems like Salesforce, SAP, and Workday.

Product Security Engineer, Server

New York, NY · On-site

  • Medical

  • Retirement

  • PTO

The team is responsible for the MongoDB Database Server (Community and Enterprise editions). The ... Comfortable leading threat modeling and being a security ambassador to other engineering teams

AI Inference Engineer

New York, NY · On-site +1

$165K - $330K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

Deploy production-ready model servers from Docker images * Deploy custom ComfyUI workflows as APIs RESPONSIBILITIES * Develop and maintain software systems and product features using one or more ...

Manager, Solutions Architect

New York, NY · On-site

$165K - $330K/yr

  • Medical

  • Dental

  • Vision

  • Retirement

  • PTO

Deploy production-ready model servers from Docker images * Deploy custom ComfyUI workflows as APIs RESPONSIBILITIES Leadership * Lead, mentor, and grow a team of Solution Architects, providing ...

Showing results 41-60

Model Server information

What is a model server?

Model servers are specialized software systems designed to deploy, manage, and serve machine learning models in production environments. They allow developers and organizations to expose trained models via APIs, enabling real-time predictions or batch processing for various applications. Model servers handle incoming requests, manage model versions, and ensure scalability, reliability, and security when serving models. Common examples include TensorFlow Serving, TorchServe, and NVIDIA Triton Inference Server.

How does a model server typically collaborate with data scientists and engineers during model deployment?

Model Servers play a key role in bridging the gap between data science teams and engineering teams during model deployment. They are responsible for integrating trained machine learning models into production environments, ensuring scalability, reliability, and low-latency access. Collaboration often involves regular communication with data scientists to understand model requirements and with engineers to align on infrastructure, security, and monitoring needs. This teamwork helps ensure that deployed models perform well and can be efficiently maintained or updated as new versions are released.

What are the key skills and qualifications needed to thrive as a model server, and why are they important?

To thrive as a Model Server engineer, you need expertise in deploying, managing, and optimizing machine learning models, typically supported by a background in computer science or a related field. Familiarity with tools like TensorFlow Serving, TorchServe, Docker, Kubernetes, and cloud platforms such as AWS or GCP is essential, along with knowledge of REST or gRPC APIs. Strong problem-solving, communication, and collaboration skills help in troubleshooting issues and working with data scientists and DevOps teams. These abilities ensure reliable, scalable, and efficient delivery of machine learning services in production environments.

What is the difference between Model Server vs Data Scientist?

AspectModel ServerData Scientist
Required CredentialsTypically requires knowledge of machine learning deployment, programming, and sometimes certifications in cloud platformsRequires degrees in data science, statistics, or related fields; certifications are optional
Work EnvironmentWorks primarily in IT, cloud environments, or data infrastructure teamsWorks in research, analytics, or business teams, often in office settings
Employer & Industry UsageUsed in tech companies, AI firms, and organizations deploying machine learning modelsEmployed across industries like finance, healthcare, marketing, and tech for data analysis

The main difference is that Model Servers focus on deploying and maintaining machine learning models in production environments, while Data Scientists analyze data, develop models, and generate insights. Model Servers are essential for operationalizing models, whereas Data Scientists drive the creation and refinement of those models.

What are popular job titles related to Model Server jobs in New York?

For Model Server jobs in New York, the most frequently searched job titles are:

What job categories do people searching Model Server jobs in New York look for?

The top searched job categories for Model Server jobs in New York are:

Infographic showing various Model Server job openings in New York as of August 2026, with employment types broken down into 84% Full Time, and 16% Part Time. Highlights an 100% In-person job distribution.

SQL Server Database Developer

RIT Solutions, Inc.

Summit, NJ • On-site

Full-time

Re-posted 15 days ago


Job description

Job Summary:
RIT Solutions, Inc. is seeking a SQL Server Database Developer to join their team. The role involves proficiency in SQL and RDMS platforms, focusing on database analysis and engineering with a strong emphasis on large datasets and financial industry experience.
Responsibilities:
• Database Analyst/Engineer with proficiency in SQL and RDMS platforms.
• JIRA/Confluence Proficiency.
• Strong written and verbal communication skills.
• Strong business partnering skills with resources across the organization in matrixed environment.
• Experience is SQL is a must.
• In-depth Experience ORACLE, MS SQL, TSQL, PL/SQL, Shell Scripting, UNIX.
• In-depth Experience modeling tools like ERWin, PowerDesigner etc.
• Experience unit testing.
• Strong knowledge of Agile.
• Strong Experience in working with global delivery teams.
• Strong Experience in establishing end-to-end SDLC practices and DEVOPs.
• Relational database experience.
• Experience gathering, analyzing and interpreting large datasets.
• Experience with databases such as Oracle or SQL server.
• Experience writing relational database queries for stored procedures, query optimization and performance tuning.
• Financial industry experience.
• Experience with SQL Server database design and administration.
• Experience with Big Data or Hadoop tools such as Spark, Hive, Kafka and Map.
• 2+ years of Apache Spark design and development experience using Scala, Java, Python or Data Frames with Resilient Distributed Datasets (RDDs).
Qualifications:
Required:
• SQL
• TSQL
• Erwin
• RDMS
• large datasets
• Database Analyst/Engineer with proficiency in SQL and RDMS platforms
• JIRA/Confluence Proficiency
• Strong written and verbal communication skills
• Strong business partnering skills with resources across the organization in matrixed environment
• Experience is SQL is a must
• In-depth Experience ORACLE, MS SQL, TSQL, PL/SQL, Shell Scripting, UNIX
• In-depth Experience modeling tools like ERWin, PowerDesigner etc.
• Experience unit testing
• Strong knowledge of Agile
• Strong Experience in working with global delivery teams
• Strong Experience in establishing end-to-end SDLC practices and DEVOPs
• relational database experience
• experience gathering, analyzing and interpreting large datasets
• experience with databases such as Oracle or SQL server
• experience writing relational database queries for stored procedures, query optimization and performance tuning
• financial industry experience
Preferred:
• experience with SQL Server database design and administration
• experience with Big Data or Hadoop tools such as Spark, Hive, Kafka and Map
• 2+ years of Apache Spark design and development experience using Scala, Java, Python or Data Frames with Resilient Distributed Datasets (RDDs)
Company:
Jobdiva Job Portal: https://www1.jobdiva.com/candidates/myjobs/searchjobsdone.jsp?a=xbjdnwgjodtga1y1im2g881fkkeiwd0775lbvq8yqgps8vb2q36w2vj1ga6xxork&compid=-1 Recruitment (contingency search and campus selection). Founded in 2019, the company is headquartered in Arlington, USA, with a team of 201-500 employees. The company is currently Growth Stage.