1

Vector Databases Jobs in New York (NOW HIRING)

Senior AI Engineer

Piscataway, NJ · On-site

$106K - $146K/yr

Design and implement solutions involving Large Language Models (LLMs), embeddings, vector databases, Retrieval-Augmented Generation (RAG), and prompt engineering. * Work with cloud AI services such ...

PostgreSQL, Vector Databases, and Advanced Retrieval strategies. ML/DL: PyTorch, TensorFlow, and Model Fine-tuning. Deployment: Docker, Production API management, and LLM monitoring. Tools: Prompt ...

PostgreSQL, Vector Databases, and Advanced Retrieval strategies. ML/DL: PyTorch, TensorFlow, and Model Fine-tuning. Deployment: Docker, Production API management, and LLM monitoring. Tools: Prompt ...

PostgreSQL, Vector Databases, and Advanced Retrieval strategies. ML/DL: PyTorch, TensorFlow, and Model Fine-tuning. Deployment: Docker, Production API management, and LLM monitoring. Tools: Prompt ...

Integrate agents with vector databases, RAG pipelines, and knowledge graphs. Production AI Systems * Implement observability, evaluation, and guardrails for agent behavior. * Optimize AI pipelines ...

Senior Software Engineer

Manhattan, NY · On-site

$175 - $220/hr

You will build pipelines that ingest petabyte‑scale data into object storage and turn it into fast, queryable databases and vector stores, design large‑scale storage and retrieval across hot and ...

... vector databases and graph databases. You'll own end-to-end delivery: ingestion → retrieval → agent orchestration → evaluation → deployment. What you'll do * Design and implement RAG ...

Senior Software Engineer

New York, NY · On-site

$134K - $176K/yr

You will build pipelines that ingest petabyte-scale data into object storage and turn it into fast, queryable databases and vector stores, design large-scale storage and retrieval across hot and cold ...

Senior Software Engineer

New York, NY · On-site

$134K - $176K/yr

You will build pipelines that ingest petabyte-scale data into object storage and turn it into fast, queryable databases and vector stores, design large-scale storage and retrieval across hot and cold ...

Gen-AI Engineers

Jersey City, NJ · On-site

$65 - $70/hr

Integrate Gen-AI solutions with enterprise systems, APIs, databases, and cloud platforms. * Develop and optimize prompts, embeddings, vector search, and RAG-based architectures. * Collaborate with ...

Senior Software Engineer

Manhattan, NY · On-site

$175K - $220K/yr

You will build pipelines that ingest petabyte-scale data into object storage and turn it into fast, queryable databases and vector stores, design large-scale storage and retrieval across hot and cold ...

Showing results 21-40

Vector Databases information

What are vector databases?

Vector databases are specialized databases designed to store, manage, and search high-dimensional vector data, which is commonly generated from machine learning models, such as embeddings from natural language processing or image recognition. They enable efficient similarity search operations, such as finding the most similar items to a given query vector, which is essential for applications like recommendation systems, semantic search, and AI-powered search engines. Unlike traditional databases that handle structured or unstructured data, vector databases are optimized for fast and scalable similarity searches on large datasets of vectors.

What are some common challenges faced when working with vector databases, and how can they be addressed?

Professionals working with vector databases often encounter challenges such as efficiently scaling to handle large datasets, ensuring low-latency similarity searches, and integrating the database with machine learning pipelines. To address these, teams typically implement distributed architectures, fine-tune indexing strategies, and collaborate closely with data engineers and machine learning specialists. Staying updated with the latest developments in vector database technologies and maintaining clear communication with cross-functional teams are also key to overcoming these challenges.

What is the difference between Vector Databases vs Data Engineers?

AspectVector DatabasesData Engineers
Required SkillsDatabase management, data modeling, query optimizationData pipeline development, ETL processes, programming
Work EnvironmentData storage systems, AI/ML projects, cloud platformsData infrastructure, cloud environments, big data tools
Industry UsageAI, machine learning, recommendation systemsData integration, analytics, data architecture

While Vector Databases focus on storing and querying high-dimensional vector data for AI applications, Data Engineers build and maintain data pipelines and infrastructure to support data analysis and machine learning workflows. Both roles are essential in data-driven industries but serve different functions within the data ecosystem.

What are the key skills and qualifications needed to thrive as a vector database engineer, and why are they important?

Success as a Vector Database Engineer requires a strong background in computer science, database management, and experience with machine learning or AI-driven data systems. Familiarity with vector database platforms (such as Pinecone, Milvus, or Weaviate), cloud infrastructure, and proficiency in languages like Python are typically expected. Strong problem-solving skills, effective communication, and the ability to work cross-functionally help engineers stand out. These competencies are vital to efficiently design, deploy, and maintain scalable vector search solutions that power modern AI applications.
What cities in New York are hiring for Vector Databases jobs? Cities in New York with the most Vector Databases job openings:
Infographic showing various Vector Databases job openings in New York as of August 2026, with employment types broken down into 86% Full Time, 7% Part Time, 1% Temporary, and 6% Contract. Highlights an 86% Physical, 4% Hybrid, and 10% Remote job distribution.

Senior AI Engineer

Accord Technologies Inc.

Piscataway, NJ • On-site

$106K - $146K/yr

Contractor

Re-posted 7 days ago


Job description

Senior AI Engineer
Location: Piscataway, NJ (Hybrid from day one)
Local to NJ candidates are preferred.
Position type: W2 contract.

Requirement:

We are seeking an experienced and proactive Senior AI Engineer to join our team.
The ideal candidate will have a strong background in AI/ML, hands-on experience with large language models, and proven ability to drive innovation and implementation in a collaborative environment.
You will collaborate with offshore teams and liaise directly with the client to ensure project deliverables are met on time and to expectations.

Responsibilities:

  • Develop and deploy machine learning models using Python and frameworks like PyTorch and TensorFlow.
  • Design and implement solutions involving Large Language Models (LLMs), embeddings, vector databases, Retrieval-Augmented Generation (RAG), and prompt engineering. 
  • Work with cloud AI services such as Azure OpenAI, AWS Bedrock, and GCP Vertex to integrate AI capabilities. 
  • Build and maintain MLOps pipelines using Docker, Kubernetes, and monitoring tools for scalable and reliable deployment. 
  • Develop APIs and endpoint services using FastAPI or Flask.
  • Collaborate with offshore teams to drive solution implementation and ensure alignment with project timelines. 
  • Engage with the client for ongoing communication, requirement gathering, and expectation management.
  • Leverage solid knowledge of data structures, algorithms, and distributed systems to optimize solutions.

Skills & Qualifications:

  • Strong experience with Python programming and ML frameworks (PyTorch, TensorFlow). 
  • Hands-on experience with LLMs, embeddings, vector databases, RAG, and prompt engineering.
  • Familiarity with cloud AI services such as Azure OpenAI, AWS Bedrock, and GCP Vertex
  • Proficiency with Docker, Kubernetes, and MLOps pipelines
  • Experience in API development (FastAPI, Flask). 
  • Solid understanding of data structures, algorithms, and distributed systems.
  • Excellent communication skills and ability to coordinate with offshore teams and clients.
  • Proven track record of driving projects from conception to delivery in a collaborative environment.