1

Internship Optimization Engineer Jobs in New York

Senior Software Engineer - AI Inference

New York, NY · On-site

$134K - $176K/yr

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

Mentor junior engineers on system design, debugging, and performance optimization. You'll need to ... The Company does not provide benefits directly to contingent workers/contractors and interns.

Quantitative Developer Intern

New York, NY · On-site

$21 - $27.50/hr

Our interns will work closely with our team, receive comprehensive, in-depth training, and help ... Optimizing data ETL pipelines, persistent/in-memory caches, and SQL databases * Improving research ...

Quantitative Developer Intern

New York, NY

$21 - $27.50/hr

Our interns will work closely with our team, receive comprehensive, in-depth training, and help ... Optimizing data ETL pipelines, persistent/in-memory caches, and SQL databases * Improving research ...

Many classes and activities are shared with our Software Engineering interns, while others focus ... library, or optimizing an ML workflow * A top-notch programmer with a love for technology

ASIC Engineer

Dobbs Ferry, NY · On-site

$90 - $130/hr

... optimization of the products. You will be involved in projects from concept through production ... internship, work experience, coding competitions, or publications and experience that includes ...

Lead Machine Learning Engineer

New York, NY · On-site +1

$112K - $147K/yr

... Internship experience does not apply) * At least 4 years of experience programming with Python, Scala, or Java * At least 2 years of experience building, scaling, and optimizing ML systems Preferred ...

Software Development Engineer, Playback Team

Newark, NJ · On-site

  • Medical

  • Dental

  • Vision

  • Life

  • Retirement

  • PTO

This team focuses on optimizing playback quality, performance, and customer experience across ... BASIC QUALIFICATIONS - 3+ years of non-internship professional software development experience - 2+ ...

Showing results 41-60

Internship Optimization Engineer information

What is the difference between Internship Optimization Engineer vs Data Analyst Intern?

AspectInternship Optimization EngineerData Analyst Intern
Required CredentialsRelevant degree in engineering, data science, or related fields; some internships may require basic programming skillsDegree in statistics, mathematics, computer science, or related fields; basic data analysis skills needed
Work EnvironmentTech companies, e-commerce, or logistics firms focusing on process and system optimizationBusiness, finance, or tech companies analyzing data to support decision-making
Employer & Industry UsageUsed in industries emphasizing operational efficiency and system improvementsCommon in industries relying on data insights for strategic decisions

While both roles involve working with data and technical skills, the Internship Optimization Engineer focuses on improving operational processes and system performance, often requiring engineering or technical backgrounds. In contrast, Data Analyst Interns primarily analyze data sets to generate insights. Both roles are valuable entry points in tech and data-driven industries, but they serve different core functions.

What are the most commonly searched types of Optimization Engineer jobs in New York? The most popular types of Optimization Engineer jobs in New York are:
What cities in New York are hiring for Internship Optimization Engineer jobs? Cities in New York with the most Internship Optimization Engineer job openings:

Senior Software Engineer - AI Inference

Bloomberg LP

New York, NY • On-site

$134K - $176K/yr

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Re-posted 13 days ago


Bloomberg rating

9.4

Company rating: 9.4 out of 10

Based on 11 frontline employees who took The Breakroom Quiz

11th of 244 rated software companies


Job description

Senior Software Engineer - AI Inference
Location
New York
Business Area
Engineering and CTO
Ref #
10050779
Description & Requirements
Our team:
Join the team that is building the core infrastructure for AI at Bloomberg. The Bloomberg AI Inference Platform provides production-grade managed infrastructure for hosting, deploying, and serving all machine learning models, both predictive and cutting-edge generative models. We abstract away infrastructure complexity, empowering engineering teams to focus on creating intelligent applications with guaranteed scalability, performance, and governance. Our platform is built on the open-source KServe project, and the CNCS AI Inference team is a primary contributor to its development.
We'll trust you to:
  • Design and build scalable infrastructure for both online and offline inference workloads.
  • Lead integration of high-performance inference runtimes and serving frameworks, including TensorRT, vLLM, ONNX, and Triton.
  • Drive architecture and technical decisions across Bloomberg's inference platform, balancing latency, throughput, reliability, and cost.
  • Partner across engineering teams to improve model deployment, observability, and production performance.
  • Mentor junior engineers on system design, debugging, and performance optimization.

You'll need to have:
  • 5+ years of professional software engineering experience.
  • Experience designing, building, and operating production distributed systems.
  • Strong systems intuition and a track record of debugging and optimizing performance-critical services.
  • Ability to own problems end-to-end and quickly ramp up in unfamiliar technical areas.
  • 4+ years of demonstrated experience working with an object-oriented programming language.
  • A degree in Computer Science, Electrical Engineering, or equivalent practical experience.

We'd love to see:
  • Experience deploying and operating machine learning systems at scale.
  • Experience with inference optimization techniques such as batching, caching, request scheduling, or memory-aware serving.
  • Familiarity with PyTorch and GPU software stacks such as CUDA and NCCL.
  • Exposure to high-performance interconnects and distributed computing technologies such as NVLink, InfiniBand, or MPI.
  • Experience with Kubernetes and cloud-native infrastructure.
  • Experience with load balancing, request routing, or traffic management systems.

Representative projects:
  • Autoscaling a heterogeneous compute fleet to match supply and demand aross diverse inference workloads.
  • Building production-grade deployment pipelines to safely roll out new models to millions of users.
  • Developing new inference capabilities such as structured sampling, prompt caching, and advanced serving optimizations.
  • Analyzing observability data from real production workloads to improve latency, throughput, and resource efficiency.

Salary Range = 160,000 - 240,000 USD Annual + Benefits + Bonus
The referenced salary range is based on the Company's good faith belief at the time of posting. Actual compensation may vary based on factors such as geographic location, work experience, market conditions, education/training and skill level.
We offer one of the most comprehensive and generous benefits plans available and offer a range of total rewards that may include merit increases, incentive compensation (exempt roles only), paid holidays, paid time off, medical, dental, vision, short and long term disability benefits, 401(k) +match, life insurance, and various wellness programs, among others. The Company does not provide benefits directly to contingent workers/contractors and interns.
Discover what makes Bloomberg unique - watch our podcast series for an inside look at our culture, values, and the people behind our success.

What Bloomberg employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom


Bloomberg logo

About Bloomberg

Sourced by ZipRecruiter

Bloomberg runs on data. As the Data Management & Analytics team within Engineering, we support our organization's needs around managing data efficiently. The vision of the team is to build solutions that drive data quality, data dictionary, data stewardship, data lineage, reference, and master data management across various data domains (prospect, customer, vendor, material etc.). We partner with business teams across the organization in addressing their data needs and ultimately helping run business operations efficiently and make improved decisions.

Industry

Finance and insurance

Company size

10,000+ Employees

Headquarters location

New York, NY, US

Year founded

1981