1

Python Llm Jobs in New York (NOW HIRING)

Architect and implement robust, scalable solutions using Python, Langchain/LangGraph, and LLM frameworks. * Act as a trusted technical advisor to customers, understanding their needs and crafting ...

Python, FastAPI, and Asynchronous Programming. RAG & Data: PostgreSQL, Vector Databases, and ... Deployment: Docker, Production API management, and LLM monitoring. Tools: Prompt Engineering ...

VP Python Tech Lead

Rutherford, NJ · On-site

$142K - $213K/yr

The Python Tech Lead is a senior level position responsible for establishing and implementing new ... You will have to have open and adaptive mindset to learn new and advanced models in LLM and GenAI ...

Python, FastAPI, and Asynchronous Programming. RAG & Data: PostgreSQL, Vector Databases, and ... Deployment: Docker, Production API management, and LLM monitoring. Tools: Prompt Engineering ...

LLM Engineer (GenAI, NYC)

New York, NY · On-site

$150K - $230K/yr

Work closely with product and design teams to develop intuitive applications that create societal impact Qualifications * 3+ YOE in Python * 1+ YOE in LLM framework like Langchain or LlamaIndex * 1+ ...

Strong programming experience with Python. * LLM Models (Llama, Mixtral, Mistral) and various inferencing mechanisms (transformer/pipeline, vllm). * Agentic frameworks such as langgraph and LLM ...

AI Solutions Developer

New York, NY · On-site

$55 - $75.75/hr

... Python and modern AI frameworks such as LangChain PyTorch and TensorFlow. The role involves designing developing and deploying intelligent solutions including LLM powered applications machine ...

next page

Showing results 1-20

Python Llm information

What is a Python LLM job?

A Python LLM job involves working with Large Language Models (LLMs) using Python to develop, fine-tune, and deploy AI models. Responsibilities may include data preprocessing, prompt engineering, model optimization, and integration with applications. Professionals in this role often work with frameworks like TensorFlow, PyTorch, or Hugging Face Transformers. They may also contribute to improving model efficiency, reducing bias, and ensuring ethical AI usage.

What are the key skills and qualifications needed to thrive in the Python Llm position, and why are they important?

To excel as a Python LLM (Large Language Model) Engineer, you need strong skills in Python programming, machine learning, and natural language processing, typically supported by a degree in computer science or a related field. Proficiency with libraries such as TensorFlow, PyTorch, Hugging Face Transformers, and experience with model deployment platforms are often essential, alongside certifications in AI or data science. Effective communication, problem-solving abilities, and collaboration are important soft skills for working in interdisciplinary teams and delivering results in dynamic environments. These skills ensure the development, fine-tuning, and deployment of advanced language models that meet both technical and business objectives.

What are some common challenges faced by Python LLM Engineers in their daily work?

Python LLM Engineers often encounter challenges related to optimizing model performance, managing large datasets, and adapting models to specific business needs. Working with large-scale language models requires balancing computational resource limitations with the need for high accuracy and efficiency. Collaboration with data scientists, product managers, and DevOps engineers is routine to ensure seamless model integration and deployment. Staying updated on the latest advancements in NLP and continuously improving models based on user feedback are also important aspects of the role.

What are the most commonly searched types of Python Llm jobs in New York? The most popular types of Python Llm jobs in New York are:
What cities in New York are hiring for Python Llm jobs? Cities in New York with the most Python Llm job openings:
AI/LLM Sr Manager of Software Engineering - Java and Python

AI/LLM Sr Manager of Software Engineering - Java and Python

JP Morgan Chase

Manhattan, NY

Full-time

Medical, Retirement

Re-posted 12 days ago


JPMorgan Chase & Co. rating

8.0

Company rating: 8.0 out of 10

Based on 491 frontline employees who took The Breakroom Quiz

58th of 149 rated banks


Job description

When you mentor and advise multiple technical teams and move financial technologies forward, it's a big challenge with big impact. You were made for this. 

As a Senior Manager of Software Engineering at JPMorganChase within the Consumer and Community Banking Core Platform Engineering team, you serve in a leadership role by providing technical coaching and advisory for multiple technical teams, as well as anticipate the needs and potential dependencies of other functions within the firm. As an expert in your field, your insights influence budget and technical considerations to advance operational efficiencies and functionalities.

Job responsibilities

  • Provide overall direction, oversight, and coaching for a team of mid-level software engineers delivering AI-enabled capabilities across the ProductGPT ecosystem, spanning basic to moderately complex tasks, and evolving toward more advanced agentic and workflow-based solutions
  • Lead with a hands-on mindset: stay close to design and implementation, unblock delivery, and drive engineering excellence through code reviews, architecture guidance, and pragmatic decision-making
  • Be accountable for decisions that influence teams' resources, budget, tactical operations, and the execution and implementation of processes and procedures, especially as priorities shift in a fast-moving AI domain
  • Establish and iterate on AI development strategies for use-case delivery, including LLM integration approaches, evaluation strategies, prompt/context management, orchestration patterns, and safe deployment practices
  • Ensure successful collaboration across teams and stakeholders in multiple locations, partnering closely with product team representation to align on outcomes, milestones, tradeoffs, and sequencing
  • Manage and prioritize multiple concurrent requests and initiatives, balancing near-term delivery with platform health, operational readiness, and long-term technical direction
  • Drive cloud-native engineering practices leveraging AWS services and modern data/storage patterns, ensuring solutions are scalable, observable, secure, and cost-aware
  • Promote strong engineering fundamentals across the stack, including API design, data modeling, resiliency, testing discipline, CI/CD, and operational excellence
  • Identifies and mitigates issues to execute a book of work while escalating issues as necessary
  • Provides input to leadership regarding budget, approach, and technical considerations to improve operational efficiencies and functionality for the team
  • Creates a culture of diversity, opportunity, inclusion, and respect for team members and prioritizes diverse representation

Required qualifications, capabilities, and skills

  • Formal training or certification on Software Engineering concepts and 5+ years applied experience. In addition, 2 + years of experience leading technologists to manage and solve complex technical items within your domain of expertise.

  • Experience leading teams of technologists.
  • Ability to guide and coach teams on approach to achieve goals aligned against a set of strategic initiatives
  • Strong software engineering foundation with hands-on experience building services in Java and Python, working with databases, and using modern integration patterns.
  • Working knowledge of AI/LLM-enabled application development, including prompt/context design, orchestration and agentic patterns, and evaluation/quality approaches.
  • Hands-on experience using AI coding assistants (e.g., GitHub Copilot, Claude Code, or firm-approved equivalents) to accelerate secure, high-quality development, test automation, and code review within enterprise guardrails.
  • Ability to set clear technical direction while remaining flexible and adaptive in a rapidly evolving problem space (e.g., AI-enabled product development).
  • Demonstrated experience partnering with product leaders and stakeholders to translate ambiguous requirements into actionable technical plans and measurable delivered results.
  • Experience hiring, developing, and recognizing talent, with a track record of building strong engineering culture and effective feedback mechanisms.
  • Practical cloud-native experience designing, deploying, and operating production systems on AWS.
  • Experience in Computer Science, Engineering, Mathematics, or a related field and expertise in technology disciplines.

Preferred qualifications, capabilities, and skills

  • Experience working at code level, including contributing to production-grade services, debugging complex issues, and setting engineering standards through exemplars.
  • Experience building AI-assisted and AI-native software systems, including LLM integration patterns, tool/skill design, retrieval/context enrichment, and agentic workflow orchestration.
  • Experience operating distributed systems in AWS (e.g., compute, storage, messaging, observability), with a track record of reliability and cost-aware scaling
  • Experience balancing delivery across multiple concurrent initiatives while managing dependencies across teams and stakeholder groups.
  • Experience with cloud-native DevOps practices, including CI/CD pipelines, infrastructure as code (e.g., Terraform, CloudFormation), and automated testing in distributed environments.

Chase is a leading financial services firm, helping nearly half of America's households and small businesses achieve their financial goals through a broad range of financial products. Our mission is to create engaged, lifelong relationships and put our customers at the heart of everything we do. We also help small businesses, nonprofits and cities grow, delivering solutions to solve all their financial needs. 

We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions.  We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process. 

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

Equal Opportunity Employer/Disability/Veterans

Our Consumer & Community Banking division serves our Chase customers through a range of financial services, including personal banking, credit cards, mortgages, auto financing, investment advice, small business loans and payment processing. We're proud to lead the U.S. in credit card sales and deposit growth and have the most-used digital solutions - all while ranking first in customer satisfaction.

What JPMorgan Chase & Co. employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom