1

Python Llm Jobs in New York (NOW HIRING)

The ideal candidate will be knowledgeable with Integrating Automation (Python, LLM's) into the Network Security stack of tools and services. They will also have experience in: Management of Next ...

The ideal candidate will be knowledgeable with Integrating Automation (Python, LLM's) into the Network Security stack of tools and services. They will also have experience in: Management of Next ...

LLM Applications Engineer

New York, NY · On-site

$130K - $175K/yr

As an LLM Applications Engineer, you will be the architect of our LLM infrastructure. You won't ... Proficiency in Python and JavaScript/TypeScript: Ability to work across the AI backend and the ...

Python GenAI

Jersey City, NJ · On-site

$52.50 - $72.25/hr

Role - Python GenAI Location - Jersey City, NJ/Charlotte, NC / Dallas, TX / NYC Type: W2-Contract ... LLM Models (Llama, Mixtral, Mistral) * Various inferencing mechanisms - transformer/pipeline, vllm

Developer II - Python

New York, NY · Hybrid

$85K - $110K/yr

Neuberger is looking for a curious and motivatedJunior Python Developerto join our growing ... LLM Awareness: Understanding of tokens, context, prompting, limitations, and responsible use

Senior Applied AI Engineer

New York, NY · On-site

$201K - $261K/yr

You've shipped LLM-powered features in production. You know what makes agents fail. You're comfortable moving across TypeScript and Python. If that's you, read on. What You'll Do: * Design and build ...

next page

Showing results 1-20

Python Llm information

What is a Python LLM job?

A Python LLM job involves working with Large Language Models (LLMs) using Python to develop, fine-tune, and deploy AI models. Responsibilities may include data preprocessing, prompt engineering, model optimization, and integration with applications. Professionals in this role often work with frameworks like TensorFlow, PyTorch, or Hugging Face Transformers. They may also contribute to improving model efficiency, reducing bias, and ensuring ethical AI usage.

What are the key skills and qualifications needed to thrive in the Python Llm position, and why are they important?

To excel as a Python LLM (Large Language Model) Engineer, you need strong skills in Python programming, machine learning, and natural language processing, typically supported by a degree in computer science or a related field. Proficiency with libraries such as TensorFlow, PyTorch, Hugging Face Transformers, and experience with model deployment platforms are often essential, alongside certifications in AI or data science. Effective communication, problem-solving abilities, and collaboration are important soft skills for working in interdisciplinary teams and delivering results in dynamic environments. These skills ensure the development, fine-tuning, and deployment of advanced language models that meet both technical and business objectives.

What are some common challenges faced by Python LLM Engineers in their daily work?

Python LLM Engineers often encounter challenges related to optimizing model performance, managing large datasets, and adapting models to specific business needs. Working with large-scale language models requires balancing computational resource limitations with the need for high accuracy and efficiency. Collaboration with data scientists, product managers, and DevOps engineers is routine to ensure seamless model integration and deployment. Staying updated on the latest advancements in NLP and continuously improving models based on user feedback are also important aspects of the role.
What are the most commonly searched types of Python Llm jobs in New York? The most popular types of Python Llm jobs in New York are:
What job categories do people searching Python Llm jobs in New York look for? The top searched job categories for Python Llm jobs in New York are:
What cities in New York are hiring for Python Llm jobs? Cities in New York with the most Python Llm job openings:
Lead Software Engineer (Python, LLM) - AskGartner

Lead Software Engineer (Python, LLM) - AskGartner

Gartner

Stamford, CT • Hybrid

Other

Medical, Dental, Vision, Retirement, PTO

Posted 10 days ago


Job description

About the RoleAskGartner is building toward becoming the AI-powered strategic advisor for enterprise clients - a product that puts the full depth of Gartner's research, proprietary data, and expert knowledge at clients' fingertips. As a Lead Engineer on the AskGartner core platform team, you will be a key technical force shaping the chat and embedded AI experiences that serve as the product's primary surface. This role demands an engineer who can independently drive complex initiatives end-to-end, make sound architecture decisions, and collaborate across teams to deliver high-quality, scalable solutions.
Leadership & Collaboration
  • Drive technical initiatives end-to-end - from requirements and design through delivery and post-launch iteration - with minimal guidance.
  • Own architecture and design decisions for complex systems, demonstrating strong judgment on scalability, reliability, and maintainability.
  • Communicate and collaborate effectively across engineering teams, product managers, and stakeholders to align on technical direction.
  • Mentor and elevate fellow engineers through thoughtful code reviews, design discussions, and knowledge sharing.
  • Lead solutioning sessions and proactively surface technical risks, trade-offs, and recommendations.
  • Serve as a technical point of contact for cross-functional teams, articulating complex engineering decisions clearly to both technical and non-technical audiences.
Core Expectations
  • Self-motivated and hands on professional - operates independently, completes work without follow-ups, and navigates ambiguity and challenges with minimal assistance.
  • Proactively picks up design, development tasks, drives them to completion, and communicates progress and blockers without prompting.
  • Participates actively in solutioning, contributes ideas, and raises issues early.
  • Adaptable and eager to learn - our team uses a wide array of technologies and the right candidate embraces new tools with confidence.
  • Thrives in a fast-paced environment and is comfortable supporting production releases.
Technical SkillsCore / Must Have (All Required)
  • Python - expert-level proficiency
  • Python backend services: development, APIs, deployment, and scaling
  • Python FastAPI and asynchronous programming
  • Cloud technologies: AWS (primary), Azure
  • AWS SageMaker Pipelines (end-to-end ML workflows)
  • Python unit testing (pytest)
  • Git
  • AWS S3 and data formats (Parquet, JSON, CSV)
  • PostgreSQL / SQL
  • Pandas
Strong Preferred (Should Have Most)
  • LangGraph / LangChain
  • Large language models (e.g., OpenAI, Anthropic, Google)
  • Load testing frameworks (e.g., Locust, JMeter)
  • AWS Athena
  • AWS S3 (bucket policies), IAM roles and policies
  • Splunk
  • AWS Secrets Manager and Parameter Store
  • AWS EMR (PySpark-based ETL)
  • Docker
  • Kubernetes
  • Terraform
  • OpenSearch / Search Engine indexing, retrieval (RAG systems)
  • Cache technologies
Nice to Have (Willing to Learn)
  • AWS Kinesis (live structured log ingestion to S3)
  • AWS SQS
  • AWS Glue (data catalog, crawlers)
  • AWS QuickSight
  • SonarQube
  • Jenkins / Groovy
  • Argo CI/CD
  • Snyk
What you will get:
  • Competitive compensation.
  • Limitless growth and learning opportunities.
  • Ongoing mentorship and apprenticeship; Leadership courses, development programs, technical courses, certification opportunities and more!
  • A collaborative and positive culture - join a diverse team of professionals that are as smart and driven as you.
  • A chance to make an impact - your work will contribute directly to our strategy.
  • Hybrid Work Environment - enjoy the flexibility of working from home and the energy of collaborating with peers in our dynamic offices.
  • 20+ PTO days plus holidays and floating holidays in your first year.
  • Extensive medical, dental insurance and vision plan.
  • 401K with corporate match, immediate vesting.
  • Health-and-wellness-related allowance programs.
  • Parental leave.
  • Tuition reimbursement.
  • Employee Stock Purchase Plan.
  • Employee Assistance Program.
  • Gartner Gives Charity Match.
    And much more!
#LI-Hybrid
#LI-AL2

Who are we?

At Gartner, Inc. (NYSE:IT), we guide the leaders who shape the world.

Our mission relies on expert analysis and bold ideas to deliver actionable, objective business and technology insights, helping enterprise leaders and their teams succeed with their mission-critical priorities.

Since our founding in 1979, we've grown to 20,000 associates globally who support over 13,000 client enterprises in ~90 countries and territories. We do important, interesting and substantive work that matters. That's why we hire associates with the intellectual curiosity, energy and drive to want to make a difference. The bar is unapologetically high. So is the impact you can have here.

What makes Gartner a great place to work?

Our vast, virtually untapped market potential offers limitless opportunities - opportunities that may not even exist right now - for you to grow professionally and flourish personally. How far you go is driven by your passion and performance.

We hire remarkable people who collaborate and win as a team. Together, our singular, unifying goal is to deliver results for our clients.

Our teams are inclusive and composed of individuals from different geographies, cultures, religions, ethnicities, races, genders, sexual orientations, abilities and generations.

We invest in great leaders who bring out the best in you and the company, enabling us to multiply our impact and results. This is why, year after year, we are recognized worldwide as a great place to work.

Gartner is the world authority on AI

At Gartner, you'll join a company at the very center of the AI revolution. Gartner has proactive, objective guidance throughout clients' AI journeys. We set the standard for how organizations leverage artificial intelligence to drive meaningful impact. You'll have access to unmatched resources, expertise, and technology, and play a key role in helping Gartner and our clients innovate and grow as we leverage AI to transform business and technology landscapes.

It's an exciting time to be at Gartner, with limitless opportunities to make a real impact, grow your skills, and build a lasting, meaningful career in a field that's reshaping the way we operate. If you're passionate about AI and want to be part of a team that's guiding the leaders who shape the world, Gartner is the place for you.

What do we offer?

Gartner offers world-class benefits, highly competitive compensation and disproportionate rewards for top performers.

In our hybrid work environment, we provide the flexibility and support for you to thrive - working virtually when it's productive to do so and getting together with colleagues in a vibrant community that is purposeful, engaging and inspiring.

Ready to grow your career with Gartner? Join us.

Gartner believes in fair and equitable pay. A reasonable estimate of the base salary range for this role is 116,000 USD - 170,000 USD. Please note that actual salaries may vary within the range, or be above or below the range, based on factors including, but not limited to, education, training, experience, professional achievement, business need, and location. In addition to base salary, employees will participate in either an annual bonus plan based on company and individual performance, or a role-based, uncapped sales incentive plan. Our talent acquisition team will provide the specific opportunity on our bonus or incentive programs to eligible candidates. We also offer market leading benefit programs including generous PTO, a 401k match up to $7,200 per year, the opportunity to purchase company stock at a discount, and more.


The policy of Gartner is to provide equal employment opportunities to all applicants and employees without regard to race, color, creed, religion, sex, sexual orientation, gender identity, marital status, citizenship status, age, national origin, ancestry, disability, veteran status, or any other legally protected status and to seek to advance the principles of equal employment opportunity.

Gartner is committed to being an Equal Opportunity Employer and offers opportunities to all job seekers, including job seekers with disabilities. If you are a qualified individual with a disability or a disabled veteran, you may request a reasonable accommodation if you are unable or limited in your ability to use or access the Company's career webpage as a result of your disability. You may request reasonable accommodations by calling Human Resources at +1 (203) 964-0096 or by sending an email toApplicantAccommodations@gartner.com.

Job Requisition ID:110236

By submitting your information and application, you confirm that you have read and agree to the country or regional recruitment notice linked below applicable to your place of residence.

Gartner Applicant Privacy Link: https://jobs.gartner.com/applicant-privacy-policy


For efficient navigation through the application, please only use the back button within the application, not the back arrow within your browser.