Llm Developer Jobs in Raleigh, NC (NOW HIRING)

Sr. Software Developer (Infrastructure)

Raleigh, NC

Apply

Who We Are:

Bandwidth, a prior “Best of EC” award winner, is a global software company that helps enterprises deliver exceptional experiences through voice, messaging, and emergency services. Reaching 65+ countries and over 90 percent of the global economy, we're the only provider offering an owned communications cloud that delivers advanced automation, AI integrations, global reach, and premium human support. Bandwidth is trusted for mission-critical communications by the Global 2000, hyperscalers, and SaaS builders!

At Bandwidth, your music matters when you are part of the BAND. We celebrate differences and encourage BANDmates to be their authentic selves. #jointheband

What We Are Looking For:

A Sr. Software Developer (Infrastructure) that will help us build the platform and tools that help Bandwidth engineers ship better software, faster.

Bandwidth powers brands like Google, Microsoft, Zoom, and GoDaddy with intelligent voice, messaging, 911 access, and phone number services, all on our own nationwide, all-IP network. We're the infrastructure layer that global enterprises trust to connect their customers.

Our Software Infrastructure team owns the "paved road." The platform, tools, and systems that let every Bandwidth engineer build and ship with confidence. We're looking for someone who wants to help take that further: an engineer who sees AI not as a tool to adopt, but as a platform to build.

You'll play a key role in helping make Bandwidth an AI-first engineering organization.

What you'll do

• Design and operate Bandwidth's AI infrastructure layer, including our LLM gateway, model routing, and cost controls, so every engineering team can experiment with AI tools safely and cheaply.

• Build and maintain the "paved road" of developer tooling and platform services that help engineers ship faster with less friction.

• Drive adoption of AI coding tools (Claude Code, Copilot, and others) by building enablement systems, prompt libraries, MCP server integrations, and internal tooling that make AI feel obvious, not optional.

• Connect AI to the systems engineers already use (Jira, Confluence, Slack, GitHub) so context flows to wherever work happens.

• Measure what actually matters: engineer velocity, build times, reversion rates, and real shipping outcomes. Not vanity metrics.

• Stay ahead of the curve on agentic workflows, helping teams evolve from writing every line of code to orchestrating AI systems that handle the toil.

What you need

• 5+ years of experience building and operating web services in production

• Hands-on experience with cloud infrastructure, especially AWS

• Strong coding skills in Python, Go, TypeScript, or similar

• Experience with platform services: CI/CD, secrets management, developer portals, internal tooling

• Familiarity with LLM APIs and the tradeoffs involved in model routing, token cost management, and AI observability

• Experience building tools or services that other engineers depend on day-to-day

• A results-driven mindset. You close the loop, you ship, you measure.

• Bachelor's degree or equivalent experience

Bonus points

• You've built or operated an LLM proxy, AI gateway, or model routing layer

• You've worked on a Developer Experience or Software Platform team before

• You've written infrastructure as code (Terraform, CDK, CloudFormation)

• You've built MCP servers or integrated AI tools with internal systems like Jira, Slack, or GitHub

• You've built tools or services other developers actually use (open source counts)

• You've worked in a startup or high-ambiguity environment where you had to define the requirements yourself

Why this role is different

• The AI landscape is moving fast. We're not looking for someone to standardize a single tool. This team is helping build the infrastructure layer that makes every tool possible. The LLM gateway, the MCP server integrations, the internal tooling that lets engineers experiment without bottlenecks: that's this team's contribution to where Bandwidth is headed.

• The principle is simple: standardize infrastructure, not tools. The aspiration is an engineering organization where every engineer has superpowers, AI is woven into how work gets done by default, and the people building software still deeply understand the systems they're building.

The Whole Person Promise:

At Bandwidth, we’re pretty proud of our corporate culture, which is rooted in our “Whole Person Promise.” We promise all employees that they can have meaningful work AND a full life, and we provide a work environment geared toward enriching your body, mind, and spirit. How do we do that? Well…

• 100% company-paid Medical, Vision, & Dental coverage for you and your family with low deductibles and low out-of-pocket expenses.

• All new hires receive four weeks of PTO.

• PTO Embargo. When you take time off (of any kind!) you’re embargoed from working. Bandmates and managers are not allowed to interrupt your PTO – not even with email.

• Additional PTO can be earned throughout the year through volunteer hours and Bandwidth challenges.

• “Mahalo moments” program grants additional time off for life’s most important moments like graduations, buying a first home, getting married, wedding anniversaries (every five years), and the birth of a grandchild.

• 90-Minute Workout Lunches and unlimited meetings with our very own nutritionist.

Are you excited about the position and its responsibilities, but not sure if you’re 100% qualified? Do you feel you can work to help us crush the mission? If you answered ‘yes’ to both of these questions, we encourage you to apply! You won’t want to miss the opportunity to be a part of the BAND.

Applicant Privacy Notice (https://www.bandwidth.com/employee-applicant-privacy-notice)

Create a Job Alert

Interested in building your career at Bandwidth? Get future opportunities sent straight to your email.

Create alert