Databricks Data Engineer Jobs in Houston, TX (NOW HIRING)

Texas, United States of America

Job Family Group:

Information Technology (IT)

Worker Type:

Regular

Posting Start Date:

June 11, 2026

Business Unit:

Projects and Technology

Experience Level:

Experienced Professionals

Job Description:

What's the role

Shell is seeking a Sr. AI & Data Engineer - Trading Analytics (also known internally as Data Engineering Lead) to join its team in Houston, TX. This role is ideal for an AI Engineer with a strong foundation in data engineering who can design and deliver AI-driven front-office analytics and GenAI/agentic solutions, collaborating closely with traders and trading analysts.

Shell Trading & Supply is one of the world's leading energy and commodity trading organizations, operating across crude, refined products, gas, LNG, power, and environmental products. Trading sits at the heart of Shell's energy transition, requiring rapid, datadriven decision making under complex market conditions. Within Trading & Supply, the Crude & Products business plays a critical commercial role, operating in highly regulated, fastmoving markets where highquality analytics, data engineering, and AI are key competitive differentiators. Our focus is to deliver secure, reliable, and tradercentric digital solutions that simplify workflows, enhance insight, and drive commercial value without compromising risk, safety, or controls.

As a Sr. AI & Data Engineer in Trading Analytics, you will work directly with frontoffice teams to design, build, and productionize AIdriven analytics over market pricing and fundamental data. You will combine Databricksbased data engineering, statistical and econometric techniques, and modern GenAI/agentic workflows to deliver insight at speed. This is a handson individual contributor role with a strong bias toward practical delivery. You will operate in a hightouch, hybrid model, iterating rapidly with users ondesk, while engineering solutions to productiongrade standards using modern CI/CD and governance practices. Also, this role is rapid prototyping, iterative learning, and incremental production hardening, balanced with adherence to engineering, security, and governance frameworks to maintain speed and reliability.

Accountabilities:

FrontOffice Analytics & Insight

• Design, build, and deliver AIdriven analytics for traders and analysts, including seasonality analysis, correlation studies, regression models, forecasting, and scenario modelling over market pricing and fundamentals data

• Work closely with traders and analysts to translate ambiguous business questions into clear analytical problem statements and working solutions

• Clearly communicate analytical outputs and AIgenerated insights to commercial stakeholders in a concise and actionable manner

Data Engineering & Platforms

• Build and maintain scalable, reusable data pipelines on Databricks using PySpark/Spark, SQL, Delta Lake, and Unity Catalog

• Support ingestion, modelling, and transformation of largescale timeseries pricing and fundamentals datasets

• Optimize pipelines for performance, reliability, and cost efficiency, following platform and data governance standards

AI, GenAI & Agentic Solutions

• Build and enhance GenAI and agentbased solutions to support trading analytics, including:

  • RetrievalAugmented Generation (RAG)

  • Prompt engineering

  • Agent orchestration using frameworks such as LangGraph

  • Tool calling and guardrails

• Integrate LLMbased workflows with structured trading and market data to augment analysis, insight generation, and decision support

• Prototype solutions quickly, gather user feedback, and help harden selected use cases for production deployment

Production, Quality & Operations

• Contribute to productionready analytics and AI solutions with testing, documentation, versioning, and basic observability

• Follow established CI/CD and DevOps practices, including use of Gitbased workflows and automated testing

• Support governance requirements such as PII handling, data lineage, and auditability in line with Trading & Supply standards

What you bring

• Must have legal authorization to work in the US on a full-time basis for anyone other than current employer

• Bachelor's degree or equivalent relevant years of experience

• At least 7 years of relevant experience

• Handson experience with Databricks and/or Spark (PySpark, SQL, Delta Lake; Unity Catalog desirable)

• Proven data engineering skills, including pipeline development, data modelling, and performance optimization

• Solid foundation in statistics, econometrics, or data science, with experience applying these techniques to timeseries or marketstyle datasets

• Practical experience building or contributing to LLMbased solutions, including prompt engineering and retrievalbased approaches

• Familiarity with GenAI frameworks and tooling (e.g., LangGraph or similar orchestration patterns)

• Experience working in collaborative engineering teams using Git and CI/CD pipelines

• Strong communication skills and the ability to work directly with analysts, traders, and other business stakeholders

Additional Preferred Qualifications

• Exposure to commodity or financial trading environments

• Understanding of market fundamentals, supplydemand dynamics, or risk concepts

• Experience with MLflow, feature stores, or vector databases

• Familiarity with working in regulated or risksensitive environments

What we offer

The base salary range for this position is $149,000 - $223,000 per year. Individual pay will be based on various factors, such as relevant work experience, education, certifications, skill level, seniority, and internal equity.

For regular full-time or regular part-time employees of the Company (participating companies as listed in the Summary Plan Description), insurance coverage options include medical, dental, vision coverage, life Insurance, Business Travel Accident Insurance, and Occupational Accidental Death Benefit programs. Employees also participate in a company pension plan and a 401(k) plan. Paid leave includes up to 6 weeks of paid vacation time, up to 11 paid holidays, and parental leave offering 16 weeks of paid leave for birthing parents, and 8 weeks of paid leave for non-birthing parents.

Additionally, employees are eligible for short-term disability leave for up to 26 weeks at 100% or 50% of base pay as well as Long-Term Disability insurance. Shell also offers other compensation such financial reimbursement for adoption, wellness, education, and personal learning expenses, and some roles are eligible for discretionary long-term incentives. For interns, eligible benefits include medical, dental, and vision coverage, life insurance, Business Travel Accident Insurance, and Occupational Accidental Death Benefit programs; participation in a 401(k) plan; and paid leave for up to 11 paid holidays. Additional information on Shell's US benefit programs can be found at https://www.shell.us/careers/about-careers-at-shell/rewards-and-benefits.html.

You bring your skills and experience to Shell and in return you work with talented, committed people on one of the most important challenges facing our planet. You'll have the opportunity to develop the skills you need to grow in an environment where we value honesty, integrity, and respect for one another. You'll be able to balance your priorities as you become the best version of yourself.

• Progress as a person as we work on the energy transition together

• Continuously grow the transferable skills you need to get ahead

• Work at the forefront of technology, trends, and practices

• Collaborate with experienced colleagues with unique expertise

• Achieve your balance in a values-led culture that encourages you to be the best version of yourself

• Benefit from flexible working hours, and the possibility of remote/mobile working

• Perform at your best with a competitive starting salary and annual performance related salary increase - our pay and benefits packages are considered to be among the best in the world.

• Take advantage of paid parental leave, including for non-birthing parents

• Join an organization working to become one of the most diverse and inclusive in the world. We strongly encourage applicants of all genders, ages, ethnicities, cultures, abilities, sexual orientation, and life experiences to apply

• Grow as you progress through diverse career opportunities in national and international teams

• Gain access to a wide range of training and development programs

We'd like you to know that Shell has a bold goal: to become one of the world's most diverse and inclusive companies. You can get to know more about how we're working towards that goal, click here.

Shell in The United States

Shell has been in the US for more than 100 years, leading the sector in energy, petrochemicals and refined products. Today, we provide millions of Americans with the energy needed to heat and cool their homes and power the economy.

We operate in all 50 states, from our Deepwater platforms in the Gulf of America to the Pennsylvania Chemicals complex and our miles of pipelines throughout the US.

We reach our customers through our 13,000 branded retail stations, and we are number 1 in gasoline sales. We also own the #1 brand of motor oil in the U.S. - Pennzoil - made from natural gas.

We are excited to play a key role in the move to net carbon emissions while providing the oil and gas needed by society for many decades to come.

-

DISCLAIMER:

Please note: We occasionally amend or withdraw Shell jobs and reserve the right to do so at any time, including prior to the advertised closing date. Before applying, you are advised to read our data protection policy. This policy describes the processing that may be associated with your personal data and informs you that your personal data may be transferred to Shell/Shell Group companies around the world. The Shell Group and its approved recruitment consultants will never ask you for a fee to process or consider your application for a career with Shell. Anyone who demands such a fee is not an authorised Shell representative and you are strongly advised to refuse any such demand. Shell participates in E-Verify. All qualified applicants will receive consideration for employment without regard to race, color, sex, national origin, age, religion, disability, sexual orientation, gender identity, protected veteran status, citizenship, genetic information or other protected status under federal, state or local laws. Shell is an Equal Opportunity Employer - Minorities/Females/Veterans/Disability. As a US Federal Contractor, hiring selections are subject to periodic audit review and documentation of your selections should be maintained for a period of three calendar years. It is the policy of Shell in the U.S. ("Shell") to provide equal opportunity to all individuals, employees and all qualified applicants for employment consistent with employment requirements and qualifications. Shell prohibits discrimination based on race, color, sex, national origin, age, religion, disability, sexual orientation, gender identity, veteran status, citizenship, genetic information, or other protected status under federal, state or local laws. All employees are expected to support this policy and contribute to an environment of equal opportunity. If you need an accommodation for a disability during the resourcing process, please speak with an HR representative.