Databricks Engineer Jobs in Pittsburgh, PA (NOW HIRING)

LMI is seeking a skilled Data Engineer to join our team and contribute to developing innovative software programs that support activities for the Army's AI2C organization, located in Pittsburgh, PA. This role is centered on building and operating data pipelines, ontologies, and applications within Palantir Foundry (Vantage), with secondary responsibilities extending into Databricks for large-scale data processing and analytics engineering. This position offers an opportunity to provide technical leadership while strategically growing the development footprint with the customer. Candidates should be comfortable working in a fast-paced, flexible environment and be self-directed, collaborative, and eager to grow technically. Candidates with the ability to be on-site in Pittsburgh are preferred.

LMI is a new breed of digital solutions provider dedicated to accelerating government impact with innovation and speed. Investing in technology and prototypes ahead of need, LMI brings commercial-grade platforms and mission-ready AI to federal agencies at commercial speed.

Leveraging our mission-ready technology and solutions, proven expertise in federal deployment, and strategic relationships, we enhance outcomes for the government, efficiently and effectively. With a focus on agility and collaboration, LMI serves the defense, space, healthcare, and energy sectors-helping agencies navigate complexity and outpace change. Headquartered in Tysons, Virginia, LMI is committed to delivering impactful results that strengthen missions and drive lasting value.

• Lead data engineering efforts within Palantir Foundry (Vantage), including ontology design, pipeline development, and data integration for Army AI2C mission applications
• Build, maintain, and optimize Foundry pipelines using Python-based transforms (PySpark/Pipeline Builder), Code Repositories, and Foundry's data connection framework
• Develop and maintain data engineering workflows in Databricks, including notebooks, Delta Lake tables, and Spark jobs, for workloads that complement or feed into the Foundry environment
• Write, design, and implement efficient, reusable, and reliable code using Python, PySpark, SQL, and TypeScript/JavaScript as needed for Foundry Workshop or Slate applications
• Translate complex data science and analytics outputs into governed, reusable data products surfaced through Foundry and Databricks
• Lead the integration of AI/ML capabilities into Foundry and Databricks-based applications, identifying opportunities to leverage emerging AI technologies (including Foundry AIP or Databricks ML/AI tooling)
• Champion AI-forward, platform-first development practices and guide the team in implementing AI/ML features and data-driven experiences
• Provide technical leadership and mentorship to grow the team's capabilities across Foundry (Vantage) and Databricks
• Identify and pursue opportunities to expand development initiatives with Army stakeholders
• Collaborate effectively with data scientists, UX designers, and software developers using Git, participating in code reviews and adopting Agile methodologies
• Engage with Army managers and representatives in a consultative capacity to identify data platform needs, explore innovative data-driven solutions including AI applications, and build strategic relationships that expand our development footprint
• Comfortable working independently and as a member of a team, with demonstrated ability to work in strategic and consultant-oriented environments
• Excellent verbal and written communication skills with ability to articulate technical concepts to non-technical stakeholders and influence strategic decisions

• Bachelor's degree in Computer Science, Data Science, Data Engineering, Software Engineering, Information Systems, or a related field, or equivalent work experience
• 3-5 years of experience in data engineering, with hands-on experience building and operating applications on the Palantir Foundry (Vantage) platform
• Demonstrated experience with Foundry pipeline development (PySpark/Pipeline Builder), Code Repositories, ontology/object modeling, and Foundry Workshop application building
• Working experience with Databricks, including notebooks, Delta Lake, and Spark-based data processing, as a secondary platform to Foundry
• Proficiency in Python and SQL for data manipulation and pipeline development (pandas, PySpark, numpy, or similar)
• Familiarity with data visualization approaches (D3.js, Plotly, Recharts, or Foundry-native Workshop widgets) for surfacing pipeline outputs
• Demonstrated experience in planning, analyzing, designing, implementing, testing, and maintaining data pipelines and applications for an enterprise-level system
• Familiarity with Git, Agile methodologies, CI/CD, and automated deployments
• Demonstrated experience in leadership roles, technical mentorship, or client relationship management
• Active Secret Clearance or ability to obtain one is required

• Experience integrating AI/ML capabilities into Foundry or Databricks-based applications and identifying strategic AI use cases
• Familiarity with AI frameworks and APIs (OpenAI, Anthropic Claude, LangChain, or similar) and with Foundry AIP
• Knowledge of statistical analysis and machine learning concepts
• Experience with Storybook for component development, documentation, and design system management
• Hands-on deployment experience across multiple environments and platforms, including classified/air-gapped Foundry instances
• Knowledge of the Army software development process and its technologies or experience developing applications for classified data
• Background working in strategic planning or consultant environments supporting government or DoD clients
• Proven track record of expanding technical scope or footprint with government customers
• 7+ years of directly related experience
• Master's degree in Computer Science, Data Science, Data Engineering, Software Engineering, Information Systems, or related field
• On-site (Pittsburgh) candidates preferred

The target salary range for this position is $101,144 - $174,591.

The salary range displayed represents the typical salary range for this position and is not a guarantee of compensation. Individual salaries are determined by various factors including, but not limited to location, internal equity, business considerations, client contract requirements, and candidate qualifications, such as education, experience, skills, and security clearances. 

Applicants must meet eligibility requirements for a U.S. Government security clearance. Only US Citizens are eligible for a security clearance. For this position, LMI will only consider applicants with security clearances or applicants who are eligible for security clearances, due to the nature of the work.

Percentage of Travel Required: 10%