The work
As a Data Engineer in this role, you will play a pivotal part in advancing operational AI adoption by building and optimizing a modern Hub-and-Spoke data architecture. Your responsibilities will include designing and implementing distributed data processing solutions, developing streaming architectures, and constructing robust enterprise data layers to support mission-critical applications.
Key responsibilities:
- Design, build, and maintain distributed data processing pipelines to support operational AI adoption
- Develop and optimize streaming architectures for real-time and batch data ingestion and transformation
- Implement and manage an Data Layer, ensuring robust data lineage and metadata management
- Create and maintain AI-ready data pipelines that enable multi-source data fusion and analytics
- Integrate and leverage technologies such as Spark, Kafka, Trino, ClickHouse, Iceberg, and OpenSearch within the data ecosystem
- Collaborate with cross-functional teams to support mission applications, enterprise AI governance, and agentic AI systems
- Ensure data pipelines are secure, scalable, and aligned with DevSecOps and cybersecurity best practices
- Support continuous monitoring, observability, and scalable software delivery for mission-focused operational workflows
- Contribute to the integration of AI, data engineering, platform engineering, and analytics within a modern Hub-and-Spoke architecture.
- You will be tasked with ensuring comprehensive data lineage and metadata management, enabling AI-ready data pipelines, and facilitating multi-source data fusion to drive actionable insights
- Your work will directly contribute to the integration of AI, DevSecOps, platform engineering, and cybersecurity within a scalable, continuously monitored environment
Here's what you need:
- Experience in any the following:
- Distributed data processing
- Streaming architectures
- Enterprise Data Layer implementation
- Data lineage and metadata
- AI-ready data pipelines
- Multi-source data fusion
Nice to have:
- Ability to collaborate across multidisciplinary teams and adapt to evolving enterprise AI governance and agentic AI system requirements will be essential for delivering scalable and resilient software solutions
Eligibility Requirements:
- US Citizen
- Active TS/SCI Clearance