Job Summary:
The Marlin Alliance is a digital transformation company dedicated to helping clients succeed in a digital world. They are seeking a Data Engineer to provide client support to their Navy client, focusing on building and optimizing data pipelines, and implementing automation and data governance strategies.
Responsibilities:
• Build and optimize robust data pipelines: ingestion, transformation, storage, and governance.
• Convert between tactical data formats, e.g., XML, JSON, GEOJSON, Cursor-on-Target (CoT), JREAP-C, Link-16.
• Implement automation using CHRON/CRON jobs and data orchestration frameworks (Apache Airflow, Kafka, AWS Step Functions).
• Architect and maintain scalable data stores (e.g., Apache Iceberg, Elasticsearch) with schema evolution and deduplication.
• Enable real-time data indexing and fast query performance.
• Implement MIL-STD-6016 (Link-16) and MIL-STD-3011 (JREAP) message handling.
• Support integration or development of Cross-Domain Solutions (CDS) for secure, policy-based data transfers.
• Present complex data flows and technical insights effectively to leadership and stakeholders using clear data models and visual aids.
Qualifications:
Required:
• 5 - 10 years' experience working as a business analyst, data analyst, data scientist, data engineer, database administrator, geospatial analyst, geospatial engineer, machine learning engineer, or software engineer
• Hands on Keyboard- Developer Skillsets
• Fluency in Python, can code without Modern libraries.
• Experience in format conversions with some of the following: XML, JREAP-C, COT (cursor-on-target), JSON, GEO JSON, UMF/UHR, text link-16, Tapil-J, and other Tactical Data Links.
• Experience in natural language parsing (NLP) and using regular expressions, RegEx
• Experience implementing CHRON/CRON jobs
• Experience in data pipeline orchestration, ETL, orchestration tools (e.g., Kafka, Apache Airflow, AWS Step Functions)
• Focused experience implementing and monitoring data stores i.e. (Apache Iceberg, elastic search, data lake management)
• Experience with schema evolution, dataflow and governance
• Experience with real-time search and analytics engines for indexing and querying semi-structured data
• Focused experience optimizing data store queries for speed and de-duplication
• Direct experience implementing MIL-STD-6016 and MIL-STD-3011
• Can translate data between source and destination schemas
• Data modeling and PowerPoint presentations for leadership and stakeholder presentations
• Experience working with or developing Cross Domain Solutions (CDS) systems.
Preferred:
• Familiarity with DoD data architecture principles (e.g. DoDAF, CADM).
• Experience with DataOps or similar mission-critical pipeline automation (e.g., deduplication, schema normalization).
• Any experience leveraging universal data distribution architectures within DOD operations.
Company:
The Marlin Alliance, Inc. Founded in 2002, the company is headquartered in San Diego, USA, with a team of 51-200 employees. The company is currently Growth Stage.