Job Summary:
NS2 Mission is seeking a Data & Software Engineer to support the team in McLean, VA. The role involves designing, developing, and maintaining scalable data pipelines and software solutions to support mission operations, leveraging modern cloud technologies and AI/ML capabilities.
Responsibilities:
• Design, develop, and maintain scalable end-to-end data pipelines using Python and modern data engineering frameworks.
• Build and optimize ETL workflows that process structured, unstructured, and geospatial data at scale.
• Deploy and manage containerized applications within AWS cloud environments.
• Develop and optimize SQL and NoSQL data solutions, including database design, performance tuning, and query optimization.
• Integrate AI/ML models and services into production data workflows.
• Utilize orchestration tools to automate data pipelines and manage Spark jobs.
• Maintain data governance, lineage, cataloging, and compliance best practices across enterprise datasets.
• Collaborate with stakeholders to gather requirements, design technical solutions, and support platform modernization initiatives.
• Troubleshoot pipeline failures, performance bottlenecks, and data quality issues while contributing to engineering best practices and technical documentation.
Qualifications:
Required:
• 5+ years of experience building production data pipelines and scalable ETL solutions.
• Advanced Python development experience, including Pandas and NumPy.
• Experience developing with Apache Spark and PySpark.
• Experience deploying containerized applications using Docker or Podman.
• Experience working with AWS services including S3, Lambda, and Step Functions.
• Strong SQL experience, including Trino, MySQL, and PostgreSQL with performance tuning and schema design.
• Experience working with NoSQL technologies such as DynamoDB.
• Experience with workflow orchestration tools including Apache Airflow and Apache Iceberg.
• Familiarity with Infrastructure as Code using Terraform or CloudFormation.
• Experience using Git and modern source control practices.
• Experience with Bash scripting for automation and data processing.
• Understanding of data governance, security, privacy, lineage, and compliance principles.
Preferred:
• Experience with Unity Catalog OSS, Apache Polaris, and OpenLineage.
• Experience with Apache Superset or similar data visualization platforms.
• Experience working with geospatial data technologies including H3 and PostGIS.
• Experience supporting AI/ML model deployment and production data workflows.
• Experience supporting large-scale data migration or platform modernization initiatives.
Company:
NS2 Mission’s expert engineers and intelligence analysts provide tailored solutions to our nation’s classified Department of Defense and Intelligence Community, employing emerging technologies and pushing the technical edge. Founded in , the company is headquartered in Chantilly, Virginia, US, , with a team of 201-500 employees. The company is currently Growth Stage.