Senior Data Engineer

The Alaka`ina Foundation Family of Companies (FOCs) is looking for a qualified Sr. Data Engineer to support our government customer located at Kirtland Air Force Base in Albuquerque, NM. This position will be on site.

The primary mission of the Defense Threat Reduction Information Analysis Center (DTRIAC) is to provide timely electronic access to all nuclear weapons test data, legacy and current, to U.S. government programs supporting U.S. nuclear deterrent missions. DTRIAC maintains a repository of over 20,000 films, two million photographs, and 60 million pages of documents dating back to The Manhattan Project. Kāpili Services is charged with making the above hardcopy materials easily accessible to DTRA deterrent mission researchers in a way that provides knowledge and meaning through the use of digitization, Machine Learning (ML), Artificial Intelligence (AI), and data science.

The role of the Sr Data Engineer is to collaborate with data scientists, architects, researchers, users, model and sim engineers, user experience designers, software engineers, digitizers, cataloguers, and system administrators to build a system to collect, manage, and convert raw data from the DTRIAC archive into usable information for U.S. deterrent missions. 

DESCRIPTION OF RESPONSIBILITIES:

• Design tools and methodologies to process the digital collection in a production mode.
• Develop and implement methods for, and configurations of, the Data Lake to support navigation, search, insertion, or extraction of information or files by the government or other performers without requiring proprietary software, tools, or data other than widely available commercial-off-the-shelf (COTS) tools, and software that can be authorized for use on government IT systems.
• Develop, maintain, and improve capabilities, such as scripting, to efficiently perform maintenance, synchronization, and production processing of data in the Data Lake on Windows- and Linux-based IT systems, including HPCMP clusters.
• Implement, configure, perform functional testing, and operate the data and applications of the ASD environment as a hosted capability on government IT systems.
• Leverage the collection, capabilities, and team to perform targeted analyses and studies and to provide dedicated support to missions and end users.
• Create documentation or training materials for Project Products.
• Support integration or hosting of capabilities or products on government IT systems.
• Hold and participate in Gate Reviews.
• Other duties as assigned by Supervisor.

REQUIRED SKILLS & EXPERIENCE:

• Five plus (5+) years relevant experience
• Experience building and working with data pipelines and large data sets (ETL)
• Deep understanding of efficient coding and data structures
• Experience with NoSQL (especially Elasticsearch)
• Experience with RDBMS (various SQL dialects)
• Proficiency in Python (Flask)
• Experience with RESTful API practices
• Current CompTIA Security+ Certification required [can be obtained in first six (6) weeks post hire]

DESIRED SKILLS AND EXPERIENCE:

• Experience with schema design and data modeling
• Proficiency in PowerShell and/or bash scripting
• Proficiency in JavaScript (React and/or NodeJS)
• Experience with machine learning and deep learning (especially optical character recognition, natural language processing, and computer vision)
• Experience with containerization (Docker, Podman, Singularity, and similar)
• Experience with microservice architecture
• Experience with simulating data (especially image simulation)
• Experience with data visualization
• Experience with revision control (git)
• Experience with CI/CD and DevSecOps (especially GitLab)

REQUIRED CITIZENSHIP AND CLEARANCE:

• U.S. Citizen
• Active DoD Secret Clearance or DOE Q Clearance required