Skip to Main Content

Data Systems Engineer

Endeavor Consulting Group
Washington, DC
  • Posted: June 10, 2022
  • Full-Time
Endeavor Consulting Group, LLC, We are a specialty project management technology and integration consulting firm laser focused on Operational Systems, Supply Chain Integration and Product Development for Life Science enterprises. At Endeavor we utilize industry-accepted best practices, methodologies and tools, and we are experienced in several software, hardware, network platform, Quality by Design product development, manufacturing equipment and integration. We are constantly monitoring our industry to stay on top of the latest trends in technology so that we can always bring the best solution that fits our clients' needs.

Endeavor Consulting Group was formed in 2006 and has experienced solid and continual growth since its inception. Our core values of integrity, quality, creativity, and freedom have allowed us to continually expand our service offerings and expand our client base.

Our experience and skills in program management, supply chain collaboration, industry standards and regulations, serialization, serialization technologies and manufacturing processes, equipment and systems provide us with the ability to offer our clients a high value and extremely cost effective approach to their manufacturing serialization program.

We are looking for a Data Systems Engineer to provide support to Naval Special Warfare Command (NSWC) - Digital Transformation Support Services.

The Data Systems Engineer will provide enterprise support for discovery and synthesis of disparate external and internal data sources, including full-stack data integration, data mesh, engineering data pipelines, data ETL/ELT (Extract, Transform, Load and Extract, Load, Transform, etc.), and Application Programming Interface (API) support, as well as analysis of requirements and systems flow. He/She will determine data systems architecture, software, database, data storage, and usage requirements while engineering solutions to facilitate agile DataOps and DevSecOps processes.

The position will act as data integration subject matter expert and will work with both on-premises and cloud-based data environments to synthesize and integrate data while engineering and managing the corresponding data pipelines and infrastructure. This position will be part of the NSW Data Engineering Team.

Additionally, the Data Systems Engineer will support administrative and governance requirements such as agreements, policies, procedures, drawings, data pipelines, user training and resources, Remedy change management and incident ticketing, Azure DevOps and other Kanban boards and backlogs, and cybersecurity accreditations.

He/She will support requirements for enterprise data integration to include the NDE, Microsoft Azure, Advana/Jupiter, Neptune web application, business systems, and other data environments for the integration of disparate data sources.

Role and Responsibilities:
  • Assemble large, complex sets of data that meet non-functional and functional business requirements.
  • Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
  • Build and optimize 'big data' data pipelines, architectures, and data sets. ETL process management.
  • Model data, engineer corresponding data warehouse architecture, develop data pipelines (ETL tools), and test ETL.
  • Manipulate, process, and extract value from large, disconnected datasets.
  • Identify, design, and implement internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
  • Build required infrastructure for optimal extraction, transformation and loading of data from various data sources using AWS or Azure or SQL modern technologies.
  • Build analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition.
  • Work with stakeholders including data, design, product, and executive teams and assisting them with data-related technical issues.
  • Identify the most optimal data engineering solutions and maintain data system infrastructures in accordance with industry best practices and security policies for continuous integration/delivery (CI/CD).
  • Support all aspects of data engineering and DataOps including data wrangling, data triage, data pipelines, data visualizations and connections supporting the integration of platforms and features across multiple subsystems, containerization, and microservices architecture.
  • Support the Government in system lifecycle sustainment operations and configuration, testing, training, release, and operations. Archiving final copy documentation and deliverables meeting a definition of done (built, reviewed, verified, tested, ready to operate, and releasable).
  • Support the Government in Product Backlog (PBL) grooming, Sprint Planning, and Sprints. Document user stories using INVEST criteria (independent, negotiable, valuable, estimable, sized, testable) that capture acceptance criteria and include a definition of done (built, reviewed, verified, tested, ready to operate, and releasable).
  • Analyze information and user requirements, design, and debug software, and document technical notes within the Government Off the Shelf (GOTS), Commercial-Off the Shelf (COTS), and approved open-source software.
  • Provide testing, problem solving, requirements collection, stakeholder collaboration, user support, Standard Operating Procedures (SOP), and system maintenance.
  • Capture and document initial requirements, system requirements, issues, infrastructure requirements, incidents, change requests, and change management processes using Remedy change management system.
  • Plan, create, and manage data systems infrastructure, develop back-end systems functionality, and design Application Programming Interfaces (APIs).
  • Educate stakeholders on the implementation of new data engineering and DataOps technologies and initiatives.
  • Design, develop, deploy, modify, and improve modular data engineering solutions in accordance with industry standards and best practice for a MOSA implementation to data science and analytics workflow processes to obtain, clean, analyze, model, and interpret data.
  • Create and maintain source-target mappings and engineering documentation. Document using scope function models.
  • Ensure efficient functioning of data storage and processing functions in accordance with company security policies and best security practices compliant with DoD Zero Trust Architecture for cloud and DoD Enterprise DevSecOps Reference Design.
  • Identify, analyze, and resolve infrastructure vulnerabilities and software deployment issues and regularly review existing systems to make recommendations for improvements.
  • Support the U.S. Government USG in tasks for data engineering and DataOps processes and accreditation, scans, and documentation to obtain an Interim Authority to Test (IATT), Authority to Operate (ATO), continuous Authority to Operate (cATO), Continuous Monitoring (CONMON) Strategy, Configuration Management (CM) Plan, Social Security Number (SSN) memorandum, Privacy Impact Assessment (PIA), Security Technical Implementation Guides (STIG), Risk Management Framework (RMF) Body of Evidence documents and checklists.
  • Continuously maintain and update on-premises and cloud technology stacks.


Requirements

  • Five (5) or more years of experience within the past ten (10) years in data integration, data engineering, data operations (DataOps), data warehouse modeling and performance, data quality, moving data between systems, managing data warehouses, building data pipelines in on-premises and cloud environments, data visualization, data security, web services and RESTful Application Programming Interfaces (API), and serving data to end users.
  • Five (5) or more years of experience within the past ten (10) years in creating and maintaining data engineering infrastructure, ETL/ELT, merging, manipulating, transforming, cleansing, and validating data, and experience in databases, data stores, data marts, data lakes and data warehouse design and operations, report writers, scripting, ad hoc querying, online analytical processing (OLAP), online transactional processing (OLTP), data visualization, data mining, and statistical analysis, excellent analytical and problem solving skills, and a fundamental knowledge of working with structured, unstructured, and semi structured data.
  • Five (5) or more years of experience within the past ten (10) years in all of the following: Structured Query Language (SQL), Microsoft (MS) C#.NET, MS SQL Server, MS SQL Server Integration Services (SSIS), MS SQL Server Reporting Services (SSRS), MS ASP.NET, MS Internet Information Server (IIS), MS Visual Studio, MS Power BI, and Microsoft SQL Server BI stack including SQL Server (2012 +), Python, and JavaScript.
  • DoD-approved IAT-II level IA baseline cyber certification for admin privileges IAW DoD 8570.01-M, paragraph C2.3.9 required at time of proposal.
  • Currently active Secret security clearance - needs prior to the start of work.
  • Qualifications:

What email should the hiring manager reach you at?

By clicking the button above, I agree to the ZipRecruiter Terms of Use and acknowledge I have read the Privacy Policy, and agree to receive email job alerts.