Job Summary:
Clarity Innovations, Inc. is a trusted national security partner, dedicated to safeguarding our nation’s interests and delivering innovative solutions. The Data Engineer role involves supporting the Air Force Special Operations Command by providing expertise in data governance and modernization efforts, while optimizing data pipelines and ensuring effective data integration.
Responsibilities:
• Developing, maintaining, and testing infrastructures for data generation to transform data from various structured and unstructured data sources.
• Develop complex queries to ensure accessibility while optimizing the performance of NoSQL and or big data infrastructure. Create and maintain optimal data pipeline architecture.
• Build and maintain the infrastructure to support extraction, transformation, and loading (ETL) of data from a wide variety of data sources. Extract data from multiple data sources, relational SQL and NoSQL databases, and other platform APIs, for data ingestion and integration.
• Configure and manage data analytic frameworks and pipelines using databases and tools such as NoSQL, SQL, HDInsight, MongoDB, Cassandra, Neo4j, GraphDB, OrientDB, Spark, Hadoop, Kafka, Hive, and Pig.
• Apply distributed systems concepts and principles such as consistency and availability, liveness and safety, durability, reliability, fault-tolerance, consensus algorithms.
• Administrate cloud computing and CI/CD pipelines to include Azure, Google, and Amazon Web Service (AWS).
• Coordinate with stakeholders, including product, data and design teams to assist with data-related technical issues and support their data infrastructure needs.
Qualifications:
Required:
• Minimum of 1-year experience is required.
• Bachelor's degree in a STEM field with preference towards Computer Science and Software Engineering.
• Verifiable work experience working with data structures, database management, distributed computing, and API driven architectures using SQL and No-SQL engines.
• Proficient in modeling frameworks like Universal Modeling Language (UML), Agile Development, and Git Operations.
• A Secret Clearance is required to start
Preferred:
• Familiarity with Palantir Envision and/or MSS
• Familiarity with DoD.
• Top Secret Clearance with SCI eligibility
Company:
Clarity Innovations helps education-based companies with their product and marketing strategy, content development, and rapid prototyping. Founded in 1996, the company is headquartered in Portland, USA, with a team of 11-50 employees. The company is currently Early Stage.