Trainee Databricks Data Engineer Jobs in Shiloh, IL

I2X Technologies is a reputable technology services company to the Federal Government.  Whether the focus is on space exploration, national security, cyber security, or cutting-edge engineering applications, I2X is ready to offer you the chance to make a real-world impact in your field and for your country.  We provide long-term growth and development. Headquartered in Colorado, I2X is engaged in programs across the country and in more than 20 states.  Our programs support multiple Federal agencies, the Department of Defense and often focused on the space initiatives of our government customers.

I2X Technologies is seeking a Data Engineer Software Developer to support ongoing activities for a customer at Scott AFB, IL. This position will be on-site and will require an active Secret clearance. 

• Designs, builds, and maintains scalable, reliable data systems and pipelines to ingest, process, and transform large, complex, and disparate data sources for analytics and reporting.
• Unifies and integrates data from multiple network operations systems into a consistent, accessible platform, ensuring data quality, accuracy, security, and compliance with DoD and DISA requirements.
• Implements solutions using Confluent Kafka, Elastic Stack, AWS, and Red Hat OpenShift (Kubernetes), including creating Kafka, Elastic, and Logstash pipelines and supporting Kibana visualizations and dashboards with React, JavaScript, and HTML.
• Develops and manages data warehouses and data lakes to support analytics, reporting, and operational dashboards, optimizing infrastructure for performance, scalability, and cost-effectiveness through automation and best practices.
• Continually analyze and optimize ingestion throughput, query performance, indexing strategies, and storage efficiency across Elastic and Kafka platforms.
• Automates data-related tasks such as ETL/ELT processes, data validation, cleansing, monitoring, and supports CI/CD pipelines for automated build, test, and deployment.
• Collaborates with data analysts, visualization engineers, and other stakeholders to deliver integrated, actionable data solutions, and documents data architecture, integration patterns, and operational procedures.
• Troubleshoots and resolves issues related to data ingestion, processing, and platform performance, storage, memory, partitioning, and cluster performance.

• Bachelor's degree in Computer Science, Engineering, or related technical discipline and 4+ years of relevant experience.
• Hands-on experience designing, building, and maintaining data pipelines (ETL/ELT) and integrating multiple, disparate data sources.
• Experience with data warehouse and/or data lake technologies (e.g., AWS Redshift, S3, Hadoop, Snowflake, or similar).
• Proficiency with data engineering tools and languages such as Python, Java, SQL, and shell scripting.
• Experience with Elastic Stack (Elasticsearch, Logstash, Kibana) and/or Kafka for data ingestion and processing.
• Familiarity with network operations data (logs, metrics, events, ticketing, CMDB) and related data models.
• Experience with Linux/UNIX system administration and automation.
• Knowledge of data security, access controls, and compliance frameworks (DoD, DISA, RMF, STIGs).
• Experience with CI/CD pipelines, containerized pipelines, version control (Git, Bitbucket), and DevOps practices.
• Strong communication and documentation skills for collaboration and knowledge sharing.
• Must be able to commute to Scott AFB, IL for up to full-time onsite support.
• Security+ certification or equivalent DoD 8570 IAT II certification is required.

Preferred Qualifications:

• Experience with DISA, DISN, or other DoD network environments, including developing and deploying software applications that meet DoD security standards (e.g., STIGs), and knowledge of network security, encryption, and access controls in classified environments.
• Experience with big data technologies and platforms such as Kafka, Spark, NiFi, Hadoop, Elasticsearch, Logstash, Databricks, and ELK Stack for text mining, summarization, search, and entity extraction.
• Experience with cloud-based data platforms (AWS, Azure, GCP, AWS GovCloud), cloud-integrated platforms, and infrastructure as code, including networking and security policies.
• Familiarity with Kubernetes deployment, platform upgrades, patching, configuration management tools (Ansible, Puppet, Chef), and monitoring, alerting, and observability tools (Prometheus, Grafana, Elastic).
• Experience with BI tools like Kibana and developing and maintaining technical documentation and runbooks.
• Strong understanding and practical experience with Agile methodologies (Scrum, SAFe), and related tools such as Atlassian JIRA and Confluence.
• Certified Confluent Developer and Certified Elastic Engineer.
• Excellent communication and collaboration skills, with experience working remotely with geographically dispersed teams and within a matrixed organization to combine software, integration, and data engineering practices.
• Apply knowledge of system architecture, networks, and centralized logging (ELK) to support data transformation initiatives.

Essential Requirements:

• US Citizenship is required.
• Active Secret clearance is required. 
• Security+ certification or equivalent DoD 8570 IAT II certification is required.

In compliance with Colorado's Equal Pay for Equal Work Act, the annual base salary range for this position is listed . Please note that the salary information is a general guideline only. I2X Technologies considers factors such as (but not limited to) scope and responsibilities of the position, candidate's work experience, education/training, key skills, internal peer equity, as well as, market and business considerations when extending an offer.

Physical Demands:

The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job with or without reasonable accommodation.

While performing the duties of this job, the employee will regularly sit, walk, stand and climb stairs and steps. May require walking long distance from parking to work station. Occasionally, movement that requires twisting at the neck and/or trunk more than the average person, squatting/ stooping/kneeling, reaching above the head, and forward motion will be required. The employee will continuously be required to repeat the same hand, arm, or finger motion many times. Manual and finger dexterity are essential to this position. Specific vision abilities required by this job include close, distance, depth perception and telling differences among colors. The employee must be able to communicate through speech with clients and public. Hearing requirements include conversation in both quiet and noisy environments. Lifting may require floor to waist, waist to shoulder, or shoulder to overhead movement of up to 20 pounds. This position demands tolerance for various levels of mental stress.

I2X Technologies is an Engineering and Information Technology Company focused on providing Services to the Federal and State Government. I2X offers a competitive compensation program and comprehensive benefits package to our employees.