1

Data Engineer Flink Jobs in Missouri (NOW HIRING)

We're looking for an engineer to help develop and scale the AI infrastructure behind these ... Experience with technologies such as Kafka, Spark, Flink, or similar distributed data frameworks.

Showing results 21-33

Data Engineer Flink information

What is a data engineer Flink?

A Data Engineer Flink is a data engineering professional who specializes in using Apache Flink, an open-source stream processing framework, to build, maintain, and optimize systems that process large-scale data in real time. They design and implement data pipelines, ensure data quality and consistency, and collaborate with other engineering teams to deliver reliable and scalable data solutions. Their expertise allows organizations to process, analyze, and react to data as it is generated, enabling real-time insights and decision-making.

What are the key skills and qualifications needed to thrive as a data engineer Flink?

To thrive as a Data Engineer specializing in Flink, you need strong programming skills (especially in Java or Scala), a solid understanding of distributed data processing, and experience with data architecture. Familiarity with Apache Flink, stream processing frameworks, big data tools (like Kafka, Hadoop, or Spark), and cloud platforms is typically required, along with relevant certifications. Excellent problem-solving abilities, attention to detail, and effective teamwork and communication skills help you excel in complex data environments. These competencies are crucial for building reliable, scalable data pipelines that power real-time analytics and business decision-making.

What are some common challenges data engineers face when working with Apache Flink in a production environment?

Data Engineers working with Apache Flink often encounter challenges such as managing stateful stream processing at scale, ensuring fault tolerance, and optimizing resource usage for real-time data pipelines. Handling late-arriving data and tuning Flink jobs for low latency and high throughput are also frequent hurdles. Collaborating closely with data scientists and application developers is key to aligning data models and ensuring smooth data flow throughout the system.

Are data engineers still in demand?

Data engineers, including those skilled in Apache Flink, are in high demand due to the increasing need for real-time data processing and scalable data infrastructure. Organizations seek professionals with expertise in big data tools, cloud platforms, and programming languages like Java or Scala to build and maintain data pipelines. The role is expected to grow as data-driven decision-making becomes more critical across industries.

What cities in Missouri are hiring for Data Engineer Flink jobs?

Cities in Missouri with the most Data Engineer Flink job openings:

System Engineer-Platform/Kafka/Messaging

O'Reilly Auto Parts

Springfield, MO • On-site

Full-time

Medical, Dental, Vision, Retirement, PTO

Re-posted 18 days ago


O'Reilly Auto Parts rating

5.3

Company rating: 5.3 out of 10

Based on 1,905 frontline employees who took The Breakroom Quiz

557th of 739 rated retailers


Job description

The Systems Engineer Platform - Messaging Platform will play a key role in designing, implementing, and maintaining enterprise messaging systems that support both real-time and asynchronous communication between distributed applications and services. This role focuses on ensuring robust, scalable, secure, and cost-efficient messaging solutions across hybrid cloud and on-premises environments. The engineer will work closely with architects, developers, infrastructure, and DevOps teams to standardize messaging platforms and promote modern integration patterns that align with the organization's digital transformation goals.
This is an on-site position located in Springfield, MO.
Responsibilities and Duties:
Messaging Platform Engineering
Design and operate scalable messaging platforms (Kafka, Pub/Sub, legacy MQ) supporting high-throughput, low-latency event streaming. Manage topics, schemas (Avro/JSON/Protobuf), connectors, and stream processing (Kafka Streams/KSQLDB). Enforce governance for naming, retention, access control, and multi-tenancy, while ensuring reliable delivery (retries, DLQs, idempotency, exactly-once).
Infrastructure as Code & Automation
Automate messaging infrastructure using Terraform, Helm, and Kubernetes (e.g., Strimzi), with Git-based configuration management. Build CI/CD pipelines for deployments, upgrades, and topic provisioning, including drift detection and self-healing workflows.
Security & Governance
Implement secure messaging with IAM integration (GCP, LDAP, Kerberos), TLS/mTLS, and ACLs. Align with compliance standards (PCI, HIPAA) and Zero Trust principles, including data classification, logging, and anomaly detection.
Monitoring & Reliability
Establish observability using Prometheus, Grafana, ELK, or GCP tools. Monitor SLAs/SLOs, consumer lag, broker health, and replication. Lead incident response, RCA, and disaster recovery planning.
Integration & Developer Enablement
Enable teams with reusable connectors, SDKs, and event-driven patterns. Provide guidance on schema evolution, idempotency, and domain-driven event design, supported by self-service tools and documentation.
Platform Modernization & Migration
Drive migration from legacy systems to modern streaming platforms, evaluating new technologies (e.g., Pulsar, Redpanda). Lead migration strategies, dual-write patterns, and multi-region replication.
Collaboration & Leadership
Collaborate with cross-functional teams on architecture and governance, contribute to event-driven and data mesh strategies, and mentor engineers while promoting best practices.
Skills:
Required:
  • 3+ years with enterprise messaging platforms (Kafka, Pub/Sub), including deep knowledge of Kafka architecture (brokers, partitions, replication, schema management, streams, and connectors).
  • Strong experience designing high-throughput, low-latency event-driven systems with governance, topic management, and access control.
  • Hands-on experience with GCP messaging services (Pub/Sub, Eventarc) and hybrid architectures, including secure connectivity, IAM, and multi-region designs.
  • Proficiency in Infrastructure as Code and automation using Terraform, Kubernetes/Helm, and CI/CD tools, with GitOps-based configuration management.
  • Solid background in security and compliance, including encryption (TLS/mTLS), authentication (SASL, IAM), and regulatory standards (PCI, SOC2, HIPAA).
  • Experience implementing observability with Prometheus, Grafana, ELK, and GCP tools, including monitoring lag, throughput, and distributed tracing.
  • Strong performance tuning and reliability practices, including scaling, backpressure handling, DLQs, retries, and cross-region replication.
  • Focus on developer enablement through reusable tools, self-service platforms, schema governance, and event-driven best practices.
  • Ability to evaluate and prototype messaging technologies (e.g., Pulsar, RabbitMQ), lead POCs, and drive adoption of modern streaming and data integration patterns.

Desired:
  • Experience running Kafka on Kubernetes (Strimzi/Confluent Operator), including scaling, configuration, and multi-tenant architectures.
  • Strong foundation in event-driven architecture, microservices communication, and asynchronous messaging patterns.
  • Hands-on experience with real-time processing tools (Kafka Streams, Flink, Spark) and Kafka Connect integrations (Debezium, JDBC, Elasticsearch).
  • Proficiency in schema management (Avro, Protobuf) and schema registries (Confluent, Apicurio).
  • Familiarity with Docker, Kubernetes (GKE), and service mesh technologies (Istio, Linkerd) for secure, cloud-native deployments.
  • Experience with cloud messaging and analytics tools (GCP Pub/Sub, Dataflow) and migrating from legacy systems (e.g., IBM MQ, RabbitMQ).
  • Strong knowledge of security and access control (ACLs, SASL/SCRAM, Kerberos, IAM) and message delivery semantics (at-least-once, exactly-once).
  • Experience with observability (Prometheus, Grafana, GCP Monitoring), CI/CD automation for Kafka resources, and data governance tools (Dataplex, Collibra).
  • Industry experience, certifications, and ability to lead design discussions, mentor teams, and work within agile environments.

O'Reilly Auto Parts has a proven track record of growth and stability. O'Reilly is full of successful career stories and believes in a strong promote-from-within philosophy, encouraging you to grow your career along with the organization.
Total Compensation Package:
  • Competitive Wages & Paid Time Off
  • Stock Purchase Plan & 401k with Employer Contributions Starting Day One
  • Medical, Dental, & Vision Insurance with Optional Flexible Spending Account (FSA)
  • Team Member Health/Wellbeing Programs
  • Tuition Educational Assistance Programs
  • Opportunities for Career Growth

O'Reilly Auto Parts is an equal opportunity employer. The Company does not discriminate on the basis of race, religion, color, national origin or ancestry (including immigration status or citizenship), sex, sexual orientation, gender identity, pregnancy (including childbirth, lactation, and related medical conditions,) age (40 and over), veteran status, uniformed service member status, physical or mental disability, genetic information (including testing or characteristics) or another protected status as defined by local, state, or federal law, as applicable.
Qualified individuals with a disability may be entitled to reasonable accommodation under the Americans with Disabilities Act. If you require a reasonable accommodation during the application or employment process, please send an email to: rar@oreillyauto.com or call (800) 471-7431 option , and provide your requested accommodation, and position details.

What O'Reilly Auto Parts employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom