1

Data Engineer Flink Jobs in Tennessee (NOW HIRING)

Sr. Data Engineer

Memphis, TN · On-site

$111K - $133K/yr

... Flink, NiFi, HDFS, Hive, Cassandra, Druid, and other big data projects. • Proficiency with Python is a plus. • Deep understanding of Private and Public Cloud Architectures. • Experience with ...

Sr. Data Engineer

Cordova, TN

$99K - $118K/yr

As a Sr. SQL Developer/Data Engineer, you will be responsible for designing, developing, and ... with Kafka, Spark/Flink, NiFi, HDFS, Hive, Cassandra, Druid, and other big data projects

Sr. Data Engineer

Cordova, TN · On-site

$99K - $118K/yr

As a Sr. SQL Developer/Data Engineer, you will be responsible for designing, developing, and ... with Kafka, Spark/Flink, NiFi, HDFS, Hive, Cassandra, Druid, and other big data projects

Sr. Data Engineer

Cordova, TN · On-site

$99K - $118K/yr

As a Sr. SQL Developer/Data Engineer, you will be responsible for designing, developing, and ... with Kafka, Spark/Flink, NiFi, HDFS, Hive, Cassandra, Druid, and other big data projects

We are seeking an experienced Software Engineer to design and develop software, including automated ... Spark, Airflow, Flink or other open-source distributed data streaming platforms and databases ...

We are seeking an experienced Software Engineer to design and develop software, including automated ... Spark, Airflow, Flink or other open-source distributed data streaming platforms and databases ...

We are seeking an experienced Software Engineer to design and develop software, including automated ... Spark, Airflow, Flink or other open-source distributed data streaming platforms and databases ...

Data Engineer Flink information

What are some common challenges data engineers face when working with Apache Flink in a production environment?

Data Engineers working with Apache Flink often encounter challenges such as managing stateful stream processing at scale, ensuring fault tolerance, and optimizing resource usage for real-time data pipelines. Handling late-arriving data and tuning Flink jobs for low latency and high throughput are also frequent hurdles. Collaborating closely with data scientists and application developers is key to aligning data models and ensuring smooth data flow throughout the system.

What are the key skills and qualifications needed to thrive as a data engineer Flink?

To thrive as a Data Engineer specializing in Flink, you need strong programming skills (especially in Java or Scala), a solid understanding of distributed data processing, and experience with data architecture. Familiarity with Apache Flink, stream processing frameworks, big data tools (like Kafka, Hadoop, or Spark), and cloud platforms is typically required, along with relevant certifications. Excellent problem-solving abilities, attention to detail, and effective teamwork and communication skills help you excel in complex data environments. These competencies are crucial for building reliable, scalable data pipelines that power real-time analytics and business decision-making.

What is a data engineer Flink?

A Data Engineer Flink is a data engineering professional who specializes in using Apache Flink, an open-source stream processing framework, to build, maintain, and optimize systems that process large-scale data in real time. They design and implement data pipelines, ensure data quality and consistency, and collaborate with other engineering teams to deliver reliable and scalable data solutions. Their expertise allows organizations to process, analyze, and react to data as it is generated, enabling real-time insights and decision-making.

Sr. Data Engineer

Yusen Logistics

Memphis, TN • On-site

$111K - $133K/yr

Full-time

Re-posted 17 days ago


Yusen Logistics rating

6.7

Company rating: 6.7 out of 10

Based on 27 frontline employees who took The Breakroom Quiz

252nd of 359 rated logistics


Job description

Job Summary:
Yusen Logistics is working to become the world’s preferred supply chain logistics company, and they are seeking a talented and highly motivated Sr. Data Engineer. In this role, you will be responsible for designing, developing, and maintaining the company's data systems, including data replications and data streaming pipelines, to ensure the availability and consistent performance of corporate applications.
Responsibilities:
• Collaborate with DBA team and other IT teams, perform data modeling and stream design to ensure that databases and data streams meet data needs of our applications and integrations.
• Implement scalable integrations with third party systems to be able to support a high volume real- time streaming data ingestion platform.
• Develop generic and custom parsers to ingest data from different platforms
• Develop data streaming pipelines using technologies such as Apache Kafka, Apache NiFi, and Apache Spark.
• Monitor and maintain data streaming pipelines, ensuring high availability and timely delivery of data.
• Troubleshoot and resolve issues with databases and data streams.
• Stay up to date with new technologies and best practices in database development and data streaming.
• Write code for new features or/and feature enhancement, including SQL server stored procedures, views, functions, triggers, queries, SQL scripts and ETL processes.
• Improve existing code to fix defects, improve DB performance, ensure data security & integrity, and eliminate technical debt.
• Thrive in a DevOps culture environment with frequent releases where developers are responsible from requirements analysis to production deployment and production support.
• Develop high-quality code, define best engineering practice, perform peer code reviews to ensure successful deliverable with engineering excellence.
• Monitor System health and proactively correct any potential issues.
• Monitor Job activity and provide prompt production support.
• Create and maintain SQL server replication chains on multiple servers, and debug replication errors.
• Document the process using the company standard.
Qualifications:
Required:
• Bachelor's Degree or higher in an Information Technology discipline or related field of study and minimum of eight years of work experience designing, programming, and supporting software programs or applications.
• 6 years of experience in database development and data streaming.
• Exceptional technical expertise in architectural design, development, and implementation with specialization in multiple technology disciplines, platforms, and applications.
• Experience developing streaming application solutions.
• Strong experience with SQL Server, PostgreSQL, and proficiency with T-SQL.
• Experience with NoSQL DB system, such as Cassandra is a plus.
• Knowledge and experience with open stack technologies, have prior experience in working with Kafka, Spark/Flink, NiFi, HDFS, Hive, Cassandra, Druid, and other big data projects.
• Proficiency with Python is a plus.
• Deep understanding of Private and Public Cloud Architectures.
• Experience with data integration and ETL processes.
• Strong problem-solving skills and attention to detail.
• Excellent communication and interpersonal skills.
• Ability to work independently and as part of a team.
Company:
Yusen Logistics is a transportation company that offers supply chain management, freight forwarding, warehousing, and distribution services. Founded in 1955, the company is headquartered in Higashi-shinagawa, JPN, with a team of 10001+ employees. The company is currently Late Stage.

What Yusen Logistics employees say

Pay

Benefits

Hours and flexibility

Workplace

Get the full story on Breakroom