Senior Data Engineer
Texas City, TX · On-site
$90K - $123K/yr
Experience with real-time/streaming data pipelines. * Experience in designing highly available and fault-tolerant data platforms.
New
Senior Data Engineer
Texas City, TX · On-site
$90K - $123K/yr
Experience with real-time/streaming data pipelines. * Experience in designing highly available and fault-tolerant data platforms.
New
Validate batch and streaming data pipelines for correctness, completeness, consistency, and ... , or Data Quality Engineering roles. * Strong handson experience with SQL for complex data ...
New
Validate batch and streaming data pipelines for correctness, completeness, consistency, and ... , or Data Quality Engineering roles. * Strong handson experience with SQL for complex data ...
New
Senior Data Engineer- US Citizen
Prosper, TX · On-site
$97K - $131K/yr
Support batch processing and, where applicable, streaming data pipelines * Follow best practices ... Engineering or related roles * Strong hands-on experience with Apache Spark (PySpark or Scala)
Quick apply
Senior Data Engineer- US Citizen
Prosper, TX · On-site
$97K - $131K/yr
Support batch processing and, where applicable, streaming data pipelines * Follow best practices ... Engineering or related roles * Strong hands-on experience with Apache Spark (PySpark or Scala)
Lead Data Engineer - Databricks
Houston, TX · On-site
$95K - $125K/yr
Lead Data Engineer Location: Houston TX - Monday to Thursday onsite Duration: 6-12 months Position ... Architect and optimize batch and streaming data pipelines using appropriate tools such as AWS Glue.
Lead Data Engineer - Databricks
Houston, TX · On-site
$95K - $125K/yr
Lead Data Engineer Location: Houston TX - Monday to Thursday onsite Duration: 6-12 months Position ... Architect and optimize batch and streaming data pipelines using appropriate tools such as AWS Glue.
Data Engineer Quality Engineer
Dallas, TX · On-site
$113K - $136K/yr
They are seeking a Data Engineer Quality Engineer to ensure the reliability and performance of data ... Responsibilities : • Validate batch and streaming data pipelines for correctness, completeness ...
Data Engineer Quality Engineer
Dallas, TX · On-site
$113K - $136K/yr
They are seeking a Data Engineer Quality Engineer to ensure the reliability and performance of data ... Responsibilities : • Validate batch and streaming data pipelines for correctness, completeness ...
Sr. Data Engineer
Austin, TX · On-site
$113K - $136K/yr
Since data engineers are responsible for their pipelines at Over-haul, this role requires engineers ... Design and maintain streaming data pipelines using Databricks, and Spark * Create ML Pipelines to ...
Quick apply
Sr. Data Engineer
Austin, TX · On-site
$113K - $136K/yr
Since data engineers are responsible for their pipelines at Over-haul, this role requires engineers ... Design and maintain streaming data pipelines using Databricks, and Spark * Create ML Pipelines to ...
Data Engineer - MarTech
Irving, TX · On-site
$109K - $132K/yr
The Data Engineer - Marketing Technologies builds and maintains the data pipelines, models, and real-time streams that serve as the foundation for 7-Eleven's Marketing Technology (MarTech ...
Data Engineer - MarTech
Irving, TX · On-site
$109K - $132K/yr
The Data Engineer - Marketing Technologies builds and maintains the data pipelines, models, and real-time streams that serve as the foundation for 7-Eleven's Marketing Technology (MarTech ...
Data Engineer - MarTech
Irving, TX · On-site
$109K - $132K/yr
The Data Engineer - Marketing Technologies builds and maintains the data pipelines, models, and real-time streams that serve as the foundation for 7-Eleven's Marketing Technology (MarTech ...
Data Engineer - MarTech
Irving, TX · On-site
$109K - $132K/yr
The Data Engineer - Marketing Technologies builds and maintains the data pipelines, models, and real-time streams that serve as the foundation for 7-Eleven's Marketing Technology (MarTech ...
Data Engineer - MarTech
Dallas, TX · On-site
$113K - $136K/yr
The Data Engineer - Marketing Technologies builds and maintains the data pipelines, models, and real-time streams that serve as the foundation for 7-Eleven's Marketing Technology (MarTech ...
Data Engineer - MarTech
Dallas, TX · On-site
$113K - $136K/yr
The Data Engineer - Marketing Technologies builds and maintains the data pipelines, models, and real-time streams that serve as the foundation for 7-Eleven's Marketing Technology (MarTech ...
Data Engineer III
The Woodlands, TX · On-site
$104K - $125K/yr
Own ingestion patterns (Autoloader, CDC, streaming) optimization * Own data modeling, quality ... Engineer Delta tables for speed and cost: partitioning, Z-Ordering or clustering, constraints, file ...
Data Engineer III
The Woodlands, TX · On-site
$104K - $125K/yr
Own ingestion patterns (Autoloader, CDC, streaming) optimization * Own data modeling, quality ... Engineer Delta tables for speed and cost: partitioning, Z-Ordering or clustering, constraints, file ...
Senior Data Engineer
Austin, TX · On-site
$105K - $142K/yr
Data Engineering works closely with business partners and Engineering teams to collect metrics on ... and streaming) that process tens of terabytes of data daily and manage a petabyte-scale data ...
Senior Data Engineer
Austin, TX · On-site
$105K - $142K/yr
Data Engineering works closely with business partners and Engineering teams to collect metrics on ... and streaming) that process tens of terabytes of data daily and manage a petabyte-scale data ...
Data Engineer III
The Woodlands, TX · On-site
$104K - $125K/yr
Own ingestion patterns (Autoloader, CDC, streaming) optimization * Own data modeling, quality ... Engineer Delta tables for speed and cost: partitioning, Z-Ordering or clustering, constraints, file ...
Data Engineer III
The Woodlands, TX · On-site
$104K - $125K/yr
Own ingestion patterns (Autoloader, CDC, streaming) optimization * Own data modeling, quality ... Engineer Delta tables for speed and cost: partitioning, Z-Ordering or clustering, constraints, file ...
Data Engineer
Dallas, TX · On-site
$60 - $65/hr
Job Title: Data Engineer Location: Dallas, TX Job Summary: As a Databricks Lead, you will be a ... Data Ingestion and Streaming (Kafka): * Architect and implement real-time and batch data ingestion ...
Quick apply
Data Engineer
Dallas, TX · On-site
$60 - $65/hr
Job Title: Data Engineer Location: Dallas, TX Job Summary: As a Databricks Lead, you will be a ... Data Ingestion and Streaming (Kafka): * Architect and implement real-time and batch data ingestion ...
IoT Data Engineer
Midland, TX · On-site
$112K - $135K/yr
Job Summary The IoT Data Engineer is responsible for designing, building, and maintaining scalable ... Implement streaming and batch ingestion patterns for IoT telemetry, alarms, and operational events.
IoT Data Engineer
Midland, TX · On-site
$112K - $135K/yr
Job Summary The IoT Data Engineer is responsible for designing, building, and maintaining scalable ... Implement streaming and batch ingestion patterns for IoT telemetry, alarms, and operational events.
IoT Data Engineer
Midland, TX · On-site
$112K - $135K/yr
Job Summary The IoT Data Engineer is responsible for designing, building, and maintaining scalable ... Implement streaming and batch ingestion patterns for IoT telemetry, alarms, and operational events.
IoT Data Engineer
Midland, TX · On-site
$112K - $135K/yr
Job Summary The IoT Data Engineer is responsible for designing, building, and maintaining scalable ... Implement streaming and batch ingestion patterns for IoT telemetry, alarms, and operational events.
IoT Data Engineer
Houston, TX · On-site
$109K - $131K/yr
Job Summary The IoT Data Engineer is responsible for designing, building, and maintaining scalable ... Implement streaming and batch ingestion patterns for IoT telemetry, alarms, and operational events.
IoT Data Engineer
Houston, TX · On-site
$109K - $131K/yr
Job Summary The IoT Data Engineer is responsible for designing, building, and maintaining scalable ... Implement streaming and batch ingestion patterns for IoT telemetry, alarms, and operational events.
IoT Data Engineer
Midland, TX · On-site
$112K - $135K/yr
Job Summary The IoT Data Engineer is responsible for designing, building, and maintaining scalable ... Implement streaming and batch ingestion patterns for IoT telemetry, alarms, and operational events.
IoT Data Engineer
Midland, TX · On-site
$112K - $135K/yr
Job Summary The IoT Data Engineer is responsible for designing, building, and maintaining scalable ... Implement streaming and batch ingestion patterns for IoT telemetry, alarms, and operational events.
IoT Data Engineer
Houston, TX · On-site
$109K - $131K/yr
Job Summary The IoT Data Engineer is responsible for designing, building, and maintaining scalable ... Implement streaming and batch ingestion patterns for IoT telemetry, alarms, and operational events.
IoT Data Engineer
Houston, TX · On-site
$109K - $131K/yr
Job Summary The IoT Data Engineer is responsible for designing, building, and maintaining scalable ... Implement streaming and batch ingestion patterns for IoT telemetry, alarms, and operational events.
IoT Data Engineer
Midland, TX · On-site
$112K - $135K/yr
Job Summary The IoT Data Engineer is responsible for designing, building, and maintaining scalable ... Implement streaming and batch ingestion patterns for IoT telemetry, alarms, and operational events.
IoT Data Engineer
Midland, TX · On-site
$112K - $135K/yr
Job Summary The IoT Data Engineer is responsible for designing, building, and maintaining scalable ... Implement streaming and batch ingestion patterns for IoT telemetry, alarms, and operational events.
Data Engineer
Dallas, TX · On-site
$113K - $136K/yr
... Streaming, Flink, Kafka Streams). • Experience with cloud data warehouses, Snowflake, and data ... engineering. • Strong problem-solving skills and ability to optimize data processes for ...
Data Engineer
Dallas, TX · On-site
$113K - $136K/yr
... Streaming, Flink, Kafka Streams). • Experience with cloud data warehouses, Snowflake, and data ... engineering. • Strong problem-solving skills and ability to optimize data processes for ...
Intern Streaming Data Engineer information
What does an intern streaming data engineer do?
An Intern Streaming Data Engineer assists in designing, developing, and maintaining systems that process real-time data streams. They typically work with technologies like Apache Kafka, Apache Flink, or Spark Streaming to collect, process, and analyze data as it arrives. Their responsibilities may include writing code, troubleshooting data pipelines, and collaborating with senior engineers to ensure data flows efficiently. The role is ideal for students or recent graduates looking to gain hands-on experience with big data and real-time analytics.
What types of projects or tasks can an intern streaming data engineer expect to work on during their internship?
As an Intern Streaming Data Engineer, you can expect to work on projects involving the development, testing, and optimization of real-time data pipelines. Typical tasks may include assisting with the integration of streaming platforms like Apache Kafka or AWS Kinesis, writing and debugging code to process large volumes of incoming data, and collaborating with senior engineers to ensure data quality and reliability. You'll often work within a team of data engineers and analysts, gaining hands-on experience with the latest big data tools and contributing to solutions that support real-time analytics and business decision-making.
What are the key skills and qualifications needed to thrive as an intern streaming data engineer, and why are they important?
To thrive as an Intern Streaming Data Engineer, you typically need foundational knowledge in computer science, data engineering concepts, and familiarity with real-time data processing. Experience with tools like Apache Kafka, Apache Flink, or Spark Streaming, and programming languages such as Python or Java, is often preferred. Strong problem-solving skills, attention to detail, and effective teamwork and communication abilities help set candidates apart. These skills and qualifications are crucial for efficiently building, maintaining, and troubleshooting streaming data pipelines in dynamic data-driven environments.
What is the difference between Intern Streaming Data Engineer vs Intern Data Analyst?
| Aspect | Intern Streaming Data Engineer | Intern Data Analyst |
|---|---|---|
| Required Skills | Knowledge of streaming platforms (e.g., Kafka, Spark Streaming), programming (Python, Java), data pipeline development | Data analysis, SQL, Excel, basic statistical skills |
| Work Environment | Developing real-time data pipelines, working with big data tools | Analyzing stored data, generating reports and insights |
| Industry Usage | Tech, finance, e-commerce companies focusing on real-time data processing | Marketing, business intelligence, research departments |
The Intern Streaming Data Engineer focuses on building and maintaining real-time data pipelines using streaming technologies, requiring programming and big data skills. In contrast, the Intern Data Analyst primarily analyzes stored data to generate insights, emphasizing statistical and reporting skills. Both roles are common in data-driven industries but serve different functions within data management and analysis.
What are popular job titles related to Intern Streaming Data Engineer jobs in Texas?
For Intern Streaming Data Engineer jobs in Texas, the most frequently searched job titles are:
What job categories do people searching Intern Streaming Data Engineer jobs in Texas look for?
The top searched job categories for Intern Streaming Data Engineer jobs in Texas are:
$90K - $123K/yr
Other
Posted 2 days ago
New
Job description
Senior Data Engineer – Job DescriptionJob Title: Senior Data Engineer
Experience: 12+ Years
Job Type: W2 Contract Job Summary
Experience: 12+ Years
Job Type: W2 Contract Job Summary
We are seeking a highly experienced Senior Data Engineer with 12+ years of experience in designing, developing, and maintaining scalable data platforms and data pipelines. The ideal candidate will have strong hands-on expertise in Python, SQL, Spark, Databricks, cloud technologies, ETL/ELT, data warehousing, and data integration.
Responsibilities- Design, develop, and maintain scalable ETL/ELT data pipelines for enterprise applications.
- Develop complex data transformation and processing workflows using Python, SQL, and Apache Spark.
- Build and optimize data pipelines using Databricks and PySpark.
- Design and implement data solutions on AWS, Azure, or Google Cloud Platform cloud platforms.
- Develop data ingestion processes from databases, APIs, files, and other structured/unstructured sources.
- Implement data quality, validation, reconciliation, and monitoring processes.
- Design and optimize data warehouses, data lakes, and lakehouse architectures.
- Work with relational and NoSQL databases to support data engineering requirements.
- Perform performance tuning and optimization of SQL queries, Spark jobs, and data pipelines.
- Implement orchestration using Apache Airflow, Azure Data Factory, AWS Glue, or similar tools.
- Develop reusable frameworks and components for data ingestion and transformation.
- Integrate data engineering solutions with CI/CD pipelines and DevOps processes.
- Implement data security, access controls, encryption, and governance best practices.
- Troubleshoot production data pipelines and resolve data processing issues.
- Collaborate with data architects, analysts, data scientists, application developers, and business stakeholders.
- Participate in Agile/Scrum ceremonies and contribute to technical design and architecture discussions.
- Mentor junior and mid-level data engineers and provide technical guidance.
- 12+ years of experience in Data Engineering, ETL, or related data technologies.
- Strong hands-on experience with Python and SQL.
- Extensive experience with Apache Spark / PySpark.
- Strong experience with Databricks and Delta Lake.
- Experience building enterprise-scale ETL/ELT pipelines.
- Strong knowledge of data warehousing concepts, dimensional modeling, and data lake architectures.
- Experience with one or more cloud platforms: AWS, Azure, or Google Cloud Platform.
- Experience with databases such as SQL Server, Oracle, PostgreSQL, MySQL, Snowflake, or similar.
- Experience with workflow orchestration tools such as Airflow, Azure Data Factory, AWS Glue, or similar.
- Strong understanding of batch and near-real-time data processing.
- Experience with Git, CI/CD, Jenkins, Azure DevOps, or GitHub Actions.
- Strong understanding of data quality, data validation, and performance optimization.
- Excellent analytical, troubleshooting, and communication skills.
- Experience with Azure Data Lake, AWS S3, ADLS, or Google Cloud Storage.
- Experience with Snowflake or other modern cloud data warehouses.
- Knowledge of Kafka, Event Hubs, or other streaming technologies.
- Experience with Terraform or Infrastructure as Code.
- Knowledge of Docker and Kubernetes.
- Experience implementing data governance, metadata management, and lineage.
- Experience working with large-scale distributed data environments.
- Knowledge of Medallion Architecture (Bronze, Silver, Gold).
- Experience with real-time/streaming data pipelines.
- Experience in designing highly available and fault-tolerant data platforms.
About Raas Infotek
Sourced by ZipRecruiter
Industry
It services
Company size
51 - 200 Employees
Headquarters location
Newark, DE, US
Year founded
2010