Chicago, IL · On-site
$118K - $141K/yr
Seeking a Senior Data Engineer with deep expertise in SQL Server, Azure SQL, and Databricks to ... PySpark: Distributed transformations and performance optimization (joins, partitions, debugging ...
New
Chicago, IL · On-site
$118K - $141K/yr
Seeking a Senior Data Engineer with deep expertise in SQL Server, Azure SQL, and Databricks to ... PySpark: Distributed transformations and performance optimization (joins, partitions, debugging ...
New
York, NY · On-site
Cognizant is looking for Sr Developer role 2. Job Summary :- Create and maintain optimal data ... PySpark Kafka etc - 1+ years of strong technical Experience with AWS cloud services like S3 IAM EC2 ...
York, NY · On-site
Cognizant is looking for Sr Developer role 2. Job Summary :- Create and maintain optimal data ... PySpark Kafka etc - 1+ years of strong technical Experience with AWS cloud services like S3 IAM EC2 ...
Manhattan, NY · On-site
$126K - $151K/yr
Sr. Data Engineer - AWS Glue & Snowflake, Healthcare Payer Location - Midtown Manhattan, NYC- 4day ... Develop PySpark and Python-based transformation logic for large-scale data processing. * Create ...
Manhattan, NY · On-site
$126K - $151K/yr
Sr. Data Engineer - AWS Glue & Snowflake, Healthcare Payer Location - Midtown Manhattan, NYC- 4day ... Develop PySpark and Python-based transformation logic for large-scale data processing. * Create ...
York, NY · On-site
Cognizant is looking for Sr Developer role 2. Job Summary :- Create and maintain optimal data ... PySpark Kafka etc - 1+ years of strong technical Experience with AWS cloud services like S3 IAM EC2 ...
York, NY · On-site
Cognizant is looking for Sr Developer role 2. Job Summary :- Create and maintain optimal data ... PySpark Kafka etc - 1+ years of strong technical Experience with AWS cloud services like S3 IAM EC2 ...
$133K - $170K/yr
Role: Senior Devops Engineer Location: Remote - USA Full Time Role We are hiring a Senior DevOps ... Python, PySpark, Shell scripting * CI/CD: Jenkins, GitHub Actions, GitLab CI, Azure DevOps * ...
$133K - $170K/yr
Role: Senior Devops Engineer Location: Remote - USA Full Time Role We are hiring a Senior DevOps ... Python, PySpark, Shell scripting * CI/CD: Jenkins, GitHub Actions, GitLab CI, Azure DevOps * ...
Reston, VA · On-site
$126K - $170K/yr
Sr AWS Python Developer (2 positions) Location- Reston, VA (In person Client interview) day one ... Build and maintain ETL pipelines using Python and PySpark on AWS Glue and other compute platforms
Quick apply
Reston, VA · On-site
$126K - $170K/yr
Sr AWS Python Developer (2 positions) Location- Reston, VA (In person Client interview) day one ... Build and maintain ETL pipelines using Python and PySpark on AWS Glue and other compute platforms
Columbus, OH · On-site
$51 - $67.25/hr
Role : Sr. Databricks Developer Location: Columbus, OH Duration: 12 Months MOI : Telephonic ... SQL, Python, AWS & PYSPARK Need Candidates with a Minimum of 9 Years of Experience. This is a 100 ...
Columbus, OH · On-site
$51 - $67.25/hr
Role : Sr. Databricks Developer Location: Columbus, OH Duration: 12 Months MOI : Telephonic ... SQL, Python, AWS & PYSPARK Need Candidates with a Minimum of 9 Years of Experience. This is a 100 ...
San Francisco, CA · On-site
$123K - $169K/yr
Foundry Sr Engineer 3. Experience : 8 to 11yrs. 4. Required Skills : Technical Skills ... Spark ,Python ,PySpark Domain Skills : 5. Nice to have skills : Technical Skills : Domain Skills ...
San Francisco, CA · On-site
$123K - $169K/yr
Foundry Sr Engineer 3. Experience : 8 to 11yrs. 4. Required Skills : Technical Skills ... Spark ,Python ,PySpark Domain Skills : 5. Nice to have skills : Technical Skills : Domain Skills ...
OR · Remote
$50 - $60/hr
Remote in USA Job Type : Full time looking for only W2 Detailed We are currently seeking a Senior Data Engineer with hands-on coding experience and a strong background in Python, PySpark, and Object ...
Quick apply
OR · Remote
$50 - $60/hr
Remote in USA Job Type : Full time looking for only W2 Detailed We are currently seeking a Senior Data Engineer with hands-on coding experience and a strong background in Python, PySpark, and Object ...
Ashburn, VA · On-site
$117K - $140K/yr
They are seeking a highly skilled and motivated Data Engineer to design, develop, and maintain data infrastructure, utilizing expertise in Python, PySpark, and ETL processes. Responsibilities : • ...
New
Ashburn, VA · On-site
$117K - $140K/yr
They are seeking a highly skilled and motivated Data Engineer to design, develop, and maintain data infrastructure, utilizing expertise in Python, PySpark, and ETL processes. Responsibilities : • ...
New
Mason, OH · On-site
Looking for a Onshore Senior Hadoop developer ... Should have good knowledge on Hive Spark Pyspark and scala. Should have expertise working with No ...
Mason, OH · On-site
Looking for a Onshore Senior Hadoop developer ... Should have good knowledge on Hive Spark Pyspark and scala. Should have expertise working with No ...
Montgomery, AL · On-site
Azure Data Factory, Databricks, Python/PySpark, Oracle / SQL * Experience in Data Migration / Conversion project
Quick apply
Montgomery, AL · On-site
Azure Data Factory, Databricks, Python/PySpark, Oracle / SQL * Experience in Data Migration / Conversion project
OR · Remote
$50 - $60/hr
Remote in USA Job Type : Full time looking for only W2 Detailed We are currently seeking a Senior Data Engineer with hands-on coding experience and a strong background in Python, PySpark, and Object ...
Quick apply
OR · Remote
$50 - $60/hr
Remote in USA Job Type : Full time looking for only W2 Detailed We are currently seeking a Senior Data Engineer with hands-on coding experience and a strong background in Python, PySpark, and Object ...
Plano, TX · On-site
$130K - $135K/yr
Job Title - Senior Data Engineer w/d Databricks and Python Experience (5) Location: Plano, TX and ... Design and build ETL/ELT pipelines using Databricks and PySpark * Develop and maintain data models ...
Quick apply
Plano, TX · On-site
$130K - $135K/yr
Job Title - Senior Data Engineer w/d Databricks and Python Experience (5) Location: Plano, TX and ... Design and build ETL/ELT pipelines using Databricks and PySpark * Develop and maintain data models ...
Tampa, FL · On-site
$111K - $149K/yr
Experience with PySpark for data processing. * Familiarity with data manipulation libraries (Pandas, NumPy). * Scripting for automation and data orchestration. * Complex query writing, including ...
Posted today
Tampa, FL · On-site
$111K - $149K/yr
Experience with PySpark for data processing. * Familiarity with data manipulation libraries (Pandas, NumPy). * Scripting for automation and data orchestration. * Complex query writing, including ...
Posted today
Jersey City, NJ · On-site
$73.67/hr
The ideal candidate will have strong experience in Python, PySpark/Spark, and data engineering on ... CI/CD using Azure DevOps or Jenkins, Git workflows, artifact versioning, and release readiness.
Jersey City, NJ · On-site
$73.67/hr
The ideal candidate will have strong experience in Python, PySpark/Spark, and data engineering on ... CI/CD using Azure DevOps or Jenkins, Git workflows, artifact versioning, and release readiness.
Austin, TX · On-site
$105K - $143K/yr
Benefits: * 401(k) Senior Data Platform Engineer Onsite Austin, TX We are hiring a Senior Data ... Develop and optimize Spark / PySpark jobs on Dataproc * Build and optimize complex SQL ...
Quick apply
Austin, TX · On-site
$105K - $143K/yr
Benefits: * 401(k) Senior Data Platform Engineer Onsite Austin, TX We are hiring a Senior Data ... Develop and optimize Spark / PySpark jobs on Dataproc * Build and optimize complex SQL ...
Ashburn, VA · On-site
$90K - $154K/yr
As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our clients data infrastructure. Your expertise in Python, PySpark, ETL processes, CI/CD (Jenkins or GitHub ...
Quick apply
Ashburn, VA · On-site
$90K - $154K/yr
As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our clients data infrastructure. Your expertise in Python, PySpark, ETL processes, CI/CD (Jenkins or GitHub ...
Pittsburgh, PA · On-site
$118K - $158K/yr
Senior Python Developer Location:- Pittsburgh,PA Duration:- Full Time Skill: Senior Python ... Added advantage if worked on Big Data, PySpark libraries. * Passionate about writing clean, logical ...
Quick apply
Pittsburgh, PA · On-site
$118K - $158K/yr
Senior Python Developer Location:- Pittsburgh,PA Duration:- Full Time Skill: Senior Python ... Added advantage if worked on Big Data, PySpark libraries. * Passionate about writing clean, logical ...
Ashburn, VA · On-site
$90K - $154K/yr
As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our clients data infrastructure. Your expertise in Python, PySpark, ETL processes, CI/CD (Jenkins or GitHub ...
Ashburn, VA · On-site
$90K - $154K/yr
As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our clients data infrastructure. Your expertise in Python, PySpark, ETL processes, CI/CD (Jenkins or GitHub ...
$118K - $141K/yr
Other
Posted 5 days ago
New
Experience: Minimum 8+ Years
Location: Chicago, IL (Hybrid 3 days Work from Office)
Duration: -12+ months
Educational Qualifications: - Engineering Degree BE/ME/BTech/MTech/BSc/MSc. Technical certification in multiple technologies is desirable.
Mandatory skills
ETL / ELT Concepts: Strong understanding of pipeline patterns, incremental loads, data validation, and troubleshooting.
SQL: Advanced querying (CTEs, views, joins, complex query logic) and performance tuning for transformations and validation. Python: Production-quality development (modular code, testing, logging, integration with APIs/files, CICD, Unit Test/Integration test automation, Code Coverage).
PySpark: Distributed transformations and performance optimization (joins, partitions, debugging), CICD, Unit Test/Integration test automation, Code Coverage.
Azure Data Factory (ADF): Build/operate ADF pipelines, parameterization, triggers, monitoring, retry/error handling; integrate with Databricks/ADLS.
Databricks: Develop and operationalize notebooks/jobs/workflows; Delta Lake patterns; basic cluster/job configuration.
Azure Fundamentals + Pulumi: Hands-on with ADLS Gen2, Azure Portal, Storage Explorer, Resource Groups, Azure SQL, and familiarity integrating with Azure OpenAI. Able to use/maintain Pulumi scripts for provisioning and managing Azure resources across environments
Roles and Responsibilities
Design, build, and support end-to-end data pipelines (ingestion, transformation, validation, publishing). Develop and optimize SQL and PySpark/Databricks transformations for large datasets.
Build production-grade Python components (reusable modules, logging, error handling, testing). Create and maintain Azure Data Factory (ADF) pipelines (triggers, parameterization, monitoring, failure handling).
Work within Azure environments (ADLS Gen2, Azure SQL, resource groups, portal operations).
Provision and maintain Azure components using Pulumi (Infrastructure as Code). Participate in code reviews, documentation, and operational support (triage + root cause analysis)
Nice to have skills: -
Ability to support/translate validation rules with SQL scripts and create data quality reports. TypeScript: Useful for pulumi pipeline to create Azure components.
Java: Useful for integration with existing services/components.
.NET: Useful for integration with existing services/components. Angular / Spring Boot: Minor troubleshooting or coordination with app teams.
Domain : Clinical (Health care)
VeeRteq Solutions is an Equal Opportunity Employer
Sourced by ZipRecruiter
Marketing
11 - 50 Employees
Portland, OR, US
2012
