ZipRecruiter

Log In

1

Data Engineer Data Jobs in New York (NOW HIRING)

Recruit Professional Services

Data Engineer

Bedminster, NJ · On-site

$116K - $140K/yr

Data Engineer Responsibilities * Develop and maintain scripts and tools using Python, PowerShell, and R. * Design, write, and optimize SQL queries for performance and scalability. * Help modernize ...

Bright Mind Solutions LLC

Data Engineer

Newark, NJ · On-site

$55 - $60/hr

AWS Data Engineer Duties: * Design and build data pipelines and ETL workflows using AWS Glue, AWS Lambda, and AWS Step Functions * Ingest and transform data from diverse sources (S3, RDS, DynamoDB ...

Sigma Computing

Data Engineer

New York, NY

$140K - $180K/yr

Data Engineer, Data Platform About the Role We are building out our Data Platform team at Sigma, with a relentless focus on developing data models that fuel trusted insights across the company. As a ...

City of New York

Data Engineer

Manhattan, NY · Hybrid

$125K - $150K/yr

Within ITD, the Geographic Data and Engineering (GDE) unit consists of application engineering, data engineering, geographic information systems, and geographic research teams, responsible for ...

City of New York

Data Engineer

Manhattan, NY · On-site

$100K - $125K/yr

Within ITD, the Geographic Data and Engineering (GDE) unit consists of application engineering, data engineering, geographic information systems, and geographic research teams, responsible for ...

City of New York

Data Engineer

Manhattan, NY · Hybrid

$125K - $150K/yr

Within ITD, the Geographic Data and Engineering (GDE) unit consists of application engineering, data engineering, geographic information systems, and geographic research teams, responsible for ...

CYNET SYSTEMS

Data Engineer

Jersey City, NJ · On-site

$55 - $60/hr

Job Overview: Pay Range: $55/hr - $60/hr Requirement/Must Have: * 10+ years of IT experience, with 7+ years of experience as an ETL/ELT developer/data engineer. * 3+ years of Databricks data ...

Virtusa

Data Engineer

Jersey City, NJ

$119K - $143K/yr

Skills from outside primary skill cluster SQL, PySpark, Python Scripting, Informatica or Collibra, JIRA, Agile, Scrum Must have a minimum of 4+ years of experience in data engineering, data ...

Berkley

Data Engineer

Greenwich, CT · On-site

$128K - $154K/yr

Responsibilities We are seeking a Data Engineer with strong engineering, coding, and problem-solving skills to design, build, and operate data platforms that support actuaries, analytics, modeling ...

Colgate-Palmolive Company

Data Engineer

Piscataway, NJ · On-site

$76K - $121K/yr

The Modern Data Engineer will be an experienced pipeline builder and data wrangler who enjoys optimizing data systems from the ground up to power the next generation of predictive and generative AI ...

Colgate-Palmolive Company

Data Engineer

Piscataway, NJ · On-site

$76K - $107K/yr

The Modern Data Engineer will be an experienced pipeline builder and data wrangler who enjoys optimizing data systems from the ground up to power the next generation of predictive and generative AI ...

Colgate-Palmolive Company

Data Engineer

Piscataway, NJ

$76K - $121K/yr

The Modern Data Engineer will be an experienced pipeline builder and data wrangler who enjoys optimizing data systems from the ground up to power the next generation of predictive and generative AI ...

Berkley

Data Engineer

Greenwich, CT

$128K - $154K/yr

We are seeking a Data Engineer with strong engineering, coding, and problemsolving skills to design, build, and operate data platforms that support actuaries, analytics, modeling, and AIenabled ...

Berkley

Data Engineer

Greenwich, CT

$128K - $154K/yr

Responsibilities We are seeking a Data Engineer with strong engineering, coding, and problemsolving skills to design, build, and operate data platforms that support actuaries, analytics, modeling ...

next page

Showing results 1-20

All JobsData Engineer Data JobsData Engineer Data Jobs in New York

Data Engineer Data information

What are some common challenges Data Engineers face when integrating data from multiple sources?

Data Engineers often encounter challenges such as inconsistent data formats, varying data quality, and differing update frequencies when integrating data from multiple sources. Ensuring data integrity and designing robust ETL pipelines that can handle these discrepancies is a key part of the role. Collaboration with data analysts, database administrators, and source system owners is crucial to resolve data mapping issues, automate data validation, and maintain reliable data flows within the organization.

What is the difference between Data Engineer Data vs Data Analyst?

AspectData Engineer DataData Analyst
Primary RoleBuilds and maintains data pipelines and infrastructureAnalyzes data to generate insights and reports
Skills & CertificationsSQL, Python, ETL tools, cloud platformsSQL, Excel, data visualization tools
Work EnvironmentData engineering teams, IT departmentsBusiness units, analytics teams
Industry UsageTech, finance, healthcare, any data-driven industryMarketing, finance, operations, business intelligence

While Data Engineer Data focuses on creating and managing data infrastructure, Data Analysts interpret this data to support decision-making. Both roles require strong SQL skills, but Data Engineers typically work more with data pipelines and cloud platforms, whereas Data Analysts focus on data visualization and reporting.

What are the key skills and qualifications needed to thrive as a Data Engineer, and why are they important?

To thrive as a Data Engineer, you need a solid understanding of data modeling, SQL, and programming languages such as Python or Java, often backed by a degree in computer science, engineering, or a related field. Familiarity with data warehousing solutions (like Amazon Redshift or Snowflake), ETL tools, and cloud platforms (such as AWS, Azure, or Google Cloud) is typically required, along with relevant certifications. Strong problem-solving abilities, collaboration, and clear communication are vital soft skills for integrating complex data systems and working with cross-functional teams. These skills ensure that data pipelines are reliable, scalable, and effectively support business intelligence and analytics needs.

What are Data Engineers?

Data Engineers are professionals who design, build, and maintain the systems and infrastructure that allow organizations to collect, store, and analyze large amounts of data. They create data pipelines, ensure data quality, and optimize data flow between systems, making it accessible for data scientists and analysts. Data Engineers often work with technologies like SQL, Python, Hadoop, and cloud platforms, and play a crucial role in supporting data-driven decision-making within organizations.
What are popular job titles related to Data Engineer Data jobs in New York? For Data Engineer Data jobs in New York, the most frequently searched job titles are:
What job categories do people searching Data Engineer Data jobs in New York look for? The top searched job categories for Data Engineer Data jobs in New York are:
What cities in New York are hiring for Data Engineer Data jobs? Cities in New York with the most Data Engineer Data job openings:
Data Engineer Data jobs near you
Data Engineer

Data Engineer

Recruit Professional Services

Bedminster, NJ • On-site

$116K - $140K/yr

Other

Posted 27 days ago

Job description

Data Engineer
Responsibilities
  • Develop and maintain scripts and tools using Python, PowerShell, and R.
  • Design, write, and optimize SQL queries for performance and scalability.
  • Help modernize 'legacy' solutions to realign with our current code base and tech stack.
  • Assist in redevelopment, improvement and ongoing maintenance of existing data, analytics, and reporting solutions.
  • Ensure accurate and efficient data integration of diverse data sources and formats.
  • Enhance and support database functions and procedures.
  • Optimize data access and data processing workflows for performance, scalability, and efficiency/
  • Implement data quality checks and validations to ensure the accuracy, consistency, and completeness of data.
  • Identify and resolve performance bottlenecks, investigate and troubleshoot data related issues, and provide solutions to address defects.
  • Seamlessly transition between production support and development tasks based on business needs.
  • Deploy and manage code utilizing engineering best practices in non-prod and prod environments.

Requirements:
  • Bachelor's Degree in computer science, data science, software engineering, information systems, or related quantitative field.
  • Minimum 4 years of experience working as a Python Developer, Solutions Engineer, Data Engineer, or similar roles.
  • 4+ years of solid continuous experience in Python.
  • 3+ years of solid experience writing SQL and PL/SQL code.
  • 3+ years of experience working with relational databases (solid understanding of Oracle preferred).
  • 2+ years of experience scripting with PowerShell.
  • Experience programming in R.
  • Experience with web application frameworks including Shiny, Dash, Streamlit.
  • Experience with CI/CD utilizing git/Azure DevOps.
  • Knowledge of alternative storage formats including Parquet/Arrow/Avro.
  • Ability to collaborate within and across teams of different technical knowledge to support delivery of solutions.
  • Expert problem-solving skills, including debugging skills, enabling the determination of sources of issues in unfamiliar code or systems.
#Recruitps

Apply