ZipRecruiter

Log In

1

Azure Big Data Engineer Jobs in Massachusetts (NOW HIRING)

C the Signs

AI Data Engineer

Boston, MA · On-site +1

$124K - $149K/yr

Position Summary The Data Engineer will play a crucial role in developing and fine-tuning data ... Azure) and their data storage and processing services. * Hands-on experience with big data ...

C the Signs

AI Data Engineer

Boston, MA · On-site +1

$124K - $149K/yr

Position Summary The Data Engineer will play a crucial role in developing and fine-tuning data ... Azure) and their data storage and processing services. * Hands-on experience with big data ...

Lorven Technologies

Senior Data Engineer

Quincy, MA · On-site

$111K - $151K/yr

The main focus is to support processing of big data volumes and integrate solution to current ... Strong, recent hands-on expertise with Azure Data Factory and Synapse is a must (3+ years)

Stellar IT Group

Azure Data Engineer

Wilmington, MA · On-site

$125K - $150K/yr

Azure Data Engineer Location: Wilmington, MA (Hybrid - 2 days onsite, remainder remote; must be local to MA or NH) Duration: Long Term Contract Position Summary We are seeking a highly motivated ...

Jobsbridge

Big Data Architect

Boston, MA · On-site

$69.25 - $89/hr

Emergent technology staffing (UI/UX developers & designers, Mobility & Cloud Engineers, Big Data ... Azure - Experience managing the full lifecycle of a Hadoop Solution - Experience creating the ...

Deloitte

Sr Databricks Data Engineer

Boston, MA

$124K - $149K/yr

Master's degree in Computer Science, Engineering, or a related field Experience in one or more of AWS, Azure, and GCP cloud ecosystems and associated big data services Experience tuning and ...

Syntricate Technologies

Azure Databricks Engineer

Quincy, MA · On-site

$109K - $150K/yr

Syntricate Technologies is seeking a Senior/Lead Azure Databricks Engineer with extensive ... Preferred : • If Candidate has big data Hadoop experience, it will be an added advantage. • Any ...

GEI Consultants

Data Engineer

Wakefield, MA · On-site

$120K - $145K/yr

The Data Engineer is responsible for designing, building, and maintaining the data pipelines and ... Experience with Azure data services, including Azure Data Factory, Azure Synapse Analytics, Azure ...

GEI Consultants

Data Engineer

Wakefield, MA · On-site

$90K - $150K/yr

The Data Engineer is responsible for designing, building, and maintaining the data pipelines and ... Experience with Azure data services, including Azure Data Factory, Azure Synapse Analytics, Azure ...

Dlapiper

Data Engineer

Boston, MA

$124K - $149K/yr

Together. Summary The Data Engineer, Solutions & Data role designs, builds, and operates data ... Design and implement data pipelines using Azure data technologies (e.g., Azure Data Factory, Azure ...

GEI Consultants

Data Engineer

Wakefield, MA

$120K - $145K/yr

The Data Engineer is responsible for designing, building, and maintaining the data pipelines and ... Experience with Azure data services, including Azure Data Factory, Azure Synapse Analytics, Azure ...

next page

Showing results 1-20

All JobsAzure Big Data Engineer JobsAzure Big Data Engineer Jobs in Massachusetts

Azure Big Data Engineer information

What does an Azure Big data engineer do?

An Azure Big Data Engineer is responsible for designing, building, and managing big data solutions using Microsoft Azure cloud technologies. They focus on processing large volumes of data, creating data pipelines, and ensuring data is stored and analyzed efficiently. Their work often involves tools such as Azure Data Lake, Azure Databricks, Azure Synapse Analytics, and Azure Data Factory. Azure Big Data Engineers collaborate with data scientists, analysts, and other IT professionals to enable data-driven decision-making within organizations.

What are the key skills and qualifications needed to thrive as an Azure Big data engineer?

To thrive as an Azure Big Data Engineer, you need expertise in data engineering, cloud computing, and programming languages such as Python or Scala, typically supported by a degree in computer science or a related field. Familiarity with Azure Data Services (like Azure Data Lake, Azure Synapse Analytics, and Azure Databricks), as well as certifications like Microsoft Certified: Azure Data Engineer Associate, is highly valuable. Strong analytical thinking, problem-solving, and communication skills help you collaborate effectively with cross-functional teams and translate business needs into technical solutions. These skills and qualities are essential for building scalable, reliable data pipelines that drive business insights and innovation in cloud environments.

What are some common challenges Azure big data engineers face when integrating multiple data sources?

Azure Big Data Engineers often encounter challenges such as ensuring data consistency and quality when integrating disparate data sources like on-premises databases, cloud storage, and third-party APIs. Handling varying data formats and latency issues can also complicate data pipelines. To overcome these challenges, engineers typically use Azure Data Factory for orchestration, implement robust data validation, and collaborate closely with data architects and business analysts to align on integration requirements.

How much do Azure Big Data Engineers make?

Azure Big Data Engineers typically earn between $90,000 and $150,000 annually, depending on experience, location, and certifications such as Azure Data Engineer Associate. Salaries tend to be higher in regions with a strong tech industry and for professionals with advanced skills in cloud services and data processing tools.

Is Azure Big Data Engineer in demand?

Azure Big Data Engineers are in high demand due to the increasing adoption of cloud-based data solutions and the need for expertise in tools like Azure Data Lake, Synapse Analytics, and Spark. Organizations seek professionals skilled in data pipeline development, cloud architecture, and big data processing to support analytics and AI initiatives.

What are popular job titles related to Azure Big Data Engineer jobs in Massachusetts?

For Azure Big Data Engineer jobs in Massachusetts, the most frequently searched job titles are:

What job categories do people searching Azure Big Data Engineer jobs in Massachusetts look for?

The top searched job categories for Azure Big Data Engineer jobs in Massachusetts are:

What cities in Massachusetts are hiring for Azure Big Data Engineer jobs?

Cities in Massachusetts with the most Azure Big Data Engineer job openings:

Azure Big Data Engineer jobs near you

AI Data Engineer

C the Signs

Boston, MA • On-site, Remote

$124K - $149K/yr

Full-time

Re-posted 5 days ago

Job description

Position Summary

The Data Engineer will play a crucial role in developing and fine-tuning data specifically for our LLMs and machine learning models. This individual will be responsible for the entire data lifecycle, including gathering, cleaning, structuring, and optimizing large, diverse healthcare datasets. The ideal candidate will have a strong background in data engineering principles, experience with big data technologies, and a keen understanding of the unique challenges and requirements of healthcare data.

You will design, build, and maintain scalable data pipelines that source, preprocess, and deliver high-quality, high-volume datasets to our machine learning engineers. This role requires a deep understanding of data engineering best practices coupled with specific knowledge of the data requirements for LLM training and refinement

Key Responsibilities
  • Collaborate with data scientists and machine learning engineers to understand data requirements for LLM and machine learning model fine-tuning.
  • Design, build, and maintain scalable data pipelines to ingest, process, and store massive and diverse healthcare datasets.
  • Implement robust data validation and monitoring to ensure the integrity, accuracy, and consistency of all training datasets.
  • Implement robust data cleaning, validation, and transformation processes to ensure data quality and integrity.
  • Develop and optimize data structures and schemas for efficient access and utilization by LLMs and machine learning models.
  • Work with the team to identify and acquire new data sources, ensuring compliance with relevant healthcare regulations (e.g., HIPAA).
  • Monitor data pipeline performance, troubleshoot issues, and implement optimizations to improve efficiency and reliability.
  • Document data engineering processes, data models, and data dictionaries.
  • Stay up-to-date with the latest advancements in data engineering, big data technologies, and machine learning.

Requirements

Required
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Proven experience as a Data Engineer, with a focus on big data technologies.
  • Strong proficiency in programming languages such as Python, Scala, or Java.
  • Extensive experience with data warehousing, ETL processes, and data modeling.
  • Experience with major cloud providers (e.g., AWS, GCP, Azure) and their data storage and processing services.
  • Hands-on experience with big data frameworks like Apache Spark for distributed processing.
  • Excellent problem-solving skills and the ability to work independently and as part of a team.
  • Strong communication and interpersonal skills.
Preferred
  • Master's degree in a related field.
  • Experience with healthcare data and a good understanding of healthcare data standards (e.g., FHIR, HL7).
  • Familiarity with machine learning concepts and LLM fine-tuning processes.
  • Experience with data orchestration tools (e.g., Apache Airflow).
Work Authorization:
    • Must be a US Citizen, Green Card holder, or currently in the US have valid H1B visa

Benefits

Why Join Us?

Joining C the Signs is not just about building AI; it's about shaping the future of healthcare. If you are a technical leader with an unshakable belief in the power of AI to save lives and the ability to make it happen at scale, this is your opportunity to create a tangible, global impact.

Benefits:

  • Competitive salary and benefits package.
  • Flexible working arrangements (remote or hybrid options available).
  • The opportunity to work on life-changing AI technology that directly impacts patient outcomes.
  • Join a team that combines cutting-edge innovation with a mission to save lives and improve health equity.
  • Continuous learning opportunities with access to the latest tools and advancements in AI and healthcare.

Apply