1

Azure Big Data Engineer Jobs in Oregon (NOW HIRING)

Big Data Engineer

Portland, OR ยท On-site

$58.75 - $77.50/hr

Kafka, Rsyslog, Logstash, Splunk โ€ข Programming/Scripting : Java / Jetty, Python, Scala ... Docker, or Azure Containers โ€ข Automation experience with ScienceLogic or Ansible โ€ข Some ...

Data Engineer

Portland, OR ยท On-site

$121K - $145K/yr

Experience with cloud computing and virtualization technologies (e.g., AWS, Azure, GCP ... Experience with big data processing technologies. * Experience with data visualization and ...

Data Engineer - Databricks

Beaverton, OR

$119K - $143K/yr

Data Engineer - Databricks Location: Beaverton, OR - Hybrid (3 Days Onsite) Contract-to-Hire Job ... Work with cloud platforms such as Azure, AWS, or GCP , with preference for Azure . * Develop and ...

New

Data Engineer - Databricks

Beaverton, OR

$119K - $143K/yr

Data Engineer - Databricks Location: Beaverton, OR - Hybrid (3 Days Onsite) Contract-to-Hire Job ... Work with cloud platforms such as Azure, AWS, or GCP , with preference for Azure . * Develop and ...

New

Data Engineer - Databricks

Beaverton, OR ยท On-site

$119K - $143K/yr

Company Description Data Engineer - Databricks Location: Beaverton, OR - Hybrid (3 Days Onsite ... Work with cloud platforms such as Azure, AWS, or GCP , with preference for Azure . * Develop and ...

New

Data Engineer

Beaverton, OR ยท On-site

$119K - $143K/yr

We are seeking a Data Engineer with deep expertise in Azure, Databricks, Python, SQL, and distributed data systems to help drive the evolution of our enterprise data platform. This role goes beyond ...

Data Engineer

Beaverton, OR ยท On-site

$119K - $143K/yr

We are seeking a Data Engineer with deep expertise in Azure, Databricks, Python, SQL, and distributed data systems to help drive the evolution of our enterprise data platform. This role goes beyond ...

next page

Showing results 1-20

Azure Big Data Engineer information

What does an Azure Big data engineer do?

An Azure Big Data Engineer is responsible for designing, building, and managing big data solutions using Microsoft Azure cloud technologies. They focus on processing large volumes of data, creating data pipelines, and ensuring data is stored and analyzed efficiently. Their work often involves tools such as Azure Data Lake, Azure Databricks, Azure Synapse Analytics, and Azure Data Factory. Azure Big Data Engineers collaborate with data scientists, analysts, and other IT professionals to enable data-driven decision-making within organizations.

What are the key skills and qualifications needed to thrive as an Azure Big data engineer?

To thrive as an Azure Big Data Engineer, you need expertise in data engineering, cloud computing, and programming languages such as Python or Scala, typically supported by a degree in computer science or a related field. Familiarity with Azure Data Services (like Azure Data Lake, Azure Synapse Analytics, and Azure Databricks), as well as certifications like Microsoft Certified: Azure Data Engineer Associate, is highly valuable. Strong analytical thinking, problem-solving, and communication skills help you collaborate effectively with cross-functional teams and translate business needs into technical solutions. These skills and qualities are essential for building scalable, reliable data pipelines that drive business insights and innovation in cloud environments.

What are some common challenges Azure big data engineers face when integrating multiple data sources?

Azure Big Data Engineers often encounter challenges such as ensuring data consistency and quality when integrating disparate data sources like on-premises databases, cloud storage, and third-party APIs. Handling varying data formats and latency issues can also complicate data pipelines. To overcome these challenges, engineers typically use Azure Data Factory for orchestration, implement robust data validation, and collaborate closely with data architects and business analysts to align on integration requirements.

How much do Azure Big Data Engineers make?

Azure Big Data Engineers typically earn between $90,000 and $150,000 annually, depending on experience, location, and certifications such as Azure Data Engineer Associate. Salaries tend to be higher in regions with a strong tech industry and for professionals with advanced skills in cloud services and data processing tools.

Is Azure Big Data Engineer in demand?

Azure Big Data Engineers are in high demand due to the increasing adoption of cloud-based data solutions and the need for expertise in tools like Azure Data Lake, Synapse Analytics, and Spark. Organizations seek professionals skilled in data pipeline development, cloud architecture, and big data processing to support analytics and AI initiatives.

What job categories do people searching Azure Big Data Engineer jobs in Oregon look for?

The top searched job categories for Azure Big Data Engineer jobs in Oregon are:

What cities in Oregon are hiring for Azure Big Data Engineer jobs?

Cities in Oregon with the most Azure Big Data Engineer job openings:

$59 - $78.25/hr

Contractor

Re-posted 9 days ago


Job description


Overview:
As a Sr. Big Data Engineer, you will work with a variety of talented teammates and be a driving force for building solutions for Digital.You will be working on projects related to consumer behavior, commerce, and consumer touchpoints
Responsibilities:
โ€ข Design and implement distributed data processing pipelines using Spark, Hive, Python, and other tools and languages prevalent in the Hadoop ecosystem.
โ€ข Ability to design and implement end to end solution.
โ€ข Experience publishing RESTful API's to enable real-time data consumption using OpenAPI specifications
โ€ข Experience with open source NOSQL technologies such as HBase, DynamoDB, Cassandra
โ€ข Familiar with Distributed Stream Processing frameworks for Fast & Big Data like ApacheSpark, Flink, Kafka stream
โ€ข Build utilities, user defined functions, and frameworks to better enable data flow patterns.
โ€ข Work with architecture/engineering leads and other teams to ensure quality solutions are implements, and engineering best practices are defined and adhered to.
โ€ข Experience in Business Rule management systems like Drools
Qualification:
โ€ข MS/BS degree in a computer science or related discipline
โ€ข 6+ years' experience in large-scale software development
โ€ข 3+ year experience in Big Data technologies
โ€ข Strong programming skills in Java/Scala, Python, Shell scripting, and SQL
โ€ข Strong development skills around Spark, MapReduce, and Hive
โ€ข Strong skills around developing RESTful API's