ZipRecruiter

Log In

1

Azure Big Data Engineer Jobs in Oregon (NOW HIRING)

ConnectWise

OR · On-site

... Azure, Google Cloud) and big data technologies (e.g., Hadoop, Spark). - Strong leadership and communication skills, with the ability to manage and motivate a team.

3B Staffing LLC

Big Data - Spark with Scala

Happy Valley, OR · On-site

$55.75 - $72.25/hr

Hands on experience working on Big Data Technologies - Spark is mandatory * Strong understanding on Big data platforms and experience in AWS is mandatory * Should have experience with ETL using Spark ...

Kynite

Azure Databricks Admin

OR

$51.50 - $64/hr

Blockchain, Cloud Services, Big Data & Analytics, Artificial Intelligence, Enterprise, Staff ... engineer permanent solutions, and coordinate implementation. Provide work guidance to less ...

Kynite

Azure Databricks Admin

OR · On-site +1

$51.50 - $64/hr

Blockchain, Cloud Services, Big Data & Analytics, Artificial Intelligence, Enterprise, Staff ... engineer permanent solutions, and coordinate implementation. • Provide work guidance to less ...

Pwc

Data Engineer - Manager

Portland, OR · On-site

... Azure Solutions Architect, Azure Data Engineer Associate, or Snowflake Core, Snowflake Databricks ... with big data technologies like Hadoop, Spark, or Kafka is a plus - Experience with machine ...

Concora Credit Inc.

Sr. Data Engineer

Beaverton, OR

$119K - $143K/yr

We are seeking a Senior Data Engineer with deep expertise in Azure, Databricks, Python, SQL, and distributed data systems to help drive the evolution of our enterprise data platform. This role goes ...

Concora Credit Inc.

Sr. Data Engineer

Beaverton, OR

$119K - $143K/yr

We are seeking a Senior Data Engineer with deep expertise in Azure, Databricks, Python, SQL, and distributed data systems to help drive the evolution of our enterprise data platform. This role goes ...

next page

Showing results 1-20

All JobsAzure Big Data Engineer JobsAzure Big Data Engineer Jobs in Oregon

Azure Big Data Engineer information

What does an Azure Big Data Engineer do?

An Azure Big Data Engineer is responsible for designing, building, and managing big data solutions using Microsoft Azure cloud technologies. They focus on processing large volumes of data, creating data pipelines, and ensuring data is stored and analyzed efficiently. Their work often involves tools such as Azure Data Lake, Azure Databricks, Azure Synapse Analytics, and Azure Data Factory. Azure Big Data Engineers collaborate with data scientists, analysts, and other IT professionals to enable data-driven decision-making within organizations.

What are the key skills and qualifications needed to thrive as an Azure Big Data Engineer, and why are they important?

To thrive as an Azure Big Data Engineer, you need expertise in data engineering, cloud computing, and programming languages such as Python or Scala, typically supported by a degree in computer science or a related field. Familiarity with Azure Data Services (like Azure Data Lake, Azure Synapse Analytics, and Azure Databricks), as well as certifications like Microsoft Certified: Azure Data Engineer Associate, is highly valuable. Strong analytical thinking, problem-solving, and communication skills help you collaborate effectively with cross-functional teams and translate business needs into technical solutions. These skills and qualities are essential for building scalable, reliable data pipelines that drive business insights and innovation in cloud environments.

What are some common challenges Azure Big Data Engineers face when integrating multiple data sources?

Azure Big Data Engineers often encounter challenges such as ensuring data consistency and quality when integrating disparate data sources like on-premises databases, cloud storage, and third-party APIs. Handling varying data formats and latency issues can also complicate data pipelines. To overcome these challenges, engineers typically use Azure Data Factory for orchestration, implement robust data validation, and collaborate closely with data architects and business analysts to align on integration requirements.
What are popular job titles related to Azure Big Data Engineer jobs in Oregon? For Azure Big Data Engineer jobs in Oregon, the most frequently searched job titles are:
What job categories do people searching Azure Big Data Engineer jobs in Oregon look for? The top searched job categories for Azure Big Data Engineer jobs in Oregon are:
What cities in Oregon are hiring for Azure Big Data Engineer jobs? Cities in Oregon with the most Azure Big Data Engineer job openings:
Azure Big Data Engineer jobs near you

Senior Big Data Engineer

BizTek People, Inc. | APA International Placement Consultants

Portland, OR • On-site

$59 - $78.25/hr

Contractor

Posted 4 days ago

Job description


Overview:
As a Sr. Big Data Engineer, you will work with a variety of talented teammates and be a driving force for building solutions for Digital.You will be working on projects related to consumer behavior, commerce, and consumer touchpoints
Responsibilities:
• Design and implement distributed data processing pipelines using Spark, Hive, Python, and other tools and languages prevalent in the Hadoop ecosystem.
• Ability to design and implement end to end solution.
• Experience publishing RESTful API's to enable real-time data consumption using OpenAPI specifications
• Experience with open source NOSQL technologies such as HBase, DynamoDB, Cassandra
• Familiar with Distributed Stream Processing frameworks for Fast & Big Data like ApacheSpark, Flink, Kafka stream
• Build utilities, user defined functions, and frameworks to better enable data flow patterns.
• Work with architecture/engineering leads and other teams to ensure quality solutions are implements, and engineering best practices are defined and adhered to.
• Experience in Business Rule management systems like Drools
Qualification:
• MS/BS degree in a computer science or related discipline
• 6+ years' experience in large-scale software development
• 3+ year experience in Big Data technologies
• Strong programming skills in Java/Scala, Python, Shell scripting, and SQL
• Strong development skills around Spark, MapReduce, and Hive
• Strong skills around developing RESTful API's

Apply