1

Azure Big Data Engineer Jobs in Oregon (NOW HIRING)

... Azure-based cloud deployments of Big Data platforms. As a Manager, Data Management, you will lead a team of in-house and outsourced Data Engineers and developers in architecture, requirements ...

Data Engineer - AI

$101K - $132K/yr

Using their technical experience in ETL processes, Data Engineers ensure operational functions are ... of big data / cloud technologies (Databricks, AWS, Azure, Hadoop, Spark, Snowflake etc.). * 3+ ...

Data Engineer

Beaverton, OR · On-site

$119K - $143K/yr

We are seeking a Data Engineer with deep expertise in Azure, Databricks, Python, SQL, and distributed data systems to help drive the evolution of our enterprise data platform. This role goes beyond ...

Data Engineer

Beaverton, OR

$119K - $143K/yr

We are seeking a Data Engineer with deep expertise in Azure, Databricks, Python, SQL, and distributed data systems to help drive the evolution of our enterprise data platform. This role goes beyond ...

Data Engineer

Beaverton, OR · On-site

$119K - $143K/yr

We are seeking a Data Engineer with deep expertise in Azure, Databricks, Python, SQL, and distributed data systems to help drive the evolution of our enterprise data platform. This role goes beyond ...

Data Engineer

Beaverton, OR

$119K - $143K/yr

We are seeking a Data Engineer with deep expertise in Azure, Databricks, Python, SQL, and distributed data systems to help drive the evolution of our enterprise data platform. This role goes beyond ...

Azure Databricks Admin

OR

$51.50 - $64/hr

Blockchain, Cloud Services, Big Data & Analytics, Artificial Intelligence, Enterprise, Staff ... engineer permanent solutions, and coordinate implementation. Provide work guidance to less ...

Lead Data Engineer

Beaverton, OR · On-site

$59.40 - $66/hr

Prior experience working within a large global consumer or retail organization (environment familiarity required) * 8-10+ years of experience in data engineering or big data environments * Strong ...

next page

Showing results 1-20

Azure Big Data Engineer information

What does an Azure Big data engineer do?

An Azure Big Data Engineer is responsible for designing, building, and managing big data solutions using Microsoft Azure cloud technologies. They focus on processing large volumes of data, creating data pipelines, and ensuring data is stored and analyzed efficiently. Their work often involves tools such as Azure Data Lake, Azure Databricks, Azure Synapse Analytics, and Azure Data Factory. Azure Big Data Engineers collaborate with data scientists, analysts, and other IT professionals to enable data-driven decision-making within organizations.

What are the key skills and qualifications needed to thrive as an Azure Big data engineer?

To thrive as an Azure Big Data Engineer, you need expertise in data engineering, cloud computing, and programming languages such as Python or Scala, typically supported by a degree in computer science or a related field. Familiarity with Azure Data Services (like Azure Data Lake, Azure Synapse Analytics, and Azure Databricks), as well as certifications like Microsoft Certified: Azure Data Engineer Associate, is highly valuable. Strong analytical thinking, problem-solving, and communication skills help you collaborate effectively with cross-functional teams and translate business needs into technical solutions. These skills and qualities are essential for building scalable, reliable data pipelines that drive business insights and innovation in cloud environments.

What are some common challenges Azure big data engineers face when integrating multiple data sources?

Azure Big Data Engineers often encounter challenges such as ensuring data consistency and quality when integrating disparate data sources like on-premises databases, cloud storage, and third-party APIs. Handling varying data formats and latency issues can also complicate data pipelines. To overcome these challenges, engineers typically use Azure Data Factory for orchestration, implement robust data validation, and collaborate closely with data architects and business analysts to align on integration requirements.
What job categories do people searching Azure Big Data Engineer jobs in Oregon look for? The top searched job categories for Azure Big Data Engineer jobs in Oregon are:
What cities in Oregon are hiring for Azure Big Data Engineer jobs? Cities in Oregon with the most Azure Big Data Engineer job openings:

$58.75 - $77.50/hr

Full-time

Re-posted 20 days ago


Job description

Job Description
• Runtime Infrastructure : Docker, Kubernetes, Lambdas
• Storage Systems : DynamoDB, MongoDB, Redis, Hadoop, Memcached
• Messaging : Kafka, Rsyslog, Logstash, Splunk
• Programming/Scripting : Java / Jetty, Python, Scala, PowerShell, C#, Bash
• Build Tools/Repositories : Jenkins, Artifactory
• Web Services Framework: Django, Flask
• API Framework: Gunicorn
5+ years of relevant experience focused on Support Engineering, TechOps, DevOps, systems administration, application development, build, release and deployment
• Experience deploying systems with Kubernets, Docker, or Azure Containers
• Automation experience with ScienceLogic or Ansible
• Some experience with monitoring and anomaly detection systems
• Hands-on experience on monitoring tools such as New Relic, Splunk, SignalFx, Solarwinds, etc.
• Well versed with ITIL concepts (Event, Incident, Knowledge, Change, Problem Management)
• Familiarity with Chatbots such as Slackbot
• End user knowledge on ITSM tools such as ServiceNow
Thanks
Arjun
arjun.d@avanitechsolutions.com