ZipRecruiter

Log In

SPECS

60 Spec Big Data Engineer Jobs Hiring Near You

SGA Inc

Big Data Engineer

Rockville, MD

$56.75 - $75.25/hr

We are seeking a highly skilled and experienced Big Data Engineer to design, develop, and optimize large-scale data processing systems. In this role, you will work closely with cross-functional teams ...

Software Guidance & Assistance

Big Data Engineer

Rockville, MD · On-site

$56.75 - $75.25/hr

We are seeking a highly skilled and experienced Big Data Engineer to design, develop, and optimize large-scale data processing systems. In this role, you will work closely with cross-functional teams ...

TriOptus LLC

Big Data Engineer

Alpharetta, GA · On-site

$54.50 - $72/hr

Big Data Engineer (Hybrid) Location: Alpharetta, Georgia (Hybrid Role) Employment Type: Contract-to-Hire (CTH) MOR2JP00017198 We are seeking a highly skilled and experienced Data Engineer to join our ...

Kanak Elite Services Inc

Big Data Engineer

Malvern, PA · On-site

$54.75 - $72.25/hr

Big Data Engineer Location : Malvern, PA Hybrid Duration : Initial 12 months + options to extend - Long term contract role Responsibilities * Collaborate on the Smartstream cash reconciliation ...

Cymertek Corporation

Big Data Engineer

Aurora, CO · On-site

$56.50 - $74.75/hr

They are seeking a skilled and motivated Big Data Engineer to design, develop, and maintain data pipelines, optimize data storage solutions, and support business intelligence and analytics needs.

HireTalent

Big Data Engineer

Fairport, NY · On-site

$53 - $70/hr

Position You've earned a bachelor's degree in Computer Science, Information Systems, Statistics, or other technical field 5+ years of experience in big data engineering, building real time data ...

HireTalent

Big Data Engineer

Fairport, NY · On-site

$53 - $70/hr

Position You've earned a bachelor's degree in Computer Science, Information Systems, Statistics, or other technical field 5+ years of experience in big data engineering, building real time data ...

Lorven Technologies

Big Data Engineer

Costa Mesa, CA · On-site

$59.75 - $79/hr

Big Data Engineer Costa Mesa , CA or PHX or Bay Area Contract Job Responsibilities 10+ years of experience in analysis, coding, implementation and testing of Big Data Applications (API & Batch) on ...

HireTalent

Big Data Engineer

Fairport, NY · On-site

$53 - $70/hr

Position You've earned a bachelor's degree in Computer Science, Information Systems, Statistics, or other technical field 5+ years of experience in big data engineering, building real time data ...

Global Sumi Technologies Inc

Big Data Engineer

Rockville, MD · On-site

$56.75 - $75.25/hr

Summary We are seeking a highly skilled and experienced Big Data Engineer to design, develop, and optimize large-scale data processing systems. In this role, you will work closely with cross ...

Avani Technology Solutions, Inc.

Big Data Engineer

Renton, WA · On-site

$63 - $83.25/hr

Big Data Engineer Location: Renton, Washington Duration: 6 Months Top Three Skills: * 5-years in SQL, SQL Server, Oracle, JDBC * 5-years in Hadoop, HDFS, MapReduce, YARN * 5-years in Sqoop, Oozie ...

HireTalent

Big Data Engineer

Fairport, NY · On-site

$53 - $70/hr

Position You've earned a bachelor's degree in Computer Science, Information Systems, Statistics, or other technical field 5+ years of experience in big data engineering, building real time data ...

InterSources

Big Data Engineer Consultant

Fremont, CA · On-site

$66 - $87.50/hr

Big Data Engineer Consultant Location : Dallas, TX, Seattle, WA Type of Hire : CWR : * Big Data Engineers serve as the backbone of the Strategic Analytics organization, ensuring both the reliability ...

Tech Digital Group

Big Data Engineer

Santa Clara, CA · On-site

$65.50 - $86.50/hr

As a Principal Big Data Engineer, you will be an integral member of our data ingestion and processing platform team responsible for architecture, design and development. Having the dynamic ability to ...

Jobsbridge

Big Data Engineer

Los Angeles, CA

$60 - $79.50/hr

Company Description Intelliswift Software, Inc As a Big Data Engineer, you will be an integral member of our threat intelligence service, i.e. auto focus, team responsible for architecture, design ...

LiniumIT

Big Data Engineer

Chicago, IL · On-site

$57.50 - $76/hr

Our client, a premier investment bank, is looking for a Big Data Engineer to join their growing team in Chicago, IL. Currently our client spends a lot of time trying to answer client's questions by ...

previous page

Showing results 41-60

All JobsSpec JobsSpec Big Data Engineer Jobs

SPECS Jobs Information

What other companies are hiring for Big Data Engineer jobs?
What are the most popular jobs at Spec?
What are the most popular categories at Spec?
Infographic showing various Big Data Engineer job openings at Spec in the United States as of August 2026, with employment types broken down into 100% Full Time. Highlights an 100% Physical job distribution.

Big Data Engineer

SGA Inc

Rockville, MD

$56.75 - $75.25/hr

Contractor

Re-posted 20 days ago

Job description

Software Guidance & Assistance, Inc., (SGA), is searching for a Big Data Engineer for a CONTRACT assignment with one of our premier Regulatory clients in either location - Washington, DC or Rockville, MD or Jersey City, NJ or New York, NY or Tysons VA. 
We are seeking a highly skilled and experienced Big Data Engineer to design, develop, and optimize large-scale data processing systems. In this role, you will work closely with cross-functional teams to architect data pipelines, implement data integration solutions, and ensure the performance, scalability, and reliability of big data platforms. The ideal candidate will have deep expertise in distributed systems, cloud platforms, and modern big data technologies such as Hadoop, Spark etc.
Responsibilities :
  • Design, develop, and maintain large-scale data processing pipelines using Big Data technologies (e.g., Hadoop, Spark, Python, Scala).
  • Implement data ingestion, storage, transformation, and analysis of solutions that are scalable, efficient, and reliable.
  • Stay current with industry trends and emerging Big Data technologies to continuously improve the data architecture
  • Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
  • Optimize and enhance existing data pipelines for performance, scalability, and reliability.
  • Develop automated testing frameworks and implement continuous testing for data quality assurance.
  • Conduct unit, integration, and system testing to ensure the robustness and accuracy of data pipelines.
  • Work with data scientists and analysts to support data-driven decision-making across the organization.
  • Ability to write and maintain automated unit, integration, and end-to-end tests
  • Monitor and troubleshoot data pipelines in production environments to identify and resolve issues.
Required Skills :
  • Bachelor's degree in Computer Science, Information Systems or related discipline with at least five (5) years of related experience, or equivalent training and/or work experience; Master's degree and past Financial Services industry experience preferred.
  • Demonstrated technical expertise in Object Oriented and database technologies/concepts which resulted in deployment of enterprise quality solutions.
  • Past experience with developing enterprise quality solutions in an iterative or Agile environment.
  • Extensive knowledge of industry leading software engineering approaches including Test Automation, Build Automation and Configuration Management frameworks.
  • Strong written and verbal technical communication skills.
  • Demonstrated ability to develop effective working relationships that improved the quality of work products.
  • Should be well organized, thorough, and able to handle competing priorities.
  • Ability to maintain focus and develop proficiency in new skills rapidly.
  • Ability to work in a fast paced environment.
  • Experience with object oriented programming languages such as Java, Scala or Python.
  • Essential Technical Skills:
    • AI Tool Proficiency: Hands-on experience with AI development tools (GitHub Copilot, Q Developer, ChatGPT, Claude, etc.)
    • Technical Background: Strong software development background with ability to contribute to technical discussions
    • Agile Methodology: Extensive experience with Scrum, Kanban, and continuous improvement practices
  • Big Data technologies
    • Experience with Big data technologies such as Hadoop, Spark, Hive & Trino
    • Evaluate understanding of common issues like:
      • Data skew and strategies to mitigate it.
      • Working with massive data volumes in PetaBytes.
      • Troubleshooting job failures due to resource limitations, bad data, scalability challenged.
    • Look for real-world debugging and mitigation stories.
  • AI Skills
    • Prompt Engineering: Proficiency in crafting effective prompts for AI coding assistants and analysis tools
    • AI Workflow Design: Experience redesigning development processes to leverage AI capabilities
    • Data Analysis: Ability to interpret AI-generated insights and translate them into actionable team improvements
    • Change Management: Experience leading teams through AI adoption and workflow transformation
  • SQL Skills (Window Functions, Joins, Complex Queries)
    • Assess comfort with SQL window functions, multi-table joins, aggregations.
    • Provide examples or ask them to write/optimize SQL queries on the spot.
    • Probe how they handle edge cases like NULLs, duplicates, ordering, etc.
  • Apache Spark (Development, Internals & Tuning)
    • Test their understanding of Spark's core architecture — executors, tasks, stages, DAG.
    • Focus on Spark performance tuning techniques: partitioning, caching, broadcast joins, etc.
    • Ask scenario-based questions on troubleshooting slow running/stuck jobs or resource issues in Spark.
    • Explore their experience optimizing Spark jobs for large-scale datasets.
  • Cloud Technologies
    • Check exposure to AWS services like S3, EMR, Glue, Lambda, Athena, etc.
    • Ask how they've used S3 with Spark (e.g., dealing with file formats, consistency issues).
  • Programming - Python or Scala
    • Assess ability to write clean, modular, and performant code.
    • Look for experience in functional programming concepts (e.g., immutability, higher-order functions).
    • Ask about real-world use cases where they wrote scalable data processing code.
    • Evaluate understanding of collections, concurrency, and memory management.
Preferred Skills :
  • Experience with managing production data pipelines/ETL systems
  • Experience with CI/CD
  • Experience writing test cases
  • AWS certifications
SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let's work better together, we mean it. You'll join a diverse team built on these core values: customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at https://sgainc.com/ .
SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company EEO page to request an accommodation or assistance regarding our policy.

Apply