ZipRecruiter

Log In

1

Freelance Streaming Data Engineer Jobs in Washington

M9 Solutions

Data Engineer

Springfield, VA · On-site

$60K - $180K/yr

M9 Solutions is seeking a Data Engineer to work onsite in support of a government contract for a ... Streaming Data Processing: Work with Apache Kafka (or similar platforms) to handle high-volume, low ...

M9 Solutions

Data Engineer

Springfield, VA · On-site

$60K - $180K/yr

M9 Solutions is seeking a Data Engineer to work onsite in support of a government contract for a ... Streaming Data Processing: Work with Apache Kafka (or similar platforms) to handle high-volume, low ...

540.co LLC

Data Engineer with Security Clearance

Arlington, VA · On-site

$131K - $158K/yr

Build and operate batch and streaming data pipelines supporting mission requirements * Develop and ... Collaborate with engineers, analysts, and data scientists to deliver reusable data products and ...

Booz Allen Hamilton

Data Engineer

Washington, DC · On-site

$77K - $176K/yr

Data Engineer The Opportunity: Ever-expanding technology such as IoT, machine learning, and ... Experience working with real-time or streaming data systems * Experience with NoSQL tools such as ...

Booz Allen Hamilton

Data Engineer

Washington, DC · On-site

$86K - $198K/yr

Data Engineer The Opportunity: Ever-expanding technology such as IoT, machine learning, and ... Experience working with real-time or streaming data systems * Experience with data warehousing ...

GRVTY

Data Engineer

Chantilly, VA · On-site

$150K - $250K/yr

The Data Engineer will work with and analyze our client's challenges and provide solutions by designing and implementing batch and streaming data pipelines. What You Must Have * Active TS/SCI with ...

Analytica

Senior Data Engineer

Washington, DC · On-site

$119K - $162K/yr

Data Engineering & Platform Development ... Design, develop, and maintain scalable batch and streaming data pipelines using Databricks and/or ...

Analytica

Senior Data Engineer

Washington, DC · On-site

$120K - $163K/yr

Data Engineering & Platform Development ... Design, develop, and maintain scalable batch and streaming data pipelines using Databricks and/or ...

GRVTY

Data Engineer

Chantilly, VA · On-site

$150K - $250K/yr

The Data Engineer will work with and analyze our client's challenges and provide solutions by designing and implementing batch and streaming data pipelines. What You Must Have * Active TS/SCI with ...

previous page

Showing results 41-60

All JobsStreaming Data Engineer JobsFreelance Streaming Data Engineer JobsFreelance Streaming Data Engineer Jobs in Washington

Freelance Streaming Data Engineer information

What is the difference between Freelance Streaming Data Engineer vs Data Engineer?

AspectFreelance Streaming Data EngineerData Engineer
CredentialsRelevant certifications (e.g., cloud, data streaming)Similar certifications, often more formal education
Work EnvironmentIndependent, project-based, remoteFull-time, in-house or remote
Industry UsageFreelance platforms, consultingOrganizations, tech companies
Search & Comparison IntentProject-based, flexible workLong-term employment, team roles

Freelance Streaming Data Engineers typically work independently on short-term projects, focusing on streaming data pipelines using tools like Kafka or Spark. Data Engineers often hold full-time roles within organizations, managing broader data infrastructure. Both roles require similar skills and certifications, but differ mainly in employment type and work setting.

Freelance Streaming Data Engineer jobs near you

Senior Consultant, Data Engineer (Python/PySpark/AWS)

Infinitive Inc

Ashburn, VA • On-site

$117K - $140K/yr

Full-time

Re-posted 12 days ago

Job description

*Candidates must be local to the Washington D.C. metro area.
About Infinitive:
Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people and personalities to our clients' culture while bringing the right mix of talent and skills to enable high return on investment.
Infinitive has been named "Best Small Firms to Work For" by Consulting Magazine 6 times most recently in 2023. Infinitive has also been named a Washington Post "Top Workplace", Washington Business Journal "Best Places to Work", and Virginia Business "Best Places to Work."
We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our clients data infrastructure. Your expertise in Python, PySpark, ETL processes, CI/CD (Jenkins or GitHub), and experience with both streaming and batch workflows will be essential in ensuring the efficient flow and processing of data to support our clients.
Responsibilities:
Data Architecture and Design:
  • Collaborate with cross-functional teams to understand data requirements and design robust data architecture solutions.
  • Develop data models and schema designs to optimize data storage and retrieval.

ETL Development:
  • Implement ETL processes to extract, transform, and load data from various sources.
  • Ensure data quality, integrity, and consistency throughout the ETL pipeline.

Python and PySpark Development:
  • Utilize your expertise in Python and PySpark to develop efficient data processing and analysis scripts.
  • Optimize code for performance and scalability, keeping up-to-date with the latest industry best practices.

Data Integration:
  • Integrate data from different systems and sources to provide a unified view for analytical purposes.
  • Collaborate with data scientists and analysts to implement solutions that meet their data integration needs.

Streaming and Batch Workflows:
  • Design and implement streaming workflows using PySpark Streaming or other relevant technologies.
  • Develop batch processing workflows for large-scale data processing and analysis.

CI/CD Implementation:
  • Implement and maintain continuous integration and continuous deployment (CI/CD) pipelines using Jenkins or GitHub Actions.
  • Automate testing, code deployment, and monitoring processes to ensure the reliability of data pipelines.

Qualifications:
  • Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
  • Proven experience as a Data Engineer or similar role.
  • Strong programming skills in Python and expertise in PySpark for both batch and streaming data processing.
  • Hands-on experience with ETL tools and processes.
  • Familiarity with CI/CD tools such as Jenkins or GitHub Actions.
  • Solid understanding of data modeling, database design, and data warehousing concepts.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.

Preferred Skills:
  • Knowledge of cloud platforms such as AWS, Azure, or Google Cloud.
  • Experience with version control systems (e.g., Git).
  • Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).
  • Understanding of data security and privacy best practices.

Infinitive is required by law in some jurisdictions to include a reasonable estimate of the compensation range for this role. The determination of this range includes various factors not limited to skill set, level, experience, relevant training, and licensure and certifications. Compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range for this role in the U.S. is $90,000.00 - $154,00.00.
Infinitive is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, protected veteran status, or any other characteristic protected by applicable federal, state, or local law.

Apply