1

Polars Data Jobs in Virginia (NOW HIRING)

Senior Data Engineer ID75059

Richmond, VA ยท On-site

$103K - $141K/yr

... Polars , PySpark or DuckDB ; - 2+ years of experience with Big Data technologies ( Spark , Snowflake ); - Expert-level knowledge of pipeline orchestration using Airflow or similar industry-standard ...

Python Developer

Mclean, VA ยท On-site

$51.50 - $71/hr

... data transformation using PySpark, Dask, Polars, etc. โ€ข Strong understanding of data modeling, data warehousing, and data integration concepts. โ€ข Experience with version control systems (e.g ...

Python Developer

West Mclean, VA ยท On-site

$65 - $70/hr

Familiarity with Python-based machine learning libraries such as scikit-learn, TensorFlow, or PyTorch. * 2+ years of experience with data transformation using PySpark, Dask, Polars, etc. * Strong ...

Showing results 21-40

Polars Data information

What is the difference between Polars Data vs Data Analyst?

AspectPolars DataData Analyst
Required SkillsData manipulation, programming in Python/R, familiarity with data processing librariesData interpretation, reporting, visualization skills, basic programming
Work EnvironmentData processing, scripting, working with large datasetsBusiness analysis, presenting insights, collaborating with teams
Industry UsageData engineering, data science, analytics projectsBusiness intelligence, reporting, decision support

Polars Data focuses on efficient data processing and manipulation using programming tools, often in data engineering or data science contexts. Data Analysts primarily interpret data, create reports, and support business decisions. While both roles work with data, Polars Data is more technical and programming-oriented, whereas Data Analysts focus on analysis and communication of insights.

What are common challenges faced by professionals working with Polars Data, and how can they be addressed?

Professionals working with Polars Data often encounter challenges such as adapting to its unique API, optimizing data processing workflows for performance, and integrating Polars with other data tools. Since Polars is relatively new compared to libraries like pandas, there may be limited community support or documentation for complex use cases. To overcome these challenges, it's helpful to actively engage with the Polars community, regularly review official documentation, and experiment with different optimization strategies. Collaborating with team members familiar with similar data processing frameworks can also accelerate the learning curve.

What are the key skills and qualifications needed to thrive as a Polars Data engineer, and why are they important?

To thrive as a Polars Data Engineer, you need strong skills in data engineering, Python programming, and a solid understanding of the Polars library for efficient data processing. Familiarity with data pipeline tools, cloud platforms, and proficiency in using Polars for large-scale, high-performance data manipulation is typical, alongside knowledge of version control systems like Git. Analytical thinking, problem-solving, and effective communication are crucial soft skills for collaborating with teams and translating data needs into actionable solutions. These skills ensure you can design robust, scalable data workflows and deliver timely insights for data-driven decision-making.

What is a Polars Data professional?

Polars Data professionals are specialists who work with Polars, a fast DataFrame library designed for data manipulation and analysis, particularly in Python and Rust. They use Polars to efficiently process large datasets, perform data cleaning, transformation, and analysis tasks. These professionals often have backgrounds in data science, analytics, or software engineering, and choose Polars for its speed and scalability compared to traditional libraries like pandas. Their work is valuable in fields that require rapid data processing, such as finance, research, and technology.
What cities in Virginia are hiring for Polars Data jobs? Cities in Virginia with the most Polars Data job openings:

Staff Data Engineer (TS/SCI with Full Scope Polygraph) {S}

The Stratagem Group

Herndon, VA โ€ข On-site, Remote

$117K - $141K/yr

Full-time

Medical, Dental, Vision, Life, Retirement, PTO

Re-posted 15 days ago


Job description

ARKA Group L.P. ("ARKA") is an advanced technologies company serving the U.S. military, intelligence community, and commercial space industry delivering next-generation solutions to support the national security space enterprise. Built on more than six decades of excellence, ARKA brings modern approaches and a culture of innovation to the challenges of today.
Join the ARKA team to learn how Beyond Begins Here. Discover your next career opportunity now!
Position Overview:
We are looking for a Staff Data Engineer/Scientist looking for new challenging problems. You will support the development of AI/ML algorithms in a multitude of disciplines from large language models, natural language processing, and time-series predictive analytics. Additionally, we have a team of excellent researchers and software developers who are eager to mentor and teach their craft. We have multiple positions available and welcome all experience levels!
We offer generous relocation benefits for eligible candidates.
In support of work/life balance, many positions are available for a flexible schedule within the pay period. Ask us about the opportunity for flex scheduling if that's of interest to you.
Responsibilities:
Lead and mentor an interdisciplinary team consisting of both developers and researchers. The team's core focus is the implementation of ETL pipelines to support a variety of AI/ML and LLM solutions, which in turn address a broad range of customer challenges.
  • Assembles large, complex sets of data to support AI/ML algorithm implementation
  • Builds required infrastructure for optimal extraction, transformation and loading of data from various data sources
  • Curate and maintain data that is stored in support of metrics and evaluation
  • Implement Artificial Intelligence/Machine Learning algorithms
  • Identifies, designs, and implements internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes
  • Using Agile methodologies to develop software.

Required Qualifications:
  • B.S. in data science, AI/ML, computer science, or related field
  • Minimum six (6) years of relevant experience as a Data Engineer/Scientist.
  • Experience developing data pipelines and normalizing data with canonical Python packages (e.g. NumPy, Pandas, Polars)
  • Experience contributing on a team using version control (e.g. git, GitLab, Bitbucket)
  • Active TS/SCI U.S. Government Security Clearance with a recent Full-Scope Polygraph (FSP)

Preferred Qualifications:
  • M.S. or PhD in data science, AI/ML, computer science, or related field
  • Experience with Gitlab, DevSecOps utilizing test-driven development, containers, (e.g. Docker, Docker Compose), cloud services (e.g. AWS), tools for distributed computing (e.g. Spark, Pyspark)
  • Experience leading an interdisciplinary team of researchers and software developers
  • Experience with any of the following:
    • Large Language Models and experience identifying ways to incorporate them into new domains and applications
    • Applying Transformer-based architectures to domains in other areas outside of Natural Language Processing (NLP) such as computer vision
    • Natural Language Processing algorithms such as BERT
    • Reinforcement learning and familiarity with Gymnasium Gym, OpenEnv, TorchRL, RLlib, and Stable Baselines
    • Applying clustering algorithms and/or deep neural networks to real life problems
    • Implementing tracking and pattern-of-life algorithms
  • Experience with GenAI Ops techniques (e.g. LLM-as-a-judge) and frameworks (e.g. LangFuse, MLFlow, Arize Phoenix)
  • Experience with Machine Learning libraries and frameworks such as HuggingFace and LangChain
  • Experience with Linux
  • Familiarity with using AWS cloud computing resources such as EC2, S3, Lambda, Bedrock, etc.
  • Experience with any of the following additional languages: Java, C++, Rust, Go, and/or C#
  • Experience implementing algorithms on the GPU in Python or C++ using CUDA and other CUDA libraries
  • Experience in application deployment, virtualization, and containerization (e.g. Podman, Docker, Kubernetes, Rancher)
  • Experience shaping and writing proposals

Location: Herndon, VA
Herndon offers a charming blend of small-town ambiance and modern conveniences. In historic Herndon you'll find small town charm while maintaining all the amenities of big city life. The area has beloved farms to explore, historic sites, festivals, local parks, breweries, and some of the best restaurants in the area. Its proximity to Dulles International Airport and the Herndon Metrorail Station provides easy travel to over 400 shops and restaurants in the malls of Tysons or stay on the train and see the monuments and memorials of Washington, DC. Overall, Herndon provides a perfect mix of small-town charm, and big-city amenities complimented with many family local attractions, events, music, restaurants and a great lifestyle!
What We Offer:
  • Comprehensive medical/vision/dental insurance packages
  • Company contributions to qualified HSA accounts
  • 401k retirement plan with industry leading company contributions
  • 3 weeks of vacation accrual per year plus time off for sick leave and unscheduled life events
  • 13 paid holidays
  • Upfront tuition assistance for approved degree programs
  • Annual bonus program based on company and employee performance
  • Company paid life insurance, AD&D, Short-Term and Long-Term disability insurance
  • 4 weeks paid Parental Leave
  • Employee assistance program (EAP)

EHS/Environmental Requirements:
This job operates in a professional office environment. While performing the duties of this job, the employee routinely is required to use hands to keyboard, communicate, listen to, and interpret instructions and remain stationary for extended periods of the time. This would require the ability to move around the campus and occasionally move/lift items weighing up to 25 lbs. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions of the job.
Applicants are invited to apply for a reasonable accommodation to perform the essential duties of the job. To apply, send a request to staffing@arka.org or contact 203-797-5000 and press 2 for Human Resources.
ITC & Security Clearance Requirements:
This position requires an active TS/SCI U.S. Government Security Clearance with a recent Full-Scope Polygraph (FSP).
Visa Restrictions:
No visa sponsorship is available for this position.
Pre-employment Screenings:
Employment with any ARKA companies in the U.S. is contingent upon satisfactory completion of several pre-employment requirements to include a credit check, background check, and drug screen.
Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities
This employer is required to notify all applicants of their rights pursuant to federal employment laws. For further information, please review the Know Your Rights notice from the Department of Labor.