Hello Folks,
Hope you are doing good!
Please find the below requirement and let me know your interest?
Title: Python Developer with AWS & Pyspark (It's backfill Role)Location: New Jersey Mode of work: HybridVisa: GC, GC EAD, USC, H4 EAD onlyLooking for Local candidates only with 10+years of experience and final round interview will be In-person interviewJob Summary:We are seeking an experienced
PythonDeveloperwith strong expertise in
AWSandPySparkto join our data engineering team. The ideal candidate will have hands-on experience developing scalable data pipelines, processing large data sets, and integrating with cloud-based environments. This role requires excellent problem-solving skills and a strong understanding of distributed data processing frameworks.
Key Responsibilities:- Design, develop, and maintaindata pipelinesandETL workflowsusingPython,PySpark, andAWS services.
- Build and optimize large-scaledata processinganddata transformationsolutions.
- Integrate various data sources and ensure data quality, performance, and reliability.
- Collaborate with data engineers, analysts, and architects to deliver end-to-end data solutions.
- Implement best practices forcode optimization,error handling, anddata validation.
- Participate in code reviews, documentation, and deployment automation.
- Ensure adherence to data security and compliance standards.
Required Skills & Qualifications:- Bachelor's degree in Computer Science, Data Engineering, or a related field.
- 10+ years of experiencein software development with a strong focus onPython.
- Hands-on experience withPySparkfor distributed data processing.
- Solid understanding ofAWS cloud servicessuch asS3, Glue, Lambda, EMR, Redshift, and Athena.
- Strong experience inETL developmentanddata pipeline orchestration.
- Familiarity withSQLand relational/non-relational databases.
- Excellent analytical, debugging, and communication skills.
Preferred Skills:- Experience withAirflow,Databricks, or other workflow management tools.
- Knowledge ofCI/CD pipelinesand version control tools likeGit.
- Exposure todata lakeordata warehousearchitectures.
- Familiarity withDockerorKubernetesfor deployment.
Thanks & Regards
JagdishManager - IT StaffingEmail ID: jagdish@polarits.com |
Phone: +1 443 489 4433
6095 Marshalee Dr, Suite 250, Elkridge, MD 21075
www.polarits.com
Consulting | Technology | Development
Offices: Maryland | Georgia | India
Note: If you have received this message in error, please notify us immediately by reply e-mail so that we may correct our internal records. Please then delete the original message (including any attachments) in its entirety. Thank you