About SPECTRAFORCE
Sourced by ZipRecruiter
Industry
Recruiting and staffing services
Company size
1,001 - 5,000 Employees
Headquarters location
Raleigh, NC, US
Year founded
2004
Other
This job posting has expired and is no longer accepting applications. Check out similar jobs
Job description
Position Title: Backend Data Engineer
Job Type: 6-Month Contract (Potential extension)
Location: Richmond, Virginia (Required) 23238
Position Overview: Seeking a skilled Backend Data Engineer to join our Technical Data Management (TDM) team in Richmond. This role is crucial for an ERP modernization project involving the migration of legacy systems to Workday and managing sensitive data movement. You will focus on building, automating, and securing data pipelines, maintaining infrastructure (specifically EMR clusters), and contributing to a patent-pending data management framework built in Scala. This position sits at the intersection of data engineering, software engineering, and production support.
Responsibilities:
- Build & Maintain Data Pipelines: Develop and maintain secure, scalable data pipelines using Python and AWS Lambda for orchestration, and a proprietary Scala-based framework for core data processing.
- Automation: Focus heavily on automating all aspects of data movement and self-service data management tools.
- Security & Auditing: Implement stringent data obfuscation techniques according to cyber guidelines. Perform constant updates to ensure security as every keystroke and data movement is audited.
- Infrastructure Management: Monitor and maintain the backend infrastructure, including AWS EMR clusters, managing vulnerabilities, and ensuring continuous operations.
- Collaboration: Work closely with a sister team managing the self-service UI and other stakeholders in a highly collaborative environment.
- Support: Provide production support, including debugging issues in file transfers and pipeline execution.
Qualifications:Top-Notch / Mandatory Skills:
- Scala (Programming Language): Strong programming experience required.
- Python (Programming Language): Essential for writing AWS Lambda functions and pipeline orchestration.
- Spark (Framework): Real-world experience building data frameworks.
- AWS (Cloud Platform): Deep knowledge is crucial, including KMS (Key Management Service), IAM (Identity & Access Management) roles, and S3 bucket policy updates.
- Shell Scripting: Required for day-to-day debugging and automation.
Required Experience & Attributes:
- Large Enterprise Background: Experience working in large-scale enterprise environments.
- Ramp-up Ability: Demonstrated ability to quickly learn new contexts, systems, and teams, with a proven history of ramping up in as little as 1-2 weeks.
- Communication & Collaboration: Strong communication skills and a preference for in-person collaboration to solve complex problems and niche skill-related challenges.
spectraforce.com
Other Helpful Pages Related To Backend Data Engineer
Senior Data Engineer Salaries
Frequently asked questions
Q: What skills or qualities help someone succeed as a Back End Engineer?
A: To succeed as a Back End Engineer, key technical skills include proficiency in programming languages such as Java, Python, or C++, as well as expertise in frameworks like Spring, Django, or Node.js. Additionally, strong knowledge of databases, data structures, and algorithms is essential. Soft skills like effective communication, problem-solving, and collaboration are also crucial, as Back End Engineers often work with cross-functional teams to design, develop, and deploy scalable and efficient systems.\n\nThese technical and soft skills enable Back End Engineers to design, develop, and maintain robust and scalable systems, collaborate effectively with teams, and communicate complex technical ideas to stakeholders, ultimately supporting career growth and effectiveness in the role.
Q: What is the career path for a Back End Engineer?
A: A Back End Engineer's typical career progression involves starting as a Junior Back End Developer, where they focus on building and maintaining server-side logic, APIs, and database integration. As they gain experience, they can move into mid-level roles such as a Back End Engineer or a Technical Lead, where they oversee the development of complex systems, mentor junior engineers, and contribute to technical decision-making. Senior Back End Engineers or Technical Architects can then take on leadership positions, overseeing large-scale projects, architecting systems, and driving technical strategy, with opportunities to transition into roles like Engineering Manager or Product Manager.