Job Summary:
Accenture Federal Services is dedicated to helping the US federal government enhance national security and improve lives through technology. The Senior Data & Software Engineer will work with a team to build complex data flows for custom applications, leveraging advanced programming skills and data governance principles.
Responsibilities:
• Work with stakeholders to understand data requirements, assess feasibility, and design appropriate solutions with minimal oversight.
• Leverage strong problem-solving and debugging skills for data quality issues, pipeline failures, and performance bottlenecks.
• Leverage a background in large-scale data migration or platform modernization efforts.
• Contribute to data engineering documentation, best practices, and design patterns.
Qualifications:
Required:
• Minimum of 5 years' experience with Apache Spark & PySpark
• Using orchestration tools to deploy data pipelines, including configuring and updating Spark Jobs
• Advanced Python skills (including Pandas & NumPy)
• Building end-to-end data pipelines leveraging Python
• Docker, Podman
• AWS S3, Lambda & Step functions
• Apache Iceberg, Airflow, etc.
• SQL (with Trino)
• NoSQL, DynamoDB
• Containerizing and deploying applications in cloud environments like AWS
• Working with MySQL and PostgreSQL including performance tuning, schema design, and query optimization for complex, analytical workloads
• Leveraging industry standard tools for code control (Git, IaaC control, etc.)
• Working with data catalogs, tracking data lineage, and handling a variety of data formats, including Geospatial
• Using Bash scripting for automation and data processing tasks
• Integrating Al/ML services and models
• Active TS/SCI with Poly security clearance is required
Preferred:
• Unity Catalog OSS, Apache Polaris
• Apache Superset
• Terraform or CloudFormation
• OpenLineage
• H3, PostGIS
Company:
Accenture Federal Services is a leading US federal services company and subsidiary of Accenture. Founded in 1989, the company is headquartered in Arlington, USA, with a team of 10001+ employees. The company is currently Late Stage.