Job DescriptionWe are seeking an experienced Cloud Data Warehouse and AI/ML Engineer to design, build, and maintain large-scale data warehouses, ETL pipelines, and AI/ML models that drive data-driven decision-making. The successful candidate will have a strong background in data warehousing, ETL, and AI/ML, with experience in working with various tools.
Key Responsibilities:
- Design and implement data pipelines to ingest, extract, transform, load (ETL) data and store large data sets from various sources
- Build and maintain data warehouses, including data modeling, data governance, and data quality
- Ensure data quality, integrity, and security by implementing data validation, data cleansing, and data governance policies
- Optimize data systems for performance, scalability, and reliability
- Collaborate with customers to understand their technical requirements and provide guidance on best practices for using Amazon Redshift
- Work with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver data solutions
- Provide technical support for Amazon Redshift, including troubleshooting, performance optimization, and data modeling
- Integrate AI/ML models with ETL pipelines and data warehouses to enable predictive analytics and machine learning
- Develop and deploy AI/ML models using popular frameworks such as TensorFlow, PyTorch, or Scikit-learn
- Work with data scientists to develop and deploy data-driven products and features
- Identify and resolve data-related issues, including data pipeline failures, data quality issues, and performance bottlenecks
- Develop technical documentation and knowledge base articles to help customers and AWS engineers troubleshoot common issues
Required Skills and Education- Bachelor's or Master's degree in Computer Science or a related field, with at least 6 years of experience in Information Technology, or equivalent experience.
- Proficiency in one or more programming languages (e.g., Python, Java, Scala)
- 6+ years of experience in data engineering, with a focus on designing and implementing large-scale data systems
- 5 + years of hands-on experience in writing complex, highly optimized queries across large data sets using AWS Redshift, Oracle and SQL Server.
- 5 + years of hands-on experience using AWS Glue, python/spark to build ETL pipelines in a production setting, including writing test cases
- Strong understanding of database design principles, data modeling, and data governance
- Proficiency in SQL, including query optimization, indexing, and performance tuning
- Experience with data warehousing concepts, including star and snowflake schemas
- Strong analytical and problem-solving skills, with the ability to break down complex problems into manageable components
- Experience with data storage solutions such as relational databases (Oracle, SQL Server), NoSQL databases and cloud-based data warehouses (Redshift)
- Experience with data processing frameworks such as Apache Kafka, Fivetran
- Experience in building ETL pipelines using AWS Glue, Apache Airflow, and programming languages including Python and PySpark
- Understanding of data quality and governance principles and best practices
- Experience with AWS services and best practices
Soft Skills:
- Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams
- Strong problem-solving and analytical skills, with the ability to break down complex problems into manageable components
- Ability to work in a fast-paced environment and adapt to changing priorities
- Strong attention to detail and ability to maintain high-quality documentation
- Commitment to continuous learning and professional development
Preferred Skills and Education- Experience with Dataiku
- Experience with building reports using PowerBI and Tableau
- Familiarity with agile development methodologies and version control systems such as Git
- Certification in data warehousing, ETL, or AI/ML (e.g., Certified Data Warehouse Architect, Certified ETL Developer)
- Experience with agile development methodologies such as Scrum or Kanban
About BAE Systems, Inc.BAE Systems, Inc. is the U.S. subsidiary of BAE Systems plc, an international defense, aerospace and security company which delivers a full range of products and services for air, land and naval forces, as well as advanced electronics, security, information technology solutions and customer support services. Improving the future and protecting lives is an ambitious mission, but it's what we do at BAE Systems. Working here means using your passion and ingenuity where it counts - defending national security with breakthrough technology, superior products, and intelligence solutions. As you develop the latest technology and defend national security, you will continually hone your skills on a team-making a big impact on a global scale. At BAE Systems, you'll find a rewarding career that truly makes a difference.
This position will be posted for at least 5 calendar days. The posting will remain active until the position is filled, or a qualified pool of candidates is identified.
Benefits InformationEmployee Benefits: At BAE Systems, we support our employees in all aspects of their life, including their health and financial well-being. Regular employees scheduled to work 20+ hours per week are offered: health, dental, and vision insurance; health savings accounts; a 401(k) savings plan; disability coverage; and life and accident insurance. We also have an employee assistance program, a legal plan, and other perks including discounts on things like home, auto, and pet insurance. Our leave programs include paid time off, paid holidays, as well as other types of leave, including paid parental, military, bereavement, and any applicable federal and state sick leave. Employees may participate in the company recognition program to receive monetary or non-monetary recognition awards. Other incentives may be available based on position level and/or job specifics.
Intern Benefits: Temporary employees generally are not eligible for BAE Systems benefits, but can elect to participate in the 401(k) savings plan. Temporary employees working 20+ hours per week are eligible for medical benefits, the employee assistance program, and business travel accident insurance.
Please note: Some benefits may be different for union employees that are governed by a collective bargaining agreement (CBA) or for positions covered by a wage law called the McNamara-O'Hara Service Contract Act (SCA).
