Senior Python Data Analysis Jobs in Sycamore, OH

Job Summary:
Marathon Petroleum Corporation is committed to fostering a collaborative team environment and is seeking a Senior Data Engineer. In this role, you will design, develop, and optimize scalable data pipelines and cloud-based data solutions, while collaborating with various teams to translate requirements into effective data solutions.
Responsibilities:
• Conducts the design, innovation and optimization of data extraction, ingestion and transformation processes.
• Facilitates the development and design of complex data architecture to process and store high-volume data sets.
• Enables the development of complex data pipelines; advocates for and implements data security and privacy measures.
• Conducts complex data quality and processing tasks using open source and cloud services.
• Provide technical expertise during critical incidents.
• Facilitates the adoption of best practices for data security and privacy and collaborates with other departments to ensure seamless data integration.
• Facilitates the implementation of continuous improvements in data processing methods and drives consistency and best practices across data engineering projects.
• Solves complex problems; takes a new perspective on existing solutions; participates in strategic planning sessions for data infrastructure.
• Oversee quality assurance and testing for data solutions.
• Mentors less experienced data engineers.
Qualifications:
Required:
• Bachelor’s Degree in Information Technology, related field or equivalent experience
• 5+ years of relevant data engineering experience
• Strong proficiency in Python, SQL, Spark, and orchestration tools such as Azure Data Factory and/or Databricks Workflows
• Familiarity with big data technologies and frameworks, such as Hadoop, Spark, and distributed computing, for processing and analyzing large volumes of data
• Knowledge of cloud-based data platforms, such as AWS, Azure, or GCP, and their associated services for data storage, processing, and analytics
• Ability to establish and oversee a set of procedures, policies, and standards that ensure the effective and efficient management of an organization's data assets
• Proficiency in integrating data from various sources, including structured and unstructured data, using technologies such as ETL (Extract, Transform, Load) processes, data pipelines, and data ingestion frameworks
• Skill in designing and implementing data models that align with business requirements, ensuring data integrity, performance, and scalability
• Data operations refer to the various actions and processes involved in managing, manipulating, and analyzing data throughout its lifecycle
• Data pipelines are a set of processes that enable the flow of data from one or multiple sources to a destination
• Ability to understand and implement practices that ensure the protection and confidential handling of personal and sensitive information
• Strong understanding of data quality dimensions, methodologies, and best practices to establish and maintain data quality standards and processes
• Knowledge of data privacy regulations, cybersecurity best practices, and techniques for protecting sensitive information and ensuring compliance
• Knowledge of monitoring and observability tools and practices for tracking data pipeline performance, data quality, and system health
• A set of practices that combines software development and information-technology operations which aims to shorten the systems development life cycle and provide continuous delivery with high software quality and a security first approach
• Applies a computer language to communicate with computers using a set of instructions and to automate the execution of tasks
• Proficiency in metadata management solutions to enable efficient data discovery, data lineage tracing, and data asset management
• NoSQL databases are a type of database management system that provides a flexible and scalable approach to storing and retrieving data
• Real-time processing refers to the method of handling data or performing computations immediately as they occur, without any noticeable delay
Company:
Marathon Petroleum Corporation (MPC) is a leading, integrated, downstream and midstream energy company headquartered in Findlay, Ohio. Founded in 2005, the company is headquartered in Findlay, USA, with a team of 10001+ employees. The company is currently Late Stage.