Kafka Software Engineer Jobs in Springfield, IL (NOW HIRING)

Company :

enGen

Job Description :

JOB SUMMARY

We are seeking a hands-on Principal Data Architect to serve as a leader in our ongoing data and digital transformation, leveraging a modern open data ecosystem build on foundational iceberg lakehouse patterns for both humans and AI to thrive. This role will own defining and delivering our enterprise strategy and architectural approach towards data movement [including integration and interoperability], Enrichment, and Orchestration. This scope will span the full enterprise of a complex hybrid ecosystem: We are not a skunkworks team just trying out new technology and you will make our implementations with dbt, airflow, kafka, and iceberg real for a $30B+ company impacting millions of lives across the country.

Not only will this person be a leader of our rapid modernization but will insistently keep a business and customer first mentality. The right leader understands the efficiencies and innovations needed to transform will also couple with deprecating a number of existing operational/legacy platforms. We require a natural thought leader and strategic advisor, shaping and driving the evolution of complex architectures across multiple domains, necessitating tradeoffs on time, cost, and complexity, but never trading off the positive experiences and impacts to our members.

Success in this role requires experience driving adoption of best practices and emerging technologies (ie lakehouse, iceberg, ELT vs ETL, and open source trends and tradeoffs), driving innovation and continuous improvement across the organization (teaching and mentoring is a passion for this person), and understanding the evolution of the space and patterns to make decisions that set the company and teams up for success short, mid, and long-term (ie you know what's ready for exploration vs what's ready for enterprise scale).

ESSENTIAL RESPONSIBILITIES

• Lead the development and articulation of complex architecture vision and strategy, ensuring alignment with business goals and strategic initiatives. Champion the adoption of best practices and emerging technologies, driving innovation and continuous improvement across the organization.

• Collaborate with senior stakeholders across the organization, influencing decision-making and ensuring alignment on complex architectural solutions.

• Lead the evaluation and selection of new technologies and solutions, ensuring they meet the organization's evolving needs and strategic direction. Develop and maintain comprehensive architectural documentation, ensuring clarity and consistency across all stakeholders.

• Proactively identify and mitigate potential risks and challenges, ensuring the successful implementation and ongoing operation of complex architectures. Serve as a subject matter expert and advocate for architectural best practices, contributing to the development of organizational standards and policies.

• Provide expert guidance and mentorship, fostering a culture of collaboration and knowledge sharing.

• Other duties as assigned or requested.

EXPERIENCE

Required

• 10 years of experience in Architecture, design, and implementation of complex systems and solutions.

Preferred

• 5+ years of enterprise data architecture experience driving transformation through data platform modernization

• 5+ years of architecture frameworks andmethodologies: This person will have a strong opinion of if medallion architecture is a framework,methodology, or a marketing term(You might getbonus points with examples of all three being an "ok" answer andmaygive a good use case argument where each may be the "best" answer)

• 7+ years of experience with data movement platforms as an engineer, architect, or technical product manager/owner

• Strong experience and knowledge ofthebelowrelevant platforms to this role:(Most critical being Airflow, Kafka, Flink,Iceberg Lakehouseand DBT)

• Heavy Emphasis for Modernization:Google Cloud Platform (GCP), Airflow (includingCloudComposer), Beam (includingDataFlow), DBT,Kafka(Confluent),Flink(Confluent), Spark (includingDataProcand Databricks), Iceberg Format,Monte Carlo, Dynatrace,Atlan, Starburst,VertexAI, GitLab, GPT,and more

SKILLS

• Architecture frameworks and methodologies

• Software Development

• Knowledge of emerging technologies

• Strategic thinking and influencing

• Critical thinking and decision making

• While not required to possess expertise in all of the following technologies/areas, Principal Architects must demonstrate proficiency in those relevant to the applications they support: IMS, DB2, Oracle, Teradata, Data Warehousing, COBAL, Visual Basic, C, C++, SAS, Java/JavaScript Framework, PEGA, CSS3, Mobile, JSON, Cognos, Hadoop, SQL, J2EE, HTML5/XML, Waterfall, Agile.

EDUCATION

Required

• Bachelor's degree in Computer Science, Information Technology or closely related discipline

Preferred

• Master's degree in Computer Science, Information Technology or closely related discipline

LICENSES or CERTIFICATIONS

Required

• None

Preferred

• None

Language (Other than English):

None

Travel Requirement:

0% - 25%

PHYSICAL, MENTAL DEMANDS and WORKING CONDITIONS

Position Type

Office- or Remote-based

Teaches / trains others

Occasionally

Travel from the office to various work sites or from site-to-site

Rarely

Works primarily out-of-the office selling products/services (sales employees)

Never

Physical work site required

No

Lifting: up to 10 pounds

Constantly

Lifting: 10 to 25 pounds

Occasionally

Lifting: 25 to 50 pounds

Rarely

Disclaimer: The job description has been designed to indicate the general nature and essential duties and responsibilities of work performed by employees within this job title. It may not contain a comprehensive inventory of all duties, responsibilities, and qualifications required of employees to do this job.

Compliance Requirement : This job adheres to the ethical and legal standards and behavioral expectations as set forth in the code of business conduct and company policies.

As a component of job responsibilities, employees may have access to covered information, cardholder data, or other confidential customer information that must be protected at all times. In connection with this, all employees must comply with both the Health Insurance Portability Accountability Act of 1996 (HIPAA) as described in the Notice of Privacy Practices and Privacy Policies and Procedures as well as all data security guidelines established within the Company's Handbook of Privacy Policies and Practices and Information Security Policy.

Furthermore, it is every employee's responsibility to comply with the company's Code of Business Conduct. This includes but is not limited to adherence to applicable federal and state laws, rules, and regulations as well as company policies and training requirements.

Pay Range Minimum:

$142,000.00

Pay Range Maximum:

$236,000.00

Base pay is determined by a variety of factors including a candidate's qualifications, experience, and expected contributions, as well as internal peer equity, market, and business considerations. The displayed salary range does not reflect any geographic differential Highmark may apply for certain locations based upon comparative markets.

Highmark Health and its affiliates prohibit discrimination against qualified individuals based on their status as protected veterans or individuals with disabilities and prohibit discrimination against all individuals based on any category protected by applicable federal, state, or local law.

We endeavor to make this site accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact the email below.

For accommodation requests, please contact HR Services Online at HRServices@highmarkhealth.org

California Consumer Privacy Act Employees, Contractors, and Applicants Notice

Req ID: J273699