Sr. Kafka Engineer
TEKsystems San Diego, CA
- Expired: over a month ago. Applications are no longer accepted.
Permanent - Sr. Kafka Engineer - San Diego, California – Remote to Start – Relocation Package
The Integrations Senior Kafka Developer will drive the design, implementation, and adoptions of the real-time stream data platform that will be a key enabler for this client’s cloud-based business-application architecture. This client has seen significant growth over the past several years, and with that, the Integrations platform is evolving from a departmental batch oriented ETL solution to a global enterprise platform to adapt to the global expansion of the business. This role will report into the Integrations IT senior manager.
•Help define the strategy and roadmap of the NextGen “Stream Data Platform” based on Apache Kafka, while assisting with establishing best practices based on identified use cases and integration patterns
•Accelerate our adoption of the Kafka ecosystem by creating a framework for leveraging technologies such as Kafka Connect, KStreams/KSQL, Schema Registry, and other streaming-oriented technology
• Contribute to our evolving DevOps practice for hosting and managing our SDP microservice and connector infrastructure in the GCP cloud
Functional Description: Technical Individual Contributor
Designs a complete and complex framework, system or product. Defines processes for technical platforms, system specifications, input/output and working parameters for hardware and/or software compatibility. Conceives system interfaces and business application prototypes. Identifies, analyzes and resolves system design weaknesses. Influences the shaping of future products by contributing to the framework (architecture) used across multiple products or systems. Provides multi-layered technical expertise for next-generation initiatives.
Possesses advanced knowledge of technical principles and theories. Recommends solutions in support of functional objectives tied to overall company objectives and strategies.
Demonstrates significant technical expertise, collaboration with others and independent thought. Anticipates potential complex problems requiring an in-depth evaluation. Demonstrates strategic thinking and commercial/industry understanding in functional projects.
•Exercises judgment in selecting methods, techniques and evaluation criteria for obtaining results.
•Determines methods and procedures on new assignments and may coordinate activities of other colleagues.
Top Skills Details:
• MUST have strong Kafka experience - Strong fundamentals in distributed systems design and operations. Possesses an established track record with Kafka technology with hands-on production experience and a good understanding of the Kafka architecture, fault-tolerance and scalability.
•MUST Hands-on experience as a developer who has used the Kafka API to build producer & consumer applications
• MUST Practical experience with Kafka Connect, KStreams, and KSQL, with ability to know how to use effectively for different use cases, including how to scale and make fault-tolerant
•Must have strong experience with JAVA
· It is important that someone also understands overall connectivity
· Open to remote for the right candidates. Preference is relocation to San Diego, CA.
· Will pay for relocation of non-local candidates
· Will sponsor H1B Candidates, NEED TO KNOW when visa is expiring- will only consider if have at least 4 months left on Visa
Drug Test Required
100% Remote Work
External Communities Job Description
Hiring for a fulltime, Sr. Kafka Engineer with 10+ years of experience. Must have in-depth knowledge of Kafka architecture, fault-tolerance and scalability. Must be hands-on with Kafka Connect, KStreams and KSQL- in addition to understanding design and ability to think 'big picture
This client is a rapidly growing organization within the medical device industry. They build products that help to improve and save the lives of their customers who are living with diabetes. They empower people to take control of diabetes. They focus on enabling better outcomes for patients, caregivers and clinicians by delivering solutions that are best in class—defined as being dependable, simple and essential to taking control of diabetes. They have had strong growth the past several years, with their stock growing 5X (2018 around $56, now up to $260). This team is a collaborative, innovative team looking to advance their technical stack.
This position is within the Systems & Cloud Integration team- they are responsible for the connectivity of the business applications. About 15-20 people combined with onsite and offshore
Additional Skills & Qualifications
•Strong familiarity of wire formats such as XML, JSON, Avro, CSV, etc.
•Solid programming proficiency with Java, and best practices in development. Passion for writing high quality, rock-solid software, including test automation (unit/integration)
•Fundamental understanding of the TCP/IP protocol stack. In addition, knowledge of security protocols such as TLS and OAUTH2, and how they work and integrate into Kafka and Connectors
•Thinks architecturally in terms of the bigger picture and has strong design instincts
•Experience with the Linux OS, process mgmt., network monitoring, I/O monitoring, and memory mgmt.
•Has worked with Agile methodologies such as Scrum and has the ability to write well-structured user stories and participate in agile ceremonies using Jira as the agile tool
•Bachelor’s degree in a technical discipline and a minimum if 13+ years of related experience, or a Master’s degree and 8+ years of equivalent industry experience, or a Ph.D. and 5+ years of experience.
Preferred Qualifications: (Optional)
•Hands-on experience in designing, writing and operationalizing new Kafka Connectors using the Kafka Connect framework
•Familiarity with Dell Boomi is a plus
•Knowledge of DevOps technology and practical experience with related tools such as Docker, Kubernetes, Jenkins, and Terraform is a plus
•Exposure to one or more of these following business applications is desirable - Oracle EBS and Fusion, Oracle Service Cloud, Salesforce
•Familiarity with Oracle DB and NoSQL stores a benefit: HBase, Cassandra, MongoDB
Impact to the Internal/External Customer
More scalability and resiliency with the systems.
Phone with the manager, followed by WebEx with the team
Moving away from batch processing towards real-time data streaming with Kafka framework.