Senior Data Engineer

Change the Game
LiveAction is changing the game on how people use and visualize their network. Gone are the days of static charts and tables. We have built a suite of tools to not only visualize your network but give awareness and control like no other. We solve many challenging problems including big analytics, working with millions of data points while ensuring our tools are meaningful to the customer.

LiveAction continues to receive rave reviews from our customers, and we aim to increase its use all over the world. As we look to the future, we plan to analyze billions of data points over a distributed network and control and visualize thousands of devices while providing awesome user experience.

Take Action
If you have a passion for technology, are driven, creative, and like to have fun, come join LiveAction on growing the next generation of award-winning networking tools. Our staff enjoys great benefits and a healthy, high-quality work environment that encourages innovation.

Position Description
LiveAction is seeking a highly motivated Senior Data Engineer to work with our engineering, data science and threat research teams. This person will function as a member of a team of software developers responsible for the ThreatEye NDR portfolio. This SaaS solution is based on containerized software packages for network detection and response (NDR) using streaming machine learning.

Candidates should have experience developing software solutions as part of a team for a network security company serving large enterprise and government customers and are ideally eligible for a US security clearance.

Job Responsibilities

• Contribute to the data architecture for the SaaS backend of the ThreatEye service
• Help select the best datastores through prototyping and performance testing
• Design schemas and optimize queries for DBs based on application access patterns
• Design, implement and maintain data ingest pipelines in AWS using Kafka or Kinesis
• Work with serverless technologies like AWS Athena to query large datasets to derive new insights and baselines
• Work to ensure that effective monitoring for the datastores and pipelines is in place
• Troubleshoot issues and performance bottlenecks in data pipelines
• Collaborate with LiveAction data scientists, software engineers, and threat researchers to develop state-of-the-art data-driven network security detections using the data

Essential Skills

Must have:

• 3+ years development experience with Python, Bash, and/or other scripting language
• 3+ years with SQL
• 2+ years using AWS data technologies like Athena, AWS Glue, RDS and AWS OpenSearch
• 2+ years working with NoSQL technologies like Redis, Apache Driill etc.
• Deep understanding of NoSQL and relational databases and database fundamentals, including data storage, data modeling, and data access patterns
• Knowledge of Git and CI/CD
• Experience working with containerized applications using Docker
• Self-motivated and able to work effectively within a team
• Exceptional communication skills (oral and written)

Nice to have:

• Data modeling experience
• Experience with ORM tools
• Experience composing data pipelines in AWS
• Database tuning experience

Education:
BS/MS in Computer Science, Engineering, or equivalent