Job Summary:
Recorded Future is the world’s most advanced, and largest, intelligence company, seeking a Principal Software Engineer to join their Engineering team. The role involves building and scaling data pipelines for the Security Intelligence Graph, driving architectural improvements, and ensuring platform scalability.
Responsibilities:
• Data Pipeline Ownership: Design, build, and maintain scalable data pipelines that collect, transform, and deliver structured threat intelligence data powering the Security Intelligence Graph.
• Architecture & Scalability: Drive meaningful architectural improvements across data and platform systems to ensure long-term scalability, reliability, and performance.
• Full-Stack Engineering: Work across both application code and infrastructure, contributing to backend services, data systems, and platform capabilities.
• Data Processing & Analysis: Apply statistical techniques to large-scale datasets to generate accurate and impactful insights.
• Reliability & Observability: Ensure production-grade pipeline reliability through strong observability, error handling, and failure recovery practices.
• Infrastructure & Deployment: Build and maintain CI/CD pipelines and contribute to infrastructure-as-code practices to support efficient and repeatable deployments.
• Cross-Team Collaboration: Communicate technical concepts clearly and collaborate effectively across teams, geographies, and varying levels of technical expertise.
• Technical Leadership: Engage with technical leaders across teams and contribute to raising the engineering bar through knowledge sharing and best practices.
Qualifications:
Required:
• At least 5 years of experience in data engineering, backend engineering, or platform engineering.
• Strong proficiency in Python, with experience in Go or Rust considered a plus.
• Experience working with cloud infrastructure, including compute, storage, networking, and IAM fundamentals.
• Hands-on experience with message queues and pub/sub systems such as Kafka or RabbitMQ.
• Experience with SQL databases such as Postgres or AWS RDS, and NoSQL databases such as MongoDB or Elasticsearch.
• Familiarity with data lake storage frameworks such as Delta Lake and graph databases such as AWS Neptune or Neo4j.
• Experience developing REST APIs using frameworks such as Flask, Django, or FastAPI.
• Proven experience architecting and delivering production-grade applications and ETL/ELT pipelines.
• Strong understanding of building reliable data pipelines, including observability, error handling, and failure recovery.
• Experience building and maintaining CI/CD pipelines; GitHub Actions experience is a plus.
• Familiarity with infrastructure-as-code tools; Terraform experience is a plus.
• Comfort working with high-volume, complex, and unstructured data.
• Strong problem-solving skills, including the ability to debug both software and data issues.
• Excellent attention to detail and ability to work independently while delivering high-quality results.
• Interest in or familiarity with security data domains such as threat infrastructure, malware, or network telemetry.
• Bachelor’s and/or Master’s degree in Computer Science, Mathematics, Statistics, Engineering, or equivalent experience.
Preferred:
• Experience or interest in cybersecurity data domains such as malware analysis, phishing detection, or network telemetry.
• Experience working with graph-based data systems or security intelligence platforms.
Company:
Recorded Future provides threat intelligence for proactive cybersecurity and risk management. Founded in 2009, the company is headquartered in Somerville, USA, with a team of 501-1000 employees. The company is currently Late Stage.