Layer Eight Jobs (NOW HIRING)

Job Summary:
Bricklayer AI is the first multi-agent LLM-based AI solution that brings autonomous AI specialists and human experts into a single collaborative and effective security team. They are seeking a Quality & Release Engineering Leader to establish and scale the systems and processes that ensure the quality and reliability of their platform releases. This role involves hands-on leadership in quality engineering, test automation, and release management while mentoring engineers and collaborating with various teams.
Responsibilities:
• Define and execute Bricklayer’s quality engineering strategy, standards, and roadmap
• Establish quality objectives, release criteria, and engineering best practices
• Create a culture where quality is owned throughout the software development lifecycle
• Develop and track quality metrics that drive continuous improvement
• Design and implement automated testing frameworks across application, API, integration, infrastructure, and agent workflow layers
• Establish automated regression testing and continuous validation processes
• Build test coverage strategies that balance speed, confidence, and engineering efficiency
• Drive automation-first quality practices across engineering teams
• Continuously improve test coverage and reduce manual testing requirements
• Own release readiness processes and production deployment validation
• Establish release quality gates within CI/CD pipelines
• Develop release management procedures that improve deployment confidence and reliability
• Coordinate release planning and cross-functional validation activities
• Ensure production releases meet established quality and stability requirements
• Develop testing methodologies for autonomous AI agents, multi-agent workflows, and AI-assisted decision-making
• Create frameworks to evaluate accuracy, consistency, repeatability, and reliability of agent outputs
• Validate model upgrades, prompt changes, workflow modifications, and orchestration logic
• Partner with AI Engineering to ensure AI-powered capabilities remain predictable, explainable, and trustworthy
• Develop performance, scalability, resiliency, and load-testing programs
• Validate platform behavior under production-scale workloads
• Partner with Platform Engineering to identify reliability risks before deployment
• Establish testing procedures for high-availability and fault-tolerant systems
• Define and monitor quality KPIs including:
• Defect escape rate
• Automated test coverage
• Release stability
• Mean time to detect issues
• Mean time to resolution
• Customer-impacting incidents
• Lead root cause analysis and quality reviews following significant production issues
• Drive continuous improvement initiatives across engineering teams
• Partner with Security and Platform Engineering teams to validate security controls
• Support SOC 2 Type II and future compliance initiatives
• Ensure testing and validation processes support enterprise customer expectations
• Participate in customer security reviews and quality-related discussions when appropriate
• Build and scale the Quality & Release Engineering organization
• Mentor engineers and establish quality engineering best practices
• Recruit and develop high-performing quality engineers
• Foster collaboration across Application Engineering, AI Engineering, Platform Engineering, Product Management, and Customer Experience teams
Qualifications:
Required:
• 8+ years of software quality engineering, release engineering, test automation, or related experience
• 3+ years of technical leadership experience
• Strong hands-on experience designing and implementing automated testing frameworks
• Experience building quality engineering processes in SaaS environments
• Strong understanding of modern software development lifecycles, Agile methodologies, and DevOps practices
• Experience integrating quality controls and automated testing into CI/CD pipelines
• Strong API testing, integration testing, and distributed systems testing experience
• Experience with performance, load, scalability, and reliability testing
• Strong understanding of release management and deployment validation processes
• Experience working closely with software engineering teams in fast-paced startup environments
• Excellent communication and leadership skills
Preferred:
• Experience testing AI, machine learning, LLM, or agent-based platforms
• Experience validating autonomous workflows and AI-driven decision systems
• Experience with Playwright, Cypress, Selenium, Postman, k6, JMeter, Locust, or similar testing platforms
• Experience with AWS and cloud-native SaaS architectures
• Experience in cybersecurity products or security operations platforms
• Familiarity with SOC 2 and enterprise compliance requirements
• Experience building quality engineering organizations from the ground up
• Degree in Computer Science, Engineering, or related field
Company:
Bricklayer AI was created to help security operations teams keep pace with AI-driven threats and an ever-expanding attack surface by introducing a coordinated, agent-based approach to the SOC. Founded in 2023, the company is headquartered in Arlington, USA, with a team of 11-50 employees. The company is currently Early Stage.