ARKA Group L.P. (โARKAโ) is an advanced technologies company serving the U.S. military, intelligence community, and commercial space industry delivering next-generation solutions to support the national security space enterprise. Built on more than six decades of excellence, ARKA brings modern approaches and a culture of innovation to the challenges of today.
Join the ARKA team to learn how Beyond Begins Here. Discover your next career opportunity now!
Position Overview:
Our AI Center of Excellence builds the next generation ofย Agentic AIย products that autonomously reason, plan, and act on behalf of our customers. To deliver these capabilities at scale, we need a platform engineering group that provides a robust, secure, andย highly availableย MLOpsย foundation across bothย on premiseย clusters and AWS. The team works closely with data scientists, product engineers, and SREs to turn experimental models into reliable services that powerย mission criticalย applications.ย
In support of work/life balance, many positions are available for a flexible schedule within the pay period.ย Ask us about the opportunity for flex scheduling if thatโs of interest to you.ย
Why join usย
- Shape theย end-to-endย lifecycle ofย cutting-edgeย AI servicesโfrom model training to production inference.ย
- Influence architecture decisions for a hybrid cloud environment that will serve thousands of concurrent agents.ย
- Collaborate with world-class researchers and product teams while enjoying a strong engineering culture focused on automation, observability, and reliability.ย
Responsibilities:ย
- Design, implement, andย operateย a unifiedย MLOpsย platformย that supports bothย on-premiseย Kubernetes clusters and AWS. The platform should enable rapid onboarding of newย Agentic AIย services and provide consistent governance across environments.ย
- Develop reusable CI/CD pipelinesย (GitLab CI) for model packaging, containerization, automated testing, canary releases, and rollbacks.ย
- Build observability, monitoring, and alerting stacksย (Prometheus, Grafana,ย OpenTelemetry, CloudWatch) to track inference latency, throughput, resourceย utilization, andย data driftย forย real timeย and batch workloads.ย
- Createย self-serviceย toolingย (CLI, SDKs, UI dashboards) that allowsย data scienceย and product teams to register models, define inference endpoints, and manage versioning without deep DevOps involvement.ย
- Architect andย maintainย data pipelinesย that feed training data, model artifacts, and inference logs into a governed data lake (S3,ย on premย object store).ย
- Collaborate with research and product engineersย to translate experimentalย Agentic AIย prototypes intoย production gradeย services, ensuring reproducibility, security, and compliance.ย
- Drive performance optimizationย for inference workloads (GPU/CPU scaling, model quantization, batching strategies)ย
- Champion best practicesย in security (IAM, network policies, secret management),ย cost efficiency, andย disaster recoveryย for the hybrid infrastructure.ย
- Mentor junior engineersย and contribute to internal knowledge bases,ย upskilling, and reviewย processes.ย
Required Qualifications:
- BS in computer science or related engineering field
- 5+years of experienceย building and operating production gradeย softwareย infrastructure, preferably inย a hybrid onpremย / cloud environment
- Deep expertise with Kubernetesย (cluster provisioning, Helm, operators, custom resources) and container runtimes (Docker, OCI)
- Hands on experience with AWS servicesย (EKS, SageMaker, S3, IAM, CloudWatch, Step Functions) and the ability to bridge onprem resources with AWS via VPN/Direct Connect
- Strong software engineering skillsย in Python and at least one compiled language (Go,ย Rust, or Java) for building platform components and SDKs
- Proficiency with CI/CD andย GitOpsย toolingย (Argo CD, Flux,ย Gitlab, GitHub Actions,ย or similar)
- Solidย understanding of distributed systems (consensus, fault tolerance, load balancing) and experience tuning high throughput, low latency inference pipelines
- Experience with data engineering frameworksย (Airflow, Prefect, Kafka, Spark, Flink) and building robust, versioned data pipelines
- Familiarity with observability stacksย (Prometheus, Grafana,ย OpenTelemetry,ย ELK) andย the ability to define meaningful SLIs/SLOs for AI services
- Track record of collaborating with research or product teamsย to move prototypes to production, translating experimental code into maintainable services
- Strongย problem solvingย mindset, excellent written and verbal communication, and a passion for building scalable AI platforms
Preferred Qualifications:
- Working knowledge of Scrum and Agile software development methodology
Location: Remote
This is a remote position that will primarily be supporting our Aurora, CO and King of Prussia, PA locations.ย Due to contract requirements, the job has to be performed from a remote location in the United States.
What We Offer:
- Comprehensive medical/vision/dental insurance packages
- Company contributions to qualified HSA accounts
- 401k retirement plan with industry leading company contributions
- 3 weeks of vacation accrual per year plus time off for sick leave and unscheduled life events
- 13 paid holidays
- Upfront tuition assistance for approved degree programs
- Annual bonus program based on company and employee performance
- Company paid life insurance, AD&D, Short-Term and Long-Term disability insurance
- 4 weeks paid Parental Leave
- Employee assistance program (EAP)
EHS/Environmental Requirements:
This job operates alongside a professional office environment. While performing the duties of this job, the employee routinely is required to use hands to keyboard, communicate, listen to, and interpret instructions and remain stationary for extended periods of the time. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions of the job.
Applicants are invited to apply for a reasonable accommodation to perform the essential duties of the job. To apply, send a request to staffing@arka.org or contact 203-797-5000 and press 2 for Human Resources.
ITC & Security Clearance Requirements:
This position requires the incumbent to access export-controlled information. If you are not a U.S. Person, any offer is contingent upon the Company's ability to obtain a special license granting you access. This could take several months. You will not be able to begin employment until such license is obtained.
Visa Restrictions:
No visa sponsorship is available for this position.
Pre-employment Screenings:
Employment with any ARKA companies in the U.S. is contingent upon satisfactory completion of several pre-employment requirements to include a credit check, background check, and drug screen.