ZipRecruiter

Log In

2

Remote Linux Engineer Jobs in Cary, NC (NOW HIRING)

Berriehill Research

Senior AI Systems Engineer

Raleigh, NC · On-site +1

$92K - $126K/yr

Proficiency with DevOps and MLOps practices, including CI/CD pipelines, Git-based workflows ... This position may be performed fully remote, hybrid, or onsite at an ARA office. Preference will be ...

Grantek

Systems Engineer

Raleigh, NC · On-site +1

Experience in DeviceNet, ControlNet, DH+, Remote IO, Modbus, etc is preferred but not necessary ... Computer Engineering, Mechatronics, Computer Science, Electrical Engineering, or related ...

IT Labs

Lead DevOps Engineer

Raleigh, NC · Remote

$54 - $74/hr

... s Engineer to support one of the most innovative companies in the digital health space. Our client ... Remote * Contract or B2B arrangement Our values We are a company that seeks the best for both our ...

WalkMe

DevOps Engineer

Raleigh, NC · Remote

$54 - $74/hr

... Engineer to join our amazing Cloud Engineering team. We are developing WalkMe's revolutionary ... We offer a hybrid work schedule to perfectly combine the benefits of remote work and the essential ...

LexisNexis

Principle AWS Cloud Engineer

Raleigh, NC · On-site +1

$54.25 - $72.50/hr

We are open to hiring on a remote basis in the United States, with the understanding that the ... You will partner with engineering, security, architecture, and product teams to implement ...

FHR

MO2-613-Senior Azure Cloud Engineer 11694-1

Raleigh, NC · Remote

$57 - $76.25/hr

100% Remote. Our direct client has an opening for a Senior Azure Cloud Engineer 11694-1 This position is up to 12 months, with the option of extension, in Columbia, SC Please send rates and a resume.

Redhat

Senior Technical Writer

Raleigh, NC · On-site +1

$94K - $151K/yr

Work closely with content strategists, documentation program managers, engineering teams, support ... For positions with Remote-US locations, the actual salary range for the position may differ based ...

Progress

Principal DevOps Engineer

Raleigh, NC · On-site +1

$163K - $185K/yr

... Engineer and help us do what we do best: propelling business forward. This role will be a hybrid so working between your home office and either our Raleigh NC or Burlington MA office. You must be ...

Rezilient Health

Senior IT Specialist

Raleigh, NC · On-site +1

Manage remote monitoring and observability tools for CloudClinic IT infrastructure across all US ... Collaborate with Product, Engineering, Operations, and Clinical teams to ensure IT infrastructure ...

next page

Showing results 1-20

All JobsRemote Linux Engineer JobsRemote Linux Engineer Jobs in Cary, NC

Remote Linux Engineer information

See Cary, NC salary details

$10

$55

$85

How much do remote linux engineer jobs pay per hour?

As of Jun 26, 2026, the average hourly pay for remote linux engineer in Cary, NC is $55.34, according to ZipRecruiter salary data. Most workers in this role earn between $44.52 and $62.12 per hour, depending on experience, location, and employer.

What is a Remote Linux Engineer job?

A Remote Linux Engineer is an IT professional responsible for designing, implementing, and maintaining Linux-based systems and servers while working remotely. They handle system administration tasks, troubleshoot issues, optimize performance, and ensure security and stability. This role often involves working with cloud platforms, automation tools, and scripting languages to manage infrastructure efficiently. Remote Linux Engineers collaborate with teams using communication tools and may support DevOps, networking, or cybersecurity functions based on business needs.

What are the key skills and qualifications needed to thrive in the Remote Linux Engineer position, and why are they important?

To thrive as a Remote Linux Engineer, you need a solid understanding of Linux systems administration, networking, scripting languages (such as Bash or Python), and troubleshooting, often backed by a degree in computer science or related certifications like RHCE or CompTIA Linux+. Familiarity with tools like Docker, Ansible, Kubernetes, and virtualization platforms is typically required. Excellent problem-solving abilities, self-motivation, and strong written communication are essential soft skills for remote collaboration and effective support. These skills and qualities are vital to ensuring reliable system performance, efficient remote operations, and seamless teamwork across distributed environments.

What are common challenges faced by Remote Linux Engineers and how are they typically addressed?

Remote Linux Engineers often encounter challenges such as troubleshooting complex system issues without on-site access, maintaining secure remote connections, and staying aligned with distributed team members. These challenges are typically addressed through advanced remote monitoring tools, comprehensive documentation, and regular virtual meetings for knowledge sharing and collaboration. Effective time management and continuous learning are also crucial for staying updated on emerging technologies and best practices. Organizations often provide clear escalation paths and encourage peer support to help engineers resolve critical incidents quickly. Being proactive and adaptable helps ensure both productivity and strong system reliability in a remote environment.

What are popular job titles related to Remote Linux Engineer jobs in Cary, NC? For Remote Linux Engineer jobs in Cary, NC, the most frequently searched job titles are:
What job categories do people searching Remote Linux Engineer jobs in Cary, NC look for? The top searched job categories for Remote Linux Engineer jobs in Cary, NC are:
What cities near Cary, NC are hiring for Remote Linux Engineer jobs? Cities near Cary, NC with the most Remote Linux Engineer job openings:
Remote Linux Engineer jobs near you

Senior AI Systems Engineer

Berriehill Research

Raleigh, NC • On-site, Remote

$92K - $126K/yr

Full-time

Posted 23 days ago

Job description

Essential Functions:

  • Lead the deployment, integration, and operational support of AI platforms, tools, and services, ensuring compatibility with existing systems and enterprise processes.
  • Design, implement, monitor, and optimize AI infrastructure, working with server, cloud, and platform engineering teams.
  • Operationalize machine learning workflows and support AI-enabled applications from development through production deployment and sustainment.
  • Build and maintain CI/CD and MLOps pipelines for model packaging, testing, deployment, rollback, and lifecycle management.
  • Implement infrastructure automation using scripting, Infrastructure as Code, and configuration management practices.
  • Provide ongoing technical support, troubleshooting, root cause analysis, and documentation for AI platforms and user-facing AI services.
  • Maintain observability across AI systems through logging, metrics, performance monitoring, alerting, and incident response practices.
  • Ensure security, compliance, and governance requirements are met, including participation in audits, vulnerability management, and secure architecture reviews.
  • Assess and implement system enhancements to improve performance, scalability, reliability, and cost efficiency.
  • Collaborate across divisions to support diverse AI initiatives and align technical implementations with mission and business objectives.
  • Evaluate emerging AI tools, frameworks, and infrastructure approaches for operational fit, supportability, and long-term value.
  • Develop and maintain technical documentation, runbooks, architecture diagrams, and operational procedures.

Experience and Skills Required:

  • Bachelor’s degree in computer science, Engineering, Information Technology, or a related STEM field with 8-10 years of engineering experience. 
  • 2+ years of experience supporting AI/ML platforms, MLOps workflows, model deployment, or AI-enabled infrastructure.
  • Strong coding and automation skills in Python, Bash, or similar scripting languages.
  • Experience with AI/ML frameworks and tooling such as PyTorch, Hugging Face, or similar ecosystems.
  • Proficiency with DevOps and MLOps practices, including CI/CD pipelines, Git-based workflows, containerization, and Kubernetes.
  • Experience deploying AI/ML models or AI services into operational environments, including containerized, cloud, or high-performance computing environments.
  • Familiarity with security frameworks and compliance standards such as NIST and CMMC.
  • Familiarity with AI security functionality in enterprise environments including OAuth
  • Strong communication skills and the ability to collaborate effectively across technical and non-technical teams.

Preferred:

  • Advanced degree or certifications related to AI or machine learning.
  • Experience integrating AI models into scientific workflows.
  • Familiarity with large language model (LLM) APIs and orchestration frameworks such as OpenAI, Hugging Face, LangGraph, or LangChain.
  • Experience with model serving, inference optimization, or AI platform tools such as MLflow, Kubeflow, vLLM, or similar.
  • Experience with simulations for scientific or engineering projects, particularly physical systems simulations.
  • Experience with GPU-based systems or running AI models in HPC environments.
  • Experience writing and deploying MCP Servers on Kubernetes
  • DoD experience
  • Secret Security Clearance – Active or Inactive

Education:

  • Bachelor’s degree in CS, Software Engineering or other IT-related field or equivalent experience

REMOTE WORK NOTICE: This position may be performed fully remote, hybrid, or onsite at an ARA office. Preference will be given to candidates located onsite in the Albuquerque, NM and Raleigh, NC area.

Apply