Senior Software Engineer-Large Scale Data Management
ITR
Oak Ridge, TN
- Full-Time
Job Description
Senior Software Engineer, Large-Scale Data Management
Overview:
East Tennessee company is seeking a senior software engineer focused on large-scale data management and storage. Position can be remote and candidates need to be able to obtain a federal security clearance.
Company operates several simulation and experimental facilities that produce large volumes of data. There is the immediate need to manage these petabytes of data efficiently and provide user-facing tools for organizing, cataloging, curating, publishing, and searching the data assets. We are seeking an expert software developer/engineer who excels in developing scalable data management software systems, and at solving interdisciplinary problems. Successful candidate(s) will possess the necessary technical skills to take on existing and new challenges, particularly in large-scale data management and storage.
Major Duties and Responsibilities:
- Architect and develop scalable data management systems to manage petabytes of data.
- Lead a team of research and technical professionals to develop new capabilities that execute on ORNL’s leading data and compute infrastructures.
- Principle Investigator / project manager for OLCF/ORNL public data portal, Constellation.
- Develop storage microservices.
- Develop software for the scalable cataloging of billions of datasets.
- Develop software for capturing and extracting metadata from scientific datasets.
- Develop software for creating scalable indexes of the captured metadata to facilitate efficient searches.
- Develop software for the scalable upload and download of datasets.
- Evaluate hardware and software that might be deployed in the future.
Basic Qualifications:
- Bachelor’s degree in Computer Science, Computer Engineering, or related field and 8+ years of relevant experience.
- 5+ years of experience leading data management development.
- Experience in writing production code in programming languages such as C++ or Python.
- Experience with container technologies such as Docker, Kubernetes and OpenShift.
- Experience with web platforms (e.g., Drupal/WordPress).
- Experience with REST APIs, HTTP.
- Experience with large-scale storage solutions.
Preferred Qualifications:
- 10+ years of experience leading data management development.
- Knowledge of large, open-data repositories.
- Experience with Globus integration
- Experience with CD/CI practices, test methodologies.
- Knowledge of distributed file systems used for large-scale cluster computing (Lustre, GPFS, etc.)
- Familiarity with open-source development tools and large-scale collaborations.
- Knowledge of Agile development methodologies and tools.
- Knowledge of metadata, graph databases, etc.
- Architectural knowledge of scalable distributed system architectures.
- Passion for data management and data technologies.
- Excellent written and oral communication skills.
- Ability to think critically.
- Strong problem-solving skills.
- Highly skilled in people management/development, strong communication skills, and an impeccable attention to detail.
- Team oriented, collaborative.
Address
ITR
Oak Ridge, TN
USA
Industry
Technology
Posted date
Over a month ago
View All ITR Jobs
How can the hiring manager reach you?
By clicking the button above, I agree to the ZipRecruiter Terms of Use and acknowledge I have read the Privacy Policy, and agree to receive email job alerts.
You Already Have an Account
We're sending an email you can use to verify and access your account.
If you know your password, you can go to the sign in page.