... sound judgment--helping evaluate emerging technologies, assess new tools and platforms, and ... annotation, metadata, naming conventions, and delivery formats. Technology Leadership & Innovation
Quick apply
... sound judgment--helping evaluate emerging technologies, assess new tools and platforms, and ... annotation, metadata, naming conventions, and delivery formats. Technology Leadership & Innovation
... sound judgment-helping evaluate emerging technologies, assess new tools and platforms, and ... annotation, metadata, naming conventions, and delivery formats. Technology Leadership & Innovation
... sound judgment-helping evaluate emerging technologies, assess new tools and platforms, and ... annotation, metadata, naming conventions, and delivery formats. Technology Leadership & Innovation
... sound judgment-helping evaluate emerging technologies, assess new tools and platforms, and ... annotation, metadata, naming conventions, and delivery formats. Technology Leadership & Innovation
... sound judgment-helping evaluate emerging technologies, assess new tools and platforms, and ... annotation, metadata, naming conventions, and delivery formats. Technology Leadership & Innovation
... sound judgment-helping evaluate emerging technologies, assess new tools and platforms, and ... annotation, metadata, naming conventions, and delivery formats. Technology Leadership & Innovation
... sound judgment-helping evaluate emerging technologies, assess new tools and platforms, and ... annotation, metadata, naming conventions, and delivery formats. Technology Leadership & Innovation
Annotation Judge information
What is an annotation judge?
An Annotation Judge is a professional who evaluates the quality and accuracy of labeled data, such as text, images, or audio, which has been annotated for use in machine learning and artificial intelligence projects. Their main responsibility is to review, verify, and ensure that the data annotations meet specific guidelines and standards. Annotation Judges play a critical role in improving the reliability of training datasets, which directly impacts the performance of AI systems. They often work closely with data annotators, quality assurance teams, and project managers to maintain high data quality.
What are the key skills and qualifications needed to thrive as an annotation judge, and why are they important?
To thrive as an Annotation Judge, you need strong analytical skills, attention to detail, and subject matter expertise relevant to the data being evaluated, usually supported by a degree in a related field. Familiarity with annotation platforms, data labeling tools, and quality assurance systems is typically required. Excellent communication, impartiality, and critical thinking help you provide clear feedback and maintain high annotation standards. These skills are crucial to ensure data accuracy and consistency, which directly impact the performance of machine learning models.
What are some common challenges faced by annotation judges, and how can they effectively overcome them?
Annotation Judges often face challenges such as maintaining impartiality, handling ambiguous or subjective data, and ensuring high consistency across large volumes of work. To overcome these, it’s essential to follow established guidelines closely, communicate regularly with team members for clarification, and participate in calibration sessions. Staying detail-oriented and seeking feedback can also help maintain accuracy and fairness in their assessments.
What is the difference between Annotation Judge vs Data Annotator?
| Aspect | Annotation Judge | Data Annotator |
|---|---|---|
| Credentials | Typically requires basic education, sometimes certification in data labeling | Usually requires similar or less formal education, often on-the-job training |
| Work Environment | Office or remote, working with data labeling platforms | Office or remote, performing data labeling tasks |
| Industry Usage | Used across AI, machine learning, and data science projects | Common in AI, machine learning, and data preparation workflows |
| Search & Comparison Intent | Often compared for roles involving data review and quality control | Compared for entry-level data labeling roles |
The main difference between an Annotation Judge and a Data Annotator lies in their roles. Annotation Judges typically review and validate annotations made by Data Annotators, ensuring quality and accuracy. Data Annotators perform the initial labeling of data. Both roles are essential in AI data pipelines, with Annotation Judges focusing on quality control and Data Annotators on data preparation.
What job categories do people searching Annotation Judge jobs in Lexington, KY look for?
The top searched job categories for Annotation Judge jobs in Lexington, KY are:
Senior Geomatics Technologist
Lexington, KY • Remote
Ayoroa Simmons LLC
Full-time
Medical, Dental, Vision, Life, Retirement, PTO
Posted 28 days ago
Job description
About Ayoroa | Simmons
Ayoroa | Simmons, LLC is a specialized professional services firm focused on 3D laser scanning, scan-to-BIM, and BIM coordination for complex facilities and infrastructure. We partner with Government and private-sector clients to create accurate digital representations of the built environment that support better planning, operations, and decision-making.
We are seeking a Senior Geomatics Technician to lead the data processing side of our growing Reality Capture Department.
Position Overview
We are seeking an experienced and forward-thinking Senior Geomatics Technician to join our Reality Capture group and serve as a technical leader across point cloud processing, survey integration, and spatial data production workflows. In this role, you will pair strong technical execution with curiosity, initiative, and sound judgment—helping evaluate emerging technologies, assess new tools and platforms, and recommend improvements that strengthen how we deliver services for clients and project teams. The right candidate will also bring market awareness and industry insight, helping identify opportunities to expand our Reality Capture capabilities into new project types, applications, and client sectors that support the group’s long-term growth.
Key Responsibilities
Point Cloud Processing & Data Production
- Post-process raw scan data from Mobile, Terrestrial, and Aerial LiDAR acquisitions including registration, classification, filtering, and 3D feature extraction.
- Import, register, and quality-control scan projects in Leica Register360 and Cyclone; process mobile and aerial datasets in TopoDOT, TerraSolid/TerraModeler, and Global Mapper.
- Process aerial photogrammetry and drone-captured imagery using Pix4D and Agisoft Metashape to produce orthomosaics, dense point clouds, and DSMs/DTMs.
- Explore and pilot emerging capture and visualization formats including Gaussian Splat models for immersive existing-condition deliverables targeted at design teams.
Survey Integration & CAD Deliverables
- Perform field-to-finish processing of conventional survey data in AutoCAD Civil 3D, including point import, surface generation, contour production, and plan preparation.
- Review and QC OPUS reports and control point observations to ensure geodetic accuracy across survey, CAD, LiDAR, and GIS deliverables.
- Learn and assist in Leica Infinity control processing.
- Produce and review base map drawings, contour maps, as-built Civil 3D deliverables, and GIS-ready datasets that integrate LiDAR-derived data with conventional survey control.
- Prepare, manage, and export spatial data for use in GIS platforms, including shapefiles, geodatabases, feature layers, raster surfaces, and other geospatial deliverable formats.
- Support GIS workflows related to coordinate systems, projections, metadata, data attribution, spatial analysis, and integration with CAD/BIM deliverables.
- Maintain consistent CAD and GIS standards across projects, including layer structure, symbology, annotation, metadata, naming conventions, and delivery formats.
Technology Leadership & Innovation
- Continuously monitor developments in geomatics hardware, software, and data workflows — including LiDAR sensors, photogrammetry platforms, point cloud processing tools, and spatial data formats.
- Evaluate new tools and methods and provide informed recommendations on adoption, workflow integration, and ROI.
- Help establish and document internal best practices, processing standards, and QA/QC procedures.
- Lead internal training and knowledge sharing on new platforms and workflows as they are adopted.
- Evaluate and implement AI-enabled tools and workflows for point cloud classification, feature extraction, object recognition, model generation, QA/QC, visualization, and data management.
- Develop, test, and maintain scripts or lightweight applications that automate repetitive production tasks, improve file handling, standardize outputs, and reduce manual processing time.
- Use scripting, coding, APIs, and automation platforms to connect reality capture, CAD, GIS, BIM, and project management workflows where appropriate.
- Explore and pilot emerging tools such as machine-learning-assisted point cloud segmentation, AI-based photogrammetry enhancement, automated clash or deviation detection, and immersive visualization formats.
Business Development & Market Intelligence
- Identify new project types, service lines, and client markets that align with team capabilities — including transportation corridor mapping, AEC as-built documentation, infrastructure inspection, heritage documentation, and site planning support.
- Contribute to proposals, capability statements, and project pricing by providing technical scope input and production estimates.
- Represent the firm at industry events, conferences, and professional organizations relevant to geomatics and remote sensing.
Success Profile
In your first year, success will look like:
- Establishing yourself as one of the technical authority for LiDAR processing, photogrammetry, and Civil 3D survey deliverables within the team.
- Completing at least one pilot project utilizing a new technology or workflow (e.g., Gaussian Splat visualization, updated mobile LiDAR pipeline) and presenting findings internally.
- Identifying a minimum of two to three new project or client market opportunities with a concrete approach to pursue them.
- Mentoring junior technicians and contributing to documented QA/QC and processing standards.
- Delivering projects on time and within scope with consistent, client-ready output quality.
Qualifications
Required:
- 5+ years of experience in geomatics, remote sensing, LiDAR processing, or a closely related technical field.
- Proficiency in AutoCAD Civil 3D including field-to-finish survey data processing, surface generation, and plan production.
- Hands-on experience with Leica Register360, TopoDOT, Global Mapper, and TerraSolid/TerraModeler.
- Working knowledge of aerial photogrammetry workflows using Pix4D and/or Agisoft Metashape.
- Ability to read and interpret OPUS reports and perform QC on geodetic control point observations.
- Experience reviewing and producing base maps, contour maps, and survey-integrated CAD deliverables.
- Strong understanding of LiDAR data formats, coordinate reference systems, and geospatial data quality standards.
- Excellent communication skills and ability to work both independently and within a collaborative team environment.
Preferred:
- Experience with Part 107 sUAS operations and aerial data acquisition.
- Background in architecture, civil engineering, or a related built environment discipline.
- Familiarity with Microstation or other DOT-preferred CAD environments.
Why Join Us
At Ayoroa | Simmons, we invest in people and technology to deliver exceptional results in geomatics, remote sensing, and spatial data production. You will not be siloed into a single task, you will have direct influence over how our team grows, what tools we adopt, and which clients and markets we pursue. We offer:
- 401(k) with 4% company match
- Comprehensive health, dental, vision, and life insurance
- Paid Time Off (PTO)
- Employee referral program
Work Environment & Conditions of Employment
- This position requires U.S. citizenship.
- Primarily office work environment.
- This position may include fieldwork, travel to client sites, and overnight stays depending on project location. Travel approximately 25%.
- Must meet all client and Ayoroa | Simmons security, conduct, and compliance requirements for applicable project sites, including background checks and training where required.
- Valid driver's license required.
How to Apply
Please submit the following:
- Resume or CV highlighting relevant geomatics, survey, and remote sensing experience.
- Brief cover letter describing your experience with point cloud processing, Civil 3D deliverables, and any technology evaluation or business development activities you have led or contributed to.
EEO
Ayoroa Simmons is an equal opportunity employer, and we value diversity. All employment decisions are based on qualifications, merit, and business needs. We do not discriminate on the basis of race, color, religion, sex, national origin, age, disability, or any other protected status.
Title VI Compliance
Ayoroa Simmons ensures nondiscrimination in all programs and activities in accordance with Title VI of the Civil Rights Act of 1964 regulation. If you need more information or special assistance for persons with disabilities or limited English proficiency, please contact the Title VI Coordinator: Kim Short at (866) 726-2246.
#LI-Remote