ZipRecruiter

Log In

1

Llm Annotation Jobs in Oregon (NOW HIRING)

Smarsh

Lead Data Scientist

OR · On-site +1

... LLM) solutions that power next-generation compliance and surveillance systems. You'll work on ... Data annotation and quality review * Exploratory data analysis and model fail state analysis

All JobsLlm Annotation JobsLlm Annotation Jobs in Oregon

Llm Annotation information

What is LLM annotation?

LLM annotation refers to the process of labeling or tagging data specifically for training and evaluating large language models (LLMs) like GPT or BERT. Annotators read text and apply labels, correct errors, or provide feedback to help improve the model's understanding and performance. This work is crucial for supervised learning, as well-annotated datasets help LLMs better recognize patterns, context, and meaning in human language. LLM annotation can involve tasks such as sentiment analysis, named entity recognition, or instruction following. Annotators often use specialized platforms or tools to complete their tasks efficiently and accurately.

What are the key skills and qualifications needed to thrive as an LLM annotation specialist?

To thrive as an LLM Annotation Specialist, you need strong analytical skills, attention to detail, and a background in linguistics, computer science, or a related field. Familiarity with annotation platforms, natural language processing (NLP) tools, and data labeling systems is typically required. Excellent communication, critical thinking, and the ability to follow guidelines precisely are valuable soft skills for this role. These skills ensure high-quality, accurate data annotation, which directly impacts the performance and reliability of large language models.

What are some common challenges faced by LLM annotation specialists, and how can they be addressed?

LLM Annotation specialists often encounter challenges such as interpreting ambiguous language data, maintaining annotation consistency across complex datasets, and keeping up with evolving guidelines. These can be addressed by participating in regular team syncs to clarify guidelines, using annotation tools with built-in quality checks, and collaborating closely with project leads and fellow annotators. Continuous learning and open communication help ensure high-quality, reliable data annotation and support professional growth within the AI and NLP fields.

What is the difference between Llm Annotation vs Data Labeler?

AspectLlm AnnotationData Labeler
Required CredentialsBasic computer skills, sometimes familiarity with AI toolsBasic skills, often on-the-job training
Work EnvironmentRemote or office-based, tech-focusedRemote or on-site, varied industries
Industry UsageAI, machine learning, NLP projectsVarious industries including marketing, healthcare, and tech
Search & Comparison IntentUnderstanding roles in AI data preparationGeneral data labeling tasks

In summary, Llm Annotation involves specialized annotation for large language models, often requiring familiarity with AI tools, while Data Labeler is a broader role focused on labeling data across multiple industries with minimal technical requirements.

How to become an Llm annotator?

To become an LLM annotator, candidates typically need strong language skills, attention to detail, and familiarity with data annotation tools. Many positions require a high school diploma or equivalent, and some companies provide training. Experience with machine learning or natural language processing can be beneficial but is not always necessary.

What are popular job titles related to Llm Annotation jobs in Oregon?

For Llm Annotation jobs in Oregon, the most frequently searched job titles are:

What job categories do people searching Llm Annotation jobs in Oregon look for?

The top searched job categories for Llm Annotation jobs in Oregon are:

What cities in Oregon are hiring for Llm Annotation jobs?

Cities in Oregon with the most Llm Annotation job openings:

Llm Annotation jobs near you

Lead Data Scientist

Smarsh

OR • On-site, Remote

Full-time

Re-posted 4 days ago

Job description

Who are we?

Smarsh empowers its customers to manage risk and unleash intelligence in their digital communications. Our growing community of over 6500 organizations in regulated industries counts on Smarsh every day to help them spot compliance, legal or reputational risks in 80+ communication channels before those risks become regulatory fines or headlines.  Relentless innovation has fueled our journey to consistent leadership recognition from analysts like Gartner and Forrester, and our sustained, aggressive growth has landed Smarsh in the annual Inc. 5000 list of fastest-growing American companies since 2008.

Summary
 
As a Lead Data Scientist (NLP & Financial Compliance) at Smarsh, you will spearhead the development of state-of-the-art natural language processing (NLP) and large language model (LLM) solutions that power next-generation compliance and surveillance systems. You'll work on highly specialized problems at the intersection of natural language processing, communications intelligence, financial supervision, and regulatory compliance, where unstructured data from emails, chats, voice transcripts, and trade communications hold the keys to uncovering misconduct and risk.
 
The role will involve working with other Senior Data Scientists and mentoring Associate Data Scientists in analyzing complex data, generating insights, and creating solutions as needed across a variety of tools and platforms. This role demands both technical excellence in NLP modeling and a deep understanding of financial domain behavior-including insider trading, market manipulation, off-channel communications, MNPI, bribery, and other supervisory risk areas. The ideal candidate for this position will possess the ability to perform both independent and team-based research and generate insights from large data sets with a hands-on/can do attitude of servicing/managing day to day data requests and analysis.
 
This role also offers a unique opportunity to get exposure to many problems and solutions associated with taking machine learning and analytics research to production. On any given day, you will have the opportunity to interface with business leaders, machine learning researchers, data engineers, platform engineers, data scientists and many more, enabling you to level up in true end-to-end data science proficiency.
How will you contribute?
  • Collect, analyze, and interpret small/large datasets to uncover meaningful insights to support the development of statistical methods / machine learning algorithms.
  • Lead the design, training, and deployment of NLP and transformer-based models for financial surveillance and supervisory use cases (e.g., misconduct detection, market abuse, trade manipulation, insider communication).
  • Development of machine learning models and other analytics following established workflows, while also looking for optimization and improvement opportunities
  • Data annotation and quality review 
  • Exploratory data analysis and model fail state analysis 
  • Contribute to model governance, documentation, and explainability frameworks aligned with internal and regulatory AI standards.
  • Client/prospect guidance in machine learning model and analytic fine-tuning/development processes
  • Provide guidance to junior team members on model development and EDA
  • Work with Product Manager(s) to intake project/product requirements and translate these to technical tasks within the team's tooling, technique and procedures
  • Continued self-led personal development
What will you bring?
  • Strong understanding of financial markets, compliance, surveillance, supervision, or regulatory technology
  • Experience with one or more data science and machine/deep learning frameworks and tooling, including scikit-learn, H2O, keras, pytorch, tensorflow, pandas, numpy, carot, tidyverse
  • Command of data science and statistics principles (regression, Bayes, time series, clustering, P/R, AUROC, exploratory data analysis etc...)
  • Strong knowledge of key programming concepts (e.g. split-apply-combine, data structures, object-oriented programming)
  • Solid statistics knowledge (hypothesis testing, ANOVA, chi-square tests, etc...)
  • Knowledge of NLP transfer learning, including word embedding models (gloVe, fastText, word2vec) and transformer models (Bert, SBert, HuggingFace, and GPT-x etc.)
  • Experience with natural language processing toolkits like NLTK, spaCy, Nvidia NeMo
  • Knowledge of microservices architecture and continuous delivery concepts in machine learning and related technologies such as helm, Docker and Kubernetes
  • Familiarity with Deep Learning techniques for NLP.
  • Familiarity with LLMs - using ollama & Langchain
  • Excellent verbal and written skills
  • Proven collaborator, thriving on teamwork
 
Preferred Qualifications
  • Master's or Doctor of Philosophy degree in Computer Science, Applied Math, Statistics, or a scientific field
  • Familiarity with cloud computing platforms (AWS, GCS, Azure)
  • Experience with automated supervision/surveillance/compliance tools
$166,000 - $214,000 a year
 
The above salary range represents Smarsh's good faith and reasonable estimate of the range of possible base compensation at the time of posting. Any applicable bonus programs will be discussed during the recruiting process.
 
The salary for this role will be set based on a variety of factors, including but not limited to, internal equity, experience, education, location, specialty and training.
 
Local cost of living assessments are done for each new hire at the time of offer.
About our culture

Smarsh hires lifelong learners with a passion for innovating with purpose, humility and humor. Collaboration is at the heart of everything we do. We work closely with the most popular communications platforms and the world's leading cloud infrastructure platforms. We use the latest in AI/ML technology to help our customers break new ground at scale. We are a global organization that values diversity, and we believe that providing opportunities for everyone to be their authentic self is key to our success. Smarsh leadership, culture, and commitment to developing our people have all garnered Comparably.com Best Places to Work Awards. Come join us and find out what the best work of your career looks like.
apply for this job

Apply