Search

Senior Data Scientist

PublishedPublished: 6/14/2022
Technology

Job Description

Job Details:

\n

Job Title: Senior Data Scientist II

\n

Duration: Long-Term Contract

\n

Location: Raleigh, NC || Onsite / Remote (EST Only)

\n


\n

Note: Preference will be given to candidates with Mandarin language proficiency.

\n


\n

Job Description:

\n

Key Responsibilities

\n

    \n
  • Develop and improve LLM-based workflows for information extraction, classification, legal summarization, and content generation.
  • \n

  • Design and evaluate prompts, retrieval-augmented generation (RAG), and multi-step agent workflows.
  • \n

  • Build reliable data-preparation pipelines, including parsing, transformation, validation, caching, and recovery from interrupted processing.
  • \n

  • Create representative evaluation datasets and conduct controlled experiments, error analysis, and regression testing.
  • \n

  • Work with subject matter experts to assess factual accuracy, completeness, source support, and consistency, and translate feedback into generalizable improvements.
  • \n

  • Diagnose problems across data, retrieval, model behavior, and application logic.
  • \n

  • Balance output quality, latency, and cost when comparing technical approaches.
  • \n

  • Maintain tested, version-controlled code and clear documentation to support reproducibility and team handoffs.
  • \n

\n


\n

Required Qualifications

\n

    \n
  • Bachelor’s degree or higher in computer science, Data Science, Statistics, Mathematics, or a related quantitative field, or equivalent practical experience.
  • \n

  • At least 3 years of relevant experience in data science, machine learning, or NLP, including hands-on experience developing LLM-based applications.
  • \n

  • Strong Python programming skills and experience with SQL and structured or semi-structured data, such as JSON and XML.
  • \n

  • Practical experience with prompt design, structured outputs, retrieval, and systematic LLM evaluation.
  • \n

  • Understanding of statistical evaluation, train/validation/test separation, data leakage, and appropriate performance metrics.
  • \n

  • Experience using Git, debugging existing code, and writing automated tests.
  • \n

  • Ability to communicate findings clearly, incorporate feedback, and proactively raise delivery risks.
  • \n

\n


\n

Preferred Qualifications

\n

    \n
  • Experience with traditional machine learning, including feature engineering, classification, tree-based models, and imbalanced datasets.
  • \n

  • Familiarity with scikit-learn, PyTorch, or comparable frameworks.
  • \n

  • Experience fine-tuning transformer models for classification, information extraction, or sequence labeling.
  • \n

  • Familiarity with AWS, particularly S3 and EC2, and Linux or GPU-based training environments.
  • \n

  • Experience with legal documents, editorial workflows, or other accuracy-sensitive domains.
  • \n

\n


\n

What are the top 3 must-have skills?

\n

    \n
  • Applied LLM development: demonstrated experience building and evaluating workflows involving prompts, retrieval, and structured generation.
  • \n

  • Python and data engineering: ability to independently build, debug, and maintain reliable data-processing and model-integration code.
  • \n

  • Experimental design and evaluation: ability to compare baselines, analyze errors, validate improvements, and communicate actionable findings.
  • \n

\n


Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...