Job Description
Job Details:
\n
Job Title: Senior Data Scientist II
\n
Duration: Long-Term Contract
\n
Location: Raleigh, NC || Onsite / Remote (EST Only)
\n
\n
Note: Preference will be given to candidates with Mandarin language proficiency.
\n
\n
Job Description:
\n
Key Responsibilities
\n
- \n
- Develop and improve LLM-based workflows for information extraction, classification, legal summarization, and content generation.
- Design and evaluate prompts, retrieval-augmented generation (RAG), and multi-step agent workflows.
- Build reliable data-preparation pipelines, including parsing, transformation, validation, caching, and recovery from interrupted processing.
- Create representative evaluation datasets and conduct controlled experiments, error analysis, and regression testing.
- Work with subject matter experts to assess factual accuracy, completeness, source support, and consistency, and translate feedback into generalizable improvements.
- Diagnose problems across data, retrieval, model behavior, and application logic.
- Balance output quality, latency, and cost when comparing technical approaches.
- Maintain tested, version-controlled code and clear documentation to support reproducibility and team handoffs.
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
Required Qualifications
\n
- \n
- Bachelor’s degree or higher in computer science, Data Science, Statistics, Mathematics, or a related quantitative field, or equivalent practical experience.
- At least 3 years of relevant experience in data science, machine learning, or NLP, including hands-on experience developing LLM-based applications.
- Strong Python programming skills and experience with SQL and structured or semi-structured data, such as JSON and XML.
- Practical experience with prompt design, structured outputs, retrieval, and systematic LLM evaluation.
- Understanding of statistical evaluation, train/validation/test separation, data leakage, and appropriate performance metrics.
- Experience using Git, debugging existing code, and writing automated tests.
- Ability to communicate findings clearly, incorporate feedback, and proactively raise delivery risks.
\n
\n
\n
\n
\n
\n
\n
\n
\n
Preferred Qualifications
\n
- \n
- Experience with traditional machine learning, including feature engineering, classification, tree-based models, and imbalanced datasets.
- Familiarity with scikit-learn, PyTorch, or comparable frameworks.
- Experience fine-tuning transformer models for classification, information extraction, or sequence labeling.
- Familiarity with AWS, particularly S3 and EC2, and Linux or GPU-based training environments.
- Experience with legal documents, editorial workflows, or other accuracy-sensitive domains.
\n
\n
\n
\n
\n
\n
\n
What are the top 3 must-have skills?
\n
- \n
- Applied LLM development: demonstrated experience building and evaluating workflows involving prompts, retrieval, and structured generation.
- Python and data engineering: ability to independently build, debug, and maintain reliable data-processing and model-integration code.
- Experimental design and evaluation: ability to compare baselines, analyze errors, validate improvements, and communicate actionable findings.
\n
\n
\n
\n
