Data Scientist Talent Network
Boost your chances before you apply.
Weekday AI
US
Summary
The role involves designing task-specific grading criteria for data science deliverables and evaluating AI-generated or human-created work. Responsibilities also include providing detailed written justifications for evaluations and ensuring assessments are consistent and evidence-based.
Job Description
This role is for one of our clients
Compensation: $100-$150 per hour
We are building a network of experienced data scientists for potential future projects with leading AI research organizations. These projects may focus on evaluating how effectively AI systems perform real-world data science work.
There is no immediate project opening, but qualified applicants may be contacted as relevant opportunities become available.
Potential Responsibilities
Future projects may involve:
- Designing precise, task-specific grading criteria for data science deliverables, including exploratory data analyses, statistical modeling work, machine learning pipelines, experimentation and A/B test write-ups, feature engineering, and technical reports or notebooks
- Evaluating AI-generated or human-created work against established criteria
- Providing detailed written justifications for evaluations and scores
- Applying consistent, evidence-based judgment so that assessments are reproducible and defensible
- Incorporating structured feedback from senior reviewers and iterating on submitted work
Specific responsibilities will vary depending on the project.
Ideal Qualifications
- 1+ years of professional data science experience
- Experience at a leading technology, research, or quantitative firm (such as top FAANG, AI labs, top-tier quant funds, or equivalent)
- Strong command of Python, SQL, statistical modeling, machine learning, experimentation and causal inference, and translating messy real-world data into rigorous analyses
- Exceptional written communication skills, including the ability to convey technical findings clearly
- A detail-oriented and consistent approach to evaluating complex work
- Comfort receiving feedback and calibrating judgment against established standards
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Finding a great startup job should not feel like a second job.
Weekday AI brings the most exciting roles from premium YC and VC-backed startups into one place. Our team hand-picks every listing, so you skip the agency spam and the dead links and go straight to companies building things that matter.
Why people use Weekday AI?
Curated roles from premium YC and VC-backed startups
Fresh jobs every week, picked by humans
AI that helps you apply in minutes
Free to join
Your next role should come from a company you are proud to work at. We help you find it.
Browse live roles at jobs.weekday.works
Founded
2022
Company size
11-50 employees
Industry
Technology, Information and Internet
Org type
Privately Held
Finding a great startup job should not feel like a second job.
Weekday AI brings the most exciting roles from premium YC and VC-backed startups into one place. Our team hand-picks every listing, so you skip the agency spam and the dead links and go straight to companies building things that matter.
Why people use Weekday AI?
Curated roles from premium YC and VC-backed startups
Fresh jobs every week, picked by humans
AI that helps you apply in minutes
Free to join
Your next role should come from a company you are proud to work at. We help you find it.
Browse live roles at jobs.weekday.works
Founded
2022
Company size
11-50 employees
Industry
Technology, Information and Internet
Org type
Privately Held