Mathematics Model Evaluators (AI Data Trainers)
Boost your chances before you apply.
Careerflow.ai
US
Summary
Design and solve complex mathematical problems to test and fine-tune large language models. Create high-quality, step-by-step solutions and collaborate with researchers to define new evaluation benchmarks.
Job Description
Role Overview
In this role, you will be working on projects to help fine-tune large language models (like ChatGPT) using your strong analytical and English comprehension skills. The ideal candidate should have a strong foundation in Maths, comparable to the level required for PhD-level programs. You should be able to break down complex Maths problems into simple, clear explanations and work efficiently. The projects will also help you learn how to leverage AI to be a better analyst. This is your chance to future-proof your career in an AI-first world!
Responsibilities:
-
Design and solve challenging Maths problems to probe the limitations of large language models.
-
Create clear, high-quality, step-by-step solutions with well-articulated reasoning.
-
Collaborate with LLM researchers to align problems with evaluation goals, especially in areas where models struggle (e.g., abstraction, multi-step reasoning, symbolic manipulation).
-
Help define new evaluation benchmarks based on Mathematics curricula spanning early undergraduate to PhD-level topics.
Required Qualifications:
-
Candidates with a Master’s, Ph.D., or those currently pursuing a Ph.D. in Mathematics, Applied Mathematics, Statistics, or a related field are encouraged to apply
-
Candidates should be proficient in at least three of the following tools: Magma, Macaulay2, Singular, GAP, SageMath, Polymake, 4ti2, LattE, DIPHA, PHAT, AUTO-07P, XPPAUT, Perseus, Stan, PyMC, OR-Tools, Z3, PARI/GP, and fpLLL.
-
Strong research and analytical skills.
-
Ability to provide constructive feedback and detailed annotations.
-
Creative and lateral thinking abilities.
-
Excellent structured communication and collaboration skills in a remote setting.
-
Self-motivated and able to work independently.
-
Access to a desktop/laptop with a reliable internet connection.
-
Ability to analyze and solve complex mathematical problems with a structured, logical approach.
-
Ability to explain mathematical concepts clearly using simple language, visuals, and examples.
Perks of Freelancing With us:
-
Work in a fully remote environment.
-
Opportunity to work on cutting-edge AI projects with leading LLM companies.
-
Potential for contract extension based on performance and project needs.
