LLM AI Quality Analyst- Chinese Mandatory
Boost your chances before you apply.
Donato Technologies Inc
US
Summary
Evaluate personalized AI responses for accuracy, helpfulness, and appropriate personalization. Create multi-turn prompts and provide detailed feedback on AI performance.
Job Description
Hiring: LLM – AI Quality Analyst (Personalization) – Chinese
We are looking for Chinese-speaking AI Quality Analysts to support a short-term AI evaluation project with a leading AI technology company.
Locations: USA
USA sourcing: Please do not source from Texas or Illinois
Duration: 4 months
Schedule: 30 or 40 hours/week | Minimum 4 hours/day
Time-zone requirement: 4 hours overlap with PST
Remote | Immediate Start
What You'll Do
- Evaluate personalized AI responses and determine their quality
- Create multi-turn prompts based on personal experiences and context
- Review AI responses for accuracy, helpfulness, and appropriate personalization
- Identify incorrect personalization, unsupported assumptions, and hallucinations
- Compare AI responses side-by-side and provide detailed feedback
- Write clear rationales explaining your evaluations
Requirements
-
Strong Chinese reading and writing skills
- Excellent analytical and critical-thinking skills
- Strong written communication
- Experience in AI evaluation, data annotation, content moderation, linguistics, research, or a related area is preferred
- Bachelor's degree or equivalent experience
- Comfortable working independently in a remote environment
- Laptop/desktop with reliable internet
- Willingness to use a primary personal Google account and enable relevant personal data sources for the evaluation
🎓 Student-friendly opportunity: This may be a good fit for students or recent graduates who have strong Chinese language skills and are interested in AI, language, data annotation, content evaluation, or technology and can meet the required weekly schedule.
Selection Process
- Job Interest Form
- Profile review
- Online assessment — must be completed within 24 hours
- Pre-onboarding discussion
📩 Interested candidates: Please send your updated resume and confirm:
- Chinese proficiency
- Current location
- Availability (30 or 40 hrs/week)
- Earliest start date
- Confirmation that you can provide 4 hours of PST overlap
This is a remote position.
Founded in 2012, Donato Technologies stands out as a premier IT service provider dedicated to delivering an exceptional staffing experience while prioritizing the needs of our clients and employees. We specialize in staffing, consulting, software development, and training, specifically tailored for small and medium-sized enterprises.
While our core expertise lies in Information Technology, we possess a deep understanding of our clients’ unique business challenges. We leverage cutting-edge IT solutions to address these needs effectively, ensuring high-quality, customized outcomes through the optimal integration of technology.
Our collaborative approach enables us to provide advanced technology solutions tailored to each client's specific requirements, whether for ongoing projects, targeted initiatives, or staffing solutions. We assemble the right mix of professionals, knowledge, methodologies, and technologies to ensure every project is completed on time and within budget—whether through staff augmentation or technology integration.
With a team skilled in all phases of the software development life cycle, we offer a comprehensive range of functional and technical expertise, committed to driving success for our clients.
Founded
2012
Company size
201-500 employees
Industry
IT Services and IT Consulting
Org type
Privately Held
Headquarters
Farmers Branch, Texas
Founded in 2012, Donato Technologies stands out as a premier IT service provider dedicated to delivering an exceptional staffing experience while prioritizing the needs of our clients and employees. We specialize in staffing, consulting, software development, and training, specifically tailored for small and medium-sized enterprises.
While our core expertise lies in Information Technology, we possess a deep understanding of our clients’ unique business challenges. We leverage cutting-edge IT solutions to address these needs effectively, ensuring high-quality, customized outcomes through the optimal integration of technology.
Our collaborative approach enables us to provide advanced technology solutions tailored to each client's specific requirements, whether for ongoing projects, targeted initiatives, or staffing solutions. We assemble the right mix of professionals, knowledge, methodologies, and technologies to ensure every project is completed on time and within budget—whether through staff augmentation or technology integration.
With a team skilled in all phases of the software development life cycle, we offer a comprehensive range of functional and technical expertise, committed to driving success for our clients.
Founded
2012
Company size
201-500 employees
Industry
IT Services and IT Consulting
Org type
Privately Held
Headquarters
Farmers Branch, Texas