LLM AI Quality Analysts
Boost your chances before you apply.
Donato Technologies Inc
US
Summary
The analyst will evaluate personalized AI responses and create multi-turn prompts to test model performance. They are responsible for assessing AI grounding, helpfulness, and identifying hallucinations or poor inferences.
Job Description
IMMEDIATE HIRING | LLM / AI QUALITY ANALYST
We are hiring for LLM – AI Quality Analysts (Personalization) – English for a 4-month remote contract opportunity.
Rate: $15/hr USD
Start Date: Immediately
Availability: 30–40 hours/week
PST Overlap: 4 hours required
Engagement: Contractor
Education: Bachelor’s or Master’s degree in IT or any IT-related field
📍 Approved States:
Alabama, Arizona, Colorado, Florida, Idaho, Iowa, Kentucky, Michigan, Minnesota, Mississippi, Missouri, Montana, New York, North Carolina, North Dakota, Oklahoma, Pennsylvania, South Carolina, South Dakota, Virginia, Wisconsin, Wyoming.
🔹 Requirements
• Strong English reading and writing skills
• Strong analytical and attention-to-detail skills
• AI evaluation, data annotation, content moderation, or related experience preferred
• Ability to work independently in a remote environment
• Laptop/Desktop with reliable internet
• Willingness to use a primary personal Google account and enable personal data sources for the assessment
🔹 What You’ll Do
• Evaluate personalized AI/Gemini responses
• Create and test multi-turn prompts
• Assess AI responses for Grounding, Integration, and Helpfulness
• Compare model responses side-by-side
• Identify incorrect personalization, poor inferences, and hallucinations
• Provide detailed feedback and rationales
📩 Interested?
Please send your updated resume + current location + availability to:
This is a remote position.
Founded in 2012, Donato Technologies stands out as a premier IT service provider dedicated to delivering an exceptional staffing experience while prioritizing the needs of our clients and employees. We specialize in staffing, consulting, software development, and training, specifically tailored for small and medium-sized enterprises.
While our core expertise lies in Information Technology, we possess a deep understanding of our clients’ unique business challenges. We leverage cutting-edge IT solutions to address these needs effectively, ensuring high-quality, customized outcomes through the optimal integration of technology.
Our collaborative approach enables us to provide advanced technology solutions tailored to each client's specific requirements, whether for ongoing projects, targeted initiatives, or staffing solutions. We assemble the right mix of professionals, knowledge, methodologies, and technologies to ensure every project is completed on time and within budget—whether through staff augmentation or technology integration.
With a team skilled in all phases of the software development life cycle, we offer a comprehensive range of functional and technical expertise, committed to driving success for our clients.
Founded
2012
Company size
201-500 employees
Industry
IT Services and IT Consulting
Org type
Privately Held
Headquarters
Farmers Branch, Texas
Founded in 2012, Donato Technologies stands out as a premier IT service provider dedicated to delivering an exceptional staffing experience while prioritizing the needs of our clients and employees. We specialize in staffing, consulting, software development, and training, specifically tailored for small and medium-sized enterprises.
While our core expertise lies in Information Technology, we possess a deep understanding of our clients’ unique business challenges. We leverage cutting-edge IT solutions to address these needs effectively, ensuring high-quality, customized outcomes through the optimal integration of technology.
Our collaborative approach enables us to provide advanced technology solutions tailored to each client's specific requirements, whether for ongoing projects, targeted initiatives, or staffing solutions. We assemble the right mix of professionals, knowledge, methodologies, and technologies to ensure every project is completed on time and within budget—whether through staff augmentation or technology integration.
With a team skilled in all phases of the software development life cycle, we offer a comprehensive range of functional and technical expertise, committed to driving success for our clients.
Founded
2012
Company size
201-500 employees
Industry
IT Services and IT Consulting
Org type
Privately Held
Headquarters
Farmers Branch, Texas