[Remote] Data Annotator (Greek) | $15/hr Remote

Note: The job is a remote job and is open to candidates in USA. Crossing Hurdles is seeking a part-time LLM – AI Quality Analyst for a short-term contract role. The analyst will evaluate a personalization feature for Gemini, design conversational prompts, and assess the effectiveness of AI model responses based on various data sources. Responsibilities • Evaluate a personalization feature for Gemini • Design and execute multi-turn conversational prompts that require the AI to utilize personal information and experiences • Assess how effectively the model uses past conversations, Gmail, Google Search, and YouTube activity to generate relevant and helpful responses • Evaluate model responses based on intent and appropriate personalization • Analyze responses for grounding issues, including flawed inferences or hallucinations • Assess integration quality to ensure personal data is incorporated naturally into responses without overnarration • Perform side-by-side evaluations and stack-rank model responses based on helpfulness, naturalness, and usability • Write clear rationales referencing specific conversation turns • Extract and verify debug information to confirm correct use of summaries and data sources • Maintain data hygiene by deleting evaluation conversations after completion Skills • Experience in data annotation, AI quality evaluation, content moderation, or related roles • Strong Greek proficiency (reading and writing) • BS/BA degree or equivalent experience in a relevant field (Policy, Law, Ethics, Linguistics, Journalism, Computer Science, or similar) • Willingness to use a primary personal Google account and enable personal data sources for assessment • Strong analytical thinking and attention to detail • Experience with creative prompt engineering and personalization concepts • Ability to evaluate nuanced and ambiguous AI responses • Ability to provide structured feedback and clear written explanations • Excellent written communication and collaboration skills • Ability to work independently in a remote environment • Desktop or laptop with a stable internet connection Company Overview • Crossing Hurdles connects skilled professionals with opportunities across AI training platforms and high-growth companies. It was founded in 2019, and is headquartered in Gurgaon, Haryana, IND, with a workforce of 51-200 employees. Its website is https://www.crossinghurdles.com.