About the role
Position: LLM – AI Quality Analyst (Personalization) – Korean Type: Short-Term Contract (2 months) Compensation: $11 per hour Location: Remote (Global) Commitment: Part-time availability required
Role Responsibilities Evaluate a personalization feature for Gemini Design and execute multi-turn conversational prompts that require the AI to utilize personal information and experiences Assess how effectively the model uses past conversations and activity to generate relevant and helpful responses Evaluate model responses based on intent and appropriate personalization Analyze responses for grounding issues, including flawed inferences or hallucinations Assess integration quality to ensure personal data is incorporated naturally into responses Perform side-by-side evaluations and stack-rank model responses based on helpfulness and naturalness Write clear rationales referencing specific conversation turns Extract and verify debug information to confirm correct use of summaries and data sources Maintain data hygiene by deleting evaluation conversations after completion
Requirements Experience in data annotation, AI quality evaluation, content moderation, or related roles Strong Korean proficiency (reading and writing) Willingness to use a primary personal Google account and enable personal data sources for assessment Strong analytical thinking and attention to detail Experience with creative prompt engineering and personalization concepts Ability to provide structured feedback and clear written explanations Ability to work independently in a remote environment
Application Process Fill out the application form Complete the ICF Complete the assessment
About Crossing Hurdles
At Crossing Hurdles, we specialise in customised recruitment and staffing solutions designed to drive success for businesses and professionals. Our focus is on connecting organisations with top-tier talent by sourcing, screening, and presenting only the top 1% of candidates across a wide range of industries. We work closely with clients to understand their unique needs, ensuring that we find candidates who not only fit the role but also align with their organizational culture.
Over the past few quarters, we've successfully partnered with leading companies such as Angel One, Ixigo, Turing, Cars24, Veera, ABP Network, Battery Smart, Zavya, and Twin Engineers. Our expertise spans various sectors, including Tech, Product, Sales, Customer Support, Growth, Finance, and Marketing. At Crossing Hurdles, our mission is to help organizations thrive by matching them with exceptional talent while simultaneously enabling candidates to find opportunities that foster long-term career growth and development.
Similar Jobs
About the role
Position: LLM – AI Quality Analyst (Personalization) – Korean Type: Short-Term Contract (2 months) Compensation: $11 per hour Location: Remote (Global) Commitment: Part-time availability required
Role Responsibilities Evaluate a personalization feature for Gemini Design and execute multi-turn conversational prompts that require the AI to utilize personal information and experiences Assess how effectively the model uses past conversations and activity to generate relevant and helpful responses Evaluate model responses based on intent and appropriate personalization Analyze responses for grounding issues, including flawed inferences or hallucinations Assess integration quality to ensure personal data is incorporated naturally into responses Perform side-by-side evaluations and stack-rank model responses based on helpfulness and naturalness Write clear rationales referencing specific conversation turns Extract and verify debug information to confirm correct use of summaries and data sources Maintain data hygiene by deleting evaluation conversations after completion
Requirements Experience in data annotation, AI quality evaluation, content moderation, or related roles Strong Korean proficiency (reading and writing) Willingness to use a primary personal Google account and enable personal data sources for assessment Strong analytical thinking and attention to detail Experience with creative prompt engineering and personalization concepts Ability to provide structured feedback and clear written explanations Ability to work independently in a remote environment
Application Process Fill out the application form Complete the ICF Complete the assessment
About Crossing Hurdles
At Crossing Hurdles, we specialise in customised recruitment and staffing solutions designed to drive success for businesses and professionals. Our focus is on connecting organisations with top-tier talent by sourcing, screening, and presenting only the top 1% of candidates across a wide range of industries. We work closely with clients to understand their unique needs, ensuring that we find candidates who not only fit the role but also align with their organizational culture.
Over the past few quarters, we've successfully partnered with leading companies such as Angel One, Ixigo, Turing, Cars24, Veera, ABP Network, Battery Smart, Zavya, and Twin Engineers. Our expertise spans various sectors, including Tech, Product, Sales, Customer Support, Growth, Finance, and Marketing. At Crossing Hurdles, our mission is to help organizations thrive by matching them with exceptional talent while simultaneously enabling candidates to find opportunities that foster long-term career growth and development.