Description
Summary AI TRAINER / AI TRAINING SPECIALIST — 101 DIGITAL 101 Digital is looking for a detail-oriented and analytical AI Trainer / AI Training Specialist to help improve the quality, accuracy, consistency, and reliability of AI systems. The role focuses on evaluating AI-generated outputs, creating high-quality training examples, identifying errors, providing structured feedback, and helping establish clear quality standards for AI training workflows. We are looking for someone who can think critically, follow detailed guidelines, recognize subtle differences in AI responses, and communicate feedback clearly. WHAT YOU'LL DO • Review and evaluate AI-generated responses and outputs. • Identify inaccurate, incomplete, irrelevant, inconsistent, or low-quality responses. • Create high-quality examples that can be used for AI training and evaluation. • Provide clear and structured feedback to improve AI outputs. • Compare multiple AI responses and determine which response better satisfies the requirements. • Classify, label, organize, and review training data when required. • Follow detailed evaluation guidelines and quality standards. • Test AI systems across different scenarios and use cases. • Identify recurring patterns in AI errors and provide useful observations. • Help improve AI evaluation processes and training workflows. • Maintain consistency and accuracy across large volumes of tasks. • Communicate clearly with our team regarding questions, edge cases, and quality issues. AI TRAINING & EVALUATION The ideal candidate should be comfortable evaluating AI responses based on criteria such as: • Accuracy • Relevance • Completeness • Clarity • Reasoning quality • Instruction following • Consistency • Helpfulness • Overall response quality You may be asked to review several AI-generated responses, identify the strongest response, explain why it is better, and provide corrections or improvements where necessary. WHAT WE'RE LOOKING FOR • Strong analytical and critical-thinking skills. • Excellent attention to detail. • Strong English reading and writing ability. • Ability to understand and follow detailed instructions. • Ability to identify subtle errors and inconsistencies. • Strong communication skills. • Comfortable working independently. • Reliable and consistent work quality. • Ability to handle repetitive evaluation tasks without losing attention to detail. • Willingness to learn new AI tools, platforms, and workflows. EXPERIENCE WITH AI Experience with any of the following is a strong advantage: • AI training • AI evaluation • Data annotation • Data labeling • LLM evaluation • Prompt evaluation • AI quality assurance • Machine learning datasets • ChatGPT or other generative AI systems • AI content review • Human feedback / RLHF workflows Technical knowledge of Python, machine learning, APIs, or data processing is a plus, but strong analytical and evaluation skills are more important for this role. QUALITY EXPECTATIONS We are looking for someone who does not simply use AI tools, but understands how to critically evaluate their outputs. You should be able to ask: • Is the response factually accurate? • Did the AI actually follow the instruction? • Is anything important missing? • Is the response clear and logically structured? • Is the information relevant to the user's request? • What could be improved? The ability to explain WHY an AI response is good or bad is particularly important. WORKING STYLE At 101 Digital, we value: • Accuracy • Consistency • Clear communication • Critical thinking • Attention to detail • Reliability • Ownership • Continuous learning • Respect for project guidelines and deadlines The role may involve working with our technology and product teams to improve AI-related workflows and quality standards. WHO THIS ROLE IS FOR This position may be a strong fit for people with backgrounds in: • AI / Machine Learning • Data Science • Data Annotation • Quality Assurance • Research • Technical Writing • Software / Technology • Content Evaluation • Linguistics • Analytics • AI Operations You do not necessarily need to be a machine-learning engineer. We are primarily interested in your ability to understand instructions, evaluate information critically, identify errors, and provide high-quality feedback. APPLICATION REQUIREMENTS Please include: 1. A short introduction about yourself. 2. Your relevant experience with AI, data, research, QA, evaluation, or related work. 3. Any experience working with AI tools or LLMs. 4. The platforms or tools you have used. 5. Your availability. 6. Your typical weekly availability in hours. 7. Examples of relevant projects, if available. APPLICATION QUESTION To help us understand your analytical ability, please briefly describe a situation where you reviewed or evaluated information, identified a problem or inconsistency, and explained how you determined the correct solution. We are interested in your reasoning process, attention to detail, and ability to communicate your conclusion clearly. ABOUT 101 DIGITAL 101 Digital works with the Android and iOS developer community to develop and publish mobile applications. Our goal is to connect technology, creative execution, and digital products to build and grow meaningful mobile experiences. This role provides an opportunity to contribute to AI-related workflows while working within a technology-focused environment connected to the Android and iOS ecosystem.