Trust & Safety Evaluator with English from United States (US) I Project duration: 6 months

*Please note that we will consider only candidates currently residing in Finland with valid work permit. Trust & Safety Evaluator conduct adversarial testing and safety evaluation of generative AI features. Main tasks are crafting queries, evaluating the safety of generated content and providing critical feedback. This role requires creative thinking about potential misuse, deep cultural and linguistic knowledge, and the ability to identify subtle safety risks. Project duration: 6 months KEY RESPONSIBILITIESWrite, review and evaluate diverse and challenging queries designed to test the system's limits and expose problematic outputs. Queries will target specific risk topics including explicit and/or offensive contentDesign and execute sequences of queries simulating realistic, unfolding conversations.Craft attack scenarios using techniques like crescendo attacks and context manipulation to test the systemAge-Appropriate Safety Evaluation: to guide adversarial query crafting and safety evaluation.Assign risk ratings to AI Generated content based on safety guidelines.Detect and articulate potential biases in system-generated contentIdentify subtle unsafe elements, inconsistencies, or problematic implicationsEvaluate specific cultural and language knowledge across different cultural contexts.Leverage familiarity with relevant domains, genres, cultural references, and industry context. Complete adversarial testing tasks within time constraintsMaintain high accuracy and attention to detail while working at pace. REQUIREMENTSValid work permit for FinlandLanguage skills: English from USA as primary language is mandatory.Deep cultural awareness of English from United States language: context, social norms, and valuesUnderstanding of cultural references and industry contextKnowledge of how different cultural groups interpret contentFamiliarity with behavioral patterns of younger audiencesAbility to evaluate content across different cultural contextsQuery crafting and scenario designTechniques like crescendo attacks and context manipulationRisk rating assignment based on guidelinesBias detection in AI outputsAttention to detail + ability to work fast under time constraintsAbility to produce creative contentUnderstanding of slang and youth target language PREFERRED BACKGROUNDCreative Writing, Social Media Management, Community Management, Content Moderation, Digital Marketing, Communications, Journalism, Public Relations, Copywriting, or related fields. PREFERRED SKILLSTrust & Safety Background: Prior experience in trust and safety, or similar roles.Understanding of how safety systems work at scale and common failure modes.Fluency in additional languages beyond English is an advantage for this role.Familiarity with Machine Learning Concepts CONTENT WARNING & OPTIONAL PARTICIPATIONThis role involves exposure to sensitive and potentially disturbing content, including examples of toxic and vulgar language, sexually explicit content, descriptions of violence and self-harm, child abuse, exploitation, and other harmful material. You will encounter this content as part of adversarial testing and safety evaluation. WE OFFEROccupational health care at Terveystalo private clinicLunch benefit with ePassiAfter 4 months, eligibility for Pohjola Comprehensive Health InsuranceComprehensive leisure-time accident insurance by PohjolaSport & Culture&Heath benefits through Epassi, Yearly tax free max.value 400€Multicultural environment/diversity and inclusivenessCharity & well-being activitiesCompany eventsEmployee referral bonuses & Recognition programs *Only shortlisted candidates will be contacted/interviewed. *Kindly attach an updated Copy of your CV in English.