Music/ Video/ App Search Relevance Rater(Job No 777)

Video Search Relevance Rating (Singapore)

Role Overview: As a Video Search Relevance Rater, you will evaluate the relevance of video search results across OTT (Over-The-Top) platforms. Your assessments will help improve search algorithms and enhance the user experience by ensuring that content returned for specific queries is accurate and satisfying.

Key Responsibilities:

• Evaluate Video Results: Assess whether search results are relevant to user queries (e.g., movies, TV shows, genres).
• Conduct Research: Use your knowledge of video content to determine the relationship between the query and the results.
• Understand Query Intent: Accurately interpret various video-related queries and assess how well the content matches.
• Provide Feedback: Write clear, concise comments justifying your relevance rating for each result.

Equipment and Access
The Contractor will:

• Use their own device (laptop or desktop preferred) to complete the work.
• Maintain consistent access to a reliable internet connection.

Assessment: To gauge the candidate's acquaintance with the language and analytical skills, project specific assessment needs to be cleared.

Assessment Duration: 150 minutes

Music Search Result Rating (Singapore) 

• Role Overview: As a Music Relevance Rater, your primary responsibility will be to assess the relevance of search results for music-related queries on streaming platforms. You will evaluate whether the returned results align with the query intent, considering artist, song, album, or playlist information. You will leverage your research skills, cultural knowledge, and attention to detail to rate the relevance of content. Your assessments will influence the quality of music search results, ensuring users receive the most accurate and appropriate content. 

Key Responsibilities: 

• Evaluate Music Search Results: Analyze search results for music queries and score the relevance based on the query intent. Why is this result returned for this query? Is this relevant?" and apply the relevant guidelines for each query type. 
• Conduct Research: Thoroughly research any unclear or ambiguous results. Use your understanding of music genres, artists, and songs to determine if the search result is aligned with the query. 
• Understand Query Intent: Differentiate between several types of music-related queries, such as artist or song queries, and apply the appropriate evaluation standards. Understand the distinctions between Artist Functional, Song Functional, and other music-specific intents. 
• Quality Control: Your work will be spot-checked for accuracy and quality. Ensure your ratings meet or exceed the standards set by the team and are consistent with the guidelines. 
• Provide Explanations: For each relevance rating, provide a clear, concise explanation in the comment box. Justify why the result is rated as it is based on the query intent. 

Equipment and Access: 
The Contractor will: 

• Use their own device (laptop or desktop preferred) to complete the work. 
• Maintain consistent access to a reliable internet connection. 

Assessment: To gauge the candidate's acquaintance with the language and analytical skills, project specific assessment needs to be cleared. 
 
Assessment Duration: 150 minutes

App Search Result Rater (Singapore) 

Role Overview: You will evaluate, and rate search results related to mobile applications based on their relevance, quality, content, and functionality. You will use screenshots to assess the app’s quality and provide ratings and explanations accordingly. Ratings must always be 

accompanied by a concise comment, explaining why the rating was chosen in alignment with the guidelines provided. 
 
Key Responsibilities: 

• Review search query results and app screenshots to assess the app’s content, design, and functionality. 
• Rate app results on a scale of Perfect, Excellent, Good, Acceptable, or Unacceptable. 
• Provide a clear and concise explanation in the comment box for each rating, even if the comment is optional (always mandatory). 
• Understand and apply different query intents (e.g., App Navigational, Functional, Developer Navigational) when rating results. 

Equipment and Access

The Contractor will: 

• Use their own device (laptop or desktop preferred) to complete the work. 
• Maintain consistent access to a reliable internet connection. 

Assessment: To gauge the candidate's acquaintance with the language and analytical skills, project specific assessment needs to be cleared. 
 
Assessment Duration: 150 minutes