Devise and evaluate user testing of games and interactive media project outputs

URN: SKSIM25
Business Sectors (Suites): Games and Interactive Media
Developed by: ScreenSkills
Approved on: 30 Mar 2021

Overview

​This standard is about devising user tests and analysing, evaluating and reporting the data obtained from them. This is likely to be an iterative process during development.

This standard can apply to games or interactive media. Interactive media can involve any type of interactive media content, products or services including, but not restricted to, websites, applications, or online marketing campaigns.

Games and interactive media projects can be for multi-platform or multi-channel use and can also involve the use of immersive technology which can include, but is not restricted to, Augmented Reality (AR), Virtual Reality (VR) and Mixed Reality (MR).

This standard is for anyone involved in user testing of games or interactive media projects.


Performance criteria

You must be able to:

  1. obtain current project information required for user testing
  2. carry out a thorough analysis of project information to identify which aspects of projects are to be tested
  3. specify assessment criteria which will meet project requirements
  4. select testing methods, tasks and activities which can generate valid data and which meet project parameters
  5. decide how test data is to be collected and design appropriate data collection instruments
  6. devise ways to mitigate factors which may affect test results
  7. specify end-user samples which are representative of target audiences and will provide sufficient valid test data
  8. select and recruit appropriate test observers or facilitators to meet testing requirements
  9. prepare clear instructions with relevant information for all the people involved
  10. collate test results
  11. analyse and evaluate test results against assessment criteria to identify issues and problems
  12. rate issues and problems for severity, ease of fixing and impact on projects
  13. document your findings in an appropriate format for circulation to relevant colleagues

Knowledge and Understanding

You need to know and understand:

  1. ​the range of data that can be tested including useability, quality, fitness for purpose, overall design, integration of design elements
  2. how to obtain information about projects and parameters including design objectives, client requirements, design constraints, functional specifications, functionality, features, target audience
  3. the principles of interaction design and issues of usability and accessibility including the use of real-time animation
  4. how to obtain and analyse project information to identify end-user characteristics, requirements, expectations, tasks and goals
  5. ethical issues relating to user testing including privacy, confidentiality, diversity, inclusivity, accessibility, emotional intelligence and behavioural psychology
  6. the features, benefits and disadvantages of low-tech techniques for conducting usability tests including questionnaires, interviews, focus groups, surveys, user observation
  7. how to prepare test scripts, interview questions and survey forms
  8. the features, benefits and disadvantages of high-tech automated techniques for conducting usability tests including eye-tracking, server logs, analytics and other scripted processes
  9. the role of test observers and facilitators and when it is appropriate to use them
  10. information required by test observers and facilitators including test objectives, assessment criteria, and their role in the process and why it is important to brief them
  11. how to produce instructions for end users which contain sufficient information for them to carry out tests without unnecessarily influencing results
  12. what factors may affect test results including equipment, environment, clarity of task instructions, leading questions, awareness of being observed
  13. collation, analysis and evaluation techniques for qualitative and quantitative data
  14. project reporting formats and who needs to receive them 
  15. how to write a well-researched and clearly worded report

Scope/range


Scope Performance


Scope Knowledge


Values


Behaviours


Skills


Glossary


Links To Other NOS


External Links


Version Number

3

Indicative Review Date

30 Mar 2026

Validity

Current

Status

Original

Originating Organisation

ScreenSkills

Original URN

SKSIM24

Relevant Occupations

Arts, Media and Publishing, Crafts, Creative Arts and Design, Media and Communication, VFX Technician, Animation Professionals, AR/VR Technician, Interactive Media Professionals, Games Professionals

SOC Code

2142

Keywords

interactive media; games; gaming; websites, applications; online marketing; AR/VR; 360; immersive technology; mixed reality; augmented reality; end user; multi-platform; multi-channel; devise; evaluate; report; user; testing; design; test; data; product