Chapter 7 – Evaluation
7.1 Functional evaluation
This section contains the functional evaluation of the skiing game that resulted from the realisation phase that is described in Chapter 6. Functional evaluation was done based on the functional requirements that were determined in the specification phase that is described in Chapter 5. For every requirement, except for the won’t have requirements, it is determined if the requirement is met in the final product that resulted from the realisation phase. Table 7.1 provides an overview of the product requirements and their assessment.
Table 7.1: Evaluation of the product requirements.
Requirements
Prioritization
level
Fulfilled
The application must contain an augmented reality environment thatcan be displayed on a pair of augmented reality glasses.
Must Yes
The application must offer the ability to play a game in the augmented reality environment.
Must Yes
The application must track a user’s motion in the physical world and determine the user’s placement in the augmented reality
environment based on it.
Must Yes
The application must move the user forward in the augmented reality environment, without the user having to move forward in the physical world (since that will not occur on the revolving ski slope).
Must Yes
The application must present three-dimensional objects that serve as gates in the augmented reality environment.
Must Yes
The application must allocate the user points when he/she skies through a gate.
Must Yes
The application should present three-dimensional objects that serve as obstacles in the augmented reality environment.
Should Yes
The application should subtract points from the user’s total number
of points when he/she collides with an obstacle.
64 The application should provide multimodal feedback to the user,
which includes audio feedback, visual feedback, and if possible haptic feedback.
Should Partially
Sub-requirements The application should play a low tone when the user hits an obstacle.
Yes The application should play a high tone when
the user passes through a gate.
Yes The application should assign red colours to
the obstacles.
Yes The application should assign blue colours to
the gates.
Yes The application should give a heavy buzz when
the user hits an obstacle.
No The application should give a small buzz when
the user passes through a gate.
No The application should show a ranking based on the number of
points per user, to show the user how well he/she is doing compared to others.
Should Partially
The application could offer the option to play the game with multiple people (multiplayer).
Could Yes
The application could display three-dimensional objects that are related to physical skiing environments, such as trees and snow.
Could Yes
The application could be an asymmetrical game, in which not every player gets the same resources and powers assigned. This could solve the issue of one player being abundantly better at the game than another.
Could No
The application could be a game with triangularity, in which the user is presented to high risk/high reward and low risk/low reward options.
Could No
The application won’t present a visual representation of a human
skeleton that is skiing in front of the user and demonstrates movements that should be mimicked.
Won’t
The application won’t have several levels. Won’t
The application won’t offer a training part, where people can
practice their skiing skills before they participate in the game.
Won’t The application won’t offer the option for the teacher to give input
to the game (such as determining its difficulty, speed, slope, or duration) through a second device that has its own interface.
Won’t
The application won’t contain summary feedback that give an
outline of the parts of the game where the player performed well, and the parts where the player did not perform so well.
Won’t
Based on the result of the functional evaluation that is presented in Table 7.1 it can be concluded that all must have-requirements of the product are fulfilled for the prototype that resulted from this project. Additionally, most of the should have-requirements were fulfilled as well. The should have- requirement of haptic feedback was only partially fulfilled, since no buzz was added to the game. The Hololens did not provide a way to do this except for making the head-mounted display itself buzz, which is seen as an undesirable thing to do during skiing. Another should have-requirement that was
only fulfilled partially was the requirement of displaying an overall ranking containing the player’s
65 in it and the information it provided was not right. The information displayed in the ranking was the score of the player himself, and an imaginary score of the opponent which was not the actual score of the opponent. Finally, two of the could have-requirements were not met. The requirements that were not met are the requirement of the game being an asymmetrical game, and having triangularity in the game. These features were not added to the game due to the limited time that was allocated to this project.