Context situation interpretation - Evaluation scenario walk through

3 UIAF system design

5.5 Evaluation scenario walk through

5.5.5 Context situation interpretation

Context situation interpretation allows learning of multimodal device configurations in different user contexts correlating to the actual user preferences in this particular situation. Interpretation and inference mechanisms as proposed by context-awareness research are not part of this thesis. In order to demonstrate the full capabilities of the UIAF under consideration of context information, the supported recommendation mechanism has been connected to the personalisation framework as developed in the FU-IST MobiLife project. Some further details on personalisation aspects are provided here [78].

The functionalities demonstrated for context situation interpretation links to the requirements category on general system requirements (Section 3.2.4) and especially react to user situation changes (RFQ015) and user preferences support (RFQ016). Recommendations are utilised for the presentation delivery as described in the UIAF system design in Section 3.4.1.1, the UIAF functionalities in Section 4.2.5.2 and the implementation mechanisms in Section 5.3.2.3.

Discovery Context Interpretation

Output Context Inference _{(User Profile)}

Fission

Figure 62: Discovery, context interpretation, context inference, fission, and output cycle The general cycle for context situation interpretation for the Multimedia Infotainer scenario is illustrated in Figure 62. During the discovery phase, available device information is interpreted in order to derive the user’s location. In the Multimedia Infotainer scenario this is indicated through the devices named home_device and car_device as described in Section 5.5.1.2. With the location information context inference can perform a matching of the current user context to stored preferences, either defined by the user or derived by a learning mechanism as proposed in the UIAF functionalities Section 4.2.5.2 for the multimedia presentation delivery. The result of the inference of the personalisation component is a recommendation to the UIAF. Figure 63 presents such a recommendation for the in-car multimedia presentation delivery.

</poc> </iteration> </recommendations>

Figure 63: Recommendation example (car audio) in the Multimedia Infotainer scenario The first parameter indicates, whether the UIAF should perform an automatic switching

Infotainer scenario this is set to manual. The second main parameter indicates a modality recommendation (attribute generic_modality_recomendation) with a recommended modality class (attribute recommendation_output_modality_class) with the value audio (attribute audio). Therefore the UIAF performs the multimedia presentation delivery adaptation, scoring the audio content higher.

i P l e a s e s e le c t a m odality a n d click on (th e GO! button to start o r Info for d etails

R e c o m m e n d e d A vailable infoj____ R e c o m m e n d e d m odalities:

► C a r A udio o n A udio C ar Kit ^ Local Audio o n Portal D evice

GO! _M Info

P le a s e se le c t a m odality a n d click on th e GO! button to start o r Info for d eta ils

R e c o m m e n d e d A vailable Info _ + Q ] d e v ic e

S Q ) m odality 8 CD au d io

^ Local A udio o n Portal D evice ^ C a r A udio o n Audio C ar Kit

► ► a CD text CD'^ideo o Q Video P la y e r T20x576 o n Horrj 4 I GO! _M Info P le a s e se le c t a m odality a n d click on th e GO! button to start o r Info for d e ta ils R e c o m m e n d e d A v ailable Info (Car A u d i o i s r e c o m m e n d e d b e c a u s e a u d i o i s a p r e f e r r e d m o d a l i t y . Local A udio is re c o m m e n d e d b e c a u s e au d io is a p referred m odality. GDI _M Info

Figure 64: Single modality selection dialogue example

Since the users preferences indicate that the user wants to do a manual selection of the Device Agents the system presents him with the recommended output modalities and format information for the manual selection. Figure 64 illustrates the choice example of the modality selection dialogue. From left to right, the user sees the recommended modality choices with the recommended audio modalities, top ranked is the car audio device. Further in the middle the user can see the discovered modalities and possible media item device combinations. And at the right side the user retrieves an explanation about why media items are recommended. This concludes the context interpretation step and the overall evaluation scenario explanation.

5.6 Conclusion

Chapter 5 has presented the UIAF system design realisation and scenario based evaluation of the UIAF functionalities introduced in Chapters 3 and 4 for a mobile terminal platform. This realisation of the UIAF system has shown that multimodal interaction application scenarios for user mobility are feasible as envisioned in the scope of this work and as defined by the set out challenges in Section 2.4. A detailed comparison of supported challenges is provided in Chapter 7 Furthermore it has been demonstrated that defined UIAF functionalities work in a prototype environment. Restrictions of the realisation have been highlighted in the according sections. Limitations compared to the design are the use of single media item adaptation and the

presentation control, which were not realised as part of this scenario. The evaluation scenario has been demonstrated on occasions to audiences in the research community (visitors of the University, as well as demonstrations to experts of the European Commission). This qualitative and scenario based evaluation was focussed on the technical realisation of the UIAF system design and the UIAF functionalities in an integrated and continuous context-awareness scenario. With the knowledge gained from the mobile terminal evaluation, the concept of multimedia presentation delivery has been further investigated, which lead to the final design as presented in Section 4.2 and further to the UIAF system design realisation and evaluation for service platforms as presented in Chapter 6.

Chapter 6 6 UIAF system design realisation and evaluation

In document Mobile Multimodal User Interfaces. (Page 166-170)