The following tasks and approaches were researched, but due to lack of available features in Web browsers and GWT, they were not included in this thesis and should therefore be implemented in future studies:
At first, a Flash fallback for older Web browsers should be added. This way, excluded browsers like the Internet Explorer 7 or 8 will be supported. Currently a Flash fallback is not provided in Google’s Web Toolkit. How- ever, this feature can be added in the future. Additionally, the HTML5 canvas element should be replaced to support obsolete Web browsers. A possible approach follows the idea of creating HTML div elements in com- bination with CSS.
At the end of the master thesis, the WebKit browsers still did not sup- port the necessary events to feature a wave form in the audio client. A de- tailed research has been undertaken but no solution has been found. This can be changed as soon as the WebKit engine supports the corresponding events.
Since the Google Web Toolkit does not feature slider bars in its latest version, both clients have no volume slider. This feature can be added as soon as Google improves its development tool.
In addition to those tasks, the following list presents proposals for fur- ther research:
Currently the audio and video client has been designed with Adobe’s Photoshop. However, all Web browsers that are capable of HTML5 also support CSS3. With help of this technology, the clients can be designed with several HTML div tags and CSS only. This way smaller changes do not need to be realized through Photoshop but can be applied through CSS file changes. Developers without Photoshop maybe would like to add or change the appearance of the clients. This feature may also be researched and added.
Most of the modern smart phones support HTML5 and CSS3, which opens the possibility of supporting those. Just because those devices have different screen sizes a method called responsive Web design [31] can be applied to the clients. This approach works with CSS media queries and allows the adaptation of all kinds of screen sizes.
A
Summary
Currently there is an ongoing trend to publish more and more multimedia on the Web. A range of solutions exists that allow end-users to organize content and to add additional information by means of annotations. Until now, however, there exists no open standard-based solution which allows users to annotate and link audio and video to contextually relevant infor- mation from other sources on the Web.
Foundation for this thesis constitutes the LEMO framework deployed by Europeana. This solution enables fragment identification and therefore introduces annotating and linking of continuous media. Due to the linkage of contextually relevant resources, the overall documentation can signifi- cantly be improved.
New developments in the research area of Linked Data enable auto- matic access to a huge amount of well defined public data.
The goal of this thesis is to determine whether a combination of new standards enables developing a Web-based audio and video application, that is usable, considers the four rules of Linked Data and that is standard- based.
The concluding statement of this master thesis is that such an appli- cation can be built. The result is based on two case studies; a qualitative research study which revealed usability issues - subsequently eliminated - and a case study, which in turn showed that a semi-automatic approach for generating and retrieving tags would prove to be efficient when annotating and linking resources.
B
Zusammenfassung
Gegenw¨artig herrscht ein Trend immer mehr Multimedia im Web zu ver ¨offentlichen. Es existiert bereits eine grosse Anzahl an Applikationen, die es Endbe-
nutzerInnen erm ¨oglicht Inhalte zu organisieren und dar ¨uber hinaus noch zus¨atzliche Anmerkungen hinzuzuf ¨ugen. Bis jetzt existiert aber keine End- benutzerInnen freundliche Applikation, die es BenutzerInnen erm ¨oglicht Audio und Video Dateien mit relevanten Informationen aus offenen Web- Quellen zu annotieren, zu verkn ¨upfen und die auch auf offenen Standards basiert.
Grundlage f ¨ur diese Arbeit bietet das von Europeana eingesetzte LEMO Framework. Dieses Framework macht Fragment Identifikation nutzbar und erm ¨oglicht damit Annotierungen und Verlinkungen von kontinuier- lichen Medien. Durch die Verlinkung von kontextuell relevanten Ressourcen, kann die Dokumentation der Medien erheblich verbessert werden.
Neue Entwicklungen im Forschungsgebiet von Linked Data erm ¨oglichen es, automatisiert auf eine Menge ¨offentlich zug¨anglicher und wohl definierter Daten zuzugreifen.
Ziel der vorliegenden Arbeit ist es fest zu stellen, ob durch eine Kom- bination von neuen Standards eine Implementierung einer Web-basierten Audio und Video Anwendung m ¨oglich ist, die usable ist, den Zielen von Linked Data entspricht und auf offenen Standards basiert.
Abschliessend l¨asst sich festhalten, dass eine solche Anwendung en- twickelt werden kann. Das Ergebnis basiert auf zwei durchgef ¨uhrten Stu- dien; eine qualitativ durchgef ¨uhrte Studie, welche usability Probleme aufzeigte - die im Anschluss eliminiert wurden - und eine weitere durchgef ¨uhrte Studie, welche wiederum aufzeigte, dass ein semi-automatischer Ansatz zur Generierung von Tags die effizienteste und effektivste M ¨oglichkeit zur Annotierung und Verlinkung darstellt.
C
DVD attachment
Attached to this master thesis, readers can find a DVD for installing and running this project. The attachment contains all the necessary files to de- bug and deploy the server and both clients. In general, the DVD contains a detailed guide for the installation, two WAR files for deploying the project, the source code files of the audio and video client, the source code of the annotation server as well as the documentation of the compiling code.
With the provided installation guide, it is possible to install the annota- tion server and the audio and video client of this master thesis. The DVD contains two WAR files for the server and the clients. Both contain all the necessary classes, binaries, pictures and media to get the whole project run- ning. The guide lists necessary applications and links for the download. Additionally, it gives detailed instructions in order to get the demo run- ning on Windows and Mac OS X computers. The setup and installation sequence is straight forward and does not require certain skills. However, it is advantageous to have fundamental programming and database knowl- edge.
Additionally, it is possible to change, extend and improve this project, since this DVD contains two projects, with compile able files. Those two Eclipse projects allow users to modify the audio and video client as well as the server. Users find a detailed documentation attached to the essential Java classes. By importing those projects into Eclipse, debug and deploy executions are possible. However, users need to install the GWT plugin for eclipse.
D
Scientific curriculum vitae
Elementary schoolGrillparzer Volksschule, St. P ¨olten
Secondary school
BRG St. P ¨olten, Josefstrasse
Upper school
3rd September 1997 - 24th June 2002
HTL und VA St. P ¨olten - Automation Engineering
Civilian Service
1st October 2002 - 30th September 2003 Seniorenwohnheim Stadtwald, St. P ¨olten
Studies
1st October 2003 - 28th February 2009
Bachelor studies at the University of Vienna and the Technical Univer- sity of Vienna in business informatics
25th January 2006
Submission of the 1st bachelor thesis with the title ”Prozessorientierte Zeit- und Personenkoordination”
23rd August 2006
Submission of the 2nd bachelor thesis with the title ”Yellow Pages Search Server”
1st March 2009 - 11th April 2012
Master studies at the University of Vienna and the Technical University of Vienna in media and informatics
11th April 2012
Submission of the master thesis with the title ”HTML5 audio and video annotations with resource detection under consideration of usability and user experience”
References
[1] B. Haslhofer, E. Momeni, M. Gay, R. Simon. Augmenting Europeana Content with Linked Data Resources, presented at I-SEMANTICS, Graz, Austria, (2010)
[2] R. Sanderson, H. v.d. Sompel, Open Annotation: Al- pha3 Data Model Guide, (2010), [Online]. Available: http://www.openannotation.org/spec/alpha3/
[3] W. Klas, Multimediale Systeme 1, University of Vienna, Vienna, (2010), pp. 4 - 18
[4] J. Kahan, M.R. Koivunen, E. Prud’Hommeaux, R. R. Swick, An- notea: An Open RDF Infrastructure for Shared Web Annotations, presented at WWW10, Hong Kong, (2001), [Online]. Available: http://www.w3.org/2001/Annotea/Papers/www10/annotea- www10.html
[5] M.R. Koivunen, Annotea and Semantic Web Supported Col- laboration, presented at UserSWeb 2005, [Online]. Available: http://annotea.org/eswc2005/01 koivunen final.pdf
[6] B. Haslhofer, W. Jochum, R. King, C. Sadilek, K. Scheller, The LEMO Annotation Framework, (2009), pp. 5 - 13
[7] R. T. Fielding, Representational State Trans-
fer (REST), (2000), [Online]. Available:
http://www.ics.uci.edu/˜fielding/pubs/dissertation/rest arch style.htm [8] R. Schroeter, J. Hunter, D. Kosovic, Vannotea, (2003), [Online]. Avail-
able: http://itee.uq.edu.au/ eresearch/papers/2003/schroeter- kcap03.pdf
[9] T. Berners-Lee, Linked Data - Design Issues, (2006), [Online]. Avail- able: http://www.w3.org/DesignIssues/LinkedData.html
[10] J. Volz, C. Bizer, M. Gaedke, G. Kobilarov, Silk - A Link Discovery Framework for the Web of Data, presented at LDOW, Madrid Spain, (2009)
[11] M.G. Butuc, Semantically Enriching Content Us-
ing OpenCalais, (2009), [Online]. Available:
http://www.eed.usv.ro/SistemeDistribuite/2009/Butuc1.pdf [12] J. Keith, HTML5 for Web Designers, New York: A Book Apart, (2010) [13] A. Budd, CSS Mastery - Advances Web Standards Solutions,
[14] D. Cederholm, CSS3 for Web designers, New York: A Book Apart, (2010)
[15] R. Hanson, Introduction to GWT, (2009). [Online]. Available: http://gwtsandbox.com/ete2009/intro-to-gwt.pdf
[16] D. Spinellis, It’s About Time to Take JavaScript (More) Seriously, IEEE Computer Society, (2010), pp. 60 - 62
[17] W. Jochum, Requirements of Fragment Identification, Uni- versity of Vienna, Vienna, (2007), [Online]. Available: http://eprints.cs.univie.ac.at/396/1/Identification.pdf
[18] J. Nielsen, Usability Engineering, London: Academic Press, (1993) [19] The Humane Interface: New Directions for Designing Interactive
Systems, J. Raskin, Addison-Wesley Professional, (2000), pp. 2 [20] J. Tidwell, Designing Interfaces, O’Reilly Media, (2010)
[21] M.J. Davidson, L. Dove, J. Weltz, Mental Mod-
els and Usability, (1999), [Online]. Available:
http://www.lauradove.info/reports/mental%20models.htm [22] M. Ward, A. Charchar, F. Inchauste, M. Rundle, J. Jovanovic, C. Heil-
mann, V. Anayian, C. Kolb, S. Weinschenk, S. Bradley, The Smashing Book #2, Freiburg: Smashing Media GmbH, (2011), pp. 254 - 272 [23] G. A. Miller, The magical Number seven, plus or minus two, Ameri-
can Psychological Association, (1995)
[24] D.M. Jones, The 7+-2 Urban Legend, presented at
MISRA C Conference, (2002), [Online]. Available:
http://www.knosof.co.uk/cbook/misart.pdf
[25] L. Mathis, Design for use, The Pragmatic Bookshelf LLC, (2011) [26] Fitts’ Law Group, Fitts’ Law, (1996), [Online]. Available:
http://ei.cs.vt.edu/ cs5724/g1/
[27] M. W. van Someren, Y. F. Barnard, J. A.C. Sandberg, The thinking aloud method, Academic Press, London, (1994)
[28] A. Cattaneo, A. Maier, C. Spooner, D. A. Monsef, D. Leggett, D. Fadeyev, J. Gube, K. Knight, R. Schmidt, S. Snell, J. Tan, The Smash- ing Book, Smashing Media GmbH, Luebeck, (2009), pp. 64 - 73,
[29] P. N. Mendes, M. Jakob, A. Garcia-Silva, C. Bizer, DB- pedia Spotlight: Shedding Light on the Web of Doc-
uments, presented at I-SEMANTICS, Graz, Austria,
Sept. (2011), [Online]. Available: http://www.wiwiss.fu- berlin.de/en/institute/pwo/bizer/research/publications/Mendes- Jakob-GarciaSilva-Bizer-DBpediaSpotlight-ISEM2011.pdf
[30] W. Klas, B. Haslhofer, Multimedia Retrieval, University of Vienna, Vienna, (2010), pp. 277 - 280
[31] E. Marcotte, Responsive Web Design, New York: A Book Apart, (2011)