Lecture Notes in Computer Science Commenced Publication in 1973 Founding and Former Series Editors: Gerhard Goos, Juris Hartmanis, and Jan van Leeuwen
Editorial Board David Hutchison Lancaster University, UK Takeo Kanade Carnegie Mellon University, Pittsburgh, PA, USA Josef Kittler University of Surrey, Guildford, UK Jon M. Kleinberg Cornell University, Ithaca, NY, USA Alfred Kobsa University of California, Irvine, CA, USA Friedemann Mattern ETH Zurich, Switzerland John C. Mitchell Stanford University, CA, USA Moni Naor Weizmann Institute of Science, Rehovot, Israel Oscar Nierstrasz University of Bern, Switzerland C. Pandu Rangan Indian Institute of Technology, Madras, India Bernhard Steffen TU Dortmund University, Germany Madhu Sudan Microsoft Research, Cambridge, MA, USA Demetri Terzopoulos University of California, Los Angeles, CA, USA Doug Tygar University of California, Berkeley, CA, USA Gerhard Weikum Max-Planck Institute of Computer Science, Saarbruecken, Germany
6102
Gobinda Chowdhury Chris Koo Jane Hunter (Eds.)
The Role of Digital Libraries in a Time of Global Change 12th International Conference on Asia-Pacific Digital Libraries, ICADL 2010 Gold Coast, Australia, June 21-25, 2010 Proceedings
13
Volume Editors Gobinda Chowdhury University of Technology, Sydney PO Box 123, Broadway, NSW 2007, Australia E-mail:
[email protected] Chris Koo Nanyang Technological University 31 Nanyang Link, Singapore 637718 E-mail:
[email protected] Jane Hunter The University of Queensland Brisbane, QLD 4072, Australia E-mail:
[email protected]
Library of Congress Control Number: 2010927958 CR Subject Classification (1998): H.3, I.2, H.4, H.5, C.2, J.1 LNCS Sublibrary: SL 3 – Information Systems and Application, incl. Internet/Web and HCI ISSN ISBN-10 ISBN-13
0302-9743 3-642-13653-2 Springer Berlin Heidelberg New York 978-3-642-13653-5 Springer Berlin Heidelberg New York
This work is subject to copyright. All rights are reserved, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, re-use of illustrations, recitation, broadcasting, reproduction on microfilms or in any other way, and storage in data banks. Duplication of this publication or parts thereof is permitted only under the provisions of the German Copyright Law of September 9, 1965, in its current version, and permission for use must always be obtained from Springer. Violations are liable to prosecution under the German Copyright Law. springer.com © Springer-Verlag Berlin Heidelberg 2010 Printed in Germany Typesetting: Camera-ready by author, data conversion by Scientific Publishing Services, Chennai, India Printed on acid-free paper 06/3180
Preface
The year 2010 was a landmark in the history of digital libraries because for the first time this year the ACM/IEEE Joint Conference on Digital Libraries (JCDL) and the annual International Conference on Asia-Pacific Digital Libraries (ICADL) were held together at the Gold Coast in Australia. The combined conferences provided an opportunity for digital library researchers, academics and professionals from across the globe to meet in a single forum to disseminate, discuss, and share their valuable research. For the past 12 years ICADL has remained a major forum for digital library researchers and professionals from around the world in general, and for the Asia-Pacific region in particular. Research and development activities in digital libraries that began almost two decades ago have gone through some distinct phases: digital libraries have evolved from mere networked collections of digital objects to robust information services designed for both specific applications as well as global audiences. Consequently, researchers have focused on various challenges ranging from technical issues such as networked infrastructure and the creation and management of complex digital objects to user-centric issues such as usability, impact and evaluation. Simultaneously, digital preservation has emerged and remained as a major area of influence for digital library research. Research in digital libraries has also been influenced by several socio-economic and legal issues such as the digital divide, intellectual property, sustainability and business models, and so on. More recently, Web 2.0 technologies have had a significant influence on digital library research. Of particular interest to digital library researchers are issues including social networks, mobile technology, social tagging, and social information retrieval and access. Issues surrounding free versus fee-based information services, related intellectual property issues, the Open Archives Initiative, Creative Commons, institutional repositories, and of late Google Books will also have a significant impact on digital libraries of the future. Keeping this in mind, the theme of this year’s ICADL conference was “The Role of Digital Libraries in a Time of Global Change.” Given the large number of high-quality submissions, choosing the accepted papers for this conference proved a great challenge. Fortunately, a large number of international experts came forward to participate in the Program Committee and review papers. Following reviews of each submission by at least two, and in most cases by three or four, experts, a total of 21 full papers, 9 short papers and 7 posters were selected for this conference volume. Through this collection of papers and posters, this conference volume provides a snapshot of the current research and development activities in digital libraries around the globe in general, and in the Asia-Pacific region in particular. The papers have been arranged under the specific sub-themes of the conference, providing readers with an overview of the current research activities in digital libraries today. The conference was also significantly enriched by keynote papers from three world leaders in the field, Katy Borner of Indiana University, David Rosenthal of Stanford University and Curtis Wong of Microsoft Research. Prior to the conference, four tutorials were offered: Multimedia Information Retrieval, Introduction to Digital
VI
Preface
Libraries, Lightweight User Studies, and Managing Digital Libraries on the Web. In addition, four workshops were held on the final day following the main conference program: Music IR for the Masses, Digital Libraries for International Development, Global Collaboration of I-Schools, and Digital Libraries and Education. On behalf of the ICADL2010 Organizing Committee we would like to thank the authors for their submissions, the Program Committee for their outstanding reviews and the editorial team members without whose cooperation and support it would not be possible to prepare this conference volume. We would also like to convey our sincere thanks to our sponsors [Microsoft Research, SAGE Publications Asia Pacific Pte Ltd, ExLibris (Australia) Pty Ltd and the University of Queensland Library], the chairs and members of the Organizing Committee and the University Queensland for their generous help and support. Finally, we are thankful to Springer for publishing this conference volume.
June 2010
Gobinda Chowdhury Chris Khoo Jane Hunter
Organization
Organizing Committee General Chair Jane Hunter
The University of Queensland, Australia
Program Chairs Gobinda Chowdhury Chris Khoo Chun Xiao Xing
University of Technology, Sydney , Australia Nanyang Technological University, Singapore Tsinghua University, China
Tutorial Chairs Glenn Newton Tamara Sumner
National Research Council Canada University of Colorado, USA
Workshop Chairs Stephen Downie Shigeo Sugimoto
University of Illinois, USA University of Tsukuba, Japan
Poster and Demo Chairs Maureen Henniger Cecile Paris
University of Technology, Sydney, Australia CSIRO, Australia
Panel Chair Ron Larsen
University of Pittsburgh, USA
Publicity Chair Sally-Jo Cunningham
Waikato University, New Zealand
Doctoral Consortia Chairs Edie Rasmussen Schubert Foo
University of British Columbia, Canada Nanyang Technological University, Singapore
VIII
Organization
Program Committee Maristella Agosti Jamshid Beheshti Jose Borbinha Christine L. Borgman George Buchanan Hsinchun Chen Hsueh-hua Chen Sudatta Chowdhury Fabio Crestani Milena Dobreva Schubert Foo Edward Fox Dion Goh Preben Hansen Hao-Ren Ke Ross Harvey Jessie Hey Ian Ruthven Peter Jacso Min-Yen Kan Debal Kar Ray Larson Yuan-Fang Li Chern Li Liew Ee-Peng Lim Gavin McCarthy Michael Moss Jin-Cheon Na Paul Nieuwenhuysen Michael Olsson Edie Rasmussen Ingeborg Solvberg Shigeo Sugimoto Hussein Suleman Yin-Leng Theng Shalini Urs Ross Wilkinson Vilas Wuwongse Ding Ying
University of Padova, Italy McGill University, Canada IST/INESC-ID - Information Systems Group, Portugal UCLA, USA Swansea University, UK University of Arizona, USA National Taiwan University, Taiwan University of Technology, Sydney, Australia University of Lugano, Italy University of Strathclyde, UK Nanyang Technological University, Singapore Virginia Tech, USA Nanyang Technological University, Singapore Swedish Institute of Computer Science, Sweden National Taiwan Normal University, Taiwan Simmons College, USA University of Southampton, UK University of Strathclyde, UK University of Hawaii, USA National University of Singapore TERI, India University of California, USA The University of Queensland, Australia Victoria University, New Zealand Nanyang Technological University, Singapore University of Melbourne, Australia Glasgow University, UK Nanyang Technological University, Singapore Vrije Universiteit Brussel, Belgium University of Technology, Sydney, Australia University of British Columbia, Canada Norwegian University of Science and Technology University of Tsukuba, Japan University of Cape Town, South Africa Nanyang Technological University, Singapore University of Mysore, India Australian National Data Service AIT, Thailand Indiana University, USA
Table of Contents
Digital Libraries of Heritage Materials A Visual Dictionary for an Extinct Language . . . . . . . . . . . . . . . . . . . . . . . . Kyle Williams, Sanvir Manilal, Lebogang Molwantoa, and Hussein Suleman A Scalable Method for Preserving Oral Literature from Small Languages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Steven Bird Digital Folklore Contents on Education of Childhood Folklore and Corporate Identification System Design . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ya-Chin Liao, Kuo-An Wang, Po-Chou Chan, Yu-Ting Lin, Jung-I Chin, and Yung-Fu Chen Ancient-to-Modern Information Retrieval for Digital Collections of Traditional Mongolian Script . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Biligsaikhan Batjargal, Garmaabazar Khaltarkhuu, Fuminori Kimura, and Akira Maeda
1
5
15
25
Annotation and Collaboration A Collaborative Scholarly Annotation System for Dynamic Web Documents - A Literary Case Study . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Anna Gerber, Andrew Hyland, and Jane Hunter
29
The Relation between Comments Inserted onto Digital Textbooks by Students and Grades Earned in the Course . . . . . . . . . . . . . . . . . . . . . . . . . . Akihiro Motoki, Tomoko Harada, and Takashi Nagatsuka
40
Visualizing and Exploring Evolving Information Networks in Wikipedia . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ee-Peng Lim, Agus Trisnajaya Kwee, Nelman Lubis Ibrahim, Aixin Sun, Anwitaman Datta, Kuiyu Chang, and Maureen
50
Mobility and Migration Do Games Motivate Mobile Content Sharing? . . . . . . . . . . . . . . . . . . . . . . . Dion Hoe-Lian Goh, Chei Sian Lee, and Alton Yeow-Kuan Chua
61
A Multifaceted Approach to Exploring Mobile Annotations . . . . . . . . . . . . Guanghao Low, Dion Hoe-Lian Goh, and Chei Sian Lee
71
X
Table of Contents
Model Migration Approach for Database Preservation . . . . . . . . . . . . . . . . Arif Ur Rahman, Gabriel David, and Cristina Ribeiro
81
Natural Language Processing Automated Processing of Digitized Historical Newspapers beyond the Article Level: Sections and Regular Features . . . . . . . . . . . . . . . . . . . . . . . . . Robert B. Allen and Catherine Hall Keyphrases Extraction from Scientific Documents: Improving Machine Learning Approaches with Natural Language Processing . . . . . . . . . . . . . . Mikalai Krapivin, Aliaksandr Autayeu, Maurizio Marchese, Enrico Blanzieri, and Nicola Segata Measuring Peculiarity of Text Using Relation between Words on the Web . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Takeru Nakabayashi, Takayuki Yumoto, Manabu Nii, Yutaka Takahashi, and Kazutoshi Sumiya Imitating Human Literature Review Writing: An Approach to Multi-document Summarization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Kokil Jaidka, Christopher Khoo, and Jin-Cheon Na
91
102
112
116
Metadata A Study of Users’ Requirements in the Development of Palm Leaf Manuscripts Metadata Schema . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Nisachol Chamnongsri, Lampang Manmart, and Vilas Wuwongse
120
Landscaping Taiwan’s Cultural Heritages - The Implementation of the TELDAP Collection-Level Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Hsueh-Hua Chen, Chiung-Min Tsai, and Ya-Chen Ho
130
GLAM Metadata Interoperability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Shirley Lim and Chern Li Liew Metadata Creation: Application for Thai Lanna Historical and Traditional Archives . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Churee Techawut
140
144
Usability and Navigation A User-Centric Evaluation of the Europeana Digital Library . . . . . . . . . . . Milena Dobreva and Sudatta Chowdhury
148
Digital Map Application for Historical Photos . . . . . . . . . . . . . . . . . . . . . . . Weiqin Chen and Thomas Nottveit
158
Table of Contents
Supporting Early Document Navigation with Semantic Zooming . . . . . . . Tom Owen, George Buchanan, Parisa Eslambochilar, and Fernando Loizides
XI
168
Knowledge Structures PODD: An Ontology-Driven Data Repository for Collaborative Phenomics Research . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Yuan-Fang Li, Gavin Kennedy, Faith Davies, and Jane Hunter
179
A Configurable RDF Editor for Australian Curriculum . . . . . . . . . . . . . . . Diny Golder, Les Kneebone, Jon Phipps, Steve Sunter, and Stuart A. Sutton
189
Thesaurus Extension Using Web Search Engines . . . . . . . . . . . . . . . . . . . . . Robert Meusel, Mathias Niepert, Kai Eckert, and Heiner Stuckenschmidt
198
Images and Retrieval Preservation of Cultural Heritage: From Print Book to Digital Library - A Greenstone Experience . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Henny M. Sutedjo, Gladys Sau-Mei Theng, and Yin-Leng Theng Improving Social Tag-Based Image Retrieval with CBIR Technique . . . . . Choochart Haruechaiyasak and Chaianun Damrongrat
208 212
Identifying Persons in News Article Images Based on Textual Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Choochart Haruechaiyasak and Chaianun Damrongrat
216
Kairos: Proactive Harvesting of Research Paper Metadata from Scientific Conference Web Sites . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Markus H¨ anse, Min-Yen Kan, and Achim P. Karduck
226
Scholarly Collaborations Oranges Are Not the Only Fruit: An Institutional Case Study Demonstrating Why Data Digital Libraries Are Not the Whole Answer to E-Research . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Dana McKay Open Access Publishing: An Initial Discussion of Income Sources, Scholarly Journals and Publishers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Panayiota Polydoratou, Margit Palzenberger, Ralf Schimmer, and Salvatore Mele
236
250
XII
Table of Contents
Posters Ontology-Based Information Management: Exploiting User Perspective within the Motion Picture Industry . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Sharmin (Tinni) Choudhury, Kerry Raymond, and Peter Higgs Expertise Mapping Based on a Bibliographic Keyword Annotation Model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Choochart Haruechaiyasak, Santipong Thaiprayoon, and Alisa Kongthon Extended Poster Abstract: Open Source Solution for Massive Map Sheet Georeferencing Tasks for Digital Archiving . . . . . . . . . . . . . . . . . . . . . Janis Jatnieks Describing OAI-ORE from the 5S Framework Perspective . . . . . . . . . . . . . N´ adia P. Kozievitch and Ricardo da S. Torres
254
256
258 260
Matching Evolving Hilbert Spaces and Language for Semantic Access to Digital Libraries . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Peter Wittek, S´ andor Dar´ anyi, and Milena Dobreva
262
Towards a Pattern-Based Approach for Scientific Writing and Publishing in Chinese . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Hao Xu and Changhai Zhang
264
Evaluation Algorithm about Digital Library Collections Based on Data Mining Technology . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Yumin Zhao, Zhendong Niu, and Lin Dai
266
Author Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
269
A Visual Dictionary for an Extinct Language Kyle Williams, Sanvir Manilal, Lebogang Molwantoa, and Hussein Suleman Department of Computer Science University of Cape Town Private Bag X3, Rondebosch, 7701 {kwilliams,smanilal,lmolwantaa,hussein}@cs.uct.ac.za
Abstract. Cultural heritage artefacts are often digitised in order to allow for them to be easily accessed by researchers and scholars. In the case of the Bleek and Lloyd dictionary of the |xam Bushman language, 14000 pages were digitised. These pages could not be transcribed, however, because the language and script are both extinct. A custom digital library system was therefore created to manage and provide access to this collection as a purely “visual dictionary”. Results from user testing showed that users found the system to be interesting, simple, efficient and informative. Keywords: Digital preservation, repository, dictionary, Web interfaces.
1
Introduction
Cultural heritage in South Africa, like in most developing countries, is subject to degradation and inaccessibility. There is a clear need to preserve cultural heritage and make it accessible for the future. A snapshot of South African heritage would be incomplete without mentioning the Bushman people - one of the oldest known ethnic groups in the world. With the rapid influence of Western culture, there are now only a handful of these Bushmen people left in South Africa [1]. It is estimated that in a few years the entire generation of Bushman will have passed on, thereby creating a need to preserve whatever artefacts and knowledge exist from the Bushmen people in order to allow for them to be accessed in the future. The Bleek and Lloyd Collection is a collection of artefacts that document the life, language and culture of the Bushman people of Southern Africa. The collection is primarily made up of notebooks that contain Bushman stories, narratives and artwork. Included in this collection is a dictionary that contains English words and their corresponding |xam Bushman language translations. This dictionary can be used to assist researchers in understanding and interpreting the |xam Bushman language. However, the script used to represent the |xam language can not be represented using modern data encoding techniques. An accessible and preservable archive for a “visual dictionary,” where words are represented by images and definitions are extracted from viewing the images, known as the Bushman OnLine Dictionary (BOLD), was therefore built. Using this visual dictionary, users are able to browse, search and interact with the |xam words based on their English translations. G. Chowdhury, C. Khoo, and J. Hunter (Eds.): ICADL 2010, LNCS 6102, pp. 1–4, 2010. c Springer-Verlag Berlin Heidelberg 2010
2
2
K. Williams et al.
Related Work
The Native Languages of the Americas is a non-profit organisation that works towards preserving Native American languages by making use of Web technology [2]. The Nuer Field Notes Project is an attempt to preserve and make available a set of linguistic field notes recorded by Eleanor Vandevort, a missionary in South Sudan between 1949 and 1963, using modern data encoding techniques [3]. In addition to these specific attempts at preserving languages, there also are a number of general preservation attempts, such as the Contemporary African Music and Art Archive [4] and the Amarius archive [5]. In 2007, Suleman [1] devised an XML-centric approach to manage the notebooks and artwork in Bleek and Lloyd Collection, showing the XML-centric approach to be more efficient than the traditional database model. All of the above-mentioned systems allow users to readily access the collection of digital cultural artefacts. However, none of these systems preserve and make accessible a dictionary, which cannot be represented using modern data encoding techniques, as a live reference for researchers and other people who access the archives.
3
Design and Implementation
The BOLD system was built using Fedora Commons as an underlying digital repository system. Figure 1 shows the Web interface with which users interact with the visual dictionary. The Web interface shows the three classes of digital objects that make up the collection: envelopes, slips and inserts. For every word in the dictionary there is one or more envelopes, and each envelope contains one slip and one or more inserts. The |xam Bushman words and their corresponding English translations are written on the inserts. The following means of interaction with the visual dictionary are provided by the interface: Core services. Browsing and searching the visual dictionary based on the English translations of |xam words is the core functionality provided by the Web interface. The results of browsing and searching the visual dictionary should be such that they can assist researchers in understanding and interpreting the |xam language, even though the language cannot be represented using modern data encoding techniques. Users are able to browse the words in the dictionary by their English initial letters, or via a scrollable list. Users also can make use of an AJAX live search to find specific words in the dictionary. Enhancement for understanding. There are a number of services that attempt to assist the user in their understanding of the collection. The first of these services comes in the form of links to the notebooks of the Bleek and Lloyd Collection for each word displayed, thereby assisting in contextualising words. In addition to this, the definition of a word appears below it when it is clicked on and spelling correction suggestion takes place when a search is performed. Enhancement for experience. To improve the experience of the user when interacting with the collection, a history of all the words that have been searched
A Visual Dictionary for an Extinct Language
3
Fig. 1. The website users use to interact with the collection
for is stored in a session cookie and there is an image zoom function that zooms an image to the size of the browser viewport when the image is clicked on, thereby allowing for closer inspection of the image. Having briefly discussed the design and implementation of the BOLD visual dictionary, the next section will present an evaluation of the system.
4
Evaluation
The visual dictionary was evaluated using usability testing in which 22 users participated. User evaluation was conducted on a one-on-one basis in which users first answered a pre-test questionnaire. Users then were given an introduction to the Bleek and Lloyd Collection to read, after which they were asked to perform three tasks. They were then given free reign to experiment with the system and, lastly, were asked to answer a post-test questionnaire. The key findings from the evaluation are summarised here. 81% of users were 100% satisfied with the way in which they could search for a single word and 60% of users were 100% satisfied with the way they could search for multiple words. 72% of users were 100% satisfied with the way in which they could browse the system. Users noted that when searching for multiple words the system became slow and was not intuitive. However, overall the results show that the core services of searching and browsing were well received and resulted in high user satisfaction. Users felt that the system was easy to navigate and that there was adequate information to help with navigation. Users also found the dictionary to be generally informative and useful and felt that they could find information quickly. Users felt that their errors were easy to correct while 17 users agreed that the system furthered their knowledge in African Cultural Heritage. All users agreed that the system is useful for researching the |xam language. Users found the
4
K. Williams et al.
enhancement for understanding useful and were surprised by the apparent complexity of the |xam language script compared to English. Two users expressed that they felt like they did not know what they could do with the system. All but 2 users felt that the system was slow. The most appealing aspects of the visual dictionary were: the thumbnail view when browsing; the multiple ways of searching and the AJAX search; the simple layout, lack of clutter, pretty design, ease of use and easy navigation; the quick access to resources; high resolution images; rich information; and links to the Bleek and Lloyd Collection. The least appealing aspects of the visual dictionary were: that it was slow; the links to the Bleek and Lloyd notebooks were not intuitive; the interface was too simple; and the correction of misspelled words to suggested words that were not in the dictionary. The most prominent words used to describe the visual dictionary were: interesting, simple, effective and informative. Evaluation showed that users were generally happy with the system and felt as if they could use it in meaningful ways. In this sense, the BOLD Project shows that it has potential in meeting its goal of assisting researchers in interpreting and understanding the |xam Bushman language.
5
Conclusions
The Bushman OnLine Dictionary (BOLD) is a cultural heritage archive system for providing access to a visual dictionary for the |xam Bushman language, which forms part of the Bleek and Lloyd Collection. The system was built to assist researchers and scholars in understanding and interpreting |xam Bushman texts. The system contains core services for browsing and searching the archive, as well as services for enhancing user understanding and enhancing user experience. Evaluation showed that users had a positive experience using the system and were pleasantly surprised by many of its features. The BOLD Project is a first step in building a system that allows for meaningful interaction with a visual dictionary and has set the stage for future work to be done in this area.
References 1. Suleman, H.: Digital Libraries Without Databases: The Bleek and Lloyd Collection. In: Kov´ acs, L., Fuhr, N., Meghini, C. (eds.) ECDL 2007. LNCS, vol. 4675, pp. 392– 403. Springer, Heidelberg (2007) 2. Native Languages of the Americas: Preserving and promoting American Indian languages, http://www.native-languages.org/ 3. Nuer Field Notes, http://www.dlib.indiana.edu/collections/nuer/ 4. Marsden, G., Malan, K., Blake, E.: Using digital technology to access and store African art. In: CHI 2002 extended abstracts on Human factors in computing systems (CHI 2002), pp. 258–259. ACM, New York (2002) 5. Doumat, R., Egyed-Zsigmond, E., Pinon, J., Csiszar, E.: Online ancient documents: Armarius. In: Proceeding of the Eighth ACM Symposium on Document Engineering (DocEng 2008), pp. 127–130. ACM, New York (2008)
A Scalable Method for Preserving Oral Literature from Small Languages Steven Bird Dept of Computer Science and Software Engineering, University of Melbourne Linguistic Data Consortium, University of Pennsylvania
Abstract. Can the speakers of small languages, which may be remote, unwritten, and endangered, be trained to create an archival record of their oral literature, with only limited external support? This paper describes the model of “Basic Oral Language Documentation”, as adapted for use in remote village locations, far from digital archives but close to endangered languages and cultures. Speakers of a small Papuan language were trained and observed during a six week period. Linguistic performances were collected using digital voice recorders. Careful speech versions of selected items, together with spontaneous oral translations into a language of wider communication, were also recorded and curated. A smaller selection was transcribed. This paper describes the method, and shows how it is able to address linguistic, technological and sociological obstacles, and how it can be used to collect a sizeable corpus. We conclude that Basic Oral Language Documentation is a promising technique for expediting the task of preserving endangered linguistic heritage.
1
Introduction
Preserving the world’s endangered linguistic heritage is a daunting task, far exceeding the capacity of existing programs that sponsor the typical 2-5 year “language documentation” projects. In recent years, digital voice recorders have reached a sufficient level of audio quality, storage capacity, and ease of use, to be used by local speakers who want to record their own languages. This paper investigates the possibility of putting the language preservation task into the hands of the speech community. With suitable training, they can be equipped to record a variety of oral discourse genres from a broad cross-section of the speech community, and then provide additional content to permit the recordings to be interpreted by others who do not speak the language. The result is an audio collection with time-aligned translations and transcriptions, a substantial archival resource. This paper describes a method for preserving oral discourse, originating in field recordings made by native speakers, and generating a variety of products including digitally archived collections. It addresses the problem of unwritten languages being omitted from various ongoing efforts to collect language resources for ever larger subsets of the world’s languages [1]. The starting point is Reiman’s work [2], modified and refined so that it uses appropriate technology G. Chowdhury, C. Khoo, and J. Hunter (Eds.): ICADL 2010, LNCS 6102, pp. 5–14, 2010. c Springer-Verlag Berlin Heidelberg 2010
6
S. Bird
for Papua New Guinea, and so that it can scale up easily. The method has been tested with Usarufa, a language of Papua New Guinea. Usarufa is spoken by about 1200 people, in a cluster of six villages in the Eastern Highlands Province, about 20km south of Kainantu (06◦ 25’S, 145◦ 39’E). There are probably no fluent speakers of Usarufa under the age of 25; only the oldest speakers retain the rich vocabulary for animal and plant species, and for a variety of cultural artefacts and traditional practices. Some texts including the New Testament and a grammar have been published in Usarufa [3]. However, only a handful of speakers are literate in the language.
2 2.1
Basic Oral Language Documentation Audio Capture
The initial task in Basic Oral Language Documentation (BOLD) is audio capture. Collecting the primary text from individual speakers is straightforward. They press the record button, hold the voice recorder a few inches from their mouth, and begin by giving their name, the date, and location. The person operating the recorder may or may not be the speaker.
Fig. 1. Informal Recording of Dialogue and Personal Narrative
Collecting a dialogue involves two speakers plus someone to operate the voice recorder (who may be a dialogue participant). The operator can introduce the recording and hold the recorder in an appropriate position between the participants. The exchange shown in Fig. 1 involved a language worker (left), the author, and a village elder. The dialogue began with an extended monologue from the man on the left, explaining the purpose of the recording and asking the other man to recount a narrative, followed by some conversation for clarification, followed by an extended monologue from the man on the right. The voice recorder was moved closer to the speaker during these extended passages, but returned to the centre during conversational sections. In most cases, the person operating the recorder was a native speaker of Usarufa, and was also participating in the dialogue. The operator was instructed not to treat the recorder like a hand-held microphone, moved deliberately between an interviewer and interviewee to signal turns in the
A Scalable Method for Preserving Oral Literature from Small Languages
7
conversation. Instead, the recorder was to be held still, and usual linguistic cues were to be used for marking conversational turns. A configuration which was not tried would be to have separate lapel microphones, one per speaker, connected to the digital voice recorder via a splitter jack. However, this would have involved four pieces of equipment (recorder, splitter, and two microphones), and increased risks of loss, incorrect use, and degraded signal quality. 2.2
Oral Annotation and Text Selection
The oral literature collected in the first step above has several shortcomings as an archival resource. Most obviously, its content is only accessible to speakers of the language. If the language falls out of use, or if knowledge of the particular word meanings of the texts is lost, then the content becomes inaccessible. Thus, it is important to provide a translation. Fortunately, most speakers of minority languages also speak a language of wider communication, and so they can record oral translations of the original sources. This can be done by playing back the original recording, pausing it regularly, and recording a translation on a second recorder, a process which is found to take no more than five minutes for each minute of source material. A second shortcoming is that the original speech may be difficult to make out clearly by a language learner or non-speaker. The speech may be too fast, the recording level may be too low, and background noise may obscure the content. Often the most authentic linguistic events take place in the least controlled recording situations. In the context of recording traditional narratives, elderly speakers are often required; they may have a weak voice or few teeth, compromising the clarity of the recording. These problems are addressed by having another person “respeak” the original recording, to make a second version [2,4]. This is done at a slower pace, in a quiet location, with the recorder positioned close to the speaker. This process has also been found to take no more than five minutes for each minute of source material. A third shortcoming is that the original collection will usually be unbalanced, having a bias towards the kinds of oral literature that were the easiest to collect. While it is possible to aim for balance during the collection process, one often cannot predict which events will produce the best recordings. Thus, it is best to capture much more material than necessary, and only later create a balanced collection. Given that the respeaking and oral translation take ten times real time, we suggest that only 10% of the original recordings are selected. This may be enough for a would-be interpreter in the distant future to get a sufficient handle on the materials to be able to detect structure and meaning in the remaining 90% of the collection. The texts are identified according to the following criteria: 1. cultural and linguistic value: idiomatic use of language, culturally significant content, rich vocabulary, minimal code-switching 2. diversity: folklore, personal narrative, public address, dialogue (greeting, discussion, instruction, parent-child), song 3. recording quality: clear source recording, minimal background noise
8
2.3
S. Bird
Recommended Protocol for Oral Annotation
The task of capturing oral transcriptions and translations onto a second recorder offers an array of possibilities. After trying several protocols, we settled on the one described here. The process requires two native speakers with specialised roles, the operator and the talker, and is illustrated in Fig. 2.
Fig. 2. Protocol for Respeaking and Oral Translation: the operator (left) controls playback and audio segmentation; the talker (right) provides oral annotations using a second recorder
Once a text has been selected, it is played back in its entirety, and the two language workers discuss any aspect of the recording which is problematic. For instance, older people captured in the recordings may have used near-obsolete vocabulary unknown to younger language workers. This preview step is also important as the opportunity to experience the context of the text; sometimes a text is so enthralling or amusing that the oral annotators are distracted from their work. When they are ready to begin recording, the operator holds the voice recorder close to the talker, with the playback speaker (rear of recorder) facing the talker. The talker holds the other recorder about 10cm from his/her mouth, turns it on, checks that the recording light came on, and then introduces the recording, giving the names of the two language workers, the date and location, and the identifier of the original recording. For the respeaking task, the operator pauses playback every 5-10 words (2-3 seconds), with a preference for phrase boundaries. For the translation task, the operator pauses playback every sentence or major clause (5-10 seconds), trying to include complete sense units which can be translated into full sentences. The talker leaves the second recorder running the whole time, and does not touch the controls. This recorder captures playback of the original recording, along with the respoken version or the translation. The operator monitors the talker’s speech, ensuring that it is slow, loud, and accurate. The operator uses agreed hand signals to control the talker’s speed and volume, and to ask for the phrase to
A Scalable Method for Preserving Oral Literature from Small Languages
9
be repeated. When necessary, the talker is prompted verbally with corrections or clarifications, and any interactions about the correct pronunciation or translation are captured on the second recorder. Once the work is complete, recording is halted, and the logbooks for both recorders are updated. 2.4
Logbooks
For each primary text, the language workers note the date, location, participant names, topic, and genre, using the logbook provided with each recorder. Genre is coded using the OLAC Discourse Type vocabulary [5]. If there is any major problem during the original recording, a fresh recording is started right away. Pausing to delete files is a distraction, draws attention to the device, and is prone to error. The recorder has substantial capacity and extraneous recordings can easily be filtered out later during the selection process.
Fig. 3. Metadata Capture in Village: (a) creating metadata by listening to the opening of each recording; (b) scanned page showing file identifier, participants, topic and genre (date and location were already known in this case)
2.5
Summary
Fig. 4 summarises the process, assuming 10 hours (100k words) of primary recordings are collected. It includes a third stage – not discussed above – involving pen and paper transcription using any orthography or notation known
Fig. 4. Overview of Basic Oral Language Documentation
10
S. Bird
to the participants, such as the orthography of the language of wider communication. Such transcripts, while imperfect, serve as a finding aid and as a clue to linguistically salient features such as sound contrasts and word breaks. A separate archiving process involves occasional backup of recorders onto a portable mass storage device, keyboarding texts and metadata, and converting audio files to a non-proprietary format, steps that typically require outside support.
3
Pilot Study in Papua New Guinea
The above protocol was developed during a pilot study during April-June 2009. Bird and Willems trained a group of language workers in the village for one week, then left them to do oral literature collection and oral annotation for a month, then brought them into an office environment to work on further oral annotation and textual transcription. In this section, the activities are briefly described and the key findings are reported. 3.1
Activities
Village-based training. Teachers, literacy workers, and other literate community members were gathered for a half-day training session. It took place in the literacy classroom in Moife village, with everyone sitting on the floor in a circle. We explained the value of preserving linguistic heritage and demonstrated the operation of the voice recorders. Participants practiced using the recorders and were soon comfortable with the controls and with hearing their own voices. Next, participants took turns to record a narrative while the rest of the group observed. Later, we demonstrated the oral annotation methods and the participants practiced respeaking and oral translation. The four recorders were loaned out, and participants were asked to collect oral literature during the evening and the next day, and to return the following day to review what they collected and to continue practicing oral annotation. A further five days were spent doing collection and annotation under the supervision of Bird and Willems. Village-based collection and oral annotation. In the second stage, we sent the digital voice recorders and logbooks back to the village for two 2-week periods. This would assess whether the training we provided was retained. Could the participants find time each day for recording activities? Could they meet with an assigned partner to do the oral annotation work using a pair of recorders? Could they maintain the logbooks? Apart from reproducing the activities from the first stage, they were asked to broaden the scope of the work in three ways. First, they were to collect audio in a greater range of contexts (e.g. home, market, garden, church, village court) and a greater range of genres (e.g. instructional dialogue, oratory, child-directed speech). They were to include a wider cross-section of the community, including elderly speakers and children, and to go to the other villages where Usarufa is spoken, up to two hours walk away. Finally, they were asked to train another person in collecting oral discourse and maintaining the logbook, then entrust the recorder to that person.
A Scalable Method for Preserving Oral Literature from Small Languages
11
Town-based oral annotation and transcription. In the third stage, we asked the language workers come to Ukarumpa, a centralized Western setting 20km away, near Kainantu, with office space and mains electricity. This provided a clean and quiet environment for text selection and oral annotation, plus the final step of the BOLD protocol: writing out the transcriptions and translations for a selection of the materials. The town context also permitted us to explore the issue of informed consent. Four speakers saw how it was possible to access materials for other languages over the Internet (see Fig. 5), and even listen to recordings of dead languages. As community leaders, they gave their written consent for the recorded materials to be placed in a digital archive with open access.
Fig. 5. Experiencing the Web and Online Access to Archived Language Data
3.2
Findings
The findings summarized here include many issues that were encountered early on in the pilot study but resolved in time for the town-based stage, leading to the protocol described in Section 2 above. Recording. The Usarufa speakers had no difficulty in operating the recorders and collecting a wide variety of material. The built-in microphone and speaker avoided the need for any auxiliary equipment. The clear display and large controls were ideal, and the small size of the device meant it could be hidden in clothing and carried safely in crowded places. We gave out four recorders for periods of up to two weeks, and some were lent on to others, but none were lost or damaged. Many members of the speech community were willing to be recorded, though some speakers spoke in a stilted manner once the recorder was turned on, and others declined to be recorded unless they were paid a share of what they assumed the language workers were being paid per recording. Respeaking. Talkers usually adopted the fast tempo of the original recording, in spite of requests to produce careful speech. When the audio segment was long, they sometimes omitted words or gave a paraphrase. Texts from older people presented difficulties for younger speakers who did not always know all
12
S. Bird
the vocabulary items. These problems were resolved, by having a second person control playback and monitor speed and accuracy of the respoken version, and by having both people listen through the recording first, to discuss any problematic terms or concepts. Oral Translation. A key issue was the difficulty in translating specialised vocabulary into the language of wider communication (Tok Pisin). For example, the name of a tree species might be translated simply as diwai (tree), or sampela kain diwai (some kind of tree). They were asked to mention any salient physical or cultural attributes of the term the first time it was encountered in a text. Another problem arose as a consequence of using the transcriber to control playback. The translator sometimes paused mid translation, in order to compose the rest of the translation before speaking. This pause was sometimes mistaken for the end of the translation, and the transcriber would resume playback. Occasionally, the resumed translation and resumed playback overlapped (just like when two people might start speaking simultaneously after a brief pause in conversation). This problem is solved by having the translator nod to the operator when s/he is finished translating a segment. Segmentation. Fundamental to respeaking and translation is the decision about where to pause playback of the original recording. While listening to playback, one needed to anticipate phrase boundaries in order to press the pause button. Older participants, or those with less manual dexterity, tended to wait until they heard silence before deciding to pause playback, by which time the next sentence had started. These problems were largely resolved once we adopted the practice of having participants review and discuss recordings before starting oral annotation, and simply through practice (e.g. about an hour of doing oral annotation). Metadata. Each participant was able to document their recordings in the supplied logbook. There was some variability in how the participants interpreted the instructions, resolved in later work by attaching a fold-out flyer with examples in the back of the logbooks. It was easy for anyone to check the state of completeness of the metadata by pressing the folder button to cycle through the five folders, and checking the current file number against the corresponding page of the exercise book. At the end of the pilot study, the logbooks were scanned and converted to PDF format for archiving. These scans are the basis for creating OLAC metadata records [6,7]. Archiving. The contents of the recorders were transferred to a computer via a USB cable. We had engraved unique identifiers on the recorders, but the filenames inside each recorder were identical, and care had to be taken to keep them separate on disk. A more pernicious problem was that the file names displayed on the recorder (e.g. folder C, file 01) did not corresponded to the name inside the device, where file numbers were in time order and not relative to folder. For example, C01 could have filename VN52017 (which means that it is the 17th file
A Scalable Method for Preserving Oral Literature from Small Languages
13
on the recorder, even though it is the first file in Folder C). Thus, the identifier for the audio file (machine id, folder letter, file number) should be spoken at the start of each recording. (Care must be taken to only read out the file number once recording has started.) A selection of the audio files were burnt on audio CD for use back in the village, and the complete set of recordings are being prepared for archiving with PARADISEC [8], and with the Institute of PNG Studies in Port Moresby.
4
Conclusions and Further Work
This paper has described a method for preserving oral literature that has been shown to work effectively for a minority language in the highlands of Papua New Guinea. Using appropriate technology and a simple workflow, people with no previous technical training were able to collect a significant body of oral literature (30 hours), and provide oral annotations and textual transcriptions for a small selection. Much of the collection and annotation work could happen in the evenings, when people were sitting around their kitchen houses lit only by the embers of a fire and possibly a kerosene lantern. At US $50 per recorder, it was easy to acquire multiple recorders, and little was risked when they were given out to people to take away for days at a time. Note that the important matters of access and use have not been addressed here (cf. [9,10]). This approach to language documentation has several benefits. It harnesses the voluntary labour of interested community members who already have access to a wide range of natural contexts where the language is used, and who decide what subjects and genres to record, cf. [11], and who are in an excellent position to train others. They are also able to move around the country to visit other language groups far more easily than a foreign linguist could. As owners of the project they may be expected to show a higher level of commitment to the task, enhancing the quality and quantity of the collected materials. The activities easily fit alongside language development activities, adding status and substance to those activities, and potentially drawing a wider cross-section of the community into language development. Limited supervision by a trained linguist/archivist is required between the initial training and the final archiving. Metadata can be collected alongside the recording activities in a simple logbook which accompanies the voice recorder, and then captured for the later creation of electronic metadata records. The whole process is able to sit alongside ongoing language documentation and development activities (and there is no suggestion that it supplant these activities). Building on the success of the pilot study, a much larger effort is underway in 2010, involving 100 digital voice recorders donated by Olympus Imaging Corporation, in collaboration with the University of Goroka, the University of PNG, Divine Word University, the Institute of PNG Studies, and the Summer Institute of Linguistics, with sponsorship from the Firebird Foundation for Anthropological Research (http://boldpng.info/).
14
S. Bird
Acknowledgments I am indebted to staff of the Summer Institute of Linguistics at Ukarumpa, especially Aaron Willems, for substantial logistical and technical support.
References 1. Maxwell, M., Hughes, B.: Frontiers in linguistic annotation for lower-density languages. In: Proceedings of the Workshop on Frontiers in Linguistically Annotated Corpora 2006. Association for Computational Linguistics, pp. 29–37, http://www.aclweb.org/anthology/W06-0605 2. Reiman, W.: Basic oral language documentation, Presentation at the First International Conference on Language Documentation and Conservation (2009) 3. Bee, D.: Usarufa: a descriptive grammar. In: McKaughan, H. (ed.) The Languages of the Eastern Family of the East New Guinea Highland Stock, pp. 324–400. University of Washington Press (1973) 4. Woodbury, A.C.: Defining documentary linguistics. In: Austin, P. (ed.) Language Documentation and Description, vol. 1, pp. 35–51. SOAS, London (2003) 5. Johnson, H., Aristar Dry, H.: OLAC discourse type vocabulary (2002), http://www.language-archives.org/REC/discourse.html 6. Bird, S., Simons, G.: Extending Dublin Core metadata to support the description and discovery of language resources. Computers and the Humanities 37, 375–388 (2003), http://arxiv.org/abs/cs.CL/0308022 7. Bird, S., Simons, G.: Building an Open Language Archives Community on the DC foundation. In: Hillmann, D., Westbrooks, E. (eds.) Metadata in Practice: a work in progress. ALA Editions, Chicago (2004) 8. Barwick, L.: Networking digital data on endangered languages of the Asia Pacific region. International Journal of Indigenous Research 1, 11–16 (2005) 9. Duncker, E.: Cross-cultural usability of the library metaphor. In: JCDL 2002: Proceedings of the 2nd ACM/IEEE-CS Joint Conference on Digital Libraries. Association for Computing Machinery, pp. 223–230 (2002) 10. Jones, M., Harwood, W., Buchanan, G., Lalmas, M.: StoryBank: an Indian village community digital library. In: JCDL 2007: Proceedings of the 7th ACM/IEEECS Joint Conference on Digital Libraries. Association for Computing Machinery, pp. 257–258 (2007) 11. Downie, J.S.: Realization of four important principles in cross-cultural digital library development. In: JCDL Workshop on Cross-Cultural Usability for Digital Libraries (2003)
Digital Folklore Contents on Education of Childhood Folklore and Corporate Identification System Design Ya-Chin Liao1,*, Kuo-An Wang2,*, Po-Chou Chan2, Yu-Ting Lin3, Jung-I Chin2, and Yung-Fu Chen4,** 1
Department of Commercial Design, National Taichung Institute of Technology, Taichung 40402, Taiwan, ROC
[email protected] 2 Department of Management Information Systems 3 Center of General Education, Central Taiwan University of Science and Technology, Taichung 40601, Taiwan {gawang,bjjem,jichin}@ctust.edu.tw,
[email protected] 4 Department of Health Services Administration, China Medical University, 91 Hsueh-Shih Road, Taichung 40402, Taiwan Tel.: 886-4-22053366 ext. 6315; Fax: 886-4-22031108
[email protected] Abstract. Digital artifacts preserved in digital repositories of museums are mostly static images. However, the artifacts may be lost, degraded, or damaged no matter how well the preservation and exhibition environments have been controlled, which makes the artifacts difficult to recover. Furthermore, if not properly inherited, information regarding making, function, and usage of an artifact might be lost after several generations. Hence, in addition to digitizing folklore artifacts, we have also digitized the crafts in how to make them and skills and rituals in how to use them to be recorded in videos. With abundant digitized collections, the repository website is becoming more and more popular for teachers and students, especially in kindergartens and elementary schools, to extract and create useful teaching materials for folklore education. Recently, folklore contents have been encouraged to be applied in the education of English as second language (ESL), social work, and mathematics. In this study, we applied the digital folklore contents for developing story books to be used in childhood folklore education and for instructing students to design corporate identification system (CIS) as a class exercise. Technology acceptance model (TAM) was used to evaluate perceived usefulness (PU), perceived ease of use (PEU), and behavior intention (BI) in using these digital contents to accomplish their tasks. The results show that the scores of PU, PEU, and BI are all greater than 3 (5-point Likert scale) indicating usefulness and ease of use of the contents and website, as well as a positive attitude toward continuous use of the contents in various educational areas.
1 Introduction Folklore may refer to unsubstantiated beliefs, legends and customs, currently existing among the common people [1] or substantiated artifacts, crafts, skills, and rituals, *
Co-first authors who contributed equally to this work. K.A. Wang is also with Dep. of CSIE, National Chi Nan University. ** Corresponding author. G. Chowdhury, C. Khoo, and J. Hunter (Eds.): ICADL 2010, LNCS 6102, pp. 15–24, 2010. © Springer-Verlag Berlin Heidelberg 2010
16
Y.-C. Liao et al.
widely governing the living style of the common people [2]. It reflects on the ancestral missions that have shaped a people and the inherited values that they reflect on their daily lives and pass to the future generations [3]. In general, folklore refers to the society and culture tradition of the common people and the customs practiced and beliefs held by the vast majority of people in the cultural mainstream that they have inherited from their ancestors [3]. As a result, the value of folklore artifacts, crafts, skills, and rituals lies in their demonstration of popular conceptions, life wisdom and the ancestral legacy hidden within the culture. Their basic value lies in their tight intermeshing of spirituality, psychology, and social mores, as well as their social functions and symbolic cultural meanings lie largely in their artistic and historical worth. 1.1 Significance of Digitizing Folklore Artifacts and Activities Recently, digital contents of biology, archeology, geology, anthropology, architecture, art, language (dialect), and so forth, have been widely developed in Taiwan (http://catalog.digitalarchives.tw) and around the world. However, most of these contents emphasized on static artifacts instead of the crafts in making them or the skills and rituals in using these digitized artifacts. The artifacts may be lost, degraded, or damaged no matter how well the preservation and exhibition environments are monitored and controlled. The degraded or damaged artifacts are not easy to recover. Furthermore, manufacturing, functions, and usages of the artifacts might be forgotten after several generations if not properly inherited. Hence, it is very important to preserve the crafts in making, the skills in operating, and the ceremonies or rituals in using the artifacts. In our previous investigations, in addition to folklore artifacts [2], folklore activities [4] have also been digitized for the preservation of Taiwanese tradition and culture. For example, the craft in making puppets concerning wood sculpture, painting, clothing, and decoration, as well as the skill of using or playing the puppet in religious rituals involving delicate finger operation, hand control, and arm and body movements. Besides, folklore and religious rituals have their spiritual meaning that step-by-step procedure embeds significant meaning for a people or a religion. The artifacts collected by national or local museums are mostly incomplete. Although Taiwanese Folklore Museum is a popular multi-function site with an important mission in the exhibition and preservation of representative folklore artifacts, there are only 1412 artifacts currently preserved in this museum. In order to extend the digital folklore contents, two strategies have been adopted to supplement insufficiency of the collected artifacts. First, folklore hobbyists are regularly invited to demonstrate their private collections, which will be digitized by the task force of the digital preservation team of the museum for extending the number of digital contents. Another aggressive strategy is to sign cooperation agreements with the members of folklore associations by giving services to digitize their personal collections [5]. As a result, 2140 additional digitized artifacts have been added to the digital repository. With the extended digital contents in hand, the website of Taiwanese Folklore Museum is becoming even more popular for folklore hobbyists, students, and teachers, especially in the kindergartens and primary schools, to extract and prepare their teaching materials for folklore, social work, and other educations.
Digital Folklore Contents on Education of Childhood Folklore
17
1.2 Web-Based Learning Motivated by the investigations which showed that media richness facilitates learning of courses with high uncertainty and equivocality [6] and that e-learning with interactive videos gains more learner satisfaction than non-interactive and traditional classroom learning [7], digital contents of crafts, skills, and rituals have been developed for the purpose of both digital preservation and online education [4]. The same concept was applied to digitize childcare standard operation procedures (SOPs) [8]. In contrast to general non-interactive e-learning and traditional classroom learning style, in a previous study we proposed a metadata-based method for recording each step of folklore activity as a metadata record in which the title, description, associated digital media, and other related information are all included [4]. In addition, folklore artifacts related to individual folklore activities are also linked in the metadata for seamless integration. Recently, a web-based (MOSAICA) system, which integrates numerous functions including preservation of culture heritage and provision of interactive and creative educational experience, has been shown to be valuable in enhancing people with different cultural backgrounds to have positive attitude toward open-mindedness through learning from stories, customs, and diverse cultures via hypertext [9]. Hence, it is promising in facilitating folklore and other educations based on digital folklore contents preserved in digital repositories.
2 Development of Digital Taiwanese Folklore Contents The digital folklore contents consist of folklore artifact and activities. The dimensions, originalities, functions, and other detailed descriptions of folklore artifacts were examined, investigated, and recorded by folklore specialists. Metadata based on the Dublin core were used to record individual folklore artifacts and activities to be compatible with international standard. All the digitized contents are stored in a database system with a website (http://www.folkpark.org.tw) designed for providing general publics, students, instructors, and researchers to browse and surrogate the digital contents.
(a)
(b)
(c)
(d)
(e)
(f)
(g)
(h)
(i)
(j)
Fig. 1. Folklore artifacts preserved were classified into ten categories: (a) Clothing and Jewelry, (b) Kitchenware and Dinnerware, (c) Furnishings, (d) Transportation, (e) Religion and Religious Ceremonies, (f) Aborigines, (g) Documents and Deeds, (h) Machinery and Tools, (i) Study, and (j) Arts and Recreation
18
Y.-C. Liao et al.
Digitized Folklore Artifacts. A total of 1412 artifacts preserved in the Taiwanese Folklore Museum were classified into ten categories according to their life styles and functions (Fig. 1). In addition, 2140 artifacts and artworks collected by folklore artists or hobbyists had also been digitized and pooled to the digital content repository (Fig. 2).
(a)
(b)
(c)
(d)
(g)
(h)
(i)
(j)
(f)
(e)
(k)
(l)
Fig. 2. Folklore artifacts and arts digitized during exhibitions: (a) Bride Wore Red, (b) Historical Documents from Old Taichung, (c) Artifacts from When Grandparents Were Young, (d) Collection of Cicada-shaped Jade Pieces, (e) Carvings by Hsu Pei-ming, (f) Paintings and Personal Letters by Contemporary Taiwan Artists, (g) Carved Wooden Puppets, (h) Jade Auspicious Animals, (i) Handicrafts Decorated Using Plant Dye and Indigo Blue, (j) Wood-fired Ceramic Creations, (k) Ancient Taiwanese Religious Books and Paintings, and (l) Dream of the Red Chamber-themed Art and Handicrafts.
Digitized Folklore Activities. Step-by-step folklore activities were demonstrated practically by the folklore specialists invited to participate in this study and the actions were taken by a professional photographer using a digital camcorder with a resolution of 640x480 pixels. The text and oral description of a folklore activity were done by a folklorist who majors in this specific activity. Video clips of individual steps were obtained by using the video editing software to edit a video sequence and saved as the Microsoft wmv and Apple Quicktime formats. These video clips were then combined with other related information and recorded using metadata format compatible with the Dublin core standard. Metadata designed based on the Taiwanese folklore artifacts [3] were extended to include folklore crafts, skills, and rituals, in which the “Relation” element contains two quantifiers, i.e. “Has Part” and “Is Part Of”, is used to interlink between the main (parent) metadata record and its children metadata of individual steps [4,5]. Table 1. Step-by-step demonstration of bamboo weaving craft
(1) Scraping
(2) Splitting into strips
(3) Splitting into thinner strips
(4) Trimming strip width
(5) Trimming thickness
(6) Round mouth weaving
(7) Weaving the bottom
(8) Drawing in the mouth
(9) Making the base
(10) Making the handle
Digital Folklore Contents on Education of Childhood Folklore
19
An example of step-by-step demonstration of bamboo weaving is described in Table 1. Each step in this table has a corresponding video segment. Additionally, a main (parent) metadata record is used to interlink with its related activity steps (children) by the “Relation” element proposed by the Dublin core, in which the element contains two Quantifiers; i.e., “Has Part” and “Is Part Of” for describing the sequential relation between the parent and children metadata records. Furthermore, the Quantifier “Reference source” is applied for expressing its relationship with other artifacts or folklore activities. The “Has Part” Qualifier is used for the parent metadata record to relate to its children steps, while the “Is Part Of” for the child steps to trace back to their parent. With this mechanism, all the child steps can be tightly connected to their parent so that the webpage can support flexible interaction between the users and the browsers for easy navigation. The Quantifier “Sub-Collection Type” was added to the Element “Type” in the metadata proposed in [2]. Table 2 shows a total of 24 digitized folklore activities which include craft (A1-A12), skills (B1-B9), and ceremonies or rituals (C1-C3). Table 2. Digitized folklore activities
(A1) Dough figurines
(A2) Bamboo weaving
(A3) Bamboo utensil carving
(A7) Pottery
(A8) Wooden carving
(A9) Painting of (A10) New (A11) Plant dying(A12) Calligraphy brush making objects Year’s paintings
(B1) Top spinning(B2) Puppet show (B3) Gongs & perform. perform. drums perform.
(B7) Dulcimer performance
(B8) Nanhu performance
(A4) Piece (A5) Puppet A6) Art cultivated together the cloth head carving in pot
(B4) Nanguan (B5) Trad. music performances performance
(B6) Ruan performance
(B9) Guzheng (C1) Spring Bull (C2) Venerating (C3) Turning performance Hitting Festival Heaven Ruler Adult Ceremony
Website for Presenting Digital Contents. The web-based system is implemented under XML protocol. Basically, XML is a way of structuring information and sending it from one software component to another. In the website, XML is used for exchanging digital contents between different museums. Figure 3 shows the homepage of the website supporting digital preservation of folklore artifacts and activities. For each craft, skill, or ritual, a step-by-step video demonstration accompanied with either Chinese or English description can be selected. Figure 4 demonstrates the homepage of a partner museum and its digital contents of folklore artifacts collected by hobbyists.
20
Y.-C. Liao et al.
(a)
(b)
Fig. 3. Home page of the Taiwanese Folklore Museum for demonstrating (a) folklore artifacts and (b) folklore activities
(a)
(b)
Fig. 4. Homepage of a collaborated folklore society: (a) Blog page of a member for information exchange with other members and (b) his digitized collected artifacts
3 Adoption of Digital Folklore Contents for Education Recently, folklore contents have been encouraged to be applied in the education of ESL (English as second language) [10], social work [11], and mathematics [12]. Bowman [10] stated that knowledge of folklore and ethnography is good discussion material for language education. It was suggested that language teachers should take at least an introductory folklore course [10]. Lee et al. [12] proposed a web-based learning system designed based on a well-known Chinese folklore story for teaching secondary school students basic probability. It was reported that the outcome is encouraging because the system provides a near-real learning environment enticing the students’ interests and motivations to use the system to learn. Furthermore, folklore knowledge and skill, especially in diverse culture groups, are deemed as powerful tools for facilitating efficiency of social works [11]. Students who major in social work having strong folklore skill and understanding will be more competent in social work practice. Open-mindedness is crucial for people to accommodate diverse views and opinions, which in turn enable ones to have critical thinking in making important decision [9]. Nakanishi and Rittner [13] addressed that people must learn their own culture before learning the cultures of other peoples. Hence, learning our own folklore
Digital Folklore Contents on Education of Childhood Folklore
21
will enable the students to be more open-minded to accommodate and tolerate different views regarding political policies, social opinions, ethnic identity, or religious beliefs. Motivated by the aforementioned investigations and findings, we applied the digital folklore contents developed in past years for developing story books to be used in childhood folklore education. In addition, these contents were also used for instructing students majoring in commercial design to design Corporate Identification System (CIS) for Taiwan Folklore Museum as a class exercise. Childhood Folklore Education. Taiwan Folklore Museum is sponsored by city government of Taichung and is currently run by a university. In addition to collection, preservation, and exhibition of folklore artifacts, another important mission is that it dedicates to folklore education for citizens, especially children, around the country. The number of annual visitors is more than 20,000, among them more than 80% are kindergarten students and pre-school children. Storytelling is deemed as a viable way and instructional strategy for promoting cultural competence for students [11]. In this study, stories used for childhood folklore education were composed based on the collected artifacts and activities by students who major in early childhood care and multimedia design. Figure 5 demonstrates an example of the composed stories. The upper row shows the digitized artifact accompanied with its description written by a folklorist. Sampled clips of the story book are displayed at the bottom row. Halter tops: Halter tops were the innermost layer of clothing and were in direct contact with the skin. This rounded halter top is relatively narrow overall and the lower half even more so. It is probably a children's halter top from mainland China. The top and side borders are adorned with lace and the bottom half with curved pieces of fabric embroidered with plant designs. From the embroidery techniques used and the flower designs, we can deduce that this halter top is a relatively recent creation.
Story: Tong is a boy with a kind heart. He likes to play in the field. One day, he saw Bear, a panda that got lost in the bamboo forest, so he carried the bear home and tried to keep him warm. Bear can’t stop himself from shaking, so Tong took off his halter top and put it on Bear. They both live happily ever after.
Fig. 5. An example of composed stories used for childhood folklore education
Practice on Designing Corporate Identification System (CIS). The students were requested to design CIS based on the digital folklore contents. Its aim is to create designs for the collection of cultural items in the museum. This exercise uses traditional images as ideas for creating logos, standard fonts, and combination of both, as well as dolls and product designs. CIS consists of three elements, i.e. Mind Identity (MI), Behavior Identity (BI) and Visual Identity (VI), which are interconnected and interacted in an organic way. CIS spreads the concept of its management and culture inside the corporate itself and to the public with its own system. Therefore, they are able to have a sense of approval and unification. MI is the core of the whole CI system. VI and BI are its external performance. MI includes three aspects, which are
22
Y.-C. Liao et al.
objective, policy and value of management. VI has the brightest image in the CI system, which is made up with two elements: core and application. BI is used to show the philosophy of the corporate. In this study, students who majors in Commercial Design taking the course “Advertising Creative Strategy” were asked to design the CIS for Taiwan Folklore Museum as an exercise by using available digital folklore contents on the website. Figure 6 shows an example of the designed CIS. The upper row of the example shows the digitized artifact and its description available on the website. The design concept proposed by the student is depicted on the middle row. Bottom row demonstrates mark, logotype, combination of both mark and logotype, character, and product which are basic CIS components. Coir Rain Coat: Coir capes, comprised of either one or two pieces, were worn in agricultural societies by individuals working in the rain. Coir capes were very effective at keeping the wearer dry and were not easily damaged by wind or rain. They were manufactured out of better quality brushed and dried palm leaves that were arranged and sewn tightly together. Design Concept: The logo is created based on the cape itself. Coir cape, which resembles a raincoat, was one of the most important cultural items in the early agricultural societies. It prevents those who go out to work from getting wet on rainy days. Its aim is to protect our culture and tradition. The two colors, green and orange symbolize the societies, in which people relied on agriculture and the rectangle on the back of the cape represents the land. Mark Logotype Combined Mark & Logo Character Product
Fig. 6. An example of CIS designs
4 Evaluation In this pilot study, 33 students who major in Early Childhood Care taking the course “Multimedia Design” and 65 students who majors in Commercial Design taking the course “Advertising Creative Strategy” were asked to use the digital folklore contents to design story books and CIS, respectively, as their term projects. Each student was requested to fill a questionnaire (Table 3) based on the modified technology acceptance model (TAM) [14] to evaluate perceived usefulness (PU), perceived ease of use (PEU), and behavior intention (BI) in looking the interested contents from the website and using these materials in accomplishing his/her project. All questions are graded on a 5-point Likert scale ranging from 1 to 5 points. The Cronbach Alpha of the questionnaire is 0.83 which indicates its high reliability. As shown in Table 3, the scores of PU, PEU, and BI are greater than 3 indicating usefulness of the digital folklore contents, ease of use of the website environment, and positive attitude toward the use of the contents in numerous education areas.
5 Discussion and Conclusion Folklore is believed to be an endangered, marginalized, or misunderstood field. Folk artists are honored to study and inherit the skills building upon earlier generation [10].
Digital Folklore Contents on Education of Childhood Folklore
23
Previously, we proposed an information exchange platform allowing folk artists and folklore hobbyists to exchange information regarding their own created or collected folklore artifacts and knowledge [5]. The digitized contents contained in the platform complement the insufficiency of folklore artifacts collected in Taiwan Folklore Museum. Additionally, hobbyists and professional folk artists of the folklore association have the potential to serve as folklore educators for preparing introductory materials and answering questions regarding their private creation and collection. Similar function was also recently integrated in MOSAICA project in which dual objectives of preservation and presentation of diverse cultural heritage have been achieved [9]. It is believed that a platform containing abundant and diverse digital folklore contents and folk artists’ knowledge can stimulate students’ interests and motivations in learning. After having learned deeply about our own folklore or culture, we can understand more about other cultures [10], which in turn can prevent conflicts among different peoples with different political, social, ethnic, and religious identities [1,9]. Further system development will focus on constructing folklore legends, stories, songs, dances, and riddles to increase diversity of the digital folklore contents, which may also be useful in reminiscence therapy of dementia and Alzheimer disease for aged people. Information quality and system integration are two important factors which highly influences perceived usefulness and post adoption of an information system [15]. In our study, the originality, category, and function of each artifact were studied, examined, and recorded by well-known Taiwanese folklore specialists, which greatly ensures quality of the digital contents [1]. Furthermore, integration of the folklore activities and folklore artifacts were achieved through “Relation” element of the metadata [4]. Each artifact collected in folklore museums and folklore hobbyists has its own story regarding religion, myth, folklore legend, ethnography, or anthropology. These materials and information are also tightly integrated into the digital folklore content system [4,5]. Table 3. Descriptive statistics of modified TAM
A. Perceived Ease of Usefulness 1. I found it is easy to operate Digital Folklore Content (DFC) Repository 2. I found DFC Repository is easy to do what I want it to do 3. I found the user interface of DFC Repository is clear and understandable 4.I found the interaction with Digital Folklore Content Repository is flexible B. Perceived Usefulness 5. I agree DFC can facilitate self-learning and accomplish tasks more quickly 6. I agree DFC Repository can decrease learning time and increase productivity 7. I agree DFC Repository can elevate learning wiliness and enhance effectiveness 8. I agree DFC Repository can provide information for different age groups 9. I agree DFC Repository can promote folklore activities 10. I agree DFC is useful for making folklore course materials 11. I agree DFC is useful for learning the current course 12. I agree DFC is useful for understanding Taiwanese folklore C. Behavior Intention 13. I intend to use DFC as frequently as I need 14. I will continue to use DFC whenever possible in suitable circumstance 15. I expect to use DFC in other related activities and courses in the future
N=33 N=65 Mean (SD) Mean (SD) 3.59 (0.46) 3.37(0.70) 3.64 (0.60) 3.42(0.83) 3.67(0.60) 3.79(0.65) 3.27(0.57) 3.63(0.29) 3.64(0.55) 3.64(0.55) 3.21(0.55) 3.70(0. 68) 3.91(068.) 3.79(0.60) 3.48(0.57) 3.88(0.33) 3.52(0.47) 3.70(0.68) 3.27(0.72) 3.58(0.66)
3.46(0.83) 3.42(0.86) 3.18(0.85) 3.57(0.57) 3.55(0.90) 3.43(0.88) 3.27(0.91) 3.58(1.04) 3.78(0.84) 3.74(0.94) 3.55(0.75) 3.78(0.86) 3.32(0.74) 3.28(0.84) 3.18(0.92) 3.51(0.97)
24
Y.-C. Liao et al.
In conclusion, the paper presents the adoption of digital folklore contents in childhood folklore education and in CIS design practice. Evaluation study based on the TAM suggests that the developed digital folklore contents are useful in designing course materials for numerous educational areas. Acknowledgments. This work was funded in part by National Science Council of Taiwan (Grants Nos. NSC96-2422-H-039-002, NSC97-2631-H-166-001 and NSC982410-H-039-003-MY2) and China Medical University (Grant No. CMU96-210).
References 1. Chan, P.C., Chen, Y.F., Huang, K.H., Lin, H.H.: Digital Content Development of Taiwanese Folklore Artifacts. In: Fox, E.A., Neuhold, E.J., Premsmit, P., Wuwongse, V. (eds.) ICADL 2005. LNCS, vol. 3815, pp. 90–99. Springer, Heidelberg (2005) 2. Bronner, S.J.: The Meanings of Tradition: An Introduction. West Folklore 59, 87–104 (2000) 3. Randall, M.: Unsubstantiated belief: What we assume as truth, and how we use those assumptions. Journal of American Folklore 117, 288–295 (2004) 4. Chen, Y.F., Chan, P.C., Huang, K.H., Lin, H.H.: A Digital Library for Preservation of Folklore Crafts, Skills, and Rituals and Its Role in Folklore Education. In: Sugimoto, S., Hunter, J., Rauber, A., Morishima, A. (eds.) ICADL 2006. LNCS, vol. 4312, pp. 32–41. Springer, Heidelberg (2006) 5. Chan, P.C., Liao, Y.C., Wang, K.A., Lin, H.H., Chen, Y.F.: Digital Content Development of Folklore Artifacts and Activities for Folklore Education. In: Li, F., Zhao, J., Shih, T.K., Lau, R., Li, Q., McLeod, D. (eds.) ICWL 2008. LNCS, vol. 5145, pp. 332–343. Springer, Heidelberg (2008) 6. Sun, P.C., Cheng, H.K.: The design of instructional multimedia in e-Learning: A media richness theory-based approach. Computers and Education 49, 662–676 (2007) 7. Zhang, D., Zhou, L., Briggs, R.O., Nunamarjer, J.F.: Instructional video in e-learning: Assessing the impact of interactive video on learning effectiveness. Information & Management 43, 15–27 (2006) 8. Wang, J.H.T., Chan, P.C., Chen, Y.F., Huang, K.H.: Implementation and Evaluation of Interactive Online Video Learning for Childcare SOPs. WSEAS Transactions on Computers 5, 2799–2806 (2006) 9. Barak, M., Herscoviz, O., Kaberman, Z., Dori, Y.J.: MOSAICA: A web-2.0 based system for the preservation and presentation of cultural heritage. Computers and Education 53, 841–852 (2009) 10. Bowman, P.B.: Standing at the crossroads of folklore and education. Journal of American Folklore 119, 66–79 (2006) 11. Carter-Black, J.: Teaching cultural competence: An innovative strategy grounded in the university of storytelling as depicted in African and African American storytelling traditions. Journal of Social Work Education 43, 31–50 (2007) 12. Lee, J.H.M., Lee, F.L., Lau, T.S.: Folklore-based learning on the Web- Pedagogy, case study, and evaluation. Journal of Educational Computing Research 34, 1–27 (2006) 13. Nakanishi, M., Rittner, B.: The inclusionary culture model. Journal of Social Work Education 28, 27–35 (1992) 14. David, F.D.: Perceived usefulness, perceived ease of usefulness, and user acceptance of information technology. MIS Quarterly 13, 319–340 (1989) 15. Saeed, K., Abdinnour-Helm, S.: Examining the effects of information system characteristics and perceived usefulness on post adoption usage of information systems. Information and Management 45, 376–386 (2008)
Ancient-to-Modern Information Retrieval for Digital Collections of Traditional Mongolian Script Biligsaikhan Batjargal1, Garmaabazar Khaltarkhuu2, Fuminori Kimura3, and Akira Maeda3 1
Graduate School of Science and Engineering, Ritsumeikan University, Japan 2 Mongolia-Japan Center for Human Resources Development, Mongolia 3 College of Information Science and Engineering, Ritsumeikan University, Japan {biligsaikhan,garmaabazar}@gmail.com, {fkimura,amaeda}@is.ritsumei.ac.jp Abstract. This paper discusses our recent improvements to the traditional Mongolian script digital library (TMSDL), which can be used to access ancient historical documents written in traditional Mongolian using a query in modern Mongolian. The results of the experiment show that the percentage of successfully retrieved queries was improved. Keywords: Traditional Mongolian, Historical documents, Information retrieval.
1 Introduction In recent years, the role and importance of digital cultural heritage preservation has been continuously increasing in the Asia-Pacific region as well as worldwide. This paper provides a summary of the recent achievements of the TMSDL [1] that aims to preserve over 800 years of old historical records written in traditional Mongolian for future use and to make them available for public viewing. There are over 50,000 registered manuscripts and historical records written in traditional Mongolian script stored in the National Library of Mongolia. Despite the importance of keeping old historical materials in good conditions, the Mongolian environment for material storage is not satisfactory to keep historical records for a long period of time. The TMSDL, which is based on Greenstone Digital Library Software (GSDL), with a modern Mongolian query input, will help the user interested in the history of Mongols access materials written in traditional Mongolian. However, some limitations still exist. Thus, we have made two improvements to the TDMSL. The first improvement is the search function that retrieves traditional Mongolian documents using modern Mongolian query. The second improvement is a display function that properly renders the ancient complex script, in this case the traditional Mongolian script.
2 Ancient-to-Modern Information Retrieval One of the biggest problems in the Mongolian language is that it has two distinct writing systems, Cyrillic and traditional. Mongolia introduced Cyrillic in 1946. This was a radical change and alienated the Mongolian people from their culture and historical archives written in traditional Mongolian script. Traditional Mongolian script G. Chowdhury, C. Khoo, and J. Hunter (Eds.): ICADL 2010, LNCS 6102, pp. 25–28, 2010. © Springer-Verlag Berlin Heidelberg 2010
26
B. Batjargal et al.
preserves a more ancient language and reflects the Mongolian language spoken in the ancient period while modern Mongolian script reflects pronunciation differences in modern dialects. Traditional Mongolian has different grammar and a distinct dialect compared to modern Mongolian. Retrieval of the desired information from traditional Mongolian documents using modern Mongolian is not a simple task due to substantial changes in the Mongolian language over time. We wanted to improve the retrieval effectiveness by utilizing a dictionary to eliminate the limitations of the previous version such as not considering irregular words for the query retrieval. The structure of the TMSDL with the improvements is shown in Fig. 1. Adding a dictionary-based query translation approach to the translation module was a major improvement that takes into account age differences in the writing systems of the ancient and modern Mongolian languages. We define such a retrieval method as “ancient-to-modern information retrieval”. Traditional Mongolian Script Digital Library
Ancient-to-modern Information Retrieval
Query in traditional Mongolian script
DOM: document.form
Translation Module
Dictionary
Rules/Grammarbased Conversions
Query in traditional Mongolian script
AJAX
DOM: document.form
Query in modern Mongolian (Cyrillic)
Retrieval in traditional Mongolian
User PC document.inner Presentation HTML Characters
Unicode Basic Characters U+1800 – U+18AF
Database XML
Rendering
Compile
Our Uniscribe converter navigator.appVersion
document. getElementsby
Traditional Mongolian Script Collections in GSDL
Retrieval results
Fig. 1. Ancient-to-modern information retrieval at the TMSDL
The developing online version of Tsevel’s concise Mongolian dictionary 1[2] was utilized. Tsevel’s dictionary was printed in 1966 and is one of two Mongolian dictionaries with definitions written in Mongolian available on the market. It includes over 30,000 words in Cyrillic and traditional Mongolian script. As shown in Fig. 1, the query in modern Mongolian (Cyrillic) was translated into a query in traditional Mongolian script. Our translation approach involved exact matching of query terms word by word from Tsevel’s dictionary. The translation technique of the previous version, which was based on grammatical rules, was used if no exact match was found. Consequently, the query in traditional Mongolian (Unicode characters in the range U+1800 – U+18AF) was submitted as a retrieval query for traditional Mongolian script collections in Greenstone. This improvement boosted the quality of the translation and allowed the users to access documents written in an ancient language (traditional Mongolian) with a query input in a modern language (modern Mongolian – Cyrillic). The “document.form” object of the HTML Document Object Model (DOM) was used to submit queries to and extract results from Greenstone. Our translation algorithm, which utilizes asynchronous JavaScript and XML (AJAX), and Tsevel's dictionary were integrated into the TMSDL using our collection-specific macro files. The modern Mongolian (Cyrillic) input at the TMSDL is illustrated in Fig. 2. 1
http://toli.query.mn/
Ancient-to-Modern Information Retrieval for Digital Collections
27
Furthermore, we improved the display algorithm of the TMSDL, allowing traditional Mongolian script to be rendered properly on any platform as shown in Fig. 2. The display algorithm for traditional Mongolian script was enhanced that Uniscribe– Unicode Scripts Processor is used by Windows Vista and later versions, and our conversion algorithm is used by other platforms e.g., Windows XP, Unix-like systems and Mac OS X. The JavaScript property “navigator.appVersion” was utilized to identify the version and name of the web browser and operating system of the client system. The “innerHTML” property was used to display the rendered text in Greenstone.
Fig. 2. Cyrillic input and retrieval results at the TMSDL
3 Evaluation After improvements, we conducted an experiment to examine the difference between the old and new versions of the TMSDL as well as to check the translation correctness. The Altan Tobci (year 1604, 164 pp) and the Story of Asragch (year 1677, 130 pp) – chronological books of Mongolian kings, Genghis Khan, and the Mongol Empire – are available in the TMSDL. We compared the word count in the search results for the 150 most frequently appearing queries of the two versions with the “Qad-un Undusun-u Quriyanggui Altan Tobci–Textological Study” [3], which contains detailed analysis of traditional Mongolian words’ frequency in the Altan Tobci. In the experiment of retrieving traditional Mongolian documents via modern Mongolian (Cyrillic) utilizing a dictionary, we found that the new version translated and retrieved about 86% of input queries, which was an improvement on the old version’s 61%. However, about 64% of input queries in modern Mongolian do not match with a word count that was less than or greater than the actual number (frequency) because
28
B. Batjargal et al.
of possible errors of translation, grammatical inflection, and text digitization, or limitations of the indexer and retrieval function. Improvements on the retrieval results are illustrated in Fig. 3. Detailed retrieval results of sample query terms are shown in Fig. 4 with modern and ancient forms, their meanings, and word count. Retrieved results in the TMSDL with highlights are shown in Fig. 2.
4 Summary and Future Development In this paper, we introduced the recent achievements to the TMSDL, which can be used to access ancient historical documents written in an ancient language using a query in a modern language. The TMSDL is a useful system to build a digital library of traditional Mongolian script digital collections. The percentage of successful retrievals from queries input in the TMSDL was increased. There were some variations in the word count of the retrieved query terms, so that requires some improvements. For future development, we want to improve the TMSDL so that all queries in modern Mongolian are correctly translated into traditional Mongolian and the word count in the retrieval results is matched with the textological study of the TMSDL contents.
Fig. 3. Improvements on the retrieval results
Fig. 4. Sample retrieval results in detail
References 1. Khaltarkhuu, G., Maeda, A.: Developing a Traditional Mongolian Script Digital Library. In: Buchanan, G., Masoodian, M., Cunningham, S.J. (eds.) ICADL 2008. LNCS, vol. 5362, pp. 41–50. Springer, Heidelberg (2008) 2. Tsevel, Y.: Mongol Helnii Tovch Tailbar Toli. Ulaanbaatar (1966) (in Mongolian) 3. Choimaa, S., Shagdarsuren, T.: Qad-un Undusun-u Quriyanggui Altan Tobci–Textological Study, Ulaanbaatar(2002) (in Mongolian)
A Collaborative Scholarly Annotation System for Dynamic Web Documents – A Literary Case Study Anna Gerber, Andrew Hyland, and Jane Hunter University of Queensland, St. Lucia, Queensland, Australia, (617) 3365 1092 {agerber,ahyland,jane}@itee.uq.edu.au
Abstract. This paper describes ongoing work within the Aus-e-Lit project at the University of Queensland to provide collaborative annotation tools for Australian Literary Scholars. It describes our implementation of an annotation framework to facilitate collaboration and sharing of annotations within research sub-communities. Using the annotation system, scholars can collaboratively select web resources and attach different types of annotations (comments, notes, queries, tags and metadata), which can be harvested to enrich the AustLit collection. We describe how rich semantic descriptions can be added to the constantly changing AustLit collection through a set of interoperable annotation tools based on the Open Annotations Collaboration (OAC) model. RDFa enables scholars to semantically annotate dynamic web pages and contribute typed metadata about the IFLA FRBR entities represented within the AustLit collection. We also describe how the OAC model can be used in combination with OAI-ORE to produce scholarly digital editions, and compare this approach with existing scholarly annotation approaches. Keywords: Annotation, Interoperability, Scholarly Editions, Ontology.
1 Background The eResearch Lab at the University of Queensland has been working with the Australian Literature community through the Aus-e-Lit project [1], developing eResearch tools for scholars of Australian literature through the AustLit web portal. AustLit [2] is a collaboration led by the University of Queensland, between twelve Australian universities and the National Library of Australia. AustLit aims to support scholars undertaking research into Australian literary heritage and print cultures by providing authoritative bibliographic information for Australian creative and critical literature works and a selection of articles, poetry and fiction in full text. The research activities within AustLit are focused around particular topics, regions and genres through Research Communities. AustLit currently supports sixteen different Research Communities, including Black Words, Children’s Literature and Popular Fiction. The AustLit data model is based on the IFLA FRBR [3], extended with event modeling. Each AustLit work record presents bibliographic information relating to a FRBR Work, which is realized through versions (FRBR Expressions), which are embodied by publications (FRBR Manifestations). AustLit does not record any details about FRBR Items. TEI XML full texts are available for selected works. AustLit also G. Chowdhury, C. Khoo, and J. Hunter (Eds.): ICADL 2010, LNCS 6102, pp. 29–39, 2010. © Springer-Verlag Berlin Heidelberg 2010
30
A. Gerber, A. Hyland, and J. Hunter
records biographical information about people and organisations (agents) involved in the creation and dissemination of Australian Literature, as well as information about the events in which they participate including work creation, realization, and manifestation, and their relationships with other agents and works. Sub-communities use their own specific vocabularies and terminologies associated with their topic of interest. If they wish to contribute their research data and knowledge to AustLit, they need to request that additional attributes are added to the AustLit data model by technical staff. This process presents a delay and barrier to establishing new topics and has also led to increasing complexity of the AustLit data model. This has also affected the user interface for editing AustLit records, making it inaccessible to scholars who do not have adequate training in information systems. As collaborative research teams have become increasingly geographically distributed, scholars have also identified a need for tools to support discussion, sharing of notes and data on projects such as scholarly editions. An analysis of annotation needs within the AustLit community has indicated there are at least five different use cases for annotation tools: 1. 2. 3. 4. 5.
Fine-grained semantic tagging of textual documents (both manual and automated); Subjective attachments of free-text notes and interpretations of resources; Input of metadata descriptions for AustLit resources and derived resources; Representation of different versions of scholarly editions as annotations; Representation of compound objects as annotated links between resources.
Hence, the primary motivation for the work described in this paper was to provide collaborative annotation and scholarly editing tools integrated within the AustLit web portal, to enable scholars to collaboratively select and annotate digital resources, and to share their annotations with the research community and enrich the AustLit collection. The remainder of the paper is structured as follows: Section 2 describes Related Work; Section 3 outlines the objectives of the work described here; Section 4 describes the architecture, implementation and user interface; Section 5 provides a discussion of the results; Section 6 outlines future work plans and Section 7 provides a brief conclusion of the outcomes.
2 Related Work Web-based collaborative annotation systems are designed to enable online communities of users to attach comments or notes to web resources and to tag them with keywords. An overview of existing web annotation systems is provided in [4]. Existing web annotation systems support the first three use cases described in Section 1, but do not support the use cases for scholarly editions or compound objects. Boot [5] provides a discussion of existing approaches to annotation for scholarly digital editions. Many scholarly edition projects employ bespoke annotation systems, using proprietary or non-standard annotation formats. These approaches typically focus on annotating source documents that are encoded using TEI XML [6], and assume that the source documents are static: when changes are made a new document will be created to represent the new version. TEI allows both inline and stand-off annotations. Inline annotations do not allow annotations to overlap, and also require that the annotator
A Collaborative Scholarly Annotation System for Dynamic Web Documents
31
have write access to the source document, making it difficult to maintain the integrity of the contents, and almost impossible to implement in a collaborative web-based environment. Stand-off annotation allows multiple layers of potentially overlapping annotation hierarchies to be stored; however this approach has limitations for some types of scholarly annotations [7], and does not provide a complete solution for annotating web resources generally, including non-TEI documents or images. The Open Annotations Collaboration (OAC) [8] has been developing a data model and framework to enable the sharing and interoperability of scholarly annotations across annotation clients, collections, media types, applications and architectures. The OAC model, outlined in Figure 1, draws on initiatives such as the W3C’s Annotea [9] and the W3C Media Fragments Working Group. Representing annotations using RDF and OWL enables the annotated resources to become accessible to the larger Semantic Web, including inferencing and reasoning engines.
Fig. 1. Open Annotations Collaboration model
3 Objectives The first objective of this work was to meet the annotation requirements of the literary scholars using AustLit. Hence, the Aus-e-Lit annotation tools need to support the following activities: • Scholarly (free text) annotation of textual documents, web pages and images; • Fine-grained semantic tagging of AustLit documents and web pages (automatic or manual) with user-specified controlled terms (AustLit data entities) to enable search and inferencing; • Annotation of changes between documents, for example for recording the transmission history of a particular text (for tracking and visualization of scholarly editions). AustLit scholars also work with documents and images sourced from a variety of institutional repositories, both within national and international collections and on the Web.
32
A. Gerber, A. Hyland, and J. Hunter
Hence a further objective was to allow the scholars to use the same annotation system to annotate resources regardless of location. Consequently, we needed to ensure that annotation content was available an open, interoperable format that could be easily extracted and exported to other formats for re-use. Hence, additional objectives were: • •
To evaluate the Open Annotations Collaboration (OAC) model; To compare RDF-based approaches with existing (TEI-XML) approaches.
For literary scholarship (and to enable further semantic reasoning), it is important to be able to identify exactly which work, expression, manifestation, agent, and the section of a literary text displayed on a Web page, is under scrutiny. Most Web annotation systems allow a context (textual segment or image region) to be specified to identify the section of interest. In practice, the annotated documents are usually HTML Web pages, with XPointer contexts. However, AustLit is a dynamic system Web pages are dynamically generated from collections that are frequently being updated with additional or corrected information. Using XPointers to represent contexts for a dynamic page is a fragile, unstable approach, as minor changes to the underlying data or stylesheets that render the page can cause the context to become invalid. In order to provide a robust Web-annotation system for dynamic pages, we need to be able to distinguish between content and presentation [10] and refer to the content objects rather than the presentation markup in annotation contexts. While it is possible to adopt conventions for HTML IDs to work around this issue, the relationships between identified sections of a dynamic web page and the data entities from which it was generated are not explicit, or able to be generalized across systems. RDFa [11] is a W3C standard for embedding RDF data in (X)HTML. Our hypothesis is that RDFa is ideal for encoding semantic entities within dynamic web pages. Hence our final objective is to evaluate RDFa for semantic tagging of dynamic documents.
4 Architecture, Implementation and User Interface (UI) Figure 2 shows a high-level view of the Aus-e-Lit annotation system architecture. Researchers annotate pages on the AustLit web portal, or Web resources from other
Fig. 2. Architecture diagram
A Collaborative Scholarly Annotation System for Dynamic Web Documents
33
sites using the Aus-e-Lit annotation client, which is implemented as a Firefox browser extension. The annotations are stored as RDF on a separate Annotation server and can be browsed and searched directly via the annotation client. Metadata attached to the annotations can be selectively harvested into the AustLit database via OAI-PMH. 4.1 Adding RDFa to the AustLit Web Portal The AustLit web portal pages have been enhanced with RDFa. The annotation client (described in Section 4.3) can identify, extract and update metadata/tags that are embedded in the AustLit resources. AustLit record pages are rendered from the AustLit database by custom Java servlets using XSLT stylesheets which we extended to insert RDFa into the HTML. The RDFa uses classes and properties from the AustLit ontology that we developed for use with LORE [12] to represent the data entities from which the pages were generated. Figure 3 shows an AustLit work record page alongside a subset of the RDFa that encodes information about the FRBR entities represented on the page.
<span rel="austlit:hasTitle"> <span typeof="austlit:Title" id="SPJi" about="#SPJi" property="austlit:title"> The Drover’s Wife <span rel="austlit:form"> <span typeof="austlit:Form" about="http://austlit.../ns#i$" property="austlit:topicName"> short story ... <span rev="austlit:usedInput"> <span typeof="austlit:Realisation" id="Z$)Fv" about="#Z$)Fv"> <span rel="austlit:producedOutput"> <span typeof="austlit:Expression" property="austlit:topicID" content="Eb7N">
Fig. 3. RDFa representing FRBR entities and properties for The Drover’s Wife
4.2
Annotation model
In order to develop a set of annotation tools that will satisfy the five use cases outlined in Section 1, we need a common model that is interoperable across all of them; hence we have adopted the OAC model. Annotations are stored as RDF using Danno [13]; an annotation server developed at the UQ eResearch Lab. Danno uses the Annotea schema to ensure compatibility with existing Annotea clients and servers, while also allowing us to store additional attributes for use by OAC-aware annotation clients. Aus-e-Lit annotations include the following attributes from the OAC model:
34
A. Gerber, A. Hyland, and J. Hunter
• oac:hasContent (the URI to the resource containing the content of the annotation – in our case this is an HTML document); • oac:hasTarget (the URI of the web document being annotated); • oac:hasPredicate (indicates the kind of annotation, such as question, comment, explanation, change etc); Additional information can be recorded using attributes from other schemas such as Dublin Core (language, format, title, subject, date created or modified etc). In addition to implementing basic annotation types representing questions, comments and so on, we extended the model to define a ScholarlyAnnotation class, with subclasses VariationAnnotation and SemanticAnnotation to support the types of scholarly annotations requested by AustLit scholars. Our extensions are as follows: ScholarlyAnnotation. Extends annotations to include tags, importance, alternate body and references, based on scholarly annotation requirements outlined in [14]. SemanticAnnotation. A subclass of ScholarlyAnnotation, which allows scholars to attach metadata conforming to the AustLit ontology to AustLit entities. It extends the model with a semantic context which indicates the entity or property from the web page’s RDFa to which the metadata applies. VariationAnnotation. Records metadata about two variants of a text, for example to annotate changes between them. It subclasses ScholarlyAnnotation and allows two targets, variantTarget and originalTarget which are subProperties of oac:hasTarget, to identify the original and variant texts. It also adds attributes for recording the date, agent (person) and place where the variation on a text occurred. Table 1 shows the attributes for a VariationAnnotation. The namespace v represents the Aus-e-Lit VariationAnnotation schema. Table 1. Example VariationAnnotation record dcterms:created
2009-09-14T15:57:42.375-07:00
dcterms:modified
2009-09-14T16:11:42.512-07:00
oac:hasPredicate
http://austlit.edu.au/ontologies/2009/03/lit-annotation-ns#VariationAnnotation
dc:title
Editorial Intervention
dc:creator
Roger Osborne
oac:hasContent (stored as separate HTML document) v:variation-date
H. M. Martin was commissioned to edit a collection of poetry from Harpur's manuscript books. The extent of his editorial intervention can be seen in the variation between the 1867 and 1883 versions of 'The Creek of the Four [1882?]
v:variation-agent
H. M. Martin
v:variation-place
Adelaide
v:variantTarget
http://www.austlit.edu.au/ ... /1883.txt# xpointer (string-range(/html[1]/body[1]/pre[1], "", 47, 300))
v:originalTarget
http://www.austlit.edu.au/.../MSA871867.txt#xpointer (string-range(/html[1]/body[1]/pre[1], "", 73, 475))
A Collaborative Scholarly Annotation System for Dynamic Web Documents
35
4.3 Annotation Client The Aus-e-Lit annotation client is implemented as an open source add-on to the LORE Firefox extension [12]. The User Interface elements are implemented using HTML and AJAX using the cross-platform ExtJS library, so that it will be possible to port the client to alternative browser extension frameworks in the future. The client provides several views that allow scholars to browse, search and edit annotations: • A tree-based Browse view, which lists all annotations on a given page, along with any replies. The annotations in the tree can be sorted in ascending or descending order by date of creation, creator or annotation title; • Timeline view, displaying a summary for all annotations and replies by date; • Search view, allowing search by creator, title or date-range; • Edit view, which allows scholars to create or modify existing annotations; • VariationAnnotation view, which shows resources that are being compared or related side-by-side along with additional scholarly metadata. Figure 4 shows the Aus-e-Lit Annotation client. The main browser window displays the VariationAnnotation view, which relates a manuscript image from the notebook of Patrick White with a transcript of another version of the text. The Browse view is visible in the top-right, and the Edit view is shown at the bottom-right of screen, including fields for editing the additional scholarly annotation attributes that were described in 4.2. For example, the Tags field allows scholars to tag resources using keywords, which can be selected from the AustLit thesaurus, or entered as free text. The user interface automatically suggests matching tags as the user types. The list of fields displayed in the editor changes depending on the type of the annotation. A key objective was to make semantic annotations accessible to scholars by providing a user interface that hides the complexity of the AustLit data model and does not require a detailed understanding of IFLA FRBR. We designed the UI to allow scholars to attach
Fig. 4. Editing a VariationAnnotation relating a manuscript image and transcript
36
A. Gerber, A. Hyland, and J. Hunter
Fig. 5. Editing a SemanticAnnotation that attaches metadata to a Manifestation
metadata directly to entities such as works or manifestations via the familiar AustLit Web interface. In Figure 5, an alternateTitle property is being contributed for an AustLit manifestation via a SemanticAnnotation. When the Choose semantic selection button is pressed, the annotation client parses the embedded RDFa and inserts icons into the Web page; a brick icon next to each entity, and a brackets icon next to each property from the RDFa. The user selects the entity that they wish to annotate by clicking on these icons. A drop down menu in the editor allows users to attach OWL DataType properties from the AustLit ontology to the annotation. The UI only displays properties that are applicable for the selected entity, and basic validation is performed on the data values entered, to assist scholars to enter data that conforms to the AustLit data model.
Fig. 6. Publishing a scholarly digital edition using LORE
A Collaborative Scholarly Annotation System for Dynamic Web Documents
37
LORE [12] allows metadata and relationships to be specified at the resource level, which are then published as OAI-ORE-compliant RDF. Annotations extend the capabilities of LORE so that parts of resources (such as image regions, or sections of a text) can be discussed, and annotations can be attached to this context. As each annotation is itself a resource with a unique URI, a Scholarly Edition can be built up by a group of collaborators annotating multiple documents representing different versions of a work, and then published as a LORE compound object that encapsulates all of the versions, along with ScholarlyAnnotations that provide critical commentary and VariationAnnotations that describe each variation in detail. Figure 6 shows how the annotation client integrates with LORE to allow annotations to be selectively added to a compound object from the annotation search or browse panel. In addition to publishing collections of annotations using LORE, scholars can select annotations for export to RDF/XML or to a Microsoft Word document, which lists the metadata, target URI(s) and contents of the selected annotations.
5
Discussion
A survey of existing scholarly annotation systems [15] revealed that the majority: • focus on scholarly formats such as TEI to the exclusion of general Web resources; • are closed systems that do not allow annotation of outside documents; • act as silos: annotations are not easily reused or referenced outside of the system. This presents a problem for collaboration and re-use of annotations. The OAC model allows any online resource to be the target or content of an annotation, regardless of media type or location, and is designed to facilitate interoperability between annotation systems. Our case study has demonstrated that the OAC model can be extended to enable specialized Scholarly Annotations that record scholarly metadata and relate multiple documents. Web pages are often discounted as scholarly resources as they are considered to be “transitory representations of the scholarly objects that need Annotation” [5]. By using RDFa to encode the relationship between presentation markup and the scholarly or data entities represented, our system enables scholarly annotation of dynamic Web pages from digital library and information systems. Feedback from AustLit scholars has included a request for semantic contexts for VariationAnnotations. While our semantic context works well for AustLit record pages, it remains to be seen how well this approach generalizes to Web pages representing full texts rendered from TEI XML. We believe our approach can be generalized to work with other ontologies and types of data, however, the following considerations should be noted: Current JavaScript libraries for extracting and working with RDFa are not very efficient, however we expect that browser support will improve for RDFa over time. Each data entity of interest needs a URI. Blank nodes should be avoided in RDFa, while triples need to be reified in order to be identified within the semantic context. Our system generates a unique hash that identifies the context triple, however a better approach would be to construct Named Graphs. XPointer contexts are also used in combination with the semantic context for presentation markup that exists inside of RDFa spans. This is necessary because the granularity of our RDFa does not allow us to specify contexts down to the character level.
38
A. Gerber, A. Hyland, and J. Hunter
This will be a problem when working with TEI documents, as the sections within AustLit’s TEI documents are very large. We may need to enrich the original TEI documents to provide finer section granularity.
6 Future Work Further work to be undertaken on this project includes a detailed performance and user evaluation of the system and the following: • To improve the integration of the annotation client and the LORE Compound Object editor for publishing scholarly digital editions, including options to export scholarly compound objects that contain annotations to TEI documents; • To store versioning information for Web documents in order to alert scholars about the changes that may have occurred since the page was annotated; • To harvest and map metadata contributed through annotation into AustLit, with a facility for filtering and moderating the annotations for inclusion; • To investigate using OAI-ORE with the OAC model for Variation annotations so that users can compare and record changes between more than two documents.
7 Conclusions In this paper we have described the implementation of a scholarly annotation and publishing framework that enables literary scholars to annotate web resources with tags, comments and notes using the Open Annotations Collaboration (OAC) model. We have extended the OAC model to enable scholars to create VariationAnnotations which document changes between texts, and SemanticAnnotations for contributing typed metadata. Our annotation client leverages RDFa embedded within dynamic Web pages to identify and to allow annotations to be associated directly with the underlying data entities, rather than with the constantly changing presentation markup. Finally, through integration with LORE, annotations and other digital resources can be aggregated into OAI-ORE compound objects representing scholarly digital editions, and shared with the research community to enrich the AustLit collection. Acknowledgements. Aus-e-Lit is funded by DEST through the National eResearch Architecture Taskforce. We gratefully acknowledge the valuable contributions made to this paper by Roger Osborne, Kerry Kilner and the AustLit research communities.
References 1. Aus-e-Lit, http://www.itee.uq.edu.au/~eresearch/projects/aus-e-lit/ 2. AustLit: The Australian Literature Resource, http://austlit.edu.au 3. Kilner, K.: The AustLit Gateway and Scholarly Bibliography: A Specialist Implementation of the FRBR. Cataloging & Classification Quarterly 39(3/4) (2004) 4. Hunter, J., Khan, I., Gerber, A.: HarVANA - Harvesting Community Tags to Enrich Collection Metadata, JCDL, PA, USA, June 16 – 20, pp. 147–156 (2008)
A Collaborative Scholarly Annotation System for Dynamic Web Documents
39
5. Boot, P.: Mesotext. Digitised Emblems, Modelled Annotations and Humanities Scholarship. Pallas Proefschriften, Amsterdam. PhD Thesis (2009) 6. Text Encoding Initiative (TEI), http://www.tei-c.org/index.xml 7. Banski, P., Przepiorkowski, A.: Stand-off TEI Annotation: the Case of the National Corpus of Polish. In: ACL-IJCNLP LAW III, Singapore, August 6 –7 (2009) 8. Open Annotations Collaboration, http://www.openannotation.org/ 9. W3C Annotea Project, http://www.w3.org/2001/Annotea/ 10. Hemminger, B.: NeoNote. Suggestions for a Global Shared Scholarly Annotation System. D-Lib Magazine (May/June 2009) 11. W3C RDFa in XHTML, http://www.w3.org/TR/rdfa-syntax/ 12. Gerber, A., Hunter, J.: LORE: A Compound Object Authoring and Publishing Tool for the Australian Literature Studies Community. In: Buchanan, G., Masoodian, M., Cunningham, S.J. (eds.) ICADL 2008. LNCS, vol. 5362, pp. 246–255. Springer, Heidelberg (2008) 13. Chernich, R., Crawley, S., Hunter, J.: Universal Collaborative Annotations with Thin Clients - Supporting User Feedback to the Atlas of Living Australia, eResearch Australasia, Sydney, Australia, November 13 – 15 (2009) 14. Furuta, R., Urbina, E.: On the Characteristics of Scholarly Annotations. In: Conference on Hypertext and Hypermedia, MD, USA, pp. 78–79 (2002) 15. Hunter, J.: Collaborative Semantic Tagging and Annotation Systems. In: Annual Review of Information Science and Technology. American Society for Information Science & Technology, vol. 43 (2009)
The Relation between Comments Inserted onto Digital Textbooks by Students and Grades Earned in the Course Akihiro Motoki, Tomoko Harada, and Takashi Nagatsuka Tsurumi University, Dept. of Library, Archival and Information Studies, Tsurumi 2-1-3,Tsurumi-ku,Yokohama, 230-8501, Japan {Motoki-A,Harada-T,Nagatsuka-T}@Tsurumi-u.ac.jp
Abstract. When students read textbooks in the classroom, they usually apply active reading. The practice of marking in university textbooks is a familiar one. They scribble comments on the margin, highlight elements, underline words and phrases, and correlate distinct parts to foster critical thinking. While the use of annotations during active reading supports the students themselves, these can also be useful for other readers. Investigations were carried out to evaluate the comments inserted by students onto their digital textbooks and how this relates to their eventual grade earned at the end of course. The results of our study highlight two main factors influencing students; eventual grade, quantity and quality of annotation. Students who wrote a lot of comments and focused upon the more important keywords in the text trend to receive a higher grade. Accordingly, our analysis was based on number and quality of text word selection. Keywords: annotation, electronic note-taking, grade, digital textbook, comments.
1 Introduction When students read textbooks in the classroom, they usually apply a very active reading, as opposed to the more passive mode of reading we employ when reading for pleasure. The practice of annotating university textbooks with a pen or pencil is perhaps the most familiar illustration of active reading. Universities generally require students to buy their books. They scribble comments in the margin, highlight elements, underline words and phrases, and correlate distinct parts to foster critical thinking. While the use of annotations during active reading supports the students themselves, these can also be useful for other readers[1]. Making annotations on books and learning materials is part of the students' everyday life[2]. Although there are many computer-based annotation systems, many people still prefer to actually print out digital documents and then make annotations on physical paper using standard pen and pencil[3]. With the growth of digital media, the document tradition is moving forward while the annotation tradition is being left behind. While many kinds of digital annotation systems have been proposed, there are also challenges ahead: not only are these shortcomings in the technology, but also we must educate students to overcome reluctance G. Chowdhury, C. Khoo, and J. Hunter (Eds.): ICADL 2010, LNCS 6102, pp. 40–49, 2010. © Springer-Verlag Berlin Heidelberg 2010
The Relation between Comments Inserted onto Digital Textbooks by Students
41
to use much system. It is clear we need to address these problems regarding annotation in the digital environment [4]. There is other important student behavior as taking note with a pen and paper which is known traditional note-taking[5,6]. Traditional note-taking remains an activity that many students in higher education continue to rely upon heavily[7]. The longestablished tradition of note-taking may also benefit from recent advances in digital technology. We also have a comprehensive understanding of the many issues that surround the process of traditional pen-on-paper note taking; for example the relationship between note taking and the storage function on notes , optimal note-taking behaviors, the relationship between note taking and one’s score on a test, etc[5-6,8-11]. Many studies or projects involving in-class and online educational technology include note-taking or annotation applications[2-4,7,9]. In-class and online note-taking or annotation systems are often based upon the methodologies of traditional notetaking or annotation on paper documents. Therefore, it is valuable to know the ways in which students today manage their note-taking and annotation practices when they are using digital textbook, and also how they view traditional note-taking with a pen and paper versus electronic note taking and annotation. The authors chose the digital textbooks(DTs) using Microsoft Word 2003 because of its annotation and note-taking features[12]. MS Word is the only digital system that supports in-line annotations among annotation and note-taking systems[4]. Digital textbooks(DTs) are uploaded to the server and then students download the DTs to their portable personal computers for use in each lecture. Students then write comments on DTs in their classrooms[13]. At first, HTML tags are inserted into each set of comments with the selected text in the DT with a macro for Word 2003, and then each set of comments with the selected text to add HTML tags is extracted with PerlScript[14,15]. The students were divided into two distinct groups: cluster-A, defined as those DTs in which students have inserted many comments, and cluster-B, in which students have inserted few comments[14]. The number of comments inserted by students is gauged to be one of the useful indexes for quantitative analysis of student motivation[14]. A preliminary study was carried out on how to relate a student’s grade earned at the end of course to the number of comments on his/her digital textbook. What the authors discovered appears to suggest that there is a positive correlation between the number of comments inserted by students and their grades earned at the end of course [15]. In this paper investigations are carried out to evaluate the comments inserted by students onto their digital textbooks and how this relates to their eventual grade earned at the end of course. Our study highlights two main factors influencing students; eventual grade, quantity and quality of annotation. It is investigated whether students who wrote a lot of comments and focused upon the more important keywords in the text have a tendency to receive a higher grade. Accordingly, our analysis is based on number and quality of text word selection.
2 Method 2.1 Overview The authors chose the digital textbooks(DTs) using Microsoft Word 2003 because of its annotation and note-taking features. In the MS Word the composition of a textual
42
A. Motoki, T. Harada, and T. Nagatsuka
annotation takes place in a sub-window within the main editing window. MS Word is the only digital system that supports inline annotations in many annotation and notetaking systems. In the DT, comments are inserted without overwriting the original text and also are indicated by assigning the annotator’s name between double brackets. When reading the DT, students may filter comments by the author and may also opt to hide all comments. Digital textbooks(DTs) are uploaded onto our department’s server in Tsurumi University(Stage 1 in Fig 1) and then students download the DTs to their portable personal computers for using in lectures(Stage 2 in Fig 1). Students write comments on DTs in their classrooms(Stage 3 in Fig 1). The DTs with comments inserted by students were collected at each end of the semester in 2005, 2006 and 2007. The authors analyze the comments inserted into DTs. At first, HTML tags are added into each set of comments with the selected text in the DT with a macro for Word 2003(Stage 6 in Fig 1), and then each set of comments with the selected text to add HTML tags is extracted from HTML documents with PerlScript(Stage 7 in Fig 1).
Fig. 1. Extraction process of comments inserted by students on Digital Textbooks
2.2 Subjects Students select a part of the text in DT and then a frame of comment, coupled with the selected portion of text, is inserted into DT automatically. Students write annotations and/or notes within the frame such as their opinions, the meaning of a word or phrase, or questions to teacher etc (Fig 2). Though inserted comments are automatically numbered in order, students find it easy to manage their comments created in the classroom.
The Relation between Comments Inserted onto Digital Textbooks by Students
43
Fig. 2. Comment with a selected portion of text inserted by student in Digital Textbook
2.3 Procedure Digital textbooks(DTs) in Japanese are prepared by each teacher taking charge of the courses, “Introduction to Networks" and "Introduction to Multimedia", with Microsoft Word 2003. The pages of two DTs, “Introduction to Networks" and "Introduction to Multimedia", are 41 and 54, respectively. The DTs in each of the two courses are composed of alphanumerical texts and graphics such as figures, tables and images. In the opening lecture of the course, teacher explains to students about how to use the DT and encourages students to add comments during the lecture on their DT. The teacher suggests to students that adding comments will lead to the improvement of their learning abilities, and also explains to students that their DT will be collected for investigation at the end of the course. In the final lecture of the course, students upload their DT with their comments and annotations to the server. Their eventual grades in the course are based on the weighted combination of the three following requirements: class participation, assignment and /or quiz, and examination. The eventual grade is composed of S(100-90 points), A(89-80 points), B(79-70 points), C(69-60 points) and D(59-0 points). Students who receive a grade of S, A, B or C succeed in getting credit for the course. On the other hand, students who receive a grade of D, fail to get credit for the course.
3 Data Analysis and Results The number and percentage of students who added comments to Digital Textbooks(DTs) are shown in Table 1. As identified above, students annotate text in their DTs using the comment feature of MS Word. Both courses of “Introduction to Networks” and “Introduction to Multimedia” are required courses during the first year in the Department of Library, Archival and Information Studies, at Tsurumi University. However, because the number of students who registered for the course can fluctuate over the course of three years, some students, however, who failed these courses in the first year must repeat the course in their second year. The total number of students who registered for the two courses over three years of 2005, 2006 and 2007 was 510. The percentages of students who submitted their DTs to the server were distributed from 62.1 to 84.5. The average percentage of all students who submitted their DTs per the total number of students was 74.1. The percentages of
44
A. Motoki, T. Harada, and T. Nagatsuka
students who added comments to DTs were distributed from 83.1 to 100.0. The average percentage of students who added comments per the total number of students who submitted their DTs was 92.7. As exemplified above, most of the students who submitted their DTs added comments. In three classrooms of “Introduction to Networks” in 2006 and “Introduction to Multimedia” in 2005 and 2006, the ratios of students who did not add comments as annotations onto their DT were 10 percents or more in the number of all students submitted DT in the course. Some of students who did not add comments used the features of the highlighter pen and/or color change in a form of annotations onto their DT. Most of students who did not submit their DT failed to get a credit for the course. The teachers encouraged their students to add comments during the period of lectures in 2007. Compared with previous years, the students who added comments onto DTs in two classrooms of “Introduction to Networks” and “Introduction to Multimedia” in 2007 have leveled up over 95 percents. Being able to show that adding comments improves their scores will clearly encourage students to implement this practice more vigorously. Table 1. The number and percentage of students who added comments to Digital Textbooks(DTs)
Course
Introduction to Networks
Introduction to Multimedia Total Number
Year
Registered students (RS)
Students submitted DTs (SS) (% for RS)
Students added comments to DTs (% for SS)
2005
84
69 (82.1)
67 (97.1)
2006
84
71(84.5)
59(83.1)
2007
83
67(80.7)
65(97.0)
2005
82
60 (73.2)
54 (90.0)
2006
90
60 (66.7)
54 (90.0)
2007
87
54(62.1)
54 (100.0)
510
381(74.1)
353(92.7)
Table 2 shows the average numbers of comments in each grade at two courses of “Introduction to Networks” and “Introduction to Multimedia”. The average numbers of comments at the course of “Introduction to Networks” are 36.91+/-15.73 (mean +/standard deviation) in S, 31.78+/-18.21 in A, 20.68+/- 15.54 in B and 11.12+/-13.47 in C, respectively. The average number of comments has clearly seen a decline from grade S to grade C. The average numbers of comments at the course of “Introduction to Multimedia” were 49.80 +/-11.43 (mean +/- standard error of the mean) in S, 28.51in A, 22.23 in B and 13.71in C, respectively. The average number of comments has also clearly seen a decline from grade S to grade C. In both cases, we can point to a trend that high-performing students who got better grades added more comments in the form of annotations than low-performing students who received a poor grade. It can be supposed from the results of our experiments shown in Table 2 that the average number of comments per student being aimed at a group of the same grade have a positive relation with their eventual grades earned in the course.
The Relation between Comments Inserted onto Digital Textbooks by Students
45
Table 2. The average number of comments inserted by each student onto DT and their eventual grades earned in two courses of “Introduction to Networks” and “Introduction to Multimedia”
Course
Introduction to Networks
Introduction to Multimedia
Grade
S
A
B
C
S
A
B
C
Mean
36.91
31.78
20.68
11.12
49.80
28.51
22.23
13.71
SD
15.73
18.21
15.54
13.47
20.56
20.65
15.25
12.43
The left side of Fig 3 is a scatter plot of the number of comments inserted by each student on the DT made up with each grade earned in the course of “Introduction to Networks”, and the right side of Fig 3 shows a scatter plot of the number of comments inserted by each student on the DT made up with each grade earned in the course of “Introduction to Multimedia”. The number of comments in each grade widely dispersed from zero to higher counts. For example, the number of comments in a group of grade A in “Introduction to Networks” widely dispersed from zero to 101. We already mentioned before the eventual grade was worked out based on the weighted combination of the three following requirements: class participation, assignment and /or quiz, and examination. However, it needs to be investigated further why some students who did not add many comments could receive a higher eventual grade. The average number of comments per student being aimed at every 381 students was 24.02. In other instances, the groups of grade C in both of “Introduction to Networks” and “Introduction to Multimedia” included students to add comments over 40. The number of 40 comments in the groups of grade C is relatively higher than the average number of comments being aimed at every 381 students. We need further study of which analyze the contents written by students within a frame of comment in the form of annotation to understand more exactly the relation between comments and eventual grade earned in the course.
Fig. 3. Scatter plots of the number of comments inserted by each student on DT in their eventual grade earned in two courses of “Introduction to Networks” and “Introduction to Multimedia”
46
A. Motoki, T. Harada, and T. Nagatsuka
The higher frequency terms being ranked within the top 10 were picked out from all words and phrases selected by students in their annotation on the DTs of “Introduction to Networks”(Table 3) and “Introduction to Multimedia”(Table 4). Some terms were translated from Japanese to English and then listed in tables. The number of comments is calculated automatically in each word or phrase at first and then similar words or phrases were brought together in a single term manually. As the term of “OSI” is high up on the list of higher frequency terms in “Introduction to Networks”, “OSI with (section number)” and “OSI with (Japanese words)” are put all together into the term of “OSI”. Table 3. The higher frequency terms picked out from all words and phrases selected by students to add comments onto the DT of “Introduction to Networks” S O r der
w or ds or phr as es
A
flow control
11
flow control
37
routing
34
2
protocol
8
routing
34
protocol
22
3
bluetooth
7
broadcast
27
20
flow control
8
4 5 6 7 8 9
OSI
7 7 7 6 6 6
physical layer
24 23 23 22 20 20
INS
OSI
19 19 17 17 16 16
data link layer
5 5 5 5 4 4
router
15
network layer
4
physical layer data link layer IP address
10
ACK
6
data link layer buffer over-flow packet bluetooth OSI Introduction to Networks
N um ber of c om m ent s
19
w or ds or phr as es
C
1
routing
w or ds or phr as es
B w or ds or phr as es Introduction to Networks IP
buffer over-flow
N um ber of c om m ent s
Introduction to Networks flow control transport layer IP packet physical layer
N um ber of c om m ent s
packet routing error control physical layer
N um ber of c om m ent s
9 9
In the case of “Introduction to Networks”, the terms of which are protocol, names of some primary protocols of the OSI reference model, flow control, routing or router, and packet were used often by students among all grades. In the case of “Introduction to Multimedia”, the terms of which are ASCII, Open (Web), Stor(aged Information), font, binary file, CD-ROM, ANK and JIS were also used often by students among all grades. Table 4. The higher frequency terms picked out from all words and phases selected by students to add comments onto the DT of “Introduction to Multimedia”
Order 1 2 3 4 5 6 7 8 9 10
S words or Number of phrases comments RAM 5 ROM 5 ASCII 5 font 5 semiconductor 4 memory binary file 4 property 4 Open 3 DIF 3 JIS 3
A words or Number of phrases comments ASCII 48 Open 36 multimedia 30 Deep 28 Stor 27 JIS 23 ANK 19 binary file 16 bitmap format 15 escape 15 sequence
B words or Number of phrases comments ASCII 37 multimedia 30 digital 29 contents Open 27 CD-ROM 21 text file 21 hard disk 19 Deep 19 floppy disk 17 ANK 16
C words or Number of phrases comments Open 16 ASCII 16 Stor 13 binary file 13 font 11 CD-ROM 9 hard disk 9 floppy disk 9 ANK 9 Deep 9
The Relation between Comments Inserted onto Digital Textbooks by Students
47
Fig. 4 and Fig. 5 show the similarities of terms which appeared often among four grades. Grade S is used as of control point in Fig 4, and grade C is used as of control point in Fig 5. Being based on the lists of higher frequency terms picked up from each grade, the similarities of terms in “Introduction to Networks” and “Introduction to Multimedia” were calculated in both of Fig 4 and Fig 5. The number of terms and frequency of appearance in “Introduction to Networks” are 22 and over 5 in grade S, 22 and over 13 in grade A, 22 and over 9 in grade B, 19 and over 4 in grade C, respectively. The number of terms and frequency of appearance in “Introduction to Multimedia” are 18 and over 3 in grade S, 22 and over 11 in grade A, 19 and over 11 in grade B, 20 and over 7 in grade C, respectively.
Fig. 4. The similarity of high frequency terms picked out all words and phrases selected by students verified among four grades used grade S as of control point
The percentages of similar terms in grade A, B, C in “Introduction to Multimedia” are 50%, 53% and 45% of grade S, respectively. The percentages of similar terms in grade A, B, C in “Introduction to Networks” are 64%, 64% and 47% of grade S, respectively(Fig 4). The percentages of similar terms in grade B, A, S in “Introduction to Multimedia” are 79%, 59% and 50% of grade C, respectively. The percentages of similar terms in grade B, A, S in “Introduction to Networks” are 59%, 55% and 41% of grade C, respectively(Fig 5). Both figures, Fig 4 and Fig 5, illustrate that the similarities of terms which appeared often among four grades positively relate to eventual grades earned at the end of the course.
Fig. 5. The similarity of high frequency term picked out all words and phrases selected by students verified among four grades used grade C as of control point
48
A. Motoki, T. Harada, and T. Nagatsuka
4 Conclusion In the study, we found the average number of comments per student being aimed at a group of the same grade related to the eventual grades earned at the end of course, in other words, high-performing students who got better grades added more comments in the form of annotations than under-performing students who received a poor grade. There are already many studies concerning for the behavior of students’ practice of adding annotations to their textbooks printed on the paper and taking notes in lectures[1, 5, 6, 8]. In our study, students added their comments in the form of annotations onto their digital textbooks using the comment feature on MS Word. We found also on their digital textbooks the other kinds of annotations: Example for highlighting important words, where a part of sentence was changed to a different color, or writing some words within text not to use the comment feature on MS Word. It needs to be investigated further what kind of differences there are between the practice of annotations and note-taking by students on digital textbooks and those on printed textbooks. We also found in the study the similarity of terms which appeared often among four grades positively related the eventual grades earned at the end of course. We need further study of which analyze the contents written by students within a frame of comment in the form of annotation to understand more exactly the relation between comments and eventual grade earned in the course. With the growth of digital environment, the document tradition is changing from paper to electronic. As more of our educational material moves to the computer, supporting annotation and note-taking digitally becomes an important task. At the same time, technology gives us unprecedented control over the annotation and note-taking process. We should study student behavior and practices and what changes will are likely to occur through use of digital textbooks as opposed to the more traditional approach in the learning environment of the paper-and-pen on the classroom. The digital textbooks should be improved and applied to the lessons for increasing student motivation and for encouraging better grades. The next major step will be to make a system to extract a set of annotated text and annotation data added by students onto the digital textbooks and then to analyze the data automatically.
References 1. Marshall, C.: Annotation: from paper books to the digital library. In: Proceedings of the ACM Digital Libraries 1997 Conference, pp. 131–140 (1997) 2. Hoff, C., Wehling, U., Rothkugel, S.: From paper-and-pen annotations to artifact-based mobile learning. Journal of Computer Assisted Learning 25(3), 219–237 (2009) 3. Hoff, C., Rothkugel, S.: Shortcomings in Computer-based Annotation Systems. In: Proceedings of World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education 2008, pp. 3715–3720 (2008) 4. Cousins, S.B., Baldonado, M., Paepcke, A.: A Systems View of Annotations. Xerox PARC Tech Report P9910022 (2000) 5. Hartley, J., Ivor, K.D.: Note-Taking:A Critical Review. Programmed Learning and Educational Technology 15(3), 207–224 (1978)
The Relation between Comments Inserted onto Digital Textbooks by Students
49
6. Palmatier, R.A., Bennet, J.M.: Note-taking habits of college students. Journal of Reading 18, 215–218 (1974) 7. Reimer, Y.J., Brimhall, E., Chen, C., O’Reilly, K.: Empirical user studies inform the design of an e-notetaking and information assimilation system for students in higher education. Computers & Education 52(4), 893–913 (2009) 8. Knight, L.J., McKelvie, S.J.: Effects of attendance, note-taking, and review on memory for a lecture: Encoding vs. external storage functions of notes. Canadian Journal of Behavioural Science 18(1), 52–61 (1986) 9. Bauer, A., Mellon, C.: Selection-based note-taking applications. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 981–990 (2007) 10. Kiewra, K.A., Benton, S.L.: The relationship between information-processing ability and notetaking. Contemporary Educational Psychology 13(1), 33–44 (1988) 11. Kiewra, K.A.: A review of note-taking: The encoding-storage paradigm and beyond. Educational Psychology Review 1(2), 147–172 (1989) 12. Motoki, A., Harada, T., Nagatsuka, T.: Poster Presentation: Digital Workbooks applied on the Librarian Training Course. In: World Library and Information Congress: 72nd IFLA General Conference and Council, Seoul (2006) 13. Motoki, A., Harada, T., Nagatsuka, T.: Digital Workbooks designed to improve skills of the Students on Librarian Training Course: A Content Analysis of Student Written Comments. The bulletin of Tsurumi University. Part 4, Studies in humanities, social and natural sciences 44, 69–76 (2007) 14. Motoki, A., Harada, T., Nagatsuka, T.: Digital Workbooks designed to improve skills of the Students on Librarian Training Course (2): Evaluation of the workbooks and content analysis of the comments written by students. The bulletin of Tsurumi University. Part 4, Studies in humanities, social and natural sciences 45, 97–111 (2008) 15. Motoki, A., Harada, T., Nagatsuka, T.: Poster Presentation: The Effects of Digital Workbook on the Information Literacy Education: The number of comments written by students and a grade for the subjects. Annual meeting of Japanese Society for Information and Media Studies (2008)
Visualizing and Exploring Evolving Information Networks in Wikipedia Ee-Peng Lim2 , Agus Trisnajaya Kwee1 , Nelman Lubis Ibrahim1 , Aixin Sun1 , Anwitaman Datta1 , Kuiyu Chang1 , and Maureen1 1
School of Computer Engineering, Nanyang Technological University, Singapore {atkwee,INLUBIS,axsun,anwitaman,askychang,maureen}@ntu.edu.sg 2 School of Information Systems, Singapore Management University, Singapore
[email protected]
Abstract. Information networks in Wikipedia evolve as users collaboratively edit articles that embed the networks. These information networks represent both the structure and content of community’s knowledge and the networks evolve as the knowledge gets updated. By observing the networks evolve and finding their evolving patterns, one can gain higher order knowledge about the networks and conduct longitudinal network analysis to detect events and summarize trends. In this paper, we present SSNetViz+, a visual analytic tool to support visualization and exploration of Wikipedia’s information networks. SSNetViz+ supports timebased network browsing, content browsing and search. Using a terrorism information network as an example, we show that different timestamped versions of the network can be interactively explored. As information networks in Wikipedia are created and maintained by collaborative editing efforts, the edit activity data are also shown to help detecting interesting events that may have happened to the network. SSNetViz+ also supports temporal queries that allow other relevant nodes to be added so as to expand the network being analyzed.
1
Introduction
Information network refers to representing information entities as nodes and their inter-relationships as edges. In this paper, we address the problem of visualizing and exploring evolving information networks in Wikipedia. Each Wikipedia article written in Wikitext describes an information entity (e.g., a person) and contains links to other related information entities (e.g., country of birth, company worked for, etc.). Using a web browser, users can browse Wikipedia articles and navigate to other articles via links. This mode of user interaction, however, does not support a network view of Wikipedia information. It is therefore difficult to gain the high level knowledge about the browsed articles in the context of the entire information network. Wikipedia also maintains historical versions of an article under the history tab of the article. Nevertheless, these historical article versions are viewed as singletons and not part of some evolving information network. Visualizing and exploring evolving information networks is important for several reasons. Firstly, it enables us to understand the relationships among network G. Chowdhury, C. Khoo, and J. Hunter (Eds.): ICADL 2010, LNCS 6102, pp. 50–60, 2010. c Springer-Verlag Berlin Heidelberg 2010
Visualizing and Exploring Evolving Information Networks in Wikipedia
51
nodes in the time dimension. When a link has existed between a pair of nodes for a long time, it is considered more permanent than another link that exists for a very short time period. Secondly, time-based network visualization allows one to study interesting network changes that signify some interesting trends or events. These may well be trends and events that occur in the physical world. SSNetViz+ is a tool designed and implemented to overcome the limitation of existing web browsers in analysing Wikipedia information networks. As an extension of the earlier SSNetViz project [6] which focuses on visualizing and exploring heterogeneous semantic networks, SSNetViz+ introduces a new time dimension and a multi-version information network representation. It supports storage of multiple versions of an information network with multiple node types. By introducing new operators to manipulate information networks, it helps users to better understand the relationships among networks, network trends and events. From Wikipedia articles, we first extract relevant information networks of multiple versions based on the network analysis task to be conducted. At present, this step is carried out semi-automatically. The extracted networks are stored in some repository. Users can then perform interactive network analysis on the multiple versioned networks using a combination of network manipulation operators and network search. There are a few design challenges for SSNetViz+. In the following, we outline these challenges and our general approaches to tackle them. – When multiple versions of information networks exist, how can they be visualized and explored without overloading users with too much information? Information network can be very large in size. Having multiple versions of information networks will only aggravates information overloading. Displaying the entire network or multiple versions of the network on a single screen is usually infeasible and not useful for analysis. SSNetViz+ is thus designed to show only one version of network at a time. Moreover, for a given version of information network, we allow users to select a subset of nodes known as anchor nodes and their neighboring nodes to be visualized. This incremental exploration approach reduces the amount of information to be shown at the same time allowing the users to focus more on the interesting sub-networks and versions. – How can time-based network analysis be performed easily? An important purpose of using SSNetViz+ is to find interesting sub-networks and versions through visual means. We realise this capability by introducing: (a) time scrollbar for examining nodes created at different points in time; (b) historical node statistics to guide users in exploiting Wikipedia user activity data so as to identify the interesting network versions; (c) delta graph operator to compare different versions of network; and (d) search enabled network exploration that allows new interesting nodes to be added to the visualized sub-networks to expand the scope of network analysis. – How can information networks with multiple versions be searched? SSNetViz+ incorporates a keyword search engine that allows users to search for interesting nodes containing keywords within user specified time period. As the
52
E.-P. Lim et al.
same keywords may appear in different versions of the information network, we have to develop a new node result ranking function that considers the versions containing the keywords. In this paper, we will illustrate SSNetViz+ using a terrorism information network example. We create this information network by gathering terrorism related articles and links among them. Using this real example, we highlight the strengths of using SSNetViz+ for analysing evolving information networks.
2
Related Work
There are several previous research works related to this paper. The first body of related works is related to visual analytics on graphs or network data. A good survey on graph or network visualization is given in [4]. The survey describes a variety of graph layout techniques applicable to both tree and graph structures. It also covers clustering techniques that summarize the amount of network information to be visualized. In the context of scientific literature, Chen also proposed several visualization techniques for citation, co-citation and other networks embedded in the document collections [3]. His work also introduced the concept of pivotal point which refers to an article with high betweenness centrality value. Such an article is believed to be important for the users to examine. Yang, et al., described a visual analytic toolkit for detecting events in an evolving information network. The main idea is to define seven different events to be tracked for the network, to visualize and explain the network changes[10]. This work shares the same objectives as ours but we rely more on user activity data to find events. We combine visualization, search and analysis in the SSNetViz+ while the toolkit is more for visualization only. In Wikipedia, there are also works on extracting topic or ontological networks from article content. Wu and Weld proposed the Kylin Ontology Generator (KOG) to extract ontology from infoboxes of Wikipedia articles and combine it with WordNet[9]. DBpedia represents an ongoing efforts to extract Wikipedia tagged content turning them into a knowledge base of RDF data[1]. Kittur, Chi and Suh extracted category tags of Wikipedia articles and derived the high level topic distribution of each article using the extracted category tags. By performing topic analysis on Wikipedia topics in January 2008 and July 2006, they concluded that “Natural and physical sciences” and “Mathematics and logic” are the two fastest growing topics[5]. To visualize revision history of a Wikipedia article, Nunes, et al., proposed a timeline representation of article revision activity and implemented that as an application known as WikiChanges[7]. HistoryViz is yet another web application that allows users to examine events and related entities of a person entity using data in Wikipedia[8]. Our work differs from the above as we use Wikipedia article titles as nodes in the information network instead of extracting nodes or events from article content. We study Wikipedia articles in an evolving network as opposed to one article evolving in isolation.
Visualizing and Exploring Evolving Information Networks in Wikipedia
3 3.1
53
Modeling of Evolving Information Networks Multi-version Information Network
Information network is the basic data structure SSNetViz+ is designed to represent and manipulate. We define an information network G = V, E to be set of nodes V and a set of directed edges E. Every node belongs to some node type and nodes of the same type share a common set of attributes. Similarly, edges are of some edge types but they do not carry any attributes. For Wikipedia, the nodes are articles and the directed edges are links from articles to other articles. As Wikipedia allows users to modify or revise articles, it results in multiple versions of information network for those articles. An article vi ∈ V in the information network can have multiple versions {vi1 , vi2 , · · · , vi,|Ti | } created at different timestamps Ti = {ti1 , ti2 , · · · , ti,|Ti | }. Each article version vik may have links to other articles and we denote these links by Eik ⊆ V . Given a set of articles V , we assume that their versions can be linearized by timestamp and we define a version of the information network for each timestamp. Formally, we define a multi-version information network V, E as a series of information networks represented by V, E, T where V = {(vi , tij )|vi ∈ V ∧tij ∈ Ti }, E = {(vi , vj )|∃vi , vj ∈ V, ∃tik ∈ Ti , ∃tjk ∈ Tj , vi = (vi , tij )∧vj = (vj , tjk )∧tik ≥ tjk ∧vj ∈ Eik }, and T is the union of all articles’ timestamps, i.e., T = ∪vi ∈V Ti . Given a multi-version information network V, E, T, we can induce another multi-version information network with given nodes Vt ⊆ V at a timestamp t (t may or may not be in T) defined by Vt , Et where Vt = {(vi , tij ) ∈ V|vi ∈ V ∧ tij is the latest timestamp at or before t}, Et = {(vi , vj ) ∈ E|vi , vj ∈ Vt }. The induced information network is thus a snapshot of the multi-version information network at the timestamp t. SSNetViz+ is designed to induce information networks with user specified node set at regular timestamps, e.g., weekly or monthly, for visualization and exploration. This requires a much smaller data size to be manipulated by SSNetViz+ compared with the original multi-version information network, hence reducing the overheads in network exploration. Henceforth, we will therefore use information networks and induced information networks interchangeably. 3.2
Manipulation of Information Networks
Based on a set of induced information networks with equally spaced timestamps, we can manipulate the networks using a set of operators so as to explore the networks. In the following, we formally define some operators for this purpose. Addition of an article node. This operator essentially adds a new node v into an existing induced information network Vt , Et by returning a new induced information network Vt , Et where (a) Vt = Vt ∪ {(v , t ) ∈ V|t is thelatest timestamp at or before t}, (b) Et = Et ∪ {(v , vj ) ∈ E|v = (v , t ) ∈ Vt ∧ vj ∈ Vt } ∪ {(vj , v ) ∈ E|v = (v , t ) ∈ Vt ∧ vj ∈ Vt }.
54
E.-P. Lim et al.
When a new node is added, its links to the existing induced information network are also included in the new network if the links are to nodes in the existing network. Similarly, we can remove an article node an induced information network by removing the relevant node and its links. Removal of an article node. The node removal operator deletes a node v from an existing induced information network Vt , Et by returning a new induced information network Vt , Et where (a) Vt = Vt − {(v , t )|(v , t ) ∈ Vt }, (b) Et = Et − {(v , vj )|(v , vj ) ∈ Et } − {(vj , v )|(vj , v ) ∈ Et }. Delta difference of two induced information networks. The delta difference of two induced information networks at timestamps t1 and t2 (t1 < t2), Vt2 , Et2 − Vt1 , Et1 returns three information networks, namely: – + network, V + , E +, defined by (a) V + = {v|(v, t) ∈ Vt2∧ ∃(v, t ), (v, t ) ∈ Vt1 , and (b) E + = {(v, w)|((v, tk ), (w, tk )) ∈ Et2 ∧ ∃((v, tl ), (w, tl )) ∈ Et1 . – − network, V − , E − defined by (a) V − = {v|(v, t) ∈ Vt1∧ ∃(v, t ), (v, t ) ∈ Vt2 , and (b) E − = {(v, w)|((v, tk ), (w, tk )) ∈ Et1 ∧ ∃((v, tl ), (w, tl )) ∈ Et2 . – 0 network, V 0 , E 0 defined by (a) V 0 = {v|(v, t) ∈ Vt1 ∧ (v, t ) ∈ Vt2 }, and (b) E 0 = {(v, w)|((v, tk ), (w, tk )) ∈ Et1 ∧ ((v, tl ), (w, tl )) ∈ Et2 }. The + , − and 0 information networks represent the added, deleted and remaining parts comparing the newer and older information networks respectively. Note that this operation does not return an induced network. The three resultant networks are not time specific. 3.3
Example Terrorism Information Network
In the SSNetViz+ project, we construct a terrorism information network with multiple versions from Wikipedia. This network consists of 813 terrorist articles, 439 terrorist group articles and 1797 incident articles. These articles were identified by first using the terrorism related entities provided by MIPT’s Terrorism Knowledge Base1 (TKB) to locate the relevant Wikipedia articles, followed by another round of human checking so as to remove wrongly matched articles. Once the terrorism articles had been found, we manually identified the links between entities represented by these articles. A total of 1922 links were found. We extracted the version histories of all selected articles and constructed the induced information networks from the version histories with monthly timestamps. The final induced information networks cover the period from August 5, 2001 to January 6, 2008.
4
Network Visualization and Exploration
4.1
Overview of User Interface
In this section, we present the visualization and exploration features of SSNetViz+. SSNetViz+ has an interactive user interface as shown in Figure 1. 1
MIPT: National Memorial Institute for the Prevent of Terrorism.
Visualizing and Exploring Evolving Information Networks in Wikipedia
55
Fig. 1. SSNetViz+ User Interface
The interface consists of: (1) a menu bar that allows information networks to be loaded for visualization; (2) a search bar for querying the network nodes; (3) a visualization panel for displaying networks and exploring them; (4) an anchor node panel for maintaining a list of anchor nodes that are bookmarked by the user to be interesting; and (5) a profile panel for displaying the Wikipedia article of any selected node. 4.2
Network Visualization and Exploration
Like its predecessor SSNetViz, SSNetViz+ displays nodes of an information network in different shapes depending on their node types. As shown in Figure 1, terrorist group nodes (e.g., Al-Qaeda) and terrorist nodes (e.g., Osama bin Laden) are shown in rectangles and ovals respectively. The lines between nodes represent relationships with source nodes at the thick ends and destination nodes at thin ends of the lines. One can perform normal and hyperbolic zooming, rotation, and node positioning on the information network using the display options and slide bar at the bottom of the main window. A set of important nodes to be always included in the visualization panel can be bookmarked by the user as anchor nodes. Anchor nodes are maintained in the anchor node panel and the respective nodes in the visualization panel are adorned with a green box at the right bottom corner. Whenever a node is selected, the article the node represents will have its textual content appear in the profile panel. A small red box on the right top corner of a node indicates that this node is an anchor node. The number in the red box shows the number of neighboring nodes not yet shown.
56
E.-P. Lim et al.
Time travel using scroll bar. SSNetViz+ incorporates several other unique visual features. To help the user select an induced information network with a specific timestamp for display, a time scroll bar at the bottom of the window is used. Once a timestamp is selected, an appropriate induced information network will be shown with appropriate colors assigned to the nodes indicating their existence statuses. The node existence status can be pre-stub (article not created and cited yet), stub (article not created but cited) or created (article created and cited). We use red, yellow and green to encode the three status values of nodes respectively. To help a user visualize when the node articles are cited and created, SSNetViz+ can display the life span bars of selected nodes which display the three stages of the nodes in red, yellow and green. In this way, the user can easily tell when a node article is cited and created, and move the time scroll bar to a timestamp to examine the network and node articles at the timestamp. For example, Figure 2(a) shows the Al-Qaeda’s network before its article was created. As we move the time scroll bar to the later timestamps, the Al-Qaeda network evolves to have more neighbors as shown in Figures 2(b) and 2(c).
(a) Initial (b) At Al-Qaeda 2002 network
June
6,
(c) At April 18, 2003
Fig. 2. Al-Qaeda network at different timestamps
Browsing articles based on past activities. To visualize the user activity behind an information network, SSNetViz+ allows user activity statistics of selected nodes to be displayed in timeline charts. SSNetViz+ can display three types of timeline charts, namely (a) number of links, (b) cumulative number of revisions, and (c) number of words. Time scroll bar, again, can be move to the appropriate timestamp to visualize the node articles and network at time points which the articles show interesting changes in activity statistics. For example, Figure 3 shows the link activity data for the Al-Qaeda node. Addition and removal of nodes. A new node can be added into or removed from the existing information network by calling the node addition and removal operators defined in Section 3.2. In addition, SSNetViz+ supports multi-node addition when an existing node (adorned with a little red box) is selected for neighborhood expansion. The expansion will include all nodes linked to the selected node
Visualizing and Exploring Evolving Information Networks in Wikipedia
57
Fig. 3. Link Activity Data
added to the information network. Multi-node removal is performed removing the neighbors of the selected node collapsing the selected nodes’ neighborhoods. Delta graph analysis. Delta graph analysis in SSNetViz+ is performed by specifying a timestamp marker (using the button at the menu bar) and moving the time scroll bar to another timestamp for comparing the information networks at these two timestamps. The delta difference operation in Section 3.2 will be called to return nodes and edges in + , − and 0 networks. The nodes and edges in + and − are shown in blue and red respectively, while those in 0 have color(s) unchanged. Figure 4 shows the delta difference of the Al-Qaeda’s network between April 11, 2005 and January 22, 2006.
Fig. 4. Delta Difference Example
5
Temporal Search
SSNetViz+ supports temporal keyword search with start and end dates as shown in the main interface window. The search returns node articles with revisions between the start and end dates and containing the specified keyword(s). After using Lucene2 to score the relevance of every revision, SSNetViz+ displays in the result window the revision scores across timestamps of each relevant node article as a colored line in a line chart as shown in Figure 5. The figure shows the nodes containing the search keyword “al-qaeda” and the top 10 relevant nodes 2
http://lucene.apache.org/
58
E.-P. Lim et al.
Fig. 5. Temporal Search Window
Fig. 6. Event Detection in Search Results
are highlighted (including the three terrorist group nodes al-qaeda, taliban and jama’at al-tawhid wal-jihad). Only the revision scores of these 10 nodes are shown to keep the chart easy to read. The recent revisions of al-qaeda node (in red) are shown to be most relevant. This is followed by the revisions of Osama bin Laden node (in blue). The line chart can be further zoomed in for more detailed viewing. Such a line chart provides a useful temporal interpretation of the search result. The left-panel of the result window enumerates all nodes of the search results grouped by node type ranked by relevance. Each node result has a number of revisions that satisfy the search criteria shown as a number in parentheses. Each time, only 10 relevant nodes are highlighted and the user can always select the next or previous 10 relevant nodes to examine.
Visualizing and Exploring Evolving Information Networks in Wikipedia
59
Temporal search coupled with line chart can be used to locate relevant events in relevant nodes. For example, when using ”september 11” keyword between August 5, 2001 to June 1, 2008, a sudden surge of revision relevance score of a terrorist Zacarias Moussaoui was found around May 5, 2005 as shown in Figure 6. Upon verification, we found out that Moussaoui had surprised the court by pleading guilty to all September 11 related charges against him around that time. This had caused in more frequent use of “september 11” keyword in his article. Selected nodes in the search results can be added to SSNetViz+’s visualization panel as anchor nodes by dragging and dropping the nodes to the visualization panel. This effectively combines search results with visualization and exploration.
6
Conclusion
In this paper, we describe the design and implementation of SSNetViz+, a tool for visualizing, exploring and querying evolving information networks in Wikipedia. SSNetViz+ has been implemented using Java with the extracted information network data stored using MySQL database. SSNetViz+ manages multiple versions of information networks and supports operations to manipulate these networks. Using terrorism network as an example, we show the various capabilities of SSNetViz+, including exploring information networks by timestamp, comparing information networks across timestamps, and showing search results by line charts. SSNetViz+ is currently under user evaluation by terrorism experts from the International Center for Political Violence and Terrorism Research (ICPVTR). The future work items on SSNetViz+ include automatic identification and visualization of interesting nodes and links based on user activity data and summarization of search results that include inter-linked nodes articles.
Acknowledgement This work was supported by A*STAR Public Sector R&D, Singapore, Project Number 062 101 0031.
References 1. Bizer, C., Lehmann, J., Kobilarov, G., Auer, S., Becker, C., Cyganiak, R., Hellmann, S.: Dbpedia - a crystallization point for the web of data. Web Semantics: Science, Service and Agents on the World Wide Web 7(3) (September 2009) 2. Brin, S., Page, L.: The anatomy of a large-scale hypertextual web search engine. Computing Network and ISDN Systems 30(1-7) (1998) 3. Chen, C.: Visualizing semantic spaces and author co-citation networks in digital libraries. Information Processing and Management, 401–420 (1999) 4. Herman, I., Melan¸con, G., Marshall, M.S.: Graph visualization and navigation in information visualization: A survey. IEEE Transactions on Visualization and Computer Graphics 6(1), 24–43 (2000)
60
E.-P. Lim et al.
5. Kittur, A., Chi, E., Suh, B.: What’s in wikipedia? mapping topics and conflict using socially annotated category structure. In: ACM CHI (2009) 6. Lim, E.-P., Maureen, Ibrahim, N., Sun, A., Datta, A., Chang, K.: Ssnetviz: a visualization engine for heterogeneous semantic social networks. In: International Conference on Electronic Commerce (2009) 7. Nunes, S., Ribeiro, C., Gabriel, D.: Wikichanges - exposing wikipedia revision activity. In: WikiSym (2008) 8. Sipos, R., Bhole, A., Fortuna, B., Grobelnik, M., Mladenic, D.: Historyviz - visualizing events and relations extracted from wikipedia. In: Aroyo, L., Traverso, P., Ciravegna, F., Cimiano, P., Heath, T., Hyv¨ onen, E., Mizoguchi, R., Oren, E., Sabou, M., Simperl, E. (eds.) ESWC 2009. LNCS, vol. 5554. Springer, Heidelberg (2009) 9. Wu, F., Weld, D.: Automatically refining the wikipedia infobox ontology. In: WWW (2008) 10. Yang, X., Asur, S., Parthasarathy, S., Mehta, S.: A visual-analytic toolkit for dynamic interaction graphs. In: KDD, pp. 1016–1024 (2008)
Do Games Motivate Mobile Content Sharing? Dion Hoe-Lian Goh, Chei Sian Lee, and Alton Yeow-Kuan Chua Division of Information Studies, Wee Kim Wee School of Communication and Information Nanyang Technological University, Singapore 637718 {ashlgoh,leecs,altonchua}@ntu.edu.sg
Abstract. Indagator (Latin for explorer) is a game which incorporates multiplayer, pervasive gaming elements into mobile content sharing. Indagator allows users to annotate real world locations with multimedia content, and concurrently, provide opportunities for play through creating and engaging interactive game elements, earning currency, and socializing. A user study of Indagator was conducted to examine the impact of the usability of Indagator’s content sharing and gaming features, as well as demographic profiles on participants’ motivation to use the application. Participants felt that the features in Indagator were able to support the objectives of content sharing and gaming, and that the idea of gaming could be a motivator for content sharing. In terms of motivation to use, usability of Indagator’s gaming features, gender and participants’ familiarity with mobile gaming emerged as significant predictors. Implications and future research directions are discussed. Keywords: Mobile content sharing game, user evaluation, usability, motivations, social computing.
1 Introduction Social computing applications support interaction and content creation among communities of users. With the rapid advancement of mobile technologies, mobile devices now boast of a collection of advanced features such as image and video capture, location positioning and networking, making it attractive and feasible for social computing applications to be deployed on them. In terms of content creation, the portability of mobile devices allows users to create, share and access multimedia content anytime, anywhere, and do these in new ways not possible with desktop applications [4]. An emerging area in social computing is the use of games to motivate content sharing. A central theme in these applications is that content is created and shared as a consequence of gameplay, and the gaming experience becomes an extrinsic motivator for content sharing [18]. One example of a mobile application that combines content sharing and gameplay is the Gopher Game [2]. Gophers are agents representing tasks to be completed. As players move about their physical surroundings, they pick up gophers and help them complete their missions by supplying them with multimedia location-based content. By doing so, content sharing is achieved since other players may pick up these gophers and view the content associated with them. Despite their potential, research in applications that combine mobile content sharing and gameplay is nascent. They have yet to attract sufficient research in a number G. Chowdhury, C. Khoo, and J. Hunter (Eds.): ICADL 2010, LNCS 6102, pp. 61–70, 2010. © Springer-Verlag Berlin Heidelberg 2010
62
D.H.-L. Goh, C.S. Lee, and A.Y.-K. Chua
of areas, including their appropriate game designs, as well as users’ experience, perceptions and attitudes. Hence, research is needed to understand how such applications can effectively blend gameplay into mobile content sharing to motivate such activities, and understand how users perceive and respond to them. The objectives of the present paper are thus two-fold. The first is to extend current research in mobile content sharing games through the design and implementation of Indagator (Latin for explorer). Unlike existing mobile content sharing games which are primarily casual in nature, Indagator introduces multiplayer, pervasive gaming elements set in a persistent virtual world. The second objective is to evaluate Indagator and uncover the motivations for using the application by examining the influence of usability and users’ demographic profiles.
2 Related Work Games that combine content sharing and gaming are also known as Games With A Purpose (GWAP), and may be characterized as applications that use games to solve a given problem [18]. Such games harness humans to perform computations in an entertaining setting. One of the more prominent examples is the ESP Game [19]. Two remote players are randomly paired and tasked to create keywords to images presented to them within a given time limit. Points are earned only if the two players assign the same keyword. The specificity of the keywords determine the number of points obtained, and coupled with a countdown timer that ticks away the seconds on the screen, excitement, challenge and motivation is added for players. While players are entertained, the matching keywords can be used to improve the performance of image search engines. A related example is the Google Image Labeler1, a variant of the ESP Game. Another example is OntoGame, a platform that uses games for creating ontological knowledge structures [17]. Games include OntoPronto for creating an ontology from Wikipedia entries and OntoTube for annotating YouTube videos with ontological elements. Similar ideas that blend content sharing and gaming can also be found in mobile applications. One example reviewed earlier is the Gopher Game [2]. The game is location-based and a player helps a gopher complete its mission by supplying it with camera phone images and textual content based on a task description. Players earn points depending on the quality of the content submitted and use these points to create new gophers and participate in other in-game activities. By helping gophers complete their missions, content sharing among players is facilitated because other users may collect these gophers and view the images and text associated with them. Next, in MobiMissions [5], content sharing is accomplished through the completion of missions, which are defined by sequences of digital photographs and text annotations associated with specific locations. Players create missions for others to undertake, and search locations for available missions. To complete a mission, a player has to capture up to five photographs and add up to five text annotations. This content can then be shared with other players. Finally, CityExplorer [14] extends the idea of games for labeling images to the physical world. The game treats a geographic 1
http://images.google.com/imagelabeler/
Do Games Motivate Mobile Content Sharing?
63
area, such as a city, as a game board subdivided into segments. Within each segment, players need to label as many points of interest with category names as possible. Categories are not predefined and players can develop their own. A player who creates the most number of labels in a segment wins credits for that segment at the end of the game.
3 Indagator: Blending Content Sharing and Gaming Indagator is inspired by tales of explorers who navigate unchartered territory in their quest for fame, fortune and adventure. As its name suggests, gameplay is modeled after an exploration theme operating in two levels. First, Indagator provides an environment for users to share and seek location-based content. Second, layered upon this information environment is a game of exploration, in which players navigate their physical world to amass treasure, overcome obstacles, and interact with other players. In doing so, Indagator blends play with the collaborative creation, seeking and sharing of information. 3.1 Content Sharing Features At its core, Indagator is a location-based mobile content sharing system. The application provides features for creating, sharing and seeking content on their mobile devices, and is adapted from a mobile annotation system known as MobiTOP (Mobile Tagging of Objects and People) [12]. In Indagator, as in MobiTOP, content refers to location-based annotations, each comprising attributes such as title, tags, textual information, multimedia content (e.g. images) and users’ ratings for that annotation (see top section of Figure 1). At creation time, other implicit attributes are also captured such as contributor name, location (latitude and longitude), and date. The Indagator client supports a map-based interface for exploring annotations (Figure 2). Individual annotations are displayed as markers on a map-based interface, and selecting a marker will show the details of its corresponding annotation. The map
Fig. 1. Annotation details
Fig. 2. Map interface
Fig. 3. Engaging an encounter
64
D.H.-L. Goh, C.S. Lee, and A.Y.-K. Chua
also offers standard navigation features such as pan and zoom. Annotations may also be accessed via tags as well as via filtering by date/time, location and user. The Indagator mobile client was developed using the Java Platform, Micro Edition (J2ME) API running on Nokia N95 smart phones. 3.2 Gaming Features Layered upon Indagator’s content sharing environment are features that allow users to concurrently engage with their content through play. The gaming environment is overlaid upon a player’s actual physical surroundings so that interaction with gaming features is done within the real world. Gameplay in Indagator is deliberately designed to be simple to reduce the cognitive overhead of players who are on the go. In essence, players explore their environment to seek content they need, or create new content to be shared. As part of the game, their goals are to amass wealth by interacting with Indagator’s gaming features. During exploration, players may engage various encounters (see below), interact with other players, and earn in-game currency. Further, the more currency (and hence wealth) a player gains, the higher his/her rank will be, and this is reflected in the game’s leaderboard. Indagator may thus be compared with pervasive, multiplayer games, but unlike these, there are no designated objectives. Instead, Indagator gameplay is open-ended, with the primary purpose of facilitating the exploration and creation of content as players move around in their physical environment. In this sense, Indagator is more similar in genre to virtual worlds such as Second Life2, with the addition of gaming elements unique to the system. Indagator gaming elements include the following. Earning currency. Players earn in-game currency (called aurum) by enriching the environment through contributing content, rating existing content, or through successful engagement of encounters. Aurum can then be spent on creating encounters, to acquire game objects and access other game-based features. Setting encounters. When creating content, players have an option to associate an encounter with it, which will be triggered when the content is accessed. The bottom section of Figure 1 shows an annotation with an encounter type and level of difficulty being selected. Encounters are meant to introduce the elements of entertainment and surprise into content sharing and seeking, and include the following types: • Mini-games are primarily casual in genre and may include puzzles, shooting and board varieties. Games may be contextual, such as a guessing game that presents clues about a nearby attraction for the player to solve, or non-contextual, as in the case of a shooting game. Different games cost varying amounts of aurum. • Traps are designed to inflict damage, and in Indagator, this refers to aurum lost. A player stumbling onto a trap causes him/her to lose aurum to the encounter setter. • Treasure earns a player some amount of aurum and hence increases wealth. This is system-generated and randomized across content. Indagator may also randomly set encounters on annotations to increase diversity of play and introduce an element of unpredictability. 2
http://secondlife.com
Do Games Motivate Mobile Content Sharing?
65
Engaging encounters. Players who access content associated with encounters will have a choice of engaging the encounter and earn aurum, or bypass the encounter to continue accessing the annotation with no penalty or reward. The latter was a design decision undertaken to ensure that content access takes priority over gameplay, and that content should not be denied access to those who need it. However, to encourage engagement, players who do so receive a small amount of aurum, while successful engagements receive more. Figure 3 shows a contextual mini-game in which a player is presented with an image and is asked to specify its location within a nine-grid map. Here, images are harvested from nearby content and the system randomly selects one for the encounter. Players who successfully specify the location will obtain aurum.
4 Evaluating Indagator: Methodology An evaluation was conducted to examine the influence of usability and participants’ demographic profiles on the motivation to use Indagator. Forty-one participants (24 males and 17 females) were recruited from a local university and consisted of undergraduate and graduate students. Their ages ranged from 19 to 37, with an average age of 24. Twenty-three of the participants (about 56%) had a background in computer science, information technology or related disciplines, while the others came from disciplines such as arts, humanities, and business. Slightly more than half of the participants (22) reported they frequently used their mobile phones to share pictures, video, music and other media with others. At the same time, 17 participants (about 40%) played games on their mobile phones frequently. However, 34 participants (about 80%) were frequent players of games on desktop computers. The study was conducted across nine sessions with between four to eight participants per session. The purpose was to keep the number of participants small to allow for greater interaction with Indagator as well as with the researchers conducting the study. Each session began with an introduction to Indagator and the concept of blending gameplay with mobile content sharing. Participants were then given a demonstration of the system and its various features. They were also asked to interact with the system and raise any questions if needed. The entire session lasted approximately one hour. At the end of the session, participants were given a questionnaire to complete. The questionnaire consisted of items that rated the usability of Indagator’s various features on a scale of 1 (strongly disagree) to 5 (strongly agree). Items were adapted from past studies on mobile usability and gaming (e.g. [10, 16]), and covered seven aspects. The first three related to the usability of Indagator’s mobile content sharing features, while the last four were associated with Indagator’s gaming features: • • • • • • •
System navigation – accessing the various features in Indagator Map navigation – zooming, panning and visualizing the annotations on the map Annotation management – creating, viewing, editing and deleting annotations Encounter usability – ease of understanding and engaging encounters Entertainment value of encounters – whether encounters were entertaining Encounter appeal – whether encounters would help encourage content sharing Adequacy of encounter genres – whether the types of encounters were sufficient
Finally, participants were asked whether they would be motivated to share content if they were to use Indagator.
66
D.H.-L. Goh, C.S. Lee, and A.Y.-K. Chua
5 Results Multiple regression analysis was conducted to examine the impact of the usability of Indagator’s content sharing and gaming features as well as demographic profiles on participants’ motivation to use the application. Table 1 shows their standardized betaweights, their associated t-values, as well as the means and standard deviations of participants’ responses to the content sharing and gaming features. In terms of the latter, the table suggests that responses were favorable, with mean values above two, suggesting agreement with the seven usability aspects covered in the questionnaire. Finally, the mean value of the response on motivation to share content (dependent variable) was 3.37 (SD = 1.26), suggesting that participants seemed willing to use Indagator for content sharing. The independent variables impacted motivation to use [F(13, 27)=20.71, p<0.001] and explained about 91% of the variance (R2 = .91). We summarize our results as follows: • Age of participants was not a predictor of motivation to use Indagator. • Males were more likely to use Indagator than females (β = .60, p < .01). • Participants’ with a background in IT-related fields were more likely to use Indagator than those with non-IT backgrounds. • Familiarity with mobile content sharing activities (e.g. photos, music, etc.) did not seem to influence participants’ motivation to use Indagator. • Familiarity with playing games on desktop computers did not appear to predict motivation to use. However, familiarity with playing mobile games was significant (β = -.45, p < .01). Interestingly, this association was negative – a lower familiarity with playing mobile games resulted in a larger inclination to use Indagator. • The usability of Indagator’s mobile content sharing features, comprising system navigation, map navigation and annotation management, did not appear to influence participants’ motivation to use the application. Table 1. Results of multiple regression analysis Independent Variables Demographics
Age Gender Educational background Familiarity with mobile content sharing Familiarity with playing mobile games Familiarity with playing desktop games Usability of mobile System navigation content sharing features Map navigation Annotation management Encounter usability Usability of gaming Entertainment value of encounters features Encounter appeal Adequacy of encounter genres ** p < .01. * p < .05. All other p-values were greater than .05. + Valid only for usability of content and gaming features
β .17 .66 -.32 .03 -.49 .11 -.28 -.15 .11 .20 .47 .40 .73
t 1.44 5.31** -2.44* .33 -5.06** 1.54 -1.88 -1.61 .10 2.10* 4.28** 3.09** 5.88**
Mean (SD) + 3.82 (.41) 3.72 (.40) 3.90 (.42) 4.05 (.97) 3.59 (1.04) 3.39 (.92) 3.39 (1.26)
Do Games Motivate Mobile Content Sharing?
67
• All four aspects associated with Indagator’s gaming features (encounter usability, entertainment value of encounters, encounter appeal and adequacy of encounter genres) were found to be significant predictors. Specifically, participants who reported that encounters were usable (β = .20, p < .05), entertaining (β = .49, p < .01), and likely to promote content sharing (β = .42, p < .01), and that the genres provided were sufficient (β = .66, p < .01), were more likely to use the application.
6 Discussion Our work shares similarities with the Gopher Game, MobiMissions, GWAPs and similar applications in that we aim to investigate the use of games for content sharing. Nevertheless, there are distinct differences that warrant the present research. The Gopher Game may be viewed as a task-based approach to content sharing in which players are given specific objectives to accomplish via gophers. On the other hand, Indagator players can independently create and share any content of interest. The Indagator environment is therefore more open-ended, requiring more complex player-player and player-system dynamics. Similarly, MobiMissions focuses primarily on generating and completing missions, which are well-defined sequences of locations and associated content. Here, Indagator offers a richer gaming environment that supports encounters in addition to content creation and access. In addition, many GWAPs are Web-based games and are primarily casual in genre. Indagator differs by catering to mobile users, and incorporates location-based, multiplayer gaming elements that existing GWAPs do not. The multiple regression analysis showed that all four aspects of Indagator’s gaming feature were positively associated with participants’ intention to use the application. This suggests the importance of creating usable, diverse, exciting and enjoyable genres of encounters to cater to a wide spectrum of players with diverse interests and preferences [6, 16]. Put differently, while Indagator is fundamentally a mobile content sharing application, the layering of gaming elements introduces an added challenge of ensuring that both components (content sharing and gaming) are effectively addressed in terms of usability and playability. Interestingly, none of the usability aspects pertaining to content sharing (system navigation, map navigation and annotation management) were significant predictors of intention to use the application. This finding however does not imply their unimportance. Rather, one possible explanation is that due to the novelty of blending content sharing and gameplay, participants were more focused on gaming features rather on those for sharing and viewing annotations. In addition, because Indagator’s content sharing features were patterned after those found on the Web (e.g. map navigation) as well as on established mobile user interface design guidelines (e.g. [12]), participants may have found usability to be a non-issue when compared to the gaming features. In terms of demographics, only educational background and gender appeared to be significant predictors in motivation to use Indagator. For the former, those trained in IT-related fields showed a greater inclination to use Indagator than those without. One likely reason could be that gaming and content sharing, which were realized as technologically-oriented activities in Indagator, struck a greater resonance with those who had more IT knowledge. There is much support for this finding in the literature where
68
D.H.-L. Goh, C.S. Lee, and A.Y.-K. Chua
prior experience with various forms of information technology has been found to influence the intention of motivation to use a particular technology (e.g. [11, 15]). In terms of gender, males were more likely to use Indagator than females. This finding concurs with research showing that in general, males seem to spend more time playing computers games and enjoy it more [3], and that this behavior occurs across difference cultures [8]. This finding again underscores the importance of designing different genres of encounters to appeal to both males and females, as well as the need for better positioning of Indagator as a platform primarily for mobile content sharing in which players can vary levels of usage of the application’s gaming features. Surprisingly, familiarity with playing mobile games was shown to be negatively associated with motivation to use Indagator. We hypothesize that this could be due to differing expectations of mobile games for entertainment and mobile games for content sharing among participants, although there is insufficient data to support this. Specifically, participants with prior mobile gaming experience held pre-conceived ideas of what games should be. Since Indagator is a relatively new gaming genre in which content sharing is a primary activity and games serve to enhance the content sharing experience, our design decisions were focused on how encounters could be used to access timely and relevant content. While the entertainment aspects of encounters were considered, they were secondary in the version of Indagator that was evaluated. In contrast, participants with no prior mobile gaming experience appeared more likely to use Indagator as their expectations of mobile games remained malleable. Consequently, they may have been able to better appreciate the way encounters were designed to support content sharing.
7 Conclusion The following are some design considerations for Indagator and similar systems: • Games are not universal motivators, and applications that incorporate gaming elements into content sharing should attempt to decouple these components to attract a wider user group [1]. Indagator was deliberately designed such that gameplay can be dislodged from mobile content sharing through the selection of an “Information Mode” by users. In this mode, encounters and other gaming elements are turned off and users only focus on content creation and access. Our intention is to appeal to both non-gamers and gamers alike so that a rich information environment can be created. • Applications that combine content sharing and gaming have to address the twin challenges of usability as well as game design. As demonstrated in our experience with Indagator, participants appeared to focus on the playability aspects of encounters. Consequently, it would be prudent to adhere to established game design guidelines (e.g. [9, 13, 16] even though content sharing may the primary focus. • On a related note, since games are the facilitators to content sharing, the importance of creating diverse and enjoyable genres of games to cater to players with different profiles therefore cannot be overlooked [6]. Thus for example, genres of games that appeal to either or both genders should be incorporated (e.g.[7]).
Do Games Motivate Mobile Content Sharing?
69
Although the user study has yielded useful results, we plan to conduct more comprehensive evaluations in future work. For example, the sample of 41 participants may prevent generalizability of our results. Further, the present study uncovered interesting observations that should be investigated. This includes a better understanding of the usability and game design aspects, as well as personality, gender and other demographic factors that influence attitudes towards content sharing and gaming applications. In the process of doing so, formulating effective design guidelines and evaluation heuristics for this genre of applications would be another area of investigation. Acknowledgements. This work was supported by the Singapore National Research Foundation Interactive Digital Media R&D Program, under research grant NRF2008IDM-IDM004-012.
References [1] Bell, M., Chalmers, M., Barkhuus, L., Hall, M., Sherwood, S., Tennent, P., Brown, B., Rowland, D., Benford, S., Capra, M., Hampshire, A.: Interweaving mobile games with everyday life. In: Proceedings of the 2006 Annual SIGCHI Conference on Human Factors in Computing Systems, pp. 417–426 (2006) [2] Casey, S., Kirman, B., Rowland, D.: The Gopher Game: A social, mobile, locative game with user generated content and peer review. In: Proceedings of the 2007 International Conference on Advances in Computer Entertainment Technology, pp. 9–16 (2007) [3] Chou, C., Tsai, M.J.: Gender differences in Taiwan high school students’ computer game playing. Computers in Human Behavior 23(1), 812–824 (2007) [4] Goh, D.H.-L., Ang, R.P., Chua, A.Y.K., Lee, C.S.: Why we share: A study of motivations for mobile media sharing. In: Liu, J., Wu, J., Yao, Y., Nishida, T. (eds.) AMT 2009. LNCS, vol. 5820, pp. 195–206. Springer, Heidelberg (2009) [5] Grant, L., Daanen, H., Benford, S., Hampshire, A., Drozd, A., Greenhalgh, C.: MobiMissions: The game of missions for mobile phones. In: Proceedings of the ACM SIGGRAPH 2007 Educators Program (2007), http://doi.acm.org/10.1145/1282040.1282053 [6] Ha, I., Yoon, Y., Choi, M.: Determinants of adoption of mobile games under mobile broadband wireless access environment. Information & Management 44(3), 276–286 (2007) [7] Hartmann, T., Klimmt, C.: Gender and computer games: Exploring females’ dislikes. Journal of Computer-Mediated Communication 11(4), Article 2 (2006), http://jcmc.indiana.edu/vol11/issue4/hartmann.html [8] Jackson, L.A., Zhao, Y., Qiu, W., Kolenic, A., Fitzgerald, H.E., Harold, R., von Eye, A.: Culture, gender and information technology use: A comparison of Chinese and US children. Computers in Human Behavior 24(6), 2817–2829 (2008) [9] Jegers, K.: Pervasive game flow: Understanding player enjoyment in pervasive gaming. ACM Computers in Entertainment 5(1), Article 9 (2007) [10] Ji, Y.G., Park, J.H., Lee, C., Yun, M.H.: A usability checklist for the usability evaluation of mobile phone user interface. International Journal of Human-Computer Interaction 20(3), 207–231 (2006) [11] Kim, S.H.: Moderating effects of job relevance and experience on mobile wireless technology acceptance: Adoption of a smartphone by individuals. Information & Management 45(6), 387–393 (2008)
70
D.H.-L. Goh, C.S. Lee, and A.Y.-K. Chua
[12] Kim, T.N.Q., Razikin, K., Goh, D.H., Theng, Y.L., Nguyen, Q.M., Lim, E.P., Sun, A., Chang, C.H., Chatterjea, K.: Exploring hierarchically organized georeferenced multimedia annotations in the MobiTOP system. In: Proceedings of the 6th International Conference on Information Technology: New Generations, pp. 1355–1360 (2009) [13] Korhonen, H., Koivisto, E.M.I.: Playability heuristics for mobile multi-player games. In: Proceedings of the 2nd International Conference on Digital Interactive Media in Entertainment and Arts, pp. 28–35 (2007) [14] Matyas, S., Matyas, C., Schlieder, C., Kiefer, P., Mitarai, H., Kamata, M.: Designing location-based mobile games with a purpose – collecting geospatial data with CityExplorer. In: Proceedings of the 2008 International Conference on Advances in Computer Entertainment Technology, pp. 244–247 (2008) [15] Morris, S.A., Gullekson, N.L., Morse, B.J., Popovich, P.M.: Updating the attitudes toward computer usage scale using American undergraduate students. Computers in Human Behavior 25(2), 535–543 (2009) [16] Pinelle, D., Wong, N., Stach, T.: Heuristic evaluation for games: Usability principles for video game design. In: Proceedings of the 2008 Annual SIGCHI Conference on Human Factors in Computing Systems, pp. 1453–1462 (2008) [17] Siorpaes, K., Hepp, M.: Games with a purpose for the Semantic Web. IEEE Intelligent Systems 23(3), 50–60 (2008) [18] von Ahn, L., Dabbish, L.: Designing games with a purpose. Communication of the ACM 51(8), 58–67 (2008) [19] von Ahn, L., Dabbish, L.: Labeling images with a computer game. In: Proceedings of the 2004 Annual SIGCHI Conference on Human Factors in Computing Systems, pp. 319–326 (2004)
A Multifaceted Approach to Exploring Mobile Annotations* Guanghao Low, Dion Hoe-Lian Goh, and Chei Sian Lee Wee Kim Wee School of Communication and Information Nanyang Technological University {lowg0008,ashlgoh,leecs}@ntu.edu.sg
Abstract. Mobile phones with capabilities such as media capture and location detection have become popular among consumers, and this has made possible the development of location-based mobile annotation sharing applications. The present research investigates the creation of mobile annotations from three perspectives: the recipients of the annotations, the type of content created, and the goals behind creating these annotations. Participants maintained a two weeklong diary, documenting their annotation activities. Results suggest that range of motivational factors, including those for relationship maintenance and entertainment. Participants were also more inclined to create leisure-related annotations, while the types of recipients were varied. Implications of our work are also discussed. Keywords: Mobile phone, mobile annotation sharing, motivations, diary study.
1 Introduction Mobile phones coupled with location-positioning functionality (e.g. global positioning system, GPS) have become increasingly popular, and this has fueled the growth of location-based applications. Combined with other functions such as wireless networking and media capture, mobile phones have become an easy to use platform for media creation and sharing. Besides availability of such functionality, a wealth of research has yielded a number of other motivations for creating or sharing mobile media (e.g. photos and video). For example, mobile media is used to share people’s daily routines, engage in conversations, share information and report news (e.g. [1], [2]). Past research has suggested that such sharing activities can be personally satisfying, meeting emotional needs [3], and serve hedonic purposes (curiosity and diversion, social connection, social avoidance) (e.g. [4], [5]). Conversely, people may choose to create mobile media for personal use only, perhaps for personal recollection or self-reflection [3]. While there are numerous studies on the motivations for mobile media creation and sharing, there is comparatively less work done on mobile annotations, which in this *
This work is partly funded by A*STAR grant 062 130 0057 and Singapore National Research Foundation Interactive Digital Media R&D Program grant NRF2008IDM-IDM004-012.
G. Chowdhury, C. Khoo, and J. Hunter (Eds.): ICADL 2010, LNCS 6102, pp. 71–80, 2010. © Springer-Verlag Berlin Heidelberg 2010
72
G. Low, D.H.-L. Goh, and C.S. Lee
paper, we define as mobile content encompassing multiple media such as text, images, and video. Here, to the best of our knowledge, research mostly centers on tagging of mobile media. For example, in [2], users tag photographs taken on mobile phones for individual and social purposes. We argue that a distinction between mobile media (encompassing single media) and mobile annotations (encompassing multiple/mixed media) are sufficiently different to warrant separate investigation. This is because mobile media may elicit different motivations [1] [6] and we should not make a general assumption that these motivations will surface when multiple media are brought together [7]. Multiple media presents a richer environment and may convey more information than single media. For example, annotations that combine text and images about a vacation would likely communicate more information than just images alone. In this paper, we therefore adopt a multifaceted investigation of mobile annotations. To accomplish this, a diary study and interview of participants were conducted. In the study, participants used MobiTOP (Mobile Tagging of Objects and People), a mobile annotation system to create location-based annotations. The annotations, diary returns and interviews were analyzed using a three-component framework which we coin TAG (Target, Annotation, Goal). The contributions of this work includes: a) the TAG Framework to study the creation of mobile annotations from multiple perspectives; and b) the application of this framework on annotations created by MobiTOP via diary study and email interview. By understanding mobile annotation creation, we argue that systems that meet users’ needs more effectively can be designed. The remaining sections of this paper are structured as follows. Section 2 provides an overview of related work and a discussion of the TAG framework. Section 3 introduces MobiTOP. Next, Section 4 describes our methodology of the study while Section 5 presents our findings and analyses. Finally, Section 6 discusses the implications of this work as well as opportunities for future research.
2 Related Work 2.1 Literature Review In earlier work, mobile media systems were generally for individual use where the main motivation was to document or for reminders. For example, [8] focuses on how to motivate annotations in a personal digital photo library. In contrast, mobile media systems for sharing attract users with different motivations [6]. Studies have shown that users of mobile media applications for sharing created tags that were primarily directed towards “others”. Another study [7] divided “others” into “friends and family” and “public”. Further, [9] explored the uses of Flickr images and discovered that in most cases, it was used to update “others” of one’s life. Many studies also looked at the type of annotations that people create. For example, [10] showed that the images taken on mobile phones tend to be personal, short-lived and ephemeral. Likewise, [11] concluded that mobile phones tended to participate in the “aesthetics of banality” in which the images captured were mainly focused on the mundane, trivial aspects of everyday life. Another example was a diary study carried out in [3] where a list of categories of annotations from the images captured for sharing were uncovered (e.g. People, Objects, and Places of Interest).
A Multifaceted Approach to Exploring Mobile Annotations
73
In the case of motivations, much work has been conducted on mobile media. For example, [12] uncovered five uses of digital images captured using the MMM2 system: (1) creating and maintaining social relationships; (2) as a record and reminder of personal and collective experiences; (3) as a means to voice one’s views; (4) to influence others’ view of oneself through self-presentation; and, (5) as a means to support both personal and group tasks. In related work, [13] organized reasons for co-present media sharing into storytelling, identity presentation, social information sharing and serendipitous discovery. In terms of annotating captured media, [6] examined the motivations for tagging Flickr images. Motivations were cast along two dimensions. The sociality dimension relates to whether an annotation was meant for personal use or for others, while the function dimension refers to an annotation’s intended use – organization or communication. As discussed, there is much work done in studying human behavior in mobile media, while there is comparatively less work done on mobile annotations. Here, work is mostly centered on implementation issues, such as GeoNotes [14] and Micro-Blog [15]. The present work is thus timely as we seek to understand the creation of mobile annotations from multiple perspectives. 2.2 The TAG Framework The literature review above suggests that annotations can be analyzed from different perspectives. In the present research, we consolidate existing work in this area and propose a framework that focuses on three dimensions: the target recipient (T), the content of the annotation (A), and the goal for creating the annotation (G). The target recipient (T) looks at who the annotations are created for. Here, past work has suggested that an annotation may be created for the general public, family and friends or for individual consumption [2] [6] [7]. Next, the content of the annotation (A) identifies the different types of annotations that users create. Studies in mobile media (e.g. [1] [2] [3]) suggest a diverse range of possible categories, and may apply to mobile annotations as well. Finally, the goal for creating the annotation (G) refers to the intentions or motivations of the creator for the annotation itself [4]. This dimension investigates the thoughts behind users’ actions, and as discussed previously, has been extensively studied, especially in mobile media [3] [12] [13]. Our approach is multifaceted, and synthesizes the perspectives from past studies such as those reviewed above. By bringing these perspectives together, we hope to provide framework for a more holistic analysis of mobile annotations behaviours.
3 A Brief Introduction to MobiTOP MobiTOP is a mobile annotation system that allows users to create, share and seek location-based annotations [16]. In MobiTOP, a map-based visualization is supported for exploring and discovering annotations. This map is populated with markers which represent the available annotations in the vicinity (see Figure 1a). Selecting a marker will cause its details to be displayed in a separate screen (see Figure 1b). Standard navigational features such as panning and zooming are also available.
74
G. Low, D.H.-L. Goh, and C.S. Lee
Fig. 1. (a - left) MobiTOP’s map view. (b - right) Screenshot of an annotation’s details
Annotations in MobiTOP consist of information such as title, tags, multimedia content (e.g. images), textual information, creator’s name and date (Figure 1b). Information such as contributor’s name, date and location (latitude and longitude) are implicitly captured at the point of creation. In MobiTOP, tags are used to facilitate the retrieval of related annotations. Additional access mechanisms include filtering by attributes such as date/time, location and user. The current implementation of MobiTOP is developed using the Java Platform, Micro Edition, and has been tested on Nokia N95 8GB smartphones to ease development and evaluation. More details about the MobiTOP system may be found in [16].
4 Methodology We adopted the diary study methodology to gather data from our participants. This was supplemented with an interview at the end of the diary study. Participants in the study were 24 part-time graduate students who were full-time working professionals. They ranged between 20 to 39 years of age and consisted of seven females and 17 males. Most of participants (24) had computer science or IT-related educational background, and they worked in diverse sectors including telecommunications, banking/finance, manufacturing and education. Generally, participants were familiar with the use of mobile phones and mobile applications. Of the 24 participants, 20 were familiar with using the mobile phone’s camera feature and more than half had experience using the mobile phone to browse the Web. However, only seven participants had experience with their phone’s GPS, suggesting that many of the participants were not frequent users of location-based applications. For the diary study, each participant was provided with a Nokia N95 phone and tasked to maintain a two-week diary whereby the participants recorded their MobiTOP usage activities. Specifically, participants were required to record the location that they were at when creating the annotation, the intended recipient(s), tags that describe the annotation, and the reason for creating the annotation. Due to the mobile nature of the study, employing direct observation methods to capture user intentions may not be feasible [17]. Obtaining responses via post-study interviews only presents issues where interviewees may have filtered out or forgotten certain information [18]. In contrast, a diary study is able to obtain a more personal and natural account which may be difficult to observe by another party. It is not intrusive, in situ and would not suffer from retrospective study like interviews.
A Multifaceted Approach to Exploring Mobile Annotations
75
Prior to the diary study, participants were trained in using MobiTOP. Thereafter, they were given instructions and scenarios for the creation of annotations. Participants were also requested to attend a post-study interview in which they further elaborated on their motivations and clarify unclear diary entries.
5 Results and Analyses The diary study generated a total of 650 entries, with an average of 27.1 entries per participant (minimum=14, maximum=33). Here, we elaborate on the findings from the analysis of these diary entries using the TAG framework described earlier. 5.1 Target (T): Who Are the Recipients? We referred to past work to identify the target audiences of the annotations created by the participants in study. Specifically, several studies [2] [3] [6] [7] have identified “self”, “friends and family” and “public” as types of intended recipients. Annotations that were meant for “self” refers to those that were created for the creator only. Those for “friends and family” were meant for the creator’s friends and family, while “public” annotations refer to anyone who may want to view the annotation. In our study, we manually inspected each diary entry provided by the participants to determine the intended recipient(s) of the annotations. We found that annotations intended for self were primarily created to serve as reminders for future reference or entertainment purposes (see Section 5.3). For instance, one participant noted that “This is the first time I am having dinner at this restaurant and it is quite nice. I want to tag it for future reference.” While most annotations were triggered by a place or an activity, some participants reported in their diary that they were “Playing with MobiTOP” from the comfort of their home. Our data showed that annotations that were intended for friends and family typically contained names of locations or items that the participants developed strong positive or negative associations with, and they felt that the information within the annotations might be valuable to their family and friends. For instance one participant had a good dining experience and created this annotation, “I want to share the real chicken rice stall around Jurong that is delicious.” Another had a bad experience in a train station and shared this with his family and friends, “The crowd was frustrating me and I had to join a long queue to take the stairs down.” Lastly, we found that annotations intended for the public contained details of places of attractions, suggestions or recommendations. They tended to include the phrase “share with others” in their diary entries, indicating their desire to share the information with others. In addition, these annotations usually possessed a neutral tone. Some examples include “To share with others the new left side of Jurong Point center” and “I wanted to share with others a moderate price food stall that I found.” 5.2 Annotation (A): What Is Annotated? The content of all annotations were manually inspected and organized into categories as shown in Figure 2. Here, content included title, description, media resources attached and tags. Some annotations’ content belonged to more than one category and
76
G. Low, D.H.-L. Goh, and C.S. Lee
were thus coded as such. As shown in the figure, “Food” and “Shop” were the top two categories indicating that many of the annotations were related to dining or shopping experiences. Annotations from the “Food” category were typically reviews and recommendations such as, “Nice place to have steamboat. Affordable and the food variety is good” and “The restaurant here provides good service compared to other branches”. As for “Shop”, one participant created the following annotation, “This is the place where you can get your fashionable fancy swimsuits”.
Fig. 2. Annotation categories
“View” was the third largest category. These were annotations were created when participants encountered scenic views, and often contained images of landscapes, buildings and breathtaking skylines. These annotations tended to be of the “image of the moment” type, reflecting the participants’ emotions at the moment when the image was captured and their needs to archive the image permanently. Thus, annotations in this category provided an outlet for participants to express their emotions visually. Additionally, we found that annotations related to one of the lower occurring categories, “religion”, typically contained descriptions, images or even videos of places of worship. We attributed the low counts due to the sensitive nature of topic (i.e. religion). Thus, this highlights that participants in our study were generally considerate and sensitive to the needs of others. 5.3 Goal: Why Annotate? Due to the lack of literature on mobile annotations, we culled motivational factors from our earlier work on mobile media [3], others such as [6] [12], as well as identified new categories for those annotations that could not fit into existing ones. We manually examined the motivations from the participants’ diary entries and attempted to include them into the following: (1) creation/maintenance of social relationships; (2) reminding of individual and collective experiences; (3) self-presentation; (4) task performance; and (5) entertainment. Here, entertainment was a new category that was uncovered through our analysis. The following presents a more detailed discussion of the motivations that emerged from our analysis. Creation/maintenance of social relationships refers to establishing new, and keeping up with existing relationships between the sender and recipients through mobile
A Multifaceted Approach to Exploring Mobile Annotations
77
annotations. Such annotations may contain content to provide personal contextual information for another individual, or for friends and family. For example a participant wanted to share with family members a statue that he saw while travelling around Singapore, “To share with my family and friends the Merlion Statue that is a symbol of Singapore” (Figure 3a). Another participant used MobiTOP as an application to share time together with his spouse by showing her how MobiTOP works (“Wife wanted to have a try on the application”). We found that participants created annotations to develop new online relationships with other users. For instance, one participant responded to the annotations created by another by providing more information (e.g. pictures), and the original annotation creator subsequently reciprocated with words of appreciation. Reminding of individual and collective experiences involves sharing annotations as a record and reminder of individual and collective experiences, and may include key moments, everyday activities or even mundane content related to oneself, others within a social circle or even the public. One of the participants created an annotation at a bus-stop so that he could find his way back to the location if he got lost, “I wanted to get to it later in case I lost my way”. Additionally, we found that participants were also motivated to record places for future references, and these places were usually locations where they had great and fun experiences. An example is, “This was the first time I had dinner at this restaurant and it was quite nice. I wanted to tag it for future reference.”
(a) An annotation for creation/maintenance of social relationships
(b) An annotation created while having fun
Fig. 3. Example of photos of annotations
Self-presentation refers to the sharing of annotations to create an impression of oneself on others, or put differently, to influence how other people would view oneself. For instance, a participant wanted to inform others that he was taking a Master’s degree at a local university and created an annotation for it (“To tell others that my Master’s degree was from this university.”) Other participants felt the need to share with others on various aspects of their personal everyday lives. Example include annotations that “Show where I buy my groceries weekly”, and “I want to show the place where I stay with my friends.” Task performance refers to annotations that have a functional value and are meant to assist the sender and/or recipient to complete a task. For instance, participants were found to help by answer or respond to the queries posted by other participants. An example was an annotation used to provide travel directions for a participant. We
78
G. Low, D.H.-L. Goh, and C.S. Lee
also observed that some participants offered help using a more proactive approach. Here, participants anticipated the needs of others and shared information that they felt might be useful. For instance, one participant found a store selling unique items that he had never seen before. He created an annotation “to tell everyone around the world” about the store. Entertainment refers to motivational factors that involve distracting oneself from a particular problem or activity, exploration by experimenting, or simply just having fun. In our study, MobiTOP was used to kill time. For instance, a participant created an annotation describing her surroundings while waiting for his/her transportation “Instead of waiting without doing anything, I decided to create an annotation.” Apart from killing time, some participants were curious about how MobiTOP would work in different situations. “Wanted to try the application in a semi-open parking lot” and “Trying out creating annotations on the move” are examples of participants who wanted to test the location detection capabilities of the application. While experimenting, some participants found it fun to create annotation trails of their travels on the map. One participant noted, “As I am in a boat, my annotations would the trace my boat’s travel when I view them in the map” (Figure 3b).
6 Discussion and Conclusion This research aims to understand for whom, what and why users create mobile annotations. This work serves as one of the first studies behind studying the creation of mobile annotations and proposes a multifaceted analytical framework which we term as TAG. This framework was applied to MobiTOP, a mobile annotation system, to discover and understand the creation of location-based annotations. Earlier studies typically looked at one to two of the following perspectives: who the annotations were for, what did the annotations contain, and why participants created annotations. The TAG framework, however, provides an integrated examination by synthesizing the various perspectives culled from existing literature. We summarize our key findings and discuss their implications on the design and development of mobile annotation systems below: • For the target of the annotations (T), we found that the three major categories were self, family and friends, and public. More importantly, we found that different features were required by different target groups. For the self category, features that will be helpful are those that allow individuals to organize annotations to facilitate future retrieval. However, for annotations intended for family and friends, communication features (e.g. social networking tools) will be highly valuable. Thus, this indicates that designers of mobile annotations systems should not only consider who their users will be, but also account for who their target recipients are. This is so that appropriate features will be incorporated to ensure that the intended recipients (e.g. self, friends and family, public) are able to access the annotations easily. • The analysis of the content of annotations (A) provides an overview of the categories of annotations that users are interested in. Hence, such analysis enables data related to the personal interests of users to be captured. This will be useful to identify user profiles which will aid developers in terms of providing better customiza-
A Multifaceted Approach to Exploring Mobile Annotations
79
tion and personalization. Such data are also highly valued by potential advertisers for personalized mobile advertisements. Thus, designers of such systems may want to explore partnerships and alliances with relevant businesses. • The Goal (G) component of the framework allows us to uncover the motivations behind creation of mobile annotations. We found that motivations are varied and include self- presentation (satisfying personal needs), creation and maintenance of social relationship (social interaction), and task performance (to complete a task). These are consistent with the findings of past work (e.g. [3]). Our findings have important implications on the design of mobile annotation systems. For example, creation and maintenance of social relationship can be afforded by social networking tools (e.g. “friend feeds”). More importantly, one critical finding is the fact that entertainment was a major motivational force behind mobile annotation creation. This implies that designers of similar systems may consider incorporating games to further motivate users to create mobile content. This could include minigames such as planting puzzles, or creating missions which would help to sustain one’s interest in content creation and access. Caution, however, should be exercised when interpreting our results because the nature of this study may reduce the generalizability of its findings. Specifically, the majority of the respondents were working professionals with IT and engineering educational backgrounds. Replication of this study in other contexts (e.g., other agegroups) or in a specific domain (e.g. education) would be useful to better understand mobile annotation creation. Expanding the study to compare MobiTOP with other mobile content sharing applications (e.g., those with games) would allow researchers to understand the impact of entertainment on the creation of mobile annotations. Finally, the effect of other personal characteristics such as gender and personality are relevant constructs that may influence the different dimensions of our TAG framework. Future work may want to investigate the influence of such constructs.
References 1. Java, A., Song, X., Finin, T., Tseng, B.: Why we twitter: understanding microblogging usage and communities. In: Proceedings of the 9th WebKDD and 1st SNA-KDD 2007 Workshop on Web Mining and Social Network Analysis, pp. 56–65. ACM, San Jose (2007) 2. Kindberg, T., Spasojevic, M., Fleck, R., Sellen, A.: I saw this and thought of you: some social uses of camera phones. In: CHI 2005 Extended Abstracts on Human Factors in Computing Systems, pp. 1545–1548. ACM, Portland (2005) 3. Goh, D., Ang, R., Chua, A., Lee, C.: Why we share: A study of motivations for mobile media sharing. In: Liu, J., Wu, J., Yao, Y., Nishida, T. (eds.) AMT 2009. LNCS, vol. 5820, pp. 195–206. Springer, Heidelberg (2009) 4. Taylor, C.A., Anicello, O., Somohano, S., Samuels, N., Whitaker, L., Ramey, J.A.: A framework for understanding mobile internet motivations and behaviors. In: CHI 2008 Extended Abstracts on Human Factors in Computing Systems, pp. 2679–2684. ACM, New York (2008) 5. Kim, H., Kim, J., Lee, Y., Chae, M., Choi, Y.: An empirical study of the use contexts and usability problems in mobile internet. In: Proceedings of the 35th Annual Hawaii International Conference on System Sciences, vol. 5, p. 132. IEEE Computer Society, Los Alamitos (2002)
80
G. Low, D.H.-L. Goh, and C.S. Lee
6. Ames, M., Naaman, M.: Why we tag: motivations for annotation in mobile and online media. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 971–980. ACM, San Jose (2007) 7. Nov, O., Naaman, M., Ye, C.: What drives content tagging: the case of photos on Flickr. In: Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems, pp. 1097–1100. ACM, Florence (2008) 8. Kustanowitz, J., Shneiderman, B.: Motivating annotations for personal digital photo libraries: Lowering barriers while raising incentives. Technical report, HCIL, Univ. of Maryland (2004) 9. House, N.A.V.: Flickr and public image-sharing: distant closeness and photo exhibition. In: CHI 2007 Extended Abstracts on Human Factors in Computing Systems, pp. 2717– 2722. ACM, San Jose (2007) 10. Gye, L.: Picture This: the Impact of Mobile Camera Phones on Personal Photographic Practices. Continuum: Journal of Media & Cultural Studies 21, 279–288 (2007) 11. Koskinen, I.: Seeing with mobile images: Towards perpetual visual contact. In: Proceedings of The Global and the Local in Mobile Communication: Places, Images, People, Connections, Budapest, Hungary (2004) 12. House, N.V., Davis, M., Ames, M., Finn, M., Viswanathan, V.: The uses of personal networked digital imaging: an empirical study of cameraphone photos and sharing. In: CHI 2005 Extended Abstracts on Human Factors in Computing Systems, pp. 1853–1856. ACM, Portland (2005) 13. Naaman, M., Nair, R., Kaplun, V.: Photos on the go: a mobile application case study. In: Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems, pp. 1739–1748. ACM, Florence (2008) 14. Espinoza, F., Persson, P., Sandin, A., Nyström, H., Cacciatore, E., Bylund, M.: GeoNotes: Social and navigational aspects of location-based information systems. In: Abowd, G.D., Brumitt, B., Shafer, S. (eds.) UbiComp 2001. LNCS, vol. 2201, pp. 2–17. Springer, Heidelberg (2001) 15. Gaonkar, S., Li, J., Choudhury, R.R., Cox, L., Schmidt, A.: Micro-Blog: sharing and querying content through mobile phones and social participation. In: Proceedings of the 6th International Conference on Mobile Systems, Applications, and Services, pp. 174–186. ACM, Breckenridge (2008) 16. Razikin, K., Goh, D., Theng, Y.-L., Nguyen, Q., Kim, T., Lim, E.-P., Chang, C., Chatterjea, K., Sun, A.: Sharing mobile multimedia annotations to support inquiry-based learning using MobiTOP. In: Liu, J., Wu, J., Yao, Y., Nishida, T. (eds.) AMT 2009. LNCS, vol. 5820, pp. 171–182. Springer, Heidelberg (2009) 17. Jacucci, G., Oulasvirta, A., Salovaara, A., Sarvas, R.: Supporting the shared experience of spectators through mobile group media. In: Proceedings of the 2005 international ACM SIGGROUP conference on Supporting group work, pp. 207–216. ACM, Sanibel Island (2005) 18. Olsson, T., Soronen, H., Väänänen-Vainio-Mattila, K.: User needs and design guidelines for mobile services for sharing digital life memories. In: Proceedings of the 10th International Conference on Human Computer Interaction with Mobile Devices and Services, pp. 273–282. ACM, Amsterdam (2008)
Model Migration Approach for Database Preservation Arif Ur Rahman1,2 , Gabriel David1,2 , and Cristina Ribeiro1,2 1
Departamento de Engenharia Inform´ atica–Faculdade de Engenharia, Universidade do Porto 2 INESC Porto Rua Dr. Roberto Frias, 4200-465 Porto, Portugal {badwanpk,gtd,mcr}@fe.up.pt
Abstract. Strategies developed for database preservation in the past include technology preservation, migration, emulation and the use of a universal virtual computer. In this paper we present a new concept of “Model Migration for Database Preservation”. Our proposed approach involves two major activities. First, migrating the database model from conventional relational model to dimensional model and second, calculating the information embedded in code and preserving it instead of preserving the code required to calculate it. This will affect the originality of the database but improve two other characteristics: the information considered relevant is kept in a simple and easier to understand format and the systematic process to preserve the dimensional model is independent of the DBMS details and application logic. Keywords: database preservation, dimensional modeling.
1
Introduction
Organizations are increasingly relying on databases as the main component of their recordkeeping systems. However, at the same pace as the amount and detail of information contained in such systems grows, also grows the concern that in a few years most of it may be lost, when the current hardware, operating systems, database management systems (DBMS) and actual applications become obsolete and turn the data repositories unreadable. The paperless office increases the risk of losing significant chunks of organizational memory. In this paper we present an approach for preserving the information stored in relational databases for the future. According to research in the area, the five characteristics of databases which must be preserved are context, structure, content, appearance and behaviour [15,17]. The context includes non-technical information giving answers to questions like who, when and why about the database as well as information on its technical features. The contents is the data stored in the database representing real-world facts. The structure of the database relates to the composition and logical hierarchy of the elements of a database, thus contributing to the meaning
This work is supported by FCT grant reference number SFRH/BD/45731/2008.
G. Chowdhury, C. Khoo, and J. Hunter (Eds.): ICADL 2010, LNCS 6102, pp. 81–90, 2010. c Springer-Verlag Berlin Heidelberg 2010
82
A. Ur Rahman, G. David, and C. Ribeiro
of the data. Appearance is about screen forms used for entering and modifying data and about generated reports. It requires the presence of the user application designed to manipulate data, submit queries, and extract information. The behavior is the dynamic part of the system and, therefore, the most difficult to preserve. It includes the interaction control component and the code implementing the business rules. If the former can be seen as less relevant from a preservation viewpoint, the latter may contain important bits of information, in the form of functions to produce important derived results not explicitly stored in the database. This paper will discuss how the migration from relational to dimensional model impacts the preservation of these database characteristics. Some aspects of preservation which need to be taken care of during the process of database preservation include integrity, intelligibility, authenticity, originality and accessibility [5]. Integrity refers to the completeness, correctness and consistency of data stored in the database. Intelligibility of a database concerns both the interpretation of the data formats and the understandability of the relationships between tables and their relation to the reality they represent. An intricate database model becomes hard to understand. The authenticity is the property which relates the preserved information with its source and is guaranteed by keeping record of the actors, tools and operations involved in a preservation process. Originality in terms of preserving the structure and functionality, should be kept into account but may conflict with other aspects like intelligibility or accessibility. Technical accessibility means that the data is kept in open formats and does not rely on vendor-specific software. The approach to database preservation proposed in Section 3 is based on model migration. This operation changes the structure of the database in order to improve intelligibility and accessibility, the crucial problems identified above. In the process, we might decide to perform a data quality assessment and repair the data to reduce problems like missing values, inserting records on foreign key errors. However, the decision was to keep the data as it is, in order to preserve as much as possible the facts recorded, though in different format, even when they are affected by data quality problems. So, the goal is to preserve the actual level of integrity. The authenticity of the actual database is guaranteed by the inclusion of audit information qualifying the records. The authenticity of the preserved database requires the addition of audit information relating the preserved records to the original ones and the specification of the migration procedures, when they were executed and by whom, using which tools. Authenticity also benefits from metadata about the context of creation and use of the original database which should be recorded in the context component of the preserved database. Note however that the model migration approach is done at the expense of originality.
2
What to Preserve
The model migration approach provides a pre-processing of the database, which can be coupled with existing database preservation initiatives such as the
Model Migration Approach for Database Preservation
83
Software Independent Archiving of Relational Databases (SIARD) [4,14] or the Digital Preservation Testbed (DPT)[15]. SIARD is a non-proprietary published open standard. It is based on other open standards like Unicode, XML, SQL 1999 and the industry standard ZIP [14]. As it is based on open standards, it supports interoperability of the database contents in the long term. Using the SIARD format, even if the database software through which the database was created is not available or not executable, the database will be accessible and usable. At the present it is possible to migrate Oracle, Microsoft SQL Server and Microsoft Access databases to SIARD format. A database in the SIARD format consists of two components namely metadata and the primary data. An uncompressed ZIP archive stores these components having the metadata in the folder header and the primary data in the folder content. Moreover, the archive also stores metadata about which primary data can be found where in the archive [14]. A SIARD database archive can be reloaded in the future to any RDBMS which supports standard SQL [5]. The model migration proposal concentrates on the archival format for the database contents. The archive should contain the original relational model and it may contain the original database file or an export file. The archive must also contain the new preservation model and the preserved contents according to the new model following the SIARD archive structure. A similar approach could be applied to the DPT, modifying its central notion of preservation object. The DPT preservation object has five main components, namely the original database, an XML overview file of the database, applications, the preservation log file and metadata. Testbed suggests the preservation of the original database file (*.mdb or export file). The XML overview file represents an overview of the tables in the database, the relationships between the tables and the content and structure of the actual tables and views. The application component is for storage of queries, stored procedures, application code (if applicable), system documentation and user manuals. It is not meant to preserve the applications as a working entity. The preservation log file contains all the information about the preservation actions through which the database passes. The metadata component contains metadata for the authentic preservation. This is mainly contextual metadata. For using the DPT with our proposal, the overview file has to contain the original relational model and the new model and also the original database file version possibly in XML or SQL DDL format. It is clear from the research done that there can be no single way to preserve all kinds of databases. For our work we define a database as a combination of four components. 1. Data: The data is the contents stored in the tables of a database. 2. Schema: The schema of a database is the structure (data model) which is needed to understand the relationships among tables. Business rules which are partly structural also need to be preserved. 3. Context: The contextual information which is normally not included in the operational system.
84
A. Ur Rahman, G. David, and C. Ribeiro
4. Database Application: The application developed in a high-level programming language for retrieval, modification, and deletion of data in conjunction with various data-processing operations. This contains the appearance and behavioural aspects of the database. A part of the business rules maybe implemented in the behavioural aspect. For preserving a database it is important to take into account the nature of its contents. The contents of some databases evolve with the passage of time e.g. the CIA World Factbook database [1,2] while others remain static as is the case of a population census database. The former needs a different approach than the latter for preservation. In this paper the focus will be on the latter. It is very important to preserve the schema of a database for the understandability and usability of the information stored in it. In our approach as we suggest to migrate the database to a dimensional model, the structure of the preserved database is different from the structure of the operational system but it is easier to understand. A database application can be preserved as a working entity by writing an emulator for it. An emulator is a program that runs on one computer and virtually re-creates a different computer. Therefore, through emulation we can use obsolete application on a recent computer [11]. But there are many problems associated with using emulation as a preservation strategy. For example it cannot be ensured that the computers in the future will be capable of executing an emulator of any older computer. Every time there is some change in the platform for which the emulator was developed, the emulator needs to be re-developed. Another approach to deal with the application component is to simply preserve the user manuals, queries and functions in textual format and not as a working entity [15]. In this paper we propose an alternative approach which calculates and explicitly stores the information embedded in the code (application logic). The goal is to keep just the data and make the information application-independent.
3
Database Migration for Database Preservation
Database migration is not a new concept, it has been studied and discussed in the past [8,9]. Database migration may take different forms including DBMS version evolution (Oracle 10 to Oracle 11), change in DBMS (Oracle to DB2) or change of the data model (hierarchal to relational data model). In this paper we propose the use of model migration from the relational model to the dimensional model as a step for preserving a relational database. 3.1
Dimensional Modeling
Dimensional modeling is a logical design technique that seeks to present the data in a standard framework which is intuitive, allows for high-performance access and is resilient to change [3,6]. Information is stored in tables of two natures: dimensions store detailed data about the entities or objects involved in a certain
Model Migration Approach for Database Preservation
85
relevant process (like clients, items being sold, employees); fact tables store the values representing real world facts (like quantities sold, amounts earned) and the relationship to the corresponding dimensions. A fact table surrounded by the related dimensions is called a star. Dimensions may be shared by different stars. Time and Location are commonly used dimensions. The strengths of the dimensional model make it better for long-term preservation and access to the information. As discussed by Kimball [7] and Ponniah [10], report writers, query tools and user interfaces can all make strong assumptions about the dimensional model which makes the processing more efficient. Other features, as discussed by Torlone [16], include explicit separation of structure and contents, and hierarchies in the dimensions. The separation of the structure and contents helps in making it DBMS independent which is crucial for database preservation. The hierarchies in dimensions help in aggregating the data and result in faster access. In the past dimensional modeling has not been considered for database preservation. 3.2
Model Migration
The design of a database preservation process requires a proper balance of the aspects of originality, integrity, accessibility, intelligibility and authenticity in each major problem to be solved. Two issues to be considered are the complexity of the relational model of real-size information systems and the embedding in code of important knowledge from the application domain. The complexity of the relational model may prove to be a serious stumbling block for preserving databases. Part of it comes from the requirement of redundancy elimination that transaction-oriented databases must follow in order to be efficient and consistent in capturing facts. The preserved database is no longer used for transaction processing but instead for querying and decision making. Although it contains the facts of the original database, the change of usage brings a change of requirements. It is better if the data is preserved in a form that gives simpler and quicker access. This can be achieved by migrating the database from relational model to a dimensional model, as depicted in Figure 1 [12]. The operation will affect the originality of the database but will give a relief from the complexities of the relational model and improve intelligibility and accessibility, because the resulting model is much easier to understand and the queries on it are simpler to state. The second problem is the fact that some results coming from the database are produced by functions embodying application-domain knowledge. Preserving code is a much more difficult problem than preserving data, because it requires the ability to preserve the engine able to run it, from the application to the DBMS or the underlying operating system. But discarding the code affects accessibility, as there is no technical way to reach the derived data it would be producing, and it affects also the integrity as chunks of the data are lost. The solution offered by migration is to include the facts and dimension attributes in the dimensional model to explicitly store the data in danger. In the data migration phase, also called ETL for extraction, transformation and loading according
86
A. Ur Rahman, G. David, and C. Ribeiro
Fig. 1. Model Migration Approach for Database Preservation
to data warehouses terminology [7], the application code is run to produce the implicit values in it, which are then kept in the preserved database. It is assumed that when the preservation operation is performed, the original platform or a compatible one is still available. In the migration process, parts of the relational model which are needed only to support the interaction at the data capture phase or which are not relevant may be dropped. To further simplify the information stored in the database, it can be converted to XML format. This will make the information platform-independent which is very important for achieving its long-term preservation [13,14].
4
Case Study
The proof of concept for the ideas presented in this paper is a case study involving the database for the “Course Evaluation System” of the University of Porto. Students are invited to answer 31 questions about the course they are attending and teacher performance, with answers ranking from 1-5, with 1 the lowest and 5 the highest grade. Information about the identity of the student is not stored and the answers are anonymous. The operational system has a rather complex model, a part of which is shown in Figure 2. It is designed to capture the answers via dynamically built on-line forms. All the reports are calculated at query time using functions based on complex queries. A report can be about the whole faculty, a program, a curricular year or a single course. The user may also choose a granularity level for a report which may be one of the following:
Model Migration Approach for Database Preservation
87
Fig. 2. Relational Model of the Operational System
– Question level: the report presents statistics about each individual question. – Vector level: the questions are grouped into vectors, the report presents statistics about the vectors. – Global level: the vectors are combined into a single result, the report presents statistics about the global results. Before starting the migration process a thorough analysis of the operational system was done. The process was carried out in small steps which resulted in the dimensional model shown in Figure 3. The tables COURSES and PROGRAMS in the operational system are represented by the IPDW COURSES dimension in the dimensional model which has two levels (courses and programs). The tables QUESTIONS and VECTORS are represented by the IPDW QUESTIONS dimension also with two levels (questions and their aggregations in vectors). The questionnaire was modified six times since the inception of the system. The tables QUIZZES and QUIZ GROUPS in the operational system store information about these different quizzes. The IPDW SEMESTER dimension stores information about a semester and the QUIZ used for it. Though the answers of the students are kept anonymous, some information related to them is stored in the IPDW QUIZ dimension in the dimensional model. IPDW ANSWERS is the fact table, it is the de-normalized form of the ANSWERS and VALUES table. Reference keys to the corresponding dimensions along with the values from ANSWERS and VALUES tables are stored in it. Tables GROUPS, VALUES GROUPS, CONFIGURATION, and QUESTIONNAIRE GROUPS were discarded as they were used for dynamically building the interface for the online data capture. In this process it was important not to damage the integrity of the data.
88
A. Ur Rahman, G. David, and C. Ribeiro
Fig. 3. Dimensional Model for the Operational System
In the next step the functions were executed and the results like averages, standard deviation, number of answers and percentiles for each granularity level were explicitly stored. For each granularity level we got a different star with the fact table storing the results coming from executing the functions and references to the corresponding dimensions. One of the stars is shown in Figure 3. The dimensions in this star are shared by others. At this stage the database became application-independent. The dimensions in the dimensional model are systematic and easy to serialize and store in XML along with their structure and metadata. If we compare the models (Figure 2 and Figure 3) it is obvious that the dimensional model is simpler and easier to understand and therefore more intelligible. The information which was embedded in code is now explicitly stored in the database and is readily accessible. Also there is no need to preserve the code for the future. After the process of migration is completed, the results coming from the migrated database were compared with the operational system to verify the authenticity of the information.
5
Conclusion
This paper proposes a model migration approach for database preservation. For migrating the relational model of the operational system a thorough understanding of the original system is required. Before migration it should be decided what is to be kept for the future and what can be discarded. This work is similar to the
Model Migration Approach for Database Preservation
89
evaluation, elimination and description work an archivist must perform before archiving a set of documents.
6
Future Work
This is a work in progress and we are currently engaged in making the process of migration easier. As the proposed approach involves migration of an operational system from a relational model to a dimensional model, we are working on defining some generic transformation rules for the process. The rules will guide the team involved in a migration process. Another aspect that requires further research is metadata. A specification of the metadata needs, both for keeping the database system context and for describing the preservation process is still required.
References 1. Buneman, P., Cheney, J., Tan, W.-C., Vansummeren, S.: Curated databases. In: PODS 2008: Proceedings of the twenty-seventh ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems, New York, NY, USA, pp. 1–12 (2008) 2. Buneman, P., M¨ uller, H., Rusbridge, C.: Curating the CIA world factbook. International Journal of Digital Curation 4(3) (2009) 3. Connolly, T.M., Begg, C.: Database Systems: A Practical Approach to Design, Implementation, and Management. Addison-Wesley Longman Publishing Co., Inc., Boston (2001) 4. Heuscher, S.: Technical aspects of SIARD. ERPANET (2003) 5. Heuscher, S., J¨ armann, S., Keller-Marxer, P., M¨ ohle, F.: Providing authentic longterm archival access to complex relational data. In: Ensuring Long-Term Preservation and Adding Value to Scientific and Technical Data. European Space Agency (2004) 6. Imhoff, C., Galemmo, N., Geiger, J.G.: Mastering Data Warehouse Design: Relational and Dimensional Techniques. Joe Wikert (2003) 7. Kimball, R., Reeves, L., Thornthwaite, W., Ross, M., Thornwaite, W.: The Data Warehouse Lifecycle Toolkit: Expert Methods for Designing, Developing and Deploying Data Warehouses. John Wiley & Sons, Inc., New York (1998) 8. Meier, A.: Providing database migration tools - a practicioner’s approach. In: VLDB 1995: Proceedings of the 21st International Conference on Very Large Databases, pp. 635–641. Morgan Kaufmann Publishers Inc, San Francisco (1995) 9. Meier, A., Dippold, R., Mercerat, J., Muriset, A., Untersinger, J.-C., Eckerlin, R., Ferrara, F.: Hierarchical to relational database migration. IEEE Softw. 11(3), 21–27 (1994) 10. Ponniah, P.: Data Warehousing Fundamentals: A Comprehensive Guide for IT Professionals. John Wiley & Sons, Inc., Chichester (2001) 11. Dutch Archives Testbed Project. Digital preservation testbed white paper emulation: Context and current status. Technical report, Dutch National Archives, Digital Preservation Testbed Project, ICTU, Nieuwe Duinweg 24-26, 2587 AD Den Haag, (June 2003)
90
A. Ur Rahman, G. David, and C. Ribeiro
12. Rahman, A.U., David, G., Ribeiro, C.: Model migration approach for database preservation. In: 5th International Digital Curation Conference, London, December 2-4 (2009) 13. Ramalho, J.C., Ferreira, M., Faria, L., Castro, R.: Relational database preservation through XML modeling. In: Extreme Markup Languages, Montreal Quebec, Department of Informatics, University of Minho, Portugal (August 2007) 14. SFA. SIARD format description. Technical report, Swiss Federal Archives, Berne (September 2008) 15. Digital Preservation Testbed. From digital volatility to digital permanence: Preserving databases. Technical report, National Library of Australia, Dutch National Archives (2003) 16. Torlone, R.: Conceptual multidimensional models. In: Multidimensional Databases, pp. 69–90. Idea Group, USA (2003) 17. Wilson, A.: Significant properties report. Technical report, InSPECT (April 2007)
Automated Processing of Digitized Historical Newspapers beyond the Article Level: Sections and Regular Features Robert B. Allen and Catherine Hall The iSchool at Drexel University 3141 Chestnut Street, Philadelphia, PA 19104, USA {rba,ceh48}@drexel.edu
Abstract. Millions of pages of historical newspapers have been digitized but in most cases access to these are supported by only basic search services. We are exploring interactive services for these collections which would be useful for supporting access, including automatic categorization of articles. Such categorization is difficult because of the uneven quality of the OCR text, but there are many clues which can be useful for improving the accuracy of the categorization. Here, we describe observations of several historical newspapers to determine the characteristics of sections. We then explore how to automatically identify those sections and how to detect serialized feature articles which are repeated across days and weeks. The goal is not the introduction of new algorithms but the development of practical and robust techniques. For both analyses we find substantial success for some categories and articles, but others prove very difficult. Keywords: Access, Classification, Digital Humanities, Historian’s Workbench, Newspapers, Text Processing.
1 Using Structure to Enhance Indexing of Historical Newspapers Local newspapers are important historical resources. In the past several years vast amounts of historical newspapers, largely created from digitized microfilm, have been generated and we would like to support access to these potentially valuable resources. In the U.S., the major initiative is the National Digital Newspaper Program (NDNP) which is being sponsored by the National Endowment for the Humanities (NEH) and the Library of Congress [1]. Participating states deliver digitized page images and OCR text using the METS/ALTO schema1. To date, this OCR has mostly been used for search interfaces2 but much richer access could be supported by identifying the structure (e.g., articles and sections) of the newspapers. Because such large amounts of historical materials are being digitized, automated methods of processing are needed. 1
2
METS/ALTO is a marriage of METS (Metadata Encoding and Transmission Standard) and ALTO (Analyzed Layout and Text Object). The former standard uses XML to encode descriptive, administrative, and structural metadata about digital objects; the latter describes the content and layout of each piece of the digital object. e.g., http://www.loc.gov/chroniclingamerica/
G. Chowdhury, C. Khoo, and J. Hunter (Eds.): ICADL 2010, LNCS 6102, pp. 91–101, 2010. © Springer-Verlag Berlin Heidelberg 2010
92
R.B. Allen and C. Hall
The structure of modern newspapers is described by standards such as the International Press and Telecommunications Council (IPTC) family of News Exchange Format Standards (e.g., NEWSML 1, NEWSML-G2, NITF). The IPTC has also developed taxonomies, known as descriptive NewsCodes, for the categorization of newspaper content.3 There are five sets of these descriptors and we will focus on two of those here. The first of these is Genres, which describes the nature, journalistic or intellectual characteristic of a news object, but not specifically its content. Some examples of Genre include: Background, Daybook, Scener, and Feature. The second taxonomy is Subject Codes which is a hierarchical system to describe content in three different levels of specificity (Topics, SubjectMatter, SubjectDetail). Examples here include: Arts, Culture & Entertainment, Archaeology, and Fire. Allen et al. [2] reports an initial study of automated processing methods for the OCR from historical newspapers. They first explored automatic methods to segment the pages based on the OCR. Several approaches were tested, such as including semantic coherence among the terms, but for this dataset the best results were obtained from detecting font changes from article headings. This approach was fairly successful overall and especially for relatively large, well-structured articles; however, it was less successful for tightly packed advertisements and notices. After the articles were segmented, they were assigned to genres with the intention that at least some of the genres (especially news stories) would be processed further (in later research), for instance by assigning subject codes. This sequence, from segmentation to genre assignment to subject code assignment, was described as a pipeline processing model. For the genre and topic categorization, they [2] primarily employed templates based on the presence of specific words. For instance, the weather reports were identified because they included terms such as “temperature”, “degree”, and “snow”. While the OCR text had many errors, there were often enough correct terms for the articles to be identified, especially for those types of articles (such as a weather reports and reports about chess matches) where there were predictable and distinctive terms. In addition to the word templates, matches (exact or partial) for some distinctive phrases (e.g., “Weather Report”) were also used as evidence of the appropriate genre category. With considerable tuning, fairly accurate matching was obtained for focused categories. However, the cost of improved accuracy could be a loss of flexibility both when formats and styles change, and across different newspapers. Moreover, it was found to be difficult to maintain the spirit of the pipeline; the second step of determining genre would actually be of use in the first step, determining segmentation [2]. In addition, the IPTC distinction between Genres and Subject Codes did not always match the logic of the pipeline. For instance, advertising is considered by IPTC as type of content. Nor are all genres easy to identify; reviews (literature, theater, music etc) often look no different in format from other news articles. Rather than pursuing the pipeline processing model per se, it seems more reasonable to frame the task as identifying and using as many of the regularities and constraints as are available to optimize the identification of the various components of 3
http://www.iptc.org. Other modern newspapers often have XML tags even if they are not IPTC compliant. For instance, in the Los Angeles Times has a types of subject category based on “Desks”; for instance, there is a “Book Review Desk”. The New York Times has “Times Topics”.
Automated Processing of Digitized Historical Newspapers beyond the Article Level
93
these newspapers. One constraint which should be useful is that articles on related topics are often positioned near each other. Knowing the section could be helpful for disambiguating OCR and correcting errors because we may then utilize domain specific ontologies which are more successful than general purpose ontologies. As a second type of constraint, we can explore whether we can find regular feature articles. Neither of these tasks is difficult for human analysis but because we need to process millions of pages of historical newspapers there is an enormous advantage to developing automated techniques. In Section 2, we survey the frequency and stability of sections across newspapers. We then turn to procedures for automatically extracting sections. In Section 3, we extend the subject categorization of based on word counts. We also explore the identification and extraction of regular feature articles.
2 Description of Regular Feature Articles and Sections Surprisingly, there has been little systematic description of the structure and organization of newspapers so we started with that. We found that some feature articles are repeated across days; some fall directly into the genre classifications as defined by IPTC, but others do not readily match those categories. In any event, knowing that those items are repeated and clustered may make them easy to detect. First, we examined what types of clustered and categorized material was typically present in the historical newspapers. Next, we examined how the type of material and its clustering changed across time and how it varies across different newspapers. We obtained page images from the NDNP team at the Library of Congress for several Washington DC newspapers for the years 1900 to 1910. The Washington Times was selected as our primary focus because we had the most complete run for it. We then compared the Washington Times for two months during 1904 and then again during 1908. We also compared the Washington Times to another Washington newspaper, the Washington Herald and a rural Pennsylvania newspaper, the New Holland Clarion. 2.1 Washington Times, March 1904 We examined each page for the first week of March. Although we kept in mind the general notion of genres, and more specifically IPTC’s genre categories, we found it helpful to think in terms of ‘sections’ as we attempted to identify and explain the pieces of information that come together to make up a newspaper. The backbone of any newspaper is its traditional news articles, those pieces that report on current or recent events, but we also identified a number of other regular items and features: Classifieds: Times Want Ads is a dedicated page each day for classified advertisements. Typical categories include; Help Wanted, Situations Wanted, Wanted, For Sale, For Rent, For Hire, Lost, Found, Personal, Miscellaneous. Daybook: This includes What Is Going on in Washington; a list of theaters and show times, excursions etc. Also, a section of possibly paid for advertisements under the heading of Amusements, which includes theater and music performances, forthcoming lectures etc.
94
R.B. Allen and C. Hall
Editorial: Appearing daily with the masthead, a portion of the page is reserved for editorial comment. Financial Information: A daily section which incorporates financial news items, market tables (Washington Stock Exchange, New York Stock Exchange, New York Cotton Market/ Chicago Grain Market). Also a section entitled Current News and Gossip of Interest to Investors. Local News: In March 1904, The Washington Times had regularly appearing features dedicated to the news of regions local to the DC area (Alexandria, Boyds, Georgetown, Hyattsville, and Rockville). Each of these sections may be as short as two or three paragraphs and while News of Georgetown appears every day during this particular week, News from Rockville only appears once. Masthead: Editorial/publication information including editor’s name, office address, subscription prices. Notices: This is a broad category that covers many of the small recurring sections identified from the March 1904 files. Some examples of Notices include Advertised Letters, Church Notices, Death Record, Died, Foreign Mails, Legal Notices, Local Mention, Marriage Licenses, Railroads, Real Estate Transfers, Special Notices, Trustee Sales. Poems: Each day on the same page as the masthead and editorial, the newspaper publishes a short poem or verse. Reviews: Weekly reviews of new theater productions (Tuesday) and literature (Saturday). Society News: A daily section appearing on the same page as the masthead/editorial titled In the Circle of Society. It contains news about and of interest to the upper echelons of Washington society - dinners, dances, receptions, people who are in and out of town. Sports: A dedicated sports page appears in the newspaper each day. It incorporates news items, results tables, schedules, etc. Weather Report: Appears on the front page daily. Includes temperature tables and sun rise/set times and tide table. Women’s Interests: A significant daily section is The Home Its Problems and Interests. Aimed at women, it contains a mix of short features, tips and recommendations on subjects such as fashion, food, children, health and beauty, and haberdashery. On Sundays, most of the aforementioned features are present, but the paper is substantially longer (about 50 pages) and split into five parts. The first part closely resembles the Monday-Saturday version of the newspaper with a few changes – e.g. more full-page advertisements and the movement of certain features such as society news, financial, classifieds etc to the Metropolitan Section. There is also a selfexplanatory Comic Section, and Magazine Features, which includes columnists, special reports and features, and women’s fashion. The final part is titled Colored Section and contains a mixture of fictional stories and factual features (sometimes pieces of historical interest or sensational true stories), all of which are richly illustrated through photographs and drawings.
Automated Processing of Digitized Historical Newspapers beyond the Article Level
95
2.2 Washington Times, November 1904 By November 1904 several sections which we had observed in March had changed names. For example, The Circle of Society became In Society’s Circle, and Literature became In the Book World. The content of these sections, however, remained largely the same. A more noticeable development is the thinning out of local news sections; Hyattsville Notes and News from Boyds which appear in the March 1904 papers do not appear in the November 1904 papers we analyzed. Additions to the paper are minor and include a daily cartoon and a section titled Points in Paragraph. Both of these appear on masthead/editorial page and the latter appears to be an extension of the editorial, offering pithy comments about current news. 2.3 Washington Times, March 1908 By 1908, Marriage Licenses and Died are combined (along with Births) in Vital Records. New sections added by this period include the politically focused What Congress Did (a short report on bills passed, resolutions adopted, people who spoke in both the Senate and the House) and Today’s Caller’s at the White House (politicians and noteworthy visitors expected that day). Another minor addition is Court Record, a notification of the cases being heard in court that day. Changes were also made to the Masthead/Editorial page; Points in Paragraph and the cartoon which appeared in November 1904 have not lasted. News from Rockville has disappeared, leaving Alexandria and Georgetown as the only local areas to have distinct news sections. Society news enjoys more prominence at this point, moving from the editorial page to earlier in the newspaper. Variously titled (e.g., Tea and Luncheon Parties; Weddings Dinners Teas) it occupies the majority of a page, sometimes continuing on to a second. Similarly, the women’s interests section (now called Facts and Fads in the Realms of Home and Fashion), which now also includes Notes from Stage Folks, has expanded to fill most of a page. 2.4 Washington Herald, 1908 After comparing the Washington Times across different years, we then moved to compare it with other newspapers. We first looked at the Washington Herald, another daily DC newspaper, founded in October 1906. Looking at the same weeks in March and November 1908, it was easy to identify similarities in the sections and structure of the two papers. Features like weather reports, advertisements, editorial comment, sports and financial sections are expected to exist in both papers, and it is also no surprise that both also contain similar notices – marriage licenses, death record, times of church services, court records etc. Both papers also have sections for women’s interests, news from local areas (although the geographic areas covered do differ), and society gossip. Sometimes the similarities extend beyond the content of the paper to the structure itself; the women’s section of both papers appears regularly, but not always, on page 7; and the ‘Want’ advertisements appear usually, but not always, on page 10 of each. While the overall structure is similar, we noted several differences between the papers. Examples of unique features in the Herald include readers’ letters, fiction serialization and the daily columnist Frederic J. Haskin, who writes on a variety of serious and frivolous topics. The similarities between the papers far outweigh the differences, however, and it
96
R.B. Allen and C. Hall
is highly likely that an automated process developed to identify sections in one paper could also identify a large number in the other. In February 1939, the two papers merged to become the Washington Times-Herald. 2.5 New Holland Clarion As a comparison with the urban Washington DC newspapers, we also evaluated the March and November 1904 and 1908 editions of The New Holland Clarion, a weekly newspaper from New Holland, a small rural town in Lancaster County, Pennsylvania. Strikingly, many similarities could be drawn with the Washington Times. There were sections for local news (Hatville, Blue Ball, Intercourse, Churchtown, etc.), sports, and finance (although focused on the produce and livestock markets). Generally, these sections were shorter than those in urban newspapers. National news was sparsely reported compared and rarely made the front page. This is a small community newspaper; a front page story from March 1904 was titled Many Bones Are Broken and concerns a number of people who had broken limbs during inclement weather. Like the Washington Times, the Clarion includes a substantial number of advertisements and classifieds, and also a number of notice-type sections including unclaimed letters, times of church services, and railroad timetables. Marriages and deaths are also reported, though sometimes more sensationally than in the Times; example headlines include The Work of the Reaper and Gone to the Great Beyond. The New Holland Clarion also has a section devoted to people who in and out of town (Points Purely Personal) and, in November 1908, it introduced a women’s interest feature called Home Circle Department, aimed at “tired mothers as they join the home circle and eveningtide”. 2.6 Summary of Observations The amount of consistency across the three papers is notable. Structure exists that should be easily recognizable by both human and automatic extraction methods. We know that certain features such as sports, classifieds, financial, society news and women’s interests appear in the Washington Times daily. We also know that when an edition of the paper is 12 pages long, the sports section is likely to appear on page 8, the financial information on page 9, and the Times Wants Ads on page 10. In addition, certain features of the Washington Times are likely to appear together; the masthead and editorial comment are always on the same page, and the society news regularly appears with them. However, there is also considerable change in sections over time and across newspapers. Indeed, not only do the details of the sections change but the conceptual organization itself changes. For instance, Vital Records may or may not appear as a separate section and when it does it appear typically includes a mix of Births, Deaths, Marriages.
3 Automated Procedures So many pages of historical newspaper have been digitized that is not realistic for them to be manually marked up. Thus, we explore techniques for automatically identifying the sections and features described in Section 2.
Automated Processing of Digitized Historical Newspapers beyond the Article Level
97
3.1 Test Data Set Because sections change frequently, we cannot simply create a template to find them consistently; instead, we need to develop automated procedures for finding the sections. We focused on five categories of sections which we judged to be fairly robust and which, if correctly identified, would account for a substantial portion of the newspapers. For each of those sections, we manually listed the pages on which they appeared for each day during March 1904 and established rules for the coding. On some days some sections filled more than one page, for instance, sports and classified advertising sometimes covered one-and-a-half pages. In those cases, we coded only one full page. However, when these sections covered less than one page they were coded for that page and, indeed, these could be two sections on one page. 3.2 Section Identification from Tagged Articles The first technique we explored was based on the article-categorization approach of Allen et al.[2]. If we found a sufficient number of sports articles on a page, we would conclude that that page was a Sports section. The accuracy for this procedure was low, even for distinct sections such like Sports. Apparently, there was enough error in the article-level identifications that accurate categorizations could not be made with this approach and we did not pursue it. 3.3 Section Identification from Page-Level Word Lists Rather than focusing on articles, we shifted to considering entire pages using a wordcounting technique similar to the method in [2]. Specifically, we developed word lists for each of the five types of sections on which we were focusing. We then found the average frequency for each of the terms across all the pages for that month. Next, we compared the frequencies separately for each page to the frequency for the entire month. If the page frequency exceeded the overall monthly frequency by a large multiplier (e.g., 30 times), that was considered to be a hit. Then, if a minimum number of such matches (e.g., 4) were obtained for a given category we identified it as that type of section. We applied this method to the 324 weekday pages of the Washington Times for March 1904 for which complete data were available and we compared the results with the section coding from Section 3.1. Table 1 summarizes the results with the pagelevel word-list technique. This technique turned out to be quite successful for the sections on which we focused but less successful when we explored other types of sections such as Editorials. Although Sports had many distinctive terms, we found only a few distinctive words which were associated with Editorials and even those were not reliably captured by the OCR. The lowest accuracy observed in Table 1 was for Society. While that section often included news about galas with royalty and diplomats, there were some days when the events reported were more mundane and hence more difficult to distinguish from other news.
98
R.B. Allen and C. Hall
Table 1. Hit and False Alarm Ratios for several sections for the weekdays (324 pages) during March