EXPLORING GEOVISUALIZATION
The maps on the cover are spatializations that use the landscape metaphor to represent the information in this book. The symbols represent the chapters, the relationships between them and the themes that they address as described in the Preface. Maps by Sara Fabrikant, Jo Wood and Jason Dykes.
EXPLORING GEOVISUALIZATION
Edited by
j. Dykes Department of Information Science City University, London, UK
A.M. MacEachren Departmentof Geography, Penn State University University Park, PA, USA
M.-J. Kraak Department of Geolnformation Processing International Institute of Geolnformation Science and Earth Observation (ITC), Enschede, The Netherlands
2005 tea
A C t
ELSEVIER
Published on behalf of the International Cartographic Association by Elsevier Amsterdam Paris - San
- Boston Diego
- Heidelberg
- San Francisco
- London
- New York-
- Singapore
- Sydney
Oxford - Tokyo
ELSEVIER B.V. Radarweg 29 P.O. Box 211, 1000 AE Amsterdam The Netherlands
ELSEVIER Inc. 525 B Street, Suite 1900 San Diego, CA 92101-4495 USA
ELSEVIER Ltd The Boulevard, Langford Lane Kidlington, Oxford OX5 1GB UK
ELSEVIER Ltd 84 Theobalds Road London WC 1X 8RR UK
9 2005 Elsevier Ltd. All rights reserved. This work is protected under copyright by Elsevier Ltd, and the following terms and conditions apply to its use: Photocopying Single photocopies of single chapters may be made for personal use as allowed by national copyright laws. Permission of the Publisher and payment of a fee is required for all other photocopying, including multiple or systematic copying, copying for advertising or promotional purposes, resale, and all forms of document delivery. Special rates are available for educational institutions that wish to make photocopies for non-profit educational classroom use. Permissions may be sought directly from Elsevier's Rights Department in Oxford, UK: phone (+44) 1865 843830, fax (+44) 1865 853333, e-mail:
[email protected]. Requests may also be completed on-line via the Elsevier homepage (http://www.elsevier.com/locate/permissions). In the USA, users may clear permissions and make payments through the Copyright Clearance Center, Inc., 222 Rosewood Drive, Danvers, MA 01923, USA; phone: (+1) (978) 7508400, fax: (+1) (978) 7504744, and in the UK through the Copyright Licensing Agency Rapid Clearance Service (CLARCS), 90 Tottenham Court Road, London WIP 0LP, UK; phone: (+44) 20 7631 5555, fax: (+44) 20 7631 5500. Other countries may have a local reprographic rights agency for payments. Derivative Works Tables of contents may be reproduced for internal circulation, but permission of the Publisher is required for external resale or distribution of such material. Permission of the Publisher is required for all other derivative works, including compilations and translations. Electronic Storage or Usage Permission of the Publisher is required to store or use electronically any material contained in this work, including any chapter or part of a chapter. Except as outlined above, no part of this work may be reproduced, stored in a retrieval system or transmitted in any form or by any means, electronic, mechanical, photocopying, recording or otherwise, without prior written permission of the Publisher. Address permissions requests to: Elsevier's Rights Department, at the fax and e-mail addresses noted above. Notice No responsibility is assumed by the Publisher for any injury and/or damage to persons or property as a matter of products liability, negligence or otherwise, or from any use or operation of any methods, products, instructions or ideas contained in the material herein. Because of rapid advances in the medical sciences, in particular, independent verification of diagnoses and drug dosages should be made. First edition 2005 Reprinted 2007 Library of Congress Cataloging in Publication Data A catalog record is available from the Library of Congress. British Library Cataloguing in Publication Data A catalogue record is available from the British Library. ISBN-13:978-0-08-044531-1 ISBN-10:0-08-044531-4 (Hardbound) ISBN-10:0-08-044533-0 (CD-rom) O The paper used in this publication meets the requirements of ANSI/NISO Z39.48-1992 (Permanence of Paper). Printed in China.
Working together to grow libraries in developing countries www.elsevier.com I www.bookaid.org ] www.sabre.org
Contents Preface ................................................................................................................
ix
Digital Appendices ...........................................................................................
xiii
Acknowledgments .............................................................................................
xv
List of Contributors .........................................................................................
xvii
Introduction: Exploring Geovisualization 1. Exploring Geovisualization Jason Dykes, Alan M. MacEachren & Menno-Jan Kraak ....................... 3
Section A Geovisualization in Context: Perspectives from Related Disciplines 2. Information Visualization: Scope, Techniques and Opportunities for Geovisualization Daniel A. Keim, Christian Panse & Mike Sips ...................................... 23 3. Information Visualization and the Challenge of Universal Usability Catherine Plaisant .................................................................................... 53 4. Beyond Tools: Visual Support for the Entire Process of GIScience Mark Gahegan .........................................................................................
83
Section B Creating Instruments for Ideation: Software Approaches to Geovisualization Perspectives 5. Creating Instruments for Ideation: Software Approaches to Geovisualization Gennady Andrienko, Natalia Andrienko, Jason Dykes, David Mountain, Penny Noy, Mark Gahegan, Jonathan C. Roberts, Peter Rodgers & Martin Theus ............................................................. 103
vi
Exploring Geovisualization
6. Statistical Data Exploration and Geographical Information Visualization Martin Theus .......................................................................................... 127 7. Graph Drawing Techniques for Geographic Visualization Peter Rodgers ......................................................................................... 143 8. Exploratory Visualization with Multiple Linked Views Jonathan C. Roberts ............................................................................... 159 9. Visualizing, Querying and Summarizing Individual Spatio-Temporal Behaviour David Mountain ..................................................................................... 181 10. Impact of Data and Task Characteristics on Design of Spatio-Temporal Data Visualization Tools Natalia Andrienko, Gennady Andrienko & Peter Gatalsky ................. 201 11. Using Multi-agent Systems for GKD Process Tracking and Steering: The Land Use Change Explorer Monica Wachowicz, Xu Ying & Arend Ligtenberg ............................ 223 12. Signature Exploration, a Means to Improve Comprehension and Choice within Complex Visualization Processes: Issues and Opportunities Penny Noy ............................................................................................. 243 13. Facilitating Interaction for Geovisualization Jason Dykes ........................................................................................... 265
Section C
Using 3D in Visualization
14. Using 3D in Visualization Jo Wood, Sabine Kirschenbauer, Jtirgen D611ner, Adriano Lopes & Lars Bodum .............................................................. 295 15. Multim im parvo Many Things in a Small Place Jo Wood ................................................................................................. 313 -
16. Geovisualization and Real-Time 3D Computer Graphics Jtirgen D611ner ....................................................................................... 325
Table of Contents
vii
17. Interactive Approaches to Contouring and Isosurfacing for Geovisualization Adriano Lopes & Ken Brodlie .............................................................. 345 18. Applying "True 3D" Techniques to Geovisualization: An Empirical Study Sabine Kirschenbauer ............................................................................ 363 19. Modelling Virtual Environments for Geovisualization: A Focus on Representation Lars Bodum ........................................................................................... 389 20. Web-based Dissemination and Visualization of Operational 3D Mesoscale Weather Models Lloyd A. Treinish .................................................................................. 403
Section D Connecting People, Data and Resources: Distributed Geovisualization 21. Connecting People, Data and Resources - Distributed Geovisualization Ken Brodlie, David Fairbairn, Zarine Kemp & Michael Schroeder ................................................................................. 425 22. Moving Geovisualization toward Support for Group Work Alan M. MacEachren ............................................................................ 445 23. Models of Collaborative Visualization Ken Brodlie ............................................................................................ 463 24. Intelligent Information Integration: From Infrastructure through Consistency Management to Information Visualization Michael Schroeder ................................................................................. 477 25. A Knowledge-based Collaborative Environment for Geovisualization: Ontologies for Multiple Perspectives on Distributed Data Resources Zarine Kemp .......................................................................................... 495 26. Geovisualization Issues in Public Transport Applications David Fairbairn ...................................................................................... 513 27. Presenting Route Instructions on Mobile Devices: From Textual Directions to 3D Visualization Volker Coors, Christian Elting, Christian Kray & Katri Laakso ......... 529
viii
Exploring Geovisualization
Section E Making Useful and Useable Geovisualization: Design and Evaluation Issues 28. Making Useful and Useable Geovisualization: Design and Evaluation Issues Sven Fuhrmann, Paula Ahonen-Rainio, Robert M. Edsall, Sara I. Fabrikant, Etien L. Koua, Carolina Tob6n, Colin Ware & Stephanie Wilson ........................................................... 553 29. 3D Geovisualization and the Structure of Visual Space Colin Ware & Matthew Plumlee ........................................................... 567 30. Applications of a Cognitively Informed Framework for the Design of Interactive Spatio-temporal Representations Robert M. Edsall & Laura R. Sidney .................................................... 577 31. User-centered Design of Collaborative Geovisualization Tools Sven Fuhrmann & William Pike ........................................................... 591 32. Towards Multi-variate Visualization of Metadata Describing Geographic Information Paula Ahonen-Rainio & Menno-Jan Kraak .......................................... 611 33. Evaluating Self-organizing Maps for Geovisualization Etien L. Koua & Menno-Jan Kraak ...................................................... 627 34. Evaluating Geographic Visualization Tools and Methods: An Approach and Experiment Based upon User Tasks Carolina Tob6n ...................................................................................... 645 35. Cognitively Plausible Information Visualization Sara Irina Fabrikant & Andr6 Skupin ................................................... 667
Conclusion" Advancing Geovisualization 36. Advancing Geovisualization Jason Dykes, Alan M. MacEachren & Menno-Jan Kraak ................... 693 Index ................................................................................................................ 705
Preface you judge a book by its cover? "Exploring Geovisualization" draws upon perspectives from disciplines including information science, computer science and cartography to discuss and advance the emerging field of geovisualization and maps the contributions from these fields on the cover of the book. One of the areas in which expertise from these domains has been usefully combined to develop techniques and augment knowledge is in the generation and mapping of information spaces or spatializations. These are maps that show the relationships between a series of documents in a collection according to the information contained in each. The cover of this book contains two such maps, on each of which the chapters within are displayed as a landmark. These are represented on the maps with a point symbol and a label identifying the first author of the chapter. The landmarks are arranged using a technique that places documents with more similar contents closer together on the page. The maps themselves fill a continuous information space in which a variety of topics are organized according to their semantic relationships. Where chapters are more closely related, landmarks are clustered in the information space and we can consider the document collection (the book in this case) to have a particular focus on the themes that the chapters address. It seems plausible to draw upon the metaphor of the landscape to map the presence or absence of information relating to themes within the information space. This can be achieved by representing the various thematic foci of the book as an undulating semantic surface with continually varying magnitudes. Where a number of chapters are relatively closely related the information landscape metaphorically piles up into mountains of information about a particular theme. The valleys between information peaks occur in areas of the information landscape associated with topics about which the book focuses less explicitly. The topographic shading scheme used in the map on the left draws further upon the metaphor to represent the "thematic density" of the book across our information landscape. Note however that the landscape and the distribution of the documents represent contributions to this book, and the documents themselves are only discrete samples of possible information sources within the information space - there are likely to be alternative information sources beyond the scope of this volume that can fill ix
Exploring Geovisualization
the information valleys. Indeed it could be argued that whilst the chapters that are clustered in our information space represent current research foci (as reported here), those in information valleys and isolated locations may represent topics that require additional research efforts and are the most 'cutting edge'. The map on the right splits the landscape up into discrete units and shades the information space according to the section of the book in which the chapter represented by the closest landmark occurs. This allows us to see how the sections of the book map into our information space and the themes that are represented by areas within it. The map also allows us to consider the ways in which the chapters within the sections relate to each other according to our spatialization. We hope that these graphics and the metaphor are interesting and that they will prompt some thought about both the book and the nature of maps and information spaces. Some of the decisions taken in developing these spatializations are subjective (though each was thoroughly discussed and we have been through a number of redesigns!) and any number of graphical realizations of the contents of the book might be developed. There are clear parallels here with conventional cartography that depicts the world around us as all map-makers draw upon the three major tenets of map design: theme, purpose and audience, to develop their products. The main difference with spatialization is that it is perhaps more difficult to compare maps of information to an objective truth than is the case with traditional cartography. Despite the complex transformations and abstractions that occur and are imbued with the influence of personal and socio-cultural preference and bias, most cartographers would accept the existence of a 'reality' that they are mapping, that shapes their work, and upon which to develop their design and assess error. When generating spatializations we do not have the notion of a physical standard upon which to base and evaluate our maps. In addition to their role in inspiring metaphors and stimulating thought and discussion we also hope that the maps on the cover provide both a pertinent starting point for the book and an overview of some aspects of its contents. Perhaps they offer a relatively novel opportunity to view and assess the scope of a book, or at least the relationships between the chapters within it, from its cover.
Details on the Cover Map The maps that we have used on the cover of the book utilize a topical or thematic density surface. The surface was produced by Sara Fabrikant and developed through discussions with the editors and a number of other colleagues. Jason Dykes and Jo Wood then used the LandSerf software to generate the maps, in discussion with Sara and others, by applying symbolism, shading and some cartographic exaggeration. The process consisted of a number of stages. Initially Latent Semantic Indexing (Deerwester et al., 1990) was used to determine the similarities between all chapters by comparing the chapter titles and keywords submitted by the authors.
Preface
xi
This seemed to produce more meaningful results than a comparison of the full-text of the abstracts. Principal Coordinate Ordination was then used to collapse the document similarity matrix into two-dimensional spatial coordinates. To generate a topical density surface that reflects the discrete nature of the input data (the book chapters in this case) a pycnophylactic surface was interpolated from these point locations (Tobler, 1979). The pycnophylactic reallocation approach is an areal interpolation technique that permits the construction of smooth density surfaces from more abrupt continuous data, such as those recorded in area-based enumeration units. The chapters represent such discrete boundaries within the information landscape of "Exploring Geovisualization". A voronoi tessellation was derived from the point locations to represent the maximal zone of influence for each of the 36 chapters. The voronoi boundaries were then used as break lines in the process of pycnophylactic interpolation to generate an estimation of the information landscape of the book. Full details on using the method to generate cognitively plausible information spaces are provided in the literature (see Fabrikant, 2001) and the development and application of a framework for doing so is presented later in Chapter 35 (Fabrikant and Skupin, this volume). The resultant density surface was further manipulated in LandSerf (Wood, 2004) to add structured noise and to apply shading and some cartographic enhancements. The noise was designed to add visual interest, to draw attention to the uncertainty inherent in the surface and to reinforce the landscape metaphor of information 'hills' and 'valleys'. This was achieved by combining the density surface with a random fractal surface of fractal dimension 2.1. The original surface was smoothed and rescaled so that the total fractal noise was approximately 4% of the 'true' variation. LandSerf was then used to generate vector contour lines at a vertical interval of approximately 10% of the total variation in relief. The colour scheme applied to the surface is based upon the work of the Swiss cartographer Eduard Imhof for the representation of relief (Imhof, 1965). Relief shading was also computed in LandSerf and the combination of the original surface with the noise, contours, topographic colour scheme and hill shading emphasizes the use of the landscape metaphor to represent density of information about the themes in our landscape. The voronoi polygons are shaded using a colour scheme derived from the examples, guidelines, and considerations suggested by Brewer (1994) and implemented in ColorBrewer (Harrower and Brewer, 2003). The colour scheme is also employed to differentiate between sections of the book in the digital appendices which provide a number of spatializations through which "Exploring Geovisualization" may be explored. The labels were added using the comprehensive text elements in SVG. LandSerf will export raster surfaces to PNG, JPEG and other graphics formats and vectors directly to SVG. Jason Dykes Sara Fabrikant Jo Wood
xii
Exploring Geovisualization
References Brewer, C. A., (1994) "Color use guidelines for mapping and visualization", In: MacEachren, A. M., and Taylor, D. R. F., (eds.), Visualization in Modern Cartography, Vol. 2. Oxford: Elsevier Science Ltd., pp. 123-148. Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T. K., and Harschman, R., (1990) "Indexing by latent semantic analysis", Journal of the American Society of Information Science, 41, 391-407. Fabrikant, S. I., (2001) "Visualizing region and scale in semantic spaces", Proceedings, The 20th International Cartographic Conference, ICC 2001, Beiing, China, pp. 2522-2529. Harrower, M., and Brewer, C. A., (2003) "ColorBrewer.org: an online tool for selecting colour schemes for maps", The Cartographic Journal, 40(1), 27-37, online: http://www.colorbrewer.org Imhof, E., (1965) Kartographische Geliindedarstellung. Berlin: De Gruyter. Wood, J. (2004) LandSerf. online: http://www.landserf.org/(10/10/04) Tobler, W. R., (1979) "Smooth pycnophylactic interpolation for geographical regions", Journal of the American Statistical Association, 74(367), 519-530.
Digital Appendices It is quite a challenge to produce a book on geovisualization as colour, animation and dynamism are so important in the field and yet we are severely limited in terms of the extent to which we can draw upon these essential features of digital cartography when publishing on paper. We have therefore produced a series of digital appendices, included on the CD that accompanies this book. These contain the colour imagery submitted by each of the authors and should be used in conjunction with your reading of the book and consideration of the figures (particularly those that rely upon colour). The digital appendices are accessed through an interactive interface that draws upon a number of alternative spatializations of the contents of the book. These include those shown on the cover and discussed in the Preface. We also draw upon a network representation, rather than one that uses a continuous space to represent relationships between the chapters. The networks and their derivation are described in the introduction to the book (Dykes et al., this volume (Chapter 1)).
xiii
This Page Intentionally Left Blank
Acknowledgments Thanks are due to a number of individuals and organisations without whom this book would not have been possible. These include: the International Cartographic Association; the ICA Commission on Visualization and Virtual Environments; City University, London, and in particular The School of Informatics, Walter Sickert Hall and the Open Learning Centre; the participants at the London 'Exploring Geovisualization' workshop for contributing to a stimulating meeting - including Bob Spence, Ebad Banissi, Heiko Bleschschmeid and Steph Wilson; the various contributors to this volume whose efforts and patience are hugely appreciated; the reviewers whose comments have helped shape this book; series editor Bob McMaster; Elsevier Ltd.; Alden PrePress Services; TheresaMarie Rhyne and the ACM SIGGRAPH Carto Project; Werner Kuhn; the European Science Foundation (EURESCO Conferences); Stephanie Marsh; Jo Wood; Emma Dykes; Sara Fabrikant and Andr6 Skupin; MGI students at City University for comments on cover proposals; ITC, International Institute of Geoinformation Science and Earth Observation and the School of Informatics, City University, London for material support. For his role in developing these perspectives on geovisualization, MacEachren is pleased to acknowledge support over the past several years from the U.S. National Science Foundation (9983451, 9978052, 0113030, 0306845), from the Advanced Research and Development Activity (ARDA), and from the U.S. National Cancer Institute (NCI-CA95949).
XV
This Page Intentionally Left Blank
List of Contributors Paula Ahonen-Rainio Department of Surveying, Institute of Cartography and Geoinformatics, Helsinki University of Technology, PO Box 1200, Espoo, FIN-02015 HUT, Finland Gennady Andrienko Fraunhofer AiS.SPADE - Institute for Autonomous Intelligent Systems, Spatial Decision Support Team, Schloss Birlinghoven, Sankt-Augustin, D-53754, Germany Natalia Andrienko Fraunhofer AiS.SPADE - Institute for Autonomous Intelligent Systems, Spatial Decision Support Team, Schloss Birlinghoven, Sankt-Augustin, D-53754, Germany Lars Bodum Centre for 3D Geolnformation, Aalborg University, Niels Jernes Vej 14, DK-9220 Aalborg 0, Denmark Ken Brodlie School of Computing, University of Leeds, Leeds LS2 9JT, UK Volker Coors Stuttgart University of Applied Sciences, Schellingstr. 24, 70174 Stuttgart, Germany
Jtirgen D611ner Hasso Plattner Institute at the University of Potsdam, Helmert-Str. 2-3, 14482 Potsdam, Germany Jason Dykes Department of Information Science, City University, London EC 1V 0HB, UK Robert M. Edsall Department of Geography, Arizona State University, PO Box 870104, Tempe, AZ 85287, USA Christian Elting European Media Lab (EML), Schloss-Wolfsbrunnenweg 33, 69118 Heidelberg, Germany Sara Irina Fabrikant Department of Geography, University of California Santa Barbara, 3611 Ellison Santa Barbara, CA 93106, USA David Fairbairn School of Civil Engineering and GeoSciences, University of Newcastle Upon Tyne, Newcastle Upon Tyne NE1 7RU, UK Sven Fuhrmann GeoVISTA Center, Department of Geography, The Pennsylvania State University, 302 Walker Building, University Park, PA 16802, USA xvii
xviii
Exploring Geovisualization
Mark Gahegan GeoVISTA Center, Department of Geography, The Pennsylvania State University, University Park, PA 16802, USA Peter Gatalsky Fraunhofer AiS.SPADE - Institute for Autonomous Intelligent Systems, Spatial Decision Support Team, Schloss Birlinghoven, Sankt-Augustin, D-53754, Germany Daniel A. Keim Computer Science Institute University of Konstanz Box D78, Universit/itsstral3e 10 D-78457, Konstanz Germany Zarine Kemp Computing Laboratory, University of Kent, Canterbury, Kent CT2 7NF, UK Sabine Kirschenbauer Institute for Cartography, Dresden University of Technology, Dresden, Germany Etien L. Koua Department of Geo-Information Processing, International Institute for Geo-Information Science and Earth Observation (ITC), P.O. Box 6, 7500 AA Enschede, The Netherlands Menno-Jan Kraak Department of Geo-Information Processing, ITC, International Institute of Geoinformation Science and Earth Observation, P.O. Box 6, NL-7500 AA Enschede, The Netherlands Christian Kray German Research Center for AI (DFKI), Stuhlsatzenhausweg 3, 66123 Saarbrticken, Germany
Katri Laakso Nokia Research Center (NRC), It~imerenkatu 11-13, 00180 Helsinki, Finland Arend Ligtenberg Wageningen UR, Centre for Geo-Information, Droevendaalsesteeg 3, PO BOX 47, 6700 AA Wageningen, The Netherlands Adriano Lopes Department of Informatics of the Faculty of Science and Technology/CITI, New University of Lisbon, Lisbon, Portugal Alan M. MacEachren GeoVISTA Center, Department of Geography, Penn State University, 303 Walker, University Park, PA 16802, USA David Mountain Department of Information Science, City University, London EC 1V 0HB, UK Penny Noy School of Informatics, City University, London EC 1V 0HB, UK Christian Panse Computer Science Institute University of Konstanz Box D78, Universit~itsstrage 10 D-78457, Konstanz Germany William Pike GeoVISTA Center, Department of Geography, The Pennsylvania State University, 302 Walker Building, University Park, PA 16802, USA Catherine Plaisant Human-Computer Interaction Laboratory, University of Maryland, HCIL/UMIACS A.V. Williams Building, University of Maryland, College Park MD 20782, USA
List of Contributors Matthew Plumlee Data Visualization Research Lab, Center for Coastal and Ocean Mapping, University of New Hampshire, Durham, New Hampshire, USA Jonathan C. Roberts Computing Laboratory, University of Kent, Canterbury, Kent CT2 7NF, UK Peter Rodgers Computing Laboratory, University of Kent, Canterbury, Kent CT2 7NF, UK Michael Schroeder Department of Computing, City University, London, UK Laura R. Sidney Department of Geography, Arizona State University, Arizona, USA Mike Sips Computer Science Institute University of Konstanz Box D78, Universit~itsstral3e 10 D-78457, Konstanz Germany Andr6 Skupin Department of Geography, University of New Orleans, New Orleans, LA 70148, USA Martin Theus Department of Computer-Oriented Statistics and Data Analysis, University of Augsburg, Universit~itsstr. 14, 86135 Augsburg, Germany Carolina Tob6n Department of Geography and Centre for Advanced Spatial Analysis
xix
(CASA), University College London (UCL), 1-19 Torrington Place, Gower Street, London WC1E 6BT, UK Lloyd A. Treinish Mathematical Sciences, IBM Thomas J. Watson Research Center, 1101 Kitchawan Road, Yorktown Heights, NY 10598, USA Monica Wachowicz Wageningen UR, Centre for Geo-Information, Droevendaalsesteeg 3, PO BOX 47, 6700 AA Wageningen, The Netherlands Colin Ware Data Visualization Research Lab, Center for Coastal and Ocean Mapping (and Computer Science Department), University of New Hampshire, 24 Colovos Road, Durham, NH 03824, USA Stephanie Wilson Centre for HCI Design, City University, Northampton Square, London EC 1V 0HB, UK Jo Wood Department of Information Science, City University, London EC 1V 0HB, UK Xu Ying Wageningen UR, Centre for Geo-Information, Droevendaalsesteeg 3, PO BOX 47, 6700 AA Wageningen, The Netherlands
This Page Intentionally Left Blank
Introduction Exploring Geovisualization
1. Exploring Geovisualization Jason Dykes, Alan M. MacEachren & Menno-Jan Kraak ..............................................................................
3
This Page Intentionally Left Blank
Exploring Geovisualization J. Dykes,A.M. MacEachren, M.-J. Kraak (Editors) 9 2005 Elsevier Ltd. All rights reserved.
Chapter 1
Exploring Geovisualization Jason Dykes, Department of Information Science, City University, London EC 1V 0HB, UK Alan M. MacEachren, GeoVISTA Center, Department of Geography, Penn State University, 303 Walker, University Park, PA 16802, USA Menno-Jan Kraak, Department of GeoInformation Processing, ITC, International Institute of Geoinformation Science and Earth Observation, PO Box 6, NL-7500 AA, Enschede, The Netherlands
Keywords: geovisualization, GIScience, Cartography, EDA, Information Visualization, maps, multi-disciplinary, research agenda, challenges, workshop, collaboration
Abstract This introductory chapter makes the case for exploring geovisualization from multiple, inter-disciplinary perspectives and presents the structure of the book in which this is achieved. It does so by introducing geovisualization and drawing upon the work of the International Cartographic Association Commission on Visualization and Virtual Environments in reporting research foci and challenges in geovisualization and documenting recommendations for action through which these can be addressed. An examination of the nature of geovisualization and its various interfaces with cognate fields of academic study is identified as a key requirement. The objective is to foster communication, encourage collaboration and augment existing knowledge with that from relevant disciplines. The organization and structure of a geovisualization workshop in which these requirements were addressed is outlined. The outcomes of the workshop form the basis of this book. The book, in turn, supports and broadens the process of collaboration through reports on current research efforts and cross-disciplinary sharing of knowledge about our related fields of expertise. It contains a series of introductory contributions followed by sections entitled "creating instruments for ideation", "using 3D in visualization", "connecting people data and resources" and "making useful and usable geovisualization". Each of these sections is preceded by a collaboratively produced co-authored introduction to a particular focus for geovisualization. Crossreferences between these chapters and sections are common and many are explicitly identified in the text and supported by the digital appendices. Readers are encouraged to further relate concepts, issues and themes that are apparent between chapters in the book as they explore geovisualization and we collectively advance this evolving field. 3
J. Dykes, A.M. MacEachren & M.-J. Kraak
1.1
Geovisualization in Context
Geovisualization is an emerging field. It draws upon approaches from many disciplines, including Cartography, Scientific Visualization, Image Analysis, Information Visualization, Exploratory Data Analysis (EDA) and GIScience to provide theory, methods and tools for the visual exploration, analysis, synthesis and presentation of data that contains geographic information (MacEachren and Kraak, 2001a). The interactions across these disciplines are fluid, as are the boundaries delimiting the disciplines themselves. The art and science of Cartography has developed to embrace and support visualization. This has occurred informally through the efforts of cartographers to support map use and map users by employing the tools afforded by technical advances effectively and more formally through the Commissions of the International Cartographic Association (ICA) on map use, visualization and most recently visualization and virtual environments. Over the past decade, the ICA Commissions have focused on the use of highly interactive maps by individual experts to support thought processes that are motivated towards the discovery of unknowns in complex spatial data sets. Over time, the technologies and techniques that have supported these processes have become more readily available, information has become more accessible and a broadening range of types of high-quality spatial data have been recorded. The result is that greater numbers of geographic information users are now employing highly interactive techniques to achieve insight from a variety of spatial data sets. These users are not the traditional consumers of conventional Cartography and the uses to which they put their maps are evolving. Yet, whomever it involves and however it is used, geovisualization is about people, maps, process, and the acquisition of information and knowledge. It can lead to enlightenment, thought, decision making and information satisfaction, but can also result in frustration! When employed effectively, geovisualization offers the possibility for engaging, personal and specific interfaces to geographic information through which a range of users may be able to participate in a variety of activities that require and rely upon the geographic component of the information in hand. The increasing importance and use of spatial information and the map metaphor establishes geovisualization an essential element of 21st century information use, a genuine opportunity for 21st century Cartography and a requirement for modern map users.
1.2
Geovisualization Research
Considerable research activity in geovisualization is drawing upon the expertise available in a number of cognate disciplines to support the efforts of this variety of users of geographic information. This is the case whether the process of discovery is private or collective and whether it is related to the acquisition of established knowns or the search for insight to identify, explain and understand particular unknowns. The nature of geovisualization research is thus multi-faceted and associated research efforts are wide ranging. However, a number of broad themes can be identified
Exploring Geovisualization
5
that pervade recent activities and define an agenda for this evolving field. "Research Challenges in Geovisualization" (MacEachren and Kraak, 2001b) is a multi-authored effort coordinated by the ICA Commission on Visualization and Virtual Environments that delineates an international research agenda by identifying particular areas in which specific activity is required and has the potential for impacts well beyond Cartography. These focus areas are closely inter-related and should certainly not be regarded as discrete. They include research with an emphasis on representation, visualization-computation integration, interfaces and cognitive/usability issues and are summarized below to describe the nature and scope of current geovisualization research priorities.
1.2.1
Focus on representation
Fundamental questions about the representation of geographic phenomena arise as technological possibilities develop and the data available for depiction through advanced and interactive graphical realizations changes. Challenges include determining the limits and advantageous uses of both traditional and novel representation methods, creating meaningful graphics to represent very large, multi-variate spatio-temporal data sets (that may include both three spatial dimensions and time) and the development, use and continual evaluation of innovative tools that take advantage of interactivity, animation, hyper-linking, immersive environments, agents, multi-modal interfaces and dynamic object behaviors. Augmented and mixed reality applications and multi-modal representations of data are examples of technologically driven possibilities for which traditional approaches to geographic representation are unlikely to be adequate.
1.2.2
Focus on visualization-computation integration
The way that we construct knowledge from geospatial data can draw upon interactive visual representations that use some of these novel techniques. However, we are likely to be most successful in analyzing large complex spatial data sets if geovisualization is able to draw heavily and directly upon advances in Computer Science and computer graphics. The design, development and testing of software and hardware solutions that support the kinds of graphical interactivity that are specifically required by geovisualization is a key requirement. One aspect of this challenge involves integrating and adapting advances in computer graphics and Information Visualization associated with visual datamining for application to geographic data analysis. Such integration of tools and techniques would make it practical for us to participate in visually enabled knowledge construction across the process of GIScience. This process can benefit from closely linked software tools focused on uncovering patterns in complex structured geospatial data, the explanation of these structures and relationships through the development and testing of theory and the ultimate communication of this knowledge.
1.2.3
Focus on interfaces
Advances in geovisualization interface design are essential for visually enabled knowledge construction to have the greatest impact. Additionally, techniques need to be
6
J. Dykes, A.M. MacEachren & M.-J. Kraak
improved and developed to make geovisualization available to a wide range of users with a variety of requirements. Facilitating progress in the real world use of geospatial information and technology may require the adaptation of existing interface design (for example, see w1.2.4) and the development of new paradigms to provide high levels of interaction with advanced forms of (possibly novel) representation (for example, those relying upon augmented and mixed reality). Further knowledge is required concerning the possibilities afforded by multi-modal methods of accessing and interacting with information, and in using these and other means to create forms of interaction that are appropriate to particular combinations of user, task and circumstance. The various requirements presented by mobile devices, the desire to support group work, and the need to accommodate and support different groups and individuals make this a particularly challenging area of research.
1.2.4
Focus on cognitive/usability issues
Whatever the application, it is essential that we develop knowledge of whether the geovisualization techniques, tools and solutions that are produced actually work and under what circumstances this is the case. We must also be able to explain and even predict such outcomes. We can begin to achieve these objectives by studying the ways in which different users react to a range of new and established geovisualization methods. By drawing upon knowledge of the perceptual and cognitive processes involved, we may be able to generate a body of knowledge and associated theory relating task, technique and user type that establishes best practice. A whole range of users with different ages, cultures, sexes, levels of experience and sensory abilities may participate in visualization as individuals or in collaboration with others. Methods drawn from human computer interaction (HCI), such as the concept of "usability" may enable us, with associated knowledge, to both develop solutions for particular types of user and task and to approach the objective of "universal usability" in geovisualization. Each of these four areas of research focus has clear parallels with more traditional cartographic research, and can draw upon the knowledge derived from that work. Each can also benefit from knowledge obtained in domains beyond Cartography and GIScience. The need to undertake effective research in these areas is becoming increasingly urgent as maps are used more frequently, for more tasks, by more users, to provide access to and insight from more data.
1.3
Geovisualization Challenges
Our progress in each of these areas of geovisualization is dependent upon various fundamental issues that cut across the themes. They are established as a series of "geovisualization research challenges" in the ICA research agenda (MacEachren and Kraak, 2001). Each challenge relates to a current concern towards which the research efforts of the geovisualization community should be usefully applied.
Exploring Geovisualization
1.3.1
7
Research challenge 1 - experimential and multi-modal "maps"
Many of the questions being asked by geovisualizers relate to the increasingly experiential and multi-sensory representation technologies that are available. There is a need to develop the technologies and understanding that will enable geovisualization to use such modes of information access and manipulation effectively. Generating maps that do so will involve improving our models of the world so that they occupy volume and are dynamic - a considerable challenge when much geospatial information draws upon the traditional map metaphor in which space is regarded as flat and static. Much geographic information science and technology also starts with this assumption. Whilst such technical challenges are addressed, conceptual tensions associated with the way that realism and abstraction are utilized must be resolved. In some circumstances and applications visual and virtual realism are regarded as an ideal (and the challenge of rendering virtual spaces in real time is an active research problem, particularly in computer graphics). Yet the existing geovisualization paradigm is grounded in an assumption that abstraction is essential for achieving insight. It is vital that we explore and resolve the tensions between these perspectives if we are to make scientific progress and take advantage of developing technologies that offer exciting possibilities for virtual realism, multi-sensory representation and sophisticated modes of interaction, rather than be taken advantage of by them.
1.3.2
Research challenge 2 - large data sets
Geospatial data sets of progressively larger size and increasingly complex structure offer a continuing challenge for geovisualization as we aim to develop appropriate techniques, tools and approaches. Whilst the initial promise of visualization was based upon leveraging the power of human vision to extract meaning from complex data sets, many existing techniques do not scale well to the massive datasets that are increasingly common. Meeting this challenge will require advances in the methods used and their integration with geocomputational techniques that must also be enhanced and developed. Ultimately human understanding can then be used to steer an investigative process that draws upon visual processing, domain knowledge and advanced computational techniques to uncover patterns and relationships and determine their meaning. A key issue here is that many existing methods and tools do not encode geographic knowledge and meaning in effective ways. Knowledge construction using such tools can neither build easily from existing knowledge as a result, nor can they capture knowledge as it is generated. This is a challenge that demands not just new methods and tools, but requires a fundamental effort in theory building directed to the representation and management of geographic knowledge.
1.3.3
Research challenge 3 - group work
Advances in telecommunications and display technologies are making multi-user systems (through which group work can be supported) more effective, sophisticated, accessible and common. Most work with geographic information requires coordinated effort by groups, and yet the tradition in geovisualization research (and GIScience research more
8
J. Dykes, A.M. MacEachren & M.-J. Kraak
broadly) focuses on the individual expert, operating in isolation in the private domain. As a result, methods and tools have tended to be designed for individual use. Research effort is required to develop a new generation of techniques and competence to support same and different-place collaborative geovisualization. Attention must also be focused on the cognitive, social, and usability issues of visual display mediated dialogue, both amongst human collaborators and between human and computer. 1.3.4
Research challenge 4 - human-centered approach
Technology is a key driver of geovisualization, yet we can learn a great deal from disciplines that have developed and continue to employ a human-centered approach to their science. An important goal involves the development of an approach to geovisualization research that integrates work on technological advances leading toward more powerful and usable tools with work on human spatial cognition and the potential of visual (and other concrete) representations to enable thinking, learning, problem solving, and decision making. Approaches that can be characterized as "build and they will come" and "one tool fits all" dominate contemporary geoinformation technology. Yet a compelling need exists to develop both the theory and practice to support universal access and usability for geospatial data. This will require new approaches and methods that support the personalization of geovisualization tools to assist particular users and user groups with particular geovisualization tasks.
1.4
Exploring Geovisualization - Rationale
The geovisualization challenges outlined here indicate that the boundaries of Cartography are becoming less clear-cut, the nature of map use and users is broadening and the range of influence and sources of stimuli shaping Cartography is widening. The set of geovisualization challenges identified is a demanding one, yet the importance of addressing them is evident. The need for a multi-disciplinary approach to address such multi-faceted issues successfully is equally apparent. A concerted effort by a broad and deep community of scientists offering multiple linked perspectives is required: "cartographers cannot address these challenges alone" (MacEachren and Kraak, 2001 a). However, MacEachren and Kraak (2001a) also note that whilst "most of the challenges [facing geovisualization] are multi-faceted ones, requiring multi-disciplinary perspectives ... Little exchange of ideas occurs across disciplines working on related problems, with multiple sets of largely separate literature having few or no cross citations". A number of recommendations for action are made in "Research Challenges in Geovisualization" (MacEachren and Kraak, 2001 a) with the aim of coordinating efforts more effectively. A key proposal is the promotion of interdisciplinary communication and cross-disciplinary work to encourage more scientists to commit to multi-disciplinary research through which the challenges can be met. The investigation of geovisualization practice and issues from a number of disciplinary perspectives and communication between experts and practitioners
Exploring Geovisualization
9
in cognate disciplines are thus key objectives for advancing geovisualization. The need for such activity to be both supported by researchers and research infrastructures and valued by systems of recognition is also noted. Events at which geovisualization can be discussed and explored from a variety of perspectives, augmented with knowledge from relevant disciplines, and reported to the community are an essential means of addressing the geovisualization challenges. Doing so enables us to investigate the nature of geovisualization and its various interfaces with cognate fields, advance our knowledge and further define our discipline and practice. These activities will assist us in establishing inter-disciplinary awareness and encourage the required collective approach in the short term. Efforts to establish shared knowledge and identify commonalities and differences in understanding, techniques and approach can be supported in this way. In the longer term, the promotion and maintenance of such collaboration will enable us to advance the various research agenda. Exploring Geovisualization and the meeting and communication that formed the basis for this book are intended as key steps in this process as researchers with a variety of interests and a range of backgrounds aim to establish and document current research efforts and share knowledge about our practice, requirements and related fields of expertise.
1.5
Exploring Geovisualization - Approach
The concept of "radical collocation" is presented by Brodlie, this volume (Chapter 23). The term is used to describe a situation where the likely gains in productivity resulting from the ease of communication, coordination and organisation associated with actually being located in the same place results in teams of subject experts being "brought together into war rooms for an intensive piece of work". This is precisely what was suggested by the ICA Commission on Visualization and Virtual Environments to advance the research agenda: "workshops should be supported to bring individuals with varied disciplinary perspectives together to discuss research questions and approaches to addressing them in detail." (MacEachren and Kraak, 2001a) To achieve this aim, a cross-disciplinary workshop was organized in September 2002 at City University, London. The School of Informatics at City offers expertise in a number of related fields of study including GIScience, information science, Computer Science and HCI design. An open invitation was made to researchers in geovisualization and cognate disciplines to participate in the presentation and discussion of existing work in their fields, current trends, likely future developments and possibilities for the sharing of knowledge, techniques, practice and approach. The planned outcomes of the meeting included position papers representing the contributions of individuals and groups, discussion between researchers with common foci from different disciplines and this edited volume containing considered individual contributions and co-authored multi-disciplinary
10
J. Dykes, A.M. MacEachren & M.-J. Kraak
statements through which geovisualization and associated research efforts could be explored and presented to a wide audience. The contributors to the workshop fall into one of two categories: members of the ICA Commission on Visualization and Virtual Environments, a group with primary concerns relating to geographic information and Cartography, and "external experts" from cognate disciplines (primarily Computer and Information science). The former were asked to document their research to a wider community by identifying generic research objectives, a summary of the knowledge gained and some additional research questions that require cross-disciplinary expertise. Specific examples of research were requested of the ICA contributors with which to illustrate key geovisualization issues and identify current knowledge and practice. Contributions included various accounts of specific geovisualization methods (and their application), system descriptions, tests of geovisualization implementations and documented opportunities for research and collaboration. The external experts were asked to produce overviews of current themes in their particular field of expertise, to identify general areas where collaboration with the geovisualization community may be beneficial and to describe ways in which their discipline might gain from and/or contribute to advances in geovisualization, particularly regarding the specific geovisualization research challenges. To define the scope of the workshop and enable the organizers to identify topics upon which discussion could focus, participants were asked to specify their primary and secondary areas of expertise from a list of alternatives including Information Visualization, cognitive sciences, Computer Science, virtual environments, information science, HCI, education/pedagogy and data exploration/datamining. Drafts of individual contributions were also circulated prior to the workshop so that the organizers and participants were introduced to the work of all other contributors in advance of the meeting. The workshop itself took place between Wednesday 1 l th and Saturday 14th September 2002. Participants were arranged into groups by the organizers in advance of the meeting according to the self-selected areas of expertise, the nature of the papers submitted and through a process of discussion with those involved. The key objectives of the groups were to provide a mixture of backgrounds and areas of expertise but a common focus through which cross-disciplinary perspectives on particular pertinent topics could be addressed. At the workshop, the groups and their foci were discussed and consensus reached on four broad topics around which to structure the discussion through which geovisualization should be explored: 9 9 9 9
creating instruments for ideation; using 3D in visualization; connecting people data and resources; making useful and usable geovisualization.
These topics are intentionally overlapping due to the complexity of the issues being addressed and the objectives of the current exercise. Indeed many participants have expertise in more than one area. There is a loose correspondence between the focus topics and the cross-cutting themes identified in the research agenda report (MacEachren and
Exploring Geovisualization
11
Kraak, 2001; see w However, the goal was not to address these cross-cutting challenges in a comprehensive way - an objective that will require more than a short workshop. Instead, the groups and topics around which they were organized reflect the particular expertise of workshop participants as well as progress in some areas over the time since the 2001 report. During the workshop, plenary sessions at which each contributor made a brief presentation to the full body of participants allowed cross-fertilization of ideas. Parallel discussion sessions directed to the four identified topics supported focused, crossdisciplinary debate. The synergy that occurred as a consequence of this activity has resulted in these topics being used to structure this volume of contributions derived from the meeting (with one section for each topic). A primary charge to each of the groups was the development of a cross-disciplinary perspective that could be presented to the wider community as a context-providing introduction to the topic under discussion. Thus, each section in "Exploring Geovisualization" begins with a coauthored introductory chapter. Much of the workshop time was spent in discussion groups, developing the structure for these overview chapters, sketching out their contents and debating the issues that arose. These joint contributions are designed to enable us to record and comment upon aspects of our work that we can share and to identify ways in which we can work together for mutual benefit. They are designed to meet the key requirement of interdisciplinary collaboration by providing a shared perspective on the research topic, demonstrating some of the similarities and differences between the various disciplines represented and identifying potential for further collaboration. The draft chapters developed from the position papers and the group discussions were finalised shortly after the meeting following dialogue and feedback in a multi-disciplinary context in London. Group chapters were then further revised by a lead author through an iterative process of re-drafting. Both the group chapters and all individual chapters submitted for consideration in the volume underwent a two-tiered process of review. The editors provided detailed feedback to authors on initial drafts for chapters. Then, revised papers were subsequently reviewed formally by another of the editors and one anonymous external reviewer. Reviewers were informed of the objectives of Exploring Geovisualization and the fact that chapters were designed to be read by a relatively broad audience including graduate students and researchers in disciplines ranging from Cartography and other areas of GIScience, through Information Visualization and EDA in statistics, to Scientific Visualization and Computer Graphics. Contributors of accepted papers were asked to address the issues raised in the review process and document their responses. The result is the structured collection of 34 individual and joint contributions that enable us to explore the nature, scope and future of geovisualization from a number of perspectives.
1.6
Exploring Geovisualization - Structure
This book itself consists of an introductory section, followed by the sections relating to each of the four discussion topics and a conclusion. The links between geovisualization
12
J. Dykes, A.M. MacEachren & M.-J. Kraak
and Information Visualization dominate, which is unsurprising as the majority of contributors regarded "Information Visualization" as being a primary or secondary area of expertise. Three additional authors (not in attendance at the workshop) were invited to produce chapters for consideration in this book that discuss geovisualization at a general level from key perspectives, specifically those of GIScience, Information Visualization (InfoVis), and human computer interaction design (HCID). These scenesetting perspectives provide an introductory section, contextualizing the following sections that represent each of the workshop discussion topics.
1.6.1
Section A~Geovisualization in context
The chapters in Section A from the Computer Science Institute at the University of Konstanz document the current scope of Information Visualization, report upon techniques deemed relevant to geovisualization and identify areas of mutual opportunity. "Usability" emerges as a theme in a number of contributions in various sections and so Catherine Plaisant of the Human-Computer Interaction Laboratory at the University of Maryland builds upon this introduction to Information Visualization by identifying themes and challenges in usability. With this important contextual material on the nature of Information Visualization in place, the final chapter of our introductory section is a contribution by Mark Gahegan that grounds visualization in applications of GIScience. Gahegan relates opportunities for taking advantage of visualization methods and tools to the various forms of reasoning used throughout the geoscientific process.
1.6.2
Section B ~ C r e a t i n g instruments for ideation
Section B is the book's longest and focuses on software approaches to geovisualization and the development of instruments that support the EDA process specifically and ideation more generally. A number of the research challenges are relevant to this section in which experienced software authors and developers provide perspectives. In the coauthored introductory chapter, Gennady Andrienko and colleagues document a diverse range of software approaches to geovisualization and provide a structured explanation for the developments that are currently taking place. These include advances in technology, data availability, changing tasks, a variety of users, the use of expertise from associated disciplines and opportunities for interoperability. This co-authored perspective is followed by a chapter from Martin Theus, author of the Mondrian software, who identifies a number of links between statistical data exploration and geovisualization. Peter Rodgers then describes the potential and current use of graph drawing techniques from Information Visualization within geovisualization. Next, Jonathan Roberts reviews tools, methodologies and models for supporting multiple-linked views and suggests ways in which linked views may be coordinated and utilized in geovisualization instruments for exploratory work. This is followed by a contribution from David Mountain, who introduces approaches and software tools for exploring spatio-temporal behaviour with the objective of summarizing and explaining
Exploring Geovisualization
13
an individual's use of space. The knowledge gained can be a useful contributor to the provision of location dependent digital information. Natalia Andrienko and colleagues then draw upon task and data typologies when describing the way in which the characteristics of data and the nature of the task in hand drive their visualization tool design. This focus on tasks is complemented by attention to the user in a chapter by Monica Wachowicz and colleagues, who introduce the Land Use Change Explorer, a tool that exemplifies an approach to the process of geographic knowledge discovery by drawing upon autonomous agents to support decision-making in planning. In a chapter directed towards method rather than implemented tools, Penny Noy presents "signature exploration" - a means of aiding user comprehension when faced with complex and abstract graphics representing large structured data sets in the kinds of tools described in this section. Finally, Jason Dykes describes some of the approaches employed and software developed to support geovisualization and identifies a number of methods of achieving high levels of interaction with data to permit geovisualization through a variety of interfaces that minimize "visualization effort".
1.6.3
Section C---Using 3D in visualization
Our second topic relates to the use of"3D" in geovisualization and a range of experts offer perspectives on matters varying from theoretical issues to the development of rendering algorithms in section C. The research relates most strongly to geovisualization challenge 1 (see w1.3.1), but large data sets, collaborative work and usability issues are also addressed. By way of introduction, Jo Wood and colleagues describe the visualization pipeline and apply three-dimensionality to each of its five stages in exploring the various links between geovisualization, technology and cartographic theory. Three-dimensionality is considered in the stages of data management, data assembly, visual mapping, rendering and display. The artifacts produced and used at each stage are associated with various meanings of the term "3D" including the raw data, the assembled data, visual representations of the data, the image and the schemata used in interpretation. Jo Wood, then provides the initial individual chapter for the section in which he considers the influences of three components of scale on measurements made from surfaces. Rendering techniques are employed to represent these in a real-time dynamic 3D environment for geovisualization. Jiirgen DOllner then assesses the impact of realtime 3D computer graphics on geovisualization. Key techniques are identified that allow us to design and implement new geovisualization strategies, systems, and environments with improved visual expressiveness and interactivity. Next, Adriano Lopes and Ken Brodlie describe the evolution of contouring and isosurfacing techniques to account for the interactive requirements of geovisualization. Sabine Kirschenbauer follows this with discussion of an empirical study into the use of the Dresden 3D LC Display (D4D) - a flat autostereoscopic display for the visual presentation of geographic data in "true 3D". The results suggest that the visual capabilities of the user, their level of experience and the task in hand affect the success of such techniques. Lars Bodum then explores the scope of "virtual environments" by providing a typology that focuses on representational aspects involved in their
14
J. Dykes, A.M. MacEachren & M.-J. Kraak
construction. The level of abstraction and the temporal characteristic of the model are of particular concern here as the philosophical and technical issues associated with the design and use of virtual environments are explored. Finally, Lloyd Treinish offers a chapter solicited subsequent to the workshop to introduce and demonstrate the Webbased 3D geovisualization of complex spatio-temporal data in an operational environment. Techniques for the automated dissemination of animations of 3D weather models to a wide range of users are discussed and a number of approaches, products and implementations are presented.
1.6.4
Section D~Connecting people, data and resources
The third topic explored in this book is "distributed geovisualization", defined as geovisualization involving distributed data, resources, and people. By way of introduction to section D, Ken Brodlie and colleagues develop an example scenario to demonstrate the importance of connecting a range of people, data and resources to coordinate approaches and expertise in a geovisualization context. The scenario allows the group to demonstrate how a distributed approach to geovisualization can bring considerable benefits to science and society where there is a need to draw upon the combined force of data, resources and people from across the globe. Challenge 3 is addressed most directly (see w but each of the geovisualization challenges is considered under this topic. Alan MacEachren calls for multi-disciplinary collaboration when introducing a framework for geovisualization involving groupwork that draws upon research activity in the GeoVISTA Center at Penn State University. The framework discriminates between the use of visual representations in supporting groupwork as the object of collaboration, in providing support for dialogue and in supporting coordinated activity. In the next chapter, Ken Brodlie develops three system architecture models for Internet-based, realtime collaborative visualization. A number of tools for supporting real-time distributed work and experience of collaborative visualization are introduced with the inference that particular combinations of the approaches may be most appropriate. In the subsequent chapter, Michael Schroeder introduces enabling technologies for intelligent information integration. The relationships between geovisualization and developments in these areas, such as Grid computing, the Semantic Web and opportunities for visual datamining are discussed. In a complementary paper, Zarine Kemp focuses on the semantic requirements that enable distributed, disparate data resources to be shared by presenting a rationale for semantics to be integrated into interfaces for geovisualization. A prototype fisheries management system is introduced by way of demonstration. Taking a cartographic perspective on design of visualization to support everyday activity, David Fairbairn explores the relationships between geovisualization and distributed public transport information systems and relates general issues in geovisualization to this particular field with examples. Finally, in another chapter focused on distributed geovisualization relating to travel, Volker Coors and colleagues report the results of a pilot study designed to evaluate methods of assisting mobile users with route instructions that include text, sketches, spoken instructions and the use of 3D models. A series of technical issues are
Exploring Geovisualization
15
addressed and guidelines developed based upon the empirical results to determine the most suitable form of representation to use in a particular situation.
1.6.5
Section E~Making useful and useable geovisualization
The final discussion topic centers on issues of geovisualization design and evaluation, focusing most strongly on challenges associated with the development of theory and practice to support universal access and usability. In their introduction to section E, Sven Fuhrmann and colleagues with backgrounds in Computer Science, Information Visualization, GIScience, Geography and Cartography emphasize that geovisualization design is not just about technical issues. They explore various means of making geovisualization tools and techniques useful and usable from a user' s perspective and aim to bridge the gap between developers and users by introducing methods and discussing research questions in user-centered geovisualization tool design. In the first contribution, Colin Ware and Matthew Plumlee characterize the structure of visual space in three ways. They demonstrate how a consideration of the perceptual structure of space, the costs associated with gaining extra information by navigation and the cognitive mechanism used to visually interrogate geo-spatial representations can enable us to identify forms of navigation interface that will be most suitable for particular tasks. Then, Robert Edsall and Laura Sidney describe approaches for representing interactions with time in tools for geovisualization. Cognitive science and usability engineering are employed to inform the development of a framework that helps cartographers design appropriate geovisualization interfaces and environments to support insight. Next, Sven Fuhrmann and William Pike aim to engage users in geovisualization tool design and evaluation when considering the user-centered design process for collaborative tools that support interaction. A case study demonstrates how three approaches to supporting user-centered design between distributed users and tool developers have been employed to enhance remote collaboration in the environmental sciences. In the subsequent chapter, Paula Ahonen-Rainio and Menno-Jan Kraak make use of multi-variate visualization techniques in proposing an environment for the exploration of geographic metadata that is designed to support users in determining how well available datasets meet their needs. In a chapter focusing on integration of visualization with other analytical methods, Etien Koua and Menno-Jan Kraak present a prototype exploratory geovisualization environment that combines visual and computational analysis. The tool draws upon Information Visualization techniques and is based upon a usability framework developed to analyze the ways in which various abstract representations are used and understood in relation to more traditional maps. Carolina Tob6n then provides a complementary outline of the contributions that experimental design and HCI may make in producing geovisualization tools that are usable, useful and fit for purpose and develops an approach to tool design that is based upon user tasks. An experiment is presented that shows how multiple techniques can be combined to evaluate the effectiveness of a system and to address the complex issue of task definition in geovisualization. The results suggest that the approach can refine existing task characterizations to reflect the cognitive visual operations supported by geovisualization
16
J. Dykes, A.M. MacEachren & M.-J. Kraak
environments. Finally, Sara Fabrikant and Andrd Skupin consider information spaces based upon spatial metaphors and use geographic information theory and principles of ontological modeling to develop a framework for the construction of cognitively plausible semantic information spaces. Examples of the application of the framework to the design of cognitively adequate information spaces are provided with the aim of supporting and augmenting the internal visualization capabilities of those who use them. 1.7
Exploring Geovisualization--Visualization
The structure presented here and described in w1.6 is somewhat linear, due to the nature of the printed medium that we are using and the organisation of the discussion groups. Yet the inter-related nature of the topics under discussion here means that some chapters could logically be grouped in more than one section. Similarly, many workshop participants were keen to comment upon the activities of groups other than their own and plenty of cross-fertilization between groups occurred at the London meeting. Citations are used throughout the book to relationships between the contributions in their own use of the book. We also provide a number of "maps" of the contents of the book to draw attention to relationships between the chapters and to guide the reader through the interrelated concepts. These are spatializations of the semantic relationships between the various chapters. The cover of the book shows a topical density surface using principal coordinate ordination (see Preface). Semantic links between chapters in the book are shown in Figure 1.1. PathFinder Network Scaling (PFNet) solutions (Schvaneveldt, 1990) are used here to spatialize such semantic relationships between documents as detailed by Skupin and Fabrikant (2003) and discussed further by Fabrikant and Skupin, this volume (chapter 35). In this case, estimates of the similarities between the contents of each of the chapters in Exploring Geovisualization are used to establish the most notable links. These similarity estimates are derived by considering the textual content of the chapter titles and keywords using Latent semantic Indexing (LSI) (Deerwester et al., 1990). 1 The PFNet algorithm then generates a topological network that preserves these semantic similarity relationships identified by LSI. The semantic network can be subsequently transformed and reproduced graphically using appropriate layout techniques (see Rodgers, this volume (Chapter 7)) as shown in Figure 1.1. Two parameters are used to generate a PFNet: the q-parameter, which constrains the maximal path length (number of links between points) adhering to the triangle inequality criterion (and is thus an integer between 2 and n - 1); the r-parameter, a value between 2 and infinity, which defines the metric used for computing the distance paths and is inversely proportional to the number of links in the network generated. Within certain constraints, q and r can be experimented with to 1 A series of network were generated using the full abstracts, but the relationships depicted were judged to be less meaningful than those presented here. Possible explanatory factors that may have resulted in relationships that did not relate whollyto the chapterthemesinclude the length of abstract, the style of the abstract and the first language of the author. On reflection the use of a closed list in generating chapter keywords may well have improved the PFNets.
I
r Figure 1.l. Exploring Geovisualization-PFNet solutions showing the relationships between chapters in this book according to titles and keywords. (a) PFNet (infinity,35)-in essence a minimum spanning tree showing only the most salient connections. (b) PFNet (infinity,2)-a highly linked network showing some of the more subtle relationships between chapters. The digital appendices include a number of PFNet solutions that readers can use to navigate between related chapters.
18
J. Dykes, A.M. MacEachren & M.-J. Kraak
produce suitable networks and any solution that uses a particular combination of q and r is referred to as PFN (r,q). The minimum-spanning tree, an undirected graph of minimal length that spans all the nodes of the network, is generated when q = n - 1. This is shown in Figure 1.1a, where 35 links are depicted connecting all 36 nodes. An alternative network with more linkages is shown in Figure 1.lb. Weaker links are included in the PFNet solution in this case. Fabrikant (2001) describes better connected documents within spatializations such as those shown in Figure 1.1 as "semantic anchor points for information exploration". We hope that the authors and readers of Exploring Geovisualization will find these static graphics useful in mapping out some of the semantic relationships between the chapters and the work that they represent. The digital supplement to the book contains a number of PFNet solutions. These maps take advantage of the digital medium to provide interactive interfaces to the digital appendices that will help readers relate chapters and navigate through the information presented in an exploratory manner.
1.8
Exploring Geovisualization - Conclusion
The result of the exercise reported here is a broad and considered volume of work with opinions and influences from a range of disciplines. We do not argue that this body of material is a comprehensive statement on the status of geovisualization and related fields. But what we have cooperatively developed is a wide-ranging collection of contributions that are clearly informed by existing descriptions of research requirements (MacEachren and Kraak, 2001). These contributions have been produced by a group of authors from diverse disciplines with a variety of perspectives and have evolved following discussion amongst colleagues from a number of fields. As a result, this volume provides a platform for exploring the nature of geovisualization, its interdependencies with other academic fields of study and viceversa. This is important as we advance the evolving field of geovisualization in terms of our collective knowledge, the techniques that we use, the tasks we address and the ways in which we address them. It is also important that knowledge is shared and collaborative work is planned, completed and reported as relationships between practitioners in increasingly related disciplines develop, enabling us to make progress with the various research challenges. Our collective perspectives have expanded considerably through this examination of geovisualization and in a concluding chapter we reflect on the contributions presented and on ways that we might continue advancing geovisualization. We hope and anticipate that the reader will have an equally enlightening experience as they use the chapters that follow to explore geovisualization.
Acknowledgements The contributions made by Andr6 Skupin and in particular Sara Fabrikant in developing, generating and advising upon the pathfinder network scaling solutions are greatly appreciated and acknowledged with thanks.
Exploring Geovisualization
19
References Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T. K., and Harschman, R., (1990) "Indexing by latent semantic analysis", Journal of the American Society of Information Science, 41, 391-407. Fabrikant, S. I. (2001) Visualizing region and scale in semantic spaces. Proceedings of the 20th International Cartographic Conference, ICC 2001, Beijing, China, pp. 2522-2529. MacEachren, A. M., and Kraak, M. J., (200 l a) "Research challenges in geovisualization, Cartography and Geographic Information Science", Special Issue on Geovisualization, 28(1), 3-12. MacEachren, A. M. and Kraak, M. -J. (eds.) (2001b) "Research challenges in geovisualization, Cartography and Geographic Information Science", Special Issue on Geovisualization, 28(1), American Congress on Mapping and Surveying, 80 pp. Schvaneveldt, R. W., (ed.), (1990) Pathfinder Associative Networks: Studies in Knowledge Organization. Norwood, NJ: Ablex. Skupin, A., and Fabrikant, S. I., (2003) "Spatialization methods: a cartographic research agenda for non-geographic information visualization", Cartography and Geographic Information Science, 30(2), 95-119.
This Page Intentionally Left Blank
Section A Geovisualization in Context Perspectives from Related Disciplines
2. Information Visualization: Scope, Techniques and Opportunities for Geovisualization Daniel A. Keim, Christian Panse & Mike Sips ............................................................................................. 23 3. Information Visualization and the Challenge of Universal Usability Catherine Plaisant ........................................................................................................................................... 53 4. Beyond Tools: Visual Support for the Entire Process of GIScience Mark Gahegan ................................................................................................................................................ 83
This Page Intentionally Left Blank
Exploring Geovisualization J. Dykes, A.M. MacEachren, M.-J. Kraak (Editors) 9 2005 Elsevier Ltd. All rights reserved.
Chapter 2
Information Visualization: Scope, Techniques and Opportunities for Geovisualization Daniel A. Keim, Christian Panse, Mike Sips, Computer Science Institute, University of Konstanz, Konstanz, Germany
Keywords: Information Visualization, visual datamining, visual data exploration, geovisualization
Abstract Never before in history has data been generated at such high volumes as it is today. Exploring and analyzing the vast volumes of data has become increasingly difficult. Information visualization and visual datamining can help to deal with the flood of information. The advantage of visual data exploration is that the user is directly involved in the datamining process. There are a large number of Information Visualization techniques that have been developed over the last two decades to support the exploration of large data sets. In this chapter, we provide an overview of Information Visualization and visual datamining techniques, and illustrate them using a few examples. We demonstrate that the application of Information Visualization methods provides new ways of analyzing geospatial data.
2.1
Introduction
The progress made in hardware technology allows today's computer systems to store very large amounts of data. Researchers from the University of Berkeley estimate that every year about 2 exabyte ( = 2 million terabytes) of data are generated, of which a large portion is available in digital form (growth rate is about 50%). This means that in the next 3 years, more data will be generated than in all of human history to date. The data are often automatically recorded via sensors and monitoring systems. Almost all transactions of every day life, such as purchases made with credit card, Web pages visited or telephone calls are recorded by computers. In many application domains, it might also be useful that much of the data include geospatial referencing. For example, credit card purchase transactions include both the address of the place of purchase and of the purchaser, telephone records include addresses and sometimes coordinates or at least cell phone zones, data from satellite remote sensed data contain coordinates or other 23
24
D.A. Keim, C. Panse & M. Sips
geographic indexing, census data and other government statistics contain addresses and/or indexes for places, and information about property ownership contains addresses, relative location info, and sometimes coordinates. These data are collected because people believe that they are a potential source of valuable information, providing a competitive advantage (at some point) to their holders. Usually many parameters are recorded, resulting in data with a high dimensionality. With today's data management systems, it is only possible to view quite small portions of the data. If the data are presented textually, the amount of data that can be displayed is in the range of some one hundred data items, but this is like a drop in the ocean when dealing with data sets containing millions of data items. Having no possibility to adequately explore the large amounts of data that have been collected because of their potential usefulness, the data become useless and the databases become data "dumps".
2.1.1
Benefits of visual data exploration
For datamining to be effective, it is important to include the human in the data exploration process and combine the flexibility, creativity, and general knowledge of the human with the enormous storage capacity and the computational power of today's computers Visual data exploration aims at integrating the human into the data exploration process, applying human perceptual abilities to the analysis of large data sets available in today' s computer systems. The basic idea of visual data exploration is to present the data in some visual form, allowing the user to gain insight into the data, draw conclusions, and directly interact with the data. Visual datamining techniques have proven to be of high value in exploratory data analysis, and have a high potential for exploring large databases. Visual data exploration is especially useful when little is known about the data and the exploration goals are vague. Since the user is directly involved in the exploration process, shifting and adjusting the exploration goals is automatically done if necessary. Visual data exploration can be seen as a hypothesis generation process, for example, (see Gahegan, this volume (Chapter 4)); the visual representations of the data allow the user to gain insight into the data and come up with new hypotheses. The verification of the hypotheses can also be achieved through data visualization, but may also be accomplished using automatic techniques from statistics, pattern recognition, or machine learning. In addition to the direct involvement of the user, the main advantages of visual data exploration over automatic datamining techniques are that: 9 9
9
visual data exploration can easily deal with highly non-homogeneous and noisy data; visual data exploration is intuitive and requires much less understanding of complex mathematical or statistical algorithms or parameters than other methods; visualization can provide a qualitative overview of the data, allowing data phenomena to be isolated for further quantitative analysis.
Scope, Techniques and Opportunities for Geovisualization
25
Visual data exploration does, however, include some underlying data processing, dimension reduction, re-mapping from one space to another, etc., which typically does require some basic understanding of the underlying algorithm to understand it properly. As a result, visual data exploration can lead to quicker and often superior results, especially in cases where automatic algorithms fail. In addition, visual data exploration techniques provide a much higher degree of confidence in the findings of the exploration. This fact leads to a high demand for visual exploration techniques and makes them indispensable in conjunction with automatic exploration techniques.
2.1.2
Visual exploration paradigm
Visual data exploration usually follows a three-step process: overview first, zoom and filter, and then details-on-demand. This has been termed the "information seeking mantra" (Shneiderman, 1996). First, the user needs to get an overview of the data. In the overview, the user identifies interesting patterns or groups in the data and focuses on one or more of them. For analyzing the patterns, the user needs to drill-down and access details of the data. Visualization technology may be used for all three steps of the data exploration process. Visualization techniques are useful for showing an overview and allowing the user to identify interesting subsets. In this step, it is important to keep the overview visualization while focusing on the subset using another visualization technique (for discussion of the perceptual factors in designing such multi-scale displays, for example, (see Ware and Plumlee, this volume (Chapter 29)). An alternative is to distort the overview visualization in order to focus on the interesting subsets. This can be performed by dedicating a larger percentage of the display to the interesting subsets while decreasing screen utilization for uninteresting data. This idea is also discussed by Plaisant (this volume, Chapter 3) and illustrated by D611ner (this volume, Chapter 16). To further explore the interesting subsets, the user needs a drill-down capability in order to observe the details about the data. Note that visualization technology does not only provide the base visualization techniques for all three steps but also bridges the gaps between the steps. The design and implementation of instruments created for supporting this kind of activity are addressed in section B of this book.
2.2
Classification of Visual Datamining Techniques
Information visualization focuses on data sets lacking inherent 2D or 3D semantics and therefore also lacking a standard mapping of the abstract data onto the physical screen space. There are a number of well known techniques for visualizing such data sets, such as X - Y plots, line plots, and histograms. These techniques are useful for data exploration but are limited to relatively small and low-dimensional data sets. In the last decade, a large number of novel Information Visualization techniques have been developed, allowing visualizations of multi-dimensional data sets without inherent two- or 3D semantics. Good overviews of the approaches can be found in a number of recent books (e.g., Card et al., 1999; Ware, 2000; Spence, 2001; Schumann and Mtiller, 2000). The techniques can be classified based on three criteria (Figure 2.1): the data to be visualized,
D.A. Keim, C. Panse & M. Sips
26
Data to be Visualized 1. one-dimensional 2. two-dimensional
|
~
VisualizatioTechni n que
3 multi-dimensional
4. text/web
ked Display
~_
5 hierarchies/graphs [
/'~ / "
6 algorithm/software I / "
Dense Pixel Display
Geometrically-transformed Display
Standard 2D/3D Display
I/ /~" /
I Standard
I
I
I
',
I
Projection Filtering Zoom Distortion Link&Brush Interaction Technique
Figure 2.1. Classification of information visualization techniques. the visualization technique, and the interaction technique used. The data type to be visualized (Shneiderman, 1996) may be: 9 9 9 9 9 9
1D data, such as temporal (time-series) data. 2D data, such as geographical maps. Multi-dimensional data, such as relational tables. Text and hypertext, such as news articles and web documents. Hierarchies and graphs, such as telephone calls and web documents. Algorithms and software, such as debugging operations.
The visualization technique used may be classified as: 9 9 9 9 9
Standard 2D/3D displays, such as bar charts and X - Y plots. G e o m e t r i c a l l y transformed displays, such as landscapes and parallel coordinates. Icon-based displays, such as needle icons and star icons. Dense pixel displays, such as the recursive pattern and circle segments. Stacked displays, such as treemaps and dimensional stacking.
The third element of the classification is the interaction technique used. Interaction techniques allow users to directly navigate and modify the visualizations, as well as select subsets of the data for further operations. Examples include: 9 9 9 9
Dynamic projection Interactive filtering Interactive zooming Interactive distortion
Scope, Techniques and Opportunities for Geovisualization
9 9
27
Interactive linking Brushing
Note that the three criteria upon which we base our classification - data type to be visualized, visualization technique, and interaction technique - can be assumed to be orthogonal. This means that any of the visualization techniques may be used in conjunction with any of the interaction techniques for any data type. Note also that a specific system may be designed to support different data types and that it may use a combination of visualization and interaction techniques.
2.3
Data Type To Be Visualized
In Information Visualization, the data usually comprise a large number of records, each consisting of a number of variables or dimensions. Each record corresponds to an observation, measurement, or transaction. Examples are customer properties, e-commerce transactions, and sensor output from physical experiments. The number of attributes can differ from data set to data set; one particular physical experiment, for example, can be described by five variables, while another may need hundreds of variables. We call the number of variables the dimensionality of the data set. Data sets may be 1D, 2D, multi-dimensional or may have more complex data types such as text/hypertext or hierarchies/graphs. Sometimes, a distinction is made between grid dimensions and the dimensions that may have arbitrary values.
2.3.1
1D data
1D data usually have one dense dimension. A typical example of 1D data is temporal data. Note that with each point of time, one or multiple data values may be associated. An example is a time series of stock prices (Figure 2.4) or the time series of news data used in the ThemeRiver (Havre et al., 2000).
2.3.2
2D data
2D data usually have two dense dimensions. A typical example is geometry-related planar data in the Euclidian plane. In general, planar data define quantities of distances, or distances and angles, which determine the position of a point on a reference plane to which the surface of a 3D object has been projected. A typical example is geographical data, where the two distinct dimensions are longitude and latitude. Longitude and Latitude describe locations on a 3D surface and some transformation is required to project the relationships between the locations specified in this way on a plane. Besides, depending upon the Cartography used, various characteristics of the relationships between locations are either preserved or lost. After the projection, the geographical data can be stored as 2D data with x/y-dimensions. X - Y plots are a typical method for showing 2D data and maps are a special type of X - Y plot for showing geographical data. Although it seems easy to deal with temporal or geographic data on 2D devices, caution is advised. If the number of records to be visualized is large, temporal axes and maps get quickly cluttered - and may not help to understand the data. There are several approaches to draw
28
D.A. Keim, C. Panse & M. Sips
upon with dense geographic data already in common use, such as Gridfit (Keim and Herrmann, 1998; see Figure 2.6 in w and PixelMap (Keim et al., 2003c; see Figure 2.7 in w
2.3.3
Multi-dimensional data
Many data sets consist of more than three attributes and therefore do not allow a simple visualization as 2D or 3D plots. Examples of multi-dimensional (or multi-variate) data are tables from relational databases, which often have from tens to hundreds of columns (or attributes). Since there is no simple mapping of the attributes to the two dimensions of the screen, more sophisticated visualization techniques are needed, such as parallel coordinates plots (Inselberg and Dimsdale, 1990; Figure 2.12a). A very different method for data with geospatial attributes is to generate multi-variate glyphs anchored on a 2.5D surface representation (Gahegan, 1998).
2.3.4
Text and hypertext
Not all data types can be described in terms of dimensionality. In the age of the World Wide Web, one important data type is text and hypertext, as well as multi-media Web page contents. These data types differ in that they cannot be easily described by numbers, and therefore most of the standard visualization techniques cannot be applied. In most cases, a transformation of the data into description vectors is necessary before visualization techniques can be used. An example for a simple transformation is word counting, which is often combined with a principal component analysis (PCA) or multidimensional scaling to reduce the dimensionality to two or three, for example, (see Fabrikant and Skupin, this volume (Chapter 35).
2.3.5
Hierarchies and graphs
Data records often have some relationship to other pieces of information. These relationships may be ordered, hierarchical, or arbitrary networks of relations. Graphs are widely used to represent such interdependencies. A graph consists of a set of objects, called nodes, and connections between these objects, called edges or links. Examples are the e-mail inter-relationships among people, their shopping behavior, the file structure of the hard disk or the hyperlinks in the World Wide Web. There are a number of specific visualization techniques that deal with hierarchical and graphical data. An example is given in Figure 2.2 that shows a snapshot of the Internet core (see also Cooperative Association for Internet Data Analysis, 2003). A fine overview of hierarchical Information Visualization techniques can be found in Chen (1999), an overview of Web visualization techniques is presented in Dodge (2001) and an overview book on all aspects related to graph drawing is by Battista et al. (1999).
2.3.6
Algorithms and software
Algorithms and software constitute another class of data. Coping with large software projects is a challenge. The goal of software visualization is to support software
Scope, Techniques and Opportunities for Geovisualization
29
Figure 2.2. Cooperative Association for Internet Data Analysis (CAIDA), k claffy "Skitter Graph" Internet Map, 2000.
92000 Regents of the University of California. Courtesy University of California.
Figure 2.4. Dense pixel displays: recursive pattern technique showing 50 stocks in the Frankfurt AIIgemeine Zeitung (Frankfurt Stock Index Jan 1975-April 1995). The technique maps each stock value to a colored pixel; high values correspond to bright colors. 92004 IEEE.
D.A. Keim, C. Panse & M. Sips
30
development by helping to understand algorithms (e.g., by showing the flow of information in a program), to enhance the understanding of written code (e.g., by representing the structure of thousands of source code lines as graphs), and to support the programmer in debugging the code (e.g., by visualizing errors). There are a large number of tools and systems that support these tasks. Comprehensive overviews of software visualization can be found in Trilk (2001) and Stasko et al. (1998). Examples of visualization, and visually enabled steering, of process models that depict geographic processes include the AGP-System for ocean flow model visualization (Johannsen and Moorhead, 1995), and visualization methods/simulation steering for the 3D turbulence model of Lake Erie (Marshall et al., 1987).
2.4
Visualization Techniques
There are a large number of visualization techniques that can be used for visualizing data. In addition to standard 2D/3D-techniques such as X - Y (X-Y-Z) plots, bar charts, line graphs, and simple maps, there are a number of more sophisticated classes of visualization techniques. The classes correspond to basic visualization principles that may be combined in order to implement a specific visualization system.
2.4.1
Geometrically transformed displays
Geometrically transformed display techniques aim at finding "interesting" transformations of multi-dimensional data sets. This class of geometric display methods includes techniques from exploratory statistics (for example, (see Theus, this volume (Chapter 6))) such as scatter plot matrices (Andrews, 1972; Cleveland, 1993) and techniques that can be subsumed under the term "projection pursuit" (Huber, 1985). Other geometric projection techniques include prosection views (Furnas and Buja, 1994; Spence et al., 1995), hyperslice (van Wijk and van Liere, 1993) and the parallel coordinates technique (Inselberg and Dimsdale, 1990). Parallel coordinates plots map the k-dimensional space onto the two display dimensions by using k axes that are parallel to each other (either horizontally or vertically oriented), evenly spaced across the display. The axes correspond to the dimensions and are usually linearly scaled from the minimum to the maximum value of the corresponding dimension. Each data item is presented as a chain of connected line segments, intersecting each of the axes at the location corresponding to the value of the considered dimensions (Figure 2.12a). A geographic extension of the parallel coordinates technique is to build them in 3D, with maps as orthogonal planes to the otherwise flat 2D parallel coordinates (Edsall, 1999).
2.4.2
Iconic displays
Another class of visual data exploration techniques includes iconic display methods. The idea here is to map the attribute values of a multi-dimensional data item to the features of an icon. Icons can be arbitrarily defined. They may for example comprise: simple faces (Chernoff, 1973); needle icons (Abello and Korn, 2001; Keim, 2000); star icons (Ward, 1994); stick figure icons (Pickett and Grinstein, 1988); color icons (Levkowitz, 1991; Keim and Kriegel, 1994); TileBars (Hearst, 1995). The visualization is generated by
Scope, Techniques and Opportunities for Geovisualization
31
mapping the attribute values of each data record to the features of the icons. In case of the stick figure technique, for example, two dimensions are mapped to the display dimensions and the remaining dimensions are mapped to the angles and/or limb length of the stick figure icon. If the data items are relatively dense with respect to the two display dimensions, the resulting visualization presents texture patterns that vary according to the characteristics of the data and are therefore detectable by pre-attentive perception. Figure 2.3 shows an example of this class of techniques. Each data point is represented by a star icon/glyph, where each data dimension controls the length of a ray emanating from the center of the icon. In this example, the positions of the icons are determined using PCA to convey more information about data relations. Other data attributes could also be mapped to icon position.
2.4.3
Dense pixel displays
The rationale behind the development of dense pixel techniques is to map each dimension value to a colored pixel and group the pixels belonging to each dimension into adjacent areas. More precisely, dense pixel displays divide the screen into multiple subwindows. For data sets with m dimensions (attributes), the screen is partitioned into m subwindows, one for each of the dimensions. Since in general dense pixel displays use one pixel per
$
@
Figure 2.3. The iris data set, displayed using star glyphs positioned based on the first two principal components (from XmdvTool; Ward, 1994). Reproduced with permission of M. Ward, Worcester Polytechnic Institute 92004 IEEE.
32
D.A. Keim, C. Panse & M. Sips
data value, the techniques allow the visualization of the largest amount of data possible on current displays (up to 1,000,000 data values on a 1,000,000 pixel screen). Although, it seems relatively straightforward to create dense pixel displays, there are some important questions to be taken into account.
Color mapping Firstly, finding a path through a color space that maximizes the numbers of just noticeable differences (JNDs), but at the same time, is intuitive for the application domain is a difficult task. The advantage of color over grey scales is that the number of JNDs is much higher.
Pixel arrangement If each data value is represented by one pixel, the main question is how to arrange the pixels on the screen within the subwindows. Note, that only a good arrangement due to the density of the pixel display will allow a discovery of clusters, local correlations, dependencies, other interesting relationships among the dimensions, and hot spots. For the arrangement of pixels, we have to distinguish between data sets that have a natural ordering of the data objects, such as time series, and data sets without inherent ordering, such as is the case when visualizing query result sets. Even if the data has a natural ordering to one attribute, there are many possible arrangements. One straightforward possibility is to arrange the data items from left to right in a line-by-line fashion. Another possibility is to arrange the data items top-down in a column-by-column fashion. If these arrangements are done pixel wise, in general, the resulting visualizations do not provide useful results. More useful are techniques that provide a better clustering of closely related data items and allow the user to influence the arrangement of the data. Techniques that support the clustering properties are screenfilling curves. Another technique that supports clustering is the recursive pattern technique (Keim et al., 1995a,b). This technique is based upon a generic recursive back-and-forth arrangement of the pixels and is particularly aimed at representing datasets with a natural order according to one attribute (e.g., time-series data). The user may specify parameters for each recursion level, and thereby control the arrangement of the pixels to form semantically meaningful substructures. The base element on each recursion level is a pattern of height hi and width wi as specified by the user. First, the elements correspond to single pixels that are arranged within a rectangle of height h l and width Wl from left to right, then below backwards from right to left, then again forward from left to right, and so on. The same basic arrangement is done on all recursion levels with the only difference being that the basic elements that are arranged on level i are the patterns resulting from the level i - 1 arrangements. In Figure 2.4, an example of a recursive pattern visualization is shown. The visualization shows 20 years of financial data (January 1974-April 1995) with the daily prices of the 50 stocks contained in the Frankfurt Stock Index (FAZ).
Shape of subwindows The next important question is whether there exists an alternative to the regular partition of the screen into rectangular subwindows. The rectangular shape of the subwindows
Scope, Techniques and Opportunities for Geovisualization
33
supports screen usage effectively, but on the other hand, the rectangular shape leads to a dispersal of the pixels belonging to one data object over the whole screen. The subwindows of each dimension can be relatively distant, especially for data sets with many dimensions. This can make it particularly difficult to detect clusters, correlations, and interesting patterns. An alternative shape of the subwindows is the circle segments technique (Ankerst et al., 1996) in which the data dimensions are displayed as segments of a circle.
Ordering of dimensions Finally, the last question to consider in dense pixel displays is the ordering of the dimensions. This is actually a case of a more general issue that arises for a number of other visualization techniques, such as the parallel coordinate plots. The basic problem is that the data dimensions have to be arranged in some 1D or 2D ordering on the screen. The ordering of dimensions, however, has a major impact on the expressiveness of the visualization. If a different ordering of the dimensions is chosen, the resulting visualization may change completely and lead to diverse interpretations. More details about designing pixel-oriented visualization techniques can be found in Keim (2000) and Keim and Kriegel (1995) and all techniques have been implemented in the VisDBSystem (Keim and Kriegel, 1994).
2.4.4
Stacked displays
Stacked display techniques are tailored to present data partitioned in an hierarchical fashion. In the case of multi-dimensional data, the data dimensions to be used for partitioning the data and building the hierarchy have to be appropriately selected. An example of a stacked display technique is dimensional stacking (LeBlanc et al., 1990). The notion is to embed one coordinate system inside another coordinate system, i.e., two attributes form the outer coordinate system, two other attributes are embedded into the outer coordinate system, and so on. The display is generated by dividing the outermost level coordinate system into rectangular cells and within the cells the next two attributes are used to span the second level coordinate system. This process may be repeated multiple times. The usefulness of the resulting visualization largely depends on the data distribution of the outer coordinates and therefore the dimensions that are used for defining the outer coordinate system have to be carefully selected. A rule of thumb is to choose the most important dimensions first. A dimensional stacking visualization of mining data with longitude and latitude mapped to the outer x and y axes, as well as ore grade and depth mapped to the inner x and y axes is shown in Figure 2.5. Other examples of stacked display techniques include Worlds-within-Worlds (Feiner and Beshers, 1990a,b), Treemap (Johnson and Shneiderman, 1991; Shneiderman, 1992), and Cone Trees (Robertson et al., 1991).
2.5
Visual Datamining on Geospatial Data
Geospatial data are relevant to a large number of applications. Examples include weather measurements such as temperature, rainfall, wind-speed, etc., measured at a large number
34
D.A. Keim, C. Panse & M. Sips
.:.!. i ~ ~.
~.i..i ~ 5.L&.oi s
!iiiilii i ?i:i.i:i!~:iiii~ iii i:
i i !,!iii
:~
~:~' '"~ '~'~
,i + ~,..~.j.',F[:~Li..
...........
~............... ~ ~
ii ii!i iiii~i iiii:i:ii~:
iiii/ii~iiii:iiii~i~i~ii~)i~it ,i::~:;~;,:~:,:~i i~:iiii:il ~ir::i:i ~ i~i:i~:i::i ii:il;iiiii~iiii:iiii; i~ ii i i ilia: iiii]iii ::i~ili:~ii:: :ii'::::i ::::::::::::::::::::::::: ~+~"i!:!i~i~~~+ :i~:i~li~:i:!:~ii :::::::::::::::::::::::::::::: ~!~-!!i ii!fi~[~.~,i+~i.~**~
::::::::::::::::::::::::::::::::::::::: ::::::::::::::::::::::::::::::::::
Figure 2.5. Dimensional stacking visualization of drill hole mining data with longitude and latitude mapped to the outer x-, y-axes and one grade and depth mapped to the inner x-, y-axes. Reproduced with permission of M. Ward, Worcester Polytechnic Institute 92004 IEEE.
of locations, use of connecting nodes in telephone business, load of a large number of Internet nodes at different locations, air pollution in cities, etc. Nowadays, there exist a large number of applications, in which it is important to analyze relationships that involve geographic location. Examples include global climate modeling (measurements such as temperature, rainfall, and wind-speed), environmental records, customer analysis, telephone calls, credit card payments, and crime data. Spatial datamining is the branch of datamining that deals with spatial (location) data. However, to analyze the huge amounts of geospatial data obtained from large databases such as credit card payments, telephone calls, environmental records (that often amount to terabytes of data), it is almost impossible for users to examine the spatial data sets in detail and extract interesting knowledge or general characteristics. Automated datamining algorithms are indispensable for analyzing large geospatial data sets, but often fall short of providing completely satisfactory results. Interactive datamining based on a synthesis of automatic and visual datamining techniques usually does not only yields better results, but also results in a higher degree of user satisfaction and confidence in the findings (Han and Kamber, 1986). Although automatic approaches have been developed for mining geospatial data (Han and Kamber, 1986), they are often no better than simple visualizations of the geospatial data on a map.
2.5.1
Visualization strategy
The visualization strategy for geospatial data can be straightforward. The geospatial data points described by longitude and latitude are displayed on the 2D Euclidian plain using a 2D projection. The two Euclidian plain dimensions x and y are directly mapped to the two physical screen dimensions. The resulting visualization depends on the spatial dimension or extent of the described phenomena and objects. A fine overview can be found in Keim et al. (2003d). Since the geospatial locations of the data are not uniformly distributed on a plane, however, the display will usually be sparsely populated in some regions while in other regions of the display a high degree
Scope, Techniques and Opportunities for Geovisualization
35
of overplotting occurs. There are several approaches to cope with dense geospatial data (Geisler, 2003). One widely used method is 2.5D visualization showing data points aggregated up to map regions. This technique is commercially available in systems such as VisualInsight's In3D (Advizor Solutions Inc, 2003) and ESRI's ArcView (Environmental Systems Research Institute, 2003). An alternative that shows more detail is a visualization of individual data points as bars on a map. This technique is embodied in systems such as SGI's MineSet (Silicon Graphics Inc, 2002) and AT&T's Swift 3D (Keim et al., 1999). A problem here is that a large number of data points are plotted at the same position, and therefore only a small portion of the data is actually displayed. Moreover, due to occlusion in 3D, a significant fraction of the data may not be visible unless the viewpoint is changed.
2.5.2
The VisualPoints-System
The VisualPoints-System solves the problem of over-plotting pixels using the Gridfit algorithm (Keim and Herrmann, 1998). An example is shown in Figure 2.6. The Gridfit algorithm is designed to hierarchically partition the data space. In each step, the data set is partitioned into four subsets containing the data points that belong to the four equally sized subregions. Since the data points may not fit into the four equally sized subregions, we have to determine a new extent of the four subregions (without changing the four subsets of data points) such that the data points of each subset can be visualized in the corresponding subregion. For an efficient implementation of the algorithm, a quadtreelike data structure is used to manage the required information and to support the recursive partitioning process. The partitioning process works as follows: starting with the root of the quadtree, in each step the data space is partitioned into four subregions. The goal of the partitioning is that the area occupied by each of the subregions (in pixels) is larger than the number of pixels to be placed within these subregions. A problem of VisualPoints is that in areas with high overlap, the repositioning depends on the ordering of the points in the database. That is, the first data item found in the database is placed at its correct position, and subsequent overlapping data points are moved to nearby free positions, and so locally appear quasi-random in their placement.
2.5.3
Fast-PixelMap-Technique
The PixelMap-Technique solves the problem of displaying dense point sets on maps, by combining clustering and visualization techniques (Keim et al., 2003c). First, the FastPixelMap algorithm approximates a 2D kernel-density-estimation in the two geographical dimensions performing a recursive partitioning of the dataset and the 2D screen space by using split operations according to the geographical parameters of the data points and the extensions of the 2D screen space. The goal is to: (i) find areas with density in the two geographical dimensions and to (ii) allocate enough pixels on the screen to place all data points, especially of dense regions, at unique positions that are close to each other. The top-down partitioning of the dataset and 2D screen space results in distortion of certain map regions. That means, however, virtually empty areas
36
D.A. Keim, C. Panse & M. Sips
will be shrinking and dense areas will be expanding to achieve pixel coherence. For an efficient partitioning of the dataset and the 2D screen space and an efficient scaling to new boundaries, a new data structure called Fast-PixelMap is used. The Fast-PixelMap data structure is a combination of a gridfile and a quadtree that realizes the split operations in the data and the 2D screen space. The Fast-PixelMap data structure enables an efficient determination of the old (boundaries of the gridfile partition in the dataset) and the new boundaries (those of the quadtree partition in the 2D screen space) of each partition. The old and the new boundaries determine the local rescaling of certain map regions. More precisely, all data points within the old boundaries will be relocated to the new positions within the new boundaries. The rescaling reduces the size of virtually empty regions and unleashes unused pixels for dense regions. Second, the Fast-PixelMap algorithm approximates a 3D kernel-densityestimation-based clustering in the 3D performing an array-based clustering for each dataset partition. After rescaling all data points to the new boundaries, the iterative positioning of data points (pixel placement step), starting with the densest regions and within the dense regions the smallest cluster is chosen first. To determine the placement sequence, we sort all final gridfile partitions (leaves of the Fast-PixelMap data structure) according to the number of data points they contain. The clustering is a crucial preprocessing step to making important information visible and achieving pixel coherence, which refers to the similarity of adjacent pixels. High pixel coherence makes small pixel clusters perceivable. The final step of the pixel placement is a sophisticated algorithm that places all data points of a gridfile partition to pixels on the output map in order to provide visualizations that are as position-, distance-, and cluster-preserving as possible. An example showing income levels based upon US-Census data is displayed in Figure 2.7.
2.5.4
Cartogram techniques
A cartogram can be seen as a generalization of a familiar land-covering choropleth map. In this interpretation, an arbitrary parameter vector gives the intended sizes of the regions displayed on the map, so a familiar land-covering choropleth is simply a cartogram with sizes proportional to land area. In addition to the classical applications mentioned above, a key motivation for cartograms as a general Information Visualization technique is to have a method for trading off shape and area adjustments. For example, in a conventional choropleth map, high values are often concentrated in highly populated areas, and low values may be spread out across sparsely populated areas. Such maps therefore tend to highlight patterns in less dense areas where few people live. In contrast, cartograms display areas in relation to an additional parameter, such as population. Patterns may then be displayed in proportion to this parameter (e.g., the number of people involved) instead of the raw size of the area involved. Example applications in the literature include population demographics (Tobler, 1976; Raisz, 1962), election results (Kocmoud and House, 1998), and epidemiology (Gusein-Zade and Tikunov, 1995). Because cartograms are difficult to make by hand, the study of automated methods is of interest (Dent, 1996).
Scope, Techniques and Opportunities for Geovisualization
37
Figure 2.6. Call volume of AT&T customers at one specified time (midnight EST). Each pixel represents one of 22:000 telephone switches. A uni-color map is used to show the call volume.
Figure 2.7. Comparison of traditional map versus PixelMap. New York State Median Household Income. 1999. This map displays cluster regions, for example on the East side of Central Park in Manhattan, where inhabitants with high income live, or on the East side of Brooklyn, where inhabitants with low income live.
38
D.A. Keim, C. Panse & M. Sips
One of the latest cartogram generation algorithm is the CartoDraw-algorithm which was recently proposed as a practical approach to cartogram generation (Keim et al., 2003a,b). The CartoDraw method incrementally repositions the vertices of the map's polygons by means of scanlines. Local changes are applied if they reduce total area error without introducing excessive shape error. Scanlines may be determined automatically, or entered interactively. The main search loop runs over a given set of scanlines. For each, it computes a candidate transformation of the polygons, and checks it for topology and shape preservation. If the candidate passes the tests, it is made persistent; otherwise it is discarded. The scanline processing order depends on their potential for reducing area error. The algorithm runs until the area error improvement over all scanlines falls below a given threshold. A result of the CartoDraw algorithm can be seen in Figure 2.8.
2.6
Interaction Techniques
In addition to the visualization techniques themselves, effective data exploration requires the use of one or more methods of interaction. Interaction techniques allow the data analyst to directly interact with the visualizations and dynamically change the visualizations according to the exploration objectives. Besides, they also make it possible to relate and combine multiple independent visualizations.
Figure 2.8. US State population cartogram showing the presidential election result of 2000. The area of the states in the cartograms corresponds to the electoral voters, the color corresponds to the percentage of the vote. A bipolar colormap depicts the candidate winning each state.
Scope, Techniques and Opportunities for Geovisualization
39
Interaction techniques can be categorized based upon the effects they have on the display. Navigation techniques focus on modifying the projection of the data onto the screen, using either manual or automated methods. View enhancement methods allow users to adjust the level of detail on part or all of the visualization, or modify the mapping to emphasize some subset of the data. Selection techniques provide users with the ability to isolate a subset of the displayed data for operations such as highlighting, filtering, and quantitative analysis. Selection can be done directly on the visualization (direct manipulation) or via dialog boxes or other query mechanisms (indirect manipulation). Some examples of interaction techniques are described below.
2.6.1
Dynamic projection
Dynamic projection is an automated navigation operation in which the projections are dynamically changed in order to explore a multi-dimensional data set. A classic example is the GrandTour system (Asimov, 1985) that aims to show all interesting 2D projections of a multi-dimensional data set as a series of scatter plots. Note that the number of possible projections is exponential in accordance with the number of dimensions, i.e., it is intractable for large dimensionality. The sequence of projections shown can be random, manual, pre-computed, or data driven. Systems supporting dynamic projection techniques include Xgobi (Swayne et al., 1992; Buja et al., 1996), XLispStat (Tierney, 1991) and ExplorN (Carr et al., 1996).
2.6.2
Interactive filtering
Interactive filtering is a combination of selection and view enhancement. In exploring large data sets, it is important to interactively partition the data set into segments and focus on interesting subsets. This can be done by a direct selection of the desired subset (browsing) or by a specification of properties of the desired subset (querying). Browsing is very difficult for very large data sets and querying often does not produce the desired results, but on the other hand, these tools offer many advantages over traditional controls. Therefore, a number of interactive selection techniques have been developed to improve interactive filtering in data exploration. An example of a tool that can be used for interactive filtering is the Magic Lens (Bier et al., 1993; Fishkin and Stone, 1995) in which a tool similar to a magnifying glass is used to support the filtering of the data directly in the visualization. The data under the magnifying glass is processed by the filter, and the result is displayed differently from the remaining data set, for a 3D example, (see D611ner, this volume (Chapter 16)). Users may also use several lenses with different filters, e.g., magnify, then apply a blur by carefully stacking multiple lenses, which work by applying their effects from back to front. Each lens acts as a filter that screens on some attribute of the data. The filter function only modifies the view only within the lens window. When the lenses overlap, their filters are combined. Other examples of interactive filtering techniques and tools are InfoCrystal (Spoerri, 1993), Dynamic Queries (Ahlberg and Shneiderman, 1994; Eick, 1994; Goldstein and Roth, 1994), Polaris (Stolte et al., 2001), Linked Micromap Plots, and Conditioned Choropleth Maps (Carr et al., 2000a,b; Figure 2.9). Additionally, a type of
40
D.A. Keim, C. Panse & M. Sips
Figure 2.9. A conditioned choropleth map of prostate data of the USA. The mapped prostate data is conditioned by male and female lung cancer. Figure created using Conditioned Choropleth Mapping System (MacEachren, 2003) developed under the project Conditioned Choropleth Maps: Dynamic Multi-variate Representations of Statistical Data supervised by Alan MacEachren.
Figure 2.11. Combination of zooming, distortion, and filtering techniques in the area of geographic visualization (Keahey, 1998). Reproduced with permission of A. Keahey, Visintuit. 92004 IEEE.
Scope, Techniques and Opportunities for Geovisualization
41
interactive filtering using a parallel coordinate plot linked to a map is illustrated in MacEachren et al. (2003a,b) and in Gahegan et al. (2002a,b).
2.6.3
Zooming
Zooming is a well-known view modification technique that is widely used in a number of applications. In dealing with large amounts of data, it is important to present the data in a highly compressed form to provide an overview of the data, but at the same time, allowing a variable display of the data at different resolutions. Zooming does not only mean increasing the size of data objects in the display, but also that the data representation may automatically change to present more details at higher zoom levels. The objects may, for example, be represented as single pixels at a low zoom level, as icons at an intermediate zoom level, and as labeled objects at a high resolution. An interesting example applying the zooming idea to large tabular data sets is the Table Lens approach (Rao and Card, 1994). Achieving an overview of large tabular data sets is difficult if the data is displayed in textual form. The Table Lens represents each numerical value through a small bar instead. All bars have a one-pixel height and the lengths are determined by the attribute values. This means that the number of rows on the display can be nearly as large as the vertical resolution and the number of columns depends on the maximum width of the bars for each attribute. The initial view allows the user to detect patterns, correlations, and outliers in the data set. In order to explore a region of interest the user can zoom in, with the result that the affected rows (or columns) are displayed in more detail, possibly even in textual form. Figure 2.10 shows an example of a baseball database with a few rows being selected in full detail. Other examples of techniques and systems that use interactive zooming include PAD+ + (Perlin and Fox, 1993; Bederson, 1994; Bederson and Hollan, 1994), IVEE/Spotfire (Ahlberg and Wistrand, 1995a,b) and DataSpace (Anupam et al., 1995). A comparison of fisheye and zooming techniques can be found in Schaffer et al. (1993).
2.6.4
Distortion
Distortion is a view modification technique that supports the data exploration process by preserving an overview of the data during drill-down operations. In this technique, portions of the data are shown with a high level of detail while others are displayed with lower levels of detail. Popular distortion techniques are hyperbolic and spherical distortions. These are often used on hierarchies or graphs but may be also applied to any other visualization technique. An example of spherical distortions is provided in the Scalable Frame-work paper (Kreuseler and Schumann, 2001). An overview of distortion techniques is provided by Leung and Apperley (1994) and Carpendale et al. (1997). Examples of distortion techniques include bifocal displays (Spence and Apperley, 1982), perspective wall (Mackinlay et al., 1991), graphical fisheye views (Furnas, 1986; Sarkar and Brown, 1994), hyperbolic visualization (Lamping et al., 1995; Munzner and Burchard, 1995), and hyperbox (Alpern and Carter, 1991). Some of the uses of distortion with map displays that combine zooming, distortion and filtering can be found
42
D.A. Keim, C. Panse & M. Sips
Figure 2.10. Table lens showing a table of baseball players performance/classification statistics for 1986. Reproduced with permission from R. Rao, Xerox PARC. 9ACM.
in Keahey (1998). Figure 2.11 shows the effect of distorting part of a familiar landcoveting map to display more detail while preserving context from the rest of the display.
2.6.5
Brushing and linking
Brushing is an interactive selection process that is often, but not always, combined with linking, a process to communicate the selected data to other views of the data set. There are many possibilities to visualize multi-dimensional data, each with their own strengths and weaknesses. The idea of linking and brushing is to combine different visualization methods to overcome the shortcomings of individual techniques. Scatter plots of different projections, for example, may be combined by coloring and linking subsets of points in all projections. In a similar fashion, linking and brushing can be applied to visualizations generated by all visualization techniques described above. As a result, the brushed points are highlighted in all visualizations, making it possible to detect dependencies and correlations. Interactive changes made in one visualization are also automatically reflected in the other visualizations. Note that connecting multiple visualizations through interactive linking and brushing provides more information than considering the component visualizations independently. Typical examples of visualization techniques that have been combined by linking and brushing are multiple scatter plots, bar charts, parallel coordinates, pixel displays, and
Scope, Techniques and Opportunities for Geovisualization
43
Figure 2.12. (a) Parallel coordinates plots. (b) Scatter plot matrix. These figures display US Census data for 50 states. A linked brushing between these multi-variate visualization techniques is used. The plots are linked and brushed by color, which represents the state wise winner party of the 2000 US presidential election (from Ihaka and Gentleman, 1996). The plots show example relationships including an inverse correlation between High School Grad rates and levels of Illiteracy as well as suggesting a tendency towards Republican party voting in states with a low or a high HS Grade.
44
D.A. Keim, C. Panse & M. Sips
maps. Most interactive data exploration systems allow some form of linking and brushing. Examples include Polaris (Stolte et al., 2001) and the Scalable Framework (Kreuseler and Schumann, 2001). Other tools and systems include S-Plus (Becker et al., 1988), XGobi (Swayne et al., 1992; Becker et al., 1996), XmdvTool (Ward, 1994; Figure 2.12), and DataDesk (Velleman, 1997; Wilhelm et al., 1995). An early example of brushing and linking applied to geospatial data was proposed by Monmonier (1989). Most subsequent geovisualization tool kits incorporate brushing and linking. These include cdv (Dykes, 1998), Descartes (Andrienko and Andrienko, 1999a-f) and GeoVISTA Studio (Gahegan et al., 2002a,b; MacEachren et al., 2003a,b; Cook et al., 1997).
2.6.6
Alternative classification from GI-Science
Crampton (2002) proposes an alternative classification of interaction techniques developed in GI Science. The interaction methods are placed in the framework of geovisualization in order to extend the geovisualization emphasis on exploratory, interactive and private functions of spatial displays. Crampton defines a hierarchy of the interaction techniques based on their increasing sophistication. Four categories of interactivity are proposed: the data, the data representation, the temporal dimension, and contextualizing interaction. The following benefits of both classifications can be observed. Firstly, interactivity types allow the user to directly interact with the visualization, dynamically change the visualization, and relate and combine independent visualization techniques in order to build interactive environments. Secondly, interactivity types allow the data analysts as well as the cartographers to compare and critique different views of the data and provide the human with a mechanism for an effective exploration and understanding of the data. In contrast to the alternative classification from GI Science, the classification presented here from the perspective of Information Visualization is based on the visual information seeking mantra (see w This means that the interaction techniques enable the user to modify the visualization for further analysis operations and that there is a strong relationship to exploration and datamining tasks. These interaction techniques can be completely summarized in the category interaction with data. The other categories of Crampton' s classification are more oriented on an interactive data representation, e.g., selection of view points, scaling, etc., and temporal features of the visualization such as fly-throughs and navigations. These interaction techniques are more related to representation tasks and computer graphics research.
2.7
Conclusion
The exploration of large data sets is an important but difficult problem. Information visualization techniques can be useful in solving this problem. Visual data exploration has significant potential, and many applications such as fraud detection and datamining can use Information Visualization technology for an improved data analysis. A significant proportion of all data being stored and processed has geospatial attributes. The task of geovisualization is to view geospatial data and to give insight into
Scope, Techniques and Opportunities for Geovisualization
45
geo-processes and geo-phenomena. In this area, maps are well-known tools for many centuries, but they have several drawbacks from the visualization standpoint. For example, when drawing large geospatial data sets on the screen, the display will usually be sparsely populated in some regions while in other regions of the display, high degree of overplotting occurs, since the geospatial locations are highly non-uniformly distributed in the plane. One of the challenges today is to find out how to deploy efficient visualization strategies to represent large geospatial data sets. Avenues for future work include the tight integration of visualization techniques from the Information Visualization area with methods from the GI Science and with traditional techniques from such disciplines as Statistics, Machine learning, Operations Research, and Simulation. Integration of visualization techniques and these more established methods would combine fast automatic datamining algorithms with the intuitive power of the human mind, improving the quality and speed of the datamining process. The intention of this chapter is to share ideas and connecting methods from both the Information Visualization and geovisualization disciplines. The ultimate goal is to bring the power of integrated visualization technology from both areas to every desktop to allow a better, faster and more intuitive exploration of very large geospatial data resources. This will not only be valuable in an economic sense but will also stimulate and delight the user.
Acknowledgments We gratefully acknowledge Stephen North from the AT&T Laboratories for his contribution to this research. "Skitter Graph" Internet Map 9 Regents of the University of California. Courtesy University of California. This chapter draws upon a framework that has been previously published (Keim, 2001).
References Abello, J., and Korn, J., (2001) "MGV: a system for visualizing massive multi-digraphs", Transactions on Visualization and Computer Graphics. Advizor Solutions Inc., (2003) Data Visualization Tools and Analytic Business Technology - ADVIZOR Solutions Inc. Online: http://www.advizorsolutions.com/ (23/10/03). Ahlberg, C., and Shneiderman, B., (1994) "Visual information seeking: tight coupling of dynamic query filters with starfield displays", In: Adelson, B., Dumais, S., and Olson, J. S., (eds.), CHI'94 Human Factors in Computing Systems. Boston, MA: ACM, pp. 313-317, (24-28 April). Ahlberg, C., and Wistrand, E., (1995a) "IVEE: an environment for automatic creation of dynamic queries applications", Proceedings of CHI '95: Human Factors in Computing Systems. ACM. Ahlberg, C., and Wistrand, E., (1995b) "IVEE: an Information Visualization and exploration environment", Proceedings International Symposium on Information Visualization, Atlanta, GA, pp. 66-73.
46
D.A. Keim, C. Panse & M. Sips
Alpern, B., and Carter, L., (199 l) "Hyperbox", Proceedings Visualization '91, San Diego, CA, pp. 133-139. Andrews, D. F., (1972) "Plots of high-dimensional data", Biometrics, 29, 125-136. Andrienko, G. L., and Andrienko, N. V., (1999a) "Interactive maps for visual data exploration", International Journal Geographic Information Science, 13(4), 355-374. Andrienko, G., and Andrienko, N., (1999b). Seasonal migration of white storks, 19981999. Online: http://www.ais.fhg.de/and/java/birds/(23/10/03). Andrienko, G., and Andrienko, N., (1999c) "GIS visualization support to the C4.5 classification algorithm of KDD", Proceedings of the 19th International Cartographic Conference, pp. 747-755. Andrienko, G., and Andrienko, N., (1999d) "Knowledge-based visualization to support spatial data mining", Proceedings of Intelligent Data Analysis. Berlin: Springer Verlag, pp. 149-160. Andrienko, G., and Andrienko, N., (1999e) "Making a GIS intelligent: CommonGIS project view", AGILE'99 Conference, Rome, April 15-17, pp. 19-24. Andrienko, G. and Andrienko, N., (1999f) Seasonal migration of white storks, 1998-1999. Online: http://www.ais.fhg.de/and/java/birds/(03/10/02). Ankerst, M., Keim, D. A., and Kriegel, H.-P., (1996) "Circle segments: a technique for visually exploring large multidimensional data sets", Proceedings Visualization 96, Hot Topic Session, San Francisco, CA. Anupam, V., Dar, S., Leibfried, T., and Petajan, E., (1995) "DataSpace: {3D} visualization of large databases", Proceedings International Symposium on Information Visualization, Atlanta, GA, pp. 82-88. Asimov, D., (1985) "The grand tour: a tool for viewing multidimensional data", SIAM Journal of Science & Statistical Computation, 6, 128-143. Becker, R., Chambers, J. M., and Wilks, A. R., (1988) The New S Language: A Programming Environment for Data Analysis and Statistics. Pacific Grove, CA: Wadsworth. Becker, R. A., Cleveland, W. S., and Shyu, M.-J., (1996) "The visual design and control of trellis display", Journal of Computational and Graphical Statistics, 5(2), 123-155. Bederson, B., (1994) "Pad+ +: advances in multiscale interfaces", Proceedings Human Factors in Computing Systems CHI'94 Conference, Boston, MA, p. 315. Bederson, B. B., and Hollan, J. D., (1994) "PAD+ ยง a zooming graphical user interface for exploring alternate interface physics", Proceedings User Interfaces Software and Technology'94. New York: ACM, pp. 17-27. Bier, E. A., Stone, M. C., Pier, K., Buxton, W., and DeRose, T., (1993) "Toolglass and magic lenses: the see-through interface", Proceedings SIGGRAPH'93, Anaheim, CA, pp. 73-80. Buja, A., Swayne, D. F., and Cook, D., (1996) "Interactive high-dimensional data visualization", Journal of Computational and Graphical Statistics, 5(1), 78-99.
Scope, Techniques and Opportunities for Geovisualization
47
CAIDA (Cooperative Association for Internet Data Analysis), (2003) Visualising internet topology at a macroscopic scale. Online: http://www.caida.org/analysis/topology/as_core_network (23/10/03). Card, S. K., Mackinlay, J. D., and Shneiderman, B., (eds.), (1999) Readings in Information Visualization: Using Vision to Think. San Francisco: Morgan Kaufmann Publishers. Carpendale, M. S. T., Cowperthwaite, D. J., and Fracchia, F. D., (1997) "IEEE computer graphics and applications, special issue on Information Visualization", IEEE Journal Press, 17(4), 42-51, (July 1997). Carr, D. B., Wegman, E. J., and Luo, Q., (1996) ExplorN: design considerations past and present, Technical Report, (No. 129). Centerfor Computational Statistics, George Mason University. Carr, D. B., Olsen, A. R., Pierson, S. M., and Jean-Yves, P. C., (2000a) "Using linked micromap plots to characterize omernik ecoregions", Data Mining and Knowledge Discovery. Hingham, MA: Kluwer Academic. Carr, D. B., Wallin, J. F., and Carr, D. A., (2000b) "Two new templates for epidemiology applications: linked micromap plots and conditioned choropleth maps", Statistics in Medicine. New York: John Wiley & Son. Chert, C., (1999) Information Visualization and Virtual Environments. London: Springer, p. 223. Chernoff, H., (1973) "The use of faces to represent points in k-dimensional space graphically", Journal of The American Statistical Association, 68(342), 361-368. Cleveland, W. S., (1993) Visualizing Data. Summit, NJ: Hobart Press. Cook, D., Symanzik, J., Majure, J. J., and Cressie, N., (1997) "Dynamic graphics in a GIS: more examples using linked software", Computers and Geosciences. Crampton, J. W., (2002) "Interactivity types in geographic visualization", Cartography and Geographic Information Science, 29(2), 85-98. Dent, B. D., (1999) Cartography: Thematic Map Design. Boston: WCB/McGraw-Hill. Di Battista, G., Eades, P., Tamassia, R. and Tollis, I. G., (1999) GraphDrawing: Algorithms for the Visualization of Graphs. Upper Saddle River, NJ: Prentice Hall. Dodge, M., (2001) An Atlas of Cyberspace. Online: http://www.cybergeography.org/atlas Dykes, J. A., (1998) "Cartographic visualization: exploratory spatial data analysis with local indicators of spatial association using Tcl/Tk and cdv", The Statistician, 47(3), 485-497. Edsall, R. M., (1999) "The dynamic parallel coordinate plot: visualizing multivariate geographic data", Proceedings 19th International Cartographic Association Conference, Ottawa, pp. 89-97. Eick, S. G., (1994) "Data visualization sliders", Proceedings ACM UIST, 119-120. Environmental Systems Research Institute, (2003) ArcGIS - ArcView. Online: http://www.esri.com/software/arcgis/arcview/index.html (23/10/03). Feiner, S., and Beshers, C., (1990a) "Visualizing n-dimensional virtual worlds with n-vision", Computer Graphics, 24(2), 37-38.
48
D.A. Keim, C. Panse & M. Sips
Feiner, S., and Beshers, C., (1990b) "Worlds within worlds: metaphors for exploring n-dimensional virtual worlds", Proceedings of UIST'90, pp. 76-83. Fishkin, K., and Stone, M. C., (1995) "Enhanced dynamic queries via movable filters", Proceedings Human Factors in Computing Systems CHI'95 Conference, Denver, CO, pp. 415-420. Furnas, G. W., (1986) "Generalized fisheye views", Proceedings CHI'86 Conference: Human Factors in Computing Systems. New York: ACM Press, pp. 16-23. Furnas, G. W., and Buja, A., (1994) "Prosections views: dimensional inference through sections and projections", Journal of Computational and Graphical Statistics, 3(4), 323-353. Gahegan, M., (1998) "Scatterplots and scenes: visualization techniques for exploratory spatial analysis", Computers, Environment and Urban Systems, 22(1), 43-56. Gahegan, M., Takatsuka, M., Wheeler, M., and Hardisty, F., (2002a) "GeoVISTA Studio: a geocomputational workbench", Computers, Environment and Urban Systems, 26, 267-292. Gahegan, M., Takatsuka, M., Wheeler, M., and Hardisty, F., (2002b) "Introducing GeoVISTA Studio: an integrated suite of visualization and computational methods for exploration and knowledge construction in geography", Computers, Environment and Urban Systems, 26(4), 267-292. Geisler, G., (2003) Making information more accessible: A survey of information, visualization applications and techniques. Online: http://www.ils.unc.edu/geisg/info/infovis/paper.html (01/02/03). Goldstein, J., and Roth, S. F., (1994) "Using aggregation and dynamic queries for exploring large data sets", Proceedings Human Factors in Computing Systems CHI'94 Conference, Boston, MA, pp. 23-29. Gusein-Zade, S., and Tikunov, V., (1995) "Map transformations", Geography Review, 9(1), 19-23. Han, J., and Kamber, M., (1986) Data Mining: Concepts and Techniques. Morgan Kaufman. Havre, S., Hetzler, B., Nowell, L., (2000) "ThemeRiver: visualizing theme changes over time", Proceedings of lEEE Symposium on Information Visualization, InfoVis 2000, Salt Lake City, Utah, October 9-10, 2000, pp. 115-123. Hearst, M., (1995) "TileBars: visualization of term distribution information in full text information access", Proceedings of A CM Human Factors in Computing Systems Conference (CHI'95), pp. 59-66. Huber, P. J., (1985) "The annals of statistics", Projection Pursuit, 13(2), 435-474. Ihaka, R., and Gentleman, R., (1996) "R: a language for data analysis and graphics", Journal of Computational and Graphical Statistics, 5(3), 299-314. Inselberg, A., and Dimsdale, B., (1990) "Parallel coordinates: a tool for visualizing multi-dimensional geometry", Proceedings Visualization 90, San Francisco, CA, pp. 361-370. Johannsen, A., and Moorhead, R. J., (1995) "AGP: ocean model flow visualization", IEEE Computer Graphics and Applications, 15(4), 28-33.
Scope, Techniques and Opportunities for Geovisualization
49
Johnson, B., and Shneiderman, B., (1991) "Tree-maps: a space-filling approach to the visualization of hierarchical information structures", Proceedings IEEE Visualization'91, Piscataway, NJ: IEEE, pp. 284-291. Keahey, T. A., (1998) "The generalized detail-in-context problem", Proceedings IEEE Visualization. Keim, D. A., (2000) "Designing pixel-oriented visualization techniques: theory and applications", IEEE Transactions on Visualization and Computer Graphics (TVCG), 6(1), 59-78, (January-March 2000). Keim, D. A., (2001) "Visual exploration of large data sets", Communications of the ACM (CA CM), 44(8), 38-44. Keim, D.A. and Herrmann, A., (1998) "The gridfit algorithm: an efficient and effective approach to visualizing large amounts of spatial data", IEEE Visualization '98. Research Triangle Park, NC: IEEE Press, pp. 181-188. Keim, D. A., and Kriegel, H.-P., (1994) "VisDB: database exploration using multidimensional visualization", Computer Graphics & Applications, 6, 40-49. Keim, D. A., and Kriegel, H.-P., (1995) "Issues in visualizing large databases", Proceedings Conference on Visual Database Systems (VDB'95). Lausanne: Schweiz, pp. 203-214. Keim, D., Bergeron, D., and Pickett, R., (1995a) "Test data sets for evaluating data visualization techniques", Perceptual Issues in Visualization. Springer, pp. 9-21. Keim, D. A., Kriegel, H. P., and Ankerst, M., (1995b) "Recursive pattern: a technique for visualizing very large amounts of data", Proceedings Visualization 95, Atlanta, GA, pp. 279-286. Keim, D. A., Koutsofios, E., and North, S. C., (1999) "Visual exploration of large telecommunication data sets", Proceedings Workshop on User Interfaces In Data Intensive Systems (Invited Talk), Edinburgh, UK, pp. 12-20. Keim, D. A., North, S. C., and Panse, C., (2003a) "CartoDraw: a fast algorithm for generating contiguous cartograms", Transaction on Visualization and Computer Graphics. Keim, D. A., North, S. C., Panse, C., and Schneidewind, J., (2003b) "Visualizing geographic information: VisualPoints vs CartoDraw", Palgrave Macmillan Information Visualization, 2(1), 58-67, (March 2003). Keim, D. A., North, S. C., Panse, C. and Sips, M., (2003c) PixelMaps: a new visual data mining approach for analyzing large spatial data sets. Florham Park: Information Visualization Research Group, AT&T Laboratories, (Dez 2003). Online: http://dbvis.fmi.uni-konstanz.de/sips/papers/03/KNPS03_TECHREPORT.pdf Keim, D. A., Panse, C., and Sips, M., (2003) "Visual data mining of large spatial data sets", 3rd Workshop on Databases in Networked Information Systems, Aizu, Japan. Kocmoud, C. J., and House, D. H., (1998) "Continuous cartogram construction", Proceedings IEEE Visualization, pp. 197-204. Kreuseler, N. L. M., Lopez, N., and Schumann, H., (2001) "A scalable framework for Information Visualization", Proceedings of IEEE Symposium on Information Visualization, InfoVis 2000, Salt Lake City, Utah, October 9-10, 2000. IEEE Press, pp. 27-38.
50
D.A. Keim, C. Panse & M. Sips
Lamping, J., Rao, R., and Pirolli, P., (1995) "A focus + context technique based on hyperbolic geometry for visualizing large hierarchies", Proceedings of CHI'95 Human Factors in Computing Systems, Denver, CO, May 1995. New York: ACM Press, pp. 401-408. LeBlanc, J., Ward, M. O., and Wittels, N., (1990) "Exploring N-dimensional databases", Proceedings Visualization'90, San Francisco, CA, pp. 230-239. Leung, Y., and Apperley, M., (1994) "A review and taxonomy of distortion-oriented presentation techniques", Proceedings Human Factors in Computing Systems CHI'94 Conference, Boston, MA, pp. 126-160. Levkowitz, H., (1991) "Color icons: merging color and texture perception for integrated visualization of multiple parameters", Proceedings Visualization 91, San Diego, CA, pp. 22-25. MacEachren, A.M., (2003) Conditioned choropleth mapping systemproject: conditioned choropleth maps: dynamic multivariate representations of statistical data. Online: http://www.geovista.psu.edu/grants/dg-qg/CCmaps/(June 2003). MacEachren, A. M., Dai, X., Hardisty, F., Guo, D., and Lengerich, G., (2003a) "Exploring high-D spaces with multiform matrices and small multiples", International Symposium on Information Visualization, Seattle, pp. 31-38. MacEachren, A. M., Hardisty, F., Dai, X., and Pickle, L., (2003b) "Geospatial statistics supporting visual analysis of federal geospatial statistics", Digital Government Table of Contents, pp. 59-60. Mackinlay, J. D., Robertson, G. G., and Card, S. K., (1991) "The perspective wall: detail and context smoothly integrated", Proceedings Human Factors in Computing Systems CHI'91 Conference, New Orleans, LA, pp. 173-179. Marshall, R. E., Kempf, J. L., Scott Dyer, D. and Yen, C. C., (1987) "Visualization methods and simulation steering for a 3D turbulence model of Lake Erie", Symposium on Interactive 3D Graphics, Computer Graphics, pp. 89-97. Monmonier, M., (1989) "Geographic brushing: enhancing exploratory analysis of the scatterplot matrix", Geographical Analysis, 21 (1), 81-84. Munzner, T., and Burchard, P., (1995) "Visualizing the structure of the World Wide Web in 3D hyperbolic space", Proceedings VRML'95 Symposium, Special Issue of Computer Graphics, ACM SIGGRAPH, San Diego, CA, pp. 33-38. Perlin, K. and Fox, D., (1993) "Pad: an alternative approach to the computer interface", In: Kajiya, J. T., (ed.), Proceedings of the 20th Annual A CM Conference on Computer Graphics (SIGGRAPH '93), Anaheim, CA: ACM Press, pp. 57-64. (Aug. 2-6). Pickett, R. M., and Grinstein, G. G., (1988) "Iconographic displays for visualizing multidimensional data", Proceedings IEEE Conferene on Systems, Man and Cybernetics, Piscataway, NJ: IEEE Press, pp. 514-519. Raisz, E., (1962) Principles of Cartography. London: McGraw-Hill, pp. 215-221. Rao, R., and Card, S. K., (1994) "The table lens: merging graphical and symbolic representation in an interactive focus + context visualization for tabular information", Proceedings Human Factors in Computing Systems CHI 94 Conference, Boston, MA. New York: ACM, pp. 318-322.
Scope, Techniques and Opportunities for Geovisualization
51
Robertson, G. G., Mackinlay, J. D., and Card, S. K., (1991) "Cone trees: animated {3D} visualizations of hierarchical information", Proceedings Human Factors in Computing Systems CHI 91 Conference, New Orleans, LA, pp. 189-194. Sarkar, M., and Brown, M., (1994) "Graphical fisheye views", Communications of the ACM, 37(12), 73-84. Schaffer, D., Zuo, Z., Bartram, L., Dill J., Dubs, S., Greenberg, S., and Roseman, M., (1993) "Comparing fisheye and full-zoom techniques for navigation of hierarchically clustered networks", Proceedings Graphics Interface (GI'93) Canadian Information Processing Society. Toronto, Ontario: Graphics Press, pp. 87-96. Schumann, H., and Mfiller, W., (2000) Visualisierung: Grundlagen und Allgemeine Methoden. Berlin: Springer Verlag. Shneiderman, B., (1992)"Tree visualization with Treemaps: a {2D} space-filling approach", A CM Transactions on Graphics, 11 (1), 92-99. Shneiderman, B., (1996) "The eyes have it: a task by data type taxonomy for Information Visualizations", Proceedings IEEE Symposium on Visual Languages. Washington: IEEE Computer Society Press, pp. 336-343. Silicon Graphics Inc., (2002). SGI - Products: Software: MineSet Update. Online: http://www.sgi.com/software/mineset.html (01/02/02). Spence, R., (2001) Information Visualization. Harlow: Addison-Wesley/ACM Press Books, 206 pp. Spence, R., and Apperley, M., (1982) "Data base navigation: an office environment for the professional", Behaviour and Information Technology, 1(1), 43-54. Spence, R., Tweedie, L., Dawkes, H., and Su, H., (1995) "Visualization for functional design", Proceedings International Symposium on Information Visualization (InfoVis'95), pp. 4-10. Spoerri, A., (1993) "InfoCrystal: a visual tool for information retrieval", Proceedings Visualization'93, San Jose, CA, pp. 150-157. Stasko, J. T., Domingue, J. B., Brown, M. H., and Price, B. A., (eds.), (1998) Software Visualization. Cambridge, MA: MIT Press. Stolte, C., Tang, D., and Hanrahan, P., (2001) "Polaris: a system for query, analysis and visualization of multi-dimensional relational databases", Transactions on Visualization and Computer Graphics. Swayne, D. F., Cook, D., and Buja, A., (1992) "XGobi: interactive dynamic data visualization in the X Window System", Journal of Computational and Graphical Statistics, 7 (1), 113-130. Tierney, L., (1991) LispStat: An Object-Orientated Environment for Statistical Computing and Dynamic Graphics. New York: Wiley. Tobler, W. R., (1976) "Cartograms and cartosplines", Proceedings of the 1976 Workshop on Automated Cartography and Epidemiology, Washington, District of Columbia, pp. 53-58. van Wijk, J. J., and van Liere, R. D., (1993) "Hyperslice", Visualization'93, San Jose, CA, pp. 119-125.
52
D.A. Keim, C. Panse & M. Sips
Velleman, P. F., (1997) Learning Data Analysis with DATA DESK 5.0. New York: Addison-Wesley. Ward, M., (1994) "XmdvTool: integrating multiple methods for visualizing multivariate data", Proceedings Visualization'94. Washington: IEEE Computer Society Press, pp. 326-333. Ware, C., (2000) Information Visualization: Perception for Design. San Francisco: Morgan Kaufmann Publishers, p. 384. Wilhelm, A., Unwin, A. R., and Theus, M., (1995) "Software for interactive statistical graphics - a review", Proceedings Int. Softstat 95 Conference Heidelberg, Germany.
Exploring Geovisualization J. Dykes, A.M. MacEachren, M.-J. Kraak (Editors) 9 2005 Elsevier Ltd. All rights reserved.
Chapter 3
Information Visualization and the Challenge of Universal Usability Catherine Plaisant, Human-Computer Interaction Laboratory, University of Maryland, HCIL/UMIACS A.V. Williams Building, College Park, MD 20782, USA
Keywords: Information Visualization, user interface, universal usability, blind users, help
Abstract Information Visualization aims to provide compact graphical presentations and user interfaces for interactively manipulating large numbers of items. We present a simple "data by tasks taxonomy" then discuss the challenges of providing universal usability, with example applications using geo-referenced data. Information Visualization has been shown to be a powerful visual thinking or decision tool but it is becoming important for services to reach and empower every citizen. Technological advances are needed to deal with user diversity (age, language, disabilities, etc.) but also with the variety of technology used (screen size, network speed, etc.) and the gaps in user's knowledge (general knowledge, knowledge of the application domain, of the interface syntax or semantic). We present examples that illustrate how those challenges can be addressed.
3.1
Introduction "If a picture is worth a thousand words, then an interface is worth a thousand pictures." (Shneiderman, 2001)
Designers are discovering how to use rapid and high-resolution color displays to present and manipulate large amounts of information in compact and user-controlled ways. Information Visualization can be defined as the use of computer-supported interactive visual representation of abstract data to amplify cognition (Card et al., 1999). The abstract characteristic of the data is what distinguishes Information Visualization from scientific visualization. Information Visualization is more likely to be used to display database content (for example, recorded stock values, health statistics) than output of models or simulations, but this distinction is not always important. The display of geo-referenced data is often a hybrid visualization that combines abstract and concrete data. In fact several of the most famous examples of Information Visualization 53
54
C. Plaisant
include maps, from the 1861 representation of the ill-fated Napoleon' s Russian campaign by Minard (see Tufte (1983) and Kraak (undated)) to the interactive HomeFinder application shown in Figure 3.1 that introduced the concept of dynamic queries (Ahlberg et al., 1992). Information Visualization aims to provide compact graphical presentations and user interfaces for interactively manipulating large numbers of items (102-106), possibly extracted from far larger datasets (Card et al., 1999; Spence, 2001; Ware, 2000; Chen, 2002; Bederson and Shneiderman, 2003). Also sometimes called visual datamining, it uses the enormous visual bandwidth and the remarkable human visual system to enable users to make discoveries, take decisions, or propose explanations about patterns, groups of items, or individual items. Perceptual psychologists, statisticians, and graphic designers (Tufte, 1983) offer valuable advice about presenting static information, but advances in processor speed, graphic devices and dynamic displays takes user-interface designers well beyond current wisdom.
Figure 3.1. The HomeFinder. Houses for sale appear as yellow dots on a stylized map of Washington DC. As users adjust sliders and click on buttons to set their search criteria immediate feedback (within 10 ms) is provided on the map showing the houses that match the query, and allowing users to pose hundreds of queries in a few seconds and rapidly explore the dataset.
Information Visualization and the Challenge of Universal Usability
55
This chapter presents a simple "data by tasks taxonomy" then discusses the challenges of providing "universal usability", with example applications using georeferenced data.
3.2
Data by Task Taxonomy
This data by tasks taxonomy includes seven basic data types and seven basic tasks (Shneiderman, 1998). The data being explored are usually multi-dimensional but most designs highlight 1, 2 or 3D that are used to define the general visual structure of the visualization. The taxonomy is organized based on those selected dimensions. This simplification is useful to describe the visualizations that have been developed and to characterize the types of problems that users encounter when using those visualizations. Examples were chosen to complement those provided by Keim et al., this volume (Chapter 2) in which a more comprehensive taxonomy for visualization of highdimensional data is the primary focus.
3.2.1
Data types
1- 2- or 3D data: Linear data types (1D) include lists, documents, program source code, and the like that are organized sequentially. Interface-design issues include what overview, scrolling, or selection methods can be used. User tasks might be to find the number of items or to see items that exhibit certain attributes (Eick et al., 1992). Planar data (2D) can be represented by geographic maps, floor plans, and newspaper layouts. User tasks are to find adjacent items, containing items and paths between items, and to perform the seven basic tasks (see below). Real-world 3D objects such as the human body or buildings have volumetric elements and connections with other elements. Users' tasks deal with adjacency plus above-below and inside-outside relationships. In 3D applications, users must understand and control their position and orientation when viewing the objects, and must be able to compensate for the serious problems of occlusion. While many examples of successful 3D computer graphics and scientific visualizations exist (Nielson et al., 1997) there are still very few Information Visualization examples in three (abstract) dimensions. Designers have used 3D representations to present attractive overviews of data that was not intrinsically 3D, such as sets of documents, as shown in Figure 3.2 (Wise et al., 1995). But controlled experiments trying to measure the benefits of 3D in such conditions have had mixed results (Cockburn and McKenzie, 2002). These mixed results complement similar findings from earlier cartographic experiments and related efforts to assess use of the third dimension to depict non-spatial attributes on maps (Kraak, 1989; Dorling, 1992) Temporal data: Time series are very common and merit a data type that is separate from 1D data. The distinctions are that items have a start and finish time, and may overlap. Timelines have been widely used, from the line plots used by Minard (see Tufte, 1983) to summaries of heterogeneous data such as LifeLines, as shown in Figure 3.3 (Plaisant et al., 1996). Frequent tasks include finding all events before, after, or during some time period or moment, and in some cases comparing periodical phenomena (Carlis and Konstan, 1998). Space-time data have also been a focus
56
C. Plaisant
Figure 3.2. ThemesViewTM (formally ThemeScape) shows a 3D map representing the results of a search in a large corpus of documents. Proximity indicates similarity of the topics, whilst height reflects the number of documents and frequency of terms. Commercial applications also exist (OmniViz Inc, 2003) Reproduced with permission of Pacific Northwest National Laboratory.
Figure 3.3. LifeLines present a summary of personal records (here a medical record), showing several facets of the records and using line thickness and color to map data attributes on the display.
Information Visualization and the Challenge of Universal Usability
57
of attention in geovisualization for more than a decade (Szego, 1987; DiBiase et al., 1992; Kraak and MacEachren, 1994; Kwan, 2000) and some recent advances are discussed by Andrienko et al., this volume (Chapter 10). Multi-dimensional data: Most relational- and statistical-database contents are conveniently manipulated as multi-dimensional data, in which items with n attributes become points in an n-dimensional space. The interface representation can be dynamic 2D scattergrams (possibly a map, as is the case in Figure 3.1) with each additional dimension controlled by a slider or button using dynamic queries (Ahlberg et al., 1992). A 3D scattergram is possible, but disorientation and occlusion are severe problems. Parallel coordinates plots (Inselberg, 1985) are one of the few truly multi-dimensional techniques and have been shown to be a powerful analysis tool. Familiarity, training and practice in using the technique will help a user become a "multi-dimensional detective" (Inselberg, 1997). Less powerful but more accessible to novice users is the Table Lens (Rao and Card, 1994; Inxight Software Inc., 2002), which uses a spreadsheet metaphor. Other examples include VisDB for multi-dimensional database visualization (Keim and Kriegel, 1994), interactive mosaic displays (Friendly, 1994; Theus, 2002a,b), the Attribute Explorer (Tweedie et al., 1996) and the scatter plot or prosection matrices of Becker and Cleveland (1987). Interactive geovisualization software also utilizes multidimensional visualization techniques (Andrienko and Andrienko, 1999a-f; Gahegan et al., 2002a,b; MacEachren et al., 2003a,b) as emphasized in section B of this volume (see Andrienko et al., this volume (Chapter 5) and subsequent chapters). Hierarchical data: Hierarchies or tree structures are collections of items, in which each item (except the root) has a link to one parent item. Examples include taxonomies, file structures, organization charts and disease classifications. Items and the links between parent and child can have multiple attributes. Tasks can be topological (for example, a query asking which branch of the company has more employees?) or attribute based (such as an attempt to find the largest old files on a hard disk). Interface representations of trees can use the outline style of indented labels used in tables of contents, node-and-link diagrams. Examples include the Hyperbolic tree (Lamping et al., 1995) commercialized by Inxight Software Inc (2002) or SpaceTree (Plaisant et al., 2002; Grosjean et al., 2002). A third possibility is to use a space filling representation such as Treemap (Johnson and Shneiderman, 1991; Bederson et al., 2002) as shown in Figure 3.4. A number of commercial applications of the Treemi~p technique are available including Shneiderman (1998), the Map of the Market (SmartMoney.com, 2003) or e-business (The Hive Group Inc., 2003). Network data: When relationships among items cannot be captured conveniently with a regular tree structure, items are linked to an arbitrary number of other items in a network. In addition to performing the basic tasks applied to items and links, network users often want to know about shortest or least costly paths connecting two items or traversing the entire network. Common representations include node-andlink diagrams (but layout algorithms are often so complex that user interaction remains limited for large networks), and square matrices of items with the value of a link attribute in the row and column representing a link. Network visualization is an old but still imperfect art because of the complexity of relationships and user tasks, for example,
58
C. Plaisant
Figure 3.4. An example of Treemap is the Map of the Market (SmartMoney.com, 2003). Rectangles each represent a stock and are organized by industry groups. The rectangle size is proportional to the market capitalization and the color indicates the percentage gain or loss for the given time period. Reproduced with permission of SmartMoney.com.
Figure 3.5. Dynamic labeling of items is still a challenge. Here Excentric Labels in incMap show the labels of all the items inside the focus circle, revealing hidden items and allowing their selection. Reproduced with permission of N Space Labs, Inc. (http://www.incmap.com).
Information Visualization and the Challenge of Universal Usability
59
(see Rodgers, this volume (Chapter 7)). It is used in a number of useful geographic applications and is being incorporated into software for geovisualization, for examples, (see Mountain, this volume (Chapter 9)) and Fairbairn, this volume (Chapter 26).
3.2.2
High-level task types
Having considered the range of data types available along with some methods that have been developed for graphically representing them, we can consider a number of highlevel tasks that apply to all data types Overview task: Gaining an overview of the data might include gauging the number of items and the range and distribution of the attribute values, or estimating how much things have changed since last time the user reviewed the data. Overview strategies include zoomed-out views adjoining the detail views, for example, (see Ware and Plumlee, this volume (Chapter 29)). A movable field-of-view box can be used to control the contents of the detail view. Intermediate views allow larger zoom factors. Another popular approach is the fisheye strategy originally described by Furnas (1986). It provides overview and details in a single combined view by using distortion based on a degree of interest function. It is effective when zoom factors are small and deformation is acceptable to users (for example, when orientation and distance measurement are not important). Zoom task: Users need to control the zoom focus and the zoom factor. Smooth zooming helps users to preserve their sense of position and context. Manual zooming is powerful but users tend to get lost so application-controlled zooming to preset levels is more likely to be usable, for example, see Ware and Plumlee, this volume (Chapter 29). Pad-+-+, now called Picolo is a popular zooming user interface toolkit that uses semantic zooming (Bederson, 1994; Bederson et al., 2000). Semantic zooming (Perlin and Fox, 1993) is commonly used with maps, where the same area can be displayed with different features and amount of details at different zoom ratios. There are key parallels with real time cartographic generalization here (Weibel and Jones, 1998). Constant density zooming (Woodruff et al., 1998) is an example of technique to maximize the number and readability of items on the display. Wood, this volume (Chapter 15) uses mipmapping to display surface characteristics according to the scale at which any part of a surface is viewed in a real-time 3D application and D611ner, this volume (Chapter 16) identifies some associated issues in computer graphics. Filter task: Dynamic queries allow users to quickly focus on their interests by eliminating unwanted items. Other techniques include sorting, grouping or highlighting followed by hiding, or locating items similar to an item of interest. Theus, this volume (Chapter 6) provides some examples of "selection" from the perspective of statistical graphics. Details-on-demand task: Once a collection has been trimmed, users need to review the details of single items or groups. The usual approach is to simply click on an item and review details in a separate or popup window. Dynamic labeling remains an important challenge. Excentric labeling (Fekete and Plaisant, 1999) is an approach
60
C. Plaisant
illustrated in Figure 3.5 through the Geographic Map of the Market in which geovisualization techniques and those of Information Visualization are integrated (N Space Labs Inc., 2003). Relate task: Users need to view relationships between items, as is the case with the LifeLines shown in Figure 3.3, where users can click on a medication and see the related visit report, prescriptions, and laboratory test results. Linking and brushing techniques (Cleveland, 1994) and the Influence Explorer (Tweedie et al., 1996) emphasize the exploration of relationships. Many applications combine multiple visualization techniques that are tightly coupled (for example, (see Roberts, this volume (Chapter 8))). This is a key strength of visualization tools, and a number of chapters in this publication demonstrate examples, particularly those concerned with "Creating Instruments for Ideation" (for example, (see Andrienko et al., this volume (Chapter 5))). Various tools are being developed in various academic and application domains to allow users to specify the visualizations they need and how the interaction between the visualizations should be controlled (North et al., 2002). History task: It is rare that a single user action produces the desired outcome. Keeping the history of actions allows users to retrace their steps, save useful exploration "recipes" and apply them to updated datasets later on. Roberts, this volume (Chapter 8) considers these issues at an operational level and Gahegan, this volume (Chapter 4) addresses the conceptual, scientific and motivational challenges that underlie support for saving and sharing entire analysis strategies. Extract and Report task: Users often need to save subsets of the data or particular views of the data into reports. They may also want to publish "cleansed" data with a simplified subset of the tool's features for others to review.
3.3
The Coming of Age of Information Visualization - Toward Universal Usability
Although maps have been used for hundreds of years, it is important to realize that most Information Visualization techniques are very recent and, if we exclude elementary tools such as pie or bar charts, these tools have mostly been used by researchers, data analysts and experts. Only recently have we seen novel designs become widely used by the public. Researchers recognize that there is no "one size fits all" visualization and that specialized techniques are needed to tackle special data (for example, genomic data or spatio-temporal data) as well as special user needs (such as collaborative analysis or real time monitoring). Two general challenges need to be faced by Information Visualization before we can anticipate more widespread uptake of many of the techniques that have been developed: the ability to handle larger volumes of data and the ability to effectively support more diverse users. The first challenge relates to the limited number of items most tools available can manage. Many innovative prototypes can only deal with a hundred or a thousand items, or have difficulties maintaining real time interactivity when dealing with larger numbers. Yet examples dealing with millions of items without aggregation have been achieved as shown in Figure 3.6 (Fekete and Plaisant, 2002). Keim
P, i
a -
,T-
-.)+-----
. : I . --..
Figure3.6. A Treemap displaying a million files from a large file system, without aggregation (Fekete and Plaisant, 2002). Careful examination of the high resolution display reveals patterns and special algorithms preserve the interactivity of the rich overviews and filtering tools.
R
R
62
C. Plaisant
et al. (2001) demonstrate that Information Visualization is not yet close to reaching the limits of human visual abilities but that new techniques are needed to tackle the large quantities of information. Keim et al., this volume (Chapter 2) provide an overview and some additional solutions. Dealing with real data also involves data cleansing or dealing with missing and uncertain values. The second challenge is focused on more specifically here: how do we make Information Visualization accessible to a wider group of diverse users? In fact a growing number of applications are being developed for what might be the most challenging user group - the general public. Let us take the example of the enormous amounts of georeferenced data accumulated by government agencies and to be made available to every citizen. These data are useful to senior citizens looking for a place to settle after retirement, business analysts, managers considering relocation, etc. They can also be useful to drivers on the road and researchers working on complex tasks on their high-end computer workstations. To address the problem of universal usability (Shneiderman, 2000; Shneiderman and Hochheiser, 2001), designers need to consider larger and more diverse groups of users. Technological advances are needed not only to deal with user diversity (age, language, disabilities, etc.) but also with the variety of technology used (screen size, network speed, platform, etc.) and any specific gaps in a user' s knowledge (e.g., general knowledge, knowledge of the application domain, of the interface syntax or semantic). Information Visualization has been shown to be a powerful visual thinking or decision tool for some average users receiving a minimum of training (Williamson and Shneiderman, 1992; Lindwarm et al., 1998; Chen and Czerwinski, 2000). But it is becoming important for services to reach and empower every citizen regardless of their background, technical disadvantages or personal disabilities. Universal usability is an ambitious long-term goal but many practical steps can be taken toward achieving it. Focusing on this problem will most likely lead to better technologies for everyone (simpler interfaces, faster downloads, etc). Several examples are reviewed below that illustrate how projects have addressed different aspects of the universal usability challenge.
3.3.1
Improving general usability
Of course the first step is to improve the general usability of the interface. Many texts are available to guide designers toward the creation of empowering user interfaces (Shneiderman, 1997; Preece et al., 2002). Usability testing can then verify that user needs and usability goals have been met and that users are able to use the system on their own with a sense of control and satisfaction (Dumas and Redish, 1999; Kuniavsky, 2003). Specific guidelines for map design are also available (Pickle, 2003) and Tob6n, this volume (Chapter 34) draws upon the usability approach to assess geovisualization map use, for example, (see also Fuhrmann et al., this volume (Chapter 28)). The success of the Map of the Market (Figure 3.4) illustrates that general techniques initially described as "difficult to understand" (i.e., Treemap) can become accessible interfaces. The popularity of this application with the general public might be attributed in part to the fact that the data is familiar, and important, to users who visit
Information Visualization and the Challenge of Universal Usability
63
a financial website. The careful simplification and refinement of the initial Treemap interface also plays a part. The names and groupings of stocks are familiar to users of the SmartMoney Website. The hierarchy is simple, being shallow and of fixed depth, and the color mapping is natural to most users (using green for gains or increased values of the stocks, red for losses, with alternative colors for those with color impairment). An elegant new algorithm has recently resulted in a better aspect ratio for all the rectangles making the display more readable and pleasing. Labeling and links to details were optimized for the particular application. Finally it was carefully written in lightweight Java so that it could actually run on most users' machines without having to download special plugins or worry about Java versioning. This combination of factors has been effective in making the map usable by the general public, as indicated by the large number of return users the Website enjoys.
3.3.2
Helping users get started
Designers need to consider whether their application is to be used by first-time users or by experts who will have invested time and effort into learning the application. A major aspect of accessibility is concerned with enabling users to get started with an application (Andrienko et al., 2002). Even the average professional analyst or researcher may need help, but a major challenge is to help ordinary citizens use Information Visualization applications successfully. Commercial Web sites can decide which population they target but Digital government applications might well be faced by the greatest challenge since they are supposed to be usable by everyone! This implies that most information consumers will be first time users and also that they will have very varied backgrounds and levels of education. They may also have limited time or interest in learning to use the system, but paradoxically may have very high expectations of the services they seek to use. Users want an answer to their question, not necessarily to learn all that a tool can do for them. Let us consider a particular example, that of DataMap (Plaisant, 1993), which was previously named Dynamap or Ymap. Dang et al. (2001) review three approaches that were explored to help users get started with the DataMap interface. DataMap (Figure 3.7) is an interactive visualization tool developed by our Human-Computer Interaction Laboratory at the University of Maryland and is scheduled to be released by the US Census Bureau on CDs and later on the Web. Users can click on a map of the US to display facts about the areas, select multiple areas to compare, zoom on the map or use dynamic queries to filter the map according to a list of criteria. Finally, they can use a scatter plot, tightly coupled to the map and table, to see relationships between two criteria. Our numerous demonstrations and tests in the lab had made us confident that average users could understand and use DataMap after a minute of two of demonstration, but usability tests at the Census Bureau with novice "off-the-street" users receiving no training revealed that many users had difficulties getting started. Some would struggle with certain details of the interface, while others would simply dismiss the interface saying, "It' s just too complicated". They had problems not only zooming and selecting multiple regions but also with the sliders. The problems ranged from recognizing that one could move the slider thumbs to understanding what the animation meant. Several users were even puzzled
64
C. Plaisant
Figure 3.7. (a) DataMap allows users to zoom on a state or county map, select areas or filter them out with dynamic queries. A tightly coupled scatter plot provides an alternative to compare areas. (b) The revised interface (reproduced with permission of Chris North, Virginia Tech).
Information Visualization and the Challenge of Universal Usability
65
by the interactive scatter plot, some not guessing that dots represented regions and some not knowing how to read a scatter plot at all. The first step was to revise the interface. This was done by a team of colleagues at Virginia Tech led by Chris North and is illustrated in Figure 3.7b. Most problems found in the usability study led to refinements of the interface. This resulted in a number of changes including: reducing the number of attribute sliders with the possibility of adding more with a control panel; making slider thumbs easier to recognize and use; limiting zooming to avoid zooming into empty areas; simplifying window resizing; using an appropriate projection for the map; using fonts consistently and selecting more readable typefaces; using color coding to show the relationship between the sliders position and the parts of the map highlighted or hidden. Some aspects of the interfaces still needed explanations. Since DataMap is meant for public access, it was clear that users would be unlikely to read manuals or go through long tutorials, so we explored alternative approaches to providing help (Plaisant et al., 2003.) We considered three approaches. The first approach is to create a multi-layered design that provides a simpler interface to get started, while complex features are accessed progressively as users move through the layers of the interface. The second approach is called Integrated Initial Guidance (IIG) or "sticky note help". It provides help within the working interface, right at the start of the application. Using the metaphor of sticky notes overlaid on top of the functional interface it locates the main widgets, demonstrates their manipulation, and explains the resulting actions by replaying recorded sets of actions. The third approach uses video demonstrations of the interface. The videos use sound and entirely overlap the interface to give the illusion of being integrated in the interface. 1
Approach 1" multi-layered designs Some applications might be suited for a multi-layer design that allows users to start with a simple interface with limited views on information and choices to make and then to move to more complex (and more functional) levels once the basic functions are understood. This is the case for DataMap, which can easily be organized in a three-layer design (Figure 3.8): 9 9 9
layer 1: map and table only; layer 2: map and table, plus dynamic query filters; layer 3: map and table and dynamic query, plus scatter plot.
The interface initial view hides level 2 and level 3 functionality. When users go up one level, the appropriate parts of the interface are added with an animated transition, which help users see what is changing. Multi-layered interfaces, termed "level-structured interfaces" when introduced to Information Visualization (Shneiderman, 1998), are commonly encountered in hardware devices like VCRs that hide advanced function buttons and controls behind a small door, or in search interfaces that often provide a Note that this workon Help was done in parallel with Chris North's workon the revisionof the interface, so the help techniques are shown on the old interface. Those two projects will be merged eventually.
66
C. Plaisant
Figure 3.8. Three different levels of the level structured approach. (a) the first level shows only the map and the data table; (b) second level shows slider bar along with map and table; (c) the third level adds scatter plot. An introduction panel lists the features of the level and indicates the location of the three level buttons.
Information Visualization and the Challenge of Universal Usability
67
simple and advanced search. This approach has been underused in software applications and could be generalized easily. The benefits are that users can get started more easily. The risk is that some users will never discover the advanced features they do not know are there.
Approach 2: integrated initial guidance or "sticky note help" IIG implements a metaphor of sticky notes inside the interface itself, thereby allowing users to use the interface or run automated demonstrations while reading the sticky notes overlaid on the functional interface (Figure 3.9). Sticky notes highlight the main functions of the interface, show the location of the main interface widgets whose use can be demonstrated and explained with a "show me" button, and provide lists of simple to complex example tasks which lead to demonstrations of advanced interface widget functions. This allows users to make use of the help in many different ways. Some users will try out all the example tasks, while others may never use any. Some users will
Figure 3.9. Using sticky notes. (a) Three IIG sticky notes lead to explanations of how to use the map, zoom, select multiple states and move to the next level. Example tasks are listed in the note at the top right. (b) The first example task was chosen. "Compare the populations of three west coast states". The next steps are shown in transparency until the user executes the current one, or asks to see an automated "show me" demonstration.
68
C. Plaisant
use the show me feature while others will execute the steps themselves, guided by the directions on the sticky notes and using the show me function only when they failed to guess what to do.
Approach 3: autonomous video or animated demonstrations Video demonstrations are used increasingly to introduce the main features of complex visual interfaces. They can be launched from the application but are really run outside the interface itself. Macromedia Flash can be used to create demonstrations but simple recording tools (such as Camtasia Studio from TechSmith) are useful to create video explanations in a matter of hours. Effectiveness is increased by the use of speech, which leads to more compact explanations and lively demonstrations (but subtitles will be needed to accommodate users with hearing difficulties). Highlighting the mouse cursor and making mouse clicks or key presses visible is important. Low-resolution videos can be effective and fast to download but we found that videos that entirely cover the interface give users the impression that they are watching the real interface, therefore reducing the transfer of learning to the interface. Of these three different approaches, the sticky note technique was found very effective during informal user testing but it was fairly difficult to design and build. On the other hand, the video demonstrations were easier to create and fairly effective when kept short and mapped in direct ways to users tasks. The multi-layered approach was appreciated by the majority of our test users and might be the most powerful approach to helping users get started with complex public access applications, as long as care is given to guide users to the advanced levels.
3.3.3
Addressing the hardware diversity
Because programmers and development teams usually work with high-end equipment and fast network connections it is important to address the range of devices and network speed available in people's homes and businesses when producing visualization software for public access. Issues may vary from application to application so we only give an example illustrating how addressing hardware problems does not necessarily result in a "lowest common denominator" application but can benefit everyone. Let us consider the example of DataMap once again. The Java version of DataMap loaded and ran quickly enough on standard PCs and broadband connections but - as with other interactive map tools - would take minutes to download with a 56K modem and could not maintain the interactivity needed for dynamic queries (i.e., 10 ms feedback) on low-end PCs. Traditionally, interactive maps use vector graphics to draw the maps which means downloading the vector data and the software to interpret it. Instead, we created a new version of DataMap that encoded geographic knowledge into raster images quickly delivered to the client (Zhao et al., 2003). Algorithms were devised to perform sub-second dynamic query, panning and zooming, with no or minimum server support. This technique leads to download times that were often counted in seconds instead of minutes for modem users, being between 5 and 10 times shorter that those experienced with Web GIS approaches that are based on vector geographic data, while
Information Visualization and the Challenge of Universal Usability
69
keeping the needed interactivity. The client-side was also implemented as light-weight Java applets to avoid version problems. This example illustrates that it is possible to find technological advances that benefit general public users with slow modem network connections and low-end machines, as well as users with fast T-1 connections and fast machines, therefore advancing the goals of Universal Usability.
3.3.4
Addressing the needs of users with visual impairments
Color blindness Color impairment is a very common condition that should not be overlooked (Rosenthal and Phillips, 1997; Olson and Brewer, 1997) This problem can more easily be addressed by limiting the use of color, using double encoding when appropriate (for example, by using symbols that vary in both shape and color), providing alternative color palettes to choose from, or allowing users to customize the colors themselves. For example the Mapof-the-Market illustrated in Figure 3.4 provides two choices of color schemes: red-green and blue-yellow. Various tools are available to both simulate color vision impairments and to optimize graphics for some of the various forms of color impairment that exist, including Vischeck (Dougherty and Wade, 2002). ColorBrewer (Brewer and Harrower, 2002) offers guidelines on color schemes that work for those with color vision impairment.
Low Vision and blindness Approximately four million people in the US are blind or visually impaired and it is a requirement for government-provided services to address this population (Vanderheiden, 2000; Muntz et al., 2003). Traditional accommodations to blind and vision-impaired users include the use of speech synthesizers as screen reader, and/or Braille to convey the text information on the display. However, speech-based approaches are very weak at representing 2D spatial layout in the graphical user interface. This is a challenge for maps as well as most other Information Visualization techniques. For navigation in the real world, GPS-based talking maps have been developed (Golledge et al., 1991a,b). One example product is a talking nationwide digital map consisting of most addresses and street intersections (The Sendero Group, 2003). Users can navigate the map using the arrow keys and listen to speech-synthesized descriptions of the map and directions. Trekker (VisuAide, 2003) is another GPS-based application that helps the blind to navigate. Maps are also important to learn an area beforehand and chose a route. Schneider and Strothotte (2000) have designed a tangible interface using physical building blocks that users manipulate to promote constructive exploration of the map. When using maps to learn Geography or discover spatial patterns in data, people with limited vision can use screen magnifiers (for instance, try the "magnifier" available from the Start menu of MS Windows, in the accessibility accessories), but those with severe vision impairments have to rely on tactile maps or atlases (Imperatore, 1992) as shown in Figure 3.10 or sonification of the maps.
70
C. Plaisant
Figure 3.10. A traditional tactile atlas showing a map of Canada. Reproduced with permission of Natural Resources Canada and the Canadian Government.
Current assistive technology research is exploring a number of promising techniques to help blind users benefit from the spatial awareness provided by maps. The first step is to provide data in both visual and descriptive form. OptiMaps (Corda Technologies Inc., 2003), employs a small "d" character below each choropleth map. This is the standard accessibility mark for image "descriptions" that visually impaired users are able to search for. These provide hyperlinks to a textual version of the data, generated automatically with the dynamic map. Examples are available in AtlasPlus (National Cancer Institute, 2003). New vector graphic file formats, such as SVG, permit embedding text descriptions with the graphic information and should simplify this process as a result. Unfortunately reading the data values still does not give an adequate feeling for the spatial relationships between areas that only spatial techniques can provide. Tactile and haptic techniques (and strategies for signifying data haptically) have been devised (Griffin, 2002). Virtual Touch provides an example of map exploration using a tactile mouse. The mouse is equipped with two Braille character mechanical units, which can be used to indicate tactile patterns (using Braille and other alternatives), as shown in Figure 3.11. As users explore the map, the patterns change over different
Information Visualization and the Challenge of Universal Usability
71
Figure 3.11. The VTPlayer is a mouse equipped with two Braille character units that can also be used to indicate patterns. For example, as users explore a map of the US, patterns change over different states (VirTouch Ltd, 2002). Reproduced with permission of VirTouch Ltd.
states or areas. One of the limitations of the mouse is that it is an input device providing only relative positioning so absolute position on the map has to be provided by audio feedback. Another example developed by TouchGraphics and their research colleagues (Landau and Gourgey, 2001) augments standard printed tactile maps. Maps are secured on top of a touch screen that provides the location of each touch (Figure 3.12). The TouchGraphics Atlas has five operational modes. Users can simply explore by touching a physical tactile map and hear names of places touched. They select a destination from an index, and listen to directions that are updated as a user's finger gets closer to the destination. Distance between two points can be calculated, and descriptions of the areas can be listened to. This work was inspired by Nomad (Parkes, 1994). 3D maps can benefit from the use of haptic devices. For example, the Phantom device provides 6 degrees of freedom input and 3 degrees of freedom output to explore the virtual sound space and augment it with haptic feedback providing the same sensation as moving a single finger over a physical 3D map. Tactile maps can be augmented with abstract audio output (Fisher, 1994; Krygier, 1994). For example, users can hear a series of graduated pitches proportional to elevations above sea level as they explore the map. Sonification alone has been demonstrated to be effective in giving blind users access to graphs (Ramloll et al., 2001) or, in some limited fashion, entire desktops (Mynatt and Edwards, 1992). In the case of maps, Jeong and Gluck (2002) compared the effectiveness of and preferences for using auditory feedback (volume of sound), haptic feedback (extent of vibration) or both in the tasks of identifying the highest or the middle valued state on a static choropleth map of the US. The experiment showed that overall performance is most successful when using haptic feedback alone but users prefer having both haptic and audio feedback. This result may be attributed to the fact that haptic devices provided spatial cues while the standard sound output does not. Unfortunately tactile and haptic techniques require special hardware, from embossed maps to specialized input devices, and hardware is usually
72
C. Plaisant
Figure 3.12. An example of tactile map augmented with audio description when mounted on a touch screen (Touch Graphics, undated). (a) Sample map plate; (b) the sample map plate in use with the talking tactile tablet (TTT). Reproduced with permission of Touch Graphics.
a limiting factor for wide dissemination, as users may not have access to the technology or the financial means to purchase it. Techniques relying solely on sonification have the potential to be used by a larger population as blind users, who often already rely on headphones when using screen readers.
Information Visualization and the Challenge of Universal Usability
73
The BATS project at the University of North Carolina (Parente and Bishop, 2003) uses simple spatial audio (mostly stereo effects) to sonify maps as shown in Figure 3.13. Real world auditory icons are played as the user moves the cursor over the map. For example, car noises are heard over cities and birds and crashing waves are heard over forests and beaches. The sound becomes louder as the user gets close to the source of the sound. Interactivity and immediate feedback provides a pleasant exploration experience and helps blind users explore the map and locate objects. A promising direction for the sonification of spatial information is the use of spatial audio using a head-related transfer function (HRTF) (Shinn-Cunningham et al., 1997). Since humans are usually able to localize sound with amazing precision by using binaural perception, spatial location can be an important aspect of information perception. It is possible that the addition of positional cues will greatly improve the sonification of maps. Stereo effects allow right-left sound separation only, while spatial audio provides up and down cues, and in a less reliable manner front and back information. CAVE-like virtual environments provide such spatial sound with sets of multiple loud-speakers (Pape, 1998; see Bodum, this volume (Chapter 19). But synthesized spatial audio allows users to experience 3D audio with ordinary headsets. Until recently this had been limited to high-performance computing environments but researchers are now able
North Carolina
C ~ ' e m merit ~ n d 1
Ci~' Sprawl (~her S~tes
....................~ u : n b , ~ e r ---
State Border
Figure 3.13. The BATS sonic map helps those without sight to explore spatial information (Parente and Bishop, 2003). Real world audio icons (car noises, wave crashing, etc.) are played as the user navigates the map and appear clearly as coming from your right or your left. Volume increases as users get closer to the source of the sound. Reproduced with permission of the authors.
74
C. Plaisant
Figure 3.14. Spatial audio allows users to hear the location of virtual sound sources. This schematic represents what a user might hear as each US state "plays" its statistics, for example a sound whose pitch is proportional to its African-American population. Proper linearization of sounds allow users to hear patterns of low to high values moving from the northern states to the lower Mississippi area.
to synthesize high-quality 3D sound in real-time on commercial off-the-shelf PCs (Zotkin et al., 2002). We are currently exploring its use for the sonification of maps. Nevertheless, the spatial effects - if noticeable - remain fairly weak and our research at the University of Maryland seeks to combine spatial effects with standard sonification techniques such as those using pitch or tone variations to reinforce the perception of the spatial information. Imagine being in the center of a virtual room with a large US state map hanging from the ceiling and wrapping around you as shown in Figure 3.14. Now imagine that each state on the map "plays" a sound indicating the value of a particular statistics for each state. Because spatial audio is helpful to separate different sounds played together, users can make sense of the location of the states with high, medium and low values. Sonification might also be useful for non-disabled users for monitoring tasks or to represent areas too small to be shown on the map. For example, The District of Columbia is often too small to be visible on US state maps but will be heard in an audio map.
3.4
Conclusions
Information Visualization allows designers to present a large amount of information using abstract representations. Geographic and scientific visualization applications
Information Visualization and the Challenge of Universal Usability
75
usually use representations determined by the nature of the data being displayed. Location within the graphic is usually used to represent location in space. For example in 2D maps, a projection of space structures the representation, whilst in 3D models of the body or of physical processes such as meteorological predictions graphics are constrained by a 3D locational framework. On the other hand, Information Visualization allows designers to choose among a palette of possible representations that fill space in a variety of ways, such as hierarchies, time lines, networks, tabular displays and the like, to produce information abundant displays. Choosing the appropriate representation(s) is challenging and research is needed to evaluate and compare different approaches. User studies are critical to judge the relative merits of different representations. Tightly coupled displays and highly interactive interfaces using the Zoom, Filter and Detail on Demand principles are needed to allow users to rapidly explore alternative views of the data in a matter of seconds to answer instant queries. Advanced interfaces also need to address the longer term process of analysis that may require annotation, history keeping, collaboration with peers, and the dissemination of results and procedures used. Faster rendering algorithms, sophisticated aggregations techniques to deal with large datasets, and novel labeling techniques are also needed, and along with careful studies of users and their needs will lead to successful visualization applications. Many of these, and related issues are addressed in the following chapters by researchers from a number of related fields. Information Visualization is becoming increasingly accessible to the general public and attention should be given to the goal of universal usability by enabling the widest range of users to benefit from the applications we develop. Universal usability remains a formidable challenge as we just begin to address the needs of users with slow modems, small screens, or wireless devices. Translation to other languages, access for novice, low education and low motivation users, children and elders all present special difficulties, and users with visual impairments often remain the "forgotten users" of Information Visualization. Tactile solutions are promising for blind users but sonification might provide wider access to map information, as it does not require specialized hardware.
Acknowledgements The content of this chapter was inspired in part by Ben Shneiderman's many writings on Information Visualization and Universal Usability, and also by papers co-authored with Haixia Zhao, Hyunmo Kang and other members of the Human-Computer Interaction Laboratory. Some of the work presented was funded by the National Science Foundation under Grant No. EIA 0129978 and the US Census Bureau. I also thank the editors of the book for their careful and extensive editing of the chapter
References Ahlberg, C., Williamson, C., and Shneiderman, B., (1992) "Dynamic queries for information exploration: an implementation and evaluation", Proceedings A CM CHI '92: Human Factors in Computing Systems. New York: ACM, pp. 619-626.
76
C. Plaisant
Andrienko and Andrienko (1999a). Seasonal Migration of White Storks, 1998-1999. Online: http://www.ais.fhg.de/and/java/birds/(23/10/03). Andrienko, G., and Andrienko, N., (1999b) "GIS visualization support to the C4.5 classification algorithm of KDD", Proceedings of the 19th International Cartographic Conference, pp. 747-755. Andrienko, G., and Andrienko, N., (1999c) "Knowledge-based visualization to support spatial data mining", Proceedings of Intelligent Data Analysis. Berlin: Springer Verlag, pp. 149-160. Andrienko, G., and Andrienko, N., (1999d) "Making a GIS intelligent: CommonGIS project view", AGILE'99 Conference, Rome, April 15-17, pp. 19-24. Andrienko, G. and Andrienko, N., (1999e) Seasonal Migration of White Storks, 1998-1999. Online: http://www.ais.fhg.de/and/java/birds/(03/10/02). Andrienko, G. L., and Andrienko, N. V., (1999f) "Interactive maps for visual data exploration", International Journal Geographic Information Science, 13(4), 355-374. Andrienko, N., Andrienko, G., Voss, H., Bernardo, F., Hipolito, J., and Kretchmer, U., (2002) "Testing the usability of interactive maps in CommonGIS", Cartographic and Geographic Information Science, 29(4), 325-342. Becker, R. A., and Cleveland, W. S., (1987) "Brushing scatterplots", Technometrics, 29(2), 127-142. Bederson, B., (1994) "Pad+ +: advances in multiscale interfaces", Proceedings Human Factors in Computing Systems CHI '94 Conference, Boston, MA, p. 315. Bederson, B., and Shneiderman, B., (2003) The Craft of Information Visualization: Readings and Reflections. San Francisco: Morgan Kaufman. Bederson, B. B., Meyer, J., and Good, L., (2000) "Jazz: an extensible zoomable user interface graphics ToolKit in Java, UIST 2000, ACM symposium on user interface software and technology", CHI Letters, 2(2), 171-180. Bederson, B. B., Shneiderman, B., and Wattenberg, M., (2002) "Ordered and Quantum treemaps: making effective use of 2D space to display hierarchies", A CM Transactions on Graphics (TOG), 21(4), 833-854 (Oct. 2002). Brewer, C. and Harrower, M., (2002) ColorBrewer - Selecting Good Color Schemes for Maps. Online: http://www.personal.psu.edu/faculty/c/a/cab38/ColorBrewerBeta.html (23/10/03). Card, S. K., Mackinlay, J. D., and Shneiderman, B., (eds.), (1999) Readings in Information Visualization: Using Vision to Think. San Francisco: Morgan Kaufmann Publishers. Carlis, J., and Konstan, J., (1998) "Interactive visualization of serial periodic data", Proceedings of User Interface Software and Technology. New York: ACM, pp. 29-38. Chen, C., (1999) Information Visualisation and Virtual Environments. Berlin: Springer Verlag. Chen, C., and Czerwinski, M., (2000) "Introduction to the special issue on empirical evaluation of Information Visualizations", International Journal of HumanComputer Studies, 53(5), 631-635 (Nov. 2000).
Information Visualization and the Challenge of Universal Usability
77
Cleveland, W. S., (1994) The Elements of Graphing Data: Revised Edition. Boca Raton, FL: CRC Press. Cockburn, A., and McKenzie, B., (2002) "Evaluating the effectiveness of spatial memory in 2D and 3D physical and virtual environments", Proceedings ACM CHI 2002 Conference on Human Factors in Computing Systems. New York: ACM Press, pp. 203-210. Corda Technologies Inc., (2003) Corda Products Optimap 5. Online: http ://www.corda.com/products/optimap/(23/10/03). Dang, G., North, C., and Shneiderman, B., (2001) "Dynamic queries and brushing on choropleth maps", Proceedings International Conference on Information Visualization. Piscataway, NJ.: IEEE Press, pp. 757-764. DiBiase, D., MacEachren, A. M., Krygier, J. B., and Reeves, C., (1992) "Animation and the role of map design in scientific visualization", Cartography and Geographic Information Systems, 19(4), 201-214, see also pp. 265-266. Dorling, D., (1992) "Stretching space and splicing time: from cartographic animation to interactive visualization", Cartography and Geographic Information Systems, 19(4), 215-227, see also pp. 267-270. Dougherty, R. and Wade, A., (2002) Vischeck. Online: http://www.vischeck.com/(23/ 10/03). Dumas, J. S., and Redish, J. C., (1999) A Practical Guide to Usability Testing. Exeter: Intellect Books, p. 404. Eick, S., Steffen, J., and Sumner, E., (1992) "SeeSoft~a tool for visualizing line-oriented software statistics", IEEE Transactions on Software Engineering, 18(11), 957-968. Fekete, J.-D., and Plaisant, C., (1999) "Excentric labeling: dynamic neighborhood labeling for data visualization", Proceedings of ACM Conference on Human Factors in Computing Systems, CH! '99. New York: ACM Press, pp. 512-519. Fekete, J., and Plaisant, C., (2002) "Interactive Information Visualization of a million items", Proceedings of IEEE Conference on Information Visualization, Boston, Sept. 2002, pp. 117-124. Fisher, P., (1994) "Hearing the reliability in classified remotely sensed images", Cartography and Geographic Information Systems, 21 (1), 31-36. Friendly, M., (1994) "Mosaic displays for multi-way contingency tables", Journal of the American Statistical Association, 89(425), 190-200. Furnas, G. W., (1986) "Generalized fisheye views", Proceedings CHI'86 Conference: Human Factors in Computing Systems. New York: ACM Press, pp. 16-23. Gahegan, M., Takatsuka, M., Wheeler, M., and Hardisty, F., (2002a) "GeoVISTA Studio: a geocomputational workbench, Computers", Environment and Urban Systems, 26, 267-292. Gahegan, M., Takatsuka, M., Wheeler, M., and Hardisty, F., (2002b) "Introducing GeoVISTA Studio: an integrated suite of visualization and computational methods for exploration and knowledge construction in geography", Computers, Environment and Urban Systems, 26(4), 267-292. Golledge, R. G., (1991) "Tactual strip maps as navigational aids", Journal of Blindness and Vision Impairment, 85(7), 296-301.
78
C. Plaisant
Golledge, R. G., Loomis, J. M., Klatzky, R. L., Flury, A., and Yang, X. L., (1991) "Designing a personal guidance system to aid navigation without sight: progress on the GIS component", International Journal of Geographical Information Systems, 5(4), 373-395. Griffin, A., (2002) "Feeling it out: the use of haptic visualization for exploratory geographic analysis", Cartographic Perspectives, 39, 12-29. Grosjean, J., Plaisant, C. and Bederson, B., (2002) SpaceTree. Online: http://www.cs.umd.edu/hcil/spacetree (23/10/03). Imperatore, W., (1992) The Braille World Atlas. Louisville, Kentucky: American Printing House for the Blind, Inc. Inselberg, A., (1985) "The plane with parallel coordinates", The Visual Computer, 1, 69-91. Inselberg, A., (1997) "Multidimensional detective", Proceedings of lEEE Symposium on Information Visualization (InfoVis '97), Phoenix, AZ, Oct. 1997, pp. 100-107. Inxight Software Inc., (2002) Inxight Software - Unstructured Data Management Solutions. Online: http://www.inxight.com (23/10/03). Jeong, W., and Gluck, M., (2002) "Multimodal bivariate thematic maps with auditory and haptic display", Proceedings of 2002 International Conference on Auditory Display, Kyoto, Japan, pp. 1-4. Johnson, B., and Shneiderman, B., (1991) "Tree-maps: a space-filling approach to the visualization of hierarchical information structures", Proceedings IEEE Visualization '91. Piscataway, NJ: IEEE, pp. 284-291. Keim, D. A., (2001) "Visual exploration of large data sets", Communications of the ACM, 44(8), 38-44. Keim, D. A., and Kriegel, H.-P., (1994) "Database exploration using multidimensional visualization", Computer Graphics & Applications, 6, 40-49, (September 1994). Kraak, M. J., (undated) Minard - What has Been Done by ITC? Online: http://www.itc.nl/personal/kraak/1812/minard-itc.htm (23/10/03). Kraak, M. J., (1989) "Computer-assisted cartographic three-dimensional imaging techniques", In: Raper, J., (ed.), Three Dimensional Applications in Geographical Information Systems. London: Taylor & Francis, pp. 99-114. Kraak, M. J., and MacEachren, A. M., (1994) "Visualization of the temporal component of spatial data", In: Waugh, T., and Healey, R., (eds.), Proceedings of the Sixth International Symposium on Spatial Data Handling, Advances in GIS Research, Edinburgh, Scotland, pp. 391-409. Krygier, J., (1994) "Sound and geographic visualization", In: MacEachren, A. M., and Taylor, D. R. F., (eds.), Visualization in Modern Cartography. Oxford, UK: Pergamon, pp. 146-166. Kuniavsky, M., (2003) Observing the User Experience: A Practitioner's Guide to User Research. San Francisco: Morgan Kaufmann. Kwan, M. P., (2000) "Interactive geovisualization of activity-travel patterns using 3D geographical information systems: a methodological exploration with a large data set", Transportation Research Part C-Emerging Technologies, 8(1-6), 185-203.
Information Visualization and the Challenge of Universal Usability
79
Lamping, J., Rao, R., and Pirolli, P., (1995) "A focus + context technique based on hyperbolic geometry for visualizing large hierarchies", Proceedings of CHI '95 Human Factors in Computing Systems, Denver, CO, May 1995. New York: ACM Press, pp. 401-408. Landau, S., and Gourgey, K., (2001) "Development of a talking tactile tablet", Information Technology and Disabilities, VII(2). Lindwarm, D., Rose, A., Plaisant, C., and Norman, K., (1998) "Viewing personal history records: a comparison of tabular format and graphical presentation using LifeLines", Behaviour & Information Technology, 17(6), 249-262. MacEachren, A. M., Dai, X., Hardisty, F., Guo, D., and Lengerich, G., (2003a) "Exploring high-D spaces with multiform matrices and small multiples", IEEE Symposium on Information Visualization, Seattle, pp. 31-38. MacEachren, A. M., Hardisty, F., Dai, X., and Pickle, L., (2003b) "Geospatial statistics supporting visual analysis of federal GeoSpatial statistics", Digital Government Table of Contents, pp. 59-60. Muntz, R. R., Barclay, T., Dozier, J., Faloutsos, C., MacEachren, A. M., Martin, J. L., Pancake, C. M., and Satyanarayanan, M., (2003) "IT roadmap to a geospatial future", Report of the Committee on Intersections Between Geospatial Information and Information Technology. Washington, DC: National Academy of Sciences. Mynatt, E., and Edwards, K., (1992) "Mapping GUIs to auditory interfaces", Proceedings of the 5th Annual A CM Symposium on User Interface Software and Technology. New York: ACM Press, pp. 61-70. N Space Labs Inc., (2003) incMapTM: Geographic Map of the Market. Online: http://www.nspacelabs.com/(23/10/03). National Cancer Institute, (2003) Cancer Mortality Maps and Graphs. Online: http://www3.cancer.gov/atlasplus/(23/10/03). Nielson, G. M., Hagen, H., and Mueller, H., (1997) Scientific Visualization: Overviews, Methodologies, Techniques. Piscataway, NJ: IEEE Computer Society. North, C., Conklin, N., and Saini, V., (2002) "Visualization schemas for flexible Information Visualization", Proceedings of InfoVis 2002, pp. 15-22. Olson, J., and Brewer, C. A., (1997) "An evaluation of color selections to accommodate maps users with color-vision impairments", Annals of the Association of American Geographers, 87(1), 103-134. OmniViz Inc., (2003) Omniviz. Online: http://www.omniviz.com (23/10/03). Pape, D., (1998), "Crayoland". In: SIGGRAPH Video Review, Issue 127/SIGGRAPH '98 Electronic Art and Animation Catalog CD-ROM. Orlando, FL: ACM. Online: http://www.evl.uic.edu/pape/projects/crayoland. Parente, P., and Bishop, G., (2003) "BATS: the blind audio tactile mapping system", Proceedings of ACM South Eastern Conference, Savannah, GA, http://www.cs.unc.edu/Research/assist/bats/history.shtml (Mar. 2003). Parkes, D., (1994) "Audio tactile systems for designing and learning complex environments as a vision impaired person: static and dynamic spatial information access", In: Steele, J., and Hedberg, J. G., (eds.), Learning Environment Technology: Selected Papers from LETA 94. Canberra, AJET Publications, pp. 219-223.
80
C. Plaisant
Perlin, K., and Fox, D., (1993) "Pad: an alternative approach to the computer interface", In: Kajiya, J. T., (ed.), Proceedings of the 20th Annual A CM Conference on Computer Graphics (SIGGRAPH '93), Aug. 2-6, Anaheim, CA. New York: ACM Press, pp. 57-64. Pickle, L., (2003) "Usability testing of map designs", Proceedings of Interface 2003. Alexandria, VA: ASA. Plaisant, C., (1993) "Facilitating data exploration: dynamic queries on a health statistics map", Proceedings of the Annual Meeting of the American Statistical Association of the Government Statistics Section, San Francisco, CA, Aug 18-23. Alexandria, VA: ASA pp. 18-23. Plaisant, C., Rose, A., Milash, B., Widoff, S., and Shneiderman, B., (1996) "LifeLines: visualizing personal histories", Proceedings of CHI '96 Conference: Human Factors in Computing Systems. New York: ACM, pp. 221-227, 518. Plaisant, C., Grosjean, J., and Bederson, B., (2002) "SpaceTree: supporting exploration in large node link tree, design evolution and empirical evaluation", Proceedings of IEEE Conference on Information Visualization, pp. 57-64. Plaisant, C., Kang, H., and Shneiderman, B., (2003) "Helping users get started with visual interfaces: multi-layered interfaces, integrated initial guidance and video demonstrations", Proceedings of Human-Computer Interaction International 2003, Crete, June 2003, pp. 790-794. Preece, J., Rogers, Y., and Sharp, H., (2002) Interaction Design: Beyond HumanComputer Interaction. New York: Wiley. Ramloll, R., Brewster, S., Yu, Y., and Riedel, B., (2001) "Using non-speech sounds to improve access to 2D tabular numerical information for visually impaired users", Proceedings 15th British HCI Group Annual Conference on Human-Computer Interaction (IHMHCI), Lille, France, Sept. 10-14. Rao, R., and Card, S. K., (1994) "The table lens: merging graphical and symbolic representation in an interactive focus + context visualization for tabular information", Proceedings Human Factors in Computing Systems CHI '94 Conference, Boston, MA. New York: ACM, pp. 318-322. Rosenthal, O., and Phillips, R., (1997) Coping With Color-Blindness. New York: Avery Publishing Group. Schneider, J., and Strothotte, T., (2000) "Constructive exploration of spatial information by blind users", Proceedings of the A CM Conference on Assistive Technologies, ASSETS 2000. New York: ACM, pp. 188-192. Shinn-Cunningham, B. G., Lehnert, H., Kramer, G., Wenzel, E. M., and Durlach, N. I., (1997) "Auditory displays", In: Gilkey, R., and Anderson, T., (eds.), Binaural and Spatial Hearing in Real and Virtual Environments. New York: Erlbaum, pp. 611-663. Shneiderman, B., (1997) Designing the User Interface - Strategies for Effective HumanComputer Interaction. Reading: Addison-Wesley Publishing Company, p. 639. Shneiderman, (1998) Treemaps for Space-Constrained Visualization of Hierarchies. Online: http ://www.cs.umd.edu/hcil/treemaps (23/10/03). Shneiderman, B., (2000) "Universal usability: pushing human-computer interaction research to empower every citizen", CACM, 23(5), 84-91.
Information Visualization and the Challenge of Universal Usability
81
Shneiderman, B., (2001) "Supporting creativity with advanced information-abundant user interfaces", In: Earnshaw, R., Guedj, R., Van Dam, A., and Vince, J., (eds.), Human-Centred Computing, Online Communities, and Virtual Environments. London: Springer-Verlag, pp. 469-480. Shneiderman, B., and Hochheiser, H., (2001) "Universal usability as a stimulus to advanced interface design", Behaviour&Information Technology, 20(5), 367-376, Online: http ://www.otal.umd.edbu/uupracticechen SmartMoney.com, (2003) Smartmoney.com - Investing, Saving and Personal Finance. Online: http://www.smartmoney.com (23/10/03). Spence, R., (2001) Information Visualization. Harlow: Addison Wesley/ACM Press Books, 206 pp. Szego, J., (1987) Human Cartography: Mapping the Worm of Man. Stockholm: Almqvist & Wiksell International, p. 236. The Hive Group Inc., (2003) The Hive Group - Creators of Honeycomb Technology. Online: http://www.hivegroup.com (23/10/03). The Sendero Group, (2003) Sendero Group Homepage - GPS for the blind. Online: http://www.senderogroup.com Theus, M., (2002a) "Geographical Information Systems", In: Kloesgen, W., and Zytkow, J., (eds.), Handbook of Data Mining and Knowledge Discovery. Oxford: Oxford University Press. Theus, M., (2002b) "Interactive data visualization using Mondrian", Journal of Statistical Software, 7(11). Tufte, E. R., (1983) The Visual Display of Quantitative Information. Cheshire, CT: Graphics Press, p. 197. Tweedie, L., Spence, R., Dawkes, H., and Su, H., (1996) "Externalising abstract mathematical models", In: Bilger, R., Guest, S., and Tauber, M. J., (eds.), CHI '96: Conference on Human Factors in Computing Systems, Vancouver, BC, ACM/ SIGCHI, Online: http://www.acm.org/sigs/sigchi/chi96/proceedings/papers/Tweedie/lt 1txt.htm Vanderheiden, G., (2000) "Fundamental principles and priority setting for universal usability", Proceedings A CM Conference on Universal Usability 2000. New York: ACM, pp. 32-38. VirTouch Ltd., (2002) Innovative Tactile Solutions for PC Users Who Are Blind. Online: http://www.virtouch.com/(23/10/03). VisuAide, (2003) GPS Orientation Solutions - Trekker. Online: http://www.visuaide.com/gpssol.html (23/10/03). Ware, C., (2000) Information Visualization: Perception for Design. San Francisco: Morgan Kaufmann Publishers, p. 384. Weibel, R., and Jones, C. B., (1998) "Computational perspectives on map generalization", Geoinformatica, 2(4), 307-314. Williamson, C., and Shneiderman, B., (1992) "The dynamic home finder: evaluating dynamic queries in a real-estate information exploration system", Proceedings of the ACM SIGIR'92 Conference. New York: ACM, pp. 338-346.
82
C. Plaisant
Wise, T. A., Thomas, J. J., Pennock, K., Lantrip, D., Pottier, M., Schur, A., and Crow, V., (1995) "Visualizing the non-visual: spatial analysis and interaction with information from text documents", Proceedings IEEE Information Visualization '95, Los Alamitos, CA. Piscataway, NJ: IEEE Computer Press, pp. 51-58. Woodruff, A., Landay, J., and Stonebreaker, M., (1998) "Constant information density in zoomable interfaces", Proceedings of the 4th International Working Conference on Advanced Visual Interfaces A VI '98, L'Aquila, Italy, May 24-27, pp. 110-119. Zhao, H., Plaisant, C., and Shneiderman, B., (2003) "Improving accessibility and usability of geo-referenced statistical data", Proceedings 2003 National Conference on Digital Government Research, Online: http://www.dgrc.org/dgo2003 Zotkin, D. N., Duraiswami, R., and Davis, L. S., (2002) "Creation of virtual auditory spaces", Proceedings International Conference on Acoustic Speech and Signal Processing, Orlando, FL, May 2002, pp. 2113-2116.
Exploring Geovisualization J. Dykes, A.M. MacEachren, M.-J. Kraak (Editors) 9 2005 Published by Elsevier Ltd. All rights reserved.
Chapter 4
Beyond Tools: Visual Support for the Entire Process of GIScience Mark Gahegan, GeoVISTA Center, Department of Geography, The Pennsylvania State University, University Park, PA 16802, USA
Keywords: geovisualization, GIScience, semantics, inference, science, activities, reasoning, visual support
Abstract Progress to date within the geovisualization research community has led to some very useful, innovative tools and systems. However, these tools are typically neither easy to integrate or use together, nor is it always clear what scientific activities they help to facilitate. In order to bring visualization tools to the fore, we must understand clearly what roles they play within the entire process of scientific investigation, including the various tasks that a researcher might undertake and the different kinds of reasoning that we wish visualization to support or enable. This chapter presents an overview of the science process, gives examples of how current approaches to visualization support certain research activities and suggests a framework by which additional aspects of: (i) science activity, (ii) reasoning mode (inference), (iii) outcomes, and (iv) pre-requisite data and knowledge could be used to better define the role or roles that different visualization tools can play, and also in how such tools might be better connected or integrated together. The chapter ends by summarizing the research challenges that follow from a more semantic, process-oriented approach to the use and integration of geovisualization tools.
4.1
Introduction
Consider, if you will, the entirety of the process of "doing" GIScience, perhaps starting by exploring an unfamiliar dataset and discovering emergent patterns - through knowledge construction where these patterns are formed into the building-blocks of analysis: concepts, relationships and instances - then onto analysis where models are constructed from these building blocks to make predictions or descriptions - these models are then evaluated to test their integrity and accuracy - and finally results are reported by way of maps, images, numbers or words. This is just a single example of 83
84
M. Gahegan
Figure 4.1. The nexus of activities comprising the scientific process (Gahegan and Brodaric,
2002a,b).
a path through the nexus 1 of activities that is defined by the geo-scientific process and as later figures show, many more such paths are equally valid. Clearly, the process itself is very complex, with myriad connections and relationships between the various activities. For example, emergent concepts that at first appear useful when exploring the data may turn out to be too difficult to categorize, may fail to provide insightful results during analysis or may be problematic to understand or communicate. So at any stage, they might be abandoned, requiring the analyst to revisit exploration or synthesis. Despite the inherent complexities, there is a mature understanding of the process of science viewed from both the perspective of the philosophy of science (Peirce, 1891; Popper, 1959; Thagard, 1988; Shrager and Langley, 1990; Sowa, 1999) and of the practicing GIScience and earth science community (Schumm, 1991; Baker, 1996; Martin, 1998). The contention presented here is that visualization can, and should, support the entire geoscientific process. But how might this goal be best achieved?
4.2
Current Geovisualization Tools: Some Pros and Cons
Now, ponder for a moment the increasing number of visualization and analysis techniques and tools available and the tasks they enable researchers to carry out. On the surface, many of these appear to have clear purposes or roles, defined by our experiences of using the tool or technique or seeing others use it, or inferred from a theoretical understanding gained from relevant articles and documentation, or even from the name alone (c.f. IBM's Data Explorer). At a finer level of detail, however, it may not be clear exactly what activities (in Figure 4.1) they can or cannot support, how well they can support these activities, and what biases they will impose on the investigation. l Nexus used in the sense described by Alfred North Whitehead in Adventures of Ideas (Whitehead, 1938).
Beyond Tools: Visual Support for the Entire Process of GIScience
85
By contrast, such information is often readily available for many kinds of statistical procedures. There are many excellent examples of tools that address specific activities in the social scientific process (for examples see the lists of resources held by the Center for Spatially Integrated Social Science - CSISS, 2003) and the Teaching Resources and Materials for Social Scientists (Wiggins et al., 2000). Concerning visualization specifically, many tools and systems have been developed that allow the same data to be viewed in a variety of displays, with a high degree of interactivity between the displays, often called "linking and brushing" (Monmonier, 1990a,b; MacDougal, 1992; Cook et al., 1996; Dykes, 1996; Andfienko and Andrienko, 1999; Gahegan et al., 2002a,b). However, the tools we currently have are, by and large, hosted in closed systems that cannot easily be modified or integrated with each other, and specifically where there is little or no thought to the positioning or integrating of tools into the wider scientific process shown above such that the investigator can move seamlessly from one tool to another, back and forth, as activities dictate. From the perspective of the academic community, this is, in part, a consequence of the fact that academics typically build tools to test and present ideas, rather than to become fully operational within a community, and the most effective way to build such tools is to close as many aspects of the system as possible, then there is less to build. From the commercial perspective, open systems carry the threat of a potential loss of market share, and again they are more problematic to develop. Furthermore, to date there is little to guide the investigator in selecting the right tool(s) for the task(s) at hand from those available, nor any way to feed back evidence of success (or failure) when particular tools are used for a specific task. This is nobody's fault, p e r se, but a consequence of many isolated research efforts that focus on pioneering specific techniques. What is required as geovisualization develops is a broader vision by which relevant tools and techniques might be orchestrated into something greater than the sum of their parts. This vision is likely to include perspectives from other disciplines and may continue to incorporate techniques and knowledge from cognate fields with expertise in visualization. Another problem with our current geovisualization tools is that they typically are focused only on the data, and not on conceptual structures such as categories or relationships that operate at a higher level of abstraction. Therefore, while they provide good support for data exploration they are less useful for synthesis activities, where concepts are constructed, or for analysis, where concepts are operationalized. To better support the entire science process, we must provide mechanisms that can visualize the connections between the various stages of analysis, and show how concepts relate to data, how models relate to concepts, and so forth. Returning to Figure 4.1, consider the substance of the links between the various scientific activities, specifically what are the inputs and outcomes that transform one stage to another? Considering just the transitions between exploration and synthesis stages, how might the mapping between data exploration and concept synthesis be visualized? During the early stages of an investigation, an analyst might recognize emergent structures in the data and synthesize these into concepts for use in analytical models. But how might this synthesis be signified so that it too can be explored?
86
M. Gahegan
We need to better understand the interfaces between science activities for two reasons. Firstly, from a theoretical perspective, such understanding will help us to gain a deeper appreciation of the investigative processes used by scientists, and hence increase understanding of how early decisions regarding the data used and the concepts synthesized will affect the outcomes of later analysis models. Secondly, and from a practical perspective, these linkages define interface specifications by which visualization tools can exchange relevant information with each other as the user switches focus between activities. New approaches to visualization are needed that can cross these "bridges of abstraction" that we mentally construct between the science activities in Figure 4.1. Some possible approaches are given by MacEachren et al. (1999a-c), Gahegan and Brodaric (2002b), Lucieer and Kraak (2002), and some examples are provided in w following a more detailed account of GIScience activities.
4.3
A More Detailed Look at the Activities of GIScience
Returning to the process of science, Figure 4.2 adds examples of conceptual structures (light grey) and concretized representations (dark grey) linking the various stages of the nexus shown in Figure 4.1. The figure shows one plausible path (selected from
Figure 4.2. A plausible path around the core scientific activities introduced in Figure 4.1. See text for details.
Beyond Tools: Visual Support for the Entire Process of GIScience
87
many possibilities) linking these core scientific activities, beginning with exploration and ending with the production of a map of categories synthesized from the data. The path might exemplify the building of a map-based representation and understanding of some phenomenon such as the degree of demographic change occurring between two census surveys (where such change is undefined at the outset, but emerges from the analyst's interactions with the data), or of producing a geological or detailed land cover map of an unexplored region. Dark grey ovals represent tangible inputs or outcomes, light grey ovals represent intangible knowledge and expertise provided by the analyst and medium grey rectangles are activities from Figure 4.1. The block arrows show the general directional trend, but the analyst may of course move back and forth between activities as revision takes place. For example, if a researcher is studying land cover mapping and is trying to synthesize useful categories for indicating a range of different species or ground conditions, then current tools can help them understand the general patterns and outliers in remote sensing and ancillary datasets, and via linking and brushing the trends in scatter plots can be explored spatially in a map, and visa versa. But usually, when the categories or indicators are formed, their connection to, and dependence on, the original data are "lost" and cannot be examined in any later stages. Likewise, the classification tools used are also, for the most part, black boxes, so the user cannot explore the cause and effect relationships between the selection of data, their own mental understanding of the study area and the analysis tools they are using. Figure 4.3 clarifies by adding some typical questions that might be asked at each of the conceptual stages, and draws the significant impacts of prior knowledge and experience into the model. The challenge that results from this situation is one of how to engineer visualization systems that explicitly support connections between data, classifiers and categories, and later between categories and prediction models that enable us to answer these kinds of questions as and when required by the process of GIScience. Figure 4.4 shows exploratory visualization tools linked to the visualization of classifiers to gain insight into the process of classification, from data exploration, through synthesis (starting with data and ending with categories in Figures 4.2 and 4.3). A parallel coordinate plot (top left) and scatter plot (right) show several training examples from a land cover mapping exercise. The utility of a maximum-likelihood classifier is shown for each separate attribute dimension across the bottom of the figure and can be visually assessed by comparing the observed points to the theoretical Gaussian distribution (the bell-shaped curves, one for each category). The top right panel shows how the same data points appear in a scatter plot matrix and the middle panel on the left shows the land cover taxonomy used as the conceptual input to the classification process. Interactive linking and brushing is supported not only between the different views of the data, but also between the data and the visual representation of the internal working of the classifiers, allowing the user to explore relationships between the two. Such functionality allows the user to ask direct questions regarding the path from exploration to synthesis (Figure 4.1) such as: Which particular training examples cause the most classification error, and where are they located in geographic space?
Figure 4.3. Questions that might be asked during a land cover change assessment exercise as illustrated by the plausible path around the core scientific activities introduced in Figure 4.2.
c
Beyond Tools: Visual Support for the Entire Process of GIScience
3
89
90
M. Gahegan 2.
3. 4.
Which categories show the most confusion or overlap and therefore might benefit from a different conceptualization or synthesis, for example by generalizing or specializing them further using the taxonomy? Which data attributes (columns in the parallel coordinate plot) only add confusion into the classification process? Which kind of classifier works best for specific categories and why?
Researchers appear very adept at mentally switching between these analysis tasks or stages, and many scientific problems rely on such movement since reaching a solution involves iterating between what the researcher wants to achieve and what can be supported from the data and methods available, and hopefully reaching some middle ground. For example, categories such as those describing land cover introduced in Figure 4.4 are used throughout human and physical geography. As illustrated in Figures 4.2 and 4.3, they are first conceptualized, then synthesized, next applied and subsequently evaluated. There are many ways by which categories can be synthesized (e.g., from theory, directly from observations, from experience) and many theories, methods and datasets by which they may be instantiated and applied. Hence, the process of inference is typically a compromise between data, theory and methods that
Figure 4.5. Other possible paths through the nexus shown in Figure 4.1, beginning with evaluation of results (which proves unsatisfactory in this example) and backtracking through previous states to find and correct problems.
Beyond Tools: Visual Support for the Entire Process of GIScience
91
might take several attempts to converge on a satisfactory outcome (methods used in ways that are consistent with both theory and data). Land cover categories, demographic indicators and eco-regions are all examples where the researcher may go back and forth through exploration, synthesis, analysis and evaluation as their understanding deepens. Of course, there are many more paths than those shown in Figures 4.2 and 4.3 that an investigation might take. Figure 4.5 illustrates one such alternative, starting later in the investigation process with the evaluation of results stage that uncovers some problem, potentially due to inconsistencies in the prior stages. The researcher is now faced with a number of choices to track down and remediate the problem: they could begin with the data, the concepts, the model and so forth.
4.4
Visual Support for Different Kinds of Reasoning
Now let us consider the nature of the reasoning that underlies the tasks that the researcher must undertake, with specific focus on the types of inferential mechanisms that are used in the transition from one state to the next in Figures 4.2, 4.3 and 4.5 (Baker, 1999; Brodaric and Gahegan, 2002). The more we understand about how the researcher is trying to think and what they are attempting to produce, the better we can design suitable visualization tools that support their tasks. Figure 4.6 adds the dominant type of inference undertaken as the researcher engages in each activity (Peirce, 1891). These can be summarized as follows: Deduction: The application of a set of pre-defined rules to data, producing predefined outcomes (e.g., syllogistic logic, rules of the form: if A then B else C). Induction: Generalization from a limited number of examples to a larger population, typically beginning with the construction (learning) of categories followed by their application to a broader collection of data (Gahegan, 2003). For example, classifying the land cover example in w using a small number of training examples. Abduction: The combined act of seeing and explaining, in the sense of observing some specific stimulus and simultaneously finding, or synthesizing, a hypothesis to explain it (Thagard and Shelley, 1997). Sometimes, this is known as the "A-ha!" moment, for example when making sense of an optical illusion. Model-based: Reasoning around and through mental and computationally held models, allowing evaluation to be grounded within structural, causal, and/or functional constraints (Magnani and Nersessian, 2002). An example would be when investigating different climate change scenarios using a global circulation model. Rhetoric: Forms of persuasion such as metaphoric reasoning that are used to justify a stance where formal theory and models cannot fully "prove" correctness - as is the case with many aspects of earth and social science (Covino and Jolliffe, 1995). The arguments in this chapter are largely based on
Smtterplot, grand tour, projection pursuit,
parallel coordinate plot.
Figure 4.6. Scientific activities shown with dominant types of inference undertaken by the analyst (deduction, induction, abduction, rhetoric, modelbased) and examples of current visualization tools (shown in white boxes) and computational tools (shown in black boxes). The question that emerges is โhow do we enable the researcher to move between tools that span different activitiesโ?
Beyond Tools: Visual Support for the Entire Process of GIScience
93
rhetorical reasoning (to motivate a more formal approach via model-based reasoning). Figure 4.6 also suggests some possible types of geovisualization tools (white boxes) and statistical-computational tools (black boxes) that "might" facilitate the various activities. These suggestions are made from the author's own experiences and are illustrative, not definitive. Our goal of a more systematic approach to geovisualization might begin by investigating the effectiveness of different existing geovisualization tools and techniques in supporting the different activities shown. Apart from a deeper understanding of the roles that our visualization devices play, this would also suggest tools that need to work directly (interoperate) with each other, that is, coordinate their behavior more closely to help the researcher transition between analysis activities. At a lower level of abstraction, Catherine Plaisant describes a related approach to visualization tool capability via a "data by tasks" taxonomy including seven basic data types and seven basic tasks such as: overview, filter, relate, and extract (Shneiderman, 1998; see Plaisant, this volume (Chapter 3)). This approach provides a framework for measuring the utility of each tool in the context of specific, low-level analysis tasks to be undertaken and the types of data to be analyzed. Figure 4.6 adds to such a framework the high-level analysis activities that the researcher is engaged in, and the types of inference they are attempting to use, the concrete outcomes from these activities and the associated mental knowledge leveraged (Gahegan, 2001). Using these dimensions of: (i) activity, (ii) inference, (iii) outcomes, and (iv) pre-requisite data and knowledge, we can formulate statements that describe the example used above in w such as: A geovisualization tool used for category synthesis must support the inductive formulation of a proposed category, from a multidimensional data-space, based on pre-existing concept(s). This can be contrasted with the current situation we typically face, where our choice of tools is based on more practical considerations such as: tool accessibility, the dimensionality of the data to be visualized and the data importing capabilities. Whereas these are indeed worthwhile considerations, they do not, of themselves, guarantee that the tool we use will help solve the problem we are considering. Such a framework could also support very specific questions that might aid the researcher who does not know which of all the available tools are the most appropriate, such as: What are the individual tasks that comprise inductive category formation and which visual tools can support them? The answer might include tasks such as: (i) inductively defining a category from examples, (ii) removing or dealing with data outliers, (iii) checking for the separability of categories, and so forth.
94
4.5
M. Gahegan
Summary Findings
The discussion presented here can be summarized by the following three major goals, each of which generates a number of significant research challenges as we explore, extend and advance geovisualization. Goal 1. Define a logical framework 2 that provides the conceptual underpinning necessary to "situate" visualization tools and analysis tasks with the scientific activities they empower. a. What is the process, or what are the processes, we are ultimately trying to facilitate? b. What activities within GIScience do we wish to facilitate and how are they interrelated? c. What visual methods and techniques facilitate each of these activities? d. What inferential mechanisms are being employed by the researcher? e. What gaps are evident (where no or few methods are currently available), and where do we have an abundance of methods already?
Goal 2. Adopt an open systems approach to engineering visualization tools, so that systems and platforms do not cause barriers to integration. a. How can the visualization environments and methods be made open and flexible, so that they can be integrated together to support the entire scientific process in an holistic fashion? b. How can systems be open schematically (ensuring that tools can be shared among the research community and that new tools can be added into existing systems as and when they become available)? c. How can systems be open semantically (avoiding or mediating ontological commitments that would otherwise render the tools incommensurate)? Andrienko et al., this volume (Chapter 5) take up this theme of interoperability when considering the issues associated with "Creating Instruments for Ideation" from a number of perspectives.
Goal 3. Devise an infrastructure for coordination between components that draws from the logical framework of Goal 1. a. How can visual tools in a geovisualization environment coordinate their behavior, and specifically support the migration of conceptual understanding (e.g., concepts, models, results) between specific tools? b. What coordination mechanisms are available or can be created to provide the necessary functionality and flexibility? c. What exactly should be coordinated between tools in order to communicate the essence of the science process?
2 Or meta-framework from which alternative frameworks can be synthesized as needed.
Beyond Tools: Visual Support for the Entire Process of GIScience
4.6
95
Concluding Remarks
The GIScience and Information Visualization communities face some difficult challenges regarding the tools and analysis methods that empower science (Bishr, 1998): 9
9
9
Although it is still difficult to share data between researchers and systems, it is even more difficult to share functionality. Many potentially useful tools for spatial analysis, uncertainty modeling, visualization, spatial reasoning, geocomputation and so forth are not portable in the sense that they can be readily shared with others. As a result, a lot of research funding and effort results in outcomes that have reduced practical impact. In our case here, we need to build the necessary standards and infrastructure to better integrate the visual functionality we have separately developed. Perhaps even more importantly, the lack of interoperability means that analyses cannot readily be shared (Goodchild, 2000), and therefore cannot be independently verified or refuted by other scientists. This is a real barrier to scientific progress and credibility. Although we can, and generally do, make our tools available to others, we still lack the means to "wrap" analysis sessions and (say) deploy them on the Internet so others can share (or take issue with) our "Aha!" moments (Takatsuka and Gahegan, 2002). A richer toolbox of methods is only useful if we also can develop ways by which methods can be combined, reconfigured, tested and used that are flexible, interactive and easily deployable (Griss, 2000). Our current diversity of tools is therefore only a potential asset until we work out how to better coordinate their functionality in a meaningful way (such as via the framework suggested here) in order to deploy them effectively.
In short, we have a pressing need to extend beyond classifying visualization tools based on the kinds of data and visual variables they use - to the roles that they play, the inference they enable and hence the analysis activities they facilitate. As GIScience researchers begin to embrace the new paradigm of component engineering, it becomes clear that the advantages on offer could have immense positive impacts on the way in which software is designed, developed and shared (Szyperski, 1997; Wills, 2001). Not least among these is the ability for an entire research community to collaborate in the development of useful functionality, without the need to adopt a common software development environment, or even agree on a specific computational platform. However, component programming and its relation, agent programming, bring into even sharper focus problems related to the ontological commitments held by developers and users and implicitly represented in data and methods (Guarino, 1998a,b; Fonseca and Egenhofer, 1999). The challenge therefore is for us to think more systematically about the science we are trying to support, so that we can better situate the tools we have into the process of science and to orchestrate our efforts more effectively, so that software instruments are developed to support each investigative stage and each style of reasoning. The Open GIS Consortium is now making significant progress towards open GIS functionality and services, developed by
96
M. Gahegan
a community of engaged users (Open GIS Consortium Inc., 2003a-c). Their success is a direct result of carefully designed interface specifications that are made public and adhered to. The geovisualization research community is small by comparison, but this further accentuates the need for the same kind of care and collaboration so that we can leverage the work of others, rather than re-implement it for ourselves.
Acknowledgements Many thanks to the editors, particularly Jason Dykes, who provided much useful feedback, and to GeoVISTA graduate students Xiping Dai and Sachin Oswal who wrote the software shown in Figure 4.4. This research was supported by the National Science Foundation (NSF) under grants BCS-9978052 (HERO), ITR (BCS)-0219025, and ITR (EAR)-0225673 (GEON) and National Institutes of Health (NIH) under Grant # R01 CA95949-01.
References Andrienko, G. L., and Andrienko, N. V., (1999) "Interactive maps for visual data exploration", International Journal Geographic Information Science, 13(4), 355-374. Baker, V., (1996) "Hypotheses and geomorphological reasoning", In: Rhoads, B. L., and Thorn, C. E., (eds.), The Scientific Nature of Geomorphology. New York: Wiley, pp. 57-86. Baker, V., (1999) "Geosemiosis", Geological Society of America Bulletin, 111(5), 633-645. Bishr, Y., (1998) "Overcoming the semantic and other barriers to GIS interoperability", International Journal of Geographical Information Science, 12(4), 299-314. Brodaric, B., and Gahegan, M., (2002) "Distinguishing instances and evidence of geographical concepts for geospatial database design", In: Egenhofer, M., and Mark, D., (eds.), Geographical Information Science - 2nd International Conference, GIScience 2002. Berlin: Springer, pp. 22-37. Cook, D., Majure, J. J., Symanzik, J., and Cressie, N., (1996) "Dynamic graphics in a GIS: exploring and analyzing multivariate spatial data using linked software", Computational Statistics: Special Issue on Computeraided Analysis of Spatial Data, 11 (4), 467-480. Covino, W., and Jolliffe, D., (1995) Rhetoric. Boston, MA: Allyn and Bacon. CSISS (2003). Center for Spatially Integrated Social Science - Select Tools. Online: http://www.csiss.org/clearinghouse/select-tools.php3 (23/10/03). Dykes, J. A., (1996) "Dynamic maps for spatial science: a unified approach to cartographic visualization", In: Parker, D., (ed.), Innovations in Geographical Information Systems 3. London: Francis and Taylor, pp. 171-181. Fonseca, F. T., and Egenhofer, M., (1999) "Ontology-driven geographic information systems", In: Medeiros, C. B., (ed.), Proceedings of the 7th ACM Conference on GIS, Kansas City, MO, pp. 14-19, Online: http://www.spatial.maine.edu/(max/RC39.html
Beyond Tools: Visual Support for the Entire Process of GIScience
97
Gahegan, M., (2001) "Visual exploration in geography: analysis with light", In: Miller, H. J., and Han, J., (eds.), Geographic Data Mining and Knowledge Discovery. London: Taylor and Francis, pp. 260-287. Gahegan, M., (2003) "Is inductive inference just another wild goose (or might it lay the golden egg)?", International Journal of Geographical Information Science, 17(1), 69-92. Gahegan, M., and Brodaric, B., (2002a) "Computational and visual support for geographical knowledge construction: filling in the gaps between exploration and explanation", Advances in Spatial Data Handling, l Oth International Symposium on Spatial Data Handling. New York: Springer-Verlag, pp. 11-26. Gahegan, M., and Brodaric, B., (2002b) "Examining uncertainty in the definition and meaning of geographical categories", In: Hunter, G., and Lowell, K., (eds.), 5th International Symposium on Spatial Accuracy Assessment in Natural Resources and Environmental Sciences, Melbourne, July 10-12. Gahegan, M., Takatsuka, M., Wheeler, M., and Hardisty, F., (2002a) "GeoVISTA Studio: a geocomputational workbench", Computers, Environment and Urban Systems, 26, 267-292. Gahegan, M., Takatsuka, M., Wheeler, M., and Hardisty, F., (2002b) "Introducing GeoVISTA Studio: an integrated suite of visualization and computational methods for exploration and knowledge construction in geography", Computers, Environment and Urban Systems, 26(4), 267-292. Goodchild, M. F., (2000) "Keynotes address", Conference of the Association of American Geographers, Pittsburgh. Griss, M., (2000) My Agent Will Call Your Agent. Online: http://www.sdmagazine.com/articles/2000/0002/0002toc.htm (23/10/03). Guarino, N., (1998a) "Formal ontology and information systems", In: Guarino, N., (ed.), Formal Ontology in Information Systems. Proceedings of FOIS'98, Trento, Italy, June 6-8 1998. Amsterdam: IOS Press, pp. 3-15, Online: http ://www.oceanlaw.net/orgs/maps/ices_map.htm Guarino, N., (1998b) "Formal ontology and information systems", In: Guarino, N., (ed.), Formal Ontology in Information Systems (FOIS'98). Amsterdam: ICES, pp. 3-15, Online: http://www.oceanlaw.net/orgs/maps/ices_map.htm Lucieer, A., and Kraak, M. J., (2002) "Interactive visualization of a fuzzy classification of remotely-sensed imagery using dynamically linked views to explore uncertainty", In: Lowell, G. H. a. K., (ed.), 5th International Symposium on Spatial Accuracy Assessment in Natural Resources and Environmental Sciences, Melbourne, July 10-12, pp. 348-356. MacDougal, E. B., (1992) "Exploratory analysis, dynamic statistical visualization and geographical information systems", Cartography and Geographical Information Systems, 19(4), 237-246. MacEachren, A. M., Edsall, R., Haug, D., Baxter, R., Otto, G., Masters, R., Fuhrmann, S., and Qian, L., (1999a) "Exploring the potential of virtual environments for geographic visualization", Annual Meeting of the Association of American
98
M. Gahegan
Geographers, Honolulu, HI, 23-27 March, AAG, p. 371 (full paper: www.geovista.psu.edu/library/aag99vr). MacEachren, A. M., Edsall, R., Haug, D., Baxter, R., Otto, G., Masters, R., Fuhrmann, S., and Qian, L., (1999b) "Virtual environments for geographic visualization: potential and challenges", Proceedings of the A CM Workshop on New Paradigms in Information Visualization and Manipulation, Kansas City, KS, Nov. 6, 1999. MacEachren, A. M., Wachowicz, M., Edsall, R., Haug, D., and Masters, R., (1999c) "Constructing knowledge from multivariate spatiotemporal data: integrating geographical visualization with knowledge discovery in database methods", International Journal of Geographical Information Science, 13(4), 311-334. Magnani, L., and Nersessian, N. J. E., (2002) Model Based Reasoning: Science, Technology, Values. New York: Kluwer Academic, p. 418. Martin, R. E., (1998) One Long Experiment. New York: Columbia University Press. Monmonier, M., (1990a) "Strategies for the visualization of geographic time-series data", Cartographica, 27(1), 30-45. Monmonier, M. S., (1990b) "Strategies for the interactive exploration of geographic correlation", In: Brassel, K.,and Kishimoto, H.,(eds.), Proceedings 4th International Symposium on Spatial Data Handling, Dept. of Geography, University of Zurich, Switzerland, pp. 381-389. Open GIS Consortium Inc., (2003a) Geographic Objects Initiative (GO-l). Online: http://ip.opengis.org/go 1/(23/10/03). Open GIS Consortium Inc., (2003b) Geography Markup Language (GML 3.0). Online: http://www.opengis.org/docs/02-023r4.pdf (23/10/03). Open GIS Consortium Inc., (2003c) Open GIS Consortium, Inc. (OGC). Online: http://www.opengis.org (23/10/03). Peirce, C. S., (1891) "The architecture of theories", The Monist, 1(161 - 176), 000-000. Popper, K. R., (1959) The Logic of Scientific Discovery. New York: Basic Books. Schumm, S. A., (1991) To Interpret the Earth: Ten ways to Be Wrong. New York: Cambridge University Press. Shneiderman, (1998) Treemaps for Space-Constrained Visualization of Hierarchies. Online: http://www.cs.umd.edu/hcil/treemaps (23/10/03). Shrager, J., and Langley, P. E., (1990) Computational Models of Scientific Discovery and Theory Formation. San Mateo, CA: Morgan Kaufman. Sowa, J. F., (1999) Knowledge Representation: Logical, Philosophical and Computational Foundations. New York: Brooks/Cole. Szyperski, C., (1997) Component Software: Beyond Object-Oriented Programming. New York: ACM Press. Takatsuka, M., and Gahegan, M., (2002) "GeoVISTA Studio: a codeless visual programming environment for geoscientific data analysis and visualization", Computers and Geosciences, 28(10), 1131-1144. Thagard, P., (1988) Computational Philosophy of Science. Cambridge, MA: MIT Press. Thagard, P., and Shelley, C., (1997) "Abductive reasoning: logic, visual thinking, and coherence", In: Dalla Chiara, M.-L. e. a., (ed.), Logic and Scientific Methods. Dordrecht: Kluwer, pp. 413-427.
Beyond Tools: Visual Support for the Entire Process of GIScience
99
Whitehead, A. N., (1938) Adventures of Ideas. New York: Prentice Hall, p. 308. Wiggins, R. D., Beedham, H., Francis, B., Goldstein, H., Hanavy, M., Harman, J., Leyland, A., Musgrave, S., Rasbash, J., and Smith, A. F., (2000) Teaching Resources and Materials for Social Scientists Home page, Online: http://tramss.data-archive.ac.uk/index.asp (23/10/03). Wills, A. C., (2001) "Components and connectors: catalysis techniques for designing component infrastructures", In: Heinenman, G. T., and Councill, W. T., (eds.), Component-Based Software Engineering: Putting the Pieces Together. New York: Addison-Wesley, pp. 307-319.
This Page Intentionally Left Blank
Section B Creating Instruments for Ideation Software Approaches to Geovisualization Perspectives
5. Creating Instruments for Ideation: Software Approaches to Geovisualization Andrienko et al ........................................................................................................................................... 6. Statistical Data Exploration and Geographical Information Visualization Martin Theus .............................................................................................................................................. 7. Graph Drawing Techniques for Geographic Visualization Peter Rodgers .............................................................................................................................................. 8. Exploratory Visualization with Multiple Linked Views Jonathan C. Roberts .................................................................................................................................... 9. Visualizing, Querying and Summarizing Individual Spatio-Temporal Behaviour David Mountain .......................................................................................................................................... 10. Impact of Data and Task Characteristics on Design of Spatio-Temporal Data Visualization Tools Natalia Andrienko, Gennady Andrienko & Peter Gatalsky ...................................................................... 11. Using Multi-agent Systems for GKD Process Tracking and Steering: The Land Use Change Explorer Monica Wachowicz, Xu Ying & Arend Ligtenberg ................................................................................. 12. Signature Exploration, a Means to Improve Comprehension and Choice within Complex Visualization Processes: Issues and Opportunities Penny Noy .................................................................................................................................................. 13. Facilitating Interaction for Geovisualization Jason Dykes ................................................................................................................................................
103 127 143 159 181
201 223
243 265
This Page Intentionally Left Blank
Exploring Geovisualization J. Dykes, A.M. MacEachren, M.-J. Kraak (Editors) 9 2005 Elsevier Ltd. All rights reserved.
Chapter 5
Creating Instruments for Ideation: Software Approaches to Geovisualization Gennady Andrienko & Natalia Andrienko, Fraunhofer AiS - Institute for Autonomous Intelligent Systems, Schloss Birlinghoven, Sankt-Augustin, D-53754, Germany Jason Dykes, David Mountain & Penny Noy, School of Informatics, City University, London EC1V 0HB, UK Mark Gahegan, GeoVISTA Center, Department of Geography, The Pennsylvania State University, University Park, PA 16802, USA Jonathan C. Roberts & Peter Rodgers, Computing Laboratory, University of Kent, Canterbury, Kent CT2 7NF, UK Martin Theus, Department of Computer-Oriented Statistics and Data Analysis, University of Augsburg, Universit~itsstr. 14, 86135 Augsburg, Germany
Keywords: geovisualization, tools, techniques, instruments, ideation, technology, task, data, user, expertise, interoperability
Abstract New visualization techniques are frequently demonstrated and much academic effort goes into the production of software tools to support visualization. Here, the authors of subsequent chapters in this section identify reasons why they continue to enhance and develop the instruments that they design to support the process of geovisualization, justifying their ongoing work and in doing so offering some perspectives on and solutions to the issues that they address. A number of inter-related themes arise including: advances in technology that create opportunities and generate demands for new geovisualization solutions; increasingly rich data sets and sources that drive design due to the associated potential for revealing new structures and relationships; various and novel tasks to which geovisualization is being applied associated with debate and continuing research concerning the kinds of instrument that are required to best undertake particular tasks in particular conditions; an increasingly diverse set of users who require a variety of tools, environments and systems to support ideation in its numerous forms, including those who participate in simulations of visualization when learning; changes in the available expertise that prompt the development of ideas and instruments that borrow from advances and methods in cognate disciplines such 103
104
G. Andrienko et al.
as Cognitive science, Statistics, Information Visualization, Knowledge Discovery and Datamining (KDD), Human-Computer Interaction and Scientific Visualization. Key issues in developing tools that address these requirements are those of interoperability and re-use. The potential advantages for geovisualizers and tool designers of common software approaches and the sharing of ideas are attractive. They allow us to proceed at speed, designing and adjusting our tools and interacting with revealing views of our data to address our objectives of creating superior instruments and enhancing our knowledge of spatio-temporal phenomena. Developing our geovisualization in this way will enable us to participate effectively in the processes of visualization and ideation and advance our science.
5.1
Introduction
During the last decade, numerous geovisualization tools have been developed by various individuals and organizations to support a variety of purposes, for example, (see Gahegan, this volume (Chapter 4)). Many of these have highly interactive and manipulable interfaces and yet we continue to build new tools using a range of technologies and techniques. Why do we invent new instruments? Or why do we need to invent new instruments? There are many possible motivations: 1. 2.
3.
4. 5. 6.
New technology continues to appear and it often enables us to do things that were not possible before. We may be able to acquire data of a new form or quality that cannot be analyzed with existing tools as the data sets may be so large, dense or contain so many dimensions that no current tool supports interactive investigation effectively. As geovisualization becomes more popular and exploited more widely, we encounter new tasks that cannot be performed using existing tools. Effectively geovisualization may be used to address new societal requirements. The particular needs of specific users (from this growing user base) are likely to vary and tools may serve a new or changing user base. Accessing expertise from cognate disciplines may contribute to what already exists and enhance it further. Collaboration between researchers may improve our ability to visualize geographic information and to develop the various instruments that support this process. The notion of interoperability underlies our efforts to develop ideas and generate knowledge from our data using instruments for ideation.
Ideation relates to the formation of ideas and concepts, the end goal of much geovisualization. Today there are many tools and techniques for creating instruments for ideation - sophisticated hardware, advanced programming languages, graphics libraries, visual programming systems and complex GUIs. In each, the developer or visualizer wishes to generate effective interactive graphic realizations of their data that are useful to them and/or their users. Indeed, these geovisualizers will come across many challenges. We suggest six factors that help explain why new tools and techniques may be developed.
Creating Instruments for Ideation: Software Approaches to Geovisualization
In this chapter, we influence and shape exploratory process. chapters that follow
5.2
105
expand upon these ideas and consider how each of these issues the way we use and develop software instruments that support the Some examples of our software approaches are documented in the in this section.
Technology Issues
Current technology has an important enabling and limiting impact upon the available range of instruments for ideation, which changes significantly over time (Cartwright et al., 2001; Fairbairn et al., 2001). In 1854, Dr. John Snow and colleagues manually plotted the locations of deaths from cholera on a paper map in order to show the outspread of the disease (Tufte, 1997; Brodlie et al., 2000). Today, Snow would most likely load these data into a GIS and look at a map display on a computer screen. In 1967, Bertin (Bertin, 1983) described advanced equipment for manipulation of data represented on paper strips or cards. Current computers obviously offer far more sophisticated opportunities for manipulating data representations and interacting with them. It is natural that builders of tools for ideation, either for their own use or for use by others, aim to utilize the most applicable capabilities of the current technologies. A major benefit of contemporary computer technology is the possibility to rapidly generate various graphical displays from data. This gives us an opportunity to try alternative transient realizations of data, discard those deemed ineffectual but when necessary reproduce them again, and look at several displays simultaneously to provide multiple views of data (McCormick et al., 1987; Becker et al., 1987; Stuetzle, 1988; Roberts, 2000). Such techniques are paramount to the process of geovisualization and enable us to address the data, task and user issues that also drive our pursuit of innovative and effective instruments. They have stimulated much of the work reported in this section. We also use advances in technology to store large amounts of data and access them on demand with minimum effort. Moreover, it is increasingly easy and common to obtain additional data when necessary in an analysis, from a range of sources including the Web or from the wireless "information everywhere" devices. The speed of computation that technology now allows enables us to combine visualization with computationally intensive methods of data analysis such as exploratory statistics or datamining: one can rapidly obtain the results of computation and compare them with what is observed or interpret them through depiction on a map or a graph. Of course, interaction and display manipulation play crucial roles in data exploration (MacEachren, 1994a-c). The speed of data access and display generation also allows the development of dynamic representations capable of changing in real time. Thus, dynamic and animated maps are now widespread and offer exciting opportunities for representing geographic data. 3D graphical representations can be realized with relative ease, and are frequently used, for example, (see Wood et al., this volume (Chapter 14)), yet we are only beginning to determine ways to utilize their potency most effectively for data analysis and ideation by developing and testing tools, for example, (see Kirschenbauer, this volume (Chapter 18) and Coors et al., this volume (Chapter 27)).
106
G. Andrienko et al.
It is not only the increase of computer power that offers us new opportunities to create more sophisticated instruments, but also the progress in software environments, such as the development of programming tools that are high level and/or cross platform and the availability of libraries and reusable software components. Examples include the MacroMedia products, Java, Tcl/Tk, the OpenGL libraries and the OpenSource paradigm. These environments and related methods of development have capabilities for visualization and enable us to produce flexible applications that are quickly extensible and may run on a variety of platforms. As a result, more sophisticated and dynamic graphics can be created and widely used. Besides increasing the opportunities, technical progress raises demands and poses challenges that drive our research and the development and testing of our instruments. New types and volumes of data made possible by technological advances may need handling in innovative ways and so require the development of geovisualization techniques (see w The Web not only enables us to obtain more data when needed but also raises issues relating to data merging, data representation, and the analysis of complex, heterogeneous data sets. Moreover, the Internet and other communications technologies such as mobile devices are changing the way people are working. Indeed, mobile devices do not only enable people to compute anywhere and to access data from everywhere but also create a demand for new instruments that are designed specifically for such devices and which can be conveniently and effectively used. In the design of these instruments, one must creatively manage limitations that once appeared to be issues of the past: small screens with low resolution, memory restrictions, limited computational power and reduced possibilities for interaction. The lucrative games industry is beginning to discover the need and market for device specific applications, and work is in progress to take advantage of opportunities for mobile geovisualization, for example, (see Coors et al., this volume (Chapter 27)). Technical progress enables people situated at different physical locations to work cooperatively, hence, there is a demand for geovisualization tools that support this mode of remote collaboration, for example, (see Brodlie et al., this volume (Chapter 21)), which in itself leads to new geovisualization tasks (see w The availability of computers, data, and the Internet encourages more people to do their own exploration and take part in knowledge construction. This calls for the creation of widely accessible instruments (including those available over the Web) that can be operated by users with different levels of sophistication and computer competence. The availability of such tools confronts designers with further challenges. How are such accessible prompts to geovisualization made understandable to a wide and usually unknown audience? Such issues are further explored in w Whilst being convenient for tool developers, modern software consumes far more computer resources than before. In some cases (for example, using Java), it can be argued that the costs of high-level flexible tools are significantly slower software applications than older alternatives written in Fortran, C or C + +. Whilst this issue can be addressed by improvements in processor speeds it is exacerbated when coupled with the "mobile device considerations" introduced above. Code reuse and exchange of components also poses numerous difficulties, some of which are discussed in w below.
Creating Instruments for Ideation: Software Approaches to Geovisualization
107
Hence, we see that technological progress has tremendous influence on the development of instruments for ideation and explains much of the rationale for our work. This influence is two-sided. On the one hand, progress creates new opportunities that may be explored and utilized. On the other hand, it creates new demands that need to be satisfied. The new demands often come together with particular restrictions and considerations that have to be appreciated. In keeping up with new technologies, geovisualizers should not disregard earlier ideas, approaches, and methods. After all, as we have seen, even the idea of manipulating data displays first appeared in the precomputer era. In the current absence of formal theory to guide or prescribe our use of the new opportunities that technology offers to us, existing knowledge and the methods of the present and past provide important resources on which to build our knowledge and techniques (see also w
5.3
Data
Motivation to develop novel graphic representations and interaction techniques can come from the data itself and our abilities to access and use it (Gahegan et al., 2001). Besides increasing the opportunities, technical progress raises demands and poses challenges that drive our research and the development and testing of our instruments. Continuing technological advances have had a profound effect upon the nature and volumes of data available to the geovisualization community. The current ease with which data are recorded and acquired results in huge data volumes that cannot be effectively explored using standard methods of representation and interaction. New data sets are being generated by such diverse applications as mobile communications technology, digital commercial transactions, Web-logging software, traffic monitoring systems, closed circuit television, various flavours of GPS "tagging" and countless others. These data sets often contain spatial and temporal referencing, whether stored explicitly or implicitly, and may benefit from either the development of new visualization techniques or the adoption of techniques from one domain by another. Consequently, a wide range of new media (such as imagery, animations and audio) is increasingly being used, offering the investigator a variety of data models. Encouraging the user to interact with different media can add a qualitative perspective, for instance by representing a phenomenon in context, that quantitative approaches alone may not be able to offer (Shifter, 1995 a,b). The data structure used to represent the phenomena of interest has implications for which visualization techniques are available and appropriate, for example, (see Keim et al., this volume (Chapter 2)). Many structures are static, representing the situation at a single moment or with no reference to time at all. Relationships can be uncovered between different parameters through techniques such as interactive statistical data exploration, but these cannot reveal dynamic processes. Data structures that incorporate time lend themselves to techniques that can represent these dynamic processes. Animation is one approach to showing time elapsing and works well for presenting information about entities evolving under the influence of long-term trends. The progression of urban form is an example (Acevedo and Masuoka, 1997). A current
108
G. Andrienko et al.
challenge lies in enhancing animation tools that simply present patterns to interactive techniques where user-controlled animation allows variable selection and control over a dynamic display to compare the behaviour of different entities over the same time period (Andrienko and Andrienko, 1999a-e; Rana and Dykes, 2003; see Andrienko et al., this volume (Chapter 10)). Time can also be represented without the need for animation. In particular, spatial plots can be combined with temporal plots to allow simultaneous interaction with both space and time. Such approaches have a long history, and include another much cited graphic that pre-dates computer supported visualization, Minard's depiction of Napoleon's Russian campaign (Tufte, 1983), but have now evolved into interactive approaches allowing selection for comparison and focus (Peuquet and Kraak, 2002; Andrienko et al., 2003). Whether a discrete or continuous data structure has been used also has implications for the visualization techniques that are applicable. Discrete approaches are more appropriate for modelling and analysis of entities, such as the movement of individuals or groups. Continuous structures, such as elevation models and point density surfaces, are more appropriate for representing the wider trends over an area: representation of and interaction with these models is quite distinct to discrete approaches. This continuous sampling strategy can generate very large datasets, often only a small subset of which is relevant to the task being undertaken by a particular user. Abstracting the relevant information from the continuous model at the appropriate scale can reduce data volume and prevent the "information overload" associated with very large datasets (Rana and Dykes, 2001). Moreover, there is a need to store these large structured volumes of data in appropriate databases such that the information is readily available and integrated with appropriate mining and visualization tools (Gahegan et al., 2001). As indicated above, the automated collection of data has become increasingly commonplace leading to a massive increase in the volumes of data that are generated. Such datasets may contain much richer information that can be revealed through most current visualization techniques, requiring the development of new methods and instruments that draw upon them. Various methods have been applied to address this particular problem. Classification by aggregating a collection of samples into a single entity, or by using pruning methods for hierarchical data, can allow large data volumes to be represented more clearly (Kumar et al., 1997). However, these aggregate entities may have different characteristics to the individual entities they represent and a dual approach may have to be adopted if the same interaction technique is to be implemented for source and aggregated data. Under these circumstances, the experience that geo-scientists have in dealing with issues of scale and scale-dependent phenomena, and their visualization could be beneficial to a wider community (for example, see Wood, this volume (Chapter 15)). Classification can also facilitate or even permit interaction with large data volumes. When interacting with a very large number of graphic elements in a display, processing time can otherwise prevent a technique from supporting the real-time interaction required for visualization (see Theus, this volume (Chapter 6)). Here, we see a clear association between the data and technology considerations that influence the instruments that we develop and the techniques that we use.
Creating Instruments for Ideation: Software Approaches to Geovisualization
109
As is the case on paper, on-screen realizations of large data sets can cause particular problems for the viewer in detecting and discerning the symbols used, assembling them into patterned regularities and estimating the magnitudes that they represent (Cleveland, 1993). Interesting trends may be lost through over plotting and the magnitude and distribution of outliers. Various graphic and software techniques can be implemented (Theus, this volume (Chapter 6)). One approach is to summarize key trends: for example GPS track logs representing individual movement can be used to generate point-density surfaces giving a representation of where an individual spends their time and their familiarity with specific locations from which information can be extracted (Dykes and Mountain, 2003; Mountain, this volume (Chapter 9)). arunselvaminThe phenomena that geovisualizers usually study exist in a spacetime framework. Static 2D maps that offer an impression of a complex 3D space at a particular time rely upon dimension reduction. Much cartographic effort has always gone into minimizing the impact of reduction upon the anticipated tasks to which the map is put. However, geovisualization techniques can be applied to data that have no spatial or temporal dimensions. A 2D surface can be generated by principle components analysis and geovisualization interaction techniques applied to it. Similarly, clusters in selforganizing maps are described in terms of distance, however none of the original dimensions that led to the map need relate to spatial metrics (for example, see Koua and Kraak, this volume (Chapter 33)). The results of techniques that use this spatialization (Fabrikant, 2000a,b) aim to utilize human abilities to interpret landform and interacting with non-spatial data in this way may offer new insight (for example, see Fabrikant and Skupin, this volume (Chapter 35)). Thus, a clear opportunity exists to explore the utility of such techniques and develop new instruments of ideation specifically for spatialization. Each graphic depiction of a data model that we develop is one of an infinite number of alternative views. Individuals developing geovisualization techniques are often attempting to display a single specific relationship at the expense of other trends and background noise. Successive transitory screen realizations designed for private "idea chasing" are not intended to communicate a single message about the data to a wide audience as has been the case with many traditional maps. The increasingly rich and potentially revealing data sets becoming available are leading to an increasing number of abstract, novel and interactive graphic realizations of data sets being developed by those creating instruments for ideation.
5.4
Tasks
Whilst technological advances and the availability of new data drive a need for new views, Casner (1991) convincingly demonstrates that the same data need to be represented in different ways using different views in order to effectively serve different information needs. The information needs that require these views are defined by different tasks. Casner considers examples of tasks such as planning a journey from city A to city B with a stopover in city C (where one has an appointment for a particular time) and finding the cheapest flight or most direct travel route. For each task, he proposes a graphical display that allows it to be effectively fulfilled. There is no "ideal" graphic
110
G. Andrienko et al.
realization of the data suited for all purposes. Indeed, the tasks that Casner considers have little to do with exploration, namely there is no attempt to grasp inherent characteristics of unfamiliar data and gain knowledge about the underlying phenomena. However, there may well be generic tasks in data exploration that define geovisualization. Has a data explorer any particular goal in mind while looking at some unfamiliar dataset from different perspectives in a hope to gain serendipitous insights into the information? And if so, is knowledge about possible tasks an important factor when designing instruments for ideation? If Casner's supposition is applicable to exploratory map use it would account for the variety of approaches employed in geovisualization, and as tasks change new instruments need to be developed to support them. Designers and developers of geovisualization tools, including those who have contributed to this chapter and the discussions surrounding its development, may have different approaches to considering tasks. Some believe that having a defined task is not (or not always) necessary in Information Visualization. Others are convinced that tasks always exist, explicitly or implicitly, even when an explorer seems "just to look" at data. Advocates of task-driven tool design argue that usually an explorer does not only look at data but also looks for something "interesting", such as a configuration that may contribute to a better understanding of the data or underlying phenomena. This may be, for instance, a salient pattern of spatial distribution, a local anomaly, some indication of unusual behaviour or an indication of a possible dependency between phenomena or processes. In order to find these "interesting" things, an explorer actually performs a range of exploratory tasks (possibly, without even realizing this): observing a spatial distribution, attempting to detect patterns and anomalies, looking for possible relationships, and so on. These tasks are, of course, very different from those contemplated by Casner. Apart from being less precise and more general, exploratory tasks are often fulfilled in parallel or combination (Gahegan et al., 2001). In the case of Casner's examples, a single (often more straightforward and well specified) task is considered in isolation. While an explorer may not be aware of their tasks or know the specific outcomes, those designing tools that support ideation must consider them explicitly and deliberately design any instrument so that it can assist in the observation of distributions and behaviours, expose patterns and facilitate detection of relationships. Taking into account the concurrency of exploratory tasks it may be inappropriate to follow the approach of building separate graphical realizations for each task. Instead, one should try to design to support a range of tasks, possibly through various methods of interaction. When a single graphical depiction appears to be insufficient, several interlinked complementary realizations of the data may be appropriate. Whichever combination of graphics and exploratory environment is used to support ideation, applying Casner's model to the realm of geovisualization explains the proliferation and development of instruments and suggests that a tool designer needs to know which exploratory tasks exist and to find methods of supporting them in order to promote ideation. Gahegan, this volume (Chapter 4) identifies outcomes of ideation when considering the nature of the research process and suggests a framework for determining the utility of tools and techniques according to a low-level analysis of tasks.
Creating Instruments for Ideation: Software Approaches to Geovisualization
111
Various approaches to defining possible tasks have been developed and numerous alternative task taxonomies suggested (Knapp, 1995; Qian et al., 1997; Shrager and Langley, 1990; Shneiderman, 1998) and Plaisant, this volume (Chapter 3) provides a simple taxonomy of seven "basic tasks". Despite their differences, these taxonomies exhibit some commonality. They are typically built from genetic tasks like "identify", "locate", "compare", or "associate". Such broad task categories cannot help a tool designer much in isolation unless they are explicitly related to data and refined in terms of the nature of the data to which they relate. Thus, it is hardly possible to create a tool supporting the abstract task "compare". Instead, one needs to determine which specific comparison tasks exist for a particular dataset or for a range of datasets with similar structures. This demonstrates another interaction between our identified motivating factors, a clear relationship between data and task. Let us assume, for example, that we need to explore data about objects that move in both time and space. We can instantiate the generic "compare" or "relate" into several more specific tasks: 9 9 9 9 9 9 9 9
compare positions of two or more objects at a particular moment in time; compare positions of an object at different moments in time; compare trajectories of different objects; compare trajectories made by the same object during different time intervals; compare the speed of movement of different objects during the same time interval; compare the speed of movement of the same object during different time intervals; compare distances travelled; ... and so on.
These tasks are obviously different and need to be supported in different ways. Hence, specialization of generic tasks in terms of data components is essential for the successful design and use of tools for ideation. An ideal task taxonomy for a tool designer would be the one that allows apparent and straightforward specialization. Object orientation may be an appropriate methodology for developing tools that utilize such a taxonomy (Boukhelifa et al., 2003). Once we have understood which tasks (potentially) exist, we need to find ways of supporting them. Unfortunately, no appropriate theory or guidelines currently exist, upon which we can rely. Certain empirically derived pieces of knowledge are useful however. For example, choropleth maps may be appropriate for detecting spatial patterns in certain circumstances but are inappropriate for comparing objects (Jung, 1995). Although we primarily deal with geographic information in this chapter, we should not restrict ourselves only to cartographic representations but adapt tools and approaches from different disciplines to our purposes (see w For instance, a scatter plot is good for detecting correlations between phenomena characterized by numeric attributes, and a time-series plot can be effectively used for exploring spatio-temporal data. We should also remember that we have the possibility to enhance our displays by facilities to interact
112
G. Andrienko et al.
with them and manipulate them, and this may radically change their properties so that choropleth maps, as in the example above, can be made more suitable for comparative tasks (Andrienko and Andrienko, 1999d, e). Moreover, interaction can also help us to link together multiple displays serving different tasks. Although we reuse the experience accumulated in the geovisualization area as well as in Information Visualization and statistics, in many cases it is not obvious what kind of instrument is needed for a specific task. In such cases, we may try different tools, either from the existing set or by devising new realizations ad hoc to suit, until we find one that satisfies the particular task in hand. For example, when using geovisualization to explore data about earthquake occurrences using an interactive animated map display, one may find that it does not facilitate the detection of spatio-temporal clusters. In trying to explain this failure, it is possible to hypothesize that the task of cluster detection requires the spatial and temporal dimensions of the data to be viewed simultaneously and in a uniform way. This consideration may lead to the idea of using the "space-time cube" where time is represented by an additional spatial dimension (Mountain, this volume (Chapter 9)). As a result, knowledge about both the process and the nature of the use of graphics is improved. This example demonstrates once again that data and tasks are interlinked factors that shape the design and use of our geovisualization instruments. And the low-level tasks to which geovisualization may be applied are changing as a result of other factors discussed in this chapter such as advances in technology, changes in the amounts and types of data that are available and changes in the type of user who make use of geovisualization.
5.5
Users
Whilst data and tasks shape the nature of geovisualization techniques and tools, the degree to which they are appropriate will ultimately depend upon those who use them. Users have a host of expectations, individual experiences, skills, domain specific knowledge and various capabilities and limitations. Importantly, they are the people who expect to gain knowledge and understanding through their interactions! Creating effective instruments for geovisualization requires us to design tools with which the target user(s) can efficiently and effectively interact (Fuhrmann et al., this volume (Chapter 28)). Thus, it is important to consider who is doing the visualization: not only does the user come with a package of skills, but they also have varying degrees of domain knowledge. For instance, a geologist may have refined skills in interpreting 3D representations, due to their experience with solid models and volumetric concepts (Gahegan, 1998). However, users without these skills may wish to access and interpret the data using alternative realizations. The background and skills of particular users have a considerable influence on the way in which instruments are used and their effectiveness. For example, an individual who foresees that they are going to use a system many times may invest a substantial amount of time and effort in learning it. However, an occasional user may wish to get some results quickly. Moreover, the need to extend our domain knowledge and that of
Creating Instruments for Ideation: Software Approaches to Geovisualization
113
geovisualization may require a geovisualizer to simply create unique graphics rapidly or demonstrate a particular aspect of their work. To minimize development time and expedite the generation of ideas resulting from successive interactive graphics they would usually prefer to build their hand crafted exploratory instruments from pieces of existing functionality that offer flexibility and efficiency. Thus interoperability issues become important (see w Users with specific domain knowledge may drive system development. It is often the case that these domain experts end up developing appropriate tools themselves. Thus, toolkits need to be built that enable the user to quickly build a prototype system from a series of available techniques. This may draw upon many methods of interoperability, from a quick and easy graphical style using a dataflow model of interconnectivity, to a very flexible but complex set of package interactions, relying on knowledge of code and data formats, which is more sophisticated and powerful than a simple model of interconnectivity, but may be harder to use. Some of the various possible approaches towards interoperability are discussed further in w Other users may have different expectations of a particular tool, perhaps depending on their level of expertise, experience, or time available to learn and use the software. One expert user may be more patient with a slow system, waiting for a particular realization to be rendered just to get that high quality and accurate display, while another may wish to generate quick representations that are not necessarily exact. When following Shneiderman's mantra "Overview First Then Details on Demand" (Shneiderman, 1996), the user often wishes to simply provide an overview followed by a process of finding out more about the representation. In w we identified that different tasks in this process require different solutions. But equally defining what an effective overview may consist of is another issue and the answer is likely to be user dependent. Is it, for example, a simple scatter plot showing the statistical relationship between two attributes for all cases in one display (with the resulting problems of interactivity and possible overplotting), or is it a higher level abstraction with symbols depicting the centres of gravity of the major clusters that appear on the plot (and so the problem becomes one of finding an algorithm to effectively abstract the groupings)? Or is it a map, or a set of maps, showing the spatial distribution of one or more of the attributes? Different users may have different answers and each will certainly want to subsequently zoom, pan, filter, and request details on demand in different ways. Personal abilities are one of the characteristics that affect a user's preferences in exploring information. They include physical constraints (e.g., sensory and cognitive limitations) as well as a variety of academic abilities (e.g., levels of reading, writing, arithmetic and interpretive skills). These all may have an effect - to a greater or lesser degree - on the level of interaction required by the user and to the appropriateness of any particular combination of realization and interactivity. The area of unseen disabilities, especially in the case of arithmetic skills, can be considered as one of "difference" (Slocum et al., 2001) and includes diverse styles such as in task-action choices and in general spatial awareness skills. In the field of human computer interaction (HCI), the issue of task-action consistency suggests that it is advisable
114
G. Andrienko et al.
to have multiple task-action methods as different people will regard different tasks as being variously similar or dissimilar (Grudin, 1989). Even though we follow best design practices, individual users are still different and have varying abilities. Indeed, it is these differences that make it difficult to fully understand how users are going to use a system, and often user trials reveal different methods of interaction from those that were expected. As is the case with different tasks, where multiple views may be required, different users are likely to require multiple visualization methods to engender understanding most successfully. Users and tasks go hand in hand. Complex tasks usually require non-trivial interfaces. Confining ourselves to limited modes of interaction and/or representations might restrict developers and investigators. For example, complex multi-variate views such as parallel coordinates and mosaic plots may involve some training to be used effectively by a mass audience. Indeed education is an important issue as we hope that insight is extended as yesterday's new view becomes tomorrow's bread and butter graphic device. Developers should not shy away from producing complex systems that may require users to invest time and effort into learning how to use them effectively - if they are effective. After all in the 1700s, Playfair's scatter plots were unlikely to have been greeted by mass approval and widespread comprehension. Moreover, cooperative work by multiple users on data exploration and analysis requires specific support. A strong impact on tool design is whether the intention is for use by an individual or a group (for example, see Brodlie et al., this volume (Chapter 21)). Developing instruments that provide effective solutions to the latter of these scenarios under particular circumstances is a key objective. Thus, different kinds of users will require and work most effectively with different instruments to support their geovisualization, and exploring the possibilities is a key motivating factor for those involved in tool specification and development. For example, applications software that is to be used widely should be stable, reliable and have a consistent look-and-feel (see Plaisant, this volume (Chapter 3)). Other systems offering additional flexibility (such as those that make use of many linked views and complex graphical representations) may be more appropriate for exploratory work undertaken by experienced and skilled users, rather than tools used in a limited context such as education. To summarize our arguments, we can say that users are diverse and so a variety of tools, environments and systems are appropriate to support ideation in various contexts. When faced with developing software for wide use, the application of multiple linked views allows a variety of user skills and abilities and background systems to be supported. In addition, a non-trivial solution with sophisticated interaction methods that is geared expert use and may offer considerable flexibility has an important role, as do a more limited and less polished or robust tools that are developed in order to demonstrate or test particular techniques. Indeed some tools may offer a variety of levels of complexity of functionality and interface through "multi-layered designs" (see Plaisant, this volume (Chapter 3)) or by developing smooth links between modes of interaction (for example, see Dykes, this volume (Chapter 13)).
Creating Instruments for Ideation: Software Approaches to Geovisualization
115
Expertise from Different Fields
5.6
Finding an appropriate representation technique using suitable methods of interaction is a common challenge in any discipline that makes use of graphics. Geovisualizers can thus draw beneficially from other communities, and many of the techniques and much of the work cited thus far in this chapter does so. This may in turn lead to the need for a wide range of skills. The complexity and specialist nature of the tools and techniques available in other disciplines may prohibit their use in certain circumstances. Collaboration and the delegation of roles may allow more work to be achieved more effectively. Indeed, the 1987 special issue of the Journal of Computer Graphics concerning Visualization in Scientific Computing (McCormick et al., 1987) was enthusiastic about the benefits of having interdisciplinary teams when producing effective visualization tools. There is a good argument for teams composed of a diverse group of investigators with a variety of expertise. The McCormick report describes a group combined of: 1. 2. 3. 4. 5.
specialists with knowledge and skills relating to the target domain; visualization scientists with software, hardware, networking, languages, operating systems and database skills; support personnel with skills to "configure and maintain visualization facilities"; artists with specialist knowledge in composition, lighting and color; cognitive scientists.
Thus, bringing people together often benefits the research (a philosophy of two - or more - heads being better than one). More recently, the US National Research Council on "Geospatial Information and Information Technology" embraces this interdisciplinary perspective (Computer Science and Telecommunications Board, 2003). Many tool development projects do include scientists with geographic and computing expertise, but it is rare that a geovisualization project includes investigators with a more diverse range of skills. Conversely, more diversity may not in fact be better for the project as managerial problems surface: for example, as any software engineer knows - getting more programmers on a project, that is already running late, in fact slows down the project as a whole (Brooks, 1995). This is a difficult equilibrium to resolve and maintain, but one that must be addressed. Experiences of managing large collaborative projects in the open source community may offer some solutions and the opportunity to extend the threshold beyond which the benefits of collaboration between individuals from different domains are offset by the costs of coordination. Technological advances that permit and support collaborative work should prove to be valuable (Brodlie et al., this volume (Chapter 21)). Another challenge with such a diverse group of experts is that the primary focus for each individual might be quite different. Geovisualizers often have a particular graphical representation of a geographic scenario as a primary focus, while Information Visualization focuses on attempts to graphically depict structures that are abstract and have no physical location or space equivalence. Conversely, statisticians may tend to
116
G. Andrienko et al.
depict relationships within sampled data, which can give new insight to the generating process, whereas Information Visualization faces the most general challenge in not being restricted to any specific domain. Despite these differences, increasing overlap exists (as indicated in many of the chapters of this book) and evidently geovisualization can gain much from the diverse knowledge available in cognate disciplines. This may prompt the development of new tools and techniques. Geovisualization and various other related fields are complementary in a number of ways. In the case of geovisualization and statistics, the two disciplines can be considered as relating to different stages of the process of seeking understanding of a dataset. Geovisualization has tended to focus on and support data exploration occurring in the earliest stage of GI scientific endeavour, with an objective of generating plausible hypotheses concerning inherent data characteristics and relationships. Traditionally, statistics becomes particularly appropriate when the hypotheses need to be validated and models built. Gahegan (see Chapter 4) argues strongly that geovisualization is a broader process that supports the entire practice of GIScience and (graphical) exploratory statistics has provided much impetus for geovisualization. Statistical data, here considered to be the characteristics of data that do not describe geographical location or properties, is usually multi-variate. Thus, the structures to be identified are interactions between numerous variables. These configurations are often far too complex to be captured by simple coefficients, and call for graphical exploration or complex statistical models. Linked highlighting and plots for highdimensional data are the building blocks of interactive statistical graphics, and all (human-computer interactions) must be built to support these tasks and plots. "Statistical thinking", that is knowledge about distributions and relationships between them, is very important in geovisualization when participating in exploratory data analysis (EDA). A different relationship exists between geovisualization and knowledge discovery in databases. Like geovisualization, KDD techniques are also meant for revealing significant characteristics and relationships in unfamiliar datasets. KDD is defined as a non-trivial process of identifying valid, novel, potentially useful, and ultimately understandable patterns in data (Fayyad et al., 1996a,b). This is usually applied to very large datasets. Whilst geovisualization focuses on knowledge extraction undertaken by a human analyst and the interactive visual tools designed to support them, KDD offers techniques for the automatic extraction of knowledge from data. Combination of these two approaches may exploit the strength of each of them and compensate for limitations (Andrienko and Andrienko, 1999b, c; Andrienko et al., 2001; Keim and Kriegel, 1996; MacEachren et al., 1999). Thus, the "human eye" can perceive and process some spatial relationships from a visual representation such as a map while a computer draws upon the relationships encoded in digital spatial information. Yet only limited characteristics of the various aspects of spatio-temporal arrangement that may be potentially relevant can currently be represented in a format suitable for datamining. Examples include, distances between centroids or neighborhood relationships. Results of datamining, in turn, require a human analyst to evaluate and interpret them and, hence, need to be appropriately visualized. On the other hand, computers are superior to humans in processing large volumes of data, and this advantage is exploited in exploratory tools
Creating Instruments for Ideation: Software Approaches to Geovisualization
117
that combine geovisualization with KDD techniques and there is an opportunity for further developments in this area (see Wachowicz et al., this volume (Chapter 11)). Indeed, examples also exist whereby artificial intelligence techniques are incorporated in geovisualization tools (Andrienko and Andrienko, 1999c-e). Such agents may be used to identify items of interest or to help users to select and generate appropriate graphical realizations. Sometimes new representation and interaction forms are brought to geovisualization from other disciplines, for example, direct manipulation from HCI or graph drawing techniques (Rodgers, this volume (Chapter 7)). Scientific visualization is another field that can benefit geovisualization. It is best at representing an object or a single phenomenon or process. Understanding the physical structure of the problem and finding the optimal way to render it are the main tasks. Thus, scientific visualization instruments are often unique to a particular problem. A usual interaction is to navigate through different (virtual) views of the object or phenomenon of interest. Since geographic inquiry tends to involve real world phenomena that have changing locations in 3D space and time, geovisualization can borrow from scientific visualization realization/rendering expertise (Wood et al., this volume (Chapter 14)). This includes the development and testing of hardware-based advances (see D611ner, this volume (Chapter 16); Kirschenbauer, this volume (Chapter 18)) and those that develop software solutions to support interaction, often across multiple linked views (for example, Lopes and Brodlie, this volume (Chapter 14); Roberts, this volume (Chapter 8)). The common theme of all disciplines concerned with visualization is the exploration of a scenario (problem, phenomenon, data or object). By interacting closely with graphical representations, the user may better understand the data, gain information from it and so acquire knowledge of the phenomenon under study. Although there may be differences in focus, skills, ideals or terminology, interdisciplinary projects should be encouraged and the creation of instruments that borrow from advances and methods in a variety of related domains offers a clear rationale for the range of approaches to creating instruments for geovisualization and continued development.
5.7
Interoperability
The increasing requirement to integrate expertise with specialist knowledge and skills, and the call for user, data and task-specific solutions, indicate a need for systems to be interoperable. Indeed, Geography itself can be viewed as the integration of perspectives, which is reflected in our constant requirement to reach beyond ourselves to find new instruments to address emerging problems. Consequently, some consider the whole issue of open systems for geovisualization to be a long-term major concern: that analyses should not be limited to tools developed by individuals (see Gahegan, this volume (Chapter 4)). One way to achieve this goal is to reduce or remove the need for any prior agreement concerning the way in which major parts of a system (sometimes termed "components") interact. Additionally, no single individual has the resources needed to develop the ultimate geovisualization system that can accommodate the various tasks, users, data and other factors that we have considered here. But effective systems could be built
118
G. Andrienko et al.
Figure 5.1. Levels of inter-operability, with the current position in terms of the status of solutions to each of the aspects of interoperability schematically represented.
efficiently, if ways could be found to integrate the wide range of tools available, both within the geovisualization speciality groups and in the wider community of visualization researchers, while maintaining flexibility and extensibility. That is not to say that great things cannot be achieved using existing approaches, but rather this is a call to look forward to the next major challenge - one that must be faced collectively for progress to be made. There are many dimensions to the problem of interoperating visualization tools, and some of these are depicted graphically here. Figure 5.1 illustrates the various levels of abstraction that comprise all facets of the term "interoperability", from the basic connections of machines on a shared network, through the sharing of data, to the fusion of perspectives. At this time, perhaps our most pressing problem is that of consistency of the "world view". This is a concept that covers all assumptions made in relation to semantics, semiotics, user interactions and so on. It is shown as the combination of "interface" and "application and action ontologies" in Figure 5.1. Different user communities and tool developers have different ontological commitments (such as different world views) and different ideas about how one component might interact with another. These can be thought of as types of implied application ontologies (the data models embodied by the tools) and action ontologies (which particular actions are supported, such as linking and brushing). More precisely, the application ontology is the specific way that an application task is conceptualized (in this case by a component or a system). Ideally, an application ontology is shared between components that are collaborating. The action ontology comprises the various actions that are defined by different systems or tools that need to be mapped to other systems and tools, such as linking, brushing, sampling or grouping. While these ontological differences may be small, say within a distinct laboratory (though they need not be) they may be considerable when considering wider
Creating Instruments for Ideation: Software Approaches to Geovisualization
119
communities of researchers discussed in w This will be especially so if their work is motivated by completely different problems or perspectives. This begs the question - to what extent are we able to borrow tools? For example, does the inclusion of spatial data dictate that distinct tools are needed? These questions relate to those that concern some visualization researchers: to what extent can generic techniques and tools meet a variety of general goals? At the moment, we tend to build systems that contain our own ontologies explicitly, hard-coded. We need to either find a way of decoupling graphical functionality from our ontology, and coding it separately, or of re-purposing or wrapping existing ontologies so that we can manipulate them to our own purpose. These issues are studied by a community of researchers under the heading of "problem solving environments", and are well understood, though good solutions are largely elusive (Schuchardt et al., 2001). The sharing of ontologies only solves the conceptual models used and the way in which components interact with various events, by themselves these problems do not guarantee that the combined systems appear to be logically integrated or to have any kind of consistency as far as the user is concerned. Parallel efforts are also required to solve user-interface issues, so that the components assembled appear to be logically consistent in use. For example, it would be desirable for components to use the same look and feel, the same layout guidelines and the same data interfaces. Again this involves decoupling of logical design from user-interface design, and coordination of layout issues among components, preferably at runtime, for the maximum flexibility. Here, interoperability issues overlap with those of usability.
(a)
method of combination
data exchange
(b) level of integration (after Rhyne, 1997)
9
rudimentary
minimal data sharing
(c) ontological agreement of components
data exchange
m, O O
operational
9
consistency of data input/output binding
functional
9
transparent communication
application (data models) action (interaction)
m. (.Q
o 0
o 0 --h
0
libraries of components
merged
9
one comprehensive toolkit
presentation
Figure 5.2. Methods of interaction between components for visualization: (a) method of combination; (b) levels of integration (Rhyne, 1997); (c) level of ontological agreement of components. Note that Rhyne's model was designed specifically for geographic information and scientific visualization systems.
120
G. Andrienko et al.
Rhyne (1997) suggests a plan of interaction that provides a systematic framework to describe this problem - four levels of interaction: rudimentary, operational, functional and merged. These levels are shown in the centre portion of Figure 5.2, alongside representations of the two other integration themes just discussed means of combining tools and level of world view consistency. Rhyne's levels relate specifically to the integration of geographic information and scientific visualization systems, but the concepts are relevant to our more general focus: 1.
2. 3.
4.
The rudimentary interaction level uses the minimum amount of data sharing and exchange. A significant obstacle is the situation where data are the same, but formats different. This requires expansion and adoption of standards for data exchange. Simply encouraging data exchange can however result in advances. A number of the current authors have shared data and applied their own different instruments to address various geovisualization issues and develop unique solutions. The operational level attempts to provide consistency of operation, consistency of data, removal of redundancies and inconsistencies between technologies. The functional level provides transparent communication between the components. Transparent communication implies that they can understand each other, without the use of a third party. The merged level describes toolkits built from the ground up.
Note that the merged level is not necessarily the desired point to be achieved by all systems. It may be inappropriate or infeasible because, for example, the interaction and presentation aspects may be too tightly coupled to be consistent between different systems that it is desired to integrate. So, we might have current systems where we can interoperate across networks, platforms, even share and exchange components, but we cannot make either their ontologies (application and action) or their interfaces agree. Above that we have absolutely no idea about their underlying philosophies since they are not represented explicitly anywhere in the systems. This position is illustrated schematically in Figure 5.1. Whilst various levels of integration of ideas and software components are possible, lessons from attempts to produce common components and standards in Computer Science indicate patchy success. In particular, difficulties arise because of the time taken to decide standards and the increased effort required by developers to meet the requirements. In the worst case, the effectiveness of the component produced can be severely compromised, because the standard does not implement required operations or forces inappropriate behaviour. As technology and perceived requirements change, so may the standards, invalidating legacy components. The evolving open source community offers a developing methodology and considerable experience in managing collaboration from which we can learn. The influence of powerful commercial organizations is also an important issue here. Such organizations can be very reluctant to contribute to coordinated efforts, either maintaining a proprietary system, or driving standards efforts towards their agendas. Yet, good examples exist whereby commercial organizations are successful partners in such projects. The possibility of extending such
Creating Instruments for Ideation: Software Approaches to Geovisualization
121
successes to geovisualization is a motivating challenge and demonstrates that tool developers should not preclude those with commercial interests from engaging in collaboration. The potential rewards of common software approaches are indisputably appealing: the reuse of code avoiding re-inventing the wheel; the effective communication of ideas via the distribution of components; the rapid and efficient development of new tools based on a firm and dependable environment that contains a comprehensive collection of modules representing the current state of the art. And above all interoperability allows us to proceed at speed, to interact with computers rapidly and so quickly design, modify and interact with revealing views of our data to address our need to develop instruments for the reasons cited in this chapter and thus aid the process of ideation.
5.8
Summary
In introducing the variety of approaches and objectives reported in the chapters that follow in this section of Exploring Geovisualization we asked why we invent new instruments and whether we need to do so. The arguments that we have presented identify motivations relating to inter-related changes and variations in the technology and data available, the tasks identified, the skills and experience of users and the availability of associated expertise to fuel our research. These factors demonstrate the wide range of issues that should be considered by those supporting and performing geovisualization and account for the equally varied set of research issues and solutions demonstrated in our work. Our thoughts on interoperability demonstrate an opportunity and identify "re-use" as a key theme that transcends much of our work. At a high level, the re-use of concepts generated by the "ideas chasers" is important, as the advances that they make are adopted, adapted or rejected. Collaboration between people with different skills should be encouraged to foster new ideas. We should not underestimate the importance of ideas re-use as our knowledge of geovisualization improves along with our subject-area expertise. At a more technical level, increasing the various levels of interoperability offers us the opportunity to develop more efficient and flexible instruments to support ideation (see Dykes, this volume (Chapter 13)). And whilst each of the various levels of interoperability that we have identified may be appropriate under certain circumstances each also comes with a set of technical, social, operational and even geovisualization issues that must be resolved. In addition, we believe that tool development has an important pedagogic aspect. When newly exposed to an existing body of tools researchers can sometimes bring novel ideas to the table. Whilst some "wheel re-invention" may take place when developing packages that largely duplicate existing tools, this can be minimized by taking advantage of existing resources and can equip researchers with the capabilities to develop new tools that expand upon and enhance current technology and techniques and address some of the issues raised here.
122
G. Andrienko et al.
In this introduction, we have asked more questions than we have answered. However, further reading will show the "richness" of approaches represented by the chapter authors as each strives to create and use instruments for ideation relevant to the data, questions, tasks, and expertise that they and their users are interested in as technology advances. These solutions will undoubtedly be different, and will change as technologies, expectations and knowledge develop.
Acknowledgements This multi-authored effort requires acknowledgment to our various funding bodies, the delegates at the International Cartographic Association Commission on Visualization and Virtual Environments workshop held at City University, London in 2002, who were the source of much discussion and provided invaluable feedback and the anonymous reviewers whose comments were extremely helpful and enabled us to crystallize and augment many of the arguments and perspectives presented.
References Acevedo, W., and Masuoka, P., (1997) "Time-series animation techniques for visualizing urban growth", Computers & Geosciences, 23(4), 423-436. Andrienko and Andrienko (1999a). Seasonal Migration of White Storks, 1998-1999. Online: http://www.ais.fhg.de/and/java/birds/(23/10/03). Andrienko, G., and Andrienko, N., (1999b) "GIS visualization support to the C4.5 classification algorithm of KDD", Proceedings of the 19th International Cartographic Conference, pp. 747-755. Andrienko, G., and Andrienko, N., (1999c) "Knowledge-based visualization to support spatial data mining", Proceedings of Intelligent Data Analysis. Berlin: Springer Verlag, pp. 149-60. Andrienko, G., and Andrienko, N., (1999d) "Making a GIS intelligent: Common GIS project view", AGILE'99 Conference, Rome, April 15-17, pp. 19-24. Andrienko, G. L., and Andrienko, N. V., (19990 "Interactive maps for visual data exploration", International Journal Geographic Information Science, 13(4), 355-374. Andrienko, N., Andrienko, G., Savinov, A., Voss, H., and Wettschereck, D., (2001) "Exploratory analysis of spatial data using interactive maps and data mining", Cartography and Geographic Information Science, 28(3), 151-165. Andrienko, N., Andrienko, G., and Gatalsky, P., (2003) "Exploratory spatio-temporal visualization: an analytical review", Journal of Visual Languages and Computing, 14(6), 503-514. Becker, R. A., Cleveland, W. S., and Wilks, A. R., (1987) "Dynamic graphics for data analysis", Statistical Science, 2(4), 355-395. Bertin, J., (1983) Semiology of Graphics: Diagrams, Networks, Maps. Madison, Wisconsin: University of Wisconsin Press.
Creating Instruments for Ideation: Software Approaches to Geovisualization
123
Boukhelifa, N., Roberts, J. C., and Rodgers, P. J., (2003) "A coordination model for exploratory multi-view visualization", Proceedings of Coordinated and Multiple Views in Exploratory Visualization (CMV2003), IEEE, (July 2003). Brodlie, K. W., Carpenter, L. A., Earnshaw, R. A., Gallop, J. R., Hubbard, R. J., Mumford, A. M., Osland, C. D., and Quarendon, P., (eds.), (1992) Scientific Visualization, Techniques and Applications. Berlin, Heidelberg: Springer-Verlog. Brooks, F. P. J., (1995) The Mythical Man-Month: Essays on Software Engineering, Addison-Wesley. Cartwright, W., Crampton, J., Dykes, J., Gartner, G., Miller, S., Mitchell, K., Siekierska, E., and Wood, J., (2001a) "User interface issues for spatial Information Visualization", Cartography and Geographic Information Systems, 28(1), 45-60. Casner, S. M., (1991) "A task-analytic approach to the automated design of graphic presentations", A CM Transactions on Graphics, 1O, 111-115. Cleveland, W. S., (1993) Visualizing Data. Summit, NJ: Hobart Press. Computer Science and Telecommunications Board (2003). CSTG Publication: IT Roadmap to a Geospatial Future. Online: http ://www7.nationalacademies.org/c stb/pub_geospatialfuture.html (23/10/03 ). Dykes, J. A. and Mountain, D. M., (2003) "Seeking structure in records of spatiotemporal behaviour: visualization issues, efforts and applications", Computational Statistics and Data Analysis, 43(Data Visualization II Special Edition), 581-603. Online: http://www, soi.city.ac.uk/--j ad7/csda/ Fabrikant, S. I., (2000a) Spatial Metaphors for Browsing Large Data Archives, Department of Geography, University of Colorado-Boulder. Fabrikant, S. I., (2000b) "Spatialized browsing in large data archives", Transactions in GIS, 4(1), 65-78. Fairbairn, D., Andrienko, G., Andrienko, N., Buziek, G., and Dykes, J. A., (2001) "Representation and its relationship with cartographic visualization: a research agenda", Cartography and Geographic Information Sciences, 28(1), 13-28. Fayyad, U., Piatetsky-Shapiro, G., and Smyth, P., (1996a) "The KDD process for extracting useful knowledge from volumes of data", Communications of the A CM, 39(11), 27-34. Fayyad, U. M., Piatetsky-Shapiro, G., Smyth, P., and Uthurusamy, R., (1996b) Advances in Knowledge Discovery and Data Mining. Cambridge, MA: AAAI-Press/ MIT-Press. Gahegan, M., (1998) "Scatterplots and scenes: visualization techniques for exploratory spatial analysis", Computers, Environment and Urban Systems, 22(1), 43-56. Gahegan, M., Harrower, M., Rhyne, T.-M., and Wachowicz, M., (2001) "The integration of geographic visualization with databases, data mining, knowledge construction and geocomputation", Cartography and Geographic Information Science, 28(1), 29-44. Grudin, J., (1989) "The case against user interface consistency", Communications of the ACM, 32(10), 1164-1173. Jung, V., (1995) "Knowledge-based visualization design for geographic information systems", Proceedings 3rd ACM Workshop on Advances in GIS, ACM Press, pp. 101-108.
124
G. Andrienko et al.
Keim, D., and Kriegel, H.-P., (1996) "Visualization techniques for mining large databases: a comparison", IEEE Transactions on Knowledge and Data Engineering (Special Issue on Data Mining), 8(6), 923-938. Knapp, L., (1995) "A task analysis approach to the visualization of geographic data", In: Nyerges, T. L., Mark, D. M., Laurini, R., and Egenhofer, M. J., (eds.), Cognitive Aspects of Human-Computer Interaction for Geographic Information Systems. Dordrecht: Kluwer Academic, pp. 355-371. Kumar, H. P., Plaisant, C., and Shneiderman, B., (1997) "Browsing hierarchical data with multi-level dynamic queries and pruning", International Journal of HumanComputer Studies, 46(1), 105-126. MacEachren, A. M., (1994a) Some Truth with Maps: A Primer on Symbolization and Design. Washington: Association of American Geographers. MacEachren, A. M., (1994b) "Time as a cartographic variable", In: Hearnshaw, H., and Unwin, D., (eds.), Visualization in Geographical Information Systems. Chichester: Wiley, pp. 115-130. MacEachren, A. M., (1994c) "Visualization in modern Cartography: Setting the agenda", In: MacEachren, A. M., and Taylor, D. R. F., (eds.), Visualization in Modern Cartography. Oxford: Pergamon, pp. 1-12. MacEachren, A. M., Wachowicz, M., Edsall, R., Haug, D., and Masters, R., (1999) "Constructing knowledge from multivariate spatiotemporal data: integrating geographical visualization with knowledge discovery in database methods", International Journal of Geographical Information Science, 13(4), 311-334. McCormick, B. H., DeFanti, T. A., and Brown, M. D., (eds.), (1987) "Visualization in scientific computing", Computer Graphics, 21 (6). Peuquet, D. J., and Kraak, M. J., (2002) "Geobrowsing: creative thinking and knowledge discovery using geographic visualization", Information Visualization, 1, 80-91. Qian, L., Wachowicz, M., Peuquet, D., and MacEachren, A. M., (1997) "Delineating operations for visualization and analysis of space-time data in GIS", GIS/LIS'97, Cincinnati, Oct. 28-30, pp. 872-877. Rana, S. S., and Dykes, J. A., (2001) "Augmenting animated maps with morphometric surface derivatives", GeoComputation. Brisbane, Australia: University of South Australia. Rana, S. S., and Dykes, J. A., (2003) "A framework for augmenting the visualization of dynamic raster surfaces", Information Visualization, 2(2), 126-139. Rhyne, T.-M., (1997) "Going virtual with geographic information and scientific visualization", Computers & Geosciences, 23(4), 489-491. Roberts, J. C., (2000) "Multiple-view and multiform visualization", In: Erbacher, R., Pang, A., Wittenbrink, C., and Roberts, J., (eds.), Visual Data Exploration and Analysis VII, Proceedings of SPIE, pp. 176-185, Online: http://www.cs.kent.ac.uk/pubs/2000/963/index.html Schuchardt, K., Myers, J., and Stephan, E., (2001) "Open data management solutions for problem solving environments: application of distributed authoring and versioning to the extensible computational chemistry environment", Proceedings of the Tenth
Creating Instruments for Ideation: Software Approaches to Geovisualization
125
International IEEE Symposium on High Performance Distributed Computing (HPDC 10), San Francisco, CA, August 7-9. Shifter, M. J., (1995a) "Environmental review with hypermedia systems", Environment and Planning B: Planning & Design, 22, 359-372. Shifter, M. J., (1995b) "Multimedia representational aids in urban planning support systems", In: Marchese, F. T., (ed.), Understanding Images - Finding Meaning in Digital Imagery. New York: Springer, pp. 77-90. Shneiderman, B., (1996) "The eyes have it: a task by data type taxonomy for Information Visualizations", Proceedings IEEE Symposium on Visual Languages. Washington: IEEE Computer Society Press, pp. 336-343. Shneiderman, (1998) Treemaps for Space-Constrained Visualization of Hierarchies. Online: http://www.cs.umd.edu/hcil/treemaps (23/10/03). Shrager, J., and Langley, P. E., (1990) Computational Models of Scientific Discovery and Theory Formation. San Mateo, CA: Morgan Kaufman. Slocum, T. A., Blok, C., Jiang, B., Koussoulakou, A., Montello, D. R., Fuhrmann, S., and Hedley, N. R., (2001) "Cognitive and usability issues in geovisualization", Cartography and Geographic Information Science, 28(1), 61-75. Stuetzle, W., (1988) "Plot windows", In: Cleveland, W. S., and McGill, M. E., (eds.), Dynamic Graphics for Statistics. Belmont, Ca: Wadsworth Inc., pp. 225-245. Tufte, E. R., (1983) The Visual Display of Quantitative Information. Cheshire, CT: Graphics Press, p. 197. Tufte, E. R., (1997) Visual Explanations: Images and Quantities, Evidence and Narrative. Cheshire, CT: Graphics Press, p. 156.
This Page Intentionally Left Blank
Exploring Geovisualization J. Dykes, A.M. MacEachren, M.-J. Kraak (Editors) 9 2005 Elsevier Ltd. All rights reserved.
Chapter 6
Statistical Data Exploration and Geographical Information Visualization Martin Theus, Department of Computer-Oriented Statistics and Data Analysis, University of Augsburg, Universit~itsstr. 14, 86135, Augsburg, Germany
Keywords: exploratory data analysis (EDA), statistical thinking, selection and linked highlighting, high interaction user interfaces, large data sets
Abstract Geographical Information Systems (GIS) and statistical data analysis systems have a lot in common. Although the geographical reference is the dominant aspect of geographical data, these data can draw upon statistical principles and methodologies to be investigated thoroughly. Much of statistical data analysis has its roots in mathematics whereas most of geovisualization draws most directly from cartography. Today, both fields make heavy use of computing power and computer graphics and take advantage of highly interactive interfaces. Several software packages have been developed to either incorporate geographical information into interactive statistical software (e.g., REGARD, MANET or Mondrian) or vice versa to incorporate statistical graphics into GIS and geovisualization environments (e.g., GeoVISTA Studio, cdv or Decartes). This chapter investigates the overlap and differences between the two areas, and identifies a possible synergy between statisticians and geographers in the light of geovisualization. The current, increasingly common and shared challenges associated with the visualization of very large data sets are also discussed. Cartographic and statistical techniques may well be employed in unison to address these issues.
6.1
Introduction
This chapter is written from the perspective of a statistician, thus focusing on the analysis of the data of a geographical referenced data set and the integration of these analyses within the geographical context. Exploratory data analysis (EDA) has been widely adopted by many disciplines beyond statistics. For these methods to be applied appropriately, the statistical background of EDA should be considered and drawn upon. The roots and aspects of EDA are reviewed in w and the most important interactive techniques developed in EDA are presented in w and w Most of the examples 127
128
M. Theus
and implementations presented derive from research projects the author has been involved in over the last 10 years. These software issues are discussed in a general context in w and w from the perspective of a software developer. An outlook on the current and impending challenges associated with large data sets that draws upon this experience is provided in w
6.2
Exploratory Statistics
EDA was formally introduced by J. W. Tukey with his seminal book, first published in 1977 (Tukey, 1977). The ideas gathered in the book loosened the strict corset of mathematical concepts and introduced a more exploratory view of data analysis. In contrast to mathematical statistical thinking m which needs to set up hypotheses before looking at the d a t a - EDA suggests a more descriptive way of looking at data. Graphic depictions and numeric summaries of data are the key concepts in EDA. The predominance of graphical and descriptive methods as against optimal, mathematical methods has fluctuated throughout the history of statistics as depicted graphically in Figure 6.1. Statistics was dominated by mathematical statistics in the early 20th century, when many breakthroughs were made in the foundations of statistical theory. It took 50 more years and the upcoming availability of computers until EDA methods were introduced. To get a better idea of what is gathered behind the term EDA, one can look at some of the most important headings in Tukey's book. The first chapter, called "Scratching Down Numbers", promotes the idea of actually looking at the raw numbers IL
descriptive graphical large samples
computational/ power / /~,
tables
# graphs
9ED
~ T u k e y
Graunt "~~'~Arbuthnot ~ D u t n ~
~ ~layfair /Gauss ~
K. Pearson ~ \
/
/ /
Wald
Neyman
small samples mathematical F' optimal
mathematical insight
Figure 6.1. Schematicrepresentationof the fluctuating predominanceof the two major paradigms in statistics over the last 200 years.
Statistical Data Exploration and Geographical Information Visualization
~1 Data II
Hypothesis
I~1761 ..I Statistical I
129
Conclusions
LiRfeSri ] dUtlonl Figure 6.2. An illustration of the linear, hypothesis-based workflow of classical statistical reasoning.
of a data set. Stem-and-Leaf plots are maybe the best-known representatives in this class. In the second chapter "Schematic Summaries," Tukey advocates the use of pictures and tables. "Easy Re-expression" is the title of the third chapter, covering various transformation procedures, which either make data more "normal", or reveal new information. Looking at different subgroups or transformations of data is described in Chapter 4 "Effective Comparison". EDA does not ignore classical statistics, but is well aware of the benefits of probability theory, which is reflected in Chapters 19, "Shapes of Distribution" and 20 "Mathematical Distributions". In the Appendix of the book, Tukey dedicates a whole section on "Our relationship to the computer", which might have been a bit peculiar in 1977, given the relative scarcity of powerful computers in the late 70s. Tukey formulated his ideas in times where computers were expensive, non-interactive and non-graphical. This makes him in some sense a visionary, because he was able to imagine tools and techniques that were not available at that time. Today computers are powerful and cheap enough to support all of these exploratory techniques as some of the instruments for exploration described in this chapter demonstrate. The strictly linear thinking typical of classical statistics is shown in Figure 6.2. In contrast, Figure 6.3 represents the iterative work flow embraced by EDA. It is important to understand that there is no fixed set of tools for EDA. Certain graphical explorations might be useful for one data set but less helpful for another data set. Furthermore, we might re-run different methods in the light of newly revealed structures in an iterative process of exploration and confirmation and/or rejection. Exploratory spatial data analysis (ESDA), is the natural extension of EDA thinking and methods towards geographical problems. ESDA dates back as far as the late 1980s, when desktop computers offered the first implementations of EDA, which were soon extended with geographical components (see Unwin and Unwin (1998)). Mark Question to ~
Explorative
Solutions
) ~
I Revealed Structure 1
Figure 6.3. An illustration of the iterative process used in EDA.
130
M. Theus
Table 6.1.
Five stages of implementing a GIS.
Statistics 1. 2. 3. 4. 5.
Data Input Data Manipulation Data M a n a g e m e n t Query and Analysis Visualization
Cartography
Data(base)Management 9
9
o 9
9 9
o
o 9
Monmonier's work describes the possible synergy between EDA and geographical analysis and resulted in example software (Monmonier, 1988, 1989). This was later developed to produce more powerful tools for ESDA.
6.3
Technologies for Data Exploration
When working with a geographic information system, essentially five tasks are performed. Table 6.1 classifies these five tasks according to the use of methods from statistics, cartography and data(base) management (Theus, 2002a). Solid circles indicate a strong impact, open circles a weaker impact of each field on the five activities. Steps 4 and 5 are typical domains where exploratory statistics can be applied. Whereas geo-scientists can learn a lot from computer scientists regarding tasks 1-3 (Gahegan et al., 2001), statisticians could well be the most influential source of ideas for activities 4 and 5. Interactive environments blend steps 4 and 5 together, offering flexible query and analysis methods within the tool for geographical visualization. This results in a much stronger role for cartography on tasks involving "Query and Analysis" in the future (e.g., map algebra might be considered a rather cartographic method contributing to the task of query and analysis).
6.4
Interactive Techniques
Tasks involving both query and analysis and visualization can draw upon a number of forms of interaction. These include the following generic techniques.
6.4.1
Selection and linked highlighting
Selection and linked highlighting are the basic interactive operation required by EDA. The collection of early papers presented in Cleveland and McGill (1988) remains an excellent source. These techniques support dynamic linking of information between various kinds of graphs and/or tables, in order to increase the number of dimensions that we are able to consider concurrently. Any case that is selected in one plot is graphically highlighted in all other plots. Selections can be quite complex, when they include different variables using Boolean operators such as "AND", "OR" or "XOR". Hofmann (1998) and Theus et al. (1998) discuss the benefits of advanced selection mechanisms in interactive data analysis systems.
Statistical Data Exploration and Geographical Information Visualization
131
In a static environment, maps and/or other graphic depictions are typically used for communicating fixed results. Thus, such maps often incorporate information on several variables at a time. In contrast, maps in a dynamic environment will support various linked interactions, allowing the user to focus in on fewer variables at a time. In a geographical context, linking can be used to create a dynamic connection between any kind of information and a graph, or a map. Figure 6.4 shows an example of census data of the Midwest of the USA (Stynes, 1996). In the figure, a parallel coordinate plot (Inselberg, 1985; Wegman, 1990) is linked with the corresponding map by highlighting corresponding cases in each.
6.4.2
Re-ordering
The ordering of graphic objects is an important consideration, whether it is the variables contributing to a parallel coordinate plot (depicted as axes), the orthogonal axes of a scatter plot, or the categories in a barchart. In most visualization tools, this is determined by some initial default. In a spatio-temporal context, a flexible re-ordering of the temporal information is at the core of an interactive analysis. A carefully designed graph might specify the ordering explicitly. In an interactive analysis, we want to be able to reorder objects immediately. All other linked graphs should update to the new ordering immediately where ever the change applies.
6.4.3
Re-expression
When interactively working with maps, operations like zooming and panning are indispensable. As long as the zoom levels do not exceed a factor of about 10, it is possible to work within a single map of a fixed resolution. Higher zoom levels need an implementation of dynamic, on-the-fly maps with different resolutions, leading to the concept of logical zooming (Unwin, 1999). Kraak and Ormeling (1996) discuss zooming in a geographical context as "change of scale" more generally, although changing scale of display and data model should not be confused. There is a need for logical zooming in classical statistical graphics as well, as the amount of data increases either in terms of the number of observed cases or the number of variables recorded. Whereas methods of logical zooming have been well know in Geography for years, addressing this issue is a new challenge for statisticians and data analysts. Plots such as scatter plots and parallel coordinate plots can suffer badly from very large data sets due to heavy over plotting. For scatter plots, one solution is to bin data - i.e., to summarize the data by deriving densities on an imposed 2D grid. When zooming in, the amount of data in the zoomed area can be expected to decrease, until the zoomed view is capable of showing discernible symbols for each measurement once again. Figure 6.5 shows an example of a scatter plot of over 300,000 observations. The data depict financial transactions from an undisclosed financial institution. The scatter plots show the transaction amount and an associated transaction fee in Deutsch Mark. The three leftmost plots show binned data, whereas the rightmost plot shows individual points. The data show extreme self-similarity at almost
132
M. Theus
O
.t-.,, rt ~ "O x_
0 0 o
0 "0 c Q..
E
,n: L_
O'J I,k
Statistical Data Exploration and Geographical Information Visualization
133
Figure 6.5. Zooming into 300,000 points. Plots (a), (b) and (c) use binning to approximate the scatter plot as zooming occurs. Plot (d) shows the 4500 points in the zoomed area, which is 3.9 x 1027 the area of plot (a).
any level of zooming, revealing artifacts (accumulations at thresholds of one variable) of different severity the deeper we zoom in. Logical zooming can be applied to other statistical graphs as well, when the number of cases and/or variables is large. For example, mosaic plots (Hartigan and Kleiner, 1981; Friendly, 1994) benefit from logical zooming, with large numbers of variables and/or categories. Another application of re-expression is to change the color-coding of choropleth maps. Whilst plenty of rules, hints and suggestions are available concerning appropriate color-coding in specific cases (see Brewer (1994)), in an interactive analysis one may need to explore many different codings to reveal patterns and structure and assess their stability. Changing the mapping must be easy and happen instantaneously to help users find structures and pattern in the data efficiently. In contrast to a static choropleth map, which typically uses a specific color scheme determined by the domain problem, interactive choropleth maps for general problems work best with a very simple color scale that does not suggest false interpretations. Unwin and Hofmann (1998) suggest an S-shaped transfer function to map data values
134
M. Theus
Figure 6.6. An example of the transfer-function Equation (6.1) implemented in MANET (left). A collection of four different parameter settings of the transfer-function Equation (6.1) (right).
to (grey-) shades using two parameters a and b. This function also supports the mapping of color scale ranging between two selected hues. ColorBrewer (Brewer and Harrower, 2002; Harrower and Brewer, 2003) can be used as an experimental guide. The S-shaped transfer function is defined as:
f(x) := a(x/a) b
for
x --< a
f(x) := 1 - (1 - a)((1 - x)/(1 - a)) b
for
x>_a
and (6.1)
The parameter a(0 -< a -< 1) determines the centering and b(0 -< b < oo) the form. An example of the proposed transfer-function to map data values to shades of grey is provided in Figure 6.6. The left-hand graphic shows the implementation in the MANET software (Unwin et al., 1996). A map of the US Midwest dataset is shown. The map is shaded according to the absolute population in the counties. The distribution is extremely skewed due to the few big cities - a condition that holds true if population density would be plotted instead due to the relatively minor variation in county area. Thus, parameters have been chosen that show differences between counties of smaller population or population density as well as the extreme outliers associated with the cities. MANET allows the specification of these parameters via sliders and updates the map instantaneously. Furthermore, the bounds of the transformed variable are displayed. The right-hand graph in Figure 6.6 shows four different parameter settings of the transfer function, illustrating its flexibility.
6.4.4
Interrogation
The ability to interrogate is a key feature of interactive systems for E(S)DA. Whenever the analyst identifies structures, anomalies or other interesting features, interrogation allow us to follow up on these structures to prompt thought with immediacy and ease. We can delineate various steps of interrogation: The simplest step is to just give an overview of where the cursor is located within the current coordinate system.
Statistical Data Exploration and Geographical Information Visualization
9
9 9
135
A more detailed query gives the values of the variables actually displayed in the plot (e.g., clicking on a point in a scatter plot gives the exact x- and y-coordinates of that point or object). The same query can also give information on variables not displayed in the graph. Going even further, an interrogation can give us the whole statistics on an object or collection of objects (e.g., clicking on a polygon can result in a local statistic, e.g., z-score.)
Furthermore, we can distinguish between contiguous interrogations and distant information display. Contiguous interrogation displays the information directly next to the location of the object that was queried, i.e., usually at the position of the mouse pointer. Distant interrogations show the information in an extra window preferably a floating window. Figure 6.7 shows two forms of interrogation - an example of an extended contiguous interrogation within Mondrian (Theus, 2002b) and a distant interrogation as implemented in cdv (Dykes, 1995, 1998). Fekete and Plaisant (1999) introduce another taxonomy of interrogations, based on the problem of placing labels of objects most efficiently without over plotting the labels. Whereas the problem described here deals with displaying multiple information components for a single object they try to solve the problem of displaying a single label for multiple nearby objects. This is an issue that has also received much attention from the cartographic community as techniques for automated map-making have taken advantage of sophisticated name placement algorithms. 6.5
Software
Tools
Most of the concepts discussed thus far have been implemented in software. In general, we can categorize these software tools according to three defining characteristics through which they differ: 1.
the range of statistical analysis types available;
Figure 6.7. An example of distant interrogation in cdv - the information is displayed in the upper left (left). Mondrian shows the information directly at the queried object (right).
136
M. Theus 2. 3.
the level of interactivity for an exploratory analysis provided by the system; the degree to which geographical information can be incorporated.
These three characteristics can be used to assess the capabilities of the different tools. At least, three approaches to tool development have been attempted. These relate to development of statistical tools for EDA and geographic analysis, the development of mapping tools to incorporate interactivity and EDA and formal links between commercial GI packages and statistical software, for example, (see Andrienko et al., this volume (Chapter 5)). Most classical statistics software is strong on characteristic 1, and typically offers a wide variety of analysis methods. These are seldom interactive and thus hardly suitable for an exploratory analysis. It is rare that such software offers any means for analyzing geographical data (i.e., the ability to plot, vary and manipulate maps, raster images, flows and other representations of spatial data). Software such as REGARD (Unwin, 1994), MANET or Mondrian are designed for analyzing data interactively and additionally offer basic means of plotting statistical maps, which are fully integrated in the interactive context. cdv and Descartes (Andrienko and Andrienko, 1999) have been developed to offer interactive interfaces for Information Visualization with a geographic focus. Here, the primary display is a map showing the spatial locations of the data. Such software has considerable strengths in terms of the various types of interactive map that are supported, but does not offer the advanced tools for statistical analysis such as that available in EDA software. Another approach to providing EDA capabilities for geographic data is the component-based model implemented in the GeoVISTA Studio software (Gahegan et al., 2001). The result is an extensible and interactive Java-based visual programming environment that allows for the rapid, programming free development of complex data visualization, exploration and knowledge construction applications to support geographic analysis. Finally, classical GIS cover a wide range of aspects of cartography and geographic data management and offer a variety of specialist spatial features. The level of interactivity provided by commercial GIsystems is usually poor and tools for EDA are frequently either absent or of limited scope. Cook et al. (1996) employed a methodology for increasing the EDA capabilities of geographic information systems by incorporating highly interactive statistical graphics into a commercial GIS. Their ArcView/XGobi-Link project resulted in linkages between the XGobi statistical package and the ArcView GIS. This link relies upon the two software tools running in parallel and communicating via remote procedure calls. A review of other similar approaches that employ such links is provided by Symanzik et al. (2000). Additional details on the different types of interactive tools and the benefits of interfaces and various forms of tool integration are offered by Unwin and Hofmann (2000) and Shneiderman (1994).
Statistical Data Exploration and Geographical Information Visualization
6.6
137
Development Environments
When reviewing the systems presented in w it is worth noting that the degree of overlap between tools is relatively minor, despite the inclusion of a variety of statistical functions, high interactivity and a complete set of geographic visualization tools. On the one hand this could just mean a lack of suitable systems, on the other hand it could also mean that the workflow in geographic data visualization is performed in two stages: firstly, exploratory analysis is performed, then secondly once findings are obtained a (static) graphical representation is generated for purposes of communication. When considering the [Cartography] 3 diagram (Figure 6.8) (Kraak and Ormeling, 1996, adapted from MacEachren and Taylor, (1994)), we find high interaction positioned in the opposite corner of the [Cartography] 3 designed for public presentation. This might be an explanation as to why no single tool serves all the needs on the path from the lower left of the cube to the upper right. Thus the development environment required for geovisualization will most probably include more than one "tool" to cover each of the steps in an exploration/visualization/presentation process. Gahegan, this volume (Chapter 4) offers some thoughts on the processes associated with undertaking geovisualization and their (inter) relationships. Different tools are designed for particular types of process and have particular strengths. A brief parable may help illustrate this point. Today we are able to buy an integrated microwave/grill/oven appliance, which would have been three single appliances 20 years ago. Although many of us will be happy with the advantages of the integrated version (space saving, multi-functional and easy to
Figure 6.8. The [Cartography]3 (adapted from MacEachren and Taylor (1994)). The schematic diagram displays the relationship between exploration, analysis and presentation in a map based information system.
138
M. Theus
use), a professional cook still might want to have the single appliances at the highest possible specification due to their concerns with performance. This distinction can also be found in statistics. A highly interactive environment usually does not plot the data in a way that is presentable, whereas presentation graphics usually cannot be used for exploration. On the other hand, if we think of the visualization/presentation side of an interactive environment with user interaction as well, this distinction can no longer be made that strictly. Although this approach would combine all steps into a single system, such an approach demands many more skills from the user than a static solution would do.
6.7
Very Large Data
EDA came into being at times when data set sizes were small ( < 100 cases) or medium ( < 10,000 cases) in size As data sets grew in size and associated challenges became apparent, a new field emerged, known as datamining and knowledge discovery in databases (for example, Fayyad et al., 1996). Although classical mathematical statistics cannot cope well with large data sets, the methods of EDA are still valid here (Carr et al., 1987 provide an early example). The management of very large data sets can only be guaranteed to be efficient, if database systems are used. A domain specific storage strategy is needed, to assure best results. "Large" can mean many cases (> 100,000) and/or many variables (> 50). In both situations, classical methods usually fail to provide an insight into the data. Certainly, not all summaries and graphics used in exploratory analysis scale up to large data sets (for a discussion of scaling problems of statistical graphs, see Theus (2004)). Note that this classification deviates from Huber's first taxonomy, which he set up before the era of datamining and KDD. The classification presented here, reflects the current practice of statisticians and computer scientists working in the area of datamining applications and tool development. When plotting millions of objects, graphs get cluttered and new graphing techniques have to be investigated. One solution to avoid over plotting is to use oL-channel transparency, where over plotting points add their color values, resulting in very saturated areas of high density and light areas of low density (Cook et al., 2004). Figure 6.9 left
Figure 6.9. Example of oL-channel transparency. Each plate has an opacity of 25%.
Statistical Data Exploration and Geographical Information Visualization
139
shows an example of 4 black plates, each having a transparency level of 75% thus an opacity level of 25 %, respectively. As the plates overlap, the intersecting area gets darker, indicating the higher density of objects. Figure 6.9 right shows the same example with two red plates. This second example shows some of the difficulties associated with interpreting combinations of more than one hue when using oL-channel transparency. Other more specific solutions need also to be developed to address this issue. Investigating hundreds of variables can be very cumbersome. A combination of automated selection procedures together with a strong interactive component are likely to be the most productive methods for handling such data. Solutions that address the issues related with very large data sets are likely to apply to geovisualization tools as well as those for EDA. Indeed, issues associated with the visual analysis of very large geographical data sets are even more acute as the need to depict spatial relations means that the graphical representation of geographical phenomena offers fewer degrees of freedom than are available for the graphical depiction of arbitrary statistical data.
6.8
Conclusions
Specialised instruments that provide interactive statistical graphics are the most significant tool for EDA. Most of the interactive functionality can be applied in the context of geovisualization as well. Linked highlighting, re-expressions and interrogation are the fundamentals of interactivity. EDA methods complement the statistical data analysis part of a geographical data exploration. The systems currently available already cover a broad range of functionality and visualization. Nonetheless, it is desirable to add more functionality, by either extending the single systems or by extending the interoperability of different systems in order to make use of various components. Whilst efforts to connect data and resources continue (see Schroeder, this volume (Chapter 24)) the seamless integrate of systems developed for a very informal, exploratory workflow with those that support highquality presentation and communication of final results of an analysis remains problematic. Novel, component-based systems may offer increasingly customizable interactive presentations that guide the user to specific findings in the geographic data, and thus may overcome this separation. The various issues associated with the depiction and interactive analysis of very large data sets constitutes an area of high potential for synergy between those with skills in developing tools for EDA, ESDA and datamining. Such data sets do not only pose new questions for data storage and handling, but point towards new analysis tools and techniques. Only a close integration of expertise in all related fields can lead to effective new solutions.
Acknowledgements The author would like to thank the participants of the ICA workshop at City University London in September 2002 for their interaction and fruitful discussions. Furthermore,
140
M. Theus
thanks go to the reviewer for their thorough work on the chapter, which substantially improved and enriched it. This manuscript was prepared while the author was visiting the Department of Statistics, at Iowa State University, ISU. References Andrienko, G. L., and Andrienko, N. V., (1999) "Interactive maps for visual data exploration", International Journal Geographic Information Science, 13(4), 355-374. Brewer, C. A., (1994) "Color use guidelines for mapping and visualization", In: MacEachren, A. M., and Taylor, D. R. F., (eds.), Visualization in Modern Cartography, Vol. 2. Oxford: Elsevier Science Ltd., pp. 123-148. Brewer, C. A., and Harrower, M., (2002) ColorBrewer - Selecting Good Color Schemes for Maps. Online: http://www.personal.psu.edu/faculty/c/a/cab38/ColorBrewerBeta.html (23/10/03). Carr, D. B., Littlefield, R. J., Nicholson, W. L., and Littlefield, J. S., (1987) "Scatterplot matrix techniques for large N", Journal of the American Statistical Association, 82(398), 424-436. Cleveland, W. S., and McGill, M. E., (1988) Dynamic Graphics for Statistics. Belmont, CA: Wadsworth. Cook, D., Majure, J. J., Symanzik, J., and Cressie, N., (1996) "Dynamic graphics in a GIS: exploring and analyzing multivariate spatial data using linked software", Computational Statistics: Special Issue on Computeraided Analysis of Spatial Data, 11 (4), 467-480. Cook, D., Theus, M., and Hofmann, H., "The binned scatterplot", Journal of Computational and Graphical Statistics, (in preparation). Dykes, J. A., (1995) "Cartographic visualization for spatial analysis", In: Proceedings 17th International Cartographic Conference, Barcelona, pp. 1365-1370. Dykes, J. A., (1998) "Cartographic visualization: exploratory spatial data analysis with local indicators of spatial association using TCL/TK and cdr", The Statistician, 47(3), 485-497. Fayyad, U. M., Piatetsky-Shapiro, G., Smyth, P., and Uthurusamy, R., (1996) Advances in Knowledge Discovery and Data Mining. Cambridge, MA: AAAI-Press/MIT-Press. Fekete, J.-D., and Plaisant, C., (1999) "Excentric labeling: dynamic neighborhood labeling for data visualization", In: Proceedings of ACM Conference on Human Factors in Computing Systems, CHI '99. New York: ACM Press, pp. 512-519. Friendly, M., (1994) "Mosaic displays for multi-way contingency tables", Journal of the American Statistical Association, 89(425), 190-200. Gahegan, M., Harrower, M., Rhyne, T.-M., and Wachowicz, M., (2001) "The integration of geographic visualization with databases, data mining, knowledge construction and geocomputation", Cartography and Geographic Information Science, 28(1), 29-44. Harrower, M., and Brewer, C. A., (2003) "ColorBrewer.org: an online tool for selecting colour schemes for maps", The Cartographic Journal, 40(1), 27-37, Online: http://www.colorbrewer.org
Statistical Data Exploration and Geographical Information Visualization
141
Hartigan, J. A., and Kleiner, B., (1981) "Mosaics for contingency tables", In: Eddy, W. F., (ed.), Computer Science and Statistics: Proceedings of the 13th Symposium on the Interface, New York, Springer, pp. 268-273. Hofmann, H., (1998) "Selection sequences in MANET", Computational Statistics, 13( 1), 77-87. Inselberg, A., (1985) "The plane with parallel coordinates", The Visual Computer, 1, 69-91. Kraak, M. J., and Ormeling, F. J., (1996) Cartography - Visualization of Spatial Data, Longman. MacEachren, A. M., and Taylor, D. R. F., (1994) Visualization in Modern Cartography. Oxford: Pergamon. Monmonier, M., (1988) "Geographical representations in statistical graphics: a conceptual framework", 1988 Proceedings of the Section on Statistical Graphics, Alexandria, VA, American Statistical Association, pp. 1-10. Monmonier, M., (1989) "Geographic brushing: enhancing exploratory analysis of the scatterplot matrix", Geographical Analysis, 21 (1), 81-84. Shneiderman, B., (1994) "Dynamic queries for visual information seeking", IEEE Software, 11 (6), 70-77. Stynes, K., (1996) ESDA with LISA Conference: Data for ESDA with LISA. Online: http ://www.mimas.ac.uk/argus/esdalisa/midwest/Data.html (23/10/03). Symanzik, J., Cook, D., Lewin-Koh, N., Majure, J. J., and Megretskaia, I., (2000) "Linking ArcView and XGobi: insight behind the front end", Journal of Computational and Graphical Statistics, 9(3), 470-490. Theus, M., (2002a) "Geographical information systems", In: Kloesgen, W., and Zytkow, J., (eds.), Handbook of Data Mining and Knowledge Discovery, Oxford University Press. Theus, M., (2002b) "Interactive data visualization using Mondrian", Journal of Statistical Software, 7 (11). Theus, M., "Upscaling Statistical Graphics", In: Unwin, A., Theus, M., Hofmann, H., and Wilhelm, A., (eds.), How to Visualize a Million. New York: Springer, (in press). Theus, M., Hofmann, H., and Wilhelm, A., (1998) "Selection sequences - interactive analysis of massive data sets", Proceedings of the 29th Symposium on the Interface: Computing Science and Statistics. Tukey, J. W., (1977) Exploratory Data Analysis. Reading, MA: Addison-Wesley. Unwin, A. R., (1994) "Regarding geographic data", In: Dirschedl, P., and Ostermann, R., (eds.), Computational Statistics. Heidelberg: Physika, pp. 315-326. Unwin, A. R., (1999) "Requirements for interactive graphics software for exploratory data analysis", Computational Statistics, 14, 7-22. Unwin, A. R., and Hofmann, H., (1998) "New interactive graphics tools for exploratory analysis of spatial data", In: St Carver, (ed.), Innovations in GIS 5. London: Taylor & Franics, pp. 46-55. Unwin, A. R., and Hofmann, H., (2000) "GUI and command line - conflict or synergy?", In: Berk, K., and Pourahmadi, M., (eds.), Computing Science and Statistics. Proceedings of the 31st Symposium on the Interface. Unwin, A. R., and Unwin, D., (1998) "Exploratory spatial data analysis with local statistics", The American Statistician, 47(3), 415-421. TM
142
M. Theus
Unwin, A. R., Hawkins, G., Hofmann, H., and Siegl, B., (1996) "Interactive graphics for data sets with missing values - MANET", Journal of Computational and Graphical Statistics, 5(2), 113-122. Wegman, E., (1990) "Hyperdimensional data analysis using parallel coordinates", Journal of the American Statistical Association, 85(411), 664-675.
Exploring Geovisualization J. Dykes, A.M. MacEachren, M.-J. Kraak (Editors) 9 2005 Elsevier Ltd. All rights reserved.
Chapter 7
Graph Drawing Techniques for Geographic Visualization Peter Rodgers, University of Kent, Canterbury, Kent, UK
Keywords: graph drawing, diagram layout, geographic visualization, geovisualization, Information Visualization
Abstract Complex data consisting of related items often occurs in Geography, and is frequently represented as a graph. Examples include travel routes, regional borders, population flow and commerce. The field of graph drawing provides an effective group of techniques to tackle the problem of visualizing such data. This chapter provides a broad background to graph drawing methods and discusses possible future applications of this area to geovisualization.
7.1
Introduction
This chapter overviews the area of graph drawing and discusses its application to the visualization of geographic information. Geovisualizers often need to represent data that consist of items related together. Such data sets can be abstracted to a mathematical structure, the graph. A graph contains nodes and edges where the nodes represent the items or concepts of interest, and the edges connect two nodes together according to some associational scheme. Examples of graph data include: network topologies; maps, where nodes represent towns and edges represent roads; and social diagrams where people are the nodes and edges represent some relationship between people, for instance, that they are friends. A good layout allows users to more easily investigate the data when performing tasks such as following paths, seeing clusters of closely related nodes and discovering general structures in data. Laying out graphs by hand is time consuming; however, there are a number of proven graph drawing methods which can be used to automatically visualize the data. Graph drawing concentrates on the automatic positioning of nodes and edges on screen or paper. Geographic visualization often includes edges that link regions, but often the spatial locations of regions that would be represented by nodes is already known. So why is graph drawing relevant to the visualization of geographic data? 143
P. Rodgers
144
9
9
9
When regions are fixed, often the connections between them are not. Graph drawing includes techniques for distinguishing close edges, and routing them in the most comprehensible manner. For example visualizing train networks (Brandes and Wagner, 2002). In some cases fixing the exact position of locations is not desirable (such as underground railway maps), or even possible (such as global map projections), but some essence of the position is required. For example, the relative positions between regions to the left, right, and below might need to be retained. In these cases, graph drawing can help by nicely laying out the nodes, whilst still maintaining the desired relationships between them. Some data, even if it is connected to geographic position, is not best analysed by retaining physical locations. Datamining of this information might be best achieved by providing visualization based on the topological relationship between items, rather than one based on their location (Monmonier, 1991). For example, economic data might be best seen by spatially grouping countries that have strong links (Figure 7.1). Mapping the internet also typically disregards location, both because of relevance, and because precise location information can be difficult to derive from Web sites (Cheswick et al., 2000; Dodge and Kitchin, 2000).
100 North
Former
583
W.Europe ~
~
136
~157 104 Middle East
Figure 7.1. An example of graph drawing. The edges in the graph represent total merchandise trade in 2001 between regions of the world. Only edges representing amounts over 100 billion dollars are shown. This has been drawn with a force directed graph drawing algorithm that includes an edge length heuristic (Mutton and Rodgers, 2002).
Graph Drawing Techniques for Geographic Visualization
145
The items of interest may not have an obvious physical location (such as data about corporations), hence an automatic graph layout is required to position the items based on how they are related. Familiar geovisualizations may be used effectively with alternate graph visualizations of the same data. Such linked multiple views (Roberts, 2000) would allow an examination of the spatially oriented representation along side the relational representation for greater breadth of understanding. An example of such multiple views is provided in Figure 7.2. Early graph drawing can be traced back to the barycenter drawing method of Tutte (1963). Early computer generated graph drawing included the work of Sugiyama et al. (1981) to address the need to visualize hierarchical structures. Later, Eades (1984) adapted the Spring Embedder from microchip design methods and this became the first widely used technique for laying out general graphs. It is a testament to their effectiveness, and a comment on progress in the field that variations on these methods are still widely used. Further methods rapidly followed and overviews of common techniques can be found in DiBattista et al. (1999); Kaufman and Wagner (2001). Methods to achieve a good drawing often depend on some knowledge of the graph semantics (that is, what the graph represents). If the graph has some known structure then there are often quick specialist algorithms for producing an effective drawing. Such structures include trees and acyclic graphs, which can represent classification hierarchies and organizational charts. Another specialist feature of graphs is planarity. Planar graphs are those which can be drawn without any edge crossings, and have a particular application to geographic data, as graphs that have edges representing region borders are planar. Other algorithms work on more general graphs including force directed methods, which can produce layout reasonably quickly. Slower methods involve quantitatively measuring the aesthetics in a graph and then moving the nodes so as to improve the resulting score. It is common for these methods to be combined in a hybrid manner, so that a fast method can produce the initial drawing, followed by a slower technique for fine tuning. For those wishing to visualize graph based data without coding algorithms there are several effective commercial and academic tools for accessing most of the graph drawing techniques mentioned in this chapter. Graph Layout Toolkit (Tom Sawyer Software, 2003) is one of the most complete and widely used, but is not freeware, whereas AT&T's sophisticated GraphViz (c), containing spring embedder and hierarchical algorithms, is open source. Other systems that implement graph drawing techniques include TouchGraph (TouchGraph, undated), DaVinci (Fr6hlich and Werner, 1994), Graphlet (Himslot, 1996), Jviews (ILOG Inc., 2003), Tulip (Tulip-Software.org, 2003) and VCG (Sander, 1994). Note that this is not a complete list, and there are several general graph algorithm systems available that include graph drawing functionality. The remainder of this chapter is organized as follows: More detail is provided on the graph drawing methods mentioned above in w Dynamic graph drawing, which is the process of laying out a graph that changes over time, is discussed in w The issues involved in drawing graphs in three dimensions are assessed in w followed by a discussion of the rendering of graph drawings in w Finally, a conclusion is
146 P. Rodgers
O O
c r-
111 o 0
N
0
>
if)
(9 .c_
tO -.~ N ...~
O
._~
r0
if)
N
L.. c
E 0 c 0 N
r.-
._m t~
c c _.1
N N
U.
Graph Drawing Techniques for Geographic Visualization
147
provided, offering some idea of future research challenges, particularly those relating to geovisualization.
7.2
Hierarchical Drawing Methods
Early graph drawing methods (Sugiyama et al., 1981) dealt with specialist graph structures, where a notion of a single direction applies. This might be because the data is organized into a hierarchy, with the main concepts at the top, and other concepts below, or because there is actual flow. These might include abstract representation of rivers, data relating to movements of people or money between regions and hierarchical classifications, based upon scale, for example, (see Fabrikant and Skupin, this volume (Chapter 35), figures 7 and 8). The main feature needed for this form of layout is that either the graph has no cycles, or that nodes participating in cycles are ordered. Figures 7.3 and 7.4 show illustrations of hierarchical layout. The nodes in a hierarchical graph can be placed in layers, with the first nodes (called roots) in the top layer, and later nodes further down. The leaves at the bottom are the lowest nodes of all, as they have no following items. Edges that cross layers are often assigned dummy nodes at each layer crossing in order to aid the drawing process. Once nodes are layered their relative positions in the layer can be assigned. Various approaches are taken, but most are designed to reduce the number of edge crossings and edge bend points.
25
Figure 7.3. Top-down hierarchical layout of world dynamics data (Forrester, 1973) drawn with GraphViz.
148
P. Rodgers
Figure 7.4. Radial hierarchical layout (Yee et al., 2001). This allows many more positions for nodes in lower layers, at the expense of a notion of flow that can be seen in the top-down approach.
7.3
Planar Layout Techniques
A planar graph is one that can be drawn with no edge crossing. Many graph theoretic algorithms rely on a graph being planar, and there are quick methods to lay out such a graph. Graphs where edges represent adjacency between regions are planar (because no border can cross another border), as are graphs that represent Delaunay triangulations, a precursor to several analytical techniques in Cartography (Watson and Mees, 1996; Tsai, 1993). A common method for drawing planar graphs is to give the nodes a canonical order, placing the first three nodes at vertices of a triangle and then adding lower ordered nodes in positions within the triangle, as shown in Figure 7.5. This method does not always produce a satisfactory layout, but it is improved if followed by a force directed method, such as the spring embedder. It is also possible to planarize graphs, a process of converting non-planar graphs to planar graphs by removing crossing edges or placing new nodes at edge crossings. Planar drawing algorithms can then be applied to the planarized graph, after which the changes to the graph can be undone, and the modifications integrated into the drawing.
7.4
Force Directed Layout Techniques
Force directed methods are widely applied techniques. Here, repeated applications of a force model result in the graph attaining a minimal energy state, where the graph is considered to be well drawn. These methods have the significant advantage of being applicable to general graphs, with no requirement that the graph has a specific structure or
Graph Drawing Techniques for Geographic Visualization
149
Figure 7.5. A planar graph in a layout based on Schnyder's method (Schnyder, 1990). Planar graphs are those that can be drawn without any of their edges crossing.
that it meets some topological constraints. For example, the spring embedder can be used with either planar or non-planar graphs. A fast approach for general graphs is the barycenter approach (Tutte, 1963) (Figure 7.6). The nodes are drawn at the average distance of their neighbours (which is known as their barycenter). This method is repeated for a set number of iterations, or until nodes stop moving, having reached a minimal energy state. A subset of the nodes must be fixed, to indicate the outer borders of the drawing space, or the nodes will simply collapse to a single point. This method is effective for sparse, symmetrical graphs, where fixed nodes can easily be defined. Eade's spring embedder (Eades, 1984) is perhaps the best known graph drawing technique and is a popular method for visualizing geographic data such as network topologies and the internet (Huang et al., 1998; McCrickard and Kehoe, 1997). A variant that has an additional edge length heuristic is shown applied to a planar graph in Figure 7.7. Nodes are treated as charged particles that repel all other nodes, and edges are treated as
Figure 7.6. A graph after the barycenter drawing approach has been applied. The nodes with black centres are fixed.
150
P. Rodgers
Figure 7.7. A planar graph representing bordering states in mainland Europe. A modified spring embedder has been applied. Such a graph could be attributed with relevant geographic information such as traffic data or population flows. (See Fabrikant and Skupin, this volume (Chapter 35)) for applications in cartographic information spaces.
springs that attract connected nodes. In an iteration of the method, the forces are calculated for all the nodes in a graph and the nodes are then moved in the direction that the forces indicate. Iterations continue until a least energy state is achieved, or a set number of iterations are performed. The result is a graph where nodes have decent minimal separation and connected nodes are reasonably close together. Recent work (Tunkelang, 1998; Walshaw, 2000) has made the application of this method to large graphs possible, with graphs containing thousands of nodes being drawn in a few seconds.
7.5
Optimizing Aesthetic Criteria
The previous methods take implicit judgements about what a good graph drawing is. However, there are approaches that attempt to explicitly improve the aesthetics of a graph by allowing users to choose from a range of aesthetic criteria, weight them, and allow a multiple criteria optimizing technique to automatically lay out the graph based on these preferences. The major disadvantage of these techniques is the time taken to reach a reasonable drawing. Typically, the criteria have to be recalculated on each iteration of the optimizer and many iterations are required. Multi-criteria optimizers that have been used include the (slow) simulated annealing method (Davidson and Harel, 1996) and the (even slower) genetic algorithm approach (Hobbs and Rodgers, 1998). The aesthetic criteria used must be quantifiable. Common criteria include: the number of edge crossings, statistics relating to even node distribution (such as the variation
Graph Drawing Techniques for Geographic Visualization
151
in distance of closest neighbours of each node); the area or aspect ratio of a rectangle containing the graph; the angular resolution of edges emanating from nodes (a small angle between edges means that they are difficult to distinguish); the number of edge bends; evenness of edge length; methods for measuring the symmetry in the graph; and encouraging directed edges in a particular direction. DiBattista et al. (1999) and Kaufmann and Wagner (2001) provide detailed discussions of aesthetic criteria. A feature of such criteria is that empirical studies can be performed to discover user preference. This work is ongoing, but some results indicate that reducing edge crossings is a major factor in making graph layout comprehensible (Purchase et al., 2000). Criteria-based methods may be effective in aiding the visualization of geographic data. In particular, even when the nodes are fixed to definite locations, criteria such as edge angular resolution (Brandes et al., 2000) and the number of edge bends may be still be optimized, producing a better visualization (Figures 7.8 and 7.9). Optimizing on aesthetic criteria is particularly effective where specialist requirements are present. For example, criteria might be developed particularly for drawing public transport routes; (see Fairbairn, this volume (Chapter 26)). Harry Beck's famous tube map provides inspiration, as he straightened out train lines, evened out distances between stations and altered the area of the map to fit within a poster. This is generally accepted as a much clearer way of enabling the public to plan their routes. Generalizing these features might allow the development of a multi-criteria optimizer for public transport schematics. Schematic generators have already been developed for other application areas, as shown in Figures 7.10 and 7.11.
7.6
Dynamic Graph Drawing
Graphs often change over time. This may be due to a user editing a diagram, or more commonly in Information Visualization, there is some alteration in the underlying data structure. For example, a real time map of the Internet will be constantly changing as
Figure 7.8. A graph with no edge crossings, even edge length and a 1:1 aspect ratio, but with poor node distribution and poor angular resolution.
152
P. Rodgers
Figure 7.9. Graph created with Ilog Jviews (Sander and Vasiliu, 2001). It shows links between French towns, using a direct edge routing method. This also shows the application of labelling techniques to graph drawing (Kakoulis and Tollis, 1996; Neyer, 2001).
Web pages and other documents are added, modified and removed. The challenge here is to retain the users' mental map of the graph (Eades et al., 1991). A mental map is the current view the user has of the graph. For complex graphs, a user has to invest considerable time and effort into understanding the current layout, so that any changes should be integrated carefully and with minimal disruption to this mental map. Some iterative techniques, such as the spring embedder can do this naturally to some extent, but this relies on the particular technique being first used to draw the graph. There is a need for research that analyses and defines the user's current mental map, before deciding on the best method for making layout alterations, perhaps drawing on related work in cognitive aspects of Cartography (Lloyd, 2000; Perusich and
Figure 7.10. The diagram on the left (a) shows a spatially exact representation of a cable plan. On the right, (b) shows the same cable plan, but using an automatically generated schematic representation (Lauther and StL~binger, 2001).
Graph Drawing Techniques for Geographic Visualization
Figure 7.11.
153
Examples of dynamic graph drawing - the node "X" has been added.
McNeese, 1997; Raubal et al., 1997). Figure 7.11 shows two possible rearrangements of a graph after the node "X" has been added to the graph. Figure 7.1 l a (left) assumes that a hierarchical algorithm has been used to draw the original graph, and that node "X" is a child of node "a". It attempts to find space on the same level as the other children of "a", without disturbing any other nodes. Figure 7.11b (right) assumes that the spring embedder has been used to draw the original graph and so has produced a layout after moving the node "a" to make space for the additional node. Although the drawing is nicer, the movement of the nodes may have disturbed the user's mental map.
7.7
Drawing Graphs in Three Dimensions
Whilst it is necessary in a document of this sort to display images in two dimensions, there are many methods that draw graphs in three dimensions. These are typically variants of the 2D techniques described above (Munzner and Burchard, 1995; Wills, 1999). For example, force directed approaches require very few modifications to deal with the extra dimension. However, not all graph drawing methods can be applied in three dimensions. In particular, planar drawing methods by their nature are very dependent on being drawn on the plane. Others need considerable adjustment, including those that drawn by measuring aesthetic criteria, as some criteria are not appropriate to three dimensions, such as measuring the number of edge crossings. In addition, new criteria may need to be developed, in particular in relation to viewpoints. Viewpoints (Eades et al., 1997) are a significant difference between 3D and 2D graph drawing. A viewpoint is a 2D projection of the 3D graph. This is of obvious importance, as with current display technology, a 3D layout must be visualized in two dimensions, and the choice of which viewpoint affords the best comprehensibility is a major issue. When presented statically, graphs that occupy 3D techniques have very little advantage, and many disadvantages over those created with methods designed for 2D display (see Ware and Plumlee, this volume (Chapter 29) and Fabrikant and Skupin, this volume (Chapter 35)). However, 3D layouts become more useful when the user can interactively explore the graph (Ware and Franck, 1996). Typically, as users rotate, pan and zoom around a graph, they gather a 3D model of the graph, allowing the structure to become clear. This sort of interactive system can allow complex graphs to be analysed
154
P. Rodgers
Figure 7.12. A map of a web site, drawn with a 3D spring embedder method (Mutton and Rodgers, 2002). The two images are alternative projections of the 3D map onto the 2D page, effectively showing the 3D map from two different viewing positions.
Figure 7.13. A graph rendered with fillets (Lukka et. al., 2002). Fillets are curved joins between edges and nodes, and so help distinguish between edges that connect to nodes, and edges that do not connect to nodes, but where the nodes lie on top of the edges.
Graph Drawing Techniques for Geographic Visualization
155
effectively, whilst using a relatively small amount of screen real estate. Figure 7.12 shows the points of a single 3D graph layout from two different viewpoints.
7.8
Graph Rendering
Frequently in graph drawing research, graphs are treated as simple relational structures, circles connected by lines, with the only challenge relating to the layout of the nodes and routing of the edges. However, the comprehensibility of a graph not only relies on the layout but also how the nodes and edges appear in the final realization. Standard visualization techniques such as colouring nodes and edges, and the use of transparency to deal with occlusion are widely used, and there is some work on distinguishing edge and node occlusion by the use of filleting (Lukka et al., 2002) (Figure 7.13). However, much more research is needed in this area, particularly regarding application-specific rendering, and geographic visualization would be a prime candidate for study.
7.9
Conclusions
This chapter has briefly overviewed the current state of the art in graph drawing and discussed some applications in visualizing geographic data. A great deal of geographic data, both spatial and non-spatial, has a relational element and is likely to benefit from graph drawing methods. There are interesting potential research areas in the application of graph drawing to geographic visualization, such as the development and use of new aesthetic criteria for geographic visualization, the empirical analysis of graph drawing in geovisualization, and the improvement of graph rendering designed specifically for geographic data to support geovisualization.
References Brandes, U., and Wagner, D., (2002) "Using graph layout to visualize train interconnection data", Journal of Graph Algorithms and Applications, 4(3), 135-155. Brandes, U., Shubina, G., and Tamassia, R., (2000) "Improving angular resolution in visualizations of geographic networks", Joint EUROGRAPHICS and IEEE TCVG Symposium on Visualization (VisSym'O0). Amsterdam: Springer, pp. 22-32. Cheswick, W., Burch, H., and Brannigan, S., (2000) "Mapping and visualizing the Internet", 2000 USENIX Annual Technical Conference, San Diego, California, USA. Davidson, R., and Harel, D., (1996) "Drawing graphs nicely using simulated annealing", ACM Transactions on Graphics, 14(4), 301-331. DiBattista, G. D., Eades, P., Tamassia, R., and Tollis, I. G., (1999) Graph Drawing: Algorithms for the Visualisation of Graphs, New Jersey: Prentice Hall. Dodge, M., and Kitchin, R., (2000) Mapping Cyberspace. London, New York: Routledge. Eades, P., (1984) "A heuristic for graph drawing", Congressus Numerantium, 42, 149-160.
156
P. Rodgers
Eades, P., Lai, W., Misue, K., and Sugiyama, K., (1991) "Preserving the mental map of a diagram", Compugraphics, pp. 24-33. Eades, P., Houle, M. E., and Webber, R., (1997) "Finding the best viewpoints for threedimensional graph drawings", Graph Drawing, 97. Rome: Springer, pp. 87-98. Forrester, J. W., (1973). World Dynamics, Pegasus Communications. Fr6hlich, M., and Werner, M., (1994) "Demonstration of the interactive graph visualization system DaVinci", Graph Drawing, 94. Princeton, NJ: Springer, pp. 266-269. Himslot, M., (1996) "The Graphlet System", Graph Drawing, 96. Berkeley, CA: Springer. Hobbs, M. H. W., and Rodgers, P. J., (1998) "Representing space: a hybrid genetic algorithm for aesthetic graph layout", FEA '98 in Proceedings of JCIS'98, pp. 415418. Online: http://www.cs.ukc.ac.uk/pubs/1998/678/index.html Huang, M. L., Eades, P., and Cohen, R. F., (1998) "WebOFDAV - navigating and visualizing the Web on-line with animated context swapping", WWW7: Seventh International World Wide Web Conference. ILOG Inc. (2003) Graph Layout Package - ILOG JViews Component Suite. Online: http://www.ilog.com/products/jviews/graphlayout/(23/10/03). Kakoulis, K. G., and Tollis, I. G., (1996) "On the edge label placement problem", Graph Drawing, 96. Berkeley, CA: Springer, pp. 241-256. Kaufmann, M., and Wagner, D., (2001) Drawing Graphs: Methods and Models, LNCS 2025. Berlin: Springer. Lauther, U., and Stfibinger, A., (2001) "Generating schematic cable plans using spring embedder methods", Graph Drawing. Vienna: Springer, pp. 465-466. Lloyd, R., (2000) "Self organizing cognitive maps", The Professional Geographer, 52(3), 517-531. Lukka, T. J., Kujala, J. V., and Niemel, M., (2002) "Fillets: cues for connections in focus + context views of graph-like diagrams", Information Visualization 2002: IEEE, pp. 557-562. MacEachren, A. M., Brewer, I., and Steiner, E., (2001) "Geovisualization to mediate collaborative work: tools to support different-place knowledge construction and decision-making", Proceedings, 20th International Cartographic Conference, Beijing, China, August 6-10, 2001: ICA, pp. 2533-2539. Online: http://hero.geog.psu.edu/products/ICC 16009amm.pdf McCrickard, D. S., and Kehoe, C. M., (1997) "Visualizing search results using SQWID", In: WWW6: Sixth International World Wide Web Conference, Santa Clara, CA. Monmonier, M., (1991) "Ethics and map design: six strategies for confronting the traditional one-map solution", Cartographic Perspectives, (10), 3-8. Munzner, T., and Burchard, P., (1995) "Visualizing the structure of the World Wide Web in 3D hyperbolic space", Proceedings VRML'95 Symposium, Special Issue of Computer Graphics. San Diego, CA: ACM SIGGRAPH, pp. 33-38. Mutton, P. J., and Rodgers, R. J., (2002) "Spring embedder preprocessing for WWW visualization", Information Visualization 2002: IEEE, pp. 744-749. Online: http://www.cs.ukc.ac.uk/pubs/2002/1372/index.html
Graph Drawing Techniques for Geographic Visualization
157
Neyer, G., (2001) "Map labeling with application to graph drawing", In: Wagner, D., and Kaufmann, M., (eds.), Drawing Graphs: Methods and Models. Berlin: Springer, pp. 247-273. Perusich, K., and McNeese, M. D., (1997) "Using fuzzy cognitive maps to define the search space in problem solving", In: Salvendy, G., Smith, M., and Koubek, R., (eds.), Design of Computing Systems: Cognitive Considerations. Amsterdam: Elsevier Science, pp. 805-809. Purchase, H. C., Allder, J.-A., and Carrington, D., (2000) "User preference of graph layout aesthetics", Graph Drawing 2000, pp. 5-18. Raubal, M., Egenhofer, M. J., Pfoser, D., and Tryfona, N., (1997) "Structuring space with image schemata: wayfinding in airports as a case study", Spatial Information Theory A Theoretical Basis for GIS, International Conference COSIT '97, pp. 85-102. Roberts, J. C., (2000) "Multiple-view and multiform visualization", In: Erbacher, R., Pang, A., Wittenbrink, C., and Roberts, J., (eds.), Visual Data Exploration and Analysis VII, Proceedings of SPIE, pp. 176-185, Online: http://www.cs.kent.ac.uk/pubs/2000/963/index.html Sander, G., (1994) "Graph layout through the VCG tool", Graph Drawing, 94. Princeton, NJ: Springer, pp. 194-205. Sander, G., and Vasiliu, A., (2001) "The ILOG JViews graph layout module", Graph Drawing 2001. Vienna: Springer, pp. 438-439. Schnyder, W., (1990) "Embedding planar graphs on the grid", First ACM-SIAM Symposium on Discrete Algorithms (SODA '90), pp. 138-148. Sugiyama, K., Tagawa, S., and Toda, M., (1981) "Methods for visual understanding of hierarchical system structures", IEEE Transactions on Systems, Man and Cybernetics, 11(2), 109-125. Tom Sawyer Software (2003) Tom Sawyer Software. Online: http://www.tomsawyer.com (23/10/03). Tsai, V., (1993) "Delaunay triangulations in TIN creation: an overview and a linertime algorithm", International Journal of Geographical Information Systems, 7(6), 501-524. Tulip-Software.org (2003) Tulip Software Home Page. Online: http://www.tulip-software.org/(23/10/03). Tunkelang, D., (1998) "JIGGLE: Java interactive graph layout algorithm", Graph Drawing, 98. Montreal: Springer, pp. 413-422. Tutte, W. T., (1963) "How to draw a graph", London Mathematical Society, 3(13), 743-767. Walshaw, C., (2000) "A multilevel algorithm for force-directed graph drawing", Graph Drawing 2000, pp. 171-182. Ware, C., and Franck, G., (1996) "Evaluating stereo and motion cues for visualizing information nets in three dimensions", A CM Transactions on Graphics, 15(2), 121-139. Watson, D. F., and Mees, A. I., (1996) "Natural trees - neighborhood-location in a nutshell", International Journal of Geographical Information Systems, 10(5), 563-572.
158
P. Rodgers
Wills, G. J., (1999) "NicheWorks - Interactive visualization of very large graphs", Journal of Computational and Graphical Statistics, 8(2), 190-212. Yee, K.-P., Fisher, D., Dhamija, R., and Hearst, M., (2001) "Animated exploration of dynamic graphs with radial layout", Proceedings IEEE InfoVis, pp. 43-50.
Exploring Geovisualization J. Dykes, A.M. MacEachren, M.-J. Kraak (Editors) 9 2005 Elsevier Ltd. All rights reserved.
Chapter 8
Exploratory Visualization with Multiple Linked Views Jonathan C. Roberts, Computing Laboratory, University of Kent, Canterbury, Kent CT2 7NF, UK
Keywords: multiple linked views, coupling, linking, coordination, exploratory visualization
Abstract Exploratory visualization enables the user to test scenarios and investigate possibilities. Through an exploration, the user may change various parameter values of a visualization system that in turn alters the appearance of the visual result. For example, the changes made may update what information is being displayed, the quantity or resolution of the information, the type of the display (say) from scatter plot to line-graph. Furthermore, the user may generate additional windows that contain the visual result of the new parameters so they can compare different ideas side-by-side (these multiple views may persist such that the user can compare previous incarnations). Commonly these windows are linked together to allow further investigation and discovery, such as selection by brushing or combined navigation. There are many challenges, such as linking multiple views with different data, initializing the different views, indicating to the user how the different views are linked. This chapter provides a review of current multiple linkedview tools, methodologies and models, discusses related challenges and ideas, and provides some rudiments for coordination within a geovisualization context. The types and uses of coordination for exploratory visualization are varied and diverse, these ideas are underused in geovisualization and exploratory visualization in general. Thus, further research needs to occur to develop specific geovisualization reference models and extensible systems that incorporate the rich variety of possible coordination exploration ideas.
8.1
Introduction
This chapter advocates the use of many lightweight views that are linked together. They are lightweight in that they are: (i) easy to generate by the user, where the user does not spend unnecessary time and effort to explicitly link the new view to existing ones; and (ii) do not take many computer resources (e.g., memory, computation). Such multiple linked 159
160
J.C. Roberts
views (MLVs) enable the user to quickly view a scenario, compare it with previous realizations, examine properties such as dependencies and sizes, put this view to one side and try out another scenario. There are many good principles that can be learned from examining how other systems achieve this MLV exploration. In geovisualization, the explorer often generates many spatial or abstract representations. With such exploratory environments, the user is able (even encouraged) to take a hands-on approach to gain a deeper understanding of the underlying information. They may examine multiple different graphical realizations that reveal different aspects of the data. These principles are applicable to the geovisualization domain (indeed, many MLVs use spatial information databases to demonstrate the techniques). This chapter highlights current trends in MLVs. In order to provide an overview of different multiple-view exploration strategies, we start by placing the MLVs in context, then discuss exploration strategies and expand upon appropriate methods to enable interactive and effective investigation and management techniques that oversee and encourage the user to explore.
8.2
Current Themes in Exploratory (Multiple View) Visualization
When carrying out research, analysts often proceed by using an experimental cycle where the experiment is set up perhaps with some default parameters, the results are noted down, then the parameters are adapted and the results are compared with previous versions. Each new investigation enhances the analyst's knowledge and understanding. When starting the investigative process we may not know anything about the database let alone what questions to ask. DiBiase (1990) focusing on the role of visualization in support of earth science research, summarizes the research process as "a sequence of 4 stages: exploration of data to reveal pertinent questions, confirmation of apparent relationships in the data in light of a formal hypothesis, synthesis or generalization of findings, and presentation of the research at professional conferences and in scholarly publications". Gahegan, this volume (Chapter 4) offers a perspective for "the entire process of GIScience". The need for exploration techniques grows as the data become larger and more complex. In such cases, the important aspects of the data are smaller, in comparison with the whole, and specific details are more likely to be hidden in a swamp of elements. Thus, in general, exploration techniques allow us to sift through volumes of data to find relationships, investigate various quantities and understand dependencies. One method to achieve this exploration, which has been the trend in the recent years, is by "dynamic queries" (Shneiderman, 1994). These are highly interactive systems that enable the visualizations to be manipulated, dissected and interrogated. The user dynamically interacts with the visualization by adjusting sliders, buttons, and menu items that filter and enhance the data and instantly update the display. By doing so the "user formulates a problem concurrently with solving it" (Spence, 2001). For instance, what was once a dark dense black region on a scatter plot can be immediately changed into a colourful and meaningful realization (see Theus, this volume (Chapter 6)). Systems that use this technique include HomeFinder (Williamson and Shneiderman, 1992) and FilmFinder (Ahlberg and Shneiderman, 1994) both now regarded as seminal work on dynamic queries. Ahlberg and Wistrand (1995a,b) developed these techniques into
Exploratory Visualization with Multiple Linked Views
161
the Information Visualization and exploration environment system (IVEE). In one example, they depict an environmental database of heavy metals in Sweden; IVEE was then developed into the commercial Spotfire system (Ahlberg, 1996). Another early example is the "density dail" (Ferreira and Wiggins, 1990), where visual results were chosen dependent on the dial position. More recently, Steiner et al. (2001) provide an exploratory tool for the Web and the Descartes system (Andrienko and Andrienko, 1999a-f) both provide dynamic queries; these systems include map-based views linked to other views. As an alternative to adapting sliders and buttons (as used in dynamic queries), the user may directly manipulate the results; such direct manipulation may be implemented using brushing techniques (Ward, 1994) or methods that select to highlight or filter the information directly. Much of the original work was done on scatter plot matrices (Becker and Cleveland, 1987; Carr et al., 1987). Brushing is used in many multiple-view systems from multi-variate matrix plots, coplot matrices (Brunsdon, 2001) to other geographic exploratory analysis (Monmonier, 1989). One map based visualization toolkit that utilizes multiple views and brushing is cdv (Dykes, 1995). cdv displays the data by methods including choropleth maps, point symbol maps, scatter plot and histogram plots. Statistical and geographic views are linked together, allowing elements to be selected and simultaneously highlighted in each. MANET (Unwin et al., 1996), developed from the earlier tools SPIDER and REGARD, provides direct manipulation facilities such as dragand-drop and selection and control of elements in the display, for example. Moreover, other direct manipulation techniques allow the inclusion of manipulators and widgets; for example the SDM system (Chuah and Roth, 1995) provides the user with handles mounted on visual objects to control the parameters directly. Often the widgets are applied to the objects when they are needed and provide additional functionality. The widgets may be multi-functional, where different adornments provide
Figure 8.1. Diagram taken from the Waltz visualization system (Roberts, 1998a,b), showing the use of the Inventor Jack manipulators.
162
J.C. Roberts
specialized manipulation. Figure 8.1 shows a jack manipulator where the outer cubes allow rotation; both the horizontal plane and vertical tubes allow constrained planar translation. This manipulator is provided by Open Inventor libraries and integrated in the Waltz multiple-view visualization system (Roberts, 1998a,b). In the figure, the manipulator has been attached to an object that has been moved along the XZ plane (using the large horizontal rectangle). Other manipulators exist; for example, selection in Mondrian (Theus, 2002a,b) may be operated through the use of rectangle areas. In this tool, the user may modify the regions by selecting handles on the rectangles, multiple selection areas can be used at once, and the selected items are highlighted in related windows.
8.3
Strategies of Exploration
In any interactive visualization, the decision needs to be made as to where the information goes, that is, when the parameters are changed does the new visualization replace the old, get overlaid, or is it displayed alongside and in separate windows? Roberts et al. (2000) names these strategies replacement, overlay and replication, respectively. This is depicted in Figure 8.2. This fits in well with the design guidelines of Baldonado et al. (2000), who describe the rule of "space/time resource optimization", where the designer must make a decision whether to present the multiple views side-byside or sequentially.
8.3.1
Replacement
The replacement strategy is the most common and has some key advantages, that is, the user knows implicitly where the information is updated and what information has
Figure 8.2. There are three strategies of exploratory visualization that determine where the information is placed: replacement, replication and overlay.
Exploratory Visualization with Multiple Linked Views
163
changed. However, there are some major challenges with this strategy. First, there are problems by using such an ephemeral exploration environment. Information about previous experimentations is usually lost, the user cannot compare different graphical realizations side-by-side, and there is often little guidance as to the sensitivity of different parameters (i.e., whether a small change of a parameter will make a small change in the image, or in fact it makes a large amendment to the visualization). Second, there is a risk of losing navigation context. For example, when a user zooms into a subpart of the display the context of how the zoomed area fits in with the whole is lost. Some visualization systems overcome the transient nature of the display by storing past visualization commands (as data or variable values) in a database, such as Grasparc (Brodlie et al., 1993) and Tioga (Stonebraker et al., 1993). In the case of Grasparc, or HyperScribe (Wright, 1996) as implemented as a module in IRIS Explorer, the user can "roll back" to a predefined state and re-visualize the data with the "old" parameters. As in the case of HyperScribe these states are usually stored in a "history tree" where data arising from the experiment process is modelled in a tree structure and the user can alter parameters and roll back to previous versions (Figure 8.3). As the user explores, it can become unclear how the filtered, extracted and specialized information fits in with the whole. Methods such as animation and distortion help to keep this context. For example, animation is used in ConeTree (Card, 1996); in this instance, a selected node is brought to the foreground by animating the 3D tree (for an explanation and figure, (see Schroeder, this volume (Chapter 24)). The animation occurs long enough for the observer to see a continuation and short enough so that the user still observes the visual momentum. Moreover, there is a current trend towards generating detail-in-context views also known as Context + Focus displays (Lamping et al., 1995). Many implementations are non'linear magnification systems using methods such as those described by Keahey and Robertson (1997). They appear with a linear (and traditional) mapping in the centre or focus of the screen and squashed or distorted mapping outside the focus area. For example, Snyder (1987) generated various magnifying glass projections of the earth. Other people who use distortion to provide a clear field-of-view to an interesting object in three dimensions include Sheelagh (1997).
Figure 8.3. Diagram showing the history tree where data arising from the experiment process are modelled in a tree structure and the user can alter parameters and roll back to previous versions.
164
8.3.2
J.C. Roberts
Replication
Another way of working is to use a replication strategy for information exploration. In this strategy, various parts of the information, parameters or views are copied or duplicated and aspects are displayed in multiple ways and in different windows. Replication refers to the action of the experimenter who wishes to repeat an experiment or procedure more than once. Replication may be used to provide methodical or random repetition of the experiment to confirm or reduce the error of the results (by perhaps averaging the different findings) or to confirm the outcomes. Far too often a user relies upon one display, presenting data by their "favourite" visualization algorithm. However, they may be missing out on the richness of the underlying information. Hence by duplicating and replicating the displays and slightly adapting the parameters for the next incarnation the user is able to observe and compare the result of different scenarios and experiment with the detail of their data. Replication can be divided into two subcategories of usage: (i) the procedure - where the results that are generated by the change of parameters are displayed in separate windows; (ii) the course of action - where the same data may be presented by different mappings. These different forms of the same information are known as multiforms (Roberts et al., 2000). It is useful to display the results of a parameter change in a new window: the user can clearly observe and compare side-by-side the differences and similarities of the results. For example, the user may wish to explore different isosurfaces depicting alternative concentrations of some phenomena. If, as the user changes the threshold value a new window appears displaying the new isosurface then the user can easily observe (and compare) the varying concentrations from the current and previous explorations. As we shall see in w such a dynamic replication could provide a multitude of views. Such a viewexplosion could confuse, rather than support the user in their exploration tasks. Not only can different parameterizations be displayed in multiple windows, but also the same information may be displayed in multiple forms. By doing so the user may be able to see information that was previously obscured, or the different form may abstract the information to provide a clearer and simpler representation, or the different views may represent alternative interpretations on the same information (such as those given by different experts). Indeed, the alternative view may help to illuminate the first. Yagel et al. (1995) advocate the use of "...visualization environments that provide the scientist with a toolbox of renderers, each capable of rendering the same dataset by employing different rendering schemes". Consequently, the user may gain a deeper understanding of their data. For example, our eyes use binocular vision to present two slightly different observations of the same scene, which provides us with a rich depiction of the information. Certainly, we miss out when we look at one picture of something, such as a still photograph of an historic building, and we gain a better understanding of the size, colours, textures and details when we browse through many photographic pictures, fly through a virtual 3D model and view it from multiple viewpoints, and read written explanations from an interactive guidebook. Likewise, it is often beneficial to the data explorer to see the information from different perspectives and in different forms.
Exploratory Visualization with Multiple Linked Views
165
There are many advantages in using replication, for example, the separate views hold a history of the exploration, allow comparisons between images, and the multiforms may emphasize different aspects of the information. Replication should be encouraged (Roberts, 1998a,b). However, not many current systems inherently support many views and the module visualization environments, which can display the data in many representations, leave all the effort of duplication to the user. Indeed, such a replication strategy is possible in the module building visualization environments, such as AVS, IRIS Explorer and IBM Data Explorer (Williams et al., 1992). However, exploring the information in such a way with these tools requires copying and reconnection of multiple modules, and thus the replication strategy is not necessarily encouraged or easy to operate in these module-building environments. It is not a lightweight operation. The system itself should have the functionality to support multiple views, created with little effort from the user, managed appropriately by the system and automatically coupled to other views. Moreover, further understanding may be gained through linking and coupling of information. For example, selections that are made in one view can be reflected in other views, other operations such as zooming and rotation operations can be cordially applied to any associated view - hence the phrase MLVs.
8.3.3
Overlay
A third method of generating the visualization result is to overlay the visualization method in the same display. Overlays allow different visualizations to share the same coordinate space. Such a fan-in method allows different representations of the same information in the same display to be layered together. The advantage of this is that it is easy to understand each view in the context of the other, and the information may be readily compared. Different representation methods may be mixed together in the same view. For example, one view may include 2D pseudo-colour slices, surface representations, legends and useful annotations. However, when too much information is presented in the one view, or layered over a previous version, it may be difficult to select and navigate through or understand specific information. This may be because the presentation is too crowded and complex or that parts of the visualization are occluded. Indeed occlusion may be a problem in 2D visualizations as the objects may lay directly over each other. This may cause a misunderstanding of how many elements are in fact at a particular coordinate. Solutions such as the use of transparency or randomly jittering the points may help to clarify the depictions. Additionally, aggregation followed by different mapping techniques may be useful, as demonstrated by the sunflower plot of Dupont and Plummmer (2003). Obviously, the usefulness and appropriateness of the overlay method depends on the graphical visualization technique and the visualization tasks being used. Related work includes the excellent Toolglass and Magic lenses (Bier et al., 1993) widgets that allow the user to see through and focus on details of the display. Geospace (Lokuge and Ishizaki, 1995) usefully employs translucency between the layers, and Kosara et al. (2002) uses a semantic depth of field to blur layers to keep the context. D611ner, this volume (Chapter 16) uses texture-mapping methods to implement a lens effect that draws
166
J.C. Roberts
upon transparent layers. Moreover, Gahegan (1998) provides an example of an integrated display to achieve more complete integration of geovisualization views. Ongoing work on MANET (Unwin et al., 1996) is focussed on methods to overlay different plots on the same view. The challenge here is to develop effective overlays that enable the user to keep the context information, understand the depth of knowledge and not become overwhelmed by a complex visual representation. Specific challenges include how to effectively operate the overlaid views - does the interaction go through a view or is only the top view active? How is the user made aware that the views may differ in their data? How are the data linked to the data, and can it be coupled?
8.4
Multiple Linked Views
Linking and relating the information in one view to that of other views assists the user in the exploration process and may provide additional insight into the underlying information. Certainly, "multiple views should be coordinated" (Carr, 1999). As the information is explored and placed in separate windows, it is important that the relationships between the views and the context of how one view relates to another are maintained. Indeed, North and Shneiderman (2000b) in their user experiments discover that MLVs are beneficial and state that "the overview and detail-view coordination improved user performance by 30-80% depending on task". Such additional "overview" realizations provide context information that enhances the understanding of the associated view. Many different forms of information may be linked and coordinated. For instance, manipulation operations (such as rotation, translation, zoom, etc.) may be concurrently applied to separate views so as when one view is manipulated the other views respond appropriately to the same manipulation operations; the spatial position of a pointer or probe may be linked between multiple views; filter, query and selection operations may be simultaneously applied. Moreover, these operations need only affect the same information but, more interestingly, to collections of different information. Coordination and abstract views provide a powerful exploratory visualization tool (Roberts, 1998a), for example, in a 3D visualization, a navigation or selection operation may be inhibited by occlusion, but the operation may be easier using an abstract view. Fuhrmann and MacEachren (1999) describe the use of an abstract view to guide navigation in a 3D geospatial representation, ideas that are further developed by Fuhrmann and MacEachren (2001). Thus, a linked abstract view may be used to better control and investigate the information in the coupled view. Accordingly, there are different reasons for coordination. North and Shneiderman (1997) state there are two different reasons for using coupled views, either for selection or for navigation. Although Pattison and Phillips (2001) disagree by saying that there are additional forms of coordination other than selection and navigation, for example, "coordinating the data in preparation for the visualization such as sorting, averaging or clustering". Likewise, Roberts (1999) believes in a broader use of coordination, exemplified by the layered model (Roberts, 1999; Boukhelifa et al., 2003) where the user may link any aspect of the dataflow and exploration process.
Exploratory Visualization with Multiple Linked Views
167
Selection allows the user to highlight one or many items either as a choice of items for a filtering operation or as an exploration in its own right; this is often done by direct manipulation where the user directly draws or wands the mouse over the visualization itself (Cleveland and McGill, 1988; Ward, 1994). Becker and Cleveland (1987) describe this as a brushing operation. Examples, of systems that implement the brushing technique include XmdvTool (Ward, 1994), IVEE (Ahlberg and Wistrand, 1995a,b) and Spotfire tools (Ahlberg, 1996). Joint navigation provides methods to quickly view related information in multiple different windows, thus providing rapid exploration by saving the user from performing the same or similar operations multiple times. Objects, such as pointers, annotations or metainformation, may be coupled. For instance, the developers of the visualization input pipeline (VIP) (Felger and Schr6der, 1992) describe an example that displays several views of the data with the cursors linked together; movement of one pointer causes the others to move correspondingly. Other forms of navigation include data probing, as implemented within both LinkWinds (Jacobson et al., 1994) and KBVision (Amerinex, 1992), and changing the viewport information, as accomplished in SciAn (Pepke and Lyons, 1993) and Visage (Roth et al., 1996), which provide coordinated manipulation of 3D views.
8.4.1
Linking architectures
The study of coordination is interdisciplinary and there is much to learn from other disciplines. Taking the simplistic view of coordination being "sharing things" then we may learn from areas such as sharing hardware devices in a computer system or managing, delegating roles in a human organization or collaborative support, for example, (see Brodlie et al., this volume (Chapter 21)). For an in depth interdisciplinary view of coordination, see Olson et al. (2001). In this particular chapter, we focus on four models: Snap (North and Shneiderman, 2000a), presentation graphics (McDonald et al., 1990) and the View Coordination Architecture (Pattison and Phillips, 2001) and a Layered Model for Coordination (Boukhelifa et al., 2003). Andrieko et al., this volume (Chapter 5) provide an in depth discussion of software issues in geovisualization. The Snap conceptual model (North and Shneiderman, 2000a) takes a datacentric approach to coordination. It uses concepts from database design to provide the required interaction. Relational database components are tightly coupled such that an interaction with one component results in changes to other components. The Snap architecture is designed to construct arbitrary coordinations without the need for programming. However, Snap's user interactions are currently limited to "select" and "load", whereas exploratory visualization permits rich and varied interactions such as representation-oriented coordinations in addition to data-centric coordinations. McDonald et al. (1990) describe a constraint system based on the presentationgraphics programming model (Figure 8.4). In this system, lenses map the subjects (objects) in the database into their visual presentations counterparts, a user interacts with the presentation and the subjects get updated through the input-translator, and finally, a constraint system updates corresponding properties and updates any other related graphical presentations.
168
J.C. Roberts
i/o devices
Links
Scene
I node I
display
~<
I
input
I
I
I presentation I~
Input Translator
Subject
I
Lens
Subject
I
Subject
I
~'
i nod/no
Consistency / constraint
Figure 8.4. Presentation graphics programming model (McDonald et al., 1990).
Figure 8.5. (a) Depicts the traditional MVC pattern. The views reflect the current state of the model; the information held in the model is updated via the controller. (b) Shows the coordination model by Pattison and Phillips (2001) based on an MVC pattern, where the presentation component observes the model for changes and updates its display as necessary, the model component observes both the specification and data model components for change and changes to the specification component are propagated up.
Exploratory Visualization with Multiple Linked Views
169
Pattison and Phillips (2001) developed an architecture based on the model view controller (MVC) design pattern that originated in the Smalltalk architecture (Figure 8.5a). This pattern describes three objects: the model, view and controller, where the model holds the state of the process and publishes notifications to the views when its state changes, the view(s) reflect the state of the data model, and the controller updates the model with requests from external events. The MVC architecture inherently supports multiple views, and Pattison and Phillips (2001) have adapted the model for Information Visualization (Figure 8.5b). Where the presentation component observes the model for changes and updates its display as necessary, the model component observes both the specification and data model components for change modifications to the specification component are propagated up. This architecture fits in with the dataflow paradigm (Haber and McNabb, 1990). Rather than concentrating on the implementation architecture, our work has focussed on a layered approach that is based on the dataflow model (Roberts, 1999; Boukhelifa et al., 2003) and incorporates more layers than that of Pattison and Phillips (2001). In this approach, the coordination may occur between any parameter at any level of the visualization flow (Figure 8.6). Therefore, the user can link a broad range or aspects
Data Space in Layers World
Coupling across layers Real Life Object
.... s a m ~ ~ Data
-s a m ~ ~
Reference Data t
filter
<
~>
J-
......
Reference Data -L
filter
Coupled data changes, new datasets
J ......
Feature
Feature Set
<
~>
Feature Set
Coupled feature set: data alterations
Object
AVO - Abstract Visualization Object
<
~>
AVO - Abstract Visualization Object
Coupled Object and mapping alterations
......
Viewport
Image
<
~> t
Window
Window
<
~>
Coupled image transformations
,,, Image ......
Window
Coupled window management
Figure 8.6. The diagram shows a layer model, where many different forms of information may be linked and coordinated. For instance, manipulation operations (such as rotation, translation, zoom, etc.) may be concurrently applied to multiple views so as one view is manipulated the other views respond appropriately to the same manipulation operations, the spatial position of a pointer or probe may be linked between multiple views.
170
J.C. Roberts
between several windows, for instance, the view projection transformations can be shared (to co-rotate several 3D objects included in separate windows) or characteristics of the objects can be simultaneously changed (such as their appearance, colour, texture or position, etc.), or window-operations can be coordinated (such as moving, deleting or iconizing windows).
8.4.2
The role of MLVs in the exploration process
The exploration process may be described as a history-tree, indeed, even if the views are a result of a set of random thoughts, each view still relates in some way (however tenuous) to former investigations. Often the newest explorations are close to the former; this is the case especially if the user makes minor amendments to a copy of the previous view. Consequently, it is sensible to consider clusters or groups of closely related views. This can occur as "render groups" (Yagel et al., 1995) where different renderers are used to display the same data filtering (at an equivalent the level to the "Data Model" in Figure 8.5). Information within each render group may be straightforwardly related to each other such that default coordinations may be readily defined (Roberts, 1999). Generating multiple views from any part of exploration process may be useful; here the user keeps older versions of their investigations such that they can compare previous incarnations. They provide a context of the whole exploration process. However, linking outside render groups is challenging as some operations may not be generally applicable such as highlighting elements between two disparate data models when each contains a set of disparate non-intersecting elements. It is both possible and often beneficial to coordinate outside the render groups, for instance, multiple 3D worlds may be simultaneously rotated even if they contain dissimilar realizations. There is an advantage in grouping the multiple views together as Kandogan and Shneiderman (1997) discover through their evaluations: the user better understands the relationships in the views, and can more easily find and drill down to the important aspects of the display.
8.5
Linking and Coordination Concepts
All the aforementioned ideas allow many windows to be created and linked with other views, but, rather than arbitrarily creating and linking views there is usually structure in an investigation. Certainly, when developing a coupled visualization system there are many questions to consider about the coupling. What is being coupled? What are their types? What gets changed? How does the information change? It may be that some links do not make sense and in fact may confuse the user, especially in visualization applied to exploration. Therefore, there are many challenges and much research still to be done. We distil these ideas into some rudiments of coordination.
8.5.1
The rudiments of coordination
In essence, the linking of information between views may be described as "information sharing" For example, if two objects in separate windows were projected using the same shared transformation matrix then any change to that matrix would update both views
Exploratory Visualization with Multiple Linked Views
171
simultaneously. Accordingly, coordination may be thought of as in terms of program variables. Thus, using this analogy the links have the following elements: 9
9
9
9
9
9
C o o r d i n a t i o n entities details what is being coordinated. For example, it could be
aspects of the data, record, parameters, process, event, function, aspects of the window or even time. The type expresses the method by which the views are linked. Coordinating parameter values such as coupling binary threshold operations or selecting ranges may be implemented by sharing primitive types (float, integer, etc.) while other operations may use more complex data structures. Some form of translation (or casting) may be required to coordinate entities with different types. In addition to this translation function, it is often useful to allow more intricate functions, such as to allow entities to be related via an offset (or by some other relation). In virtual reality it may be useful to provide two 3D views with one being at ground level and the other tethered above; the tethered view could provide an overview and thus move correspondingly with the ground view, for example, (see D611ner, this volume (Chapter 16)). The types may also determine the directionality of the links whether unidirectional or bidirectional. C h r o n o l o g y details temporal aspects such as the persistence or lifetime of the coupling, that is, how long the coupling exists? For example, it may be that objects in the scene are coupled for a specific task and then uncoupled when the task is over. Incidentally, like program variables, persistence and scope are inherently related. Moreover, the coordination may be synchronous, asynchronous, reactive, and proactive. For example, it may be useful to join the rotation of two views, one from a fast and the other a slow renderer, such that the slower render gets updated at a lesser rate; additionally, the user may make and review a change, then decide whether to commit or cancel this operation. McDonald et al. (1990) describes these capabilities as markup and commit/cancel. S c o p e controls the "area" of the correlation, whether two specific views, many realizations, or all realizations are coupled within an exploration. For example, the render group scenario is equivalent to a local variable and the global variable would be equivalent to coupling every view in the exploratory session. G r a n u l a r i t y expresses how many entities may be connected together. For example, how many entities are coordinated, how many views are connected in one coordination operation. Initialisation indicates who creates a correlation, whether the user or the system. For example, in spreadsheet system it is possible to name particular views for specific operations, or by using a render group method it is possible to automatically correlate aspects of the views. There is a similar issue regarding the creation of the views themselves. Some visualization systems automatically create the visualizations from a database of knowledge (metadata information) and user requirements. The Vista tool (Senay and Ignatius, 1994), for example, creates appropriate visualizations by asking the user to list the variables in order of preference.
J.C. Roberts
172
Updating describes how and when the information within the views and child modules are updated and refreshed, such as lazy update, or greedy update or user initiated. This is similar to the cold/warm/hot-linking concepts mentioned by Unwin (2001). Cold linking allows an adjacent view to be coupled once and ignores any changes to the former view (similar to copying values rather than copying a formulae in a spreadsheet), warm linking allows the user to decide when to update, hot linking provides automatic and dynamic updating of the linked views. Moreover, the interface should reflect the current state, for example by shading out the out-of-date views. However, it may be that views depend on other views and if the user is relying on the data-history it may be prudent to allow the user to force the update when required. Currently, some general-purpose visualization systems do provide some of these rudiments, for instance, IRIS Explorer allows parameters to be coordinated through unidirectional events and more intricate functions may be formed using the p-func editor; however, IRIS Explorer does not provide bidirectional links and disallows simultaneously connecting the reverse linkage to inhibit circular event explosions taking place. In geovisualization, a good example of linking is that of the bi-directional link between ArcView and xGobi (Symanzik et al., 2000). Coordination is used in other geovisualization systems; the GeoVISTA Studio for example (MacEachren et al., 2001) incorporate some coordination features. Many systems provide an overview map to manage the manipulation of the whole (Steiner et al., 2001; Andrienko and Andrienko, 1999a-f). Additionally panoraMap (Dykes, 2000) allows panoramic photographs (georeferenced with GPS positions) and other information to be dynamically linked with an interactive map, other information such as key-points visited and qualitative and quantitative information collected on site are also shown by icons and symbols on the map. It is clear that there are many issues still unanswered regarding each of these rudiments, for example, are there specific rudiments for geovisualization? Or in general: does it make sense to coordinate different types together? And if so: what translators are required? How does the user recognize the scope of the coordination or indeed understand the persistence or recognize whether something is out-of-date? Moreover, many systems do not provide the full rich set of linking strategies that are possible.
8.6
Management of Views and Linkages
In addition to the linking concepts there are some subsidiary issues to consider, such as managing the views and linkages, placement of the views and temporal aspects.
8.6.1
Managing the MLVs
The essence of lightweight MLVs is that they are easy and quick to generate, but by supporting such a strategy the user may generate many views (that will create a view explosion) where many of the representations are only slightly different to the previous This creates two main problems. First, these many representations may easily clutter
Exploratory Visualization with Multiple Linked Views
173
the screen-space (there is a limited "real-estate" in any screen technology), and thus their needs to be either some form of restraint to guard the user from generating too many windows or management strategies to appropriately and automatically place each window (the latter is detailed in w Second, the user may also be confused as to "which image relates to which data-instance". The systems in the literature provide different solutions. One solution is to inhibit the number of views: Baldonado et al. (2000) provides a useful set of guidelines for using multiple views, and include the rule of parsimony - use multiple views sparingly. Another solution is to trade space by time. Spence (2001) discusses this solution and provides the idea of rapid serial visual presentation (RSVP); this allows the user to rifle through a set of objects analogous to flicking through the pages of a book in order to acquire some understanding of its content. This space/time trade off may be described as an overlay methodology. Finally, a good policy would be to use the three strategies (replacement, overlay and replication) together, allowing the user to replace certain instances and replicate when they need to achieve side-by-side comparisons. It is important that the user should clearly understand the relationship of how each view relates to each data model. Many systems display the history tree (on a workpane or canvas) allowing the user to rollback to previous versions (Brodlie et al., 1993; Wexelblat and Maes, 1999). Then the problem becomes how to relate the views with the canvas. This can be achieved using various methods. In the Waltz system (Roberts, 1998a,b), each window is labelled, relating it to its respective module on the work-pane. This is a hierarchical numbering scheme, like the sections of a book, and is used to name each view. The names are then displayed on the history tree. The spiral calendar (Mackinlay et al., 1994) provides a graphical solution by using lines to relate one window to another. There is still much work to be done in developing effective view management strategies for MLVs; whether managing the placement of the views, controlling a possible view explosion, or relating the view information to that of the exploration hierarchy.
8.6.2
View placement strategies
The placement of the many windows can have a significant impact on the usability of the system: it is an important human computer interaction issue. Overlapping windows can cause the user to spend more time arranging the windows rather than doing the task (Kandogan and Shneiderman, 1997), whereas the screen may not be large enough to display each required view simultaneously. There are different placement strategies described as follows. First, the user is given the responsibility to position, iconize and scale the windows. As it is often difficult to select and find occluded windows, the system provides a repository or toolbar to hold a list of the displayed windows. This may take the form of a list of the named views, collection of icons, or thumbnail representation of the current views. Second, the system holds the responsibility for placing the views on the screen. These "intelligent" interfaces tile (or tabulate) the windows such that they appear
174
J.C. Roberts
adjacently without overlap. Elastic views (Kandogan and Shneiderman, 1997) provide a good example; in this methodology, the windows are hierarchically placed on the screen and dynamically scaled to fill the available space. Alternatively, spreadsheet styles are becoming popular (Chi et al., 1998; Jankun-Kelly and Ma, 2001) where the views are positioned in a tabular formation. Furthermore, the strategy may depend on some aspect of the data exploration or some other metric. For example, windows could be scaled smaller if less important, implemented by a zoomable interface such as Pad-+-+ (Perlin and Fox, 1993), or presented in a scatter plot form where the placement of each is dependent on two variables, or hierarchically as in the Flip zoom technique (Holmquist and Ahlberg, 1997). Many of the current multiple view visualization systems hand the responsibility to the user, however, there is much benefit in structuring the position of the views relative to each other. Thus, strategies for positioning the views appropriately should be researched. Many questions remain including: are the requirements of an MLV visualization system very much different to that of a traditional windowing system?
8.6.3
Chronology, animation and timing in MLV
Many datasets are time dependent; their visualization in an MLV environment may be treated in different ways. The simple case is to generate an animation of the data. In the above terminology, each frame would replace the previous. Alternatively, each individual frame (or a sample of frames) may be displayed in a separate view (or stacked and overlaid in a single view). Coupling multiple-view animations would involve synchronizing the two streams. This may be at a fine granularity (e.g., tightly synchronizing each individual frame) or coarse granularity (e.g., synchronizing on specified key-frames). Additionally, it may be that there are objects animated or moving in the scene (such as people, planes or boats). It may be useful to couple one view to the moving object and provide another view of the whole environment. The linked view may be tethered such that it looks down on the object being moved (separated by an appropriate distance). For example, the GeoZui3D of Plumlee and Ware (2003) provide different "frame of reference coupling" methods that describe how the new view moves in relation to the animated objects.
8.7
Current Objectives and Challenges
Recent research has focussed on providing principles for multiple views (Baldonado et al., 2000) and examining linking methods such as Roberts' taxonomy of coordination (Roberts, 1999; Boukhelifa et al., 2003) and North's Snap-together system (North and Shneiderman, 2000a) that allows unforeseen combinations of coordinated visualizations. This research is opening the way for more expressive investigation environments that support the user in their task rather than distracting the user from their task. Currently many multi-view systems only really support a few views where the system determines what and how the information is linked. Thus, further research should focus on developing systems that utilize many lightweight views that are truly quick to
Exploratory Visualization with Multiple Linked Views
175
generate and automatically linked with other information and implicit to operate. Indeed, the system could be designed that would suggest or automatically generate other views that the user had not thought of using. The user may find these non-traditional views unfamiliar, but this unfamiliarity itself may provide a better understanding. There are many issues surrounding MLVs that are lightweight (some have been highlighted in this chapter). To develop an appropriate MLV system that utilizes these aforementioned concepts, it may be that the system needs to automatically generate the visualizations on behalf of the user, such as in the Vista system (Senay and Ignatius, 1994) or at least make it as easy as possible to generate further representations (Roberts, 1998a,b). Furthermore, if the system provides a diverse and functional-rich interface then the user may be overwhelmed by the nature of the system. Overall, a balance needs to be found both to generate the right amount of views for the task (whether they are by replacement, replication or overlay), and to provide an expressive linking mechanism that also restrains the user from performing incomprehensible and unprofitable coupling operations. In addition, more empirical research needs to take place on the different designs to evaluate what is useful. Kandogan and Shneiderman (1997) have evaluated the effectiveness of certain multiple view systems and North and Shneiderman (2000b) have looked at coordinated views. However, more studies are needed. It is well understood that the effectiveness of a particular system or design is highly dependent on the visualization or investigative task and the domain; to this end Baldonado et al. (2000) offers some guidelines, but it still remains unclear when the user should replace, replicate or overlay the information to gain the best understanding. The geovisualization domain poses many challenges (MacEachren and Kraak, 2001). Indeed, highly interactive systems have already been developed such as Descartes (Andrienko and Andrienko, 1999a-f), GeoVIBE (Cai, 2001) and cdv (Dykes, 1997a,b). However, further research is required to put in place the tools and techniques that will allow appropriate multiple-view exploratory geovisualization systems to be easily developed. We propose the following strands of research: 1. Specific geovisualization reference models and toolkits need to be developed that incorporate lightweight MLVs and include the rudiments of coordination. 2. The tools need to support dynamic queries and complex coordination operations enabling highly interactive context + focus navigation. 3. The developed systems need to be easily extensible that will allow the data from the ever increasing and diverse range of data to be suitably visualized. 4. Methods need to be developed that integrate a wide range of different presentation methods, thus, allowing the user to view the information from different perspectives and try out different scenarios.
Acknowledgements This work has been supported by EPSRC (grant reference: GR/R59502/01) entitled coordinated views in exploratory visualization (CVEV), http://www.cvev.org. Moreover, I acknowledge Peter Rodgers and Nadia Boukhelifa and other colleagues in the Kent Visualization Group for their help in this work.
176
J.C. Roberts
References
Ahlberg, C., (1996) "Spotfire: an information exploration environment", SIGMOD Record, 24(4), 25-29. Ahlberg, C., and Shneiderman, B., (1994) "Visual information seeking: tight coupling of dynamic query filters with starfield displays", In: Adelson, B., Dumais, S., and Olson, J. S., (eds.), CHI'94 Human Factors in Computing Systems, Boston, MA, 24-28 April. New York: ACM Press, pp. 313-317. Ahlberg, C., and Wistrand, E., (1995a) "IVEE: an environment for automatic creation of dynamic queries applications", Human Factors in Computing Systems. Proceedings of CHI'95. New York: ACM Press. Ahlberg, C., and Wistrand, E., (1995b) "IVEE: an information visualization and exploration environment", Proceedings International Symposium on Information Visualization, Atlanta, GA, pp. 66-73. A.I. Amerinex Inc., (1992) General Support Tools for Image Understanding. Online: http ://www. aai. com/AAI/KB V/KB V.html (23 / 10/03 ). Andrienko, and Andrienko, (1999a) Seasonal Migration of White Storks, 1998-1999. Online: http://www.ais.fhg.de/and/java/birds/(23/10/03). Andrienko, G., and Andrienko, N., (1999b) "GIS visualization support to the C4.5 classification algorithm of KDD", Proceedings of the 19th International Cartographic Conference, pp. 747-755. Andrienko, G., and Andrienko, N., (1999c) "Knowledge-based visualization to support spatial data mining", Proceedings of Intelligent Data Analysis. Berlin: Springer, pp. 149-160. Andrienko, G., and Andrienko, N., (1999d) "Making a GIS intelligent: CommonGIS project view", AGILE'99 Conference, Rome, April 15 - 17, pp. 19-24. Andrienko, G., and Andrienko, N., (1999e). Seasonal Migration of White Storks, 1998-1999. Online: http://www.ais.fhg.de/and/java/birds/(03/10/02). Andrienko, G. L., and Andrienko, N. V., (1999f) "Interactive maps for visual data exploration", International Journal Geographic Information Science, 13(4), 355-374. Baldonado, M. Q. W., Woodruff, A., and Kuchinsky, A., (2000) "Guidelines for using multiple views in information visualization", Proceedings ofA VI '2000, pp. 110-119. Becker, R. A., and Cleveland, W. S., (1987) "Brushing scatterplots", Technometrics, 29(2), 127-142. Bier, E. A., Stone, M. C., Pier, K., Buxton, W., and DeRose, T., (1993) "Toolglass and magic lenses: the see-through interface", Proceedings SIGGRAPH'93, Anaheim, CA, pp. 73-80. Boukhelifa, N., Roberts, J. C., and Rodgers, P. J., (2003) "A coordination model for exploratory multi-view visualization", Proceedings of Coordinated and Multiple Views in Exploratory Visualization (CMV2003), July 2003. Piscataway, NJ: IEEE. Brodlie, K., Poon, A., Wright, H., Branklin, L., Banecki, G., Gay, A., and Cai, G. (1993) "GRASPARC - a problem solving environment integrating computation and
Exploratory Visualization with Multiple Linked Views
177
visualization", Proceedings Visualization'93. Los Alamitos, CA: IEEE Computer Society Press, pp. 102-109. Brunsdon, C., (2001) "The comap: exploring spatial pattern via conditional distributions", Computers, Environment and Urban Systems, 25, 53-68. Cai, G., (2001) "GeoVIBE: a visual interface to geographic digital library", JCDL Workshop on Visual Interfaces, ACM/IEEE. Card, S. K., (1996) "Visualizing retrieved information: a survey", IEEE Computer Graphics and Applications, 3(16), 63-67. Carr, D., (1999) "Guidelines for designing information visualization applications", Proceedings of ECUE'99, Stockholm, Sweden, pp. 1-3. Carr, D. B., Littlefield, R. J., Nicholson, W. L., and Littlefield, J. S., (1987) "Scatterplot matrix techniques for large N", Journal of the American Statistical Association, 82(398), 424-436. Chi, E. H. et al., (1998) "Principles for information visualization spreadsheets", IEEE Computer Graphics and Applications, 18(4), 30-38. Chuah, M. C., and Roth, S. F., (1995) "SDM: selective dynamic manipulation of visualizations", Proceedings UIST'95. Cleveland, W. S., and McGill, M. E., (1988) Dynamic Graphics for Statistics. Belmont, CA: Wadsworth. DiBiase, D., (1990) "Visualization in the earth sciences, earth and mineral sciences", Bulletin of the College of Earth and Mineral Sciences, The Pennsylvania State University, 59(2), 13-18. Dupont, W. D., and Plummer, W. D. J., (2003) "Density distribution sunflower plots", Journal of Statistical Software, 8(3). Dykes, J. A., (1995) "Cartographic visualization for spatial analysis", In: Proceedings International Cartographic Conference, Barcelona, pp. 1365-1370. Dykes, J., (1997a) "cdv: a flexible approach to ESDA with free software demonstration", In: Proceedings of the British Cartographic Society 34th Annual Symposium, Leicester, UK, pp. 100-107. Dykes, J. A., (1997b) "Exploring spatial data representation with dynamic graphics", Computers & Geosciences, 23(4), 345-370, Online: http://www.mimas.ac.uk/argus/ICA/J.Dykes/ Dykes, J. A., (2000) "An approach to virtual environments for fieldwork using linked geo-referenced panoramic imagery", Computers, Environment and Urban Systems, 24(2), 127-152, Online: http://www.geog.le.ac.uk/jad7/CE&US/(6/21/1999). Felger, W., and Schr6der, F., (1992) "The visualization in-put pipeline - enabling semantic interaction in scientific visualization", Proceedings of Eurographics 92, Eurographics Association, pp. 39-151. Ferreira, J. J., and Wiggins, L. L., (1990) "The density dial: a visualization tool for thematic mapping", Geo Info Systems, 10, 69-71. Fuhrmann, S., and MacEachren, A. M., (1999) "Navigating desktop GeoVirtual environments", IEEE Information Visualization 99, Late Breaking Hot Topics Proceedings, San Francisco, CA, Oct. 23-28, pp. 11-14. Online: http://www.geovista.psu.edu/publications/amm/ammIV99.pdf
178
J.C. Roberts
Fuhrmann, S., and MacEachren, A. M., (2001) "Navigation in desktop geovirtual environments: usability assessment", 20th International Cartographic Conference Mapping the 21st Century, Beijing, pp. 2444-2453. Gahegan, M., (1998) "Scatterplots and scenes: visualization techniques for exploratory spatial analysis", Computers, Environment and Urban Systems, 22(1), 43-56. Haber, R. B., and McNabb, D. A., (1990) "Visualization idioms: a conceptual model for scientific visualization systems", In: Nielson, G., Shriver, B., and Rosenblum, L., (eds.), Visualization in Scientific Computing. Piscataway, NJ: IEEE Computer Society Press, pp. 74-93. Holmquist, L. E., and Ahlberg, C., (1997) "Flip zooming: a practical focus + context approach to visualizing large information sets", Procedings HCI International'97. Amsterdam: Elsevier, pp. 763-766. Jacobson, A. S., Berkin, A. L., and Orton, M. N., (1994) "LinkWinds: interactive scientific data analysis and visualization", Communications of the ACM, 37(4), 43-52. Jankun-Kelly, T. J., and Ma, K.-L., (2001) "Visualization exploration and encapsulation via a spreadsheet-like interface", IEEE Transactions on Visualization and Computer Graphics, 7(3), 275-287. Kandogan, E., and Shneiderman, B., (1997) "Elastic windows: evaluation of multiwindow operations", A CM Proceedings CHI'97: Human Factors in Computing Systems, Atlanta, GA. New York: ACM, pp. 250-257. Keahey, T. A., and Robertson, E. L., (1997) "Nonlinear magnification fields", Proceedings of the IEEE Symposium on Information Visualization: IEEE Visualization, Oct.1997, pp. 51-58. Kosara, R., Miksch, S., and Hauser, H., (2002) "Focus + context taken literally", IEEE Computer Graphics & Applications, 22(1), 22-29, (Jan~eb 2002). Lamping, J., Rao, R., and Pirolli, P., (1995) "A focus ยง context technique based on hyperbolic geometry for visualizing large hierarchies", Proceedings of CHI'95 Human Factors in Computing Systems, Denver, CO, May 1995. New York: ACM Press, pp. 401-408. Lokuge, I., and Ishizaki, S., (1995) "Geospace: an interactive visualization system for exploring complex information spaces", CHI'95 Proceedings. New York: ACM, pp. 409-414. MacEachren, A. M., and Kraak, M.-J., (2001) "Research challenges in geovisualization", Cartography and Geographic Information Society, 28(1), 3-12. MacEachren, A. M., Hardisty, F., Gahegan, M., Wheeler, M., Dai, X., Guo, D., and Takatsuka, M., (2001) "Supporting visual integration and analysis of geospatiallyreferenced statistics through web-deployable, cross-platform tools", Proceedings, dg.o.2001, National Conference for Digital Government Research, Los Angeles, CA, May 21-23, pp. 17-24. Mackinlay, J. D., Robertson, G. G., and DeLine, R., (1994) "Developing calendar visualizers for the information visualizer", Proceedings ACM UIST, Nov., 109-119. McDonald, J. A., Stuetzle, W., and Buja, A., (1990) "Painting multiple views of complex objects", ECOOP/OOPSLA'90 Proceedings. New York: ACM Press, pp. 245-257.
Exploratory Visualization with Multiple Linked Views
179
Monmonier, M., (1989) "Geographic brushing: enhancing exploratory analysis of the scatterplot matrix", Geographical Analysis, 21 (1), 81-84. North, C. and Shneiderman, B., (1997) A taxonomy of multiple window coordinations, Tecnical Report #CS-TR-3854. University of Maryland, Computer Science Dept. North, C., and Shneiderman, B., (2000a) "Snap-together visualization: a user interface for coordinating visualizations via relational schemata", Proceedings of Advanced Visual Interfaces 2000, Italy, pp. 128-135. North, C., and Shneiderman, B., (2000b) "Snap-together visualization: can users construct and operate coordinated visualizations?", International Journal of Human-Computer Studies, 53(5), 715-739. Olson, G. M., Malone, T. W., and Smith, J. B., (2001) Coordination Theory and Collaboration Technology, Lawrence Erlbaum Associates, Inc. Pattison, T., and Phillips, M., (2001) "View coordination architecture for information visualisation", Australian Symposium on Information Visualisation, Sydney, Australia. Darlinghurst, Australia: Australian Computer Society, Inc. Pepke, E. and Lyons, J., (1993) SciAn: User's Manual. Online: http://www.scri.fsu.edu/---lyons/scian (01/10/02). Perlin, K., and Fox, D., (1993) "Pad: an alternative approach to the computer interface", In: Kajiya, J. T., (ed.), Proceedings of the 20th Annual A CM Conference on Computer Graphics (SIGGRAPH'93), Anaheim, CA, Aug. 2-6. NY: ACM Press, pp. 57-64. Plumlee, M., and Ware, C., (2003) "Integrating multiple 3D views through frame-ofreference interaction", Proceedings of Coordinated and Multiple Views in Exploratory Visualization (CMV2003), July 2003. Piscataway, NJ: IEEE Computer Society. Roberts, J. C., (1998a) "On encouraging multiple views for visualization", Information Visualization IV'98. Piscataway, NJ: IEEE Computer Society, pp. 8-14. Roberts, J. C., (1998b) "Waltz - an exploratory visualization tool for volume data, using multiform abstract displays", Visual Data Exploration and Analysis V, Proceedings of SPIE, Jan. 1998, p. 11. Roberts, J. C., (1999) "On encouraging coupled views for visualization exploration", Visual Data Exploration and Analysis VI, Proceedings of SPIE, Jan. 1999, SPIE, pp. 14-24. Roberts, J. C., Knight, R., Gibbins, M., and Patel, N., (2000) "Multiple window visualization on the web using VRML and the EAI", In: Hollands, R., (ed.), Proceedings of the Seventh UK VR-SIG Conference, Sept. 2000, pp. 149-157. Roth, S. F. et al., (1996) "Visage: a user interface environment for exploring information", Proceedings of Information Visualization, 3-12. Senay, H., and Ignatius, E., (1994) "A knowledge-based system for visualization design", IEEE Computer Graphics and Applications, 6(14), 36-47. Sheelagh, M., (1997) "Extending distortion viewing from 2D to 3D", IEEE Computer Graphics and Applications, 4(17), 42-51. Shneiderman, B., (1994) "Dynamic queries for visual information seeking", IEEE Software, 11 (6), 70-77.
180
J.C. Roberts
Snyder, J. P., (1987) "Magnifying glass azimuthal map projection", The American Cartographer, 14(1), 61-68. Spence, R., (2001) Information Visualization. Harlow: Addison Wesley/ACM Press Books, 206 pp. Steiner, E. B., MacEachren, A. M., and Guo, D., (2001) "Developing and assessing lightweight data-driven exploratory geovisualization tools for the web", 20th International Cartographic Conference, Beijing, China, Aug. 6-10. Stonebraker, M., Chen, J., Nathan, N., Paxon, C., Su, A., and Wu, J., (1993) "Tioga: a database-oriented visualization tool", Proceedings Visualization'93. Piscataway, NJ: IEEE Computer Society Press, pp. 86-93. Symanzik, J., Cook, D., Lewin-Koh, N., Majure, J. J., and Megretskaia, I., (2000) "Linking ArcView and XGobi: insight behind the front end", Journal of Computational and Graphical Statistics, 9(3), 470-490. Theus, M., (2002a) "Geographical information systems", In: Kloesgen, W., and Zytkow, J., (eds.), Handbook of Data Mining and Knowledge Discovery. New York: Oxford University Press, pp. 232-241. Theus, M., (2002b) "Interactive data visualization using Mondrian", Journal of Statistical Software, 7 (11). Unwin, A., (2001) "R objects, two interfaces! (R objects to interfaces?)", Proceedings of the 2nd International Workshop on Distributed Statistical Computing. Unwin, A. R., Hawkins, G., Hofmann, H., and Siegl, B., (1996) "Interactive graphics for data sets with missing values - MANET", Journal of Computational and Graphical Statistics, 5(2), 113-122. Ward, M., (1994) "XmdvTool: integrating multiple methods for visualizing multivariate data", Proceedings Visualization'94. Piscataway, NJ: IEEE Computer Society Press, pp. 326-333. Wexelblat, A., and Maes, P., (1999) "Footprints: history-rich tools for information foraging", Proceedings of CHI 99, Pittsburgh, PA. New York: ACM Press, pp. 270-277. Williams, C., Rasure, J., and Hansen, C., (1992) "The state of the art of visual languages for visualization" Proceedings Visualization'92, Piscataway, NJ: IEEE Computer Society Press, pp. 202-209. Williamson, C., and Shneiderman, B., (1992) "The dynamic home finder: evaluating dynamic queries in a real-estate information exploration system", Proceedings of the ACM SIGIR'92 Conference. New York: ACM Press, pp. 338-346. Wright, H., (1996) The HyperScribe Data Management Facility, NAG Technical Report TRl-~96, NAG. Yagel, R., Ebert, D. S., Scott, J. N., and Kurzion, Y., (1995) "Grouping volume renderers for enhanced visualization in computational fluid dynamics", IEEE Transactions on Visualization and Computer Graphics, 2(1), 117-132. TM
Exploring Geovisualization J. Dykes, A.M. MacEachren, M.-J. Kraak (Editors) 9 2005 Published by Elsevier Ltd. All rights reserved.
Chapter 9
Visualizing, Querying and Summarizing Individual Spatio-Temporal Behaviour David Mountain, Geographic Information Science Group, Department of Information Science, City University, Northampton Square, London EC1V 0HB, UK
Keywords: collapsed real-time, geographic relevance, mobile telecommunication, mobile trajectory, spatial behaviour, spatial history explorer, spatio-temporal query, spotlights, time geography
Abstract Recent technological advances, in particular the increased ownership of mobile telecommunication devices, have led to the generation of vast quantities of spatiotemporal data recording the movement of individuals. Concurrently mobile devices are an increasingly important means of accessing information, adding a sense of place to Internet usage that has previously been relatively time and space insensitive. Mobile Internet users often have an information need, either to find a service or answer a query, provoked by some stimulus from the real world that they want to satisfy rapidly to assist decision-making. The interactive visualization of previous spatial behaviour can allow the simultaneous manipulation of space, time and attribute offering insight (at the exploratory stage of work) into underlying processes that may drive or constrain individual behaviour. This in turn assists in the development of algorithms to augment mobile information searches with spatio-temporal information derived from previous behaviour. Several interactive techniques and summaries of spatial behaviour are presented. An interactive tool for visualization of the movement of individuals (or other point entities) across space over time, the spatial history explorer, is described. Approaches for interactive spatio-temporal querying, visualizing mobility attributes and representing the cyclical nature of time are suggested. This approach of linking spatial and temporal representations is then contrasted with a single 3D spatiotemporal representation based upon a time geography approach. Finally, several surface representations that summarize large volumes of point data are described, in particular for identifying interesting locations associated with destinations, transport links and constraints. The insight gained from these techniques has led to several approaches to improving the way in which mobile individuals access digital information; this work is ongoing and described briefly in the conclusions. 181
182
9.1
D. Mountain
Introduction
Recent and continuing advances in mobile telecommunications technology have had a significant impact upon the nature and volume of information stored about individual spatial behaviour (Golledge and Stimson, 1997). Mobile telecommunication devices generate vast quantities of spatio-temporal data from logged network traffic recording when a mobile device, and by inference its owner, was in a particular network cell (Swedberg, 1999; Mountain and Raper, 2001a,b). The spatial accuracy of this information is increasing due to legal (Federal Communications Commission, 2002) and commercial imperatives promising detailed records of individual movement that can be made available with the permission of that individual. These vast, rich data sources offer great utility in numerous disciplines beyond monitoring spatial variation in quality of service (of network connection), the application to which they have thus far been applied. Information about the spatial behaviour of individuals has value theoretically in developing models of individual accessibility (Miller, 1991; Kwan, 2000a,b), in resource management for managers of natural recreation areas (WebPark Project, 2002), and in transportation planning to see (for example) how temporary migration may affect demand upon the transport infrastructure. Advances in the collection and processing of data has allowed the disaggregate approach (Frihida et al., 2002) to be used in transportation and consumer behaviour modelling considering the decisions made by individuals based upon the options available to them, in contrast to aggregate approaches that considered the needs of groups of people based upon distinct regions. Issues of privacy and availability of individual information (Barr, 2000) mean that an individual must consent to the release of this information for such modelling to take place. Individuals must feel that they are getting some service in return for granting this consent. Concurrently, mobile devices are an increasingly important means of accessing information via Web browsers and wireless connections, moving the Internet experience from static to mobile (Vincent, 1999). This is adding a sense of place that has been less obvious when searching for information from a static location such as an immobile desktop machine. Rather than accessing information sources that are relatively time and space insensitive, mobile Internet users often need to access information that is relevant to their physical location at that time, and to do so quickly since the mobile Internet tends to be a less absorbing environment than the static version (attention can be distracted by the external environment). People often have an information need either to find a service or answer a query provoked by some stimulus from the real world, which they want to satisfy rapidly to assist decision-making. Just as static users of the Web require filtering to avoid information overload, so users of mobile communications devices require techniques to ensure that the information they receive is relevant (Dykes and Mountain, 2003). Heuristics based on previous user behaviour could identify geographically relevant information (Raper, 2001) offering an incentive for individuals to overcome their concerns regarding privacy and release their positional data for analysis.
Visualizing, Querying and Summarizing Individual Spatio-Temporal Behaviour
183
The nature and availability of this geographic information (GI) has contributed to a recent trend for increasing numbers of collaborations between information scientists and geographers, for example, (see Andrienko et al., this volume (Chapter 5)). The geographic component of information is often used to generate an organizational structure for a wide range of information and spatial metaphors are used to graphically represent a non-spatial information source (Fabrikant, 2000a,b; Fabrikant and Skupin, this volume (Chapter 35)). A highly interactive approach that allows the simultaneous manipulation of space and time can offer insight at the exploratory stage of work and altering the spatial and temporal scales of analysis can reveal different processes that may drive or constrain individual behaviour. This chapter describes efforts to visualize, query and summarize personal spatiotemporal data of this nature in the context of previous research. The spatial history explorer (SHE) has been developed specifically to analyze such datasets in a highly interactive environment that places equal importance upon both the spatial and temporal location of data. A dataset recording the location of a moving point object through time has been termed a mobile trajectory (Smyth, 2000), referring to a path created by that object across space through time. This path has also been called a world line (Raper, 2000), life path (H~igerstand, 1970), space-time path (Miller, 1991) and spatial history. Such mobile trajectories, as well as being recorded by mobile networks (in a way less conducive to retrieving the movement of individuals) can be downloaded from handheld GPS. This has been done by several volunteers at City University who have generated many months of GPS data, some of which will be used as examples in this chapter. Since GPS signals cannot penetrate masonry the dataset cannot be complete and sometimes "no data" can be taken as a proxy for no movement; algorithms have been developed to augment GPS datasets with data for time spent at destinations to provide a less biased mobile trajectory.
9.2
Background
Traditional Glsystems have received criticism for being most suited to an inventory role of objects with a spatial reference at a fixed moment in time (Langran, 1992; Wang and Cheng, 2001). If we accept that geographic space is a combination of space, time and attribute (Parkes and Thrift, 1980), then in order to be more than spatial information systems, Glsystems must include the temporal component and allow the modelling of dynamic processes. Increasingly, the temporal component is also being included in geovisualization processes (Andrienko and Andrienko, 1999a-f; Wang and Cheng, 2001; Dykes and Mountain, 2003) although the idea pre-dates the computing era with examples from the nineteenth century on paper (Tufte, 1983) and on the cusp of the digital age using film (Moellering, 1976). In order to develop effective on-screen realizations and interact with the temporal component, the nature of the spatio-temporal processes we aim to represent must be understood. Within the GI community, spatial data structures have been the focus of more previous research than temporal databases (A1-Taha et al., 1994), however more recent efforts to define a truly spatio-temporal Glsystem has forced researchers to consider the dynamic characteristics of the real world entities that they wish to represent.
184
D. Mountain
Claramunt and Th6riault (1996) define three main classes of spatio-temporal processes related to the evolution of an individual entity, dynamic relationships between multiple entities and the restructuring of complex entities. The classes are hierarchical, for example, evolution of individual entities comprises changes in existence, location and physical transformation (of shape or size). Sixteen subclasses are used in all to represent all possible spatio-temporal processes. Much parallel research is being conducted leading to representations of phenomena being developed that may only be relevant within one of the classes or subclasses of spatio-temporal process identified above. For example, land-use change can be represented by discrete events where complex entities are restructured internally (Peuquet and Duan, 1995) and dynamic geomorphological systems can be represented by succession of or transmission between multiple entities (Raper and Livingstone, 1995). These two examples are dependent upon an area representation whereas modelling individual mobility, the focus of this chapter, can be better represented by the movement of a point abstraction (Erwig et al., 1999) since the space occupied by individuals is negligible for most scales of analysis. A current focus for modelling entities as mobile point abstractions is in fleet monitoring for haulage firms and transportation systems (Cleary, 2000). Individual mobility is most suited to representation by stepwise change (defined by Wang and Cheng as an object that is sometimes moving and sometime