EXPLORING GEOVISUALIZATION
The maps on the cover are spatializations that use the landscape metaphor to represent the information in this book. The symbols represent the chapters, the relationships between them and the themes that they address as described in the Preface. Maps by Sara Fabrikant, Jo Wood and Jason Dykes.
EXPLORING GEOVISUALIZATION
Edited by
j. Dykes Department of Information Science City University, London, UK
A.M. MacEachren Departmentof Geography, Penn State University University Park, PA, USA
M.-J. Kraak Department of Geolnformation Processing International Institute of Geolnformation Science and Earth Observation (ITC), Enschede, The Netherlands
2005 tea
A C t
ELSEVIER
Published on behalf of the International Cartographic Association by Elsevier Amsterdam Paris - San
- Boston Diego
- Heidelberg
- San Francisco
- London
- New York-
- Singapore
- Sydney
Oxford - Tokyo
ELSEVIER B.V. Radarweg 29 P.O. Box 211, 1000 AE Amsterdam The Netherlands
ELSEVIER Inc. 525 B Street, Suite 1900 San Diego, CA 92101-4495 USA
ELSEVIER Ltd The Boulevard, Langford Lane Kidlington, Oxford OX5 1GB UK
ELSEVIER Ltd 84 Theobalds Road London WC 1X 8RR UK
9 2005 Elsevier Ltd. All rights reserved. This work is protected under copyright by Elsevier Ltd, and the following terms and conditions apply to its use: Photocopying Single photocopies of single chapters may be made for personal use as allowed by national copyright laws. Permission of the Publisher and payment of a fee is required for all other photocopying, including multiple or systematic copying, copying for advertising or promotional purposes, resale, and all forms of document delivery. Special rates are available for educational institutions that wish to make photocopies for non-profit educational classroom use. Permissions may be sought directly from Elsevier's Rights Department in Oxford, UK: phone (+44) 1865 843830, fax (+44) 1865 853333, e-mail:
[email protected]. Requests may also be completed on-line via the Elsevier homepage (http://www.elsevier.com/locate/permissions). In the USA, users may clear permissions and make payments through the Copyright Clearance Center, Inc., 222 Rosewood Drive, Danvers, MA 01923, USA; phone: (+1) (978) 7508400, fax: (+1) (978) 7504744, and in the UK through the Copyright Licensing Agency Rapid Clearance Service (CLARCS), 90 Tottenham Court Road, London WIP 0LP, UK; phone: (+44) 20 7631 5555, fax: (+44) 20 7631 5500. Other countries may have a local reprographic rights agency for payments. Derivative Works Tables of contents may be reproduced for internal circulation, but permission of the Publisher is required for external resale or distribution of such material. Permission of the Publisher is required for all other derivative works, including compilations and translations. Electronic Storage or Usage Permission of the Publisher is required to store or use electronically any material contained in this work, including any chapter or part of a chapter. Except as outlined above, no part of this work may be reproduced, stored in a retrieval system or transmitted in any form or by any means, electronic, mechanical, photocopying, recording or otherwise, without prior written permission of the Publisher. Address permissions requests to: Elsevier's Rights Department, at the fax and e-mail addresses noted above. Notice No responsibility is assumed by the Publisher for any injury and/or damage to persons or property as a matter of products liability, negligence or otherwise, or from any use or operation of any methods, products, instructions or ideas contained in the material herein. Because of rapid advances in the medical sciences, in particular, independent verification of diagnoses and drug dosages should be made. First edition 2005 Reprinted 2007 Library of Congress Cataloging in Publication Data A catalog record is available from the Library of Congress. British Library Cataloguing in Publication Data A catalogue record is available from the British Library. ISBN-13:978-0-08-044531-1 ISBN-10:0-08-044531-4 (Hardbound) ISBN-10:0-08-044533-0 (CD-rom) O The paper used in this publication meets the requirements of ANSI/NISO Z39.48-1992 (Permanence of Paper). Printed in China.
Working together to grow libraries in developing countries www.elsevier.com I www.bookaid.org ] www.sabre.org
Contents Preface ................................................................................................................
ix
Digital Appendices ...........................................................................................
xiii
Acknowledgments .............................................................................................
xv
List of Contributors .........................................................................................
xvii
Introduction: Exploring Geovisualization 1. Exploring Geovisualization Jason Dykes, Alan M. MacEachren & Menno-Jan Kraak ....................... 3
Section A Geovisualization in Context: Perspectives from Related Disciplines 2. Information Visualization: Scope, Techniques and Opportunities for Geovisualization Daniel A. Keim, Christian Panse & Mike Sips ...................................... 23 3. Information Visualization and the Challenge of Universal Usability Catherine Plaisant .................................................................................... 53 4. Beyond Tools: Visual Support for the Entire Process of GIScience Mark Gahegan .........................................................................................
83
Section B Creating Instruments for Ideation: Software Approaches to Geovisualization Perspectives 5. Creating Instruments for Ideation: Software Approaches to Geovisualization Gennady Andrienko, Natalia Andrienko, Jason Dykes, David Mountain, Penny Noy, Mark Gahegan, Jonathan C. Roberts, Peter Rodgers & Martin Theus ............................................................. 103
vi
Exploring Geovisualization
6. Statistical Data Exploration and Geographical Information Visualization Martin Theus .......................................................................................... 127 7. Graph Drawing Techniques for Geographic Visualization Peter Rodgers ......................................................................................... 143 8. Exploratory Visualization with Multiple Linked Views Jonathan C. Roberts ............................................................................... 159 9. Visualizing, Querying and Summarizing Individual Spatio-Temporal Behaviour David Mountain ..................................................................................... 181 10. Impact of Data and Task Characteristics on Design of Spatio-Temporal Data Visualization Tools Natalia Andrienko, Gennady Andrienko & Peter Gatalsky ................. 201 11. Using Multi-agent Systems for GKD Process Tracking and Steering: The Land Use Change Explorer Monica Wachowicz, Xu Ying & Arend Ligtenberg ............................ 223 12. Signature Exploration, a Means to Improve Comprehension and Choice within Complex Visualization Processes: Issues and Opportunities Penny Noy ............................................................................................. 243 13. Facilitating Interaction for Geovisualization Jason Dykes ........................................................................................... 265
Section C
Using 3D in Visualization
14. Using 3D in Visualization Jo Wood, Sabine Kirschenbauer, Jtirgen D611ner, Adriano Lopes & Lars Bodum .............................................................. 295 15. Multim im parvo Many Things in a Small Place Jo Wood ................................................................................................. 313 -
16. Geovisualization and Real-Time 3D Computer Graphics Jtirgen D611ner ....................................................................................... 325
Table of Contents
vii
17. Interactive Approaches to Contouring and Isosurfacing for Geovisualization Adriano Lopes & Ken Brodlie .............................................................. 345 18. Applying "True 3D" Techniques to Geovisualization: An Empirical Study Sabine Kirschenbauer ............................................................................ 363 19. Modelling Virtual Environments for Geovisualization: A Focus on Representation Lars Bodum ........................................................................................... 389 20. Web-based Dissemination and Visualization of Operational 3D Mesoscale Weather Models Lloyd A. Treinish .................................................................................. 403
Section D Connecting People, Data and Resources: Distributed Geovisualization 21. Connecting People, Data and Resources - Distributed Geovisualization Ken Brodlie, David Fairbairn, Zarine Kemp & Michael Schroeder ................................................................................. 425 22. Moving Geovisualization toward Support for Group Work Alan M. MacEachren ............................................................................ 445 23. Models of Collaborative Visualization Ken Brodlie ............................................................................................ 463 24. Intelligent Information Integration: From Infrastructure through Consistency Management to Information Visualization Michael Schroeder ................................................................................. 477 25. A Knowledge-based Collaborative Environment for Geovisualization: Ontologies for Multiple Perspectives on Distributed Data Resources Zarine Kemp .......................................................................................... 495 26. Geovisualization Issues in Public Transport Applications David Fairbairn ...................................................................................... 513 27. Presenting Route Instructions on Mobile Devices: From Textual Directions to 3D Visualization Volker Coors, Christian Elting, Christian Kray & Katri Laakso ......... 529
viii
Exploring Geovisualization
Section E Making Useful and Useable Geovisualization: Design and Evaluation Issues 28. Making Useful and Useable Geovisualization: Design and Evaluation Issues Sven Fuhrmann, Paula Ahonen-Rainio, Robert M. Edsall, Sara I. Fabrikant, Etien L. Koua, Carolina Tob6n, Colin Ware & Stephanie Wilson ........................................................... 553 29. 3D Geovisualization and the Structure of Visual Space Colin Ware & Matthew Plumlee ........................................................... 567 30. Applications of a Cognitively Informed Framework for the Design of Interactive Spatio-temporal Representations Robert M. Edsall & Laura R. Sidney .................................................... 577 31. User-centered Design of Collaborative Geovisualization Tools Sven Fuhrmann & William Pike ........................................................... 591 32. Towards Multi-variate Visualization of Metadata Describing Geographic Information Paula Ahonen-Rainio & Menno-Jan Kraak .......................................... 611 33. Evaluating Self-organizing Maps for Geovisualization Etien L. Koua & Menno-Jan Kraak ...................................................... 627 34. Evaluating Geographic Visualization Tools and Methods: An Approach and Experiment Based upon User Tasks Carolina Tob6n ...................................................................................... 645 35. Cognitively Plausible Information Visualization Sara Irina Fabrikant & Andr6 Skupin ................................................... 667
Conclusion" Advancing Geovisualization 36. Advancing Geovisualization Jason Dykes, Alan M. MacEachren & Menno-Jan Kraak ................... 693 Index ................................................................................................................ 705
Preface you judge a book by its cover? "Exploring Geovisualization" draws upon perspectives from disciplines including information science, computer science and cartography to discuss and advance the emerging field of geovisualization and maps the contributions from these fields on the cover of the book. One of the areas in which expertise from these domains has been usefully combined to develop techniques and augment knowledge is in the generation and mapping of information spaces or spatializations. These are maps that show the relationships between a series of documents in a collection according to the information contained in each. The cover of this book contains two such maps, on each of which the chapters within are displayed as a landmark. These are represented on the maps with a point symbol and a label identifying the first author of the chapter. The landmarks are arranged using a technique that places documents with more similar contents closer together on the page. The maps themselves fill a continuous information space in which a variety of topics are organized according to their semantic relationships. Where chapters are more closely related, landmarks are clustered in the information space and we can consider the document collection (the book in this case) to have a particular focus on the themes that the chapters address. It seems plausible to draw upon the metaphor of the landscape to map the presence or absence of information relating to themes within the information space. This can be achieved by representing the various thematic foci of the book as an undulating semantic surface with continually varying magnitudes. Where a number of chapters are relatively closely related the information landscape metaphorically piles up into mountains of information about a particular theme. The valleys between information peaks occur in areas of the information landscape associated with topics about which the book focuses less explicitly. The topographic shading scheme used in the map on the left draws further upon the metaphor to represent the "thematic density" of the book across our information landscape. Note however that the landscape and the distribution of the documents represent contributions to this book, and the documents themselves are only discrete samples of possible information sources within the information space - there are likely to be alternative information sources beyond the scope of this volume that can fill ix
Exploring Geovisualization
the information valleys. Indeed it could be argued that whilst the chapters that are clustered in our information space represent current research foci (as reported here), those in information valleys and isolated locations may represent topics that require additional research efforts and are the most 'cutting edge'. The map on the right splits the landscape up into discrete units and shades the information space according to the section of the book in which the chapter represented by the closest landmark occurs. This allows us to see how the sections of the book map into our information space and the themes that are represented by areas within it. The map also allows us to consider the ways in which the chapters within the sections relate to each other according to our spatialization. We hope that these graphics and the metaphor are interesting and that they will prompt some thought about both the book and the nature of maps and information spaces. Some of the decisions taken in developing these spatializations are subjective (though each was thoroughly discussed and we have been through a number of redesigns!) and any number of graphical realizations of the contents of the book might be developed. There are clear parallels here with conventional cartography that depicts the world around us as all map-makers draw upon the three major tenets of map design: theme, purpose and audience, to develop their products. The main difference with spatialization is that it is perhaps more difficult to compare maps of information to an objective truth than is the case with traditional cartography. Despite the complex transformations and abstractions that occur and are imbued with the influence of personal and socio-cultural preference and bias, most cartographers would accept the existence of a 'reality' that they are mapping, that shapes their work, and upon which to develop their design and assess error. When generating spatializations we do not have the notion of a physical standard upon which to base and evaluate our maps. In addition to their role in inspiring metaphors and stimulating thought and discussion we also hope that the maps on the cover provide both a pertinent starting point for the book and an overview of some aspects of its contents. Perhaps they offer a relatively novel opportunity to view and assess the scope of a book, or at least the relationships between the chapters within it, from its cover.
Details on the Cover Map The maps that we have used on the cover of the book utilize a topical or thematic density surface. The surface was produced by Sara Fabrikant and developed through discussions with the editors and a number of other colleagues. Jason Dykes and Jo Wood then used the LandSerf software to generate the maps, in discussion with Sara and others, by applying symbolism, shading and some cartographic exaggeration. The process consisted of a number of stages. Initially Latent Semantic Indexing (Deerwester et al., 1990) was used to determine the similarities between all chapters by comparing the chapter titles and keywords submitted by the authors.
Preface
xi
This seemed to produce more meaningful results than a comparison of the full-text of the abstracts. Principal Coordinate Ordination was then used to collapse the document similarity matrix into two-dimensional spatial coordinates. To generate a topical density surface that reflects the discrete nature of the input data (the book chapters in this case) a pycnophylactic surface was interpolated from these point locations (Tobler, 1979). The pycnophylactic reallocation approach is an areal interpolation technique that permits the construction of smooth density surfaces from more abrupt continuous data, such as those recorded in area-based enumeration units. The chapters represent such discrete boundaries within the information landscape of "Exploring Geovisualization". A voronoi tessellation was derived from the point locations to represent the maximal zone of influence for each of the 36 chapters. The voronoi boundaries were then used as break lines in the process of pycnophylactic interpolation to generate an estimation of the information landscape of the book. Full details on using the method to generate cognitively plausible information spaces are provided in the literature (see Fabrikant, 2001) and the development and application of a framework for doing so is presented later in Chapter 35 (Fabrikant and Skupin, this volume). The resultant density surface was further manipulated in LandSerf (Wood, 2004) to add structured noise and to apply shading and some cartographic enhancements. The noise was designed to add visual interest, to draw attention to the uncertainty inherent in the surface and to reinforce the landscape metaphor of information 'hills' and 'valleys'. This was achieved by combining the density surface with a random fractal surface of fractal dimension 2.1. The original surface was smoothed and rescaled so that the total fractal noise was approximately 4% of the 'true' variation. LandSerf was then used to generate vector contour lines at a vertical interval of approximately 10% of the total variation in relief. The colour scheme applied to the surface is based upon the work of the Swiss cartographer Eduard Imhof for the representation of relief (Imhof, 1965). Relief shading was also computed in LandSerf and the combination of the original surface with the noise, contours, topographic colour scheme and hill shading emphasizes the use of the landscape metaphor to represent density of information about the themes in our landscape. The voronoi polygons are shaded using a colour scheme derived from the examples, guidelines, and considerations suggested by Brewer (1994) and implemented in ColorBrewer (Harrower and Brewer, 2003). The colour scheme is also employed to differentiate between sections of the book in the digital appendices which provide a number of spatializations through which "Exploring Geovisualization" may be explored. The labels were added using the comprehensive text elements in SVG. LandSerf will export raster surfaces to PNG, JPEG and other graphics formats and vectors directly to SVG. Jason Dykes Sara Fabrikant Jo Wood
xii
Exploring Geovisualization
References Brewer, C. A., (1994) "Color use guidelines for mapping and visualization", In: MacEachren, A. M., and Taylor, D. R. F., (eds.), Visualization in Modern Cartography, Vol. 2. Oxford: Elsevier Science Ltd., pp. 123-148. Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T. K., and Harschman, R., (1990) "Indexing by latent semantic analysis", Journal of the American Society of Information Science, 41, 391-407. Fabrikant, S. I., (2001) "Visualizing region and scale in semantic spaces", Proceedings, The 20th International Cartographic Conference, ICC 2001, Beiing, China, pp. 2522-2529. Harrower, M., and Brewer, C. A., (2003) "ColorBrewer.org: an online tool for selecting colour schemes for maps", The Cartographic Journal, 40(1), 27-37, online: http://www.colorbrewer.org Imhof, E., (1965) Kartographische Geliindedarstellung. Berlin: De Gruyter. Wood, J. (2004) LandSerf. online: http://www.landserf.org/(10/10/04) Tobler, W. R., (1979) "Smooth pycnophylactic interpolation for geographical regions", Journal of the American Statistical Association, 74(367), 519-530.
Digital Appendices It is quite a challenge to produce a book on geovisualization as colour, animation and dynamism are so important in the field and yet we are severely limited in terms of the extent to which we can draw upon these essential features of digital cartography when publishing on paper. We have therefore produced a series of digital appendices, included on the CD that accompanies this book. These contain the colour imagery submitted by each of the authors and should be used in conjunction with your reading of the book and consideration of the figures (particularly those that rely upon colour). The digital appendices are accessed through an interactive interface that draws upon a number of alternative spatializations of the contents of the book. These include those shown on the cover and discussed in the Preface. We also draw upon a network representation, rather than one that uses a continuous space to represent relationships between the chapters. The networks and their derivation are described in the introduction to the book (Dykes et al., this volume (Chapter 1)).
xiii
This Page Intentionally Left Blank
Acknowledgments Thanks are due to a number of individuals and organisations without whom this book would not have been possible. These include: the International Cartographic Association; the ICA Commission on Visualization and Virtual Environments; City University, London, and in particular The School of Informatics, Walter Sickert Hall and the Open Learning Centre; the participants at the London 'Exploring Geovisualization' workshop for contributing to a stimulating meeting - including Bob Spence, Ebad Banissi, Heiko Bleschschmeid and Steph Wilson; the various contributors to this volume whose efforts and patience are hugely appreciated; the reviewers whose comments have helped shape this book; series editor Bob McMaster; Elsevier Ltd.; Alden PrePress Services; TheresaMarie Rhyne and the ACM SIGGRAPH Carto Project; Werner Kuhn; the European Science Foundation (EURESCO Conferences); Stephanie Marsh; Jo Wood; Emma Dykes; Sara Fabrikant and Andr6 Skupin; MGI students at City University for comments on cover proposals; ITC, International Institute of Geoinformation Science and Earth Observation and the School of Informatics, City University, London for material support. For his role in developing these perspectives on geovisualization, MacEachren is pleased to acknowledge support over the past several years from the U.S. National Science Foundation (9983451, 9978052, 0113030, 0306845), from the Advanced Research and Development Activity (ARDA), and from the U.S. National Cancer Institute (NCI-CA95949).
XV
This Page Intentionally Left Blank
List of Contributors Paula Ahonen-Rainio Department of Surveying, Institute of Cartography and Geoinformatics, Helsinki University of Technology, PO Box 1200, Espoo, FIN-02015 HUT, Finland Gennady Andrienko Fraunhofer AiS.SPADE - Institute for Autonomous Intelligent Systems, Spatial Decision Support Team, Schloss Birlinghoven, Sankt-Augustin, D-53754, Germany Natalia Andrienko Fraunhofer AiS.SPADE - Institute for Autonomous Intelligent Systems, Spatial Decision Support Team, Schloss Birlinghoven, Sankt-Augustin, D-53754, Germany Lars Bodum Centre for 3D Geolnformation, Aalborg University, Niels Jernes Vej 14, DK-9220 Aalborg 0, Denmark Ken Brodlie School of Computing, University of Leeds, Leeds LS2 9JT, UK Volker Coors Stuttgart University of Applied Sciences, Schellingstr. 24, 70174 Stuttgart, Germany
Jtirgen D611ner Hasso Plattner Institute at the University of Potsdam, Helmert-Str. 2-3, 14482 Potsdam, Germany Jason Dykes Department of Information Science, City University, London EC 1V 0HB, UK Robert M. Edsall Department of Geography, Arizona State University, PO Box 870104, Tempe, AZ 85287, USA Christian Elting European Media Lab (EML), Schloss-Wolfsbrunnenweg 33, 69118 Heidelberg, Germany Sara Irina Fabrikant Department of Geography, University of California Santa Barbara, 3611 Ellison Santa Barbara, CA 93106, USA David Fairbairn School of Civil Engineering and GeoSciences, University of Newcastle Upon Tyne, Newcastle Upon Tyne NE1 7RU, UK Sven Fuhrmann GeoVISTA Center, Department of Geography, The Pennsylvania State University, 302 Walker Building, University Park, PA 16802, USA xvii
xviii
Exploring Geovisualization
Mark Gahegan GeoVISTA Center, Department of Geography, The Pennsylvania State University, University Park, PA 16802, USA Peter Gatalsky Fraunhofer AiS.SPADE - Institute for Autonomous Intelligent Systems, Spatial Decision Support Team, Schloss Birlinghoven, Sankt-Augustin, D-53754, Germany Daniel A. Keim Computer Science Institute University of Konstanz Box D78, Universit/itsstral3e 10 D-78457, Konstanz Germany Zarine Kemp Computing Laboratory, University of Kent, Canterbury, Kent CT2 7NF, UK Sabine Kirschenbauer Institute for Cartography, Dresden University of Technology, Dresden, Germany Etien L. Koua Department of Geo-Information Processing, International Institute for Geo-Information Science and Earth Observation (ITC), P.O. Box 6, 7500 AA Enschede, The Netherlands Menno-Jan Kraak Department of Geo-Information Processing, ITC, International Institute of Geoinformation Science and Earth Observation, P.O. Box 6, NL-7500 AA Enschede, The Netherlands Christian Kray German Research Center for AI (DFKI), Stuhlsatzenhausweg 3, 66123 Saarbrticken, Germany
Katri Laakso Nokia Research Center (NRC), It~imerenkatu 11-13, 00180 Helsinki, Finland Arend Ligtenberg Wageningen UR, Centre for Geo-Information, Droevendaalsesteeg 3, PO BOX 47, 6700 AA Wageningen, The Netherlands Adriano Lopes Department of Informatics of the Faculty of Science and Technology/CITI, New University of Lisbon, Lisbon, Portugal Alan M. MacEachren GeoVISTA Center, Department of Geography, Penn State University, 303 Walker, University Park, PA 16802, USA David Mountain Department of Information Science, City University, London EC 1V 0HB, UK Penny Noy School of Informatics, City University, London EC 1V 0HB, UK Christian Panse Computer Science Institute University of Konstanz Box D78, Universit~itsstrage 10 D-78457, Konstanz Germany William Pike GeoVISTA Center, Department of Geography, The Pennsylvania State University, 302 Walker Building, University Park, PA 16802, USA Catherine Plaisant Human-Computer Interaction Laboratory, University of Maryland, HCIL/UMIACS A.V. Williams Building, University of Maryland, College Park MD 20782, USA
List of Contributors Matthew Plumlee Data Visualization Research Lab, Center for Coastal and Ocean Mapping, University of New Hampshire, Durham, New Hampshire, USA Jonathan C. Roberts Computing Laboratory, University of Kent, Canterbury, Kent CT2 7NF, UK Peter Rodgers Computing Laboratory, University of Kent, Canterbury, Kent CT2 7NF, UK Michael Schroeder Department of Computing, City University, London, UK Laura R. Sidney Department of Geography, Arizona State University, Arizona, USA Mike Sips Computer Science Institute University of Konstanz Box D78, Universit~itsstral3e 10 D-78457, Konstanz Germany Andr6 Skupin Department of Geography, University of New Orleans, New Orleans, LA 70148, USA Martin Theus Department of Computer-Oriented Statistics and Data Analysis, University of Augsburg, Universit~itsstr. 14, 86135 Augsburg, Germany Carolina Tob6n Department of Geography and Centre for Advanced Spatial Analysis
xix
(CASA), University College London (UCL), 1-19 Torrington Place, Gower Street, London WC1E 6BT, UK Lloyd A. Treinish Mathematical Sciences, IBM Thomas J. Watson Research Center, 1101 Kitchawan Road, Yorktown Heights, NY 10598, USA Monica Wachowicz Wageningen UR, Centre for Geo-Information, Droevendaalsesteeg 3, PO BOX 47, 6700 AA Wageningen, The Netherlands Colin Ware Data Visualization Research Lab, Center for Coastal and Ocean Mapping (and Computer Science Department), University of New Hampshire, 24 Colovos Road, Durham, NH 03824, USA Stephanie Wilson Centre for HCI Design, City University, Northampton Square, London EC 1V 0HB, UK Jo Wood Department of Information Science, City University, London EC 1V 0HB, UK Xu Ying Wageningen UR, Centre for Geo-Information, Droevendaalsesteeg 3, PO BOX 47, 6700 AA Wageningen, The Netherlands
This Page Intentionally Left Blank
Introduction Exploring Geovisualization
1. Exploring Geovisualization Jason Dykes, Alan M. MacEachren & Menno-Jan Kraak ..............................................................................
3
This Page Intentionally Left Blank
Exploring Geovisualization J. Dykes,A.M. MacEachren, M.-J. Kraak (Editors) 9 2005 Elsevier Ltd. All rights reserved.
Chapter 1
Exploring Geovisualization Jason Dykes, Department of Information Science, City University, London EC 1V 0HB, UK Alan M. MacEachren, GeoVISTA Center, Department of Geography, Penn State University, 303 Walker, University Park, PA 16802, USA Menno-Jan Kraak, Department of GeoInformation Processing, ITC, International Institute of Geoinformation Science and Earth Observation, PO Box 6, NL-7500 AA, Enschede, The Netherlands
Keywords: geovisualization, GIScience, Cartography, EDA, Information Visualization, maps, multi-disciplinary, research agenda, challenges, workshop, collaboration
Abstract This introductory chapter makes the case for exploring geovisualization from multiple, inter-disciplinary perspectives and presents the structure of the book in which this is achieved. It does so by introducing geovisualization and drawing upon the work of the International Cartographic Association Commission on Visualization and Virtual Environments in reporting research foci and challenges in geovisualization and documenting recommendations for action through which these can be addressed. An examination of the nature of geovisualization and its various interfaces with cognate fields of academic study is identified as a key requirement. The objective is to foster communication, encourage collaboration and augment existing knowledge with that from relevant disciplines. The organization and structure of a geovisualization workshop in which these requirements were addressed is outlined. The outcomes of the workshop form the basis of this book. The book, in turn, supports and broadens the process of collaboration through reports on current research efforts and cross-disciplinary sharing of knowledge about our related fields of expertise. It contains a series of introductory contributions followed by sections entitled "creating instruments for ideation", "using 3D in visualization", "connecting people data and resources" and "making useful and usable geovisualization". Each of these sections is preceded by a collaboratively produced co-authored introduction to a particular focus for geovisualization. Crossreferences between these chapters and sections are common and many are explicitly identified in the text and supported by the digital appendices. Readers are encouraged to further relate concepts, issues and themes that are apparent between chapters in the book as they explore geovisualization and we collectively advance this evolving field. 3
J. Dykes, A.M. MacEachren & M.-J. Kraak
1.1
Geovisualization in Context
Geovisualization is an emerging field. It draws upon approaches from many disciplines, including Cartography, Scientific Visualization, Image Analysis, Information Visualization, Exploratory Data Analysis (EDA) and GIScience to provide theory, methods and tools for the visual exploration, analysis, synthesis and presentation of data that contains geographic information (MacEachren and Kraak, 2001a). The interactions across these disciplines are fluid, as are the boundaries delimiting the disciplines themselves. The art and science of Cartography has developed to embrace and support visualization. This has occurred informally through the efforts of cartographers to support map use and map users by employing the tools afforded by technical advances effectively and more formally through the Commissions of the International Cartographic Association (ICA) on map use, visualization and most recently visualization and virtual environments. Over the past decade, the ICA Commissions have focused on the use of highly interactive maps by individual experts to support thought processes that are motivated towards the discovery of unknowns in complex spatial data sets. Over time, the technologies and techniques that have supported these processes have become more readily available, information has become more accessible and a broadening range of types of high-quality spatial data have been recorded. The result is that greater numbers of geographic information users are now employing highly interactive techniques to achieve insight from a variety of spatial data sets. These users are not the traditional consumers of conventional Cartography and the uses to which they put their maps are evolving. Yet, whomever it involves and however it is used, geovisualization is about people, maps, process, and the acquisition of information and knowledge. It can lead to enlightenment, thought, decision making and information satisfaction, but can also result in frustration! When employed effectively, geovisualization offers the possibility for engaging, personal and specific interfaces to geographic information through which a range of users may be able to participate in a variety of activities that require and rely upon the geographic component of the information in hand. The increasing importance and use of spatial information and the map metaphor establishes geovisualization an essential element of 21st century information use, a genuine opportunity for 21st century Cartography and a requirement for modern map users.
1.2
Geovisualization Research
Considerable research activity in geovisualization is drawing upon the expertise available in a number of cognate disciplines to support the efforts of this variety of users of geographic information. This is the case whether the process of discovery is private or collective and whether it is related to the acquisition of established knowns or the search for insight to identify, explain and understand particular unknowns. The nature of geovisualization research is thus multi-faceted and associated research efforts are wide ranging. However, a number of broad themes can be identified
Exploring Geovisualization
5
that pervade recent activities and define an agenda for this evolving field. "Research Challenges in Geovisualization" (MacEachren and Kraak, 2001b) is a multi-authored effort coordinated by the ICA Commission on Visualization and Virtual Environments that delineates an international research agenda by identifying particular areas in which specific activity is required and has the potential for impacts well beyond Cartography. These focus areas are closely inter-related and should certainly not be regarded as discrete. They include research with an emphasis on representation, visualization-computation integration, interfaces and cognitive/usability issues and are summarized below to describe the nature and scope of current geovisualization research priorities.
1.2.1
Focus on representation
Fundamental questions about the representation of geographic phenomena arise as technological possibilities develop and the data available for depiction through advanced and interactive graphical realizations changes. Challenges include determining the limits and advantageous uses of both traditional and novel representation methods, creating meaningful graphics to represent very large, multi-variate spatio-temporal data sets (that may include both three spatial dimensions and time) and the development, use and continual evaluation of innovative tools that take advantage of interactivity, animation, hyper-linking, immersive environments, agents, multi-modal interfaces and dynamic object behaviors. Augmented and mixed reality applications and multi-modal representations of data are examples of technologically driven possibilities for which traditional approaches to geographic representation are unlikely to be adequate.
1.2.2
Focus on visualization-computation integration
The way that we construct knowledge from geospatial data can draw upon interactive visual representations that use some of these novel techniques. However, we are likely to be most successful in analyzing large complex spatial data sets if geovisualization is able to draw heavily and directly upon advances in Computer Science and computer graphics. The design, development and testing of software and hardware solutions that support the kinds of graphical interactivity that are specifically required by geovisualization is a key requirement. One aspect of this challenge involves integrating and adapting advances in computer graphics and Information Visualization associated with visual datamining for application to geographic data analysis. Such integration of tools and techniques would make it practical for us to participate in visually enabled knowledge construction across the process of GIScience. This process can benefit from closely linked software tools focused on uncovering patterns in complex structured geospatial data, the explanation of these structures and relationships through the development and testing of theory and the ultimate communication of this knowledge.
1.2.3
Focus on interfaces
Advances in geovisualization interface design are essential for visually enabled knowledge construction to have the greatest impact. Additionally, techniques need to be
6
J. Dykes, A.M. MacEachren & M.-J. Kraak
improved and developed to make geovisualization available to a wide range of users with a variety of requirements. Facilitating progress in the real world use of geospatial information and technology may require the adaptation of existing interface design (for example, see w1.2.4) and the development of new paradigms to provide high levels of interaction with advanced forms of (possibly novel) representation (for example, those relying upon augmented and mixed reality). Further knowledge is required concerning the possibilities afforded by multi-modal methods of accessing and interacting with information, and in using these and other means to create forms of interaction that are appropriate to particular combinations of user, task and circumstance. The various requirements presented by mobile devices, the desire to support group work, and the need to accommodate and support different groups and individuals make this a particularly challenging area of research.
1.2.4
Focus on cognitive/usability issues
Whatever the application, it is essential that we develop knowledge of whether the geovisualization techniques, tools and solutions that are produced actually work and under what circumstances this is the case. We must also be able to explain and even predict such outcomes. We can begin to achieve these objectives by studying the ways in which different users react to a range of new and established geovisualization methods. By drawing upon knowledge of the perceptual and cognitive processes involved, we may be able to generate a body of knowledge and associated theory relating task, technique and user type that establishes best practice. A whole range of users with different ages, cultures, sexes, levels of experience and sensory abilities may participate in visualization as individuals or in collaboration with others. Methods drawn from human computer interaction (HCI), such as the concept of "usability" may enable us, with associated knowledge, to both develop solutions for particular types of user and task and to approach the objective of "universal usability" in geovisualization. Each of these four areas of research focus has clear parallels with more traditional cartographic research, and can draw upon the knowledge derived from that work. Each can also benefit from knowledge obtained in domains beyond Cartography and GIScience. The need to undertake effective research in these areas is becoming increasingly urgent as maps are used more frequently, for more tasks, by more users, to provide access to and insight from more data.
1.3
Geovisualization Challenges
Our progress in each of these areas of geovisualization is dependent upon various fundamental issues that cut across the themes. They are established as a series of "geovisualization research challenges" in the ICA research agenda (MacEachren and Kraak, 2001). Each challenge relates to a current concern towards which the research efforts of the geovisualization community should be usefully applied.
Exploring Geovisualization
1.3.1
7
Research challenge 1 - experimential and multi-modal "maps"
Many of the questions being asked by geovisualizers relate to the increasingly experiential and multi-sensory representation technologies that are available. There is a need to develop the technologies and understanding that will enable geovisualization to use such modes of information access and manipulation effectively. Generating maps that do so will involve improving our models of the world so that they occupy volume and are dynamic - a considerable challenge when much geospatial information draws upon the traditional map metaphor in which space is regarded as flat and static. Much geographic information science and technology also starts with this assumption. Whilst such technical challenges are addressed, conceptual tensions associated with the way that realism and abstraction are utilized must be resolved. In some circumstances and applications visual and virtual realism are regarded as an ideal (and the challenge of rendering virtual spaces in real time is an active research problem, particularly in computer graphics). Yet the existing geovisualization paradigm is grounded in an assumption that abstraction is essential for achieving insight. It is vital that we explore and resolve the tensions between these perspectives if we are to make scientific progress and take advantage of developing technologies that offer exciting possibilities for virtual realism, multi-sensory representation and sophisticated modes of interaction, rather than be taken advantage of by them.
1.3.2
Research challenge 2 - large data sets
Geospatial data sets of progressively larger size and increasingly complex structure offer a continuing challenge for geovisualization as we aim to develop appropriate techniques, tools and approaches. Whilst the initial promise of visualization was based upon leveraging the power of human vision to extract meaning from complex data sets, many existing techniques do not scale well to the massive datasets that are increasingly common. Meeting this challenge will require advances in the methods used and their integration with geocomputational techniques that must also be enhanced and developed. Ultimately human understanding can then be used to steer an investigative process that draws upon visual processing, domain knowledge and advanced computational techniques to uncover patterns and relationships and determine their meaning. A key issue here is that many existing methods and tools do not encode geographic knowledge and meaning in effective ways. Knowledge construction using such tools can neither build easily from existing knowledge as a result, nor can they capture knowledge as it is generated. This is a challenge that demands not just new methods and tools, but requires a fundamental effort in theory building directed to the representation and management of geographic knowledge.
1.3.3
Research challenge 3 - group work
Advances in telecommunications and display technologies are making multi-user systems (through which group work can be supported) more effective, sophisticated, accessible and common. Most work with geographic information requires coordinated effort by groups, and yet the tradition in geovisualization research (and GIScience research more
8
J. Dykes, A.M. MacEachren & M.-J. Kraak
broadly) focuses on the individual expert, operating in isolation in the private domain. As a result, methods and tools have tended to be designed for individual use. Research effort is required to develop a new generation of techniques and competence to support same and different-place collaborative geovisualization. Attention must also be focused on the cognitive, social, and usability issues of visual display mediated dialogue, both amongst human collaborators and between human and computer. 1.3.4
Research challenge 4 - human-centered approach
Technology is a key driver of geovisualization, yet we can learn a great deal from disciplines that have developed and continue to employ a human-centered approach to their science. An important goal involves the development of an approach to geovisualization research that integrates work on technological advances leading toward more powerful and usable tools with work on human spatial cognition and the potential of visual (and other concrete) representations to enable thinking, learning, problem solving, and decision making. Approaches that can be characterized as "build and they will come" and "one tool fits all" dominate contemporary geoinformation technology. Yet a compelling need exists to develop both the theory and practice to support universal access and usability for geospatial data. This will require new approaches and methods that support the personalization of geovisualization tools to assist particular users and user groups with particular geovisualization tasks.
1.4
Exploring Geovisualization - Rationale
The geovisualization challenges outlined here indicate that the boundaries of Cartography are becoming less clear-cut, the nature of map use and users is broadening and the range of influence and sources of stimuli shaping Cartography is widening. The set of geovisualization challenges identified is a demanding one, yet the importance of addressing them is evident. The need for a multi-disciplinary approach to address such multi-faceted issues successfully is equally apparent. A concerted effort by a broad and deep community of scientists offering multiple linked perspectives is required: "cartographers cannot address these challenges alone" (MacEachren and Kraak, 2001 a). However, MacEachren and Kraak (2001a) also note that whilst "most of the challenges [facing geovisualization] are multi-faceted ones, requiring multi-disciplinary perspectives ... Little exchange of ideas occurs across disciplines working on related problems, with multiple sets of largely separate literature having few or no cross citations". A number of recommendations for action are made in "Research Challenges in Geovisualization" (MacEachren and Kraak, 2001 a) with the aim of coordinating efforts more effectively. A key proposal is the promotion of interdisciplinary communication and cross-disciplinary work to encourage more scientists to commit to multi-disciplinary research through which the challenges can be met. The investigation of geovisualization practice and issues from a number of disciplinary perspectives and communication between experts and practitioners
Exploring Geovisualization
9
in cognate disciplines are thus key objectives for advancing geovisualization. The need for such activity to be both supported by researchers and research infrastructures and valued by systems of recognition is also noted. Events at which geovisualization can be discussed and explored from a variety of perspectives, augmented with knowledge from relevant disciplines, and reported to the community are an essential means of addressing the geovisualization challenges. Doing so enables us to investigate the nature of geovisualization and its various interfaces with cognate fields, advance our knowledge and further define our discipline and practice. These activities will assist us in establishing inter-disciplinary awareness and encourage the required collective approach in the short term. Efforts to establish shared knowledge and identify commonalities and differences in understanding, techniques and approach can be supported in this way. In the longer term, the promotion and maintenance of such collaboration will enable us to advance the various research agenda. Exploring Geovisualization and the meeting and communication that formed the basis for this book are intended as key steps in this process as researchers with a variety of interests and a range of backgrounds aim to establish and document current research efforts and share knowledge about our practice, requirements and related fields of expertise.
1.5
Exploring Geovisualization - Approach
The concept of "radical collocation" is presented by Brodlie, this volume (Chapter 23). The term is used to describe a situation where the likely gains in productivity resulting from the ease of communication, coordination and organisation associated with actually being located in the same place results in teams of subject experts being "brought together into war rooms for an intensive piece of work". This is precisely what was suggested by the ICA Commission on Visualization and Virtual Environments to advance the research agenda: "workshops should be supported to bring individuals with varied disciplinary perspectives together to discuss research questions and approaches to addressing them in detail." (MacEachren and Kraak, 2001a) To achieve this aim, a cross-disciplinary workshop was organized in September 2002 at City University, London. The School of Informatics at City offers expertise in a number of related fields of study including GIScience, information science, Computer Science and HCI design. An open invitation was made to researchers in geovisualization and cognate disciplines to participate in the presentation and discussion of existing work in their fields, current trends, likely future developments and possibilities for the sharing of knowledge, techniques, practice and approach. The planned outcomes of the meeting included position papers representing the contributions of individuals and groups, discussion between researchers with common foci from different disciplines and this edited volume containing considered individual contributions and co-authored multi-disciplinary
10
J. Dykes, A.M. MacEachren & M.-J. Kraak
statements through which geovisualization and associated research efforts could be explored and presented to a wide audience. The contributors to the workshop fall into one of two categories: members of the ICA Commission on Visualization and Virtual Environments, a group with primary concerns relating to geographic information and Cartography, and "external experts" from cognate disciplines (primarily Computer and Information science). The former were asked to document their research to a wider community by identifying generic research objectives, a summary of the knowledge gained and some additional research questions that require cross-disciplinary expertise. Specific examples of research were requested of the ICA contributors with which to illustrate key geovisualization issues and identify current knowledge and practice. Contributions included various accounts of specific geovisualization methods (and their application), system descriptions, tests of geovisualization implementations and documented opportunities for research and collaboration. The external experts were asked to produce overviews of current themes in their particular field of expertise, to identify general areas where collaboration with the geovisualization community may be beneficial and to describe ways in which their discipline might gain from and/or contribute to advances in geovisualization, particularly regarding the specific geovisualization research challenges. To define the scope of the workshop and enable the organizers to identify topics upon which discussion could focus, participants were asked to specify their primary and secondary areas of expertise from a list of alternatives including Information Visualization, cognitive sciences, Computer Science, virtual environments, information science, HCI, education/pedagogy and data exploration/datamining. Drafts of individual contributions were also circulated prior to the workshop so that the organizers and participants were introduced to the work of all other contributors in advance of the meeting. The workshop itself took place between Wednesday 1 l th and Saturday 14th September 2002. Participants were arranged into groups by the organizers in advance of the meeting according to the self-selected areas of expertise, the nature of the papers submitted and through a process of discussion with those involved. The key objectives of the groups were to provide a mixture of backgrounds and areas of expertise but a common focus through which cross-disciplinary perspectives on particular pertinent topics could be addressed. At the workshop, the groups and their foci were discussed and consensus reached on four broad topics around which to structure the discussion through which geovisualization should be explored: 9 9 9 9
creating instruments for ideation; using 3D in visualization; connecting people data and resources; making useful and usable geovisualization.
These topics are intentionally overlapping due to the complexity of the issues being addressed and the objectives of the current exercise. Indeed many participants have expertise in more than one area. There is a loose correspondence between the focus topics and the cross-cutting themes identified in the research agenda report (MacEachren and
Exploring Geovisualization
11
Kraak, 2001; see w However, the goal was not to address these cross-cutting challenges in a comprehensive way - an objective that will require more than a short workshop. Instead, the groups and topics around which they were organized reflect the particular expertise of workshop participants as well as progress in some areas over the time since the 2001 report. During the workshop, plenary sessions at which each contributor made a brief presentation to the full body of participants allowed cross-fertilization of ideas. Parallel discussion sessions directed to the four identified topics supported focused, crossdisciplinary debate. The synergy that occurred as a consequence of this activity has resulted in these topics being used to structure this volume of contributions derived from the meeting (with one section for each topic). A primary charge to each of the groups was the development of a cross-disciplinary perspective that could be presented to the wider community as a context-providing introduction to the topic under discussion. Thus, each section in "Exploring Geovisualization" begins with a coauthored introductory chapter. Much of the workshop time was spent in discussion groups, developing the structure for these overview chapters, sketching out their contents and debating the issues that arose. These joint contributions are designed to enable us to record and comment upon aspects of our work that we can share and to identify ways in which we can work together for mutual benefit. They are designed to meet the key requirement of interdisciplinary collaboration by providing a shared perspective on the research topic, demonstrating some of the similarities and differences between the various disciplines represented and identifying potential for further collaboration. The draft chapters developed from the position papers and the group discussions were finalised shortly after the meeting following dialogue and feedback in a multi-disciplinary context in London. Group chapters were then further revised by a lead author through an iterative process of re-drafting. Both the group chapters and all individual chapters submitted for consideration in the volume underwent a two-tiered process of review. The editors provided detailed feedback to authors on initial drafts for chapters. Then, revised papers were subsequently reviewed formally by another of the editors and one anonymous external reviewer. Reviewers were informed of the objectives of Exploring Geovisualization and the fact that chapters were designed to be read by a relatively broad audience including graduate students and researchers in disciplines ranging from Cartography and other areas of GIScience, through Information Visualization and EDA in statistics, to Scientific Visualization and Computer Graphics. Contributors of accepted papers were asked to address the issues raised in the review process and document their responses. The result is the structured collection of 34 individual and joint contributions that enable us to explore the nature, scope and future of geovisualization from a number of perspectives.
1.6
Exploring Geovisualization - Structure
This book itself consists of an introductory section, followed by the sections relating to each of the four discussion topics and a conclusion. The links between geovisualization
12
J. Dykes, A.M. MacEachren & M.-J. Kraak
and Information Visualization dominate, which is unsurprising as the majority of contributors regarded "Information Visualization" as being a primary or secondary area of expertise. Three additional authors (not in attendance at the workshop) were invited to produce chapters for consideration in this book that discuss geovisualization at a general level from key perspectives, specifically those of GIScience, Information Visualization (InfoVis), and human computer interaction design (HCID). These scenesetting perspectives provide an introductory section, contextualizing the following sections that represent each of the workshop discussion topics.
1.6.1
Section A~Geovisualization in context
The chapters in Section A from the Computer Science Institute at the University of Konstanz document the current scope of Information Visualization, report upon techniques deemed relevant to geovisualization and identify areas of mutual opportunity. "Usability" emerges as a theme in a number of contributions in various sections and so Catherine Plaisant of the Human-Computer Interaction Laboratory at the University of Maryland builds upon this introduction to Information Visualization by identifying themes and challenges in usability. With this important contextual material on the nature of Information Visualization in place, the final chapter of our introductory section is a contribution by Mark Gahegan that grounds visualization in applications of GIScience. Gahegan relates opportunities for taking advantage of visualization methods and tools to the various forms of reasoning used throughout the geoscientific process.
1.6.2
Section B ~ C r e a t i n g instruments for ideation
Section B is the book's longest and focuses on software approaches to geovisualization and the development of instruments that support the EDA process specifically and ideation more generally. A number of the research challenges are relevant to this section in which experienced software authors and developers provide perspectives. In the coauthored introductory chapter, Gennady Andrienko and colleagues document a diverse range of software approaches to geovisualization and provide a structured explanation for the developments that are currently taking place. These include advances in technology, data availability, changing tasks, a variety of users, the use of expertise from associated disciplines and opportunities for interoperability. This co-authored perspective is followed by a chapter from Martin Theus, author of the Mondrian software, who identifies a number of links between statistical data exploration and geovisualization. Peter Rodgers then describes the potential and current use of graph drawing techniques from Information Visualization within geovisualization. Next, Jonathan Roberts reviews tools, methodologies and models for supporting multiple-linked views and suggests ways in which linked views may be coordinated and utilized in geovisualization instruments for exploratory work. This is followed by a contribution from David Mountain, who introduces approaches and software tools for exploring spatio-temporal behaviour with the objective of summarizing and explaining
Exploring Geovisualization
13
an individual's use of space. The knowledge gained can be a useful contributor to the provision of location dependent digital information. Natalia Andrienko and colleagues then draw upon task and data typologies when describing the way in which the characteristics of data and the nature of the task in hand drive their visualization tool design. This focus on tasks is complemented by attention to the user in a chapter by Monica Wachowicz and colleagues, who introduce the Land Use Change Explorer, a tool that exemplifies an approach to the process of geographic knowledge discovery by drawing upon autonomous agents to support decision-making in planning. In a chapter directed towards method rather than implemented tools, Penny Noy presents "signature exploration" - a means of aiding user comprehension when faced with complex and abstract graphics representing large structured data sets in the kinds of tools described in this section. Finally, Jason Dykes describes some of the approaches employed and software developed to support geovisualization and identifies a number of methods of achieving high levels of interaction with data to permit geovisualization through a variety of interfaces that minimize "visualization effort".
1.6.3
Section C---Using 3D in visualization
Our second topic relates to the use of"3D" in geovisualization and a range of experts offer perspectives on matters varying from theoretical issues to the development of rendering algorithms in section C. The research relates most strongly to geovisualization challenge 1 (see w1.3.1), but large data sets, collaborative work and usability issues are also addressed. By way of introduction, Jo Wood and colleagues describe the visualization pipeline and apply three-dimensionality to each of its five stages in exploring the various links between geovisualization, technology and cartographic theory. Three-dimensionality is considered in the stages of data management, data assembly, visual mapping, rendering and display. The artifacts produced and used at each stage are associated with various meanings of the term "3D" including the raw data, the assembled data, visual representations of the data, the image and the schemata used in interpretation. Jo Wood, then provides the initial individual chapter for the section in which he considers the influences of three components of scale on measurements made from surfaces. Rendering techniques are employed to represent these in a real-time dynamic 3D environment for geovisualization. Jiirgen DOllner then assesses the impact of realtime 3D computer graphics on geovisualization. Key techniques are identified that allow us to design and implement new geovisualization strategies, systems, and environments with improved visual expressiveness and interactivity. Next, Adriano Lopes and Ken Brodlie describe the evolution of contouring and isosurfacing techniques to account for the interactive requirements of geovisualization. Sabine Kirschenbauer follows this with discussion of an empirical study into the use of the Dresden 3D LC Display (D4D) - a flat autostereoscopic display for the visual presentation of geographic data in "true 3D". The results suggest that the visual capabilities of the user, their level of experience and the task in hand affect the success of such techniques. Lars Bodum then explores the scope of "virtual environments" by providing a typology that focuses on representational aspects involved in their
14
J. Dykes, A.M. MacEachren & M.-J. Kraak
construction. The level of abstraction and the temporal characteristic of the model are of particular concern here as the philosophical and technical issues associated with the design and use of virtual environments are explored. Finally, Lloyd Treinish offers a chapter solicited subsequent to the workshop to introduce and demonstrate the Webbased 3D geovisualization of complex spatio-temporal data in an operational environment. Techniques for the automated dissemination of animations of 3D weather models to a wide range of users are discussed and a number of approaches, products and implementations are presented.
1.6.4
Section D~Connecting people, data and resources
The third topic explored in this book is "distributed geovisualization", defined as geovisualization involving distributed data, resources, and people. By way of introduction to section D, Ken Brodlie and colleagues develop an example scenario to demonstrate the importance of connecting a range of people, data and resources to coordinate approaches and expertise in a geovisualization context. The scenario allows the group to demonstrate how a distributed approach to geovisualization can bring considerable benefits to science and society where there is a need to draw upon the combined force of data, resources and people from across the globe. Challenge 3 is addressed most directly (see w but each of the geovisualization challenges is considered under this topic. Alan MacEachren calls for multi-disciplinary collaboration when introducing a framework for geovisualization involving groupwork that draws upon research activity in the GeoVISTA Center at Penn State University. The framework discriminates between the use of visual representations in supporting groupwork as the object of collaboration, in providing support for dialogue and in supporting coordinated activity. In the next chapter, Ken Brodlie develops three system architecture models for Internet-based, realtime collaborative visualization. A number of tools for supporting real-time distributed work and experience of collaborative visualization are introduced with the inference that particular combinations of the approaches may be most appropriate. In the subsequent chapter, Michael Schroeder introduces enabling technologies for intelligent information integration. The relationships between geovisualization and developments in these areas, such as Grid computing, the Semantic Web and opportunities for visual datamining are discussed. In a complementary paper, Zarine Kemp focuses on the semantic requirements that enable distributed, disparate data resources to be shared by presenting a rationale for semantics to be integrated into interfaces for geovisualization. A prototype fisheries management system is introduced by way of demonstration. Taking a cartographic perspective on design of visualization to support everyday activity, David Fairbairn explores the relationships between geovisualization and distributed public transport information systems and relates general issues in geovisualization to this particular field with examples. Finally, in another chapter focused on distributed geovisualization relating to travel, Volker Coors and colleagues report the results of a pilot study designed to evaluate methods of assisting mobile users with route instructions that include text, sketches, spoken instructions and the use of 3D models. A series of technical issues are
Exploring Geovisualization
15
addressed and guidelines developed based upon the empirical results to determine the most suitable form of representation to use in a particular situation.
1.6.5
Section E~Making useful and useable geovisualization
The final discussion topic centers on issues of geovisualization design and evaluation, focusing most strongly on challenges associated with the development of theory and practice to support universal access and usability. In their introduction to section E, Sven Fuhrmann and colleagues with backgrounds in Computer Science, Information Visualization, GIScience, Geography and Cartography emphasize that geovisualization design is not just about technical issues. They explore various means of making geovisualization tools and techniques useful and usable from a user' s perspective and aim to bridge the gap between developers and users by introducing methods and discussing research questions in user-centered geovisualization tool design. In the first contribution, Colin Ware and Matthew Plumlee characterize the structure of visual space in three ways. They demonstrate how a consideration of the perceptual structure of space, the costs associated with gaining extra information by navigation and the cognitive mechanism used to visually interrogate geo-spatial representations can enable us to identify forms of navigation interface that will be most suitable for particular tasks. Then, Robert Edsall and Laura Sidney describe approaches for representing interactions with time in tools for geovisualization. Cognitive science and usability engineering are employed to inform the development of a framework that helps cartographers design appropriate geovisualization interfaces and environments to support insight. Next, Sven Fuhrmann and William Pike aim to engage users in geovisualization tool design and evaluation when considering the user-centered design process for collaborative tools that support interaction. A case study demonstrates how three approaches to supporting user-centered design between distributed users and tool developers have been employed to enhance remote collaboration in the environmental sciences. In the subsequent chapter, Paula Ahonen-Rainio and Menno-Jan Kraak make use of multi-variate visualization techniques in proposing an environment for the exploration of geographic metadata that is designed to support users in determining how well available datasets meet their needs. In a chapter focusing on integration of visualization with other analytical methods, Etien Koua and Menno-Jan Kraak present a prototype exploratory geovisualization environment that combines visual and computational analysis. The tool draws upon Information Visualization techniques and is based upon a usability framework developed to analyze the ways in which various abstract representations are used and understood in relation to more traditional maps. Carolina Tob6n then provides a complementary outline of the contributions that experimental design and HCI may make in producing geovisualization tools that are usable, useful and fit for purpose and develops an approach to tool design that is based upon user tasks. An experiment is presented that shows how multiple techniques can be combined to evaluate the effectiveness of a system and to address the complex issue of task definition in geovisualization. The results suggest that the approach can refine existing task characterizations to reflect the cognitive visual operations supported by geovisualization
16
J. Dykes, A.M. MacEachren & M.-J. Kraak
environments. Finally, Sara Fabrikant and Andrd Skupin consider information spaces based upon spatial metaphors and use geographic information theory and principles of ontological modeling to develop a framework for the construction of cognitively plausible semantic information spaces. Examples of the application of the framework to the design of cognitively adequate information spaces are provided with the aim of supporting and augmenting the internal visualization capabilities of those who use them. 1.7
Exploring Geovisualization--Visualization
The structure presented here and described in w1.6 is somewhat linear, due to the nature of the printed medium that we are using and the organisation of the discussion groups. Yet the inter-related nature of the topics under discussion here means that some chapters could logically be grouped in more than one section. Similarly, many workshop participants were keen to comment upon the activities of groups other than their own and plenty of cross-fertilization between groups occurred at the London meeting. Citations are used throughout the book to relationships between the contributions in their own use of the book. We also provide a number of "maps" of the contents of the book to draw attention to relationships between the chapters and to guide the reader through the interrelated concepts. These are spatializations of the semantic relationships between the various chapters. The cover of the book shows a topical density surface using principal coordinate ordination (see Preface). Semantic links between chapters in the book are shown in Figure 1.1. PathFinder Network Scaling (PFNet) solutions (Schvaneveldt, 1990) are used here to spatialize such semantic relationships between documents as detailed by Skupin and Fabrikant (2003) and discussed further by Fabrikant and Skupin, this volume (chapter 35). In this case, estimates of the similarities between the contents of each of the chapters in Exploring Geovisualization are used to establish the most notable links. These similarity estimates are derived by considering the textual content of the chapter titles and keywords using Latent semantic Indexing (LSI) (Deerwester et al., 1990). 1 The PFNet algorithm then generates a topological network that preserves these semantic similarity relationships identified by LSI. The semantic network can be subsequently transformed and reproduced graphically using appropriate layout techniques (see Rodgers, this volume (Chapter 7)) as shown in Figure 1.1. Two parameters are used to generate a PFNet: the q-parameter, which constrains the maximal path length (number of links between points) adhering to the triangle inequality criterion (and is thus an integer between 2 and n - 1); the r-parameter, a value between 2 and infinity, which defines the metric used for computing the distance paths and is inversely proportional to the number of links in the network generated. Within certain constraints, q and r can be experimented with to 1 A series of network were generated using the full abstracts, but the relationships depicted were judged to be less meaningful than those presented here. Possible explanatory factors that may have resulted in relationships that did not relate whollyto the chapterthemesinclude the length of abstract, the style of the abstract and the first language of the author. On reflection the use of a closed list in generating chapter keywords may well have improved the PFNets.
I
r Figure 1.l. Exploring Geovisualization-PFNet solutions showing the relationships between chapters in this book according to titles and keywords. (a) PFNet (infinity,35)-in essence a minimum spanning tree showing only the most salient connections. (b) PFNet (infinity,2)-a highly linked network showing some of the more subtle relationships between chapters. The digital appendices include a number of PFNet solutions that readers can use to navigate between related chapters.
18
J. Dykes, A.M. MacEachren & M.-J. Kraak
produce suitable networks and any solution that uses a particular combination of q and r is referred to as PFN (r,q). The minimum-spanning tree, an undirected graph of minimal length that spans all the nodes of the network, is generated when q = n - 1. This is shown in Figure 1.1a, where 35 links are depicted connecting all 36 nodes. An alternative network with more linkages is shown in Figure 1.lb. Weaker links are included in the PFNet solution in this case. Fabrikant (2001) describes better connected documents within spatializations such as those shown in Figure 1.1 as "semantic anchor points for information exploration". We hope that the authors and readers of Exploring Geovisualization will find these static graphics useful in mapping out some of the semantic relationships between the chapters and the work that they represent. The digital supplement to the book contains a number of PFNet solutions. These maps take advantage of the digital medium to provide interactive interfaces to the digital appendices that will help readers relate chapters and navigate through the information presented in an exploratory manner.
1.8
Exploring Geovisualization - Conclusion
The result of the exercise reported here is a broad and considered volume of work with opinions and influences from a range of disciplines. We do not argue that this body of material is a comprehensive statement on the status of geovisualization and related fields. But what we have cooperatively developed is a wide-ranging collection of contributions that are clearly informed by existing descriptions of research requirements (MacEachren and Kraak, 2001). These contributions have been produced by a group of authors from diverse disciplines with a variety of perspectives and have evolved following discussion amongst colleagues from a number of fields. As a result, this volume provides a platform for exploring the nature of geovisualization, its interdependencies with other academic fields of study and viceversa. This is important as we advance the evolving field of geovisualization in terms of our collective knowledge, the techniques that we use, the tasks we address and the ways in which we address them. It is also important that knowledge is shared and collaborative work is planned, completed and reported as relationships between practitioners in increasingly related disciplines develop, enabling us to make progress with the various research challenges. Our collective perspectives have expanded considerably through this examination of geovisualization and in a concluding chapter we reflect on the contributions presented and on ways that we might continue advancing geovisualization. We hope and anticipate that the reader will have an equally enlightening experience as they use the chapters that follow to explore geovisualization.
Acknowledgements The contributions made by Andr6 Skupin and in particular Sara Fabrikant in developing, generating and advising upon the pathfinder network scaling solutions are greatly appreciated and acknowledged with thanks.
Exploring Geovisualization
19
References Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T. K., and Harschman, R., (1990) "Indexing by latent semantic analysis", Journal of the American Society of Information Science, 41, 391-407. Fabrikant, S. I. (2001) Visualizing region and scale in semantic spaces. Proceedings of the 20th International Cartographic Conference, ICC 2001, Beijing, China, pp. 2522-2529. MacEachren, A. M., and Kraak, M. J., (200 l a) "Research challenges in geovisualization, Cartography and Geographic Information Science", Special Issue on Geovisualization, 28(1), 3-12. MacEachren, A. M. and Kraak, M. -J. (eds.) (2001b) "Research challenges in geovisualization, Cartography and Geographic Information Science", Special Issue on Geovisualization, 28(1), American Congress on Mapping and Surveying, 80 pp. Schvaneveldt, R. W., (ed.), (1990) Pathfinder Associative Networks: Studies in Knowledge Organization. Norwood, NJ: Ablex. Skupin, A., and Fabrikant, S. I., (2003) "Spatialization methods: a cartographic research agenda for non-geographic information visualization", Cartography and Geographic Information Science, 30(2), 95-119.
This Page Intentionally Left Blank
Section A Geovisualization in Context Perspectives from Related Disciplines
2. Information Visualization: Scope, Techniques and Opportunities for Geovisualization Daniel A. Keim, Christian Panse & Mike Sips ............................................................................................. 23 3. Information Visualization and the Challenge of Universal Usability Catherine Plaisant ........................................................................................................................................... 53 4. Beyond Tools: Visual Support for the Entire Process of GIScience Mark Gahegan ................................................................................................................................................ 83
This Page Intentionally Left Blank
Exploring Geovisualization J. Dykes, A.M. MacEachren, M.-J. Kraak (Editors) 9 2005 Elsevier Ltd. All rights reserved.
Chapter 2
Information Visualization: Scope, Techniques and Opportunities for Geovisualization Daniel A. Keim, Christian Panse, Mike Sips, Computer Science Institute, University of Konstanz, Konstanz, Germany
Keywords: Information Visualization, visual datamining, visual data exploration, geovisualization
Abstract Never before in history has data been generated at such high volumes as it is today. Exploring and analyzing the vast volumes of data has become increasingly difficult. Information visualization and visual datamining can help to deal with the flood of information. The advantage of visual data exploration is that the user is directly involved in the datamining process. There are a large number of Information Visualization techniques that have been developed over the last two decades to support the exploration of large data sets. In this chapter, we provide an overview of Information Visualization and visual datamining techniques, and illustrate them using a few examples. We demonstrate that the application of Information Visualization methods provides new ways of analyzing geospatial data.
2.1
Introduction
The progress made in hardware technology allows today's computer systems to store very large amounts of data. Researchers from the University of Berkeley estimate that every year about 2 exabyte ( = 2 million terabytes) of data are generated, of which a large portion is available in digital form (growth rate is about 50%). This means that in the next 3 years, more data will be generated than in all of human history to date. The data are often automatically recorded via sensors and monitoring systems. Almost all transactions of every day life, such as purchases made with credit card, Web pages visited or telephone calls are recorded by computers. In many application domains, it might also be useful that much of the data include geospatial referencing. For example, credit card purchase transactions include both the address of the place of purchase and of the purchaser, telephone records include addresses and sometimes coordinates or at least cell phone zones, data from satellite remote sensed data contain coordinates or other 23
24
D.A. Keim, C. Panse & M. Sips
geographic indexing, census data and other government statistics contain addresses and/or indexes for places, and information about property ownership contains addresses, relative location info, and sometimes coordinates. These data are collected because people believe that they are a potential source of valuable information, providing a competitive advantage (at some point) to their holders. Usually many parameters are recorded, resulting in data with a high dimensionality. With today's data management systems, it is only possible to view quite small portions of the data. If the data are presented textually, the amount of data that can be displayed is in the range of some one hundred data items, but this is like a drop in the ocean when dealing with data sets containing millions of data items. Having no possibility to adequately explore the large amounts of data that have been collected because of their potential usefulness, the data become useless and the databases become data "dumps".
2.1.1
Benefits of visual data exploration
For datamining to be effective, it is important to include the human in the data exploration process and combine the flexibility, creativity, and general knowledge of the human with the enormous storage capacity and the computational power of today's computers Visual data exploration aims at integrating the human into the data exploration process, applying human perceptual abilities to the analysis of large data sets available in today' s computer systems. The basic idea of visual data exploration is to present the data in some visual form, allowing the user to gain insight into the data, draw conclusions, and directly interact with the data. Visual datamining techniques have proven to be of high value in exploratory data analysis, and have a high potential for exploring large databases. Visual data exploration is especially useful when little is known about the data and the exploration goals are vague. Since the user is directly involved in the exploration process, shifting and adjusting the exploration goals is automatically done if necessary. Visual data exploration can be seen as a hypothesis generation process, for example, (see Gahegan, this volume (Chapter 4)); the visual representations of the data allow the user to gain insight into the data and come up with new hypotheses. The verification of the hypotheses can also be achieved through data visualization, but may also be accomplished using automatic techniques from statistics, pattern recognition, or machine learning. In addition to the direct involvement of the user, the main advantages of visual data exploration over automatic datamining techniques are that: 9 9
9
visual data exploration can easily deal with highly non-homogeneous and noisy data; visual data exploration is intuitive and requires much less understanding of complex mathematical or statistical algorithms or parameters than other methods; visualization can provide a qualitative overview of the data, allowing data phenomena to be isolated for further quantitative analysis.
Scope, Techniques and Opportunities for Geovisualization
25
Visual data exploration does, however, include some underlying data processing, dimension reduction, re-mapping from one space to another, etc., which typically does require some basic understanding of the underlying algorithm to understand it properly. As a result, visual data exploration can lead to quicker and often superior results, especially in cases where automatic algorithms fail. In addition, visual data exploration techniques provide a much higher degree of confidence in the findings of the exploration. This fact leads to a high demand for visual exploration techniques and makes them indispensable in conjunction with automatic exploration techniques.
2.1.2
Visual exploration paradigm
Visual data exploration usually follows a three-step process: overview first, zoom and filter, and then details-on-demand. This has been termed the "information seeking mantra" (Shneiderman, 1996). First, the user needs to get an overview of the data. In the overview, the user identifies interesting patterns or groups in the data and focuses on one or more of them. For analyzing the patterns, the user needs to drill-down and access details of the data. Visualization technology may be used for all three steps of the data exploration process. Visualization techniques are useful for showing an overview and allowing the user to identify interesting subsets. In this step, it is important to keep the overview visualization while focusing on the subset using another visualization technique (for discussion of the perceptual factors in designing such multi-scale displays, for example, (see Ware and Plumlee, this volume (Chapter 29)). An alternative is to distort the overview visualization in order to focus on the interesting subsets. This can be performed by dedicating a larger percentage of the display to the interesting subsets while decreasing screen utilization for uninteresting data. This idea is also discussed by Plaisant (this volume, Chapter 3) and illustrated by D611ner (this volume, Chapter 16). To further explore the interesting subsets, the user needs a drill-down capability in order to observe the details about the data. Note that visualization technology does not only provide the base visualization techniques for all three steps but also bridges the gaps between the steps. The design and implementation of instruments created for supporting this kind of activity are addressed in section B of this book.
2.2
Classification of Visual Datamining Techniques
Information visualization focuses on data sets lacking inherent 2D or 3D semantics and therefore also lacking a standard mapping of the abstract data onto the physical screen space. There are a number of well known techniques for visualizing such data sets, such as X - Y plots, line plots, and histograms. These techniques are useful for data exploration but are limited to relatively small and low-dimensional data sets. In the last decade, a large number of novel Information Visualization techniques have been developed, allowing visualizations of multi-dimensional data sets without inherent two- or 3D semantics. Good overviews of the approaches can be found in a number of recent books (e.g., Card et al., 1999; Ware, 2000; Spence, 2001; Schumann and Mtiller, 2000). The techniques can be classified based on three criteria (Figure 2.1): the data to be visualized,
D.A. Keim, C. Panse & M. Sips
26
Data to be Visualized 1. one-dimensional 2. two-dimensional
|
~
VisualizatioTechni n que
3 multi-dimensional
4. text/web
ked Display
~_
5 hierarchies/graphs [
/'~ / "
6 algorithm/software I / "
Dense Pixel Display
Geometrically-transformed Display
Standard 2D/3D Display
I/ /~" /
I Standard
I
I
I
',
I
Projection Filtering Zoom Distortion Link&Brush Interaction Technique
Figure 2.1. Classification of information visualization techniques. the visualization technique, and the interaction technique used. The data type to be visualized (Shneiderman, 1996) may be: 9 9 9 9 9 9
1D data, such as temporal (time-series) data. 2D data, such as geographical maps. Multi-dimensional data, such as relational tables. Text and hypertext, such as news articles and web documents. Hierarchies and graphs, such as telephone calls and web documents. Algorithms and software, such as debugging operations.
The visualization technique used may be classified as: 9 9 9 9 9
Standard 2D/3D displays, such as bar charts and X - Y plots. G e o m e t r i c a l l y transformed displays, such as landscapes and parallel coordinates. Icon-based displays, such as needle icons and star icons. Dense pixel displays, such as the recursive pattern and circle segments. Stacked displays, such as treemaps and dimensional stacking.
The third element of the classification is the interaction technique used. Interaction techniques allow users to directly navigate and modify the visualizations, as well as select subsets of the data for further operations. Examples include: 9 9 9 9
Dynamic projection Interactive filtering Interactive zooming Interactive distortion
Scope, Techniques and Opportunities for Geovisualization
9 9
27
Interactive linking Brushing
Note that the three criteria upon which we base our classification - data type to be visualized, visualization technique, and interaction technique - can be assumed to be orthogonal. This means that any of the visualization techniques may be used in conjunction with any of the interaction techniques for any data type. Note also that a specific system may be designed to support different data types and that it may use a combination of visualization and interaction techniques.
2.3
Data Type To Be Visualized
In Information Visualization, the data usually comprise a large number of records, each consisting of a number of variables or dimensions. Each record corresponds to an observation, measurement, or transaction. Examples are customer properties, e-commerce transactions, and sensor output from physical experiments. The number of attributes can differ from data set to data set; one particular physical experiment, for example, can be described by five variables, while another may need hundreds of variables. We call the number of variables the dimensionality of the data set. Data sets may be 1D, 2D, multi-dimensional or may have more complex data types such as text/hypertext or hierarchies/graphs. Sometimes, a distinction is made between grid dimensions and the dimensions that may have arbitrary values.
2.3.1
1D data
1D data usually have one dense dimension. A typical example of 1D data is temporal data. Note that with each point of time, one or multiple data values may be associated. An example is a time series of stock prices (Figure 2.4) or the time series of news data used in the ThemeRiver (Havre et al., 2000).
2.3.2
2D data
2D data usually have two dense dimensions. A typical example is geometry-related planar data in the Euclidian plane. In general, planar data define quantities of distances, or distances and angles, which determine the position of a point on a reference plane to which the surface of a 3D object has been projected. A typical example is geographical data, where the two distinct dimensions are longitude and latitude. Longitude and Latitude describe locations on a 3D surface and some transformation is required to project the relationships between the locations specified in this way on a plane. Besides, depending upon the Cartography used, various characteristics of the relationships between locations are either preserved or lost. After the projection, the geographical data can be stored as 2D data with x/y-dimensions. X - Y plots are a typical method for showing 2D data and maps are a special type of X - Y plot for showing geographical data. Although it seems easy to deal with temporal or geographic data on 2D devices, caution is advised. If the number of records to be visualized is large, temporal axes and maps get quickly cluttered - and may not help to understand the data. There are several approaches to draw
28
D.A. Keim, C. Panse & M. Sips
upon with dense geographic data already in common use, such as Gridfit (Keim and Herrmann, 1998; see Figure 2.6 in w and PixelMap (Keim et al., 2003c; see Figure 2.7 in w
2.3.3
Multi-dimensional data
Many data sets consist of more than three attributes and therefore do not allow a simple visualization as 2D or 3D plots. Examples of multi-dimensional (or multi-variate) data are tables from relational databases, which often have from tens to hundreds of columns (or attributes). Since there is no simple mapping of the attributes to the two dimensions of the screen, more sophisticated visualization techniques are needed, such as parallel coordinates plots (Inselberg and Dimsdale, 1990; Figure 2.12a). A very different method for data with geospatial attributes is to generate multi-variate glyphs anchored on a 2.5D surface representation (Gahegan, 1998).
2.3.4
Text and hypertext
Not all data types can be described in terms of dimensionality. In the age of the World Wide Web, one important data type is text and hypertext, as well as multi-media Web page contents. These data types differ in that they cannot be easily described by numbers, and therefore most of the standard visualization techniques cannot be applied. In most cases, a transformation of the data into description vectors is necessary before visualization techniques can be used. An example for a simple transformation is word counting, which is often combined with a principal component analysis (PCA) or multidimensional scaling to reduce the dimensionality to two or three, for example, (see Fabrikant and Skupin, this volume (Chapter 35).
2.3.5
Hierarchies and graphs
Data records often have some relationship to other pieces of information. These relationships may be ordered, hierarchical, or arbitrary networks of relations. Graphs are widely used to represent such interdependencies. A graph consists of a set of objects, called nodes, and connections between these objects, called edges or links. Examples are the e-mail inter-relationships among people, their shopping behavior, the file structure of the hard disk or the hyperlinks in the World Wide Web. There are a number of specific visualization techniques that deal with hierarchical and graphical data. An example is given in Figure 2.2 that shows a snapshot of the Internet core (see also Cooperative Association for Internet Data Analysis, 2003). A fine overview of hierarchical Information Visualization techniques can be found in Chen (1999), an overview of Web visualization techniques is presented in Dodge (2001) and an overview book on all aspects related to graph drawing is by Battista et al. (1999).
2.3.6
Algorithms and software
Algorithms and software constitute another class of data. Coping with large software projects is a challenge. The goal of software visualization is to support software
Scope, Techniques and Opportunities for Geovisualization
29
Figure 2.2. Cooperative Association for Internet Data Analysis (CAIDA), k claffy "Skitter Graph" Internet Map, 2000.
92000 Regents of the University of California. Courtesy University of California.
Figure 2.4. Dense pixel displays: recursive pattern technique showing 50 stocks in the Frankfurt AIIgemeine Zeitung (Frankfurt Stock Index Jan 1975-April 1995). The technique maps each stock value to a colored pixel; high values correspond to bright colors. 92004 IEEE.
D.A. Keim, C. Panse & M. Sips
30
development by helping to understand algorithms (e.g., by showing the flow of information in a program), to enhance the understanding of written code (e.g., by representing the structure of thousands of source code lines as graphs), and to support the programmer in debugging the code (e.g., by visualizing errors). There are a large number of tools and systems that support these tasks. Comprehensive overviews of software visualization can be found in Trilk (2001) and Stasko et al. (1998). Examples of visualization, and visually enabled steering, of process models that depict geographic processes include the AGP-System for ocean flow model visualization (Johannsen and Moorhead, 1995), and visualization methods/simulation steering for the 3D turbulence model of Lake Erie (Marshall et al., 1987).
2.4
Visualization Techniques
There are a large number of visualization techniques that can be used for visualizing data. In addition to standard 2D/3D-techniques such as X - Y (X-Y-Z) plots, bar charts, line graphs, and simple maps, there are a number of more sophisticated classes of visualization techniques. The classes correspond to basic visualization principles that may be combined in order to implement a specific visualization system.
2.4.1
Geometrically transformed displays
Geometrically transformed display techniques aim at finding "interesting" transformations of multi-dimensional data sets. This class of geometric display methods includes techniques from exploratory statistics (for example, (see Theus, this volume (Chapter 6))) such as scatter plot matrices (Andrews, 1972; Cleveland, 1993) and techniques that can be subsumed under the term "projection pursuit" (Huber, 1985). Other geometric projection techniques include prosection views (Furnas and Buja, 1994; Spence et al., 1995), hyperslice (van Wijk and van Liere, 1993) and the parallel coordinates technique (Inselberg and Dimsdale, 1990). Parallel coordinates plots map the k-dimensional space onto the two display dimensions by using k axes that are parallel to each other (either horizontally or vertically oriented), evenly spaced across the display. The axes correspond to the dimensions and are usually linearly scaled from the minimum to the maximum value of the corresponding dimension. Each data item is presented as a chain of connected line segments, intersecting each of the axes at the location corresponding to the value of the considered dimensions (Figure 2.12a). A geographic extension of the parallel coordinates technique is to build them in 3D, with maps as orthogonal planes to the otherwise flat 2D parallel coordinates (Edsall, 1999).
2.4.2
Iconic displays
Another class of visual data exploration techniques includes iconic display methods. The idea here is to map the attribute values of a multi-dimensional data item to the features of an icon. Icons can be arbitrarily defined. They may for example comprise: simple faces (Chernoff, 1973); needle icons (Abello and Korn, 2001; Keim, 2000); star icons (Ward, 1994); stick figure icons (Pickett and Grinstein, 1988); color icons (Levkowitz, 1991; Keim and Kriegel, 1994); TileBars (Hearst, 1995). The visualization is generated by
Scope, Techniques and Opportunities for Geovisualization
31
mapping the attribute values of each data record to the features of the icons. In case of the stick figure technique, for example, two dimensions are mapped to the display dimensions and the remaining dimensions are mapped to the angles and/or limb length of the stick figure icon. If the data items are relatively dense with respect to the two display dimensions, the resulting visualization presents texture patterns that vary according to the characteristics of the data and are therefore detectable by pre-attentive perception. Figure 2.3 shows an example of this class of techniques. Each data point is represented by a star icon/glyph, where each data dimension controls the length of a ray emanating from the center of the icon. In this example, the positions of the icons are determined using PCA to convey more information about data relations. Other data attributes could also be mapped to icon position.
2.4.3
Dense pixel displays
The rationale behind the development of dense pixel techniques is to map each dimension value to a colored pixel and group the pixels belonging to each dimension into adjacent areas. More precisely, dense pixel displays divide the screen into multiple subwindows. For data sets with m dimensions (attributes), the screen is partitioned into m subwindows, one for each of the dimensions. Since in general dense pixel displays use one pixel per
$
@
Figure 2.3. The iris data set, displayed using star glyphs positioned based on the first two principal components (from XmdvTool; Ward, 1994). Reproduced with permission of M. Ward, Worcester Polytechnic Institute 92004 IEEE.
32
D.A. Keim, C. Panse & M. Sips
data value, the techniques allow the visualization of the largest amount of data possible on current displays (up to 1,000,000 data values on a 1,000,000 pixel screen). Although, it seems relatively straightforward to create dense pixel displays, there are some important questions to be taken into account.
Color mapping Firstly, finding a path through a color space that maximizes the numbers of just noticeable differences (JNDs), but at the same time, is intuitive for the application domain is a difficult task. The advantage of color over grey scales is that the number of JNDs is much higher.
Pixel arrangement If each data value is represented by one pixel, the main question is how to arrange the pixels on the screen within the subwindows. Note, that only a good arrangement due to the density of the pixel display will allow a discovery of clusters, local correlations, dependencies, other interesting relationships among the dimensions, and hot spots. For the arrangement of pixels, we have to distinguish between data sets that have a natural ordering of the data objects, such as time series, and data sets without inherent ordering, such as is the case when visualizing query result sets. Even if the data has a natural ordering to one attribute, there are many possible arrangements. One straightforward possibility is to arrange the data items from left to right in a line-by-line fashion. Another possibility is to arrange the data items top-down in a column-by-column fashion. If these arrangements are done pixel wise, in general, the resulting visualizations do not provide useful results. More useful are techniques that provide a better clustering of closely related data items and allow the user to influence the arrangement of the data. Techniques that support the clustering properties are screenfilling curves. Another technique that supports clustering is the recursive pattern technique (Keim et al., 1995a,b). This technique is based upon a generic recursive back-and-forth arrangement of the pixels and is particularly aimed at representing datasets with a natural order according to one attribute (e.g., time-series data). The user may specify parameters for each recursion level, and thereby control the arrangement of the pixels to form semantically meaningful substructures. The base element on each recursion level is a pattern of height hi and width wi as specified by the user. First, the elements correspond to single pixels that are arranged within a rectangle of height h l and width Wl from left to right, then below backwards from right to left, then again forward from left to right, and so on. The same basic arrangement is done on all recursion levels with the only difference being that the basic elements that are arranged on level i are the patterns resulting from the level i - 1 arrangements. In Figure 2.4, an example of a recursive pattern visualization is shown. The visualization shows 20 years of financial data (January 1974-April 1995) with the daily prices of the 50 stocks contained in the Frankfurt Stock Index (FAZ).
Shape of subwindows The next important question is whether there exists an alternative to the regular partition of the screen into rectangular subwindows. The rectangular shape of the subwindows
Scope, Techniques and Opportunities for Geovisualization
33
supports screen usage effectively, but on the other hand, the rectangular shape leads to a dispersal of the pixels belonging to one data object over the whole screen. The subwindows of each dimension can be relatively distant, especially for data sets with many dimensions. This can make it particularly difficult to detect clusters, correlations, and interesting patterns. An alternative shape of the subwindows is the circle segments technique (Ankerst et al., 1996) in which the data dimensions are displayed as segments of a circle.
Ordering of dimensions Finally, the last question to consider in dense pixel displays is the ordering of the dimensions. This is actually a case of a more general issue that arises for a number of other visualization techniques, such as the parallel coordinate plots. The basic problem is that the data dimensions have to be arranged in some 1D or 2D ordering on the screen. The ordering of dimensions, however, has a major impact on the expressiveness of the visualization. If a different ordering of the dimensions is chosen, the resulting visualization may change completely and lead to diverse interpretations. More details about designing pixel-oriented visualization techniques can be found in Keim (2000) and Keim and Kriegel (1995) and all techniques have been implemented in the VisDBSystem (Keim and Kriegel, 1994).
2.4.4
Stacked displays
Stacked display techniques are tailored to present data partitioned in an hierarchical fashion. In the case of multi-dimensional data, the data dimensions to be used for partitioning the data and building the hierarchy have to be appropriately selected. An example of a stacked display technique is dimensional stacking (LeBlanc et al., 1990). The notion is to embed one coordinate system inside another coordinate system, i.e., two attributes form the outer coordinate system, two other attributes are embedded into the outer coordinate system, and so on. The display is generated by dividing the outermost level coordinate system into rectangular cells and within the cells the next two attributes are used to span the second level coordinate system. This process may be repeated multiple times. The usefulness of the resulting visualization largely depends on the data distribution of the outer coordinates and therefore the dimensions that are used for defining the outer coordinate system have to be carefully selected. A rule of thumb is to choose the most important dimensions first. A dimensional stacking visualization of mining data with longitude and latitude mapped to the outer x and y axes, as well as ore grade and depth mapped to the inner x and y axes is shown in Figure 2.5. Other examples of stacked display techniques include Worlds-within-Worlds (Feiner and Beshers, 1990a,b), Treemap (Johnson and Shneiderman, 1991; Shneiderman, 1992), and Cone Trees (Robertson et al., 1991).
2.5
Visual Datamining on Geospatial Data
Geospatial data are relevant to a large number of applications. Examples include weather measurements such as temperature, rainfall, wind-speed, etc., measured at a large number
34
D.A. Keim, C. Panse & M. Sips
.:.!. i ~ ~.
~.i..i ~ 5.L&.oi s
!iiiilii i ?i:i.i:i!~:iiii~ iii i:
i i !,!iii
:~
~:~' '"~ '~'~
,i + ~,..~.j.',F[:~Li..
...........
~............... ~ ~
ii ii!i iiii~i iiii:i:ii~:
iiii/ii~iiii:iiii~i~i~ii~)i~it ,i::~:;~;,:~:,:~i i~:iiii:il ~ir::i:i ~ i~i:i~:i::i ii:il;iiiii~iiii:iiii; i~ ii i i ilia: iiii]iii ::i~ili:~ii:: :ii'::::i ::::::::::::::::::::::::: ~+~"i!:!i~i~~~+ :i~:i~li~:i:!:~ii :::::::::::::::::::::::::::::: ~!~-!!i ii!fi~[~.~,i+~i.~**~
::::::::::::::::::::::::::::::::::::::: ::::::::::::::::::::::::::::::::::
Figure 2.5. Dimensional stacking visualization of drill hole mining data with longitude and latitude mapped to the outer x-, y-axes and one grade and depth mapped to the inner x-, y-axes. Reproduced with permission of M. Ward, Worcester Polytechnic Institute 92004 IEEE.
of locations, use of connecting nodes in telephone business, load of a large number of Internet nodes at different locations, air pollution in cities, etc. Nowadays, there exist a large number of applications, in which it is important to analyze relationships that involve geographic location. Examples include global climate modeling (measurements such as temperature, rainfall, and wind-speed), environmental records, customer analysis, telephone calls, credit card payments, and crime data. Spatial datamining is the branch of datamining that deals with spatial (location) data. However, to analyze the huge amounts of geospatial data obtained from large databases such as credit card payments, telephone calls, environmental records (that often amount to terabytes of data), it is almost impossible for users to examine the spatial data sets in detail and extract interesting knowledge or general characteristics. Automated datamining algorithms are indispensable for analyzing large geospatial data sets, but often fall short of providing completely satisfactory results. Interactive datamining based on a synthesis of automatic and visual datamining techniques usually does not only yields better results, but also results in a higher degree of user satisfaction and confidence in the findings (Han and Kamber, 1986). Although automatic approaches have been developed for mining geospatial data (Han and Kamber, 1986), they are often no better than simple visualizations of the geospatial data on a map.
2.5.1
Visualization strategy
The visualization strategy for geospatial data can be straightforward. The geospatial data points described by longitude and latitude are displayed on the 2D Euclidian plain using a 2D projection. The two Euclidian plain dimensions x and y are directly mapped to the two physical screen dimensions. The resulting visualization depends on the spatial dimension or extent of the described phenomena and objects. A fine overview can be found in Keim et al. (2003d). Since the geospatial locations of the data are not uniformly distributed on a plane, however, the display will usually be sparsely populated in some regions while in other regions of the display a high degree
Scope, Techniques and Opportunities for Geovisualization
35
of overplotting occurs. There are several approaches to cope with dense geospatial data (Geisler, 2003). One widely used method is 2.5D visualization showing data points aggregated up to map regions. This technique is commercially available in systems such as VisualInsight's In3D (Advizor Solutions Inc, 2003) and ESRI's ArcView (Environmental Systems Research Institute, 2003). An alternative that shows more detail is a visualization of individual data points as bars on a map. This technique is embodied in systems such as SGI's MineSet (Silicon Graphics Inc, 2002) and AT&T's Swift 3D (Keim et al., 1999). A problem here is that a large number of data points are plotted at the same position, and therefore only a small portion of the data is actually displayed. Moreover, due to occlusion in 3D, a significant fraction of the data may not be visible unless the viewpoint is changed.
2.5.2
The VisualPoints-System
The VisualPoints-System solves the problem of over-plotting pixels using the Gridfit algorithm (Keim and Herrmann, 1998). An example is shown in Figure 2.6. The Gridfit algorithm is designed to hierarchically partition the data space. In each step, the data set is partitioned into four subsets containing the data points that belong to the four equally sized subregions. Since the data points may not fit into the four equally sized subregions, we have to determine a new extent of the four subregions (without changing the four subsets of data points) such that the data points of each subset can be visualized in the corresponding subregion. For an efficient implementation of the algorithm, a quadtreelike data structure is used to manage the required information and to support the recursive partitioning process. The partitioning process works as follows: starting with the root of the quadtree, in each step the data space is partitioned into four subregions. The goal of the partitioning is that the area occupied by each of the subregions (in pixels) is larger than the number of pixels to be placed within these subregions. A problem of VisualPoints is that in areas with high overlap, the repositioning depends on the ordering of the points in the database. That is, the first data item found in the database is placed at its correct position, and subsequent overlapping data points are moved to nearby free positions, and so locally appear quasi-random in their placement.
2.5.3
Fast-PixelMap-Technique
The PixelMap-Technique solves the problem of displaying dense point sets on maps, by combining clustering and visualization techniques (Keim et al., 2003c). First, the FastPixelMap algorithm approximates a 2D kernel-density-estimation in the two geographical dimensions performing a recursive partitioning of the dataset and the 2D screen space by using split operations according to the geographical parameters of the data points and the extensions of the 2D screen space. The goal is to: (i) find areas with density in the two geographical dimensions and to (ii) allocate enough pixels on the screen to place all data points, especially of dense regions, at unique positions that are close to each other. The top-down partitioning of the dataset and 2D screen space results in distortion of certain map regions. That means, however, virtually empty areas
36
D.A. Keim, C. Panse & M. Sips
will be shrinking and dense areas will be expanding to achieve pixel coherence. For an efficient partitioning of the dataset and the 2D screen space and an efficient scaling to new boundaries, a new data structure called Fast-PixelMap is used. The Fast-PixelMap data structure is a combination of a gridfile and a quadtree that realizes the split operations in the data and the 2D screen space. The Fast-PixelMap data structure enables an efficient determination of the old (boundaries of the gridfile partition in the dataset) and the new boundaries (those of the quadtree partition in the 2D screen space) of each partition. The old and the new boundaries determine the local rescaling of certain map regions. More precisely, all data points within the old boundaries will be relocated to the new positions within the new boundaries. The rescaling reduces the size of virtually empty regions and unleashes unused pixels for dense regions. Second, the Fast-PixelMap algorithm approximates a 3D kernel-densityestimation-based clustering in the 3D performing an array-based clustering for each dataset partition. After rescaling all data points to the new boundaries, the iterative positioning of data points (pixel placement step), starting with the densest regions and within the dense regions the smallest cluster is chosen first. To determine the placement sequence, we sort all final gridfile partitions (leaves of the Fast-PixelMap data structure) according to the number of data points they contain. The clustering is a crucial preprocessing step to making important information visible and achieving pixel coherence, which refers to the similarity of adjacent pixels. High pixel coherence makes small pixel clusters perceivable. The final step of the pixel placement is a sophisticated algorithm that places all data points of a gridfile partition to pixels on the output map in order to provide visualizations that are as position-, distance-, and cluster-preserving as possible. An example showing income levels based upon US-Census data is displayed in Figure 2.7.
2.5.4
Cartogram techniques
A cartogram can be seen as a generalization of a familiar land-covering choropleth map. In this interpretation, an arbitrary parameter vector gives the intended sizes of the regions displayed on the map, so a familiar land-covering choropleth is simply a cartogram with sizes proportional to land area. In addition to the classical applications mentioned above, a key motivation for cartograms as a general Information Visualization technique is to have a method for trading off shape and area adjustments. For example, in a conventional choropleth map, high values are often concentrated in highly populated areas, and low values may be spread out across sparsely populated areas. Such maps therefore tend to highlight patterns in less dense areas where few people live. In contrast, cartograms display areas in relation to an additional parameter, such as population. Patterns may then be displayed in proportion to this parameter (e.g., the number of people involved) instead of the raw size of the area involved. Example applications in the literature include population demographics (Tobler, 1976; Raisz, 1962), election results (Kocmoud and House, 1998), and epidemiology (Gusein-Zade and Tikunov, 1995). Because cartograms are difficult to make by hand, the study of automated methods is of interest (Dent, 1996).
Scope, Techniques and Opportunities for Geovisualization
37
Figure 2.6. Call volume of AT&T customers at one specified time (midnight EST). Each pixel represents one of 22:000 telephone switches. A uni-color map is used to show the call volume.
Figure 2.7. Comparison of traditional map versus PixelMap. New York State Median Household Income. 1999. This map displays cluster regions, for example on the East side of Central Park in Manhattan, where inhabitants with high income live, or on the East side of Brooklyn, where inhabitants with low income live.
38
D.A. Keim, C. Panse & M. Sips
One of the latest cartogram generation algorithm is the CartoDraw-algorithm which was recently proposed as a practical approach to cartogram generation (Keim et al., 2003a,b). The CartoDraw method incrementally repositions the vertices of the map's polygons by means of scanlines. Local changes are applied if they reduce total area error without introducing excessive shape error. Scanlines may be determined automatically, or entered interactively. The main search loop runs over a given set of scanlines. For each, it computes a candidate transformation of the polygons, and checks it for topology and shape preservation. If the candidate passes the tests, it is made persistent; otherwise it is discarded. The scanline processing order depends on their potential for reducing area error. The algorithm runs until the area error improvement over all scanlines falls below a given threshold. A result of the CartoDraw algorithm can be seen in Figure 2.8.
2.6
Interaction Techniques
In addition to the visualization techniques themselves, effective data exploration requires the use of one or more methods of interaction. Interaction techniques allow the data analyst to directly interact with the visualizations and dynamically change the visualizations according to the exploration objectives. Besides, they also make it possible to relate and combine multiple independent visualizations.
Figure 2.8. US State population cartogram showing the presidential election result of 2000. The area of the states in the cartograms corresponds to the electoral voters, the color corresponds to the percentage of the vote. A bipolar colormap depicts the candidate winning each state.
Scope, Techniques and Opportunities for Geovisualization
39
Interaction techniques can be categorized based upon the effects they have on the display. Navigation techniques focus on modifying the projection of the data onto the screen, using either manual or automated methods. View enhancement methods allow users to adjust the level of detail on part or all of the visualization, or modify the mapping to emphasize some subset of the data. Selection techniques provide users with the ability to isolate a subset of the displayed data for operations such as highlighting, filtering, and quantitative analysis. Selection can be done directly on the visualization (direct manipulation) or via dialog boxes or other query mechanisms (indirect manipulation). Some examples of interaction techniques are described below.
2.6.1
Dynamic projection
Dynamic projection is an automated navigation operation in which the projections are dynamically changed in order to explore a multi-dimensional data set. A classic example is the GrandTour system (Asimov, 1985) that aims to show all interesting 2D projections of a multi-dimensional data set as a series of scatter plots. Note that the number of possible projections is exponential in accordance with the number of dimensions, i.e., it is intractable for large dimensionality. The sequence of projections shown can be random, manual, pre-computed, or data driven. Systems supporting dynamic projection techniques include Xgobi (Swayne et al., 1992; Buja et al., 1996), XLispStat (Tierney, 1991) and ExplorN (Carr et al., 1996).
2.6.2
Interactive filtering
Interactive filtering is a combination of selection and view enhancement. In exploring large data sets, it is important to interactively partition the data set into segments and focus on interesting subsets. This can be done by a direct selection of the desired subset (browsing) or by a specification of properties of the desired subset (querying). Browsing is very difficult for very large data sets and querying often does not produce the desired results, but on the other hand, these tools offer many advantages over traditional controls. Therefore, a number of interactive selection techniques have been developed to improve interactive filtering in data exploration. An example of a tool that can be used for interactive filtering is the Magic Lens (Bier et al., 1993; Fishkin and Stone, 1995) in which a tool similar to a magnifying glass is used to support the filtering of the data directly in the visualization. The data under the magnifying glass is processed by the filter, and the result is displayed differently from the remaining data set, for a 3D example, (see D611ner, this volume (Chapter 16)). Users may also use several lenses with different filters, e.g., magnify, then apply a blur by carefully stacking multiple lenses, which work by applying their effects from back to front. Each lens acts as a filter that screens on some attribute of the data. The filter function only modifies the view only within the lens window. When the lenses overlap, their filters are combined. Other examples of interactive filtering techniques and tools are InfoCrystal (Spoerri, 1993), Dynamic Queries (Ahlberg and Shneiderman, 1994; Eick, 1994; Goldstein and Roth, 1994), Polaris (Stolte et al., 2001), Linked Micromap Plots, and Conditioned Choropleth Maps (Carr et al., 2000a,b; Figure 2.9). Additionally, a type of
40
D.A. Keim, C. Panse & M. Sips
Figure 2.9. A conditioned choropleth map of prostate data of the USA. The mapped prostate data is conditioned by male and female lung cancer. Figure created using Conditioned Choropleth Mapping System (MacEachren, 2003) developed under the project Conditioned Choropleth Maps: Dynamic Multi-variate Representations of Statistical Data supervised by Alan MacEachren.
Figure 2.11. Combination of zooming, distortion, and filtering techniques in the area of geographic visualization (Keahey, 1998). Reproduced with permission of A. Keahey, Visintuit. 92004 IEEE.
Scope, Techniques and Opportunities for Geovisualization
41
interactive filtering using a parallel coordinate plot linked to a map is illustrated in MacEachren et al. (2003a,b) and in Gahegan et al. (2002a,b).
2.6.3
Zooming
Zooming is a well-known view modification technique that is widely used in a number of applications. In dealing with large amounts of data, it is important to present the data in a highly compressed form to provide an overview of the data, but at the same time, allowing a variable display of the data at different resolutions. Zooming does not only mean increasing the size of data objects in the display, but also that the data representation may automatically change to present more details at higher zoom levels. The objects may, for example, be represented as single pixels at a low zoom level, as icons at an intermediate zoom level, and as labeled objects at a high resolution. An interesting example applying the zooming idea to large tabular data sets is the Table Lens approach (Rao and Card, 1994). Achieving an overview of large tabular data sets is difficult if the data is displayed in textual form. The Table Lens represents each numerical value through a small bar instead. All bars have a one-pixel height and the lengths are determined by the attribute values. This means that the number of rows on the display can be nearly as large as the vertical resolution and the number of columns depends on the maximum width of the bars for each attribute. The initial view allows the user to detect patterns, correlations, and outliers in the data set. In order to explore a region of interest the user can zoom in, with the result that the affected rows (or columns) are displayed in more detail, possibly even in textual form. Figure 2.10 shows an example of a baseball database with a few rows being selected in full detail. Other examples of techniques and systems that use interactive zooming include PAD+ + (Perlin and Fox, 1993; Bederson, 1994; Bederson and Hollan, 1994), IVEE/Spotfire (Ahlberg and Wistrand, 1995a,b) and DataSpace (Anupam et al., 1995). A comparison of fisheye and zooming techniques can be found in Schaffer et al. (1993).
2.6.4
Distortion
Distortion is a view modification technique that supports the data exploration process by preserving an overview of the data during drill-down operations. In this technique, portions of the data are shown with a high level of detail while others are displayed with lower levels of detail. Popular distortion techniques are hyperbolic and spherical distortions. These are often used on hierarchies or graphs but may be also applied to any other visualization technique. An example of spherical distortions is provided in the Scalable Frame-work paper (Kreuseler and Schumann, 2001). An overview of distortion techniques is provided by Leung and Apperley (1994) and Carpendale et al. (1997). Examples of distortion techniques include bifocal displays (Spence and Apperley, 1982), perspective wall (Mackinlay et al., 1991), graphical fisheye views (Furnas, 1986; Sarkar and Brown, 1994), hyperbolic visualization (Lamping et al., 1995; Munzner and Burchard, 1995), and hyperbox (Alpern and Carter, 1991). Some of the uses of distortion with map displays that combine zooming, distortion and filtering can be found
42
D.A. Keim, C. Panse & M. Sips
Figure 2.10. Table lens showing a table of baseball players performance/classification statistics for 1986. Reproduced with permission from R. Rao, Xerox PARC. 9ACM.
in Keahey (1998). Figure 2.11 shows the effect of distorting part of a familiar landcoveting map to display more detail while preserving context from the rest of the display.
2.6.5
Brushing and linking
Brushing is an interactive selection process that is often, but not always, combined with linking, a process to communicate the selected data to other views of the data set. There are many possibilities to visualize multi-dimensional data, each with their own strengths and weaknesses. The idea of linking and brushing is to combine different visualization methods to overcome the shortcomings of individual techniques. Scatter plots of different projections, for example, may be combined by coloring and linking subsets of points in all projections. In a similar fashion, linking and brushing can be applied to visualizations generated by all visualization techniques described above. As a result, the brushed points are highlighted in all visualizations, making it possible to detect dependencies and correlations. Interactive changes made in one visualization are also automatically reflected in the other visualizations. Note that connecting multiple visualizations through interactive linking and brushing provides more information than considering the component visualizations independently. Typical examples of visualization techniques that have been combined by linking and brushing are multiple scatter plots, bar charts, parallel coordinates, pixel displays, and
Scope, Techniques and Opportunities for Geovisualization
43
Figure 2.12. (a) Parallel coordinates plots. (b) Scatter plot matrix. These figures display US Census data for 50 states. A linked brushing between these multi-variate visualization techniques is used. The plots are linked and brushed by color, which represents the state wise winner party of the 2000 US presidential election (from Ihaka and Gentleman, 1996). The plots show example relationships including an inverse correlation between High School Grad rates and levels of Illiteracy as well as suggesting a tendency towards Republican party voting in states with a low or a high HS Grade.
44
D.A. Keim, C. Panse & M. Sips
maps. Most interactive data exploration systems allow some form of linking and brushing. Examples include Polaris (Stolte et al., 2001) and the Scalable Framework (Kreuseler and Schumann, 2001). Other tools and systems include S-Plus (Becker et al., 1988), XGobi (Swayne et al., 1992; Becker et al., 1996), XmdvTool (Ward, 1994; Figure 2.12), and DataDesk (Velleman, 1997; Wilhelm et al., 1995). An early example of brushing and linking applied to geospatial data was proposed by Monmonier (1989). Most subsequent geovisualization tool kits incorporate brushing and linking. These include cdv (Dykes, 1998), Descartes (Andrienko and Andrienko, 1999a-f) and GeoVISTA Studio (Gahegan et al., 2002a,b; MacEachren et al., 2003a,b; Cook et al., 1997).
2.6.6
Alternative classification from GI-Science
Crampton (2002) proposes an alternative classification of interaction techniques developed in GI Science. The interaction methods are placed in the framework of geovisualization in order to extend the geovisualization emphasis on exploratory, interactive and private functions of spatial displays. Crampton defines a hierarchy of the interaction techniques based on their increasing sophistication. Four categories of interactivity are proposed: the data, the data representation, the temporal dimension, and contextualizing interaction. The following benefits of both classifications can be observed. Firstly, interactivity types allow the user to directly interact with the visualization, dynamically change the visualization, and relate and combine independent visualization techniques in order to build interactive environments. Secondly, interactivity types allow the data analysts as well as the cartographers to compare and critique different views of the data and provide the human with a mechanism for an effective exploration and understanding of the data. In contrast to the alternative classification from GI Science, the classification presented here from the perspective of Information Visualization is based on the visual information seeking mantra (see w This means that the interaction techniques enable the user to modify the visualization for further analysis operations and that there is a strong relationship to exploration and datamining tasks. These interaction techniques can be completely summarized in the category interaction with data. The other categories of Crampton' s classification are more oriented on an interactive data representation, e.g., selection of view points, scaling, etc., and temporal features of the visualization such as fly-throughs and navigations. These interaction techniques are more related to representation tasks and computer graphics research.
2.7
Conclusion
The exploration of large data sets is an important but difficult problem. Information visualization techniques can be useful in solving this problem. Visual data exploration has significant potential, and many applications such as fraud detection and datamining can use Information Visualization technology for an improved data analysis. A significant proportion of all data being stored and processed has geospatial attributes. The task of geovisualization is to view geospatial data and to give insight into
Scope, Techniques and Opportunities for Geovisualization
45
geo-processes and geo-phenomena. In this area, maps are well-known tools for many centuries, but they have several drawbacks from the visualization standpoint. For example, when drawing large geospatial data sets on the screen, the display will usually be sparsely populated in some regions while in other regions of the display, high degree of overplotting occurs, since the geospatial locations are highly non-uniformly distributed in the plane. One of the challenges today is to find out how to deploy efficient visualization strategies to represent large geospatial data sets. Avenues for future work include the tight integration of visualization techniques from the Information Visualization area with methods from the GI Science and with traditional techniques from such disciplines as Statistics, Machine learning, Operations Research, and Simulation. Integration of visualization techniques and these more established methods would combine fast automatic datamining algorithms with the intuitive power of the human mind, improving the quality and speed of the datamining process. The intention of this chapter is to share ideas and connecting methods from both the Information Visualization and geovisualization disciplines. The ultimate goal is to bring the power of integrated visualization technology from both areas to every desktop to allow a better, faster and more intuitive exploration of very large geospatial data resources. This will not only be valuable in an economic sense but will also stimulate and delight the user.
Acknowledgments We gratefully acknowledge Stephen North from the AT&T Laboratories for his contribution to this research. "Skitter Graph" Internet Map 9 Regents of the University of California. Courtesy University of California. This chapter draws upon a framework that has been previously published (Keim, 2001).
References Abello, J., and Korn, J., (2001) "MGV: a system for visualizing massive multi-digraphs", Transactions on Visualization and Computer Graphics. Advizor Solutions Inc., (2003) Data Visualization Tools and Analytic Business Technology - ADVIZOR Solutions Inc. Online: http://www.advizorsolutions.com/ (23/10/03). Ahlberg, C., and Shneiderman, B., (1994) "Visual information seeking: tight coupling of dynamic query filters with starfield displays", In: Adelson, B., Dumais, S., and Olson, J. S., (eds.), CHI'94 Human Factors in Computing Systems. Boston, MA: ACM, pp. 313-317, (24-28 April). Ahlberg, C., and Wistrand, E., (1995a) "IVEE: an environment for automatic creation of dynamic queries applications", Proceedings of CHI '95: Human Factors in Computing Systems. ACM. Ahlberg, C., and Wistrand, E., (1995b) "IVEE: an Information Visualization and exploration environment", Proceedings International Symposium on Information Visualization, Atlanta, GA, pp. 66-73.
46
D.A. Keim, C. Panse & M. Sips
Alpern, B., and Carter, L., (199 l) "Hyperbox", Proceedings Visualization '91, San Diego, CA, pp. 133-139. Andrews, D. F., (1972) "Plots of high-dimensional data", Biometrics, 29, 125-136. Andrienko, G. L., and Andrienko, N. V., (1999a) "Interactive maps for visual data exploration", International Journal Geographic Information Science, 13(4), 355-374. Andrienko, G., and Andrienko, N., (1999b). Seasonal migration of white storks, 19981999. Online: http://www.ais.fhg.de/and/java/birds/(23/10/03). Andrienko, G., and Andrienko, N., (1999c) "GIS visualization support to the C4.5 classification algorithm of KDD", Proceedings of the 19th International Cartographic Conference, pp. 747-755. Andrienko, G., and Andrienko, N., (1999d) "Knowledge-based visualization to support spatial data mining", Proceedings of Intelligent Data Analysis. Berlin: Springer Verlag, pp. 149-160. Andrienko, G., and Andrienko, N., (1999e) "Making a GIS intelligent: CommonGIS project view", AGILE'99 Conference, Rome, April 15-17, pp. 19-24. Andrienko, G. and Andrienko, N., (1999f) Seasonal migration of white storks, 1998-1999. Online: http://www.ais.fhg.de/and/java/birds/(03/10/02). Ankerst, M., Keim, D. A., and Kriegel, H.-P., (1996) "Circle segments: a technique for visually exploring large multidimensional data sets", Proceedings Visualization 96, Hot Topic Session, San Francisco, CA. Anupam, V., Dar, S., Leibfried, T., and Petajan, E., (1995) "DataSpace: {3D} visualization of large databases", Proceedings International Symposium on Information Visualization, Atlanta, GA, pp. 82-88. Asimov, D., (1985) "The grand tour: a tool for viewing multidimensional data", SIAM Journal of Science & Statistical Computation, 6, 128-143. Becker, R., Chambers, J. M., and Wilks, A. R., (1988) The New S Language: A Programming Environment for Data Analysis and Statistics. Pacific Grove, CA: Wadsworth. Becker, R. A., Cleveland, W. S., and Shyu, M.-J., (1996) "The visual design and control of trellis display", Journal of Computational and Graphical Statistics, 5(2), 123-155. Bederson, B., (1994) "Pad+ +: advances in multiscale interfaces", Proceedings Human Factors in Computing Systems CHI'94 Conference, Boston, MA, p. 315. Bederson, B. B., and Hollan, J. D., (1994) "PAD+ § a zooming graphical user interface for exploring alternate interface physics", Proceedings User Interfaces Software and Technology'94. New York: ACM, pp. 17-27. Bier, E. A., Stone, M. C., Pier, K., Buxton, W., and DeRose, T., (1993) "Toolglass and magic lenses: the see-through interface", Proceedings SIGGRAPH'93, Anaheim, CA, pp. 73-80. Buja, A., Swayne, D. F., and Cook, D., (1996) "Interactive high-dimensional data visualization", Journal of Computational and Graphical Statistics, 5(1), 78-99.
Scope, Techniques and Opportunities for Geovisualization
47
CAIDA (Cooperative Association for Internet Data Analysis), (2003) Visualising internet topology at a macroscopic scale. Online: http://www.caida.org/analysis/topology/as_core_network (23/10/03). Card, S. K., Mackinlay, J. D., and Shneiderman, B., (eds.), (1999) Readings in Information Visualization: Using Vision to Think. San Francisco: Morgan Kaufmann Publishers. Carpendale, M. S. T., Cowperthwaite, D. J., and Fracchia, F. D., (1997) "IEEE computer graphics and applications, special issue on Information Visualization", IEEE Journal Press, 17(4), 42-51, (July 1997). Carr, D. B., Wegman, E. J., and Luo, Q., (1996) ExplorN: design considerations past and present, Technical Report, (No. 129). Centerfor Computational Statistics, George Mason University. Carr, D. B., Olsen, A. R., Pierson, S. M., and Jean-Yves, P. C., (2000a) "Using linked micromap plots to characterize omernik ecoregions", Data Mining and Knowledge Discovery. Hingham, MA: Kluwer Academic. Carr, D. B., Wallin, J. F., and Carr, D. A., (2000b) "Two new templates for epidemiology applications: linked micromap plots and conditioned choropleth maps", Statistics in Medicine. New York: John Wiley & Son. Chert, C., (1999) Information Visualization and Virtual Environments. London: Springer, p. 223. Chernoff, H., (1973) "The use of faces to represent points in k-dimensional space graphically", Journal of The American Statistical Association, 68(342), 361-368. Cleveland, W. S., (1993) Visualizing Data. Summit, NJ: Hobart Press. Cook, D., Symanzik, J., Majure, J. J., and Cressie, N., (1997) "Dynamic graphics in a GIS: more examples using linked software", Computers and Geosciences. Crampton, J. W., (2002) "Interactivity types in geographic visualization", Cartography and Geographic Information Science, 29(2), 85-98. Dent, B. D., (1999) Cartography: Thematic Map Design. Boston: WCB/McGraw-Hill. Di Battista, G., Eades, P., Tamassia, R. and Tollis, I. G., (1999) GraphDrawing: Algorithms for the Visualization of Graphs. Upper Saddle River, NJ: Prentice Hall. Dodge, M., (2001) An Atlas of Cyberspace. Online: http://www.cybergeography.org/atlas Dykes, J. A., (1998) "Cartographic visualization: exploratory spatial data analysis with local indicators of spatial association using Tcl/Tk and cdv", The Statistician, 47(3), 485-497. Edsall, R. M., (1999) "The dynamic parallel coordinate plot: visualizing multivariate geographic data", Proceedings 19th International Cartographic Association Conference, Ottawa, pp. 89-97. Eick, S. G., (1994) "Data visualization sliders", Proceedings ACM UIST, 119-120. Environmental Systems Research Institute, (2003) ArcGIS - ArcView. Online: http://www.esri.com/software/arcgis/arcview/index.html (23/10/03). Feiner, S., and Beshers, C., (1990a) "Visualizing n-dimensional virtual worlds with n-vision", Computer Graphics, 24(2), 37-38.
48
D.A. Keim, C. Panse & M. Sips
Feiner, S., and Beshers, C., (1990b) "Worlds within worlds: metaphors for exploring n-dimensional virtual worlds", Proceedings of UIST'90, pp. 76-83. Fishkin, K., and Stone, M. C., (1995) "Enhanced dynamic queries via movable filters", Proceedings Human Factors in Computing Systems CHI'95 Conference, Denver, CO, pp. 415-420. Furnas, G. W., (1986) "Generalized fisheye views", Proceedings CHI'86 Conference: Human Factors in Computing Systems. New York: ACM Press, pp. 16-23. Furnas, G. W., and Buja, A., (1994) "Prosections views: dimensional inference through sections and projections", Journal of Computational and Graphical Statistics, 3(4), 323-353. Gahegan, M., (1998) "Scatterplots and scenes: visualization techniques for exploratory spatial analysis", Computers, Environment and Urban Systems, 22(1), 43-56. Gahegan, M., Takatsuka, M., Wheeler, M., and Hardisty, F., (2002a) "GeoVISTA Studio: a geocomputational workbench", Computers, Environment and Urban Systems, 26, 267-292. Gahegan, M., Takatsuka, M., Wheeler, M., and Hardisty, F., (2002b) "Introducing GeoVISTA Studio: an integrated suite of visualization and computational methods for exploration and knowledge construction in geography", Computers, Environment and Urban Systems, 26(4), 267-292. Geisler, G., (2003) Making information more accessible: A survey of information, visualization applications and techniques. Online: http://www.ils.unc.edu/geisg/info/infovis/paper.html (01/02/03). Goldstein, J., and Roth, S. F., (1994) "Using aggregation and dynamic queries for exploring large data sets", Proceedings Human Factors in Computing Systems CHI'94 Conference, Boston, MA, pp. 23-29. Gusein-Zade, S., and Tikunov, V., (1995) "Map transformations", Geography Review, 9(1), 19-23. Han, J., and Kamber, M., (1986) Data Mining: Concepts and Techniques. Morgan Kaufman. Havre, S., Hetzler, B., Nowell, L., (2000) "ThemeRiver: visualizing theme changes over time", Proceedings of lEEE Symposium on Information Visualization, InfoVis 2000, Salt Lake City, Utah, October 9-10, 2000, pp. 115-123. Hearst, M., (1995) "TileBars: visualization of term distribution information in full text information access", Proceedings of A CM Human Factors in Computing Systems Conference (CHI'95), pp. 59-66. Huber, P. J., (1985) "The annals of statistics", Projection Pursuit, 13(2), 435-474. Ihaka, R., and Gentleman, R., (1996) "R: a language for data analysis and graphics", Journal of Computational and Graphical Statistics, 5(3), 299-314. Inselberg, A., and Dimsdale, B., (1990) "Parallel coordinates: a tool for visualizing multi-dimensional geometry", Proceedings Visualization 90, San Francisco, CA, pp. 361-370. Johannsen, A., and Moorhead, R. J., (1995) "AGP: ocean model flow visualization", IEEE Computer Graphics and Applications, 15(4), 28-33.
Scope, Techniques and Opportunities for Geovisualization
49
Johnson, B., and Shneiderman, B., (1991) "Tree-maps: a space-filling approach to the visualization of hierarchical information structures", Proceedings IEEE Visualization'91, Piscataway, NJ: IEEE, pp. 284-291. Keahey, T. A., (1998) "The generalized detail-in-context problem", Proceedings IEEE Visualization. Keim, D. A., (2000) "Designing pixel-oriented visualization techniques: theory and applications", IEEE Transactions on Visualization and Computer Graphics (TVCG), 6(1), 59-78, (January-March 2000). Keim, D. A., (2001) "Visual exploration of large data sets", Communications of the ACM (CA CM), 44(8), 38-44. Keim, D.A. and Herrmann, A., (1998) "The gridfit algorithm: an efficient and effective approach to visualizing large amounts of spatial data", IEEE Visualization '98. Research Triangle Park, NC: IEEE Press, pp. 181-188. Keim, D. A., and Kriegel, H.-P., (1994) "VisDB: database exploration using multidimensional visualization", Computer Graphics & Applications, 6, 40-49. Keim, D. A., and Kriegel, H.-P., (1995) "Issues in visualizing large databases", Proceedings Conference on Visual Database Systems (VDB'95). Lausanne: Schweiz, pp. 203-214. Keim, D., Bergeron, D., and Pickett, R., (1995a) "Test data sets for evaluating data visualization techniques", Perceptual Issues in Visualization. Springer, pp. 9-21. Keim, D. A., Kriegel, H. P., and Ankerst, M., (1995b) "Recursive pattern: a technique for visualizing very large amounts of data", Proceedings Visualization 95, Atlanta, GA, pp. 279-286. Keim, D. A., Koutsofios, E., and North, S. C., (1999) "Visual exploration of large telecommunication data sets", Proceedings Workshop on User Interfaces In Data Intensive Systems (Invited Talk), Edinburgh, UK, pp. 12-20. Keim, D. A., North, S. C., and Panse, C., (2003a) "CartoDraw: a fast algorithm for generating contiguous cartograms", Transaction on Visualization and Computer Graphics. Keim, D. A., North, S. C., Panse, C., and Schneidewind, J., (2003b) "Visualizing geographic information: VisualPoints vs CartoDraw", Palgrave Macmillan Information Visualization, 2(1), 58-67, (March 2003). Keim, D. A., North, S. C., Panse, C. and Sips, M., (2003c) PixelMaps: a new visual data mining approach for analyzing large spatial data sets. Florham Park: Information Visualization Research Group, AT&T Laboratories, (Dez 2003). Online: http://dbvis.fmi.uni-konstanz.de/sips/papers/03/KNPS03_TECHREPORT.pdf Keim, D. A., Panse, C., and Sips, M., (2003) "Visual data mining of large spatial data sets", 3rd Workshop on Databases in Networked Information Systems, Aizu, Japan. Kocmoud, C. J., and House, D. H., (1998) "Continuous cartogram construction", Proceedings IEEE Visualization, pp. 197-204. Kreuseler, N. L. M., Lopez, N., and Schumann, H., (2001) "A scalable framework for Information Visualization", Proceedings of IEEE Symposium on Information Visualization, InfoVis 2000, Salt Lake City, Utah, October 9-10, 2000. IEEE Press, pp. 27-38.
50
D.A. Keim, C. Panse & M. Sips
Lamping, J., Rao, R., and Pirolli, P., (1995) "A focus + context technique based on hyperbolic geometry for visualizing large hierarchies", Proceedings of CHI'95 Human Factors in Computing Systems, Denver, CO, May 1995. New York: ACM Press, pp. 401-408. LeBlanc, J., Ward, M. O., and Wittels, N., (1990) "Exploring N-dimensional databases", Proceedings Visualization'90, San Francisco, CA, pp. 230-239. Leung, Y., and Apperley, M., (1994) "A review and taxonomy of distortion-oriented presentation techniques", Proceedings Human Factors in Computing Systems CHI'94 Conference, Boston, MA, pp. 126-160. Levkowitz, H., (1991) "Color icons: merging color and texture perception for integrated visualization of multiple parameters", Proceedings Visualization 91, San Diego, CA, pp. 22-25. MacEachren, A.M., (2003) Conditioned choropleth mapping systemproject: conditioned choropleth maps: dynamic multivariate representations of statistical data. Online: http://www.geovista.psu.edu/grants/dg-qg/CCmaps/(June 2003). MacEachren, A. M., Dai, X., Hardisty, F., Guo, D., and Lengerich, G., (2003a) "Exploring high-D spaces with multiform matrices and small multiples", International Symposium on Information Visualization, Seattle, pp. 31-38. MacEachren, A. M., Hardisty, F., Dai, X., and Pickle, L., (2003b) "Geospatial statistics supporting visual analysis of federal geospatial statistics", Digital Government Table of Contents, pp. 59-60. Mackinlay, J. D., Robertson, G. G., and Card, S. K., (1991) "The perspective wall: detail and context smoothly integrated", Proceedings Human Factors in Computing Systems CHI'91 Conference, New Orleans, LA, pp. 173-179. Marshall, R. E., Kempf, J. L., Scott Dyer, D. and Yen, C. C., (1987) "Visualization methods and simulation steering for a 3D turbulence model of Lake Erie", Symposium on Interactive 3D Graphics, Computer Graphics, pp. 89-97. Monmonier, M., (1989) "Geographic brushing: enhancing exploratory analysis of the scatterplot matrix", Geographical Analysis, 21 (1), 81-84. Munzner, T., and Burchard, P., (1995) "Visualizing the structure of the World Wide Web in 3D hyperbolic space", Proceedings VRML'95 Symposium, Special Issue of Computer Graphics, ACM SIGGRAPH, San Diego, CA, pp. 33-38. Perlin, K. and Fox, D., (1993) "Pad: an alternative approach to the computer interface", In: Kajiya, J. T., (ed.), Proceedings of the 20th Annual A CM Conference on Computer Graphics (SIGGRAPH '93), Anaheim, CA: ACM Press, pp. 57-64. (Aug. 2-6). Pickett, R. M., and Grinstein, G. G., (1988) "Iconographic displays for visualizing multidimensional data", Proceedings IEEE Conferene on Systems, Man and Cybernetics, Piscataway, NJ: IEEE Press, pp. 514-519. Raisz, E., (1962) Principles of Cartography. London: McGraw-Hill, pp. 215-221. Rao, R., and Card, S. K., (1994) "The table lens: merging graphical and symbolic representation in an interactive focus + context visualization for tabular information", Proceedings Human Factors in Computing Systems CHI 94 Conference, Boston, MA. New York: ACM, pp. 318-322.
Scope, Techniques and Opportunities for Geovisualization
51
Robertson, G. G., Mackinlay, J. D., and Card, S. K., (1991) "Cone trees: animated {3D} visualizations of hierarchical information", Proceedings Human Factors in Computing Systems CHI 91 Conference, New Orleans, LA, pp. 189-194. Sarkar, M., and Brown, M., (1994) "Graphical fisheye views", Communications of the ACM, 37(12), 73-84. Schaffer, D., Zuo, Z., Bartram, L., Dill J., Dubs, S., Greenberg, S., and Roseman, M., (1993) "Comparing fisheye and full-zoom techniques for navigation of hierarchically clustered networks", Proceedings Graphics Interface (GI'93) Canadian Information Processing Society. Toronto, Ontario: Graphics Press, pp. 87-96. Schumann, H., and Mfiller, W., (2000) Visualisierung: Grundlagen und Allgemeine Methoden. Berlin: Springer Verlag. Shneiderman, B., (1992)"Tree visualization with Treemaps: a {2D} space-filling approach", A CM Transactions on Graphics, 11 (1), 92-99. Shneiderman, B., (1996) "The eyes have it: a task by data type taxonomy for Information Visualizations", Proceedings IEEE Symposium on Visual Languages. Washington: IEEE Computer Society Press, pp. 336-343. Silicon Graphics Inc., (2002). SGI - Products: Software: MineSet Update. Online: http://www.sgi.com/software/mineset.html (01/02/02). Spence, R., (2001) Information Visualization. Harlow: Addison-Wesley/ACM Press Books, 206 pp. Spence, R., and Apperley, M., (1982) "Data base navigation: an office environment for the professional", Behaviour and Information Technology, 1(1), 43-54. Spence, R., Tweedie, L., Dawkes, H., and Su, H., (1995) "Visualization for functional design", Proceedings International Symposium on Information Visualization (InfoVis'95), pp. 4-10. Spoerri, A., (1993) "InfoCrystal: a visual tool for information retrieval", Proceedings Visualization'93, San Jose, CA, pp. 150-157. Stasko, J. T., Domingue, J. B., Brown, M. H., and Price, B. A., (eds.), (1998) Software Visualization. Cambridge, MA: MIT Press. Stolte, C., Tang, D., and Hanrahan, P., (2001) "Polaris: a system for query, analysis and visualization of multi-dimensional relational databases", Transactions on Visualization and Computer Graphics. Swayne, D. F., Cook, D., and Buja, A., (1992) "XGobi: interactive dynamic data visualization in the X Window System", Journal of Computational and Graphical Statistics, 7 (1), 113-130. Tierney, L., (1991) LispStat: An Object-Orientated Environment for Statistical Computing and Dynamic Graphics. New York: Wiley. Tobler, W. R., (1976) "Cartograms and cartosplines", Proceedings of the 1976 Workshop on Automated Cartography and Epidemiology, Washington, District of Columbia, pp. 53-58. van Wijk, J. J., and van Liere, R. D., (1993) "Hyperslice", Visualization'93, San Jose, CA, pp. 119-125.
52
D.A. Keim, C. Panse & M. Sips
Velleman, P. F., (1997) Learning Data Analysis with DATA DESK 5.0. New York: Addison-Wesley. Ward, M., (1994) "XmdvTool: integrating multiple methods for visualizing multivariate data", Proceedings Visualization'94. Washington: IEEE Computer Society Press, pp. 326-333. Ware, C., (2000) Information Visualization: Perception for Design. San Francisco: Morgan Kaufmann Publishers, p. 384. Wilhelm, A., Unwin, A. R., and Theus, M., (1995) "Software for interactive statistical graphics - a review", Proceedings Int. Softstat 95 Conference Heidelberg, Germany.
Exploring Geovisualization J. Dykes, A.M. MacEachren, M.-J. Kraak (Editors) 9 2005 Elsevier Ltd. All rights reserved.
Chapter 3
Information Visualization and the Challenge of Universal Usability Catherine Plaisant, Human-Computer Interaction Laboratory, University of Maryland, HCIL/UMIACS A.V. Williams Building, College Park, MD 20782, USA
Keywords: Information Visualization, user interface, universal usability, blind users, help
Abstract Information Visualization aims to provide compact graphical presentations and user interfaces for interactively manipulating large numbers of items. We present a simple "data by tasks taxonomy" then discuss the challenges of providing universal usability, with example applications using geo-referenced data. Information Visualization has been shown to be a powerful visual thinking or decision tool but it is becoming important for services to reach and empower every citizen. Technological advances are needed to deal with user diversity (age, language, disabilities, etc.) but also with the variety of technology used (screen size, network speed, etc.) and the gaps in user's knowledge (general knowledge, knowledge of the application domain, of the interface syntax or semantic). We present examples that illustrate how those challenges can be addressed.
3.1
Introduction "If a picture is worth a thousand words, then an interface is worth a thousand pictures." (Shneiderman, 2001)
Designers are discovering how to use rapid and high-resolution color displays to present and manipulate large amounts of information in compact and user-controlled ways. Information Visualization can be defined as the use of computer-supported interactive visual representation of abstract data to amplify cognition (Card et al., 1999). The abstract characteristic of the data is what distinguishes Information Visualization from scientific visualization. Information Visualization is more likely to be used to display database content (for example, recorded stock values, health statistics) than output of models or simulations, but this distinction is not always important. The display of geo-referenced data is often a hybrid visualization that combines abstract and concrete data. In fact several of the most famous examples of Information Visualization 53
54
C. Plaisant
include maps, from the 1861 representation of the ill-fated Napoleon' s Russian campaign by Minard (see Tufte (1983) and Kraak (undated)) to the interactive HomeFinder application shown in Figure 3.1 that introduced the concept of dynamic queries (Ahlberg et al., 1992). Information Visualization aims to provide compact graphical presentations and user interfaces for interactively manipulating large numbers of items (102-106), possibly extracted from far larger datasets (Card et al., 1999; Spence, 2001; Ware, 2000; Chen, 2002; Bederson and Shneiderman, 2003). Also sometimes called visual datamining, it uses the enormous visual bandwidth and the remarkable human visual system to enable users to make discoveries, take decisions, or propose explanations about patterns, groups of items, or individual items. Perceptual psychologists, statisticians, and graphic designers (Tufte, 1983) offer valuable advice about presenting static information, but advances in processor speed, graphic devices and dynamic displays takes user-interface designers well beyond current wisdom.
Figure 3.1. The HomeFinder. Houses for sale appear as yellow dots on a stylized map of Washington DC. As users adjust sliders and click on buttons to set their search criteria immediate feedback (within 10 ms) is provided on the map showing the houses that match the query, and allowing users to pose hundreds of queries in a few seconds and rapidly explore the dataset.
Information Visualization and the Challenge of Universal Usability
55
This chapter presents a simple "data by tasks taxonomy" then discusses the challenges of providing "universal usability", with example applications using georeferenced data.
3.2
Data by Task Taxonomy
This data by tasks taxonomy includes seven basic data types and seven basic tasks (Shneiderman, 1998). The data being explored are usually multi-dimensional but most designs highlight 1, 2 or 3D that are used to define the general visual structure of the visualization. The taxonomy is organized based on those selected dimensions. This simplification is useful to describe the visualizations that have been developed and to characterize the types of problems that users encounter when using those visualizations. Examples were chosen to complement those provided by Keim et al., this volume (Chapter 2) in which a more comprehensive taxonomy for visualization of highdimensional data is the primary focus.
3.2.1
Data types
1- 2- or 3D data: Linear data types (1D) include lists, documents, program source code, and the like that are organized sequentially. Interface-design issues include what overview, scrolling, or selection methods can be used. User tasks might be to find the number of items or to see items that exhibit certain attributes (Eick et al., 1992). Planar data (2D) can be represented by geographic maps, floor plans, and newspaper layouts. User tasks are to find adjacent items, containing items and paths between items, and to perform the seven basic tasks (see below). Real-world 3D objects such as the human body or buildings have volumetric elements and connections with other elements. Users' tasks deal with adjacency plus above-below and inside-outside relationships. In 3D applications, users must understand and control their position and orientation when viewing the objects, and must be able to compensate for the serious problems of occlusion. While many examples of successful 3D computer graphics and scientific visualizations exist (Nielson et al., 1997) there are still very few Information Visualization examples in three (abstract) dimensions. Designers have used 3D representations to present attractive overviews of data that was not intrinsically 3D, such as sets of documents, as shown in Figure 3.2 (Wise et al., 1995). But controlled experiments trying to measure the benefits of 3D in such conditions have had mixed results (Cockburn and McKenzie, 2002). These mixed results complement similar findings from earlier cartographic experiments and related efforts to assess use of the third dimension to depict non-spatial attributes on maps (Kraak, 1989; Dorling, 1992) Temporal data: Time series are very common and merit a data type that is separate from 1D data. The distinctions are that items have a start and finish time, and may overlap. Timelines have been widely used, from the line plots used by Minard (see Tufte, 1983) to summaries of heterogeneous data such as LifeLines, as shown in Figure 3.3 (Plaisant et al., 1996). Frequent tasks include finding all events before, after, or during some time period or moment, and in some cases comparing periodical phenomena (Carlis and Konstan, 1998). Space-time data have also been a focus
56
C. Plaisant
Figure 3.2. ThemesViewTM (formally ThemeScape) shows a 3D map representing the results of a search in a large corpus of documents. Proximity indicates similarity of the topics, whilst height reflects the number of documents and frequency of terms. Commercial applications also exist (OmniViz Inc, 2003) Reproduced with permission of Pacific Northwest National Laboratory.
Figure 3.3. LifeLines present a summary of personal records (here a medical record), showing several facets of the records and using line thickness and color to map data attributes on the display.
Information Visualization and the Challenge of Universal Usability
57
of attention in geovisualization for more than a decade (Szego, 1987; DiBiase et al., 1992; Kraak and MacEachren, 1994; Kwan, 2000) and some recent advances are discussed by Andrienko et al., this volume (Chapter 10). Multi-dimensional data: Most relational- and statistical-database contents are conveniently manipulated as multi-dimensional data, in which items with n attributes become points in an n-dimensional space. The interface representation can be dynamic 2D scattergrams (possibly a map, as is the case in Figure 3.1) with each additional dimension controlled by a slider or button using dynamic queries (Ahlberg et al., 1992). A 3D scattergram is possible, but disorientation and occlusion are severe problems. Parallel coordinates plots (Inselberg, 1985) are one of the few truly multi-dimensional techniques and have been shown to be a powerful analysis tool. Familiarity, training and practice in using the technique will help a user become a "multi-dimensional detective" (Inselberg, 1997). Less powerful but more accessible to novice users is the Table Lens (Rao and Card, 1994; Inxight Software Inc., 2002), which uses a spreadsheet metaphor. Other examples include VisDB for multi-dimensional database visualization (Keim and Kriegel, 1994), interactive mosaic displays (Friendly, 1994; Theus, 2002a,b), the Attribute Explorer (Tweedie et al., 1996) and the scatter plot or prosection matrices of Becker and Cleveland (1987). Interactive geovisualization software also utilizes multidimensional visualization techniques (Andrienko and Andrienko, 1999a-f; Gahegan et al., 2002a,b; MacEachren et al., 2003a,b) as emphasized in section B of this volume (see Andrienko et al., this volume (Chapter 5) and subsequent chapters). Hierarchical data: Hierarchies or tree structures are collections of items, in which each item (except the root) has a link to one parent item. Examples include taxonomies, file structures, organization charts and disease classifications. Items and the links between parent and child can have multiple attributes. Tasks can be topological (for example, a query asking which branch of the company has more employees?) or attribute based (such as an attempt to find the largest old files on a hard disk). Interface representations of trees can use the outline style of indented labels used in tables of contents, node-and-link diagrams. Examples include the Hyperbolic tree (Lamping et al., 1995) commercialized by Inxight Software Inc (2002) or SpaceTree (Plaisant et al., 2002; Grosjean et al., 2002). A third possibility is to use a space filling representation such as Treemap (Johnson and Shneiderman, 1991; Bederson et al., 2002) as shown in Figure 3.4. A number of commercial applications of the Treemi~p technique are available including Shneiderman (1998), the Map of the Market (SmartMoney.com, 2003) or e-business (The Hive Group Inc., 2003). Network data: When relationships among items cannot be captured conveniently with a regular tree structure, items are linked to an arbitrary number of other items in a network. In addition to performing the basic tasks applied to items and links, network users often want to know about shortest or least costly paths connecting two items or traversing the entire network. Common representations include node-andlink diagrams (but layout algorithms are often so complex that user interaction remains limited for large networks), and square matrices of items with the value of a link attribute in the row and column representing a link. Network visualization is an old but still imperfect art because of the complexity of relationships and user tasks, for example,
58
C. Plaisant
Figure 3.4. An example of Treemap is the Map of the Market (SmartMoney.com, 2003). Rectangles each represent a stock and are organized by industry groups. The rectangle size is proportional to the market capitalization and the color indicates the percentage gain or loss for the given time period. Reproduced with permission of SmartMoney.com.
Figure 3.5. Dynamic labeling of items is still a challenge. Here Excentric Labels in incMap show the labels of all the items inside the focus circle, revealing hidden items and allowing their selection. Reproduced with permission of N Space Labs, Inc. (http://www.incmap.com).
Information Visualization and the Challenge of Universal Usability
59
(see Rodgers, this volume (Chapter 7)). It is used in a number of useful geographic applications and is being incorporated into software for geovisualization, for examples, (see Mountain, this volume (Chapter 9)) and Fairbairn, this volume (Chapter 26).
3.2.2
High-level task types
Having considered the range of data types available along with some methods that have been developed for graphically representing them, we can consider a number of highlevel tasks that apply to all data types Overview task: Gaining an overview of the data might include gauging the number of items and the range and distribution of the attribute values, or estimating how much things have changed since last time the user reviewed the data. Overview strategies include zoomed-out views adjoining the detail views, for example, (see Ware and Plumlee, this volume (Chapter 29)). A movable field-of-view box can be used to control the contents of the detail view. Intermediate views allow larger zoom factors. Another popular approach is the fisheye strategy originally described by Furnas (1986). It provides overview and details in a single combined view by using distortion based on a degree of interest function. It is effective when zoom factors are small and deformation is acceptable to users (for example, when orientation and distance measurement are not important). Zoom task: Users need to control the zoom focus and the zoom factor. Smooth zooming helps users to preserve their sense of position and context. Manual zooming is powerful but users tend to get lost so application-controlled zooming to preset levels is more likely to be usable, for example, see Ware and Plumlee, this volume (Chapter 29). Pad-+-+, now called Picolo is a popular zooming user interface toolkit that uses semantic zooming (Bederson, 1994; Bederson et al., 2000). Semantic zooming (Perlin and Fox, 1993) is commonly used with maps, where the same area can be displayed with different features and amount of details at different zoom ratios. There are key parallels with real time cartographic generalization here (Weibel and Jones, 1998). Constant density zooming (Woodruff et al., 1998) is an example of technique to maximize the number and readability of items on the display. Wood, this volume (Chapter 15) uses mipmapping to display surface characteristics according to the scale at which any part of a surface is viewed in a real-time 3D application and D611ner, this volume (Chapter 16) identifies some associated issues in computer graphics. Filter task: Dynamic queries allow users to quickly focus on their interests by eliminating unwanted items. Other techniques include sorting, grouping or highlighting followed by hiding, or locating items similar to an item of interest. Theus, this volume (Chapter 6) provides some examples of "selection" from the perspective of statistical graphics. Details-on-demand task: Once a collection has been trimmed, users need to review the details of single items or groups. The usual approach is to simply click on an item and review details in a separate or popup window. Dynamic labeling remains an important challenge. Excentric labeling (Fekete and Plaisant, 1999) is an approach
60
C. Plaisant
illustrated in Figure 3.5 through the Geographic Map of the Market in which geovisualization techniques and those of Information Visualization are integrated (N Space Labs Inc., 2003). Relate task: Users need to view relationships between items, as is the case with the LifeLines shown in Figure 3.3, where users can click on a medication and see the related visit report, prescriptions, and laboratory test results. Linking and brushing techniques (Cleveland, 1994) and the Influence Explorer (Tweedie et al., 1996) emphasize the exploration of relationships. Many applications combine multiple visualization techniques that are tightly coupled (for example, (see Roberts, this volume (Chapter 8))). This is a key strength of visualization tools, and a number of chapters in this publication demonstrate examples, particularly those concerned with "Creating Instruments for Ideation" (for example, (see Andrienko et al., this volume (Chapter 5))). Various tools are being developed in various academic and application domains to allow users to specify the visualizations they need and how the interaction between the visualizations should be controlled (North et al., 2002). History task: It is rare that a single user action produces the desired outcome. Keeping the history of actions allows users to retrace their steps, save useful exploration "recipes" and apply them to updated datasets later on. Roberts, this volume (Chapter 8) considers these issues at an operational level and Gahegan, this volume (Chapter 4) addresses the conceptual, scientific and motivational challenges that underlie support for saving and sharing entire analysis strategies. Extract and Report task: Users often need to save subsets of the data or particular views of the data into reports. They may also want to publish "cleansed" data with a simplified subset of the tool's features for others to review.
3.3
The Coming of Age of Information Visualization - Toward Universal Usability
Although maps have been used for hundreds of years, it is important to realize that most Information Visualization techniques are very recent and, if we exclude elementary tools such as pie or bar charts, these tools have mostly been used by researchers, data analysts and experts. Only recently have we seen novel designs become widely used by the public. Researchers recognize that there is no "one size fits all" visualization and that specialized techniques are needed to tackle special data (for example, genomic data or spatio-temporal data) as well as special user needs (such as collaborative analysis or real time monitoring). Two general challenges need to be faced by Information Visualization before we can anticipate more widespread uptake of many of the techniques that have been developed: the ability to handle larger volumes of data and the ability to effectively support more diverse users. The first challenge relates to the limited number of items most tools available can manage. Many innovative prototypes can only deal with a hundred or a thousand items, or have difficulties maintaining real time interactivity when dealing with larger numbers. Yet examples dealing with millions of items without aggregation have been achieved as shown in Figure 3.6 (Fekete and Plaisant, 2002). Keim
P, i
a -
,T-
-.)+-----
. : I . --..
Figure3.6. A Treemap displaying a million files from a large file system, without aggregation (Fekete and Plaisant, 2002). Careful examination of the high resolution display reveals patterns and special algorithms preserve the interactivity of the rich overviews and filtering tools.
R
R
62
C. Plaisant
et al. (2001) demonstrate that Information Visualization is not yet close to reaching the limits of human visual abilities but that new techniques are needed to tackle the large quantities of information. Keim et al., this volume (Chapter 2) provide an overview and some additional solutions. Dealing with real data also involves data cleansing or dealing with missing and uncertain values. The second challenge is focused on more specifically here: how do we make Information Visualization accessible to a wider group of diverse users? In fact a growing number of applications are being developed for what might be the most challenging user group - the general public. Let us take the example of the enormous amounts of georeferenced data accumulated by government agencies and to be made available to every citizen. These data are useful to senior citizens looking for a place to settle after retirement, business analysts, managers considering relocation, etc. They can also be useful to drivers on the road and researchers working on complex tasks on their high-end computer workstations. To address the problem of universal usability (Shneiderman, 2000; Shneiderman and Hochheiser, 2001), designers need to consider larger and more diverse groups of users. Technological advances are needed not only to deal with user diversity (age, language, disabilities, etc.) but also with the variety of technology used (screen size, network speed, platform, etc.) and any specific gaps in a user' s knowledge (e.g., general knowledge, knowledge of the application domain, of the interface syntax or semantic). Information Visualization has been shown to be a powerful visual thinking or decision tool for some average users receiving a minimum of training (Williamson and Shneiderman, 1992; Lindwarm et al., 1998; Chen and Czerwinski, 2000). But it is becoming important for services to reach and empower every citizen regardless of their background, technical disadvantages or personal disabilities. Universal usability is an ambitious long-term goal but many practical steps can be taken toward achieving it. Focusing on this problem will most likely lead to better technologies for everyone (simpler interfaces, faster downloads, etc). Several examples are reviewed below that illustrate how projects have addressed different aspects of the universal usability challenge.
3.3.1
Improving general usability
Of course the first step is to improve the general usability of the interface. Many texts are available to guide designers toward the creation of empowering user interfaces (Shneiderman, 1997; Preece et al., 2002). Usability testing can then verify that user needs and usability goals have been met and that users are able to use the system on their own with a sense of control and satisfaction (Dumas and Redish, 1999; Kuniavsky, 2003). Specific guidelines for map design are also available (Pickle, 2003) and Tob6n, this volume (Chapter 34) draws upon the usability approach to assess geovisualization map use, for example, (see also Fuhrmann et al., this volume (Chapter 28)). The success of the Map of the Market (Figure 3.4) illustrates that general techniques initially described as "difficult to understand" (i.e., Treemap) can become accessible interfaces. The popularity of this application with the general public might be attributed in part to the fact that the data is familiar, and important, to users who visit
Information Visualization and the Challenge of Universal Usability
63
a financial website. The careful simplification and refinement of the initial Treemap interface also plays a part. The names and groupings of stocks are familiar to users of the SmartMoney Website. The hierarchy is simple, being shallow and of fixed depth, and the color mapping is natural to most users (using green for gains or increased values of the stocks, red for losses, with alternative colors for those with color impairment). An elegant new algorithm has recently resulted in a better aspect ratio for all the rectangles making the display more readable and pleasing. Labeling and links to details were optimized for the particular application. Finally it was carefully written in lightweight Java so that it could actually run on most users' machines without having to download special plugins or worry about Java versioning. This combination of factors has been effective in making the map usable by the general public, as indicated by the large number of return users the Website enjoys.
3.3.2
Helping users get started
Designers need to consider whether their application is to be used by first-time users or by experts who will have invested time and effort into learning the application. A major aspect of accessibility is concerned with enabling users to get started with an application (Andrienko et al., 2002). Even the average professional analyst or researcher may need help, but a major challenge is to help ordinary citizens use Information Visualization applications successfully. Commercial Web sites can decide which population they target but Digital government applications might well be faced by the greatest challenge since they are supposed to be usable by everyone! This implies that most information consumers will be first time users and also that they will have very varied backgrounds and levels of education. They may also have limited time or interest in learning to use the system, but paradoxically may have very high expectations of the services they seek to use. Users want an answer to their question, not necessarily to learn all that a tool can do for them. Let us consider a particular example, that of DataMap (Plaisant, 1993), which was previously named Dynamap or Ymap. Dang et al. (2001) review three approaches that were explored to help users get started with the DataMap interface. DataMap (Figure 3.7) is an interactive visualization tool developed by our Human-Computer Interaction Laboratory at the University of Maryland and is scheduled to be released by the US Census Bureau on CDs and later on the Web. Users can click on a map of the US to display facts about the areas, select multiple areas to compare, zoom on the map or use dynamic queries to filter the map according to a list of criteria. Finally, they can use a scatter plot, tightly coupled to the map and table, to see relationships between two criteria. Our numerous demonstrations and tests in the lab had made us confident that average users could understand and use DataMap after a minute of two of demonstration, but usability tests at the Census Bureau with novice "off-the-street" users receiving no training revealed that many users had difficulties getting started. Some would struggle with certain details of the interface, while others would simply dismiss the interface saying, "It' s just too complicated". They had problems not only zooming and selecting multiple regions but also with the sliders. The problems ranged from recognizing that one could move the slider thumbs to understanding what the animation meant. Several users were even puzzled
64
C. Plaisant
Figure 3.7. (a) DataMap allows users to zoom on a state or county map, select areas or filter them out with dynamic queries. A tightly coupled scatter plot provides an alternative to compare areas. (b) The revised interface (reproduced with permission of Chris North, Virginia Tech).
Information Visualization and the Challenge of Universal Usability
65
by the interactive scatter plot, some not guessing that dots represented regions and some not knowing how to read a scatter plot at all. The first step was to revise the interface. This was done by a team of colleagues at Virginia Tech led by Chris North and is illustrated in Figure 3.7b. Most problems found in the usability study led to refinements of the interface. This resulted in a number of changes including: reducing the number of attribute sliders with the possibility of adding more with a control panel; making slider thumbs easier to recognize and use; limiting zooming to avoid zooming into empty areas; simplifying window resizing; using an appropriate projection for the map; using fonts consistently and selecting more readable typefaces; using color coding to show the relationship between the sliders position and the parts of the map highlighted or hidden. Some aspects of the interfaces still needed explanations. Since DataMap is meant for public access, it was clear that users would be unlikely to read manuals or go through long tutorials, so we explored alternative approaches to providing help (Plaisant et al., 2003.) We considered three approaches. The first approach is to create a multi-layered design that provides a simpler interface to get started, while complex features are accessed progressively as users move through the layers of the interface. The second approach is called Integrated Initial Guidance (IIG) or "sticky note help". It provides help within the working interface, right at the start of the application. Using the metaphor of sticky notes overlaid on top of the functional interface it locates the main widgets, demonstrates their manipulation, and explains the resulting actions by replaying recorded sets of actions. The third approach uses video demonstrations of the interface. The videos use sound and entirely overlap the interface to give the illusion of being integrated in the interface. 1
Approach 1" multi-layered designs Some applications might be suited for a multi-layer design that allows users to start with a simple interface with limited views on information and choices to make and then to move to more complex (and more functional) levels once the basic functions are understood. This is the case for DataMap, which can easily be organized in a three-layer design (Figure 3.8): 9 9 9
layer 1: map and table only; layer 2: map and table, plus dynamic query filters; layer 3: map and table and dynamic query, plus scatter plot.
The interface initial view hides level 2 and level 3 functionality. When users go up one level, the appropriate parts of the interface are added with an animated transition, which help users see what is changing. Multi-layered interfaces, termed "level-structured interfaces" when introduced to Information Visualization (Shneiderman, 1998), are commonly encountered in hardware devices like VCRs that hide advanced function buttons and controls behind a small door, or in search interfaces that often provide a Note that this workon Help was done in parallel with Chris North's workon the revisionof the interface, so the help techniques are shown on the old interface. Those two projects will be merged eventually.
66
C. Plaisant
Figure 3.8. Three different levels of the level structured approach. (a) the first level shows only the map and the data table; (b) second level shows slider bar along with map and table; (c) the third level adds scatter plot. An introduction panel lists the features of the level and indicates the location of the three level buttons.
Information Visualization and the Challenge of Universal Usability
67
simple and advanced search. This approach has been underused in software applications and could be generalized easily. The benefits are that users can get started more easily. The risk is that some users will never discover the advanced features they do not know are there.
Approach 2: integrated initial guidance or "sticky note help" IIG implements a metaphor of sticky notes inside the interface itself, thereby allowing users to use the interface or run automated demonstrations while reading the sticky notes overlaid on the functional interface (Figure 3.9). Sticky notes highlight the main functions of the interface, show the location of the main interface widgets whose use can be demonstrated and explained with a "show me" button, and provide lists of simple to complex example tasks which lead to demonstrations of advanced interface widget functions. This allows users to make use of the help in many different ways. Some users will try out all the example tasks, while others may never use any. Some users will
Figure 3.9. Using sticky notes. (a) Three IIG sticky notes lead to explanations of how to use the map, zoom, select multiple states and move to the next level. Example tasks are listed in the note at the top right. (b) The first example task was chosen. "Compare the populations of three west coast states". The next steps are shown in transparency until the user executes the current one, or asks to see an automated "show me" demonstration.
68
C. Plaisant
use the show me feature while others will execute the steps themselves, guided by the directions on the sticky notes and using the show me function only when they failed to guess what to do.
Approach 3: autonomous video or animated demonstrations Video demonstrations are used increasingly to introduce the main features of complex visual interfaces. They can be launched from the application but are really run outside the interface itself. Macromedia Flash can be used to create demonstrations but simple recording tools (such as Camtasia Studio from TechSmith) are useful to create video explanations in a matter of hours. Effectiveness is increased by the use of speech, which leads to more compact explanations and lively demonstrations (but subtitles will be needed to accommodate users with hearing difficulties). Highlighting the mouse cursor and making mouse clicks or key presses visible is important. Low-resolution videos can be effective and fast to download but we found that videos that entirely cover the interface give users the impression that they are watching the real interface, therefore reducing the transfer of learning to the interface. Of these three different approaches, the sticky note technique was found very effective during informal user testing but it was fairly difficult to design and build. On the other hand, the video demonstrations were easier to create and fairly effective when kept short and mapped in direct ways to users tasks. The multi-layered approach was appreciated by the majority of our test users and might be the most powerful approach to helping users get started with complex public access applications, as long as care is given to guide users to the advanced levels.
3.3.3
Addressing the hardware diversity
Because programmers and development teams usually work with high-end equipment and fast network connections it is important to address the range of devices and network speed available in people's homes and businesses when producing visualization software for public access. Issues may vary from application to application so we only give an example illustrating how addressing hardware problems does not necessarily result in a "lowest common denominator" application but can benefit everyone. Let us consider the example of DataMap once again. The Java version of DataMap loaded and ran quickly enough on standard PCs and broadband connections but - as with other interactive map tools - would take minutes to download with a 56K modem and could not maintain the interactivity needed for dynamic queries (i.e., 10 ms feedback) on low-end PCs. Traditionally, interactive maps use vector graphics to draw the maps which means downloading the vector data and the software to interpret it. Instead, we created a new version of DataMap that encoded geographic knowledge into raster images quickly delivered to the client (Zhao et al., 2003). Algorithms were devised to perform sub-second dynamic query, panning and zooming, with no or minimum server support. This technique leads to download times that were often counted in seconds instead of minutes for modem users, being between 5 and 10 times shorter that those experienced with Web GIS approaches that are based on vector geographic data, while
Information Visualization and the Challenge of Universal Usability
69
keeping the needed interactivity. The client-side was also implemented as light-weight Java applets to avoid version problems. This example illustrates that it is possible to find technological advances that benefit general public users with slow modem network connections and low-end machines, as well as users with fast T-1 connections and fast machines, therefore advancing the goals of Universal Usability.
3.3.4
Addressing the needs of users with visual impairments
Color blindness Color impairment is a very common condition that should not be overlooked (Rosenthal and Phillips, 1997; Olson and Brewer, 1997) This problem can more easily be addressed by limiting the use of color, using double encoding when appropriate (for example, by using symbols that vary in both shape and color), providing alternative color palettes to choose from, or allowing users to customize the colors themselves. For example the Mapof-the-Market illustrated in Figure 3.4 provides two choices of color schemes: red-green and blue-yellow. Various tools are available to both simulate color vision impairments and to optimize graphics for some of the various forms of color impairment that exist, including Vischeck (Dougherty and Wade, 2002). ColorBrewer (Brewer and Harrower, 2002) offers guidelines on color schemes that work for those with color vision impairment.
Low Vision and blindness Approximately four million people in the US are blind or visually impaired and it is a requirement for government-provided services to address this population (Vanderheiden, 2000; Muntz et al., 2003). Traditional accommodations to blind and vision-impaired users include the use of speech synthesizers as screen reader, and/or Braille to convey the text information on the display. However, speech-based approaches are very weak at representing 2D spatial layout in the graphical user interface. This is a challenge for maps as well as most other Information Visualization techniques. For navigation in the real world, GPS-based talking maps have been developed (Golledge et al., 1991a,b). One example product is a talking nationwide digital map consisting of most addresses and street intersections (The Sendero Group, 2003). Users can navigate the map using the arrow keys and listen to speech-synthesized descriptions of the map and directions. Trekker (VisuAide, 2003) is another GPS-based application that helps the blind to navigate. Maps are also important to learn an area beforehand and chose a route. Schneider and Strothotte (2000) have designed a tangible interface using physical building blocks that users manipulate to promote constructive exploration of the map. When using maps to learn Geography or discover spatial patterns in data, people with limited vision can use screen magnifiers (for instance, try the "magnifier" available from the Start menu of MS Windows, in the accessibility accessories), but those with severe vision impairments have to rely on tactile maps or atlases (Imperatore, 1992) as shown in Figure 3.10 or sonification of the maps.
70
C. Plaisant
Figure 3.10. A traditional tactile atlas showing a map of Canada. Reproduced with permission of Natural Resources Canada and the Canadian Government.
Current assistive technology research is exploring a number of promising techniques to help blind users benefit from the spatial awareness provided by maps. The first step is to provide data in both visual and descriptive form. OptiMaps (Corda Technologies Inc., 2003), employs a small "d" character below each choropleth map. This is the standard accessibility mark for image "descriptions" that visually impaired users are able to search for. These provide hyperlinks to a textual version of the data, generated automatically with the dynamic map. Examples are available in AtlasPlus (National Cancer Institute, 2003). New vector graphic file formats, such as SVG, permit embedding text descriptions with the graphic information and should simplify this process as a result. Unfortunately reading the data values still does not give an adequate feeling for the spatial relationships between areas that only spatial techniques can provide. Tactile and haptic techniques (and strategies for signifying data haptically) have been devised (Griffin, 2002). Virtual Touch provides an example of map exploration using a tactile mouse. The mouse is equipped with two Braille character mechanical units, which can be used to indicate tactile patterns (using Braille and other alternatives), as shown in Figure 3.11. As users explore the map, the patterns change over different
Information Visualization and the Challenge of Universal Usability
71
Figure 3.11. The VTPlayer is a mouse equipped with two Braille character units that can also be used to indicate patterns. For example, as users explore a map of the US, patterns change over different states (VirTouch Ltd, 2002). Reproduced with permission of VirTouch Ltd.
states or areas. One of the limitations of the mouse is that it is an input device providing only relative positioning so absolute position on the map has to be provided by audio feedback. Another example developed by TouchGraphics and their research colleagues (Landau and Gourgey, 2001) augments standard printed tactile maps. Maps are secured on top of a touch screen that provides the location of each touch (Figure 3.12). The TouchGraphics Atlas has five operational modes. Users can simply explore by touching a physical tactile map and hear names of places touched. They select a destination from an index, and listen to directions that are updated as a user's finger gets closer to the destination. Distance between two points can be calculated, and descriptions of the areas can be listened to. This work was inspired by Nomad (Parkes, 1994). 3D maps can benefit from the use of haptic devices. For example, the Phantom device provides 6 degrees of freedom input and 3 degrees of freedom output to explore the virtual sound space and augment it with haptic feedback providing the same sensation as moving a single finger over a physical 3D map. Tactile maps can be augmented with abstract audio output (Fisher, 1994; Krygier, 1994). For example, users can hear a series of graduated pitches proportional to elevations above sea level as they explore the map. Sonification alone has been demonstrated to be effective in giving blind users access to graphs (Ramloll et al., 2001) or, in some limited fashion, entire desktops (Mynatt and Edwards, 1992). In the case of maps, Jeong and Gluck (2002) compared the effectiveness of and preferences for using auditory feedback (volume of sound), haptic feedback (extent of vibration) or both in the tasks of identifying the highest or the middle valued state on a static choropleth map of the US. The experiment showed that overall performance is most successful when using haptic feedback alone but users prefer having both haptic and audio feedback. This result may be attributed to the fact that haptic devices provided spatial cues while the standard sound output does not. Unfortunately tactile and haptic techniques require special hardware, from embossed maps to specialized input devices, and hardware is usually
72
C. Plaisant
Figure 3.12. An example of tactile map augmented with audio description when mounted on a touch screen (Touch Graphics, undated). (a) Sample map plate; (b) the sample map plate in use with the talking tactile tablet (TTT). Reproduced with permission of Touch Graphics.
a limiting factor for wide dissemination, as users may not have access to the technology or the financial means to purchase it. Techniques relying solely on sonification have the potential to be used by a larger population as blind users, who often already rely on headphones when using screen readers.
Information Visualization and the Challenge of Universal Usability
73
The BATS project at the University of North Carolina (Parente and Bishop, 2003) uses simple spatial audio (mostly stereo effects) to sonify maps as shown in Figure 3.13. Real world auditory icons are played as the user moves the cursor over the map. For example, car noises are heard over cities and birds and crashing waves are heard over forests and beaches. The sound becomes louder as the user gets close to the source of the sound. Interactivity and immediate feedback provides a pleasant exploration experience and helps blind users explore the map and locate objects. A promising direction for the sonification of spatial information is the use of spatial audio using a head-related transfer function (HRTF) (Shinn-Cunningham et al., 1997). Since humans are usually able to localize sound with amazing precision by using binaural perception, spatial location can be an important aspect of information perception. It is possible that the addition of positional cues will greatly improve the sonification of maps. Stereo effects allow right-left sound separation only, while spatial audio provides up and down cues, and in a less reliable manner front and back information. CAVE-like virtual environments provide such spatial sound with sets of multiple loud-speakers (Pape, 1998; see Bodum, this volume (Chapter 19). But synthesized spatial audio allows users to experience 3D audio with ordinary headsets. Until recently this had been limited to high-performance computing environments but researchers are now able
North Carolina
C ~ ' e m merit ~ n d 1
Ci~' Sprawl (~her S~tes
....................~ u : n b , ~ e r ---
State Border
Figure 3.13. The BATS sonic map helps those without sight to explore spatial information (Parente and Bishop, 2003). Real world audio icons (car noises, wave crashing, etc.) are played as the user navigates the map and appear clearly as coming from your right or your left. Volume increases as users get closer to the source of the sound. Reproduced with permission of the authors.
74
C. Plaisant
Figure 3.14. Spatial audio allows users to hear the location of virtual sound sources. This schematic represents what a user might hear as each US state "plays" its statistics, for example a sound whose pitch is proportional to its African-American population. Proper linearization of sounds allow users to hear patterns of low to high values moving from the northern states to the lower Mississippi area.
to synthesize high-quality 3D sound in real-time on commercial off-the-shelf PCs (Zotkin et al., 2002). We are currently exploring its use for the sonification of maps. Nevertheless, the spatial effects - if noticeable - remain fairly weak and our research at the University of Maryland seeks to combine spatial effects with standard sonification techniques such as those using pitch or tone variations to reinforce the perception of the spatial information. Imagine being in the center of a virtual room with a large US state map hanging from the ceiling and wrapping around you as shown in Figure 3.14. Now imagine that each state on the map "plays" a sound indicating the value of a particular statistics for each state. Because spatial audio is helpful to separate different sounds played together, users can make sense of the location of the states with high, medium and low values. Sonification might also be useful for non-disabled users for monitoring tasks or to represent areas too small to be shown on the map. For example, The District of Columbia is often too small to be visible on US state maps but will be heard in an audio map.
3.4
Conclusions
Information Visualization allows designers to present a large amount of information using abstract representations. Geographic and scientific visualization applications
Information Visualization and the Challenge of Universal Usability
75
usually use representations determined by the nature of the data being displayed. Location within the graphic is usually used to represent location in space. For example in 2D maps, a projection of space structures the representation, whilst in 3D models of the body or of physical processes such as meteorological predictions graphics are constrained by a 3D locational framework. On the other hand, Information Visualization allows designers to choose among a palette of possible representations that fill space in a variety of ways, such as hierarchies, time lines, networks, tabular displays and the like, to produce information abundant displays. Choosing the appropriate representation(s) is challenging and research is needed to evaluate and compare different approaches. User studies are critical to judge the relative merits of different representations. Tightly coupled displays and highly interactive interfaces using the Zoom, Filter and Detail on Demand principles are needed to allow users to rapidly explore alternative views of the data in a matter of seconds to answer instant queries. Advanced interfaces also need to address the longer term process of analysis that may require annotation, history keeping, collaboration with peers, and the dissemination of results and procedures used. Faster rendering algorithms, sophisticated aggregations techniques to deal with large datasets, and novel labeling techniques are also needed, and along with careful studies of users and their needs will lead to successful visualization applications. Many of these, and related issues are addressed in the following chapters by researchers from a number of related fields. Information Visualization is becoming increasingly accessible to the general public and attention should be given to the goal of universal usability by enabling the widest range of users to benefit from the applications we develop. Universal usability remains a formidable challenge as we just begin to address the needs of users with slow modems, small screens, or wireless devices. Translation to other languages, access for novice, low education and low motivation users, children and elders all present special difficulties, and users with visual impairments often remain the "forgotten users" of Information Visualization. Tactile solutions are promising for blind users but sonification might provide wider access to map information, as it does not require specialized hardware.
Acknowledgements The content of this chapter was inspired in part by Ben Shneiderman's many writings on Information Visualization and Universal Usability, and also by papers co-authored with Haixia Zhao, Hyunmo Kang and other members of the Human-Computer Interaction Laboratory. Some of the work presented was funded by the National Science Foundation under Grant No. EIA 0129978 and the US Census Bureau. I also thank the editors of the book for their careful and extensive editing of the chapter
References Ahlberg, C., Williamson, C., and Shneiderman, B., (1992) "Dynamic queries for information exploration: an implementation and evaluation", Proceedings A CM CHI '92: Human Factors in Computing Systems. New York: ACM, pp. 619-626.
76
C. Plaisant
Andrienko and Andrienko (1999a). Seasonal Migration of White Storks, 1998-1999. Online: http://www.ais.fhg.de/and/java/birds/(23/10/03). Andrienko, G., and Andrienko, N., (1999b) "GIS visualization support to the C4.5 classification algorithm of KDD", Proceedings of the 19th International Cartographic Conference, pp. 747-755. Andrienko, G., and Andrienko, N., (1999c) "Knowledge-based visualization to support spatial data mining", Proceedings of Intelligent Data Analysis. Berlin: Springer Verlag, pp. 149-160. Andrienko, G., and Andrienko, N., (1999d) "Making a GIS intelligent: CommonGIS project view", AGILE'99 Conference, Rome, April 15-17, pp. 19-24. Andrienko, G. and Andrienko, N., (1999e) Seasonal Migration of White Storks, 1998-1999. Online: http://www.ais.fhg.de/and/java/birds/(03/10/02). Andrienko, G. L., and Andrienko, N. V., (1999f) "Interactive maps for visual data exploration", International Journal Geographic Information Science, 13(4), 355-374. Andrienko, N., Andrienko, G., Voss, H., Bernardo, F., Hipolito, J., and Kretchmer, U., (2002) "Testing the usability of interactive maps in CommonGIS", Cartographic and Geographic Information Science, 29(4), 325-342. Becker, R. A., and Cleveland, W. S., (1987) "Brushing scatterplots", Technometrics, 29(2), 127-142. Bederson, B., (1994) "Pad+ +: advances in multiscale interfaces", Proceedings Human Factors in Computing Systems CHI '94 Conference, Boston, MA, p. 315. Bederson, B., and Shneiderman, B., (2003) The Craft of Information Visualization: Readings and Reflections. San Francisco: Morgan Kaufman. Bederson, B. B., Meyer, J., and Good, L., (2000) "Jazz: an extensible zoomable user interface graphics ToolKit in Java, UIST 2000, ACM symposium on user interface software and technology", CHI Letters, 2(2), 171-180. Bederson, B. B., Shneiderman, B., and Wattenberg, M., (2002) "Ordered and Quantum treemaps: making effective use of 2D space to display hierarchies", A CM Transactions on Graphics (TOG), 21(4), 833-854 (Oct. 2002). Brewer, C. and Harrower, M., (2002) ColorBrewer - Selecting Good Color Schemes for Maps. Online: http://www.personal.psu.edu/faculty/c/a/cab38/ColorBrewerBeta.html (23/10/03). Card, S. K., Mackinlay, J. D., and Shneiderman, B., (eds.), (1999) Readings in Information Visualization: Using Vision to Think. San Francisco: Morgan Kaufmann Publishers. Carlis, J., and Konstan, J., (1998) "Interactive visualization of serial periodic data", Proceedings of User Interface Software and Technology. New York: ACM, pp. 29-38. Chen, C., (1999) Information Visualisation and Virtual Environments. Berlin: Springer Verlag. Chen, C., and Czerwinski, M., (2000) "Introduction to the special issue on empirical evaluation of Information Visualizations", International Journal of HumanComputer Studies, 53(5), 631-635 (Nov. 2000).
Information Visualization and the Challenge of Universal Usability
77
Cleveland, W. S., (1994) The Elements of Graphing Data: Revised Edition. Boca Raton, FL: CRC Press. Cockburn, A., and McKenzie, B., (2002) "Evaluating the effectiveness of spatial memory in 2D and 3D physical and virtual environments", Proceedings ACM CHI 2002 Conference on Human Factors in Computing Systems. New York: ACM Press, pp. 203-210. Corda Technologies Inc., (2003) Corda Products Optimap 5. Online: http ://www.corda.com/products/optimap/(23/10/03). Dang, G., North, C., and Shneiderman, B., (2001) "Dynamic queries and brushing on choropleth maps", Proceedings International Conference on Information Visualization. Piscataway, NJ.: IEEE Press, pp. 757-764. DiBiase, D., MacEachren, A. M., Krygier, J. B., and Reeves, C., (1992) "Animation and the role of map design in scientific visualization", Cartography and Geographic Information Systems, 19(4), 201-214, see also pp. 265-266. Dorling, D., (1992) "Stretching space and splicing time: from cartographic animation to interactive visualization", Cartography and Geographic Information Systems, 19(4), 215-227, see also pp. 267-270. Dougherty, R. and Wade, A., (2002) Vischeck. Online: http://www.vischeck.com/(23/ 10/03). Dumas, J. S., and Redish, J. C., (1999) A Practical Guide to Usability Testing. Exeter: Intellect Books, p. 404. Eick, S., Steffen, J., and Sumner, E., (1992) "SeeSoft~a tool for visualizing line-oriented software statistics", IEEE Transactions on Software Engineering, 18(11), 957-968. Fekete, J.-D., and Plaisant, C., (1999) "Excentric labeling: dynamic neighborhood labeling for data visualization", Proceedings of ACM Conference on Human Factors in Computing Systems, CH! '99. New York: ACM Press, pp. 512-519. Fekete, J., and Plaisant, C., (2002) "Interactive Information Visualization of a million items", Proceedings of IEEE Conference on Information Visualization, Boston, Sept. 2002, pp. 117-124. Fisher, P., (1994) "Hearing the reliability in classified remotely sensed images", Cartography and Geographic Information Systems, 21 (1), 31-36. Friendly, M., (1994) "Mosaic displays for multi-way contingency tables", Journal of the American Statistical Association, 89(425), 190-200. Furnas, G. W., (1986) "Generalized fisheye views", Proceedings CHI'86 Conference: Human Factors in Computing Systems. New York: ACM Press, pp. 16-23. Gahegan, M., Takatsuka, M., Wheeler, M., and Hardisty, F., (2002a) "GeoVISTA Studio: a geocomputational workbench, Computers", Environment and Urban Systems, 26, 267-292. Gahegan, M., Takatsuka, M., Wheeler, M., and Hardisty, F., (2002b) "Introducing GeoVISTA Studio: an integrated suite of visualization and computational methods for exploration and knowledge construction in geography", Computers, Environment and Urban Systems, 26(4), 267-292. Golledge, R. G., (1991) "Tactual strip maps as navigational aids", Journal of Blindness and Vision Impairment, 85(7), 296-301.
78
C. Plaisant
Golledge, R. G., Loomis, J. M., Klatzky, R. L., Flury, A., and Yang, X. L., (1991) "Designing a personal guidance system to aid navigation without sight: progress on the GIS component", International Journal of Geographical Information Systems, 5(4), 373-395. Griffin, A., (2002) "Feeling it out: the use of haptic visualization for exploratory geographic analysis", Cartographic Perspectives, 39, 12-29. Grosjean, J., Plaisant, C. and Bederson, B., (2002) SpaceTree. Online: http://www.cs.umd.edu/hcil/spacetree (23/10/03). Imperatore, W., (1992) The Braille World Atlas. Louisville, Kentucky: American Printing House for the Blind, Inc. Inselberg, A., (1985) "The plane with parallel coordinates", The Visual Computer, 1, 69-91. Inselberg, A., (1997) "Multidimensional detective", Proceedings of lEEE Symposium on Information Visualization (InfoVis '97), Phoenix, AZ, Oct. 1997, pp. 100-107. Inxight Software Inc., (2002) Inxight Software - Unstructured Data Management Solutions. Online: http://www.inxight.com (23/10/03). Jeong, W., and Gluck, M., (2002) "Multimodal bivariate thematic maps with auditory and haptic display", Proceedings of 2002 International Conference on Auditory Display, Kyoto, Japan, pp. 1-4. Johnson, B., and Shneiderman, B., (1991) "Tree-maps: a space-filling approach to the visualization of hierarchical information structures", Proceedings IEEE Visualization '91. Piscataway, NJ: IEEE, pp. 284-291. Keim, D. A., (2001) "Visual exploration of large data sets", Communications of the ACM, 44(8), 38-44. Keim, D. A., and Kriegel, H.-P., (1994) "Database exploration using multidimensional visualization", Computer Graphics & Applications, 6, 40-49, (September 1994). Kraak, M. J., (undated) Minard - What has Been Done by ITC? Online: http://www.itc.nl/personal/kraak/1812/minard-itc.htm (23/10/03). Kraak, M. J., (1989) "Computer-assisted cartographic three-dimensional imaging techniques", In: Raper, J., (ed.), Three Dimensional Applications in Geographical Information Systems. London: Taylor & Francis, pp. 99-114. Kraak, M. J., and MacEachren, A. M., (1994) "Visualization of the temporal component of spatial data", In: Waugh, T., and Healey, R., (eds.), Proceedings of the Sixth International Symposium on Spatial Data Handling, Advances in GIS Research, Edinburgh, Scotland, pp. 391-409. Krygier, J., (1994) "Sound and geographic visualization", In: MacEachren, A. M., and Taylor, D. R. F., (eds.), Visualization in Modern Cartography. Oxford, UK: Pergamon, pp. 146-166. Kuniavsky, M., (2003) Observing the User Experience: A Practitioner's Guide to User Research. San Francisco: Morgan Kaufmann. Kwan, M. P., (2000) "Interactive geovisualization of activity-travel patterns using 3D geographical information systems: a methodological exploration with a large data set", Transportation Research Part C-Emerging Technologies, 8(1-6), 185-203.
Information Visualization and the Challenge of Universal Usability
79
Lamping, J., Rao, R., and Pirolli, P., (1995) "A focus + context technique based on hyperbolic geometry for visualizing large hierarchies", Proceedings of CHI '95 Human Factors in Computing Systems, Denver, CO, May 1995. New York: ACM Press, pp. 401-408. Landau, S., and Gourgey, K., (2001) "Development of a talking tactile tablet", Information Technology and Disabilities, VII(2). Lindwarm, D., Rose, A., Plaisant, C., and Norman, K., (1998) "Viewing personal history records: a comparison of tabular format and graphical presentation using LifeLines", Behaviour & Information Technology, 17(6), 249-262. MacEachren, A. M., Dai, X., Hardisty, F., Guo, D., and Lengerich, G., (2003a) "Exploring high-D spaces with multiform matrices and small multiples", IEEE Symposium on Information Visualization, Seattle, pp. 31-38. MacEachren, A. M., Hardisty, F., Dai, X., and Pickle, L., (2003b) "Geospatial statistics supporting visual analysis of federal GeoSpatial statistics", Digital Government Table of Contents, pp. 59-60. Muntz, R. R., Barclay, T., Dozier, J., Faloutsos, C., MacEachren, A. M., Martin, J. L., Pancake, C. M., and Satyanarayanan, M., (2003) "IT roadmap to a geospatial future", Report of the Committee on Intersections Between Geospatial Information and Information Technology. Washington, DC: National Academy of Sciences. Mynatt, E., and Edwards, K., (1992) "Mapping GUIs to auditory interfaces", Proceedings of the 5th Annual A CM Symposium on User Interface Software and Technology. New York: ACM Press, pp. 61-70. N Space Labs Inc., (2003) incMapTM: Geographic Map of the Market. Online: http://www.nspacelabs.com/(23/10/03). National Cancer Institute, (2003) Cancer Mortality Maps and Graphs. Online: http://www3.cancer.gov/atlasplus/(23/10/03). Nielson, G. M., Hagen, H., and Mueller, H., (1997) Scientific Visualization: Overviews, Methodologies, Techniques. Piscataway, NJ: IEEE Computer Society. North, C., Conklin, N., and Saini, V., (2002) "Visualization schemas for flexible Information Visualization", Proceedings of InfoVis 2002, pp. 15-22. Olson, J., and Brewer, C. A., (1997) "An evaluation of color selections to accommodate maps users with color-vision impairments", Annals of the Association of American Geographers, 87(1), 103-134. OmniViz Inc., (2003) Omniviz. Online: http://www.omniviz.com (23/10/03). Pape, D., (1998), "Crayoland". In: SIGGRAPH Video Review, Issue 127/SIGGRAPH '98 Electronic Art and Animation Catalog CD-ROM. Orlando, FL: ACM. Online: http://www.evl.uic.edu/pape/projects/crayoland. Parente, P., and Bishop, G., (2003) "BATS: the blind audio tactile mapping system", Proceedings of ACM South Eastern Conference, Savannah, GA, http://www.cs.unc.edu/Research/assist/bats/history.shtml (Mar. 2003). Parkes, D., (1994) "Audio tactile systems for designing and learning complex environments as a vision impaired person: static and dynamic spatial information access", In: Steele, J., and Hedberg, J. G., (eds.), Learning Environment Technology: Selected Papers from LETA 94. Canberra, AJET Publications, pp. 219-223.
80
C. Plaisant
Perlin, K., and Fox, D., (1993) "Pad: an alternative approach to the computer interface", In: Kajiya, J. T., (ed.), Proceedings of the 20th Annual A CM Conference on Computer Graphics (SIGGRAPH '93), Aug. 2-6, Anaheim, CA. New York: ACM Press, pp. 57-64. Pickle, L., (2003) "Usability testing of map designs", Proceedings of Interface 2003. Alexandria, VA: ASA. Plaisant, C., (1993) "Facilitating data exploration: dynamic queries on a health statistics map", Proceedings of the Annual Meeting of the American Statistical Association of the Government Statistics Section, San Francisco, CA, Aug 18-23. Alexandria, VA: ASA pp. 18-23. Plaisant, C., Rose, A., Milash, B., Widoff, S., and Shneiderman, B., (1996) "LifeLines: visualizing personal histories", Proceedings of CHI '96 Conference: Human Factors in Computing Systems. New York: ACM, pp. 221-227, 518. Plaisant, C., Grosjean, J., and Bederson, B., (2002) "SpaceTree: supporting exploration in large node link tree, design evolution and empirical evaluation", Proceedings of IEEE Conference on Information Visualization, pp. 57-64. Plaisant, C., Kang, H., and Shneiderman, B., (2003) "Helping users get started with visual interfaces: multi-layered interfaces, integrated initial guidance and video demonstrations", Proceedings of Human-Computer Interaction International 2003, Crete, June 2003, pp. 790-794. Preece, J., Rogers, Y., and Sharp, H., (2002) Interaction Design: Beyond HumanComputer Interaction. New York: Wiley. Ramloll, R., Brewster, S., Yu, Y., and Riedel, B., (2001) "Using non-speech sounds to improve access to 2D tabular numerical information for visually impaired users", Proceedings 15th British HCI Group Annual Conference on Human-Computer Interaction (IHMHCI), Lille, France, Sept. 10-14. Rao, R., and Card, S. K., (1994) "The table lens: merging graphical and symbolic representation in an interactive focus + context visualization for tabular information", Proceedings Human Factors in Computing Systems CHI '94 Conference, Boston, MA. New York: ACM, pp. 318-322. Rosenthal, O., and Phillips, R., (1997) Coping With Color-Blindness. New York: Avery Publishing Group. Schneider, J., and Strothotte, T., (2000) "Constructive exploration of spatial information by blind users", Proceedings of the A CM Conference on Assistive Technologies, ASSETS 2000. New York: ACM, pp. 188-192. Shinn-Cunningham, B. G., Lehnert, H., Kramer, G., Wenzel, E. M., and Durlach, N. I., (1997) "Auditory displays", In: Gilkey, R., and Anderson, T., (eds.), Binaural and Spatial Hearing in Real and Virtual Environments. New York: Erlbaum, pp. 611-663. Shneiderman, B., (1997) Designing the User Interface - Strategies for Effective HumanComputer Interaction. Reading: Addison-Wesley Publishing Company, p. 639. Shneiderman, (1998) Treemaps for Space-Constrained Visualization of Hierarchies. Online: http ://www.cs.umd.edu/hcil/treemaps (23/10/03). Shneiderman, B., (2000) "Universal usability: pushing human-computer interaction research to empower every citizen", CACM, 23(5), 84-91.
Information Visualization and the Challenge of Universal Usability
81
Shneiderman, B., (2001) "Supporting creativity with advanced information-abundant user interfaces", In: Earnshaw, R., Guedj, R., Van Dam, A., and Vince, J., (eds.), Human-Centred Computing, Online Communities, and Virtual Environments. London: Springer-Verlag, pp. 469-480. Shneiderman, B., and Hochheiser, H., (2001) "Universal usability as a stimulus to advanced interface design", Behaviour&Information Technology, 20(5), 367-376, Online: http ://www.otal.umd.edbu/uupracticechen SmartMoney.com, (2003) Smartmoney.com - Investing, Saving and Personal Finance. Online: http://www.smartmoney.com (23/10/03). Spence, R., (2001) Information Visualization. Harlow: Addison Wesley/ACM Press Books, 206 pp. Szego, J., (1987) Human Cartography: Mapping the Worm of Man. Stockholm: Almqvist & Wiksell International, p. 236. The Hive Group Inc., (2003) The Hive Group - Creators of Honeycomb Technology. Online: http://www.hivegroup.com (23/10/03). The Sendero Group, (2003) Sendero Group Homepage - GPS for the blind. Online: http://www.senderogroup.com Theus, M., (2002a) "Geographical Information Systems", In: Kloesgen, W., and Zytkow, J., (eds.), Handbook of Data Mining and Knowledge Discovery. Oxford: Oxford University Press. Theus, M., (2002b) "Interactive data visualization using Mondrian", Journal of Statistical Software, 7(11). Tufte, E. R., (1983) The Visual Display of Quantitative Information. Cheshire, CT: Graphics Press, p. 197. Tweedie, L., Spence, R., Dawkes, H., and Su, H., (1996) "Externalising abstract mathematical models", In: Bilger, R., Guest, S., and Tauber, M. J., (eds.), CHI '96: Conference on Human Factors in Computing Systems, Vancouver, BC, ACM/ SIGCHI, Online: http://www.acm.org/sigs/sigchi/chi96/proceedings/papers/Tweedie/lt 1txt.htm Vanderheiden, G., (2000) "Fundamental principles and priority setting for universal usability", Proceedings A CM Conference on Universal Usability 2000. New York: ACM, pp. 32-38. VirTouch Ltd., (2002) Innovative Tactile Solutions for PC Users Who Are Blind. Online: http://www.virtouch.com/(23/10/03). VisuAide, (2003) GPS Orientation Solutions - Trekker. Online: http://www.visuaide.com/gpssol.html (23/10/03). Ware, C., (2000) Information Visualization: Perception for Design. San Francisco: Morgan Kaufmann Publishers, p. 384. Weibel, R., and Jones, C. B., (1998) "Computational perspectives on map generalization", Geoinformatica, 2(4), 307-314. Williamson, C., and Shneiderman, B., (1992) "The dynamic home finder: evaluating dynamic queries in a real-estate information exploration system", Proceedings of the ACM SIGIR'92 Conference. New York: ACM, pp. 338-346.
82
C. Plaisant
Wise, T. A., Thomas, J. J., Pennock, K., Lantrip, D., Pottier, M., Schur, A., and Crow, V., (1995) "Visualizing the non-visual: spatial analysis and interaction with information from text documents", Proceedings IEEE Information Visualization '95, Los Alamitos, CA. Piscataway, NJ: IEEE Computer Press, pp. 51-58. Woodruff, A., Landay, J., and Stonebreaker, M., (1998) "Constant information density in zoomable interfaces", Proceedings of the 4th International Working Conference on Advanced Visual Interfaces A VI '98, L'Aquila, Italy, May 24-27, pp. 110-119. Zhao, H., Plaisant, C., and Shneiderman, B., (2003) "Improving accessibility and usability of geo-referenced statistical data", Proceedings 2003 National Conference on Digital Government Research, Online: http://www.dgrc.org/dgo2003 Zotkin, D. N., Duraiswami, R., and Davis, L. S., (2002) "Creation of virtual auditory spaces", Proceedings International Conference on Acoustic Speech and Signal Processing, Orlando, FL, May 2002, pp. 2113-2116.
Exploring Geovisualization J. Dykes, A.M. MacEachren, M.-J. Kraak (Editors) 9 2005 Published by Elsevier Ltd. All rights reserved.
Chapter 4
Beyond Tools: Visual Support for the Entire Process of GIScience Mark Gahegan, GeoVISTA Center, Department of Geography, The Pennsylvania State University, University Park, PA 16802, USA
Keywords: geovisualization, GIScience, semantics, inference, science, activities, reasoning, visual support
Abstract Progress to date within the geovisualization research community has led to some very useful, innovative tools and systems. However, these tools are typically neither easy to integrate or use together, nor is it always clear what scientific activities they help to facilitate. In order to bring visualization tools to the fore, we must understand clearly what roles they play within the entire process of scientific investigation, including the various tasks that a researcher might undertake and the different kinds of reasoning that we wish visualization to support or enable. This chapter presents an overview of the science process, gives examples of how current approaches to visualization support certain research activities and suggests a framework by which additional aspects of: (i) science activity, (ii) reasoning mode (inference), (iii) outcomes, and (iv) pre-requisite data and knowledge could be used to better define the role or roles that different visualization tools can play, and also in how such tools might be better connected or integrated together. The chapter ends by summarizing the research challenges that follow from a more semantic, process-oriented approach to the use and integration of geovisualization tools.
4.1
Introduction
Consider, if you will, the entirety of the process of "doing" GIScience, perhaps starting by exploring an unfamiliar dataset and discovering emergent patterns - through knowledge construction where these patterns are formed into the building-blocks of analysis: concepts, relationships and instances - then onto analysis where models are constructed from these building blocks to make predictions or descriptions - these models are then evaluated to test their integrity and accuracy - and finally results are reported by way of maps, images, numbers or words. This is just a single example of 83
84
M. Gahegan
Figure 4.1. The nexus of activities comprising the scientific process (Gahegan and Brodaric,
2002a,b).
a path through the nexus 1 of activities that is defined by the geo-scientific process and as later figures show, many more such paths are equally valid. Clearly, the process itself is very complex, with myriad connections and relationships between the various activities. For example, emergent concepts that at first appear useful when exploring the data may turn out to be too difficult to categorize, may fail to provide insightful results during analysis or may be problematic to understand or communicate. So at any stage, they might be abandoned, requiring the analyst to revisit exploration or synthesis. Despite the inherent complexities, there is a mature understanding of the process of science viewed from both the perspective of the philosophy of science (Peirce, 1891; Popper, 1959; Thagard, 1988; Shrager and Langley, 1990; Sowa, 1999) and of the practicing GIScience and earth science community (Schumm, 1991; Baker, 1996; Martin, 1998). The contention presented here is that visualization can, and should, support the entire geoscientific process. But how might this goal be best achieved?
4.2
Current Geovisualization Tools: Some Pros and Cons
Now, ponder for a moment the increasing number of visualization and analysis techniques and tools available and the tasks they enable researchers to carry out. On the surface, many of these appear to have clear purposes or roles, defined by our experiences of using the tool or technique or seeing others use it, or inferred from a theoretical understanding gained from relevant articles and documentation, or even from the name alone (c.f. IBM's Data Explorer). At a finer level of detail, however, it may not be clear exactly what activities (in Figure 4.1) they can or cannot support, how well they can support these activities, and what biases they will impose on the investigation. l Nexus used in the sense described by Alfred North Whitehead in Adventures of Ideas (Whitehead, 1938).
Beyond Tools: Visual Support for the Entire Process of GIScience
85
By contrast, such information is often readily available for many kinds of statistical procedures. There are many excellent examples of tools that address specific activities in the social scientific process (for examples see the lists of resources held by the Center for Spatially Integrated Social Science - CSISS, 2003) and the Teaching Resources and Materials for Social Scientists (Wiggins et al., 2000). Concerning visualization specifically, many tools and systems have been developed that allow the same data to be viewed in a variety of displays, with a high degree of interactivity between the displays, often called "linking and brushing" (Monmonier, 1990a,b; MacDougal, 1992; Cook et al., 1996; Dykes, 1996; Andfienko and Andrienko, 1999; Gahegan et al., 2002a,b). However, the tools we currently have are, by and large, hosted in closed systems that cannot easily be modified or integrated with each other, and specifically where there is little or no thought to the positioning or integrating of tools into the wider scientific process shown above such that the investigator can move seamlessly from one tool to another, back and forth, as activities dictate. From the perspective of the academic community, this is, in part, a consequence of the fact that academics typically build tools to test and present ideas, rather than to become fully operational within a community, and the most effective way to build such tools is to close as many aspects of the system as possible, then there is less to build. From the commercial perspective, open systems carry the threat of a potential loss of market share, and again they are more problematic to develop. Furthermore, to date there is little to guide the investigator in selecting the right tool(s) for the task(s) at hand from those available, nor any way to feed back evidence of success (or failure) when particular tools are used for a specific task. This is nobody's fault, p e r se, but a consequence of many isolated research efforts that focus on pioneering specific techniques. What is required as geovisualization develops is a broader vision by which relevant tools and techniques might be orchestrated into something greater than the sum of their parts. This vision is likely to include perspectives from other disciplines and may continue to incorporate techniques and knowledge from cognate fields with expertise in visualization. Another problem with our current geovisualization tools is that they typically are focused only on the data, and not on conceptual structures such as categories or relationships that operate at a higher level of abstraction. Therefore, while they provide good support for data exploration they are less useful for synthesis activities, where concepts are constructed, or for analysis, where concepts are operationalized. To better support the entire science process, we must provide mechanisms that can visualize the connections between the various stages of analysis, and show how concepts relate to data, how models relate to concepts, and so forth. Returning to Figure 4.1, consider the substance of the links between the various scientific activities, specifically what are the inputs and outcomes that transform one stage to another? Considering just the transitions between exploration and synthesis stages, how might the mapping between data exploration and concept synthesis be visualized? During the early stages of an investigation, an analyst might recognize emergent structures in the data and synthesize these into concepts for use in analytical models. But how might this synthesis be signified so that it too can be explored?
86
M. Gahegan
We need to better understand the interfaces between science activities for two reasons. Firstly, from a theoretical perspective, such understanding will help us to gain a deeper appreciation of the investigative processes used by scientists, and hence increase understanding of how early decisions regarding the data used and the concepts synthesized will affect the outcomes of later analysis models. Secondly, and from a practical perspective, these linkages define interface specifications by which visualization tools can exchange relevant information with each other as the user switches focus between activities. New approaches to visualization are needed that can cross these "bridges of abstraction" that we mentally construct between the science activities in Figure 4.1. Some possible approaches are given by MacEachren et al. (1999a-c), Gahegan and Brodaric (2002b), Lucieer and Kraak (2002), and some examples are provided in w following a more detailed account of GIScience activities.
4.3
A More Detailed Look at the Activities of GIScience
Returning to the process of science, Figure 4.2 adds examples of conceptual structures (light grey) and concretized representations (dark grey) linking the various stages of the nexus shown in Figure 4.1. The figure shows one plausible path (selected from
Figure 4.2. A plausible path around the core scientific activities introduced in Figure 4.1. See text for details.
Beyond Tools: Visual Support for the Entire Process of GIScience
87
many possibilities) linking these core scientific activities, beginning with exploration and ending with the production of a map of categories synthesized from the data. The path might exemplify the building of a map-based representation and understanding of some phenomenon such as the degree of demographic change occurring between two census surveys (where such change is undefined at the outset, but emerges from the analyst's interactions with the data), or of producing a geological or detailed land cover map of an unexplored region. Dark grey ovals represent tangible inputs or outcomes, light grey ovals represent intangible knowledge and expertise provided by the analyst and medium grey rectangles are activities from Figure 4.1. The block arrows show the general directional trend, but the analyst may of course move back and forth between activities as revision takes place. For example, if a researcher is studying land cover mapping and is trying to synthesize useful categories for indicating a range of different species or ground conditions, then current tools can help them understand the general patterns and outliers in remote sensing and ancillary datasets, and via linking and brushing the trends in scatter plots can be explored spatially in a map, and visa versa. But usually, when the categories or indicators are formed, their connection to, and dependence on, the original data are "lost" and cannot be examined in any later stages. Likewise, the classification tools used are also, for the most part, black boxes, so the user cannot explore the cause and effect relationships between the selection of data, their own mental understanding of the study area and the analysis tools they are using. Figure 4.3 clarifies by adding some typical questions that might be asked at each of the conceptual stages, and draws the significant impacts of prior knowledge and experience into the model. The challenge that results from this situation is one of how to engineer visualization systems that explicitly support connections between data, classifiers and categories, and later between categories and prediction models that enable us to answer these kinds of questions as and when required by the process of GIScience. Figure 4.4 shows exploratory visualization tools linked to the visualization of classifiers to gain insight into the process of classification, from data exploration, through synthesis (starting with data and ending with categories in Figures 4.2 and 4.3). A parallel coordinate plot (top left) and scatter plot (right) show several training examples from a land cover mapping exercise. The utility of a maximum-likelihood classifier is shown for each separate attribute dimension across the bottom of the figure and can be visually assessed by comparing the observed points to the theoretical Gaussian distribution (the bell-shaped curves, one for each category). The top right panel shows how the same data points appear in a scatter plot matrix and the middle panel on the left shows the land cover taxonomy used as the conceptual input to the classification process. Interactive linking and brushing is supported not only between the different views of the data, but also between the data and the visual representation of the internal working of the classifiers, allowing the user to explore relationships between the two. Such functionality allows the user to ask direct questions regarding the path from exploration to synthesis (Figure 4.1) such as: Which particular training examples cause the most classification error, and where are they located in geographic space?
Figure 4.3. Questions that might be asked during a land cover change assessment exercise as illustrated by the plausible path around the core scientific activities introduced in Figure 4.2.
c
Beyond Tools: Visual Support for the Entire Process of GIScience
3
89
90
M. Gahegan 2.
3. 4.
Which categories show the most confusion or overlap and therefore might benefit from a different conceptualization or synthesis, for example by generalizing or specializing them further using the taxonomy? Which data attributes (columns in the parallel coordinate plot) only add confusion into the classification process? Which kind of classifier works best for specific categories and why?
Researchers appear very adept at mentally switching between these analysis tasks or stages, and many scientific problems rely on such movement since reaching a solution involves iterating between what the researcher wants to achieve and what can be supported from the data and methods available, and hopefully reaching some middle ground. For example, categories such as those describing land cover introduced in Figure 4.4 are used throughout human and physical geography. As illustrated in Figures 4.2 and 4.3, they are first conceptualized, then synthesized, next applied and subsequently evaluated. There are many ways by which categories can be synthesized (e.g., from theory, directly from observations, from experience) and many theories, methods and datasets by which they may be instantiated and applied. Hence, the process of inference is typically a compromise between data, theory and methods that
Figure 4.5. Other possible paths through the nexus shown in Figure 4.1, beginning with evaluation of results (which proves unsatisfactory in this example) and backtracking through previous states to find and correct problems.
Beyond Tools: Visual Support for the Entire Process of GIScience
91
might take several attempts to converge on a satisfactory outcome (methods used in ways that are consistent with both theory and data). Land cover categories, demographic indicators and eco-regions are all examples where the researcher may go back and forth through exploration, synthesis, analysis and evaluation as their understanding deepens. Of course, there are many more paths than those shown in Figures 4.2 and 4.3 that an investigation might take. Figure 4.5 illustrates one such alternative, starting later in the investigation process with the evaluation of results stage that uncovers some problem, potentially due to inconsistencies in the prior stages. The researcher is now faced with a number of choices to track down and remediate the problem: they could begin with the data, the concepts, the model and so forth.
4.4
Visual Support for Different Kinds of Reasoning
Now let us consider the nature of the reasoning that underlies the tasks that the researcher must undertake, with specific focus on the types of inferential mechanisms that are used in the transition from one state to the next in Figures 4.2, 4.3 and 4.5 (Baker, 1999; Brodaric and Gahegan, 2002). The more we understand about how the researcher is trying to think and what they are attempting to produce, the better we can design suitable visualization tools that support their tasks. Figure 4.6 adds the dominant type of inference undertaken as the researcher engages in each activity (Peirce, 1891). These can be summarized as follows: Deduction: The application of a set of pre-defined rules to data, producing predefined outcomes (e.g., syllogistic logic, rules of the form: if A then B else C). Induction: Generalization from a limited number of examples to a larger population, typically beginning with the construction (learning) of categories followed by their application to a broader collection of data (Gahegan, 2003). For example, classifying the land cover example in w using a small number of training examples. Abduction: The combined act of seeing and explaining, in the sense of observing some specific stimulus and simultaneously finding, or synthesizing, a hypothesis to explain it (Thagard and Shelley, 1997). Sometimes, this is known as the "A-ha!" moment, for example when making sense of an optical illusion. Model-based: Reasoning around and through mental and computationally held models, allowing evaluation to be grounded within structural, causal, and/or functional constraints (Magnani and Nersessian, 2002). An example would be when investigating different climate change scenarios using a global circulation model. Rhetoric: Forms of persuasion such as metaphoric reasoning that are used to justify a stance where formal theory and models cannot fully "prove" correctness - as is the case with many aspects of earth and social science (Covino and Jolliffe, 1995). The arguments in this chapter are largely based on
Smtterplot, grand tour, projection pursuit,
parallel coordinate plot.
Figure 4.6. Scientific activities shown with dominant types of inference undertaken by the analyst (deduction, induction, abduction, rhetoric, modelbased) and examples of current visualization tools (shown in white boxes) and computational tools (shown in black boxes). The question that emerges is “how do we enable the researcher to move between tools that span different activities”?
Beyond Tools: Visual Support for the Entire Process of GIScience
93
rhetorical reasoning (to motivate a more formal approach via model-based reasoning). Figure 4.6 also suggests some possible types of geovisualization tools (white boxes) and statistical-computational tools (black boxes) that "might" facilitate the various activities. These suggestions are made from the author's own experiences and are illustrative, not definitive. Our goal of a more systematic approach to geovisualization might begin by investigating the effectiveness of different existing geovisualization tools and techniques in supporting the different activities shown. Apart from a deeper understanding of the roles that our visualization devices play, this would also suggest tools that need to work directly (interoperate) with each other, that is, coordinate their behavior more closely to help the researcher transition between analysis activities. At a lower level of abstraction, Catherine Plaisant describes a related approach to visualization tool capability via a "data by tasks" taxonomy including seven basic data types and seven basic tasks such as: overview, filter, relate, and extract (Shneiderman, 1998; see Plaisant, this volume (Chapter 3)). This approach provides a framework for measuring the utility of each tool in the context of specific, low-level analysis tasks to be undertaken and the types of data to be analyzed. Figure 4.6 adds to such a framework the high-level analysis activities that the researcher is engaged in, and the types of inference they are attempting to use, the concrete outcomes from these activities and the associated mental knowledge leveraged (Gahegan, 2001). Using these dimensions of: (i) activity, (ii) inference, (iii) outcomes, and (iv) pre-requisite data and knowledge, we can formulate statements that describe the example used above in w such as: A geovisualization tool used for category synthesis must support the inductive formulation of a proposed category, from a multidimensional data-space, based on pre-existing concept(s). This can be contrasted with the current situation we typically face, where our choice of tools is based on more practical considerations such as: tool accessibility, the dimensionality of the data to be visualized and the data importing capabilities. Whereas these are indeed worthwhile considerations, they do not, of themselves, guarantee that the tool we use will help solve the problem we are considering. Such a framework could also support very specific questions that might aid the researcher who does not know which of all the available tools are the most appropriate, such as: What are the individual tasks that comprise inductive category formation and which visual tools can support them? The answer might include tasks such as: (i) inductively defining a category from examples, (ii) removing or dealing with data outliers, (iii) checking for the separability of categories, and so forth.
94
4.5
M. Gahegan
Summary Findings
The discussion presented here can be summarized by the following three major goals, each of which generates a number of significant research challenges as we explore, extend and advance geovisualization. Goal 1. Define a logical framework 2 that provides the conceptual underpinning necessary to "situate" visualization tools and analysis tasks with the scientific activities they empower. a. What is the process, or what are the processes, we are ultimately trying to facilitate? b. What activities within GIScience do we wish to facilitate and how are they interrelated? c. What visual methods and techniques facilitate each of these activities? d. What inferential mechanisms are being employed by the researcher? e. What gaps are evident (where no or few methods are currently available), and where do we have an abundance of methods already?
Goal 2. Adopt an open systems approach to engineering visualization tools, so that systems and platforms do not cause barriers to integration. a. How can the visualization environments and methods be made open and flexible, so that they can be integrated together to support the entire scientific process in an holistic fashion? b. How can systems be open schematically (ensuring that tools can be shared among the research community and that new tools can be added into existing systems as and when they become available)? c. How can systems be open semantically (avoiding or mediating ontological commitments that would otherwise render the tools incommensurate)? Andrienko et al., this volume (Chapter 5) take up this theme of interoperability when considering the issues associated with "Creating Instruments for Ideation" from a number of perspectives.
Goal 3. Devise an infrastructure for coordination between components that draws from the logical framework of Goal 1. a. How can visual tools in a geovisualization environment coordinate their behavior, and specifically support the migration of conceptual understanding (e.g., concepts, models, results) between specific tools? b. What coordination mechanisms are available or can be created to provide the necessary functionality and flexibility? c. What exactly should be coordinated between tools in order to communicate the essence of the science process?
2 Or meta-framework from which alternative frameworks can be synthesized as needed.
Beyond Tools: Visual Support for the Entire Process of GIScience
4.6
95
Concluding Remarks
The GIScience and Information Visualization communities face some difficult challenges regarding the tools and analysis methods that empower science (Bishr, 1998): 9
9
9
Although it is still difficult to share data between researchers and systems, it is even more difficult to share functionality. Many potentially useful tools for spatial analysis, uncertainty modeling, visualization, spatial reasoning, geocomputation and so forth are not portable in the sense that they can be readily shared with others. As a result, a lot of research funding and effort results in outcomes that have reduced practical impact. In our case here, we need to build the necessary standards and infrastructure to better integrate the visual functionality we have separately developed. Perhaps even more importantly, the lack of interoperability means that analyses cannot readily be shared (Goodchild, 2000), and therefore cannot be independently verified or refuted by other scientists. This is a real barrier to scientific progress and credibility. Although we can, and generally do, make our tools available to others, we still lack the means to "wrap" analysis sessions and (say) deploy them on the Internet so others can share (or take issue with) our "Aha!" moments (Takatsuka and Gahegan, 2002). A richer toolbox of methods is only useful if we also can develop ways by which methods can be combined, reconfigured, tested and used that are flexible, interactive and easily deployable (Griss, 2000). Our current diversity of tools is therefore only a potential asset until we work out how to better coordinate their functionality in a meaningful way (such as via the framework suggested here) in order to deploy them effectively.
In short, we have a pressing need to extend beyond classifying visualization tools based on the kinds of data and visual variables they use - to the roles that they play, the inference they enable and hence the analysis activities they facilitate. As GIScience researchers begin to embrace the new paradigm of component engineering, it becomes clear that the advantages on offer could have immense positive impacts on the way in which software is designed, developed and shared (Szyperski, 1997; Wills, 2001). Not least among these is the ability for an entire research community to collaborate in the development of useful functionality, without the need to adopt a common software development environment, or even agree on a specific computational platform. However, component programming and its relation, agent programming, bring into even sharper focus problems related to the ontological commitments held by developers and users and implicitly represented in data and methods (Guarino, 1998a,b; Fonseca and Egenhofer, 1999). The challenge therefore is for us to think more systematically about the science we are trying to support, so that we can better situate the tools we have into the process of science and to orchestrate our efforts more effectively, so that software instruments are developed to support each investigative stage and each style of reasoning. The Open GIS Consortium is now making significant progress towards open GIS functionality and services, developed by
96
M. Gahegan
a community of engaged users (Open GIS Consortium Inc., 2003a-c). Their success is a direct result of carefully designed interface specifications that are made public and adhered to. The geovisualization research community is small by comparison, but this further accentuates the need for the same kind of care and collaboration so that we can leverage the work of others, rather than re-implement it for ourselves.
Acknowledgements Many thanks to the editors, particularly Jason Dykes, who provided much useful feedback, and to GeoVISTA graduate students Xiping Dai and Sachin Oswal who wrote the software shown in Figure 4.4. This research was supported by the National Science Foundation (NSF) under grants BCS-9978052 (HERO), ITR (BCS)-0219025, and ITR (EAR)-0225673 (GEON) and National Institutes of Health (NIH) under Grant # R01 CA95949-01.
References Andrienko, G. L., and Andrienko, N. V., (1999) "Interactive maps for visual data exploration", International Journal Geographic Information Science, 13(4), 355-374. Baker, V., (1996) "Hypotheses and geomorphological reasoning", In: Rhoads, B. L., and Thorn, C. E., (eds.), The Scientific Nature of Geomorphology. New York: Wiley, pp. 57-86. Baker, V., (1999) "Geosemiosis", Geological Society of America Bulletin, 111(5), 633-645. Bishr, Y., (1998) "Overcoming the semantic and other barriers to GIS interoperability", International Journal of Geographical Information Science, 12(4), 299-314. Brodaric, B., and Gahegan, M., (2002) "Distinguishing instances and evidence of geographical concepts for geospatial database design", In: Egenhofer, M., and Mark, D., (eds.), Geographical Information Science - 2nd International Conference, GIScience 2002. Berlin: Springer, pp. 22-37. Cook, D., Majure, J. J., Symanzik, J., and Cressie, N., (1996) "Dynamic graphics in a GIS: exploring and analyzing multivariate spatial data using linked software", Computational Statistics: Special Issue on Computeraided Analysis of Spatial Data, 11 (4), 467-480. Covino, W., and Jolliffe, D., (1995) Rhetoric. Boston, MA: Allyn and Bacon. CSISS (2003). Center for Spatially Integrated Social Science - Select Tools. Online: http://www.csiss.org/clearinghouse/select-tools.php3 (23/10/03). Dykes, J. A., (1996) "Dynamic maps for spatial science: a unified approach to cartographic visualization", In: Parker, D., (ed.), Innovations in Geographical Information Systems 3. London: Francis and Taylor, pp. 171-181. Fonseca, F. T., and Egenhofer, M., (1999) "Ontology-driven geographic information systems", In: Medeiros, C. B., (ed.), Proceedings of the 7th ACM Conference on GIS, Kansas City, MO, pp. 14-19, Online: http://www.spatial.maine.edu/(max/RC39.html
Beyond Tools: Visual Support for the Entire Process of GIScience
97
Gahegan, M., (2001) "Visual exploration in geography: analysis with light", In: Miller, H. J., and Han, J., (eds.), Geographic Data Mining and Knowledge Discovery. London: Taylor and Francis, pp. 260-287. Gahegan, M., (2003) "Is inductive inference just another wild goose (or might it lay the golden egg)?", International Journal of Geographical Information Science, 17(1), 69-92. Gahegan, M., and Brodaric, B., (2002a) "Computational and visual support for geographical knowledge construction: filling in the gaps between exploration and explanation", Advances in Spatial Data Handling, l Oth International Symposium on Spatial Data Handling. New York: Springer-Verlag, pp. 11-26. Gahegan, M., and Brodaric, B., (2002b) "Examining uncertainty in the definition and meaning of geographical categories", In: Hunter, G., and Lowell, K., (eds.), 5th International Symposium on Spatial Accuracy Assessment in Natural Resources and Environmental Sciences, Melbourne, July 10-12. Gahegan, M., Takatsuka, M., Wheeler, M., and Hardisty, F., (2002a) "GeoVISTA Studio: a geocomputational workbench", Computers, Environment and Urban Systems, 26, 267-292. Gahegan, M., Takatsuka, M., Wheeler, M., and Hardisty, F., (2002b) "Introducing GeoVISTA Studio: an integrated suite of visualization and computational methods for exploration and knowledge construction in geography", Computers, Environment and Urban Systems, 26(4), 267-292. Goodchild, M. F., (2000) "Keynotes address", Conference of the Association of American Geographers, Pittsburgh. Griss, M., (2000) My Agent Will Call Your Agent. Online: http://www.sdmagazine.com/articles/2000/0002/0002toc.htm (23/10/03). Guarino, N., (1998a) "Formal ontology and information systems", In: Guarino, N., (ed.), Formal Ontology in Information Systems. Proceedings of FOIS'98, Trento, Italy, June 6-8 1998. Amsterdam: IOS Press, pp. 3-15, Online: http ://www.oceanlaw.net/orgs/maps/ices_map.htm Guarino, N., (1998b) "Formal ontology and information systems", In: Guarino, N., (ed.), Formal Ontology in Information Systems (FOIS'98). Amsterdam: ICES, pp. 3-15, Online: http://www.oceanlaw.net/orgs/maps/ices_map.htm Lucieer, A., and Kraak, M. J., (2002) "Interactive visualization of a fuzzy classification of remotely-sensed imagery using dynamically linked views to explore uncertainty", In: Lowell, G. H. a. K., (ed.), 5th International Symposium on Spatial Accuracy Assessment in Natural Resources and Environmental Sciences, Melbourne, July 10-12, pp. 348-356. MacDougal, E. B., (1992) "Exploratory analysis, dynamic statistical visualization and geographical information systems", Cartography and Geographical Information Systems, 19(4), 237-246. MacEachren, A. M., Edsall, R., Haug, D., Baxter, R., Otto, G., Masters, R., Fuhrmann, S., and Qian, L., (1999a) "Exploring the potential of virtual environments for geographic visualization", Annual Meeting of the Association of American
98
M. Gahegan
Geographers, Honolulu, HI, 23-27 March, AAG, p. 371 (full paper: www.geovista.psu.edu/library/aag99vr). MacEachren, A. M., Edsall, R., Haug, D., Baxter, R., Otto, G., Masters, R., Fuhrmann, S., and Qian, L., (1999b) "Virtual environments for geographic visualization: potential and challenges", Proceedings of the A CM Workshop on New Paradigms in Information Visualization and Manipulation, Kansas City, KS, Nov. 6, 1999. MacEachren, A. M., Wachowicz, M., Edsall, R., Haug, D., and Masters, R., (1999c) "Constructing knowledge from multivariate spatiotemporal data: integrating geographical visualization with knowledge discovery in database methods", International Journal of Geographical Information Science, 13(4), 311-334. Magnani, L., and Nersessian, N. J. E., (2002) Model Based Reasoning: Science, Technology, Values. New York: Kluwer Academic, p. 418. Martin, R. E., (1998) One Long Experiment. New York: Columbia University Press. Monmonier, M., (1990a) "Strategies for the visualization of geographic time-series data", Cartographica, 27(1), 30-45. Monmonier, M. S., (1990b) "Strategies for the interactive exploration of geographic correlation", In: Brassel, K.,and Kishimoto, H.,(eds.), Proceedings 4th International Symposium on Spatial Data Handling, Dept. of Geography, University of Zurich, Switzerland, pp. 381-389. Open GIS Consortium Inc., (2003a) Geographic Objects Initiative (GO-l). Online: http://ip.opengis.org/go 1/(23/10/03). Open GIS Consortium Inc., (2003b) Geography Markup Language (GML 3.0). Online: http://www.opengis.org/docs/02-023r4.pdf (23/10/03). Open GIS Consortium Inc., (2003c) Open GIS Consortium, Inc. (OGC). Online: http://www.opengis.org (23/10/03). Peirce, C. S., (1891) "The architecture of theories", The Monist, 1(161 - 176), 000-000. Popper, K. R., (1959) The Logic of Scientific Discovery. New York: Basic Books. Schumm, S. A., (1991) To Interpret the Earth: Ten ways to Be Wrong. New York: Cambridge University Press. Shneiderman, (1998) Treemaps for Space-Constrained Visualization of Hierarchies. Online: http://www.cs.umd.edu/hcil/treemaps (23/10/03). Shrager, J., and Langley, P. E., (1990) Computational Models of Scientific Discovery and Theory Formation. San Mateo, CA: Morgan Kaufman. Sowa, J. F., (1999) Knowledge Representation: Logical, Philosophical and Computational Foundations. New York: Brooks/Cole. Szyperski, C., (1997) Component Software: Beyond Object-Oriented Programming. New York: ACM Press. Takatsuka, M., and Gahegan, M., (2002) "GeoVISTA Studio: a codeless visual programming environment for geoscientific data analysis and visualization", Computers and Geosciences, 28(10), 1131-1144. Thagard, P., (1988) Computational Philosophy of Science. Cambridge, MA: MIT Press. Thagard, P., and Shelley, C., (1997) "Abductive reasoning: logic, visual thinking, and coherence", In: Dalla Chiara, M.-L. e. a., (ed.), Logic and Scientific Methods. Dordrecht: Kluwer, pp. 413-427.
Beyond Tools: Visual Support for the Entire Process of GIScience
99
Whitehead, A. N., (1938) Adventures of Ideas. New York: Prentice Hall, p. 308. Wiggins, R. D., Beedham, H., Francis, B., Goldstein, H., Hanavy, M., Harman, J., Leyland, A., Musgrave, S., Rasbash, J., and Smith, A. F., (2000) Teaching Resources and Materials for Social Scientists Home page, Online: http://tramss.data-archive.ac.uk/index.asp (23/10/03). Wills, A. C., (2001) "Components and connectors: catalysis techniques for designing component infrastructures", In: Heinenman, G. T., and Councill, W. T., (eds.), Component-Based Software Engineering: Putting the Pieces Together. New York: Addison-Wesley, pp. 307-319.
This Page Intentionally Left Blank
Section B Creating Instruments for Ideation Software Approaches to Geovisualization Perspectives
5. Creating Instruments for Ideation: Software Approaches to Geovisualization Andrienko et al ........................................................................................................................................... 6. Statistical Data Exploration and Geographical Information Visualization Martin Theus .............................................................................................................................................. 7. Graph Drawing Techniques for Geographic Visualization Peter Rodgers .............................................................................................................................................. 8. Exploratory Visualization with Multiple Linked Views Jonathan C. Roberts .................................................................................................................................... 9. Visualizing, Querying and Summarizing Individual Spatio-Temporal Behaviour David Mountain .......................................................................................................................................... 10. Impact of Data and Task Characteristics on Design of Spatio-Temporal Data Visualization Tools Natalia Andrienko, Gennady Andrienko & Peter Gatalsky ...................................................................... 11. Using Multi-agent Systems for GKD Process Tracking and Steering: The Land Use Change Explorer Monica Wachowicz, Xu Ying & Arend Ligtenberg ................................................................................. 12. Signature Exploration, a Means to Improve Comprehension and Choice within Complex Visualization Processes: Issues and Opportunities Penny Noy .................................................................................................................................................. 13. Facilitating Interaction for Geovisualization Jason Dykes ................................................................................................................................................
103 127 143 159 181
201 223
243 265
This Page Intentionally Left Blank
Exploring Geovisualization J. Dykes, A.M. MacEachren, M.-J. Kraak (Editors) 9 2005 Elsevier Ltd. All rights reserved.
Chapter 5
Creating Instruments for Ideation: Software Approaches to Geovisualization Gennady Andrienko & Natalia Andrienko, Fraunhofer AiS - Institute for Autonomous Intelligent Systems, Schloss Birlinghoven, Sankt-Augustin, D-53754, Germany Jason Dykes, David Mountain & Penny Noy, School of Informatics, City University, London EC1V 0HB, UK Mark Gahegan, GeoVISTA Center, Department of Geography, The Pennsylvania State University, University Park, PA 16802, USA Jonathan C. Roberts & Peter Rodgers, Computing Laboratory, University of Kent, Canterbury, Kent CT2 7NF, UK Martin Theus, Department of Computer-Oriented Statistics and Data Analysis, University of Augsburg, Universit~itsstr. 14, 86135 Augsburg, Germany
Keywords: geovisualization, tools, techniques, instruments, ideation, technology, task, data, user, expertise, interoperability
Abstract New visualization techniques are frequently demonstrated and much academic effort goes into the production of software tools to support visualization. Here, the authors of subsequent chapters in this section identify reasons why they continue to enhance and develop the instruments that they design to support the process of geovisualization, justifying their ongoing work and in doing so offering some perspectives on and solutions to the issues that they address. A number of inter-related themes arise including: advances in technology that create opportunities and generate demands for new geovisualization solutions; increasingly rich data sets and sources that drive design due to the associated potential for revealing new structures and relationships; various and novel tasks to which geovisualization is being applied associated with debate and continuing research concerning the kinds of instrument that are required to best undertake particular tasks in particular conditions; an increasingly diverse set of users who require a variety of tools, environments and systems to support ideation in its numerous forms, including those who participate in simulations of visualization when learning; changes in the available expertise that prompt the development of ideas and instruments that borrow from advances and methods in cognate disciplines such 103
104
G. Andrienko et al.
as Cognitive science, Statistics, Information Visualization, Knowledge Discovery and Datamining (KDD), Human-Computer Interaction and Scientific Visualization. Key issues in developing tools that address these requirements are those of interoperability and re-use. The potential advantages for geovisualizers and tool designers of common software approaches and the sharing of ideas are attractive. They allow us to proceed at speed, designing and adjusting our tools and interacting with revealing views of our data to address our objectives of creating superior instruments and enhancing our knowledge of spatio-temporal phenomena. Developing our geovisualization in this way will enable us to participate effectively in the processes of visualization and ideation and advance our science.
5.1
Introduction
During the last decade, numerous geovisualization tools have been developed by various individuals and organizations to support a variety of purposes, for example, (see Gahegan, this volume (Chapter 4)). Many of these have highly interactive and manipulable interfaces and yet we continue to build new tools using a range of technologies and techniques. Why do we invent new instruments? Or why do we need to invent new instruments? There are many possible motivations: 1. 2.
3.
4. 5. 6.
New technology continues to appear and it often enables us to do things that were not possible before. We may be able to acquire data of a new form or quality that cannot be analyzed with existing tools as the data sets may be so large, dense or contain so many dimensions that no current tool supports interactive investigation effectively. As geovisualization becomes more popular and exploited more widely, we encounter new tasks that cannot be performed using existing tools. Effectively geovisualization may be used to address new societal requirements. The particular needs of specific users (from this growing user base) are likely to vary and tools may serve a new or changing user base. Accessing expertise from cognate disciplines may contribute to what already exists and enhance it further. Collaboration between researchers may improve our ability to visualize geographic information and to develop the various instruments that support this process. The notion of interoperability underlies our efforts to develop ideas and generate knowledge from our data using instruments for ideation.
Ideation relates to the formation of ideas and concepts, the end goal of much geovisualization. Today there are many tools and techniques for creating instruments for ideation - sophisticated hardware, advanced programming languages, graphics libraries, visual programming systems and complex GUIs. In each, the developer or visualizer wishes to generate effective interactive graphic realizations of their data that are useful to them and/or their users. Indeed, these geovisualizers will come across many challenges. We suggest six factors that help explain why new tools and techniques may be developed.
Creating Instruments for Ideation: Software Approaches to Geovisualization
In this chapter, we influence and shape exploratory process. chapters that follow
5.2
105
expand upon these ideas and consider how each of these issues the way we use and develop software instruments that support the Some examples of our software approaches are documented in the in this section.
Technology Issues
Current technology has an important enabling and limiting impact upon the available range of instruments for ideation, which changes significantly over time (Cartwright et al., 2001; Fairbairn et al., 2001). In 1854, Dr. John Snow and colleagues manually plotted the locations of deaths from cholera on a paper map in order to show the outspread of the disease (Tufte, 1997; Brodlie et al., 2000). Today, Snow would most likely load these data into a GIS and look at a map display on a computer screen. In 1967, Bertin (Bertin, 1983) described advanced equipment for manipulation of data represented on paper strips or cards. Current computers obviously offer far more sophisticated opportunities for manipulating data representations and interacting with them. It is natural that builders of tools for ideation, either for their own use or for use by others, aim to utilize the most applicable capabilities of the current technologies. A major benefit of contemporary computer technology is the possibility to rapidly generate various graphical displays from data. This gives us an opportunity to try alternative transient realizations of data, discard those deemed ineffectual but when necessary reproduce them again, and look at several displays simultaneously to provide multiple views of data (McCormick et al., 1987; Becker et al., 1987; Stuetzle, 1988; Roberts, 2000). Such techniques are paramount to the process of geovisualization and enable us to address the data, task and user issues that also drive our pursuit of innovative and effective instruments. They have stimulated much of the work reported in this section. We also use advances in technology to store large amounts of data and access them on demand with minimum effort. Moreover, it is increasingly easy and common to obtain additional data when necessary in an analysis, from a range of sources including the Web or from the wireless "information everywhere" devices. The speed of computation that technology now allows enables us to combine visualization with computationally intensive methods of data analysis such as exploratory statistics or datamining: one can rapidly obtain the results of computation and compare them with what is observed or interpret them through depiction on a map or a graph. Of course, interaction and display manipulation play crucial roles in data exploration (MacEachren, 1994a-c). The speed of data access and display generation also allows the development of dynamic representations capable of changing in real time. Thus, dynamic and animated maps are now widespread and offer exciting opportunities for representing geographic data. 3D graphical representations can be realized with relative ease, and are frequently used, for example, (see Wood et al., this volume (Chapter 14)), yet we are only beginning to determine ways to utilize their potency most effectively for data analysis and ideation by developing and testing tools, for example, (see Kirschenbauer, this volume (Chapter 18) and Coors et al., this volume (Chapter 27)).
106
G. Andrienko et al.
It is not only the increase of computer power that offers us new opportunities to create more sophisticated instruments, but also the progress in software environments, such as the development of programming tools that are high level and/or cross platform and the availability of libraries and reusable software components. Examples include the MacroMedia products, Java, Tcl/Tk, the OpenGL libraries and the OpenSource paradigm. These environments and related methods of development have capabilities for visualization and enable us to produce flexible applications that are quickly extensible and may run on a variety of platforms. As a result, more sophisticated and dynamic graphics can be created and widely used. Besides increasing the opportunities, technical progress raises demands and poses challenges that drive our research and the development and testing of our instruments. New types and volumes of data made possible by technological advances may need handling in innovative ways and so require the development of geovisualization techniques (see w The Web not only enables us to obtain more data when needed but also raises issues relating to data merging, data representation, and the analysis of complex, heterogeneous data sets. Moreover, the Internet and other communications technologies such as mobile devices are changing the way people are working. Indeed, mobile devices do not only enable people to compute anywhere and to access data from everywhere but also create a demand for new instruments that are designed specifically for such devices and which can be conveniently and effectively used. In the design of these instruments, one must creatively manage limitations that once appeared to be issues of the past: small screens with low resolution, memory restrictions, limited computational power and reduced possibilities for interaction. The lucrative games industry is beginning to discover the need and market for device specific applications, and work is in progress to take advantage of opportunities for mobile geovisualization, for example, (see Coors et al., this volume (Chapter 27)). Technical progress enables people situated at different physical locations to work cooperatively, hence, there is a demand for geovisualization tools that support this mode of remote collaboration, for example, (see Brodlie et al., this volume (Chapter 21)), which in itself leads to new geovisualization tasks (see w The availability of computers, data, and the Internet encourages more people to do their own exploration and take part in knowledge construction. This calls for the creation of widely accessible instruments (including those available over the Web) that can be operated by users with different levels of sophistication and computer competence. The availability of such tools confronts designers with further challenges. How are such accessible prompts to geovisualization made understandable to a wide and usually unknown audience? Such issues are further explored in w Whilst being convenient for tool developers, modern software consumes far more computer resources than before. In some cases (for example, using Java), it can be argued that the costs of high-level flexible tools are significantly slower software applications than older alternatives written in Fortran, C or C + +. Whilst this issue can be addressed by improvements in processor speeds it is exacerbated when coupled with the "mobile device considerations" introduced above. Code reuse and exchange of components also poses numerous difficulties, some of which are discussed in w below.
Creating Instruments for Ideation: Software Approaches to Geovisualization
107
Hence, we see that technological progress has tremendous influence on the development of instruments for ideation and explains much of the rationale for our work. This influence is two-sided. On the one hand, progress creates new opportunities that may be explored and utilized. On the other hand, it creates new demands that need to be satisfied. The new demands often come together with particular restrictions and considerations that have to be appreciated. In keeping up with new technologies, geovisualizers should not disregard earlier ideas, approaches, and methods. After all, as we have seen, even the idea of manipulating data displays first appeared in the precomputer era. In the current absence of formal theory to guide or prescribe our use of the new opportunities that technology offers to us, existing knowledge and the methods of the present and past provide important resources on which to build our knowledge and techniques (see also w
5.3
Data
Motivation to develop novel graphic representations and interaction techniques can come from the data itself and our abilities to access and use it (Gahegan et al., 2001). Besides increasing the opportunities, technical progress raises demands and poses challenges that drive our research and the development and testing of our instruments. Continuing technological advances have had a profound effect upon the nature and volumes of data available to the geovisualization community. The current ease with which data are recorded and acquired results in huge data volumes that cannot be effectively explored using standard methods of representation and interaction. New data sets are being generated by such diverse applications as mobile communications technology, digital commercial transactions, Web-logging software, traffic monitoring systems, closed circuit television, various flavours of GPS "tagging" and countless others. These data sets often contain spatial and temporal referencing, whether stored explicitly or implicitly, and may benefit from either the development of new visualization techniques or the adoption of techniques from one domain by another. Consequently, a wide range of new media (such as imagery, animations and audio) is increasingly being used, offering the investigator a variety of data models. Encouraging the user to interact with different media can add a qualitative perspective, for instance by representing a phenomenon in context, that quantitative approaches alone may not be able to offer (Shifter, 1995 a,b). The data structure used to represent the phenomena of interest has implications for which visualization techniques are available and appropriate, for example, (see Keim et al., this volume (Chapter 2)). Many structures are static, representing the situation at a single moment or with no reference to time at all. Relationships can be uncovered between different parameters through techniques such as interactive statistical data exploration, but these cannot reveal dynamic processes. Data structures that incorporate time lend themselves to techniques that can represent these dynamic processes. Animation is one approach to showing time elapsing and works well for presenting information about entities evolving under the influence of long-term trends. The progression of urban form is an example (Acevedo and Masuoka, 1997). A current
108
G. Andrienko et al.
challenge lies in enhancing animation tools that simply present patterns to interactive techniques where user-controlled animation allows variable selection and control over a dynamic display to compare the behaviour of different entities over the same time period (Andrienko and Andrienko, 1999a-e; Rana and Dykes, 2003; see Andrienko et al., this volume (Chapter 10)). Time can also be represented without the need for animation. In particular, spatial plots can be combined with temporal plots to allow simultaneous interaction with both space and time. Such approaches have a long history, and include another much cited graphic that pre-dates computer supported visualization, Minard's depiction of Napoleon's Russian campaign (Tufte, 1983), but have now evolved into interactive approaches allowing selection for comparison and focus (Peuquet and Kraak, 2002; Andrienko et al., 2003). Whether a discrete or continuous data structure has been used also has implications for the visualization techniques that are applicable. Discrete approaches are more appropriate for modelling and analysis of entities, such as the movement of individuals or groups. Continuous structures, such as elevation models and point density surfaces, are more appropriate for representing the wider trends over an area: representation of and interaction with these models is quite distinct to discrete approaches. This continuous sampling strategy can generate very large datasets, often only a small subset of which is relevant to the task being undertaken by a particular user. Abstracting the relevant information from the continuous model at the appropriate scale can reduce data volume and prevent the "information overload" associated with very large datasets (Rana and Dykes, 2001). Moreover, there is a need to store these large structured volumes of data in appropriate databases such that the information is readily available and integrated with appropriate mining and visualization tools (Gahegan et al., 2001). As indicated above, the automated collection of data has become increasingly commonplace leading to a massive increase in the volumes of data that are generated. Such datasets may contain much richer information that can be revealed through most current visualization techniques, requiring the development of new methods and instruments that draw upon them. Various methods have been applied to address this particular problem. Classification by aggregating a collection of samples into a single entity, or by using pruning methods for hierarchical data, can allow large data volumes to be represented more clearly (Kumar et al., 1997). However, these aggregate entities may have different characteristics to the individual entities they represent and a dual approach may have to be adopted if the same interaction technique is to be implemented for source and aggregated data. Under these circumstances, the experience that geo-scientists have in dealing with issues of scale and scale-dependent phenomena, and their visualization could be beneficial to a wider community (for example, see Wood, this volume (Chapter 15)). Classification can also facilitate or even permit interaction with large data volumes. When interacting with a very large number of graphic elements in a display, processing time can otherwise prevent a technique from supporting the real-time interaction required for visualization (see Theus, this volume (Chapter 6)). Here, we see a clear association between the data and technology considerations that influence the instruments that we develop and the techniques that we use.
Creating Instruments for Ideation: Software Approaches to Geovisualization
109
As is the case on paper, on-screen realizations of large data sets can cause particular problems for the viewer in detecting and discerning the symbols used, assembling them into patterned regularities and estimating the magnitudes that they represent (Cleveland, 1993). Interesting trends may be lost through over plotting and the magnitude and distribution of outliers. Various graphic and software techniques can be implemented (Theus, this volume (Chapter 6)). One approach is to summarize key trends: for example GPS track logs representing individual movement can be used to generate point-density surfaces giving a representation of where an individual spends their time and their familiarity with specific locations from which information can be extracted (Dykes and Mountain, 2003; Mountain, this volume (Chapter 9)). arunselvaminThe phenomena that geovisualizers usually study exist in a spacetime framework. Static 2D maps that offer an impression of a complex 3D space at a particular time rely upon dimension reduction. Much cartographic effort has always gone into minimizing the impact of reduction upon the anticipated tasks to which the map is put. However, geovisualization techniques can be applied to data that have no spatial or temporal dimensions. A 2D surface can be generated by principle components analysis and geovisualization interaction techniques applied to it. Similarly, clusters in selforganizing maps are described in terms of distance, however none of the original dimensions that led to the map need relate to spatial metrics (for example, see Koua and Kraak, this volume (Chapter 33)). The results of techniques that use this spatialization (Fabrikant, 2000a,b) aim to utilize human abilities to interpret landform and interacting with non-spatial data in this way may offer new insight (for example, see Fabrikant and Skupin, this volume (Chapter 35)). Thus, a clear opportunity exists to explore the utility of such techniques and develop new instruments of ideation specifically for spatialization. Each graphic depiction of a data model that we develop is one of an infinite number of alternative views. Individuals developing geovisualization techniques are often attempting to display a single specific relationship at the expense of other trends and background noise. Successive transitory screen realizations designed for private "idea chasing" are not intended to communicate a single message about the data to a wide audience as has been the case with many traditional maps. The increasingly rich and potentially revealing data sets becoming available are leading to an increasing number of abstract, novel and interactive graphic realizations of data sets being developed by those creating instruments for ideation.
5.4
Tasks
Whilst technological advances and the availability of new data drive a need for new views, Casner (1991) convincingly demonstrates that the same data need to be represented in different ways using different views in order to effectively serve different information needs. The information needs that require these views are defined by different tasks. Casner considers examples of tasks such as planning a journey from city A to city B with a stopover in city C (where one has an appointment for a particular time) and finding the cheapest flight or most direct travel route. For each task, he proposes a graphical display that allows it to be effectively fulfilled. There is no "ideal" graphic