Astrophysics and Space Science Proceedings
The Cluster Active Archive Studying the Earth’s Space Plasma Environment
Harri Laakso Editor ESA/ESTEC, Noordwijk, The Netherlands
Matthew G.T.T. Taylor Editor ESA/ESTEC, Noordwijk, The Netherlands
C. Philippe Escoubet Editor ESA/ESTEC, Noordwijk, The Netherlands
123
Editors Dr. Harri Laakso European Space Agency European Space Research & Technology Centre (ESTEC) Keplerlaan 1 2200 AG Noordwijk Netherlands
[email protected]
Dr. C. Philippe Escoubet European Space Agency European Space Research & Technology Centre (ESTEC) Keplerlaan 1 2200 AG Noordwijk Netherlands
[email protected]
Dr. Matthew Taylor European Space Agency European Space Research & Technology Centre (ESTEC) Keplerlaan 1 2200 AG Noordwijk Netherlands
[email protected]
ISSN 1570-6591 e-ISSN 1570-6605 ISBN 978-90-481-3498-4 e-ISBN 978-90-481-3499-1 DOI 10.1007/978-90-481-3499-1 Springer Dordrecht Heidelberg London New York Library of Congress Control Number: 2009934513 c Springer Science+Business Media B.V. 2010 ° No part of this work may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, electronic, mechanical, photocopying, microfilming, recording or otherwise, without written permission from the Publisher, with the exception of any material supplied specifically for the purpose of being entered and executed on a computer system, for exclusive use by the purchaser of the work. Cover design: eStudio Calamar S.L. Printed on acid-free paper Springer is part of Springer Science+Business Media (www.springer.com)
Preface
Magnetospheric physics started more than 50 years ago when many of the first satellites carried detectors to explore the space environment around the Earth and made plenty of new discoveries. The first findings inspired the development of a plethora of scientific satellites in the 1960s and 1970s exploring near-Earth space, which was found to have several distinct regions with their own structural and dynamical characteristics. Since then magnetospheric physics has remained a strong space science discipline, not only for its own sake but also because near-Earth space provides us with a unique space laboratory where we can investigate physical processes of tenuous collisionless plasmas with in-situ instruments and apply the resulting understanding to physical phenomena observed in more exotic environments of the Solar System and of the Universe. For long time magnetospheric research was carried out only by means of single spacecraft. In the 1970s the science community realized that one needs coordinated simultaneous observations from several satellites in order to make a major step forward in magnetospheric and space plasma physics. In particular the ISEE (three satellites), GEOS (two satellites) and DE (two satellites) programs provided many new discoveries that single spacecraft measurements could not achieve. In particular it was the dual spacecraft constellation of ISEE-1 and ISEE-2 that offered the first opportunity to improve the understanding of spatio-temporal features in physical processes of space environment while the other previous missions were separated by very large distances and were on different orbits, so one could not separate spatial and temporal features. In early 1980s the science community started dreaming about the next generation of multi-satellite constellation mission, the culmination of which came in 1982 when a group of scientists proposed a four-satellite mission, called Cluster, to ESA. After the assessment studies, the Cluster mission, together with the SOHO mission, were selected as the first cornerstone of the ESA’s Horizons 2000 Programme in 1986. Unfortunately, after 10 years of hard work the Cluster satellites were dramatically destroyed by the failure of the first flight of Ariane 5 on 4 June 1996. However, it was decided soon after that the mission was of such high importance to the science community that the satellites and payload must be rebuilt, and 4 years later the four Cluster spacecraft were successfully launched in pairs on two Soyuz rockets in July and August 2000. After 1 year of successful operations, the mission was extended
v
vi
Preface
for an additional 35 months, up to December 2005. Later the mission was further extended for 4 years until the end of 2009, and a new extension proposal has been submitted to request further operations beyond 2009. During the first extension, ESA decided to establish the Cluster Active Archive (CAA) to contain all processed and validated high-resolution scientific data, as well as raw data, calibration data and documentation from all the Cluster instruments. This is essential in order to preserve all Cluster observations in a stable, long-term archive for scientific analysis well beyond the end of the mission. The CAA activities started in 2004 and 2 years later in February 2006, the CAA opened services to the community. The Cluster mission has held science workshops twice a year since autumn 2001, which has helped bring together scientists to compare and exchange their observations and begin new collaborations. Before the CAA, scientists got access to the Cluster observations via their personal contacts with the instrument Principal Investigators and Co-Investigators. Now and in the future, the CAA provides the primary access route to the Cluster observations. Soon after the CAA opening it was realized that while some of the Cluster datasets are quite easy to use, there are plenty of complex datasets whose usage may not always be obvious. Therefore it was decided to organize a school for the users of the CAA datasets, which was organized together with the 15th Cluster science workshop in order to attract as many users as possible. The details of this and other workshops can be found at the CAA website http://caa.estec.esa.int/. The 15th Cluster workshop, attended by 120 people, was held in Hotel Playa la Arena (Puerto Santiago), Tenerife, Canary Islands, on 9–15 March 2008. The workshop provided the attending community with an in-depth overview of the CAA data products and tools. In addition, attendees were able to discuss with instrument team developers, the core CAA team and software developers. The packed schedule included presentations of instrument datasets, software tools and the CAA infrastructure and was interspersed with invited scientific talks and several dedicated science sessions on the bow shock, solar wind, magnetopause and cusp, the magnetotail and inner magnetosphere. The fact that the workshop/school was hosted in the same location as the accommodation was fundamental in the success of the meeting, allowing attendees to continue working with colleagues and discussing work in and around the workshop hours. This book contains presentations made at the workshop, including several articles about the CAA and its datasets as well as a few overview papers on the Cluster mission. In addition all participants were offered an opportunity to publish their scientific results on solar wind/magnetosheath, magnetopause, and magnetotail, presented during the workshop in this book. We would like to thank the following people for their contributions in reviewing the articles in this book: O. Alexandrova, A. Allen, M. Andr´e, T. Asikainen, ˚ A. Asnes, R. Benson, J. Blecki, J. Borovsky, D. Burgess, J. Cao, N. CornilleauWehrlin, P. Daly, I. Dandouras, J. Davies, M. Dunlop, J. Eastwood, S. Elkington, A. Eriksson, J. Faden, A. Fazakerley, J. Fennell, R. Friedel, T. Fritz, S. Fung, E. Gamby, V. G´enot, M. Goldstein, E. Grigorenko, B. Grison, M. Hapgood,
Preface
vii
C. Harvey, R. Horne, C. Jacquey, Y. Khotyaintsev, L. Kistler, H. Kucharek, G. Le, E. Lucek, J. McFadden, S. Milan, F. Mozer, J. Mukherjee, H. Opgenoorth, C. Owen, G. Parks, M. Parrot, A. Pedersen, C. Perry, J. Pickett, P. Puhl-Quinn, J. Rae, J.L. Rauch, A. Retino, A. Roux, V. Sergeev, A. Tjulin, K. Torkar, K. Trattner, A. Walsh, Y. Wang, J. Weygand, J. Wild, and Q. Zong. May 2009
Harri Laakso, Matthew G.T.T Taylor, and Philippe Escoubet
View on the Tenerife Island
Contents
Preface .. . . . . . . . . . . . . . . . .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . .
v
Part I Products and Services of the Cluster Active Archive 1
Cluster Active Archive: Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . . H. Laakso, C. Perry, S. McCaffrey, D. Herment, A.J. Allen, C.C. Harvey, C.P. Escoubet, C. Gruenberger, M.G.G.T. Taylor, and R. Turner
3
2
ASPOC Data Products in the Cluster Active Archive . . . . . . . . .. . . . . . . . . . . 39 K. Torkar and H. Jeszenszky
3
Cluster Ion Spectrometry (CIS) Data in the Cluster Active Archive (CAA) . . .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . . 51 I. Dandouras, A. Barthe, E. Penou, S. Brunato, H. R`eme, L.M. Kistler, M.B. Bavassano-Cattaneo, A. Blagau, and the CIS Team
4
Digital Wave Processor Products in the Cluster Active Archive .. . . . . . . . . . .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . . 73 K.H. Yearby, H.St.C. Alleyne, S.N. Walker, I. Bates, M.P. Gough, A. Buckley, and T.D. Carozzi
5
EDI Data Products in the Cluster Active Archive . . . . . . . . . . . . .. . . . . . . . . . . 83 E. Georgescu, P. Puhl-Quinn, H. Vaith, M. Chutter, J. Quinn, G. Paschmann, and R. Torbert
6
The EFW Data in the CAA .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . . 97 Y. Khotyaintsev, P.-A. Lindqvist, A. Eriksson, and M. Andr´e
7
FGM Data Products in the CAA .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . .109 J.M. Gloag, E.A. Lucek, L.-N. Alconcel, A. Balogh, P. Brown, C.M. Carr, C.N. Dunford, T. Oddy, and J. Soucek
ix
x
Contents
8
PEACE Data in the Cluster Active Archive . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . .129 A.N. Fazakerley, A.D. Lahiff, R.J. Wilson, I. Rozum, C. Anekallu, M. West, and H. Bacai
9
RAPID Products at the Cluster Active Archive .. . . . . . . . . . . . . . .. . . . . . . . . . .145 Patrick W. Daly and Elena A. Kronberg
10 STAFF Instrument Products Distributed Through the Cluster Active Archive .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . .159 N. Cornilleau-Wehrlin, L. Mirioni, P. Robert, V. Bouzid, M. Maksimovic, Y. de Conchy, C.C. Harvey, and O. Santol´ık 11 Cluster Wideband Data Products in the Cluster Active Archive .. . . . . . . . . . .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . .169 J.S. Pickett, J.M. Seeberger, I.W. Christopher, O. Santol´ık, and K.M. Sigsbee 12 The WHISPER Relaxation Sounder and the CLUSTER Active Archive. . . .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . .185 J.G. Trotignon, P.M.E. D´ecr´eau, J.L. Rauch, X. Valli`eres, A. Rochel, S. Kougbl´enou, G. Lointier, G. Facsk´o, P. Canu, F. Darrouzet, and A. Masson 13 ESOC Data Products in the CAA . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . .209 J. Volpp and D. Sieg Part II Tools for the CAA Data Analysis 14 QSAS, QM Science Analysis Software . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . .225 A.J. Allen 15 Flexible Tools for Accessing the Cluster Archives . . . . . . . . . . . . .. . . . . . . . . . .233 E. Gamby, J. De Keyser, and M. Roth 16 AMDA, Automated Multi-Dataset Analysis: A Web-Based Service Provided by the CDPP .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . .239 C. Jacquey, V. G´enot, E. Budnik, R. Hitier, M. Bouchemit, M. Gangloff, A. Fedorov, B. Cecconi, N. Andr´e, B. Lavraud, C. Harvey, F. D´eriot, D. Heulet, E. Pallier, E. Penou, and J.L. Pinc¸on 17 Cluster CAA Module for PaPCo .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . .249 ˚ J. Faden, A. Asnes, R. Friedel, M. Taylor, S. McCaffrey, C. Perry, and M.L. Goldstein
Contents
Part III
xi
Measurement Techniques and Calibration Routines
18 Electron Density Estimation in the Magnetotail: a Multi-Instrument Approach.. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . .261 A. Masson, O. Santol´ık, M.G.G.T. Taylor, C.P. Escoubet, ˚ A.N. Fazakerley, J. Pickett, A. Asnes, X. Valli`eres, H. Laakso, and J.-G. Trotignon 19 Cluster-PEACE In-flight Calibration Status . . . . . . . . . . . . . . . . . . .. . . . . . . . . . .281 A.N. Fazakerley, A.D. Lahiff, I. Rozum, D. Kataria, H. Bacai, ˚ C. Anekallu, M. West, and A. Asnes 20 Generation and Validation of Ion Energy Spectra Based on Cluster RAPID and CIS Measurements . . . . . . . . . . . . .. . . . . . . . . . .301 Elena A. Kronberg, Patrick W. Daly, Iannis Dandouras, Stein Haaland, and Edita Georgescu Part IV
Magnetospheric Missions
21 The Cluster Mission: Space Plasma in Three Dimensions . . . .. . . . . . . . . . .309 M.G.G.T. Taylor, C.P. Escoubet, H. Laakso, A. Masson, and M.L. Goldstein 22 Double Star: Mission, Instruments and Joint Observations ... . . . . . . . . . .331 M.W. Dunlop, C.P. Escoubet, Z.-X. Liu, C. Shen, H. Laakso, M.G.G.T. Taylor, A.N. Fazakerley, and the Double star PIs Part V
Observations of Solar Wind and Magnetosheath
23 Effect of Shock Normal Orientation Fluctuations on Field-Aligned Beam Distributions. . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . .349 K. Meziane, A.M. Hamza, M. Wilber, M.A. Lee, C. Mazelle, E.A. Lucek, T. Hada, and A. Markowitch 24 Wave Number Spectra in the Solar Wind, the Foreshock, and the Magnetosheath . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . .363 Y. Narita, K.-H. Glassmeier, S.P. Gary, M.L. Goldstein, and R.A. Treumann 25 Cluster Hot Flow Anomaly Observations During Solar Cycle Minimum . .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . .369 G. Facsk´o, M. T´atrallyay, G. Erd˝os, and I. Dandouras
xii
Contents
26 On the Growth of Mirror Mode Waves in the Magnetosheath Based on Cluster Observations . . . . . . . .. . . . . . . . . . .377 M. T´atrallyay, G. Erd˝os, I. Dandouras, and E. Georgescu Part VI Observations of Magnetopause and Cusp 27 Mixed Azimuthal Scales of Flux Transfer Events . . . . . . . . . . . . . .. . . . . . . . . . .389 R.C. Fear, S.E. Milan, E.A. Lucek, S.W.H. Cowley, and A.N. Fazakerley 28 Perspectives Gained from a Combination of Polar, Cluster and ISEE Energetic Particle Measurements in the Dayside Cusp . . . . . . . . . . . . . . .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . .399 T.A. Fritz 29 Energetic Particles in the Cusp: A Cluster/RAPID View . . . . .. . . . . . . . . . .415 T. Asikainen Part VII Observations of Magnetospheric Tail 30 Plasma Flow Reversals in the Magnetotail and Their Implications on Substorm Models. . . . . . . . . . . . . . . . . . .. . . . . . . . . . .429 A.T.Y. Lui 31 Spatial and Temporal Structures in the Vicinity of the Earth’s Tail Magnetic Separatrix Cluster Observations .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . .435 E.E. Grigorenko, L.M. Zelenyi, M.S. Dolgonosov, and J.-A. Sauvaud 32 Cluster Observations of Energy Conversion Regions in the Plasma Sheet .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . .453 O. Marghitu, M. Hamrin, B. Klecker, K. R¨onnmark, S. Buchert, L.M. Kistler, M. Andr´e, and H. R`eme 33 Acceleration of > 40 keV Electrons in Near-Earth Magnetotail Reconnection Events . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . .461 ˚ A. Asnes, M.G.G.T. Taylor, and A.L. Borg 34 Evolution and Energization of Energetic Electrons in the Inner Magnetosphere . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . .467 J.F. Fennell and J.L. Roeder
Contributors
L.-N. Alconcel Space and Atmospheric Physics, The Blackett Laboratory, Imperial College, London, SW7 2BW, UK A.J. Allen Blacket Laboratory, Imperial College, London, SW7 2AZ, UK,
[email protected] H.St.C. Alleyne Department of Automatic Control and Systems Engineering, University of Sheffield, Mappin Street, Sheffield, S1 3JD, UK,
[email protected] M. Andr´e Swedish Institute of Space Physics, Uppsala, Sweden N. Andr´e CDPP/CESR, CNRS/Universit´e Paul Sabatier, 9, avenue du colonel Roche, 31028 Toulouse, France C. Anekallu Mullard Space Science Laboratory, University College London, UK T. Asikainen Department of Physics Centre of Excellence in Research, P.O. Box 3000, FIN-90014, University of Oulu, Finland,
[email protected] ˚ A. Asnes ESA/ESTEC, Noordwijk, The Netherlands,
[email protected] H. Bacai Mullard Space Science Laboratory, University College London, UK A. Balogh Space and Atmospheric Physics, The Blackett Laboratory, Imperial College, London, SW7 2BW, UK and International Space Science Institute (ISSI), Hallerstrasse 6, 3012 Bern, Switzerland A. Barthe Universit´e de Toulouse, Centre d’Etude Spatiale des Rayonnements, B.P. 44346, 31028 Toulouse, France and AKKA Technologies, 6 Rue R. Camboulives, 31036 Toulouse, France,
[email protected] I. Bates Department of Automatic Control and Systems Engineering, University of Sheffield, Mappin Street, Sheffield, S1 3JD, UK
xiii
xiv
Contributors
M.B. Bavassano-Cattaneo Istituto di Fisica dello Spazio Interplanetario, INAF, Via del Fosso del Cavaliere 100, 00133 Roma, Italy,
[email protected] A. Blagau Institute of Space Sciences, P.O. Box MG-23, RO 77125 BucharestMagurele, Romania,
[email protected] A.L. Borg Norwegian Defense Research Institute, Kjeller, Norway M. Bouchemit CDPP/CESR, CNRS/Universit´e Paul Sabatier, 9, avenue du colonel Roche, 31028 Toulouse, France V. Bouzid Laboratoire de Physique des Plasmas, Ecole Polytechnique, UPMC, CNRS, route de Saclay, 91128 Palaiseau, France P. Brown Space and Atmospheric Physics, The Blackett Laboratory, Imperial College, London, SW7 2BW, UK S. Brunato Universit´e de Toulouse, Centre d’Etude Spatiale des Rayonnements, B.P. 44346, 31028 Toulouse, France and Noveltis, 2 Avenue de l’Europe, 31520 Ramonville-Saint-Agne, France,
[email protected] S. Buchert Swedish Institute of Space Physics, Uppsala, Sweden A. Buckley Space Science Group, University of Sussex, Falmer, Brighton, BN1 9QH, UK,
[email protected] E. Budnik Noveltis, 2, Avenue Europe, 31520 Ramonville Saint Agne, France P. Canu Laboratoire de Physique des Plasmas, V´elizy, France,
[email protected] T.D. Carozzi Space Science Group, University of Sussex, Falmer, Brighton, BN1 9QH, UK,
[email protected] C.M. Carr Space and Atmospheric Physics, The Blackett Laboratory, Imperial College, London, SW7 2BW, UK B. Cecconi LESIA, Observatoire de Paris-Meudon, 5, place Janssen, 92195 Meudon I.W. Christopher Department of Physics and Astronomy, The University of Iowa, Iowa City, 52240, USA M. Chutter University of New Hampshire, Durham, USA,
[email protected] N. Cornilleau-Wehrlin Laboratoire de Physique des Plasmas, Ecole Polytechnique, UPMC, CNRS, route de Saclay, 91128 Palaiseau, France and Station de Radioastronomie de Nanc¸ay, 18330 Nancay, France,
[email protected]
Contributors
xv
S.W.H. Cowley University of Leicester, UK I. Dandouras Universit´e de Toulouse, Centre d’Etude Spatiale des Rayonnements, B.P. 44346, 31028 Toulouse, France,
[email protected] F. Darrouzet Institut d’A´eronomie Spatiale de Belgique, Bruxelles, Belgique,
[email protected] J. De Keyser Belgian Institute for Space Aeronomy, Brussels, Belgium P.M.E. D´ecr´eau Laboratoire de Physique et Chimie de l’Environnement et de l’Espace, Universit´e d’Orl´eans, Orl´eans, France,
[email protected] F. D´eriot CNES, Centre spatial de Toulouse, 18 avenue E. Belin, 31401 Toulouse, France M.S. Dolgonosov Space Research Institute of RAS, Moscow, Profsoyuznaya str, 84/32, Russia C.N. Dunford Space and Atmospheric Physics, The Blackett Laboratory, Imperial College, London, SW7 2BW, UK M.W. Dunlop SSTD, Rutherford Appleton Laboratory, Chilton, Didcot, Oxfordshire, OX11 0QX, UK,
[email protected] G. Erd˝os KFKI Research Institute for Particle and Nuclear Physics, H-1525 Budapest, P.O. Box 49, Hungary A. Eriksson Swedish Institute of Space Physics, Uppsala, Sweden C.P. Escoubet European Space Agency, ESTEC, D-SRE, Keplerlaan 1, 2200 AG Noordwijk, The Netherlands G. Facsk´o Laboratoire de Physique et Chimie de l’Environnement et de l’Espace, Universit´e d’Orl´eans, Orl´eans, France and KFKI Research Institute for Particle and Nuclear Physics, H-1525 Budapest, P.O. Box 49, Hungary,
[email protected] J. Faden Cottage Systems, Iowa City, IA, USA,
[email protected] A.N. Fazakerley Mullard Space Science Laboratory, University College London, Dorking, Surrey, RH5 6NT, UK,
[email protected] R.C. Fear University of Leicester, UK,
[email protected] A. Fedorov CDPP/CESR, CNRS/Universit´e Paul Sabatier, 9, avenue du colonel Roche, 31028 Toulouse, France J.F. Fennell The Aerospace Corporation, P.O. Box 92957, Los Angeles, CA 90009, USA,
[email protected] R. Friedel Los Alamos National Labs, Los Alamos, NM, USA T.A. Fritz Center for Space Physics, Boston University, Boston, MA 02215 USA,
[email protected]
xvi
Contributors
E. Gamby Belgian Institute for Space Aeronomy, Brussels, Belgium,
[email protected] M. Gangloff CDPP/CESR, CNRS/Universit´e Paul Sabatier, 9, avenue du colonel Roche, 31028 Toulouse, France V. G´enot CDPP/CESR, CNRS/Universit´e Paul Sabatier, 9, avenue du colonel Roche, 31028 Toulouse, France E. Georgescu Max-Planck-Institute for Solar Research, Katlenburg-Lindau, Germany,
[email protected] J.M. Gloag Space and Atmospheric Physics, The Blackett Laboratory, Imperial College, London, SW7 2BW, UK M.L. Goldstein Geospace Physics Laboratory, NASA Goddard Space Flight Center, Code 673, Greenbelt, MD 20771, USA M.P. Gough Space Science Group, University of Sussex, Falmer, Brighton, BN1 9QH, UK,
[email protected] E.E. Grigorenko Space Research Institute of RAS, Moscow, Profsoyuznaya str, 84/32, Russia,
[email protected] C. Gruenberger European Space Agency, ESTEC, Noordwijk, The Netherlands T. Hada ESST, Kyushu University, Fukuora, Japan M. Hamrin Department of Physics, Ume˚a University, Ume˚a, Sweden and Swedish Institute of Space Physics, Ume˚a, Sweden A.M. Hamza Physics Department, University of New Brunswick, Canada C.C. Harvey Centre de Donn´ees de Physique des Plasmas, CNRS, Toulouse, France D. Herment European Space Agency, ESTEC, Noordwijk, The Netherlands D. Heulet CNES, Centre spatial de Toulouse, 18 avenue E. Belin, 31401 Toulouse, France R. Hitier Co-Libri, Cremefer 11290 Montr´eal, France C. Jacquey CDPP/CESR, CNRS/Universit´e Paul Sabatier, 9, avenue du colonel Roche, 31028 Toulouse, France,
[email protected] H. Jeszenszky Space Research Institute, Austrian Academy of Sciences, Schmiedlstrasse 6, 8042 Graz, Austria D. Kataria Mullard Space Science Laboratory, University College London, UK Y. Khotyaintsev Swedish Institute of Space Physics, Uppsala, Sweden,
[email protected] L.M. Kistler Space Science Center, University of New Hampshire, Durham, NH 03824, USA,
[email protected]
Contributors
xvii
B. Klecker Max-Planck-Institut f¨ur extraterrestrische Physik, Garching, Germany S. Kougbl´enou Laboratoire de Physique et Chimie de l’Environnement et de l’Espace, Universit´e d’Orl´eans, Orl´eans, France,
[email protected] H. Laakso European Space Agency, ESTEC, D-SRE, Keplerlaan 1, 2200 AG Noordwijk, The Netherlands,
[email protected] A.D. Lahiff Mullard Space Science Laboratory, University College London, UK B. Lavraud CDPP/CESR, CNRS/Universit´e Paul Sabatier, 9, avenue du colonel Roche, 31028 Toulouse, France M.A. Lee Space Science Center, University of New Hampshire, Durham, USA P.-A. Lindqvist Royal Institute of Technology, Stockholm, Sweden Z.-X. Liu Centre for Space Science and Applied Research, Chinese Academy of Sciences, Beijing 100080, China G. Lointier Laboratoire de Physique et Chimie de l’Environnement et de l’Espace, Universit´e d’Orl´eans, Orl´eans, France,
[email protected] E.A. Lucek Space and Atmospheric Physics, The Blackett Laboratory, Imperial College, London, SW7 2BW, UK,
[email protected] A.T.Y. Lui The Johns Hopkins University Applied Physics Laboratory, Laurel, MD 20723, USA,
[email protected] M. Maksimovic LESIA, Observatoire de Paris-Meudon, 5 place Jules Jansen, 92195 Meudon Cedex, France O. Marghitu Institute for Space Sciences, Bucharest, Romania and Max-Planck-Institut f¨ur extraterrestrische Physik, Garching, Germany,
[email protected] A. Markowitch Laboratoire de Physique et Astroparticules, Universit´e de Montpellier, France A. Masson RSSD, ESA, Noordwijk, The Netherlands and ESA/ESTEC, D-SRE, Keplerlaan 1, 2200 AG Noordwijk, The Netherlands,
[email protected] C. Mazelle Centre d’Etudes Spatiales des Rayonnements, Toulouse, France S. McCaffrey European Space Agency, ESTEC, Noordwijk, The Netherlands K. Meziane Physics Department, University of New Brunswick, Canada,
[email protected] L. Mirioni Laboratoire de Physique des Plasmas, Ecole Polytechnique, UPMC, CNRS, route de Saclay, 91128 Palaiseau, France
xviii
Contributors
T. Oddy Space and Atmospheric Physics, The Blackett Laboratory, Imperial College, London, SW7 2BW, UK E. Pallier CDPP/CESR, CNRS/Universit´e Paul Sabatier, 9, avenue du colonel Roche, 31028 Toulouse, France G. Paschmann Max-Planck-Institute for Extraterrestrial Physics, Garching, Germany,
[email protected] E. Penou Universit´e de Toulouse, Centre d’Etude Spatiale des Rayonnements, B.P. 44346, 31028 Toulouse, France and CDPP/CESR, CNRS/Universit´e Paul Sabatier, 9, avenue du colonel Roche, 31028 Toulouse, France,
[email protected] C. Perry Rutherford Appleton Laboratory, Chilton, Didcot, Oxon, UK J.S. Pickett Department of Physics and Astronomy, The University of Iowa, Iowa City, 52240, USA,
[email protected] J.L. Pinc¸on LPCE, Laboratoire de Physique et Chimie de l’Environnement, 45071 Orl´eans, France P. Puhl-Quinn University of New Hampshire, Durham, USA,
[email protected] J. Quinn Boston University, Boston, MA, USA,
[email protected] J.L. Rauch Laboratoire de Physique et Chimie de l’Environnement et de l’Espace, Universit´e d’Orl´eans, Orl´eans, France,
[email protected] P. Robert Laboratoire de Physique des Plasmas, Ecole Polytechnique, UPMC, CNRS, route de Saclay, 91128 Palaiseau, France A. Rochel Laboratoire de Physique et Chimie de l’Environnement et de l’Espace, Universit´e d’Orl´eans, Orl´eans, France,
[email protected] J.L. Roeder The Aerospace Corporation, P.O. Box 92957, Los Angeles, CA 90009, USA K. R¨onnmark Department of Physics, Ume˚a University, Ume˚a, Sweden M. Roth Belgian Institute for Space Aeronomy, Brussels, Belgium H. R`eme Universit´e de Toulouse, Centre d’Etude Spatiale des Rayonnements, B.P. 44346, 31028 Toulouse, France and CNRS, UMR 5187, B.P. 44346, 31028 Toulouse, France,
[email protected] I. Rozum Mullard Space Science Laboratory, University College London, UK
Contributors
xix
O. Santol´ık Department of Physics and Astronomy, The University of Iowa, Iowa City, Iowa, 52240, USA and Institute of Atmospheric Physics, ASCR, Bocni II/1401, CZ-14131 PRAHA 4, Czech Republic and Institute of Atmospheric Physics and Charles University, Faculty of Mathematics and Physics, Prague, 18000, Czech Republic J.-A. Sauvaud Centre d’Etudie Spatial des Rayonnements, Toulouse cedex4, France J.M. Seeberger Department of Physics and Astronomy, The University of Iowa, Iowa City, 52240, USA C. Shen Centre for Space Science and Applied Research, Chinese Academy of Sciences, Beijing 100080, China D. Sieg Hewlett-Packard GmbH at European Space Operations Centre,
[email protected] K.M. Sigsbee Department of Physics and Astronomy, The University of Iowa, Iowa City, 52240, USA J. Soucek Department of Space Physics, Institute of Atmospheric Physics, Academy of Sciences of the Czech Republic, Prague, Czech Republic M. T´atrallyay KFKI Research Institute for Particle and Nuclear Physics, H-1525 Budapest, P.O. Box 49, Hungary,
[email protected] M.G.G.T. Taylor European Space Agency, ESTEC, Noordwijk, The Netherlands,
[email protected] R. Turner European Space Agency, ESTEC, Noordwijk, The Netherlands R. Torbert University of New Hampshire, Durham, USA,
[email protected] K. Torkar Space Research Institute, Austrian Academy of Sciences, Schmiedlstrasse 6, 8042 Graz, Austria,
[email protected] J.G. Trotignon Laboratoire de Physique et Chimie de l’Environnement et de l’Espace, Universit´e d’Orl´eans, Orl´eans, France,
[email protected] H. Vaith University of New Hampshire, Durham, USA,
[email protected] X. Valli`eres Laboratoire de Physique et Chimie de l’Environnement et de l’Espace, Universit´e d’Orl´eans, Orl´eans, France,
[email protected] J. Volpp European Space Operations Centre, Robert-Bosch-Strasse 5, D-64625 Darmstadt, Germany,
[email protected]
xx
Contributors
S.N. Walker Department of Automatic Control and Systems Engineering, University of Sheffield, Mappin Street, Sheffield, S1 3JD, UK,
[email protected] M. West Mullard Space Science Laboratory, University College London, UK and Royal Observatory, Belgium M. Wilber Space Sciences Laboratory, University of California, Berkeley, USA R.J. Wilson Mullard Space Science Laboratory, University College London, UK and Los Alamos National Laboratory, Los Alamos, USA K.H. Yearby Department of Automatic Control and Systems Engineering, University of Sheffield, Mappin Street, Sheffield, S1 3JD, UK,
[email protected] L.M. Zelenyi Space Research Institute of RAS, Moscow, Profsoyuznaya str, 84/32, Russia
Part I
Products and Services of the Cluster Active Archive
Chapter 1
Cluster Active Archive: Overview H. Laakso, C. Perry, S. McCaffrey, D. Herment, A.J. Allen, C.C. Harvey, C.P. Escoubet, C. Gruenberger, M.G.G.T. Taylor, and R. Turner
Abstract The four-satellite Cluster mission investigates the small-scale structures and physical processes related to interaction between the solar wind and the magnetospheric plasma. The Cluster Active Archive (CAA) (URL: http://caa.estec.esa.int) will contain the entire set of Cluster high-resolution data and other allied products in a standard format and with a complete set of metadata in machine readable format. The total amount of the data files in compressed format is expected to exceed 50 TB. The data archive is publicly accessible and suitable for science use and publication by the world-wide scientific community. The CAA aims to provide user-friendly services for searching and accessing these data and ancillary products. The CAA became operational in February 2006 and as of Summer 2008 has data from most of the Cluster instruments for at least the first 5 years of operations (2001–2005). The coverage and range of products are being continually improved with more than 200 datasets available from each spacecraft, including high-resolution magnetic and electric DC fields and wave spectra; full three-dimensional electron and ion distribution functions from a few eV to hundreds of keV; and various ancillary and browse products to help with spacecraft and event location. The CAA is continuing to extend and improve the online capabilities of the system and the quality of the existing data. It will add new data files for years 2006–2009 and is preparing for the long-term archive with complete coverage after the completion of the Cluster mission.
H. Laakso (), S. McCaffrey, D. Herment, C.P. Escoubet, C. Gruenberger, M.G.G.T. Taylor, and R. Turner European Space Agency, ESTEC, Noordwijk, The Netherlands e-mail:
[email protected] C. Perry Rutherford Appleton Laboratory, Chilton, Didcot, Oxon, UK A.J. Allen Imperial College, London, UK C.C. Harvey Centre de Donn´ees de Physique des Plasmas, CNRS, Toulouse, France
H. Laakso et al. (eds.), The Cluster Active Archive, Astrophysics and Space Science Proceedings, DOI 10.1007/978-90-481-3499-1 1, c Springer Science+Business Media B.V. 2010
3
4
H. Laakso et al.
1.1 Introduction The Cluster mission consists of four identical spacecraft, each carrying 11 instruments [2]. The satellites were launched in two pairs in July/August 2000, and after a 6-months commissioning phase, the mission moved into an operational phase in February 2001. The mission has been approved to operate until summer 2009, and a new extension proposal is in preparation to request further operations beyond 2009.
1.1.1 Cluster Mission A key aspect of the Cluster mission is the controllable flight formation. At two locations along the satellite trajectories, the four spacecraft are aligned at the tips of a regular tetrahedron that is the optimal configuration for the measurements of spatial gradients. In other positions the tetrahedron is less regular and near the perigee the satellites fly in a string-of-pearls formation, and there are two positions on each orbit where the four satellites are coplanar. The size of the tetrahedron formation was changed systematically, covering various distances between 100 and 10,000 km during the years 2001–2005. This strategy was necessary to cover the different characteristic spatial and temporal scales of the fundamental plasma physics processes in the different regions of the dynamic magnetosphere. During the mission extension, which started in January 2006, Cluster has been in a multi-scale phase where three satellites fly in a 10,000 km triangular formation and the fourth satellite (Cluster 4) is perpendicular to the plane and is separated from Cluster 3 by a distance varying between 40 km and a few 1,000 km.
1.1.2 CAA Concept The key scientific rationales for the Cluster Active Archive are (1) to maximize the scientific return from the Cluster mission by making all high-resolution Cluster data available to the world-wide scientific community, (2) to ensure that the unique Cluster observations are preserved in a stable, long-term archive for scientific analysis beyond the end of the mission, and (3) to provide this archive as a major contribution by ESA and the Cluster science community to the International Living With a Star programme. The CAA database and services are established and maintained by the European Space Agency (ESA) at ESTEC. The aims of the CAA are to ensure that the CAA contains all of the Cluster high resolution data; the data archived should be of the best quality achievable within the limited resources available; the data should be suitable for science use and publication by the world-wide scientific community;
1
Cluster Active Archive: Overview
5
and the CAA will provide user friendly services for searching and accessing these data and ancillary products such as orbit information. The implementation of the CAA has two important aspects: (1) In view of the shortage of manpower in most institutes processing Cluster data, ESA-supported manpower has been deployed in institutes where the relevant expertise exists, to assist in the preparation, validation, and documentation of the high-resolution data to be deposited in the archive, and (2) each PI team matches the level of ESA supported manpower with an equal level of effort from their own National Funding Agency.
1.1.3 CAA Standards The CAA standards form the basis of a consistent approach to the formatting and description of the digital data products being handled by the CAA. This is vital for the development of standard data handling tools and to maximize the ease of use of numerous products that are provided by many different groups. The lack of standardization in the past has proved a major impediment to the full exploitation of data, and every effort is being made to avoid this in the case of the CAA. In the early phase of the CAA two important working groups were established for standardization: one for the definition of the data format [1], and the other for the creation of a metadata model and dictionary [3].
1.2 Infrastructure The CAA project, managed by ESA, draws upon expertise from within ESA, the Cluster instrument teams and other groups. This combination encompasses the full range of skills and experience in handling the diverse and complex Cluster products that is required to achieve the CAA goals.
1.2.1 Organization The structure of the project team in summer 2008 is presented in Fig. 1.1. The core team consists of a project manager, technical manager, system engineer, and two system/software developers. The project has received support from the agency in the form of a Young Graduate Trainee (YGT) for 2 years. The Cluster project scientist and his deputy provide additional scientific support. The remaining CAA resources are deployed within the instrument teams. This is a key aspect of the CAA approach and is intended to ensure timely delivery of the best quality data from all the Cluster instruments. Some important supporting data are received from
6
H. Laakso et al.
Fig. 1.1 CAA management structure
the Cluster Joint Science Operations Centre (JSOC) that provides the CAA with data catalogues of orbital parameters of the predicted scientific events. The European Space Operations Centre (ESOC) provides the CAA with a wide range of spacecraft operations related information, which could be helpful as background information for science data processing; for further information, see Volpp and Sieg [Chapter 13].
1.2.2 System Architecture A key requirement of the CAA system architecture is that the system be scalable as the amount of data increases over time, affecting all hardware components, including servers, storage, backup system, and network. The current hardware components are sketched in Fig. 1.2. The total volume of compressed data products to be handled by the CAA is expected to exceed 50 TB, built up over the course of the mission. The CAA will keep all data available online to ensure the users have rapid access to the data they request. To provide the necessary flexibility and performance, the data storage is implemented via a storage area network (SAN). The SAN uses Fibre Channel network technology, which is well suited to the small, closed environment of the CAA system. This SAN is local to the CAA system, and is not part of a wider departmental SAN infrastructure. Storage is implemented on 7 RAID (Redundant Array of Independent Disks) arrays, each connected to the CAA servers via a dedicated fibre-channel infrastructure that includes fibre-channel “fabric” switches. These RAID arrays use highly cost-effective SATA (Serial Advanced Technology Attachment) disks, up to 250 GB each, but logical volumes are created by a hardware controller on each device, to create much larger volumes. The volumes are generally built as RAID 5, the most recent as RAID 6, in most cases with a hot spare. Each RAID array is divided
Cluster Active Archive: Overview
Fig. 1.2 Sketch of the CAA system in autumn 2008. The system has seven servers and most disks are directly mounted to the main data processing server (CAA-2), and the data catalogue disks are NFS mounted to other servers. CAA-5 is the access point to the users and data providers
1 7
8
H. Laakso et al.
into volumes of approximately 2 TB, in order to be manageable for backups. There are currently 21 volumes in use, giving approximately 42 TB of data connected to the server. In addition, several servers have significant internal storage, bringing the total data storage to approximately 45TB. The main data processing and database handling operations are undertaken by two (Ubuntu) Linux servers (caa-2 and caa-3 in Fig. 1.2), both having two Quadcore Intel Xeon 2.33 GHz processors. The systems share data using NFS (Network File System) and access rights using NIS (Network Information Service). Additional servers (containing 8 Intel Xeon processors and 4 Pentium processors) host the main web interface and development activities, and data backup services. The recent addition of a dedicated web development server allows development in parallel to operational systems. The CAA backup solution is based on an Overland Neo 4100 system with 2 internal drives and 24 TB tape capacity (58 tapes online from a pool over several hundred, each tape holding between 200 and 400-GB) based on LTO3 (Linear Tape Open) technology. The library is connected via fast SCSI to an Intel based Linux server, running the commercially licenced BakBone Netvault software. This system handles incremental backups, full backups, and periodic data archiving requirements. A number of network issues had to be taken into account in implementing the CAA at ESA. The CAA machines are inside a firewall protected part of ESA grid that provides high speed access to the international academic networks. Significant volumes of data are transferred from the instrument teams and ESOC to the CAA, and later the users request these data, all of which require good network connectivity between the CAA and the public internet. For this network, a dedicated inter-connect between systems has been implemented, before that is connected to the world. Interconnectivity of the servers is essential as the tasks are distributed to various servers. For this purpose, a dedicated local network was implemented in order to allow secure local communications between systems, without loading the DMZ (demilitarized zone) or exposing internal data such as backups, potentially to the world. The application software at the CAA has been partially developed by the CAA core team and partially in the PI institutes or other involved institutes, all of which needs to be supported by the CAA system. For this reason Linux was selected as the CAA operating system, as many instrument teams use Linux in one form or another. The services and data sets available from the CAA have grown and as a consequence have increased the requirements on the system performance. The CAA processing system handles various tasks, such as data management; data delivery; data processing for those instruments that provide software rather than pre-processed products; data ingestion into the CAA database; and data manipulation and visualization.
1
Cluster Active Archive: Overview
9
1.2.3 System Reviews Formal project reviews are held annually to verify that the key milestones have been met, that the technical aspects of the project are sound, and that the activities are progressing on schedule and within budget. The following project reviews have been held: System Specification Review in November 2003, to approve the user require-
ments, to review conceptual design, to review proposed PI inputs, to agree the archive implementation plan, and to release instrument team contracts Implementation Review in May 2005, to approve the archiving plans of the experiments and the technical implementation of the overall system First to second Operations Review in May 2006 and 2007 to review the status of data delivery and CAA services for years 2001–2002 and 2003–2004, respectively Third Operations Review in May 2008, to review the first part of the CAA activity (data availability from years 2001–2005) Fourth Operations Review in May 2009, to review the CAA activity for the first part of the second mission extension (data availability from years 2006–2007)
In future the operations reviews will be held annually as before. In addition in February-March 2009 an extensive peer review process was carried out to evaluate the usability and quality of the CAA database and its services to the users. More than 200 recommendations were obtained that are now under implementation.
1.2.4 User Access Statistics The CAA opened its services to the science community in February 2006. The evolution of the number of registered users and their use of CAA is shown in Fig. 1.3. At the time of opening, nearly 100 people had registered to support beta testing of the system. The top panel of the figure shows there has been a consistent rise in the number of registered users, approximately 20–30 new users per month, as shown in the middle panel, until there are currently about 800 registered users. The monthly number of user logins to the CAA website is shown in the second panel from bottom. The current average rate is around 450–500 logins per month. There is a clear increase by approximately 50% over the last year, which is in line with the increasing number of active users shown in the second panel from top that shows the number of those users who have logged in the CAA, either via web or command line interface. The bottom panel in Fig. 1.3 shows the monthly download volume. This is not expected to increase drastically because many institutes have implemented centralized data servers for the CAA data so that files are downloaded only once unless a new version of data file is ingested into the CAA (which can be automatically
10
H. Laakso et al.
Fig. 1.3 User statistics of the CAA. The panels from top to bottom are: the total number of registered users, the number of active users per month (i.e. users who have logged in the system), the number of new registered users per month, the total number of logins per month through the web-site, and the total monthly download rate in GigaBytes
checked via a command-line request). The download minimum in December 2007 was caused by a system failure whose consequences required several weeks for recovery and the statistics of download volume was lost. Within spring and summer 2008 the CAA will received plenty of new data as well as many of the old datasets have been recalibrated and will be ingested into the system which will likely raise the downloading rate.
1
Cluster Active Archive: Overview
11
1.2.5 User Feedback The CAA is a new type of data archiving activity for the Sun–Earth science community which, for the first time, provides this community with access to all calibrated full resolution data from a space mission. Therefore it is planned that both the data and the services of the CAA will significantly improve over time. Here the scientific community can make important contributions by using the data and the system and providing feedback to the CAA suggesting where the improvements, changes and additional features are desirable. To facilitate this feedback, the CAA has opened a user feedback area at http://caa.estec.esa.int/caa/feedback intro.xml where users can find two kinds of forms for reporting problems or sending suggestions. The first form is technical where users can report on missing data, speed of the system, and so on. The second form is for scientific issues where users can tell the CAA team what they want from the CAA system.
1.3 Standards The Cluster Exchange Format (CEF) is a self-describing ASCII format consisting of a metadata header followed by data represented as a comma-separated list of values. This was recommended by the Cluster Science Data System (CSDS) Archive Task Group for the exchange of science data between instrument teams of the Cluster mission. Adoption of a single common format allows the delivery of data products to users throughout the whole science community, including future scientists without the need for specific access software. The CEF format provides storage of science products in a robust and easily accessible form. The complexity of some high-resolution data products led the CAA design team to produce an extended version 2 of the CEF as the format to be used in the CAA [1]. Earlier versions of this syntax are referred to as CEF 1, and the syntax specified for the CAA is designated CEF 2. The data description or metadata consists of (1) a data model that is a logical framework into which the metadata information is placed, and (2) a data dictionary that is an ensemble of words used to populate the data model. The data model and data dictionary define the semantics used to describe the data. The development of the standard CAA data dictionary [3] was a major activity during implementation phase since it is a vital input to the development of the instrument team products. However, the dictionary has been updated several times during the operations phase.
1.3.1 CEF Data Format Files in the CEF syntax must have names with the extension .cef to assist identification. An exclamation mark is used as a comment marker, and all input to the right
12
H. Laakso et al.
of this marker up to the new line character is ignored on input. A header must be included, preceding the data records, and provide sufficient metadata to fully describe the data and their formatting. Use of detached headers is supported to minimize duplication. The file syntax and header content of a CEF file is specified in Allen et al. [1]. Entries in a record are comma separated and white space surrounding delimiters is ignored. Missing parameter values must be padded by a fill value that must be specified in the metadata. All data files are tabular and homogeneous – they have a sequence of records each with the same variables in the same order. Each record is ended by END OF RECORD MARKER, which by default is a new line character (nn) but can be set to another character in order to allow multiline records. The END OF RECORD MARKER, tab characters, carriage return (nr), new line and white space characters at the start and end of records and surrounding delimiters should be ignored when read. Thus, data may safely be formatted with white space and end of line markers for human (text editor) readability, allowing for easier exchange between platforms where the end of line marker is variously nrnn under DOS, nn under Unix and nr under Mac OS. For time series the records are ordered on the monotonic increasing time variable, and the time tag must be the first entry in a record. The other entries in the record are associated with that time via the metadata. Time tags are usually centered within the sampling interval, and the spacing between time tags is often the same as that sampling interval. Otherwise, Delta PLUS and Delta MINUS metadata describe the sampling or integration interval corresponding to the data and the location of the time tag within that interval. Time is represented as a text string in the strict ISO 8601 ASCII calendar date time format: yyyy-mm-ddTHH:MM:ss.wwwZ where the trailing ‘Z’ is UTC designator. For example, 2001-02-01T01:23:00.000Z corresponds to 01 February 2001 at 01:23:00 UT. This format permits any number of digits after the decimal point in the seconds field, e.g., the example above is a valid time string to millisecond accuracy. This format is robust for arbitrary timing accuracy, but software developers must take care to ensure that their software retains the accuracy. Multi-dimensional variables follow the natural ordering of the C Programming Language (i.e., the last index varies the fastest), and one entry is required for each element. For a velocity vector one has three entries and for a 2 by 2 array four entries, while a 16 by 8 by 24 array (e.g. for a distribution function) has 3,072 entries. It must be recognized that some data products may result in extremely long record lines. The rigid record structure to the data is intended to allow simple generic software to handle all instrument files.
1.3.2 CEF Metadata Metadata must contain all the information required to read and interpret the data (syntactic description), and to understand what the resulting numerical values
1
Cluster Active Archive: Overview
13
Table 1.1 Hierarchical levels for metadata Level Description Mission Information relevant to the whole mission Observatory One of four spacecraft (Cluster-1, Cluster-2, Cluster-3, and Cluster-4) or Cluster-Multi that contains datasets that contain data from more than one observatory Experiment Each spacecraft has 11 experiments, each identified by its Principal Investigator, plus the auxiliary data Instrument Some experiments consists of more than one physical instrument, each of which produces its own datasets; for two of these, CIS and STAFF, for the purpose of archiving it has been found convenient to identify two instruments. Thus CAA contains datasets from 4(11 C 2) D 52 instruments Dataset Each instrument produces one or more datasets; this level of metadata is common to the whole of each dataset Parameter A dataset contains one or more parameters, each of which has its own metadata and is also common to the entire dataset File Each dataset is composed of files, the number of which will grow with time during the lifetime of the CAA
represent (semantic description), including how the data were obtained. The purpose of the CAA Metadata Dictionary [3] is to describe fully the required CAA metadata information and to explain how that information must be formatted so as to be exploitable by the generic CAA software. Table 1.1 shows different concepts in the CAA that are hierarchically organized. An example of CEF metadata is given in Appendix. Three forms of metadata are recognized: File metadata are used to provide information unique to the file such as filename,
time coverage and provenance. Global metadata is applicable to the entire contents of a dataset, and fulfils the
same purpose as the global attributes in a CDF file. Support metadata (called variable metadata in the CEF) describes an individual
parameter in a dataset, and is equivalent to the CDF variable attributes. Support metadata blocks must appear in the CEF header in the same order as the corresponding parameters appear in the data records. Apart from this, there is no required order for the global metadata or parameters blocks within any metadata block although usually the global metadata are followed by the parameter definitions. Apart from quoted text data and variable names, metadata information is case insensitive. The open format also allows for the inclusion of any extra metadata deemed desirable by the generating team. Lines of metadata may be continued using ‘n’ as a continuation marker, following one of the commas separating a list of values. A metadatum consists of a text string of the form “KEYWORD D value”. The keyword values can be of three types: (1) a single data value (which may be numerical, logical, enumerated text string, formatted text string, free text string, ISO time code), (2) a comma delimited sequence of data values or (3) the name of a data variable in the same file carrying the requisite information.
14
H. Laakso et al.
1.4 Software System The CAA is built around a MySQL database and XML-based data management system, which provides a robust and extensible framework for handling the data products delivered to the CAA. There are two routes of accessing the data products: web GUI and command-line interfaces that are described in the following section.
1.4.1 User Interface The access point to the CAA database and services is the website at http://caa.estec. esa.int/ (Fig. 1.4). Part of the information on the website is available to all visitors, but the access to the main data and graphical products requires a login into the system. Therefore users must first register to the system. The registration procedure is fully automatic so that the user defines the password (which can be changed later if wished) but the user-id is determined by the system and is sent to the e-mail address given during the registration process. The registration allows the CAA to gather usage statistics (see Section 1.2.4) and more importantly to monitor the system performance in order to improve it, when and where necessary. In addition, the users can save their configurations of datasets or plots for using them during future requests. Furthermore, occasionally poor-quality data products may have been delivered and ingested into the system, and in such cases the CAA can find from the usage database who had requested those data and these users can then be informed about the presence of better quality products.
1.4.1.1 Web Interface Figure 1.5 shows the front page of the CAA website after a user has successfully logged into the system. The user can now find USER AREA in the left-hand menu bar that currently holds user-defined lists of profiles that are useful when searching or plotting certain variables regularly. In “Modify User Details” one can modify user details such as password or contact e-mail address. Currently the following data services are provided (see the left-hand menu bar): CAA Data Download Area: allows users to perform data requests, using filters
given in the entry page. CAA Graphical Products: allows users to display some of variables. CAA Quick-look Plots: allows users to view pre-generated quick-look plots that
are based on non-validated data sets processed by instrument teams or CSDS. CAA Inventory Plots: allows users to view the completeness of the database.
1
Cluster Active Archive: Overview
15
Fig. 1.4 The front page of the CAA website (http://caa.estec.esa.int/) in early 2009
There are currently a little more than 200 datasets from each spacecraft in the CAA data repository. By setting values for Start Time, Stop Time, Observatory, Experiment, Measurement Type, and Instrument Type, one can filter datasets to be shown on the GUI, thus speeding identification of the datasets needed by a user. Some, all or none of these selections may be set. For instance, if only Start and Stop Time are selected, then all the datasets that exist for this interval will be shown. If Time fields are left empty, this defaults to the time range of the entire mission.
16
Fig. 1.5 The front page of the CAA website after login into the system
H. Laakso et al.
1
Cluster Active Archive: Overview
17
For Observatory, the option Cluster Multi refers to the products that contain data from more than one spacecraft. Measurement Type is a general description of the type of measurement. Instrument Type supplies information about the nature of the instrument used to obtain the data. Often the same physical parameter can be obtained from more than one type of instrument. For example, electron density can be derived from particle detector, Langmuir probe, wave spectral or active resonance sounder data. After the selection, available datasets are listed by Observatory (see Fig. 1.6). Clicking “Expand/Collapse All” will toggle the expansion/collapse of the results. When expanded, the datasets available are listed. The following details are provided for each dataset: Dataset Name: with check box beside it to indicate if the user wishes to download
this dataset. Notice that this Dataset Name needs to be known for the use of command-line interface (see next section). Result Timespan: tells the timespan where this dataset is available on the CAA. Note that this does not tell anything about the coverage of the dataset which can be examined via inventory plots. Dataset Details this link opens up a new window with the dataset metadata details, e.g., variables available in the dataset. Users must select each dataset they wish to download by clicking on the checkbox. Currently there is a limit of about 1 GB on the amount of data one can download at one time. This limit is necessary because the web request is executed immediately and larger requests may time-out the Internet connection before completion. The requests of larger amounts of data can be done via command-line interface (see Section 1.4.1.2), which supports batch operation and currently has a limit of 50 GB. After selecting the datasets, possibly modifying the time interval and then clicking on “Search”, the available datasets will be listed, including an estimated total size of uncompressed files given in brackets. There is also again a link to the dataset information. Here the users must select each dataset they wish to download, by clicking on the checkbox, and then click “Download”. In addition the user may also choose to download the files in a single file (default) or in shorter intervals (e.g. hourly or daily files). Next the files are combined and compressed into a single zip file. Once this process has completed, the new page shows a link “Search results ready for download”. Selecting this link, the user will be prompted for their local directory where the file will be stored in the .zip format.
1.4.1.2 Command-Line Interface During year 2007 a command-line tool was introduced which allows users to bypass the graphical interface to gain faster access to the data products. This facility is utilized to make automated enquiries about the arrival of new files on the CAA database and also for data analysis and visualization software tool to gain direct
18
H. Laakso et al.
Fig. 1.6 Results of searching datasets. For each experiment the datasets are grouped into smaller sets helping the faster identification of the right dataset
1
Cluster Active Archive: Overview
19
access to the CAA database. For example, when new files have been ingested into the system, a user can run a script that will automatically transfer the appropriate files from the CAA to the users’ own local systems. The data download volume via the command-line interface is three times greater than via the web forms interface, and it supports batch operation so that large jobs can be queued for offline processing. McCaffrey [4] defines the format, syntax and mechanism of this tool that allows users to submit requests from a command line using the GNU wget tool [GNUWGET]. The non-CEF files delivered (e.g., for graphical products) are direct copies of the original files, whereas the CEF files delivered cover exactly the time span specified in the request. If the requested parameters are correct, and there are data available, the request may not be executed immediately if there are many other jobs currently executing or if the request is large. When a request is scheduled, the user will receive a file called CAA Info.log.X that indicates a URL where the completed file can be retrieved. The following example URL is a request of three CEF products, covering an interval of four days to be split to daily files: http://caa.estec.esa.int/caa query/?uname=uname&pwd=pwd&dataset id=C1 C P EDI EGD,C1 CP EFW L3 P,C1 CP FGM FULL&time range=2001-02-01T00: 00:00Z/2001-02-05T00:00:00Z &file interval=1day where C1 CP EDI EGD, C1 CP EFW L3 P, and C1 CP FGM FULL are the datasets for electron gyroperiod, 4-s averages of spacecraft potential and fullresolution magnetic field, respectively. Notice that CEF is a default format, but one can also request data in CDF format. The job size is over the ‘immediate execute’ limit, and will therefore be scheduled. When complete, the software creates a zip file and alerts the user via email that the file is available for download (if the parameter ‘notify’ is not specified, a notification email is sent as default).
1.4.2 Visualization The CAA provides three visualization utilities. The main graphics tool is “CAA Graphical Products” that displays variables using the calibrated CAA data products. The “CAA Quicklook Plots” are produced outside the CAA and may be based on quick calibration routines. “CAA Inventory Plots” provide a view on the coverage of the CAA data products.
1.4.2.1 CAA Graphics At http://caa.estec.esa.int/caa/graphics.xml one can display some variables that are either variables in datasets (e.g. electric or magnetic field components) or results of some data manipulation (e.g. omni-directional energy spectrograms for electrons
20
H. Laakso et al.
Fig. 1.7 Selecting variables for graphical display. At the moment there are about 100 variables for each spacecraft that can be displayed. Selected variables can be saved as a profile for future use
and ions). Figure 1.7 shows the variables of Whisper available for graphics. The list of selected variables are displayed in a window where the order of the variables can be changed, and if the set of variables is frequently used, one can save it as a profile for future use. The graphics are based on IDL software libraries that are used to read, manipulate and plot the variables. These scripts are made available for download from the CAA website (see software in the menu bar). Figure 1.8 shows an example of the plot for a 4-h interval on 17 March 2001. Under “Plot Type”, one can find four types of plots, including pre-generated 1h, 6 h and 1 day plots that are created when new data files are ingested into the system. Selecting “On demand”, one can specify any interval (up to one orbit) for which the selected panels will be displayed.
1
Cluster Active Archive: Overview
Fig. 1.8 Example of graphical display for a 4-h interval on 17 March 2001
21
22
H. Laakso et al.
1.4.2.2 Quick-Look Plots The quick-look plots, produced by the PI teams or the CSDS, may be based on simple calibration routines and are generally not suitable for scientific analysis or publication without prior discussion with the producer. For CSDSweb plots, please note that the plot availability on the CAA is delayed. The complete set of plots is available at the CSDSwebsite (http://www.cluster.rl.ac.uk/csdsweb-cgi/ csdsweb pick). The quick-look plot utility also allows browsing of the pre-generated WBD (Cluster Wide-Band Plasma Wave Investigation Experiment) science plots. The WBD plots can also be retrieved through “Search”. The overview plots can be downloaded in both postscript and png format under Cluster-Multi Observatory whereas the high-resolution (30 s) WBD gif plots are produced for each spacecraft individually and can be downloaded under each spacecraft. 1.4.2.3 Pre-generated Inventory Plots The inventory plots give an overview of the coverage of the database for a number of datasets for each instrument and spacecraft. During the ingestion process, each data file is examined and any time step longer than 5 min is recorded as a data gap and is shown in the inventory plot. The data used by the inventory plots are generated subsequent to ingestion, and the inventory plots are produced later usually at the end of the day, and so there may be a delay between ingestion (i.e. the time when the data become available for downloading or plotting) and an update of an inventory plot. The following three colours are used to indicate the data content: Blue: the data exist (notice that the data can be fill values) Purple: there is a data gap White: no data exists in the database
In addition the top two panels tell the presence of predicted events (top panel) and the spacecraft mode (second from top) where blue is used for normal mode and red for burst mode (higher data rates).
1.4.2.4 User-Defined Inventory Plots Users can also produce their own inventory plots over intervals that are longer than 6 h in the data search area. Selecting one or more datasets and clicking then on “INVENTORY”, one gets an inventory plot that shows the data coverage for the selected time interval. Notice that these plots are generated on the fly using the current ingestion status. So some data may appear on these that are not yet on the pre-generated inventory plots.
1
Cluster Active Archive: Overview
23
1.4.3 Support Tools There are some software tools available for the users under “Software” in the lefthand menu bar. The software, called Qtran (Queen Mary File Translator), can translate files between CDF and CEF. Notice that if a user requests to download a CEF file in CDF format, this is the tool used to perform the conversion. The same software is also able to read other record-oriented ASCII data files and may help with translation from ASCII into the recommended exchange format. The QSAS (Queen Mary Science Analysis System) software [Allen, Chapter 14] can manipulate CEF files and visualize multi-instrument and multi-spacecraft products. Both the Qtran and QSAS software are maintained at the Imperial College of London. The CAAtools package provides a set of tools for checking the products against the metadata dictionary and CEF specification. The CEF product validation part of the package is made available for download, and the library is also used by the CAA Matlab toolbox for reading CEF datasets. For Matlab users there are two toolboxes for reading, writing, manipulating and plotting CEF files. The function cefRead can be applied directly to gzipped CEF files. Documentation and the Matlab source files are provided under Software. For IDL the CAA has developed two packages that simplify the process of reading and plotting data. The cef read procedure provides a single command to load a CEF file into IDL. Options include to load only a sub-set of variables or to restrict the reading to a set of time intervals. The software will also handle conversion of the time information into MJD (Modified Julian Date) or CDF epoch formats. The documentation provides the full details of the utility as well as several examples of different reading options and a full example of generating multi-panel plots of simple scalar and vector parameters. For users not wishing to do their own plotting in IDL an additional package provides an extensive set of options to generate high quality plots of CEF products including scalars, vectors and multi-dimensional arrays. The software makes use of the cef read software described above and is based on the software used within the CAA to provide pre-generated and on-demand graphical products.
1.5 Science Data Products The CAA holds three types of science data files: calibrated and uncalibrated data files from the instrument teams that are available in CEF format; raw data files received from the ESOC; CSDS primary and summary parameters (PP and SP, respectively) data files. The CSDS files are preliminary survey data and not calibrated to the level done within the CAA and are so not suitable for publication without discussion with the relevant instrument team.
24
H. Laakso et al.
1.5.1 CAA Products The key CAA science data products are the datasets that have been calibrated and validated within the CAA. Each team performs detailed calibration of the data to the level suitable for optimum scientific return. However, all data cannot be validated manually, and thus the data files can still contain features that represent instrumental effects rather than physical processes. It is therefore important that the users read all documentation and caveat information related to the data and contact the CAA for specific questions or problems. At the moment there are over 200 different datasets from each spacecraft, and even in this phase of the project new datasets can still appear into the system. In summer 2008 approximately the first 5 years (2001–2005) of observations have been ingested, and the following 4 years (2006–2009) will become available before summer 2010. In addition, large-scale reprocessing of some products is planned to improve quality and consistency, which highlights the benefit of the cross calibration working group, which has helped to identify and solve calibration issues. The total number of CEF and other format data files that are currently active (i.e. latest version) is in excess of 3.5 million with a total uncompressed volume equivalent to over 40 TB. The pre-generated plot panels amount to more than twice this number of files although they require much less disk space. In addition there remains a large volume of raw and some Level-1 data that are not yet available via the CAA catalogue system but that are being added as time and resources permit.
1.5.2 Cluster Raw Data System For the second extension of the Cluster mission, starting in January 2006, there was a change in the distribution of the raw data. Earlier, the raw data collected by ESOC were transferred to CDROM (Raw Data Media – RDM) and mailed to about 70 recipients. Now the data are transferred over the network from ESOC to the CAA from where they can be accessed by the users. The CAA is also working to provide a full online archive of the RDM from the entire mission by copying the existing CDs. Notice that these data primarily useful to the instrument teams that are able to decommutate the data content and produce the instrument products in physical units. Currently the CAA does not provide access to the PI software. For automated access of the RDM data, one can use HTTP GET method either within a web browser address bar or using a command line based http browser (e.g. wget) tool: http://caa.estec.esa.int/cgi-bin/caa rdm?key1=value1&key2=value2&. . . Both the keyword and the value are treated as case insensitive. The files delivered are direct copies of the contents of the original RDM volume. The details of the utility including the keywords and their values are explained by Perry [5].
1
Cluster Active Archive: Overview
25
1.5.3 CSDS Products The raw Cluster data files are transferred from ESOC to the national Data Centres (DCs), previously on CD-ROMs, and since January 2006 through the network via CAA. The national DCs process the raw data using PI software and produce physically meaningful parameters (fields, particle fluxes, temperatures, spectral densities, etc.) for those experiments for which the DC is responsible. The results are stored as CDF files. These files are then exchanged with the other national DCs so that each one has a full set, which is then made available to the scientific users in that country. The interfacing between the users and the DC, as well as among the DCs themselves, is the CSDS Data Management System (DMS), a software package that has been developed especially for this purpose. A number of JSOC (Joint Science Operations Centre) products (e.g. predicted orbit and event files, scientific events catalogue) are also made available to the local users via the national DC. The key CSDS datasets are Prime Parameter Data Base consists of 65 parameters from all four spacecraft
averaged over one spin (4 s). Summary Parameter Data Base consists of 86 parameters from only one space-
craft and averaged over 1 min; auxiliary parameters such as position and spin orientation are also included. Event Catalogues provide data concerning predicted and observed scientific events for the Cluster mission. CSDS auxiliary data contains such information as tetrahedron quantities, orbit number, position, velocity and attitude of spacecraft. All the vector quantities are given in the GSE coordinate system. The rotation angle between the GSE and GSM is also given, enabling a straightforward and unambiguous conversion. CSDS products that can be found at http://sci2.estec.esa.nl/cluster/csds/ ring.html were not initially part of the CAA. However, now these products are being transcribed into CEF format files and ingested in the CAA and can be used in combination with CAA products.
1.6 Cross-calibration Activity The CAA cross-calibration working group is actively supported by the instrument teams with two to three annual workshops; for the list of the past workshops, see http://caa.estec.esa.int/caa/cross-cal.xml. This activity is invaluable for assessing and improving the quality of the datasets. Although the active participants in the working group come mainly from the instrument teams, anyone interested in the calibration issues of various measurements are welcome to participate in these workshops.
26
H. Laakso et al.
The key issues in the meetings have been: To improve the calibration of dc magnetic field measurements much better than
1 nT To determine the total plasma density using various measurements techniques To calibrate the dc electric field measurements using and comparing various data
sources To determine the E B-drift velocity using and comparing various data sources To compare energy fluxes of electrons and ions between different experiments To compare power spectral densities of wave measurements, including both elec-
tric and magnetic field wave components
1.7 Future Planning The CAA development will continue to enhance the core functionality of the system, to reprocess existing data files (2001–2005) and to expand the coverage of the datasets to the next years (2006–2009). There will be further updates to both the web and command line data request mechanism to support the selection and delivery of the non-CEF formatted data products. These products include pre-generated graphical products supplied by the instruments teams, calibration information and reformatted raw data. The activities planned for the period leading up to the next operations review in May 2009 are as follows: Routine operations, data delivery and maintenance of the existing data access and
value-added services Production and delivery of data files from years 2006–2007 before May 2009 Monitoring system of the file ingestion processes in order to display the status
of ingestion as well as to monitor the performance of the system in the validation/ingestion procedures Development of advanced documentation service for searching and browsing the Cluster documents, i.e., a utility to search for specific reports (e.g. ESOC spacecraft anomaly information) Improvements to user interface based on user feedback and problem reports. ı Additional search and filtering options for dataset selection ı Provision of the detailed data coverage information as a CAA product (to be used by external tool developers) ı Updates to the command line interface in response to requests from tool developers ı Provision of a simple and easy to use interface Value-added software development activities
ı Adding new plotting options to the CAA graphics menu ı Provide a user selectable option to automatically include referenced products such as caveat information and documentation
1
Cluster Active Archive: Overview
27
In addition some progress has also been made on the translation of CAA metadata into Space Physics Archive Search and Extract (SPASE). Automated translation of simple products is straightforward but differences between the CAA and SPASE parameter specification increase the difficulty of translation as the dimensionality and complexity of products increase. Discussions are underway with the NASA Virtual Magnetospheric Observatory at UCLA to improve compatibility.
Appendix: CEF Metadata The users are strongly advised to become familiar with the CEF metadata dictionary given by Harvey et al. [3] in order to get a full benefit of the metadata provided with the numerical data. This appendix points out some of the metadata details that users should be aware of. We have included an example of metadata from the FGM SPIN resolution data file on 1 January 2003, 0–1 UT, which is given in the end of this appendix. The user should be aware that the delivered files to the users and the actual source files in the CAA database are not identical. The source files can be of any length and most of the metadata are usually given in detached header files. When the data are requested by the user, CAA software tools are used to create a file of the desired interval from the source files and the metadata are included in the file. The FILE NAME starts with the dataset name and the requested interval followed by the version number that tells the latest ingestion date of all input data files used for the requested file, which is 2006 August 15 in the case of the example file. The top-level metadata provides some general level information about the mission and the experiment: MISSION: all MISSION metadata are the same for all datasets and are provided
by a detached MISSION header file. OBSERVATORY: There are four OBSERVATORY header files, one for each
Cluster spacecraft. These metadata are the same for all datasets from the same spacecraft. EXPERIMENT and INSTRUMENT: these metadata provide some details of the experiment and are identical to all the datasets of one experiment on one spacecraft. INSTRUMENT CAVEATS: the instrument level general caveats are given here, the relevant dataset is given here. This may include references to external files. The important part of metadata are given at the dataset level and are global to the all files of the given dataset. Some of the useful keywords are: DATASET ID is a unique identifier of the dataset, which is also used in the be-
ginning of the filename. This ID is needed when requesting data via the command line interface. DATASET TITLE is a concise description of the dataset. DATASET DESCRIPTION provides a detailed description of the dataset.
28
H. Laakso et al.
TIME RESOLUTION is a time interval between two data points, expressed
in seconds. If this is not constant, the two further keywords, MIN TIME RESOLUTION and MAX TIME RESOLUTION, must be used. PROCESSING LEVEL tells the level to which the data have been processed. Possible values are: Raw, Uncalibrated, Calibrated, Derived, and Auxiliary. DATASET CAVEATS provides miscellaneous information about the dataset. This may include references to external files. LOGICAL FILE ID is the same filename. VERSION NUMBER is the date of the latest ingested file used to create the requested file. DATASET VERSION lists all the individual files used to produce the requested file. FILE CAVEATS provides specific caveats of individual files. This may include references to external files. FILE TYPE is normally CEF but for plots and some other files it can be something else. In principle any type of file including binary files can be included in the CAA database as long as a proper detached header is provided. FILE TIME SPAN tells the requested time interval.
Each parameter is described with a number of useful keywords where the most important ones are: CATDESC provides a concise description of the parameter. COORDINATE SYSTEM provides an acronym of a coordinate system (for
vectors, tensors or their components). Allowed acronyms are provided by Harvey et al. [3]. DELTA PLUS (DELTA MINUS) provides the number of units (of the parameter) to be added to (or be subtracted from) the nominal value to obtain the upper (or lower) limit of the parameter interval within which the data was acquired. This is used in particular with time tags to provide the time interval where the data value is valid. DEPEND 0 ties explicitly the parameters to the independent variable parameter(s) on which it depends. FIELDNAM describes the parameter and which can be used, for example, to give a title for a plot (use LABLAXIS for the axis label). This could be the same as CATDESC. Note, however, that while FIELDNAM is optional, CATDESC is not. FILLVAL is used to replace bad or missing data. FRAME VELOCITY is important to the physical parameters whose values depend upon the motion of the coordinate system in which they are measured. Three possible values are accepted: Observatory (default); Inertial (i.e. GEI); EarthCorotating. LABEL i is used for multi-dimensional parameters to label individual components (as LABLAXIS is not sufficient to describe the variables).
1
Cluster Active Archive: Overview
29
LABLAXIS can be used to label the y-axis of a plot or to provide a column
heading for a data listing. For more than one-dimensional parameters, the labels can be given in LABEL i. QUALITY provides a quality of the parameter, with the following values: 0 – Not applicable; 1 – Known problems, use at your own risk; 2 – Survey data, not for publication; 3 – Good for publication, subject to PI approval; 4 – Excellent data which has received special treatment. REPRESENTATION is used to provide essential information describing vectors and tensors; for details, see Harvey et al. [3]. SI CONVERSION factor is required to take the archived value to the corresponding value in a standard SI unit. For instance, “1:0E 9 > T” is used to transform the magnetic field data stored in nanotesla (nT) into tesla (T). SIGNIFICANT DIGITS provides the number of decimal digits required to preserve the precision of the parameter and can have a value of any positive integer. SIZES provides the dimensions of the array that is required for any parameter represented by more than one component (vectors, tensors, spectral arrays, etc.). For example, SIZES D 3 is for a vector of 3 components. TENSOR ORDER: 0 for scalars (default value), 1 for vectors (e.g., magnetic field or velocity), 2 for tensors (e.g., plasma pressure). UNITS: this provides the unit of the parameter that can be indicated on the axes of a plot. If parameter has no unit, this must be specified by UNITS D “unitless”. VALUE TYPE provides identification of the value type (essential for ASCII conversion) with possible values: CHAR; DOUBLE; FLOAT; INT; ISO TIME; ISO TIME RANGE.
The following example shows the metadata for the FGM SPIN resolution data file on 1 January 2003, 0–1 UT, requested on 17 February 2009: FILE NAME = “C1 CP FGM SPIN 20030101 000000 20030101 010000 V060815.cef” FILE FORMAT VERSION = “CEF-2.0” END OF RECORD MARKER = “$” START META = MISSION ENTRY = “Cluster” END META = MISSION START META = MISSION TIME SPAN VALUE TYPE = ISO TIME RANGE ENTRY = 2000-08-16T12:39:00Z/2009-12-31T23:59:59Z END META = MISSION TIME SPAN START META = MISSION AGENCY ENTRY = “ESA” END META = MISSION AGENCY START META = MISSION DESCRIPTION ENTRY = “The aim of the Cluster mission is to study small-scale structures of the” ENTRY = “magnetosphere and its environment in three dimensions. To achieve this,” ENTRY = “Cluster is constituted of four identical spacecraft that will flight in a”
30
H. Laakso et al.
ENTRY = “tetrahedral configuration. The separation distances between the spacecraft” ENTRY = “will be varied between 40 km and 10 000 km, according to the key” ENTRY = “scientific regions.” END META = MISSION DESCRIPTION START META = MISSION KEY PERSONNEL ENTRY = “Philippe Escoubet>
[email protected] >Cluster Project Scientist” END META = MISSION KEY PERSONNEL START META = MISSION REFERENCES ENTRY = “The Cluster and Phoenix Missions>Cluster project and” ENTRY = “instrument teams>Space Sci. Rev. 79, Nos. 1-2, 1997” END META = MISSION REFERENCES START META = MISSION REGION ENTRY = “Solar Wind” ENTRY = “Bow Shock” ENTRY = “Magnetosheath” ENTRY = “Magnetopause” ENTRY = “Magnetosphere” ENTRY = “Magnetotail” ENTRY = “Polar Cap” ENTRY = “Auroral Region” ENTRY = “Cusp” ENTRY = “Radiation Belt” ENTRY = “Plasmasphere” END META = MISSION REGION START META = MISSION CAVEATS ENTRY = “*CL” END META = MISSION CAVEATS START META = OBSERVATORY ENTRY = “Cluster-1” END META = OBSERVATORY START META = OBSERVATORY CAVEATS ENTRY = “*C1 CQ” END META = OBSERVATORY CAVEATS START META = OBSERVATORY DESCRIPTION ENTRY = “Cluster-1 (Rumba)” ENTRY = “Launched: 09 Aug 2000” ENTRY = “ESA Number: 1” ENTRY = “COSPAR ID: 2000-045A” ENTRY = “USSPACECOM catalogue number 26463” ENTRY = “CSDS Code: C1” ENTRY = “ESOC FD code: S1” ENTRY = “ESA Flight Model Number: FM5” END META = OBSERVATORY DESCRIPTION
1
Cluster Active Archive: Overview
START META = OBSERVATORY TIME SPAN VALUE TYPE = ISO TIME RANGE ENTRY = 2000-07-16T12:39:00Z/2009-12-31T23:59:59Z END META = OBSERVATORY TIME SPAN START META = OBSERVATORY REGION ENTRY = “Solar Wind” ENTRY = “Bow Shock” ENTRY = “Magnetosheath” ENTRY = “Magnetopause” ENTRY = “Magnetosphere” ENTRY = “Magnetotail” ENTRY = “Polar Cap” ENTRY = “Auroral Region” ENTRY = “Cusp” ENTRY = “Radiation Belt” ENTRY = “Plasmasphere” END META = OBSERVATORY REGION START META = EXPERIMENT ENTRY = “FGM” END META = EXPERIMENT START META = EXPERIMENT DESCRIPTION ENTRY = “Fluxgate Magnetometer” END META = EXPERIMENT DESCRIPTION START META = INVESTIGATOR COORDINATES ENTRY = “Andre Balogh>PI>
[email protected]” ENTRY = “Elizabeth Lucek>PI>
[email protected]” END META = INVESTIGATOR COORDINATES START META = EXPERIMENT REFERENCES ENTRY = “*CL CD CAA FGM ICD 0001 V0 1.pdf” ENTRY = “*CL CD FGM USERMAN.pdf” ENTRY = “http://www.sp.ph.ic.ac.uk/Cluster/” END META = EXPERIMENT REFERENCES START META = EXPERIMENT KEY PERSONNEL ENTRY = “Andre Balogh>PI>
[email protected]” ENTRY = “Elizabeth Lucek>PI>
[email protected]” END META = EXPERIMENT KEY PERSONNEL START META = EXPERIMENT CAVEATS ENTRY = “*CL CQ FGM CAVF.txt” END META = EXPERIMENT CAVEATS
31
32
H. Laakso et al.
START META = INSTRUMENT NAME ENTRY = “FGM1” END META = INSTRUMENT NAME START META = INSTRUMENT DESCRIPTION ENTRY = “FGM Experiment on Cluster C1” END META = INSTRUMENT DESCRIPTION START META = INSTRUMENT TYPE ENTRY = “Flux Feedback” END META = INSTRUMENT TYPE START META = MEASUREMENT TYPE ENTRY = “Magnetic Field” END META = MEASUREMENT TYPE START META = INSTRUMENT CAVEATS ENTRY = “*C1 CQ FGM CAVF” END META = INSTRUMENT CAVEATS START META = DATASET ID ENTRY = “C1 CP FGM SPIN” END META = DATASET ID START META = DATA TYPE ENTRY = “CP>CAA Parameter” END META = DATA TYPE START META = DATASET TITLE ENTRY = “Magnetic field, spin resolution” END META = DATASET TITLE START META = DATASET DESCRIPTION ENTRY = “This dataset contains spin resolution measurements of the magnetic field vector” ENTRY = “ from the FGM experiment on the Cluster C1 spacecraft” END META = DATASET DESCRIPTION START META = CONTACT COORDINATES ENTRY = “Elizabeth Lucek>PI>
[email protected]” END META = CONTACT COORDINATES START META = TIME RESOLUTION ENTRY = 4 END META = TIME RESOLUTION START META = MIN TIME RESOLUTION ENTRY = 4.412 END META = MIN TIME RESOLUTION
1
Cluster Active Archive: Overview
33
START META = MAX TIME RESOLUTION ENTRY = 3.636 END META = MAX TIME RESOLUTION START META = PROCESSING LEVEL ENTRY = “Calibrated” END META = PROCESSING LEVEL START META = ACKNOWLEDGEMENT ENTRY = “Please acknowledge the FGM team and ESA Cluster Active Archive” ENTRY = “ in any publication based upon use of this data” END META = ACKNOWLEDGEMENT START META = DATASET CAVEATS ENTRY = “*C1 CQ FGM CAVF” END META = DATASET CAVEATS START META = LOGICAL FILE ID ENTRY = “C1 CP FGM SPIN 20030101 000000 20030101 010000 V060815” END META = LOGICAL FILE ID START META = VERSION NUMBER ENTRY = 060815 END META = VERSION NUMBER START META = DATASET VERSION ENTRY = “Merged file, the dataset version for each segment follows: ” ENTRY = “2003-01-01T00:00:00Z/2003-01-01T01:00:00Z, C1 CP FGM SPIN 20021231 092502 20030102 182906 V01” ENTRY = “ 01” END META = DATASET VERSION START META = FILE CAVEATS ENTRY = “CAA Merged File - $Id: cefmerge.c,v 1.23 2008/08/06 14:56:43 cperry Exp cperry $” ENTRY = “The file caveats for each segment follows:-” ENTRY = “2003-01-01T00:00:00Z/2003-01-01T01:00:00Z C1 CP FGM SPIN 20021231 092502 20030102 182906 V01” ENTRY = “Calibration parameters have been estimated using the Fourier analysis” ENTRY = “ method, solar wind analysis and the range jump correction method.” END META = FILE CAVEATS START META = FILE TYPE ENTRY = “cef” END META = FILE TYPE START META = METADATA TYPE ENTRY = “CAA” END META = METADATA TYPE
34
H. Laakso et al.
START META = METADATA VERSION ENTRY = “2.0” END META = METADATA VERSION START META = FILE TIME SPAN VALUE TYPE = ISO TIME RANGE ENTRY = 2003-01-01T00:00:00.000Z/2003-01-01T01:00:00.000Z END META = FILE TIME SPAN START META = GENERATION DATE VALUE TYPE = ISO TIME ENTRY = 2009-02-17T15:49:51Z END META = GENERATION DATE START VARIABLE = time tags C1 CP FGM SPIN PARAMETER TYPE = “Support Data” CATDESC = “Interval centred time tag” UNITS = “s” SI CONVERSION = “1.0 > s” SIZES = 1 VALUE TYPE = ISO TIME SIGNIFICANT DIGITS = 24 FILLVAL = 9999-12-31T23:59:59Z FIELDNAM = “Universal Time” LABLAXIS = “UT” DELTA PLUS = half interval C1 CP FGM SPIN DELTA MINUS = half interval C1 CP FGM SPIN END VARIABLE = time tags C1 CP FGM SPIN START VARIABLE = half interval C1 CP FGM SPIN PARAMETER TYPE = “Support Data” CATDESC = “Half averaging interval length” UNITS = “s” SI CONVERSION = “1.0>s” SIZES = 1 VALUE TYPE = FLOAT SIGNIFICANT DIGITS = 6 FILLVAL = -1e30 FIELDNAM = “Half width of averaging interval” LABLAXIS = “s” END VARIABLE = half interval C1 CP FGM SPIN START VARIABLE = B vec xyz PARAMETER TYPE = ENTITY = PROPERTY = FLUCTUATIONS =
gse C1 CP FGM SPIN “Data” “Magnetic Field” “Vector” “Waveform”
1
Cluster Active Archive: Overview
CATDESC = UNITS = SI CONVERSION = TENSOR ORDER = COORDINATE SYSTEM = REPRESENTATION 1 = SIZES = VALUE TYPE = SIGNIFICANT DIGITS = FILLVAL = QUALITY = FIELDNAM = LABLAXIS = DEPEND 0 = LABEL 1 = END VARIABLE = B vec xyz gse
“Cluster C1, Magnetic Field Vector, spin resolution in GSE” “nT” “1.0E-9>T” “1” “GSE>Geocentric Solar Ecliptic” “x”, “y”, “z” 3 FLOAT 6 -1e30 3 “Cluster C1, Magnetic Field Vector, spin resolution in GSE” “Mag Field” time tags C1 CP FGM SPIN “Bx”, “By”, “Bz” C1 CP FGM SPIN
START VARIABLE = B mag C1 CP FGM SPIN PARAMETER TYPE = “Data” ENTITY = “Magnetic Field” PROPERTY = “Magnitude” FLUCTUATIONS = “Waveform” CATDESC = “Cluster C1, Magnetic Field Magnitude, spin resolution” UNITS = “nT” SI CONVERSION = “1.0E-9>T” TENSOR ORDER = “0” SIZES = 1 VALUE TYPE = FLOAT SIGNIFICANT DIGITS = 6 FILLVAL = -1.0E30 QUALITY = 3 FIELDNAM = “Cluster C1, Magnetic Field Magnitude, spin resolution” LABLAXIS = “B” DEPEND 0 = time tags C1 CP FGM SPIN END VARIABLE = B mag C1 CP FGM SPIN START VARIABLE = sc pos PARAMETER TYPE ENTITY PROPERTY CATDESC UNITS SI CONVERSION TENSOR ORDER COORDINATE SYSTEM REPRESENTATION 1 SIZES VALUE TYPE SIGNIFICANT DIGITS FILLVAL
xyz = = = = = = = = = = = = =
35
gse C1 CP FGM SPIN “Data” “Other1” “Vector” “Position of Cluster C1 in GSE” “km” “1.0E3>m” “1” “GSE>Geocentric Solar Ecliptic” “x”, “y”, “z” 3 FLOAT 7 -1.0E30
36 QUALITY FIELDNAM LABLAXIS DEPEND 0 LABEL 1 END VARIABLE = sc pos
H. Laakso et al. = = = = = xyz
0 “Position of Cluster C1 in GSE” “Position” time tags C1 CP FGM SPIN “x”, “y”, “z” gse C1 CP FGM SPIN
START VARIABLE = range C1 CP FGM SPIN PARAMETER TYPE = “Support Data” CATDESC = “Cluster C1, FGM instrument range, defined on spin resolution time line” TENSOR ORDER = “0” UNITS = “Unitless” SIZES = 1 VALUE TYPE = INT SIGNIFICANT DIGITS = 1 FILLVAL = -9 FIELDNAM = “Cluster C1, FGM Instrument Range, on spin resolution time line” LABLAXIS = “Range” DEPEND 0 = time tags C1 CP FGM SPIN END VARIABLE = range C1 CP FGM SPIN START VARIABLE = tm C1 CP FGM SPIN PARAMETER TYPE = “Support Data” CATDESC = “Cluster C1, FGM telemtry mode (burst mode/normal mode) on spin resolution time line” UNITS = “Unitless” TENSOR ORDER = “0” SIZES = 1 VALUE TYPE = INT SIGNIFICANT DIGITS = 2 FILLVAL = -99 FIELDNAM = “Cluster C1, telemetry mode on spin resolution time line” LABLAXIS = “TM” DEPEND 0 = time tags C1 CP FGM SPIN END VARIABLE = tm C1 CP FGM SPIN DATA UNTIL = EOF 2003-01-01T00:00:02.187Z,2,-15.086,7.672,8.769,19.062,31105.1,91115.5,33976.5,2,22 $ 2003-01-01T00:00:06.197Z,2,-15.017,9.020,8.156,19.323,31108.8,91119.2,33972.9,2,22 $ 2003-01-01T00:00:10.208Z,2,-14.396,9.873,5.241,18.226,31112.4,91123.0,33969.3,2,22 $ 2003-01-01T00:00:14.218Z,2,-11.938,14.285,2.235,18.750,31116.1,91126.8,33965.7,2,22 $ 2003-01-01T00:00:18.229Z,2,-11.995,15.514,5.203,20.289,31119.8,91130.6,33962.1,2,22 $ 2003-01-01T00:00:22.240Z,2,-11.672,15.160,5.497,19.907,31123.5,91134.4,33958.5,2,22 $ 2003-01-01T00:00:26.250Z,2,-11.143,13.097,7.096,18.602,31127.2,91138.1,33954.9,2,22 $ 2003-01-01T00:00:30.261Z,2,-12.215,12.659,6.489,18.751,31130.8,91141.9,33951.3,2,22 $
1
Cluster Active Archive: Overview
37
References 1. Allen A., S.J. Schwartz, C. Harvey, C. Perry, C. Huc, P. Robert, Cluster Exchange Format – Data File Syntax, DS-QMW-TN-0010, v2.4, 04 March 2008. URL: http://caa.estec.esa.int/ caa/documentation.xml 2. Escoubet, C. P., M. Fehringer, and M. Goldstein, The Cluster mission, Ann Geophys., 19, 1197, 2001. 3. Harvey C.C., A.J. Allen, F. D´eriot, C. Huc, M. Nonon-Latapie, C.H. Perry, S.J. Schwartz, T. Erikssony and S. McCaffrey, Cluster Metadata Dictionary, CAA-CDPP-TN-0002, v2.3, 03 March 2008. URL: http://caa.estec.esa.int/caa/documentation.xml 4. McCaffrey, S., Command Line Query Interface, Doc: CAA-EST-CMDLINE-0001, v2.0, 06 April 2007. URL: http://caa.estec.esa.int/documents/CAA-EST-CMDLINE-001.pdf 5. Perry, C., Raw Data Network Delivery Interface Document, Doc CAA-EST-ID-0001, v1.2, 28 November 2005. URL: http://caa.estec.esa.int/documents/ CAA-EST-CMDLINE-001.pdf
Chapter 2
ASPOC Data Products in the Cluster Active Archive K. Torkar and H. Jeszenszky
Abstract The instrument ASPOC (Active Spacecraft Potential Control) controls the electric potential of the Cluster spacecraft by means of an ion beam. This modification of the charge balance improves the plasma measurements on board. Beneficial effects have also been observed for the electric field measurements by double probes (EFW). Comprehensive knowledge about the status of the instruments including the ion beam current is necessary to correctly interpret spacecraft potential data. This paper provides an overview of the instrument modes and the parameters contained in the ASPOC data sets in the Cluster Active Archive. A few examples illustrate the relation between instrument modes and data.
2.1 Introduction The ASPOC (Active Spacecraft Potential Control) instruments for the Cluster mission have been described by Torkar et al. [6]. The primary objective of ASPOC is to insure the effective and complete measurement of the ambient plasma distribution functions down to low energy. With the exception of very rare eclipse time intervals the Cluster spacecraft are illuminated by the Sun, and photo-electrons are emitted from the surface. Throughout the Cluster orbit, i.e. outside the plasmasphere, emitted photo-electrons will dominate over collected plasma electrons. A balance between escaping and collected electrons is achieved at a positive potential forcing low energy photoelectrons to orbit back to the spacecraft, allowing only a fraction of the photoelectrons at higher energies to escape and be in current balance with collected plasma electrons. Ions can be neglected because of their low mobility compared to the electrons. The resulting uncontrolled potentials may reach C50 V and more in regions of the magnetosphere with tenuous plasma. In order to control the electrical potential of the spacecraft, the ASPOC instruments emit a beam of positive indium ions (115 amu) at energies of about 6–9 keV K. Torkar () and H. Jeszenszky Space Research Institute, Austrian Academy of Sciences, Schmiedlstrasse 6, 8042 Graz, Austria e-mail:
[email protected]
H. Laakso et al. (eds.), The Cluster Active Archive, Astrophysics and Space Science Proceedings, DOI 10.1007/978-90-481-3499-1 2, c Springer Science+Business Media B.V. 2010
39
40
K. Torkar and H. Jeszenszky
and currents up to about 30 A. Typical currents applied in the mission were between 10 and 20 A. The emission of positive charges from the spacecraft balances the excess of charge accumulating on the vehicle from interactions with the environment. By adjusting the positive emission current, the spacecraft potential can thus be adjusted to single-digit positive voltages. As a result of the equilibrium between the relevant currents of photo-electrons generated at the spacecraft surface, plasma electrons from the environment, and the ASPOC ion beam current, the spacecraft potential will be clamped to a potential determined by a current balance between ASPOC-generated ions on the one hand and escaping photoelectrons minus collected ambient electrons on the other hand. In a tenuous plasma the latter term can be neglected. The resulting improvement of both particle and electric field measurements is most effective in low plasma density environments and boundaries thereof. In these environments the equilibrium potential of the spacecraft is not only strongly fluctuating together with the variations of plasma density, but also the absolute value of the potential easily reaches tens of volts positive. As a consequence, the bulk of photo-electrons will return to the surface and the plasma electron detectors, where the resulting high count rates let the micro-channel plates age at a faster rate. The energies and trajectories of plasma electrons and ions are modified in the potential well around the spacecraft, thereby complicating the interpretation of the distribution functions and the calculation of plasma moments. The improvement of the electron measurements by a controlled spacecraft potential is illustrated in Fig. 2.1 adapted from Torkar et al. [7]. It shows energy-time spectrograms of field-aligned electrons measured by the PEACE-LEEA sensors (for an instrument description see Szita et al. [5]) of Spacecraft 1 (panel a) and 4 (panel b) over a 2-h time interval starting at 06 UT on May 21, 2002. The electron features in the 10–100 eV decade clearly visible on spacecraft 4 – where ASPOC reduced the potential to 8 V – are not discernible on spacecraft 1, where the uncontrolled potential peaked at 47 V. The spacecraft potential is measured by the EFW instrument (Gustafsson et al., [2, 3]). Its probes are controlled to stay within 1–2 V relative to the ambient plasma and thus provide a reference for the measurement. A reduction of the spacecraft potential also helps to avoid wake artefacts in electric field measurements by the double probes, which may occur in cold, streaming plasma, e.g., polar wind [1]. Under similar conditions, the ion spectrometer CIS [4] could detect cold ion beams (HC and OC ) only while ASPOC was operating. As the photo-emission is fairly stable, the potential of a spacecraft (without control) reflects the variation of the plasma electron current and thereby images the electron density and temperature. As the temperature effect is relatively small, the uncontrolled spacecraft potential is often used as an estimator for plasma density. However, the introduction of an artificial ion current for control purposes changes the relationship dramatically. Under the influence of a constant artificial ion beam current, the controlled spacecraft behaves like a strongly biased plasma probe with rather small residual variations of the potential. As illustrated in Fig. 2.2, a good correlation between the uncontrolled potential (spacecraft 1, black line, scale on the left hand side) and the controlled potential (here represented by spacecraft 3, green
2
ASPOC Data Products in the Cluster Active Archive
a
41
C1 2002141 0600 PA 180
Energy [eV]
1000
100
10
06
b
07
08 UT
C4 2002141 0600 PA 180
Energy [eV]
10–4
100
10–5
10–6
10
06
07
Energy Flux [ergs/(cm 2 s sr eV)]
1000
08 UT
Fig. 2.1 Energy-time spectrograms of field-aligned electrons from the PEACE-LEEA sensors of spacecraft 1 (panel a) and spacecraft 4 (panel b) plotted as function of time on May 21, 2002, from 06 to 08 UT
line and dots) may still exist. The potential of spacecraft 3 is shown in two different ways. The full, green line refers to the common scale with spacecraft 1 on the left hand side and demonstrates the significant reduction of the potential. The same data set is also shown by the green dots for which the right hand scale is valid. The good correlation between the residual variations of the controlled potential on spacecraft 3 with the uncontrolled values on spacecraft 1 is obvious. Thus, by inserting the ASPOC ion current into the current balance equation for the controlled spacecraft one can deduce the uncontrolled potential and use it for density estimations as usual.
42
K. Torkar and H. Jeszenszky
Fig. 2.2 Spacecraft potential (raw potential between the probes and the spacecraft body) measured by EFW (Electric Fields and Waves, [2]) on spacecraft 1 (black, scale at the left) and 3 (both the green line with scale at the left and green dots with scale on the right) on April 30, 2002, from 10:20 to 12:00 UT
2.2 Instrument Overview 2.2.1 Ion Emitters The ion emitters are liquid metal ion sources using indium as charge material. A needle is mounted in a reservoir with indium, which has to be elevated to operational temperature (well above the melting point of indium at 156ıC by an attached small heater. The melting process is initiated by command and takes about 12–20 min. When the specified temperature has been reached, high voltage is turned on and ramped up until the field emission process around the liquid indium at the tip ignites and an ion beam is generated. As soon as the ion beam appears, the high voltage supply is switched into a current controlled mode where the emission current is being set, while the extraction voltage adjusts itself to the conditions of the emitter. The emitters are operated one at a time. For lifetime and redundancy, each instrument holds eight emitters, arranged in two “modules” with four emitters each. All emitters within a module are connected to a single high voltage circuit. The selection of the active emitter is made by heating one of them (the tip curvature of cold emitters with solid indium is not suitable for field emission).
2
ASPOC Data Products in the Cluster Active Archive
43
2.2.2 Currents in the Emitter System The behaviour of the ion beam current is better understood with some knowledge of the currents flowing in the emitter system. At first, there is the current of the emitted ion beam. This current is referred to as ion current, beam current, or emission current. It continues through the ambient plasma and is closed by other currents to the spacecraft surface, particularly the photoemission current. ASPOC ions returning to the spacecraft can be totally neglected even if the ion beam is emitted perpendicular to the magnetic field. Secondly, there is the total current delivered by the high voltage supply to the emitter. This current includes the beam current and internal loss currents (e.g. the current to the extraction and beam focusing electrodes), and may therefore be larger than the beam current. There are two major types of loss currents: currents from ions hitting the extractor electrode, and leakage currents through insulators. The percentage of extractor electrode currents with regard to the total current is small (0–20%) for small to medium currents and may increase from 30% to 50% for currents of about 50 A. The typical emission currents applied on Cluster range between 10 and 16 A. They set an upper limit to the spacecraft potential on the order of 6–8 V. The emission current of an emitter may be increased to maximum current over a short period (between 30 s and a few minutes) as a precaution to remove any contamination from the emitter, thereby ensuring that the operating voltage remains within operational limits. This procedure is called “cleaning”.
2.2.3 Instrument Modes The most widely used active mode of the instrument is the “constant total current mode” (ITOT). It sets a constant output current of the high voltage unit, which includes any losses inside the lens system. Experience has shown that the resulting emission of an almost constant ion current fulfils all requirements for spacecraft potential control in the magnetosphere and the solar wind even without on-board feedback from measurements of the spacecraft potential. In “constant ion current mode” (IION) the processor of the instrument reads the monitor of the outgoing beam current and adjusts the output current of the high voltage supply to compensate for any losses in the system. This mode has been used during commissioning only. In the two available, so-called feedback modes, a measurement of the spacecraft potential is supplied to ASPOC by either the electric field experiment (EFW) or the electron analyser (PEACE) and this information is then used to adjust the beam current in order to maintain a constant value of the potential in a closedloop scheme. This mode is called feedback mode with EFW (mode FEFW) or feedback mode with PEACE (mode FPEA). The measurements of the spacecraft potential are updated once every spin and sent to ASPOC via dedicated serial, digital inter-experiment links. The mode FEFW has been tested successfully during commissioning. Unfortunately, active soundings of the WHISPER instrument cause
44
K. Torkar and H. Jeszenszky
spikes in the potential information transmitted on board. The control software could not handle these spikes, so that this feedback mode could not be used in the nominal mission. The feedback mode with PEACE suffered from the difficulty to provide a reliable potential estimator from the electron spectra onboard, and was not used in the mission at all. In standby mode (STDB) both the emitters and their heaters are turned off. The standby mode is also the safe mode of the instrument, to which it returns autonomously under certain error conditions. The transition into standby mode also clears all error flags and the emitter selection, and disables high voltage and the heaters. In order to reduce the time before emission starts, a “hot standby” mode (HOTS) keeps the indium in a liquid state. This mode can be used to interrupt the ion emission by command, without change of modes or emitters before and after the break. The re-ignition time is reduced to the time required to sweep the high voltage (less than a minute). A “test and commissioning” mode (T&C) varies the total ion current in steps of 8 or 16 s with 2 or 4 A current increments. This mode has been used occasionally to establish the current-voltage characteristics of the spacecraft. A technical mode (TECH) is available for low-level commanding during commissioning and re-commissioning of emitters. Start-up (STUP) is a state of the instrument at the beginning of an active mode when the emitter is being warmed up and ion emission has not yet started. Depending on ambient temperature and emitter condition it takes about 12–20 min to reach a temperature inside the emitters which is sufficient to ignite the ion beam. Within this period the “instrument mode” reported in telemetry is already the commanded target mode, although there is no ion emission yet.
2.3 ASPOC Datasets in the Cluster Active Archive The ASPOC Datasets in the Cluster Active Archive are listed in Table 2.1. All data sets are Cluster Exchange Format (CEF) files, except the textual caveat description. The caveat information consists of an automatically generated part (CEF) and a manually generated part (text) added after inspection of the data produced in the batch process. The automatically generated caveats shall help the user to assess the quality. The production software derives a quality parameter from the total current consumed by the ion emitter and the emitted ion current. In the typical mode of operation a constant current is applied to the ion emitters. If internal loss currents can be neglected, the emitted ion current is also constant and the resulting spacecraft potential has the best stability. In the presence of loss currents, the emitted ion current and with it the spacecraft potential will start to fluctuate. Table 2.2 summarises the definition of the quality levels. There are new entries whenever the instrument mode changes, or when the commanded emission current changes.
2
ASPOC Data Products in the Cluster Active Archive
45
Table 2.1 ASPOC data sets Product Description IONC ASPOC ion beam current at a sampling interval of 0.5 s IONS Snapshots (samples of 8.25 s duration collected every 128.8 s) of the ion beam current with a sampling interval of 0:033 s. Suitable to check current fluctuations in the beam and to resolve the current profile during the ignition or shut-down of an ion emitter STAT Comprehensive status information of the instrument at 5.15 s resolution (10.3 s for some parameters) Operating mode, including emitter start-up status and cleaning: In both of these states the beam current deviates significantly from the nominal current Emitter identification and emitter module identification: Each instrument carries eight emitters bundled into two modules with a common high voltage system within a module. Both emitters and modules may exhibit individual characteristics and performance, which may have an effect on the value and temporal behaviour of the beam current Anomaly flags: These flags give the reason for an anomaly, for example failure of ignition of an emitter Ion beam energy: The voltage applied to the emitter is equivalent to the energy of the ions in the beam Total ion source current: The current delivered by the high voltage supply into the emitter will be higher than the emitted current if internal losses are present Heater current: The current drawn by the heater element associated with an emitter Heater voltage: The voltage applied to the heater element associated with an emitter. Voltage and current together can be used to calculate not only the electrical power but also the temperature of the heater element. From this temperature, the temperature of the emitter tip can be derived Temperature of the ion source module: This parameter contains the ambient temperature of the emitter module. The temperature of the emitter tip shows a strong dependence on the heater temperature, but also some influence of this ion source module temperature Raw spacecraft potential received on board from EFW: This parameter mirrors the spacecraft potential data delivered by the instrument EFW to ASPOC on board the spacecraft. It differs from the EFW data product in the archive with respect to timing CMDH
CAVEATS
Command history with time stamps according to on-board execution time by the instrument. The execution delay may reach 1 min. Included parameters are the command code, the command counter, command mnemonic, description, and parameter (if any) Information on the status and quality of the ion emission (see the description of quality levels). Time spans correlate with commands to change the operational mode or the value of the current
ACTIVE
Mean quality level during time span Minimum quality level during time span Maximum quality level during time span Comment; a textual description associated with the average quality level value
Contains the time spans when ASPOC is switched on and is emitting a significant ion current (>1 A). Useful for quick checks whether ASPOC was operational
46
K. Torkar and H. Jeszenszky Table 2.2 Quality level definition Quality flag Condition 1 Ibeam =Itotal > 0:97 2 0:92 < Ibeam =Itotal 0:97 3 0:75 < Ibeam =Itotal 0:92 4 0:30 < Ibeam =Itotal 0:75 5 0:00 < Ibeam =Itotal 0:30 8 Itotal 20A and Ibeam =Itotal 0:50 9 Ibeam D 0:0
Ion emission quality definition Excellent Good, almost completely stable Moderate fluctuations Substantial fluctuations Severe variations Cleaning No emission
2.4 Examples and Applications No specific software is required to use the data sets. However, visualisation software in IDL language originally developed for the validation of the data products is available. It allows to browse through a set of CEF files, either uncompressed or in gzip. Check boxes allow to select certain parameters. Plot options and scales can be set automatically or interactively. The plots presented in this section have been generated by this tool. Figure 2.3 shows beam current and voltage in the top and bottom panel, respectively, over a 12-h time interval for spacecraft 3. The colour bar at the bottom indicates the quality flag, which is one (excellent) for this operational interval of about 7 h. The commands to enter into active mode have been sent shortly before 04 UT (red vertical lines). It takes about 15 min (interval indicated by the yellow status bar) until the emitter is hot and ion emission starts. The time interval contained in the respective entry in the ACTIVE data set would only cover the time interval of the green status bar. Figure 2.4 shows (from top to bottom) for the same time interval the beam current, total current, and spacecraft potential (as transmitted on board from EFW to ASPOC). Noteworthy is the “bite-out” of the beam current at 18:30 UT, due to a suddenly appearing and later disappearing leakage current inside the emitter. Although the beam current decreases by about 30%, the spacecraft potential hardly shows any reaction. This shows that variations of the beam current should be taken into account for accurate studies related to spacecraft potential, but do not generally deteriorate the control of the spacecraft potential. Finally, Fig. 2.5 illustrates an application of the beam current snapshot parameter (IONS) at 33 ms resolution. The plotted interval covers 15 s around a beam turn-on. The top panel contains the standard beam current parameter (IION) which cannot fully resolve the variation of the beam current, whereas the snapshot reflects the variations very accurately, which is confirmed by the analogous variation of the spacecraft potential (bottom panel) taken from the EFW data set C3 CP EFW L2 P.
2
ASPOC Data Products in the Cluster Active Archive
47
Satellite #3 - 20040728
30
I_Beam [uA]
NOE
40
CLN
50
0 10
4 2
UT
0 00 2004-07-28
Energy [kV]
Q=2 Q=1
8
OFF
Q=3
Q=4
10
6
#051: ZEASTDBS (0x1000)
#046: ZEAITOTS (0x1100)
Q=5
20
02
04
06
08
10
12 2004-07-28
Fig. 2.3 ASPOC data set visualisation with beam current, beam energy, data quality, and commands
Fig. 2.4 ASPOC data set visualisation with beam current, total current, and spacecraft potential
48
K. Torkar and H. Jeszenszky
Fig. 2.5 Example of ASPOC snapshot data set with corresponding variation of the spacecraft potential
2.5 Status of the Data Sets As the ASPOC instruments were finally shut down at the end of June, 2008, the data set in the Cluster Active Archive can be considered complete. Unless there are future outside requests for additions or modifications, the data set is also the final one. Files have been generated whenever the instruments were powered on, even if no ion emission took place. This is the case for many data sets in the extended mission due to exhaustion of the ion emitter reservoirs. Acknowledgements The authors would like to thank many teams for their valuable efforts: the CAA team for building the archive, the ASPOC team for building the instruments, the EFW and PEACE teams for good co-operation during the project, and ESOC and JSOC for operational support.
References 1. Engwall, E., A. I. Eriksson, M. Andr´e, I. Dandouras, G. Paschmann, J. Quinn, K. Torkar, Low-energy (order 10 eV) ion flow in the magnetotail lobes inferred from spacecraft wake observations, Geophys. Res. Lett 33, L06110, doi:10.1029/2005GL025179, 2006.
2
ASPOC Data Products in the Cluster Active Archive
49
2. Gustafsson, G, R. Bostrom, G. Holmgren, A. Lundgren, K. Stasiewicz, L. Ahlen, F.S. Mozer, D. Pankow, P. Harvey, P. Berg, R. Ulrich, A. Pedersen, R. Schmidt, A. Butler, A. Fransen, D. Klinge, C.-G. Falthammar, P.-A. Linqvist, S. Christenson, J. Holtet, B. Lybekk, T.A. Sten, P. Tanskanen, K. Lappalainen, J. Wygant, The electric field experiment for the Cluster mission, Space Sci. Rev. 79, 137–156, 1997. 3. Gustafsson, G., M. Andr´e, T. Carozzi, A.I. Eriksson, C.-G. F¨alhammar, R. Grard, G. Holmgren, J.A. Holtet, N. Ivchenko, T. Karlsson, Y. Khotyaintsev, S. Klimov, H. Laakso, P.-A. Lindqvist, B. Lybekk, G. Marklund, F. Mozer, K. Mursula, A. Pedersen,B. Popielawska, S. Savin, K. Stasiewicz, P. Tanskanen, A. Vaivads, J-E.Wahlund, First results of electric field and density observations by Cluster EFW based on initial months of operation, Ann. Geophys. 19, 1219– 1240, 2001. 4. R`eme, H., Aoustin, C., Bosqued, J. M., Dandouras, I, et al., First multispacecraft ion measurements in and near the Earth’s magnetosphere with the identical Cluster ion spectrometry (CIS) experiment, Ann. Geophys. 19, 1303–1354, 2001. 5. Szita, S., A. N. Fazakerley, P. J. Carter, et al., Cluster PEACE observations of electrons of spacecraft origin, Ann. Geophys 19, 1721–1730, 2001. 6. Torkar K., W. Riedler, C.P. Escoubet M. Fehringer, R. Schmidt, R.J.L. Grard, H. Arends, F. R¨udenauer, W. Steiger, B.T. Narheim, K. Svenes, R. Torbert, M. Andr´e, A. Fazakerley, R. Goldstein, R.C. Olsen, A. Pedersen, E. Whipple, H. Zhao, Active spacecraft potential control for Cluster – implementation and first results, Ann. Geophys 19, 1289–1302, 2001. 7. Torkar K., K.R. Svenes, A. Fazakerley, S. Szita, H. R`eme, I. Dandouras, M. Fehringer, C.P. Escoubet, M. Andr´e, Improvement of plasma measurements onboard Cluster due to spacecraft potential control, Adv. Space Res 36, doi:10.1016/j.asr.2005.01.109, 2005.
Chapter 3
Cluster Ion Spectrometry (CIS) Data in the Cluster Active Archive (CAA) I. Dandouras, A. Barthe, E. Penou, S. Brunato, H. R`eme, L.M. Kistler, M.B. Bavassano-Cattaneo, A. Blagau, and the CIS Team
Abstract The Cluster Active Archive (CAA) aims at preserving the four Cluster spacecraft data, so that they are usable in the long-term by the scientific community as well as by the instrument team PIs and Co-Is. This implies that the data are filed together with the descriptive and documentary elements making it possible to select and interpret them. The CIS (Cluster Ion Spectrometry) experiment is a comprehensive ionic plasma spectrometry package onboard the four Cluster spacecraft, capable of obtaining full three-dimensional ion distributions (about 0–40 keV/e) with a time resolution of one spacecraft spin (4 s) and with mass-per-charge composition determination. The CIS package consists of two different instruments, a Hot Ion Analyser (HIA) and a time-of-flight ion Composition Distribution Function (CODIF) analyser, plus a sophisticated dual-processor based instrument control and
I. Dandouras (), A. Barthe, E. Penou, S. Brunato, and H. R`eme Universit´e de Toulouse, Centre d’Etude Spatiale des Rayonnements, B.P. 44346, 31028 Toulouse, France and CNRS, UMR 5187, B.P. 44346, 31028 Toulouse, France e-mail:
[email protected];
[email protected];
[email protected] A. Barthe AKKA Technologies, 6 Rue R. Camboulives, 31036 Toulouse, France e-mail:
[email protected] S. Brunato Noveltis, 2 Avenue de l’Europe, 31520 Ramonville-Saint-Agne, France e-mail:
[email protected] L.M. Kistler Space Science Center, University of New Hampshire, Durham, NH 03824, USA e-mail:
[email protected] M.B. Bavassano-Cattaneo Istituto di Fisica dello Spazio Interplanetario, INAF, Via del Fosso del Cavaliere 100, 00133 Roma, Italy e-mail:
[email protected] A. Blagau Institute of Space Sciences, P.O. Box MG-23, RO 77125 Bucharest-Magurele, Romania e-mail:
[email protected]
H. Laakso et al. (eds.), The Cluster Active Archive, Astrophysics and Space Science Proceedings, DOI 10.1007/978-90-481-3499-1 3, c Springer Science+Business Media B.V. 2010
51
52
I. Dandouras et al.
data processing system (DPS). For the archival of the CIS data a multi-level approach has been adopted. The CAA archival includes processed raw data (Level 1 data), moments of the ion distribution functions (Level 2 data), and calibrated highresolution data in a variety of physical units (Level 3 data). The latter are 3-D ion distribution functions. In addition, a software package has been developed to allow the CAA user to interactively calculate partial or total moments of the ion distributions. The CIS data archive includes also experiment documentation, graphical products for browsing through the data, and data caveats. Given the complexity of an ion spectrometer, and the variety of its operational modes, each one being optimised for a different magnetospheric region or measurement objective, consultation of the data caveats by the end user will always be a necessary step in the data analysis.
3.1 Introduction The Cluster Active Archive (CAA) aims at preserving the four Cluster spacecraft data, so that they are usable in the long-term by the world-wide scientific community as well as by the instrument team PIs and Co-Is. Its purpose is to maximise the scientific return from the mission, and to ensure that the unique data set returned by the Cluster mission is preserved in a stable, long-term archive for scientific analysis beyond the end of the mission. This implies that the instrument data, properly calibrated, are filed together with the descriptive and documentary elements making it possible to select and interpret them [8]. The CAA home page is at http://caa.estec.esa.int/.
3.2 The CIS Experiment The CIS (Cluster Ion Spectrometry) experiment is a comprehensive ionic plasma spectrometry package onboard the four Cluster spacecraft, capable of obtaining full three-dimensional ion distributions (about 0–40 keV/e) with a time resolution of one spacecraft spin (4 s) and with mass-per-charge composition determination [10]. The prime scientific objective of the CIS experiment is the study of the dynamics of magnetised plasma structures in and in the vicinity of the Earth’s magnetosphere, with the determination, as accurately as possible, of the local orientation and the state of motion of the plasma structures required for macrophysics and microphysics studies. The four Cluster spacecraft encounter ionic plasma of vastly diverse characteristics in the course of 1 year (Fig. 3.1). In order to study all the plasma regions with the fluxes shown in Fig. 3.1, the CIS experiment needs therefore to be a highly versatile and reliable ionic plasma experiment, capable of measuring both the cold and hot ions of Maxwellian and non-Maxwellian populations (for example, beams) from the solar wind, the magnetosheath, and the magnetosphere (including the upper ionosphere), with sufficient angular, energy and mass resolutions to accomplish the scientific objectives.
3
Cluster Ion Spectrometry (CIS) Data in the Cluster Active Archive (CAA)
53
IONS 1010 SW
CIS 2 / HIA LOW SIDE
DIFFRENTIAL DIRECTIONAL ENERGY FLUX (cm2.s.sr)–1
109
MP
108
CIS 1/ CODIF LOW SIDE
MSH
UPW 0+ 107
CIS 1/ CODIF HIGH SIDE PM
106
PS 105
LOBE
CIS 2/ HIA HIGH SIDE
MSPH
104
CIS 1/RPA
LOBE 103
1
10
100 1000 ENERGY (eV)
10000
Fig. 3.1 Representative ion fluxes encountered along the Cluster orbit in the solar wind (SW), the magnetopause (MP), the magnetosheath (MSH), the plasma mantle (PM), the plasma sheet (PS), the lobe and upwelling ions (UPW). The range of the different sensitivities of CIS1/CODIF (low side, high side and RPA) and CIS2/HIA (low side and high side) are shown with different colours
To satisfy all these criteria, which cannot be met with a single instrument, the CIS package consists of two different instruments: A time-of-flight ion Composition and Distribution Function analyser (CODIF,
or CIS-1) A Hot Ion Analyser (HIA, or CIS-2)
In addition, each of the instruments, in order to be able to cover a dynamic range of about 6 orders of magnitude in particle fluxes, provides two different geometric factors: a high-sensitivity side (or HS) and a low-sensitivity side (or LS).
54
I. Dandouras et al.
The CIS experiment includes also a sophisticated dual-processor based instrument control and data processing system (DPS). The CIS home page is at http://cluster.cesr.fr:8000/.
3.2.1 The CODIF (CIS-1) Instrument The CODIF instrument is a high-sensitivity mass-resolving spectrometer with an instantaneous 360ı 8ı field of view to measure full 3-D distribution functions of the major ion species (in as much as they contribute significantly to the total mass density of the plasma), within one spin period of the spacecraft. Typically these include HC , HeC , HeCC and OC , with energies from 25 eV=e to 40 keV/e and with medium .22:5ı / angular resolution. The CODIF instrument combines ion energy per charge selection, by deflection in a rotationally symmetric toroidal electrostatic analyser, with a subsequent time-of-flight analysis after post-acceleration to 15 keV=e. Ions are selected as a function of their E=q (energy per charge) ratio, by sweeping the high voltage applied between the two toroidal hemispheres. The full energy sweep with 31 contiguous energy channels is performed 32 times per spin. In the time-of-flight (TOF) section the velocity of the incoming ions is measured, which allows then the calculation of their m=q (mass per charge) ratio. Microchannel plate (MCP) electron multipliers are used to detect both the ions and the secondary electrons, which are emitted from a carbon foil at the entry of the TOF section, during the passage of the ions. These secondary electrons give the “start” signal, for the time-of-flight measurement, and the position information (elevation angle of the incoming ion, provided by the MCP sectoring in anodes). In order to cover populations ranging from magnetosheath protons to tail lobe ions, a dynamic range of more than 105 is required. CODIF therefore consists of two sections, each with a 180ı field of view, with geometry factors differing by a factor of 100. This way, one of the sections will have counting rates which are statistically meaningful and which at the same time can be handled by the time-offlight electronics. However, intense ion fluxes can in some cases saturate the CODIF instrument (particularly if data are acquired from the high sensitivity side), but these fluxes are measured with HIA. The operation of the high-sensitivity side (“high-G”, or “HS”) and of the low-sensitivity side (“low-g”, or “LS”) on CODIF is mutually exclusive, and only one of the two sides can be selected at a time to supply data. The high-sensitivity side is divided into eight sectors (or anodes), 22:5ı each, and the low-sensitivity side into six 22:5ı sectors, i.e. there are two “blind” anodes. With an additional Retarding Potential Analyser (RPA) device in the aperture system of the CODIF sensor, and with pre-acceleration for the energies below 25 eV/e, the range is extended to energies as low as almost the spacecraft potential. The retarding potential analyser operates only in the RPA mode, and provides an energy range between about 0.7 and 25 eV/e (with respect to the spacecraft potential). The operation on CODIF of the RPA mode and of the normal magnetospheric modes (which provide a 25 eV/e to 40 keV/e energy range) is mutually exclusive.
3
Cluster Ion Spectrometry (CIS) Data in the Cluster Active Archive (CAA)
55
During the RPA operation, however, ion measurements above 25 eV/e are provided by the HIA instrument. For the RPA aperture system all anodes have the same geometric factor (on both sides), although the instrument electronics allow the operation of only one side at a time.
3.2.2 The HIA (CIS-2) Instrument The HIA instrument is an ion energy spectrometer, capable of obtaining full three-dimensional ion distributions with good angular and time resolution (one spacecraft spin). HIA combines the selection of incoming ions, according to the ion energy per charge by electrostatic deflection in a quadrispherical analyser, with a fast imaging particle detection system. This particle imaging is based on microchannel plate (MCP) electron multipliers and position encoding discrete anodes. As for CODIF, ions are selected as a function of their E=q (energy per charge) ratio, by sweeping the high voltage applied between the two hemispheres. In order to cover populations ranging from solar wind and magnetosheath ions to tail lobe ions, a dynamic range of more than 105 is required. HIA therefore consists of two 180ı field-of-view sections, with two different sensitivities (with a ratio 20), corresponding respectively to the high-sensitivity (“high-G”, or “HS”) and to the low-sensitivity (“low-g”, or “LS”) side. The “low g” side allows detection of the solar wind and the required high angular resolution is achieved through the use of 8 sectors (or MCP anodes), 5:625ı each, the remaining 8 sectors having 11:25ı resolution. The 180ı “high G” side is divided into 16 sectors, 11:25ı each. For each sensitivity side a full 4 steradian scan, consisting of 32 energy sweeps, is completed every spin of the spacecraft, i.e. every 4 s, giving a full three-dimensional distribution of ions in the energy range 5 eV=e–32 keV=e. Each sweep consists of 62 contiguous energy channels.
3.2.3 The CIS Operational Modes The CIS instruments have a large amount of flexibility, either in the selection of the operational mode or in the reduction of the data necessary to fit the available telemetry bandwidth. CIS can thus operate in any combination of the six Spacecraft Telemetry Modes (three Normal Telemetry Modes, NM1-NM3, and three Burst Telemetry Modes, BM1-BM3) and the 16 CIS Operational Modes. These 16 modes (Table 3.1) can be grouped into solar wind tracking modes, solar wind study modes with the priority on the upstreaming ions, magnetospheric modes, magnetosheath modes, an RPA mode and a calibration and test mode. These modes correspond to different energy sweeping schemes and different combinations of telemetry products transmitted. Onboard calculated moments are always transmitted to the telemetry with a high-time resolution (1 spin). A combination of 2-D and 3-D ion distribution functions, plus other telemetry products, are transmitted in parallel to onboard calculated
56
I. Dandouras et al. Table 3.1 CIS operational modes CIS mode Mode name 0 SW-1 Solar wind/SW tracking – mode 1 1 SW-2 Solar wind/3D upstreaming ions – mode 2 2 SW-3 Solar wind/SW tracking – mode 3 3 SW-4 Solar wind/3D upstreaming ions – mode 4 4 SW-C1 Solar wind/SW tracking – data compression – mode 1 5 SW-C2 Solar wind/3D upstreaming ions – data compression-mode 2 6 RPA RPA mode 7 PROM PROM operation 8 MAG-1 Magnetosphere – mode 1 9 MAG-2 Magnetosphere – mode 2 10 MAG-3 Magnetosphere – mode 3 11 MAG-4 Magnetosphere/Magnetosheath – mode 1 12 MAG-5 Magnetosheath – mode 2 13 MAG-C1 Magnetosphere – data compression – mode 1 14 MAG-C2 Magnetosheath – data compression – mode 2 15 CAL Calibration/test mode
moments, with a mode-dependent and product-dependent time resolution. The table in Fig. 3.2 gives a typical example of CODIF telemetry products transmitted during the NM1 and the BM1 spacecraft telemetry modes, for the 16 CIS modes, and the corresponding time resolution for each product, in number of spins. The actual tables are supplied in the CIS calibration files (cf. Section 3.3.5). Mode change is performed by time-tagged commands, according to the plasma populations anticipated along the Cluster orbit. Although during the first 2 years of operations various CIS mode selection rules have been in use, since 2003 the most commonly used modes are mode 8 (MAG-1) and 13 (MAG-C1) in the magnetosphere, mode 12 (MAG-5) and 14 (MAG-C2) in the magnetosheath, and mode 3 (SW-4) and 5 (SW-C2) in the solar wind. Mode 10 (MAG-3) is also used in the magnetosphere for providing full resolution HIA data at the expense of CODIF data, as e.g. onboard sc1 since the end of 2004 (cf. Section 3.2.4). The RPA mode is operated about once per month, either on all spacecraft or on selected spacecraft. Magnetospheric modes stay relatively simple, i.e. the full energy-angle ranges are systematically covered. For HIA the different telemetry products (including moments) are deduced from the 62E 128 energy solid angle count rate matrices accumulated on the “high G” section. For CODIF they are deduced from the sensitivity side selected by command. Solar wind tracking modes allow a precise and fast measurement (4 s) of the ion flow parameters (HC , HeCC ). For that, in the solar wind, for HIA the energy sweep range is automatically reduced when the field-of-view of the “low g” section is facing the 45ı sector centred in the solar wind direction. This energy sweep range is adapted every spin (Modes 0, 2, 4), centred on the main solar wind velocity by using a criterion based on the HC thermal and bulk velocities computed during the previous spin (solar wind beam tracking). This allows a higher energy resolution for the solar wind beam data.
Cluster Ion Spectrometry (CIS) Data in the Cluster Active Archive (CAA)
Fig. 3.2 CODIF Telemetry Products transmitted in various modes and corresponding time resolution, in number of spins
3 57
58
I. Dandouras et al.
Fig. 3.3 Schematic of the CIS-2 (HIA) energy-sweep scheme, as a function of the instrument field-of-view orientation in the spin plane: solar wind modes (modes 0–5). Note that, at any given spin phase, the high-sensitivity side field-of-view is looking at the diametrically opposite direction with respect to the low-sensitivity side field-of-view, indicated in the schematic
During solar wind modes with the priority on the upstreaming ions (Modes 1, 3, 5) solar wind beam tracking is performed by HIA only once every 16 spins (exact value can vary depending on mode number). During the remaining 15/16 spins a broader energy sweep is used for the solar wind detection by the “low g” section, allowing at the same time the detection of upstreaming ions by the “high G” section, which is then looking in the anti-sunward direction. Detailed 3-D distributions for the solar wind (“low g” section) are then transmitted to the telemetry only during solar wind beam tracking (once every 16 spins), but onboard calculated solar-wind moments are transmitted every spin. Moreover, detailed 3-D distributions from the “high G” section (e.g. for upstreaming ions and/or for interplanetary disturbances) are included in the basic products transmitted to the telemetry. Outside this 45ı sector, the full energy sweep range is used (solar wind modes and solar wind modes with the priority on the upstreaming ions). However, when the field-of-view of the “high G” section is facing the 45ı sector centred in the solar wind direction (Fig. 3.3), the energy sweep stops (and “freezes”) above the solar wind alpha particles energy, to avoid a quick degradation of the MCPs by the intense solar wind beam (modes 0–5). For CODIF, the reduced energy-sweep principle is also used during modes 0–5, when the field-of-view of the “high G” section is facing the 45ı sector centred in the solar wind direction. Complete energy sweeping is used in the remaining part of the spin (Fig. 3.4). Magnetosheath modes are like magnetospheric modes. However, starting from 1 November 2003, the energy sweep scheme has been redefined for CODIF. With the new CODIF Magnetosheath Modes (modes 12 and 14), the energy sweeps are
Cluster Ion Spectrometry (CIS) Data in the Cluster Active Archive (CAA) log E
3
0
11
15
59
Spin# n
31
10 Sweep
1
Solar Wind Alphas Protons
0.1 HS 0.01
180 0
11
0 15
31
10 Solar Wind
Sweep
1
Alphas Protons
0.1 LS 0.01 Azimuth
0
180
Fig. 3.4 Schematic of the CIS-1 (CODIF) energy-sweep scheme, for solar wind modes, as a function of the spin phase: high-sensitivity side field-of-view orientation (upper panel), and lowsensitivity side field-of-view orientation (bottom panel). The energy “freeze”, during the reduced energy sweeps, is at about 2 keV
truncated and “frozen” at about 2 keV for 16 out of 32 sweeps (when the highsensitivity side faces the magnetosheath mainstream flow), to save the MCP lifetime.
3.2.4 CIS Instrument Status The overall experiment performance, after about 8 years of operation in space, is good. The particle detection efficiency degradation, due to the MCP gain fatigue mechanism [9], is moderate for the HIA instrument. Actual efficiencies (first half 2008) are reduced to about 77% of the initial HIA detection efficiencies on Cluster sc1 (spacecraft 1), and are almost the same as the initial ones for HIA on sc3. However, the physical degradation of the MCPs is in reality higher, but it is in some extent compensated by applying increased high voltages on the MCP plates, to restore secondary electron gain in the MCP channels despite the physical degradation of their emissive surfaces. For CODIF the efficiency degradation is more pronounced, due to the operational principle of this instrument, requiring the detection of both the ion (“stop” timeof-flight signal) and of the electrons emitted by the carbon foil (“start” time-offlight signal), plus a “position” signal, to validate the detection of an ion. Actual efficiencies for CODIF are now reduced, on the average, to less than about 10% of the initial detection efficiencies on Cluster sc4, and to less than about 5% on sc3
60
I. Dandouras et al. Table 3.2 CIS instrument status SC 1 SC 2 CODIF Operations until Not operational October 2004 HIA
Normal operations
SC 3 One deficient MCP quadrant (cf. Section 3.3.8) Normal operations
SC 4 Normal operations
Switched OFF
(cf. Section 3.3.5). In spite of these values, the CODIF performance and ability to still collect data of quality adequate for addressing most of its scientific objectives is remarkable. When processing the raw instrument data to convert them into higher-level data in physical units, these efficiency degradations are compensated by the calibration values used, supplied in the calibration files (cf. Section 3.3.5). However, these calibrations cannot correct for the degraded signal-to-noise ratio induced by the reduced particle counting statistics, particularly when measurements are performed in lowdensity plasmas. The CODIF instrument onboard Cluster sc1 is switched off since 25 October 2004, due to an MCP high voltage anomaly. Onboard Cluster sc3, the CODIF instrument presents one deficient MCP quadrant (southward looking directions on the high-sensitivity side, cf. Section 3.3.8). The HIA instrument is switched off on Cluster sc4, but could be switched on if necessary. On this spacecraft, due to an electrostatic analyser high voltage issue, the HIA energy sweep range is limited between 5 and 400 eV=e. The CIS experiment is not operational on Cluster sc2. Table 3.2 summarises the CIS instrument status, at the time of this writing (2008).
3.3 CIS-CAA Archival Products For the archival of the CIS data a multi-level approach has been adopted [2, 4]. The CAA archival includes processed raw data (Level 1 data), moments of the distribution functions (Level 2 data), and calibrated high-resolution data in a variety of physical units (Level 3 data). Furthermore, the calibration files and high-level processing software are also archived. This approach provides “ready to use” high-resolution data products, archived in ASCII (CEF-2 format), which are expected to have a long lifetime. However, should a user wish to re-analyse the raw data and the instrument calibrations, he will also be able to do it. The CIS data archive includes also experiment documentation, graphical products for browsing through the data, and data caveats. In order to help the user, a CIS Data Selection Guide has been also provided as appendix in the CIS-CAA ICD and in the User Guide to the CIS Measurements in the CAA.
3
Cluster Ion Spectrometry (CIS) Data in the Cluster Active Archive (CAA)
61
3.3.1 CIS Level 1 Data CIS Level 1 data are decommutated, decompressed, and time-tagged telemetry data. They are in raw instrument units (no corrections for MCP efficiencies etc.), represent the complete CIS Telemetry, and are the input for all higher-level processing. CIS Level 1 data, together with the CIS calibration files, are in particular the input files for the “cl” software (cf. Section 3.3.6). These data are organised in one file per telemetry product – spacecraft – day, and each file is a time-series of equal-length records. Each data record is complete: time tag, product type, mode info, etc. Data are in IEEE integers or floats.
3.3.2 CIS Level 2 Data CIS Level 2 data are moments of the particle distribution functions: ion density, velocity (in the GSE reference frame), temperature (parallel and perpendicular components, obtained by diagonalising the pressure tensor). For CODIF, which has a higher upper energy limit than HIA, the pressure is also supplied in addition. They correspond to the Prime Parameters from the Cluster Science Data System [1]: onboard calculated moments, then reprocessed on ground (total efficiency calibration adjustments, coordinate transformations etc.). Onboard calculated moments provide 1-spin time resolution, and are calculated from the full angular and energy resolution 3-D ion distributions. In addition to the onboard calculated moments, CIS Level 2 data include also CODIF moments calculated on the ground from the 3-D ion distributions. These provide better calibration adjustments (per anode efficiency) and are thus more accurate, but have a reduced time and energy resolution. HIA on the ground calculated moments are not supplied, because the same anode calibrations would be used as for the onboard calculated ones, but with a degraded time, energy and angular resolution (no added value). A software package has also been developed and is available for download at the CAA web site, allowing the user to interactively calculate partial (or total) moments of the ion distributions, for selected energy and solid angle ranges: CODIF (all 4 ion species) and HIA data (cf. Section 3.3.6). Onboard calculated moments and on the ground calculated moments from the 3-D ion distributions are thus complementary. A data selection guide, to help the CAA user select the most appropriate dataset, is given in Appendix 1 of the CAACIS Interface Control Document [2] and in the User Guide to the CIS Measurements in the CAA. The way moments are calculated from the 3-D ion distribution functions is described in Appendix 2 of the CAA-CIS Interface Control Document.
62
I. Dandouras et al.
3.3.3 CIS Level 3 Data CIS Level 3 data are processed high-resolution data: 3-D ion distributions. They are produced by correcting the Level 1 data for detector efficiencies, geometric factors and other information available from the calibration tables, and give measurements in several physical units (in separate files):
(Differential) Particle flux (Differential) Particle energy flux Particle phase space density Corrected-for-efficiency particle count rate Raw particle counts
ions cm2 s1 sr1 keV1 keV cm2 s1 sr1 keV1 ions s3 km6 ions s1 Number of ions per counter bin
These Level 3 archival files are constructed by joining files from similar telemetry data products (same ion species, different angular, energy or time resolution). Figure 3.5 shows how these files are organised as a function of:
The instrument (HIA or CODIF) The operational mode (magnetospheric, solar wind, or RPA) The instrument sensitivity side (HS or LS) The ion species (for CODIF only)
The 3-D distributions are in the ISR2 pseudo-GSE reference frame (X sunward, Z is the spacecraft axis and northward pointing). They give the complete 16 azimuth 8 elevation D 128 solid angles matrix, and remove the reduction to a total of 88 solid angles in the telemetry products, where adjacent solid angles near the polar directions have been binned together (for some CIS telemetry products). This is achieved by sub-diving each of these binned-together solid angles into the original 2 or 4 solid angles, and distributing the corresponding particle counts in an equal way. Solid angles, defined in the distributions, correspond to particle arrival directions (direction of travel of the particle). HS CODIF
LS
3 types x 4 ion species x 5 physical units = 60 datasets
RPA CIS HS_MAG HIA
HS_SW
3 types x 5 physical units = 15 datasets
LS_SW
Fig. 3.5 CIS level 3 data archival scheme for the 3-D ion distributions
3
Cluster Ion Spectrometry (CIS) Data in the Cluster Active Archive (CAA)
63
In addition to the 3-D distributions, pitch-angle distributions (PADs) are also provided. These are calculated on the ground from the 3-D distributions and the magnetic field direction (spacecraft reference frame), are given in particle flux units as a function of the particle energy and pitch-angle (2-D distributions), and their resolution is in 16 equal angular sectors covering the pitch angle range from 0ı to 180ı . Besides these 2-D and 3-D distributions, some uncalibrated CODIF data sets are also included in the CIS Level 3 data: files with onboard selected ion detection events, MCP monitor rates, and low-angular resolution distributions in 64 m=q ranges. These data sets are useful for monitoring instrument performance against eventual background and ion mass species separation, or for searching for minority ion species. Level 3 archival files are labelled with metadata, i.e. information that describes the dataset and its contents, so as to be easily understandable by the CAA user. These metadata follow the specifications given in the Cluster Metadata Dictionary [6], which has been produced for the CAA project by the CAA Metadata Working Group and the CDPP, the French Plasma Physics Data Centre (http://cdpp.cesr.fr/).
3.3.4 CIS Graphical Data Products The CIS graphical data archived are 6-h energy-time ion spectrograms. They are preformatted displays: PNG graphic files embedded in HTML pages, and they are given at two levels of resolution: browsing and detailed. These spectrograms are supplied separately for each spacecraft. Figure 3.6 shows an example of a CIS energy-time spectrogram. It includes, from top to bottom, HIA data from the low-sensitivity side (ions in the 45ı 45ı sector centred in the solar wind direction), HIA data from the high-sensitivity side (separately for four azimuthal sectors: ions arriving in the 90ı 180ı sector with a field-of-view pointing in the sun, dusk, tail, and dawn direction respectively), omnidirectional CODIF data for HC , HeC and OC ions respectively, ion velocity components measured by HIA, and ion densities measured by HIA and by CODIF. Instrument operational mode and spacecraft telemetry mode data are also included, as well as spacecraft coordinates. As can be seen in the HIA mode panel, at the top, the instrument was initially in a solar wind – upstreaming ions mode (mode 3). The solar wind narrow-energy beam is clearly identified in the low-sensitivity side HIA spectrogram, while at the same time the high-sensitivity side HIA spectrogram for ions arriving from the sunward looking direction does not detect the solar wind beam. This is due to the energy-sweep scheme adopted during these modes, that stops (and “freezes”) above the solar wind alpha particles energy, as explained in Section 3.2.3. Some high-energy upstreaming ions are however visible at that time, in the high-sensitivity side HIA spectrograms, as well as in the CODIF HC spectrogram, which was then operating at the high-sensitivity side. Note that CODIF also does not detect the solar wind beam, for the same reason: the energy-sweep scheme adopted during these modes (cf. Fig. 3.4), but solar wind beam data are supplied by
I. Dandouras et al.
5.9 4.3 2.7 Log c/s 6.8
HIA HIA lons
6.0 5.3
HIA lons
4.6
A
3.9
HIA lons
3.2
A
E (eV) SW–E E (eV) E (eV) E (eV) E (eV) E (eV) v (km/s) E (eV)
n (cm–3) n (cm–3)
BM3 NM1
A
Fig. 3.6 CIS energy-time ion spectrogram. See text for details
13/Feb/2001
2.5
HIA lons BM3
1.8
NM1 15kv 12kv
PACC
SAMBA (SC 3)
A
CIS
16 HIA Mode 8 0 10000 1000 100 10000 1000 100 10 10000 1000 100 10 10000 1000 100 10 10000 1000 100 10 16 CODIF Mode 8 0 High CODIF G Low 10000 1000 100 10 10000 1000 100 10 10000 1000 100 10 400 200 0 –200 –400 –600 100.00 10.00 1.00 0.10 0.01 100.0000 10.0000 1.0000 0.1000 0.0100 0.0010 0.0001 12:00 13:00 14:00 15:00 16:00 14.09 12.38 11.39 13.28 14.83 XGSE 1.42 0.62 0.21 1.02 1.81 YGSE –5.72 –6.78 –5.30 –6.12 –6.47 ZGSE 15.28 13.25 15.85 14.66 13.98 DIST Produced by CESR, Printing date: 16/Oct/2007
A
64
Ä
Log c/s 6.7 5.8 4.9 Ä 4.0 CODIF He+ 3.1 Ä 2.2 CODIF 1.3 O+ VxH1_HIA_GSM VyH1_HIA_GSM
CODIF H+
VzH1_HIA_GSM NH1_HIA NHe2_HIA NH1_CODIF N01_CODIF NHe1_CODIF NHe2_CODIF 17:00 18:00 9.10 10.30 –0.59 –0.19 –7.02 –7.20 12.47 11.62 vue_web_new.cl
3
Cluster Ion Spectrometry (CIS) Data in the Cluster Active Archive (CAA)
65
HIA. At 12:40 UT the instrument, while in the solar wind, was switched into mode 12 (magnetosheath mode). Both instruments switched then to an omnidirectional full energy sweep scheme (cf. Section 3.2.3), and the low-sensitivity side of HIA ceased collecting data. The solar wind beam became then detectable in the sunward looking direction spectrogram from the HIA high-sensitivity side (but with a lower energy resolution), and in the CODIF data, collected then from the high-sensitivity instrument side, but with a strong saturation in the solar wind beam energies. Note, however, the ability of the CODIF high-sensitivity side to detect the relatively weak fluxes of the upstreaming ion populations. The energy flux of these upstreaming ions is a factor of 2;000 lower than the energy flux of the solar wind beam ions, as this beam population is measured by the low-sensitivity side of HIA. At 14:40 UT the spacecraft entered in the magnetosheath, as revealed by the broader energy distribution of the detected ions (bow shock heating) and by the anisotropic flow shown in the four directional HIA spectrograms. These energy-time ion spectrograms are also available through the CIS home page: http://cluster.cesr.fr:8000/.
3.3.5 CIS Calibration Files CIS calibration files are ASCII files, self-documented (including comments), machine-readable and human-readable. They include parameters such as: Geometric factors MCP ion detection efficiencies: for each of the four main ions species, separately
for each anode, and including the polynomial coefficients for the efficiency energy dependence An overall instrument efficiency (called also absolute efficiency), for each of the four main ions species and separately for each instrument sensitivity side CODIF post-acceleration high voltage values Energy sweep tables for the various modes During how many spacecraft spins each 3-D ion distribution is accumulated, for the various modes
The way these calibration factors are used to convert instrument raw particle counts to higher-level data in physical units, such as particle flux or particle energy flux, and then to calculate the moments of the ion distribution functions, is described in Appendix 2 of the CAA-CIS Interface Control Document [2]. Both CODIF and HIA have been very well calibrated before launch, in vacuum test facilities [10]. However, due to the in-flight evolution of the MCP detection efficiencies as a function of time, the CIS calibration files are updated regularly. A calibrations catalogue file, which is provided with the calibration files, serves as a pointer to which calibration files to use for each data time period. This catalogue file evolves in an incremental way through the mission, to take into account the existence of new calibration files, which correspond to the instrument particle detection efficiency evolution, or other changes in the instrument.
66
I. Dandouras et al.
Fig. 3.7 CODIF high-sensitivity side absolute efficiency evolution for Cluster spacecraft 4, normalised to the efficiency at the start of the mission
1.2
Absolute Efficiency SC4/FM7
1
Efficiency
0.8
0.6
0.4
0.2
0 2002/1/1
2004/1/1 Day
2006/1/1
Calibration files include thus parameters that have been determined during ground calibrations in vacuum test facilities and are stable through the mission (e.g. instrument angle response, electrostatic analyser constant used in the calculation of the energy sweep tables, etc.), parameters that change gradually through the mission (e.g. particle detection efficiencies), and parameters that can be changed during the mission by command (e.g. upload of new spin accumulation tables for 3-D ion distributions in the various modes). All of them are equally important in converting raw data into physical units, and are used together. Figure 3.7 shows an example for the evolution, as a function of time, of the CODIF high-sensitivity side absolute efficiency for Cluster spacecraft 4, normalised to the efficiency at the start of the mission. Some sharp efficiency increases that are observed are due to an increased high voltage applied to the MCP, in order to compensate, as much as possible, for the efficiency decrease due to the well-known gain fatigue mechanism (cf. Section 3.2.4). However, as can be seen, the effects of such a high-voltage boost on the efficiency of the instrument are limited in time. Updating the calibration files for the detection efficiency evolution, with respect to the pre-launch calibrations, is a multi-step process, and is performed about once per year. The HIA ion density values are compared and cross-calibrated with the electron density values supplied by the Whisper sounder experiment [5]. This is performed in the magnetosheath for the high-sensitivity side and in the solar wind for the low-sensitivity side, i.e. in the plasma environment where each of the two sides has the optimum performance, and where the plasma energy spectrum is within the energy domain covered by the instrument. It should be noted also that the HIA anodes relative efficiencies are remarkably stable, i.e. the efficiency drift is very homogeneous between the anodes (11:25ı or 5:625ı sectors).
3
Cluster Ion Spectrometry (CIS) Data in the Cluster Active Archive (CAA)
67
The CODIF calibrations updating is a more complex process. It involves the determination of the start-MCP efficiency, the stop-MCP efficiency, the fraction of coincidences between the “start” time-of-flight signal and the “stop” time-of-flight signal that also have a “single position” signal, allowing thus to calculate the total efficiency. In addition, the efficiencies of the individual anodes (22:5ı sectors) have to be cross-calibrated, since they slowly drift relative to each other, and this is performed by using time periods when the ion distributions are expected to be gyrotropic. CODIF calibrations involve also separate efficiencies determination for HC and OC ions. The resulting CODIF HC measurements are finally cross-checked with the HIA measurements, for periods when the plasma is composed mainly from HC ions. CODIF data are also cross-checked with the high-energy ion data supplied by the RAPID experiment [12], for periods where energetic plasma is present in the energy range of both instruments.
3.3.6 CIS Data Processing Software The CIS data processing software to be archived is composed of two packages: The CIS 3D MOM software, specially developed for the CAA, allows the user
to read the CIS Level 3 files, available at the CAA, and interactively calculate partial or total moments of the ion distributions, for selected energy and solid angle ranges. The input is 3-D ion distribution functions, in CEF-2 format and in corrected-for-efficiency particle count rate units, and the output is ion density, bulk velocity, pressure tensor and temperature, also in CEF-2 format and in the ISR2 pseudo-GSE reference frame. It is written in C and it can be used for either CODIF or HIA data. The cl software, written in IDL, and developed initially for the CIS team. It reads Level 1 CIS data and calibration files; is interactive, and can generate a large variety of high-resolution graphics (spectrograms, distribution functions, PADs . . . ) in several physical units. It can also export the results as ASCII (CEF) data files. In addition to the CIS data, this software can also read generic CDF and CEF data files, for correlation studies. These software packages are available “as documents”, for installation and execution on the end user’s machine.
3.3.7 CIS Documentation The CIS documentation for the CAA includes: The CIS-CAA Interface Control Document (ICD), including the appendices
“CIS Data Selection Guide” and “CIS: Particle Counts to Flux and to Moments of the Ion Distribution Function” [2]
68
I. Dandouras et al.
A description of the instrument [10] The User Guide to the CIS Measurements in the CAA Calibration documentation The present paper
3.3.8 CIS Data Caveats CIS caveat files include both general caveats for the CIS data, and caveats for specific data intervals. Given the complexity of an ion spectrometer, and the variety of its operational modes, each one being optimised for a different plasma region or measurement objective, consultation of the data caveats by the end user will always be a necessary step in the data analysis (independently of the data level). The CIS caveats are also available at the CIS home page, at http://cluster.cesr.fr: 8000/index.php?page=caveats&langue=en. Following are some of the most important caveats, which the user of the CIS data should be aware of. The calculated density values are in reality ion partial density values in the energy
domain covered by the instrument, typically 25 eV/e to 40 keV/e for CODIF and 5 eV/e to 32 keV/e for HIA. In the presence of cold plasma at energies below the instrument energy threshold, or of hot plasma at energies above the instrument upper energy limit, this partial density is evidently lower than the total plasma density. In the presence of hot plasma at energies above the instrument upper energy limit the result is also underestimated ion bulk velocity, temperature and pressure values. The instrument energy domain is always defined with respect to the spacecraft potential. Spacecraft charging to a positive floating potential, as can be the case in low density plasmas when the ASPOC ion emitter for spacecraft potential control is not operating [11], repels the low-energy ions which in these cases cannot be detected by CIS (cf. for example Section 6.10 of R`eme et al. [10], and Section 3.4 of Dandouras et al. [3]). This effect results in a further increase of the difference between the partial density, measured by CIS, and the total plasma density. In addition to the finite energy range, the accuracy of the computed moments is also affected by the finite energy and angular resolution of the two instruments. This is in particular the case for narrow-energy distributions (cold plasmas or cold beams), and/or narrow solid angle beams. CODIF is more sensitive to this effect, due to its coarser energy and angular resolution. Adequate counting statistics are essential for reliable results. For density calculations, in the case of isotropic plasma distributions, HIA “hits” a lower limit density value of the order of 0:01–0:02 cm3 . CODIF continues to supply density values down to about 0:001–0:002 cm3 , although with very poor counting statistics in these cases, which do not allow a reliable calculation of the higherorder moments.
3
Cluster Ion Spectrometry (CIS) Data in the Cluster Active Archive (CAA)
69
Ion measurements are sensitive to possible detector saturation in the presence
of high ion fluxes (instrument dead time effects). The most striking example is the strongly underestimated solar wind density and magnetosheath density by the CODIF high-sensitivity side, while the instrument is operating in a magnetospheric mode. However, these saturation effects are phase space dependent: the detector can be saturated only in a limited energy range and for particles arriving in a given solid angle, where the highest counting rates occur (e.g. solar wind beam), but at the same time can supply reliable measurements in the remaining phase space, as are for example the upstreaming ion populations discussed in Section 3.3.4 (CODIF data spectrogram). Note that HIA data acquired in a magnetospheric mode can also suffer from partial detector saturation when in the solar wind: slightly underestimated densities, by a factor depending on the solar wind density and temperature [7]. Eventual instrument background counts due to penetrating particles, from the radiation belts around perigee passes or during SEP (Solar Energetic Particles) events, can result in an overestimation of the measured fluxes, and the resulting density values. This effect is stronger for HIA, whereas for CODIF it is mitigated by the time-of-flight technique, which requires both a “start” signal and a “stop” signal, in the correct time-of-flight window, to validate the detection of an ion. The entire velocity phase space, corresponding to the instrument energy domain, is not covered during all modes (cf. for example the spectrogram discussed in Section 3.3.4). This is the case during solar wind modes, and during some magnetosheath modes (CODIF data acquired after 1 November 2003 during modes 12 and 14). The result is: ı Incorrect HIA moment values in the magnetosheath when the instrument is in a solar wind mode (modes 0–5) ı Incorrect CODIF moment values when data come from the high-sensitivity side and the instrument is in a solar wind mode (modes 0–5) ı Incorrect CODIF moment values when data come from the high-sensitivity side and the instrument is in mode 12 or 14, for data acquired after 1 November 2003 CIS mode information is supplied in the spectrograms (cf. Section 3.3.4) and in the Level 3 data (cis mode variable). CODIF data in the solar wind, if acquired from the low-sensitivity side but with
the instrument operating in a magnetospheric mode, can suffer from cross-talk with the high counting rates of the high-sensitivity side, which is then saturated by the solar wind. The result is then overestimated densities and underestimated velocities. The Vz term of the ion bulk velocity is very sensitive to the anode crosscalibrations, and in particular to those of the anodes looking in directions away from the spacecraft spin plane (polar anodes). In some cases the efficiency calibration coefficients cannot completely compensate for strongly asymmetrically decreased efficiencies of such polar anodes, which results in a residual offset of Vz . This is in particular the case of CODIF onboard Cluster sc3, where one
70
I. Dandouras et al.
MCP quadrant (southward looking directions on the high-sensitivity side) suffers from a strongly decreased particle detection efficiency. This asymmetric efficiency degradation amplified with time, and for data acquired after 23 February 2003 it cannot anymore be corrected. As a result the Vz velocity component is highly unreliable (strong offset), and the density suffers from the fact that the instrument under-detects the ions in one hemisphere of the phase space. CODIF mass-separated data can suffer from spillover between neighboring mass channels. HeCC data, in particular, are usually contaminated by HC ions, resulting in over-estimated HeCC densities. CODIF OC data can be contaminated by penetrating particles in the radiation belts. They can also be slightly contaminated by HC ions in very high HC flux plasmas, as for example in the magnetosheath. The latter is due to occasionally two uncorrelated HC ions, one generating only a “start” time-of-flight signal and the other generating only a “stop” time-of-flight signal, and the time difference between the two being that of an OC ion. Presence of ions other than HC in the HIA data results in underestimated densities and in overestimated temperatures and pressures. During short eclipses the absence of a Sun reference pulse completely desynchronises the HIA data, which become useless, whereas the CODIF data are acquired using an extrapolated Sun reference pulse, and are thus still usable. During long eclipses CIS is off. Determinations of the evolution of the MCPs detection efficiency are statistical (based on the analysis of a number of data intervals). Detector ageing is accompanied by a degradation of the signal-to-noise ratio. Operation incidents can occasionally result, for short periods, in missing data products, in incorrect MCP high voltage and/or discriminator settings, which reduce the accuracy of the collected data, etc. These are flagged in the caveats for specific data intervals.
3.4 Conclusion The CIS experiment, due to its unique features, is a versatile instrument package, capable of obtaining full three-dimensional ion distributions with a time resolution of one spacecraft spin and with mass-per-charge composition determination. The quality of the data supplied by CIS has resulted, until now, in the publication of more than 300 scientific papers in refereed journals, based on the analysis of these data. These papers, and the results they present, constitute the ultimate validation of the data supplied by the two complementary instruments composing the CIS experiment, CODIF and HIA. The Cluster Active Archive will preserve these data in the long-term, so that they are usable by the scientific community. For the CIS data archived there a multilevel approach has been adopted, including both processed raw data and calibrated
3
Cluster Ion Spectrometry (CIS) Data in the Cluster Active Archive (CAA)
71
high-resolution data in a variety of physical units. The CIS data archive includes also experiment documentation, graphical products for browsing through the data, and data caveats. Given the complexity of an ion spectrometer, and the variety of its operational modes, each one being optimised for a different plasma region or measurement objective, the user has to be careful in selecting for his analysis the appropriate data set and instrument mode. In order to help the user in this task, a User Guide to the CIS Measurements in the CAA has been provided. Consultation of the data caveats by the user will also always be a necessary step in the data analysis. Acknowledgements The CIS Team is grateful to ESA, for the support supplied in operating the instrument and in preparing the CIS data for the CAA. CIS archival activities at CESR are jointly funded by ESA, by CNES and by CNRS. Activities in the USA are funded by NASA.
References 1. Daly, P.W. et al.: Users Guide to the Cluster Science Data System. DS–MPA–TN–0015 (2002) 2. Dandouras, I., A. Barthe: Cluster Active Archive: Interface Control Document for CIS. CAACIS-ICD-0001 (2007). http://caa.estec.esa.int/caa/instr doc.xml 3. Dandouras, I., V. Pierrard, J. Goldstein, C. Vallat, G. K. Parks, H. R`eme, C. Gouillart, F. Sevestre, M. McCarthy, L. M. Kistler, B. Klecker, A. Korth, M. B. Bavassano-Cattaneo, P. Escoubet, A. Masson: Multipoint observations of ionic structures in the Plasmasphere by CLUSTER-CIS and comparisons with IMAGE-EUV observations and with Model Simulations. In: AGU Monograph: Inner Magnetosphere Interactions: New Perspectives from Imaging, 159, 23–53, 10.1029/159GM03 (2005) 4. Dandouras, I., A. Barthe, E. Penou, H. R`eme, S. McCaffrey, C. Vallat, L.M. Kistler, and the CIS Team: Archival of the Cluster Ion Spectrometry (CIS) Data in the Cluster Active Archive (CAA). In: Proceeding of the Cluster and Double Star Symposium-5th Anniversary of Cluster in Space, ESA SP-598, Noordwjik (2006) 5. D´ecr´eau, P.M.E., P. Fergeau, V. Krasnoselskikh, E. Le Guirriec, M. L´evˆeque, Ph. Martin, O. Randriamboarison, J.L. Rauch, F.X. Sen´e, H.C. S´eran, J.G. Trotignon, P. Canu, N. Cornilleau, H. de F´eraudy, H. Alleyne, K. Yearby, P.B. M¨ogensen, G. Gustafsson, M. Andr´e, D.C. Gurnett, F. Darrouzet, J. Lemaire, C.C. Harvey, P. Travnicek: Early results from the Whisper instrument on Cluster: an overview. Ann. Geophys., 19, 1241 (2001) 6. Harvey, C.C., A.J. Allen, F. D´eriot, C. Huc, M. Nonon-Latapie, C.H. Perry, S.J. Schwartz, T. Eriksson, S. McCaffrey: Cluster Metadata Dictionary. CAA-CDPP-TN-0002 (2008) 7. Martz, C., J.A. Sauvaud, H. R`eme : Accuracy of ion distribution measurements and related parameters using the Cluster CIS experiment. In: Spatio-Temporal Analysis for Resolving Plasma Turbulence (START), ESA WPP-047, 229 (1993) 8. Perry, C., T. Eriksson, P. Escoubet, S. Esson, H. Laakso, S. McCaffrey, T. Sanderson, H. Bowen, A. Allen, C. Harvey: The ESA Cluster Active Archive. In: Proceeding of the Cluster and Double Star Symposium-5th Anniversary of Cluster in Space, ESA SP-598, Noordwjik (2006) 9. Prince, R.H., J.A. Cross: Gain Fatigue Mechanism in Channel Electron Multipliers. Rev. Sci. Instrum., 42, 66; DOI:10.1063/1.1684879 (1971) 10. R`eme, H., C. Aoustin, J.M. Bosqued, I. Dandouras, B. Lavraud, J.A. Sauvaud, A. Barthe, J. Bouyssou, Th. Camus, O. Coeur-Joly, A. Cros, J. Cuvilo, F. Ducay, Y. Garbarowitz, J.L. Medale, E. Penou, H. Perrier, D. Romefort, J. Rouzaud, C. Vallat, D. Alcayd´e, C. Jacquey, C. Mazelle, C. dˆaUston, E. M¨obius, L.M. Kistler, K. Crocker, M. Granoff, C. Mouikis,
72
I. Dandouras et al.
M. Popecki, M. Vosbury, B. Klecker, D. Hovestadt, H. Kucharek, E. Kuenneth, G. Paschmann, M. Scholer, N. Sckopke, E. Seidenschwang, C.W. Carlson, D.W. Curtis, C. Ingraham, R.P. Lin, J.P. McFadden, G.K. Parks, T. Phan, V. Formisano, E. Amata, M.B. Bavassano-Cattaneo, P. Baldetti, R. Bruno, G. Chionchio, A. Di Lellis, M.F. Marcucci, G. Pallocchia, A. Korth, P.W. Daly, B. Graeve, H. Rosenbauer, V. Vasyliunas, M. McCarthy, M. Wilber, L. Eliasson, R. Lundin, S. Olsen, E.G. Shelley, S. Fuselier, A.G. Ghielmetti, W. Lennartsson, C.P. Escoubet, H. Balsiger, R. Friedel, J-B. Cao, R. A. Kovrazhkin, I. Papamastorakis, R. Pellat, J. Scudder, B. Sonnerup: First multispacecraft ion measurements in and near the Earth’s magnetosphere with the identical Cluster ion spectrometry (CIS) experiment. Ann. Geophys., 19, 1303 (2001) 11. Torkar, K., W. Riedler, C.P. Escoubet, M. Fehringer, R. Schmidt, R.J.L. Grard, H. Arends, F. R¨udenauer, W. Steiger, B.T. Narheim, K. Svenes, R. Torbert, M. Andr´e, A. Fazakerley, R. Goldstein, R.C. Olsen, A. Pedersen, E. Whipple, H. Zhao: Active spacecraft potential control for Cluster implementation and first results. Ann. Geophys., 19, 1289 (2001) 12. Wilken, B., P.W. Daly, U. Mall, K. Aarsnes, D.N. Baker, R.D. Belian, J.B. Blake, H. Borg, J. B¨uchner, M. Carter, J.F. Fennell, R. Friedel, T.A. Fritz, F. Gliem, M. Grande, K. Kecskemety, G. Kettmann, A. Korth, S. Livi, S. McKenna-Lawlor, K. Mursula, B. Nikutowski, C.H. Perry, Z.Y. Pu, J. Roeder, G.D. Reeves, E.T. Sarris, I. Sandahl, F. Søraas, J. Woch, Q.-G. Zong: First results from the RAPID imaging energetic particle spectrometer on board Cluster. Ann. Geophys., 19, 1355 (2001)
Chapter 4
Digital Wave Processor Products in the Cluster Active Archive K.H. Yearby, H.St.C. Alleyne, S.N. Walker, I. Bates, M.P. Gough, A. Buckley, and T.D. Carozzi
Abstract The Digital Wave Processor (DWP) is the central control and data processing instrument for the Cluster Wave Experiment Consortium. DWP products in the Cluster Active Archive (CAA) provide a mainly supporting function for the rest of the consortium. This includes a time correction dataset which allows the standard timing accuracy of 2 ms to be improved to around 20 s, and experiment command and status datasets which show what commands have been sent to the experiments, and the resulting status. DWP also contains a particle correlator experiment that computes the auto-correlation of electron counts received by the PEACE electron experiment via an inter-experiment link.
4.1 Introduction The DWP instrument is the central control and data processing unit for the Wave Experiment Consortium (WEC) which comprises the EFW, STAFF, WHISPER and WIDEBAND instruments. Pedersen et al. [8] give an overview of the WEC, while Woolliscroft et al. [9] describe the DWP instrument. A block diagram of the consortium is shown in Fig. 4.1). For nominal operations, all commanding and telemetry acquisition for these instruments is routed via DWP, except for WIDEBAND telemetry to NASA’s Deep Space Network (DSN) and the Czech Republic’s Panska Ves station. Time synchronisation of WEC modes is controlled by DWP, and the WEC science telemetry is dynamically allocated between the WEC instruments according to the requirements of each WEC mode. Housekeeping data for all WEC instruments is acquired by DWP. In addition DWP contains a particle correlator experiment which computes K.H. Yearby (), H.St.C. Alleyne, S.N. Walker, and I. Bates Department of Automatic Control and Systems Engineering, University of Sheffield, Mappin Street, Sheffield, S1 3JD, UK e-mail:
[email protected];
[email protected];
[email protected] M.P. Gough, A. Buckley, and T.D. Carozzi Space Science Group, University of Sussex, Falmer, Brighton, BN1 9QH, UK e-mail:
[email protected];
[email protected];
[email protected]
H. Laakso et al. (eds.), The Cluster Active Archive, Astrophysics and Space Science Proceedings, DOI 10.1007/978-90-481-3499-1 4, c Springer Science+Business Media B.V. 2010
73
74
K.H. Yearby et al.
STAFF Wave Analyser
Inter-experimental links to other instruments of the Cluster scientific payload Spacecraft telecommand interface
STAFF Spectrum Analyser
EFW
DWP
WBD Wideband data
WHISPER
Spacecraft data interface
Direct link for WBD data
WEC Power supply
Spacecraft power interface
Fig. 4.1 Block diagram of the WEC showing DWP in the centre of the consortium
the auto-correlation of electron counts received by the PEACE experiment [7]. The correlator was designed to detect modulations and short time particle bursts in the electron population as an indicator of wave-particle interactions. The DWP products in the CAA consist of the following datasets: Time correction data (C1 CP DWP TCOR). Enable the standard 2 ms timing ac-
curacy to be improved to 20 s Summary of the status of the Wave Experiment Consortium (C1 CP DWP
LOG). One record for each interval that the WEC operates in the same mode. A total of 64 parameters including: instrument modes, telemetry use statistics, errors and anomalies, summary of voltage and temperature housekeeping A listing of the command sequences uplinked to the Wave Experiment Consortium (CM CD DWP UT PIOR) High resolution particle correlator data (C1 CP DWP COR FX and C1 CP DWP COR ST) Documentation and software Their production and interpretation is outlined in the following sections.
4
Digital Wave Processor Products in the Cluster Active Archive
75
4.2 Time Correction Data 4.2.1 Introduction The STAFF and EFW experiments include magnetic and electric field wave data at frequencies up to 180 Hz in burst mode [2, 6]. Inter-spacecraft comparison of this data requires high timing accuracy – for example 1ı of phase at 180 Hz is 15 s. The standard timing accuracy of the Cluster mission is 2 ms, and in the worst case, this corresponds to a 4 ms error between spacecraft which is 260ı of phase at 180 Hz. In the normal bit rate, for which the maximum frequency is 10 Hz, the maximum phase error becomes 12ı . Fortunately a considerable improvement in timing accuracy is possible. To understand how this can be achieved it is first necessary to explain how the standard time stamping of Cluster data is performed by the European Space Operations Centre (ESOC). Most Cluster data is not acquired from the spacecraft in real time, but is recorded on an onboard solid state recorder. All data released to experimenters (both recorded onboard and acquired in real time) are time stamped using an onboard clock which is calibrated to UTC using a time correlation process. Until recently, the error of this onboard clock was allowed to increase to the ˙2 ms limit before a new calibration was applied. The time correlation process uses the real time data which is time stamped by the ground stations with the Earth Receive Time. By subtracting various delays, including the propagation time from spacecraft to ground, the Spacecraft Event Time (SCET) is obtained. The total error for real time data is estimated to be 11 s. During each real time pass, the difference (DIFF) between the SCET measured by the onboard clock, and that derived from the Earth Receive Time is monitored. When the difference exceeds 2 ms a new time correlation is performed. This process is described in detail in the ESOC report CL-OPS-TN-1004-OPS-OPC provided to the DWP team as a private communication, but this should be available from the CAA in due course. The DIFF measurements can be used to apply a correction to the onboard clock to bring its accuracy close to that of the real time data. The DIFF is slowly varying, so a simple linear interpolation can be used to estimate the DIFF between real time passes. An independent set of DIFF measurements are also available during real time data acquisition for the Wideband experiment [5] from the ground stations of DSN and Panska Ves. Detailed analysis of the time stamps has revealed that a second correction is needed. When data are recorded onboard, the onboard time counter recorded in the data packets is not precisely correlated with the timing reference pulse distributed to the experiments but may be subject to an offset which is fixed for each period of the same telemetry mode. This term is called OFFSET and specifies the difference between the time of the reference pulse and the onboard time stamp recorded in the data packets. It applies only to data recorded onboard, and is zero for real time data. OFFSET normally ranges ˙180 s for normal mode data, and ˙30 s in burst modes.
76
K.H. Yearby et al.
From 2007 November 23, a new procedure has been adopted at ESOC. A time correlation is performed during every nominal pass, instead of waiting until the DIFF reaches 2 ms. DIFF is now usually less than 20 s, but this is not guaranteed. While a correction for the OFFSET term is in principle still needed, for burst mode data (when the most accurate timing is needed), this is less than 30 s, so overall timing will usually be accurate to ˙50 s. This corresponds to 100 s between spacecraft or 6ı of phase at 180 Hz which may be good enough for many purposes. It will still be possible to use the time correction dataset when the highest possible accuracy is needed.
4.2.2 Production The DWP team use the time difference measured by ESOC and DSN to prepare the time correction dataset. Both ESOC and DSN timing are sometimes subject to errors due to ground station configuration problems, so these data are subject to a manual validation process, illustrated in Fig. 4.2. It is observed that most of the points fall close to a smooth curve which is taken to be the correct value. The result is a set of DIFF measurements valid at specific points in time (during ESA or DSN ground station passes). The OFFSET term is determined by analysis of the time stamps of the housekeeping telemetry. The onboard time (OBT) is first converted to its raw 56 bit binary format. The telemetry format generator issues the reference pulse every 5.15222168 s, which is exactly 86439936 OBT counts. Therefore OBT modulo 86439936 should be constant. In practice the OBT modulo changes at every telemetry mode change,
1000
DIFF [SCETrt - SCETobt] (us)
500
Cluster SC1 ESOC & WBD DIFF for January 2002 ESOC DIFF WBD diff Valid DIFF
0 –500 –1000 –1500 –2000 –2500 –3000 2002-01-01 2002-01-06 2002-01-11 2002-01-16 2002-01-21 2002-01-26 2002-01-31 Date
Fig. 4.2 Plot of the DIFF values measured by ESOC (C) and DSN ( ). The solid line represents the assumed correct value used to prepare the time corrections
4
Digital Wave Processor Products in the Cluster Active Archive
77
but tends to return to the same value for each period of real time telemetry. The deviation from the real time value is the OFFSET. Finally, the DIFF and OFFSET values are merged into the TCOR files. Linear interpolation of the original DIFF dataset is used to obtain values at the times of OFFSET changes.
4.2.3 Validation Validation of the TCOR dataset is performed by computing the difference between the time stamps of successive HK formats. The maximum, minimum, mean, and standard deviation from the nominal value are computed for each 24 h period. Values larger than about 3 s indicate an error in the production. These values are removed for the first issue of the dataset.
4.2.4 Caveats Users of the time correction dataset should be aware of its limitations. Most importantly, TCOR data is not available at all times. In the first issue of the dataset, any data that fails validation is simply deleted from the files. TCOR coverage is typically around 90%. Applications requiring accurate timing should confirm that TCOR data is available at the relevant time. Time corrections are provided at the start and end of each period of the same telemetry mode. Time corrections at other times may be obtained by interpolation subject to certain rules. The OFFSET term is constant throughout each period, and the same value will be written in the records at the start and end of the period. If the OFFSET values before and after the required time are different, or either has the fill value of –1e31, then OFFSET is not available for that period. No interpolation between different OFFSET values is allowed. The DIFF may be obtained by linear interpolation of the DIFF values immediately before and after the required time. However, if either DIFF has the fill value of –1e31, then DIFF is not available for that period. It is not allowed to interpolate over a fill value.
4.2.5 Application For WEC data, the time corrections may be applied using the latest version of the Telemetry Extraction and Decommutation (TED) package (see Section 4.5). This is done automatically once TED and the TCOR files are correctly installed. By default, TED 2.5 produces Decommutated Science Data (DSD) files with all time corrections applied. A new bit in the diagnostic word (HKTCOR CORRECTED) will be set when time corrections have been successfully applied. This bit should be checked by applications requiring accurate timing.
78
K.H. Yearby et al.
It is also in principle possible to apply time corrections to calibrated high level science data, provided that micro-second level precision has been maintained during the production of that data. The basic method is to obtain the DIFF and OFFSET at the required time, and add these to the data time tag.
4.3 Experiment Status and Commanding Datasets 4.3.1 Status Log (DWP LOG) The status log contains information regarding the overall status of the WEC instruments. The dataset contains one record for each interval that the WEC operates in the same mode. Each record has a total of 64 parameters including:
Time interval Instrument modes Telemetry use statistics Errors and anomalies Summary of voltage and temperature housekeeping
The dataset is produced by automatic analysis of WEC telemetry, and validated by visual inspection. Figure 4.3 shows a typical record from this dataset. Interval: Mode desc.: STAFF SA: Whisper:
2002-01-01T09:57:21Z/2002-01-01T23:34:45Z, (9519 formats) NBR 52s recurrence mode (SWECJ275) NM1, NM1b 4F/CB1050, 1A/AD12500E
TM mode: Model tag: Log event: DWP config: TM overflows: DWP errors: STA SA errors: Correlator:
NM CD09 MACRO FULL, FULL, FULL 0 0 0 ( 42 zeros) COR0, MAR
WEC current: STAFF SA +6V: STAFF SA +5V: STAFF SC +9V: STAFF SC +6V: Wideband +6V:
538.7869 6.0886 5.4880 9.1271 5.7319 6.0566
DWP temp: STAFF SA: Wideband: EFW TM: STAFF SA TM: Correl TM: Unused TM: Total TM:
± 15.2694 ± 0.0013 ± 0.0169 ± 0.0037 ± 0.0105 ± 0.0064
23.45 °C 24.11 °C 26.15 °C 1472 1640 135 81 5217
bps bps bps bps bps
WEC mode: NM52 Clock: 900.0208 Hz SEU count: 0 Checksum: 0000 AP overflows: 0 Whisper errors: 0 STA SC errors: 0 Fixed level: 15 DWP voltage: STAFF SA -6V:
4.8900 ± 0.0536 -5.9049 ± 0.0023
STAFF SC -9V: STAFF SC -6V:
-9.1652 ± 0.0117 -5.7730 ± 0.0310
Whisper temp: STAFF SC:
33.48 °C 20.45 °C
Whisper TM: STAFF SC TM: Wideband TM: TM overhead:
902 960 0 28
bps bps bps bps
Fig. 4.3 One record from the WEC status log dataset showing period from 09:57 to 23:34 on 1 January 2002 for spacecraft 1 (the spacecraft identification is contained within the metadata not shown in this figure)
4
Digital Wave Processor Products in the Cluster Active Archive
79
4.3.2 Commanding (DWP UT PIOR) This dataset is a record of the command sequences and parameters that have been used to control the WEC. A single dataset covers the four Cluster spacecraft, with a spacecraft mask field used to indicate which spacecraft each command sequence applies to. Normally, all four spacecraft are commanded in the same way, so this format is concise, and helps to highlight exceptions. Such exceptions include special commanding needed to allow for the partial failure of some electric field antennae.
4.4 Particle Correlator Datasets 4.4.1 Description The particle correlator experiment computes the Auto-Correlation Functions (ACF) of electron counts received by the PEACE HEEA sensor via an inter-experiment link. The ACFs are constructed in correlator electron energy bands which correspond to either two or four PEACE energy levels. Constraints of processing and WEC telemetry allows ACFs for only two of the possible 15 energy bands to be processed at any particular time. One of these energy bands is pre-selected while the other available band steps sequentially through the remaining 14 energies, once per spin. Individual ACFs are constructed within separate 1.111 ms DWP clock cycles. The time series of electron counts is of duration 732 s and comprises 61 “count bins” of 12 s duration. Zero to 31 lags are performed on each individual time series to produce a 32-point ACF. Individual ACFs based on separate 1.111 ms DWP clock cycles are summed lag-for-lag on board and the summed ACF is transmitted in telelmetry. This gives the particle correlator the following characteristics: Frequency range 1.4–41.6 KHz in 32 frequency bands and DC to 4 Hz based on successive ACF outputs Energy range 0.6 eV to 26 keV in 15 energy bands (PEACE mode dependent)
The correlator data consists of two identically formatted datasets, one for the fixed energy band (DWP COR FX), and the other for the stepped energy band (DWP COR ST). The full specification is given in Section 5.1 of the DWP CAA ICD [3]. The ACF amplitude is given in counts squared per unit time. The count rate obtained depends on both the particle flux (physical effect) and the geometric factor of the sensor and gain of the micro-channel plates (instrumental effects). It was decided that it was not feasible to provide CAA correlator ACF amplitudes recalibrated to take account of the varying HEEA sensor gain. However, all necessary supporting data (calibrated energy level, lag shift duration and look direction) are included. Results from this experiment were presented by Buckley et al. [1] and Gough et al. [4].
80
K.H. Yearby et al.
4.4.2 Caveats Some artifacts are illustrated in Fig. 4.4 which shows the validation plot for 23 April 2002, spacecraft 3. Correlator data is present only when the PEACE HEEA sensor is in use. In the figure, data is absent when PEACE is switched off around perigee (2–4 UTC). In addition there are some periods where, although HEEA is on, the particle count rates are so low that the ACFs are mostly zeros (12 UTC onwards). The energy range corresponds to that being scanned by the PEACE HEEA sensor at any particular time. The energy may be undefined if the PEACE and correlator sweep modes were not compatible (i.e. ACFs acquired at widely different energies have been summed together and no unique energy calibration is possible). The behaviour of the polar angle depends on how PEACE selects the polar zone for the correlator. Early in the mission, the polar zone was selected according to the magnetic field direction, so the polar angle tends to stay on a single value for long periods. Later, the zone stepped through the 12 possible zones, at one step per spin. The azimuth angle is averaged over a spin except in burst modes, where there may be 4, 8, or 16 summed ACFs output per spin. The period 8 to 12 UTC shows a sloping ACF which is due to steep edges in the energy spectrum causing a rapid change in count rate with time during the energy
40 20 0 40
ACF bin
20 0 30 20 10 0
Azim polar log ev
fix kHz
step kHz
Cluster/DSP DWP correlator summary plot: spacecraft: 3, date: 2002-04-23 File: C3_CP_DWP_COR_FX_20020423_V01, Valid records: 18236, invalid: 0 File: C3_CP_DWP_COR_ST_20020423_V01, Valid records: 18286, invalid: 0 Averaged spectrum (stepped, fixed) and ACF
4 2 –0 –0 360 180 –0
Averaged count rate, versus energy, polar angle and azimuth
0
2
4
6
8
10 12 Hour of day
14
16
18
20
22
24
Fig. 4.4 Correlator data validation plot for 23 April 2002, spacecraft 3. The top two panels show the Fourier transform of the ACF for the stepped and fixed energy bands, respectively. The next panel is the ACF itself, summed over fixed and stepped energies. The lower three panels show the count rate as a function of energy level, polar angle and azimuth angle (undefined in this case)
4
Digital Wave Processor Products in the Cluster Active Archive
81
sweep. This period also shows a correlation at 36 s period (variable, and different on each S/C) and associated high frequency interference line. This effect is present whenever the count rate is very high, and is believed to be caused by a modulation of the gain of the detectors.
4.5 Software The WEC telemetry extraction and decommutation (TED) software is archived for reference purposes only. No DWP software runs in the archive. The latest version is 2.5.0.108 and appears satisfactory for those using it. This version includes support for using the TCOR dataset to obtain 20 s timing accuracy. The TED software is the first stage in the processing of WEC science data by all WEC teams, with the exception of Wideband data telemetered directly to DSN or Panska Ves. It can be used in two ways: 1. As a stand alone application (levelone) reading the RDM, extracting the data for one or more WEC instruments, and writing it to decommutated science data (DSD) files 2. As a library, allowing application software to read the WEC RDM directly Several earlier versions of TED exist and may still be in use by WEC teams. Version 2.4.3 is satisfactory where the standard 2 ms timing accuracy is sufficient. It does not support the use of time correction files. TED version 3 was a major rewrite which unfortunately introduced several new problems, and was therefore abandoned. Version 2.5.0 was based on version 2.4.3 and correctly supported the time correction files. It contained one bug affecting only Wideband data obtained in the burst mode (BM2) which was corrected in version 2.5.0.108. Version 2.5.0.108 is available from the CAA on the DWP documentation page in file: http://caa.estec.esa.int/documents/teams/DWP/ted-2.5.0.108.tar.gz
References 1. Buckley, A.M., Gough, M.P., Alleyne, H., Yearby, K.H., Walker, S.N.: First measurements of electron modulations by the Particle Correlator experiments on Cluster. ESA Spec. Publ. 492, 19–26 (2001) 2. Cornilleau-Wehrlin, N., Chauveau, P., Louis, S., Meyer, A., Nappa, J.M., Perraut, S., Rezeau, L., Robert, P., Roux, A., de Villedary, C., de Conchy Y., Friel, L., Harvey, C.C., Hubert, D., Lacombe, C., Manning, R., Wouters, F., Lefeuvre, F., Parrot, M., Pinc¸on, J.L., Poirier, B., Kofman,W., and Louarn, Ph.: The CLUSTER Spatio-Temporal Analysis of Field Fluctuations (STAFF) Experiment. Space Sci. Rev. 79, 107–136 (1997) 3. DWP team: Cluster Active Archive: Interface Control Document for DWP. Cluster Active Archive. http://caa.estec.esa.int/caa/instr doc.xml (2005), Accessed 28 May 2008. 4. Gough, M.P., Buckley, A.M., Carozzi, T.D., and Beloff, N.: Experimental Studies of Wave Particle Interactions in Space Using Particle Correlators: Results & Future Developments. Adv. Space Res. 32, 407–416 (2003)
82
K.H. Yearby et al.
5. Gurnett, D.A., Huff, R.L., Kirchner, D.L.: The wide-band plasma wave investigation. Space Sci. Rev. 79, 195–208 (1997) 6. Gustafsson, G., Bostrom, R., Holback, B., Holmgren, G., Lundgren, A., Stasiewicz, K., Ahlen, L., Mozer, F.S., Pankow, D., Harvey, P., Berg, P., Ulrich, R., Pedersen, A., Schmidt, R., Butler, A., Fransen, A.W.C., Klinge, D., Thomsen, M., Falthammar, C.G., Lindqvist, P.A., Christenson, S., Holtet, J., Lybekk, B., Sten, T.A., Tanskanen, P., Lappalainen, K., Wygant, J.: The electric field and wave experiment for the Cluster mission. Space Sci. Rev. 79, 137–156 (1997) 7. Johnstone, A.D., Alsop, C., Burge, S., Carter, P.J., Coates, A.J., Coker, A.J., Fazakerley, A.N., Grande, M., Gowen, R.A., Gurgiolo, C., Hancock, B.K., Narheim, B., Preece, A., Sheather, P.H., Winningham, J.D., Woodliffe, R.D.: Peace: A Plasma Electron and Current Experiment. Space Sci. Rev. 79, 351–398 (1997) 8. Pedersen, A., Cornilleau-Wehrlin, N., de la Porte, B., Roux, A., Bouabdellah, A., D´ecr´eau, P.M.E., Lefeuvre, F., Sen´e, F.X., Gurnett, D., R. Huff, R., Gustafsson, G., Holmgren, G., Woolliscroft, L.J.C., Thompson, J.A., and Davies, P.H.N.: The Wave Experiment Consortium (WEC). Space Sci. Rev. 79, 93–106 (1997) 9. Woolliscroft, L.J.C., Alleyne, H.St.C., Dunford, C.M., Sumner, A., Thompson, J.A., Walker, S.N., Yearby, K.H., Buckley, A., Chapman, S., Gough, M.P., and the DWP Co-investigators: The digital wave processing experiment on Cluster. Space Sci. Rev. 79, 209–231 (1997)
Chapter 5
EDI Data Products in the Cluster Active Archive E. Georgescu, P. Puhl-Quinn, H. Vaith, M. Chutter, J. Quinn, G. Paschmann, and R. Torbert
Abstract The Electron Drift Instrument (EDI) contribution to the Cluster Active Archive (CAA) is described. Presented are descriptions of the EDI instrument, the various CAA/EDI data products, the CAA ingestion schedule and the current EDI status. An example of a science application is given for one of the main EDI data products available in the CAA.
5.1 Introduction The contribution of the Electron Drift Instrument (EDI) to the CAA is completely described by the Interface Control Document (ICD) available online [1]. The ICD contains, in addition to the description of the convention on data formats, metadata and delivery to the archive, a section on instrument description, dealing with the scientific objectives of the EDI experiment, a hardware overview, and the description of the data processing chain and of the data products. This paper presents the most interesting aspects of this document for the user of the archive. It briefly describes the EDI experiment, the data processing chain and the EDI data products in the archive and it gives an example of scientific use of one of the main data products. EDI delivers data products and documentation to the archive. The data range E. Georgescu () Max-Planck-Institute for Solar Research, Katlenburg-Lindau, Germany e-mail:
[email protected] P. Puhl-Quinn, H. Vaith, M. Chutter, and R. Torbert University of New Hampshire, Durham, USA e-mail:
[email protected];
[email protected];
[email protected];
[email protected] J. Quinn Boston University, Boston, MA, USA e-mail:
[email protected] G. Paschmann Max-Planck-Institute for Extraterrestrial Physics, Garching, Germany e-mail:
[email protected]
H. Laakso et al. (eds.), The Cluster Active Archive, Astrophysics and Space Science Proceedings, DOI 10.1007/978-90-481-3499-1 5, c Springer Science+Business Media B.V. 2010
83
84
E. Georgescu et al.
from the complete set of raw data to auxiliary and final products. The documentation refers to the already mentioned ICD, to the instrument user manual, instrument reference papers and software scripts.
5.2 Instrument Overview The EDI instrument and its modes of operation are described in detail by Paschmann et al. [2] and Quinn et al. [3]. EDI was designed to measure the electric field E? perpendicular to the ambient magnetic field B, when the gradient of B in the plane perpendicular to it can be neglected. This is done in an active mode using the electron drift technique. EDI also operates in a passive mode, whereby ambient electrons are detected.
5.2.1 Electric Field Measurement The aim is to determine the drift velocity of the injected electrons Vd induced by an electric field E? and/or a magnetic-field gradient rB? . Under the assumption that the rB? -drift can be ignored, the electric field can be computed according to: E? Š Vd B
(5.1)
The basis of the electron-drift technique is the injection of weak beams of electrons perpendicularly to the ambient magnetic field and their detection after one or more gyrations. In the presence of a drift velocity, the circular electron orbits are distorted into cycloids. Their shape depends on whether the beam is injected with a component parallel or anti-parallel to the drift velocity. The lengths of the two orbits and the electron travel times differ. To be able to realize both types of orbits simultaneously, EDI uses two guns and two detectors. Figure 5.1 shows examples of these two orbits in the plane perpendicular to B, which we refer to as the B? -plane. The instrument records the positions and firing directions of the guns and the times of flight of the electrons. The magnetic field information is received through the inter-experimental link from the FGM (flux-gate magnetometer). The drift velocity can be determined by two methods: triangulation and time-offlight. (a) The basis of the triangulation technique, explained in detail in [3], is the determination of the ‘drift-step’ vector d which is the displacement of the electrons after a gyro time Tg . The drift velocity Vd is: Vd D d=Tg
(5.2)
The location in the B? -plane, at which electrons reach the detector after one gyration, can be viewed as the ‘target’ for the electron beams.
5
EDI Data Products in the Cluster Active Archive
85
Fig. 5.1 Principle of operation for EDI
(b) The time-of-flight technique uses the difference of time-of-flight for the electrons emitted with velocity components parallel and anti-parallel to the drift velocity. The electrons emitted with their velocity directed with a component parallel to Vd have a time-of-flight T2 that is shorter than Tg while the electrons emitted in the opposite direction have a time-of-flight T1 that is longer than Tg : T1;2 D Tg .1 ˙ Vd =Ve /
(5.3)
where Ve is the electron velocity, which depends on the initial kinetic energy. From Eq. 5.3 it follows immediately that the difference between the two times-of-flight T D T1 –T2 provides a measure of the drift velocity magnitude, Vd Vd D T Ve =.2Tg /
(5.4)
while their sum is twice the gyro time: T1 C T2 D 2Tg
(5.5)
Equation 5.4 is the basic equation of the time-of-flight technique. Since Tg D 2me =.eB/
(5.6)
86
E. Georgescu et al.
where me and e are the mass and the charge of the electron, the time-of-flight measurements allow B to be determined as well. The triangulation and time-of-flight techniques complement each other ideally. While triangulation naturally becomes increasingly inaccurate if the target moves further and further away, the time-of-flight technique becomes more accurate because, according to Eq. 5.4, T increases with increasing drift step, and thus becomes easier to measure. EDI consists of two gun-detector units (GDUs) and a controller unit. The GDUs are mounted on opposite sides of the spacecraft and have oppositely directed fields of view. The guns are capable of firing in any direction within more than a hemisphere to accommodate arbitrary magnetic and electric field directions. Similarly, the detectors can detect beams coming from any selectable direction within more than a hemisphere. Electron energies can be switched between 0.5 and 1.0 keV. In order to measure the electron times-of-flight, as well as to distinguish beam electrons from the background of ambient electrons, the electron beams are amplitudemodulated with a pseudo-noise (PN) code. To find the beam directions that will hit the detector, EDI sweeps each beam in the plane perpendicular to B at a fixed angular rate (typically 0:2ı =ms) until a signal has been acquired by the detector. Once signal has been acquired, the beams are swept back and forth to stay on target; this operational mode is called windshield-wiper (WW). As the times when the beams hit their detectors are neither synchronized with the telemetry nor equidistant, EDI does not have a fixed time-resolution.
5.2.2 Ambient Electron Monitoring When the electron beams are off, the EDI detectors allow for ambient electron measurements with very high sensitivity and time resolution, albeit at fixed energies of 0.5 or 1.0 keV. In this mode the two detectors which are facing opposite hemispheres are looking strictly into opposite directions. Either both detectors are looking in the plane perpendicular to B (pitch angle of 90ı ), or one detector is looking along B while the other is looking antiparallel to B (pitch angles of 0ı and 180ı ). When looking in the plane perpendicular to B the two directions within the plane are determined by the cross product of the magnetic field vector B with a selectable but fixed vector P that is constant in the spinning spacecraft frame of reference. When looking parallel/antiparallel to B the two detectors switch roles every half spin of the spacecraft as the tip of the B vector spins outside the field of view of one detector and into the field of view of the other detector. In nominal telemetry mode (NM) there are 16 counts per detector and per second. Each count is accumulated over approximately 16 ms (1/64 s). In Burst mode (BM1) there are 128 counts per detector and per second, and the accumulation time is approximately 8 ms (1/128 s). Counts are accumulated synchronously by the two detectors and each counts pair is stored in telemetry with its corresponding look direction, expressed in spinning spacecraft coordinates (azimuth and polar angle). As the two look directions are antiparallel only one set of angles needs to be transmitted. As the spacecraft is spinning the
5
EDI Data Products in the Cluster Active Archive
87
look directions need to be maintained in order to point at a fixed pitch angle. The look directions reported in telemetry correspond to those used at the center of the respective sample accumulation time window. Full resolution AED (Ambient Electron Data) starting October 2004 have been delivered for ingestion in the CAA. Before this time, the detectors’ configuration for ambient operations and the correction procedures were evolving continuously and hence an ambient electron data product is not available.
5.2.3 Operations and Limitations EDI operations are limited by low magnetic fields and/or high background electron fluxes. Low magnetic field requires high beam currents to overcome the beam divergence along large gyro orbits, and to get sufficient signal-to-background ratio. However large beam currents, in conjunction with the beam-modulation and – coding, lead to interference with the electric wave measurements by the WHISPER instrument. Moreover, the smaller the magnetic field gets, the higher the requirement for very precise on-board magnetometer calibrations. Last but not least, rapid timevariations in magnetic and/or electric fields, as well as large fluxes of background electrons can also cause loss of track. Because of the noted interference with the WHISPER measurements, EDI beam operations have been subject to a 6-orbit cycle, where high beam currents (up to 300 nA) were allowed in only two out of six orbits, while currents were limited to about 100 nA in another orbit and no beam operation was allowed outside 4 h of perigee in the remaining three orbits. The code repetition frequency and beam current is delivered to the wave instruments as CRF (Code Repetition Frequency) auxiliary data product to help them recognize and correct for this interference.
5.3 Data Processing Chain The data processing chain consists of onboard, ground and science processing. The onboard processing writes to telemetry the measured quantities and instrument parameters. A schematic representation of the data processing chain is given in Fig. 5.2. The telemetry data consists of three types: (1) housekeeping (HK TM); (2) science normal mode (NM TM); and (3) science burst mode (BM TM). They are input into the EDI ground-processing chain after having a DDS-header (Data Disposition System, described in [5]) attached during the ground-processing performed at ESOC. The ground processing software consists of Merged Science File (MSF) production and the Pick-Library. The first merges the TM-packets and orders them in time and the second extracts the quantities needed by the science processing as input. The output of the science processing consists of time series of physical quantities contained in the science data products, as discussed in detail in the next section.
88
E. Georgescu et al.
EDI Data Processing Chain and Output ONBOARD SW
OUTPUT
HK TM
GROUND SW
(ESOC)
SCIENCE OUTPUT
SW
RDM
wwconv (c) caa_editof (IDL)
NM TM
OUTPUT EGD
qstat (c)
QSTAT
EDI_PISO (IDL)
PP PPplus MPD
MSF BM TM MSF (GCDC) FGM Data PICK LIBRARY (IDL) AEC
SW
Software TBA for documention (white on green)
DATA
SurveyPlot (IDL)
C3-3h Survey Plots
AE (IDL)
AED
Data product TBA = to be archived (white on blue)
Fig. 5.2 EDI data processing chain and output
The CRF and CLIST (CaveatLIST) auxiliary products used for cross-calibration with other instruments are not represented. They are produced from the MSF-files using the Pick-Library and an IDL main program that is archived for documentation. The software, archived for documentation only, is represented with white text on green background and the data products with white on blue (violet).
5.4 Instrument Data Products As we have learned from the instrument description section EDI operates in two modes: (1) an active one called WW (windshield wiper), or, EF (electric field), where electrons emitted by the guns are detected; and (2) a passive one called ambient electron mode (AE), where the guns are not emitting. Whenever EDI operates in its active mode, the electric field and the drift velocities of the electrons are measured. The data are analyzed with two techniques: triangulation and timeof-flight. The technique which gives better results based on some error criteria produces the winners, the other the losers. All results are assigned a quality flag (good/caution/bad).
5
EDI Data Products in the Cluster Active Archive
89
In addition to the main data products, raw and auxiliary data are being archived.
Raw data consist of merged science files (MSF); they are obtained by merging the housekeeping and science (burst (BM) and normal (NM) mode) telemetry files. They are in binary format and are input for the Pick-Library that is used by all science processing programs. Auxiliary are either data used internally by the main data production software (QSTAT) or data dedicated to intercalibration (EGD, CRF) or time-interval lists of the EDI operation modes (CLIST). – QSTAT contains a table of 24 rows (for each hour of the day) and 6 columns (for each 10 min of an hour) with detection efficiencies. The detection efficiency is defined as the percentage of the number of spin periods with at least 4 successful measurements per spin to the total number of spin periods. – AEC (ambient electron correction file) are used to correct raw, ambient electron counts for the internal, theta/phi dependence of the individual detectors. Transformation of the corrected counts to a particle flux is a non-trivial matter, and has only been performed (to-date) on a case-by-case basis. – CLIST files contain a listing of time intervals with the two possible operation modes of EDI: WW and AE. – EGD parameters are measurement time tags with microsecond precision, timeof-flight (TOF) and its error (sigma TOF) in microseconds, and the label of the used detector unit (DU). Using Eq. 5.6 the magnetic field magnitude can be determined and compared with FGM or WHISPER measurements for crosscalibration. An example of use of the EDI CAA auxiliary data is given in [4], where the QSTAT and EGD datasets were used to check and improve the calibration of the flux-gate magnetometer (FGM).
Main data products contain: – For the WW mode: time series of the three components of the electron drift velocity and of the three components of the electric field in Cartesian GSE coordinate system (corrected for spacecraft motion) with different qualities and time resolution (PP, PPP, MPD) – For the AE mode: time series of ambient electron counts for the three pitch angles .0ı ; 90ıo ; 180ıo /, the detector look direction in the spacecraft frame and in GSE and the status for AE mode – Overview plot of the main parameters for both modes for every 3 h for one reference spacecraft (usually C3)
The data products, their acronyms, contents, qualities, resolutions, time ranges and formats are summarized in Table 5.1. For the time ranges, following abbreviations have been used: d: day, mo: month, h: hour. Note that they are differences between the CAA acronyms and the group of letters appearing in the file and parameter names (e.g. the D for data was left away for MPD and AED).
90
E. Georgescu et al.
Table 5.1 EDI data products in the CAA CAA Data type Nr acronym Format (mode) 1 PP CDF MAIN
CEF
(WW)
2
PPP
CDF
MAIN (WW)
3
MPD
CDF CEF
MAIN (WW)
4
AED
CDF CEF
MAIN (AE)
5
3hSPLOT
PNG
MAIN Graphics (AE + WW)
6
EGD
CEF
Auxiliary (WW)
7
QSTAT
ASCII
Auxiliary (WW)
8
CLIST
CEF
Auxiliary (WW/AE)
9
AEC
ASCII
Auxiliary (AE)
10
CRF
CEF
Auxiliary (WW)
11
MSF
Binary
RAW
Name, content (C), quality (Q), time resolution (R) Prime Parameter C: electric field, drift velocity, status and errors Q: winners, good/caution R: spin (4 s) Prime Parameter plus C: electric field, drift velocity, status, errors, drift step (see Table 5.2) Q: winners + losers good/caution/bad R: spin (4 s) Merged Parameter Data C: electric field, drift velocity, status and errors R: 1–4 s Q: winners, good/caution/bad Ambient Electron Data C: ambient electron counts at 0ı ; 90ı ; 180ı pitch angles R: full 3-hourly Survey plots C: MPD, AED and CLIST parameters for one spacecraft (usually C3) Electron Gyrotime Data C: Electron time-of-flight, error and GDU-flag R: full Quality STATistics C: EDI detection efficiency (beam tracking performance), R: 10 min Caveat List C: Time intervals of EDI operation modes (WW/AE) AE Correction files Used to correct raw, ambient electron counts for theta/phi Code Repetition Frequency C: code repetition frequency, beam current index R: telemetry (5:12 s) Merged Science Files C: Merged HK + NM + BM
Time range 1d
1d
1d
1d
3h
1d
1d
1 mo
1d
1d
1d
5
EDI Data Products in the Cluster Active Archive
91
Table 5.2 EDI PP (MPD) and PPP parameters for CDF and CEF files (WW operation mode) CEF fPPjMPg CDF- fPPjMPg PP-Plus file parameters (CDF) parameters (winners and losers) C1 CP EDI fPPjMPg (“winners” only) time tags Epoch Epoch Half interval Status Status Status V ed xyz gse V ed xyz gse V ed xyz gse E xyz gse E xyz gse E xyz gse Reduced chi sq Reduced chi sq Reduced chi sq Drift step mag Drift step mag error inertial Drift step azi error inertial Nbeam Status loser V ed xyz gse loser E xyz gse loser Reduced chi sq loser Drift step mag loser Drift step mag error inertial loser Drift step azi error inertial loser Nbeam loser
Table 5.2 gives an overview of the WW-mode main data parameters. The first two columns describe the contents of the PP and MP files for both CEF and CDF formats. The third column describes the contents of the PP-Plus files, which are only available in CDF format. The PP-Plus files are meant for experts who want to compare the results of both “winner” and “loser” methods. The differences between the CEF and CDF files for PP or MPD are in time parameters. The CEF files have “time tags” variable instead of “Epoch”. The MP data have an additional half-interval parameter to account for the mixed resolution. The exact nature and quality of the data is indicated in the seven EDI status bytes described in detail in [5]. Status[0] byte is the data quality flag as defined for all Cluster experiments: 0, 1, and 2 for bad, use with caution and good data, respectively. The others define the percentage of 1 keV beams used in entire spin (Status[1]), the percentage of the highest quality beams used in entire spin (Status[2]), the chosen “winner” method among Triangulation/Time-offlight/simultaneous-time-of-flight with the ambiguity flag of the choice (Status[3]), percentage of Triangulation outliers (Status[4]), and the magnitude error (as a percentage) and azimuthal error (in degrees) on the drift step in the spacecraft frame (Status[5] and Status[6], respectively). The following caveats must be considered:
The measured electron drift velocity cannot always be separated into the electric-field and magnetic gradient induced parts; in such cases the computed electric fields are subject to contamination by magnetic gradient effects.
92
E. Georgescu et al. Table 5.3 Ambient electron data parameters CEF variable name CDF variable name ( C# CP EDI AE) Epoch C# EDI AE time tags C1 CP EDI AE C1 CP EDI AE C1 CP EDI AE AE status C# Status AE theta CL# Theta index AE phi D1 CL# Phi index AE counts CL# GDU1 PA 90 counts GDU1 PA 90 AE counts CL# GDU2 PA 90 counts GDU2 PA 90 AE counts CL# GDU1 PA 180 counts GDU1 PA 180 AE counts CL# GDU2 PA 0 counts GDU2 PA 0 AE counts CL# GDU1 PA 0 counts GDU1 PA 0 AE counts CL# GDU2 PA 180 counts GDU2 PA 180 AE D1 GSE CL# D1 xyz gse
The data quality is variable, and it is therefore mandatory that the status bytes be consulted before interpreting the data. The number of samples in the averages is variable.
Note that all EDI electric field and drift velocities delivered to the CAA, regardless of product, are in the inertial frame. Table 5.3 shows the AED parameters. These are raw data counts and in order to transform them in relative particle fluxes the theta and phi dependence must firstly be removed by using the AEC files. The AEC files contain a list of correction factors for the phi and theta angles of the look directions. The 6 “count” variables are signed 2-byte integers. The fill value for these counts is -32,768. The theta variable is the same for both EDI detectors and contains an index between 0 and 138; each step corresponds to 0:703125ı. The phi variable contains an index between 0 and 127 and each step corresponds to 2:8125ı . The reported phi is the azimuth look direction for detector 1. The phi for detector 2 is opposite, i.e. phi2 D 64 – phi1, and then adjusted so that it is between 0 and 127 if necessary. Only 2 bits of the status byte are used. Bit 0 indicates the energy: 1 is used for 1 keV, and 0 is used for 0.5 keV. Bit 1 indicates sub mode: if it is set, the data is from BM1 data; otherwise, the data is from NM123 or BM2. AE D1 GSE CL# (or D1 xyz gse C# CP EDI AE) is the detector 1 look direction in Cartesian GSE coordinates, where #=1, 2, 3 is the spacecraft id. The ambient electron counts must be divided by 2 in NM (normal mode) because the NM accumulation interval is twice that of BM1. The following caveats must be considered:
The raw-data counts have to be corrected for the angular dependence of the efficiency. The status byte and the AEC-files must be used as described above. Ambient electron data are available since October 2004 on C1, C2 and C3, see CLIST files for time intervals. The EDI instrument on C2 is working only in ambient mode.
5
EDI Data Products in the Cluster Active Archive
93
5.5 Example of Science Application An example of using EDI electric field data in the inner magnetosphere is described in this section. The primary electric field science product delivered to the CAA by the EDI team is the variable time-resolution Merged Parameter Data, or, MPD, as indicated in Table 5.1. This product is found at the CAA after selecting “EDI” as the “Experiment”, and then “Science” as the data category. The MPD data is available in either CDF or CEF formats, which is indicated in the product name as either C1 CE EDI MP CDF or C1 CP EDI MP, respectively (using spacecraft 1, or, C1, as an example). As noted earlier, the MPD data has a variable time-resolution of 1, 2 or 4 s. This differs from the PP dataset (i.e., C1 CP EDI PP, which is located under the “CSDS” data category) time-resolution of 4 s (spin-resolution). Another important difference between the MPD and PP datasets is that while the poorest quality data (i.e., quality D “BAD” data) has been filtered out of the PP dataset, it remains in the MPD dataset. The “BAD” data exists in the MPD dataset because it is useful for the advanced user who might be studying data quality itself. Therefore, it is necessary for occasional users to apply their own quality filter on the MPD dataset if desired. This can be done using the variable “Status C1 CP EDI MP”, or, Status, for short. As mentioned in the previous chapter the 0th byte of the Status is the quality flag and 0 indicates “BAD” data. It is recommended that the CAA user filter out the “BAD” data. Figure 5.3 shows MPD data from Cluster 1 on 08-Apr-2004. Plotted in the left-hand column (Panels a–c) is electric field data, which has the variable name “E xyz gse C1 CP EDI MP” in the MPD dataset. From top to bottom are the x, y and z components in GSE coordinates (Ex ; Ey and Ez , respectively). The “BAD” data has been filtered out. The MPD dataset contains electric fields and drift velocities in the inertial frame (i.e., the spacecraft motion has been removed). This hour of data, from 06:45 to 07:45 UT, encompasses perigee and the crossing of the magnetic equator in the pre-midnight MLT range. The two large electric field structures with peak magnitudes approaching 25 mV/m at approximately 06:58 and 07:28 UT were identified in [6] as subauroral ion drift (SAID) channels. This identification was facilitated by looking at the data in a more useful coordinate system than GSE. The electric field measured by EDI is only the perpendicular component, and therefore is only a two dimensional vector in a coordinate system with one of its axes along the magnetic field. This type of coordinate system is known as a “magnetic field-aligned” system, or, MFA system. Using the magnetic field data from the FGM experiment and the Cluster position data from the AUX data files, it is possible to construct an MFA system. In the inner magnetosphere, the magnetic field, B, and the position vector, P, form roughly a meridional plane. The MFA system constructed for this example has B lying along the z-axis while the x-axis lies in this meridional plane and points outward. The y-axis completes the coordinate system and points generally eastward. At the magnetic equator, for instance, the z-axis points northward (aligned), the y-axis points eastward (azimuthal) and the x-axis points outward (radial).
94
E. Georgescu et al. EDI Electric Field in GSE
Ez [mV/m]
c
Er [mV/m]
0 –10 –20
e
20 10 0 –10
Ea [mV/m]
Ey [mV/m]
b
20 10
–20
f
20 10 0 –10 –20
UT: 06:45 07:00 MLT: 22:00 21:55 R: 4.46 4.30 MLAT: –10.78 –2.81 08-Apr-2004
EDI Electric Field in MFA
d
E|| [mV/m]
Ex [mV/m]
a
20 10 0 –10 –20 20 10 0 –10 –20 20 10 0 –10 –20
07:15 21:50 4.18 5.72
07:30 21:43 4.10 14.66
07:45 21:36 4.06 23.84
06:45 22:00 4.46 –10.78
07:00 21:55 4.30 –2.81
07:15 21:50 4.18 5.72
07:30 21:43 4.10 14.66
07:45 21:36 4.06 23.84
Fig. 5.3 EDI electric field data from Cluster 1 on 08 April 2004. Plotted in the left-hand column are the x, y and z components of the perpendicular electric field in GSE coordinates. This is Merged Parameter Data (MPD), available at the CAA. Ephemeris data are tabulated underneath the UT labels. Plotted in the right-hand column are these same data in an alternative, magnetic field-aligned (MFA) coordinate system. From top to bottom are the radial, azimuthal and parallel components
The right-hand column of Fig. 5.3 (Panels d–f) shows the electric field data transformed into this MFA system. From top to bottom are the radial .Er /, azimuthal .Ea / and parallel Ejj components. By definition, the parallel component is identically zero (Panel f). In the MFA system, the electric field is close to being purely radially outward (Panel a). This is a defining characteristic of magnetospheric SAID electric fields. When mapped to ionospheric heights, the SAID field is directed poleward. The SAID electric field orientation and morphology produces a westward drift channel extending from the southern to northern ionosphere at subauroral latitudes. Subsequent SAID observations by Cluster have been reported in [7].
5.6 Summary of EDI Contribution EDI contributes to the Cluster Active Archive with data (raw, auxiliary and main products) and documentation. The main data products contain:
Time series of the following physical quantities (with errors and data qualities): (a) E D electric field vector in GSE, (b) V D drift velocity vector in GSE,
5
EDI Data Products in the Cluster Active Archive
95
(c) N D high resolution ambient electron counts at 0ı , 90ı and 180ı pitch angles, at fixed energy (0.5 or 1.0 keV). The time resolution is between 1 and 4 s except for (c). Graphics: Survey plots of the physical quantities and operation modes for one reference spacecraft (usually C3) with 3 h time range.
The auxiliary data contain time series of:
QSTAT: EDI detection efficiencies (10 min resolution) EGD: electron time-of-flight (full resolution, not regularly spaced) CLIST: listing of instrument operation mode time intervals CRF: code repetition frequencies, beam current indices, 5 s resolution AEC: correction tables for the AE mode
The documentation consists of:
ICD – a complete description of the EDI contribution to the CAA Instrument Reference Papers and User Manual Program Scripts
EDI data production and delivery are conforming to the ICD and is an ongoing activity. Currently all data for 2001–2005 were delivered and ingested. The data for 2006–2009 are going to be delivered until mid 2010. Note that all data files in the CAA contain in their headers caveats with general information for the user regarding the mission, the observatory, the instrument and the dataset. These state for instance that EDI didn’t work on Cluster 4 or that AED are available starting October 2004 and that C2 works only in ambient mode since April 2004. Acknowledgments The authors wish to thank the CAA team for their efforts in building the archive.
References 1. http://caa.estec.esa.int/documents/ICD/CAA EDI ICD V13.pdf 2. Paschmann G. et al., The Electron Drift Instrument on Cluster: overview of first results, Annales Geophysicae (2001) 19: 1273–1288 3. Quinn, J. M., Cluster EDI convection measurements across the high-latitude plasma sheet boundary at midnight, Annales Geophysicae (2001) 19: 1669–1681 4. Georgescu E. et al., Use of EDI Time-of-Flight Data for FGM Calibration Check on CLUSTER, Proceedings of the Cluster and Double Star Symposium 5th Anniversary of Cluster in Space, ESTEC, Noordwijk, ESA SP-598, 2005 5. “Users Guide to the Cluster Science Data System”, DS–MPA–TN–0015, issue3, 2008, ftp://ftp.estec.esa.nl/pub/csds/task for/users guide/csds guide 3 0.pdf 6. Puhl-Quinn, P. A., H. Matsui, E. Mishin, C. Mouikis, L. Kistler, Y. Khotyaintsev, P. M. E. Decreau, and E. Lucek (2007), Cluster and DMSP observations of SAID electric fields, J. Geophys. Res., 112, A05219, doi:10.1029/2006JA012065 7. Mishin, E. V. and P. A. Puhl-Quinn (2007), SAID: Plasmaspheric short-circuit of substorm injections, Geophys. Res. Lett., Vol. 34, L24101, doi: 10.1029/2007LG031925
Chapter 6
The EFW Data in the CAA Y. Khotyaintsev, P.-A. Lindqvist, A. Eriksson, and M. Andr´e
Abstract The Electric Field and Waves (EFW) instrument measures the 2D electric field (in the spacecraft spin plane) and spacecraft potential with sampling rates, on some occasions, up to 36,000 samples/s. We present a summary of the CAA data products produced from the EFW measurements. We briefly describe the production pipeline from the raw data to final data products and discuss the most common caveats.
6.1 Introduction The Cluster Active Archive (CAA) was created to archive all data from the Cluster mission. Emphasis is on providing the scientific community with calibrated high resolution science data. This paper describes the CAA products from the EFW instrument. It gives some brief information on the instrument, followed by a description of all EFW parameters available in CAA. Some important things to keep in mind when using the data are given in Section 6.5. For those interested, there is also a section describing some of the processing details of the electric field data.
6.2 Measured Quantities, Coordinate Systems A detailed description of the EFW instrument can be found in Gustafsson et al. [5]. We first briefly describe the raw quantities measured by the instrument which correspond to Level 1 products in the CAA. The detector of the instrument consists of four spherical sensors numbered 1 to 4 deployed orthogonally on 44 m long wire booms in the spin plane of the spacecraft. The potential drop between Y. Khotyaintsev (), A. Eriksson, and M. Andr´e Swedish Institute of Space Physics, Uppsala, Sweden e-mail:
[email protected] P.-A. Lindqvist Royal Institute of Technology, Stockholm, Sweden
H. Laakso et al. (eds.), The Cluster Active Archive, Astrophysics and Space Science Proceedings, DOI 10.1007/978-90-481-3499-1 6, c Springer Science+Business Media B.V. 2010
97
98
Y. Khotyaintsev et al.
two sensors, separated by 88 m tip-tip (62 m in case of P32, see Section 6.5.2) is measured to provide an electric field measurement (CAA quantities P12/P32 and P34). The probe difference signals are normally routed through 10 Hz low-pass filters if sampled at 25 s1 , and through 180 Hz low-pass filters when sampled at 450 s1 (see Section 6.5 for the exceptions). The potential difference between each sensor and the spacecraft (CAA quantities P1, P2, P3 and P4) is measured separately with a sampling frequency of 5 s1 after routing through low-pass filters with a cut-off frequency of 10 Hz. The unfiltered analog output signals from the spherical sensor preamplifiers are also provided to the wave instruments (STAFF, WHISPER and WBD) for analysis of high frequency wave phenomena. The EFW instrument measures the electric field only in the spacecraft spin plane, therefore a spin-plane oriented coordinate system is best suited for scientific studies involving the electric field. The ISR2 (Inverted Spin Reference) system, also known as DSI (Despun System Inverted), is such a system. The X and Y axes are in the spin plane, with X pointing as near sunward as possible and Y perpendicular to the sunward direction, positive towards dusk. The Z-axis is along the (negative) spacecraft spin axis, towards the north ecliptic. The coordinate system is called “Inverted” because the actual spin axis of Cluster is pointing towards the south ecliptic. The difference between ISR2 (DSI) and the GSE (Geocentric Solar Ecliptic) is a tilt of 2ı to 7ı of the Z-axis performed in order to avoid shading of the EFW probes by the spacecraft.
6.3 Science Data Products As already mentioned the raw EFW data correspond to the Level 1 products in the CAA. They are archived for reference purpose only. In this section we discuss the science data represented by Level 2 (full resolution) and Level 3 (4 s resolution) products in the CAA. For a complete list of the EFW products see Lindqvist and Khotyaintsev [6]. The spacecraft potential (P) is here defined as the average of all available probes, measured relative to the spacecraft. It relates linearly to true spacecraft potential Vsc with respect to the surrounding plasmas, approximately as Vsc D 1:23 P C 0:7 V [1]. We here keep the opposite sign in order to get a quantity approximately logarithmically co-varying with the plasma density (see Section 6.5). If all four probes are available, the average is done over all 4 probes. If only two or three probes are available, the average is done over 2 probes (P1 and P2, or P3 and P4). If only one probe is available, this quantity is the value of that probe. The number of probes used for P is given in the Parameter caveats. The electric field vector (Ex and Ey / in the spin plane is represented by the quantity E. For Level 2 data it is computed using 2, 3 or 4 probes. When 4 probes are available, the computation of E is straightforward. When 3 probes are available, the computation is also mathematically straightforward, but the electric field has larger errors since the measured components are not orthogonal. When only 2 probes
6
The EFW Data in the CAA
99
are available, only one component of the electric field is measured in the spinning system, and thus E will have a strong spin modulation (see Section 6.5.2). For Level 3 data E is computed from a least-squares fit of a sine wave to one probe pair (P12 or P34) over 4 s (approximately one spin). The least-squares fit is normally done on P34, if available, otherwise on P12. The result is two components of the electric field (Ex and Ey / and a measure of the standard deviation of the raw data points from a sine wave (Sigma). The details of production are described in the next section. EINERT is the electric field vector in the spin plane in the inertial reference frame. It is computed from E by subtracting the spacecraft motion induced electric field vSC xB, where vSC is velocity of the spacecraft with respect to the center of the Earth. EGSE is the full 3-dimensional electric field vector in the GSE coordinate system. It is computed from EINERT by first computing the third (non-measured axial) component of the electric field using the zero parallel electric field assumption, E B D 0, and then transforming the full 3D vector into the GSE coordinate system. These computations are only done when the magnetic field direction is more than 15ı away from the spin plane and jBZ j is larger than 2 nT. Otherwise the error in the computed electric field component becomes too large. The plasma convection velocity VGSE is computed from EGSE and the magnetic field B as VGSE D .EGSE B/=B2 . This computation relies on the availability of EGSE, which in turn depends on the orientation and magnitude of B.
6.4 Production of the Electric Field Data Here we describe the processing chain of the electric field data. At the initial stage of production we remove intervals with: bad data due to issues with electronics, probe saturations due to low plasma density, and non-optimal bias current settings. Usually, only a few minutes of data are removed from each orbit for these reasons. However, large data gaps may occasionally occur. If the spacecraft is in the solar wind we attempt to correct for the wakes usually present in the raw data (see Section 6.5.3). In the presence of a constant ambient electric field, the raw data signal (probe potential difference) is a sine wave where the amplitude and phase give the electric field magnitude and direction. A least-squares fit to the raw data of the form y D A C B sin .!t/ C C cos .!t/ C D sin .2!t/ C E cos .2!t/ C : : : is done once every 4 s .2=! 4 s is the spacecraft spin period), and gives the following output: The sine and cosine terms, B and C (the electric field in ISR2). The raw data DC offset, A. Ideally, the DC level of the raw data should be zero,
however small differences between the probe surfaces and in the electronics create a DC offset in the raw data. If not corrected, it shows up as a signal at the spin frequency in the despun electric field.
100
Y. Khotyaintsev et al.
The standard deviation of the raw data from the fitted sine wave. Higher order terms, D, E, . . . , may be used for diagnostics of data quality.
The electric field (computed from B and C ) and the standard deviation are available in the CAA as Level 3 E. The raw data DC offset (A) is used for processing the Level 2 data. It is applied to P12/P32 and P34 prior to despinning. Variations in the electric field cause small changes of the DC offset, and therefore the DC offset is smoothed using a weighted average over seven spins [6]. Intervals containing WHISPER pulses are blanked prior to despinning (see Section 6.5.6). Another offset which is applied during despinning is the so called Delta offset, which is the difference between the electric fields in ISR2 obtained from the least-squares fit procedure for individual probe pairs, P12/P32 and P34. This offset comes from slow evolution of the probe characteristics with time. A value averaged over several orbits is used. At this stage both the Level 2 (from despinning) and Level 3 (from least-squares fit) electric fields contain systematic errors, namely an amplitude factor and a DC offset, which need to be corrected for. The ambient electric field is “short-circuited” by the presence of the spacecraft and wire booms. This is caused by the spacecraft potential, which is also the potential of the wire booms, extending out to a large distance from the spacecraft. On the basis of simulations and comparisons with other Cluster instruments it has been determined that the measured electric field magnitude needs to be multiplied by a factor of 1.1 to get the real electric field (see also appendix 4 in Lindqvist and Khotyaintsev [6], Cully et al. [1]). This value is routinely applied for all spacecraft and for the entire mission. However, this factor depends on plasma environment, and in some cases may deviate from the value used. In case of Cluster it can vary in a range from 1.0 to 1:2. The spacecraft, wire booms and probes emit photoelectrons, which create an excess of negative charge on the sunward side. This will be measured by the EFW instrument as a spurious sunward electric field, generally referred to as the sunward DC offset. The offset varies slowly with time and plasma conditions around the spacecraft, and is slightly different for the different spacecraft. Its magnitude is determined by comparisons with other measurements, performed by Electron Drift Instrument (EDI) and Cluster Ion Spectrometry experiment (CIS). The values of the offsets that have been subtracted from the data in the CAA are given in the Parameter caveats. The photoelectron asymmetry responsible for the sunward DC offset by definition gives an offset in the sunward direction only. However, results of comparisons with other instruments have at times shown an offset of a fraction of mV/m also in the duskward direction, which is not yet well understood. In most cases the duskward offset is negligible. Prior to delivery to the CAA we attempt to identify and blank intervals with suspected spurious fields in various magnetospheric regions (see Sections 6.5.4 and 6.5.5).
6
The EFW Data in the CAA
101
6.5 Caveats Much effort has been spent on calibrating the data and removing spurious effects to give a useful database for scientific analysis. In spite of this, there will always be data in the CAA which are not of optimum quality, and this section attempts to describe some of the potential problems in the data the CAA user must be aware of.
6.5.1 10 Hz Filter Failure on C2 The 10 Hz filter on probe 3 on C2 failed on 25 July 2001. As a workaround for this, the 180 Hz filter has been used for the difference signals sampled at 25 s1 (sc nominal mode), which has no effect on the 4 s resolution data or on the burst mode data. There is a marginal effect on the 25 s1 data in those situations with large amplitude electric field fluctuations present between 10 and 180 Hz, when these fluctuations alias into frequencies below 10 Hz. After the filter failure, probe 3 on C2 is also not used for computation of the spacecraft potential.
6.5.2 Probe 1 Failure on C1, C2 and C4 Normally, the spin plane electric field is computed using the orthogonal signals P12 and P34. However, a failure occurred on probe 1 on C1 (28 December 2001), on C3 (29 July 2002), and on C2 (13 May 2007). After this, it is no longer possible to measure P12, but a workaround was implemented in the flight software to use P32 instead, the so-called asymmetric mode. This was fully implemented on 29 September 2003 on C1 and C3, and on 24 November 2007 on C2. In the intermediate period (Jan 2002–Sep 2003 for SC1, Aug 2002–Sep 2003 for SC3, and May–Nov 2007 for SC2), full resolution data are available only from one probe pair, which means that they contain a strong spin modulation, and must be used for overview purposes only. The 4-second resolution electric field data are not affected. Data produced from P32 and P34 also have a lower quality with a significant error signal around 0.25 and 0.75 Hz. Figure 6.1 shows examples of the electric fields obtained in the cases of: (1) orthogonal signals P12 and P34, (2) P34 only, (3) the asymmetric configuration.
6.5.3 Solar Wind Wakes The streaming solar wind creates a negatively charged wake behind the spacecraft, in the anti-sunward direction. As the individual probes enter and exit this wake, there is a dip in the probe potential, and thus a spike in the raw data signal twice per spin
102
Y. Khotyaintsev et al.
Fig. 6.1 Examples of spectra and time series (X and Y components in ISR2, circles show 4 s data) of electric field obtained in different instrument configurations on Cluster 1. Panels show (top) normal configuration – both p12 and p34 are present, (middle) p34 only and (bottom) asymmetric configuration – p32 and p34
6
The EFW Data in the CAA
103
Fig. 6.2 Electric field measurements in the solar wind by Cluster 1. The two upper panels show spectra of Ex before and after wake correction. The bottom panel shows raw (blue) and corrected (green) data from p12. Here and in the other figures P12 and P34 are given in units of electric field, i.e. the measured potential difference divided by the boom length
on each probe pair (see blue curve on the bottom panel in Fig. 6.2). In the despun electric field data this shows up as a negative spike in the sunward component, Ex, four times per spin. The resulting spectrum of the electric field (top panel in Fig. 6.2) has a strong signal at 4x the spin frequency (1 Hz) and multiples thereof. An algorithm has been developed to correct for the solar wind wake in the electric field data before submission to the CAA [4]. While doing a good job (results of the correction shown in middle and bottom panels in Fig. 6.2), the algorithm is not always perfect, so the problem with solar wind wake should be kept in mind as soon as spikes at four times per spin period (signal at 1 Hz) are encountered in the data.
6.5.4 Cold Ion Drift Wakes In the low-density plasma encountered for example in the tail lobes, above the polar caps and in the low latitude dayside magnetosphere the spacecraft potential is
Raw p34 [mV/m]
104
Y. Khotyaintsev et al.
5 0 −5 04:20:30
04:20:40
Ex [mV/m]
0 −5 −10
Sc pot [−V]
Ey [mV/m]
−15 8 6 4 2 0 −2 −10 −20
ASPOC ON Removed in the CAA
−30 04:00
04:05
04:10
04:15 14-Feb-2001
04:20
04:25
04:30
Fig. 6.3 Electric field measurements in the polar cap by Cluster 3. The middle panels show Ex and Ey measured by EFW (blue) and EDI (black). Large deviations in Ex are caused by a wake. The upper panel shows 4 spin periods of non-sinusoidal raw p34 data inside the wake region. The bottom panel shows the spacecraft potential. ASPOC is turned on at 04:24 UT
usually of the order of several tens of volts. A cold ion population flowing in such plasma environments will see effectively much thicker booms (several meters instead of a few mm), creating a large negatively charged wake behind the booms in the direction of flow [2, 3]. Figure 6.3 shows an example of such a wake, defined by a large deviation of Ex measured by the EFW and EDI. When ASPOC is operating, the spacecraft potential is kept at a much lower value and the problem of wakes due to cold ion drift is much less severe. In comparison to the solar wind wake the ion drift wake is broader and more diffuse. For a relatively small wake the raw data are non-sinusoidal (see top panel in Fig. 6.3). For large wake they can become sinusoidal again and look very similar to those created by a real ambient electric field. The CAA production software attempts to detect such ion wakes by looking at a combination of parameters, such as spacecraft potential, magnetic field direction, and the relation between different electric field components. For small magnetic field elevations (B direction is within 15ı from the spin plane) we check for the ratio between the components of E along the projection of B into the spin plane and perpendicular to it. For larger elevations we look at the ratio between the measured
6
The EFW Data in the CAA
105
(spin plane) and unmeasured (perpendicular to the spin plane) components of E? , where E? is computed under assumption of zero parallel electric field, E B D 0. Higher ratios indicate a higher probability of the wake being present in the data. At present there is no algorithm to correct the data, and the bad intervals are removed from Level 2 and Level 3 data. Since it is sometimes difficult to discern between these wakes and a real electric field, analysis of the electric field should be done with caution in regions with possible cold ion drifts.
6.5.5 Plasmasphere
Raw p34 [mV/m]
During comparisons of electric field measurements made by EFW and EDI in the inner magnetosphere, it was found that EFW sometimes measures a spurious field of the order of 1–2 mV/m, mostly in the sunward direction (Fig. 6.4, see also Figure 1c in Puhl-Quinn et al. [8]). The raw data signal is often non-
2 1 0 −1 −2
Ey [mV/m]
Ex [mV/m]
12:35:30 1
12:35:35
12:35:40
1 0 −1
1 0 −1
EDI EFW
Sc pot [−V]
corotation −0.5 −1 −1.5
Removed in the CAA
−2 12:20
12:40
13:00 29−Sep−2002
13:20
13:40
Fig. 6.4 Electric field measurements in the plasmasphere by Cluster 1. The middle panels show Ex and Ey in ISR2 measured by EFW (blue) and EDI (black) as well as the co-rotation electric field (red). The upper panel shows 4 spin periods of non-sinusoidal raw p34 data. The bottom panel shows the spacecraft potential
106
Y. Khotyaintsev et al.
sinusoidal (top panel). This problem is not quantitatively understood, but apparently depends on simultaneously acting phenomena: (a) the dense plasmaspheric plasma can sometimes be so high as to give a random electron current to the probes almost as large as the applied bias current, driving the probe away from its vacuum potential with respect to the plasma; (b) the wake created by the spacecraft makes the random current and the resulting error dependent on the spin phase and hence gives an apparent DC field in a non-spinning reference frame; and (c) small differences in probe surfaces and bias circuitry will make this effect slightly different between the probes, further complicating the result. A first principles error treatment is therefore complex. Nevertheless, an empirical algorithm has been developed to detect the bad data. The algorithm uses a comparison between the measured electric field and the expected field if the ambient plasma were to co-rotate with Earth, and is applied only in regions of high density as indicated by the spacecraft potential (Sc Pot > 1:5 V). The problematic intervals are removed in the CAA data. Users studying the electric field in the inner magnetosphere should be aware of this problem, since the detection of bad data is not always perfect.
6.5.6 WHISPER Operations The WHISPER instrument regularly (often at a repetition period of 52 or 104 s in the normal mode) emits waves of certain frequencies to detect resonances in the ambient plasma. These active soundings are seen in the EFW data (the vertical stripes in the spectra in Fig. 6.2 are for example cause by WHISPER pulses) and are removed automatically in the CAA data by testing for a “sounder active” flag in the telemetry. There are some residual effects after removing the active sounding periods, mainly seen as small spikes in the Level 3 potential data (for details see appendix 5 in Lindqvist and Khotyaintsev [6].
6.5.7 ASPOC Operations The ASPOC instrument attempts to keep the spacecraft potential at a low value, primarily to enable low-energy ion and electron measurements by the particle instruments. In the absence of ASPOC the spacecraft potential often reaches several tens of V in the low-density plasmas encountered by Cluster. With ASPOC operating, the spacecraft potential is brought down to the order of 5–8 V. An example of ASPOC turning on is shown in the bottom panel of Fig. 6.3. As already mentioned, a positive side-effect of this is that the electric field measurements are most often improved since the wake effects associated with large spacecraft potentials in the polar cap are drastically reduced. However, while ASPOC alleviates spacecraft cold plasma wakes, there are also cases when the EFW data are adversely affected by
6
The EFW Data in the CAA
107
ASPOC. First, with ASPOC on, the sunward offset in the magnetosphere is more variable than with ASPOC off. This is not yet understood. Second, with ASPOC on, the noise level sometimes increases significantly at low frequencies. As ASPOC never has been operational on all four s/c, a general advice is that when using EFW data from a s/c with ASPOC on, always look out for ASPOC-related effects on the EFW data by comparing to the measurements from a nearby Cluster s/c with ASPOC off. The spacecraft potential is often used as a proxy for ambient plasma density variations [7]. The data quantity in the CAA is the probe potential measured with respect to the spacecraft potential, which is most often a negative quantity. More negative probe potential corresponds to more positive spacecraft potential which also usually corresponds to lower ambient plasma density. Though the conversion of the spacecraft potential to density can be used at reduced accuracy also when ASPOC is on [9], it works best when ASPOC is off and the spacecraft potential is allowed to float freely. Any use of the spacecraft potential to determine plasma density must take into account whether ASPOC was operating or not. ASPOC is not operational on C1.
6.5.8 EDI Operations EDI measures the ambient electric field by emitting a beam of electrons and detecting the drift step as the electrons gyrate around the ambient magnetic field. The emitted beam current contributes to increasing the spacecraft potential, particularly in a low density plasma. During some periods in the beginning of the mission, the emitted EDI beam current was larger than expected, in particular on C2, so there is a tendency for the spacecraft potential to be larger than on the other spacecraft. It also affects the EFW electric field measurements in that there is a larger risk of saturating the measurements, which happens when the spacecraft potential reaches 70 V. However, after April, 2004, the EDI guns on C2 were turned off in favor of running the instrument in an alternative, “ambient” mode and they no longer cause problems.
6.6 Summary We presented a summary of EFW products in the CAA. We stress that a spin-plane oriented coordinate system (for example ISR2) is best suited for scientific studies involving the electric field. The uncertainty of the electric field measurement is generally less than the greater of 1 mV/m or 10% of the measured value. Accuracies better than 1 mV/m can be achieved by detailed analysis of calibration factors and errors in specific events. We have also listed the most important caveats a user of the electric field data must be aware of.
108
Y. Khotyaintsev et al.
References 1. Cully C. M., R. E. Ergun, and A. I. Eriksson, Electrostatic structure around spacecraft in tenuous plasmas, J. Geophys. Res. 112, A09211 (2007). doi:10.1029/2007JA012269 2. Engwall, E., A. I. Eriksson, and J. Forest, Wake formation behind positively charged spacecraft in flowing tenuous plasmas, Phys. Plasmas 13, 062904 (2006). doi: 10.1063/1.2199207 3. Eriksson, A. I., M. Andr´e, B. Klecker, H. Laakso, P.-A. Lindqvist, F. Mozer, G. Paschmann, A. Pedersen, J. Quinn, R. Torbert, K. Torkar, and H. Vaith, Electric field measurements on Cluster: comparing the double-probe and electron drift techniques, Ann. Geophys. 24, 275–289 (2006) 4. Eriksson, A. I., Y. Khotyaintsev, and P.-A. Lindqvist, Spacecraft wakes in the solar wind, In Proceedings of the 10th Spacecraft Charging Technology Conference (SCTC-10), (2007) URL: http://www.space.irfu.se/aie/publ/Eriksson2007b.pdf ˚ en, F. 5. Gustafsson, G., R. Bostr¨om, B. Holback, G. Holmgren, A. Lundgren, K. Stasiewicz, L. Ahl´ S. Mozer, D. Pankow, P. Harvey, P. Berg, R. Ulrich, A. Pedersen, R. Schmidt, A. Butler, A. W. C. Fransen, D. Klinge, M. Thomsen, C.-G. F¨althammar, P.-A. Lindqvist, S. Christenson, J. Holtet, B. Lybekk, T. A. Sten, P. Tanskanen, K. Lappalainen, and J. Wygant, The Electric Field and Wave Experiment for the Cluster Mission, Space Sci. Rev. 79, 137–156 (1997) 6. Lindqvist, P.-A. and Y. Khotyaintsev, Cluster Active Archive: Interface control document for EFW, ESA document CAA-EFW-ICD-0001 (2007), URL : http://caa.estec.esa.int/caa/ instr doc.xml 7. Pedersen, A., B. Lybekk, M. Andr´e, A. Eriksson, A. Masson, F. S. Mozer, P.-A. Lindqvist, P. M. E. D´ecr´eau, I. Dandouras, J.-A. Sauvaud, A. Fazakerley, M. Taylor, G. Paschmann, K. R. Svenes, K. Torkar, and E. Whipple, Electron density estimations derived from spacecraft potential measurements on Cluster in tenuous plasma regions, J. Geophys. Res. 113, A07S33 (2008). doi: 10.1029/2007JA012636 8. Puhl-Quinn, P. A., H. Matsui, V. K. Jordanova, Y. Khotyaintsev, and P.-A. Lindqvist, An effort to derive a convection electric field model in the inner-magnetosphere: Merging Cluster EDI and EFW data, J. Atmosph. Solar-Terr. Phys., 70, 564–573 (2007). doi: 10.1016/ j.jastp.2007.08.069 9. Torkar, K., A.I. Eriksson, P.-A. Lindqvist, and W. Steiger, Long-term study of active spacecraft potential control, IEEE Trans Plasma Science, 70, 2294–2300 (2008)
Chapter 7
FGM Data Products in the CAA J.M. Gloag, E.A. Lucek, L.-N. Alconcel, A. Balogh, P. Brown, C.M. Carr, C.N. Dunford, T. Oddy, and J. Soucek
Abstract Set out in this paper is a description of the magnetic field and supporting data products that the FGM team have generated and submitted to the Cluster Active Archive. A significant amount of effort has been put into the calibration and validation of the magnetic field data products and details of the calibration techniques used to produce these data are given here. The quality control tools used to validate the extensive magnetometer dataset and the quality indicators used to label the data itself (namely the caveat and accuracy) files are described. A summary of overall magnetometer calibration status, accuracy level and conclusions from the analysis work undertaken so far is also included.
7.1 FGM Instrument Description The FGM instrument consists of two three-axis fluxgate magnetometer (FGM) sensors located on a radial boom and an onboard data processing unit. The outboard sensor (OB) is located on the end of a 5.2 m boom and the inboard sensor is located 1.5 m in from the end of the boom. Each of the four Cluster spacecraft carries an identical FGM instrument and a full description of the hardware can be found in Balogh et al. [1, 2]. In flight either sensor can be designated as the primary sensor for acquiring the main data stream of the magnetic field vectors and since the J.M. Gloag, E.A. Lucek (), L.-N. Alconcel, P. Brown, C.M. Carr, C.N. Dunford, and T. Oddy Space and Atmospheric Physics, The Blackett Laboratory, Imperial College, London SW7 2BW, UK e-mail:
[email protected] A. Balogh Space and Atmospheric Physics, The Blackett Laboratory, Imperial College, London SW7 2BW, UK and International Space Science Institute (ISSI), Hallerstrasse 6, 3012 Bern, Switzerland J. Soucek Department of Space Physics, Institute of Atmospheric Physics, Academy of Sciences of the Czech Republic, Prague, Czech Republic
H. Laakso et al. (eds.), The Cluster Active Archive, Astrophysics and Space Science Proceedings, DOI 10.1007/978-90-481-3499-1 7, c Springer Science+Business Media B.V. 2010
109
110
J.M. Gloag et al. Table 7.1 FGM operating ranges Range number Range (nT) 2 64 to C63:97 3 256 to C255:87 4 1;024 to C1;023:5 5 4;096 to C4;094 7 65;536 to C65;504
Resolution (nT) 7:8 103 3:1 103 0.125 0.5 8
beginning of nominal operations in 2001 the OB sensor has been set as primary on all four spacecraft. The instrument is designed to be highly failure-tolerant through a full redundancy of all its functions. The wide range of magnetic field values to be sampled across the different regions encountered in the Cluster orbits necessitates the use of instrument ranging in order to prevent saturation of the fluxgates during perigee pass while at the same time providing high resolution in the solar wind where the ambient field is typically a few nT. The sensors measure the three components of the field in seven ranges, although only four of these (numbered 2–5) are used on Cluster, with full scales and corresponding digital resolutions as shown in Table 7.1. Another range (range 7) was used only for ground testing. The instrument data processing unit automatically switches the ranges by continually monitoring each component of the measured magnetic field vector. There are two telemetry modes in common use with a rate derived from the instrument raw sample rate of 201.75 vectors/s. In normal mode the data are digitally filtered and decimated down to 22.416 vectors/s and in burst mode the data are filtered and decimated to 67.249 vectors/s. In both cases the digital filter is an FIR (Finite Impulse Response) filter derived from a Gaussian shaped impulse response. The fluxgate sensors are most sensitive in the range (0–10) Hz. The signal chain from the sensor acquisition to the telemetered data stream has two filter stages – an anti-aliasing analogue filter on the output of the raw sensor voltage and the DPU implemented digital filter(s) described above (See also Figures 5 and 6 in Balogh [2]). The following section of this paper introduces the challenges of calibrating the magnetometer data. After an introduction and overview of the in-flight calibration procedure there are sections which give an introduction and useful practical insights into the implementation of the different calibration analyses required to produce the highest quality FGM data. Section 7.3 introduces FGM data products which have been submitted to the CAA, sets out the data production procedure and finally describes the quality control procedure for the FGM data products.
7.2 The FGM Calibration Procedure for CAA Data Products The calibration problem for a fluxgate magnetometer can be most clearly expressed in terms of the calibration equation. This is shown in Eq. 7.1 to relate the magnetic
7
FGM Data Products in the CAA
111
field in a calibrated orthogonal coordinate system in nT to the magnetic field in the fluxgate sensor coordinate system in engineering units. 0
1 0 10 1 0 1 BS1 Bx G1 cos 1 G1 sin 1 cos 1 G1 sin 1 sin 1 O1 @ BS2 A D @ G2 cos 2 G2 sin 2 cos 2 G2 sin 2 sin 2 A @ By A C @ O2 A BS3 G3 cos 3 G3 sin 3 cos 3 G3 sin 3 sin 3 Bz O3 (7.1) There are three sets of physical calibration parameters in the calibration equation. There are the sensor aligned offsets O1 , O2 , O3 which alter the overall level of the magnetic field, the gains G1 , G2 , G3 which scale the field and the angles ™1 , ™2 , ™3 , ®1 , ®2 , ®3 which transform from the almost orthogonal sensor coordinate system to an exactly orthogonal coordinate system. The subscripts s1, s2, s3 refer to the sensor coordinate system and the subscripts x, y, z refer to an orthogonal coordinate system. The equation has been written so that the s1 direction is in the spin axis sensor direction which is consistent with FGM on Cluster and the x direction is in precisely the spin axis direction. The aim is to determine values for these 12 calibration parameters. However there is no single way to solve this calibration equation and in reality several different analysis methods are employed to gain as much information about the 12 calibration parameters as possible. The type of analysis that can be done depends on details of a particular spacecraft mission such as whether it is a spinning spacecraft or three-axis stabilised and what type of space plasma regions are encountered. In addition some of the ground calibration values are used as input which can provide a starting point for some of the analysis. The approach taken for the calibration of Cluster FGM for the CAA is to start each analysis period with a well defined starting point and work with the physical calibration parameters as much as possible when performing the calibration analyses in order to make the results at each stage as transparent as possible. What are meant here by physical calibration parameters are the sensor offsets gains and misalignment angles. Each of the four instrument ranges used during Cluster FGM flight operations have a different set of calibration parameters, which means that for any particular analysis period there are 48 calibration parameters (i.e. 4 ranges 12 parameters for each range) to be determined. As a general guide to the physical calibration parameters it can be noted that the sensor offsets tend to vary over the shortest timescales. It is possible to see very small changes in offsets over times scales as short as minutes or hours but the more significant changes tend to be seen over weeks or months. As the offsets only change the overall level of the magnetic field, they tend to be more important in the lower instrument ranges where the magnetic field is lower. The gains and misalignment angles can be considered together as generally they change by much smaller amounts over longer time scales of months. One notable exception to this is when the spacecraft go through eclipses and the sudden changes in temperature can cause gains and misalignment angles to change significantly over the period of minutes and hours. Both gains and angles tend to be more important at the higher end of ranges and in the higher ranges as they are both multiplying factors to the field.
112
J.M. Gloag et al.
7.2.1 Overview of the Calibration Procedure Figure 7.1 shows an overview of the CAA calibration procedure. The central calibration method is the Fourier analysis technique, based on Kepko et al. [4]. This technique is applicable on Cluster as the spacecraft are spin stabilised and it is used to calculate the bulk of the calibration parameters. The range 2 spin axis offset is required as an input to the Fourier analysis which means this needs to be determined first. During the solar wind season the range 2 spin axis offset can be determined using the solar wind analysis and during the tail season a linear interpolation is made for the correction to the spin axis to the next solar wind season. It is possible to use the EDI (Electron Drift Instrument, Paschmann et al. [7]) data to monitor the magnetic field magnitude and make sure that no large deviations from the interpolated spin axis offset occur during the tail season. After the Fourier analysis has been performed there are still a number of calibration parameters that have not been estimated. Due to a number of these parameters being incorrect at this stage it may be possible to observe jumps in the magnetic field at instrument range changes. It is possible to use the measurement of these jumps at range changes to refine a number of calibration parameters. Under very specific conditions (see Section 7.2.5) it is possible to apply an inter-spacecraft calibration analysis to the data in order to determine a further set of parameters but it is very rarely the case that the correct conditions exist. The standard calibration files produced to calibrate the data for submission to the CAA are valid for the period of an orbit from perigee to perigee. These calibration files have had input from the solar wind analysis, Fourier analysis and range change analysis and are produced for every orbit of data submitted to the CAA. A small number of files have also had the results of inter-spacecraft
Calibration in
Solar wind analysis
Spin axis offsets
Fourier analysis (Kepko et al., 1996)
EDI
Bulk of cal. set
Refinement files to compensate for short term variations in calibration
Tweaks to some cal.
Intercalibration on selected data periods
Tweaks to some cal.
Jumps at range changes
Fig. 7.1 A diagram illustrating an overview of the calibration procedure used to generate the calibration parameters that are applied to the FGM data products submitted to the CAA
7
FGM Data Products in the CAA
113
calibration analysis incorporated into the parameters. It is possible for some calibration parameters to change on shorter timescales than an orbit which results in small residual observable signals in the calibrated data. The final calibration analysis is designed to produce a refinement to the orbit calibration and take account of the short timescale changes in a particular set of calibration parameters. Due to the intensity of processing and validation required to produce these calibration refinement parameters, only a subset of prioritised data periods are being considered for this analysis, and to date no FGM data within the CAA have calibrated using this method. Therefore we do not describe it in detail here. In the following sections an outline of each of the other calibration techniques is given. These descriptions do not aim to rigorously define the basis of each technique but instead the aim is to give an insight into the challenges of implementing these analyses in practice.
7.2.2 The Solar Wind Analysis The determination of offsets for non-spinning axes is generally considered to be one of the more challenging calibration tasks. However if several hours of solar wind data are available with the physical properties described below then it is possible to obtain corrections to these type of offsets to very high accuracy. The general idea is to exploit a particular natural property of the solar wind as done by Hedgecock [3], for example. The solar wind contains short period fluctuations which are predominantly rotational in nature. These fluctuations are therefore observed as changes in field direction. This means that measurements made in any particular non-spinning axis being considered should have on average no correlation with the measured magnetic field magnitude. However if an offset exists on a non-spinning axis then measurements of the magnetic field on this axis will have a correlation with the magnetic field magnitude. The offset on this axis is then estimated by determining a field value that when removed from the magnetic field on the axis under consideration results in a zero correlation between this corrected field and the magnetic field magnitude. In reality compressive fluctuations are also observed in the solar wind to a certain extent and the key to applying this calibration method successfully and accurately is in the selection of data periods to be used in the calibration analysis. The implementation of the solar wind calibration analysis used in the calibration procedure for producing Cluster FGM data for the CAA was originally developed by FGM CoIs at UCLA (H.K. Schwarzl, K. Khurana, M. Kivelson, 2005, private communication) who have also collaborated with us on its implementation at Imperial College. The data selection scheme is applied to data for an analysis period which have been split into bins of a fixed width. Each bin is also overlapped by a fixed time period. The length of analysis period, bin widths and overlap periods are discussed in the next paragraph. The data in the non-spinning axis being considered for calibration first has an artificial positive offset applied to it and the correlation coefficient between this field and the magnetic field magnitude is calculated for each bin. The data in
114
J.M. Gloag et al.
the same axis then has the same artificial offset applied in the negative direction and the correlation coefficient calculated for each bin. In order for this method to work most effectively it is important that the artificial offset is greater than the offset correction being calculated. This means that there can be some trial and error involved in deciding on what value to give this artificial offset. The data selection parameters can then be calculated by taking the absolute value of the difference between the two correlation coefficients for each bin. The greater the value of the data selection parameter, the more Alfv´enic the fluctuations are in that particular data bin and the more suitable the data are for use in the solar wind calibration analysis. The data selection parameters are then put into descending order and the bins that fall in the top 75th, 80th, 85th, 90th and 95th percentile boundaries are taken forward as the five sets of bins to be used in the calibration analysis. The procedure is applied to data from each of the four spacecraft independently. The period of time used for a particular analysis is usually 2 weeks but can be 1 month if less solar wind data are available. The analysis is normally done for three sets of bin widths and overlaps and then all the calibration results considered together to decide what correction to the spin axis offset is most suitable. The following combinations of bin width and overlap are used: (3,600, 200 s); (900, 50 s); (200, 20 s). The solar wind analysis is an iterative process and the input data to the analysis is calibrated using calibration from an orbit which is immediately before the analysis period being considered. This means that the analysis data is in an orthogonalised coordinate system with one axis precisely in the spin axis direction. The spin axis offset corrections are therefore also in this orthogonalised coordinate system. The spin axis offset corrections for the first iteration are generated by taking the median value of the corrections determined in each of the five percentile groups of bins containing the top 75th, 80th, 85th, 90th and 95th percentile bins from the data selection analysis. The final offset correction for this iteration is then calculated by taking the mean of these five median values. The next iteration then repeats the process using data which has been modified using the offset correction from the present iteration. Usually a stable result is established in three to five iterations. As stated already, this final offset correction is in an orthogonalised coordinate system. However this value should then be applied as a correction to the input sensor offset so must be transformed into the sensor coordinate system in order to do this. It is this corrected sensor offset which is required as an input to the Fourier analysis calibration. The results generated using different data bin widths generally give slightly different results and occasionally, if there is particularly little data for instance, the longest bin widths may not give good results. In order to check that the best spin axis offset corrections have been chosen the data are visually validated at this stage. The four spacecraft data are plotted together with the chosen spin axis offset corrections applied. It is expected that in the solar wind the four spacecraft data will lie on top of each other. There is always a level of natural variation in each spacecraft data but on average and particularly when the data are quiet it should not be possible to observe a significant systematic difference in one or more spacecraft spin axis data. If this is observed the use of a different spin axis offset correction should be considered for the affected spacecraft.
7
FGM Data Products in the CAA
115
Once the standard solar wind calibration has been performed successfully it is possible to further refine the spin axis offset corrections by considering the four spacecraft data together. A set of equations can be written which relate differences in the spin axis field between every combination of spacecraft to the refinements in spin axis offsets for each spacecraft. Singular value decomposition can be used to solve this set of equations for the refinements to the spin axis offsets for each spacecraft. In practice it is found that this technique can only be used rarely because exceptionally quiet solar wind data are required. It is important to visually identify the systematic small differences between the four spacecraft field in smooth field regions and then confirm that the results of this refinement analysis are consistent with these differences. This ensures that the analysis is determining refinements to the spin axis offsets and is not simply producing a measure of fluctuations in the field between spacecraft.
7.2.3 The Fourier Analysis Technique The Fourier calibration analysis [4] is central to the calibration procedure and based on the fact that a number of calibration parameters, if incorrect can produce spin signals in the despun magnetic field data. If the calibration Eq. 7.1 is linearised, has the despin matrix applied to it and then the Fourier transform applied to it as described in Kepko et al. [4], it is found that a set of the calibration parameters are directly related to first and second harmonic spin signals in the despun data. Measurement of these signals in the data can therefore be used to calculate estimates to a set of calibration parameters. The first harmonic signal in the spin axis magnetic field can be used to estimate the spin axis elevation and azimuthal angles. The first harmonic signal in the spin plane magnetic field can be used to estimate the two spin plane offsets and two spin plane elevation angles. Finally the second harmonic signal in the spin plane magnetic field component can be used to estimate the ratio of the spin plane gains and the relative spin plane azimuthal angles. The total, final estimates of the calibration parameters may not be small but the results come from a linearised set of equations. Therefore the final set of calibration parameters are made by using an iterative approach where at each iteration the new estimates of the calibration parameters are applied to the data to be used in the next iteration. For each iteration the calibration parameters are estimated using least squares analysis applied to the equations that come from the manipulations made to the calibration equation described above. Data selection is an important step to ensure the best results are obtained. The data are split into approximately two minute bins and each instrument range is calibrated separately. Normal mode FGM data at 22 Hz time resolution is used. It is essential that the data bins are chopped to size so that their length is an exact integer number of the spacecraft spin periods. The best data bins for use in the analysis are those which have generally low levels of fluctuations, field which is reasonably constant over the bin width but that also have good signal to noise on the spin signals
116
J.M. Gloag et al.
that are to be removed. However it is also important that there is a good spread of magnetic field magnitude and direction over the full set of bins so a compromise on these conditions is required. Three tests are made on the data bins in order to choose the best ones for analysis. The first calculates the median power spectral density between 0.1 and 1 Hz and the data that exhibit the highest level of fluctuations are removed. The second test calculates the standard deviations for each of the remaining data bins and these statistics used to remove the data bins with the most change in field over the bin width. The third test uses the calculation of the signal to noise ratio of the first harmonic signal to find the intervals with the clearest spin signals. Each of these tests are carried out on the spin axis and spin plane data bins independently. Fourier analysis is applied to data from a full orbit defined from perigee to perigee. Data quality for calibration varies from orbit to orbit in terms of coverage and data characteristics. For instance if a large amount of data in a particular range is sheath data which contains high levels of fluctuations over a wide band of frequencies it can be difficult to measure the spin signal associated with certain calibration parameters. Some calibration parameters change over shorter time scales than others. Generally speaking, the angles and gains tend to change over a longer timescale than the offsets. Under normal circumstances offsets can change by small amounts over the period of an orbit but angles tend to be reasonably constant for many orbits. However during events such as eclipses when the temperature drops and then rises significantly all the calibration parameters can change on a timescale significantly shorter than an orbit. In these circumstances the analysis results is the determination of average calibration parameters over the period of the orbit and it is sometimes clear from the least squares fitting routine that there are multiple solutions which correspond to different parts of the orbit. The starting point for this Fourier analysis is to use a calibration file which has the range 2 spin axis offset predetermined using the solar wind analysis for instance and the range 3–5 spin axis offsets input from a previous orbit within 1 month. The spin plane offsets are set to zeros and the gains are set to the ground determined values. Finally the angles are set to 0ı or 90ı in such a way as to align the three sensor axes in an orthogonal set. The initial results are evaluated for calibration quality. The first check is to create a table of all the spin axis angles that have been determined for each range. These angles should only change relatively slowly through time which means that if large variations are seen on any particular orbits it may be the case that the data quality was not sufficient to obtain good results. This can often be the case in range 2 as there tend to be larger levels of fluctuations in this data and the angle errors don’t produce as big a signal in lower field magnitudes. In practise the best orbits for calibration within a month are identified and the spin axis angles used from these in the orbits where the data are not as good for calibration. Secondly a calibration report is automatically produced for each orbit and spacecraft containing information about the three data selection tests and plots of the least square results from the first iteration. It is also recorded here if there are not enough data intervals to perform the analysis on a particular range. Finally spectrograms are generated for the spin axis field and spin plane magnitude field
7
FGM Data Products in the CAA
117
using the calibration parameters calculated at this stage. All this information together can be used to decide what calibration parameters may need to be substituted into one orbit calibration from another orbit where the data were more suitable for performing the analysis. In our implementation of the Fourier analysis technique, a first analysis is performed on a months worth of orbits. The set of spin axis angles for all orbits and ranges are used to determine which orbits are the best for calibration purposes and spin axis angles substituted from these best orbits to those where the analysis was less successful. If any orbits have too low data coverage in a particular range then the full set of calibration for that range is substituted from an adjacent good orbit. The spectrograms are then rerun with the updated calibration and then these are compared to the original spectrograms to make sure an improvement has been made. There may be more than one possibility for updating certain calibration parameters. All possible improvements are tried and then the calibration that produces the best spectrogram is chosen to be the calibration for that orbit. If a particular problem still remains with the calibration for a certain orbit then the automatically produced calibration report described previously can be used to try and establish the problem with the orbit. One point to note is that there is a spacecraft generated field on spacecraft 1 which manifests as a small first and second harmonic spin signal in the spin axis field. This cannot be removed with this calibration analysis but it has been found that the major part of the signal is in the imaginary component of the first harmonic spin signal so the real part is used to estimate the spin axis angles successfully. It should also be noted that the spin axis angles can be more precisely determined in the higher ranges because the angles produce a bigger signal in higher magnetic fields and also because the data tends to be quieter in the higher ranges. This means that the angles from the higher ranges can be used as guidance for the lower ranges if the data in the lower ranges are not good quality for calibration. It is possible for the calibration to vary within an orbit. The calibration from this analysis is effectively an average calibration over the period of an orbit and the calibration refinement method is required to remove the residual spin tone caused by these short timescale variations of calibration parameters. Figure 7.2 presents example spectrograms for a complete orbit of spacecraft 2 data from February 2006. Figure 7.2a is the spectra prior to Fourier analysis and Fig. 7.2b is the spectra produced following the analysis. The red lines and white lines overlaid on the plots mark out demarcations of instrument range switches with the long middle period corresponding to range 2 data. Looking at the period immediately following the 02/08 time marker in Fig. 7.2a where the instrument range switches from 2 to 3 it can be seen that there is significant increase in power at 0.25 and 0.5 Hz indicating that the initial range 3 calibration is incorrect. Following the Fourier analysis this power burst is identified as unnatural and corrected by the re-calculated calibration parameters.
118
J.M. Gloag et al.
b
Dynamic spectrum, |Byz|(Spin plane) sensor coords − SC2 orbit 863 V01
Dynamic spectrum, |Byz|(Spin plane) sensor coords − SC2 orbit 863 V03 1
0.9
0
0.8
−1
0.7
−2
0.6
−3
0.5
−4
0.4
−5
0.3
−6
log(PSD) nT2 Hz−1 Frequency / Hz
Frequency / Hz
1
0.9
0
0.8
−1
0.7
−2
0.6
−3
0.5
−4
0.4
−5
0.3
log(PSD) nT2 Hz−1
a
−6
0.2
0.2
−7
0.1
−7 0.1
02/06
02/07
02/08
Time
02/06
02/07
02/08
Time
Fig. 7.2 Spectrograms of spin plane magnitude magnetic field data from the 6th, 7th and 8th of February 2006 which has been calibrated using parameters derived using the standard Fourier analysis procedure. The horizontal axis shows time in month and day, the vertical axis shows frequency in Hz and the colour scale is a measure of the power spectral density: (a) corresponds to the spectrogram prior to the analysis and (b) corresponds to the spectrogram achieved following this calibration step. The red and white overlaid lines represent the different instrument ranges used through time. The lowest level is range 2, the mid level range 3 and highest level range 4
7.2.4 The Range Change Analysis Following the range 2 spin axis offset determination and the application of the Fourier analysis method there are still a number of calibration parameters which may not be correct. If the natural fluctuations in the data are small enough it may be possible to see small jumps in the magnetic field across instrument range changes when the calibration at this stage is used. These jumps are an indication that some calibration parameters are incorrect as the data should be continuous across the range changes. A method was developed by FGM CoIs at UCLA (H.K. Schwarzl, K. Khurana, M. Kivelson, 2005, private communication) to use these jumps at range changes in order to correct a subset of calibration parameters. Through collaboration with these FGM CoIs at UCLA this range change calibration analysis has been implemented at Imperial College. The analysis is performed in the spin plane and the spin axis magnetic field separately. In the spin plane a jump in the field at a range change can be ascribed to a gain error and an error in azimuthal angle. In the spin axis a jump in the field at a range change can be accounted for by a gain error and an offset error. A set of equations can be derived which relate these calibration parameters to the jumps in the field observed at the range changes. In order to cause the smallest change to the overall field the gain corrections are applied to the lower range in both the spin axis and spin plane and the other parameters are applied to the upper range, the offset in the case of the spin axis and the azimuthal angle in the case of the spin plane. The implementation of this range change analysis involves creating analysis tools which are used to plot the data close to range changes, select which range changes are most suitable for the analysis and measure the jump in each component of the
7
FGM Data Products in the CAA
119
magnetic field. The period of data used for analysis is generally 2 weeks or 1 month, which usually has enough suitable range changes to give good results although occasionally slightly longer periods of time need to be considered. The calibration of changes between ranges 2 and 3 is usually the most difficult because the data often have a significant amount of natural signal compared with the size of the jumps being measured. Ideally the data either side of the range change should be smooth and the jump in the field to be measured should be clear. The data tend to be smoother close to range changes between ranges 3 and 4 which means that more jumps in the field can be used and generally it is possible to do the analysis with 2 weeks of data. The range 2 and 3 calibration is done first, the data reprocessed with the new calibration and then the range 3–4 calibration done. When all the ranges have been calibrated the data are reprocessed again and both the range 2–3 and 3–4 changes are compared with the original data to make sure that the tweaks to the calibration have been successful. This is an important step because when correcting the range 3 and 4 calibration small jumps may be reintroduced at the range 2 and 3 changes. One important point to note is that when doing the spin axis calibration it is important to make sure that the spin axis has a good range of magnetic field values. This is because the calculation of the calibration corrections involves a linear fit so the larger the range of field values, the more accurate the gradient and offset of this fit. An example of time series data from spacecraft 2 before and after the range change analysis is shown in Fig. 7.3. The upper plots show a range change from 4 to 5 for each vector component Bx, By and Bz. One can see there is a discontinuity where the range change occurs due to a calibration error. The lower plots display the same range change plotted following re-calibration of the time series using the parameter modifications determined during the analysis.
7.2.5 Inter-Spacecraft Calibration It is possible to use the four spacecraft data together to perform inter-spacecraft calibration and a method for doing this was developed by Khurana et al. [5]. The method demonstrates that if the assumption can be made for a period of data that the Curl of the magnetic field vector should be zero and it is taken that the divergence of the magnetic field is zero then it is possible to estimate a correction to a set of calibration parameters. This is done by minimising the Curl and divergence of the magnetic field in regions of magnetic field where the current density and therefore Curl of the magnetic field is expected to be zero. Using this technique it is possible to calculate a set of misorientation angles, a set of spin axis gain corrections and a set of spin axis offset corrections for three spacecraft relative to a pre-chosen mother spacecraft. This method has been implemented by FGM CoIs at UCLA (H.K. Schwarzl, K. Khurana, M. Kivelson, 2005, private communication) and a collaboration with these CoIs has lead to an implementation of this technique at Imperial College. Data selection is of prime importance when implementing this calibration technique and the initial task is to choose general data periods when the current density is
120
J.M. Gloag et al. Range 45 jumps before jump calibration −325
388
−26
−327
384
−27
−28
Bz /nT
By /nT
Bx /nT
−25
380
−329
18:50:00 18:50:30 UTC time
−331
18:49:40 18:49:50 UTC time
376
18:49:40 18:49:50 UTC time
Range 45 jumps after final jump calibration −325
388
−26
−327
384
−27
Bz /nT
Bx /nT
By /nT
−25
380
−329
−28
376
−331
18:50:00 18:50:30 UTC time
18:50:00 18:50:30 UTC time
18:50:00 18:50:30 UTC time
Fig. 7.3 A typical figure generated during the range change analysis. The data are from 30th of January 2009. The upper three plots correspond to a range 4–5 jump for each field component utilising the calibration file produced by the Fourier analysis step. The lower panel shows the same jumps after the corrected file has been further modified by the range change analysis. We can see on all three components that the jump offset has been reduced to almost zero and the data are now continuous across the range change
expected to be zero, for example, in the magneto-tail lobe regions. The lobe regions are located by finding the point where the magnetic field in the x-axis of the J2k coordinate system (Geocentric inertial reference frame using the Julian Epoch of Jan. 1, 2000) smoothly moves through zero and by considering the data either side of this point in the magneto-tail. Data is then selected where the Curl of the magnetic field is smooth, the magnetic field in the x-axis of the J2k coordinate system is smooth, the inter-spacecraft distances are less than 4,000 km and the Q-factor [8] for the spacecraft tetrahedral is greater than 2. In practice the most successful results between spacecraft have been obtained in the tail season of 2003 when the inter-spacecraft distances were of the order 100 km. It was also found that more stable results were found when only solving for the spin axis gain corrections and spin axis offset corrections. Generally between 2 weeks and 1 month of data are considered when performing the data selection for the inter-spacecraft calibration analysis. When the minimisation analysis has been performed checks are made to determine if good results have been obtained. The Curl and divergence of the magnetic field are calculated, which should be small, considered and the changes to the calibration parameters made after the last three or four iterations are checked to make sure a
7
FGM Data Products in the CAA
121
stable solution has been achieved. A visual check is made to make sure the four spacecraft spin axis field values are close together in the regions selected for the analysis. The inter-spacecraft calibration is rewarding in that it yields corrections to calibration parameters which could otherwise not be estimated.
7.3 The FGM Data Products 7.3.1 Primary Data Products The primary FGM data products consist of magnetic field data products at three different time resolutions. Each of the three data products are processed independently and are calibrated using the same calibration file. Each calibration file is valid for the period of one orbit defined from perigee to perigee. The highest resolution magnetic field data product (Cx CP FGM FULL) contains data which has no time averaging applied. If the instrument is in normal mode the data is at approximately 22 Hz resolution and if it is in burst mode the data is at approximately 67 Hz resolution. The second magnetic field data product (Cx CP FGM 5VPS) is averaged to a time resolution of 5 vectors/s and the third magnetic field data product (Cx CP FGM SPIN) is averaged over one spacecraft spin where the spin phase for averaging is the same as that used for the Prime Parameter data (26:367ı). Each of the three primary data products have the same format below the CEF-2 (Cluster Exchange Format, version 2) header which consists of the following columns of data: ISO time; half time interval/s; magnetic field vector (3 components)/nT; magnetic field magnitude/nT; spacecraft position (3 components)/km; instrument range; telemetry mode. The magnetic field components and the spacecraft position are in the GSE coordinate system. An example 5 lines of 5 vectors/s data directly below the CEF-2 header for the cluster 4 spacecraft is shown below. DATA_UNTIL = EOF 2003-02-01T07:00:00.100Z,0.1,9.070,-20.395,2.979,22.519,104287.6,63758.5,1468.6,2,22 2003-02-01T07:00:00.300Z,0.1,8.972,-20.451,2.665,22.491,104287.7,63758.4,1468.4,2,22 2003-02-01T07:00:00.500Z,0.1,8.819,-20.501,2.418,22.448,104287.8,63758.4,1468.2,2,22 2003-02-01T07:00:00.700Z,0.1,8.635,-20.526,2.290,22.386,104287.9,63758.4,1468.0,2,22 2003-02-01T07:00:00.900Z,0.1,8.426,-20.608,2.326,22.385,104288.0,63758.3,1467.8,2,22
$ $ $ $ $
7.3.2 Support Data Products There are several support data products produced for the FGM data which give additional information about the magnetic field data products or about the calibration used to generate the data. There are two data products which give information about data gaps in the FGM data. The first product (Cx CQ FGM GAPF) lists the data gaps that are introduced at the processing stage which may be due to times when no data were taken for instance. The second product (Cx CQ FGM VALF) lists time periods where invalid data have been removed at the data validation stage.
122
J.M. Gloag et al.
Caveat files (Cx CQ FGM CAVF) are produced for periods of data when the calibration is known to be changing on short timescales near eclipses and for other events when visible effects have been observed in the data. Calibration accuracy files (Cx CQ FGM CALA) contain detailed information on the accuracy of the magnetic field data products and can be used to select periods of data which would be particularly good for a certain type of analysis from an accuracy point of view.
7.3.3 Calibration Files The calibration files (Cx CC FGM CALF) contain the nine elements of the 3 3 calibration matrix and the three offsets for each instrument range which are used to transform the FGM data from uncalibrated data in the sensor coordinate system to calibrated data in an orthogonal coordinate system. Each of the calibration files are valid for the period of one orbit and are produced for each spacecraft for every orbit where magnetic field data products have been submitted to the CAA. There are several different calibration analyses that are used to produce these standard orbit calibration files including the use of inter-spacecraft comparisons and which methods are employed at a particular point in time depends on properties of the data that are available at that time.
7.3.4 The Data Production Procedure There are several steps involved with producing the FGM data products. The first and most time intensive step is to determine calibration parameters for every orbit for which data is submitted to the CAA. The procedure for producing these calibration parameters is described in the next section. The next step is to validate the data which is also a time intensive step and is discussed in detail below. The data are then processed from raw data into calibrated data in the GSE coordinate system. In order to do this processing the calibration files are applied to the data and other auxiliary data are used to transform the data into its final form. Finally the data products are submitted to the CAA. Further information on the production and quality control procedures along with further information about the data products can be found in the FGM ICD (Interface Control Document), the newest version of which can be found in the CAA, Lucek et al. [6].
7.3.5 Quality Control for FGM Data Products Submitted to the CAA The outcome of the calibration procedure is one calibration file for each spacecraft for each orbit. However as already outlined some calibration parameters are
7
FGM Data Products in the CAA
123
necessarily derived from periods of data much longer than an orbit, typically of 2 weeks or 1 month. Each calibration method is unable to track changes in calibration parameters that occur on a timescale shorter than the data interval used to estimate the calibration coefficients. If the changes in calibration parameters are large, then the effects will be visible in the final magnetic data product. Therefore FGM calibration analysis does not always result in perfect calibration. The accuracy of the calibration depends on a number of factors including: Data coverage – extensive data gaps can have a strong negative impact on the
calibration. Data characteristics – most corrections to the calibration parameters are small.
Therefore power within the natural signal can make it difficult to identify the correction required to the calibration matrix. Spread of B and jBj within the data – The majority of calibration techniques require measurements over a range of magnetic field magnitudes and directions. A narrow spread in either of these can adversely impact the quality of the calibration. The time over which the calibration is calculated depends on each of these three factors. Poor data coverage might, for example, suggest that using data over a longer period would be helpful. However, all the calibration methods assume that the underlying calibration parameters do not change over the period of data being analysed. If there is a change in calibration parameters during the interval of analysis, then since only a single estimate of the parameters is derived, some part of that period will be less well calibrated. The quality control system for the FGM data products has three parts to it. The first is the validation procedure which is applied to all periods of data which are submitted to the CAA. The validation procedure is based on visual inspection of the 5 vectors/s data product. Semi-automated software searches for possible spikes in the data and these spikes are then visually inspected to determine whether they are invalid data (and therefore removed) or a natural feature. High resolution data may be inspected if the 5 vectors/s data are inconclusive. The start and end times of the periods of invalid data to be removed are recorded using the validation tools and then the data processed to remove these intervals. At this point the validation gap files (VALF) are produced which contain the start and end times for data periods removed at the validation stage. The second aspect of quality control is in the form of caveat files (CAVF). CAVF files are generated for intervals of data when the calibration procedure is compromised, often for one of the reasons listed in the previous section. The signatures of poor calibration at this level are generally either a visible signal at the spacecraft spin frequency, or a spread of magnetic field values between the four spacecraft while they are in a region when we would expect all spacecraft to measure the same average magnetic field. The latter is most commonly seen in the solar wind.
124
J.M. Gloag et al.
Within a CAVF file for a particular spacecraft for a particular interval, the signature of poor calibration, and (where possible) the cause are given. Common reasons for caveats are: 1. Spacecraft eclipses, where the temperature change experienced by the instrument during short or particularly long eclipses can often lead to a small but significant change in calibration parameters during that orbit. This leads to a larger than normal residual spin tone in the data that can be identified at the validation stage. 2. Spacecraft manoeuvres can also cause changes in the calibration parameters, leading to a similar signature as in 1. 3. An unexplained spread in sensor spin axis magnetic field data exceeding 0.25 nT is seen between the four spacecraft. This signature can generally only be seen in the solar wind where the magnetic field magnitude is low, and the magnetic field data are very quiet. This can arise if the spin axis offset changes during the 2 weeks or 1 month over which the spin axis offset calibration method is applied. However, poor data coverage might also influence the accuracy with which the spin axis offset can be estimated. 4. Unexplained instances where higher than normal spin tone is observed. These occur occasionally. Finally the third aspect of the quality control are the Calibration Accuracy files (CALA). CALA files give information on the accuracy of the calibration used to process each data interval. Three different categories of calibration accuracy parameters are recorded for users of the data: The first category is a set of parameters that are derived from the solar wind calibration analysis. Recorded here are the median values of the differences in spin axis magnetic field between all combinations of the four Cluster spacecraft. Also recorded are the standard deviations associated with the differences, calculated for each of the spacecraft combinations. The values are calculated over the period of each solar wind analysis, which is either 2 weeks or a month. The idea behind using these parameters is that after the solar wind analysis has been performed independently for each spacecraft it is expected that the spin axis field measurements from the four spacecraft would lie on top of each other when the spacecraft are in the solar wind. The measured differences in spin axis magnetic field between each spacecraft combination therefore indicates how well this calibration has been performed in a particular region or may indicate if the calibration is changing within a certain period. An example of when you might be interested in these parameters is if a study is being done which uses inter-spacecraft comparisons. The median parameters would give an indication of the accuracy of these inter-spacecraft comparisons in low field regions. The second category of calibration parameters are connected with the calibration analysis performed at range changes. The principal used in this method is that the magnetic field should not change as a result of the instrument changing range. Only a subset of range changes can be used to measure this effect, because the power in the science signal needs to be low enough for the small jump in B associated with the error in calibration parameters to be observed. The parameters
7
FGM Data Products in the CAA
125
recorded in the files are the residual jump in the magnetic field magnitudes for each spacecraft at both range 2-to-3 and 3-to-4 changes after the calibration has been performed. Only the range changes that are selected in the calibration analysis are used here, as data close to other range changes may contain too much natural signal for it to be possible to measure the accuracy parameters. In addition the residual angle deflection in magnetic field after the calibration analysis has been performed is also recorded for range 2-to-3 and 3-to-4 changes. All of these parameters are an average value taken over the period of a month. These parameters are important if analysis is being performed on data in higher field regions where the fluxgate magnetometer is in a higher instrument range. The parameters give an indication of how successful the range change analysis has been in a particular region and therefore an idea of the accuracy of the magnetic field data in the higher ranges. A user of the data can identify times when range changes occur from the primary data products described in Section 7.3.1. As shown in the sample of data at the end of Section 7.3.1 the second to last column of data is the instrument range so when these numbers change from one sample to the next, a range change has occurred. The third category of calibration accuracy parameters are extracted from the Fourier analysis calibration. They comprise of hourly averaged values of the residual first harmonic signal (spin frequency) to noise ratio in the spin axis and spin plane and the residual second harmonic signal (twice spin frequency) to noise ratio in the spin plane after the calibration has been performed. The residual power spectral density after calibration are also recorded for the corresponding first and second harmonic signal to noise ratios. These parameters demonstrate how well the Fourier analysis calibration has been done for a particular orbit or whether the calibration is changing within an orbit. More generally, these calibration accuracy parameters give an indication of how well a particular orbit is calibrated. Factors which influence how well it is possible to calibrate a particular orbit include the data coverage in each instrument range and also the type and level of physical signal in the data which is often connected with the magnetospheric region being encountered at the time. As the Fourier analysis method is applied to every orbit, the hourly averaged calibration accuracy values described above demonstrate how suitable the data available in a particular orbit is for producing a good set of calibration parameters. In addition to these parameters a single score value is also recorded in the calibration accuracy files for each category. The score values are on a scale of 1–4 (1 being the best) and are based on the long-term distributions of each parameter. A score is assigned for a particular period of time by considering in which quartile of the long-term distribution the parameter falls for that period. For each category of parameters an average score value is determined for a period and rounded to the nearest score value. In this way a single score value for each category is determined for each period of time. This simple scoring system makes it possible to run a rough filter on a proposed set of data periods in order to extract which periods are most suitable for a particular type of analysis.
126
J.M. Gloag et al.
0 −90
180
−5 −10
10
By
Bx
0
0
0
10
−10
0
Bz
φ°
360
−10
10
|B|
θ°
90
8 6 01 00
01 10
01 20
01 30
01 40
2006 Feb 07 (038) hour min (UT)
Fig. 7.4 Time series plot showing a typical piece of FGM data in the solar wind submitted to the CAA. We can recognise this data set as well calibrated due to the fact the traces lie directly on top of each other in quiet regions together with the absence of spin tone. The four traces correspond to each of the spacecraft using the conventional Cluster colours (C1 Black, C2 Red, C3 Green and C4 Magenta)
An example of a validated FGM time series plot is shown in Fig. 7.4. The panels correspond to , ', Bx, By, Bz, and jBj with all four spacecraft traces displayed in the traditional Cluster colours. The data is taken from a solar wind interval from the same orbit (863) as that of the spectrograms used in Fig. 7.2 although only 47 min of data are plotted in order to show the fine structure within the time series. We can see that in regions where the background field is smooth the four traces lie on top of each other indicating that the data is well calibrated whereas during sudden field changes the spacecraft traces are not overlaid reflecting the fact that different spacecraft do not encounter the discontinuity at the same time.
7.4 Conclusion This paper gives an introduction to the FGM data products submitted to the CAA along with a description of how the data were produced and an outline of the quality control procedures used to ensure the integrity of the data. This is the first time that such a high quality of calibration has been applied across large multi-spacecraft magnetometer datasets and it has so far resulted in an exceptional magnetic field data set in the CAA. The routinely achieved accuracy level for well calibrated science data in instrument ranges 2, 3 and 4 is between 0.1–0.2 nT in regions where jBj < 200 nT and better than 0.4 nT in regions where jBj > 200 nT. Spin tone may be seen in the data
7
FGM Data Products in the CAA
127
on occasion. This usually indicates a small residual error in the calibration, typically due to calibration drifts occurring on timescales much shorter than that of a single orbit. The highest case of spin tone occurs during perigee pass during passage through maximum jBj, where it may reach up to 0.4 nT. Where it occurs elsewhere during an orbit it will generally be less than 0.1 nT. If an extreme amount of spin tone (i.e. greater than 1 nT) is observed within a period of interest (a given range), a caveat will be produced along with the data that forewarns the user as to the nature of the excessive spin tone. The presence of spin tone in an FGM time series inevitably means its spectrogram will show residual power at spin (0:25 Hz) and twice spin (0:5 Hz) frequencies. Generally speaking if a particular narrow band signal is seen at either of these frequencies, it is likely that it arises from small calibration errors and is not natural in origin. This derives from the fact that it is not possible to distinguish power between natural signal and calibration error at these frequencies. 2 4 p The instrument noise level above 1 Hz is of the order 1 10 nT =Hz.10pT= Hz/. This may be compared with a digital resolution of 7.8 pT in the highest resolution range 2. Highest resolution data in burst mode are primarily designed for use in time series analysis, for example discontinuity analyses at the bow shock or magnetopause. CAA users wishing to study waves in the frequency range above 10 Hz should note that FGM is a DC instrument, and that filters within the instrument will significantly attenuate wave power above this frequency. It is recommended that data from the STAFF instrument be used to analyse waves in this frequency range. The FGM team does not recommend the use of 67 Hz for spectrograms. If a user of the data at a later date is interested in attempting an improvement to a short period of data of particular interest then the only way to achieve this is to develop a good understanding of the in-flight calibration techniques which are used to produce the calibration files. The detailed sections set out in this paper on the different calibration analyses give a good starting point to gaining this calibration knowledge required. Although the details of specific algorithms will need to be looked up in other sources, the sections in this paper contain valuable practical knowledge on implementing the calibration procedures. Acknowledgments We would like to acknowledge the invaluable assistance of the FGM CoIs and FGM CoI teams who have contributed to the calibration effort. We would also like to thank M. Kivelson, K. Khurana and H.K. Schwarzl for their generosity in helping with the implementation at Imperial College of the calibration methods developed at UCLA.
References 1. Balogh A., M. W. Dunlop, S. W. H. Cowley, D. J. Southwood, J. G. Thomlinson and the Cluster magnetometer team: The Cluster magnetic field investigation, Space Sci. Rev., 79, 65, (1997) 2. Balogh A., C. M. Carr, M. H. Acuna, M. W. Dunlop, T. J. Beek, P. Brown, K.-H. Fornacon, E. Georgescu, K.-H. Glassmeier, J. Harris, G. Musmann, T. Oddy, and K. Schwingenschuh: The Cluster Magnetic Field Investigation: Overview of in-flight performance and initial results, Ann. Geophysicae., 19, 1207–1217 (2001)
128
J.M. Gloag et al.
3. Hedgecock, P. C.: A correlation technique for magnetometer zero level determination, Space Sci. Inst., 1, 83–90 (1975) 4. Kepko, E. L., K. K. Khurana, M. G. Kivelson, R. C. Elphic, and C. T. Russell: Accurate determination of magnetic field gradients from four point vector measurements: I. Use of natural constraints on vector data obtained from a single spinning spacecraft, IEEE Transactions on Magnetics, 32, 377–385 (1996) 5. Khurana, K. K., E. L. Kepko, M. G. Kivelson, and R. C. Elphic: Accurate determination of magnetic field gradients from four point vector measurements: II. Use of natural constraints on vector data obtained from four spinning spacecraft, IEEE Transactions on Magnetics, 32, 5193–5205 (1996) 6. Lucek, E. A., J. M. Gloag, A. Balogh, C. Carr, Cluster Active Archive: Interface control document for FGM, http://caa.estec.esa.int/documents/ICD/CAA FGM ICD V40.pdf (2008) 7. Paschmann, G., J.M. Quinn, R.B. Torbert, H. Vaith, C.E. McIlwain, G. Haerendel, O.H. Bauer, T. Bauer, W. Baumjohann, W. Filliius, M. F¨orster, S. Frey, S.S. Kerr, C.A. Kletzing, P. Puhl-Quinn, and E.C. Whipple, The electron drift instrument on Cluster: overview of first results, Ann. Geophysicae, 19, 1273, (2001) 8. Robert, P., A. Roux, C. C. Harvey, M. W. Dunlop, P. W. Daly, and K.-H. Glassmeier: Tetrahedron Geometric Factors. In: Paschmann G. and P. W. Daly (Eds.) Analysis Methods for Multi-Spacecraft Data, pp. 323–348, ISSI, Bern (1998)
Chapter 8
PEACE Data in the Cluster Active Archive A.N. Fazakerley, A.D. Lahiff, R.J. Wilson, I. Rozum, C. Anekallu, M. West, and H. Bacai
Abstract We describe the data products of the Cluster Plasma Electron and Current Experiment (PEACE) instruments which have been produced for the Cluster Active Archive. This article is intended to introduce the PEACE instruments, the measured data and the data products provided through the CAA. We aim to help the researcher to choose the data products most suited to their needs and to avoid inadvertent misuse of the data.
8.1 Introduction The Plasma Electron and Current Experiment (PEACE) measurements of the thermal electron plasma population enable characterisation of the local plasma – its density, bulk flow, electron temperature – and electron pitch angle data reveal whether the local region is magnetically connected to regions of electron acceleration or lies between magnetic mirrors. PEACE electron data reveals whether electron pitch angle or energy scattering processes are active, for example as waveparticle interactions occur. Good quality moments of the electron distribution may also be used to study the contribution of electrons to currents in key regions (e.g., magnetotail current sheet, auroral regions, reconnection sites). The four spacecraft capability allows determination of the three-dimensional motion of plasma boundaries (which may not always have a corresponding magnetic signature) and probing A.N. Fazakerley (), A.D. Lahiff, I. Rozum, C. Anekallu, and H. Bacai Mullard Space Science Laboratory, University College London, UK e-mail:
[email protected] R.J. Wilson Mullard Space Science Laboratory, University College London, UK and Now at Los Alamos National Laboratory, Los Alamos, USA M. West Mullard Space Science Laboratory, University College London, UK and Now at Royal Observatory, Belgium
H. Laakso et al. (eds.), The Cluster Active Archive, Astrophysics and Space Science Proceedings, DOI 10.1007/978-90-481-3499-1 8, c Springer Science+Business Media B.V. 2010
129
130
A.N. Fazakerley et al.
of three dimensional structures such as Flux Transfer Events or the magnetotail plasmasheet, where electrons on neighbouring field lines may have had quite different recent histories. The dataset is key to studies of plasma boundary regions (magnetopause, bowshock, cusp etc.) and how mass, momentum and energy are transferred across them. Each Cluster spacecraft carries an identical PEACE instrument, consisting of two sensors, HEEA and LEEA, and a data processing unit, the DPU. Below, we briefly describe a PEACE instrument and how it works, after which we introduce the Cluster Active Archive PEACE data products. Readers may also be interested in the PEACE Science User Guide available at the CAA website, which complements this paper.
8.2 The Cluster PEACE Instruments 8.2.1 Instrument Description The Low Energy Electron Analyser (LEEA) is designed to specialise in coverage of the very lowest electron energies (<10 eV) but is also capable of covering the full energy range up to 26 keV. LEEA has a geometric factor appropriate for the higher electron fluxes usually found at lower energies (e.g., in the solar wind and magnetosheath). The High Energy Electron Analyser (HEEA) has a larger geometric factor, better suited to the outer magnetosphere, which extends the dynamic range of the instrument. Each sensor usually covers about 70% of the instrument energy range, and the sensors are used together to cover the full range every spacecraft spin. An Inter-Experiment Link (IEL) connects the HEEA sensor to the Digital Wave Processor (DWP) experiment providing detailed timing information about each arriving electron to the Particle Correlator. An IEL between the Fluxgate Magnetometer (FGM) and PEACE is used to share raw magnetic field data, for use in onboard pitch-angle selection. The sensors conform to the Cluster II specification (Fazakerley et al., manuscript in preparation, 2009) which is similar to the Cluster I specification [1], except that the sensor anodes were modified to delete the fine angular resolution capability and the MCP resistivity was altered, in both cases to improve performance under high electron fluxes. 8.2.1.1 The Electrostatic Analysers Each sensor consists of a “Top Hat” Electrostatic Analyser with an annular microchannel plate chevron pair (MCP) and segmented anode to provide position sensitive detection of arriving electrons, together with a supporting Sensor Electronics Unit. Figure 8.1 illustrates the operating principle of the PEACE electrostatic analyser. Each PEACE analyser is mounted with its field of view fan lying perpendicular
8
PEACE Data in the Cluster Active Archive
131
Fig. 8.1 Illustration of the principle of the PEACE Top Hat electrostatic analyser. The voltage applied to the analyser hemispheres diverts electrons (shown in blue) of a specific narrow band of energy and arriving within the acceptance angle ‰ through the analyser to the detector, while electrons of other energies (e.g., in red) strike one of the analyser hemispheres and are not detected. The semi-annular microchannel plate amplifies the signal of an electron reaching it, and the resulting charge cloud is detected by one of 12 segments of the anode beneath, giving information about the electron arrival direction ™. The Top Hat design is able to provide a focussed spot in the detector plane for a parallel electron beam arriving from anywhere in the aperture plane. At times when the aperture looks sunward, the majority of photons (black wiggly arrow) pass through the aperture and do not find their way to the detector
rather than tangential to the spacecraft surface, as shown in Fig. 8.2, in order to minimise the entry into the aperture of photoelectrons and secondary electrons from the local spacecraft surface. Consequently, each sensor has a 180ı field of view. The two sensors are mounted on opposite sides of the spacecraft thus their combined field of view is 360ı (though they may not always be sampling the same energy at the same time). In combination, the two sensors view the complete 4 solid angular range during each half rotation of the spacecraft. Figure 8.2 shows the direction from which electrons arrive to be counted on anodes 0 to 11.
8.2.1.2 The Data Accumulation Time Interval and the PEACE Spin The basic measurement made by PEACE is the number of counted electrons per accumulation time. The satellite spin period, Tspin , is subdivided into 1,024 equal parts, of duration Tacc , the accumulation time. For a nominal 4 s spin, Tacc 3:9 ms. The start of a PEACE spin occurs on reception of a rephased sun pulse. PEACE azimuth angles in the spinning frame are defined with 0ı as the LEEA look direction at that time. The rephase angle can be changed on command. It is used to minimise measurements of solar UV generated photoelectrons when the sensor apertures look sunwards. The rephase angle used during early operations was modified in August 2003 in order to better correspond to the CSDS spin definition.
132
A.N. Fazakerley et al. Zb Yb
30° Spin
LEEA
HEEA
10 11 8
9 Xb
7 6 5 4 3 2 1
0
Fig. 8.2 The physical deployment of the sensors on the spacecraft. The spacecraft body coordinate system is shown .Xb , Yb , Zb ). The sensor numbering with respect to the spin axis is indicated, e.g., zone 0 looks towards –Xb , and sees electrons with velocities along the spin axis direction, CXb . In orbit the spacecraft spin axes are maintained roughly anti-parallel to the GSE Z axis
8.2.1.3 Energy and Solid Angle Coverage, and Resolution The energy range of the instrument is nominally from 0.6 to 26,460 eV. The Sensors can each make measurements at 88 distinct non-zero levels. The first 16 energy levels are equally spaced linearly in the range from 0.6 to 9.5 eV. Levels 16 to 87 inclusive are equally spaced logarithmically over the rest of the range. In normal operation, an energy sweep, during which the energy is continuously varied from a high to a low level, over a time interval Tsweep , is repeated 16, 32 or 64 times per spin, depending on the selected sweep mode (LAR, MAR or HAR). During a sweep, the measured energy is reduced by one “step” from energy level n to level n–1 in sweep mode LAR or else by two “steps” from energy level n to level n–2 in sweep modes MAR and HAR, during each measurement period Tacc . A complete sweep also has a “flyback” component, during which the sweep HV is returned to the high value needed at the start of the next measurement sweep. Sweep characteristics such as the energy range coverage, flyback and sweep duration, are shown in Table 8.1. The energy sweeps, including the flybacks, are illustrated in Fig. 8.3. During the satellite spin period the satellite rotates through 360ı . The angle of rotation between two measurements at the same energy is called the azimuth angle resolution, and is given by 360ı Tsweep =Tspin . The azimuthal angle
8
PEACE Data in the Cluster Active Archive
133
Table 8.1 Properties of the Energy Sweep Modes: LAR, MAR and HAR. Note that MAR is the most frequently used energy sweep mode Energy Polar Azimuth Energy Polar Azimuth Flyback Energy resolution resolution resolution samples samples samples samples coverage LAR 1 step /bin 15ı 22:5ı 60 bin 12 bin 16 bin 4 bins 60 step ı MAR 2 step /bin 15 11:25ı 30 bin 12 bin 32 bin 2 bins 60 step HAR 2 step /bin 15ı 5:625ı 15 bin 12 bin 64 bin 1 bin 30 step
Fig. 8.3 The pattern of the energy sweeps in each of the three sweep modes (flybacks shaded)
resolutions vary with sweep mode as shown in Table 8.1; thus the sweep mode names LAR/MAR/HAR refer to Low/Medium/High Angular Resolution. The azimuthal acceptance angle (i.e., ‰ in Fig. 8.1) is 5ı for HEEA and 3ı for LEEA. The look direction rotates through only 0:35ı of azimuth angle during Tacc . A related useful concept is the “basic sector” which has duration 64 Tacc . Each spin contains 16 basic sectors. The basic sector contains 1 sweep in LAR, 2 sweeps in MAR or 4 sweeps in HAR sweep mode. The 180ı detector field of view is divided up into 12 equal parts of angular width 15ı as illustrated in Figs. 8.1 and 8.2. Measurements are made simultaneously in each of these 12 “polar zones”. In any sweep mode, a single PEACE sensor measures 11,520 values per spin (e.g., in MAR 30 energy 32 azimuth 12 polar) which we call 3DX.
134
A.N. Fazakerley et al.
8.2.2 How PEACE Science Data Is Generated and Transmitted The DPU is able to produce a full resolution three dimensional (3-D) data product (3DX) from one or both sensors. However, these are too large to be transmitted at a rate of one every spin. Therefore, to achieve good temporal coverage, it is necessary to create reduced resolution data products onboard (i.e., in the PEACE DPU) which can be transmitted within the available normal mode telemetry (NM) or burst mode telemetry (BM). Uncompressed 3DX data is sometimes transmitted, albeit at a slow rate, e.g., to support in-flight calibration or other instrument tests. The most compressed set of information is the “onboard moments sums dataset” (OMS), from which electron moments may be calculated after transmission to the ground. The next most compressed dataset is the “onboard selected pitch angle data” (PAD). Here, the reduction in data volume is achieved by sending the bare minimum of solid angle information needed to reconstruct the pitch angle distribution for a single gyrophase. A third compressed dataset (LER) focuses on the lowest energy part of the low energy sensor’s coverage. These data products have been sized to be available every spin for both NM and BM (though for LER on C2 the rate is sometimes slightly lower; see Section 8.4.2.1). The remaining transmitted science datasets are various forms of 3-D data. The most commonly available is 3DR (3DX compressed 8) which is used onboard as the basis for calculation of the onboard moment sums. During BM intervals, 3DXP (3DX compressed 2) is often used, though this is further compressed on spacecraft C1 and C3 by slightly reducing energy coverage (discussed in more detail below). The rate at which these products are transmitted using standard NM and BM is shown in Table 8.2. For most of the mission, spacecraft telemetry capacity which was not being used by out-of-commission instruments (CIS on C2 and EDI sensor on C4) has been made available to PEACE. The enhanced NM has allowed routine transmission of 3DR every spin on C2, and every 3 spins (or so) on C4. The enhanced BM enables the transmission of full energy range 3DXP data from both sensors every spin, on both C2 and C4.
Table 8.2 Rate of transmission of the main scientifically relevant data products. Table shows the number of spins needed to transmit a data product. NM1 and BM1 refer to enhanced data rates available on C2 since 25 November 2001 and on C4 since 21 March 2002. From July 2003 to June 2004, the C2 BM rate fell to that of C4 BM on some orbits (TM sharing with RAPID). Note that on C2, a slightly enhanced NM was initially available from 16 January 2001 Data NM1 NM1 BM1 BM1 OMS, PAD 1 1 1 1 3DR 40 C2: 1 C4: 3 1 (one sensor) Not sent 3DXP 1 (other sensor) 1(both sensors) 3DX (H&L) 315 C2: 9 C4: 31 5 3
8
PEACE Data in the Cluster Active Archive
135
8.2.3 PEACE Instrument Status At the time of writing (summer 2008) all four PEACE instruments are working well during their eighth year of science operations. The only hardware failure of any kind is the loss of information from the Cluster 3 PEACE HEEA anode 2 since August 22 2005, i.e., data is not available from one of the 12 anodes in one of the eight PEACE sensors. The consequences are a loss of accuracy in moments generated with data from that sensor and incomplete pitch angle distributions from that sensor when the magnetic field is within 30ı of the spin axis direction. Consequently, in-flight calibration of the remaining anodes is also more difficult.
8.3 The CAA PEACE Science Data Products This section describes the CAA science data products that we expect a typical scientist to be interested in working with. Many of the data files have a suffix H for HEEA or L for LEEA. The 3-D and 2-D data products have some elements in the energy matrix which do not relate to measured energy. These relate to the HV sweep flyback and are used in the files to allow proper representation of the timeline of events during each spin. The 3-D and 2-D data products contain the measured quantity (i.e., count rate, differential number flux, differential energy flux or phase space density) in a suitable array, and also contain a reference “background noise” level quantity, based on a rate of 1/8th count per accumulation bin time interval derived experimentally in flight. In the case of pitch angle data, it is essential to provide “background” data for every record, as the anode which corresponds to a given pitch angle may change frequently in a non-steady magnetic field, and different anodes have different calibrations. There is an additional background signature associated with the spin phase at which the aperture faces the Sun, but this is not included at the time of writing.
8.3.1 Three Dimensional Distribution Data A variety of 3-D data products are produced by PEACE, but only one, 3DR, is routinely produced. These differ only in the degree of data decimation, which is tailored to the telemetry rate available at the time of data collection in orbit (see Table 8.2). The 3-D data is provided in different combinations of energy, azimuth and polar bins for different sweep modes (except for 3DR). We use one file per data product to contain the commonly used MAR and HAR sweep mode data, and another file structure for the less frequently available LAR sweep mode data. The approach is a compromise between having many different types of file (e.g., one per sweep mode per 3-D data product) and a one-size-fits-all file structure which would require very large files, which are very sparsely populated.
136
A.N. Fazakerley et al.
8.3.1.1 Standard Reduced Resolution 3-D Data (3DR) As noted above, 3DR is compressed by a factor 8 relative to 3DX. Unlike the other 3-D data files, the 3DR files have a standard size independent of sweep mode (see Table 8.3). In all sweep modes, adjacent pairs of 3DX polar bins are added together. The energy/azimuth compression depends on sweep mode: consecutive groups of four energy bins are summed for LAR; consecutive groups of four azimuth bins are summed for HAR; pairs of energy bins and pairs of azimuth bins are summed for MAR. The “flyback” information is correspondingly merged. The rate of 3DR data transmission varies with spacecraft and telemetry mode (see Table 8.2). Occasionally, 3DR is transmitted for only one sensor, and thus there may not always be both 3DRL and 3DRH files. While 3DR is the default 3-D product, less compressed 3-D data is often sent during BM intervals. These 3DX or 3DXP data have been used in ground data processing to make corresponding 3DR data files, in order to give continuity of 3DR file coverage at the request of the CAA. When the source 3DXP file has reduced energy coverage (see below) the corresponding 3DR will have only 13 as opposed to all 15 energy bins.
Table 8.3 This table shows the organization of data in 3-D data files. Fill factors are never 100%, as space allocated to flybacks holds fill values. The 3DX spin data record is sized to hold both MAR and HAR mode data, using 32 MAR energy and flyback bins and 64 HAR azimuth bins, for each of the 12 polar zones; hence 3DX files are roughly half filled with data. The same principle applies to 3DXP and 3DXPA, although in these cases only six polar zones (each 30ı wide) are applicable, and for 3DXPA fewer azimuths are relevant as explained in the text. The LAR files are separate as (a) LAR is rarely used and (b) a file able to hold data from all sweep modes would have a fill factor of only 23.4% CAA data Sweep Flyback Energy Azimuth Polar Data Fill factor product mode bins bins bins bins bins/spin (%) Reduced energy/polar/azimuth resolution (/8) 3DR H/M/LAR 1 15 16 6 1,440 94 Full resolution 3DX MAR 2 30 32 12 11,520 47 3DX HAR 1 15 64 12 11,520 47 3DXLAR LAR 4 60 16 12 11,520 94 Reduced polar resolution (/2) 3DXP MAR 2 30 32 6 5,760 47 3DXP HAR 1 15 64 6 5,760 47 3DXPLAR LAR 4 60 16 6 5,760 94 Reduced azimuth coverage, and reduced polar resolution (/2) 3DXPA MAR 2 30 4 6 720 47 3DXPA HAR 1 15 8 6 720 47 3DXPALAR LAR 4 60 2 6 720 94
8
PEACE Data in the Cluster Active Archive
137
8.3.1.2 Flexible Reduced Polar Resolution 3-D Data (3DXP, 3DXPLAR) The 3DXP data are compressed from 3DX by adding pairs of polar bins together (see Table 8.3). While such data is well sized to be sent every spin from both sensors in BM on C2 and C4, it is too large to be sent every spin from one sensor only with 3DR from the other sensor, on C1 and C3. In this case, to maintain a spin rate data stream, some energy coverage is sacrificed and a 2/15th subset of the measured energy range is discarded from either the top or bottom of the range. Fill values replace the data in the CAA files. 8.3.1.3 Full Resolution 3-D Distributions (3DX, 3DXLAR) The CAA 3DX data files are used for full resolution 3-D data, and also (rarely) for transmitted “summed energy” data which has been compressed onboard by adding pairs of energy bins together. The use of separate files for 3DX and 3DXP data is more efficient in terms of file size than using 3DX for both. 8.3.1.4 Partial Azimuth Content 3-D Data (3DXPA, 3DXPALAR) The 3DXPA data are a subset of 3DX, produced by reducing angular coverage rather than resolution. The files contain only two basic sectors, 180ı apart and each spanning 22:5ı in azimuth, selected to contain the magnetic field direction as determined onboard. If these data were provided in the 3DX (or 3DXLAR) files, 7/8ths of the file would be empty, so it is more efficient to provide a dedicated alternative file. Such data is available relatively rarely. It is regarded as an enhanced form of PAD.
8.3.2 Pitch Angle Distribution Data The PEACE DPU produces “onboard selected pitch angle data” (PAD) designed to use the minimum possible telemetry (see Section 8.4.1.1). As a result, these data are inconveniently formatted from the point of view of a scientific user, and may not always capture the full pitch angle range. For scientific use, the PEACE team provides pitch angle data to the CAA in a family of PITCH data files, which are more userfriendly and which incorporate corrected (“rebinned”) pitch angle data. The data are given in scientific units and are in the spacecraft frame, rather than the plasma rest frame. Some characteristics of these PITCH data products are summarized in Table 8.4, and they are discussed in more detail below. 8.3.2.1 Standard Spin Rate Pitch Angle Data (PITCH SPIN) The recommended CAA pitch angle product for routine use is PITCH SPIN. The data are derived from PAD data (see Section 8.4.1.1) which has been rebinned
138
A.N. Fazakerley et al.
Table 8.4 This table illustrates how data is organized in the PITCH family of data files. PITCH SPIN has no sub-spin timing, and so no azimuth/flyback information. It uses data from both sensors and caters for all three sweep modes. The PITCH SPIN data record is sized to hold up to 44 energy bins, and 12 pitch angle bins. The fill factor depends on the sweep modes and energy coverage of both sensors. PITCH FULL also caters for all three sweep modes. The PITCH FULL data record is sized to hold up to 32 energy and flyback bins, and 12 pitch angle bins, for each of the two sensors, all of this for each of two azimuths per spin. PITCH 3DR, PITCH 3DX and PITCH 3DXLAR files are for single sensor data only, and have similar structure to 3DR, 3DX and 3DXLAR files except that 12 pitch angles replaces the polar zones. Pitch angle data from 3DXP and 3DXPA is provided in the PITCH 3DX files Flyback Energy Azimuth P.A. Data Max. fill CAA data product Sweep mode bins bins bins bins bins/spin factor (%) Pitch angle data from both sensors, merged in one record, for each spin (2-D) PITCH SPIN MAR–MAR 44 12 528 100 PITCH SPIN HAR–HAR 30 12 360 68 PITCH SPIN LAR–LAR 44 12 528 100 Pitch angle snapshots, both sensors, two two-sensor records, for each spin (2-D) PITCH FULL MAR–MAR 2 30 2 12 720 94 PITCH FULL HAR–HAR 2 15 2 12 360 47 PITCH FULL LAR–LAR 2 30 2 12 720 94 Pitch angle information, one sensor, determined for every energy-azimuth sweep (3-D) PITCH 3DR Any 1 15 16 12 3,072 94 PITCH 3DX MAR 2 30 32 12 11,520 47 PITCH 3DX HAR 1 15 64 12 11,520 47 PITCH 3DX LAR LAR 4 60 16 12 11,520 94 PITCH 3DXPA MAR 2 30 4 12 1,440 47 PITCH 3DXPA HAR 1 15 8 12 1,440 47 PITCH 3DXPA LAR LAR 4 60 2 12 1,440 94
using ground calibrated magnetic field data, using FGM team software and daily calibration files (not the CAA FGM data, at the time of writing). PITCH SPIN is usually available every spin, except during weekly MCP tests (see Section 8.4.2.2). PITCH SPIN contains merged data from both the HEEA and LEEA sensors. It is a two dimensional product, with twelve 15ı pitch angle bins (covering 0ı to 180ı pitch angle) and 44 energy bins (sufficient to cover the full instrument energy range). The energy bin boundaries can be defined on a spin by spin basis. This enables efficient packaging of all data collected in all three sweep modes. At energies and pitch angles measured by both HEEA and LEEA, the average of the measured values from the two sensors is used. The data is provided in spin records, with no sub-spin timing information. Full pitch angle coverage is only possible if the magnetic field are slowly varying compared to the spin period. This condition is not always met, and the user is encouraged to check for such cases by plotting the Status PADSelectionQuality parameters together with the PITCH SPIN data.
8
PEACE Data in the Cluster Active Archive
139
8.3.2.2 Full Time Resolution Pitch Angle Data (PITCH FULL) The PITCH FULL product is designed to provide the rebinned PAD data at sub-spin time resolution from both the HEEA and LEEA sensors. This can be useful in a rapidly changing plasma environment. In effect, the electron data is collected as two-dimensional pitch angle snapshots, of duration an energy sweep (or two sweeps in HAR mode), collected twice within each spin, as illustrated in Fig. 8.4. The PITCH FULL data for each sensor is organized by pitch angle and energy, and azimuth angle to provide sub-spin timing information. The data can be conceptually divided up into up to four energy regions (top, bottom, HEEA overlap and LEEA overlap). For any given snapshot, part of the pitch angle coverage will be provided by LEEA while the remaining part is provided by HEEA (see Fig. 8.4), so that pitch angle coverage will only be complete in the sensor energy overlap region. A PITCH FULL snapshot has, for each sensor, twelve 15ı pitch angle bins (covering 0ı to 180ı pitch angle) and 32 energy bins, though usually the energy-pitch angle matrix for a given sensor will only be partially filled with data, for the reasons given above. The data in a single snapshot record from one sensor has an azimuth value 180ı apart from that of the other sensor. There are two snapshot records per spin, at azimuths which are 180ı apart. The snapshot azimuth angles may vary from spin to spin as the magnetic field direction varies. The leading energy bins are flyback related and contain fill values, which are useful in establishing accurate timing within the spin. As with PITCH SPIN, the energy bin boundaries can be redefined in the metadata from spin to spin, enabling efficient packaging of all data collected in all three sweep modes. The use of 32 energy bins is sufficient to cover the full energy range used by a single sensor.
Fig. 8.4 Illustration of onboard selected pitch angle data collection. The figure shows which polar zones (shaded) are selected for transmission. These are selected only for the azimuths containing the magnetic field direction
140
A.N. Fazakerley et al.
8.3.2.3 Pitch Angle Data from 3-D Data (PITCH 3DR, PITCH 3DX, PITCH 3DXLAR, PITCH 3DXA, 3DXA LAR) The PITCH 3D products are expected to sometimes be of interest in rapidly varying plasma environments, and are provided as a complement to PITCH FULL. The advantage of PITCH 3D data is that they contain pitch angle data collected throughout a spin, in contrast to PITCH SPIN and PITCH FULL which provide only a 2-D cut through the distribution. Thus PITCH 3D products may show pitch angle information at specific times of interest, including times not sampled in PITCH FULL. Such data may sometimes be useful, even if only a restricted pitch angle range is available. Also, under conditions of rapidly varying magnetic field or plasma environment, it may be that only the PITCH 3D products contain the 0ı and 180ı pitch angle, as in such cases the onboard pitch angle selection may have been unsuccessful (so that PAD and hence PITCH SPIN and PITCH FULL, do not contain these pitch angles). The disadvantage of PITCH 3D are that a separate file is needed for each sensor and that if we use only one file to contain any possible type of 3D data it will always be large and usually only sparsely populated. In order to avoid providing many very large sparsely filled files, it was decided to provide a separate files for PITCH 3DR, PITCH 3DX and PITCH 3DXPA, and for the rarely used LAR mode, additional files for PITCH 3DXLAR and PITCH 3DXPALAR. PITCH 3DR is the smallest and is required most often as 3DR is the most commonly available 3D product. PITCH 3DX is required usually only for BM telemetry intervals. It is associated with 3DX and 3DXP data. PITCH 3DXPA is only needed in rare cases when 3DXPA is available. These PITCH 3D products will often have poorer pitch angle and energy resolution than PITCH SPIN and PITCH FULL. The energy resolution will be highest when the parent data is 3DXLAR or 3DXPALAR. The energy and pitch angle resolution are most reduced for PITCH 3DR.
8.3.3 Electron Moments Data The CAA provides the CSDS Prime Parameter data (see Section 8.3.3.2) which have some inherent limitations and the MOMENTS data (see Section 8.3.3.1) which offer the highest quality moments, though not always at spin rate. 8.3.3.1 Moments from 3-D Data (MOMENTS) The CAA “Moments” data are electron density, velocity vector, pressure tensor and heat flux vector. The vectors and tensors are provided in GSE coordinates. Velocity and temperature are also provided as components perpendicular and parallel to the magnetic field (where the magnetic field data is taken from CSDS FGM PP data, at present). In particular, T? and Tjj are determined by projecting the pressure tensor
8
PEACE Data in the Cluster Active Archive
141
along the magnetic field and dividing by the density and by Boltzmann’s constant. T? is the average of the two perpendicular components. Similarly, vjj D .v:b/b and v? D v .v:b/b. where v is the velocity vector and b is the magnetic field unit vector. Supporting information on data quality is provided (see Section 8.5). These data are produced on the ground (as opposed to onboard the spacecraft), using 3-D data and thus are available at time resolutions which are limited by the rate at which 3-D data can be transmitted (see Section 8.2.2). The data source used to generate the moments is always the best available resolution 3-D data. Choices on the best way to combine data from the two sensors can be made in the moments production software; in the first release the moments are made using LEEA data in the energy overlap region. The spin rate C2 electron moments can be a useful substitute for ion moments that are lacking due to the non-availability of C2 CIS data. The advantage of these ground-calculated moments is that the best available calibration data is used, a correction can be made for the spacecraft potential, and spacecraft electrons can be properly removed. The current release has been generated automatically using default values to control the approach to potential correction and photoelectron removal, and has not been systematically humanvalidated, so some errors may exist. Specifically, the spacecraft potential is set to be 1 V greater than the measured probe-spacecraft potential provided by the electric field experiment (EFW) and the lower energy cutoff for the moments integration is set to reject the energy bin containing the EFW potential and the one above that (which in practice may contain counts due to spacecraft electrons). A further release is likely, pending improved calibrations. Moments production software will be provided by the PEACE team, via the CAA, to allow scientists to calculate their own moments, if they wish, for example using a subset of the measured energies and polar zones. 8.3.3.2 Prime Parameters The Cluster Science Data System (CSDS) Prime Parameter (PP) data are provided by the CAA. PEACE PP data are produced at MSSL and sent to the UK CSDS data centre, from where the CAA collects them. The data are derived from the onboard moment sums (see Section 8.4.1.2), which are converted to electron moments data (density, velocity, perpendicular and parallel temperature, parallel heat flux). The PP data are provided in the GSE coordinate system. Geometric factor updates based on in-flight calibration are used to correct for errors due to the less up-to-date onboard calibrations. However, difficulties with onboard inter-anode calibration cannot be corrected during ground data processing, which may lead to errors in the spin axis component of velocity. It is not possible within the PEACE DPU, or late on the ground) to make corrections for the acceleration of plasma electrons due to the spacecraft-plasma potential. Fortunately, this does not introduce significant error in all plasma environments, only those such as the solar wind where the energy gained by electrons due to the spacecraft potential is not negligible compared to the mean measured energy of the
142
A.N. Fazakerley et al.
distribution. The data are not corrected for possible interference from WHISPER, EDI or EFW. It is recommended that the CAA Moments data (and not the PP data) are preferred for science analysis, despite the reduced time resolution in some cases, and that use of the PP data is only made after careful consideration of their limitations.
8.4 Other Data Products 8.4.1 Pre-science Data Here we very briefly discuss the data products produced onboard which are the basis for scientifically useful products discussed above. More detail is available in the Interface Control Document [2].
8.4.1.1 Onboard Selected Pitch Angle Data (PAD) The routinely transmitted, “onboard selected pitch angle” product is provided to the CAA as PADHAR, PADLAR and PADMAR files. PAD data is sent routinely in both NM and BM intervals, with few exceptions. The magnetic field direction estimate used to select these data onboard is usually based on a single vector extracted at the start of each spin from the data stream provided by the Inter-Experiment Link from FGM. The vector is applied after being corrected onboard using uplinked values of the estimated magnetometer offset calibrations. On rare occasions this onboard data link gave corrupted data; for Cluster 2 this occurred in 2002 between 05–30 April and between 02–24 May. The data are organized as indicated in Table 8.5. The selected azimuths look parallel and anti-parallel to the (onboard determined) magnetic field. The selected polar zones are from these azimuths, and are chosen as shown in Fig. 8.4. The PAD data product usually contains both HEEA and LEEA data. From 2007, in cases when HEEA is turned off, LEEA data may be returned for the key azimuths from all polar zones, each half spin.
Table 8.5 This table illustrates the way that the data is organized in the PAD data files. In LAR mode, only 50% of the energy bins and flyback bins are transmitted each spin; these are the even numbered bins on one spin and the odd numbered bins on the next. For the special case of LEEA only PAD, used sometimes from 2007, all 24 polar bins in a spin contain data Polar bins DPU data Sweep Flyback Energy Azimuth Polar bins second product mode bins bins bins first half spin half spin PAD MAR 2 30 2 n 13-n PAD HAR 1 15 4 n 13-n PAD LAR 2 30 2 n 13-n
8
PEACE Data in the Cluster Active Archive
143
8.4.1.2 Onboard Moments Sums (OMS) Onboard moment sums data are sent routinely in both Normal Mode and Burst Mode spacecraft telemetry operations. Data that will be used to calculate the parameters mentioned in Section 8.3.3.2 are calculated onboard from 3DR data, for the Top and Bottom energy regions once per spin, and the Overlap regions for each sensor, twice a spin. Data from energies below 10 eV are excluded, on the assumption that they contain spacecraft electrons. In practice, spacecraft electrons may be measured above 10 eV. Then, the partial density in the Bottom region and sometimes in the Overlap regions will be overestimated. Users may check for this by viewing energy spectra.
8.4.2 Diagnostic Data These data may not interest the typical scientist, but are provided to the CAA for completeness. 8.4.2.1 LER The LER data product contains data from only one sensor, usually LEEA. It is a reduced 3-D distribution designed to enable estimation of spacecraft-plasma potential using PEACE spectra (provided the potential lies within the LER energy range). LER contains only the lowest 16 LAR bins, or 8 MAR/HAR bins. Polar data is summed in sets of four bins, so that three LER polar bins cover 180ı . Only a subset of evenly spaced azimuths are transmitted each spin. Neighbouring azimuths are sent on successive spins, in a cycle that has eight steps before all azimuths have been transmitted in MAR and HAR mode, or four steps in LAR mode. LER data is usually sent routinely in both NM and BM, though on C2, from 25 November 2001, LER is sent less often, ensuring spin rate 3DR. The LER label refers to fact that this data product contains only the “low energy, reduced” part of the distribution. 8.4.2.2 NOI The NOI data product is used during routine weekly MCP operational level tests, to capture anode-by-anode responses to changing MCP voltages. It is transmitted in place of PAD data. NOI always contains both HEEA and LEEA data (LEEA appear first). All energy bins are summed together. Azimuth bins are summed as for 3DR to provide 16 equal azimuth sectors. The “NOI” label is an abbreviation of “noise”, since this product was first used during ground testing, to monitor MCP count rates vs. anode.
144
A.N. Fazakerley et al.
8.5 Caveats and Status Information Our approach to assisting the user in avoiding pitfalls when working with PEACE data centres on provision of detailed spin by spin status information. Examples include warnings of saturation of the HEEA sensor in strong fluxes (leading to under-counting) and warnings of occasions when the PAD selection has erred (e.g., in rapidly changing magnetic fields) which should aid interpretation of PITCH
products. To aid interpretation of moments data, warnings about incomplete energy coverage of the measured distribution, or suspected coverage of more than one plasma population are provided. Full details are given in the Interface Control Document [2], available at the CAA website.
8.6 Summary Our article has briefly introduced the PEACE instruments, the measured data and the data products provided through the CAA. We hope that together with the Status information in the CAA files, and documentation at the CAA website, this paper will help the researcher to understand what the PEACE data offers, and how to work effectively with PEACE data. In addition to moments software, the PEACE team is providing a simple tool (plotcf) via CAA which facilitates quick plotting of PEACE and other CAA data. Acknowledgments The authors thank ESA and STFC for funding, and also gratefully acknowledge the excellent work of the engineers and scientists who conceived, built and are operating the PEACE instruments.
References 1. Johnstone A.D., C. Alsop, S. Burge, P.J. Carter, A.J. Coates, A.J. Coker, A.N. Fazakerley, M. Grande, R.A. Gowen, C. Gurgiolo, B.K. Hancock, B. Narheim, A. Preece, P.H. Sheather, J.D. Winningham, and R.D. Woodliffe, Peace: A Plasma Electron and Current Experiment, Space Sci. Rev. 79, pp. 351–398, 1997. 2. Fazakerley A.N, A.D. Lahiff, R.J. Wilson, M.G.G.T. Taylor, CAA Interface Control Document for PEA, CAA-PEA-ICD-0001, v5, 2008 (http://caa.estec.esa.int/caa/documentation.xml).
Chapter 9
RAPID Products at the Cluster Active Archive Patrick W. Daly and Elena A. Kronberg
Abstract The RAPID instrument on board the four Cluster spacecraft delivers 3-D distributions of energetic (&30 keV) ion and electron flux for up to eight energy channels. To make this data set available to the general scientific community, both during the operations phase and beyond the end of the mission, the RAPID Team is delivering processed data to the Cluster Active Archive (CAA). These data consist of both fluxes generated with the best current calibrations available, as well as raw count rates for knowledgeable users. Diagnostic products, caveats, documentation, and summary plots are also part of the deliverables. The intention is that once the Cluster Mission is completed and the instrument teams disbanded, this will be the sole repository of all available RAPID data and knowledge about it. This article gives an overview of the RAPID data products at CAA, and is intended to summarize the more complete description given in the Interface Control Document.
9.1 Introduction The RAPID experiment (Research with Adaptive Particle Imaging Detectors) on board Cluster measures 3-D energetic electron and ion fluxes in the energy range above 30 keV. Since the raw data delivered by the instrument are of no use without detailed knowledge of their construction, functioning, calibrations, and limitations, it is essential that the RAPID Team process this initial data set into usable, physical parameters, and make them available to the scientific community. This has been done for a restricted subset of the data by means of the Cluster Science Data System (CSDS at http://sci2.estec.esa.nl/cluster/csds/csds.html). Also, the RAPID community has had access through the Principal Investigator to the entire data set in a special format developed only for this purpose. With the Cluster Active Archive (CAA), a mechanism has been created to make the entire data set from all
P.W. Daly () and E.A. Kronberg Max Planck Institute for Solar System Research, 37191 Katlenburg-Lindau, Germany e-mail:
[email protected];
[email protected]
H. Laakso et al. (eds.), The Cluster Active Archive, Astrophysics and Space Science Proceedings, DOI 10.1007/978-90-481-3499-1 9, c Springer Science+Business Media B.V. 2010
145
146
P.W. Daly and E.A. Kronberg
11 instruments available to all users in a standardized format, known as Cluster Exchange Format (CEF) [1]. Furthermore, a uniform set of metadata [4] has been defined, based on that of CSDS but further extended. The metadata allow data sets to be “self-describing”, essential for analysis and plotting tools that process them. We are in the process of delivering all RAPID data to CAA, both in the form of physical parameters (particle flux) and raw data (count rates) as well as diagnostic products such as housekeeping data and caveats. As CAA is an active archive, it is envisaged that redeliveries will take place, due to improved calibrations and additional or altered data products. This indeed is happening with RAPID. In the rest of this article, we describe briefly the RAPID instrument, then the data as obtained from the instrument (the base products), and finally the products as they are to be found at CAA. The complete description of the RAPID CAA data products is given in the Interface Control Document [3] (hereafter referred to as ICD). A brief description (of the initial release) has been given by Daly and M¨uhlbachler [2]. What is presented here is intended as a more detailed overview of the current situation.
9.2 The RAPID Instrument A complete technical description of the RAPID instrument has been given by Wilken et al. [5]; here we present a brief summary to aid understanding of the nature and structure of the data products. RAPID contains two independent detections systems, IES (Imaging Electron Spectrometer) for electrons, and IIMS (Imaging Ion Mass Spectrometer) for ions. Each of these consists of three detector heads, each covering an opening of 60ı acceptance angle (Fig. 9.1). Altogether, the instrument is sensitive to incoming particles within one half-plane containing the spin axis (Fig. 9.2).
Time-of-flight measurement Start Stop
Incoming Ion 15∞
Incoming Electrons
3 Microstrip solid-state detectors Energy and direction
15∞
15∞
Energy measurement in solid-state detectors
15∞
Collimators
Fig. 9.1 Schematic of a single detector heads for IES (left) and IIMS (right)
9
RAPID Products at the Cluster Active Archive IIMS 0
IES
4
3 2
8 3
1
9
5 6
4
0
10 5
7 8
6
9
Spin
4
7 2
3
10
5
6 1
8 Spin
7
in Sp
0
1 2
11
147
15
11 12
13
14
RAPID at 60.167 deg from Sun at start of Spin Sun Sensor Offset = 26.367 deg
Fig. 9.2 The IIMS and IES polar segments relative to the spin axis (left and center) and the RAPID sectorization relative to the sun (right)
9.2.1 Electrons One of the three IES detector heads is shown in the left side of Fig. 9.1. Each functions as a pin-hole camera, with three microstrip detectors to locate the incoming particles to within 20ı . Not shown is a foil between the pin-hole aperture and detectors that removes any ions up to 350 keV. A single head covers an acceptance angle of 60ı in all; a total of three heads span the entire range of 180ı with 9 “pixels” (middle of Fig. 9.2) in one half-plane. During one spacecraft spin (4 s), this plane rotate through 360ı, during which time, 16 measurements are made; one speaks of 16 spin sectors which are synchronized to the sun (right side of Fig. 9.2). A 3-D distribution thus consists of 9 polar 16 azimuth directions. The 3rd dimension, energy, is determined by the charge deposited in the detector by the absorbed electron, which is proportional to that energy (minus a constant). The accumulated charge is swept out and converted to a digital signal at regular intervals. Because of background currents, zero energy corresponds to some finite signal, called the pedestal; eight energy channels are defined in terms of the 256 bin numbers, relative to the expected pedestal location (Fig. 9.3). The read-out interval is called the integration time; it is adjusted to ensure that there is no more than one count per interval, otherwise pile-up occurs and it is the summed energy that is read out instead. The integration time switches automatically between values of 2, 5, 15, and 50 s. The read-out time itself is about 50 s, which is why it is desirable to keep the integration time as long as possible, to maximize the duty cycle. Complications There can be jumps in the flux values at such switching times as the
erroneous pile-up effects are suddenly removed. Corrections for this are not possible; the user must be careful with such jumps.
148
P.W. Daly and E.A. Kronberg
Pedestal
Electron Line
Electron energy relative to pedestal
PHA Ch# 0
N
N+45
N+90
N+135
0
100
200
300
255
Energy, keV
Fig. 9.3 The IES pulse-height analysis. The analog signal, reflecting the electron’s energy on top of a background pedestal, is digitized from 0 to 255, and then sorted into broad energy bins that must be set relative to the pedestal
Since the pedestal position moves with time (aging), temperature, and even
count rate, its position is constantly monitored and corrected for in the data. This is described in Sect. 9.3. However, the corrections are not always perfect and the user should be aware of this.
9.2.1.1 The Electron Base Products The electron data sets as delivered directly by IES exhibit some importance differences between the nominal telemetry mode (NM, low bit rate) and burst mode (BM, high bit rate). Burst mode: There is one full 3-D electron distribution per spin, with 9 polar directions, 16 azimuthal sectors, and eight energy channels. The polar directions 0–2 and 6–8 (those closest to the spin axis, Fig. 9.2) really have only eight sectors per spin; the CAA products artificially double this to simplify handling the data as a rectangular array of size f8,16,9g. Nominal mode: Counts are summed over the whole spin, so angular information is limited to nine polar directions; thus this is often called 2-D data, as reflected in the CAA product name. There are also only six energy channels, the top two corresponding to the upper 4 in burst mode. The array size is f6,9g. Omnidirectional: There are no omnidirectional electron fluxes in the base products, but one is created artificially for CAA from the 3-D/2-D data. It always has the six energy channels of nominal mode: array size f6g.
9
RAPID Products at the Cluster Active Archive
149
EPAD: To compensate for the missing 3-D data in NM, there is an additional product called EPAD (electron pitch angle distribution): it contains fluxes from three polar directions for each of 16 sectors, but only for two energy channels. One direction is perpendicular to the magnetic field in that sector, another 90ı to the first, the third is either parallel or anti-parallel to the spin axis. To simplify life for the user, the CAA product places these values into their proper location within an array of f2,16,9g with the other six directions having fill values. The definitions of the two energy channels has changed several times over the first years of operation; hence three separate versions of this product exist with different energies. All three versions cease after May 2004 (the CAA data files exist but are empty), when they were replaced by the next product. Electrons lite: Since May 2004, a new 3-D electron product is available in nominal mode. It is the same as the burst mode distribution but for energy channels 1 and 3 only. For CAA, this product is also provided in burst mode, by simply extracting it from the existing burst mode distribution. The array size is f2,16,9g. All the above products have a time resolution of one spin 4 s.
9.2.2 Ions A single ion head is illustrated on the right side of Fig. 9.1. The entering particle first traverses collimating plates, penetrates a thin foil that emits electrons to generate a start signal, and then strikes the solid state detector, where electrons emitted at the surface produce a stop signal. The particle energy is deposited in the detector and recorded. The opening angle for a single ion detector is also 60ı , but unlike for the electrons, the subdivision into four 15ı slots is done by determining the location of the start signal. This of course has a certain efficiency associated with it. The start and stop signals are used to measure the time-of-flight (TOF) over the 32 mm separation. This time plus measured energy locate the event within the energy-TOF space of Fig. 9.4 which then determines the species and energy channel. The number of events in each of the species-channel bins in Fig. 9.4 is read out and reset once per sector (1/16 spin). Only the hydrogen, helium, and carbon-nitrogen-oxygen (CNO) data are delivered by RAPID as part of the regular products; the silicon-iron channels are also available but only in the direct events product (see below). Complications The start and stop signals are generated by multichannel plate detec-
tors, whose performance change considerably over time. Thus the overall efficiency of the TOF mechanism is monitored continuously and the
CNO7
100 H2
SiFe1
SiFe2
SiFe6
He2
H3
CNO 1
CNO2
H4
CNO4 CNO3
He5
He1
H5
SiFe5 SiFe4 SiFe3
He6
CNO5
Measured energy, keV
H6
Over Range = 1500 keV
He3
1000
CNO6 SiFe7
He7
He4
H7
He7
CNO7
H6
CNO8
H7
He6
P.W. Daly and E.A. Kronberg
CNO8
150
H1
Under Range = 30 keV
H1
He1
CNO1
10 1.25
2.50
5.00
10.00 20.00 Time of Flight, ns
40.00
80.00
Fig. 9.4 The RAPID ion classification system. Every ion “event” occupies a point in the 256 256 energy-TOF space, which is divided into areas for different ion species and up to eight energy channels
calibration files regularly updated. The user must realize that interspacecraft cross-calibrations are only approximate and must be used with great care. The lower part of Fig. 9.4 shows the “underrange” region, where no energy signal is received (<30 keV); ion classification is done solely on TOF information. These events contribute to energy channel 1. The species determination is not so precise: low energy hydrogen enters and dominates the helium channel 1 (which is therefore suppressed) and the CNO channel 1 exhibit signs of contamination as well. The central ion head on all four spacecraft deteriorated within the first months of the mission; most likely sunlight saturated the time-of-flight system. The result is that ion distributions are not available within 30ı of the ecliptic plane. This is often referred to as the “donut” effect (hole in the middle). There is a bug in the onboard programming that causes the 3-D ions to be accumulated at different times in different sectors. The CAA product provides a key to help recombine these distributions. This is described in an appendix to the ICD.
9
RAPID Products at the Cluster Active Archive
151
9.2.2.1 The Ion Base Products The ion data products delivered directly by IIMS can be summarized as follows. 3-D data: Ion fluxes for three species (H, He, CNO) in 12 polar and 16 azimuthal directions over eight energy channels. For CAA, this is split up into three separate products, one per species. Array size is f8,16,12g. Each distribution is accumulated over 8 spins, except on spacecraft 2 where they are accumulated over a single spin. In burst mode, there is one such distribution every 8 spins; in nominal mode, there is 1 every 32 spins. This is a result of the limited telemetry rate for RAPID. There are thus data gaps between the delivered accumulations. Omnidirectional: There is an omnidirectional base product for H, with eight energy channels. Since these events do not depend upon the efficiency of the directional signal mentioned above, they are not identical to the sum of the 3-D data. Array size is f8g, frequency is once per spin. There are also omnidirectional He and CNO spectra at a rate of 1 per 4 spins: their array sizes are f8g. IPAD: As for the electrons, there is a sparse 3-D hydrogen distribution available every spin, with three polar directions per sectors, which vary with the magnetic field. Like EPAD, it too is expanded to fill the complete 3-D array with fill values for those directions not measured. The array size is f2,16,12g. As of May 2004, this product exists only in burst mode. Direct events: The complete energy and time-of-flight values of Fig. 9.4 plus polar and azimuthal direction numbers are transmitted for a limited number of events per spin: 20 in NM and 106 in BM. A priority scheme ensures that the rarer heavy ion events are read out before the dominating hydrogens. For CAA, the species and energy channels determined from the scheme in Fig. 9.4 are also provided. Details are to be found in the ICD.
9.3 Standardized Energy Channels A number of different values for the RAPID energy channels have been published over the years, especially for the electrons. The reason is that each of the electron and ion sensors in the different heads and on different spacecraft really do have deviating values. For the electrons, this is mainly due to setting some lower thresholds high enough to avoid contamination from a wide pedestal, while for the ions, slightly differing foil thicknesses lead to variations in energy losses at the start signal. However, a uniform set of energy channel definitions is essential for any physical analysis of the data. Hence, the variations in the spectra among the sensors are corrected to bring them effectively to such a standardized set. The “official” values now used for the CAA products are listed in Table 9.1. The algorithm used for this correction is to fit the data between adjacent channels to a power law which is then integrated over the energy shift region, with the resulting flux subtracted from the one and added to the other channel, as shown in Fig. 9.5.
152
P.W. Daly and E.A. Kronberg Table 9.1 The standardized RAPID energy channels Electrons Channel 1 2 3 4 5 6 7 8 Upper
Hydrogen a
27.7–64.4 75.3 92.2 159.7 374. 962. 1885. —e 4007.
Helium b
29.9 137.8 172.3 235.1 351. 737. 1689. —e 3799.
CNO
BM
c
NM d
37:3d 50:5 68:1 94:5 127:5 244:1 — — 406:5
37:3 50:5 68:1 94:5 127:5 175:9 244:1 336:5 406:5
83.8 274.4 414. 498. 638. 948. 1414. 2539. 4046.
Lower thresholds, all units keV a Energy gap between hydrogen 1 & 2. b Helium channel 1 contains hydrogen, suppressed. c CNO channel 1 contaminated at times, not suppressed. d Some electron channels start at 46.1 keV. e 8th channel not accessible for hydrogen and helium.
Fitted power law j = AE
−γ
Ln j
j1
j2
E1
e1
E2 E2’
e2
E3
Ln E
Fig. 9.5 Shifting the energy threshold between two channels: the differential flux in two channels is fitted to a power law, that fit is integrated over the energy shift E20 E2 (shaded area), and the result moved from one channel to the other
For the electrons, there is a further adjustment to be made: because the pedestal that defines the energy origin can move in a way that depends on count rate, its location is monitored by some additional channels. The spectral shift introduced by this effect can be deduced and then also corrected for as part of the energy channel standardization.
9
RAPID Products at the Cluster Active Archive
153
Note that the spectral correction is applied only to flux data, not to the count rates since they are to remain as original raw data.
9.4 CAA Products So far we have described the RAPID products as they come from the instrument. Here we explain what goes into the Cluster Active Archive specifically. The primary idea is to archive as much as possible so that the RAPID data may be used both today and in the far future when the RAPID Team is no longer available for advice. Obviously this includes processed data as flux, with all calibrations, cleaning, corrections, and glitch removal included; but it also means archiving raw data as count rates, housekeeping data, instrument settings and other data sets that normally can only be exploited by very knowledgeable users. If these expert data sets are not archived they will later be lost forever. They are essential to understand any puzzling and possibly erroneous effects in the processed data. Here we will not detail the names of the CAA files or the variable names in them. That can be found directly from CAA or from the ICD.
9.4.1 Main Products The most important products are those derived from the base products described above. The following points apply to them: Processed data are in units of differential particle flux, 1/(cm2 sr s keV). Raw data are count rates (1/s); these contain no corrections, no calibrations, no
suppressions whatsoever; only the accumulation time is employed to convert from counts to rates. This accumulation time is well-defined but not trivial to determine, hence it is included as an item in every count-rate record (the original number of counts can thus be reconstructed if wanted). For both fluxes and rates, the standard deviation is also included in each record, in the same format and array size as for the data. This is obtained from both the Poisson statistical error of the counts plus a factor for the data compression uncertainty; the former normally dominates. There is a CEF file for every product for every day and spacecraft; for those times when the product does not exist (e.g. the Electrons Lite distributions before May 2004) the files are empty. The record time tag refers to the middle of the record interval; the time-halfinterval for each record is also given (CAA metadata standard). Note that the record interval and the accumulation time are two separate things: data are accumulated over a certain interval but not necessary for 100% of that time.
154
P.W. Daly and E.A. Kronberg
The direct events are also a main product, but are different in that they are a listing of a limited number of event parameters. No rates or fluxes can be derived from them: they only indicate the presence of particles. For measured zero flux, the standard deviation is also set to 0, although it should really be that for a single count, to express the uncertainty level. However, such a procedure would lead to errors when summing over longer times. Recall that errors are combined by summing the variance, i.e. the sum of the squares of the standard deviations.
9.4.2 Support Products Some additional data sets are provided to assist users with the interpretations; their derivation requires detailed knowledge of the RAPID location on the spacecraft, the spin axis, and sun sensor. Thus all this is worked out for the user, as separate products. Flow directions: For each of RAPID’s 9 16 (electrons) and 12 16 (ions) polarazimuth directions, the GSE coordinates of the flow vector at their centers are provided. Since these values change very slowly, they are only given once per hour. SC-GSE rotation matrix: Provided in the same files as the flow directions is the actual 3 3 rotation matrix to do a general transformation to GSE from the RAPID spacecraft frame ( D angle to spin axis, D sector 22:5ı ). Pitch angles: For each of the electron and ion polar-azimuth flow directions, the angle to the magnetic field (pitch angle) plus a magnetic azimuth is provided; this is done for each spin. Warning: this calculation uses the magnetic data delivered directly to RAPID on-board and not the final calibrated FGM data from CAA. Proper pitch angle calculations must be done by combining the flow directions with that magnetic data set.
9.4.3 Diagnostic Products These are products that are intended mainly for experts and are explained further in the ICD. Housekeeping parameters: Various flags and parameters (137 in all) used to indicate the instrument status or mode or performance. Instrument settings: A subset of the housekeeping data, 11 in all, for the most important aspects of the instrument status; this includes telemetry mode, multichannel plate voltages, electron integration time, ion accumulation mode.
9
RAPID Products at the Cluster Active Archive
155
Pedestals: Information on the electron pedestals: counts (not rates) in the pedestal channels, calculated pedestal positions, used for spectral corrections, for burst and nominal mode separately.
9.4.4 Graphics and Software The RAPID Team also makes available an IDL visualizing software package and summary plots. The software package can be used to read RAPID data files (the CAA CEF format or the RAPID-specific SCI format) to produce various types of plots: line plots, spectrograms, angle-angle plots, and pitch angle distributions. The user can combine different spacecraft or different data sets from one spacecraft. Summary plots, as illustrated in Fig. 9.6, are of 6-h duration, and contain omnidirectional spectrograms for electrons, hydrogen, helium, and CNO, with various instrument settings as well.
9.5 Status of RAPID Data at CAA Since the CAA is an active archive, it is expected that the contents shall be replaced, refined, and/or updated in the course of time. There are several reasons for doing this.
9.5.1 Recalibration The calibration factors used for the first number of years were preliminary ones based on pre-launch measurements and tests during commissioning. Only over the longer operational phase could actual data be used to establish the need for recalibration. The original data delivered to CAA for 2001–2004 were made using these preliminary calibrations. New calibrations are now available and were used for the initial delivery of the 2005 data. Reprocessing of the 2001–2004 data (and reissuing of 2005) will take place after the delivery of the 2006 data, starting mid-2008. The calibration version can be found in the data files. There is a metadata parameter called Dataset Version, which for RAPID is a 4-digit code, the most significant digit of which is 1 for the older and 2 for the newer calibrations. See the ICD for further details. Ultimately, all the older versions will be replaced with the newer ones.
156
P.W. Daly and E.A. Kronberg Cluster/RAPID SC3 (Samba) 2008-02-20 18:00:00 – 23:59:59 Time resolution = 1 min Energy, keV
103
Electrons 104 103 102 101
102
100 Energy, keV
Protons
104 103
103
102 101
102
100
Energy, keV
Diff. flux [1/(cm2 sr s kev)]
Helium 102
103
101
102
100 103 102
103
101 102
100
ON
AutoSW
OFF
HIST
50 us 15 us 5 us 2 us A B TM 10 8 6 4 2 0
HV, kV
IIMS Modes
Int Time
Energy, keV
CNO
XGSE YGSE ZGSE R
S/B
Serial
Paralel IFFT
HV off
HV on
HV ok ENA
NM
BM
BM3
STA 18 1.86 3.73 3.37 5.36
NM3
STO 19 3.84 4.68 3.18 6.84
20 5.58 5.34 2.77 8.20
DEF 21 7.12 5.79 2.26 9.45
22 8.50 6.10 1.70 10.59
23 9.73 6.31 1.10 11.64
24 10.83 RE 6.43 RE 0.50 RE 12.61 RE
Hours of 2008 Feb 20 Generated 2008-Jul-16 21:41:39; V2.1; Data Vers 2123 (E) & 2220 (I)
Fig. 9.6 RAPID 6-h summary plot
9
RAPID Products at the Cluster Active Archive
157
9.5.2 Reissues A re-release of the data products is also necessary when new or revised products are ready. The first release is missing the diagnostic products and some minor main products, which are coming with the next release. Even so, some of the main products require format changes and must therefore be replaced. In particular, the original nominal mode electron products were artificially given eight energy channels, to be consistent with burst mode. This has led to misunderstandings and even errors, so these products are being replaced by new ones with the proper six channels.
All the product descriptions in this article are for the newer release.
9.6 Summary The RAPID products at CAA aim to be as complete as possible to ensure reliable and convenient usage by the general scientific community. For this reason, the Team provides not only processed data as fluxes, but also raw data as count rates, and standard deviations for error estimates for both fluxes and rates. Support data for coordinate transformations as well as diagnostic products for “experts” are also available. Delivery of new data is proceeding on schedule; reprocessing of older data with improved calibrations is also under way. The CAA repository and its CEF format will soon become the primary means of obtaining and using RAPID data, especially as more data is ingested and the calibrations improved. Acknowledgements The authors wish to thank the CAA and its Team for all the efforts they have put in to making the Active Archive a functioning and useful system.
References 1. Allen A., Schwartz S.J., Harvey C., Perry C., Huc C., Robert P.: Cluster Exchange Format— Data File Syntax. ESA document DS–QMW–TN–0010, Queen Mary University of London, London, UK (2004). Latest version available at http://caa.estec.esa.int/caa/documentation.xml 2. Daly P.W., M¨uhlbachler S.: The Cluster Active Archive—The RAPID contribution. In: P. Escoubet, H. Laakso, M. Taylor, A. Masson (eds.) Proceedings Cluster and Double Star Symposium—5th Anniversary of Cluster in Space, Noordwijk, The Netherlands, 19–23 September 2005, ESA SP-598. ESA Publ. Div., Noordwijk (2006). http://caa.estec.esa.int/ documents/publications/P6.11 Daly.pdf
158
P.W. Daly and E.A. Kronberg
3. Daly P.W., M¨uhlbachler S., Kronberg E.: Cluster Active Archive: Interface Control Document for RAPID. ESA document CAA–RAP–ICD–0001, Max-Planck-Institut f¨ur Sonnensystemforschung, Katlenburg-Lindau, Germany (2008). Latest version available at http:// caa.estec.esa.int/caa/instr doc.xml 4. Harvey C.C., Allen A.J., D´eriot F., Huc C., Nonon-Latapie M., Perry C.H., Schwartz S.J., Eriksson T., McCaffrey S.: Cluster Metadata Dictionary. ESA document CAA–CDPP–TN– 0002, European Space Agency, Noordwijk, Netherlands (2008). Latest version available at http://caa.estec.esa.int/caa/documentation.xml 5. Wilken B., Axford W.I., Daly P., et al.: RAPID: The Imaging Energetic Particle Spectrometer on Cluster. Space Science Reviews 79, 399–473 (1997)
Chapter 10
STAFF Instrument Products Distributed Through the Cluster Active Archive N. Cornilleau-Wehrlin, L. Mirioni, P. Robert, V. Bouzid, M. Maksimovic, Y. de Conchy, C.C. Harvey, and O. Santol´ık
Abstract Cluster Spatio-Temporal Analysis of Field Fluctuations (STAFF) high resolution data that are available at Cluster Active Archive (CAA) comprise two main parts, corresponding to data issued from the two onboard data analysers. The STAFF waveform analyser (STAFF-SC) provides data in the frequency range 0.1–10 Hz or 0.1–180 Hz, depending on the spacecraft telemetry rate. The Spectrum Analyser (STAFF-SA) calculates the complete spectral matrix elements for five wave components, the three magnetic components from the STAFF experiment and the two electric components from the Electric Field and Wave (EFW) experiment, in the frequency range 8–4,000 Hz. From STAFF-SC the CAA data comprise waveform data in telemetry units, complex spectra in physical units, dynamic spectra plots, and possibly in the future waveform data in physical units. The CAA products from STAFF-SA are the spectral matrix data in physical units. In the future, STAFF-SA value added products containing wave polarisation and propagation characteristics will be delivered.
10.1 Introduction The purpose of the present paper is to give a short overview of the STAFF instrument itself and its data available through the Cluster Active Archive (CAA). N. Cornilleau-Wehrlin (), L. Mirioni, P. Robert, and V. Bouzid Laboratoire de Physique des Plasmas, Ecole Polytechnique, UPMC, CNRS, route de Saclay, 91128 Palaiseau, France e-mail:
[email protected] N. Cornilleau-Wehrlin Station de Radioastronomie de Nanc¸ay, 18330 Nancay, France M. Maksimovic and Y. de Conchy LESIA, Observatoire de Paris-Meudon, 5 place Jules Jansen, 92195 Meudon Cedex, France C.C. Harvey CESR, 9 avenue du Colonel Roche, BP 4346, 31028 Toulouse Cedex 4, France O. Santol´ık Institute of Atmospheric Physics, ASCR, Bocni II/1401, CZ-14131 PRAHA 4, Czech Republic H. Laakso et al. (eds.), The Cluster Active Archive, Astrophysics and Space Science Proceedings, DOI 10.1007/978-90-481-3499-1 10, c Springer Science+Business Media B.V. 2010
159
160
N. Cornilleau-Wehrlin et al.
The scientific rationale underpinning the CAA is to: Maximise the scientific return from the mission by making all Cluster data avail-
able to the worldwide scientific community Ensure that the unique data set returned by the Cluster mission is preserved in a
stable, long-term archive for scientific analysis beyond the end of the mission Provide this archive as a major contribution by ESA and the Cluster science
community to the International Living With a Star programme In the case of the Spatio-Temporal Analysis of Field Fluctuations (STAFF) experiment, the main responsibilities are to deliver to CAA high resolution data in an agreed format at the best possible quality level, as far as possible in physical units. Additional value added products will be delivered too.
10.2 Instrument Hardware The Cluster STAFF experiment (see Cornilleau-Wehrlin et al. [2] and CornilleauWehrlin et al. [3]) comprises a boom-mounted three-axis search coil magnetometer to measure magnetic fluctuations in the frequency range 0.1 Hz–4 kHz, a preamplifier and an electronics box that houses the two complementary data analysis packages: an on-board waveform unit and a digital Spectrum Analyser. The later uses the five electromagnetic wave components available, the three magnetic coming from STAFF and the two electric coming from the Electric Field and Wave experiment (EFW [4]). STAFF is one of the five experiments of the Wave Experiment Consortium (WEC [7]).
10.2.1 The Magnetic Waveform Unit The magnetic waveform unit (STAFF-SC) is made of three sections in order to fulfil different filtering and waveform digitalisation, output interface and onboard calibration (for the whole STAFF experiment). The three magnetic components of the magnetic field (Bx , By and Bz ), at the output of the search coil preamplifier are filtered simultaneously in either one of the two bandwidths 0.1–10 and 0–180 Hz depending on the spacecraft telemetry mode, then they are digitised simultaneously by a 16 bits sampling and hold device at 25 and 450 Hz, respectively. STAFF and EFW samplings are synchronized by the Digital Wave Processor (DWP). It is also to be noticed that EFW and STAFF filters are identical.
10.2.2 The Spectrum Analyser The Spectrum Analyser (STAFF-SA) is designed to perform the complete auto and cross correlation matrix of five sensor channels (Bx , By , Bz , Ey , Ez ) over a
10
STAFF Instrument Products Distributed Through the Cluster Active Archive
161
frequency range of more than nine octaves at a high rate. The two electric components come from EFW. The “frontend” of the analyser is analogue. The analysis band of 8 Hz–4 kHz is divided into three logarithmically distributed frequency subbands (A: 8–64 Hz, B: 64–512 Hz and C: 512–4,096 Hz), each one being divided into nine frequency channels. The analysis band is therefore divided into 27 frequency bands, logarithmically spaced. For each of the three sub-bands and for each of the five sensor channels there is a separate band pass filtering. For each sub-band there are three automatic gaincontrolled amplifiers. It is worth noting that in High Bit Rate telemetry mode there are no data for the lowest frequency band A as there is an overlap with the STAFF and EFW waveform data (up to 180 Hz), which permits to save telemetry for the benefice of other WEC experiments.
10.3 Data Processing Figure 10.1 shows a general picture of how STAFF data are processed on, and how CAA files are created. The DWP team produced the TED software that extracts and time-tags the STAFF Level 0 data from the WEC raw data packets, producing different data packets for STAFF-SC and STAFF-SA data that are then decommutated (Level 1). The more recent version of TED has an option allowing improving the precision of the time tag, from 2 ms (standard precision) to about 20 s. For this application DWP uses tables given by ESOC and DSN [Yearby et al., Chapter 4]. For inter-spacecraft analysis this correction is specially needed for waveform data in the High Bit Rate
CWF CS
DWF WEC Level
Level 0
Level 1
STAFF L0 File
STAFF L1 File
Level 2
Normal Modes Burst Modes
TED
Decom
...
Level 3
STAFF−SC L2 File
RC L
STAFF−SC L3 Files
STAFF−SA L2 File
PRAS− SADCO
STAFF−SA L3 Files
Calib
House Keeping
SATT File
Plots
Calibration Files
PSD SM AGC
Polarisation Propagation Parameters
Fig. 10.1 STAFF data ground processing chain. Products available at CAA are, on one hand, Decommutated Waveform (DWF), Complex Spectra (CS) and graphical plots of spectrograms (Plots) for STAFF-SC data, and on another hand, Power Spectral Density (PSD), Spectral Matrix (SM) and Automatic Gain Control (AGC) for STAFF-SA data
162
N. Cornilleau-Wehrlin et al.
(HBR) mode (up to 180 Hz). At 180 Hz, the phase resolution is 260ı for 2 ms precision, going to 3ı with the improved time tag. This option is used for STAFF waveform Level 1 data delivered in CAA. For telemetry limitation reasons, waveform data are compressed onboard in the DWP unit. During the decompression of STAFF-SC data on ground, it is possible to estimate the loss due to the on-board compression from 16 to 12 bits (maximum value of the error). This maximum error is given with the Level 1 waveform data for each component and each sample. Other data are also recorded, in particular spin phase and spin axis direction for polarisation and propagation direction computation. Level 1 file also contains a status word which records operation mode information.
10.3.1 STAFF-SC STAFF-SC data are calibrated with dedicated software [8]. From Level 1 files, this software performs time checking, calibration, filtering, coordinate system transformations and other processing operations including dynamic spectra and wave polarisation computations to produce calibrated data files (Level 2) and value added products (Level 3). Value added products such as dynamic spectra produced routinely by the STAFF team (Level 3 graphical plots) are also stored in the CAA.
10.3.2 STAFF-SA The calibration procedure for the STAFF-SA is fully described in Harvey et al. [5]. The calibrated data (Level 2) are then processed by the PRASSADCO software [9] in order to get the polarisation and propagation parameters, in addition to the five components of the power spectral density.
10.4 Available STAFF Data Products in the CAA Before delivery to CAA, these data are translated into the Cluster Exchange Format (CEF, [1]), and then stored in the CAA database [6], together with the PNG graphical plots (e.g. Fig. 10.2). The Cluster Exchange Format is ASCII which allows the end-user to actually see, with a simple text editor, what the file does contain. The file header may seem hard to decrypt because it records every piece of information one may expect, but the way data are recorded is as clear and simple as possible and may be read quite easily with any usual scientific software.
10
STAFF Instrument Products Distributed Through the Cluster Active Archive
Fig. 10.2 Example of STAFF-SC NBR dynamic spectra
163
164
N. Cornilleau-Wehrlin et al.
Table 10.1 Summary of STAFF data files in the CAA. CWF are not yet available, they will be delivered on a best effort basis Level Product Experiment Mode Number of files Format 1 Decommutated WaveForm (DWF) STAFF-SC NBR 1 file/1 sat./24 h CEF 1 Decommutated WaveForm (DWF) STAFF-SC HBR 1 file/1 sat./24 h CEF 2 Calibrated WaveForm (CWF) STAFF-SC NBR 1 file/1 sat./24 h CEF 2 Calibrated WaveForm (CWF) STAFF-SC HBR 1 file/1 sat./24 h CEF 2 Complex Spectra (CS) STAFF-SC NBR 1 file/1 sat./24 h CEF 2 Complex Spectra (CS) STAFF-SC HBR 1 file/1 sat./24 h CEF 2 Automated Gain Control (AGC) STAFF-SA All 1 file/1 sat./24 h CEF 2 Power Spectral Density (PSD) STAFF-SA All 1 file/1 sat./24 h CEF 2 Spectral Matrix (SM) STAFF-SA All 1 file/1 sat./24 h CEF 3 Dynamic spectra plots STAFF-SC NBR 1 file/1 sat./3 h PNG 3 Dynamic spectra plots STAFF-SC HBR 1 file/1 sat./3 h PNG 3 Polarisation parameters STAFF-SA All TBD CEF 3 Plots STAFF-SA All TBD TBD
Level 0 (L0) data are raw data. None is stored in the CAA. Level 1 (L1) data are only decommutated and time-tagged. This is the case of STAFF-SC Decommutated WaveForm (DWF) which is provided un-calibrated. Level 2 (L2) data are calibrated (physical units). One will find STAFF-SC Complex Spectra (CS), STAFF-SA Spectral Matrix (SM) and Power Spectral Density (PSD) data in the CAA. Level 3 (L3) data are value-added products. The only type of L3 products delivered to CAA yet, are graphical plots of dynamic spectra for browsing purpose only, but STAFF-SA polarisation and propagation parameters data will also be stored in CAA. The reader will find a summary of CAA-STAFF products main characteristics in Table 10.1.
10.4.1 STAFF-SC Decommutated Waveform These L1 CEF files contain the Decommutated WaveForm (DWF) of the magnetic field (un-calibrated) sampled at 25 Hz for the Normal Bit Rate (NBR) mode and 450 Hz for the High Bit Rate (HBR) mode. Other variables or constant data (constant for one given file) are also stored here: the spin axis direction, the mean spin rate, the status (containing HK information), the phase angle and the maximum compression error. Bx , By and Bz are given in telemetry counts units. To keep as much information as possible, it has also been decided to store Level 1 data in the STAFF instrument reference frame (so-called SSW6RF). This minimizes information loss (this way loss can only result from compression error which is estimated in the instrument reference frame) as data records are as close to raw data as possible except that they are nice-looking and time tagged with the highest precision available.
10
STAFF Instrument Products Distributed Through the Cluster Active Archive
165
10.4.2 STAFF-SC Complex Spectra These L2 files give the values of Complex Spectra (CS) of the magnetic field in GSE coordinate system, in the 0.1–12.5 Hz and 0.1–225 Hz frequency range in NBR mode and in the HBR mode respectively, with a time resolution of 10 s and a frequency resolution of 0.1 Hz.
10.4.3 STAFF-SC Dynamic Spectra These L3 files are graphical plots showing dynamic spectra and integrated power for the component parallel to the spacecraft spin axis and for the four satellites. At the bottom the amplitude of the DC field perpendicular to the spin axis, computed from the search-coil spin signal, is also plotted for the four spacecraft. Plots are delivered in time series of 3 h for HBR or NBR (e.g. Fig. 10.2). They are provided in Portable Network Graphics (PNG) format for preview.
10.4.4 STAFF-SA Automatic Gain Control These L2 CEF files contain the three measured values of the Automatic Gain Control (AGC) for Bx , By C Bz and Ey C Ez , for each of the three frequency bands (A, B and C). The AGC data are not subject to direct scientific use. However they represent a measure of the total wave power for the corresponding sensor or group of sensors (B or E in the spacecraft spin plan) and frequency band.
10.4.5 STAFF-SA Power Spectral Density and Spectral Matrix These L2 CEF files store the records of the 5 5 complex Spectral Matrix (SM) which is the cross-product of the magnetic and electric fields values computed onboard the spacecraft: 0 B B B B B @
Bx2 By :Bx
Bz :Bx
Ex :Bx
Ey :Bx
Bx :By
By2 Bz :By
Ex :By
Ey :By
Bx :Bz
By :Bz
Bz2 Ex :Bz
Ey :Bz
Bx :Ex
By :Ex
Bz :Ex
Ex2 Ey :Ez
Bx :Ey
By :Ey
Bz :Ey
Ex :Ey
Ey2
1 C C C C C A
As this matrix is complex, the real and imaginary parts have been separated in the SM CEF file.
166
N. Cornilleau-Wehrlin et al.
It has also been decided to cut it in three pieces to be unit consistent, the first being the magnetic elements B B, the second the electric ones E E and the third the cross-product B E. As the matrix is also non-hermitian, that is Si :S j D Sj :S i (where S D B or E, and i, j D x, y, z), only half of the non-diagonal elements are stored. The Power Spectral Density (PSD) file is a record of the SM diagonal values. PSD are averaged over shorter time scales than the SM elements. That is why they are stored in a separated CEF file. All of these values are given for each of the 27 frequency channels (3 bands 9 sub-bands logarithmically spaced). The time resolution is 1 s for PSD and 4 s for SM in NBR mode, and 125 ms or 250 ms for PSD and 1 s for SM in HBR mode. There is no A-band measurement in the HBR mode.
10.4.6 Caveats Presently there are few caveat files for STAFF CAA products. Most of the data gaps, errors, telemetry overflow relevant to WEC data, either as a whole or for individual experiments, thus in particular STAFF, are listed in the WEC status log provided by the DWP team (see Chapter 4). STAFF caveats include information on absence of sun pulse due to eclipses and the presence of erroneous STAFF-SA PSD negative values. In the future, possible new caveats will be produced in conjunction with the new products to be delivered. One possible source of caveat is linked to the possibility to remove the spin signal nicely or not in the vicinity of the perigee of the Cluster orbit, where this signal is the strongest. This is not an issue with the data that are presently delivered to CAA. This might become a need once the waveform data in physical units are delivered, as for this some data processing is needed, as a Fourier transform to correct from the transfer function followed by an inverse one to get wave form in physical units. This explains partly why such a product is not delivered yet. The CSDS product that is the integrated power density in the frequency range 1–10 Hz is accompanied by caveats sometimes when in the vicinity of the perigee. This is translated in the delivered data by an increase of the signal level at 0.25 Hz and maybe at 0.5 Hz, close to perigee, those frequencies corresponding to the spin frequency and its first harmonic. Another caveat would be linked to the EFW experiment for the availability of electric component data for the Spectrum Analyser. This should be found in EFW experiment caveats: it concerns periods after one of the EFW boom suffers malfunction on one spacecraft or another (filter or preamplifier failure). In that case the electric field data are meaningless as STAFF-SA combines onboard the two components to de-spin the data. The priority has been given for STAFF-SA to keep good magnetic field data, onboard de-spun, allowing to get the polarisation parameters of the electromagnetic waves.
10
STAFF Instrument Products Distributed Through the Cluster Active Archive
167
10.5 Prospects 10.5.1 CAA STAFF Data Status At present time STAFF Level 2 data that are available at CAA cover at least years 2001–2005. All data (Levels 1, 2 and 3) covering the years 2001–2009 should be available by the end of 2010. STAFF data that are available at CAA are also delivered by STAFF to the French data centre Centre de Donn´ees de la Physique des Plasmas (CDPP).
10.5.2 STAFF Data Prospects The polarisation and propagation parameters from STAFF-SA data will be provided (delivery start is scheduled on 2009). STAFF-SC waveform data in physical units (CWF) will be provided on best effort basis. Acknowledgments STAFF experiment realisation and software have been founded by CNES and ESA.
References 1. Allen, A., Schwarz, S.J., Harvey C.C., Perry, C., Huc C., Robert P.: Cluster Exchange Format: Data FileSyntax. Technical Report DS-QMW-TN-0010, issue 2, rev. 0.4, ESA (2008) 2. Cornilleau-Wehrlin, N., Chauveau, P., Louis, S., Meyer, A., Nappa, J.M., Perraut, S., Rezeau, L., Robert, P., Roux, A., de Villedary, C., de Conchy, Y., Friel, L., Harvey, C.C., Hubert, D., Lacombe, C., Manning, R., Wouters, F., Lefeuvre F., Parrot, M., Pinc¸on, J.L., Poirier, B., Kofman, W., Louarn, P.: The Cluster Spatio-Temporal Analysis of Field Fluctuations (STAFF) Experiment, Space Science Reviews, 79:107–136 (1997) 3. Cornilleau-Wehrlin, N., Chanteur, G., Perraut, S., Rezeau, L., Robert, P., Roux, A., Villedary, C. de, Canu, P., Maksimovic, M., Conchy, Y. de, Hubert, D., Lacombe, C., Lefeuvre, F., Parrot, M., Pinc¸on, J.L., D´ecr´eau, P.M.E., Harvey C.C., Louarn, Ph., Santol´ık, O., Alleyne, H.St.C., Roth, M., STAFF team: First results obtained by the Cluster STAFF experiment, Annales Geophysicae, 21:437–456 (2003) 4. Gustafsson, G., Bostr¨om, R., Holback, B., Holmgren, G., Lundgren, A., Stasiewicz, K., ˚ en L., Mozer, F.S., Pankow, D., Harvey, P., Berg, P., Ulrich, R., Pedersen, A., Schmidt, R., Ahl´ Butler, A., Fransen, A.W.C., Klinge, D., Thomsen, M., F¨althammar, C.-G., Lindqvist, P.-A., Christenson, S., Holtet, J., Lybekk, B., Sten, T.A., Tanskanen, P., Lappalainen, K., Wygant J.: The Electric Field and Wave Experiment for the Cluster Mission, Space Science Reviews, 79:137–156 (1997) 5. Harvey, C.C., Belkacemi, M., Manning, R., Wouters, F., de Conchy, Y.: STAFF Spectrum Analyzer, Conversion of the Science Data to Physical Units. Technical Report OBSPM-TN-0001, issue 7, rev. 5, Observatoire de Paris-Meudon, http://www.cesr.fr/harvey/TN01 V75.pdf (2004)
168
N. Cornilleau-Wehrlin et al.
6. Mirioni, L., Cornilleau-Wehrlin, N., Maksimovic, M., Burlaud, C., Robert, P.: Cluster Active Archive: Interface Control Document for STAFF, Technical Report CAA-STA-ICD-0001, issue 3.0, ESA (2008) 7. Pedersen, A., Cornilleau-Wehrlin, N., de la Porte, B., Roux, A., Bouabdellah, A., D´ecr´eau, P.M.E., Lefeuvre, F., Sen´e, F.X., Gurnett, D., R. Huff, R., Gustafsson, G.,, Holmgren, G., Woolliscroft, L.J.C., J.A. Thompson, J.A., and Davies, P.H.N., The Wave Experiment Consortium (WEC), Space Sci. Rev., 79, 93–106 (1997) 8. Robert, P.: Les Proc´edures Roproc pour le Traitement des Donn´ees de Cluster/STAFF-SC, FGM et ORBIT, Technical Report, CETP, http://cluster.cetp.ipsl.fr/ressources/Roproc V2p0.pdf (2003) 9. Santol´ık, O.: PRopagation Analysis of STAFF-SA Data with COherency tests (PRASSADCO), http://oberon.troja.mff.cuni.cz/santolik/PRASSADCO/staff sa/ (2003)
Chapter 11
Cluster Wideband Data Products in the Cluster Active Archive J.S. Pickett, J.M. Seeberger, I.W. Christopher, O. Santol´ık, and K.M. Sigsbee
Abstract Cluster Wideband Data (WBD) plasma wave receivers are mounted on all four of the Cluster spacecraft providing approximately 4–7% orbit coverage since mission operations began in February 2001. Data obtained by the WBD instruments are downlinked in real time to various Deep Space Network (DSN) and Panska Ves (PV) ground stations. The strengths of the WBD instruments lie in their high time and frequency resolution data, which allow analysis of the wave fine structure in order to more accurately investigate the linear and nonlinear nature of the waves, and in their use in carrying out Very Long Baseline Interferometry (VLBI) investigations to locate and characterize remote wave sources and their characteristics. The WBD team has already archived at the Cluster Active Archive (CAA) the documentation, software and data plots required for carrying on an independent scientific investigation. A document on interpretation issues has also been archived to help ensure that signals which are not naturally in the plasma are not misinterpreted. The WBD team also plans to archive digital, calibrated data files for the entire mission in cdf format at NASA’s CDAWeb and submit these files for conversion to the Cluster standard cef format and archiving at the CAA. In order to ensure that the calibration of the WBD data has been done properly, WBD has taken part in Cluster cross calibration activities with the other wave instruments with regard to wave amplitudes in the time and frequency domains and with the PEACE instruments with regard to low density measurements.
11.1 Introduction The Cluster Wideband Data (WBD) plasma wave receiver is a part of the Cluster Wave Experiment Consortium (WEC) which consists of four other wave instruments (EFW, STAFF-SC, STAFF-SA and WHISPER) and a central Digital Wave J.S. Pickett (), J.M. Seeberger, I.W. Christopher, O. Santol´ık, and K.M. Sigsbee Department of Physics and Astronomy, The University of Iowa, Iowa City, Iowa, 52240, USA e-mail:
[email protected] O. Santol´ık Institute of Atmospheric Physics and Charles University, Faculty of Mathematics and Physics, Prague, 18000, Czech Republic H. Laakso et al. (eds.), The Cluster Active Archive, Astrophysics and Space Science Proceedings, DOI 10.1007/978-90-481-3499-1 11, c Springer Science+Business Media B.V. 2010
169
170
J.S. Pickett et al.
Processor (DWP) (see Yearby et al. [Chapter 4]). WBD instruments are mounted on all four Cluster spacecraft providing high time resolution (5–36 s depending on filter mode) waveforms in the range of 100 Hz to 577 kHz. In order to obtain such high time resolution, WBD measurements along only one axis are telemetered to the ground at 220 kbits/s, with the signal being picked up by either NASA’s Deep Space Network (DSN) or the Czech Republic’s station at Panska Ves (PV). The one axis measurements consist of either the AC electric field from one of the two 88 m spin plane electric field antennas or the AC magnetic field from one of the two searchcoils available for WBD measurements (one is in the spin plane, the other along the spin axis). The WBD data are obtained in one of three filter bandwidth modes: (1) 9.5 kHz, (2) 19 kHz, or (3) 77 kHz. The minimum frequency of each these three frequency bands can be shifted up (converted) from the default 0 kHz base frequency by 125.454, 250.908 or 501.816 kHz in order to obtain higher frequency measurements However, due to internal WBD and other external filters and to antenna constraints (e.g., the magnetic searchcoils have a maximum frequency extent of 4 kHz), the useable portion of each frequency band, i.e., that part which can be calibrated, is restricted to the following ranges: Filter bandwidth (kHz) 9.5 19 77
Electric 100 Hz–9.5 kHz 100 Hz–19 kHz 700 Hz–77 kHz
Magnetic 70 Hz–4 kHz 80 Hz–4 kHz 700 Hz–4 kHz
For example, measurements made with the electric antenna, filter bandwidth of 9.5 kHz and a conversion to 250.908 kHz would provide valid calibrated data in the frequency range of 251.008 to 260.408 kHz. Although frequency components are often observed in the WBD data either below the lower frequency cutoff or above the upper frequency cutoff as shown in the above table, the amplitudes of these components are invalid because their frequencies fall outside the calibrated analysis bandwidth. Thus, use of the WBD data outside the valid frequency range shown above is discouraged. In addition, the resolution of the data can be set to 8, 4, or 1 bit(s). Normal operation is set to 8 bits resolution which means that only the 9.5 kHz filter mode has a 100% duty cycle. Lowering the resolution to 4 bits allows the 19 kHz filter mode to send back continuous data as opposed to 50% duty cycle with 8 bits, and to 1 bit allowing for the 77 kHz filter to obtain continuous data, as opposed to 12.5% duty cycle with 8 bits and 25% with 4 bit mode. For more information on the instrument and its various modes, please refer to Gurnett et al. [1] and the Cluster Active Archive (CAA) WBD Interface Control Document. The WBD data chain is shown in the block diagram of Fig. 11.1. Once the data are received at one of the DSN or PV ground stations, they are Reed Solomon decoded in order to ensure that every transfer frame sent by the spacecraft is received exactly as it was transmitted, and are time tagged with the ground receive time with an accuracy of 10–50 s. DSN and PV then transfer via ftp these raw WBD data files to The University of Iowa for processing. Iowa performs Level 1 processing
11
Cluster Wideband Data Products in the Cluster Active Archive
Fig. 11.1 Block Diagram of the Cluster Data Chain. ( WBD data have been recorded only once onboard (BM2 mode on 7 March 2001) since start of mission operations phase)
171
Input Wave
WBD INSTRUMENT Make waveform measurement using appropriate mode for region, with one parameter selected from each of the following sets: Antenna Conversion Freq. 0 kHz (Baseband) Ez 125.454 kHz Ey Bx 250.908 kHz By 501.816 kHz Bandwidth 9.5 kHz 19 kHz 77 kHz
Resolution 8 bits 4 bits 1 bit Transmit to Ground (220 kbits/s) *
DSN or Panska Ves Processing
FTP Transfer
The University of Iowa Level 1 (L1) Processing Creation of L1 files Validation of L1 files Write L1 files to DVD Mail DVDs
French, Swedish and UK Cluster Data Centres, Stanford University, SwRI Extract L1 Data Local Institute Analyze waveform Or convert to frequency domain
on these files in order to: (1) check for expected synchronization bits to verify that the data in any one data frame are good, (2) convert the onboard counter parameter in each transfer frame to UT time of measurement using the ESOC-provided time
172
J.S. Pickett et al.
calibration files and known delays in the onboard data system, (3) convert the ground receive time supplied by DSN or PV to UT time of measurement with microsecond accuracy taking into account the propagation delay in addition to the delay in the onboard data system, (4) create Level 1 data files with at most 10 min of uncalibrated data together with the aforementioned time tags (steps 2 and 3) attached to each minor frame of data (1,090 data points covering a period of approximately 5 to 39.7 ms, depending on filter mode). The Level 1 data files are then validated by using a set of plots and time analysis routines to check for the goodness of the time tags and to verify that the science data are not corrupted. Once validated, the Level 1 data files are made available on the Cluster WBD home page and written to DVDs. These DVDs are distributed once per month to the WEC data centers in France, Sweden and the United Kingdom and to Stanford University and Southwest Research Institute in the U.S. They contain the validated WBD waveform data, explanation documentation about the instrument, its modes and its calibration, and the calculated time tags described above, as well as software programs that easily and quickly can be used by anyone to read, calibrate and write out the WBD data. At this point the data are now ready for use by the scientific community. A scientist can either create plots or download WBD digital data files in text mode through the Cluster WBD website (http://www-pw.physics.uiowa.edu/cluster/) under the “Digital Data Download Tool” link or download the Level 1 files and accompanying software from one of the remote sites to their home site and use the supplied simplified software programs to read, calibrate and write out the WBD science data for analysis using their own analysis and plotting software. For a current listing of publications, including peer-reviewed journal and proceedings articles and graduate and undergraduate degree theses, in which WBD data were highlighted, please refer to the Cluster WBD website (http://www-pw.physics. uiowa.edu/cluster/publications.html). One important factor to keep in mind with regard to the WBD instrument is that it is dependent on real time reception on the ground by either DSN or PV. Except for a few periods during the Cluster mission, the spacecraft are too widely separated in space for any one antenna on the ground to pick up the signals from at least two spacecraft simultaneously (called MSPA, or Multi-spacecraft Per Aperture). Therefore, we are dependent on having at least one ground antenna available per Cluster spacecraft. Obtaining simultaneous WBD coverage from four spacecraft is thus somewhat limited and only possible at either the DSN Goldstone or Canberra complexes where at least four antennas are available and by prior negotiations, not in conflict with the needs of other missions. In the planning stage of WBD operations, science targets are defined based primarily on the needs of WBD and WEC. DSN then schedules reception of WBD data during some of these science target periods, providing, by agreement, about 2 h per spacecraft per 57-h orbit, or about 24 h per week. DSN provides as much simultaneous coverage from the four Cluster spacecraft as possible given the numerous constraints placed on WBD operation by ESOC and resources available at DSN within the context of its many other missions. PV has at most two available antennas, and usually captures 20 h of WBD data per week. Operations are greatly constrained at PV by the higher priority operations of the
11
Cluster Wideband Data Products in the Cluster Active Archive
173
Cluster spacecraft (uploading commands and downloading all other recorded data) when the ground stations they use are in view of the Cluster spacecraft. These constraints are also applicable to DSN reception of WBD data but are not as severe as at PV because DSN visibility of the Cluster spacecraft does not overlap as greatly with the ground stations used by ESA for Cluster. WBD data can be recorded onboard in a special burst mode (BM2) with either one-third the bandwidth or at one-third the duty cycle of the chosen WBD filter. This mode has only been used once for 1 h on March 7, 2001 because the Whisper instrument gets no data and all the other instruments have reduced telemetry rates. In the remainder of this paper, we first provide an example of WBD data and briefly discuss the types of studies for which WBD is ideally suited. Then we describe the documentation, software and Iowa-generated data plots archived at the CAA, followed by a brief description of some of the interpretation issues related to analyzing WBD data. We follow this with a discussion of our plans for eventually archiving the WBD data in cef format at the CAA as is done for all other Cluster instruments. We close with a brief description of the cross-calibration activities with respect to the WBD data.
11.2 WBD Data and Science Investigations WBD data are best suited for detailed analysis of the fine structure of linear and nonlinear waves observed throughout the Cluster orbit in support of: WEC scientific objectives by providing information about the fine structure of
the waves observed by the other WEC instruments WBD-specific objectives such as Very Long Baseline Interferometry (VLBI) and
cross-spacecraft waveform correlation These science objectives are discussed in more detail in the WBD instrument paper of Gurnett et al. [1] and in the Cluster WBD first results paper of Gurnett et al. [2]. An example of a two spacecraft WBD observation of fine structured triggered emissions (hooks) is shown in Fig. 11.2. In the spectrogram of Fig. 11.2a we see a series of seven prominent riser/hook combinations on both spacecraft, with those seen on spacecraft 2 being slightly before and more intense than those on spacecraft 4, suggesting that the source is closer to spacecraft 2. When we look at a short 10 ms section of the filtered waveforms in Fig. 11.2b, FIR filtered to retain only the 2–3 kHz components, taken near the top of the correlated hook pointed out in the spectrogram, we can easily see these same correlations with respect to the wave packets and the shape of their envelopes, which is quite remarkable. At this time the spacecraft are separated by about 150 km and located at 4:4 RE , 12ı Magnetic Latitude and 16.8 Magnetic Local Time. This example points out the beauty of the WBD instrument, i.e., the capability to resolve the fine structure of waves in both the time and frequency domains.
174
J.S. Pickett et al.
a
Cluster WBD 9.5 kHz
V2m-2Hz-1 10-11
4
3
SC2 Salsa
Ez Frequency [kHz]
Hook
2
10-12
10-13
1
0
10-14
4
10-11
SC4 Tango
Ez Frequency [kHz]
Hook 3
2
10-12
10-13
1 10-14
0 03:45:05
03:45:10
03:45:15
03:45:20
03:45:25
b Filtered Waveforms from Center of Hook
Fig. 11.2 Example of high frequency and time resolution WBD data showing several hooks, which are a triggered emission. (a) Spectrograms from two Cluster spacecraft showing the cross spacecraft correlation of hooks. (b) Filtered waveforms of a part of one hook showing the cross spacecraft correlation. Adapted from Pickett et al. [3]
11
Cluster Wideband Data Products in the Cluster Active Archive
175
11.3 WBD Products Currently Archived at the CAA WBD has already archived documentation, software and plots at the CAA for the first 4 years of the Cluster mission. Below we briefly describe each of these products.
11.3.1 Documentation The following general documents, with their format specified in brackets following the document name, have already been made available at the CAA. They are accessible through the “Documentation” link on the CAA home page by selecting “ICD and Publications” under the Cluster Instrumentation section. WBD ICD [pdf ], the WBD Interface Control Document, which supplies detailed
information about the WBD instrument and its various modes, references to other instrument documents, and contact information regarding the WBD investigation Listing of Coordinated Cluster WBD/PEACE Chorus Operations [html], which supplies the times when WBD and PEACE carried out coordinated observations of chorus emissions for the purpose of investigating the generation of chorus and wave-particle interactions Listing of Coordinated Cluster WBD/WHISPER/PEACE Nonthermal Continuum Operations [html], which supplies the time when WBD, Whisper and PEACE carried out coordinated operations for studying the generation and propagation of Nonthermal Continuum Listing of Other Special Operations (HAARP, IMAGE RPI Transmissions, Mutual Impedance tests) [html], which contains times when WBD carried out coordinated operations with HAARP (a ground facility located in Alaska for temporarily modifying a limited portion of the ionosphere), with the IMAGE spacecraft when the RPI instrument was transmitting at high frequency and the WBD instrument was observing the transmissions a few RE away, and with the Cluster WHISPER instrument, which was actively working in the mutual impedance mode Cluster WBD Interpretation Issues [pdf ], a document that details most of the known interferences and other non-natural features that might possibly be observed and misinterpreted in the WBD data (see Section 11.4 below) WBD Raw Telemetry to Calibrated Values Conversion [pdf ], a document that describes the calibration function for the WBD instrument
In addition, several documents that are included on every WBD Level 1 data DVD are available as follows: Instrument Description [txt] Description of the format of the Cluster WBD LEVEL1 data files contained on
the Level 1 DVDs [txt] Description of the contents of a Level 1 data DVD volume [txt] List of known problems and anomalies in the data [txt]
176
J.S. Pickett et al.
Fig. 11.3 Sample of a small section of a WBD “Coverage” listing (from file wbd mop. jan apr2002)
Description of the origin of time stamps, their accuracies, and their preferred
applications [txt] Finally, some very useful WBD documents for identifying WBD intervals for scientific study are the two types of listings of when WBD data have been taken, the WBD mode in which they were taken, etc. “Coverage” files in text format, which can be used to check if WBD data are
available at the time of a user’s interest and in the preferred mode, along with a document describing the format. File names contain the start and ending month followed by the year, e.g.: wbd mop.jan apr2002, where “mop” stands for mission operations phase. Note that listings for 2000 and 2001 contain all months. A sample from one of these files is shown in Fig. 11.3. “Science Summary” files in html format, which show times of WBD data coverage, instrument mode, science target (orbital region such as bow shock, magnetopause, etc. or wave emission) and information about active experiments (EDI, ASPOC) during the coverage period (i.e., if active and level of interference, if any). These files can be used to obtain a subset of WBD coverage times that fit specified investigation criteria. File names contain the two-digit year, followed by the inclusive months (as numbers), e.g.: scidatarec 02 1-3.html.
11.3.2 Software The following software and associated documentation are available through the “Team Software” section of the “Software” link, as well as from the
11
Cluster Wideband Data Products in the Cluster Active Archive
177
“Documentation” link on the CAA home page. All WBD software and associated documentation will be downloaded as a zip file. EXAMPLES Directory: EX README.TXT: Explanation of how to use the software CLOG.C: Example C code to output a list of all data modes contained in a Level1
file (if no mode changes, only one line is output) PARSETIME.C: C code used to parse the data (needs to be linked to
RD WBD WF.C) RD WBD WF.C: Example C code to read the Level1 data files and output the
calibrated data in binary format WBDL1LIST.C: Example C code to extract and list most fields contained in the
Cluster WBD Level 1 file records WBDL1.H: Contains macros, tables, etc. for use in processing Cluster WBD
Level1 data MAKEFILE: Converts to Unix-friendly format, compiles the programs, runs the
test programs, and outputs data 03082749.9C1: Test WBD Level1 data file WBDL1LIST03082749 9C1.TXT: Output listing of all field values in file CLOG03082749 9C1.TXT: Output listing of all data modes found R WBD WF0308271001.TXT: Output Data File (waveform data only)
CALIBRATE.C: C code to calibrate the WBD Level 1 data. Note that the calibration is applied in the time domain and is thus frequency independent. The electric field calibration assumes a physical antenna length of 88 m, whereas the effective length may in fact be less than that in some regions and at some frequencies. Units for electric field are mV/m. The magnetic field calibration is in nT. FIX SC2.C: C code to identify known bad data points in the time series and average across adjacent points for spacecraft 2 data. This problem originates within the Onboard Data Handling system and was discovered from data obtained while spacecraft 2 was on the launch pad and thus not possible to be fixed.
11.3.3 WBD Plots Two types of WBD plots serving different purposes have been generated at The University of Iowa and archived at the CAA. Overview Spectrograms: Used to identify events for in depth study and are generally not meant to be
published. Generally range from about 0.5–6 h (see example in Fig. 11.4). Show WBD spectral data (via FFT on ground) from all spacecraft being sampled
for the data overview interval (see full plot description in WBD ICD). Obtained by following the “CAA Quicklook Plots” link on the CAA home page,
selecting the Plot Type, CM CG WBD SPECPLOT OVERVIEW PNG, and entering a plot start time (the first plot with a start time later than the chosen start time will be displayed).
178
J.S. Pickett et al. Cluster WBD 9.5 kHz DSN
R
V2m-2Hz-1 -10
SC1 Rumba
6 4 2
SC2 Salsa
10 8 6 4 2
SC3 Samba
10 8 6 4 2 10 8
E MLAT MLT L
SC4 Tango
Ey Freq. [kHz] Ez Freq. [kHz] Ez Freq. [kHz] Ez Freq. [kHz]
NOT FOR PUBLICATION : Plot intended for browse purposes only since cyclic 42-second data intervals are dilated across 10-second data gaps throughout.
FFT Size 1024 (Overlap 0) 10 8
6 4 2 07:30
08:00
08:30
5.04 -38.42 21.55 8.20
4.68 -25.57 21.34 5.80
4.44 -10.74 21.14 4.60
09:00 4.35 5.44 20.95 4.40
09:30 4.42 21.78 20.76 5.10
10:00 4.64 37.09 20.58 7.30
10 -11 10 -12
10 -13 10 -14
10 -15 10 -16 10-10 10 -11 10 -12
10 -13 10 -14 10 -15
10 -16 10-10 10 -11 10 -12 10 -13 10 -14 10 -15 10 -16 10-10 10 -11 10 -12
10 -13 10 -14 10 -15 10 -16 10
10:30 4.99 50.60 20.40 12.40
UIowa 060227
UT_OBT: 2002-04-18T07:13:00 to 2002-04-18T10:36:00
Fig. 11.4 Sample WBD Overview spectrogram
Available as png files with the date, start time of the data and version provided in
the file name, e.g.: CM CG WBD SPECPLOT OVERVIEW PNG 20020418 1036 V00.PNG Postscript versions generated by Iowa and archived at the CAA will eventually be available from the CAA home page. CAA currently contains overview plots for 1 Feb 2001 thru 31 Jan 2005 (will be expanded as resources and time permit; see Section 11.5). High Time Resolution Spectrograms: Used to resolve the fine structure of waves. Cover a 30-s time span with full resolution (no averaging) (see example in
Fig. 11.5). Provide WBD gain and mode information, spectral data (via FFT on ground)
from only one spacecraft, start date and time, and ephemeris data (see full plot description in WBD ICD). Obtained by following the “CAA Quicklook Plots” link on the CAA home page, selecting the Plot Type, C CG WBD GIFPLOT, where is the number of the Cluster spacecraft of interest, ranging from 1 to 4, and entering a plot start time (the first plot with a start time later than the chosen start time will be displayed).
11
Cluster Wideband Data Products in the Cluster Active Archive
Gain (dB)
30
40
50
179 00
DATA MODE 80 60 40 20 0
80 60 40 20 0
DSN Filter DC ANTENNA Ez Bx By Ey RESOLUTION 8-bit 4-bit 1-bit
dB
–70
10
10 Frequency (kHz)
–80 –90 –100
5
–110
5
–120
2002 108 09:10: 30.000 (18 April) Cluster - C4
TRANSLATION 0 kHz 125 kHz 250 kHz 500 kHz
RE
4.4 MLAT 11.2 MLT 20.9 L 4.5
0
0 30
40
50
00
Time (sec)
Fig. 11.5 Sample WBD High Resolution Spectrogram showing the gain and instrument mode at the top, date and start time at right, and ephemeris data in the lower right
Available as gif files, with the date and start minute followed by the date and
end minute and version number contained in the file name (if the start and end minutes are identical, the plot covers 00 to 30 s of that minute, whereas plot names with different start and end minutes have plots starting at 30 s of the start minute and ending at 00 s of the end minute) e.g.: C4 CG WBD GIFPLOT 20020418 0910 20020418 0911 V00.gif CAA currently contains overview plots for 1 Feb 2001 thru 31 Jan 2005 (will be expanded as resources and time permit; see Section 11.5).
11.4 Interpretation Issues with WBD Data In certain regions of the orbit and during certain planned operations, interference from other instruments and/or spacecraft systems affects the WBD measurements. At these times one must use caution so as not to misinterpret the WBD data. In addition certain design features of the WBD hardware and software and of the electric antenna that is used by WBD make the WBD instrument (1) vulnerable to nonlinear effects in the form of harmonic generation under certain environmental conditions
180
J.S. Pickett et al.
and (2) susceptible to distorting waveforms when measuring specific types of waves, most notably solitary waves. In these cases, extreme caution must be used when analyzing the data. We have created an “Interpretation Issues” document that describes most of these interferences and instrument limitations and shows how they are manifested in the data through actual WBD data examples. This document is available for download through the CAA Documentation link (see Section 11.3.1 above). The list of issues currently covered is:
Electron Drift Instrument (EDI) interference Gain change effects within the WBD receiver Spacecraft battery interference Spacecraft power bus interference WHISPER Sounder interference DWP 900 Hz clock interference Periodic interference patterns of unknown origin, which are probably not naturally-occurring plasma emissions (see example in Fig. 11.6) Waveform distortion by the WBD receiver (see Section 11.6) Harmonic generation due to clipping (amplitude of received signal greater than that allowed by the 8 bit system, but receiver not in saturation) and due to amplitude saturation resulting in nonlinear effects Cluster WBD 9.5 kHz
9.5 9.0 11.0 10.5 10.0 9.5 9.0 11.0
10-16
10-16
10-17 10-15
10.0 9.5 9.0 11.0 10.5 10.0
09:35:00 5.47 -53.61 22.62 15.50
09:35:05 5.46 -53.58 22.62 15.48
09:35:10 5.46 -53.55 22.62 15.45
09:35:15 5.46 –53.53 22.62 15.43
09:35:20 5.46 -53.50 22.62 15.40
SC3 Samba
10-17 10-15
10.5
9.5 9.0 09:34:55 RE 5.47 MLAT-53.63 MLT 22.62 L 15.52
SC1 Rumba
10.0
10-16
SC4 Tango
Ez Freq. [kHz] Ey Freq. [kHz] Ez Freq. [kHz] Ez Freq. [kHz]
10.5
SC2 Salsa
V2m-2Hz-1 10-15
FFT Size 1024 (Overlap 0) 11.0
10-16
10-17 10-15
10-17 09:35:25 5.46 -53.47 22.62 15.38 UIowa 080912
UT_OBT : 2002-04-06T09:34:55 to 2002-04-06T09:35:25
Fig. 11.6 Sample Spectrogram of interference of unknown origin but probably not natural
11
Cluster Wideband Data Products in the Cluster Active Archive
181
11.5 Plans for Archiving WBD Digital Data Files Currently, it is not possible to download the WBD digital calibrated waveform data in cef format from the CAA. A link (“CLUSTER WBD Digital Data Download”) is provided under the WBD section of “Team Software” under the “Software” link from the CAA home page. This link will take the user to the Cluster WBD home page located at The University of Iowa. Data in text format will be made available for download. These download files currently provide a header containing the spacecraft name, start time and date of the data requested, description of the parameters contained in each column in the data which follow and a description of how to convert the data to the frequency domain via a standard FFT routine. The data columns provide the time since the defined start time, the calibrated data point, a flag indicating whether the data point is clipped (original raw value of 0 or 255) or not, the instrument mode (filter bandwidth, conversion frequency, gain, antenna selected and resolution), and the sampling frequency which is required for FFT analysis (different filter modes have different sampling frequencies; see Gurnett et al. [1]). NASA has just recently made available to The University of Iowa funds for WBD data archiving at NASA Goddard Space Flight Center’s CDAWeb (http://cdaweb. gsfc.nasa.gov). We envision that the archived WBD data files will each be 10 min in length and contain all of the parameters currently available from the Digital Data Download tool at Iowa discussed above, as well as auxiliary parameters such as the angle between the magnetic field and the antenna WBD is using to make the measurement, and the two angles defining the orientation of this antenna in a GSE coordinate system. Pursuant to standard cdf formatting, these files will also contain information about the data set, pertinent references, and information on how to reverse calibrate the data in order to analyze the raw data numbers (0 to 255) returned by the instrument. Once the cdf files have been generated they will be made available to the CAA for conversion to cef format and archiving at the CAA. We expect that the first files should be available to the CAA as early as May 2009.
11.6 Cross Calibration Activities WBD has participated in the following cross calibration activities:
11.6.1 Waveform Waveform cross calibration carried out with EFW, which identified some timing, sign (of E-field) and receiver response issues (see WBD report at the February 2006 Cross Calibration Workshop available through the CAA website). The timing and sign issues have since been corrected. With regard to WBD receiver response issues, this primarily concerns WBD response to pulses observed in the data. This is a
182
J.S. Pickett et al.
serious issue if one wishes to use the WBD data to study solitary waves or impulsive bursts of data. Some guidelines in this regard are provided in the document “WBD Response to Bipolar and Tripolar Pulses: Bench Tests vs. in Flight Observations”, by J. M. Swanner, J. S. Pickett, J. R. Phillips, and D. L. Kirchner, which is available in pdf format for download from the CAA website by following the “Documentation” link, then the “ICDs and Publications” link, to the WBD section.
11.6.2 Power Spectral Density Power Spectral Density cross calibration was carried out with WHISPER and STAFF-SA (see WHISPER report at the February 2006 Cross Calibration Workshop available through the CAA website). While the agreement with WHISPER was good, it was not good with regard to STAFF-SA in the overlapping frequency ranges. An investigation of this disagreement is ongoing.
11.6.3 Density Density cross calibration was carried out with PEACE and EFW of densities in low density regions, more specifically the magnetotail (e.g., see WBD reports at the February and May 2006 Cross Calibration Workshops available through the CAA). The method that WBD uses to obtain densities in these regions is to identify the L-X mode cutoff at L D 0 around a few kHz in time and frequency spectrograms. Provided the plasma frequency, fpe , is hgreater than the cyclotronifrequency, fce , this 1=2 frequency cutoff, FL , is equal to 1=2 fce C fce 2 C 4fpe 2 or approximately fpe – 1=2 fce . Thus, fpe FL C 1=2 fce , and ne .fpe =9/2 , where ne is the plasma density in cm3 and fpe is in kHz.
11.7 Summary All of the WBD documentation, software, overview and high time resolution plots, and digital data files necessary for any scientist anywhere in the world with internet access to the Cluster Active Archive to carry out independent science investigations are described above. We encourage such investigations and remain available to answer questions and/or participate in these investigations. The WBD observations, together with the observations from all of the other Cluster instruments, provide a unique observatory for answering many of the still outstanding questions with respect to the various boundary layers, the inner magnetosphere, magnetic reconnection, and substorms, as well as the auroral acceleration region from Cluster crossings of this region beginning in 2009.
11
Cluster Wideband Data Products in the Cluster Active Archive
183
Acknowledgements The authors would like to acknowledge support for this work from NASA Goddard Space Flight Center under Grant NNX07AI24G.
References 1. Gurnett DA, Huff, RL, Kirchner DL (1997) The Wide-band plasma wave investigation. Space Sci. Rev 79:195–208 2. Gurnett DA, Huff RL, Pickett JS, Persoon AM, Mutel RL, Christopher IW, Kletzing CA, Inan US, Martin WL, Bougeret J-L, Alleyne H St C, Yearby KH (2001) First results from the Cluster wideband plasma wave investigation. Annal Geophys 19:1259–1272 3. Pickett JS, Santol´ık O, Kahler SW, Masson A, Adrian ML, Gurnett DA, Bell TF, Laakso H., Parrot M, D´ecr´eau P, Fazakerley A, Cornilleau-Wehrlin N, Balogh A, Andr´e M (2004) Multipoint Cluster observations of VLF risers, fallers and hooks at and near the plasmapause. In: Sauvaud JA and N˘emeˇcek Z, (Eds), Multiscale processes in the Earth’s magnetosphere: From Interball to Cluster, Kluwer Academic Publishers, Netherlands, 307–328
Chapter 12
The WHISPER Relaxation Sounder and the CLUSTER Active Archive J.G. Trotignon, P.M.E. D´ecr´eau, J.L. Rauch, X. Valli`eres, A. Rochel, S. Kougbl´enou, G. Lointier, G. Facsk´o, P. Canu, F. Darrouzet, and A. Masson
Abstract The Waves of HIgh frequency and Sounder for Probing of Electron density by Relaxation (WHISPER) instrument is part of the Wave Experiment Consortium (WEC) of the CLUSTER mission. With the help of the long double sphere antennae of the Electric Field and Wave (EFW) instrument and the Digital Wave Processor (DWP), it delivers active (sounding) and natural (transmitter off) electric field spectra, respectively from 4 to 82 kHz, and from 2 to 80 kHz. These frequency ranges have been chosen to include the electron plasma frequency, which is closely related to the total electron density, in most of the regions encountered by the CLUSTER spacecraft. Presented here is an overview of the WHISPER data products available in the CLUSTER Active Archive (CAA). The instrument and its performance are first recalled. The way the WHISPER products are obtained is then described, with particular attention being paid to the density determination. Both sounding and natural measurements are commonly used in this process, which depends on the ambient plasma regime. This is illustrated using drawings similar to the Bryant plots commonly used in the CLUSTER master science plan. These give a clear overview of typical density values and the parts of the orbits where they are obtained. More information on the applied software or on the quality/reliability of the density determination can also be highlighted. J.G. Trotignon (), P.M.E. D´ecr´eau, J.L. Rauch, X. Valli`eres, A. Rochel, S. Kougbl´enou, G. Lointier, and G. Facsk´o Laboratoire de Physique et Chimie de l’Environnement et de l’Espace, Universit´e d’Orl´eans, Orl´eans, France e-mail:
[email protected];
[email protected];
[email protected];
[email protected];
[email protected];
[email protected];
[email protected];
[email protected] P. Canu Laboratoire de Physique des Plasmas, V´elizy, France e-mail:
[email protected] F. Darrouzet Institut d’A´eronomie Spatiale de Belgique, Bruxelles, Belgique e-mail:
[email protected] A. Masson RSSD, ESA, Noordwijk, The Netherlands e-mail:
[email protected] H. Laakso et al. (eds.), The Cluster Active Archive, Astrophysics and Space Science Proceedings, DOI 10.1007/978-90-481-3499-1 12, c Springer Science+Business Media B.V. 2010
185
186
J.G. Trotignon et al.
12.1 Introduction The CLUSTER Active Archive (CAA) has been created to house data delivered from all of the CLUSTER instruments and to make these data available to the wide scientific community [18] In this context, the WHISPER (Waves of HIgh frequency and Sounder for Probing of Electron density by Relaxation) team provides two principal types of data: the total electron density at standard time resolutions of either 2.15 or 52 s, and electric field spectra in the frequency range 2–82 with time resolution 1.7 or 3.4 s. The total wave energy in the range 2–80 kHz is also provided with higher time resolutions. The density can be deduced from the characteristics of natural waves monitored whenever WHISPER is in natural mode (transmitter off) and/or from resonances triggered in the sounding mode. After a brief description of the instrument design and operation (Section 12.2) the data products ingested into CAA (Section 12.3) and some of the cross calibration activities (Section 12.5) are presented. The way the electron density is determined is then recalled (Section 12.4) with, as far as possible, a particular attention paid to the reliability, accuracy and degree of confidence (Sections 12.4 and 12.6).
12.2 WHISPER Instrument Design and Performance The WHISPER experiment results from a collaboration between experimenters organised within the context of the Wave Experiment Consortium, WEC, which includes five instruments ([15, 26] esp. Sects. 1 and 4). The WHISPER instrument [6,7] consists basically of a receiver, a transmitter, and a wave spectrum analyser, associated with parts of two other WEC instruments: the sensors of the Electric Field and Wave, EFW, experiment and data processing functions of the Digital Wave Processing, DWP, experiment. WHISPER is devoted to the survey, active and natural, of the WEC electric signal in the frequency range from about 2–82 kHz, which includes electrostatic and electromagnetic natural emissions of interest to the CLUSTER objectives, in particular in the vicinity of the plasma frequency from which the total electron density may be determined. Let us note that one of the main functions of the WHISPER experiment is to provide reference values of this fundamental plasma parameter. Two modes of operation are used alternatively. The natural wave mode, when the transmitter stays on stand-by, and the sounding mode during which the transmitter triggers plasma resonances prior to reception. In both cases, a pair of EFW sensors is used as a double-sphere electric dipole antenna, whose potential difference is band-pass filtered, digitised, multiplied by a windowing function (to make the signal periodic), and finally analysed in frequency by an onboard FFT processor which computes a full frequency spectrum every 13.33 ms (40 ms/3) in normal telemetry operation (normal mode, NM), and in most burst mode (BM) usually every 26.6 or 40 ms (two or three times the basic WHISPER recurrence period of 13.33 ms). The spectrum covers the 0–83 kHz band in 512 bins or 256 bins, with a frequency
12
The WHISPER Relaxation Sounder and the CLUSTER Active Archive
187
resolution of 162.8 Hz (Fech= 1024 with the sampling frequency Fech = 1 MHz/6) in the 512-bin FFT option or 325.5 Hz in the 256-bin FFT option. The modulus of the complex amplitude in each bin is calculated, while the associated phase information is discarded. These spectral amplitude (moduli) are used for all subsequent onboard calculations. This choice of amplitude (rather than power) may appear curious, but there was a strong technical constraint: the dynamic range of the spectral power exceeds the dynamic range (limited by the word length) of the processors used by WHISPER, and also by DWP which, in some modes of operation, performs processing for WHISPER. The difference in the results obtained by summing the squares and summing the amplitudes is not large (less than 2 dB) for a wide-sense-stationary random process. A few bins are not transmitted to the CLUSTER telemetry (due to limited TM resource and input signal filtering), which explains why the 0–83 kHz band is not fully covered in the WHISPER data (as the WHISPER spectrum data size is always 512 in CAA, the missing bins are set to the -1.0 fill value). In natural wave mode, successive spectra are accumulated onboard over intervals of 0.213 s (16 times 13.33 ms) to 0.853 s (64 times 13.33 ms) when in NM mode and of 0.107 s (8 times 13.33 ms) to 0.213 s (16 times 13.33 ms) when in BM mode, thus smoothing sporadic features and improving the signal to noise ratio. Moduli of the same frequency are thus summed onboard while averages are computed on ground. Each accumulated modulus is compressed quasi-logarithmically to a 6-bit word (or 8-bit word). At regular time intervals, one of these accumulated spectra is selected and transmitted to ground: between one out of ten and one out of two in NM mode, resulting in a time resolution in the range 1.7–3.4 s; and one out of three in BM mode, resulting in a time resolution of 0.320 or 0.640 s. In all natural telemetry modes, the measured integrated power in the band 2–80 kHz, prior to windowing and FFT processings, is accumulated over each time acquisition, forming a quantity called “Energy”, available every 13.33 ms. In one option, available in BM telemetry, time series of “Energy” are transmitted to ground at full time resolution (13.33 ms), after a quasi-logarithmic compression of the “Energy” values to 8 bits (3 bits for the mantissa and 5 bits for the exponent; mantissa and exponent are described in Section 12.3.1). Otherwise, these “Energy” values are accumulated aboard over the same time interval as for the onboard accumulated-spectra. These values, also quasi-logarithmically compressed to 8 bits, are transmitted to the ground without further selection, i.e. with a time resolution better than that of the transmitted-to-ground accumulated spectra, by a factor between two and ten in NM telemetry mode and up to 48 in BM. In sounding mode, a signal acquisition is performed a few milliseconds (4.9 or 5.2 ms) after transmission of a sounding pulse, the listening duration is at least 6.14 ms, which is compatible with a sampling frequency of 166.66 kHz and a 512-bin FFT. The sounding pulse is a short sinusoidal wave train whose frequency sweeps the 4–82 kHz band, or less depending on the operating mode, in steps of 976.6 Hz (1 MHz/1024) when the wave train duration is 1.024 ms and of 1953.1 Hz when the wave train duration is 0.512 ms. The spectral width of the emitted pulse is the inverse of its duration, and consequently the pulse can trigger all the characteristic frequencies of the medium within a band of 1 or 2 kHz around the pulse
188
J.G. Trotignon et al.
frequency. The high spectral resolution of the FFT receiver allows the triggered frequencies to be identified as resonances, i.e. as very intense echoes which are strongly monochromatic and correspond to frequencies for which the group velocity is very small and close to the spacecraft velocity [3, 10]. In natural wave mode, the measured antenna potential difference is processed by FFT to compute a full frequency spectrum every 13.33 ms, while in sounding mode this computation is performed after every emission of a sounding pulse, at intervals equal to the step duration, 26.6 or 40 ms in most cases (two or three times the basic WHISPER recurrence period of 13.33 ms). As the telemetry resource does not allow all the onboard computed spectra to be downloaded the following compression strategy has been applied. It consists in selecting, in each full (0–83 kHz) spectrum associated to each sounding wave train, only the bins whose frequency is inside the frequency band (1 or 2 kHz) of the emitted pulse. Those selected frequency bins contribute to a global “active/sounding” spectrum, obtained once the 4–82 kHz frequency sweep has been completed, which is downloaded. Let us note that 80 frequency steps of 976.6 Hz frequency bandwidth are for instance necessary to cover the full WHISPER frequency range. This corresponds to sweep duration of 3.2 s (80 40 ms) in the simplest mode, available as a back up operation option fully managed by the WHISPER electronic module. This back up option has been used on C4 CLUSTER satellite since September 2003, when part of the onboard WHISPER memory failed, probably due to severe environmental conditions. In other operational modes, DWP performs much of the WHISPER data processing. The most frequently used option has the emitter stepping by 976.6 Hz (pulse duration 1.024 ms) in the lower part of the frequency range, and by 1,953.1 Hz (pulses of 0.512 ms) at higher frequencies. With a step duration of 26.6 ms at all frequencies, the overall sweep duration is less than 1.5 s, which permits two sweeps within 3 s of a total sounding time interval. Other modes are available, with sweep duration between 0.5 and 10 s. Active spectrum values (moduli) are compressed quasi-logarithmically to 8-bit words before being transmitted to ground. In addition to the frequency bins retained in each frequency step to construct a sounding spectrum (usually 6 bins, 162.8 Hz in bandwidth), bins whose frequency is far away from the sounding frequencies may also be retained as part of a ‘passive’ spectrum. As a consequence, whenever a sounding sweep is complete, both a sounding spectrum and a passive spectrum may be available. In addition, provided the retained passive bins (again usually 6 bins, 162.8 Hz in bandwidth) are those whose frequencies are the same as the ones that will be covered, by the next transmitting pulse frequency, i.e. in the next frequency step of the current weep, the time delay, for a given frequency, between passive and sounding measurements becomes very short (less than 40 ms). The WHISPER relaxation sounder has been designed in order to avoid, or at least minimize, any corruption between natural and sounding measurements, and also between sounding measurements. In particular, transmitted frequencies are swept in appropriate orders, described in tables chosen by command, in such a way that several consecutive transmitting pulses never have central frequencies close together. Passive measurements associated with sounding measurements are therefore not
12
The WHISPER Relaxation Sounder and the CLUSTER Active Archive
189
influenced by long lasting resonances and no perturbations are expected between two successive sounding steps. Analysis on the ground of the resonance pattern observed in active spectra (plus comparison with the associated passive spectra when available) allows the identification of characteristic frequencies of the surrounding plasma (see Section 12.4.1 and 12.4.2), in particular the plasma frequency Fpe , and hence the total electron density Ne D Fpe2 =’ where ’ is a constant: ’ D e 2= .4 2 ©o m/ D 80:7 Hz2 =cm3 . The sounding mode is operated alternately with the natural wave mode, with all four spacecraft following closely the same time line. Typically, 3 s (or 4 s) of sounding mode (two sweeps in frequency) are followed by 49 s (or 100 s) of natural wave mode, leading to a standard 52 s (or 104 s) sounding recurrence time. After September 2003, C4 CLUSTER spacecraft operates always at a 104 s sounding recurrence. In the standard (most frequently used) sounding cycle, the four spacecraft sound simultaneously every 104 s, and C1, C2 and C3 also sound 52 s later, but C4 does not transmit, it continues to monitor natural waves. Such a duty cycle is used for all WEC operations, both in nominal (NM) telemetry mode and in burst (BM) mode, when the time resolution of natural wave measurements is, on average, improved by a factor 5. WHISPER data are usually presented in the form of dynamic spectrograms, in which the electric-field intensity is plotted as a function of time (abscissa) and frequency (ordinate) using a colour code. The spectrograms bear important information about explored regions. The characteristic signature of natural or actively triggered waves indicates the nature of the ambient plasma regime and, combined with the spacecraft position, reveals the position of key magnetospheric boundaries encountered during a specific time interval. Fig. 12.1 shows typical signatures encountered by CLUSTER. The yellow ellipses indicate natural emissions: (a) faint escaping non-thermal continuum radio waves, (b) continuum enhancement [8], (c) Type III solar radio burst and (d) magnetosheath low frequency turbulence. White arrows show characteristic resonances triggered by the sounder: (1) the plasma frequency WHISPER 3, 9 November 2002
1 a
c
LPCE/CNRS, Orléans
3
2 b
d
Fig. 12.1 One day E-field spectrogram showing typical signatures of natural waves and resonances seen by the CLUSTER/WHISPER relaxation sounder (see text)
190
J.G. Trotignon et al.
at the plasmapause boundary, (2) the electron gyrofrequency and its harmonics and (3) the plasma frequency in the magnetosheath. The plasmapause is recognized by the plasma frequency increasing as the spacecraft enters the plasmasphere near 00.50 UT, then decreasing near 01:50 UT as it exits. The magnetopause position (crossed at 18:50 UT) is indicated by a rapid change in both the plasma frequency and the level of low frequency turbulence.
12.3 WHISPER Data Products in CAA This section describes the WHISPER data products to a level adequate to be able to understand and start using them. Further information may be found in the CAA Interface Control Document for WHISPER [13], and other documents available on the CAA site. All WHISPER data products are validated at LPC2E (Laboratoire de Physique et Chimie de l’Environnement et de l’Espace Orl´eans, France) before being delivered to the archive as CEF files (CLUSTER Exchange Format). Eleven WHISPER datasets are archived at CAA. They fall into four categories: natural waves (one science and one support dataset), energy (two science datasets), electron number density (one science dataset), and sounding (three science and three support datasets), as explained in the following sections.
12.3.1 Natural Waves Related Datasets Most of the time WHISPER observes natural waves in the (2, 80 kHz) band, using one of the two EFW antenna pairs: Ey or Ez. Frequency spectra are obtained by onboard FFT (generally in 512 or 256 frequency bins, but 64 and 128 bins are also possible) with a nominal resolution of 162.8 Hz in 512 bins. Only accumulated bin moduli are transferred to the telemetry. Three gains are available: 12, 24, 36 dB. The 24/12 and 36/24 modes switch automatically from high gain to low gain whenever too many overflows are encountered, overflows being signal samples exceeding the dynamical range of the analog-to-digital converter. Natural wave spectra cannot all be transferred due to TM limitations: compression and selection are therefore required. A number of successive spectra called “average number”, are accumulated bin by bin, and accumulated spectra are transmitted at a rate selected to optimize the use of the TM rate available at the time. Finally, spectral values are compressed logarithmically from 24 bits (DWP word size) to 8-bit or 6-bit words. There are two types of natural wave related datasets: CP WHI NATURAL for natural (accumulated) spectra and CT WHI NATURAL EVENT indicating processing mode changes. Only the first is briefly presented below. The second is an event table, which contains engineering parameters needed to fully understand the associated physical data: for a description please refer to the ICD (2009).
12
The WHISPER Relaxation Sounder and the CLUSTER Active Archive
191
CP WHI NATURAL files contain: the spectrum (central) time; the time uncertainty which is due to accumulation, in s; the FFT size; the EFW receiving antenna actually used; the electric-field spectral power densities computed on ground from accumulated moduli, expressed in V2 m2 Hz1 ; the FFT bin frequencies, given in kHz; an overflow coded value which can vary between 0 (no saturation, i.e. no time samples out of limits before A/D conversion) and 1 (all time samples are out of limits, thus clipped during conversion); the average number, i.e. the number of accumulated spectra; the number of gain changes during acquisition; and the mantissa and exponent sizes of compressed data (usually adjusted to the observed signal dynamical range), which indicate the uncertainty in spectral line moduli due to onboard compression. It is important to recall that electric-field spectral power densities are not quantities directly delivered by the instrument, but are elaborated on ground. We will now follow each step of the conversion from TM words to physical quantities, in order for the user to appreciate the precision and reliability of the data. The parameter measured onboard is the potential difference between the two probes used to form the dipole antenna, which is then analysed spectrally by FFT of successive segments of the waveform, the moduli of the complex Fourier transform being accumulated bin by bin to obtain the values transmitted to the ground. A telemetry word (of 6 or 8 bits) allocated to a bin is divided into two parts, the exponent and the mantissa. Their respective size (for instance 4 bits for the exponent and 2 bits for the mantissa) is the same for all words in the spectrum. Exponent indicates the dynamical range of a bin modulus in a given spectrum. For instance a value of 4 indicates that the number of bit shifts from the largest to the smallest values need 4 bits to be coded, meaning that all values are within a 96 dB range, which accommodates the largest dynamical range possibly encountered in the WHISPER instrument. The mantissa bit size gives the number of significant bits allocated to each bin modulus, thus the uncertainty; for instance a value of 2 yields an uncertainty below 25%. When the dynamical range of bin moduli is small, the exponent size is small (for instance, 2 bits for a range of 18 dB) and the mantissa size allows a high precision (a 4 bits mantissa leads to an uncertainty below 6%). The shift value common to all bins, i.e. the position of largest shift, is indicated via the bin size information (exponent and mantissa sizes) present in the data record of each spectrum. The receiver transfer function (gain in modulus versus working frequency) is known with a similar uncertainty, of order 1 dB, to what is due to onboard compression. The transfer function has been measured on ground with great detail, on each spacecraft and in various environmental conditions. A possible evolution of this quantity exceeding tolerable thresholds would immediately be known to the WHISPER operation team, via results of onboard calibrations activities, run every orbit. Nothing of the kind happened since the start of CLUSTER mission. The same calibration functions have thus been applied on ground since then, translating telemetry words to physical quantities. The total uncertainty attached to the electric field spectral modulus is estimated to be about 2 dB. To determine the electric field, i.e. the physical quantity of interest, the potential difference must be divided by the effective (electrical) length of the antenna. The latter has been assumed to be equal to 100 m tip-to-tip which is the rounded
192
J.G. Trotignon et al.
geometrical length (actually 88 m). While the geometrical length is used widely to convert potential differences to electric-field values, it is only a crude approximation of the effective length. It may be indeed significantly wrong close to characteristic frequencies of the ambient plasma, and possibly too in conditions, natural or instrumental (EFW), which produce an unusual plasma sheath around the antenna. This point is discussed further in Section 12.6. The final operation transforms the electric field spectral moduli to the equivalent spectral power density, while simultaneously taking account of the shape of the Blackman-Harris windowing function applied prior to FFT analysis.
12.3.2 Energy Related Datasets In each natural spectrum acquisition interval, the large band (2–80 kHz) electric potential is sampled over 512 or 1024 time samples (depending on FFT size) which are squared, summed, and transmitted. A compression from 48 to 8 bits is applied onboard, with fixed bit allocations for the exponent and for the mantissa. The dynamical range of the energy parameter, corresponding to the ratio between the largest and smallest measurable values of large band electric-field power, is only 48 dB, due to instrumental limits. The energy parameter is thus especially interesting in case of bursty signals of large amplitudes, and when the selection rate of transmitted spectra is severe. In such cases, it allows to survey the variability of the electric field during the time intervals when spectra are not transmitted. There are two datasets related to ‘energy’ like parameters: CP WHI WAVE FORM ENERGY; and PP WHI. The latter gives, together with an extremely crude estimate of density, the energy in three wide frequency bands (2–10, 10–20, and 20–80 kHz), calculated on ground from available spectra, and the normalized standard deviation of large band electric field power from time samples, calculated on ground.
12.3.3 Sounding Related Datasets As for the natural wave spectra described in Section 12.3.1 not all the active/sounding spectra can be transferred due to TM limitations: compression and selection are thus required. Different strategies can be selected such as: compression of the values (to 8-bit or 6-bit words); reduction of the frequency sweep range; active bins grouped by pairs, with only the greater of each pair being kept, and the missing spectral values being filled by linear interpolation during ground processing prior to archiving; active-to-passive ratios coded on 2 bits and transmitted rather than sending passive data. As described in Section 12.2, whenever a frequency sweep is complete, both an active spectrum and a passive spectrum are available. They are constructed with frequency bins selected in each of the frequency steps that compose the sweep, so that
12
The WHISPER Relaxation Sounder and the CLUSTER Active Archive
193
the time difference, for a given frequency, between a passive bin and an active bin is less than 40 ms. Let us recall that passive spectra have a frequency/time distribution which is significantly different from that obtained in the natural wave modes described in Section 12.3.1. The constructed ‘passive’ spectrum associated with the ‘active’ spectrum can be sent to ground or used to compute active-to-passive ratios that can also be sent to ground, depending on the chosen compression strategy. Comparison of ‘passive’ and ‘active’ conditions at a given frequency during a single frequency sweep is possible because the succession of the frequency steps in a sweep are ranged in such an order as ‘passive’ measurements cannot be perturbed by previous soundings (see Section 12.2). This is a great advantage compared to previous sounder concepts, because the time delay between these passive measurements and the related active ones is here very short (a few tens ms instead of a few s). The 2-bit coding of the active-to-passive intensity ratio is as follows: if (active/2 passive) return 0; else if (active/4 passive return 1; else if (active/16 passive return 2; else return 3). The types of sounding related archives are six in number: CP WHI ACTIVE including sounding (active) spectra CP WHI PASSIVE ACTIVE for associated passive spectra CP WHI ACTIVE TO PASSIVE RATIO, which contains the active to passive ratios (with only four possible values for each bin) CT WHI ACTIVE EVENT to list sounding mode changes CP WHI HK, which gives elementary sounding events extracted from the WEC housekeeping files CP WHI SOUNDING TIMES, which is a simplified version of the above mentioned CP WHI ACTIVE file where only the sweep central sounding time is kept The CP WHI ACTIVE content is recalled below, for the other files please refer to the ICD for WHISPER document (2009). In the CP WHI ACTIVE file, we find the following information: spectrum (central) time; time uncertainty due to acquisition and sweep, in s; the EFW receiving antenna used; the active electric-field spectral power densities, in V2 m2 Hz1 ; FFT bin frequencies, in kHz; scanned frequency table, which gives the transmitted frequencies and the sweep order; sounding pulse length, in ms; time between 2 successive emissions in a sweep; emission/reception delay i.e. the time between emission and reception; number of gain changes; and compression parameters i.e. the mantissa and exponent sizes.
12.3.4 Electron Density Related Dataset Compared with the three previous categories of WHISPER data products, created at CNES, validated at LPC2E, and directly delivered by CNES to CAA, the CP WHI ELECTRON DENSITY file is not a product which can be generated by routine processing (decommutation and conversion into physical units) of WHISPER data. As explained in Section 12.4, the electron density is determined from either the characteristic plasma frequencies at which resonances are triggered when
194
J.G. Trotignon et al.
WHISPER is in sounding mode, or from natural wave signatures, or a combination of both [Chapter 18 of this book, 22, 24]. Density files result from complex procedures which require human intervention and scientific expertise, and therefore they are produced at the laboratory and delivered to CAA on a best effort basis. Are included in the CP WHI ELECTRON DENSITY file: the central time of the spectrum from which the density is derived; the uncertainty time, in s; the spectrum type (Active or Natural); the computational method, i.e. the algorithm and code used; information on the external data used, for example E whenever EFW data are used; the derived electron density value, expressed in cm3 ; the electron density uncertainty, expressed in cm3 , if available (depends on the applied algorithm); a “contrast” factor, between 0 and 1, if available (based on the local contrast of the peak/cut-off, as we will see later).
12.4 Electron Density Determination Process The electron density is determined semi-automatically with the help of a specific tool called FPTool whose working principle is shown in Fig. 12.2. The first step is to visualize input parameters from the four spacecraft, such as the WHISPER active/passive spectrograms, the EFW spacecraft potential and FGM magnetic-field strength. The user is then invited to select a frequency band that includes the plasma frequency signature, a resonance or a clear cutoff, from which the density will be derived [25]. Knowledge of the region (plasma regime) where the spacecraft is located is also highly desirable for a reliable determination; this information may come from the ESOC Predicted Event Times or the dedicated software (MAGLIB) developed at CNES. The next step is to choose and apply the appropriate algorithm (FPTool box in Fig. 12.2) to look at the electron density file (Fp file box in Fig. 12.2) that
Binary WHI Data
FPTool (interactive)
Config. files
FP Computation (automatic)
EFW Archives/PP (Preview) FGM Archives/PP
EDI CRF files
Fp files Archive Generation (automatic)
CAA Act. & Nat. files
CAA Ne files
Fig. 12.2 FPTool flow chart describing how the CAA WHISPER density files are produced
12
The WHISPER Relaxation Sounder and the CLUSTER Active Archive
195
is produced and, if necessary (Preview box in Fig. 12.2), remove erroneous values or select another algorithm. The loop indicated in Fig. 12.2 (FPTool – FP Computation – Preview) is driven until a satisfactory result is obtained. This process has been conceived to minimize large errors in the density estimate, to confirm that the most appropriate algorithm has been applied, and to minimize the time necessary to validate products automatically created.
12.4.1 Density Determination in the Solar Wind and Magnetosheath Only one strong resonance is usually observed at, or close to, the plasma frequency Fpe from which the density Ne is directly derived (see also Section 12.2): Ne Œcm3 D Fpe2 ŒkHz =80:7 In addition, lower cut-off of thermal noise recorded whenever WHISPER is used as a natural wave detector is also a valuable way to determine Ne . Cut-off indeed occurs very close to Fpe . Another way to derive Ne is to combine WHISPER active observations with S/C potential measurements made by EFW and to adjust, at best, the two time series, interval by interval. Pattern recognition processes are therefore applied. Thus, the density (plasma frequency) determination process may be decomposed into three steps: a preprocessing of active spectrograms; a reliable identification of plasma-frequency resonances on active spectra (only peaks with high signal-tonoise ratios are kept); and finally a density extraction from active and/or passive spectra in a frequency band centered on the general trend of the plasma frequency variations. This trend is defined using the previously determined resonance frequencies and interpolation frequencies coming from any cut-off signature and/or a recalibration of the EFW S/C potential. It is worth noting that some of the resonances that were first rejected due to their low signal-to-noise ratios may be finally reselected provided they are in the search frequency band. The two last steps are illustrated in Fig. 12.3. The active spectrogram pre-processing consists in removing the interference signals (perturbations from EDI, spurious signals from the onboard power converter, or DSP bug in the FFT transform for WHISPER). These signals are detected by converting active spectrograms into “peak images” where only spectral peaks are kept [19]. A morphological “opening” operator is applied on the obtained binary images along the “time” dimension. Whenever three peaks are at least located at the same frequency in five contiguous spectra, they are considered as interference signatures, and the five values related to this frequency are then removed and replaced by interpolated values. How to compute the plasma frequency from active spectra? Fpe is usually characterized by a strong resonance. It is therefore given by the tallest peak in each
196
J.G. Trotignon et al.
WHISPER 1, 06 June 2002, Earth’s Magnetosheath
Frequency (kHz)
80 60 40 20
Frequency (kHz)
80 60 40 20
05:00
05:20
05:40
06:00
05:00
05:20
05:40
06:00 UT
Fig. 12.3 Density determination in magnetosheath: top-left panel, WHISPER active spectrogram; bottom-left panel, identified plasma frequency resonances (white full circles) superimposed on active spectrogram; top-right panel, plasma frequency derived from the EFW S/C potential (white line) superimposed on WHISPER natural/passive spectrogram; bottom-right panel plasma frequency (white line) deduced from natural wave lower cut-off superimposed on passive spectrogram
spectrum, provided its intensity (in dB) is at least 0.85 times higher than the intensity (in dB) of the second tallest peak. The Fpe uncertainty is nominally 163 Hz, the best WHISPER frequency resolution. The values obtained are shown in the lower left panel of Fig. 12.3. The “contrast” factor, which is also given in the dataset, reflects the local contrast of the peak. Let P be the tallest peak intensity relative to the background level and M the mean intensity in the 20 frequency bins around the peak, the contrast factor C is simply given by: C D min.P = M 1; 1/ The last step in this example is the use of cut-off signatures and/or EFW S/C potential recalibration. A rough approximation of Fpe may indeed be derived from the S/C potential SP (which is negative) using the empirical relation: Fpe D 9.˛.SP /ˇ /1= 2 ; with, by default, ˛ D 200 and ˇ D –1:85 (if necessary, these values can be adjusted by the operator during the validation process). The resultant Fpe curve is then fitted to the above mentioned extracted resonances by a simple affine transformation. There are now two possibilities: whenever a clear cut-off arises in natural/passive
12
The WHISPER Relaxation Sounder and the CLUSTER Active Archive
197
spectra, its frequency is automatically extracted inside a search band (about 30 frequency bins in width) defined around a Fpe curve that links up the already extracted resonances or the Fpe curve coming from the S/C potential recalibration; conversely, if no natural signature is present at all, the EFW fit itself is given as the plasma frequency. Let us note that the contrast factor is set to the fill value of 1 when the density value is obtained from EFW data. Otherwise, the contrast is an indicator of the contrast of the low cut-off range in the search band. Let M , U , and L be the mean signal magnitudes in respectively, the whole search band, the upper part of the search band (from the cut-off frequency bin returned by the algorithm to the upper limit of the search band), and the lower part of the search band (from the lower limit of the search band to the cut-off frequency bin returned by the algorithm), the contrast factor C is given by: C D max.min..U L/ = M; 1/; 0/ Finally, it may be noted that the cut-off seen in the natural wave spectrograms of Fig. 12.3 is that of the continuum which differs from the thermal noise that has a much narrower bandwidth, within which there is no structure. The fact that the cut-off is close to the plasma frequency can be confirmed here by comparison with the plasma frequency resonances shown in the bottom left panel, this is a great advantage compared with only passive experiments: natural waves may be indeed generated at a considerable distance from the spacecraft and their frequency signatures, such as cut-offs, may thus not reflect local plasma characteristics. Let us also note that in the solar wind and magnetosheath the electron gyrofrequency Fce is too low compared with the plasma frequency Fpe for the upper-hybrid frequency Fuh (if actually triggered) to be distinguished.
12.4.2 Density Determination in the Plasmasphere, Cusp and Tail In the Earth’s magnetosphere, and in particular in the plasmasphere, resonances arise at the electron cyclotron frequency Fce , its harmonics nFce , the electron plasma frequency Fpe , the upper-hybrid frequency Fuh .Fuh D .Fpe2 C Fce2 /1=2 /, and Fqn that correspond to Bernstein electrostatic cyclotron waves with group velocity close to zero .Fqn > 2 Fce and nFce < Fqn < .n C 1/Fce /. A detailed plasma diagnosis can therefore be made from the identification of these resonances, which depend on the magnetic field strength and the total electron density. Two populations of electrons, cold and hot may also be revealed [23]; nevertheless this kind of analysis is too intricate and time consuming to be performed automatically. Consequently, we decided to take advantage of the higher spectral energy density close to Fuh , from which the plasma frequency (and thus the electron density) may be directly derived. It has been indeed established from many observations in the magnetosphere (on ISEE-1 GEOS 1 & 2, Viking) that the resonances, including the n Fce series, are more intense close, and above, the plasma frequency and that the spectral energy
198
J.G. Trotignon et al.
density reached its maximum very close to Fuh [11,21]. The magnetic field strength, and hence Fce , are known either from FGM or from nFce observed by WHISPER (Fce D 28 B, where Fce is expressed in Hz and B in nT). Active spectrograms are first pre-processed to enhance the contrast of resonances: a morphological top-hat operator [20] is first applied to each spectrum and spectra are not normalised [19]. In other words, as usual in image processing the objective is to reduce the noise and to detrend the image while preserving edges in order to highlight peaks. Spectra are then smoothed (Butterworth filter) and the peak frequency of each smoothed spectrum is retained as Fuh , the uncertainty being the half-width at the half-height of smoothed peaks. Let also note that only maxima with intensities at least five times higher than the around background level observed in close natural/passive spectra (10 frequency bins around) are retained. Are also discarded spectra where two or more peaks are observed with similar intensities. The kept points are indicated in green and those who are rejected in black, in the bottom-left panel of Fig. 12.4 The next step is the EFW S/C potential recalibration on the “green” points as described in Section 12.4.1. A search band may then be defined around the obtained Fuh values (the upper and lower limits of this frequency band, shown as red lines in the bottom-left panel of Fig. 12.4, are respectively 0.5 and 1.5 times these values derived from the recalibrated potential). Finally, a new WHISPER 1, 12 January 2003, Earth’s Plasmasphere 6
80
40
40
3
0
0
20
Arbitrary Unit
60
dB
Frequency(kHz)
80
80 60 40
40
dB
Frequency(kHz)
80
20 0 04:00
05:00
06:00
07:00 04:00
05:00
06:00
07:00 UT
Fig. 12.4 Upper-hybrid frequency Fuh determination in plasmasphere: top-left panel, WHISPER active spectrogram; top-right panel, reprocessed active spectrogram to bring out resonances; bottom-left panel, search band (red lines) around the Fuh calculated from the re-calibrated EFW density estimate, Fuh derived from WHISPER resonances (points kept during the first recognition step in green, rejected points in black, new points obtained during the last step of the recognition process in blue); bottom-right panel, final set of identified Fuh (white line) superimposed on active spectrogram
12
The WHISPER Relaxation Sounder and the CLUSTER Active Archive Y Y
Signatures
N
Y
Resonances
Cutoff
N EFW
No Data
Upper cut-off
Active Spectra
N
L
Y
EFW Resonances & EFW filtering
Signatures
N U
199
Lower cut-off around EFW
Y
N EFW
Lower cut-off
Recalibrated Potential
No Data
Natural Spectra
Fig. 12.5 Flow charts of plasma frequency/density recognition algorithms that are applied to WHISPER active (on the right) and natural/passive (on the left) E-field spectra, depending on the availability of EFW S/C potential data and upper or lower cut-off signatures of natural waves
search of spectrum maxima is made in this frequency band, which gives the final set of Fuh values: they are represented in green and blue. The last step of processing calculates Fpe from the pair Fuh and Fce , and finally the density. Figure 12.5 shows the different strategies that can be used to determine the electron density, depending upon the available inputs: resonances, natural wave cut-off signatures, and EFW spacecraft potential measurements It applies to all plasma regimes.
12.5 Cross-calibration Activities WHISPER determines the total electron density from the propagation characteristics of radio waves in a large region of space surrounding the spacecraft, and consequently the satellite potential and the plasma sheath surrounding the spacecraft have negligible effect on the measured density. The PEACE experiment measures the flux of electrons at down to thermal energies, where the correction for the spacecraft floating potential is significant. Therefore there is a strong demand from PEACE for high reliability electron density data from WHISPER, which regularly receives lists of time intervals of particular interest. As these intervals are well in advance of the foreseen WHISPER date for delivering these data to CAA, it was agreed not to interrupt routine WHISPER density production, but to provide for PEACE cross calibration work specially derived accurate and reliable density files which, for convenience, are in a simple ASCII format. The main problems arise from the fact that the requested time intervals, particularly in the cusp and tail regions, are often difficult to interpret and process due to the absence of triggered resonances, the absence of clear signatures in the natural/passive data, and/or strong interferences of various natures. Anyway, the process is not without success and PEACE still continues to ask for new time intervals. For cross-calibration of the magnetic field with FGM and EDI resonances observed by WHISPER in the plasmasphere have been used. These resonances occur
200
J.G. Trotignon et al.
at the electron cyclotron frequency Fce and its harmonics nFce , from which the magnetic field strength may be derived (see Section 12.4.2). An algorithm has been developed [19], leading to a sub-pixel accuracy for the Fce determination, i.e. less than 163 Hz, the highest WHISPER frequency resolution. It is based on the Radon transform technique, commonly used in image processing. This algorithm has been validated on synthetic spectrograms. WHISPER measures Fce (and hence the magnetic field strength) directly, and the only limitation comes from the measurement accuracy. By using the nFce the Fce determination can be much more accurate provided the number of available harmonics is sufficient. Particle instruments have great difficulty in analyzing particle fluxes at thermal energies, which are comparable with the spacecraft floating potential. WHISPER should be of great help for internal calibration of such measurements. Particular attention has therefore to be paid to comparing density evaluations from WHISPER and CLUSTER particle experiments. The same is true for EFW and WHISPER density products [16].
12.6 Discussion and Conclusion The WHISPER relaxation sounder has been designed in such a way that natural wave (passive) and even active measurements cannot be perturbed by long lasting echoes received after transmitted wave trains. We indeed know, since the eighties, that sounder-stimulated resonances can last up to a few 100 ms (see, for example, Figure 12.2 in [21]), it is therefore required not to perform any natural and even active measurements at, or close to, the same frequency of the last transmitted pulse before the echo intensity fades away. To solve this problem, natural wave measurements are always made before active measurements and in active modes the transmitted frequencies are not swept in a regular order, they follows an appropriate order, which is described in a table and chosen by command, where two successive frequencies are always well separated. Finally, let us note that the minimum time separation between WHISPER active and passive operations is 215 ms, i.e. the time separation between the last sounding pulse and the next natural waveform recording: so even for very long lasting resonances no perturbations may be detected on natural spectra due to the averaging process applied before TM delivery. One appreciable advantage of WHISPER instrument, shared by most wave instruments, is that calibration files are stable over the mission lifetime. Conversion of raw spectra to physical units can be performed at an early stage of data handling, immediately after telemetry decommutation. The calibration procedure is still executed once per orbit, to check the instrument’s health. But during the 8 years since launch, the calibration files have never needed any revision. We may note that amplitudes of waves from distant radio sources (type III solar bursts), as measured from the four different WHISPER instruments, are equal to within 1 dB, less than the experimental uncertainty which is estimated to be 2 dB. Furthermore, the conversion of bin number to frequency is well defined due to the high stability of the onboard oscillators, and does not evolve with time.
12
The WHISPER Relaxation Sounder and the CLUSTER Active Archive
201
Contrast Factor
However, a word of caution must be given concerning signal amplitudes. To convert the potential difference measured by the antenna to an electric field a fixed effective antenna length has been used. In reality, the CLUSTER antenna effective length depends on the plasma regime (see [1]). Scientific studies requiring precise signal amplitudes may need a better estimation of the antenna effective length as, for example, in the study of electrostatic waves as a possible cause of the precipitation of the particles associated with diffuse auroras [9]. The intrinsic quality of the main WHISPER data products (high resolution electric-field active/passive spectra, power spectral density, and large band intensity) is considered to be good, except when: (1) There are gaps in the data from one or more of the spacecraft during segments of the orbit where data coverage had been planned (as indicated in the Master Plan). Some gaps affect easily identifiable time intervals, other are irregular and random; (2) WHISPER data are corrupted on one or more spacecraft, possibly due to DWP/EFW/WHISPER bugs; (3) EDI strongly perturbs WHISPER data. EDI Event files indicate time intervals that are potentially affected, and the probable extent of the perturbation. The quality control of WHISPER density products is performed during the production of the plasma frequency. If the plasma frequency determination seems flawed it is corrected when possible, or else discarded. An automatically-computed “contrast” index is associated with each determination (see Section 12.4.1, for example). Examples of contrast factors for density determinations from active and passive data respectively are shown in Figs. 12.6 and 12.7. As Fuh resonances shown in the
0.6
Frequency (kHz)
0.2 Plasmasphere 60
80 Fce
40
dB
Fig. 12.6 Example of the contrast factor associated with the density de