HANDBOOK OF MATERIALS MODELING
HANDBOOK OF MATERIALS MODELING Part B. Models Editor Sidney Yip, Massachusetts Institute of Technology
A C.I.P. Catalogue record for this book is available from the Library of Congress.
ISBN-10 1-4020-3287-0 (HB) Springer Dordrecht, Berlin, Heidelberg, New York ISBN-10 1-4020-3286-2 (e-book) Springer Dordrecht, Berlin, Heidelberg, New York ISBN-13 978-1-4020-3287-5 (HB) Springer Dordrecht, Berlin, Heidelberg, New York ISBN-13 978-1-4020-3286-8 (e-book) Springer Dordrecht, Berlin, Heidelberg, New York
Published by Springer, P.O. Box 17, 3300 AA Dordrecht, The Netherlands.
Printed on acid-free paper
All Rights Reserved
© 2005 Springer No part of this work may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, electronic, mechanical, photocopying, microfilming, recording or otherwise, without written permission from the Publisher, with the exception of any material supplied specifically for the purpose of being entered and executed on a computer system, for exclusive use by the purchaser of the work. Printed in The Netherlands
CONTENTS PART A – METHODS Preface
xii
List of Subject Editors
ix
List of Contributors
xi
Detailed Table of Contents
xxix
Introduction
1
Chapter 1.
Electronic Scale
7
Chapter 2.
Atomistic Scale
449
Chapter 3.
Mesoscale/Continuum Methods
1069
Chapter 4.
Mathematical Methods
1215
PART B – MODELS Preface
xii
List of Subject Editors
ix
List of Contributors
xi
Detailed Table of Contents
xxix
Chapter 5.
Rate Processes
1565
Chapter 6.
Crystal Defects
1849
Chapter 7.
Microstructure
2081
Chapter 8.
Fluids
2409
Chapter 9.
Polymers and Soft Matter
2553
Plenary Perspectives
2657
Index of Contributors
2943
Index of Keywords
2947 v
PREFACE This Handbook contains a set of articles introducing the modeling and simulation of materials from the standpoint of basic methods and studies. The intent is to provide a compendium that is foundational to an emerging field of computational research, a new discipline that may now be called Computational Materials. This area has become sufficiently diverse that any attempt to cover all the pertinent topics would be futile. Even with a limited scope, the present undertaking has required the dedicated efforts of 13 Subject Editors to set the scope of nine chapters, solicit authors, and collect the manuscripts. The contributors were asked to target students and non-specialists as the primary audience, to provide an accessible entry into the field, and to offer references for further reading. With no precedents to follow, the editors and authors were only guided by a common goal – to produce a volume that would set a standard toward defining the broad community and stimulating its growth. The idea of a reference work on materials modeling surfaced in conversations with Peter Binfield, then the Reference Works Editor at Kluwer Academic Publishers, in the spring of 1999. The rationale at the time already seemed quite clear – the field of computational materials research was taking off, powerful computer capabilities were becoming increasingly available, and many sectors of the scientific community were getting involved in the enterprise. It was felt that a volume that could articulate the broad foundations of computational materials and connect with the established fields of computational physics and computational chemistry through common fundamental scientific challenges would be timely. After five years, none of the conditions have changed; the need remains for a defining reference volume, interest in materials modeling and simulation is further intensifying, the community continues to grow. In this work materials modeling is treated in 9 chapters, loosely grouped into two parts. Part A, emphasizing foundations and methodology, consists of three chapters describing theory and simulation at the electronic, atomistic, and mesoscale levels, and a chapter on analysis-based methods. Part B is more concerned with models and basic applications. There are five chapters describing basic problems in materials modeling and simulation, rate-dependent phenomena, crystal defects, microstructure, fluids, polymers and soft matter. In vii
viii
Preface
addition this part contains a collection of commentaries on a range of issues in materials modeling, written in a free-style format by experienced individuals with definite views that could enlighten the future members of the community. See the opening Introduction for further comments on modeling and simulation and an overview of the Handbook contents. Any organizational undertaking of this magnitude cans only be a collective effort. Yet the fate of this volume would not be so certain without the critical contributions from a few individuals. My gratitude goes to Liesbeth Mol, Peter Binfield’s successor at Springer Science + Business Media, for continued faith and support, Ju Li and Xiaofeng Qian for managing the websites and manuscript files, and Tim Kaxrias for stepping in at a critical stage of the project. To all the authors who found time in your hectic schedules to write the contributions, I am deeply appreciative and trust you are not disappointed. To the Subject Editors I say the Handbook is a reality only because of your perseverance and sacrifices. It has been my good fortune to have colleagues who were generous with advice and assistance. I hope this work motivates them even more to continue sharing their knowledge and insights in the work ahead. Sidney Yip Department of Nuclear Science and Engineering, Department of Materials Science and Engineering, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
LIST OF SUBJECT EDITORS Martin Bazant, Massachusetts Institute of Technology (Chapter 4) Bruce Boghosian, Tufts University (Chapter 8) Richard Catlow, Royal Institution, UK (Chapter 6) Long-Qing Chen, Pennsylvania State University (Chapter 7) William Curtin, Brown University (Chapter 1, Chapter 2, Chapter 4) Tomas Diaz de la Rubia, Lawrence Livermore National Laboratory (Chapter 6) Nicolas Hadjiconstantinou, Massachusetts Institute of Technology (Chapter 8) Mark F. Horstemeyer, Mississippi State University (Chapter 3) Efthimios Kaxiras, Harvard University (Chapter 1, Chapter 2) L. Mahadevan, Harvard University (Chapter 9) Dimitrios Maroudas, University of Massachusetts (Chapter 4) Nicola Marzari, Massachusetts Institute of Technology (Chapter 1) Horia Metiu, University of California Santa Barbara (Chapter 5) Gregory C. Rutledge, Massachusetts Institute of Technology (Chapter 9) David J. Srolovitz, Princeton University (Chapter 7) Bernhardt L. Trout, Massachusetts Institute of Technology (Chapter 1) Dieter Wolf, Argonne National Laboratory (Chapter 6) Sidney Yip, Massachusetts Institute of Technology (Chapter 1, Chapter 2, Chapter 6, Plenary Perspectives)
ix
LIST OF CONTRIBUTORS Farid F. Abraham IBM Almaden Research Center, San Jose, California
[email protected] P20
Robert Averback Accelerator Laboratory, P.O. Box 43 (Pietari Kalmin k. 2), 00014, University of Helsinki, Finland; Department of Materials Science and Engineering, University of Illinois at Urbana-Champaign, Illinois, USA
[email protected] 6.2
Francis J. Alexander Los Alamos National Laboratory, Los Alamos, NM, USA
[email protected] 8.7
D.J. Bammann Sandia National Laboratories, Livermore, CA, USA
[email protected] 3.2
N.R. Aluru Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, IL 61801, USA
[email protected] 8.3
K. Barmak Department of Materials Science and Engineering, Carnegie Mellon University, Pittsburgh, PA 15213, USA
[email protected] 7.19
Filippo de Angelis Istituto CNR di Scienze e Tecnologie Molecolari ISTM, Dipartimento di Chimica, Universit´a di Perugia, Via Elce di Sotto $, I-06123, Perugia, Italy
[email protected] 1.4
Stefano Baroni DEMOCRITOS-INFM, SISSA-ISAS, Trieste, Italy
[email protected] 1.10
Emilio Artacho University of Cambridge, Cambridge, UK
[email protected] 1.5
Rodney J. Bartlett Quantum Theory Project, Departments of Chemistry and Physics, University of Florida, Gainesville, FL 32611, USA
[email protected] 1.3
Mark Asta Northwestern University, Evanston, IL, USA
[email protected] 1.16
Corbett Battaile Sandia National Laboratories, Albuquerque, NM, USA
[email protected] 7.17
xi
xii Martin Z. Bazant Department of Mathematics, Massachusetts Institute of Technology, Cambridge, MA, USA
[email protected] 4.1, 4.10 Noam Bernstein Naval Research Laboratory, Washington, DC, USA
[email protected] 2.24 Kurt Binder Institut fuer Physik, Johannes Gutenberg Universitaet Mainz, Staudinger Weg 7, 55099 Mainz, Germany
[email protected] P19 Peter E. Bl¨ohl Institute for Theoretical Physics, Clausthal University of Technology, Clausthal-Zellerfeld, Germany
[email protected] 1.6 Bruce M. Boghosian Department of Mathematics, Tufts University, Bromfield-Pearson Hall, Medford, MA 02155, USA
[email protected] 8.1 Jean Pierre Boon Center for Nonlinear Phenomena and Complex Systems, Universit´e Libre de Bruxelles, 1050-Bruxelles, Belgium
[email protected] P21
List of contributors Russel Caflisch University of California at Los Angeles, Los Angeles, CA, USA
[email protected] 7.15 Wei Cai Department of Mechanical Engineering, Stanford University, Stanford, CA 94305-4040, USA
[email protected] 2.21 Roberto Car Department of Chemistry and Princeton Materials Institute, Princeton University, Princeton, NJ, USA
[email protected] 1.4 Paolo Carloni International School for Advanced Studies (SISSA/ISAS) and INFM Democritos Center, Trieste, Italy
[email protected] 1.13 Emily A. Carter Department of Mechanical and Aerospace Engineering and Program in Applied and Computational Mathematics, Princeton University, Princeton, NJ 08544, USA
[email protected] 1.8
Iain D. Boyd University of Michigan, Ann Arbor, MI, USA
[email protected] P22
C.R.A. Catlow Davy Faraday Laboratory, The Royal Institution, 21 Albemarle Street, London W1S 4BS, UK; Department of Chemistry, University College London, 20 Gordon Street, London WC1H 0AJ, UK
[email protected] 2.7, 6.1
Vasily V. Bulatov Lawrence Livermore National Laboratory, University of California, Livermore, CA 94550, USA
[email protected] P7
Gerbrand Ceder Department of Materials Science and Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA
[email protected] 1.17, 1.18
List of contributors
xiii
Alan V. Chadwick Functional Materials Group, School of Physical Sciences, University of Kent, Canterbury, Kent CT2 7NR, UK
[email protected] 6.5
Marvin L. Cohen University of California at Berkeley and Lawrence Berkeley National Laboratory, Berkeley, CA, USA
[email protected] 1.2
Hue Sun Chan University of Toronto, Toronto, Ont., Canada
[email protected] 5.16
John Corish Department of Chemistry, Trinity College, University of Dublin, Dublin 2, Ireland
[email protected] 6.4
James R. Chelikowsky University of Minnesota, Minneapolis, MN, USA
[email protected] 1.7 Long-Qing Chen Department of Materials Science and Engineering, Penn State University, University Park, PA 16802, USA
[email protected] 7.1 I-Wei Chen Department of Materials Science and Engineering, University of Pennsylvania, Philadelphia, PA 19104-6282, USA
[email protected] P27 Sow-Hsin Chen Department of Nuclear Engineering, MIT, Cambridge, MA 02139, USA
[email protected] P28 Christophe Chipot Equipe de dynamique des assemblages membranaires, Unit´e mixte de recherche CNRS/UHP 7565, Institut nanc´een de chimie mol´eculaire, Universit´e Henri Poincar´e, BP 239, 54506 Vanduvre-l`es-Nancy cedex, France 2.26 Giovanni Ciccotti INFM and Dipartimento di Fisica, Universit`a “La Sapienza,” Piazzale Aldo Moro, 2, 00185 Roma, Italy
[email protected] 2.17, 5.4
Peter V. Coveney Centre for Computational Science, Department of Chemistry, University College London, 20 Gordon Street, London WC1H 0AJ, UK
[email protected] 8.5 Jean-Paul Crocombette CEA Saclay, DEN-SRMP, 91191 Gif/Yvette cedex, France
[email protected] 2.28 Darren Crowdy Department of Mathematics, Imperial College, London, UK
[email protected] 4.10 G´abor Cs´anyi Cavendish Laboratory, University of Cambridge, UK
[email protected] P16 Nguyen Ngoc Cuong Massachusetts Institute of Technology, Cambridge, MA, USA
[email protected] 4.15 Christoph Dellago Institute of Experimental Physics, University of Vienna, Vienna, Austria
[email protected] 5.3
xiv J.D. Doll Department of Chemistry, Brown University, Providence, RI, USA Jimmie
[email protected] 5.2 Patrick S. Doyle Department of Chemical Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA
[email protected] 9.7
List of contributors Diana Farkas Department of Materials Science and Engineering, Virginia Tech, Blacksburg, VA 24061, USA
[email protected] 2.23 Clemens J. F¨orst Institute for Theoretical Physics, Clausthal University of Technology, Clausthal-Zellerfeld, Germany
[email protected] 1.6
Weinan E Department of Mathematics, Program in Applied and Computational Mathematics, Princeton University, Princeton, NJ 08544-1000, USA
[email protected] 4.13
Glenn H. Fredrickson Department of Chemical Engineering & Materials, The University of California at Santa, Barbara Santa Barbara, CA, USA
[email protected] 9.9
Jens Eggers School of Mathematics, University of Bristol, University Walk, Bristol BS8 1TW, UK
[email protected] 4.9
Daan Frenkel FOM Institute for Atomic and Molecular Physics, Amsterdam, The Netherlands
[email protected] 2.14
Pep Espanol ˜ Dept. Física Fundamental, Universidad Nacional de Educaci´on a Distancia, Aptdo. 60141, E-28080 Madrid, Spain
[email protected] 8.6 J.W. Evans Ames Laboratory - USDOE, and Department of Mathematics, Iowa State University, Ames, Iowa, 50011, USA
[email protected] 5.12 Denis J. Evans Research School of Chemistry, Australian National University, Canberra, ACT, Australia
[email protected] P17 Michael L. Falk University of Michigan, Ann Arbor, MI, USA
[email protected] 4.3
Julian D. Gale Nanochemistry Research Institute, Department of Applied Chemistry, Curtin University of Technology, Perth, 6845, Western Australia
[email protected] 1.5, 2.3 Giulia Galli Lawrence Livermore National Laboratory, CA, USA
[email protected] P8 Venkat Ganesan Department of Chemical Engineering, The University of Texas at Austin, Austin, TX, USA
[email protected] 9.9 Alberto García Universidad del País Vasco, Bilbao, Spain
[email protected] 1.5
List of contributors C. William Gear Princeton University, Princeton, NJ, USA
[email protected] 4.11 Timothy C. Germann Applied Physics Division, Los Alamos National Laboratory, Los Alamos, NM 87545, USA
[email protected] 2.11 Eitan Geva Department of Chemistry, University of Michigan, Ann Arbor, Michigan 48109-1055, USA
[email protected] 5.9 Nasr M. Ghoniem Department of Mechanical and Aerospace Engineering, University of California, Los Angeles, CA 90095-1597, USA
[email protected] 7.11, P11, P30 Paolo Giannozzi Scuola Normale Superiore and National Simulation Center, INFM-DEMOCRITOS, Pisa, Italy
[email protected] 1.4, 1.10 E. Van der Giessen University of Groningen, Groningen, The Netherlands
[email protected] 3.4 Daniel T. Gillespie Dan T Gillespie Consulting, 30504 Cordoba Place, Castaic, CA 91384, USA
[email protected] 5.11 George Gilmer Lawrence Livermore National Laboratory, P.O. box 808, Livermore, CA 94550, USA
[email protected] 2.10
xv William A. Goddard III Materials and Process Simulation Center, California Institute of Technology, Pasadena, CA 91125, USA
[email protected] P9 Axel Groß Physik-Department T30, TU M¨unchen, 85747 Garching, Germany
[email protected] 5.10 Peter Gumbsch Institut f¨ur Zuverl¨assigkeit von Bauteilen und Systemen izbs, Universit¨at Karlsruhe (TH), Kaiserstr. 12, 76131Karlsruhe, Germany and Fraunhofer Institut f¨ur Werkstoffmechanik IWM, W¨ohlerstr. 11, D-79194 Freiburg, Germany
[email protected] P10 Fran¸cois Gygi Lawrence Livermore National Laboratory, CA, USA P8 Nicolas G. Hadjiconstantinou Department of Mechanical Engineering, Massachusetts Institute of Technology, 77 Massachusetts Avenue, Cambridge, MA 02139, USA
[email protected] 8.1, 8.8 J.P. Hirth Ohio State and Washington State Universities, 114 E. Ramsey Canyon Rd., Hereford, AZ 85615, USA
[email protected] P31 K.M. Ho Ames Laboratory-U.S. DOE and Department of Physics and Astronomy, Iowa State University, Ames, IA 50011, USA 1.15
xvi
List of contributors
Wesley P. Hoffman Air Force Research Laboratory, Edwards, CA, USA
[email protected] P37
C.S. Jayanthi Department of Physics, University of Louisville, Louisville, KY 40292
[email protected] P39
Wm.G. Hoover Department of Applied Science, University of California at Davis/Livermore and Lawrence Livermore National Laboratory, Livermore, California, 94551-7808
[email protected] P34
Raymond Jeanloz University of California, Berkeley, CA, USA
[email protected] P25
M.F. Horstemeyer Mississippi State University, Mississippi State, MS, USA
[email protected] 3.1, 3.5 Thomas Y. Hou California Institute of Technology, Pasadena, CA, USA
[email protected] 4.14 Hanchen Huang Department of Mechanical, Aerospace and Nuclear Engineering, Rensselaer Polytechnic Institute, 110 8th Street, Troy, NY 12180-3590, USA
[email protected] 2.30 Gerhard Hummer National Institutes of Health, Bethesda, MD, USA
[email protected] 4.11 M. Saiful Islam Chemistry Division, SBMS, University of Surrey, Guildford GU2 7XH, UK
[email protected] 6.6 Seogjoo Jang Chemistry Department, Brookhaven National Laboratory, Upton, New York 11973-5000, USA
[email protected] 5.9
Pablo Jensen Laboratoire de Physique de la Mati´ere Condens´ee et des Nanostructures, CNRS and Universit´e Claude Bernard Lyon-1, 69622 Villeurbanne C´edex, France
[email protected] 5.13 Yongmei M. Jin Department of Ceramic and Materials Engineering, Rutgers University, 607 Taylor Road, Piscataway, NJ 08854, USA
[email protected] 7.12 Xiaozhong Jin Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, IL 61801, USA
[email protected] 8.3 J.D. Joannopoulos Francis Wright Davis Professor of Physics, Department of Physics, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
[email protected] P4 Javier Junquera Rutgers University, New Jersey, USA
[email protected] 1.5 Jo˜ao F. Justo Escola Polit´ecnica, Universidade de S˜ao Paulo, S˜ao Paulo, Brazil
[email protected] 2.4
List of contributors Hideo Kaburaki Japan Atomic Energy Research Institute, Tokai, Ibaraki, Japan
[email protected] 2.18 Rajiv K. Kalia Collaboratory for Advanced Computing and Simulations, Department of Physics & Astronomy, University of Southern California, 3651 Watt Way, VHE 608, Los Angeles, CA 90089-0242, USA
[email protected] 2.25 Raymond Kapral Chemical Physics Theory Group, Department of Chemistry, University of Toronto, Toronto, Ont. M5S 3H6, Canada
[email protected] 2.17, 5.4 Alain Karma Northeastern University, Boston, MA, USA
[email protected] 7.2 Johannes K¨astner Institute for Theoretical Physics, Clausthal University of Technology, Clausthal-Zellerfeld, Germany
[email protected] 1.6 Markos A. Katsoulakis Department of Mathematics and Statistics, University of Massachusetts - Amherst, Amherst, MA 01002, USA
[email protected] 4.12 Efthimios Kaxiras Department of Nuclear Science and Engineering and Materials Science and Engineering, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
[email protected] 2.1, 8.4
xvii Ronald J. Kerans Air Force Research Laboratory, Materials and Manufacturing Directorate, Wright-Patterson Air Force Base, Ohio, USA
[email protected] P38 Ioannis G. Kevrekidis Princeton University, Princeton, NJ, USA
[email protected] 4.11 Armen G. Khachaturyan Department of Ceramic and Materials Engineering, Rutgers University, 607 Taylor Road, Piscataway, NJ 08854, USA
[email protected] 7.12 T.A. Khraishi University of New Mexico, Albuquerque, NM, USA
[email protected] 3.3 Seong Gyoon Kim Kunsan National University, Kunsan 573-701, Korea
[email protected] 7.3 Won Tae Kim Chongju University, Chongju 360-764, Korea
[email protected] 7.3 Michael L. Klein Center for Molecular Modeling, Chemistry Department, University of Pennsylvania, 231 South 34th Street, Philadelphia, PA 19104-6323, USA
[email protected] 2.26 Walter Kob Laboratoire des Verres, Universit´e Montpellier 2, 34095 Montpellier, France
[email protected] P24
xviii David A. Kofke University at Buffalo, The State University of New York, Buffalo, New York, USA
[email protected] 2.14 Maurice de Koning University of S˜ao Paulo, S˜ao Paulo, Brazil
[email protected] 2.15 Anatoli Korkin Quantum Theory Project, Departments of Chemistry and Physics, University of Florida, Gainesville, FL 32611, USA 1.3 Kurt Kremer MPI for Polymer Research, D-55021 Mainz, Germany
[email protected] P5
List of contributors C. Leahy Department of Physics, University of Louisville, Louisville, KY 40292, USA P39 R. LeSar Theoretical Division, Los Alamos National Laboratory, Los Alamos, NM 87545, USA
[email protected] 7.14 Ju Li Department of Materials Science and Engineering, Ohio State University, Columbus, OH, USA
[email protected] 2.8, 2.19, 2.31 Xiantao Li Program in Applied and Computational Mathematics, Princeton University, Princeton, NJ 08544, USA
[email protected] 4.13
Carl E. Krill III Materials Division, University of Ulm, Albert-Einstein-Allee 47, D-89081 Ulm, Germany
[email protected] 7.6
Gang Li Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, IL 61801, USA
[email protected] 8.3
Ladislas P. Kubin LEM, CNRS-ONERA, 29 Av. de la Division Leclerc, BP 72, 92322 Chatillon Cedex, France
[email protected] P33
Vincent L. Lign`eres Department of Chemistry, Princeton University, Princeton, NJ 08544, USA 1.8
D.P. Landau Center for Simulational Physics, The University of Georgia, Athens, GA 30602, USA
[email protected] P2 James S. Langer Department of Physics, University of California, Santa Barbara, CA 93106-9530, USA
[email protected] 4.3, P14
Turab Lookman Theoretical Division, Los Alamos National Laboratory, Los Alamos, NM, USA
[email protected] 7.5 Steven G. Louie Department of Physics, University of California at Berkeley and Materials Sciences Division, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA
[email protected] 1.11
List of contributors
xix
John Lowengrub University of California, Irvine, California, USA
[email protected] 7.8
Richard M. Martin University of Illinois at Urbana, Urbana, IL, USA
[email protected] 1.5
Gang Lu Division of Engineering and Applied Science, Harvard University, Cambridge, Massachusetts, USA
[email protected] 2.20
Georges Martin ´ Commissariat a` l’Energie Atomique, Cab. H.C., 33 rue de la F´ed´eration, 75752 Paris Cedex 15, France
[email protected] 7.9
Alexander D. MacKerell, Jr. Department of Pharmaceutical Sciences, School of Pharmacy, University of Maryland, 20 Penn Street, Baltimore, MD, 21201, USA
[email protected] 2.5
Nicola Marzari Department of Materials Science and Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA
[email protected] 1.1, 1.4
Alessandra Magistrato International School for Advanced Studies (SISSA/ISAS) and INFM Democritos Center, Trieste, Italy 1.13
Wayne L. Mattice Department of Polymer Science, The University of Akron, Akron, OH 44325-3909
[email protected] 9.3
L. Mahadevan Division of Engineering and Applied Sciences, Department of Organismic and Evolutionary Biology, Department of Systems Biology, Harvard University Cambridge, MA 02138, USA
[email protected] Dionisios Margetis Department of Mathematics, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
[email protected] 4.8
V.G. Mavrantzas Department of Chemical Engineering, University of Patras, Patras, GR 26500, Greece
[email protected] 9.4 D.L. McDowell Georgia Institute of Technology, Atlanta, GA, USA
[email protected] 3.6, 3.9
E.B. Marin Sandia National Laboratories, Livermore, CA, USA
[email protected] 3.5
Michael J. Mehl Center for Computational Materials Science, Naval Research Laboratory, Washington, DC, USA
[email protected] 1.14
Dimitrios Maroudas University of Massachusetts, Amherst, MA, USA
[email protected] 4.1
Horia Metiu University of California, Santa Barbara, CA, USA
[email protected] 5.1
xx R.E. Miller Carleton University, Ottawa, ON, Canada
[email protected] 2.13 Frederick Milstein Mechanical Engineering and Materials Depts., University of California, Santa Barbara, CA, USA
[email protected] 4.2 Y. Mishin George Mason University, Fairfax, VA, USA
[email protected] 2.2 Francesco Montalenti INFM, L-NESS, and Dipartimento di Scienza dei Materiali, Universit`a degli Studi di Milano-Bicocca, Via Cozzi 53, I-20125 Milan, Italy
[email protected] 2.11 Dane Morgan Massachusetts Institute of Technology, Cambridge MA, USA
[email protected] 1.18 John A. Moriarty Lawrence Livermore National Laboratory, University of California, Livermore, CA 94551-0808
[email protected] P13 J.W. Morris, Jr. Department of Materials Science and Engineering, University of California, Berkeley, CA, USA
[email protected] P18 Raymond D. Mountain Physical and Chemical Properties Division, Chemical Science and Technology Laboratory, National Institute of Standards and Technology, Gaithersburg, MD 20899-8380, USA
[email protected] P23
List of contributors Marcus Muller ¨ Department of Physics, University of Wisconsin, Madison, WI 53706-1390, USA
[email protected] 9.5 Aiichiro Nakano Collaboratory for Advanced Computing and Simulations, Department of Computer Science, University of Southern California, 3651 Watt Way, VHE 608, Los Angeles, CA 90089-0242, USA
[email protected] 2.25 A. Needleman Brown University, Providence, RI, USA
[email protected] 3.4 Abraham Nitzan Tel Aviv University, Tel Aviv, 69978, Israel
[email protected] 5.7 Kai Nordlund Accelerator Laboratory, P.O. Box 43 (Pietari Kalmin k. 2), 00014, University of Helsinki, Finland; Department of Materials Science and Engineering, University of Illinois at Urbana-Champaign, Illinois, USA 6.2 G. Robert Odette Department of Mechanical Engineering and Department of Materials, University of California, Santa Barbara, CA, USA
[email protected] 2.29 Shigenobu Ogata Osaka University, Osaka, Japan
[email protected] 1.20
List of contributors Gregory B. Olson Department of Materials Science and Engineering, Northwestern University, Evanston, IL, USA
[email protected] P3 Pablo Ordej´on Instituto de Materiales, CSIC, Barcelona, Spain
[email protected] 1.5 Tadeusz Pakula Max Planck Institute for Polymer Research, Mainz, Germany and Department of Molecular Physics, Technical University, Lodz, Poland
[email protected] P35 Vijay Pande Department of Chemistry and of Structural Biology, Stanford University, Stanford, CA 94305-5080, USA
[email protected] 5.17 I.R. Pankratov Russian Research Centre, “Kurchatov Institute”, Moscow 123182, Russia
[email protected] 7.10 D.A. Papaconstantopoulos Center for Computational Materials Science, Naval Research Laboratory, Washington, DC, USA
[email protected] 1.14 J.E. Pask Lawrence Livermore National Laboratory, Livermore, CA, USA
[email protected] 1.19 Anthony T. Patera Massachusetts Institute of Technology, Cambridge, MA, USA
[email protected] 4.15
xxi Mike Payne Cavendish Laboratory, University of Cambridge, UK
[email protected] P16 Leonid Pechenik University of California, Santa Barbara, CA, USA
[email protected] 4.3 Joaquim Peir´o Department of Aeronautics, Imperial College, London, UK
[email protected] 8.2 Simon R. Phillpot Department of Materials Science and Engineering, University of Florida, Gainesville, FL 32611, USA
[email protected] 2.6, 6.11 G.P. Potirniche Mississippi State University, Mississippi State, MS, USA
[email protected] 3.5 Thomas R. Powers Division of Engineering, Brown University, Providence, RI, USA thomas
[email protected] 9.8 Dierk Raabe Max-Planck-Institut f¨ur Eisenforschung, Max-Planck-Str. 1, D-40237 D¨usseldorf, Germany
[email protected] 7.7, P6 Ravi Radhakrishnan Department of Bioengineering, University of Pennsylvania, Philadelphia, PA, USA
[email protected] 5.5
xxii Christian Ratsch University of California at Los Angeles, Los Angeles, CA, USA
[email protected] 7.15 John R. Ray 1190 Old Seneca Road, Central, SC 29630, USA
[email protected] 2.16 William P. Reinhardt University of Washington Seattle, Washington, USA
[email protected] 2.15 Karsten Reuter Fritz-Haber-Institut der Max-Planck-Gesellschaft, Faradayweg 4-6, D-14195 Berlin, Germany
[email protected] 1.9 J.M. Rickman Department of Materials Science and Engineering, Lehigh University, Bethlehem, PA 18015, USA
[email protected] 7.14, 7.19
List of contributors Tomonori Sakai Centre for Computational Science, Queen Mary, University of London, Mile End Road, London E1 4NS, UK 8.5 Deniel S´anchez-Portal Donostia International Physics Center, Donostia, Spain
[email protected] 1.5 Joachim Sauer Institut f¨ur Chemie, Humboldt-Universit¨at zu Berlin, Unter den Linden 6, D-10099 Berlin, Germany 1.12 Avadh Saxena Theoretical Division, Los Alamos National Laboratory, Los Alamos, NM, USA
[email protected] 7.5 Matthias Scheffler Fritz-Haber-Institut der Max-Planck-Gesellschaft, Faradayweg 4-6, D-14195 Berlin, Germany
[email protected] 1.9
Angel Rubio Departamento Física de Materiales and Unidad de Física de Materiales Centro Mixto CSIC-UPV, Universidad del País Vasco and Donosita Internacional Physics Center (DIPC), Spain
[email protected] 1.11
Klaus Schulten Theoretical and Computational Biophysics Group, Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, IL 61801, USA
[email protected] 5.15
Robert E. Rudd Lawrence Livermore National Laboratory, University of California, L-045 Livermore, CA 94551, USA
[email protected] 2.12
Steven D. Schwartz Departments of Biophysics and Biochemistry, Albert Einstein College of Medicine, New York, USA
[email protected] 5.8
Gregory C. Rutledge Department of Chemical Engineering, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
[email protected] 9.1
Robin L.B. Selinger Physics Department, Catholic University, Washington, DC 20064, USA
[email protected] 2.23
List of contributors Marcelo Sepliarsky Instituto de Física Rosario, Facultad de Ciencias Exactas, Ingenieria y Agrimensura, Universidad Nacional de Rosario, 27 de Febreo 210 Bis, (2000) Rosario, Argentina
[email protected] 2.6 Alessandro Sergi Chemical Physics Theory Group, Department of Chemistry, University of Toronto, Toronto, Ont. M5S 3H6, Canada
[email protected] 2.17, 5.4 J.A. Sethian Department of Mathematics, University of California, Berkeley, CA, USA
[email protected] 4.6 Michael J. Shelley Courant Institute of Mathematical Sciences, New York University, New York, NY, USA
[email protected] 4.7 C. Shen The Ohio State University, Columbus, Ohio, USA
[email protected] 7.4 Spencer Sherwin Department of Aeronautics, Imperial College, London, UK
[email protected] 8.2 Marek Sierka Institut f¨ur Physikalische Chemie, Lehrstuhl f¨ur Theoretische Chemie, Universit¨at Karlsruhe, Kaiserstraße 12, D-76128 Karlsruhe, Germany
[email protected] 1.12 Asimina Sierou University of Cambridge, Cambridge, UK
[email protected] 9.6
xxiii Grant D. Smith Department of Materials Science and Engineering, Department of Chemical Engineering, University of Utah, Salt Lake City, Utah, USA
[email protected] 9.2 Fr´ed´eric Soisson CEA Saclay, DMN-SRMP, 91191 Gif-sur-Yuette, France
[email protected] 7.9 Jos´e M. Soler Universidad Aut´onoma de Madrid, Madrid, Spain
[email protected] 1.5 Didier Sornette Institute of Geophysics and Planetary Physics and Department of Earth and Space Science, University of California, Los Angeles, California, USA and CNRS and Universit´e des Sciences, Nice, France
[email protected] 4.4 David J. Srolovitz Princeton Materials Institute and Department of Mechanical and Aerospace Engineering, Princeton University, Princeton, NJ 08544, USA
[email protected] 7.1, 7.13 Marcelo G. Stachiotti Instituto de Física Rosario, Facultad de Ciencias Exactas, Ingenieria y Agrimensura, Universidad Nacional de Rosario, 27 de Febreo 210 Bis, (2000) Rosario, Argentina
[email protected] 2.6 Catherine Stampfl Fritz-Haber-Institut der Max-Planck-Gesellschaft, Faradayweg 4-6, D-14195 Berlin, Germany; School of Physics, The University of Sydney, Sydney 2006, Australia
[email protected] 1.9
xxiv
List of contributors
H. Eugene Stanley Center for Polymer Studies and Department of Physics Boston, University, Boston, MA 02215, USA
[email protected] P36
Meijie Tang Lawrence Livermore National Laboratory, P.O. Box 808, Livermore, CA 94550
[email protected] 2.22
P.A. Sterne Lawrence Livermore National Laboratory, Livermore, CA, USA
[email protected] 1.19
Mounir Tarek Equipe de dynamique des assemblages membranaires, Unit´e mixte de recherche CNRS/UHP 7565, Institut nanc´eien de chimie mol´eculaire, Universit´e Henri Poincar´e, BP 239, 54506 Vanduvre-l`es-Nancy cedex, France 2.26
Howard A. Stone Division of Engineering and Applied Sciences, Harvard University, Cambridge, MA 01238, USA
[email protected] 4.8 Marshall Stoneham Centre for Materials Research, and London Centre for Nanotechnology, Department of Physics and Astronomy, University College London, Gower Street, London WC1E 6BT, UK
[email protected] P12 Sauro Succi Istituto Applicazioni Calcolo, National Research Council, viale del Policlinico, 137, 00161, Rome, Italy
[email protected] 8.4 E.B. Tadmor Technion-Israel Institute of Technology, Haifa, Israel
[email protected] 2.13 Emad Tajkhorshid Theoretical and Computational Biophysics Group, Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, IL 61801, USA
[email protected] 5.15
DeCarlos E. Taylor Quantum Theory Project, Departments of Chemistry and Physics, University of Florida, Gainesville, FL 32611, USA
[email protected] 1.3 Doros N. Theodorou School of Chemical Engineering, National Technical University of Athens, 9 Heroon Polytechniou Street, Zografou Campus, 157 80 Athens, Greece
[email protected] P15 Carl V. Thompson Department of Materials Science and Engineering, M.I.T., Cambridge, MA 02139, USA
[email protected] P26 Anna-Karin Tornberg Courant Institute of Mathematical Sciences, New York University, New York, NY, USA
[email protected] 4.7 S. Torquato Department of Chemistry, PRISM, and Program in Applied & Computational Mathematics, Princeton University, Princeton, NJ 08544, USA
[email protected] 4.5, 7.18
List of contributors Bernhardt L. Trout Department of Chemical Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA
[email protected] 5.5 Mark E. Tuckerman Department of Chemistry, Courant Institute of Mathematical Science, New York University, New York, NY 10003, USA
[email protected] 2.9 Blas P. Uberuaga Theoretical Division, Los Alamos National Laboratory, Los Alamos, NM 87545, USA
[email protected] 2.11, 5.6 Patrick T. Underhill Department of Chemical Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA 9.7 V.G. Vaks Russian Research Centre, “Kurchatov Institute”, Moscow 123182, Russia
[email protected] 7.10 Priya Vashishta Collaboratory for Advanced Computing and Simulations, Department of Chemical Engineering and Materials Science, University of Southern California, 3651 Watt Way, VHE 608, Los Angeles, CA 90089-0242, USA
[email protected] 2.25 A. Van der Ven Department of Materials Science and Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA 1.17 Karen Veroy Massachusetts Institute of Technology, Cambridge, MA, USA
[email protected] 4.15
xxv Alessandro De Vita King’s College London, UK, Center for Nanostructured, Materials (CENMAT) and DEMOCRITOS National Simulation Center, Trieste, Italy alessandro.de
[email protected] P16 V. Vitek Department of Materials Science and Engineering, University of Pennsylvania, Philadelphia, PA 19104, USA
[email protected] P32 Dionisios G. Vlachos Department of Chemical Engineering, Center for Catalytic Science and Technology, University of Delaware, Newark, DE 19716, USA
[email protected] 4.12 Arthur F. Voter Theoretical Division, Los Alamos National Laboratory, Los Alamos, NM 87545, USA
[email protected] 2.11, 5.6 Gregory A. Voth Department of Chemistry and Henry Eyring Center for Theoretical Chemistry, University of Utah, Salt Lake City, Utah 84112-0850, USA
[email protected] 5.9 G.Z. Voyiadjis Louisiana State University, Baton Rouge, LA, USA
[email protected] 3.8 Dimitri D. Vvedensky Imperial College, London, United Kingdom
[email protected] 7.16 G¨oran Wahnstr¨om Chalmers University of Technology and G¨oteborg University Materials and Surface Theory, SE-412 96 G¨oteborg, Sweden
[email protected] 5.14
xxvi
List of contributors
Duane C. Wallace Theoretical Division, Los Alamos National Laboratory, Los Alamos, NM 87545, USA
[email protected] P1
Brian D. Wirth Department of Nuclear Engineering, University of California, Barkeley, CA, USA
[email protected] 2.29
Axel van de Walle Northwestern University, Evanston, IL, USA
[email protected] 1.16
Dieter Wolf Materials Science Division, Argonne National Laboratory, Argonne, IL 60439, USA
[email protected] 6.7, 6.9, 6.10, 6.11, 6.12, 6.13
Chris G. Van de Walle Materials Department, University of California, Santa Barbara, California, USA
[email protected] 6.3
C.Z. Wang Ames Laboratory-U.S. DOE and Department of Physics and Astronomy, Iowa State University, Ames, IA 50011, USA
[email protected] 1.15
Y. Wang The Ohio State University, Columbus, Ohio, USA
[email protected] 7.4
Yu U. Wang Department of Materials Science and Engineering, Virginia Tech., Blacksburg, VA 24061, USA
[email protected] 7.12
Hettithanthrige S. Wijesinghe Department of Mechanical Engineering, Massachusetts Institute of Technology, 77 Massachusetts Avenue, Cambridge, MA 02139, USA
[email protected] 8.8
Chung H. Woo The Hong Kong Polytechnic University, Hong Kong SAR, China
[email protected] 2.27 Christopher Woodward Northwestern University, Evanston, Illinois, USA
[email protected] P29 S.Y. Wu Department of Physics, University of Louisville, Louisville, KY 40292, USA
[email protected] P39 Yang Xiang Department of Mathematics, Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong
[email protected] 7.13 Sidney Yip Department of Physics, Harvard University, Cambridge, MA 02138, USA
[email protected] 2.1, 2.10, 6.7, 6.8, 6.11 M. Yu Department of Physics, University of Louisville, Louisville, KY 40292, USA P39
List of contributors H.M. Zbib Washington State University, Pullman, WA, USA
[email protected] 3.3 Fangqiang Zhu Theoretical and Computational Biophysics Group, Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, IL 61801, USA
[email protected] 5.15
xxvii M. Zikry North Carolina State University, Raleigh, NC, USA
[email protected] 3.7
DETAILED TABLE OF CONTENTS PART A – METHODS Chapter 1. Electronic Scale 1.1
Understand, Predict, and Design Nicola Marzari 1.2 Concepts for Modeling Electrons in Solids: A Perspective Marvin L. Cohen 1.3 Achieving Predictive Simulations with Quantum Mechanical Forces Via the Transfer Hamiltonian: Problems and Prospects Rodney J. Bartlett, DeCarlos E. Taylor, and Anatoli Korkin 1.4 First-Principles Molecular Dynamics Roberto Car, Filippo de Angelis, Paolo Giannozzi, and Nicola Marzari 1.5 Electronic Structure Calculations with Localized Orbitals: The Siesta Method Emilio Artacho, Julian D. Gale, Alberto García, Javier Junquera, Richard M. Martin, Pablo Ordej´on, Deniel S´anchez-Portal, and Jos´e M. Soler 1.6 Electronic Structure Methods: Augmented Waves, Pseudopotentials and the Projector Augmented Wave Method Peter E. Bl¨ochl, Johannes K¨astner, and Clemens J. F¨orst 1.7 Electronic Scale James R. Chelikowsky 1.8 An Introduction to Orbital-Free Density Functional Theory Vincent L. Lign`eres and Emily A. Carter 1.9 Ab Initio Atomistic Thermodynamics and Statistical Mechanics of Surface Properties and Functions Karsten Reuter, Catherine Stampfl, and Matthias Scheffler 1.10 Density-Functional Perturbation Theory Paolo Giannozzi and Stefano Baroni
xxix
9 13
27
59
77
93 121 137
149 195
xxx
Detailed table of contents
1.11 Quasiparticle and Optical Properties of Solids and Nanostructures: The GW-BSE Approach Steven G. Louie and Angel Rubio 1.12 Hybrid Quantum Mechanics/Molecular Mechanics Methods and their Application Marek Sierka and Joachim Sauer 1.13 Ab Initio Molecular Dynamics Simulations of Biologically Relevant Systems Alessandra Magistrato and Paolo Carloni 1.14 Tight-Binding Total Energy Methods for Magnetic Materials and Multi-Element Systems Michael J. Mehl and D.A. Papaconstantopoulos 1.15 Environment-Dependent Tight-Binding Potential Models C.Z. Wang and K.M. Ho 1.16 First-Principles Modeling of Phase Equilibria Axel van de Walle and Mark Asta 1.17 Diffusion and Configurational Disorder in Multicomponent Solids A. Van der Ven and G. Ceder 1.18 Data Mining in Materials Development Dane Morgan and Gerbrand Ceder 1.19 Finite Elements in Ab Initio Electronic-Structure Calculations J.E. Pask and P.A. Sterne 1.20 Ab Initio Study of Mechanical Deformation Shigenobu Ogata
215
241
259
275 307 349
367 395 423 439
Chapter 2. Atomistic Scale 2.1 2.2 2.3 2.4 2.5 2.6
2.7 2.8
Introduction: Atomistic Nature of Materials Efthimios Kaxiras and Sidney Yip Interatomic Potentials for Metals Y. Mishin Interatomic Potential Models for Ionic Materials Julian D. Gale Modeling Covalent Bond with Interatomic Potentials Jo˜ao F. Justo Interatomic Potentials: Molecules Alexander D. MacKerell, Jr. Interatomic Potentials: Ferroelectrics Marcelo Sepliarsky, Marcelo G. Stachiotti, and Simon R. Phillpot Energy Minimization Techniques in Materials Modeling C.R.A. Catlow Basic Molecular Dynamics Ju Li
451 459 479 499 509
527 547 565
Detailed table of contents 2.9 2.10 2.11
2.12
2.13 2.14 2.15 2.16
2.17 2.18
2.19 2.20
2.21 2.22
2.23 2.24 2.25
2.26
Generating Equilibrium Ensembles Via Molecular Dynamics Mark E. Tuckerman Basic Monte Carlo Models: Equilibrium and Kinetics George Gilmer and Sidney Yip Accelerated Molecular Dynamics Methods Blas P. Uberuaga, Francesco Montalenti, Timothy C. Germann, and Arthur F. Voter Concurrent Multiscale Simulation at Finite Temperature: Coarse-Grained Molecular Dynamics Robert E. Rudd The Theory and Implementation of the Quasicontinuum Method E.B. Tadmor and R.E. Miller Perspective: Free Energies and Phase Equilibria David A. Kofke and Daan Frenkel Free-Energy Calculation Using Nonequilibrium Simulations Maurice de Koning and William P. Reinhardt Ensembles and Computer Simulation Calculation of Response Functions John R. Ray Non-Equilibrium Molecular Dynamics Giovanni Ciccotti, Raymond Kapral, and Alessandro Sergi Thermal Transport Process by the Molecular Dynamics Method Hideo Kaburaki Atomistic Calculation of Mechanical Behavior Ju Li The Peierls–Nabarro Model of Dislocations: A Venerable Theory and its Current Development Gang Lu Modeling Dislocations Using a Periodic Cell Wei Cai A Lattice Based Screw-Edge Dislocation Dynamics Simulation of Body Center Cubic Single Crystals Meijie Tang Atomistics of Fracture Diana Farkas and Robin L.B. Selinger Atomistic Simulations of Fracture in Semiconductors Noam Bernstein Multimillion Atom Molecular-Dynamics Simulations of Nanostructured Materials and Processes on Parallel Computers Priya Vashishta, Rajiv K. Kalia, and Aiichiro Nakano Modeling Lipid Membranes Christophe Chipot, Michael L. Klein, and Mounir Tarek
xxxi 589 613
629
649 663 683 707
729 745
763 773
793 813
827 839 855
875 929
xxxii
Detailed table of contents
2.27 Modeling Irradiation Damage Accumulation in Crystals Chung H. Woo 2.28 Cascade Modeling Jean-Paul Crocombette 2.29 Radiation Effects in Fission and Fusion Reactors G. Robert Odette and Brian D. Wirth 2.30 Texture Evolution During Thin Film Deposition Hanchen Huang 2.31 Atomistic Visualization Ju Li
959 987 999 1039 1051
Chapter 3. Mesoscale/Continuum Methods 3.1 3.2
3.3 3.4 3.5 3.6 3.7 3.8 3.9
Mesoscale/Macroscale Computational Methods M.F. Horstemeyer Perspective on Continuum Modeling of Mesoscale/Macroscale Phenomena D.J. Bammann Dislocation Dynamics H.M. Zbib and T.A. Khraishi Discrete Dislocation Plasticity E. Van der Giessen and A. Needleman Crystal Plasticity M.F. Horstemeyer, G.P. Potirniche, and E.B. Marin Internal State Variable Theory D.L. McDowell Ductile Fracture M. Zikry Continuum Damage Mechanics G.Z. Voyiadjis Microstructure-Sensitive Computational Fatigue Analysis D.L. McDowell
1071
1077 1097 1115 1133 1151 1171 1183 1193
Chapter 4. Mathematical Methods 4.1 4.2
4.3
4.4
Overview of Chapter 4: Mathematical Methods Martin Z. Bazant and Dimitrios Maroudas Elastic Stability Criteria and Structural Bifurcations in Crystals Under Load Frederick Milstein Toward a Shear-Transformation-Zone Theory of Amorphous Plasticity Michael L. Falk, James S. Langer, and Leonid Pechenik Statistical Physics of Rupture in Heterogeneous Media Didier Sornette
1217
1223
1281 1313
Detailed table of contents 4.5 4.6
4.7 4.8 4.9 4.10 4.11 4.12
4.13 4.14
4.15
Theory of Random Heterogeneous Materials S. Torquato Modern Interface Methods for Semiconductor Process Simulation J.A. Sethian Computing Microstructural Dynamics for Complex Fluids Michael J. Shelley and Anna-Karin Tornberg Continuum Descriptions of Crystal Surface Evolution Howard A. Stone and Dionisios Margetis Breakup and Coalescence of Free Surface Flows Jens Eggers Conformal Mapping Methods for Interfacial Dynamics Martin Z. Bazant and Darren Crowdy Equation-Free Modeling for Complex Systems Ioannis G. Kevrekidis, C. William Gear, and Gerhard Hummer Mathematical Strategies for the Coarse-Graining of Microscopic Models Markos A. Katsoulakis and Dionisios G. Vlachos Multiscale Modeling of Crystalline Solids Weinan E and Xiantao Li Multiscale Computation of Fluid Flow in Heterogeneous Media Thomas Y. Hou Certified Real-Time Solution of Parametrized Partial Differential Equations Nguyen Ngoc Cuong, Karen Veroy, and Anthony T. Patera
xxxiii 1333
1359 1371 1389 1403 1417 1453
1477 1491
1507
1529
PART B – MODELS Chapter 5. Rate Processes 5.1 5.2 5.3 5.4 5.5
5.6
Introduction: Rate Processes Horia Metiu A Modern Perspective on Transition State Theory J.D. Doll Transition Path Sampling Christoph Dellago Simulating Reactions that Occur Once in a Blue Moon Giovanni Ciccotti, Raymond Kapral, and Alessandro Sergi Order Parameter Approach to Understanding and Quantifying the Physico-Chemical Behavior of Complex Systems Ravi Radhakrishnan and Bernhardt L. Trout Determining Reaction Mechanisms Blas P. Uberuaga and Arthur F. Voter
1567 1573 1585 1597
1613 1627
xxxiv 5.7 5.8
5.9 5.10
5.11 5.12
5.13 5.14 5.15
5.16 5.17
Detailed table of contents Stochastic Theory of Rate Processes Abraham Nitzan Approximate Quantum Mechanical Methods for Rate Computation in Complex Systems Steven D. Schwartz Quantum Rate Theory: A Path Integral Centroid Perspective Eitan Geva, Seogjoo Jang, and Gregory A. Voth Quantum Theory of Reactive Scattering and Adsorption at Surfaces Axel Groß Stochastic Chemical Kinetics Daniel T. Gillespie Kinetic Monte Carlo Simulation of Non-Equilibrium Lattice-Gas Models: Basic and Refined Algorithms Applied to Surface Adsorption Processes J.W. Evans Simple Models for Nanocrystal Growth Pablo Jensen Diffusion in Solids G¨oran Wahnstr¨om Kinetic Theory and Simulation of Single-Channel Water Transport Emad Tajkhorshid, Fangqiang Zhu, and Klaus Schulten Simplified Models of Protein Folding Hue Sun Chan Protein Folding: Detailed Models Vijay Pande
1635
1673 1691
1713 1735
1753 1769 1787
1797 1823 1837
Chapter 6. Crystal Defects 6.1 6.2 6.3 6.4 6.5 6.6 6.7
Point Defects C.R.A. Catlow Point Defects in Metals Kai Nordlund and Robert Averback Defects and Impurities in Semiconductors Chris G. Van de Walle Point Defects in Simple Ionic Solids John Corish Fast Ion Conductors Alan V. Chadwick Defects and Ion Migration in Complex Oxides M. Saiful Islam Introduction: Modeling Crystal Interfaces Sidney Yip and Dieter Wolf
1851 1855 1877 1889 1901 1915 1925
Detailed table of contents 6.8 6.9 6.10
6.11 6.12 6.13
Atomistic Methods for Structure–Property Correlations Sidney Yip Structure and Energy of Grain Boundaries Dieter Wolf High-Temperature Structure and Properties of Grain Boundaries Dieter Wolf Crystal Disordering in Melting and Amorphization Sidney Yip, Simon R. Phillpot, and Dieter Wolf Elastic Behavior of Interfaces Dieter Wolf Grain Boundaries in Nanocrystalline Materials Dieter Wolf
xxxv 1931 1953
1985 2009 2025 2055
Chapter 7. Microstructure 7.1 7.2 7.3 7.4 7.5 7.6 7.7 7.8
7.9
7.10 7.11 7.12 7.13
Introduction: Microstructure David J. Srolovitz and Long-Qing Chen Phase-Field Modeling Alain Karma Phase-Field Modeling of Solidification Seong Gyoon Kim and Won Tae Kim Coherent Precipitation – Phase Field Method C. Shen and Y. Wang Ferroic Domain Structures using Ginzburg–Landau Methods Avadh Saxena and Turab Lookman Phase-Field Modeling of Grain Growth Carl E. Krill III Recrystallization Simulation by Use of Cellular Automata Dierk Raabe Modeling Coarsening Dynamics using Interface Tracking Methods John Lowengrub Kinetic Monte Carlo Method to Model Diffusion Controlled Phase Transformations in the Solid State Georges Martin and Fr´ed´eric Soisson Diffusional Transformations: Microscopic Kinetic Approach I.R. Pankratov and V.G. Vaks Modeling the Dynamics of Dislocation Ensembles Nasr M. Ghoniem Dislocation Dynamics – Phase Field Yu U. Wang, Yongmei M. Jin, and Armen G. Khachaturyan Level Set Dislocation Dynamics Method Yang Xiang and David J. Srolovitz
2083 2087 2105 2117 2143 2157 2173
2205
2223 2249 2269 2287 2307
xxxvi
Detailed table of contents
7.14 Coarse-Graining Methodologies for Dislocation Energetics and Dynamics J.M. Rickman and R. LeSar 7.15 Level Set Methods for Simulation of Thin Film Growth Russel Caflisch and Christian Ratsch 7.16 Stochastic Equations for Thin Film Morphology Dimitri D. Vvedensky 7.17 Monte Carlo Methods for Simulating Thin Film Deposition Corbett Battaile 7.18 Microstructure Optimization S. Torquato 7.19 Microstructural Characterization Associated with Solid–Solid Transformations J.M. Rickman and K. Barmak
2325 2337 2351 2363 2379
2397
Chapter 8. Fluids 8.1 8.2
8.3
8.4 8.5
8.6 8.7
8.8
Mesoscale Models of Fluid Dynamics Bruce M. Boghosian and Nicolas G. Hadjiconstantinou Finite Difference, Finite Element and Finite Volume Methods for Partial Differential Equations Joaquim Peir´o and Spencer Sherwin Meshless Methods for Numerical Solution of Partial Differential Equations Gang Li, Xiaozhong Jin, and N.R. Aluru Lattice Boltzmann Methods for Multiscale Fluid Problems Sauro Succi, Weinan E, and Efthimios Kaxiras Discrete Simulation Automata: Mesoscopic Fluid Models Endowed with Thermal Fluctuations Tomonori Sakai and Peter V. Coveney Dissipative Particle Dynamics Pep Espa˜nol The Direct Simulation Monte Carlo Method: Going Beyond Continuum Hydrodynamics Francis J. Alexander Hybrid Atomistic–Continuum Formulations for Multiscale Hydrodynamics Hettithanthrige S. Wijesinghe and Nicolas G. Hadjiconstantinou
2411
2415
2447 2475
2487 2503
2513
2523
Chapter 9. Polymers and Soft Matter 9.1 9.2
Polymers and Soft Matter L. Mahadevan and Gregory C. Rutledge Atomistic Potentials for Polymers and Organic Materials Grant D. Smith
2555 2561
Detailed table of contents 9.3 9.4 9.5 9.6 9.7
9.8 9.9
Rotational Isomeric State Methods Wayne L. Mattice Monte Carlo Simulation of Chain Molecules V.G. Mavrantzas The Bond Fluctuation Model and Other Lattice Models Marcus M¨uller Stokesian Dynamics Simulations for Particle Laden Flows Asimina Sierou Brownian Dynamics Simulations of Polymers and Soft Matter Patrick S. Doyle and Patrick T. Underhill Mechanics of Lipid Bilayer Membranes Thomas R. Powers Field-Theoretic Simulations Venkat Ganesan and Glenn H. Fredrickson
xxxvii 2575 2583 2599 2607
2619 2631 2645
Plenary Perspectives P1 P2 P3 P4 P5 P6
P7
Progress in Unifying Condensed Matter Theory Duane C. Wallace The Future of Simulations in Materials Science D.P. Landau Materials by Design Gregory B. Olson Modeling at the Speed of Light J.D. Joannopoulos Modeling Soft Matter Kurt Kremer Drowning in Data – A Viewpoint on Strategies for Doing Science with Simulations Dierk Raabe Dangers of “Common Knowledge” in Materials Simulations Vasily V. Bulatov
Quantum Simulations as a Tool for Predictive Nanoscience Giulia Galli and François Gygi P9 A Perspective of Materials Modeling William A. Goddard III P10 An Application Oriented View on Materials Modeling Peter Gumbsch P11 The Role of Theory and Modeling in the Development of Materials for Fusion Energy Nasr M. Ghoniem
2659 2663 2667 2671 2675
2687
2695
P8
2701 2707 2713
2719
xxxviii
Detailed table of contents
P12 Where are the Gaps? Marshall Stoneham P13 Bridging the Gap between Quantum Mechanics and Large-Scale Atomistic Simulation John A. Moriarty P14 Bridging the Gap between Atomistics and Structural Engineering J.S. Langer P15 Multiscale Modeling of Polymers Doros N. Theodorou P16 Hybrid Atomistic Modelling of Materials Processes Mike Payne, G´abor Cs´anyi, and Alessandro De Vita P17 The Fluctuation Theorem and its Implications for Materials Processing and Modeling Denis J. Evans P18 The Limits of Strength J.W. Morris, Jr. P19 Simulations of Interfaces between Coexisting Phases: What Do They Tell us? Kurt Binder P20 How Fast Can Cracks Move? Farid F. Abraham P21 Lattice Gas Automaton Methods Jean Pierre Boon P22 Multi-Scale Modeling of Hypersonic Gas Flow Iain D. Boyd P23 Commentary on Liquid Simulations and Industrial Applications Raymond D. Mountain P24 Computer Simulations of Supercooled Liquids and Glasses Walter Kob P25 Interplay between Materials Theory and High-Pressure Experiments Raymond Jeanloz P26 Perspectives on Experiments, Modeling and Simulations of Grain Growth Carl V. Thompson P27 Atomistic Simulation of Ferroelectric Domain Walls I-Wei Chen
2731
2737
2749 2757 2763
2773 2777
2787 2793
2805 2811
2819 2823
2829
2837 2843
Detailed table of contents
xxxix
P28 Measurements of Interfacial Curvatures and Characterization of Bicontinuous Morphologies Sow-Hsin Chen
2849
P29 Plasticity at the Atomic Scale: Parametric, Atomistic, and Electronic Structure Methods Christopher Woodward P30 A Perspective on Dislocation Dynamics Nasr M. Ghoniem P31 Dislocation-Pressure Interactions J.P. Hirth P32 Dislocation Cores and Unconventional Properties of Plastic Behavior V. Vitek P33 3-D Mesoscale Plasticity and its Connections to Other Scales Ladislas P. Kubin P34 Simulating Fluid and Solid Particles and Continua with SPH and SPAM Wm.G. Hoover P35 Modeling of Complex Polymers and Processes Tadeusz Pakula P36 Liquid and Glassy Water: Two Materials of Interdisciplinary Interest H. Eugene Stanley P37 Material Science of Carbon Wesley P. Hoffman P38 Concurrent Lifetime-Design of Emerging High Temperature Materials and Components Ronald J. Kerans P39 Towards a Coherent Treatment of the Self-Consistency and the Environment-Dependency in a Semi-Empirical Hamiltonian for Materials Simulation S.Y. Wu, C.S. Jayanthi, C. Leahy, and M. Yu
2865 2871 2879
2883 2897
2903 2907
2917 2923
2929
2935
5.1 INTRODUCTION: RATE PROCESSES Horia Metiu University of California, Santa Barbara, CA, USA
We can divide the time evolution of a system into two classes. In one, a part of the system changes its state from time to time; chemical reactions, polaron mobility, diffusion of adsorbates on a surface, and protein folding belong to this class. In the other, the change of state takes place continuously; electrical conductivity, the diffusion of molecules in gases, and the thermoelectric effect in doped semiconductors belong to this class. Chemical kinetics deals with phenomena of the first kind; the second kind is studied by transport theory. It is in the nature of a many-body system that its parts share energy with each other, creating a state of approximate equality. This leads to stagnation: each part tends to hover near the bottom of a bowl in the potential energy surface. Occasionally, the inherent thermal fluctuations put enough energy in a part of the many-body system to cause it to escape from its bowl and travel away from home. But the tendency to lose energy rapidly, once a part acquires more than its average share, will trap the traveler in another bowl. When this happens, the system has undergone a chemical reaction, or the polaron took a jump to another lattice site, or an impurity in a solid changed location. The rate of these events is described by well known, generic, phenomenological rate equations. The parameter characterizing the rate of a specific system is the rate constant k. In the past 30 years great progress has been made in our ability to calculate the rate constant by atomic simulations. The machinery for performing such calculations is described in the first articles in this chapter. Doll presents the modern view on the old and famous transition state theory, which is still one of the most useful and widely used procedures for calculating rate constants. The atomic motion in a many-body system takes place on a scale of femtoseconds, while the lifetime of a system in a potential energy bowl is much longer. This discrepancy led to the misconception that the dynamics of a chemical reaction is slow. 1567 S. Yip (ed.), Handbook of Materials Modeling, 1567–1571. c 2005 Springer. Printed in the Netherlands.
1568
H. Metiu
The main insight of TST is that a system acquires enough energy to undergo a reaction only “once in a blue moon”. If enough energy is acquired, in the right coordinates, the dynamics of the reaction is very rapid. The rate of reaction is low not because its dynamics is slow, but because the system has enough energy very rarely. In modern parlance the reaction is a rare event. This causes problems for a brute-force simulation of a reaction. One can follow a group of atoms, in the many-body system, for a nanosecond, because of limitations in computing power, and not observe a reactive event. The second insight of TST is that the only parameter out of equilibrium, in a chemical kinetics experiment, is the concentration. Each molecule participating in the reaction is in equilibrium with its environment at all times. Therefore, one can calculate, from equilibrium statistical mechanics, the probability that the system reaches the transition state and the rate with which the system crosses the ridge separating the bowl in which the system is initially located from the one that is the final destination. This is all it takes to build a theory of the rate constant. The only approximation is the assumption that once the system crosses the ridge, it will turn back only in a long time, on the order of k−1 . This late event is part of the backward reaction and it does not affect the forward rate constant. Given the propensity of many-body systems to share energy among degrees of freedom, this is not a bad assumption: once it crosses the ridge the system has a high energy in the reaction coordinate and it is likely to lose it. There are, however, cases in which the shape of the potential energy around the ridge is peculiar or the reaction coordinate is weakly coupled to the other degrees of freedom. When this happens, recrossing is not negligible and TST makes errors. In my experience these errors are small and rarely affect the prefactor A, in the expression k =A exp[−E/RT], by more than 30%. Given the fact that we are unable to calculate the activation energy E accurately and that the latter appears at the exponent it seems unwise to try to obtain an accurate value for A when one makes substantial errors in E (a 0.2-eV error is not rare). This is why TST is still popular in spite of the fact that one could calculate the rate constant exactly, sometimes without a great deal of additional computational effort. The TST reduces the calculation of k to the calculation of partition functions, which can be performed by Monte Carlo simulations. There is no longer any need to perform extremely long Molecular Dynamics calculations in the hope of observing a transition of the system from one bowl to another. Because recrossing is neglected, the rate constant calculated by TST is always larger than the exact rate constant. This does not mean that the TST rate constant is always larger than the measured one. It is only larger than the rate constant calculated exactly on the potential energy surface used in the TST calculations. This inequality led to the development of variational transition state theory, developed and used extensively in Truhlar’s work. In this procedure one
Introduction: rate processes
1569
varies the position of the surface dividing the initial and the final bowls, until the transition theory rate constant has a minimum. The rate constant obtained in this way is more accurate (assuming that the potential energy is accurate) than the one calculated by placing the dividing surface on the ridge separating the two bowls. These issues are discussed and explained in Doll’s article. The next two articles, by Dellago and by Ciccotti, Kapral and Sergi, describe the methods used for exact calculations of the rate constant k. Here “exact” means the exact rate constant for a given potential energy surface. If the potential energy surface is erroneous, the exact rate constant has nothing to do with reality. However, it is important to have an exact theory, since our ability to generate reasonable (and sometimes accurate) potential energy surfaces is improving each year. The exact theory of the rate constant is based on the so-called correlation function theory, which first appeared in a paper by Yamamoto. Since this theory does not assume that recrossing does not take place, it must use molecular dynamics to determine which trajectories recross and which do not. It does this very cleverly, to avoid the “rare event” trap. It uses equilibrium statistical mechanics to place the system on the dividing surface, with the correct probability. Then it lets the system evolve to cross the dividing surface and follows its evolution to determine whether it will recross the dividing surface. If it does, that particular crossing event is discarded. If it does not, it is kept as a reactive event. Averages over many such reactive events, used in a specific equation provided by the theory, give the exact rate constant. The advantage of this method, over ordinary molecular dynamics, is that it must follow the trajectory only for the time when the reaction coordinate loses energy and the system becomes unable to recross the dividing surface. As many experiments and simulations show, this time is shorter than a picosecond, which is quite manageable in computations. Moreover, the procedure generates a large of number of reactive trajectories with the appropriate probability. Since reactive trajectories are very improbable, a brute-force molecular dynamics simulation, starting with the reactants, will generate roughly one reactive trajectory in 100 000 calculations, each requiring a very long trajectory. This is why brute-force calculations of the rate constant are not possible. The two articles mentioned above discuss two different ways of implementing the theory. The theory presented by Dellago is new and has not been extensively tested. The one presented by Ciccotti, Kapral, and Sergi is the workhorse used for all systems that can be described by classical mechanics. While in principle the method is simple, the implementation is full of pitfalls and “small” technical difficulties, and these are clarified in the articles. Application of the correlation function theory to the diffusion of impurities in solids is discussed by Wahnstrom.
1570
H. Metiu
The statements made above, about the time scales reached by molecular dynamics, were true until a few years ago, when Voter proposed several methods that allow us to accelerate molecular dynamics to the point that we can follow the evolution of a complex system for microseconds. This has brought unexpected benefits. To use the transition state theory, or the correlation function theory of rare events, one must know what the events are; we need to know the initial and final state of the system. There are systems for which this is not easy to do. For example, Johnsson discovered, while studying the evolution of the shape of an “island” made by adsorbed atoms, that six atoms move in concert with relative ease. It is very unlikely that anyone would have proposed the existence of this “reaction” on the basis of chemical intuition. In general, in the complex systems encountered in biology and materials science, a group of molecules may move coherently and rapidly together in ways that are not intuitively expected. The accelerated dynamics method often finds such events, since it does not make assumptions about the final state of the system. The article of Blas, Uberuaga, and Voter discusses this aspect of kinetics. Since Kramers’ classic work, it has been realized that in many systems chemical reactions can be described by a stochastic method that involves the Brownian motion of the representative point of the system on the potential energy surface. Since then, the theory has been expanded and used to explain chemical kinetics in condensed phases. Its advantage is that it expresses chemical kinetics in complex media in terms of a few parameters, the strength of thermal fluctuations in the system and the “friction” causing the system to lose energy from the reaction coordinate. This reductionist approach appeals to many experimentalists who have used it to analyze chemical kinetics of molecules in liquids. Much work has also been done to connect the friction and the fluctuations to the detailed dynamics of the system. Nitzan’s article reviews the status of this field. All theories mentioned above assume that the motion of the system can be described by classical mechanics. This is not the case in reactions involving proton or electron transfer. The generalization of the correlation function theory of the rate constant to a fully quantum theory has been made by Miller, Schwartz, and Tromp, who extended considerably the early work of Yamamoto. Some of the first computational methods using this theory were proposed by Wahnstrom and Metiu. Since then, approximate methods, that allow calculations for systems with many degrees of freedom, have been invented. These are reviewed by Schwartz and Voth, who have both contributed substantially to this field. The review of quantum theory of rates is rounded off by an article by Gross, on reactive scattering and adsorption at surfaces. This discusses the dynamics of such reactions in more detail than usual in kinetics, since it examines the rate of reaction (dissociation or adsorption) when the molecule approaching the surface has a well-defined quantum
Introduction: rate processes
1571
state. One can obtain the rate constant from this information, by averaging the state-specific rates over a thermal distribution of initial states. Many people familiar with statistical mechanics have realized that chemical kinetics is, like any other phenomenon in a many-body system, subject to fluctuations that might be observable if one could detect the kinetic behavior of a small number of molecules. It was believed that light scattering may be able to study such fluctuations, since it can detect the evolution of concentration in the very small volume illuminated by light. It turned out that the volume was not small enough and, as far as I know, the fluctuations have not been detected by this method. Undaunted by this lack of experimental observations, Gillespie went ahead and developed the methodology needed for studying the stochastic evolution of the concentration in a system undergoing chemical reactions. This methodology assumed that the rate constants are known and examined the evolution of the concentrations in space and time. Later on, scanning tunneling microscopy studies of the evolution of atoms deposited on a surface and a variety of single molecule kinetic experiments provided examples of systems in which fluctuations in rate processes play a very important role. Gillespie’s article reviews the methods dealing with fluctuating chemical kinetics. Evans reviews the stochastic algorithms needed for studying the kinetics of adsorbates, with applications to crystal growth and catalysis. Jensen’s article studies specific kinetic models used in crystal growth. The chapter ends with three articles on kinetic phenomena of interest in biology. The rate of protein folding, studied with minimalist models that try to capture the essential features causing proteins to fold, is reviewed by Chan. Pande examines the use of detailed models in which the interatomic interactions are treated in detail. The two approaches are complementary and much can be learned by comparing their conclusions. Tajkhorshid, Zhu, and Schulten review the transport of water through the pores of cell membranes. A dominant feature of this transport is that water forms a quasi one-dimensional “wire”. For this reason, transport in biological channels is closely related to water transport through a carbon nanotube and the article reviews both. Kinetics, one of the oldest and most useful branches of chemical physics, is undergoing a quiet revolution and is penetrating in all areas of materials science and biochemistry. There is a very good reason for this: most systems we are interested in are metastable. To understand what they are, we need to use kinetics to simulate how they are made. Moreover, we need to use kinetics to understand how they function and how they are degraded by outside influences or by inner instabilities. Finally, a well-formulated kinetic model contains thermodynamics as the long-time limit.
5.2 A MODERN PERSPECTIVE ON TRANSITION STATE THEORY J.D. Doll Department of Chemistry, Brown University, Providence, RI, USA
Chemical rates, the temporal evolution of the populations of species of interest, are of fundamental importance in science. Understanding how such rates are determined by the microscopic forces involved is, in turn, a basic focus of the present discussion. Before delving into the details, it is valuable to consider the general nature of the problem we face when considering the calculation of chemical rates. In what follows we shall assume that we know: • • • •
the relevant physical laws (classical or quantum) governing the system, the molecular forces at work, the identity of the chemical species of interest, and the formal statistical-mechanical expressions for the desired rates.
Given all that, what is the “problem?” In principle, of course, there is none. “All” that we need do is to work out the “details” of our formal expressions and we have our desired rates. The kinetics of any conceivable physical, chemical, or biologic process are thus within our reach. We can predict fracture kinetics in complex materials, investigate the effects of arbitrary mutations on protein folding rates, and optimize the choice of catalyst for the decomposition/storage of hydrogen in metals, right? Sadly, “no.” Even assuming that all of the above information is at our disposal, at present it is not possible in practice to carry out the “details” at the level necessary to produce the desired rates for arbitrary systems of interest. Why not? The essential problem we face when discussing chemical rates is one of greatly differing time scales. If, for example, a species is of sufficient interest that it makes sense to monitor its population, it is, by default, generally relatively “stable.” That is, it is a species that tends to live a “long” time on the scale 1573 S. Yip (ed.), Handbook of Materials Modeling, 1573–1583. c 2005 Springer. Printed in the Netherlands.
1574
J.D. Doll
of something like a molecular vibration. On the other hand, if we are to understand the details of chemical events of interest, then we must be able to describe the dynamics of those events on a time scale that is “short” on the molecular level. If we do otherwise , we risk losing the ability to understand how those detailed molecular motions influence and/or determine the rates at issue. What happens then when we confront the problem of describing a rate process whose natural time scale is on the order of seconds? If we are not careful we end up drowning in the detail imposed by being forced to describe events on macroscopic time scales using microscopic dynamical methods. In short, we spend a great deal of time (and effort) watching things “not happen.” Is there a better way to proceed? Fortunately, “yes.” Using methods developed by a number of investigators [1–9], it is possible to formulate practical and reliable methods for estimating chemical rates for systems of realistic complexity. While there are often assumptions involved in the practical implementation of these approaches, it is increasingly feasible to quantify and often remove the effects of these assumptions albeit at the expense of additional work. It is our purpose to review and illustrate these methods. Our discussion will focus principally on classical level implementations. Quantum formulations of these methods are possible and are considered elsewhere in this monograph. While much effort has been devoted to the quantum problem, it remains a particularly active area of current research. In the present discussion, we purposely utilize a sometimes nonstandard language in order to unify the discussion of a number of historically separate topics and approaches. The starting point for any discussion of chemical rates is the identification of various species of interest whose population will be monitored as a function of time. While there are many possible ways in which to do this, it is convenient to consider an approach based on the Stillinger/Weber inherent structure ideas [10, 11]. In this formulation, configuration space is partitioned by assigned each position to a unique potential energy basin (“inherent structure”) based on a steepest descent quench procedure. The relevant mental image is that of watching a “ball” roll slowly “downhill” on the potential energy surface under the action of an over-damped dynamics. In many applications the Stillinger/Weber inherent structures are themselves of primary interest. Although the number of such structures grows rapidly (exponentially) with system size [12], this type of analysis and the associated graphical tools it has spawned [13], provide a valuable language for characterizing potential energy surfaces. Wales, in particular, has utilized variations of the technique to great advantage in their study of the minimization problem [14]. In our discussion, it is the evolution of the populations of the inherent structures rather than the structures themselves that are of primary concern. Inherent structures, by construction, are associated with local minima in the
A modern perspective on transition state theory
1575
potential energy surface. They thus have an intrinsic equilibrium population that can, if desired, be estimated using established statistical–mechanical techniques. Since the dynamics in the vicinity of the inherent structures is locally stable, the inherent structure populations tend to be (relatively) slowly varying and thus provide us with a natural set of populations for kinetic study. If followed as a function of time under the action of the dynamics generated by potential energy surface to which the inherent structures belong, the populations of the inherent structures will, aside from fluctuations, tend to remain constant at their various equilibrium values. Fluctuations in these populations, on the other hand, will result in a net flow of material between the various inherent structures. Such flows are the mechanism by which such fluctuations, either induced or spontaneous, “relax.” Consequently, they contain sufficient information to establish the desired kinetic parameters. To make the discussion more explicit, we consider the simple situation of a particle moving on the bistable potential energy depicted in Fig. 1. Performing a Stillinger/Weber quench on this potential energy will obviously produce two inherent structures. Denoted A and B in the figure, these correspond to the regions to the left and right of the potential energy maximum, respectively. We now imagine that we follow the dynamics of a statistical ensemble of N particles moving on this potential energy surface. For the purposes of discussion, we assume that the physical dynamics involved includes a solvent or “bath” (here unspecified) that provides fluctuating forces that act on the system
V(x)
A
B x
Figure 1. A prototypical, bistable potential energy. The two inherent structures, A and B, are separated by an energy barrier.
1576
J.D. Doll
of interest. The bath dynamics acts both to energize the system (permitting it to acquire sufficient energy to sometimes cross the potential barrier) as well as to dissipate that energy once it has been acquired. It is important to note that these fluctuations and dissipations must, in some sense, be balanced if an equilibrium state is to be produced and sustained [7]. Were the dynamics in our example purely conservative and one-dimensional in nature, for example, the notion of rates would be ill-posed. We now assume in what follows that we can monitor the populations of the inherent structures as a function of time. Denoting these populations NA (t) and NB (t), we further assume, following Chandler [7], that the overall kinetics of the system can described by the phenomenological rate equations dNA (t) = −kA→B NA (t) + kB→A NB (t) dt (1) dNB (t) = +kA→B NA (t) − kB→A NB (t). dt If the total number of particles is conserved, then the two inherent structure populations are trivially related: the fluctuation in the population of one inherent structure is the negative of that for the other. Assuming a fixed number of particles, it is thus a relatively simple matter to show that dδ NA (t) = −(kA→B + kB→A )δ NA (t), (2) dt where δ NA (t) indicates the deviation of NA (t) from its equilibrium value. The decay of a fluctuation in the population of inherent structure A, relative to an initial value at time zero, is thus given by δ NA (t) = δ NA (0) e−keff t ,
(3)
where keff is given by the sum of the “forward” and “backward” rate constants keff = (kA→B + kB→A ).
(4)
As noted by Onsager [15], it is physically reasonable to assume that if they are small, fluctuations, whether induced or spontaneous, are damped in a similar manner. Accepting this hypothesis, we conclude from the above analysis that the decay of the equilibrium population autocorrelation function, denoted here by , is given in terms of keff by δ NA (0)δ NA (t) = e−keff t . δ NA (0)δ NA (0)
(5)
Equivalently, taking the time derivative of both sides of this expression, we see that keff is given explicitly as keff = −
δ NA (0)δ N˙ A (t) . δ NA (0)δ NA (t)
(6)
A modern perspective on transition state theory
1577
Equations (5) and (6) are formally exact expressions that relate the sum of the basic rate constants of interest to various dynamical objects that can be computed. Since we also know the ratio of these two rate constants (it is given by the corresponding ratio of the equilibrium populations), the desired rate parameters can be obtained from either expression provided that we can obtain the relevant time correlation functions involved. Although formally equivalent, Eqs. (5) and (6) differ with respect to their implicit computational demands. Computing the rate parameters via Eq. (5), for example, entails monitoring the decay of the population autocorrelation function. To obtain reliable estimates of the rate parameters from Eq. (5), we have to follow the system dynamics over a time-scale that is an appreciable fraction of the reciprocal of keff . If the barriers separating the inherent structures involved are “large”, this time scale can become macroscopic. Simply stated, the disparate time-scale problem makes it difficult to study directly the dynamics of infrequent events using the approach suggested by Eq. (5). Equation (6), on the other hand, offers a more convenient route to the desired kinetic parameters. In particular, it indicates that we might be able to obtain these parameters from short as opposed to long-time dynamical information. If the phenomenological rate expressions are formally correct for all times, then the ratio of the two time correlation functions in Eq. (6) is time-independent. However, since it is generally likely that the phenomenological rate expressions accurately describe only the longer-time motion between inherent structures, we expect in practice that the ratio on the right hand side of Eq. (6) will approach a constant “plateau” value only at times long on the scale of detailed molecular motions. The critical point, however, is that this transient period will be of molecular not macroscopic duration. With Eq. (6), we thus have a route to the desired kinetic parameters that requires only molecular or short time-scale dynamical input. A valuable practical point concerning kinetic formulations based on Eq. (6) is that for many applications the final plateau value of the correlation function ratio involved is often relatively well approximated by its zero time value. Because the correlation functions required depend only on time differences, such zero-time quantities are purely equilibrium objects. Consequently, an existing and extensive set of equilibrium tools can be invoked to produce approximations to kinetic parameters. The approach to the calculation of chemical rates based on Eq. (6) has several desirable characteristics. Most importantly, it has a refinable nature and can be implemented in stages. At the simplest level, we can estimate chemical rate parameters using purely zero-time, or equilibrium methods. Such approximate methods alone may be adequate for many applications. We are, however, not restricted to accepting such approximations blindly. With additional effort we can “correct” such preliminary estimates by performing additional dynamical studies. Because such calculations involve “corrections” to
1578
J.D. Doll
equilibrium estimates of rate parameters, as opposed to the entire rate parameters themselves, the dynamical input required is only that necessary to remove the errors induced by the initial equilibrium assumptions. Because such errors tend to involve simplified assumptions concerning the nature of transition state dynamics, the input required to estimate the corrections is of a molecular, not macroscopic time scale. We now focus our discussion on some of practical issues involved in generating equilibrium estimates of the rates. We shall illustrate these using the simple two-state example described above. We begin by imagining that we have at our disposal the time history of a reaction coordinate of interest, x(t). As a function of time, x(t) moves back-and-forth between inherent structures A and B, which we assume to be separated by the position x = q. Using one of the basic properties of the delta function, δ(ax) =
1 δ(x), |a|
(7)
it is easy to show that N (τ , [x(t)]), defined by N (τ, [x(t)]) =
τ
dx(t) δ(x(t) − q), dt
dt
0
(8)
is a functional of the path whose value is equal to the (total) number of crossings of the x(t) = q surface in the interval (0,τ ). Every time x(t) crosses q, the delta function argument takes on a zero value. Because the delta function in Eq. (8) is in coordinate space while the integral is with respect to time, the Jacobian factor into Eq. (8) creates a functional whose value jumps by unity each time x(t) − q sweeps through a value of zero. If we form a statistical ensemble corresponding to various possible histories of the motion of our system and bath, we can compute the average number of crossings of the x(t) = q surface in the (0,τ ) interval, N(τ , [x(t)]), using the expression N (τ, [x(t)]) =
τ
dt x(t) ˙ δ(x(t) − q) .
(9)
0
Here represents the time derivative of x(t). Because are dealing with a “stationary” or equilibrium process, the time correlation function that appears on the right hand side of Eq. (9) can be function only of time differences. Consequently, the integrand on the right hand side of Eq. (9) is time-independent and can be brought outside the integral. The result thus becomes τ dt, N (τ, [x(t)]) = x˙ δ(x − q) 0
(10)
A modern perspective on transition state theory
1579
where the (now unnecessary) time labels have been dropped. We thus see that the number of crossings of the x(t) = q surface in this system per unit time is given by N (τ, [x(t)]) = x˙ δ(x − q) . (11) τ Recalling that N measures the total number of crossings, the number of crossings per unit time in the direction from A to B (the number of “up zeroes” of x(t) − q in the language of Slater) is half the value in Eq. (11). Thus, the equilibrium estimate of the rate constant for the A to B transition, (i.e., the number of crossings per unit time from A to B per atom in inherent structure A) is given by
1 TST = kA→B 2
x˙ δ(x − q)
NA
.
(12)
Equation (12) gives an approximate expression to the rate constant that involves an equilibrium flux between the relevant inherent structures. Because the relevant flux is associated with the “transition” of one inherent structure into another, the approach to chemical rates suggested by Eq. (12) is typically termed “transition state” theory (TST). Along with its multi-dimensional generalizations, it represents a convenient and useful approximation to the desired chemical rate constants. Being an equilibrium approximation to the dynamical objects of interest, it permits the powerful machinery of Monte Carlo methods [16, 17] to be brought to bear on the computational problem. The significance of this is that the required averages can be computed to any desired accuracy for arbitrary potential energy models. One can proceed analytically by making secondary, simplifying assumptions concerning the potential. Such approximations are, however, controllable in that their quality can be tested. Furthermore, Eq. (12) provides a unified treatment of the problem that is independent of the nature of the statistical ensemble that is involved. Applications involving canonical, microcanonical and other ensembles are treated within a common framework. It is historically interesting in this regard to note that if the reaction coordinate of interest is expressed as a superposition of normal modes, Eq. (12) leads naturally to the unimolecular reaction expressions of Ref. [4]. There is a technical aspect concerning the calculation of the averages appearing in Eq. (12) that merits discussion. In particular, it is apparent from the nature of the average involved that, if they are to be computed accurately, the numerical methods involved must be capable of accurately describing the reactant’s concentration profile in the vicinity of the transition state. If we are dealing with with activated processes where the difference between transition state in inherent structure energies are “large”, then such concentrations can become quite small and difficult to treat by standard methods. This is
1580
J.D. Doll
simply the equilibrium, “sparse-sampling” analog of the disparate time-scale dynamical problem. Fortunately, there are a number well-defined techniques for coping with this technical issue. These include, to name a few, umbrella methods [18], Bennett/Voter techniques [19, 20], J-walking [21, 22], and parallel tempering approaches [23]. These and related methods make it possible to compute the the required, transition-state-constrained averages. The basic approach outlined above can be extended in a number of ways. One immediate extension involves problems in which there are multiple, rather than two states involved. Adams has considered such problems in the context of his studies on the effects of precursor states on thermal desorption [24]. A second extension involves using the fundamental kinetic parameters produced to study more complex events. Voter, in a series of developments, has formulated a computationally viable method for studying diffusion in solids based on such an approach [25]. In its most complete form (including dynamical corrections), this approach produces a computationally exact procedure for surface or bulk diffusion coefficients of a point defect at arbitrary temperatures in a periodic system [26]. In related developments, Voter [25] and Henkelmen and J´onsson [27] have discussed using “on-the-fly” determinations of TST kinetic parameters in kinetic Monte Carlo studies. Such methods make it possible to explore a variety of lattice dynamical problems without resorting to ad hoc assumptions concerning mechanisms of various elementary events. In a particularly promising development, they also appear to offer a valuable tool for the study of long-time dynamical events [28, 29]. An important practical issue in the calculation of TST approximations to rates is the identification of the transition state itself. In many problems, such as the simple two-state problem discussed previously, locating the transition state is trivial. In others, it is not. Techniques designed to locate explicit transition states in complex systems have been discussed in the literature. One popular technique, developed by Cerjan and Miller [30] and extended by others [31–33], is based on an “eigenvector following” method. In this approach, one basically moves “up-hill” from a selected inherent structure using local mode information to determine the transition state. Other approaches, including methods that do not require explicit second-order derivatives of the potential, have been discussed [34]. It is also important to mention a different class of methods suggested by Pratt [35]. Borrowing a page from path integral applications, this technique attempts to locate transition states by working with paths that build in proper initial and final inherent structure character from the outset. Expanding upon the spirit of the original Pratt suggestion, recent efforts have considered sampling barrier crossing paths directly [36]. We wish to close by pointing out what we feel may prove to be a potentially useful link between inherent structure decomposition methods and the problem of “probabilistic clustering” [37, 38]. An important problem in applied mathematics is the reconstruction of an unknown probability distribution given a
A modern perspective on transition state theory
1581
known statistical sampling of that distribution. So stated, the probabilistic clustering problem is effectively the inverse of the Monte Carlo sampling problem. Rather than producing a statistical sampling of a given distribution, we seek instead to reconstruct the unknown distribution from a known statistical sampling. This clustering problem is of broad significance in information technology and has received considerable attention. Our point in emphasizing the link between probabilistic clustering and inherent structure methods is that our increased ability to sample arbitrary, sparse distributions would appear to offer an alternative to the Stillinger/Weber quench approach to the inherent structure decomposition problem. In particular, one could use clustering methods both to “identify” and to “measure” the concentrations of inherent structures present in a system.
Acknowledgments The author would like to thank the National Science Foundation for support through awards CHE-0095053 and CHE-0131114 and the Department of Energy through award DE-FG02-03ER46704. He also wishes to thank the Center for Advanced Scientific Computing and Visualization (TCASCV) at Brown University for valuable assistance with respect to some of the numerical simulations described in the present paper.
References [1] M. Polanyi and E. Wigner, “The interference of characteristic vibrations as the cause of energy fluctuations and chemical change,” Z. Phys. Chem., 139(Abt. A), 439, 1928. [2] H. Eyring, “Activated complex in chemical reaction,” J. Chem. Phys., 3, 107, 1935. [3] H.A. Kramers, “Brownian motion in a field of force and the diffusion model of chemical reactions,” Physica (The Hague), 7, 284, 1940. [4] N.B. Slater, Theory of Unimolecular Reactions, Cornell University Press, Ithaca, 1959. [5] P.J. Robinson and K.A. Holbrook, Unimolecular Reactions, Wiley-Interscience, 1972. [6] D.G. Truhlar and B.C. Garrett, “Variational transition state theory,” Ann. Rev. Phys. Chem., 35, 159, 1984. [7] D. Chandler, Introduction to Modern Statistical Mechanics, Oxford, New York, 1987. [8] P. H¨anggi, P. Talkner, and M. Borkovec, “Reaction-rate theory: fifty years after Kramers,” Rev. Mod. Phys., 62, 251, 1990. [9] M. Garcia-Viloca, J. Gao, M. Karplus, and D.G. Truhlar, “How enzymes work: analysis by modern rate theory and computer simulations,” Science, 303, 186, 2004.
1582
J.D. Doll
[10] F.H. Stillinger and T.A. Weber, “Dynamics of structural transitions in liquids,” Phys. Rev. A, 28, 2408, 1983. [11] F.H. Stillinger and T.A. Weber, “Packing structures and transitions in liquids and solids,” Science, 225, 983, 1984. [12] F.H. Stillinger, “Exponential multiplicity of inherent structures,” Phys. Rev. E, 59, 48, 1999. [13] O.M. Becker and M. Karplus, “The topology of multidimensional potential energy surfaces: theory and application to peptide structure and kinetics,” J. Chem. Phys., 106, 1495, 1997. [14] D.J. Wales and J.P.K. Doye, “Global optimization by basin-hopping and the lowest energy structures of Lennard–Jones clusters containing up to 110 atoms,” J. Phys. Chem. A, 101, 5111, 1997. [15] L. Onsager, “Reciprocal relations in irreversible processes, II,” Phys. Rev., 38, 2265, 1931. [16] M.H. Kalos and P.A. Whitlock, Monte Carlo Methods, Wiley-Interscience, New York, 1986. [17] M.P. Nightingale and C.J. Umrigar, Quantum Monte Carlo Methods in Physics and Chemistry, Kluwer, Dordrecht, 1998. [18] J.P. Valleau and G.M. Torrie, “A guide to Monte Carlo for statistical mechanics: 2. byways,” In: B.J. Berne (ed.), Statistical Mechanics: Equilibrium Techniques, Plenum, New York, 1969, 1977. [19] C.H. Bennett, “Exact defect calculations in model substances,” In: A.S. Nowick and J.J. Burton (eds.), Diffusion in Solids: Recent Developments, Academic Press, New York, pp. 73, 1975. [20] A.F. Voter, “A Monte Carlo method for determining free-energy differences and transition state theory rate constants,” J. Chem. Phys., 82,1890, 1985. [21] D.D. Frantz, D.L. Freeman, and J.D. Doll, “Reducing quasi-ergodic behavior in Monte Carlo simulations by J-walking: applications to atomic clusters,” J. Chem. Phys., 93, 2769, 1990. [22] J.P. Neirotti, F. Calvo, D.L. Freeman, and J.D. Doll, “Phase changes in 38 atom Lennard-Jones clusters: I: a parallel tempering study in the canonical ensemble,” J. Chem. Phys., 112, 10340, 2000. [23] C.J. Geyer and E.A. Thompson, “Anealing Markov chain Monte Carlo with applications to ancestral inference,” J. Am. Stat. Assoc., 90, 909, 1995. [24] J.E. Adams and J.D. Doll, “Dynamical aspects of precursor state kinetics,” Surf. Sci., 111, 492, 1981. [25] J.D. Doll and A.F. Voter, “Recent developments in the theory of surface diffusion,” Ann. Revi. Phys. Chem., 38, 413, 1987. [26] A.F. Voter, J.D. Doll, and J.M. Cohen, “Using multistate dynamical corrections to compute classically exact diffusion constants at arbitrary temperature,” J. Chem. Phys., 90, 2045, 1989. [27] G. Henkelman and H. J´onsson, “Long time scale kinetic Monte Carlo simulations without lattice approximation and predefined event table,” J. Chem. Phys., 115, 9657, 2001. [28] A.F. Voter, F. Montalenti, and T.C. Germann, “Extending the time scale in atomistic simulation of materials,” Ann. Rev. Mater. Res., 32, 321, 2002. [29] V.S. Pande, I. Baker, J. Chapman, S.P. Elmer, S. Khaliq, S.M. Larson, Y.M. Rhee, M.R. Shirts, C.D. Snow, E.J. Sorin, and B. Zagrovic, “Atomistic protein folding simulations on the submillisecond time scale using worldwide distributed computing,” Biopolymers, 68, 91, 2003.
A modern perspective on transition state theory
1583
[30] C.J. Cerjan and W.H. Miller, “On finding transition states,” J. Chem. Phys., 75, 2800, 1981. [31] C.J. Tsai and K.D. Jordan, “Use of an eigenmode method to locate the stationary points on the potential energy surfaces of selected argon and water clusters,” J. Phys. Chem., 97, 11227, 1993. [32] J. Nichols, H. Taylor, P. Schmidt, and J. Simons, “Walking on potential energy surfaces,” J. Chem. Phys., 92, 340, 1990. [33] D.J. Wales, “Rearrangements of 55-atom Lennard–Jones and (C60) 55 clusters,” J. Chem. Phys., 101, 3750, 1994. [34] G. Henkelman and H. J´onsson, “A dimer method for finding saddle points on high dimensional potential surfaces using only first derivatives,” J. Chem. Phys., 111, 7010, 1999. [35] L.R. Pratt, “A statistical method for identifying transition states in high dimensional problems,” J. Chem. Phys., 85, 5045–5048, 1986. [36] P.G. Bolhuis, D. Chandler, C. Dellago, and P.L. Geissler, “Transition path sampling: throwing ropes over rough mountain passes, in the dark,” Ann. Rev. Phys. Chem., 53, 291, 2002. [37] B.G. Mirkin, Mathematical Classification and Clustering, Kluwer, Dordrecht, 1996. [38] D. Sabo, D.L Freeman, and J.D. Doll, “Stationary tempering and the complex quadrature problem,” J. Chem. Phys., 116, 3509, 2002.
5.3 TRANSITION PATH SAMPLING Christoph Dellago Institute of Experimental Physics, University of Vienna, Vienna, Austria
Often, the dynamics of complex condensed materials is characterized by the presence of a wide range of different time scales, complicating the study of such processes with computer simulations. Consider, for instance, dynamical processes occurring in liquid water. Here, the fastest molecular processes are intramolecular vibrations with periods in the 10–20 fs range. The translational and rotational motions of water molecules occur on a significantly longer time scale. Typically, the direction of translational motion of a molecule persist for about 500 fs, corresponding to 50 vibrational periods. Hydrogen bonds, responsible for many of the unique properties of liquid water, have an average lifetime of about 1 ps and the rotational motion of water molecules stays correlated for about 10 ps. Much longer time scales are typically involved if covalent bonds are broken and formed. For instance, the average lifetime of a water molecule in liquid water before it dissociates and forms hydroxide and hydronium ions is on the order of 10 h. This enormous range of time scales, spanning nearly 20 orders of magnitude, is a challenge for the computer simulator who wants to study such processes. In general, the dynamics of molecular systems can be explored on a computer with molecular dynamics simulation (MD), a method in which the underlying equations of motion are solved in small time steps. In such simulations the size of the time step must be shorter than the shortest characteristic time scale in the system. Thus, many molecular dynamics steps must be carried out to explore the dynamics of a molecular system for times that are long compared with the basic time scale of molecular vibrations. Depending on specific system properties and the available computer equipment, one can carry out from 10 000 to millions of such steps. In ab initio simulations where interatomic forces are determined by solving the electronic structure problem on the fly, total simulation times typically do not exceed dozens of picoseconds. Longer simulations of nanosecond, or, in some rare cases, microsecond length can be achieved if forces are determined from computationally less expensive empirical force fields often 1585 S. Yip (ed.), Handbook of Materials Modeling, 1585–1596. c 2005 Springer. Printed in the Netherlands.
1586
C. Dellago
used to simulate biological systems. But many interesting and important processes still lay beyond the time scale accessible with MD simulations even on today’s fastest computers. Indeed, an ab initio molecular dynamics simulation of liquid water long enough to observe a few dissociations of water molecules would require a multiple of the age of the universe of computing time even on state-of-the-art parallel high performance computers. The computational effort needed to study many other interesting processes, ranging from protein folding to the nucleation of phase transitions and transport in and on solids, in straightforward molecular dynamics simulations with atomistic resolution may be less extreme, but still surpasses the capabilities of current computer technology. Fortunately, many processes occurring on long time scale are rare rather than slow. Consider, for instance, a chemical reaction during which the system has to overcome a large energy barrier on its way from reactants to products. Before the reaction occurs, the system typically spends a long time in the reactant state and only a rare fluctuation can drive the system over the barrier. If this fluctuation happens, however, the barrier is crossed rapidly. For example, it is now known from transition path sampling simulations that the dissociation of a water molecule in liquid water takes place in a few hundred femtoseconds once a rare solvent fluctuation drives the transition between the stable states, the intact water molecule and the separated ion pair. As mentioned earlier, the waiting time for this event, however, is of the order of 10 h. Other examples of rare but fast transitions between stable states include the nucleation of first order phase transitions, conformational transitions of biopolymers, and transport in and on solids. In such cases it is computationally advantageous to focus on those segments of the time evolution during which the rare event takes place rather than wasting large amounts of computing time following the dynamics of the system waiting for the rare event to happen. Several computational techniques to accomplish that have been put forward [1–4]. One approach consists in locating (or postulating) the bottleneck separating the stable states between which the rare transition occurs. Molecular dynamics trajectories initiated at this bottleneck, or transition state, can then be used to study the reaction mechanism in detail and to calculate reaction rate constants [5]. In small or highly ordered systems transition states can often be associated with saddle points on the potential energy surface. Such saddle points can be located with appropriate algorithms. Particularly in complex, disordered systems such as liquids, however, such an approach is frequently unfeasible. The number of saddle points on the potential energy surface may be very large and most saddle points may be irrelevant for the transition one wants to study. Entropic effects can further complicate the problem. In this case, a technique called transition path sampling provides an alternative approach [6]. Transition path sampling is a computational methodology based on a statistical mechanics of trajectories. It is designed to study rare transitions between
Transition path sampling
1587
known and well defined stable states. In contrast to other methods, transition path sampling does not require any a priori knowledge of the mechanism. Instead, it is sufficient to unambiguously define the stable states between which the transition occurs. The basic idea of transition path sampling consists in assigning a probability, or weight, to every pathway. This probability is a statistical description of all possible reactive trajectories, the transition path ensemble. Then, trajectories, are generated according to their probability in the transition path ensemble. Analysis of the harvested pathways yields detailed mechanistic information on the transition mechanism. Reaction rate constants can be determined within the framework of transition path sampling by calculating “free energies” between different ensembles of trajectories. In the following, we will give a brief overview of the basic concepts and algorithms of the transition path sampling technique. For a detailed description of the methodology and for practical issues regarding the implementation of transition path sampling simulations the reader is referred to two recent review articles [7, 8].
1.
The Transition Path Ensemble
Imagine a system with two long-lived stable states, call them A and B, between which rare transitions occur (see Fig. 1). The system spends much of its time fluctuating in the stable states A and B but rarely transitions between A and B occur. In the transition path sampling method one focuses on short
B
A
Figure 1. Several transition pathways connecting stable states A and B which are separated by a rough free energy barrier.
1588
C. Dellago
trajectories x(T ) of length T (in time) represented by a time-ordered discrete sequence of states: x(T ) ≡ {x0 , xt , x2t , . . . , xT }.
(1)
Here, xt is the state of the system at time t. Each trajectory may be thought of as a chain of states obtained by taking snapshots at regular time intervals of length t as the system evolves according to the rules of the underlying dynamics. If the time evolution of the system follows Newton’s equations of motion, x ≡ {r, p} is a point in phase space and consists of the coordinates, r, and momenta, p, of all particles. For systems evolving according to a high friction Langevin equation or a Monte Carlo procedure the state x may include only coordinates and no momenta. The probability of a certain trajectory to be observed depends on the probability ρ(x0 ) of its initial point x0 and on the probability to observe the subsequent sequence of states starting from that initial point. For a Markovian process, that is for a process in which the probability of state xt to evolve into state xt +t over a time t depends only on xt and not on the history of the system prior to t, the probability P[x(T )] of a trajectory x(T ) can simply be written as a product of single step transition probabilities p(xt → xt +t ): P[x(T )] = ρ(x0 )
T /t −1
p(xit → x(i+1)t ).
(2)
i=0
For an equilibrium system in contact with a heat bath at temperature T the distribution of starting points is canonical, i.e., ρ(x0 ) ∝ exp{−H (x)/kB T }, where H (x) is the Hamiltonian of the system and kB is Boltzmann’s constant. Depending on the process under study other distributions of initial conditions may be appropriate. The path distribution of Eq. (2) describes the probability to observe a particular trajectory regardless of whether it connects the two stable states A and B. Since in the transition path approach the focus is on reactive trajectories, the path distribution P[x(T )] is restricted to the subset of pathway starting in A and ending in B: PAB [x(T )] ≡ h A (x0 )P[x(T )]h B (xT )/Z AB (T ).
(3)
The functions h A (x) and h B (x) are unity if their argument x lies in region A or B, respectively, and they vanish otherwise. Accordingly, only reactive trajectories starting in A and ending in B can have a weight different from zero in the path distribution PAB [x(T )]. The factor Z AB (T ) ≡
Dx(T ) h A (x0 )P[x(T )]h B (xT ),
(4)
which has the form of a partition function, normalizes the path distribution of Eq. (3). The notation Dx(T ), familiar from path integral theory, denotes a
Transition path sampling
1589
summation over all pathways. The function PAB [x(T )], which is a probability distribution function in the high dimensional space of all trajectories, describes the set of all reactive trajectories with their correct weight. This set of pathways is the transition path ensemble. In transition path sampling simulations care must be exercised in defining the stable states A and B. Both A and B need to be large enough to accommodate most equilibrium fluctuations, i.e., the system should spend the overwhelming fraction of time in either A or B. At the same time, A and B should not overlap with each other’s basin of attraction. Here, the basin of attraction of region A consist of all configurations that relax predominantly into that region. The basin of attraction of region B is defined analogously. If state A is incorrectly defined in such a way that it contains also points belonging to the basin of attraction of B, the transition path ensemble includes pathways only apparently connecting the two stable states. This situation is illustrated in Fig. 2. In many cases the stable states A and B can be defined through specific limits of a one-dimensional order parameter q(x). Although there is no general rule guiding the construction of such order parameters, this step in setting up a
q'
TS
A
B qA
qB
q
Figure 2. Regions A and B must be defined in a way to avoid overlap of A and B with each other’s basin of attraction. On this two dimensional free energy surface region A defined through q < q A includes points belonging to the basin of attraction of B (defined through q > q B ). Thus, the transition path ensemble PAB [x(T )] contains paths which start in A and end in B, but which never cross the transition state region marked by TS (dashed line). This problem can be avoided by using also the variable q in the definition of the stable states.
1590
C. Dellago
transition path sampling simulation can be usually completed quite easily with a trial and error procedure. Note, however, that an appropriate order parameter is not necessarily a good reaction coordinate capable of describing the whole transition. In general, finding such a reaction coordinate is a difficult problem.
2.
Sampling the Transition Path Ensemble
In the transition path sampling method a biased random walk through path space is performed in such a way that pathways are visited according to their weight in the transition path ensemble PAB [x(T )]. This can be accomplished in an efficient way with Monte Carlo methods proceeding in analogy to a conventional Monte Carlo simulation of, say, a simple liquid at a given temperature T [9]. In that case a random walk through configuration space is constructed by carrying out a sequence of discrete steps. In each step, a new configuration is generated from an old one, for instance by displacing a single particle in a random direction by a random amount. Then, the new configuration, also called trial configuration, is accepted or rejected depending on how the probability of the new configuration compares to that of the old one. This is most easily done by applying the celebrated Metropolis rule [10], designed to enforce detailed balance between the move and its reverse. As a result, the trial move is always accepted if the energy of the new configuration is lower than that of the old one and accepted with a probability exp(−E/kB T ) if the trial move is energetically uphill (here, E is the energy difference between the new and the old configuration). Execution of a long sequence of such random moves followed by the acceptance or rejection step yields a random walk of the system through configuration space during which configurations are sampled with a frequency proportional to their weight in the canonical ensemble. Ensemble averages of structural and thermodynamics quantities can then straightforwardly computed by averaging over this sequence of configurations. In a transition path sampling simulation one proceeds analogously. But in contrast to a conventional Monte Carlo simulation, the random walk is carried out in the space of all trajectories and the result is a sequence of pathways instead of a sequence of configurations. In each step of this random walk a new pathway x (n) (T ), the trial path, is generated from an an old one, x (o) (T ). Then, the trial pathway is accepted or rejected according to how its weight PAB [x (n) (T )] in the transition path ensemble compares to the weight of the old one, PAB [x (o) (T )]. Correct sampling of the transition path ensemble is guaranteed by enforcing the detailed balance condition which requires the probability of a path move from x (o) (T ) to x (n) (T ) to be balanced exactly by the probability of the reverse path move. This detailed balance condition can be satisfied using the Metropolis criterion. Iterating this procedure of path generation followed by acceptance or rejection, one obtains a sequence of pathways in which
Transition path sampling
1591
each pathway is visited according to its weight in the transition path ensemble. It is important to note that while pathways are sampled with a Monte Carlo procedure, each single pathway is a genuinely dynamical pathway generated according to the rules of the underlying dynamics. To implement the procedure outlined above, one needs to specify how to generate a new pathway from an old one. This can be done efficiently with algorithms called shooting and shifting. For simplicity we will explain these algorithms for Newtonian dynamics (as used in most MD simulations) although they can be easily applied to other types of dynamics as well. So, imagine a Newtonian trajectory of length T as obtained from a molecular dynamics simulation of L = T /t steps starting in region A and ending in region B (see Fig. 3). From this existing transition pathway a new trajectory is generated by first randomly selecting a state of the existing trajectory. Then, the momenta belonging to the selected state are changed by a small random amount. Starting from this state with modified momenta the equations of motion are integrated forward to time T and backward to time 0. As a result, one obtains a complete new trajectory of length T which crosses (in configuration space) the old trajectory at one point. By keeping the momentum displacement small the new trajectory can be made to resemble the old one closely. As a consequence, the new pathway is likely to be reactive as well and to have a nonzero weight in the transition path ensemble. Any new trajectory with starting point in A and ending point in B can be accepted with high likelihood (in fact, for constant energy trajectories with a microcanonical distribution of initial conditions all new trajectories connecting A and B can be accepted). If the new trajectory does not begin in A or does not end in B it is rejected. For optimum efficiency, the magnitude of the momentum displacement should be selected such that the average acceptance probability is in the range from 40 to 60%. Shooting moves can be complemented with shifting moves, which consist in shifting the starting point of the path in time. This kind of move is computationally inexpensive since typically only a small part of the pathway needs to
A
B
Figure 3. In a shooting move one generates a new trajectory (dashed line) from an old one (solid line) by integrating the equations of motion forward and backward starting from a point with random momenta randomly selected along the old trajectory. The acceptance probability of the newly generated path can be controlled by varying the magnitude of the momentum displacement (thin arrow).
1592
C. Dellago
be regrown. If the starting point of the path is shifted forward in time, a path segment of appropriate length has to be appended at the end of the path by integration of the equation of motion. If, on the other hand, the starting point is shifted backward in time, the trajectory must be completed by integrating the equations of motion backward in time starting from the initial point of the original pathway. Depending on the time by which the path is shifted, the new path can have large parts in common with the old path. Since ergodic sampling is not possible with shifting moves alone, path shifting always needs to be combined with path shooting. Although shifting moves cannot generate a truly new path, they can increase sampling efficiency especially for the calculation of reaction rate constants. To start the Monte Carlo path sampling procedure one needs a pathway that already connects A with B. This initial pathway is not required to be a high-weight dynamical trajectory, but can be an artificially constructed chain of states. Shooting and shifting will then rapidly relax this initial pathway towards regions of higher probability in path space. The generation of an initial trajectory is strongly system dependent and usually does not pose a serious problem.
3.
Analyzing Transition Pathways
Pathways harvested with the transition path sampling method are full dynamical trajectories in the space spanned by positions and momenta of all particles. In such high-dimensional many-particle systems it is usually difficult to identify the relevant degrees of freedom and to distinguish them from those which might be regarded as random noise. In the case of a chemical reaction occurring in a solvent, for instance, the specific role of solvent molecules during the reaction is often unclear. Although direct inspection of transition pathways with molecular visualization tools may yield some insight, detailed knowledge of the transition mechanism can only be gained through systematic analysis of the collected pathways. In the following, we will briefly review two approaches to carry out such an analysis: the transition state ensemble and the distribution of committors. In simple systems of a few degrees of freedom, for instance a small molecule undergoing an isomerization in the gas phase, one can study transition mechanisms by locating minima and saddle points on the potential energy surface of the system. While the potential energy minima are the stable states in which the system spends most of its time, the saddle point are configurations the system must cross on its way from one potential energy well to another. These so called transition states are the lowest points on ridges separating the stable states from each other. From the transition states the system can relax
Transition path sampling
1593
into either one of the two stable states depending on the initial direction of motion. In a high dimensional complex system local potential energy minima and saddle points do not carry the same significance as in simple systems. In a large, disordered system many local potential energy minima and saddle points may belong to one single stable state, and free energy barriers may not be related to a single saddle point. Nevertheless, the concept of a transition state is still meaningful if defined in a statistical way. In this definition, configurations are considered to be transition states if trajectories started from them with random initial momenta have equal probability to relax to either one of the stable states between which transitions occur. Naturally, along each transition pathway there is at least one (but sometimes several) configuration with this property. Performing such an analysis for many transition pathways yields the transition state ensemble, the set of all configurations on transition pathways which relax into A and B with equal probability. Inspection of this set of configurations is simpler than scrutiny of the set of harvested complete pathways. As a result of the analysis described above one may be led to guess which degrees of freedom are most important during the transition, or, in other words, which degrees of freedom contribute to the reaction coordinate. Such a guessed reaction coordinate, q(x), can be tested with the following procedure. The first step consists in calculating the free energy F(q), for instance by using umbrella sampling [9] or constrained molecular dynamics [11]. The free energy profile F(q) will possess minima at values of q typical for the stables states A and B and a barrier located at q = q ∗ separating these two minima. If q is a good reaction coordinate, trajectories started from configurations with q = q ∗ relax into A and B with equal probability. To verify the quality of the postulated reaction coordinate, a set of configurations with q = q ∗ is generated. Then, for each of these configurations one calculates p B , the probability to relax into state B, also called the committor. This can be done by initiating many short trajectories at the configuration and observing which state they relax to. As a result, one obtains a distribution P( p B ) of committors. For a good reaction coordinate, this distribution should peak at a value of p B ≈ 1/2. If this is not case, other degrees of freedom need to be taken into account for a correct description of the transition [7].
4.
Reaction Rate Constants
Since trajectories collected in the transition path sampling method are genuine dynamical trajectories, they can be used to study the kinetics of reactions. The phenomenologic description of the kinetics in terms of reaction rate constants is related to the underlying microscopic dynamics by time correlation functions of appropriate population functions that describe how the system
1594
C. Dellago
relaxes after a perturbation [12]. In particular, for transitions from A to B the relevant correlation function is h A (x0 )h B (xt ) , (5) C(t) = h A where the angular brackets · · · denote equilibrium averages. The correlation function C(t) is the conditional probability to observe the system in region B at time t provided it was in region A at time 0. To understand the general features of this function, let us imagine that we prepare a large number of identical and independent systems in a way that at time t = 0 all of them are located in A. Then, we let all systems evolve freely and observe the fraction of systems in region B as a function of time. This fraction is the correlation function C(t). Initially, all systems are in A and, therefore, C(0) = 0. As time goes on, some systems cross the barrier due to random fluctuations and contribute to the population in region B. So C(t) grows and it keeps growing until equilibrium sets in, i.e., until the flow of systems from A to B is compensated by the flow of system moving from B back to A. For very long times, correlations are lost and the probability to find a system in B is just given by the equilibrium population h B . For first order kinetics C(t) approaches its asymptotic value exponentially, C(t) = h B [1 − exp(−t/τrxn )], where the reaction time τrxn can be written in terms of the forward and backward reaction rate constants, τrxn = (k AB + k B A )−1 . For times short compared to the reaction time τrxn (but longer than the time necessary to cross the barrier) the correlation function C(t) grows linearly, C(t) ≈ k AB t, and the slope of this curve is the forward rate constant k AB . Thus, to determine reaction rate constants one has to calculate the correlation function C(t). To determine the correlation form C(t) in the transition path sampling method we rewrite it in the suggestive form
C(t) =
Dx(t) h A (x0 )P[x(t)]h B (xt ) . Dx(t) h A (x0 )P[x(t)]
(6)
Here, both numerator and denominator are integrals over path distributions and can be viewed as partition functions belonging to two different path ensembles. The integral in the denominator has the form of a partition function of the ensemble of pathways starting in region A and ending somewhere. The integral in the numerator, on the other hand, is more restrictive and places a condition also on the final point of the path. This integral can be viewed as the partition function of the ensemble of pathways starting in region A and ending in region B. Thus, the path ensemble in the numerator is a subset of the path ensemble in the denominator. The ratio of partition functions can be related to the free energy difference F between the two ensembles of pathways, C(t) ≡ exp(−F).
(7)
Transition path sampling
1595
This free energy difference is the generalized reversible work necessary to confine the endpoints of pathways starting in A to region B. Exploiting this viewpoint, one can calculate the time correlation function C(t) and hence determine reaction rate constants by adapting conventional free energy estimation methods to work in trajectory space. So far, reaction rate constants have been calculated in the framework of transition path sampling with umbrella sampling, thermodynamic integration, and fast switching methods. In principle, the forward reaction rate constant k AB can be determined by carrying out a free energy calculation for different times t and taking a numerical derivative. In the time range where C(t) grows linearly, this derivative has a plateau which coincides with k AB . Proceeding in such a way one has to perform several computationally expensive free energy calculations. Fortunately, C(t) can be factorized in a way so that only one such calculation needs to be carried out for a particular time t . The value of C(t) at all other times in the range [0, T ] can then be determined from a single transition path sampling simulation of trajectories with length T . Thus, calculating reaction rate constants in the transition path sampling method is a two-step procedure. First, C(t ) is determined for a particular time t using a free energy estimation method in path space. In a second step, one additional transition path sampling simulation is carried out to determine C(t) at all other times. The reaction rate constant can finally be calculated by determining the time derivative of C(t).
5.
Outlook
Transition path sampling is a practical and very general methodology to collect and analyze rare pathways. In equilibrium, such rare but important trajectories may arise due to free energetic barriers impeding the motion of the system through configuration space. Transition path sampling, however, can be used equally well to study rare trajectories occurring in non-equilibrium processes such as solvent relaxation following excitation or rare pathways arising in new methodologies for the computation of free energy differences. Different types of dynamics ranging from Monte Carlo and Brownian dynamics to Newtonian and non-equilibrium dynamics can be treated on the same footing. To date, the transition path sampling method has been applied to many processes in physics, chemistry and materials science. Examples include chemical reactions in solution, conformational changes of biomolecules, isomerizations of small cluster, the dynamics of hydrogen bonds, ionic dissociation, transport in solids, proton transfer in aqueous systems, the dynamics of non-equilibrium systems, base pair binding in DNA, hydrophobic collapse, and cavitation between solvophobic surfaces. Furthermore, the transition path sampling has been combined with other approaches such as parallel tempering, master equation methods, and the Jarzynski method for the computation of free energy
1596
C. Dellago
differences. Due to the generality of the transition path sampling method it is likely that in the future this approach will be used fruitfully to study new problems in a variety of complex systems.
References [1] D. Wales, Energy Landscapes, Applications to Clusters, Biomolecules and Glasses, Cambridge University Press, Cambridge, 2003. [2] R. Elber, A. Ghosh, and A. C´ardenas, Long time dynamics of complex systems, Acc. Chem. Res., 35, 396, 2002. [3] H. J´onsson, G. Mills, and K.W. Jacobsen, “Nudged elastic band method for finding minimum energy paths of transitions,” In: B.J. Berne, G. Ciccotti, and D.F. Coker, (eds.), Computer Simulation of Rare Events and Dynamics of Classical and Quantum Condensed-Phase Systems – Classical and Quantum Dynamics in Condensed Phase Simulations, World Scientific, Singapore, p. 385, 1998. [4] W.E.W. Ren and E. Vanden-Eijnden, String method for the study of rare events, Phys. Rev. B, 66, 052301, 2002. [5] D. Chandler, “Barrier crossings: classical theory of rare but important events,” In: B.J. Berne, G. Ciccotti, and D.F. Coker (eds.), Computer Simulation of Rare Events and Dynamics of Classical and Quantum Condensed-Phase Systems – Classical and Quantum Dynamics in Condensed Phase Simulations, World Scientific, Singapore, p. 3, 1998. [6] C. Dellago, P.G. Bolhuis, F.S. Csajka, and D. Chandler, “Transition path sampling and the calculation of rate constants,” J. Chem. Phys., 108, 1964, 1998. [7] C. Dellago, P.G. Bolhuis, and P.L. Geissler, “Transition path sampling,” Adv. Chem. Phys., 123, 1, 2002. [8] P.G. Bolhuis, D. Chandler, C. Dellago, and P.L. Geissler, “Transition path sampling: throwing ropes over mountain passes in the dark,” Ann. Rev. Phys. Chem., 53, 291, 2002. [9] D. Frenkel and B. Smit, Understanding Molecular Simulation: From Algorithms to Applications, 2nd edn. Academic, San Diego, 2002. [10] N. Metropolis, A.W. Metropolis, M.N. Rosenbluth, A.H. Teller, and E. Teller, “Equation of state calculations for fast computing machines,” J. Chem. Phys., 21, 1087, 1953. [11] G. Ciccotti, “Molecular dynamics simulations of nonequilibrium phenomena and rare dynamical events,” In: M. Meyer and V. Pontikis (eds.), Proceedings of the NATO ASI on Computer Simulation in Materials Science, Kluwer, Dordrecht, p. 119, 1991. [12] D. Chandler, Introduction to Modern Statistical Mechanics, Oxford University Press, Oxford, 1987.
5.4 SIMULATING REACTIONS THAT OCCUR ONCE IN A BLUE MOON Giovanni Ciccotti1 , Raymond Kapral2 , and Alessandro Sergi2 1
INFM and Dipartimento di Fisica, Universit`a “La Sapienza”, Piazzale Aldo Moro, 2, 00185 Roma, Italy 2 Chemical Physics Theory Group, Department of Chemistry, University of Toronto, Toronto, ON, Canada, M5S 3H6
The computation of the rates of condensed phase chemical reactions poses many challenges for theory. Not only do condensed phase systems possess a large number of degrees of freedom so that computations are lengthy, but typically chemical reactions are activated processes so that transitions between metastable states are rare events that occur on time scales long compared to those of most molecular motions. This time scale separation makes it almost impossible to determine reaction rates by straightforward simulation of the equations of motion. Furthermore, condensed phase reactions often involve collective degrees of freedom where the solvent participates in an important way in the reactive process. Consequently, the choice of a reaction coordinate to describe the reaction is often far from a trivial task. Various methods for determining reaction paths have been devised (see Refs. [1, 2] and references therein). These methods have the goal of determining how the system passes from one metastable state to another and thus finding the reaction path or reaction coordinate. In many situations one has some knowledge of how to construct a reaction coordinate (or set of reaction coordinates) for a particular physical problem. One example is the use of the many-body solvent polarization reaction coordinate to describe electron or proton transfer in solution. In almost all situations investigated to date the dynamics of condensed phase activated reaction rates can be described in terms of a small number of reaction coordinates (often involving collective degrees of freedom). In this chapter, we describe how to simulate the rates of activated chemical reactions that occur on slow time scales, assuming that some set of suitable reaction coordinates is known. In order to compute the rates of rare reactive 1597 S. Yip (ed.), Handbook of Materials Modeling, 1597–1611. c 2005 Springer. Printed in the Netherlands.
1598
G. Ciccotti et al.
events we need to be able to sample regions of configuration space that are rarely visited since the interconversion between reactants and products entails passage through such regions of low probability. We show that by applying holonomic constraints to the reaction coordinate in a molecular dynamics simulation we can force the system to visit unfavorable configuration space regions. Through such constraints we can generate an ensemble of configurations (the Blue Moon ensemble) that allows one to efficiently estimate the rate constant for activated chemical processes [3].
1.
Reactive Flux Correlation Function Formalism
We begin with a sketch of the reactive flux correlation function formalism in order to specify the quantities that must be computed to obtain the reaction rate constant. In order to simplify the notation, we consider a molecular system containing N atoms with Hamiltonian H = K (p) + V (r), where K (p) is the kinetic energy, V (r) is the potential energy and (p, r) denotes the 6N momenta and coordinates defining the phase space of the system. A chemical reaction A B is assumed to take place in the system. The reaction dynamics is described phenomenologically by the mass action rate law dn A (t) = −kf n A (t) + kr n B (t), dt
(1)
where n A (t) is the mean number density of species A. The task is to compute −1 the forward kf and reverse kr = kf K eq (K eq is the equilibrium constant) rate constants by molecular dynamics simulation. (The formalism is easily generalized to other reaction schemes.) To this end, we assume that the progress of the reaction can be characterized on a microscopic level by a scalar reaction coordinate ξ(r) which is a function of the positions of the particles in the system. A dividing surface at ξ ‡ serves to partition the configuration space of the system into two A and B domains that contain the metastable A and B species. The microscopic variable corresponding to the fraction of systems in the A domain is n A (r) = θ(ξ ‡ − ξ(r)), where θ is the Heaviside function. Similarly, the fraction of systems in the B domain is n B (r) = θ(ξ(r) − ξ ‡ ). The time rate of change of n A (r) is n˙ A (r) = −ξ˙ (r)δ(ξ(r) − ξ ‡ ).
(2)
The rate at which the A and B species interconvert can be determined from the well-known reactive flux formula for the rate constant [4–6]. Using this formalism the time-dependent forward rate coefficient can be expressed in terms of the equilibrium correlation function of the initial flux of A with the
Simulating reactions that occur once in a blue moon
1599
A species density at time t as 1 1 ˙ A (r)n A (r, t) = eq ξ˙ δ(ξ(r) − ξ ‡ ) θ(ξ(r(t)) − ξ ‡ ) . (3) eq n nA nA
kf (t) =
Here, the angular brackets denote an equilibrium canonical average, · · · = eq Q −1 dr dr exp{−β H } · · · , where Q is the partition function and n A is the equilibrium density of species A. The forward rate constant can be determined from the plateau value of this time-dependent forward rate coefficient [6]. We can separate the static and dynamic contributions to the rate coefficient by multiplying and dividing each term on the right-hand side of Eq. (3) by δ(ξα (r) − ξ ‡ ) to obtain kf (t) =
ξ˙ δ(ξ(r) − ξ ‡ )θ(ξ ‡ − ξ(r(t))) δ(ξ(r) − ξ ‡ )
δ(ξ(r) − ξ ‡ )
eq
nA
.
(4)
The equilibrium average δ(ξ(r) − ξ ‡ ) = P(ξ ‡ ) is the probability density of finding the value of the reaction coordinate ξ(r) = ξ ‡ . We may introduce the free energy W(ξ ) associated with the reaction coordinate by the definition W(ξ ) = − β −1 ln(P(ξ )/Pu ), where Pu is a uniform probability density of ξ . For an activated process the free energy will have the form shown schematically in Fig. 1. A high free energy barrier at ξ = ξ ‡ separates the metastable reactant and product states. The equilibrium density of species A is
n A = θ(ξ ‡ − ξ(r)) = eq
=
dξ θ(ξ ‡ − ξ ) δ(ξ(r) − ξ )
dξ P(ξ ).
(5)
ξ <ξ ‡
B
W(ξ)
A
ξ‡
ξ
Figure 1. Sketch of the free energy versus ξ showing the free energy maximum at ξ = ξ ‡ and specification of the A and B domains.
1600
G. Ciccotti et al.
Using these results the expression for the time-dependent rate coefficient may be written as cd
‡
e−β W (ξ ) , kf (t) = ξ˙ θ(ξ ‡ − ξ(r(t)) ‡ ξ ‡ dξ e−β W (ξ ) ξ <ξ
(6)
where · · · cd‡ defines an average conditional on ξ(r) = ξ ‡ ξ
· · · cd ξ =
· · · δ(ξ(r) − ξ ) . δ(ξ(r) − ξ )
(7)
Often it is useful to represent the results in terms of the time-dependent transmission coefficient κ(t) which is defined as κ(t) = kf (t)/kfTST , where the transition-state theory value of the rate constant is given by the limit t → 0+ of Eq. (3) as [5] kfTST =
1 ‡ ˙ ˙ ξ δ(ξ(r) − ξ )θ( ξ ) . eq nA
(8)
The transmission coefficient κ(t) measures the deviations from kfTST due to dynamical recrossing events. From Eq. (6) we see that the computation of the rate coefficient requires the calculation of conditional averages depending on specified, rarely visited, values of the reaction coordinate. The ensemble of such configurations which are visited “once in a blue moon” is termed the blue moon ensemble [3]. In Section 2, we describe how the conditional averages which play an essential role in the computation of the rate constant may be determined from constrained molecular dynamics trajectories which allow one to efficiently sample rarely visited regions of configuration space.
2.
The Blue Moon Ensemble
The presence of the delta function δ(ξ(r) − ξ ) in the conditional equilibrium averages fixes the reaction coordinate to have the specified value ξ . We shall now show that such conditional averages of observables depending only on configuration space variables can be computed by applying holonomic constraints to the equations of motion. For simplicity, we assume that no other bond constraints are present but this more general case is easily treated [3]. To this end, we consider a system described by the Cartesian coordinates (r, p) subject to a holonomic constraint σ (r) = ξ(r) − ξ = 0 on the reaction coordinate. When there are constraints one usually introduces a set of generalized coordinates q and conjugate momenta pq such that r = r(q). In general, it is not possible to invert this relation since there are more r coordinates than q
Simulating reactions that occur once in a blue moon
1601
coordinates. However, by adding the expression for the constraint there is an extra generalized coordinate and the one to one correspondence r = r(q, σ ) is recovered. The statistical mechanics of the system may be formulated in terms of the generalized coordinates q; however, it is useful to have an equivalent formulation in terms of the original Cartesian coordinates. The dynamics of the system is described in Cartesian coordinates by the Lagrangian L(r, r˙ ) = K (˙r) − V (r) =
N 1 i=1
2
m i r˙ 2i − V (r),
(9)
to which we add the constraint σ = 0. The set of 3N − 1 generalized coordinates q plus σ can be taken as a new set of equivalent coordinates denoted collectively by u. We have r = r (q, σ ) = r (u), or u = u (r). In the new variables the Lagrangian is given by ˙ = 12 u˙ T Mu˙ − V (u), L (u, u)
(10)
where uT is the transpose of vector u and M = JT mJ is the metric matrix with elements given by Mµν =
N
mi
i=1
∂ri ∂u µ
·
∂ri ∂u ν
.
(11)
Here, J is the Jacobian matrix of the transformation r ↔ u and m is a diagonal matrix of the masses. The Lagrangian of the constrained motion is easily obtained by putting σ = σ˙ = 0 ˙ σ˙ = 0). ˙ ≡ L (q, σ = 0, q, Lc (q, q)
(12)
To derive the statistical mechanical ensemble we need the Hamiltonian description of the dynamical system. The Hamiltonian corresponding to the description with coordinates u is given by H (u, pu ) = 12 pu T M−1 pu + V (u),
(13)
where pu =
∂L ∂u˙
˙ = Mu.
(14)
The inverse of the metric matrix M−1 can be written explicitly as
M−1
µν
=
N 1 ∂u µ i=1
m i ∂ri
·
∂u ν ∂ri
.
(15)
To obtain the constrained motion we have to compute the Hamiltonian at σ = 0 and pσ satisfying the constraints σ = σ˙ = 0. Since
σ˙ = M−1 pu
3N
= Epq + Z pσ ,
(16)
1602
G. Ciccotti et al.
where the subscript 3N denotes that element of the vector M−1 pu and E and Z are submatrices in the block form of M−1 M−1 =
ET
E , Z
(17)
˜ q , where the tilde the above condition corresponds to taking pσ = − Z˜ −1 Ep means that the matrices have to be evaluated at σ = 0. The explicit form of Z is needed below and is given by Z=
N 1 ∂σ i=1
m i ∂ri
·
∂σ ∂ri
.
(18)
The constrained Hamiltonian may now be written as
˜ q . Hc (q, pq ) ≡ H q, σ = 0, pq , pσ = − Z˜ −1 Ep
(19)
Note that Eq. (16) implies pσ + Z −1 Epq = Z −1 σ˙ . Letting ρc (q, pq ) be the probability density for the constrained dynamical system, we have
ρc q, pq dq dpq = ρ u, pu δ(σ )δ( pσ + Z −1 Epq )du dpu = ρ r, pr δ(σ )δ(Z −1 σ˙ )dr dpr ≡ ρξ r, pr dr dpr . (20) In the penultimate equality, we used the fact that the point contact transformation (u, pu ) ↔ (r, pr ) is a canonical, phase space volume conserving, transformation [7]. We may rewrite this probability density as
p
ρξ r, pr = ρξr (r) ρξ pr |r ,
(21)
where the configurational probability density, ρξr (r), is obtained by performing the momentum integration of the full probability density ρξ (r, pr ) and the conditional probability density of the momenta given the configuration, p ρξ (pr |r), is defined in Eq. (21). In the canonical ensemble, the configurational probability density is given by 1/2 −β V (r) 1/2 −β V (r) e δ(σ )dr = Q −1 e δ(ξ(r) − ξ )dr, ρξr (r) dr = Q −1 c |Z | c |Z | (22)
where Q c is the partition function of the constrained system. The factor |Z |1/2 arises from performing the momentum integration of Eq. (20). The conditional probability density of the momenta given the configuration is
ρξ pr |r dpr = |Z |−1/2 e−β K δ(Z −1 σ˙ )dpr . p
(23)
Simulating reactions that occur once in a blue moon
1603
The physical interpretation of Z which enters this expression for the probability density has been discussed by several authors [8, 9] and has its origin in the restriction imposed in momentum space by the constraint σ = 0 which, holding at all times, implies that the generalized velocity σ˙ must vanish. The configurational probability density in Eq. (22) should be compared with the joint configurational probability density to be at r and at ξ = ξ ρ r (r) δ(ξ(r) − ξ )dr = Q −1 e−β V (r) δ(ξ(r) − ξ )dr.
(24)
We may express the conditional average of any configurational property of our system in terms of the ξ -constrained ensemble introduced above. While the value ξ we wish to sample is rare in the original ensemble, only configurations with ξ = ξ are sampled in the ξ -constrained ensemble. This feature is illustrated schematically in Fig. 2. By comparison of Eqs. (22) and (24) we may write O(r)δ(ξ(r) − ξ ) |Z |−1/2 O(r)ξ = , δ(ξ(r) − ξ ) |Z |−1/2 ξ
(25)
where the observable O(r) is any function of the configuration space, · · · denotes a canonical ensemble average and · · · ξ denotes an average over the constrained ensemble with ξ = ξ . Equation (25) allows one to estimate the conditional average on the left-hand side in terms of averages in the constrained ensemble with evident statistical advantages. The constrained ensemble we have constructed can be generalized to give the biased (whose bias may be removed) configurational sample determined above and the correct distribution of momenta. This Blue Moon ensemble can be easily obtained by multiplying the ξ -constrained configurational probability
ξ(r)⫽ξ'
Figure 2. Schematic representation of the sampling procedure in the Blue Moon ensemble. The bold line depicts the constrained (ξ(r) = ξ ) dynamical evolution in phase space. The unconstrained natural evolution of the system is shown as a dashed line. The open circles represent common points in configuration space which are the initial conditions of the activated trajectory sampling. These points are not real crossings in phase space since the two trajectories differ in the momentum space. Interruptions of the dashed line denote lengthy segments in the natural trajectory and indicate that “crossings” are rare events. The dynamics represented by the solid line segments of the unconstrained trajectory in the vicinity of the crossing points provide the dynamical information needed to compute averages.
1604
G. Ciccotti et al.
density times the correct (Maxwellian) conditional (most often the momenta and coordinates are independent) probability of the momenta ρBM (r, pr ) = ρξr (r)ρ p (pr |r).
(26)
This ensemble provides the basis for a natural method that can be used to compute time correlation functions. Given two arbitrary dynamical variables O (r, pr ) and O (r, pr ) we may write O (r, pr )O (r(t), pr (t))δ(ξ(r) − ξ ) δ(ξ(r) − ξ ) −1/2 O (r, pr )O (r(t), pr (t))ξ |Z | . = |Z |−1/2 ξ
(27)
The result in Eq. (27) allows one to compute the contribution to the timedependent rate coefficient in the first set of brackets in Eq. (4) using the Blue Moon ensemble. To complete the calculation of the time-dependent rate coefficient, we must be able to calculate Pξ (ξ ) = δ(ξ − ξ ) = Pu exp(−βW(ξ )) in an efficient manner. The free energy W(ξ ) is the reversible work needed to bring the system from a given reference state to ξ = ξ . The associated thermodynamic force F(ξ ) = −
dW(ξ ) , dξ
(28)
can be expressed as the conditional average of a suitable observable and from the thermodynamic integration of F(ξ ) over ξ , we can obtain the potential of mean force W(ξ ) =
ξ
dW(ξ dξ dξ
)
ξ
=
dξ
(∂ H/∂ξ ) δ(ξ − ξ ) . δ(ξ − ξ )
(29)
The explicit form of the thermodynamic force can be obtained by performing the derivative in Eq. (28) to obtain (∂ H/∂ξ )δ(ξ −ξ ) (β −1 (∂/∂ξ ) ln |J |−(∂ V /∂ξ ))δ(ξ − ξ ) = δ(ξ −ξ ) δ(ξ − ξ ) ˆ ξ ˆ Fδ(ξ − ξ ) Z −1/2 F = , (30) ≡ δ(ξ − ξ ) Z −1/2 ξ
F(ξ ) = −
where |J | is the Jacobian of the transformation r → u resulting from the explicit integration over the momenta. The quantity Fˆ whose conditional average determines the mean force is the sum of two terms: the first term, β −1 (∂/∂ξ ) ln|J |, represents the apparent forces acting on the system due to the use of generalized (non-inertial) coordinates, while the second term,
Simulating reactions that occur once in a blue moon
1605
−(∂ V /∂ξ ), corresponds to the component along the generalized coordinate ξ of the force coming from the potential V . This result expresses the thermodynamic force as a conditional average which can be computed numerically by using the Blue Moon ensemble as indicated in the last line of Eq. (30). It is possible to obtain another, more convenient, expression for the mean force that obviates the need to compute the Jacobian and the ξ derivative of the potential, two quantities that are often difficult to determine [10]. The alternative form involves the Lagrange multiplier associated with the constraint on ξ , one of the variables in the (u, pu ) representation of phase space u˙ =
∂H ∂pu
,
p˙ u = −
∂H ∂u
− λδξ u .
(31)
In this approach, one keeps the momentum dependent observable (∂ H/∂ξ ) and computes the difference between the configurationally unbiased constrained average and the corresponding conditional average. The (negative of the) mean force can be written as dW(ξ ) (∂ H/∂ξ ) δ(ξ − ξ ) = dξ δ(ξ − ξ ) −1/2 Z − λ − p˙ξ + (1/2β) (∂ ln |Z |/∂ξ ) ξ = Z −1/2 ξ −1/2 Z (1/β)G − λ ξ = , Z −1/2 ξ
(32)
where G=
N 1 ∂ξ ∂2 ξ ∂ξ 1 · · . 2 Z i, j =1 m i m j ∂ri ∂ri ∂r j ∂r j
(33)
The computations leading to this result are straightforward but lengthy [10]. This formula provides a much more convenient route for the computation of the mean force and, hence, the potential of mean force which uses quantities that are automatically provided by SHAKE [11, 12] in the constrained molecular dynamics simulation. From these considerations, we see that all quantities needed to estimate the rate coefficient may be determined efficiently in the Blue Moon ensemble. It is a straightforward to include other constraints, such as bond constraints, in the formalism [3]. In particular, the expression for the correlation function takes the form O (r, pr )O (r(t), pr (t))δ(ξ(r) − ξ ) δ(ξ(r) − ξ ) −1/2 O (r, pr )O (r(t), pr (t))ξ ,M D , = D −1/2 ξ ,M
(34)
1606
G. Ciccotti et al.
where the subscript M refers to the other bond constraints and D = |Z|/|Z | with Z defined as in Eq. (18) but extended to include all constraints Z mn =
N 1 ∂σm i=1
m i ∂ri
·
∂σn ∂ri
,
(35)
while Z is defined by a similar equation with the restriction to only bond constraints. To illustrate how the formalism can be applied we consider the adiabatic transfer of a proton in an [AH A]− complex, with fixed internuclear separation between the A− anions, solvated by a polar liquid [13] A − H · · · A− A− · · · H − A.
(36)
Let rp be the quantum coordinate of the proton and R the remainder of the complex and solvent classical degrees of freedom. The total potential energy of the system is V =Vps (rp , R)+Vs (R), where Vps and Vs are the proton–solvent and solvent–solvent interactions, respectively. In the adiabatic approximation, ¨ the proton wave function satisfies the following Schrodinger equation
h¯ 2 2 − ∇ + Vps (rp , R) n (rp ; R) = n (R) n (rp ; R), 2m p rp
(37)
where m p is the mass of the proton, 2πh¯ is Planck’s constant, n (R) is the nth adiabatic eigenvalue and the corresponding wave function is n (rp ; R). The ¨ = −∇R (Vps + classical coordinates follow Newton’s equations of motion m i R
n (R)) on the nth adiabatic energy surface. In particular, the adiabatic dynamics on the ground-state surface can be calculated easily by solving the ¨ Schrodinger equation for each solvent configuration in order to obtain the ground-state energy 0 (R) and wave function 0 . A convenient reaction coordinate for this problem is the solvent polarization, ξ(R) = E(R) E(R) =
i
zi
1 1 − , |Ri − u| |Ri − u |
(38)
where z i is the charge on site i and u and u are two chosen reference positions. The Blue Moon expression for the time-dependent transmission coefficient is κf (t) =
˙ D −1/2 ( E)θ( E(t) − E ‡ )ξ,M . ˙ ˙ D −1/2( E)θ( ( E)) ξ,M
(39)
Here, D −1/2 is the Blue Moon unbiasing factor with D = (2m)−1 i (∇i E)2 , where the sum extends over all classical degrees of freedom assumed to have equal mass m. The time-dependent transmission coefficient κ(t) was calculated by constraining the system to E(t) = E ‡ to generate the Blue Moon ensemble and releasing the constraint to determine the time evolution of
Simulating reactions that occur once in a blue moon
1607
1
κ(t )
0.8
0.6
0.4
0
1
2
3
4
5
t (ps) Figure 3.
The time-dependent transmission coefficient for adiabatic proton transfer.
θ( E(t) − E ‡ ) that appears in the correlation function expression for κ(t). The results of this calculation are shown in Fig. 3 [13]. The simulations show that a plateau is reached on the order of 1 ps and that the forward rate constant kf is about 0.6 of its kfTST value as a result of recrossings of the E(t) = E ‡ surface. The transition-state rate constant can also be determined in the Blue Moon ensemble using the expression
kfTST = (2πβ)−1/2 D −1/2
−1
ξ,M
e−β W ( E
E< E ‡
‡)
d Ee−β W ( E)
.
(40)
The free energy at the barrier top E ‡ was estimated from quadratic approximations to the free energy function near the metastable states and the expectation value of D −1/2 in the above formula was evaluated in the Blue Moon ensemble. The resulting value for the transition-state rate constant is kfTST = 4 × 109 s−1 . The direct molecular dynamics simulation of the rate constant would be a difficult task without the use of a rare event sampling technique in view of the activated nature of this proton transfer reaction.
3.
Vectorial Reaction Coordinate
In some instances, the reaction path the system takes to go from reactants to products may not be simply related to a single scalar reaction coordinate which is chosen on physical grounds. An inappropriate choice of a reaction coordinate can lead to difficulties in the computation of the rate. The underlying structure of the reaction path may often be revealed by extending the description to vectorial reaction coordinates. For example, if the free energy surface as a function of two reaction coordinates ξ1 and ξ2 has the structure
1608
G. Ciccotti et al.
shown in Fig. 4, then a description based on projections of the free energy along ξ1 will lead to misleading results. The discovery of the appropriate set of reaction coordinates, or more generally the reaction path, may not be a simple task for some systems. To describe the free energy of such more complex situations, we suppose that the system can be characterized by a set of reaction coordinates which are a functions of the positions of the particles in the system, ξ(r) = {ξ1 , ξ2 , . . . , ξn }. The probability density of finding ξ(r) = ξ is
P(ξ ) = δ(ξ(r) − ξ ) =
n
δ(ξα (r) −
α=1
ξα )
.
(41)
The free energy W(ξ ) associated with the vectorial reaction coordinate is W(ξ ) = −β −1 ln(P(ξ )/Pu ),
(42)
where Pu is again a uniform probability density of ξ . This free energy W or reversible work needed to take the system from the vectorial reaction coordinate value ξa to ξb can be calculated by means of a n-dimensional line integral
W(ξb ) − W(ξa ) =
dξ ·
∂W
C (ξ a ,ξ b )
∂ξ
,
(43)
where C(ξ a , ξ b ) is the path taken from ξa to ξb . Using Eqs. (41) and (42) and the properties of the delta function one may show that −
∂W ∂ξ
=−
∂H ∂ξ
cd
= Fξ ,
(44)
ξ
ψ2
B
‡
ψ2
X
A ψ1‡
ψ1
Figure 4. Sketch of a free energy surface showing two metastable regions depicted as shaded domains in the figure. To obtain such a plot, the free energy is computed for specified values ‡ ‡ of two reaction coordinates, ξ1 (r) and ξ2 (r). The saddle point at (ξ1 , ξ2 ) is indicated by a × symbol.
Simulating reactions that occur once in a blue moon
1609
where Fξ is the mean force associated with ξ. Following the procedure outlined in Section 2 we may write the (negative of the) mean force in the form [14] ∂W ∂ξ
||−1/2 1/βG − λ
=
||−1/2
ξ‡
ξ‡
,
(45)
where αβ =
1 ∂ξα ∂ξβ k
m k ∂rk ∂rk
.
(46)
and we have defined the vector G with elements Gα =
i,n
1 −1 ∂ξµ ∂2 ξγ ∂ξν −1 , m i m n µγ ν µα ∂ri ∂ri ∂rn ∂rn γ ν
α = 1, . . . , n,
(47)
and λ is the vector of Lagrange multipliers appearing in the constrained equations of motion. The formalism for the most general treatment where there are both other constraints and vectorial reaction coordinate constraints has been given by [15]. The Blue Moon ensemble has been used to compute the free energy as a function of several reaction coordinates for ionization reactions of [NaCl2 ]− ion complexes in water clusters [16]. The multidimensional reaction coordinate formalism described above has also been applied to study the interaction between monomers in a superoxide dismutase protein, Photobacterium leiognathi [14], which we now briefly describe. This protein provides a good example of macromolecular recognition since the monomers are able to form the dimeric enzyme in water. Calculation of the binding force for different mutant proteins, obtained by substituting the amino acids at the monomer–monomer interface, and structural analysis could provide insight into the recognition process. In Fig. 5, we give a pictorial view of the protein as found in nature.
Zn Cu
Figure 5. Photobacterium leiognathi Cu,Zn SOD structure. The ribbon shows the fold of the two identical subunits constituting the dimer. Arrows represent the β-strands while thin wires represent the random-coil structure and the turns. The copper and zinc ions are shown as dark and light gray labelled spheres, respectively.
1610
G. Ciccotti et al. 10
W(kcal/mol)
0 ⫺10 ⫺20 ⫺30 ⫺40 ⫺50 16
17
18
19
20
21
22
23
24
ψ1(Å) Figure 6.
The graph shows the potential of mean force as a function of the separation.
The separation of the two monomers can be studied as a function of their relative displacement and orientation. This requires a six-dimensional reaction coordinate. A complete sampling of the phase space as a function of this sixdimensional coordinate is not feasible for the system under investigation (there are 2694 atoms in the proteins which were solvated by 9944 water molecules). However, the principal component of the binding force can be calculated by freezing the slow orientational modes of the two monomers and studying their separation at a fixed orientation. One can choose the initial orientation of the monomers to be that minimizing the energy of the system; hence, the mean force along the relative separation distance can be calculated. The result of such a calculation is shown in Fig. 6. While the separation path one obtains is not fully realistic, it can be used to perform a series of identical numerical experiments on different mutants of Photobacterium leiognathi to investigate the important structural and dynamical features in the recognition process.
4.
Outlook
The description of condensed phase activated rate processes is a challenging problem. The choice of a suitable reaction coordinate or set of reaction coordinates is a central feature of such descriptions. Often this choice is made on physical grounds but schemes for determining reaction paths are needed to provide results when physical considerations are inadequate. Once such reaction coordinates are known the methods described in this chapter provide algorithms for the computation of reaction rates. As briefly described in the text, the methods presented here have been used to investigate also adiabatic quantum rate processes. Non-adiabatic reaction rates may also be treated using the techniques developed here [17].
Simulating reactions that occur once in a blue moon
1611
References [1] C. Dellago, P.G. Bolhuis, and P.L. Geissler, “Transition path sampling,” Adv. Chem. Phys., 123, 1–78, 2002. [2] W.E and E. Vanden Eijnden, “Conformational dynamics and transition pathways in complex systems,” In: S. Attinger and P. Koumoutsakes (eds.), Lecture Notes in Computational Science and Engineering, Springer, Berlin, vol. 39, to be published, 2004. [3] E. Carter, G. Ciccotti, C. Hynes, and R. Kapral, “Constrained reaction coordinate dynamics for the simulation of rare events,” Chem. Phys. Lett., 156, 472–477, 1989. [4] T. Yamamoto, “Quantum statistical mechanical theory of the rate of exchange chemical reactions in the gas phase,” J. Chem. Phys., 33, 281–289, 1960. [5] D. Chandler, “Statistical-mechanics of isomerization dynamics in liquids and transition-state approximation,” J. Chem. Phys., 68, 2959–2970, 1978. [6] R. Kapral, S. Consta, and L. McWhirter, “Chemical rate laws and rate constants,” In: B. Berne, G. Ciccotti, and D. Coker (eds.), Classical and Quantum Dynamics in Condensed Phase Systems, World Scientific, Singapore, pp. 583–616, 1998. [7] H. Goldstein, Classical Mechanics, Addison-Wesley, Reading, MA, 1980. [8] M. Fixman, “Classical statistical-mechanics of constraints – theorem and application to polymers,” Proc. Natl. Acad. Sci. USA., 71, 3050–3053, 1974. [9] N.G. van Kampen and J.J. Lodder, “Constraints,” Am. J. Phys., 52, 419–424, 1984. [10] M. Sprik and G. Ciccotti, “Free energy from constrained molecular dynamics,” J. Chem. Phys., 109, 7737–7744, 1998. [11] J.P. Ryckaert, G. Ciccotti, and H.J.C. Berendsen, “Numerical-integration of Cartesian equations of motion of a system with constraints – molecular-dynamics of n-alkanes, J. Comput. Phys., 23, 327–341, 1977. [12] G. Ciccotti and J.P. Ryckaert, “Molecular dynamics simulation of rigid molecules,” Comput. Phys. Rep., 4, 345–392, 1986. [13] D. Laria, G. Ciccotti, M. Ferrario, and R. Kapral “Molecular dynamics study of adiabatic proton transfer reactions in solution,” J. Chem. Phys., 97, 378–388, 1992. [14] A. Sergi, G. Ciccotti, M. Falconi, A. Desideri, and M. Ferrario, “Effective binding force calculation in a dimeric protein by molecular dynamics simulation,” J. Chem. Phys., 116, 6329–6338, 2002. [15] I. Coluzza, M. Sprik, and G. Ciccotti, “Constrained reaction coordinate dynamics for systems with constraints,” Mol. Phys., 101, 2885–2894, 2003. [16] S. Consta and R. Kapral, “Ionization reactions of ion complexes in mesoscopic water clusters,” J. Chem. Phys., 111, 10183–10191, 1999. [17] A. Sergi and R. Kapral, “Quantum-classical dynamics of non-adiabatic chemical reactions,” J. Chem. Phys., 118, 8566–8575, 2003.
5.5 ORDER PARAMETER APPROACH TO UNDERSTANDING AND QUANTIFYING THE PHYSICO-CHEMICAL BEHAVIOR OF COMPLEX SYSTEMS Ravi Radhakrishnan1 and Bernhardt L. Trout2 1 Department of Bioengineering, University of Pennsylvania, Philadelphia, PA, USA 2
Department of Chemical Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA
Many physico-chemical processes such as nucleation events in phase transitions, chemical reactions, conformational changes of biomolecules, and protein folding are activated processes that involve rare transitions between stable or metastable states in the free energy surface. Understanding the underlying mechanism and computing the rates associated with such processes is a central to many applications. For instance, the familiar process of nucleation of ice from supercooled water is encountered in several scientific and technologically relevant processes. The formation of ice microcrystals in clouds via nucleation is a phenomenon that has a large impact in terms of governing global climatic changes. The key to the survival of Antarctic fish and certain species of beetles through harsh winters is their ability to inhibit nucleation of intracellular ice with the aid of antifreeze proteins. At the other end of the spectrum, certain protein assemblies called ice-nucleation agents are believed to be responsible for catalyzing ice nucleation, a phenomenon, which is exploited by certain bacteria to derive nutrients from their host plants. Controlling the formation and propagation of intracellular ice is finding importance in cryopreservation of natural and biosynthetic tissues. Similarly, one can cite many technologically relevant self-assembly and transport processes in the context of fabrication of advanced materials for specific applications in drug delivery, biosensing, and chemical catalysis. A unifying feature among various activated events is that they can be understood in terms of transitions between a series of stable (global minimum) 1613 S. Yip (ed.), Handbook of Materials Modeling, 1613–1626. c 2005 Springer. Printed in the Netherlands.
1614
R. Radhakrishnan and B.L. Trout
or metastable (local minima) basins in the free energy landscape separated by free energy barriers or bottlenecks (also known as transition states). The metastable states represent high-probability regions and the transition states represent low-probability regions of phase space. For a system consisting of N atoms, the free energy landscape F = −kB T ln Q is 3N-dimensional and related the configurational partition function Q given by,
Q=
dr1 dr2 · · · dr N exp(−β H (r1 , r2 , . . ., r N )).
(1)
Here, kB is the Boltzmann constant, T is the temperature, r1 ,r2 , . . . , r N are coordinates of the N atoms in the system, β = 1/kB T , and H is the classical Hamiltonian giving the energy of the system for a given configuration. An activated process can be described by a set of pathways connecting the relevant metastable states in the free energy landscape (see Fig. 1). A Monte Carlo path or a molecular dynamics trajectory that captures an activated process is likely to be representative of a pathway for the transition in the sense that the trajectory will show many characteristics that are unique to the pathway. However, an ensemble of molecular dynamics trajectories (or Monte Carlo paths) connecting the metastable states of the free energy landscape, rather than a single trajectory or path best describes the mechanism of transition. Consequently, the intermediate states along the pathway can be
H (r1,r2)
1.5 1 0.5 0 ⫺0.5 ⫺1 ⫺1.5 ⫺2 80
A
60 r2 40
B 20 0
0
10
20 30
40 r1
50
60
70
Figure 1. Model Hamiltonian for a system with two degrees of freedom. The stable (A) and metastable (B) states are shown along with the transition state. Three different paths connecting states A and B are shown on the contour projection.
Order parameter approach of complex systems
1615
characterized by unifying patterns (structural or energetic) that are common to the ensemble of molecular dynamics trajectories. In a statistical sense, identifying the dynamical variables to quantify the patterns and averaging over the different molecular configurations along the transition pathway can yield insight into the relationship between the evolution of the patterns and the free energy landscape. These dynamical variables, also referred to as order parameters, are quantities that can classify different metastable states according to their distinguishing characteristics (such as symmetries associated with different phases). In addition, the order parameters depend on the nature of intermolecular forces, solvent degrees of freedom, etc., and consequently, the chemical environment will impact their choice. In the simple example in Fig. 1, the intermediate states and the transition pathway are easily described in terms of the variables r1 and r2 , which serve as good order parameters. As we shall see throughout this article, the information about the free energy landscape obtained from such an approach is useful in quantifying the rate of the activated process while the evolution of the order parameters along the pathway is useful in understanding the underlying mechanism. Furthermore, equilibrium properties of the system, and how they depend on the control variables, can be inferred from the relationship between the order parameters and the free energy landscape. Conceptual understanding of the nature of the process, which arises from the relationship between the order parameters and the free energy landscape, generally goes by the name of “a phenomenological theory”. More specifically, the phenomenology arises from identifying how the order parameters (and hence the rate of the process) are influenced by the chemical environment, state variables, and control variables, so that the order parameters can themselves be ascribed physical meaning and interpretation.
1.
Relationship between the Order Parameters and the Free Energy Function
The use of order parameters to construct phenomenological theories (top-down approach) of phase transitions in condensed matter and solid-state systems was pioneered by Landau, Ginzburg, De Gennes, and others. In this approach, the order parameter is chosen based on physical grounds and intuition, and the free energy functional (as a function of the order parameter) is constructed based on symmetry arguments. The literature in this class of problems is extensive, with applications ranging from superconductivity and superfluidity, magnetic and liquid-gas transitions, and theory of liquid crystals. A comprehensive treatise on the study of phase transitions using
1616
R. Radhakrishnan and B.L. Trout
phenomenological approaches, including universality associated with critical behavior and the re-normalization group method is provided in Refs. [1, 2]. Order parameters can also be used to construct the free energy functional by the coarse graining (bottom-up approach) of the microscopic Hamiltonian. For complex systems, for which the construction of an analytic free energy functional may be nontrivial, the free energy as a function of the order parameters can be obtained via density functional theory [3], or via molecular simulations. In this article, we discuss the latter approach. Starting from a set of n order parameters (φ1 , φ2 , . . . , φn ), the free energy density, [φ1 , φ2 , . . . , φn ] (also called the potential of mean force or Landau free energy), along the order parameters, are related to the microscopic Hamiltonian by [1]
exp(−β[φ1 , φ2 , . . . , φn ])=
dr1 dr2 · · · dr N exp(−β H (r1 , r2 , . . . , r N )) ×δ(φ1 − φ1 )δ(φ2 − φ2 ) · · · (φn − φn ).
Here, δ is the Dirac delta function, and [φ1 , φ2 , . . . , φn ] is to be interpreted as [φ1 = φ1 ,φ2 = φ2 , . . . , φn = φn ]. The free energy F is then given by
exp(−β F) =
dφ1 dφ2 · · · dφn exp(−β[φ1 , φ2 , . . . , φn ]).
(3)
The domain of integration in the above equation covers the range of order parameter values characterizing the particular state. In the example given in Fig. 1, [φ1 , φ2 ] ≡ [r1 , r2 ] = exp(−β H (r1 , r2 )), and the free energy of state A is obtained by integrating over r1 in the range (0–30), and over r2 in the range (30–60). The value of the free energy is insensitive to the exact values defining the domain of integration, as long as the region containing the minimum of the function is included. In the course of a microscopic simulation (such as molecular dynamics or Monte Carlo), the free energy density is calculable by collecting histograms of the distribution of the order parameters. If the sampling in the simulations is ergodic (i.e., encompasses the relevant phase space) and sufficiently long, these histograms are proportional to the joint probability distribution of the order parameters, P[φ1 , φ2 , . . . , φn ]. The free energy density is related to the P[φ1 , φ2 , . . . , φn ] by β[φ1 , φ2 , . . . , φn ] = −ln(P[φ1 , φ2 , . . . , φn ]) + Constant.
(4)
In order to circumvent the problem associated with ergodicity, the histograms are evaluated in separate windows of the order parameter ranges using the procedure of umbrella sampling [4]. The umbrella sampling can be understood as performing the simulations in an extended ensemble whose free
Order parameter approach of complex systems
1617
energy is related to the original thermodynamic ensemble (with a free energy F) by = F −
h i φi ,
(5)
i
where i h i φi is chosen a priori as a weighting function W {φ1 , φ2 , . . . , φn }. The umbrella sampling scheme amounts to simulations being performed using a modified Hamiltonian H = H + βW {φ1 , φ2 , . . . , φn }). The probability distribution P [φ1 , φ2 , . . . , φn ] in the modified ensemble defined by is the related to P[φ1 , φ2 , . . . , φn ] by −kB T ln(P [φ1 , φ2 , . . . , φn ]) = −kB T ln(P[φ1 , φ2 , . . . , φn ]) −W {φ1 , φ2 , . . . , φn }.
(6)
In the simplest case, choosing W {φ1 , φ2 , . . . , φn } = 0 for φ1,min < φ1 < φ1,max , and ∞ otherwise, enables the calculation of P[φ1 , φ2 , . . . , φn ] in the range φ1,min < φ1 < φ1,max . Performing such calculations over several windows covering the entire range of φ1 (of relevance) enables an accurate calculation of P[φ1 , φ2 , . . . , φn ]. In addition, enhanced sampling methods such as configurational bias sampling [5], parallel tempering [6], density of states Monte Carlo [7], and methods based on Tsallis statistics [8] can be used to improve the accuracy of the calculations.
2.
Types of Order Parameters
Order parameters have been extensively used in conjunction with molecular simulations in applications involving solid and liquid-crystalline (LC) phases, in which one of the phases is characterized by long-range order. In such cases, the order parameter can be chosen on the basis of the symmetry of the ordered phase. A few examples are given in Fig. 2. For phases with longrange order (i.e., φ(0)φ(r → ∞) = nonzero constant), the order parameter assumes a nonzero value. For disordered phases (i.e., φ(0)φ(r) ∼ exp(−r/λ), λ being the correlation length), the order parameter is zero for an infinite system. For phases with quasi-long-range order (i.e., φ(0)φ(r) ∼ r −η ), the order parameter in a finite system assumes a value intermediate between the disordered and ordered phases, with system size dependence characterized by the exponent η. The Mermin order parameter [9] is introduced to quantify order in a twodimensional crystal of circular disks, where the only close-packing possible is hexagonal, i.e., leading to a triangular lattice. More generally, for an “N-atic” order in two-dimensional systems, the pair correlation function g(r) ≡ g(r, θ) in a cylindrical coordinate system (r ≡ reiθ ) can be expressed in terms of a Fourier series in angular (θ) space
1618
Figure 2.
R. Radhakrishnan and B.L. Trout
Order parameters describing bond-orientational order in condensed phases.
g(r, θ) =
g j (r) exp(i N j θ),
(7)
j
where the summation over j runs from 0 to ∞. The coefficients of expansion (i.e., the g j (r)s ) are suitable order parameters. For a hexatic (6-fold) symmetry, the dominant order parameter is given by the first term in the expansion
Order parameter approach of complex systems
1619
evaluated at the nearest neighbor distance, i.e., g1 (r = rnn ), which is the same as the Mermin order parameter 6 (r) in Fig. 2. The Steinhardt order parameters [10] are a generalization of the above definition to three-dimensional systems. The pair correlation function g(r) ≡ g(r, θ, φ) in spherical polar coordinates is expanded in terms of a Fourier series,
g(r) = go (r) 1 +
l
lm (r) lm (θ, φ) ,
(8)
m
where the summation over l runs from 0 to ∞, and that over m runs from −1 to +1. The coefficients lm are related to the Steinhardt order parameters (Fig. 2), which are useful in differentiating between various crystal types in three-dimensional systems. For water-like molecules (which have a propensity for tetrahedral coordination, owing to their hydrogen-bonding nature), the tetrahedral order parameter [11] in Fig. 2 measures the degree to which the nearest-neighbor molecules are tetrahedrally coordinated with respect to a given molecule. The tetrahedral order parameter is a three-body order parameter, which ensures local tetrahedral symmetry around each (water-like) molecule. The tetrahedral order parameter is sensitive to formation of structures of crystalline structures in water. Similarly, the nematic order parameter [1] in Fig. 2 quantifies the degree of nematic order (i.e., parallel ordering of anisotropic molecules along their longitudinal axis) in liquid-crystalline systems. In fact, the nematic order parameter is characterized by a 2-fold symmetry (the longitudinal axis is a headless director, i.e., with no up or down direction), and therefore is closely related to Y2m term of the Steinhardt order parameter. In the examples given in Fig. 2, the definitions of order parameters are based on bond-orientational order, i.e., orientation of nearest neighbor (or molecular) bonds. In each case, the order parameters quantify the degree of crystalline order in the system; therefore, the order parameters assume nonzero (distinct) values in the crystalline phase, which reduce (mostly to zero) in the disordered phase.
3. 3.1.
Applications of Order Parameters Quantification of Disorder
Torquato and coworkers [12], have used the three-dimensional Steinhardt order parameters along with a translational order parameter t (based on the radial distribution function g(r)) to quantify the degree of disorder in dense packed materials. For a system of hard spheres in three dimensions, the authors
1620
R. Radhakrishnan and B.L. Trout
computed order parameter maps (Q 6 vs. t) for the liquid and crystal phases at equilibrium, and series of metastable states with jammed configurations (i.e., those configurations in which a given particle cannot be displaced when the rest of the particles in the system are fixed). The authors found that the translational order parameter was always positively correlated with the bond orientational order parameter (i.e., an increase in one led to an increase in the other) for the hard sphere system. Additionally, the bond orientational order parameter (being the more sensitive measure of the two) increased monotonically with increasing volume packing fraction for the jammed structures, for the entire range of packing fraction between the equilibrium liquid and crystal. The authors concluded that the concept of random close-packing is ill-defined based on the observation that an infinitesimal increase in the bond-orientational order parameter can lead to an infinitesimal increase in the packing fraction. The results also supported the view that glassy structures were not merely liquid-like structures with “frozen-in” disorder, because they were characterized by distinctly different values of Q 6 , intermediate between liquid and crystal phases.
3.2.
Anomalies of Liquid Water
Errington and Debenedetti [13] have advanced a formalism to understand the structure–property relationship in liquid water on the basis of order parameter maps. Based on the values of the translational order parameter t and the tetrahedral order parameter ξ for liquid water at equilibrium, the authors traced paths of the system in ξ − t space. Each path was obtained at constant temperature as the density was gradually increased in their computer simulations. Unlike the hard sphere case (where Q 6 and t are positively correlated and monotonically increase with increasing volume fraction), the authors found structurally anomalous regions (of state space, e.g., in the temperature–density plot) in water where “order” decreased with increasing density. The boundary of the structurally anomalous region was identified by ξ and t extrema on the ξ − t traces at different temperatures. The authors also found that the structural anomaly in water was correlated with a transport anomaly (when the diffusion coefficient increases with increasing density), and with a thermodynamic anomaly (when the coefficient of thermal expansion is negative); in particular, the anomalous regions occur as a cascade, i.e., the structurally anomalous region encompasses the region characterized by the transport anomaly, which encompasses the region showing the thermodynamic anomaly. In a following work, the authors also investigated the order parameter maps in a system of Lennard-Jones particles and found that the LJ system of particles displayed the same qualitative behavior as the system of hard spheres, which further
Order parameter approach of complex systems
1621
supports the view that the anomalies in water are directly related to the chemical structure of the water molecule.
3.3.
Nucleation of Crystalline Forms from Liquid
In a pioneering study, Frenkel and coworkers [14] calculated the free energy barrier to crystal nucleation in a system of Lennard-Jones particles in three dimensions, by employing the Steinhardt order parameters and using the formalism in Section 2. The authors showed that the path to nucleation of the stable face centered cubic phase (when the liquid is supercooled below the freezing temperature) can be described in terms of increasing values of Q 6 , while simultaneously suppressing the increase of W4 . The path in order parameter space along which both Q 6 and W4 simultaneously increase, leads the system into a metastable body centered cubic phase. Radhakrishnan and Trout [15–17] extended the above approach to describe ice-nucleation under a variety of homogeneous and inhomogeneous environments including hexagonal ice in the bulk, cubic ice under an external electric field and in a confined system, and clathrate hydrates in a super-saturated aqueous solution containing the hydrophobic solute, CO2 . In order to calculate the free energy barrier to nucleation, the authors employed the two-body Steinhardt order parameters and the three-body tetrahedral order parameters for the one-component systems, and additionally used a translational order parameter based on g(r) for the two-component aqueous solution of CO2 . The authors found that as the successive density modes in the liquid (quantified by peaks in the direct correlation function) became more correlated – owing to a decrease in temperature, influence of an external potential, or increased inhomogeneity – the free energy barrier to nucleation decreased. Interpreting their results in light of density functional theory of freezing, the authors discovered an inverse correlation between the degree of coupling of the successive density modes in the liquid phase and the free energy barrier to nucleation. Rutledge and coworkers [18], using molecular dynamics simulations, have studied crystal nucleation in a polymer melt. The time-scale to observe nucleation of a crystal phase in a polymer melt is normally beyond the scope of molecular dynamics simulations. The authors, however, found that under an applied a uniaxial (extensional) stress, the barrier to nucleation reduces considerably, to the extent that crystal nucleation can be captured in the simulations. The crystalline domains in the simulations were identified based on the local value of the nematic order parameter. The authors concluded that the addition of a large deforming stress accelerates the crystallization process by driving the individual chains into a low energy torsional conformation and by aligning them in a single direction, which leads to a lowering of the nucleation barrier.
1622
R. Radhakrishnan and B.L. Trout
Shetty and coworkers [19] have proposed a new formalism to construct new types of order parameters to quantify local order in inhomogeneous systems (such as a crystal–melt interface) based on pattern recognition and genetic algorithm.
3.4.
Solvation in Biomolecules
The contribution of hydration in molecular assembly and enzyme catalysis has long been recognized. Many biomolecules are characterized by surfaces containing extended nonpolar regions, and the aggregation and subsequent removal of such surfaces from water is believed to play a critical role in the biomolecular assembly in cells. Conventional views hold that the hydration shell of small hydrophobic solutes is clathrate-like, characterized by local cage-like hydrogen-bonding structures and a distinct loss in entropy. Using molecular dynamics simulations on the solvated polypeptide melittin, Cheng and Roskky [20] found that the hydration of extended nonpolar planar surfaces appears to involve structures that are orientationally inverted relative to clathrate-like hydration shells, with unsatisfied hydrogen bonds that are directed towards the hydrophobic surface. The authors employed bond-orientational order parameters to classify the local structuring of the solvent. Based on the correlation between the observed values of the order parameters and the average binding energy (i.e., the interaction of a molecule with all other molecules in the system) of proximal water molecules in each surface set, they concluded that the clathrate-like and inverted clathrate-like structures are distinguished by a substantial difference in the water–water interaction enthalpy, and that their relative contributions depended strongly on the surface topography of the melittin molecule. Clathrate-like structures dominate near convex surface patches, whereas the hydration shell near flat surfaces fluctuates between clathrate-like and less-ordered or inverted structures. The strong influence of surface topography on the structure and free energy of hydrophobic hydration is likely to be a generic feature, which may be important for many biomolecules.
3.5.
Freezing of Inhomogeneous Fluids in Porous Media
Molecular simulations for simple fluids confined in model systems of slit-shaped pores show a freezing behavior that is governed by the relative strength of the fluid–wall interaction to the fluid–fluid interaction (quantified by a parameter α), and the pore width H . The shift in the freezing temperature, Tf,pore − Tf,bulk, is found to be positive if the fluid–wall interaction is more strongly attractive than the fluid–fluid interaction and negative if the fluid–wall interaction is less attractive than the fluid–fluid interaction.
Order parameter approach of complex systems
1623
Using the Mermin order parameters and the free energy formalism in Section 2, Radhakrishnan and coworkers [21] discovered the presence of several thermodynamically stable intermediate phases lying between the liquid phase and the solid phase in computer simulation studies of Lennard-Jones molecules in slit-pores. Their studies led to the conclusion that the contact layers, i.e., the layers closest to the pore walls, freeze at a higher temperature than the inner layers for strongly attractive pores (large values of α), and thus the intermediate phase has the structure termed “contact-crystalline”, i.e., the contact layers are crystalline while the inner layers are liquid-like. For moderate values of α, the contact layers are liquid-like while the inner layers are crystalline, and the intermediate phase exists as a “contact-liquid” phase. The authors also found that for repulsive and weakly attractive walls, the intermediate (contact-layer) phase is at best metastable, and thus, only the liquid and crystal phases are stable. Based on these observations, the authors constructed “global phase diagrams” which present a unifying picture of confined phase freezing behavior in terms of the parameter α and the pore width H . In a later study [22], the authors also found evidence for the existence of a hexatic phase as an intermediary between the fluid and crystalline ones. The hexatic phase is a manifestation of the fact that, in a continuous symmetry breaking transition such as the freezing transition, the translational symmetry and the rotational symmetry can break at two different temperatures. Thus, in the liquid to hexatic phase transition, the rotational symmetry is broken and in the hexatic to crystalline transition the translational symmetry is broken. Hexatic phases, which retain long-range orientational, but not positional order, are known to occur in infinite quasi-two-dimensional systems; the authors established their presence in the simulations using a system size scaling analysis. They also found that for pore sizes accommodating more than three adsorbed molecular layers, a “contact-hexatic” phase was stable phase (in the simulations), where the contact layers are hexatic, while the inner layers are liquid-like.
4.
Assumptions in the Order Parameter Approach and Outlook
As illustrated in this article, the order parameter approach can be gainfully employed in studies of complex systems. In problems where an obvious symmetry is involved, defining a suitable set of order parameters becomes an easy task. The various examples described here demonstrate that these order parameters can be used to associate a defining characteristic of the free energy landscape to the observed phenomenon. At the expense of increased physical insight and phenomenological understanding, several inherent assumptions go into the order parameter approach described here, which we discuss below.
1624
4.1.
R. Radhakrishnan and B.L. Trout
Physical Significance of the Order Parameters
Based on the relationship between the order parameters and the free energy landscape, it is tempting to associate the order parameters with physical variables. However, in most cases, the order parameters appear as coefficients of expansion of an extensive thermodynamic variable. Consequently, depending on the choice of expansion, the definitions of the order parameters vary and are certainly not unique. Therefore, it is not guaranteed a priori that the order parameters should represent physical variables. In the examples described here, the physicality of the order parameters can be understood on the basis of density functional theory. Since the free energy F is a unique functional of the spatially varying density ρ(r), and the order parameters in Fig. 2 are all based on expansions of g(r) (where ρg(r) = ρ(r)), the order parameters can be ascribed to physical variables, if the particular density mode they characterize can be identified. In general, for other choices of order parameters, this connection must be established. Another underlying assumption is that the phenomena of interest (happening in 3N-dimensional space) can be described in terms of a small number of order parameters. Although a rigorous proof in support of this assumption may not be possible, an argument based on a few general characteristics of physical systems may be put forward in its defense. If our objective is to correlate the equilibrium properties of the system using the order parameters, the order parameters can once again be chosen as the coefficients of expansion of g(r). On first glance, it appears that one needs to include an infinite set of order parameters to have a rigorous theory. However, most often, correlations in g(r) die out by molecular length scales (even in the ordered phase, at finite temperatures), and therefore only order parameters corresponding to density modes relevant to these length-scales need to be included, which reduces their number to a few. If the objective is to describe an activated process, only those dynamical variables corresponding to the slowest modes (which are identifiable by principal component analysis of a molecular dynamics trajectory) in the transition pathway need to be included, therefore greatly reducing the number of relevant order parameters.
4.2.
Rate Processes
Within order parameter framework, we need to invoke additional assumptions to compute the rates of activated processes. A straightforward and conceptually appealing description is using transition state theory, according to which, the rate k is given by k = A exp(−β F),
(9)
Order parameter approach of complex systems
1625
where F is the free energy barrier along the reaction pathway (i.e., the free energy of the transition state relative to the reactants), and A is a pre-factor related to the inherent frequency of barrier crossing. For an ideal gas, A = (βh)−1 , h being the Planck’s constant. More generally, A is given by the inverse of the time-scale over which the order parameter correlation function φ(0)φ(t) decays when calculated at the transition state. Both terms (i.e., F and A) can be important in calculating the rate. In closing, we note that methods for verifying the existence of a transition state in a multidimensional free energy landscape independent of the order parameter formalism exist, which can validate the findings of the order parameter approach [23]. Alternative approaches to treat activated processes, which are independent of the existence of order parameters (and hence related approximations) have also been developed [24]. Nevertheless, the order parameter approach continues to be widely employed because of its simplicity, computational efficiency, and phenomenological appeal.
References [1] P.M. Chaikin and T.C. Lubensky, Principles of Condensed Matter Physics, Cambridge University Press, Cambridge, 1995. [2] N. Goldenfeld, Lectures on Phase Transitions and the Renormalization Group, Addison-Wesley, New York, 1992. [3] D. Henderson (ed.), Fundamentals of Inhomogeneous Fluids, Marcel Dekker, New York, 1992. [4] D. Chandler, Introduction to Modern Statistical Mechanics, Oxford University Press, Oxford, 1987. [5] D. Frenkel and B. Smit, Understanding Molecular Simulations: From Algorithms to Applications, 2nd edn., Academic Press, San Diego, 2001. [6] R.H. Zhou, B.J. Berne, and R. Germain, “The free energy landscape for beta hairpin folding in explicit water,” Proc. Natl. Acad. Sci. USA, 98, 14931–14936, 2001. [7] F.G. Wang and D.P. Landau, “Efficient, multiple-range random walk algorithm to calculate the density of states,” Phys. Rev. Lett., 86, 2050–2053, 2001. [8] C. Tsallis, “Possible generalization of the Boltzmann–Gibbs Statistics,” J. Stat. Phys., 52, 479–487, 1988. [9] N.D. Mermin, “Crystalline order in 2 dimensions,” Phys. Rev., 176, 250, 1968. [10] P.J. Steinhardt, D.R. Nelson, and M. Ronchetti, “Bond-orientational order in liquids and glasses,” Phys. Rev. B, 28, 784–805, 1983. [11] P.L. Chau and A.J. Hardwick, “A new order parameter for tetrahedral configurations,” Mol. Phys., 93, 511–518, 1998. [12] S. Torquato, T.M. Truskett, and P.G. Debenedetti, “Is random close packing of spheres well defined?” Phys. Rev. Lett., 84, 2064–2067, 2000. [13] J.R. Errington and P.G. Debenedetti, “Relationship between structural order and the anomalies of liquid water,” Nature, 409, 318–321, 2001. [14] R.M. Lyndenbell, J.S. Van Duijneveldt, and D. Frenkel, “Free-energy changes on freezing and melting ductile metals,” Mol. Phys., 80, 801–814, 1993.
1626
R. Radhakrishnan and B.L. Trout
[15] R. Radhakrishnan and B.L. Trout, “A new approach for studying nucleation phenomena using molecular simulations: application to CO2 hydrate clathrates,” J. Chem. Phys., 117(4), 1786, 2002. [16] R. Radhakrishnan and B.L. Trout, “Nucleation of crystalline phases of water in homogeneous and inhomogeneous environments,” Phys. Rev. Lett., 90, 2003, 2003. [17] R. Radhakrishnan and B.L. Trout, “Nucleation of hexagonal ice Ih in liquid water,” J. Am. Chem. Soc., 125, 7743, 2003. [18] M.S. Lavine, N. Waheed, and G.C. Rutledge, “Molecular dynamics simulation of orientation and crystallization of polyethylene during uniaxial extension,” Polymer, 44, 1771–1779, 2003. [19] R. Shetty, F. Escobedo, D. Choudhary, and P. Clancy, “Characterization of order in simple materials. A pattern recognition approach,” J. Chem. Phys., 117, 4000–4009, 2002. [20] Y.K. Cheng and P.J. Rossky, “Surface topography dependence of biomolecular hydrophobic hydration,” Nature, 392, 696–699, 1998. [21] R. Radhakrishnan, K.E. Gubbins, and M. Sliwinska-Bartkowiak, “Global phase diagrams for freezing in porous media,” J. Chem. Phys., 116, 1147–1155, 2002. [22] R. Radhakrishnan, K.E. Gubbins, and M. Sliwinska-Bartkowiak, “Existence of a hexatic phase in porous media,” Phys. Rev. Lett., 89, 076101, 2002. [23] P.G. Bolhuis, C. Dellago, and D. Chandler, “Reaction coordinates of biomolecular isomerization,” Proc. Natl. Acad. Sci. USA, 97, 5877–5882, 2000. [24] P.G. Bolhuis, D. Chandler, C. Dellago, and P. Geissler “Transition path sampling: throwing ropes over rough mountain passes, in the dark,” Ann. Rev. Phys. Chem., 53, 291–318, 2002.
5.6 DETERMINING REACTION MECHANISMS Blas P. Uberuaga and Arthur F. Voter Theoretical Division, Los Alamos National Laboratory, Los Alamos, NM 87545, USA
The articles in this chapter review methods for determining reaction rates for systems in which transitions from state to state are infrequent. Building on seminal concepts such as transition state theory, advances in the last 25 years have given us efficient techniques for finding saddle points and computing accurate rate constants, both classically and quantum mechanically. One motivation for calculating rate constants is that they can be supplied as input to higher-level simulation models, such as the kinetic Monte Carlo (KMC) method, which are the subject of the next chapter. For a KMC simulation to provide dynamical predictions at a desired level of quality, the accuracy of the rate constants should be of equal quality, but, just as important, the list of rates needs to be complete; it should contain all of the relevant reaction mechanisms. This latter challenge is often more daunting than the former. In this article, we discuss specific examples illustrating the difficulty in identifying the important reaction mechanisms. Through these examples, we demonstrate the use of methods for searching for these mechanisms and the importance of doing so. Realistic systems often behave in ways we least expect and if we rely on our intuition about what reaction pathways exist, we are almost certain to miss important mechanisms. We focus on infrequent-event systems in which each state corresponds to a basin in the potential energy surface, the typical case for materials processes, although some of the concepts can be generalized to free-energy basins (i.e., entropically trapped states). As we consider making up a list of rates, these systems generally fall into one (or more) of four categories: Category 0: systems in which all the reaction mechanisms are known, and can be specified in advance. Category 1: systems with reaction mechanisms that are unexpected, lying outside our intuition. Category 2: systems with reaction mechanisms that only become important (or come into existence) when the system conditions are varied. 1627 S. Yip (ed.), Handbook of Materials Modeling, 1627–1634. c 2005 Springer. Printed in the Netherlands.
1628
B.P. Uberuaga and A.F. Voter
Category 3: systems with reaction mechanisms that become important (or come into existence) after evolution of the system causes it to change its character. Systems from category 0 are ideal for kinetic Monte Carlo simulation. Knowing all the reaction mechanisms, we can, in principle, compute the rate constant for each one, forming a complete rate catalog [1]. If the rate constants provided to the KMC algorithm are exact, the resulting dynamics will also be exact – an extremely appealing situation. However, in essence, category 0 exists only for model systems. Systems for which all the reaction mechanisms are known in advance are ones we have made that way by construction. Pure model systems play an important role in understanding materials properties and testing methodology, but often we are interested in accurately modeling realistic systems or obtaining accurate results for dynamics in a particular interatomic potential. As physical systems are allowed to evolve freely, they inevitably show us unexpected reaction mechanisms. This puts them into category 1 at least, and varying the conditions may also reveal additional mechanisms (category 2). The problem is that, often, a system must evolve for times longer than those accessible via MD before this behavior becomes evident. Worse, if the system also belongs to category 3, which we typically do not know in advance, we will need to follow the dynamics for much longer times. Frustratingly, this time scale issue is the very reason we appealed to KMC in the first place, and now we are faced with it again just to find the relevant rate constants.
1.
Approaches to Exploring the System
Accelerated molecular dynamics (AMD) methods [2], described elsewhere in this handbook [3], offer a way around this dilemma. They give us a way to probe the system dynamics without the limitations of our imposed intuition. In the accelerated dynamics approach, the system is allowed to evolve according to the classical equations of motion, as in a direct molecular dynamics simulation. However, by design, during this evolution, state-to-state transitions are coaxed into occurring more rapidly, though in a way still faithful to the dynamics of the system. The result is that, with these methods, the system evolution can be followed over much longer time scales than are accessible to direct molecular dynamics simulation. Reaction mechanisms that are too slow to be observed with direct MD occur naturally during the evolution of an AMD simulation. An alternative to AMD for discovering reaction mechanisms and probing long-time dynamics is to collect a set of escape paths from a given potential
Determining reaction mechanisms
1629
basin. One way of doing this is to search for saddle points bounding the basin. For example, in the dimer method, described elsewhere in this chapter [4], efficient mode-following searches are initiated at random positions in the basin. Such methods offer a convenient way to scan for possible reaction mechanisms out of a given state and can be employed to probe long-time dynamics. By performing a large number of saddle searches, the majority of relevant escape paths can be found. If the escape rate is then computed for each of these paths, one can be chosen in an on-the-fly kinetic Monte Carlo (OFKMC) step. This takes the system to a new state, and the procedure is then repeated. One must keep in mind, however, that if any of the escape paths are missed in the saddle searches, then the OFKMC step to the next state may not be advancing the system in a dynamically correct way. If low-barrier escape paths are missed, the dynamical evolution will almost certainly be corrupted. The philosophy of this saddle-finding approach differs from that of the accelerated dynamics methods. In AMD, no attempt is made to determine all possible mechanisms for escape from a state (potential basin). Instead, the goal is to propagate the system from state to state as fast as possible while maintaining accuracy in the sense that the probability for choosing a given escape path from a state is proportional to the rate constant for that path. In exact evolution (e.g., via MD), the system chooses an appropriate escape path without knowing about the other possible escape paths, and the power of AMD comes from adopting this philosophy. As tools for determining reaction mechanisms to be supplied as input to KMC, the AMD approach and the saddle-finding approach are complimentary. To probe long times accurately, e.g., for category-3 systems, the higher fidelity of the AMD approach may be advantageous. To generate a list of reaction mechanisms out of a given type of state, the saddle-finding approach is typically more efficient. To illustrate the main point of this discussion, we now give examples of systems for each of the three categories listed above; in each case, an incomplete (intuition-based) KMC table would result in incorrect dynamics. The category-1 example is historical, concerning the diffusion behavior on the fcc(100) surface, perhaps the simplest of metal surfaces. For the surfacediffusion community, at least, this was where the issue of mechanism complexity and rate-catalog incompleteness first became apparent. The second example, the diffusion of interstitial hydrogen in an fcc lattice of fullerenes, illustrates a category-2 system in which parallel replica dynamics (an AMD method) was instrumental in uncovering an unexpected mechanism that, in turn, qualitatively altered the KMC predictions. In the last (category-3) example, taken from a study of radiation damage annealing in MgO, a surprising and unexpected mechanism turned up only after a temperature accelerated dynamics simulation was used to evolve interstitial clusters for seconds.
1630
2.
B.P. Uberuaga and A.F. Voter
Category 1: Surface Exchange on FCC(100)
The simplicity of the fcc(100) surface has long made it a prototype case for studies of metallic surface diffusion and growth. An isolated adatom rests in a four-fold hollow with four available 011 directions for hopping to an adjacent site. Because atoms in the surface layer make four nearest-neighbor bonds, i.e., the surface is tightly packed, it was originally assumed that these hopping events were the only diffusive mechanism available to the adatom, and kinetic Monte Carlo models [1] were based on this assumption. However, density functional theory calculations on A1 [5] showed that an adatom can exchange with a surface layer atom, leading to a 100 displacement to a second-nearest-neighbor position, as shown in Fig. 1. For a number of fcc metals (e.g., Al, Pt, Au), this mechanism is not only available, but substantially favored over hopping. The exchange event can be easily observed in a hightemperature molecular dynamics simulation using embedded-atom method potentials [6], but up to that time the community was so confident in its intuition about adatoms hopping on fcc(100) that no such simulation had been performed. In subsequent years, exchange processes were discovered to play a dominant role, providing low-energy paths for surface smoothing, diffusion over step edges and interface mixing (e.g, see Refs. [7, 8]), even for the metals where hopping is favored for an isolated adatom. Many more complicated processes have been discovered as well (e.g., [9] and Refs. [30–44] in Ref. [2]). Clearly, exchange events should be included in kinetic Monte Carlo simulations to obtain a proper description of the long-time behavior during growth or annealing.
Figure 1. Adatom diffusion mechanisms on Ag(100). Top row: adatom hop. Bottom row: adatom exchange mechanism. In each case, themiddle frame is the saddle point and the initial adatom is highlighted for clarity.
Determining reaction mechanisms
3.
1631
Category 2: H2 Diffusion in FCC C60
Understanding the behavior of H2 and other light gases in carbonaceous materials is of great interest because of the potential technological applications, such as fuel cells. Using parallel replica dynamics, the diffusive behavior of H2 in crystalline C60 was examined in an effort to determine the important diffusive events [10]. As expected, H2 moves through the interstitial sites of the C60 lattice by single molecular hops, jumping between octahedral and tetrahedral sites in the lattice. The parallel replica simulations revealed, however, that under higher H2 loading, more than one H2 molecule can occupy a single octahedral site, and this fact dramatically changes the diffusive behavior. The dependence of the diffusive behavior on loading makes this system an example of a category2 system. After the parallel replica simulations had explored the system long enough so that all of the relevant mechanisms were uncovered, the rates of these mechanisms were provide as input to a KMC simulation. If multiple occupancy of octahedral sites is not allowed, the self-diffusivity of H2 in C60 falls off quickly as the loading of H2 is increased, as seen in Fig. 2. However, once the fact that multiple H2 can share an interstitial site is included in the KMC simulation, the behavior reverses and the self-diffusivity increases substantially with loading. The system had to be allowed to fully explore the state-space available to it under high loading conditions.
100
D/D0
10
1
T=700K T=500K T=300K T=500K (restricted model) T=300K (restricted model)
0.1
0.01
0
0.2
0.4
0.6
0.8
1
Fractional loading
Figure 2. Self-diffusivity of H2 predicted by a lattice-gas KMC model with and without the existence of interstitial dimers and trimers (filled and open symbols, respectively). At each temperature, the self-diffusivity is shown normalized by the self-diffusivity of an isolated interstitial H2 , D0 . Error bars, shown for the 700 K case with dimers, are similar for the other cases. The overall self-diffusivity changes completely with the addition of reactions involving interstitial dimers (after Ref. [11]).
1632
4.
B.P. Uberuaga and A.F. Voter
Category 3: Radiation-damage Annealing in MgO
Oxide ceramics are important materials in nuclear applications, as, for example, fuels in light water reactors and host materials for storing nuclear waste. Thus, an understanding of the radiation damage behavior is critical for predicting the aging properties of these materials. In a study using pairwise Coulombic potentials for MgO, and temperature accelerated dynamics (TAD) augmented by lowest-barrier information from the dimer method (dimer-TAD [3]), the room-temperature annealing of cascade-generated defects was investigated [11]. Because the barriers in this system were typically high (relative to T = 300 K), dimer-TAD yielded substantial boost factors, allowing simulations on very long time scales. With this interatomic potential, interstitials and vacancies formed in lowenergy cascades are charged, and thus interact strongly. Interstitials, mobile on the ns time scale, annihilate with vacancies (which are immobile) or aggregate with other interstitials to form clusters In , containing n interstitials. Dimers (I2 ) are mobile on the time scale of seconds at T = 300 K, and two dimers encountering each other form an I4 cluster, which is both stable against dissociation and essentially immobile. This suggested that all larger clusters would be stable and immobile as well, so that only the mobility of smaller clusters (n < 4) needed to be accounted for in order to understand the long time behavior of damage in MgO. However, pursuing the cascade annealing evolution further showed this was not true, and several unusual characteristics probably would not have been discovered in a static study. As shown in Fig. 3, a diffusing I2 that encounters an I4 can create a highly mobile I6 entity. After the initial encounter, the I6 system passed through 32 states over a time of 2.9 s before the onset of mobility. Further, this mobile state travels one-dimensionally along a single 110 direction, and diffuses faster than a single interstitial. Each diffusive jump is a concerted event involving 12 atoms – the six interstitial atoms and six lattice atoms. Finally, this kinetically formed state is not the ground state, but a metastable state with a lifetime of years at T = 300 K. This is a clear example of category-3 behavior. Simulations following the coalescence of interstitials into dimers, which in turn formed tetramers and finally hexamers, on the time scale of seconds, were required before the unexpectedly mobile I6 cluster emerged. This behavior clearly impacts the cascade annealing dynamics, and an accurate KMC model will need to include the formation and diffusion kinetics of I6 and perhaps larger clusters as well.
5.
Conclusions
As these examples illustrate, care must be taken in constructing a rate table for higher-level simulations such as KMC. Often, human intuition is not
Determining reaction mechanisms (a)
1633 (b)
8 ps
(c)
4.1 s
1.2 s
(d)
4.1 s ⫹ 41 ns
Figure 3. TAD simulation of the formation of interstitial cluster I6 (three Mg cation interstitials and three O anion interstitials) from I2 and I4 at T = 300 K. Only defects in the lattice are shown. The scheme is: large spheres are interstitials and small spheres arevacancies, light spheres are O and dark spheres are Mg, where a vacancy is defined to be any lattice site with no atom within 0.83 Å and, conversely, an interstitial is any atom not within 0.83 Å of a lattice site. (a) An I2 and I4 begin about 1.2 nm apart. (b) By t = 1.2 s, the I2 approaches the immobile I4 . (c) By t = 4.1 s, the combined cluster anneals to form the metastable I6 , (d) which diffuses on the ns time scale with a barrier of 0.24 eV (after Ref. [11]).
adequate for determining what reaction mechanisms might be important. A much more reliable approach is to allow the system to explore the space available to it, considering both the varying initial conditions that might be relevant as well as the states it might enter (unexpectedly) at much longer times. Finally, we note that for some systems, the behavior will be so complex as to defy condensation into an accurate rate catalog. Highly concerted mechanisms can make even the specification of events difficult. Moreover, if the rates depend strongly on the environment beyond a short distance, the size of the catalog, which grows exponentially with the neighborhood size [1], becomes prohibitively large. This becomes a serious problem more quickly for alloy systems. In this situation, direct simulation using accelerated dynamics or OFKMC methods offers an alternative.
Acknowledgments This work was supported by the United States Department of Energy (DOE), Office of Science, Office of Basic Energy Sciences, Division of
1634
B.P. Uberuaga and A.F. Voter
Materials Sciences; and through a cooperative research and development agreement (CRADA) with Motorola, Inc.
References [1] A.F. Voter, “Classically exact overlayer dynamics – diffusion of rhodium clusters on Rh(100),” Phys. Rev. B–Condens. Matter., 34, 6819–6829, 1986. [2] A.F. Voter, F. Montalenti, and T.C. Germann, “Extending the time scale in atomistic simulation of materials,” Annu. Rev. Mater. Res., 32, 321–346, 2002. [3] B.P. Uberuaga, F.Montalenti, T.C. Germann, and A.F. Voter, “Accelerated molecular dynamics methods,” Handbook of Materials, 2004. [4] H. J´onsson, Handbook of Materials, 2004. [5] G.L. Kellogg and P.J. Feibelman, “Surface self-diffusion on Pt(001) by an atomic exchange mechanism,” Phys. Rev. Lett., 64, 3143–3146, 1990. [6] M.S. Daw, S.M. Foiles, and M.I. Baskes, “The embedded-atom method: a review of theory and applications,” Mater. Sci. Rep., 9, 251–310, 1993. [7] T. Ala-Nissila, R. Ferrando, and S.C. Ying, “Collective and single particle diffusion on surfaces,” Adv. Phys., 51, 949–1078, 2002. [8] A.K. Schmid, J.C. Hamilton, N.C. Bartelt, and R.Q. Hwang, “Surface alloy formation by interdiffusion across a linear interface,” Phys. Rev. Lett., 77, 2977–2980, 1996. [9] H. J´onsson, “Theoretical studies of atomic-scale processes relevant to crystal growth,” Ann. Rev. Phys. Chem., 51, 623–653, 2000. [10] B.P. Uberuaga, A.E. Voter, K.K. Sieber, and D.S. Sholl, “Mechanisms and rates of interstitial H2 diffusion in crystalline C60 ,” Phys. Rev. Lett., 91, 105901, 2003. [11] B.P. Uberuaga, R. Smith, A.R. Cleave, F. Montalenti, G. Henkelman, R.W. Grimes, A.F. Voter, and K.E. Sickafus, “Structure and mobility of defects formed from collision cascades in MgO,” Phys. Rev. Lett., 92, 115505, 2004.
5.7 STOCHASTIC THEORY OF RATE PROCESSES Abraham Nitzan Tel Aviv University, Tel Aviv, 69978, Israel
1. 1.1.
Stochastic Modeling of Physical Processes Introduction
This chapter is written under the assumption that the reader has basic knowledge of probability theory such as needed in an elementary course in statistical mechanics, and at least an intuitive feeling for random numbers as those generated by tossing a coin or throwing a die. A random function is a function that assigns a random number to each value of its argument. Using this argument as an ordering parameter, each realization of this function is an ordered sequence of such random numbers. When the ordering parameter is time we have a time series of random variables, which is called a stochastic process. For example, the random function F(t) that assign to each time t the number of cars on a given highway segment is a random function of time, i.e., a stochastic process. Time is a continuous ordering parameter, however if observations of the random function z(t) are made at discrete time 0 < t1 < t2 , · · · , < tn < T , then the sequence {z(ti )} is a discrete sample of the continuous function z(t). Stochastic processes are ubiquitous in descriptions of observed phenomena. Here we focus on systems of classical particles. Given the initial conditions of a classical system of N particles (i.e., all initial 3N positions and 3N momenta) its time evolution is determined by the Newton equations of motion. For a quantum system, the corresponding N -particle wavefunction is determined by evolving the initial wavefunction according to the Schr¨odinger equation. In fact these initial conditions are generally not known but can be often characterized by a probability distribution (e.g., the Boltzmann distribution for an equilibrium system). The (completely deterministic) time evolution 1635 S. Yip (ed.), Handbook of Materials Modeling, 1635–1672. c 2005 Springer. Printed in the Netherlands.
1636
A. Nitzan
associated with any given initial state should be averaged over this distribution. This is the usual starting point of non-equilibrium statistical mechanics. In many cases, however, we seek simplified descriptions of physical processes by focusing an small subsystems or on a few observables that characterize the process of interest. These observables can be macroscopic, e.g., the energy, pressure, temperature, etc. of the system, or microscopic, e.g., the center of mass position, a particular bond length or the internal energy of a single molecule. In the reduced space of these “important” observables, the microscopic influence of the other ∼1023 degrees of freedom appears as random fluctuations that give these observables an apparently random character. For example, the energy of an individual molecule behaves as a random function of time (i.e., a stochastic process) even in a closed system whose total energy is strictly constant. Lets consider a particular example in which we are interested in the center of mass position ri of an isotopically substituted molecule i in an equilibrium homogeneous fluid containing a macroscopic number N of normal molecules. The trajectory ri (t) of this molecule shows an erratic behavior, changing direction (and velocity) after each collision. Indeed, this trajectory is just a projection a deterministic trajectory in the 6N dimensional phase space on the coordinate of interest, however solving this 6N -dimensional problem may be intractable and, moreover, may constitute a huge waste of effort because it yields the time dependence of 6N momenta and positions of all N particles while we are interested only in ri (t), the position of a single particle i. Instead we may look for a reduced description of ri (t) only. We may attempt to get it by a systematical reduction the 6N -coupled equations of motion. Alternatively we may construct a phenomenological model for the motion of this coordinate under the influence of all other motions. As we shall see, both ways lead to the characterization of ri (t) as a stochastic process. As another example consider the internal vibrational energy of a diatomic solute molecule, e.g., CO, in a simple atomic solvent (e.g., Ar). This energy can be monitored by spectroscopic methods, and we can follow processes such as thermal (or optical) excitation and relaxation, energy transfer and energy migration. The quantity of interest may be the time evolution of the average vibrational energy per molecule, where the average is taken over all molecules of this type in the system (or in the observation zone). At low concentration these molecules do not affect each other and all dynamical information can be obtained by observing (or theorizing on) the energy Ej (t) of a single molecule j . Average over many such molecules or over repeated independent observations on a single molecule is an ensemble average. Following vibrational excitation, it is often observed that the subsequent relaxation is exponential, E(t)=E(0) exp(−γt). A single trajectory Ej (t) (also observable by a method called single molecule spectroscopy) is however much more complicated. As before, to predict its exact course of evolution we need to know the initial
Stochastic theory of rate processes
1637
positions and velocities of all the particles in the system, then to solve the Newton or the Schr¨odinger equation with these initial conditions. Again, the resulting trajectory in phase space is completely deterministic, however Ej (t) appears random. In particular, it will look different in repeated experiments because in setting up such experiments only the initial value of Ej is specified, while the other degrees of freedom are subjected only to a few conditions (such as temperature and density). In this reduced description Ej (t) may be viewed as a stochastic variable. The role of the theory is to set up its statistical properties and to investigate its consequences. Obviously, once the usefulness of descriptions of physical processes as stochastic processes in a small subspace of variables is realized, different models of this type can be examined, in which different subspaces are considered. Being interested in the time evolution of the vibrational energy of a single diatomic molecule, we may focus just on this variable, or on the coordinate (the internuclear distance) and momentum of the intramolecular nuclear motion, or on the atomic coordinates and velocities associated with the molecule and its nearest neighbors, etc. These increasingly detailed reduced descriptions lead to greater accuracy at the cost of bigger calculations. The choice of level of reduction is guided by the information designated as relevant based on available experiments, and by considerations of accuracy based on physical arguments. In particular, timescale and interaction-range considerations are central to the theory and practice of reduced descriptions. The relevance of stochastic descriptions brings out the issue of their theoretical and numerical evaluation. Instead of solving the equations of motion for ∼6×1023 degrees of freedom we now face the much less demanding, but still challenging need to construct and to solve stochastic equations of motion for the few relevant variables. The next section describes a particular example.
1.2.
An Example: The Random Walk Problem
An example of a stochastic process associated with a reduced molecular description is the random walk process, in which a particle starts from a given position and moves randomly. This is a model for the motion of a molecule that is assumed to change direction randomly after each collision, then moves a certain length l (of the order of the mean free path) before the next collision. For simplicity lets consider a 1-dimensional (1D) model: during a time interval t the particle is assumed to move to the right with probability pr = kr t and to the left with probability pl = kl t, so that the probability that its stays in its original position is 1 − pr − pl . kl and kr are rate coefficients, measuring the probabilities per unit time that the corresponding properties will occur. In a homogeneous system the rates to move to the right and the left are the
1638
A. Nitzan
same, kl = kr . Inequality may reflect the existing of some force that makes the probability to move in a particular direction larger than in the opposite one. Obviously pl and pr are linear in t only for t sufficiently small so that these numbers are substantially less then 1. Starting from t = 0, we require the probability P(n, t) = P(n, N t) that the particle has made a net number of n steps to the right (A negative n implies that the particle has actually moved to the left), i.e., if it starts at position n = 0 we ask what is the probability that it is found at position n (i.e., at distance nl from the origin) at time t, after making at total of N steps. An equation for P(n, t) can be found by considering the propagation from time t to t +t: P(n, t + t) = P(n, t) + kr t (P(n − 1, t) − P(n, t)) + kl t (P(n + 1, t) − P(n, t))
(1.1)
In Eq. (1.1) the terms that add to P(n, t) on the right are associated with different random steps. Thus, for example, kr t P(n − 1, t) is the increase in P(n, t) due to the possibility of jump, during a time interval t, from position n − 1 to position n, while −kr t P(n, t) is the decrease in P(n, t) resulting from transitions from n to n + 1 in the same period. Rearranging Eq. (1.1) and deviding by t we get, when t → 0, ∂ P(n, t) = kr (P(n − 1, t) − P(n, t)) + kl (P(n + 1, t) − P(n, t)) ∂t (1.2) Note that in (1.2) time is a continuous variable while position, expressed by n is discrete. We may also go into a continuous representation in position space by substituting n → nx = x, n − 1 → x − x, n + 1 → x + x to get ∂ P(x, t) = kr (P(x − x, t) − P(x, t)) + kl (P(x + x, t) − P(x, t)) ∂t (1.3) Here P(x, t) may be understood as the probability to find the particle in an interval of length x about x. Introducing the density f (x, t) so that P(x, t) = f (x, t)x and expanding the right hand side of (1.3) up to second order in x we obtain ∂ f (x, t) ∂ 2 f (x, t) ∂ f (x, t) = −v +D (1.4) ∂t ∂x ∂x2 where x (1.5) v = (kr − kl )x = ( pr − pl ) t and where 1 x 2 (kr + kl )x = ( pr + pl ) (1.6) D= 2 (2t)
Stochastic theory of rate processes
1639
Note that even though in (1.4) we use a continuous representation of position and time, the nature of our physical problem implies that x and t are finite, of the order of the mean free path and the mean free time, respectively. To get a feeling for the nature of the solution of Eq. (1.4) consider first the case D = 0. The solutions of the equation ∂ f /∂t = −v∂ f /∂ x have the form f (x, t) = f (x − vt) i.e., any structure defined by f is moving forward (to the right) with speed (drift velocity)) v. This is what is expected under the influence of a constant force that makes kr and kl different. The first term of (1.4) is seen to reflect the effect of the systematic motion resulting from this force. Next consider Eq. (1.4) for the case v = 0, i.e., when kr = kl . In this case Eq. (1.4) becomes the diffusion equation ∂ 2 f (x, t) ∂ f (x, t) =D (1.7) ∂t ∂x2 The solution of this equation for the initial condition f (x, 0) = δ(x − x0 ) is
1 (x − x0 )2 exp − f (x, t|x0 , t = 0) = 4Dt (4π Dt)1/2
(1.8)
(Note that the left hand side is written as a conditional probability density: We have found the probability density about point x at time t given that the particle was at x 0 at time t = 0. Note also that the initial density f (x, 0) = δ(x − x0 ) reflects the initial condition that the particle was, with probability 1, in a neighborhood of length x about x0 taken in the limit x → 0). The diffusion process is the actual manifestation of the random walk that leads to a symmetric spread of the density about the initial position. Equation (1.7) implies that the solution of (1.4) under the initial condition f (x, 0) = δ(x − x0 ) is
1 (x − vt − x0 )2 exp − f (x, t|x0 , t = 0) = 4Dt (4π Dt)1/2
(1.9)
showing both the drift and the diffusion spread. Further insight into the nature of the drift-diffusion process that we are studying can be obtained by considering moments of the probability distribution. Equation (1.2) readily yields equations that describe the time evolution of these moments. Both sides of Eq. (1.4) yield zero when summed over all n from −∞ to ∞, while multiplying this equation by n and n 2 then performing the summation lead to d n = kr − kl (1.10) dt and dn 2 = 2n(kr − kl ) + kr + kl (1.11) dt
1640
A. Nitzan
Assuming n(t = 0) = n 2 (t = 0) = 0, i.e., that the particle starts its walk from the origin, n = 0, Eq. (1.10) results in nt = (kr − kl )t
(1.12)
while Eq. (1.11) leads to n 2 t = (kr − kl )2 t 2 + (kr + kl )t
(1.13)
From Eqs. (1.12) and (1.13) it follows that t = ( pr + pl )N (1.14) t for a walker that has executed a total of N steps during time t = N t. When we are interested in length scales that are large relative to x we may consider a continuous representation of these results. Putting x = nx, Eq. (1.12) becomes δn 2 t = n 2 t − n2t = (kr + kl )t = ( pr + pl )
xt = vt
(1.15)
while Eq. (1.14) gives δx 2 t = 2Dt
(1.16)
where v and D are given by Eqs. (1.5) and (1.6), respectively. Together Eqs. (1.5) and (1.6) express the essential features of biased random walk: a drift with speed v associated with the bias kr =/ kl , and a spread with a diffusion coefficient D. The linearity of the spread δx 2 with time is a characteristic feature of normal diffusion. Note that for a random walk in an isotropic 3-dimensional space the corresponding relationship is δr 2 = δx 2 + δy 2 + δz 2 = 6Dt
2.
(1.17)
Some Concepts from the General Theory of Stochastic Processes
In Section 1 we have defined a stochastic process as a time series of random variable(s). If observations are made at discrete time 0 < t1 < t2 , · · · , < tn < T , then the sequence {z(ti )} is a discrete sample of the continuous function z(t). In the random walk problem discussed in Section 1 z(t) was the position at time t of a particle that executes such a walk. We can measure and discuss z(t) directly, keeping in mind that we will obtain different realizations (stochastic trajectories) of this function from different experiments performed under identical conditions. Alternatively we can characterize the process using the probability distributions associated with it. We can consider many such distributions: P(z, t)dz is the probability that the
Stochastic theory of rate processes
1641
realization of the random variable z at time t is in the interval between z and z + dz. P2 (z 2 t2 ; z 1 t1 ) dz 1 dz 2 is the probability that z will have a value between z 1 and z 1 + dz 1 at t1 and between z 2 and dz 2 at t2 , etc. The time evolution of the process, if recorded in times t0 , t1 , t2 , . . . , tn is most generally represented by the joint probability distribution P(z n tn ; . . . ; z 0 t0 ). The concept of conditional probability is useful: P1 (z 1 t1 |z 0 t0 )dz 1 =
P2 (z 1 t1 ; z 0 t0 )dz 1 P1 (z 0 t0 )
(2.1)
is the probability that the variable z will have a value in the interval z 1 , . . . , z 1 + dz 1 at time t1 if it assumed the value z 0 at time t0 . Similarly P2 (z 4 t4 ; z 3 t3 |z 2 t2 ; z 1 t1 )dz 3 dz 4 =
P4 (z 4 t4 ; z 3 t3 ; z 2 t2 ; z 1 t1 ) dz 3 dz 4 P2 (z 2 t2 ; z 1 t1 )
(2.2)
is the conditional probability that z is in z 4 , . . . , z 4 + dz 4 at t4 and is in z 3 , . . . , z 3 + dz 3 at t3 , given that its values were z 2 at t2 and z 1 at t1 . In the absence of time-correlations, the values taken by z(t) at different times are independent. In this case P(z n tn ; z n−1 tn−1 ; . . . ; z 0 t0 )= nk=0 P(z k , tk ) and time correlation functions, e.g., C(t2 , t1 ) = z(t2 )z(t1 ), are given by products of simple averages C(t2 , t1 )=z(t2 )z(t1 ), where z(t1 )= dz z P1 (z, t1 ). This is often the case when the sampling times tk are placed far from each other – farther than the longest correlation time of the process. More generally, the time correlation function C(t1 , t2 ) can be obtained from the distribution P2 (z 2 t2 ; z 1 t1 ) by the obvious expressions
C(t2 , t1 ) = dz 1 dz 2 z 2 z 1 P2 (z 2 t2 ; z 1 t1 )
(2.3a)
C(t3 , t2 , t1 ) = dz 1 dz 2 dz 3 z 3 z 2 z 1 P2 (z 3 t3 ; z 2 t2 ; z 1 t1 )
(2.3b)
In practice, numerical values of time correlations functions are obtained by averaging over an ensemble of realizations. Let z (k) (t) be the kth realization of the random function z(t). Such realizations are obtained by observing z as a function of time in many experiments done under identical conditions. The correlation function C(t2 , t1 ) is then given by C(t2 , t1 ) = lim
N→∞
N 1
z (k) (t2 )z (k) (t1 ) N k=1
(2.4)
If the stochastic process is stationary, the time origin is of no importance. In this case P1 (z 1 , t1 ) = P1 (z 1 ) does not depend on time, while P2 (z 2 t2 ; z 1 t1 ) = P2 (z 2 , t2 − t1 ; z 1 , 0) depends only on the time difference t21 = t2 − t1 . Also in this case the correlation function C(t2 , t1 ) = C(t21 ) can be obtained by taking
1642
A. Nitzan
a time average over different origins along a single stochastic trajectory according to N 1
z(tk + t)z(tk ) C(t) = lim N→∞ N k=1
(2.5)
Here the average is over a sample of reference times that span a region of time that is much larger than the longest correlation time of the process. Further progress can be made by specifying particular kinds of processes of physical interest. In particular we focus on two such processes: (1) Markovian stochastic processes. The process z(t) is called Markovian if the knowledge of the value of z (say z 1 ) at a given time (say t1 ) fully determines the probability of observing z at any later time P(z 2 t2 |z 1 t1 ; z 0 t0 ) = P(z 2 t2 |z 1 t1 );
t2 > t1 > t0
(2.6)
Markov processes have no memory of earlier information. Newton equations describe deterministic Markovian processes by this definition, since knowledge of system state (all positions and momenta) at a given time is sufficient for determining it at any later time. The random walk problem discussed in Section 1.2 is an example of a stochastic Markov process. The Markovian property can be expressed by P(z 2 t2 ; z 1 t1 ; z 0 t0 ) = P(z 2 t2 |z 1 t1 )P(z 1 t1 ; z 0 t0 );
for t0 < t1 < t2
(2.7)
or P(z 2 t2 ; z 1 t1 |z 0 t0 ) = P(z 2 t2 |z 1 t1 )P(z 1 t1 |z 0 t0 );
for t0 < t1 < t2
(2.8)
because, by definition, the probability to go from (z 1 , t1 ) to (z 2 , t2 ) is independent of the probability to go from (z 0 , t0 ) to (z 1 , t1 ). The above relation holds for any intermediate point between (z 0 , t0 ) and (z 2 , z 2 ). As with any joint probability, integrating the left hand side of Eq. (2.8) over z 1 yields P(z 2 t2 |t0 z 0 ). Thus for a Markovian process P(z 2 , t2 |z 0 , t0 ) =
dz 1 P(z 2 , t2 |z 1 , t1 )P(z 1 , t1 |z 0 , t0 )
(2.9)
This is the Chapman Kolmogorov equation. What is the significance of the Markovian property of a physical process? Note that the Newton equations of motion as well as the time dependent Schrodinger equation are Markovian in the sense that the future evolution of a system described by these equations is fully determined by the present (“initial”) state of the system. Non-Markovian dynamics results from the same reduction procedure that we use in order to focus on the “relevant” subsystem, that, as argued above, leads us to consider stochastic time evolution. To see
Stochastic theory of rate processes
1643
this consider a “universe” described by two variables, x1 and x2 , that satisfy the Markovian equations of motion dx1 = F1 (x1 (t), x2 (t), t) dt
(2.10a)
dx2 = F2 (x1 (t), x2 (t), t) dt
(2.10b)
We have taken F2 to depend only on the instantaneous value of x1 for simplicity. If x1 is the “relevant” subsystem, a description of the dynamics in the subspace of this variable can be achieved if we integrate Eq. (2.10b) to get x2 (t) = x2 (t = 0) +
t
F2 x1 (t ), t
(2.11)
0
Inserting this into (2.10a) gives
dx1 = F1 x1 (t), x2 (t = 0) + dt
t
F2 x1 (t ), t , t
(2.12)
0
This equation describes the dynamics in the x1 subspace, and its non-Markovian nature is evident. Starting at time t, the future evolution of x1 is seen to depend not only on its value at time t, but also on its past history, since the right hand side depends on all values of x1 (t ) starting from t = 0.1 Why has the Markovian time evolution (2.10) of a system of two degrees of freedom become a non-Markovian descripting in the subspace of one of them? Equation (2.11) shows that this results from the fact that x2 (t) responds to the historical time evolution of x1 , and therefore depends on past values of x1 , not only on its value at time t. More generally, consider a system A+B made of a part (subsystem) A that is relevant to us as observers, and another part B, “the environment”, that is uninteresting to us except for its effect on the relevant subsystem A. A non-Markovian behavior of the reduced description of the physical subsystem A reflects the fact the at any time t subsystem A interacts with the rest of the total system, i.e., with B, whose state is affected by its past interaction with A. In effect, the present state of B carries the memory of past states of the relevant subsystem A. This observation is very important because it points to a way to consider this memory as a qualitative attribute of system B (the environment or the bath) that 1 Equation (2.12) shows also the origin of the stochastic nature of reduced descriptions. Focusing on x , 1 we have no knowledge of the initial state x2 (t = 0) of the “rest of the universe”. At most we may know the distribution (e.g., Boltzmann) of different initial states. Different values of x2 (t = 0) correspond to different realizations of the “relevant” trajectory x1 (t). When the number of “irrelevant” degrees of freedom becomes huge their initial state and therefore also this trajectory assume a stochastic character.
1644
A. Nitzan
determines the physical behavior of system A. In the example of Eq. (2.10), where system B comprises one degree of freedom x2 , its dynamics is solely determined by its interaction with system A, coordinate x1 and the memory can be as long as the duration of the observed motion. In practical applications however system A represents only a few degrees of freedom, while B is the rest of the universe. B is so large relative to A that its dynamics may be dominated by interactions between B particles. To be more precise, suppose first that the interaction between subsystems A and B suddenly disappeared at some time t . From this time on B evolves under its internal interactions, and our physical experience tells us that it will eventually, say after a characteristic relaxation time τB , reach thermal equilibrium. Therefore at time of order t + τB subsystem B will carry no memory of its interaction with A at times up to t . This implies that also in the real case, where A and B interact continuously, the state of B at time t does not depend on states of A at times earlier than t = t − τB . Consequently, dynamics in the A subspace at time t will depend on the history of A at earlier times going back only as far as this t . The relaxation time τB can be therefore identified with the memory time of the environment B. We can now state the condition for the reduced dynamics of subsystem A to be Markovian: This will be the case if the characteristic timescales of the evolution of A are slow relative to the characteristic relaxation time associated with the environment B. When this condition holds, measurable changes in the A subsystem occur slowly enough so that on this relevant timescale B appears to be always at thermal equilibrium, and independent of its historical interaction with A. Reiterating, denoting the characteristic time for the evolution of subsystem A by τA , the condition for the time evolution within the A subspace to be Markovian is τB τA .
(2.13)
(2) Gaussian stochastic Processes. The special status of the Gaussian (“normal”) distribution in reduced descriptions of physical processes stems from the central limit theorem of probability theory and the fact that in a coarsegrained description a “time evolution step” taken by the system is affected by many more or less independent random events. A succession of such evolution steps, whether Markovian or not, constitutes a Gaussian stochastic process. As a general definition, a stochastic process z(t) is Gaussian if the probability distribution of its observed values z 1 , z 2 , . . . , z n at any n time points t1 , t2 , . . . , tn (for any value of the integer n) is an n-dimensional Gaussian distribution. − 12
Pn (z 1 t1 , z 2 t2 , . . . , z n tn ) = ce
n n j =1 k=1
a j k (z j −m j )(z k −m k )
;
−∞ < z j < ∞ (2.14)
where the matrix (a j k ) = A is symmetric and positive definite (i.e., u† Au > 0 for any vector u) and where c is a normalization factor.
Stochastic theory of rate processes
1645
A Gaussian process can be Markovian. Consider, for example, the process defined by Eq. (2.8) together with
1 (z k − zl )2 P(z k , tk |zl , tl ) = √ exp − 22kl 2π kl
(2.15)
This process is Gaussian by definition since (2.14) is satisfied for any pair of times. It follows that
1 dz 1 P(z 2 , t2 |z 1 , t1 )P(z 1 , t1 |z 0 , t0 ) = 2π 221 + 210
(z 2 − z 0 )2 × exp 2 2 21 + 210
(2.16)
so the Markovian property (2.9) implies 220 = 221 + 210
(2.17)
If we further assume that kl is a function only of tk − tl , it follows that its form must be √ (t) = Dt (2.18) where D is some constant. Noting that 210 is the variance of the probability distribution in Eq. (2.15), we have found that in a Markovian process described by (2.15) this variance is proportional to the elapsed time. Comparing this result with (1.8) we see that we have just identified diffusion as a Gaussian Markovian stochastic process. Taken independently of the time ordering, the distribution (2.14) is a multivariable, n-dimensional, Gaussian distribution Pn (z 1 , z 2 , . . . , z n ). We state without proof two important properties of this distribution: z j = m j ;
δz j δz k = (A)−1
j,k
;
where
δz = z − z
(2.19)
These relationships imply that a Gaussian distribution is completely characterized by the first two moments of its variables. In particular, since in (2.14) z j and the matrix element z k are associated with the times t j and tk , respectively, −1 are seen to be the time correlation function δz(t j )δz(tk ) . (A) j,k
3.
Stochastic Equations of Motion
We have already observed that the full phase space description of a system of N particles (taking all 6N coordinates and velocities into account) requires the solution of the Newton (or Schr¨odinger) equations of motion in this phase
1646
A. Nitzan
space, and is deterministic in nature, while the time evolution of a small subsystem is stochastic in nature. Focusing on the latter, we would like to derive or construct appropriate equations of motion that will describe this stochastic motion. Two routes can be taken towards this goal: (1) Derive such equations from first principles. In this approach we start with the equations of motion for the entire system, and derive from it equations of motion for the subsystem under consideration. The stochastic nature of the latter stems from the fact that the state of the complementary system, “the rest of the world”, is not known precisely, and is given only in probabilistic terms. (2) Construct such equations using physical arguments, experimental observations and intuition. The resulting equations must be considered phenomenological. We have already encountered an example for such a phenomenological model in Eq. (1.2) for the random walk problem ∂ P(n, t) = kr (P(n − 1, t) − P(n, t)) + kl (P(n + 1, t) − P(n, t)) ∂t (3.1) Such an equation has been termed master equation. The Master equation is a generalized kinetic equation, giving the time-evolution of the probability distribution in terms of the transition rates between different “states” of the system. In this section we take the second route. The equations introduced and discussed below should be viewed as models for physical processes. The input to these models is the nature of the process and the choice of stochastic variables, available information such as the temperature or known average rates, some knowledge of the time and length scales involved (such as needed to choose between a Markovian or non-Markovian description) and basic principles such as any known symmetries and conservation rules, and when applicable, the requirement that at long time the system described should approach thermal equilibrium.
3.1.
Langevin Equations
3.1.1. Langevin equation for 1 particle in 1 dimension Sometimes we find it advantageous to focus our stochastic description not on the probability but on the random variable itself. This makes it possible to describe in a more direct way the source of randomness in the system and its effect on the time evolution of the interesting subsystem. In this case the basic stochastic input is not a set of transition probabilities, but the actual
Stochastic theory of rate processes
1647
effect of the “environment” on the “interesting subsystem”. Obviously this effect is random in nature, reflecting the fact that we do not have a complete microscopic description of the environment. As discussed above, we could attempt to derive these stochastic equations of motion from first principle, i.e., from the full Hamiltonian of the system + environment, Alternatively we can construct the equation of motion using intuitive arguments and as much available physical information as possible. Again, we are taking the second route. As a simple example consider the equation of motion of a particle moving in a 1-dimensional potential, x¨ = −
1 ∂ V (x) m ∂x
(3.2)
and consider the effect on this particle’s dynamics of putting it in contact with a “thermal environment”. Obviously the effect depends on the strength of interaction between the particle and it environment. A useful measure of the latter within a simple intuitive model is the friction force, proportional to the particle velocity, which acts to slow the particle: x¨ = −
1 ∂ V (x) − γ x˙ m ∂x
(3.3)
The effect of friction is to damp the particle energy. This can most easily be seen by multiplying Eq. (3.3) by m x, ˙ and using m x˙ x¨ + x˙ (∂ V (x)/∂ x) = (d/dt)[E K + E P ] = E˙ to get E˙ = −2γ E k . Here E, E K and E P are the total energy of the particle and its kinetic and potential components, respectively. Equation (3.3) thus describes a process of energy dissipation, and leads to zero energy (when measured from a local minimum on the potential surface) at infinite time. It therefore cannot in itself describe the time evolution in a thermal system. What is missing is the random “kicks” that the particle can occasionally obtain from the surrounding thermal particles. These kicks can be modeled by an additional random force in Eq. (3.3) x¨ = −
1 1 ∂ V (x) − γ x˙ + R(t) m ∂x m
(3.4)
The function R(t) describes the effects of random collisions between our particle (“system”) and the molecules of the thermal environment (“bath”). This force is obviously a stochastic process, and a full stochastic description of our system is obtained once we define its statistical nature. What can be said about the statistical character of the stochastic process R(t)? First, from symmetry arguments valid for stationary systems, R(t)=0, where the average can be either time or ensemble average. Secondly, since Eq. (3.3) seems to describe the relaxation of the system at temperature T = 0, R should be related to the finite temperature of the thermal environment. Next, at T = 0, the time evolution of x is Markovian (knowledge of x and x˙ fully
1648
A. Nitzan
determines the future of x), so the system-bath coupling introduced in (3.3) is of Markovian nature (i.e., what the bath does to the system at time t does not depend on history of the system or the bath; in particular, the bath has no memory of what the system did in the past). The additional, finite temperature term R(t) has to be consistent with the Markovian form of the damping term since both arise from the same source, the bath motion. Finally, in the absence of further knowledge and because R is envisioned as a combined effect of many environmental motions, it makes sense to assume that, for each time t, R(t) is a Gaussian variable, and that the stochastic process R(t) is a Gaussian process. We have already argued that the Markovian nature of the system evolution implies that the relaxation dynamics of the bath is much faster than that of the system. The bath loses its memory fast relative to the timescale of interest for the system dynamics. Still the timescale for the bath motion is not unimportant. If, for example the sign of R(t) would change infinitely fast it will make no effect on the system. Indeed, in order for a finite force R to move the particle it has to have a finite duration. It is convenient to introduce a timescale τ B , which characterizes the bath motion, and to consider an approximate picture in which R(t) is constant in the interval τ B , while R(t1 ) and R(t2 ) are independent Gaussian random variables if |t1 − t2 | ≥ (1/2)τ B . Accordingly, R(t1 )R(t1 + t) = C S(t)
(3.5)
where S(t) is 1 if |t| < (1/2)τ B , and is 0 otherwise. Since R(t) was assumed to be a Gaussian process, the first two moments specify completely its statistical nature. The assumption that the bath is fast relative to the timescales that characterize the system implies that τ B is much shorter than all timescales (inverse frequencies) derived from the potential V (x) and much smaller than the time γ −1 for the energy relaxation. In Eqs. (3.4) and (3.5), both γ and C are related to the strength of the system-bath coupling, and should therefore be somehow related to each other. In order to obtain this relation it is sufficient to consider Eq. (3.4) for the case where the potential V is a position independent constant. In this case the equation u˙ = −γ u +
1 m
R(t)
(3.6)
(here u= x˙ is the particle velocity) can be solved as a first order inhomogeneous differential equation, to yield
u(t) = u(t = 0)e
−γ t
1 + m
t 0
dt e−γ (t −t ) R(t )
(3.7)
Stochastic theory of rate processes
1649
For long times, as the system reaches equilibrium, only the second term on the right of (3.7) contributes. For the average u at thermal equilibrium this gives zero, while for u 2 we get 1 u = 2 m
t
2
dt 0
t
dt e−γ (t −t )−γ (t −t ) C S(t − t )
(3.8)
0
Since for non-vanishing integrand, |t − t"| ≤ τ B 1/γ , u 2 in Eq. (3.8) can be approximated by 1 u = 2 m
t
2
−2γ (t −t )
t
dt e 0
0
dt C S(t − t ) =
1 Cτ B 2m 2 γ
(3.9)
where to get the final result we took the limit t → ∞. Since in this limit the system should be in thermal equilibrium we have u 2 = k B T/m, whence C=
2mγ k B T τB
(3.10)
Using this result in Eq. (3.5) we find that the correlation function of the Gaussian random force R has the form R(t1 )R(t1 + t) = 2mγ k B T
S(t) τ B →0 −−−→ 2mγ k B T δ(t) τB
(3.11)
The last result indicates that, since for the system’s motion to be Markovian τ B has to be much shorter than the relevant system timescales, its actual magnitude is not important and the random force may be thought of as δ-correlated. The limiting process described above indicates that mathematical consistency requires that as τ B → 0 the second moment of the random force diverge, and the proper limiting form of the correlation function is a Dirac δ function in the time difference. Usually in analytical treatments of the Langevin equation this limiting form is convenient. In numerical solutions however, the random force is generated at time intervals t, determined by the integration routine. The random force then is generated as a Gaussian random variable with zero average and variance equal to 2mγ k B T/t. The result (3.11) shows that the requirement that the friction γ and the random force R(t) together act to bring the system to thermal equilibrium at long time, naturally leads to a relation between them, expressed by Eq. (3.11). This is a relation between the fluctuations and the dissipation in the system. It constitutes an example of the fluctuation-dissipation theorem of non-equilibrium statistical mechanics.
1650
A. Nitzan
3.1.2. The high friction limit The friction coefficient γ defines the timescale, γ −1 , of the thermal relaxation of the system described by (3.4). A simpler stochastic description can be obtained for a system in which this time is shorter than any other characteristic timescale of our system. This situation is often referred to as the overdamed limit. In this limit of large γ , the relaxation of the velocity is so fast that we can assume that v quickly reaches a steady state for any value of the random force R(t), i.e., v˙ = x¨ = 0. This statement is not obvious, and a supporting (though not rigorous) argument is provided below. If it is true then Eqs. (3.4) and (3.11) yield 1 dx = dt γm
−
dV + R(t) ; dx
R = 0;
R(0)R(t) = 2mγk B T δ(t) (3.12)
This is a Langevin type equation that describes strong coupling between the system and its environment. Obviously, the limit γ → 0 of deterministic motion cannot be identified here. Why can we, in this limit, neglect the acceleration term in (3.4)? Consider a particular realization of the random force in this equation and denote −(1/m)dV/dx + R(t) = F(t). Consider then Eq. (3.4) in the form v˙ = −γ v + F(t)
(3.13)
If F(t) is constant than after some transient (short for large γ ) the solution of (3.13) reaches the constant velocity state v = F/γ
(3.14)
The neglect of the v˙ term in (3.13) is equivalent to the assumption that Eq. (3.14) provides a good approximation for the solution of (3.13) even when F depends on time. To find the conditions under which this assumption holds consider the solution of (3.13) for a particular Fourier component of the time dependent force F(t) = Fω eiωt
(3.15)
Disregarding any initial transient amounts to looking for a solution of (3.13) of the form v(t) = v ω eiωt .
(3.16)
Inserting (3.15) and (3.16) into (3.13) we find vω =
Fω 1 Fω = iω + γ γ 1 + iω/γ
(3.17)
Stochastic theory of rate processes
1651
which implies F(t) (1 + O(ω/γ )) (3.18) v(t) = γ We found that Eq. (3.14) holds, with corrections of order ω/γ . It should be emphasized that this argument is not rigorous because the random part of F(t) is in principle fast, i.e., contain Fourier components with large ω. More rigorously, the transition from Eq. (3.4) to (3.12) should be regarded as coarsegraining in time that leads to a description in which the fast components of the random force are averaged to zero and the velocity distribution follows the instantaneous applied force.
3.2.
Master Equations
As discussed at the beginning of Section 3, a phenomenological stochastic evolution equation can be constructed using a model that describes the relevant states of the system and the transition rates between them. For example, in the one-dimensional random walk problem discussed in Section 1.2 we described the position of the walker using a discrete set of equally spaced points mx(m = −∞ . . . ∞) on the real axis. Denoting by P(m, t) the probability that the particle is at position m at time t and by kr and kl the probabilities per unit time (i.e., the rates) that the particle would move from a given site to the neighboring site on its right and left respectively, we obtained a kinetic equation for the time evolution of P(m, t): ∂ P(n, t) = kr (P(n − 1, t) − P(n, t)) + kl (P(n + 1, t) − P(n, t)) ∂t (3.19) This is an example of a master equation.2 More generally, transition rates between any two states can be given, and the master equation then takes the form
∂ P(m, t)
= kmn P(n, t) − knm P(m, t) (3.20) ∂t n n n= /m
n= /m
where kmn ≡ km←n is the rate to go from state n to state m. Note that we may write (3.20) in the form ∂ P(m, t)
∂P K mn P(n, t); i.e., = = KP (3.21) ∂t ∂t n 2 Many science texts refer to a 1928 paper by W. Pauli [W. Pauli, Festschrift zum 60. Geburtstage A.
Sommerfelds (Hirzel, Leipzig, 1928) p. 30] as the first derivation of this type of Kinetic equation. Pauli has used this approach to construct a model for the time evolution of a many-state quantum system, using expression derived from quantum perturbation theory for the transition rates.
1652
A. Nitzan
provided we define K mn = kmn for m =/ n;
K mm = −
knm
(3.22)
n
n= /m
Note that (3.22) implies that m K mn = 0 for all n. This is compatible with the fact that m P(m, t) = 1 is independent of time. The nearest neighbor random walk process is described by a special case of this master equation with K mn = kl δn,m+1 + kr δn,m−1 − (kl + kr ) δn,m
(3.23)
In what follows we consider several examples.
3.2.1. The random walk problem We first consider the 1-dimensional random walk problem described by Eq. (3.19). It can be easily seen that summing either side of this equation over all m from −∞ to ∞ yields zero, while multiplying this equation by m and m 2 then performing the summation yields ∂m = kr − kl (3.24) ∂t and ∂m 2 = 2m(kr − kl ) + kr + kl (3.25) ∂t Therefore (assuming m(t = 0) = m 2 (t = 0) = 0, i.e., that the particle starts its walk from the origin, m = 0) mt = (kr − kl )t = ( p − q)t/τ = ( p − q)N m 2 t = (kr − kl )2 t 2 + (kr + kl )t
(3.26)
and δm 2 t = m 2 t − m2t = (kr + kl )t = ( p + q) τt = ( p + q)N
(3.27)
for a walker that has executed a total of N steps during the time t = N τ , with probabilities p and q to jump to the right and to the left, respectively. We can do more by introducing the generating function, defined by F(s, t) =
∞
P(m, t)s m ;
(0 < |s| < 1)
(3.28)
m=−∞
Its usefulness stems from the fact that it can be used to generate all moments of the probability distribution according to:
∂ s ∂s
k
= m k
F(s, t) s=1
(3.29)
Stochastic theory of rate processes
1653
We can get an equation for the time evolution of F by multiplying the master ∞ m m and summing over all m. Using equation by s m = −∞ s P(m − 1, t) = s F(s) ∞ m and m = −∞ s P(m + 1, t) = F(s)/s leads to ∂ F(s, t) = k+ s F(s, t) + k− 1s F(s, t) − (k+ + k− )F(s, t) ∂t whose solution is F(s, t) = Ae[k+ s+(k− /s)−(k+ +k− )]t
(3.30)
(3.31)
If the particle starts from m = 0, i.e., P(m, t = 0) = δm,0 , Eq. (3.28) implies that F(s, t = 0) = 1. In this case the integration constant in Eq. (3.31) is A=1. It is easily verified that using (3.31) in Eq. (3.29) with k = 1, 2 leads to Eqs. (3.26). Using it with larger k’s leads to the higher moments of the time dependent distribution.
3.2.2. Chemical kinetics k
Consider the simple 1st order chemical reaction, A −→ B. The corresponding kinetic equation, dA = −kA ⇒ A(t) = A(t = 0)e−kt (3.32) dt describes the time evolution of the average number of molecules A in the system. Without averaging, the time evolution of this number is a random process, because the moment at which each specific A molecule transforms into B is undetermined. (The stochastic nature of radioactive decay, which is described by a similar 1st order kinetics, can be realized by listening to a Geiger counter). In addition, fluctuations from the average can also be observed if we monitor the reaction in a small enough volume, e.g., in a biological cell. We can derive a master equation for the probability P(n, t) that the number of A molecules is n at time t using considerations similar to those we used above: P(n, t + t) = P(n, t) + k(n + 1)P(n + 1, t)t − kn P(n, t)t ∂ P(n, t) = k(n + 1)P(n + 1, t) − kn P(n, t) (3.33) ⇒ ∂t Unlike the random walk problem, the rate at which the probability to be in a given state n changes depends on the state: The probability per unit time to go from n + 1 to n is k(n + 1), and the probability per unit time to go from n to n − 1 is kn. The process described by Eq. (3.33) is an example of a birthand-death process. In this particular example there is no source feeding A molecules into the system, so only death steps take place.
1654
A. Nitzan
The solution of Eq. (3.33) is easily achieved using the generating function method. The random variable n can take only non-negative integer values, and the generating function is therefore F(s, t) =
∞
s n P(n, t)
(3.34)
n=0
Multiplying (3.33) by s n and summing leads to ∂F ∂F ∂F ∂ F(s, t) =k − ks = k(1 − s) ∂t ∂s ∂s ∂s
(3.35)
Here we have used identities such as ∞
s n n P(n, t) = s
n=0
∂ F(s, t) ∂s
(3.36)
and ∞
s n (n + 1)P(n + 1, t) =
n=0
∂F ∂s
(3.37)
If P(n, t = 0) = δn,n0 then F(s, t = 0) = s n0 . For this initial condition the solution of Eq. (3.35) is
F(s, t) = 1 + (s − 1)e−kt
n0
(3.38)
This again gives all the moments using Eq. (3.29). For example it is easy to get nt = n o e−kt
(3.39)
δn 2 t = n o e−kt (1 − e−kt )
(3.40)
The first moment gives the familiar evolution of the average A population. The second moment shows that the variance of the fluctuations from this average is zero at t = 0 and t = ∞, and goes through a maximum at some intermediate time.
3.3.
The Fokker Planck Equation
In many practical situations the random process under observation is continuous in the sense that (a) the space of possible states x is continuous (or it can be transformed to a continuous-like representation by a coarse graining procedure), and (b) the change in the system state during a small time interval is small, i.e., if the system is found in a state x at time t then the
Stochastic theory of rate processes
1655
probability to find it in state y =/ x at time t + δt vanishes when δt → 0.3 When these, and some other conditions detailed below, are satisfied, we can derive a partial differential equation for the probability distribution. The result is the Fokker–Planck equation. As an example without mathematical justification consider the master equation for the random walk problem ∂ P(n, t) = kr P(n − 1, t) + kl P(n + 1, t) − (kr + kl )P(n, t) ∂t = −kr (P(n, t) − P(n − 1, t)) − kl (P(n, t) − P(n + 1, t)) (3.41) = −kr (1 − e−∂/∂n )P(n, t) − kl (1 − e∂/∂n )P(n, t) In the last step we have regarded n as a continuous variable and have used the Taylor expansion ea(∂/∂n) P(n) = 1 + a
1 ∂2 P ∂P + a 2 2 + · · · = P(n + a) ∂n 2 ∂n
(3.42)
In practical situations n is a very large number – it is the number of microscopic steps taken on the timescale of a macroscopic observations. This implies that ∂ k P/∂n k ∂ k + 1 P/∂n k + 1 .4 We therefore expand the exponential operators according to ∂
1 − e± ∂n = ∓
1 ∂2 ∂ − ∂n 2 ∂n 2
(3.43)
and neglect higher order terms, to get ∂ P(n, t) ∂ 2 P(n, t) ∂ P(n, t) = −A +B ∂t ∂n ∂n 2
(3.44)
where A = −(kr − kl ) and B = kr + kl . We can give this result a more physical form by transforming from the number-of-steps variable n to the position variable x = nx, using Pn (n) = Px (x) · x. Here x is the step length, and the subscripts n and x denote the probability in the space of position indices and the probability density on the axis x (we omit these subscripts above and below when the nature of the distribution is clear from the text). This leads to ∂ P(x, t) ∂ 2 P(x, t) ∂ P(x, t) = −v +D ∂t ∂x ∂x2
(3.45)
3 In fact we will require that this probability vanishes faster than δt when δt → 0. 4 For example if f (n) = n a then ∂ f /∂n = an a−1 which is of order f /n. The situation is less obvious in cases such as the Gausssian distribution f (n) ∼ exp((n − n)2 /2δn 2 ). Here the derivatives with respect to n adds a factor ∼ (n − n) /δn 2 that is much smaller than 1 as long as n − n n because δn 2 is of
order n.
1656
A. Nitzan
where v = x A and D = x 2 B. Note that we have just repeated, using a somewhat different form, the derivation of Eq. (1.4). The result (3.45) (or (1.4)) is a Fokker–Planck type equation. As already discussed below Eq. (1.4), these equations describe a drift diffusion process: For a symmetric walk, kr = kl , v = 0 and (3.45) becomes the diffusion equation with the diffusion coefficient D = x 2 (kr + kl ) = x 2 /τ. Here τ is the hopping time defined by τ = (kr + kl )−1 . When kr =/ kl the parameter v is non-zero and represents the drift velocity that may be induced by an external force that creates an asymmetry in the flow through the system. Additional insight can be obtained by rewriting Eq. (3.45) in the form: ∂ P(x, t) ∂ J (x, t) =− ∂t ∂x J (x, t) = v P(x, t) − D
(3.46a) ∂ P(x, t) ∂x
(3.46b)
Equation (3.46a) expresses the fact that the probability distribution P is a conserved quantity and therefore its time dependence can only stem from boundary fluxes. Indeed, Eq. (3.46a) implies that Pab (t) = ab P(x, t); a < b satisfies dPab (t)/dt =J (a, t) − J (b, t). This identifies J (x, t) as the probability flux at point x: J (a, t) is the flux entering the [a,b] interval (for positive J ) from a, J (b, t) – the flux leaving the interval (if positive) from b. In 1-dimension, J is of dimensionality t −1 , and when multiplied by the total number of walkers it gives the number of such walkers that pass the point x per unit time in a direction determined by the sign of J . Equation (3.46b) shows that J is a combination of the drift flux, v P, associated with the net local velocity v, and the diffusion flux, D∂ P/∂ x associated with the spatial inhomogeneity of the distribution. In a 3-dimensional system the analog of Eq. (3.46) is ∂ P(r, t) = −∇ · J(r, t) ∂t J(r, t) = v P(r, t) − D∇ P(r, t)
(3.47)
Now P(r, t) is of dimensionality l −3 and the vector J has the dimensionality l −2 t −1 . J expresses the flux of walkers (number per unit time and area) in the J direction.5 The derivation of the Fokker–Planck (FP) equation described above is far from rigorous since the conditions for neglecting higher order terms in the 5 It is important to emphasize that, again, the first of Eqs. (3.47) is just a conservation law. Integrating it over some volume s enclosed by some surface S and denoting P (t) = dP(r, t) we find, using the
divergence theorem of vector calculus, dP (t)/dt =− S dS · J(r, t) where dS is a vector whose magnitude is a surface element and its direction is a vector normal to this element in the direction outward of the volume .
Stochastic theory of rate processes
1657
expansion of exp(±∂/∂ x) where not established. A rigorous derivation of the Fokker–Planck equation for a Markov process can be obtained from the Chapman–Kolmogorov equation, Eq. (2.9), under fairly general continuity conditions that are satisfied in most physical situations. Since the latter describes a continuous stochastic process, a Fokker–Planck equation is indeed expected in the Markovian case. Here we outline this derivation for the simpler case of the high friction limit, where the Langevin equation is (c.f. Eq. (3.12)) 1 dx = dt γm
−
dV + R(t) dx
(3.48)
where R(t) again satisfies Eq. (3.11). In this case we will derive an equation for P(x, t), the probability density to find the position at x (the velocity distribution is assumed equilibrated on the timescale considered). It is convenient to redefine the time scale τ = t/(γm)
(3.49)
Denoting the random force on this timescale by ρ(τ ) = R(t), we have ρ(τ1 )ρ(τ2 ) = 2mγk B T δ(t1 − t2 ) = 2k B T δ(τ1 − τ2 ). The new Langevin equation becomes dV (x) dx =− + ρ(τ ) dt dx ρ = 0;
(3.50a)
ρ(0)ρ(τ ) = 2k B T δ(τ )
(3.50b)
The friction γ does not appear in these scaled equations, however any rate evaluated from this scheme will be inversely proportional to γ when described on the real (i.e., unscaled) time axis. The starting point of the derivation of an equation for the time evolution of the probability density P(x, t) is the statement of the fact that the integrated probability is conserved. As already discussed this implies that the time derivative of P should be given by the gradient of the flux xP, ˙ i.e., ∂ ∂ ∂ P(x, τ ) = − (x˙ P) = − ∂τ ∂x ∂x
−
∂V + ρ(τ ) P ∂x
Rewrite this in the form ∂ P(x, t) ˆ )P = (τ ∂t ∂ ∂V ˆ − ρ(τ ) (τ ) = ∂x ∂x
(3.51)
(3.52)
and integrate between τ and τ + τ to get P(x, τ + τ ) = P(x, τ ) +
τ +τ τ
dτ1 (τ1 )P(x, τ1 )
(3.53)
1658
A. Nitzan
The operator contains the random function ρ(τ ). Repeated iterations in the integral and averaging over all realizations of ρ lead to P(x, τ + τ ) − P(x, τ ) =
τ +τ
+
dτ1 (τ1 )
τ τ +τ
τ1
dτ2 (τ1 )(τ2 )+· · · P(x, τ )
dτ1 τ
τ
(3.54) Our aim now is to take these averages using the statistical properties of ρ and to carry out the required integrations keeping only terms of order τ . To this ˆ ˆ ) = Aˆ + Bρ(τ end we note that is of the form (τ ) where Aˆ and Bˆ are deterministic operators. Since ρ = 0 the first term in the square brackets is ˆ simply Aτ = ∂/∂ x(∂ V (x)/∂ x)τ , where the operator ∂/∂ x is understood to operate on everything on its right. The integrand in the second term inside the square brackets contains terms of the kind A A, ABρ=0 and B 2 ρ(τ1 )ρ(τ2 ). The deterministic AA terms with the double integral are of order τ 2 and may be neglected. The only contribution of order τ come from the BB terms (recall Bˆ = ∂/∂ x) using Eq. (3.50b) τ1
τ +τ
dτ1 τ
τ
∂2 dτ2 ρ(τ1 )ρ(τ2 ) 2 = ∂x
τ +τ
dτ1 k B T τ
∂2 ∂2 = k T τ B ∂x2 ∂x2 (3.55)
With a little effort we can convince ourselves that higher order terms in the 2 expansion (2.15) contribute only terms of order τ τ2 or higher. Consider for τ +τ τ1 dτ1 τ dτ2 τ dτ3 (τ1 )(τ2 )(τ3 ). example the third order term τ Evaluating the integrals with a deterministic AAA term will yield a result of order τ 3 that can be disregarded. The AAB and BBB terms appear in products with terms like ρand ρρρ which are zero. The only terms that may potentially contribute are of the type ABB. However they do not: such terms appear with a function like ρ(τ1 )ρ(τ2 ) that yields a δ-function that eliminates one of the three time integrals, however the remaining two yield a τ 2 term and do not contribute to order τ . Similar considerations show that all higher order terms in Eq. (3.54) may be disregarded. Equations (3.56) and (3.55) finally lead to ∂ P(x, τ ) = ∂τ
∂2 ∂ dV + k B T 2 P(x, τ ) ∂ x dx ∂x
(3.57)
Stochastic theory of rate processes
1659
Transforming back to the original time variable t = γ mτ results in the Smoluchowski equation
∂ ∂ ∂V ∂ P(x, t) =D + β P(x, t); ∂t ∂x ∂x ∂x D=
β=
kB T mγ
1 kB T
(3.58) (3.59)
The Smoluchowski equation (3.58) is the overdamped limit of the original Fokker–Planck equation. When the potential V is constant it becomes the well-known diffusion equation. Equation (3.59) is a relationship between the diffusion constant D and the friction coefficient γ and is known as the Einstein relationship. Let’s consider some properties of Eq. (3.58). First note that it can be rewritten in the form ∂ ∂ P(x, t) = − J (x, t) ∂t ∂x
(3.60)
where the probability flux J is given by
∂V ∂ +β J = −D ∂x ∂x
P(x, t)
(3.61)
As discussed above (see Eq. (3.46) and the discussion below it) Eq. (3.60) has the form of a conservation rule, related to the fact that the overall probability is conserved.6 The 3-dimensional generalization of (3.58), ∂ P(r, t) = D∇ · (β∇ V + ∇)P(r, t), ∂t
(3.62)
can similarly be written as a divergence of a flux ∂ P(r, t) = −∇ · J ∂t
(3.63a)
J = −D (β∇ V + ∇) P(r, t)
(3.63b)
Again, Eq. (3.63a) is just a conservation low: it may be shown to be equivalent to the integral form dP =− dt
J(r) · ds
(3.64)
S
6 If N is the total number of particles NP(x) is the particles number density. The conservation of the inte
grated probability, i.e., dx P(x, t) = 1 is equivalent to the conservation of the total number of particles: In the process under discussion particles are neither destroyed nor created, only move in position space.
1660
A. Nitzan
where the probability P to be in the region of space surrounded by a closed surface S
d3 P(r)
P =
(3.65)
and where ds is a vector whose magnitude equals that of the surface element and its direction is normal to that element in the outward direction. (The flux through a surface that defined a closed subspace is defined to be positive when the flux is directed in the outward direction). Equation (3.64) expresses the fact that the change in the probability to be in the region is associated with the flux(s) that enter or leave through the boundary S of .The equivalence of the differential form (3.63a) and the integral form (3.64) of the conservation condition is a direct result of the divergence theorem of vector calculus
J(r) · ds =
S
(∇ · J)d3 r
(3.66)
S
that implies
d3r
∂ P(r, t) =− ∂t
d3r(∇ · J) ⇒
∂P = −∇ · J ∂t
(3.67)
Secondly, the flux is seen to be a sum of two terms, J = JD + JF , where JD = −D∂ P/∂ x (or, in 3D, J D = −D∇ P) is the diffusion flux, while JF = Dβ (−∂ V /∂ x) P (or , in 3D, J F = β D (−∇ V ) P) is the flux caused by the force F = −∂ V /∂ x (or F = −∇ V ). The latter corresponds to the term v P in (3.46b), where the drift velocity v is proportional to the force, i.e., JF = u FP. This identifies the mobility u as u = β D = (mγ )−1
(3.68)
Finally note that at equilibrium the flux should be zero. Equation (3.61) then leads to a Boltzmann distribution: ∂V ∂P = −β P ⇒ P(x) = const · e−β V (x) ∂x ∂x
(3.69)
The procedure to find the evolution equation for the probability distribution equivalent to the general 1D Langevin Eq. (3.4) is similar in spirit to that described for the derivation of the Smoluchowski equation and will not be repeated here. It leads to the Fokker–Planck equation
1 ∂V ∂ ∂ ∂ ∂P(x, v, t) = −v + +γ ∂t ∂x m ∂ x ∂v ∂v
kB T ∂ v+ m ∂v
P(x, v, t) (3.70)
Stochastic theory of rate processes
1661
To understand the physical content of this equation consider first the case where γ vanishes. In this case the Langevion Eq. (3.4) becomes the deterministic Newton equation (1/m) ∂ V /∂ x = −v˙ and Eq. (3.70) is seen to take the form ∂P ∂P ∂P = −x˙ − v˙ (3.71) ∂t ∂x ∂v This is, again, an expression for the conservation of probability since it implies dP ∂P dx ∂P dv ∂P = + + =0 (3.72) dt ∂t dt ∂ x dt dv Equation (3.72) is known as the Liouville equation (written here for a 1D single particle system), and is completely equivalent to the Newton equation of motion. Next consider the term proportional to γ in Eq. (3.70). This term is responsible for the system-bath coupling. We see that γ (v + (k B T /m) ∂/∂v) P(x, v, t) is an expression for a dissipative probability flux: it is a flux in the v direction that results from the coupling of our particle to the thermal environment. This coupling cannot change P if P is already an equilibrium distribution. Indeed kB T ∂ 2 v+ e−β1/2mv = 0 (3.73) m ∂v i.e., the dissipative flux vanishes at equilibrium just as the deterministic flux does. Finally note that the dissipative flux does not depend on the potential.
4.
Applications to Chemical Reactions in Condensed Phases
In this section we apply the mathematical apparatus developed above to study the dynamics of chemical reactions in condensed phase. Only two simple examples will be handled with some detail while other physical situations will only be briefly outlined. A chemical reaction may generally be viewed as taking place in two principal stages. In the first the reactants are brought together and in the second the assembled chemical system undergoes the structural/chemical change. In a condensed phase the first process involves diffusion, sometimes (e.g., when the species involved are charged) in a force field. The second stage often involves the crossing of a potential barrier. In unimolecular reactions the species that undergoes the chemical change is already assembled and only the latter process is relevant. Also, when the barrier is high the latter process is rate determining. On the other hand in bi-molecular reactions, if the barrier is low (of order k B T or less) the diffusion process that brings the reactants together may be rate determining. In this case the reaction is controlled by this diffusion process. In what follows we treat these two processes separately.
1662
4.1.
A. Nitzan
Diffusion Controlled Reactions
To treat the case where the reaction rate is determined by the rate at which reactants approach each other we model the molecular motion by the Smoluchowski equation. To be specific we consider two species, A and B, where the A molecules are assumed to be static while the B molecules undergo diffusion characterized by a diffusion coefficient D.7 A chemical reaction in which B disappears occurs when B reaches a critical distance R ∗ from A. We will assume that A remains intact in this reaction. The macroscopic rate equation is d[B] = −k[B][A] (4.1) dt where [A] and [B] are molar concentrations. We want to relate the rate coefficient k to the diffusion coefficient D. It is convenient to define A = A[A] and B = A[B], where A is the Avogadro number and A and B are molecular number densities of the two species. In terms of these quantities Eq. (4.1) takes the form dB −k B A = (4.2) dt A Macroscopically the system is homogeneous. Microscopically however, as the reaction proceeds, the concentration of B near any A center becomes depleted and the rate becomes dominated by the diffusion process that brings fresh supply of B into the neighborhood of A. Focusing on one particular A molecule we consider the distribution of B molecules, B(r) = N B P(r) in its neighborhood. Here N B is the total number of B molecules and P(r) is the probability density for finding B molecules at position r given that an A molecule resides at the origin. P(r), and therefore B(r), satisfy the Smoluchowski equation ∂ B(r, t) = −∇ · J ∂t J = −D(β∇ V + ∇)B(r, t)
(4.3)
where V is the A − B interaction potential. At long time a steady state is established, in which B disappears as it reaches a distance R ∗ from A and a constant diffusion flux of B molecules is maintained towards A. If D is small (i.e., if the reaction is diffusion controlled) this steady state is established much before B is consumed, and we are interested in the corresponding steady state rate. For simplicity we assume that the A and B molecules are spherical, so that the interaction between them depends only on their relative distance rand 7 It can be shown that if the molecules A diffuse as well, the same formalism applies, with D replaced by
D A + DB .
Stochastic theory of rate processes
1663
the steady state distribution is spherically symmetric. This implies that only the radial part of J is non zero
J (r) = −D β
d d B(r) V (r) + dr dr
(4.4)
Fur