INFORMATION PROCESSING AND LIVING SYSTEMS
SERIES ON ADVANCES IN BIOINFORMATICS AND COMPUTATIONAL BIOLOGY
Series Editors: Ying XU (University of Georgia, USA) Limsoon WONG (Institute for Infocomm Research, Singapore) Associate Editors: Ruth Nussinov (NCI, USA) Rolf Apweiler (EBI, UK) Ed Wingender (BioBase, Germany)
See-Kiong Ng (Instfor Infocomm Res, Singapore) Kenta Nakai (Univ of Tokyo, Japan) Mark Ragan (Univ of Queensland, Australia)
Vol. 1: Proceedings of the 3rd Asia-Pacific Bioinformatics Conference Eds: Yi-Ping Phoebe Chen and Limsoon Wong
Vol. 2: Information Processing and Living Systems Eds: Vladimir B. Bajic and Tan Tin Wee
Series on Advances in Bioinformofics and Computational Biology - Volume 2
INFORMATION PROCESSING AND LIVING SYSTEMS ECJiTORS
VkdiiviiR B BAj'ic INSTITUTE foR iNfocoMM RESEARCIH, SiNqApoRE
TAN
Tii\
WEE
NATiONAl UlNliVERSITy o f SiNqApOR, SiNQApORE
_/f9t^
Imperial College Press
Published by Imperial College Press 57 Shelton Street Covent Garden London WC2H 9HE Distributed by World Scientific Publishing Co. Pte. Ltd. 5 Toh Tuck Link, Singapore 596224 USA office: 27 Warren Street, Suite 401-402, Hackensack, NJ 07601 UK office: 57 Shelton Street, Covent Garden, London WC2H 9HE
British Library Cataloguing-in-Publication Data A catalogue record for this book is available from the British Library.
INFORMATION PROCESSING AND LIVING SYSTEMS Copyright © 2005 by Imperial College Press All rights reserved. This book, or parts thereof, may not be reproduced in any form or by any means, electronic or mechanical, including photocopying, recording or any information storage and retrieval system now known or to be invented, without written permission from the Publisher.
For photocopying of material in this volume, please pay a copying fee through the Copyright Clearance Center, Inc., 222 Rosewood Drive, Danvers, MA 01923, USA. In this case permission to photocopy is not required from the publisher.
ISBN 1-86094-563-5
Printed in Singapore by B & JO Enterprise
Preface
This is a book on information processing by and information processing for living systems. It is about the Information of Life, of living computers and the human endeavour of computing life. "... No man is an island, entire of itself; every man is a piece of the continent, a part of the main. If a clod be washed away by the sea, Europe is the less, as well as if a promontory were, as well as if a manor of thy friend's or of thine own were: any man's death diminishes me, because I am involved in mankind, and therefore never send to know for whom the bell tolls; it tolls for thee...." Meditation XVII, John Donne (1623) All living systems reproduce after their kind to perpetuate their lineage. The offsprings inherit characteristics from both parents and the basis for this inheritance lies with genetic material, whether it is DNA for most unicellular or higher organisms, or RNA in some viruses. Prom the genetic material inherited from the parents, the progeny must decode the information within the genetic material which then manifests as various traits that we observe amongst the great diversity of organisms in the living world. This involves information processing and information flow at the most fundamental level throughout the course of the organisms development and lifespan. Organisms do not exist isolated, but interact with each other constantly within a complex ecosystem. The relationships between organisms such as those between prey or predator, host and parasite, mating partners, or amongst members of a colony of social insects, etc., are both complex and multi-dimensional. In all cases, there is constant communication and inforv
vi
Information Processing and Living Systems
mation flow at many levels. Therefore it is important for us to appreciate that living systems need to compute and process information. For example, the hottest area in microbiology today is quorum sensing in bacteria. How does a bacterium know how many of its kind is present in its surroundings before it can launch an attack successfully against a host? How does a cell calculate a density gradient and propel its motion towards a food source at the right speed without overshooting the target? How does transcription of DNA know when there is enough messenger RNA, and how does a ribosome know when to stop producing proteins? Where are the feedback loops and how is the regulation tied to the computation or sensing of how much is out there? How do biological systems calculate time - time to live, time to spawn, circadian rhythms and so on? How does the brain process information, count, sense time or store information in memory? How do living systems retain information and transmit it to the next generation? How do living systems share information with others? Thus our book focuses on information processing by life forms and the use of information technology to understand the wonder and fascination of living things. Overview of the Book Today, far too many books have been written about bioinformatics. Most of them are highly mathematical and emphasize the underlying mathematical principles and how they may be applied to biological data; or else, they take a superficial but practical approach towards processing and analyzing biological data, covering the so-called "how-to" approach. Few books come close to dealing with computing challenges and computing phenomena in nature, but none combines these with the complementary bioinformatics topics and useful bioinformatics applications. In this book we attempted to do so and we believe that the benefits to the reader will be multiple, going from a simple-to-grasp presentation, to sophisticated and innovative applications. This book is organised into two major parts, focussing on Biocomputing and Bioinformatics. Both are facets of the information of life - the flow of information in life forms, as well as the use of information technology and computing to understand the mystery of living things. In the first part, the first two chapters present a comprehensive overview of biocomputing. This constitutes the biocomputing part "Living Computers" that attempts to explain natural processing of biological information using physiological models and analogous models in computing.
Preface
vii
The bioinformatics part "Computing Life" - deals with "artificial" processing of biological information as a human endeavour in order to derive new knowledge and insights into life forms and how they function. This part provides overviews of different bioinformatics topics and a glimpse of specific innovative applications for biological discovery as the link and complement to biocomputing. Why Eire we putting these two domains together? Artificial processing of biological information is complementary to natural processing, and by juxtaposing the two, we attempt to enhance our understanding of the natural processing by elucidating and discovering new relevant biological information in a way not commonly done in the literature today. Our thesis is that a better understanding of the natural processing of biological information, as coming from the biocomputing part, helps us improve the way of processing biological information in deriving new knowledge and insights into life forms and how they function. Consequently, readers will be exposed to complementary domains and will be better equipped to grasp ideas of biocomputing and bioinformatics in tandem when dealing with the biological problems of their interest. Overall, this book contains a systematic and comprehensive survey of biocomputing not existing in the current literature, and combines it with overviews of different bioinformatics topics complemented by a number of novel bioinformatics applications that illustrate some of the principles of biocomputing. The book represents a unique source of information on the biological and physiological background against which biological "computing" processes are performed in living systems, including higher cognitive processes. It also shows how some of these computing exemplars in biology have found their way into useful computing applications, many of these applications useful in themselves for dealing with biological information. In particular, we focussed on representative, easy-to-read overviews complemented by a few illustrative applications in dealing with biological information in the bioinformatics realm. The recent phenomenon of genomics, where large amounts of information stored in the genetic code of living organisms have been elucidated, the accompanying wave of proteomics, metabolomics, transcriptomics, systems biology and other newer 'omics, urgently calls for a quantum leap of advance in information processing needed for deciphering the meaning of
viii
Information Processing and Living Systems
all this information in living systems. In dealing with this deluge, we hope that you will enjoy this ecletic combination of thoughts found in this book and take time out from the rush of the Internetised world today, to ponder over the intriguing issues raised in this book. Enjoy! Vladimir B Bajic and Tin Wee Tan September 2004 Singapore
Contents
Preface
v
Chapter 1. A Multi-Disciplinary Survey of Biocomputing: 1. Molecular and Cellular Levels
1
1 2 3 4 5
6
Introduction Lock-Key Paradigm versus Switch-Based Processing Absolute versus Relative Determinism Nested Hierarchy of Biocomputing Dynamics Membrane as a Mesoscopic Substrate 5.1 Localized and Delocalized Potentials in Biomembranes . 5.2 Role of Membrane Fluidity in the Mesoscopic Dynamics 5.3 Electrostatic Interactions as a Molecular Switching Mechanism 5.4 Lateral Mobility of Protons on Membrane Surfaces: the "Pacific Ocean" Effect 5.5 Role and Specificity of Phospholipid Polar Head- Groups 5.6 Effect of Transmembrane Diffusion Potentials and Compartmentalization 5.7 Vesicular Transport, Exocytosis and Synaptic Transmission Shape-Based Molecular Recognition 6.1 Role of Short-Range Non-Covalent Bond Interactions in Molecular Recognition 6.2 Molecular Recognition between Ferredoxin and FNR . . 6.3 Comparison of Plastocyanin and Cytochrome C6 6.4 Molecular Recognition of Transducin and Arrestin . . . ix
2 3 10 13 16 17 24 29 34 36 39 40 42 43 49 51 54
x
Information Processing and Living Systems
6.5 Electronic-Conformational Interactions Intracellular and Intramolecular Dynamics 7.1 Electrostatic Interactions between a Small Molecule and a Macromolecule 7.2 Effect of Phosphorylation 7.3 Concept of Intelligent Materials 7.4 Concept of Calcium-Concentration Microdomain . . . . 7.5 Errors, Gradualism and Evolution 7.6 Protein Folding 8 Stochastic Nature of Neural Events: Controlled Randomness of Macroscopic Dynamics 9 Long-Term Potentiation and Synaptic Plasticity 10 Role of Dendrites in Information Processing 11 Efficiency of Biocomputing 12 General Discussion and Conclusion References
88 100 103 105 110 115
Chapter 2. A Multi-Disciplinary Survey of Biocomputing: 2. Systems and Evolutionary Levels, and Technological Applications
141
7
1 2
3
4
Introduction Background 2.1 Key Conclusions to Part 1 2.2 Element of Non-Equilibrium Thermodynamics 2.3 Element of Cellular Automata 2.4 Element of Nonlinear Dynamic Analysis Biocomputing at the Evolutionary Level 3.1 Is Evolution Deterministic? 3.2 Explanatory Power of Evolution 3.3 Evolution as Problem Solving 3.4 Random Search, Exhaustive Search and Heuristic Search 3.5 Enigma of Homochirality of Biomolecules 3.6 Damage Control and Opportunity Invention 3.7 Analogues and Homologues 3.8 Co-Evolution and Perpetual Novelty 3.9 Punctuated Equilibrium and Cambrian Explosion . . . Cognitive Aspects of Biocomputing 4.1 Models of Creative Problem Solving
60 61 62 64 67 75 77 80
142 147 147 148 149 151 153 153 155 156 157 158 160 163 164 165 166 166
Contents
5
4.1.1 Wallas' Four-Phase Model 4.1.2 Koestler's Bisociation Model 4.1.3 Simonton's Chance-Configuration Model . . . . 4.2 Parallel Processing versus Sequential Processing in Pattern Recognition 4.3 Random Search versus Heuristic Search 4.4 Dogmatism and Self-imposed Constraint 4.5 Retention Phase: The Need of Sequential Verification . 4.6 Picture-Based Reasoning versus Rule-Based Reasoning in Pattern Recognition 4.7 Advantages and Disadvantages of Rule-Based Reasoning 4.8 Contemporary Interpretation of Freud's Concept of the Unconscious and Poincare's Introspective Account . . . 4.9 Interpretation of Hypnagogia and Serendipity 4.10 Gray Scale of Understanding and Interpretation of Intuition and "Aha" Experience 4.11 Pseudo-Parallel Processing 4.12 Need of Conceptualization and Structured Knowledge . 4.13 Koestler's Bisociation versus Medawar's HypotheticoDeduction Scheme 4.14 Behaviorism versus Cognitivism 4.15 Cerebral Lateralization 4.16 Innovation versus Imitation: Gray Scale of Creativity . 4.17 Elements of Anticipation and Notion of Planning Ahead 4.18 Intelligence of Nonhuman Animals: Planning Ahead, Versatility and Language Capability 4.19 Multiple Intelligences: Role of Working Memory . . . . 4.20 Creativity in Music, Art and Literary Works 4.21 Complex and Interacting Factors in the Creative Process: Role of Motivation, Hard Work and Intelligence . . . . 4.22 Education and Training: Present Educational Problem 4.23 Substituted Targets and Goals in Social Engineering . . 4.24 Cognitive Development: Nature versus Nurture 4.25 Is the Crisis in the U.S. Science Education False? . . . 4.26 Simulations of Gestalt Phenomena in Creativity . . . . Consciousness and Free Will 5.1 Consciousness 5.2 Controversy of the Free Will Problem 5.3 Conflict between Free Will and Classical Determinism .
xi
167 167 168 170 175 177 179 181 183 191 205 215 226 229 231 234 236 241 244 248 256 261 274 284 297 300 306 311 325 326 328 330
xii
Information Processing and Living Systems
5.4 5.5 5.6 5.7
6
One-to-One versus One-to-Many Temporal Mapping . . Compatibilists versus Incompatibilists Randomness and Determinism in Microscopic Dynamics Randomness and Determinism in Mesoscopic and Macroscopic Dynamics 5.8 Endogenous Noise 5.9 "Controlled" Randomness in a Hierarchical Biocomputing System 5.10 Impossibility of Proving or Disproving the Existence of Free Will 5.11 Quantum Indeterminacy at the Biological Level . . . . 5.12 Microscopic Reversibility and Physical Determinism . . 5.13 Incompatibility of Microscopic Reversibility and Macroscopic Irreversibility 5.14 Origin of Macroscopic Irreversibility 5.15 Enigmas of Alternativism, Intelligibility and Origination 5.16 Laplace's "Hidden Cause" Argument 5.17 Physical Determinism and Cosmology 5.18 Free Will and Simulations of Consciousness 5.19 Critique of the New-Mysterian View 5.20 Readiness Potential and Subjective Feeling of Volition . Digression on Philosophy and Sociology of Science 6.1 Falsifiability and Non-Uniqueness of Scientific Theories 6.2 Rise of Postmodernism 6.3 Gauch's Analysis 6.4 Fallibility of Falsification 6.5 Science of Conjecture 6.6 Role of Subjectivity in Creative Problem Solving and Value Judgement 6.7 Critiques of Science Fundamentalism and Postmodernism 6.8 Level of Confidence in Scientific Knowledge 6.9 Sociological Aspects of Science 6.10 Logical Inconsistencies of Antirealism 6.11 Objective Knowledge: Popper's Third World 6.12 Method of Implicit Falsification: Is Psychoanalysis Unscientific? 6.13 Life Itself: Epistemological Considerations
332 335 338 341 343 354 355 356 358 363 376 386 394 397 399 403 413 419 419 423 424 425 427 435 442 446 447 448 449 449 451
Contents
6.14 Unity of Knowledge or Great Divide: The Case of Harris versus Edwards 7 Technological Applications 7.1 Expert Systems in Artificial Intelligence 7.2 Neural Network Computing 7.3 Animat Path to Artifical Intelligence 7.4 Agent Technology 7.5 Neuromolecular Brain Model: Multi-Level Neural Network 7.6 Embryonics: Evolvable Hardware 7.7 A Successful Example of Molecular Computing: Solving the Direct Hamiltonian Path Problem 7.8 Prospect of Molecular Electronics in Biocomputing . . 8 General Discussion and Conclusion References
Chapter 3. Models for Complex Eukaryotic Regulatory DNA Sequences 1 2
Introduction Some Biology of Transcription Regulation 2.1 The Basal Transcription Machinery 2.2 Chromatin Structure in Regulatory Regions 2.3 Specific Gene Regulation: Sequence Elements and Transcription Factors 3 Core Promoter Recognition 3.1 Ab Initio Prediction 3.2 Alignment Approaches 4 Prediction of Regulatory Regions by Cross-Species Conservation 5 Searching for Motif Clusters 6 Perspective References
Chapter 4. An Algorithm for Ab Initio DNA Motif Detection 1 2
Introduction Algorithm
xiii
475 481 481 483 488 489 490 493 493 495 499 532
575 575 576 576 579 581 585 585 592 593 596 599 602
611 611 612
xiv
Information Processing and Living Systems
3 Experiments References
613 614
Chapter 5. Detecting Molecular Evidence of Positive Darwinian Selection
615
1
Introduction 1.1 Molecular Evolution Research in a Time of Genomes . 1.2 Some Examples 1.3 Chapter Overview 2 Types of Adaptive Evolution 2.1 Episodic Positive Selection 2.2 Diversifying Selection — The Biological Arms Races . 3 The Neutral Theory of Molecular Evolution 3.1 Cost of Natural Selection 3.2 Recent Tests of the Neutral Theory 3.3 Detecting Departures from Neutrality 4 Selective Sweeps and Genetic Hitchhiking 4.1 Detecting Selective Sweeps 4.2 Correlation between Local Recombination Rates and Diversity 4.3 Distinguishing Complex Demographic Histories or Background Selection from Positive Selection 5 Codon-Based Methods to Detect Positive Selection 5.1 Counting Methods 5.1.1 Window-Based Methods 5.1.2 Site-Specific Methods 5.2 Probabilistic Methods 5.2.1 Site-Specific Methods 5.2.2 Lineage-Specific Methods 5.2.3 Detecting Selection in Non-Coding Regions . . . 5.3 Comparison of Counting and Probabilistic Approaches to Comparative Methods 5.4 Codon Volatibility 5.5 Codon-Based Methods that use Polymorphism Data . . 6 Discussion and Future Prospects References
615 616 616 617 618 618 618 619 619 620 621 622 623 624 625 626 628 629 629 630 631 634 634 635 636 637 638 639
Contents
Chapter 6. Molecular Phylogenetic Analysis: Understanding Genome Evolution 1 2 3
xv
645
What is Phylogenetics? What is a Phylogenetic Tree? Identifying Duplicate Genes 3.1 Generate Protein Families 3.2 Multiple Sequence Alignments 3.3 Reconstructing Phylogenetic Trees 4 Assessing the Accuracy of Phylogenetic Trees 5 High-Throughput Screening of Tree Topologies 6 Concluding Remarks References
645 646 646 647 647 647 649 649 649 650
Chapter 7. Constructing Biological Networks of Protein-Protein Interactions
653
1 2
Introduction Bioinformatic Approaches 2.1 Homology 2.2 Fusion Events 2.3 Co-Localization 2.4 Co-Evolution 2.5 Literature Mining 3 From Interactions to Networks 3.1 False Negatives 3.2 False Positives 4 Conclusion References
653 654 655 656 657 659 660 664 665 666 668 669
Chapter 8. Computational Modelling of Gene Regulatory Networks
673
1 2 3
Introduction 673 A Novel Approach 674 Modelling Application with Integrated Approach of FirstOrder Differential Equations, State Space Representation and Kalman Filter 676 3.1 Discrete-Time Approximation of First-Order Differential Equations 676
xvi
Information Processing and Living Systems
3.2 3.3 3.4 3.5 3.6
State Space Representation Kalman Filter Using GA for the Selection of Gene Subset for a GRN . GA Design for Gene Subset Selection Procedure of the GA-Based Method for Gene Subset Selection 4 Experiments and Results 4.1 Building a Global GRN of the Whole Gene Set out of the GRNs of Smaller Number of Genes (Putting the Pieces of the Puzzle Together) 5 Conclusions References
677 678 678 679
Chapter 9. Overview of Text-Mining in Life-Sciences
687
679 681 683 684 685
1 2 3
Introduction 687 Overview of Text-Mining 689 Scope and Nature of Text-Mining in Life-Sciences Domain . . 689 3.1 Characteristics of Text-Mining Systems 690 3.2 Systems Aimed at Life-Sciences Applications 690 4 Conclusions 692 References 692 Chapter 10. Integrated Prognostic Profiles: Combining Clinical and Gene Expression Information through Evolving Connectionist Approach 1 2
3 4
Introduction Methods 2.1 Data sets 2.2 Data Integration 2.3 Common Feature Set Selection 2.4 Algorithm of Integrated Feature Selection 2.5 Experimental Design Results 3.1 Classification Accuracy Test and Profile Verification . . Discussion 4.1 Discovering Genotype Phenotype Relationships through Integrated Profiles
695 696 697 698 698 698 699 701 701 702 704 704
Contents
xvii
5 Conclusion References
705 706
Chapter 11. Databases on Gene Regulation
709
1 2
Introduction Brief Overview of Common Databases Presenting General Information on Genes and Proteins 3 Specialized Databases on Transcription Regulation 3.1 TRANSFAC® 3.2 TRANSCompel® — A Database on Composite Regulatory Elements 3.3 SMARt DB — A Database on Scaffold/Matrix Attached Regions 4 Databases on Biomolecular Interactions and Signaling Networks 4.1 Regulatory Networks: General Properties and Peculiarities 4.2 Variety of Databases on Protein Interactions and Signaling Networks 4.3 TRANSPATH® — A Database on Signal Transduction Pathways 5 Application of the Databases for Causal Interpretation of Gene Expression Data 5.1 Analysis of Promoters 5.2 Identification of Key Nodes in Signaling Networks . . . References Chapter 12. On the Search of Better Validation and Statistical Methods in Microarray Data Analysis 1 2 3 4 5 6 7
Introduction Microarray Analysis Steps Preprocessing Normalization Identification of Differentially Expressed Genes Validation Strategies Experimental Validation Methods 7.1 Self-Hybridization or Identical Replicates
709 711 712 713 715 715 716 716 717 719 721 721 723 724
729 729 730 730 732 733 734 736 736
xviii
Information Processing and Living Systems
7.2 Quantitative RT-PCR 7.3 Mutant versus Wild Type 7.4 Gene Spike-In Experiments 7.5 Other Validation Experiments 8 Summary References
736 737 738 739 739 740
Chapter 13. Information Extraction from Dynamic Biological Web Sources
741
1 2 3
Introduction Information Extraction from Dynamic Web Sources Survey of Wrapper Maintenance Systems 3.1 Wrapper Verification Methods 3.1.1 RAPTURE 3.1.2 Forward-Backward Scanning Algorithm 3.2 Wrapper Reinduction Methods 3.2.1 ROADRUNNER 3.2.2 DataProg 3.2.3 Schema-Guided Wrapper Maintenance (SG-WRAM) 3.2.4 Relnduce Algorithm 4 Conclusion References
741 743 745 745 745 745 746 746 747 747 748 748 749
Chapter 14. Computer Aided Design of Signaling Networks 751 1 Introduction 2 Signaling Pathways: A Prickly Proposition 3 Challenges of Signaling Modeling 4 The Goals and Features of Cellware 5 Concluding Remarks References
751 751 754 756 757 759
Chapter 15. Analysis of DNA Sequences: Hunting for Genes
761
1 2
Introduction DNA and Genes 2.1 DNA 2.2 Coding Genes
761 762 762 762
Contents
2.3 The Genetic Code and Proteins 2.4 Structure of Coding Genes 2.5 Complementary DNA (cDNA) 2.6 Non-Coding Genes 3 Genomes 3.1 Computational Analysis of the Genome: Coding Gene Prediction 3.2 Computational Analysis of the Genome: Non-Coding Gene Prediction 4 Closing Remarks References Chapter 16. Biological Databases and Web Services: Metrics for Quality 1 2 3
Introduction Growing Need for Quality Control Metrics for Quality Analysis 3.1 Content 3.2 Availability 3.3 Combining Different Metrics 4 Discussion and Conclusion References
xix
764 764 765 765 766 767 768 769 769 771 771 772 773 773 774 775 776 776
CHAPTER 1 A MULTI-DISCIPLINARY SURVEY OF BIOCOMPUTING: 1. MOLECULAR AND CELLULAR LEVELS*
Felix T. Hong Department of Physiology Wayne State University School of Medicine Detroit, Michigan 48201, USA E-mail:
[email protected] The first part of this two-part survey examines the molecular and the cellular aspects of information processing in biological organisms (biocomputing). Information processing is analyzed in the framework of a multi-level nested hierarchical network pioneered by Conrad. The control laws that govern input-output relationships are examined at four separate levels: protein folding (submolecular level), biochemical reactions in cytoplasm (microscopic level), physico-chemical processes at the membrane surfaces and its interiror (mesocopic level), and the neuronal interactions (macroscopic level). Molecular recognition relies on random searching to increase the probability of encounters at large distances but switches to more deterministic searching at mesoscopic distances of close encounters. The presence of endogenous noise associated with ion channel fluctuation suggests that biocomputing abides by a weaker form of determinism. However, the noise does not become steadily amplified in the subsequent steps because the control law re-converges to a well-defined law at higher levels of biocomputing. Thus, information processing proceeds through various hierarchical levels, the control laws swing alternatingly between nearly random and nearly deterministic but never reach either extremes. It appears that the inherent randomness included in biocomputing processes and the dynamic nature of the network structures are essential for the intelligent behavior of a living organism. * Dedicated to the memory of the late President Detlev W. Bronk of The Rockefeller University
1
2
F. T. Hong
1. Introduction The human brain is often compared to a digital computer. However, this comparison is misleading because the similarity is only superficial. A conventional sequential digital computer is long on speed and accuracy for number-crunching but short on cognitive skills. Attempts to emulate the human brain with a digital computer have led to advances in artificial intelligence research. Research efforts seeking an alternative to digital computing have led to the prospects of using molecular materials to construct functional devices and computing elements: an emerging field known as molecular electronics (see Sec. 7.8 of Chapter 2). This two-part survey examines biocomputing principles from the molecular to the systems level with an intent to facilitate technological applications. Biocomputing encompasses various aspects of information processing such as pattern recognition, process control, learning, problem solving, adaptation to environmental changes, optimization for long-term survival, etc. Thus, almost every biological process is related to biocomputing. Although we shall focus primarily on the neural aspect of biocomputing, some non-neural processes that are not computational in nature, such as bioenergetic conversion, will also be discussed. Chloroplasts and mitochondria, the organelles for bioenergetic conversion, are the power supply for biocomputing processes. Their operation indirectly influences the performance of biocomputing. The function and regulation of genes constitute a very important aspect of the life process (process control). The detailed molecular mechanisms that form the core of modern molecular biology are readily available in the literature and will not be covered in this survey. The immune response which involves some kind of memory — the memory of self — will also not be covered. The "disanalogy" (difference) between information processing in a conventional digital computer and in a living organism is a topic that has attracted considerable attention of investigators who seek to "reverseengineer" the human brain. Conrad75 previously pointed out that a digital computer is material-independent and all internal dynamic processes of the hardware components are suppressed, whereas the internal dynamics is allimportant for the operation of the brain. Particularly relevant to our discussion here is a nested hierarchical macroscopic-microscopic (M-m) scheme of biological information processing enunciated by Conrad's group.73 We shall use the M-m scheme, which he later extended to include a mesoscopic link, as a convenient point of departure in this article.181'182-186 The hormonal
Bicomputing Survey I
3
system links various organ systems together, thus constituting another level of network processing. However, we shall not pursue this level of dynamics here. The detail can be found in a standard physiology textbook. The present article will examine the salient features of biocomputing at the molecular, membrane and intercellular levels by exploring actual examples. Since conclusions in this article are to be drawn mainly by means of induction instead of deduction, it is necessary to present numerous examples. Specific examples, most of which are commonly known, are chosen to: a) illustrate the dynamic network nature of biocomputing with particular emphasis on modularity of the structural organization and the input-output relationship of biocomputing (control laws), b) to emphasize the electrostatic interactions and related switching functions which were often treated ambiguously in the standard biochemistry and computer science literatures, and c) to evaluate biological information processing from the point of view of computer science and computer engineering. The choice of examples is biased by the author's background but in no way implies that other examples are less relevant. In principle, validation of a conclusion by means of induction requires an infinite number of examples, whereas refutation requires only a single well-established counter-example.311 Thus, the limited number of examples included in this article hardly suffices to establish any conclusion. It is my hope that the cited examples will remind the readers of additional examples and/or will set the readers on a path of exploration for additional supporting evidence. Preliminary discussions along the same line of reasoning have appeared in Refs. 180, 181, 182, 186 and 188. General treatises on biocomputing can be found in the literature.76'214'77 The cognitive and evolutionary aspects of biocomputing, as well as its technological applications, is presented in Part 2 of this survey (Chapter 2). Extensive cross-references are made between sections and between the two parts of this survey, and may be ignored upon first reading. 2. Lock-Key Paradigm versus Switch-Based Processing Obviously, the mode of operation in the human nervous system is neither completely digital nor completely analog. Transmission of information in the nervous system is coded in the form of action potentials (nerve impulses), which obey the "all-or-none" principle and are mainly digital in nature (e.g., see Ref. 211 or any standard physiology textbook). However, the intensity of a neural message is coded in frequency (or, rather, the interval of trains of action potentials) and is thus analog in nature. At
4
F. T. Hong
a synapse which bridges the gap between two neurons, signal integration starts with a digital process: neurotransmitters are released in packets of a fixed (quantal) amount and the individual postsynaptic (electrical) responses are therefore somewhat discrete. However, the stochastic nature of neurotransmitter release and its binding to receptors on the postsynaptic membrane bestows noise upon the processes of signal integration at the neuronal membrane, thus making it less than strictly deterministic. As a result, the large number of superimposed responses allows the discrete levels to merge into a virtual continuum. On the other hand, certain degrees of predictability are preserved by virtue of the specificity of transmitter-receptor interactions and the "hard-wired" and highly specific neural network pathways, although the hard-wired patterns are subject to modifications (neural plasticity). The pattern of synaptic inputs, consisting of a large number of discrete switching events, acquires an analog nature collectively. The essence of biomolecular computing in the nervous system depends primarily on the unique neural architecture and the underlying specific and complex interactions between the network elements (Conrad's macroscopic dynamics). Conrad70 was among the first to propose the use of biological information processing as an alternative architectural paradigm for future computers. The motivation stemmed from the apparent weakness of a sequential digital computer in sophisticated decision-making processes such as pattern recognition, learning and other cognitive processes. He pointed out that the predominant mode of biological information processing is not a sequence of simple logical operations based on a finite set of switches but rather a subtle form of information processing involving molecular recognition which he referred to as "shape-based information processing"76'78 and which is essentially the lock-key paradigm enunciated by Emil Fischer in 1897 (e.g., see Ref. 29) (Fig. 1). Conrad pointed out the advantage of parallel processing that is inherent in shape-based information processing. A large variety of macromolecules that are distributed in various types of cells constitute the substrate on which biological information processing is carried out (Conrad's microscopic dynamics). The versatility of biomolecular computing apparently stems from the rich repertoire of biochemical reactions. The specificity of these biochemical reactions derives in part from the molecular conformation ("shape"), as exemplified by processes such as enzyme catalysis, antigen-antibody reactions, neurotransmitter-receptor or hormone-receptor interactions, etc. Conrad79 suggested that, in accordance with the lock-key paradigm, biological information processing is equivalent
Bicomputing Survey I
5
Fig. 1. Lock-key paradigm. A. The schematic shows a ligand (a small molecule that binds to an enzyme or a receptor) and a protein with a complementary binding site. The binding site shows the complementary shape as well as matching ionic charges. When the ligand binds to the protein, the complex is stabilized by the ionic bonds and other short-range non-covalent bond interactions. In our subsequent discussion, the ligand is identified as a "template" while the protein with the binding pocket provides the "pattern." However, the role of pattern and template can be reversed. B. The schematic reveals the linear peptide structure of the proteins. The amino acids that interact with the ligand at the binding site need not be at adjacent sites along the polypeptide chain, as indicated in this schematic of the folded protein. The unfolded polypeptide chain is shown below, with the interacting amino acids (shown in black with ionic charges) which spread over several parts of the polypeptide chain. Thus, the shape (conformation) is crucial for making these sites active. (Reproduced from Ref. 381 with permission; Copyright by McGraw-Hill)
to a free-energy minimization problem. This idea is illustrated by the selfassembly model for pattern recognition (Fig. 2). The pattern of signal inputs causes specific macromolecules to be released from internal depots, to be activated, and to undergo conformational changes. These macromolecules then self-assemble to form a mosaic pattern. This mosaic pattern then determines the output signal. Conrad's self-assembly model emphasizes that a good deal of information processing is achieved by shape-matching of macromolecules: a rudimentary form of parallel distributed processing (PDP). The diversity of the elemental pattern processors is derived from the diversity of macromolecular interactions with different molecular specificity and affinity, and different reaction kinetics. In particular, carbohydrates provide the diversity
6
F. T. Hong
Fig. 2. Self-assembly model for pattern recognition. Input signals cause the macromolecules to undergo conformational changes and to assume mutually complementary shapes. These macromolecules then form a supramolecular complex, in an interlocking way, as a result of free energy minimization. The self-assembled complex subsequently generates an output signal. (Reproduced from Ref. 76 with permission; Copyright by Academic Press)
of recognition sites by conjugating with either lipids or proteins at the cell surface for cell recognition.339 These elemental computational steps are collectively known as signal transduction in the molecular biology literature. Conrad76 pointed out that the variety of elemental computational steps is so huge — and is continuing to be revised (via evolution) — that it defies cataloging in a finite user manual. In contrast, the user manual of a digital computer is finite and reasonably manageable. A digital computer is constructed from a small set of switches known as logic gates (which perform AND, OR, NEGATION, Exclusive OR operations) and flip-flops (which can also be configured as memory devices) ("switch-based information processing"). The complexity arises from the complex interconnections between a large number of these switches. The computational process is strictly deterministic. Only at the input and the output stages does a digital computer resort to analog processing via analog-to-digital and digital-to-analog conversions, respectively. In other words, the introduction of errors in digital computing is generally limited to the input and output stages; additional errors are neither admitted nor amplified by the intervening steps of computation unless there are "bugs" in the software program or in the hardware. Strict determin-
Bicomputing Survey I
7
ism is enforced to achieve the reliability of digital computers. Regardless of the constituent materials, the basic computing elements exhibit only two states, the familiar "0" and "1" in binary numbers. All components are designed to recognize only these two states. The appearance of signals not recognized as either "0" or "1" causes the hardware to malfunction. As Conrad frequently pointed out, the internal dynamics is thus deliberately suppressed. This practice makes concurrent use of digital and analog processing impossible. In contrast, enlisting the rich repertoire of biochemical reactions and adopting a nested hierarchical organization make intermixing of digital and analog processing possible in biocomputing. The lock-key paradigm captures a unique feature of biocomputing. However, additional features are needed to make effective and efficient computing possible. For simple inorganic chemicals or small organic chemicals, the rate of reaction depends on a) encounter of the reactants by random diffusion and collisions in the solution phase, and/or b) intrinsic reaction rates that are characteristic of the participating reactants; both processes are usually temperature-dependent. Unless the products are removed or consumed, a chemical reaction seldom goes to completion and, strictly speaking, never goes to completion no matter how close to completion it becomes. This is because the accumulation of products creates a tendency for the reaction to proceed in the reverse direction (reverse reaction or back reaction). That is, most if not all reactions can proceed in both directions, and the net reaction tends to proceed in the direction that will minimize the net Gibbs free energy (under constant temperature and pressure). For small molecules, a close encounter between reactants by means of random diffusion and collisions is all that is required for the reaction to proceed. For macromolecular reactions, mere close encounters alone are not sufficient; the reactant molecules must also perform a search for the reactive sites in order to achieve a lock-key alignment (Sec. 6). If macromolecular reactions were dependent solely on random searching, then information processing based on the lock-key paradigm would be slow and inefficient even though the efficiency conferred by parallel processing partially compensates for the deficiency. It is hard to imagine that intelligence and decisive actions can arise from random searching alone. Conrad's self-assembly model demonstrates two important aspects of biocomputing that are absent in digital computing: a) transformation of states is implemented by means of chemical reactions in addition to physical changes, and b) molecular recognition confers a continuous shade of specificity, affinity and kinetics. However, the self-assembly model is also
8
F. T. Hong
somewhat misleading because it implies that: a) biocomputing is driven exclusively by the tendency of microscopic molecular dynamics to seek the state with the lowest free energy, b) biocomputing is cost-free, and c) biocomputing includes steps of random searching for matching molecular entities prior to consummation of chemical reactions. The self-assembly model neglects several important features in biocomputing. First, life processes do not always seek the global minimum in the free energy landscape. In other words, achieving a metastable state may be sufficient; the stability is required only during the active phase of biocomputing. Second, biocomputing is not cost-free at each and every stage of biocomputing, since the maintenance of life processes requires continuing input of matter and energy and output of waste and heat. The appearance of being cost-free exhibited by a passive chemical relaxation is contingent upon a pre-formed high-energy intermediate (such as ATP) or a preexisting transmembrane potential-energy gradient that has been built up in prior steps of bioenergetic processes. Third, the process of random searching required by Conrad's free-energy minimization scheme would make biocomputing too slow to cope with life. What the energy minimization scheme did not show is the uncertainty generated by branching biochemical reactions. A given metabolite (biochemical intermediate) often participates in several branching chemical reactions that belong to different metabolic pathways, and "cross-talks" are constant hazards. Apparently, some crucial features are missing in Conrad's self-assembly model. Although free-energy minimization is an important principle underlying many biological processes including protein folding (Sec. 7.6) and passive electrodiffusion across the plasma membranes (Sec. 8), additional energy-consuming processes — top-down processes — are required to "restrain" the inherently random processes of reactions and diffusion in the solution phase of the cytoplasm and other subcellular compartments. Some of these processes are controllable via switch-like mechanisms such as activation of enzymes, i.e., digital processes. Activation of enzymes requires energy consumption in terms of ATP hydrolysis — ATP is the energy currency in the living world. Thus, reactions represented by the free-energy minimization scheme can be viewed as an analog process, whereas switchlike processes can be viewed as a digital process. Biocomputing requires an intricate interplay between digital and analog processes. These additional processes that make biochemical reactions more deterministic often involve short-range interactions between molecules and within the same molecule, i.e., non-covalent bond interactions. Basic short-
Bicomputing Survey I
9
range non-covalent bond interactions include the van der Waals interaction, hydrogen bonding, and the hydrophobic and the electrostatic interactions.87 These forces also underlie the intramolecular processes collectively referred to as conformational changes of proteins (intramolecular information processing). Phenomena common to molecule-based information processing such as cooperativity requires a coherent and concerted interplay of these short-range non-covalent bond interactions for its manifestation (Sec. 7.3). A detailed analysis of short-range non-covalent bond interactions in biological interactions and the methodology of measurements can be found in work by Leckband241 and Israelachvili.197 A decision-making step of digital processing is usually implemented in terms of a branching computation algorithm. A branching process, in which one of several alternative decisions are available, in digital computing is clear-cut and deterministic; there is no ambivalence in decision making. In biocomputing, a branching process is, in general, much less clear-cut. A branching process in microscopic dynamics is often implemented in terms of branching biochemical reactions. Prom the perspective of synthetic organic chemists, branching chemical reactions are often undesirable because they produce a mixture of both desired and unwanted products; the unwanted reactions are called side reactions (see also Sec. 5.6 of Chapter 2). The possibility of generating several different reaction products, in various proportions, from the same reactants creates uncertainty and prevents biocomputing from being strictly deterministic. The nearly universal presence of reverse reactions, mentioned above, further contributes to the uncertainty. However, biochemical reactions are at times made less random by intricate top-down control processes such as enzyme activation and deactivation, and gene activation, to name a few.a These switch-like control processes channel the reactions in certain preferential directions at the expense of others. The alternative pathways can be made negligibly small but cannot be completely shut off. We shall examine in detail the molecular control mechanisms mediated by phosphorylation, an energy-consuming process (Sec. 7.2). As we shall see later, phosphorylation acts like a switch that frequently leads to alterations of interacting non-covalent bond types of molecular forces, either within the protein molecules, between protein subunits, between two different molecules, or even between a protein molecule and the membrane surface. The importance of electrostatic interactions is a
An interesting account of digital processes in genetic control was presented by Hayes.156
10
F. T. Hong
particularly emphasized268 (Sees. 5.3 and 6.2). Such interactions tend to be obscure in biochemical reactions in the solution phase. Often an electrostatically controlled biochemical reaction is more deterministic than a diffusion-controlled reaction.34 Such processes are vital in many membranebased processes (Sec. 5). Membrane-based biochemical processes will be extensively discussed since they are usually neglected in the general discussion of biocomputing. Furthermore, many prototype molecular devices are either membrane-based or thin-film-based. It is therefore instructive to examine these membrane-based processes with unique features that are absent in solution-phase biochemical processes. 3. Absolute versus Relative Determinism It is apparent that biocomputing does not abide by the kind of determinism commonly seen in digital computing. However, it is not a foregone conclusion because deterministic events with unknown causes may sometimes disguise as indeterministic events. In Sec. 5 of Chapter 2, we shall argue that biocomputing complies with a weaker form of determinism, which is neither absolutely deterministic nor pure randomness. Anticipating the forthcoming discussion, we shall consider a "gray scale" of determinism ranging from extremely deterministic to extremely random, in place of a simple dichotomy of determinism and indeterminism. Here, determinism will be considered at the level of control laws. A control law in biocomputing is defined as a specific rule or set of rules that "maps" (transform) a set of input variables to output variables, i.e., input-output relationship. If the input variables are represented by a statevector (a set of numbers representing the input condition), a control law is a mathematical operator that maps this input state-vector to the output state-vector. The output state-vector can then become the input statevector for the next computing step. Given a precisely known single-valued input signal (or a set of input signals), a strictly deterministic control law dictates a sharply defined single-valued output signal (or a set of sharply defined output signals). The best known example of strictly deterministic control laws is Newton's equation of motion. Given a precisely known set of variables representing the position and momentum of a particle at a given moment, the precise position and momentum at a subsequent time can be calculated and are uniquely determined. Newton's equation of motion predicts a single sharply denned set of values for position and momentum. Repeated experimental measurements or observations usually yield slightly
Bicomputing Survey I
11
different values that tend to cluster together with the highest frequency of occurrence at the center. The values are thus characterized by a mean value and a standard error (or deviation or variance). Typically, the frequency versus output relationship is a Gaussian curve. In handling the spread of measured output values, there are, in principle, two options: a) attributing the spread to errors in inputs or outputs (boundary conditions), and/or b) attributing the spread to the control law. In Newtonian mechanics, the control law is presumed to be deterministic. The deviations of an observed output value from that predicted by Newton's law of motion are usually attributed to a) observational errors of the output value due to the limitations of the instrumental resolution, the observer's skill, etc., b) uncertainty of the input value, and c) perturbations from external contingencies (e.g., perturbations from other planets in the calculation of the eclipse of the Sun or the Moon as a three-body problem of the Sun, the Moon and the Earth). The above reference to Newton's classical mechanics, as an example of deterministic control laws, is obviously naive and oversimplified. Earman discussed several examples of deviations of Newtonian mechanics from strict determinism in his book A Primer of Determinism.97 A more rigorous discussion of the topic will be deferred to Sec. 5 of Chapter 2. In social sciences, part of the spread of measured values from the central mean may be attributed to the control law itself. The notion of "individual variations" implies that control laws in social sciences are usually not deterministic, and the variations are partly associated with imprecise control laws governing human affairs rather than measurement errors. In biocomputing, it is legitimate to attached the spread of measured values to a control law so that the control law maps a single sharply denned input parameter into a range of output values characterized by a mean and a deviation. This practice appears to be an operational choice simply for convenience, and is justified by the fact that, noise, regardless of its source, affects the outcome of biocomputing. Besides, bioorganisms were "designed" to operate in a noisy environment anyway. If, however, the variations of measured values are not caused by external contingencies or by measurement errors and/or uncertainties of inputs, the variations must then be attributed to the control law itself, and the practice is no longer an operational choice. It then becomes a serious epistemological problem. Of course, the variations can always be attributed to hidden variables and thus indeterminacy of the control law can always be denied or avoided. The distinction between the two epistemological choices is subtle, and will discussed in detail in Sec. 5.16 of
12
F. T. Hong
Chapter 2. In the present article, we shall replace the term "error" with neutral terms such as "dispersion" or "variance" to designate the spread of measured data from the central mean value. If the dispersion is zero, the control law is said to be absolutely (or strictly) deterministic, and the frequency versus output curve yields a delta-function in the mathematical sense, namely, a curve with infinite height (amplitude) and infinitesimal width but with a finite area under the curve. For reasons presented in Sec. 2, biocomputing seldom yields a sharply defined output value, as is commonly seen in measurements performed in physics. The values may be well denned but the dispersions are far from zero. Thus, the control law is relatively deterministic if part of the dispersion can be attributed to the control law alone. This determinism is referred to as relative determinism, whereas absolute determinism will be treated as synonymous with strict determinism. Some biocomputing processes do not yield single-valued outputs. Instead, their governing control law dictates a probability density function of the output values which do not cluster around a central mean but scatter "erratically" over a considerable range (Sec. 8). Thus, relative determinism includes both regular control laws (with a well-defined mean and a non-zero dispersion) and probabilistic control laws (without a "meaningful" mean). It is important to realize that relative determinism does not necessarily mean weak causality in biocomputing since the control law can occupy any position on the gray scale of determinism. Thus, on a gray scale from 0 to 1 (with 0 equal to complete randomness and 1 equal to absolute determinism), relative determinism assumes a value less than 1 but greater than 0. Deviations from strict determinism may be essential in certain biocomputing processes. Physical causality has been analyzed by Yates with respect to brain function.397 In Yates' terminology, absolute determinism and absolute indeterminism occupy the two extremes on the gray scale of determinism. In the above definition of control laws, it was tacitly assumed that biocomputing can be formalized. Rosen323 argued that life processes cannot be formalized. A rigorous discussion will be deferred to Sec. 6.13 of Chapter 2.
Bicomputing Survey I
13
4. Nested Hierarchy of Biocomputing Dynamics Information processing in the nervous system is often described as being massively parallel distributed in nature.325'270 This is largely the consequence of a nested hierarchical organization of networks. The neurons are discrete building blocks of the nervous system. Input and output macroscopic signals link the neural network to the outside world. However, neurons are not merely elements of a vast network of switches. The actions of nerve impulses and hormones on cell membranes may induce additional intracellular signal transduction processes leading to activation of genes, initiation or modulation of the synthesis of specific kinds of proteins, activation of enzymes, and permanent or semi-permanent modifications of the synapses. These processes may lead to long-term and profound cellular changes. Traditionally regarding glia cells as a passive supporting partner of neurons, neuroscientists have been awaken to the prospect of a more critical role of glia cells in thinking and learning.109 Thus, the intracellular molecular dynamics must also be treated as a separate kind of biomolecular computing that can, in turn, affect the signaling at the macroscopic level. Conrad referred to this vertical coupling of computational dynamics as the macroscopic-microscopic (M-m) scheme of molecular computing73 (Fig. 3). This was a somewhat novel but not unprecedented idea. Before Herbert Simon wrote his ground-breaking treatise Administrative behavior in 1945, the hierarchy of authority and the modes of organizational departmentalization were central concepts of organization theory in economics. While most analyses of organization had emphasized "horizontal" specialization — the division of work — as the basic characteristic of organized activity, Simon was the first to consider "vertical" specialization — the division of decision-making duties between operative and supervisory personnel (p. 7 of Ref. 352). A living cell houses a large variety of molecular components and the intracellular molecular processes comprise a myriad of branching biochemical pathways. The complex interactions can be viewed as distributed networks and the computational dynamics involves kinetic interactions of biochemical reactions and diffusion of reactants and products. The complexity of these processes can be visualized in Fig. 4. Conrad and coworkers have carried out a systematic investigation of computer simulations of microscopic biocomputing dynamics. The reactiondiffusion model of neurons implies that the intramolecular dynamics is highly random.225'83 However, the cytoplasm is not merely a bag of water
14
F. T. Hong
Fig. 3. The macroscopic-microscopic scheme of vertical information coupling in biocomputing. Macroscopic information processing is performed by the network of neurons. Microscopic information processing is performed by diffusion and reactions of macromolecules. The two processing systems are linked via chemical signals (second messengers, etc.). (Reproduced from Ref. 76 with permission; Copyright by Academic Press)
containing a random mixture of a large number and variety of biomolecules. Furthermore, intracellular processes are not merely random diffusion and reactions of biomolecules. Indeed, the cytoplasm is highly compartmentalized. Various biochemical processes are segregated by an intricate network of endoplasmic reticulum as well as intracellular organelles, such as mitochondria and chloroplasts. Newly synthesized proteins carry specific segments of signal peptides or signal patches that allow these proteins to be delivered to specific compartments (protein sorting and protein targeting)194'191 (see also Chapters 12 and 13 of Ref. 3 and Chapter 35 of Ref. 364). Lipidation of proteins also plays a dynamic role in targeting.37 Binding of enzymes to
Bicomputing Survey I
15
Fig. 4. The microscopic network of interconnecting biochemical pathways in the cells. About 500 common biochemical reactions are shown, with each chemical species represented by a filled circle. The large circle appearing at the lower center portion (slightly to the left) represents the citric acid cycle. A typical mammalian cell synthesizes 10,000 different proteins. (Reproduced from Ref. 3 with permission; Copyright by Garland Publishing)
an appropriate anchoring protein directs the enzyme to an appropriate intracellular compartment where the action takes place.67 31P-NMR diffusion spectroscopic measurements suggested that, in addition to compartmentalization, other intracellular structure may also influence diffusion.90 There is a host of cytoskeletal components in the cytoplasm (for reviews, see Refs. 118, 161, 162, 233 and 301). Hameroff and coworkers146-147 have conducted a study of the intracellular cytoskeletal system as a biomolecular computing system to model consciousness. Ample evidence indicates that
16
F. T. Hong
some cytoskeletal networks are intimately coupled to the plasma membrane and are involved in the regulation of ion channel distribution and function (membrane-cytoskeleton).150'117 Motor proteins use the microtubule networks as scaffolds to mediate cell motility, to promote cell shape changes, to position membrane-bound organelles and to regulate ion channels.164'333 Experimental evidence indicates that ligand-gated ion channels are linked to cytoskeleton and to appropriate signal transduction pathways through their cytoplasmic domain.342 Cytoskeletal systems are also involved in the process of transporting organelles from one part of the cytoplasm to another part (cytoplasmic cytoskeleton). Thus, in addition to chemical reactions and diffusion, there are somewhat deterministic convective flows of materials in the highly compartmentalized environment. In this context, intracellular information processing can be viewed as network processing. However, the network is distributed rather than lumped, and the network connections are dynamic (time-dependent) rather than fixed ("hard-wired"). 5. Membrane as a Mesoscopic Substrate The processes that link macroscopic signals and microscopic intracellular molecular events are neither macroscopic nor microscopic. These events usually take place in the biomembrane or its immediate vicinity where the spatial scale is too small to be considered macroscopic but too large to be considered microscopic. The events between microscopic and macroscopic are usually referred to as mesoscopic events. The mesoscopic events are intimately related to the plasma membrane and membranes that line intracellular compartments. These membranes have a basic uniform structure: a uniform matrix of a phospholipid bilayer configuration in which membranebound proteins are embedded. The plasma membrane delineates an intracellular environment that is drastically different from the extracellular environment. It is well known that the maintenance of concentration gradients of several biologically important small ions are crucial for nerve signaling in the neural network; metabolic energy is temporarily stored as an electrochemical gradient for ready utilization. This electrochemical energy can be rapidly deployed for nerve signaling via the action of ion channels.165'200 In addition, many neurotransmitter-receptor and hormone-receptor interactions lead to signal transduction events that link the macroscopic dynamics to the intracellular dynamics via G protein and second messenger-mediated
17
Bicomputing Survey I
processes.131'201'293 Conrad76 has singled out the mesoscopic signals carried by second messengers (cyclic AMP, cyclic GMP, Ca 2+ , etc.; see Ref. 364 for general references) as the communication links between the macroscopic dynamics and the microscopic dynamics. He renamed the M-m scheme as the M-m-m scheme (where the italicized m stands for mesoscopic). This line of thinking was based on an experiment in which microinjection of cyclic AMP influenced the firing pattern of a neuron.247 However, second messenger-mediated processes are not the only mesoscopic processes that are important in biocomputing. Furthermore, the plasma membrane is not simply a boundary between two aqueous phases, nor is it an inert supporting matrix to anchor functional proteins for intercellular signaling and transmembrane signal transduction. The biomembrane possesses a structure that exhibits rich internal network dynamics: mesoscopic dynamics. Peculiar phenomena not seen in the solution phase appear in the mesoscopic events and allow unique computational paradigms to be established. It seems appropriate to elevate mesoscopic signaling to a distinct level of computational dynamics, and to reinterpret Conrad's M-m or M-m-m scheme as a full-fledged three-level network computational scheme. Two important membrane properties are particularly relevant to the underlying mesoscopic processes: membrane thickness and membrane fluidity. 5.1. Localized and delocalized potentials in
biomembranes
Biomembranes consist of two oriented molecular layers of phospholipids. The membrane thickness (about 60 A) is of the same order as the dimension of many macromolecules (for general references, see Refs. 125 and 202). The combination of the membrane thickness and the insulating properties of the phospholipids creates a unique environment for electric fields to modulate the mesoscopic dynamics. Since electric field strength inside a membrane is approximately equal to the transmembrane potential divided by the membrane thickness, a small membrane thickness implies that a hefty electric field can appear inside the biomembrane if a modest electric potential is imposed across the membrane. In addition, an externally applied electric field will appear predominantly across the membrane rather than distributed throughout the cytoplasm primarily because the membrane has a considerably higher resistivity than the cytoplasm. This makes the mesoscopic dynamics exquisitely sensitive to the influence of the electromagnetic fields
18
F. T. Hong
present in the environment. In other words, biocomputing is not immune to the interference of electromagnetic fields. Specifically, many experiments reported in recent decades indicated that some intracellular processes, such as gene transcription, are sensitive to extremely low frequency (ELF) electromagnetic fields (about 100 Hz) (e.g., Refs. 40, 41, 183 and 35). Physiologically, there are two types of electric fields in the membrane: delocalized and localized. A delocalized potential across the membrane is caused by the accumulation of excess mobile ions at the two membrane surfaces. The diffusion potential that appears as a consequence of transmembrane ionic gradients and selective ionic permeability is a delocalized potential. Delocalized potentials can also be generated by the pumping of small mobile ions by an electrogenic ion pump. The electric field associated with a delocalized potential vanishes when the membrane ruptures or when the ionic gradients are dissipated by shunting (electric short-circuiting) of the membrane with ionophores. The localized potential is caused by charges that are attached to the membrane surface or to a macromolecule (membrane-bound or watersoluble). A charged membrane surface exhibits a surface potential. In contrast to the delocalized potentials, the electric field originating from a charged membrane surface does not vanish upon rupture or shunting of the membrane. There are two sources of surface charges in a biomembrane: phospholipids and membrane-bound proteins (including glycolipids and glycoproteins). The polar head-groups of membrane phospholipids are ionizable. Some phospholipids carry negatives charges, and others carry positive charges. Still others, such as lecithin, carry zwitterions, which may exhibit zero, net positive or net negative charges depending on the state of ionization. The hydrophilic domains of membrane-bound proteins also contain ionizable groups such as the carboxylate group of aspartic acid or glutamic acid, and the quaternary ammonium groups of arginine or lysine. The ionization state of surface charged groups are sensitive to pH and the ionic strength of the adjacent aqueous phases. The plasma membrane usually possesses net negative surface charges and exhibits a net negative surface potential in the physiological pH range. As one moves away from the membrane surface, the electric potential varies from a negative value at the surface to zero in the bulk phase where the electroneutrality condition prevails (Fig. 5). Recalling that the electric field equals the negative gradient of the potential profile (E = —dV(x)/dx), a steep slope of the potential profile indicates an intense electric field. The
Bicomputing Survey I
19
Fig. 5. Localized electric potential associated with membrane surface charges. A. The schematic shows a charged membrane surface. The aqueous phase in the double layer region is divided into thin layers, 1, 2, 3, 4, 5. In each layer, the net excess charges are shown. Layer 1 sees the full array of fixed positive charges on the membrane surface and has a higher density of excess negative charges than other layers. Layer 2 sees both the fixed positive surface charges as well as the excess negative charges in layer 1. Therefore, layer 2 has a lower excess negative charge density than layer 1 because layer 1 partially screens the surface charges. Layer 5 sees no net charges because the entire surface charges are screened by the combined layers 1 through 4, and can be regarded as the bulk phase. Complete screening (as shown) is possible only if the Debye length is considerably less than the membrane thickness. Otherwise, the amount of net excess negative charges in the double layer is still less than that of fixed positive charges (incomplete screening). The diagram is highly schematic and is not based on an actual computation. Also the number of ions and their distribution are not meant to be realistic. B. The schematic illustrates the incomplete screening in a diffuse double layer when the membrane thickness is comparable to the Debye length. The two surfaces of the membrane are represented by two vertical lines. Only the left surface carries positive surface charges. The right surface is uncharged (assumed theoretical case). The charge density profile, p(x), shows a single peak of positive charges at the left membrane surface, and two peaks of negative charges, at the diffuse double layers of the two aqueous phases (bottom trace). The electric potential profile, *(a;), is also shown (top trace). Note that a positive surface potential exists at the right interface even though the right surface is uncharged. (B. Reproduced from Ref. 172 with permission; Copyright by American Society for Photobiology)
electroneutrality condition does not hold in the vicinity of the membrane surface, a region known as the diffuse electrical double layer in the electrochemistry literature.383 The thickness of the diffuse double layer is indicated by the Debye length. If all of the net excess charges were imagined to be concentrated as a thin sheet of charges at a distance of the Debye length from the membrane surface, the electric potential difference between the membrane surface and the imaginary sheet of charges would be equal to the surface potential. The Debye length, which is a function of the ionic
20
F. T. Hong
strength, is of molecular dimensions in a physiological solution (less than 5 A). For a given charged membrane surface, the shorter the Debye length is, the steeper the potential profile becomes and the more intense the electric field exists within the double layers. The (effective) electric force in this region has a range of action that is longer than that of covalent bond interactions but is shorter than what is dictated by the inverse square law. It therefore plays an important role in mesoscopic events. Since ions in the diffuse double layers are more freely mobile than charges inside the membrane, a charged interface tends to attract ions of opposite polarity (counter-ions) and to repel ions of the same polarity (co-ions). On the other hand, the concentration gradients formed across the double layers cause the counter-ions to diffuse away from the membrane surface and the co-ions to diffuse towards it. The balance between the concentration gradient-driven and electrical gradient-driven diffusions (of counter-ions and co-ions) results in a slight excess of counter-ions at any location within the diffuse double layer. Qualitatively, this is expected from an overall electroneutrality of the region that includes the membrane surface and the diffuse double layer. At a given location, the electric field is determined by the combined effect of the fixed surface charges and the excess mobile counter-ions in the intervening layer (Fig. 5A). In other words, the electric field generated by the fixed surface charges is partially canceled by the excess counter-ions held in the intervening layer. As the distance from the membrane surface increases, the thickness of the intervening layer increases and, therefore, its cancellation effect also increases. This is the reason why, as one moves away from the surface, the electric field declines faster than expected from the inverse square law. Beyond the Debye length, the electricfieldis hardly detectable. This process is called charge screening. It might appear intuitively evident that the excess counter-ions in the double layers neutralize the net surface charges. In reality, however, the neutralization is incomplete in a biomembrane (Fig. 5B). The unneutralized portion of the surface charges can exert an electric field in the membrane interior as well as in the aqueous phase at the opposite side of the membrane, only to be neutralized by the diffuse double layer there. 172 ' 174 ' 187 As shown in Fig. 5B, a substantial surface potential appears at the opposite interface even if that interface possesses no net surface charges. The transmembrane effect of the surface charges is often overlooked in the membrane biophysics literature. Of course, the surface charges are completely neutralized by the combined excess ions accumulated in the two diffuse double layers. From the above analysis, it appears that the electric field generated
Bicomputing Survey I
21
by a charged membrane surface is highly localized and its effects are not extended beyond the two double layer regions. For example, a surface potential of —100 mV would give rise to an electric field inside the membrane that is comparable to what a diffusion potential exerts across the membrane. This same surface potential also gives rise to an electric field in the adjacent double layer region that is at least just as intense as in the membrane phase. This local electric field has the effect of raising the local (surface) concentration of monovalent counter-ions by a factor of e (where e is the base of natural logarithm, 2.71828) for an increase of every 25.6 mV, at room temperature, compared to the bulk concentration. Thus, for a surface potential of —100 mV, the proton concentration at the membrane surface becomes approximately 50 times the value at the remote bulk region, i.e., the local pH is decreased by 1.7 units compared to the bulk pH. The local electric fields generated by a charged membrane surface have a profound effect on the mesoscopic dynamics. The complexity of such interactions can be appreciated by considering the proton transport in a photosynthetic membrane. One of the essential steps is the binding of protons to the photosynthetic reaction center. Such a process can be viewed as a bimolecular reaction between the reaction center complex, which is membrane-bound, and the proton donor, the hydronium ion, H3O"1", in the aqueous phase: (P)m + (H3O+)ag £ (PH+)m + (H2O)aq where the subscripts m and aq designate the membrane and the aqueous phase, respectively. According to the law of mass action, the two factors that affect the chemical equilibrium of this reaction are the proton-binding constant, K, and the aqueous proton concentration (pH). A decrease of pH and an increase of K both favor proton binding, whereas an increase of pH and a decrease of K both favor the reverse reaction, i.e., proton release. Clearly, the aqueous pH to be considered here is the surface (local) pH instead of the bulk pH. Although the bulk pH is generally buffered and remains constant in time, the local (surface) pH is not. As the reaction progresses and advances, and more and more protons are bound to the membrane, there will be an increase in the magnitude of the positive surface potential or a decrease in the magnitude of the negative surface potential. As a result, the local pH will increase accordingly even if the (bulk) aqueous phase is buffered. The surface potential can, in principle, affect the chemical equilibrium by altering the proton binding constant because a change in the surface
22
F. T. Hong
potential also leads to a change in the intramembrane electric field. Superposition of localized and delocalized potentials can lead to dramatic changes of the electric field inside the membrane (see Fig. 11 of Ref. 285). That the intramembrane electric field is capable of affecting the function of a membrane-bound protein is suggested by two experimental observations. The first example is the use of the 515 nm spectral shift of carotenoids inside the thylakoid membrane of chloroplasts as an indicator of the intramembrane electric field of the chloroplast membrane.212'213 The method is based on the electrochromic effect of carotenoids; the photo-induced charge separation generates a sufficiently intense electric field inside the membrane to cause a significant shift of the absorption spectrum of carotenoids. The second example is an observation made by Tsong and coworkers376-375 who demonstrated that an externally applied AC electric field can supply energy for Na+-K+-ATPase to pump Rb+ across the red cell membrane. These investigators formulated an electroconformational coupling theory to explain their observations (cf. Brownian ratchets11'13'12). Essentially, the electric field inside the membrane affects the ion-binding constants at the two membrane surfaces asymmetrically. Therefore, the energy absorbed during the first half cycle of the sinusoid AC field is not fully canceled by the energy released during the second half cycle. The net absorbed energy in a full cycle is thus utilized to pump Rb+ ions. An alternative interpretation has been considered by Blank.39 He claimed that the AC field alters the surface concentration of the ions periodically, thus leading to enhanced one-way transport of the ions (surface compartment model).38 While the controversy awaits future resolution, the problem highlights the importance of mesoscopic dynamics. Potentials associated with fixed charges at the membrane surface and at the exposed portions of ion channels serve to enhance the rate of transport by increasing the local (surface) concentrations of small ions (cf. Blank's surface compartment model). Consider a superfamily of ligand-gated ion channels (LGIC), of which the cation-selective acetylcholine (ACh) receptor and the anion-selective glycine receptor are two well investigated members. 21>304 Based on an electrostatic calculation, Jordan 209 found that a cluster of negatively charged amino acids at the mouth of ACh receptor significantly increases the local Na+ concentration at the extracellular surface, thus resulting in an increase of the passive Na+ influx. Based on site-directed mutagenesis, Imoto et al. 195 found that the rings of negatively charged amino acids determine the ACh receptor channel conductance. This regulatory function has been attributed to the M2 helical segment of LGIC
Bicomputing Survey I
23
proteins: a cluster of negatively and positively charged amino acids on the M2 segment is believed to be responsible for the cation selectivity of the ACh receptor and the anion selectivity of the glycine receptor, respectively ("selectivity filter"; see, for example, Fig. 2 of Ref. 2). Langosch et al.239 incorporated synthetic M2 segments of the glycine receptor into an artificial bilayer lipid membrane (BLM) and found that the charged residues on the segment critically affect the ion selectivity; exchanges of the terminal arginine residues by glutamate resulted in a significant shift towards cation selectivity of the respective channels, as compared to peptide M2. Galzi et al.123 demonstrated that mutations in the M2 segment converted the ion selectivity of the ACh receptor from cationic into anionic. An electrostatics calculation by Adcock et al.2 shows that other protein domains of the ion channels also play an important role in increasing the local concentration of the permeant ion at the mouth of the transmembrane pore, and in "focusing" the electrostatic field due to the pore per se. There is little doubt that electrostatic interactions are the major determinant of ion selectivity of ligand-gated ion channels. One may wonder how ion concentrations in such an ultrathin double layer (with finite amounts of excess cations) is capable of sustaining the enhanced transport rate without being quickly depleted. It turns out that the time required to establish quasi-equilibrium of ion concentrations in the diffuse double layer is governed by the ionic cloud relaxation time constant:
Tr
~ 2D
where L is the Debye length, and D is the diffusion coefficient. For a typical value for the diffusion constant of small ions, 10~5 cm?/s, the relaxation time constant is 0.5 ns in 0.1 M NaCl (Debye length 9.7 A). Therefore, the enriched surface concentrations of a small inorganic cation can never be depleted by the enhanced transport process. As long as its bulk concentration is maintained constant, any local depletion is replenished almost instantly. The above discussion highlights the exquisite sensitivity of the mesoscopic dynamics to electric field effects from within and from outside. Additional examples will be described to indicate that the mesoscopic effects may be responsible for shaping the control law, making an otherwise random process more deterministic once reactive species get into the range of diffuse double layers in a close encounter.
24
F. T. Hong
5.2. Role of membrane fluidity in the mesoscopic
dynamics
Mitochondria and chloroplasts are two important molecular machines (organelles) that are associated with membranes and require membrane fluidity for their function (for general reviews see Refs. 7, 18, 93, 137, 154, 167, 243, 244 and 335). Both organelles produce the energy-rich compound ATP and both rely on long-distance electron transfers for energy conversion. Mitochondria accomplish the energy conversion from nutrients to chemical energy by oxidation (oxidative phosphorylation). Chloroplasts accomplish the energy conversion from sunlight to chemical energy by reduction (photosynthetic phosphorylation). Energy conversion in both organelles leads to the formation of an electrochemical gradient of protons across the membrane. According to the chemiosmotic theory, 278 the dissipation of the proton gradient is utilized for ATP synthesis by ATP synthase, which is a membrane-bound enzyme residing in both the mitochondrial inner membrane and the thylakoid membrane. Thus, the proton gradient is the intermediate state that stores the converted energy temporarily and that links electron transfer to ATP production. In other words, the energy-rich intermediate is not a specific biomolecule but rather a mesoscopic state. This mode of ATP synthesis is referred to as membrane-level phosphorylation. Before these organelles evolved, phosphorylation was achieved exclusively in the solution phase (substrate-level phosphorylation). In the mitochondrial inner membrane, the energy source is supplied in the form of NADH (nicotinamide adenine dinucleotide, reduced form) or FADH2 (flavin adenine dinucleotide, reduced form), both of which are products of biochemical degradation of carbohydrates or fatty acids. The molecular machine in the mitochondrial inner membrane consists of four protein complexes embedded in the membrane. These protein complexes are not rigidly anchored in the inner membrane but are capable of rotational and lateral (translational) diffusion owing to membranefluidity.Electrons are transferred from NADH to Complex I (NADH dehydrogenase), then to Complex III (cytochrome b-C\ complex) and finally to Complex IV (cytochrome oxidase) (Fig. 6A). In transferring electrons from NADH to O2, a substantial fraction of energy is converted into a transmembrane electrochemical gradient of protons. A separate entry point allows FADH2 to feed electrons to Complex II (succinate dehydrogenase), then to Complex III and finally to Complex IV. The complexes are not connected in a fixed chain-like structural relationship but are loosely connected in the twodimensional space of the membrane, i.e., it is a two-dimensional network.
Bicomputing Survey I
25
Fig. 6. Electron transfers in the mitochondrial inner membrane. A. The schematic shows the NADH dehydrogenase complex (Complex I), the cytochrome b-c\ complex (Complex III), and cytochrome oxidase (Complex V). Mobile charge carriers ubiquinone (Q) and cytochrome c (c) are also shown. B. and C. Docking surface of cytochrome c showing lysine groups for electron transfers from the b-ci complex (B) and to cytochrome c (C). The circles are lysine groups on cytochrome c. The full circles are at the front (with the size indicating closeness to the reader), and the dotted circles are behind the molecule. Stippled circles indicate those lysine groups crucial for electron transfer. When these stippled (positively charged) lysine residues are replaced with residues that are either neutral or negatively charged, the electron transfer is inhibited. These critical lysine groups are protected from acetylation when cytochrome c is docked with the matching complex. (A. Reproduced from Ref. 3 with permission; Copyright by Garland Publishing. B. and C. Reproduced from Ref. 358 with permission; Copyright by Journal of Biological Chemistry)
The coupling of these complexes is accomplished with the aid of ubiquinone (connecting Complex I to III) and cytochrome c (connecting Complex III to Complex IV), which thus serve to delineate the two-dimensional network via their dynamic connections.
26
F. T. Hong
A question arises as to whether cytochrome c links Complex III to Complex IV like an electron "wire" or an electron "shuttle." This question was settled by an experiment in which individual lysine residues on the surface domain of cytochrome c were replaced with neutral residues or negatively charged residues.358'56 The replacement of some lysine residues (open circles in Fig. 6B) has no effect but the replacement of others (shaded circles in Fig. 6B) inhibits electron transfer from the cytochrome b-ci complex to cytochrome c. Similarly, replacement of some lysine residues also inhibits electron transfer from cytochrome c to cytochrome oxidase (shown in Fig. 6C). Apparently, common lysine residues are used during "docking" of cytochrome c either to the cytochrome b-c\ complex or to cytochrome oxidase. As is evident from the comparison of Fig. 6B and Fig. 6C, eight of the lysine residues are common to both processes. Furthermore, several of these lysine groups were shown to be protected from acetylation when cytochrome c was bound either to the cytochrome b-c\ complex or to cytochrome oxidase. Apparently, cytochrome c uses the same surface domain to dock either with the cytochrome b-c\ complex or with cytochrome oxidase. A simple explanation that is consistent with both the replacement and the protection experiments is that cytochrome c acts as an electron "shuttle" rather than as an electron "wire," i.e., the electron path is not "hardwired." These positive charged amino acid residues are strategically located on the surface domain so that the residues match the complementary negative charges on the cytochrome b-c\ complex as well as those on cytochrome oxidase (cf. lock-key paradigm, Sec. 2). The matching charge pairs form the basis of a type of electrostatic interaction known as salt-bridges or ionic bonds. Long-distance electron transfer does not necessarily take place upon a collision of these redox partners; a correct mutual orientation is required in addition to sufficient proximity. Since shape-based molecular recognition seldom allows for a perfect match, matching salt-bridges ensures proper molecular alignment and sufficiently long dwell-times of molecular encounters to allow for long-distance electron transfer to consummate (see Sec. 6.1 for detail). Similar electron shuttles also appear in the photosynthetic apparatus. In cyanobacteria, green algae and green plants, there are two separate photosynthetic reaction centers known as Photosystem I and Photosystem II (Fig. 7). Their three-dimensional structures have been determined at 4 A and 8 A resolution, respectively.232'334'318'299'317 Although these two reaction centers are situated side by side — in parallel — in the thylakoid membrane of the chloroplast, their functional connection is actually in series.
Bicomputing Survey I
27
Fig. 7. Schematic diagram showing the two photosystems of a green plant. The segments of the thylakoid membrane are shown to be juxta-positioned in the appressed region or widely separated from each other at the non-appressed region. The Photosystem I (PS1) together with its antenna complex (LHC-1, light-harvesting complex I) are shown in the non-appressed region, whereas the Photosystem II (PS2) and its antenna complex (LHC-2) are shown in the appressed regions. Plastoquinone (PQ) is the mobile membrane-bound charge carrier that shuttles electrons between PS2 and the cytochrome be-f complex, and shuttles protons from the stromal space (at the top) to the thylakoid space (at the bottom). Ferredoxin (Fd) and plastocyanin (PC) are mobile aqueous electron carriers. The ATP synthase (with two subunits CFo and CFi) are shown in the non-appressed region. Photophosphorylation of LHC-2 leads to the state 1-state 2 transition. (Reproduced from Ref. 18 with permission; Copyright by Blackwell Science)
As shown in Fig. 7, electrons are ejected from excited chlorophyll P680, the reaction center of Photosystem II, towards the stromal space. The "hole" (photooxidized chlorophyll) is then refilled with an electron from water, and an oxygen molecule is concurrently released when four electrons are transferred sequentially. The electrons reaching the stromal side are then passed on to plastoquinone, which is a lipid-soluble mobile carrier similar to ubiquinone in the mitochondrial inner membrane.276 Plastoquinone then carries two electrons together with two protons picked up at the stromal side of the aqueous phase, and shuttles the electrons to the cytochrome 66-/ complex. A similar activity in Photosystem I transports electrons to the stromal side and leaves behind a "hole" in oxidized chlorophyll P700, the reaction center of Photosystem I. An aqueous-borne mobile carrier, plastocyanin (a copper containing redox molecule), then carries electrons from the b^-f complex to the oxidizing end of Photosystem I, and thus refills the "hole." The ejected electron from Photosystem I is then transported across the thylakoid membrane and is eventually picked up by ferredoxin (Fd) at the
28
F. T. Hong
stromal side. Fd is another aqueous mobile carrier that feeds the electron to an enzyme ferredoxin:NADP+ reductase (FNR, ferredoxin:nicotinamide adenine dinucleotide phosphate reductase), thus converting NADP+ into NADPH: 2 Fdred + 2 e~ + NADP+ + 2 H+ «=t 2 Fdox + NaDPH + H+ where NADP+ and NADPH are the oxidized and the reduced form of nicotinamide adenine dinucleotide phosphate, respectively, and Fdred and Fdox stand for the fully reduced and the fully oxidized form of ferredoxin. The two transferred electrons are provided by two molecules of Fdred, and are fed, one at a time to FNR. FNR is a two-electron transfer protein, with a partially reduced/partially oxidized semiquinone state, just like other quinones. NADPH is a reducing equivalent that is used in many biosynthetic processes including the fixation of CO2 and the synthesis of carbohydrates, and thus can be construed as an intermediate energy source. Ferredoxin is a highly negatively charged (acidic) molecule (net charge —14; not shown in the above equation) that contains a single [2Fe-2S] (iron-sulfur) center. In contrast, FNR is a basic (positively charged) protein that contains a non-covalently bonded flavine adenine dinucleotide (FAD) molecule as the cofactor for electron transfers. As expected, the opposite charges on FNR and Fd are involved in docking via electrostatic interactions112 (also see Ref. 282 for a brief summary). The scheme in Fig. 7 implies a 1:1 coupling between the two photosystems. In the actual three-dimensional space, the two systems form a two-dimensional network in the plane of thylakoid membranes and, again owing to membrane fluidity, can be decoupled and operate independently depending on the lighting conditions. This regulatory process, known as the State 1-State 2 transition,286'^7 is implemented by means of the action of a specific membrane-bound protein known as the light-harvesting chlorophyll protein complex (LHC-2). LHC-2 serves primarily as the antenna complex that funnels absorbed photon energy to the Photosystem II reaction center by means of resonant energy transfer. Its second function is the regulation of the State 1-State 2 transition. When the cytosolic side (stromal side) of LHC-2 is phosphorylated, LHC-2 and Photosystem II move laterally, thus becoming decoupled from Photosystem I. These lateral movements are caused by electrostatic interactions.237'19 Maintenance of fluidity of the thylakoid membrane is crucial for the State 1-State 2 transition. Interestingly, there is lateral heterogeneity of membrane fluidity. Photosystem II is
Bicomputing Survey I
29
usually located in the appressed region, which is less fluid, whereas Photosystem I is usually located in the non-appressed region, which is more fluid (see Fig. 7). Examples discussed above serve to illustrate the role of the twodimensional mesoscopic dynamics in process control. Furthermore, the network structure is only partially hard-wired through formation of supramolecular complexes; electron shuttles serve as the loose connections. The hard-wired part provides a top-down constraint, whereas the loose connections make possible a bottom-up process of exploration. This is a recurrent theme that appears in several levels of the nested hierarchical organization of biocomputing (see Sees. 7.6 and 11 of this Chapter and Sees. 3.4, 4.8 and 4.17 of Chapter 2). Membrane fluidity, together with the State 1-State 2 transition, makes a dynamic network connection possible, thus allowing for dynamic allocation of computing resources. It is evident that the mesoscopic dynamics is neither highly deterministic nor highly random. This observation further justifies the adoption of a gray scale of determinism. Superficially, bioenergetics is not biocomputing. However, the supply of energy sources such as ATP critically affects neural signaling processes. How deterministic these bioenergetic processes are certainly influence how deterministic biocomputing is with respect to the gray scale. In contrast, fluctuations of the power supply to a digital computer either has no effect whatsoever on computing (when the fluctuations stay within the tolerable range), or causes the computer to crash (when the fluctuations exceed the tolerable range). 5.3. Electrostatic interactions as a molecular switching mechanism In addition to the formation of ionic bonds, there is yet another electrostatic interaction between small charged molecules or ions, on the one hand, and charged membrane surfaces, on the other hand. Rapid redistribution of small ions in the aqueous phase guarantees a concentration jump of small ions near the membrane surface if the surface charges are abruptly generated or abolished. This feature makes the electrostatic interaction an ideal molecular switching mechanism.175'176'184 The onset of its action is on the nanosecond time scale, which is considerably faster than ionic diffusion in the aqueous phase. The relatively short range of action ensures that the switching process occurs only at a restricted region where the stimu-
30
F. T. Hong
lus is applied, thus minimizing "cross-talks" and preserving the network structure. That the action of photopotential is short-ranged and highly localized has been demonstrated by Sokolov et al.359 in an artificial planar bilayer lipid membrane. These investigators sensitized one of the two membrane surfaces with aluminum phthalocyanine tetrasulfonate. Illumination of the sensitizer caused a localized damage (photodynamic action) at the half lipid-leaflet facing the sensitizer. The following example illustrates the principle of photo-gated and electrostatically controlled switching process. Visual phototransduction is a major molecular switching event during which the stimulating light energy is amplified 100,000 fold. The biochemical process is known as the cyclic GMP (cGMP) cascade: the main biochemical amplification mechanism of visual transduction.362'363'248'190'152'151 Illumination converts the visual pigment rhodopsin into metarhodopsin II (Mil), which is the photoactivated form of rhodopsin that triggers the cGMP cascade. The process starts with binding of inactive transducin (Gt) — a GDP-binding protein or, simply, G protein — to Mil, resulting in the activation of Gt, which, in turn, activates phosphodiesterase, a peripheral protein at the cytosolic surface. Activated phosphodiesterase then hydrolyzes cGMP. The role of cGMP is to keep Na+ channels of the photoreceptor plasma membrane open in the dark. The diminished cGMP concentration following its hydrolysis allows Na+ channels to close, thus constituting the excitation of the photoreceptor. Accompanying the formation of Mil is the appearance of a photoelectric signal known as the R2 component of the early receptor potential (ERP), which was discovered by Brown and Murakami four decades ago.47 Unlike most bioelectric signals, this signal has a submicrosecond rise-time. The conventional wisdom has attributed the ERP to intramolecular charge displacements caused by the conformational change when metarhodopsin II is formed from its precursor, metarhodopsin I (MI), by virtue of an acid-base reaction: Metarhodopsin I + H+ «=± Metarhodopsin II By analyzing the interfacial photoelectric process in terms of the GouyChapman theory of membrane electrostatics, Hong172'173 demonstrated that intramolecular charge displacement is not the only possibility; an interfacial proton binding could, in principle, give rise to a fast photoelectric signal that possesses all the major characteristics of the ERP. Hong also suggested that the appearance of such a fast photosignal is accompanied by a positive-going surface potential change, which may serve as the molecular
Bicomputing Survey I
31
switch that triggers visual transduction. Subsequently, this surface potential was experimentally demonstrated by Cafiso and Hubbell. 52 As is evident in the above reaction scheme, the formation of metarhodopsin II is accompanied by binding of a proton. Schleicher and Hofmann331 attributed this proton uptake to the process of transducin binding to MIL However, by directly measuring the pH of the aqueous phase in a reconstituted system of photoreceptor disk membrane vesicles during rhodopsin photolysis, Ostrovsky and coworkers343'305 demonstrated that such a proton binds to the cytoplasmic surface of rhodopsin (Mil) without the presence of transducin. That is, the generation of Mil alone alkalinizes the cytoplasmic interface, and causes the light-induced surface potential change. By means of FTIR (Fourier transform infrared) spectroscopy, Fahmy105 suggested that the protonation site is a carboxylate at the rhodopsin cytoplasmic surface, thus independently confirming the earlier observation of Ostrovsky and coworkers. In principle, the positive-going surface potential appears in the right place at the right time to initiate visual phototransduction. Hong176 further theorized that the termination of visual transduction may be hastened by a negative-going surface potential at the cytoplasmic side. The deactivation of visual transduction involves mainly the binding of arrestin to MIL Subsequent to the activation of Gt, Mil is phosphorylated by rhodopsin kinase at its C-terminal tail, which faces the cytosol. Nine groups of serine and threonine residues at the C-terminal tail are phosphorylated at the stage of deactivation.390 Thus, a negative-going surface potential appears at the cytoplasmic side where the cGMP cascade takes place. The idea that this negative-going surface potential may be involved in resetting the photoreceptor was shared by Liebman and coworkers,128 who did extensive experimental work to support this view. Until recently, surface potentials have not been seriously considered in elucidation of visual transduction. This might have been due to the fact that most experimental investigations of visual transduction were carried out in the solution phase. Therefore, such a switching mechanism might have been ignored for the following reason. Some investigators presume that all membrane potentials vanish upon rupture of the membrane (personal observation). Since the switching action did take place in a broken membrane preparation, a possible electrostatic mechanism was not suspected to be relevant. However, that membrane potentials cannot exist in a ruptured membrane is an unwarranted generalization. As a matter of fact, localized potentials (such as surface potentials) persisted in a ruptured membrane;
32
F. T. Hong
only delocalized potentials vanish (see Sec. 5.1 and Ref. 187). A detailed discussion mainly based on the analysis of Liebman and coworkers 129 will be given in Sec. 6.4, after a general discussion of molecular recognition. Here, we shall demonstrate that a surface-potential based switching mechanism is physically realistic and mechanistically competent by describing a biomimetic system reported by Drain et al.96 More recently, Rokitskaya et al.321 used the aforementioned phthalocyanine sensitizer to inactivate gramicidin ion channels in a planar bilayer lipid membrane. Drain and coworkers studied the transport of hydrophobic ions, tetraphenyl borate and tetraphenyl phosphonium, in an artificial bilayer lipid membrane system (Fig. 8). These organic ions have larger diameters, and, therefore, smaller Born charging energy than small ions.240 As a consequence, large organic ions partition more favorably into the membrane phase than small inorganic ions. These organic ions are often called hydrophobic ions. An externally applied potential across the membrane causes these hydrophobic ions to drift down the electric potential gradient, and the event can be detected as a transmembrane current. Drain and coworkers incorporated a lipid-soluble pigment, magnesium octaethylporphyrin, into the bilayer lipid membrane and enriched the two aqueous phases with equal concentrations of an electron acceptor, methyl viologen. Illumination with a brief pulse of laser light caused electrons to be transferred from the photoexcited magnesium octaethylporphyrin to the aqueous-borne methyl viologen. As a result, a positive surface potential appeared at each of the two membrane-water interfaces upon illumination (Fig. 8A). Since the electron acceptor methyl viologen was present in equal concentrations on both sides of the membrane, nearly equal numbers of electrons moved from the two membrane surfaces into the two adjacent aqueous phases but in opposite directions, thus generating two equal but opposing photoelectric currents which cancel each other. Therefore, no photovoltaic effect was detected externally. However, the light-induced positive surface potential caused a concentration jump of the negatively charged tetraphenyl borate ion. This effect was detected as a sudden increase of the membrane current carried by tetraphenyl borate ions when a transmembrane potential was applied (Fig. 8B). If, however, the tetraphenyl borate ion was replaced with the positively charged tetraphenylphosphonium ion, a sudden decrease of the membrane current was detected, as expected from a decrease of its surface concentration (Fig. 8C). The switching event demonstrated here is reminiscent of a field-effect transistor. The above examples demonstrate that an electrostatic interaction, if
Bicomputing Survey I
33
Fig. 8. Experimental prototype showing switching of ionic currents, based on lightinduced surface potentials. A. An artificial bilayer lipid membrane contained lipid-soluble Mg octaethylporphyrin (3.6 mM). The aqueous solution contained the electron acceptor methyl viologen (A~), in equal concentrations on both sides (20 mM). Tetraphenyl borate ions, B~, were partitioned into the membrane near the region of polar head-groups. Photoactivation of Mg octaethylporphyrin formed P+, thus generating two symmetrical positive surface potentials. The surface potentials increased the surface concentration of B~, but decreased the surface concentration of tetraphenylphosphonium ions (not shown). B. The ionic current, carried by 1 fJ,M tetraphenyl borate ions, increased 50% upon illumination with a laser pulse (1 us; indicated by the arrow marked with hv). C. The ionic current, carried by 5 mM of tetraphenylphosphonium ions, decreased 25% upon illumination. In both B and C, the spikes preceding the illumination were capacitative transients caused by the application of a transmembrane potential of +50 mV. The steady-state dark current /o was generated by the externally imposed potential. The additional current (the second spike) was generated by light. (Reproduced from Ref. 96 with permission; Copyright by National Academy Sciences)
it appears or vanishes rapidly, may serve as an ideal switch-based control mechanism. Of course, the above-demonstrated effect is not the only way that an electrostatic interaction can exert a switching action. For example, protonation of rhodopsin may cause local rearrangement of non-covalent bonds, thus leading to a conformational change and exposing critical transducin binding groups (see Sec. 6.4 for detailed discussion).
34
F. T. Hong
5.4. Lateral mobility of protons on membrane surfaces: the "Pacific Ocean" effect There is a long-standing controversy regarding the bioenergetic process of membrane-level phosphorylation. As described briefly in Sec. 5.2, membrane-level phosphorylation relies on the conversion of externally supplied energy into a transmembrane proton gradient via long-distance electron transfers. The coupling of the proton gradient to ATP production requires lateral movement of protons from the electron transfer site to the phosphorylation site. Yet, the chemiosmotic theory implies that the photon energy conversion process allows protons to be dumped into the vast extracellular space. Thus, the major fraction of transported protons is dispersed to the bulk solution phase of the extracellular space. There are two conceivable effects. First, the transmembrane proton gradient will be diminished by the buffering capacity of the solution phase. Second, the remaining "free" protons diffuse and disperse throughout the bulk phase. Although the dispersed protons are not forever lost, they must be retrieved by reversing the buffering reaction and by diffusion from the bulk phase back to the double layer region, before the protons can be used for ATP synthesis. Both processes cause some free energy to be dissipated as heat, thus resulting in an unacceptable loss of converted free energy. This objection against the so-called delocalized chemiosmotic theory is referred to as the "Pacific Ocean" effect, and has been extensively debated.394 Partial alleviation of the problem is accomplished by the convoluted extracellular space between the plasma membrane and the cell wall (known as the periplasmic space in photosynthetic bacteria) and between the outer and inner membrane of a mitochondrion ("San Francisco Bay" effect?). The small (intra)thylakoid space in a chloroplast corresponds to the extracellular space because thylakoid membranes are inverted membranes (insideout orientation). The extracellular space of a mitochondrion is the small space between the mitochondrial outer and inner membranes (intermembrane space; Fig. 6A). Thus, the "Pacific Ocean" effect may not be as dramatic as suggested by the opponents of the (delocalized) chemiosmotic theory; the space into which protons are pumped is smaller than implied by the opponents. Still, the coupling process seems rather inefficient and unnecessarily awkward. The rival "localized" chemiosmotic theory392'393'395 requires that protons be preferentially channeled to the phosphorylation site either through an internal membrane route or through a pathway provided by a proton
Bicomputing Survey I
35
network on the membrane surface. Kell224 suggested that the interfacial region (Stern layer) is separated by a diffusion barrier that keeps most of the converted protons in this adjacent layer and thus preferentially diverts protons to the phosphorylation site. Such preferential proton lateral mobility has subsequently been demonstrated by Teissie and coworkers in phospholipid monolayers371'370'369 and in pure protein films,122 and by Alexiev et al.4 in the purple membrane of Halobacterium salinarum. Teissie and coworkers detected rapid lateral movement of protons on a phospholipid monolayer-water interface by a number of measurements: fluorescence from a pH indicator dye near the membrane surface, electrical surface conductance, and surface potential. These investigators found that the conduction of protons along the surface is considerably faster than proton conduction in the bulk phase (2-3 minutes vs. 40 minutes for a comparable distance in their measurement setup). This novel conduction mechanism is proton-specific, as has been confirmed by a radioactive electrode measurement as well as by replacement with deuterated water. The conduction mechanism is truly mesoscopic because it is present only in the liquid expanded (fluid) state of the monolayer but disappears in the liquid condensed (gel) state. It is a consequence of cooperativity between neighboring phospholipid molecules; the conduction mechanism disappears when phospholipid molecules are not in contact with each other. Teissie and coworkers suggested that the enhanced lateral proton movement occurs along a hydrogen-bonded network on the membrane surface in accordance with a mechanism previously proposed by Onsager303 for proton conduction in ice crystals. The hydrogen-bonded network is formed by the polar head-groups of phospholipids and the associated ordered water molecules at the membrane surface. Thus, a proton jumps from H 3 O + to a neighboring H2O. The newly formed H 3 O + then rotates and becomes a new proton donor to its neighbor farther down the chain in the network. As a result, protons move considerably faster on the membrane surface than expected by classical diffusion. The importance of the integrity of the hydrogen-bonded network was demonstrated by Fisun and Savin.111 These investigators simulated the long-range proton transfer along the hydrogenbonded chain that is formed by amino acids containing OH groups, and found that the replacement of the L-amino acid residues by the corresponding D-isomers in a peptide chain suppresses proton transport through the network. In fact, a similar mechanism has been used to explain proton diffusion in the bulk phase, which is considerably faster than the diffusion of ions of comparable size in the same medium. Therefore, the "hop-and-
36
F. T. Hong
turn" mechanism enhances proton movement both at the interface and in the bulk phase. So what makes the lateral proton movement on the membrane surface so much faster than proton diffusion in bulk water? I think that there are at least two reasons. First, the proton movement at the membrane surface is two-dimensional, whereas the movement in bulk water is three-dimensional {reduction-of-dimensionality principle of Adam and Delbriick.1) It is true that simple diffusion in a two-dimensional space is faster than in a three-dimensional space according to the probability theory. It may also be true for the "hop-and-turn" mechanism. The second reason may be the increased surface concentration of protons as compared to the bulk concentration caused by a negative surface potential (see Sees. 5.1 and 5.3). The negative surface potential is primarily due to the net negative surface charges of the phospholipid polar head-groups. The increased concentration at the surface makes the "hop-and-turn" mechanism work better along the surface than in bulk water. Teissie's group has shown that there is indeed a steep gradient near the membrane surface (2 pH units in less than 1.5 nm). However, these authors also observed similar facilitated lateral proton movement with monolayers formed from neutral and zwitterionic phospholipids. Therefore, the effect of a negative surface potential is probably secondary and supplementary but not essential. In summary, a special mechanism of the mesoscopic dynamics serves the purpose of containment of randomness. Protons which are pumped across the membrane need not search for the site of ATP synthase randomly and waste time (and energy) wandering into the bulk solution phase (aqueous phase beyond the Debye length) senselessly — it is a heuristic search instead of a random search. The question raised by the "Pacific Ocean" effect thus finds a satisfactory answer. 5.5. Role and specificity of phospholipid polar head-groups The phospholipid polar head-groups serve at least two purposes: a) to provide hydrophilicity for stabilizing the bilayer configuration of biomembranes, and b) to provide the hydrogen-bonded network for efficient proton lateral mobility. Neither of these functions require much of the head-group specificity. Thus, the diversity of head-groups suggests additional functions that may require head-group specificity. We shall examine a head-groupdependent process that modulates the activity of protein kinase C.295 Protein kinase C (PKC) is a ubiquitous protein that plays a crucial role in signal transduction and in protein targeting.191 Receptor-mediated hy-
Bicomputing Survey I
37
drolysis of phosphatidyl inositol bisphosphate (PIP2), which is initiated by extracellular signaling, generates two second messengers: a) inositol triphosphate (IP3, water-soluble, negatively charged), and b) diacylglycerol (lipid-soluble). Inositol triphosphate, in turn, mobilizes intracellular Ca2+, causing PKC — a peripheral protein initially located in the aqueous environment of cytosol — to bind to the plasma membrane, where it becomes activated. The activation of PKC appears to be partly electrostatic in nature (Fig. 9). The process can be conveniently divided into two stages. The first stage appears to be the electrostatic interaction between PKC and an acidic membrane (negatively charged head-group) in the presence of Ca2+. This step is sensitive to ionic strength and surface charges, and is accompanied by a global conformational change of PKC. The first stage can also be induced by nonspecific acidic phospholipids. In contrast, the second stage is a highly specific interaction that requires both diacylglycerol and phosphatidyl serine (PS), a negatively charged phospholipid. It is also insensitive to increasing ionic strength. The specific interaction induces a local conformational change that exposes the pseudosubstrate domain (which carries multiple positive charges) of PKC, which is further stabilized by binding to any acidic lipid (electrostatic interaction). The interaction between PKC and PS is cooperative. The PS dependence of PKC activity exhibits a steep sigmoidal kinetics (cf. hemoglobin cooperativity, Sec. 7.3). The interaction is highly specific. Negative charges and the amino group configuration of PS are important, since partial activation can be achieved by other phospholipids that have similar amino group functionality or negative charges at the polar head-group region. It is also highly stereo-specific (D-serine ineffective) and configuration-specific (L-homoserine ineffective). The binding of diacylglycerol is a prerequisite for PKC activation (stoichiometry 1:1); it increases the affinity of PKC for PS and is responsible for induction of the specificity and the cooperativity of PS binding. Strict stereospecificity is required of the structure of the diacylglycerol backbone and ester linkages to the fatty acids. However, the requirement of fatty acid acyl side-chain specificity is less stringent; only sufficient hydrophobicity of the acyl groups seems relevant. Ca2+ is required for some isozymes of PKC, but not for others. The underlying mechanism remains to be elucidated. Thus, electrostatic interactions are invoked twice in PKC activation: first as the homing device to help PKC target acidic membranes, and second as part of the allosteric mechanism to produce the catalytic activity. The
38
F. T. Hong
Fig. 9. Model for the interaction of protein kinase C (PKC) with phospholipid headgroups. A. In the first step, electrostatic interactions drive PKC to bind to acidic lipids (middle). This binding results in a conformational change that exposes the hinge region of PKC. B. The second stage of activation is rather specific. Diacylglycerol (DG) promotes cooperativity and specificity in the protein-lipid interaction and causes a marked increase in the affinity of PKC to phosphatidyl serine (PS), thus resulting in a PSdependent release of the pseudosubstrate domain from the active site and activation of PKC. (Reproduced from Ref. 295 with permission; Copyright by Annual Reviews)
first stage represents a rather general mechanism shared by the association of coagulation proteins with anionic membranes,85 as well as binding of synapsins to acidic membranes.30 In Sec. 5.3, we have postulated a similar homing mechanism for visual transduction: a photo-induced positive surface potential triggers the binding of a peripheral protein, transducin. The difference here is that the surface charges are photo-induced on the membrane-bound protein rhodopsin rather than on the phospholipid (which is not light-sensitive). The plausibility of this mechanism is also suggested by the following investigation about thyrotropin-releasing hormone (TRH). Colson et al.69 demonstrated that the binding of TRH to the receptor is not merely mediated by a process of random collisions, but rather by an elaborate two-step gradient-like process (cf. Sec. 6.1). The docking process involves the formation of an initial recognition site between TRH and the surface of its receptor. TRH may then be guided into the transmembrane binding pocket by fluctuations in
Bicomputing Survey I
39
the extracellular loop of the receptor. The activation of PKC serves as an excellent example showing how an electrostatic mechanism can make a lock-key paradigm work more deterministically and efficiently. By first "locking onto" the membrane surface, the searching for the target molecule is transformed from three-dimensional random searching to less random two-dimensional searching (reduction-ofdimensionality principle; cf. proton lateral mobility, Sec. 5.4). 5.6. Effect of transmembrane diffusion potentials and compartmentalization The efficiency of membrane-level phosphorylation discussed in Sees. 5.2 and 5.4 is further enhanced by additional mesoscopic mechanisms. Consider the following reaction, which is catalyzed by ATP synthase: ADP +Pi^
ATP
where Pi stands for inorganic phosphate. As the reaction proceeds in the forward direction, the ATP concentration will increase and the ADP concentration will decrease. Both changes of concentration will decrease the forward reaction rate and increase the reverse reaction rate. Eventually, the (net) forward reaction will come to a halt when chemical equilibrium is reached. In accordance with the law of mass action, the equilibrium can be shifted to the right by the following mechanisms. First, there is a transporter system (antiporter) that moves ADP into and ATP out of the matrix space of the mitochondria.297'378 Of course, both actions favor continuation of the net forward reaction and more ATP will be formed and exported. Second, the transmembrane movement of ADP and ATP is further assisted by the existence of a transmembrane diffusion potential (inside negative polarity) which favors the exit of ATP (containing three negatively charged phosphate groups and being transported as ATP4~) more than the exit of ADP (containing two phosphate groups and being transported as ADP3~) (pp. 159-164 of Ref. 297 and pp. 212-213 of Ref. 378). The equilibrium of the exchange is affected tenfold for each 60 mV of membrane potential. Again, this example demonstrates the role of membrane and electrostatic interactions in making the intracellular dynamics more deterministic. This example also illustrates the effect of compartmentalization: keeping biomolecules in appropriate compartments to make biochemical processes more deterministic than possible in a homogeneous solution phase.
40
F. T. Hong
5.7. Vesicular transport, exocytosis and synaptic transmission A general mechanism is employed by cells to deliver synthesized biomolecules to targeted subcellular compartments, e.g., from the endoplasmic reticulum to the Golgi apparatus. Essentially, the same mechanism is also utilized to export biomolecules to the extracellular space by exocytosis. Synaptic transmission depends on an exceptionally rapid process of exocytosis, upon cuing by an arriving action potential at the axonal terminals, i.e., neurotransmitter release. Not only is the process far more deterministic than purely random diffusion, but the destination is also reasonably assured by means of specific molecular recognition. Basically, the scheme is known as the SNARE hypothesis.360 Experimental evidence in support of the hypothesis has begun to surface at a rapid rate in recent years140'203' 126,272,205,48 ( see a l s o Chapter 35 of Ref. 364). SNARE is a widely used acronym, standing for soluble iV-ethylmaleimidesensitive factor attachment protein receptors. iV-ethylmaleimide-sensitive fusion factor (NSF) is a molecule that is required for the fusion of vesicles to another membrane; W-ethylmaleimide blocks the fusion process by alkylating sulfhydryl groups of NSF. Attachment of NSF to the vesicular membrane is a prerequisite for its fusion with another membrane. NSF itself is an ATPase; ATP binding is necessary for membrane attachment, whereas ATP hydrolysis is required for release. The latter process needs the help of additional cytosolic proteins, called SNAPs (soluble iV-ethylmaleimide-sensitive factor attachment proteins), which recognizes the receptor on a membrane. Thus, SNAREs are SNAP receptors. SNAREs are further classified into two categories: u-SNAREs, which are present in the vesicular membrane, and i-SNAREs, which are present in the target membrane. Recognition of the target membrane by a particular vesicle requires that the w-SNAREs match the i-SNAREs, in a "cognate" fashion (cognate SNAREs). The assembled u-SNAREs/£-SNAREs complex consists of a bundle of four helices.119 For example, synaptobrevin94 is a u-SNARE that is present on the surface of synaptic vesicles, whereas syntaxin is a f-SNARE that is present on presynaptic plasma membranes; the fusion is triggered by a rising cytosolic Ca2+ concentration as a consequence of membrane depolarization. The mutual recognition of these cognate SNAREs is absolutely required for rapid neurotransmitter release. The requirement of fairly specific complementary pairings of v-SNAREs and t-SNAREs has been demonstrated in reconstituted systems.272
Bicomputing Survey I
41
Just how specific are these cognate docking processes? Specificity arises from the availability of "cognitively" different u-SNAREs and i-SNAREs. There are enough different w-SNAREs and £-SNAREs to make targeting somewhat deterministic. However, it turns out that the destination targeting is not absolutely accurate. A vesicular cargo, of endoplasmic reticulum (ER) origin, that is destined for the Golgi complex could have fused with the plasma membrane, were it not for the proximity factor. The proximity factor makes the encounter of ER-derived vesicles with the Golgi membrane more likely than with the plasma membrane. 329 Thus, vesicle-targeting is deterministic but not absolutely deterministic (relatively deterministic). The accuracy of vesicle targeting is safeguarded by imposing several layers of constraints sequentially. The situation is similar to the problem-solving process described by Boden, in which a large number of constraints must be met en masse but none is individually necessary: each constraint "inclines without necessitating" (p. I l l of Ref. 42; cf. Sec. 4.21 of Chapter 2). The processes described above are also utilized in exocytosis of secretory granules, and in synaptic transmission. Yet, vesicular fusion in synaptic transmission is far more rapid than in exocytosis of secretory granules. Apparently, special mechanisms have evolved to ensure the high speed fusion required for synaptic transmission; exocytosis at synapses is orders of magnitude faster than in other secretory systems. Synaptic vesicles are not randomly distributed in the cytoplasm of axonal terminals. Rather they are organized and concentrated near specialized areas of the presynaptic membrane called "active zones."203 Regulatory mechanisms include tethering and binding of Rab GTPase proteins. 388,134,273 Synaptic vesicles can be pre-positioned at designated portions of target membranes by long tethers extending from the membranes. Distinct sets of tethering and vesicle-bound Rab proteins are used for different target membranes. Rab proteins are active only when GTP is bound. There are additional peripheral proteins associated with nerve terminals. Phosphorylation of these proteins, such as synapsin I, modulates the synaptic efficacy and, therefore, the synaptic plasticity.379'140'163 There are two pools of synaptic vesicles: a reserve pool that is tethered to the cytoskeleton and not immediately available for release, and a releasable pool that is immediately available. Dephosphorylated synapsin I links synaptic vesicles in the reserve pool to the actin-based cytoskeleton, and also exerts an inhibitory constraint on fusion (with the plasma membrane) of the vesicles in the releasable pool. The phosphorylation state of synapsin I increases under all conditions that promote the Ca2+-dependent release of neurotransmitter
42
F. T. Hong
molecules, such as the arrival of the action potential or Jf+-induced depolarization. However, the mechanism of synapsin I action is not as well established as the cognate SNARE pairing for vesicle docking. Classical studies based on measurements of synaptic potentials suggested that neurotransmitters are released in quantal packets after complete fusion of synaptic vesicles with the plasma membrane218 (Sec. 8). However, Neher290 thought that this classical picture presented a wasteful scheme because the fused vesicular membrane would have to be retrieved for recycling only a short moment after complete fusion. Recent evidence based on electrophysiological studies and atomic force microscopy suggests that the vesicles fuse with the plasma membrane only transiently, forming fusion pores and releasing only part of the content. For reviews see Refs. 234 and 206. The above example illustrates how both shape-based and switch-based processing in the microscopic dynamics are linked to the mesoscopic switching process that, in turn, leads to the macroscopic switching process. In other word, both shape-based and switch-based processing are utilized in synaptic transmission; the process is thus more deterministic than implied by simple shape-based processing alone. 6. Shape-Based Molecular Recognition Conrad's version of the lock-key paradigm stipulates that macromolecules recognize each other by complementary shape matching like a lock and key, via random diffusion and collisions. Such a simplified mechanism of shapebased molecular recognition is problematic in the solution phase (intracellular dynamics). The recognition process will be slow and inefficient for the following reasons. Macromolecules must find each other by random diffusion and collisions in a three-dimensional space. In the event of a random collision, the encountering molecules can be deflected from each other, just as rapidly as they approach each other, because of their linear momenta. The contact dwell-time, the duration of the period during which the encountering partners remain in close contact, may not be sufficiently long to ensure consummation of a chemical reaction. To make matters worse, a chemical reaction between two highly asymmetric macromolecules requires proper orientation because the reactive site often occupies a small area relative to the entire macromolecular's exposed surface. Thus, a pair of macromolecules with complementary shapes may not match like a key and lock for immediate docking upon collision since it would be like throwing a key
43
Bicomputing Survey I
at the keyhole from a considerable distance; an additional adjustment for mutual re-orientation is often required prior to recognition. Re-orientation by means of rotational diffusion (rotational Brownian motion) can be a slow process because of the size of a macromolecule. Since the reaction rate of many enzymes is diffusion-limited (encounter-limited),108 searching for the correct docking orientation must be a rapid process; additional mechanisms may be involved in making shape-based recognition more deterministic and efficient. Nature solved this problem by evolving mechanisms for homing, transient complex formation and docking of reaction partners, by recruiting short-range non-covalent bond interactions. The lock-key paradigm is thus made more deterministic, and therefore more efficient, than a plain shapefitting scheme. A strong causality is often achieved by means of intermixing shape-based and switch-based mechanisms, some of which are nevertheless energy-consuming. Conversely, a switching mechanism often requires the lock-key paradigm for its functioning. For example, enzyme activation is often accomplished by binding an activator via the allosteric effect.281 This topic was recently reviewed by Hong.188 The discussion will be recapitulated here. 6.1. Role of short-range non-covalent bond interactions molecular recognition
in
It is instructive to examine the docking process of cytochrome c and mitochondrial inner membrane complexes (Figs. 6B and 6C). The recognition involves primarily a small number of matching ionic bonds. Furthermore, the lock-key matching is not unique: cytochrome c utilizes two nearly identical sets of ionic bonds to dock with the cytochrome b-c\ complex and with cytochrome oxidase. Thus, shape-fitting in macromolecular recognition is only approximate, and the geometric shapes of the two docking sites are not precisely complementary to each other. Apparently, perfect shapefitting in molecular recognition is neither desirable nor necessary. As we shall see, pattern recognition in cognitive problem solving is useful only if imperfect patterns can also be recognized (fault tolerance; cf. Sec. 4.2 of Chapter 2). Likewise, molecular recognition is functionally useful only if perfect shape-fitting is not required. The requirement of perfect shapefitting would make molecular recognition an unacceptably slow process. Also, perfect shape-fitting tends to make the complex much too stable to be able to come apart subsequently. In other words, perfect or near-perfect
44
F. T. Hong
shape fitting confers an affinity (to the encountering partners) that is too high to make molecular recognition functionally useful. Molecular recognition is determined in part by shape-matching and in part by the matching of specifically aligned ionic bonds, hydrogen bonds, van der Waals contacts, and hydrophobic interactions. The docking process is achieved by minimizing the combined potential energy of all shortrange non-covalent bond interactions, and is equivalent to settling at the potential-energy minimum of the free energy landscape (cf. Sec. 7.5). These non-covalent bonds are weaker than covalent bonds. However, depending on the total number of bonds, together they are sufficiently strong to overcome dislodging by thermal agitation. Again, in Boden's words, each constraint "inclines without necessitating."42 The non-covalent bonds exert their collective effect by acting en masse. The van der Waals forces, which are nonspecific, require close proximity of atoms (3-4 A) for its action. These forces contribute to the stability of complex formation but require close shape-match to exert effect. Hydrophobic forces are also non-specific and confer no polarity of bonding. As we shall see, a docking cavity is often lined with hydrophobic amino acid residues. Hydrogen and ionic bonds, however, possess "directionality" and require matching parts with opposite polarities, just like Velcro (registered mark) fasteners' loops and hooks. These bonds thus confer some specificity on molecular recognition. However, as indicated by the action of cytochrome c, the specificity is not absolute and unique. Since these bonds are not highly specific, a "false" (imperfect or incorrect) match can occur with fewer, "accidentally" aligned, hydrogen or ionic bonds, thus settling in a local potential-energy minimum. However, a false match helps trap the encountering molecules and allows them to form a transient complex. As a result, the contact dwell-time is significantly increased and a threedimensional searching process is converted into a two-dimensional one for the global potential-energy minimum (reduction-of-dimerisionality principle). The reduction-of-dimensionality effect has been observed in a Brownian dynamics simulation of cytochrome c and cytochrome c peroxidase complex formation.302 The specificity of the correct docking position is provided by the pattern formed collectively by the geometric distribution of these bonds at the interface of the two complexing molecules. In other words, the complementary shape of the docking site, which often looks like a cavity in the larger one of the two partners, helps define the bond distribution pattern and, hence, its specificity. The shape of the docking cavity affects the distance between
Bicomputing Survey I
45
the matching recognition sites. The shape of the docking cavity matters because, with the exception of electrostatic interactions, the non-covalent bond interactions are extremely short-ranged (no more than a few A). Is two-dimensional searching for the correct docking position purely random? Not necessarily. In operations research and human problem solving, approaching the task by trial and error and by examining every possible way is simply not realistic. This is because the number of possibilities rapidly increases beyond bound as the complexity of the problem increases (a situation known as combinatorial explosion). A typical example is provided by the enormous number of possible moves, countermoves, countermoves against countermoves, etc., in a chess game when a player tries to outsmart the opponent and searches for a strategic move by planning ahead at a search depth of several levels (or, rather, plies — half moves) (see Sec. 4.3 of Chapter 2). Even IBM supercomputer Deep Blue, which defeated world chess champion Garry Kasparov in 1997, could not afford to explore the search space exhaustively294 (see Sec. 5.18 of Chapter 2). Therefore, selective searching based on explicitly prescribed rules of thumb or heuristics often allows a problem to be solved in a reasonable length of time, whereas an undirected or trial-and-error search would require an enormous amount of time, and often could not be completed in a human lifetime. The approach is known as heuristic searching in cognitive science and operations research.351'353 Searching in molecular recognition and other biocomputing processes cannot be readily quantified as in chess games, but the implication of combinatorial explosion is no less alarming. As we shall see, Nature was perfectly capable of evolving additional mechanisms which are increasingly deterministic so as to avoid random searching. Variation in the number of hydrogen or ionic bonds permits fine-tuning of the overall bonding strength by evolution. Protein conformations offer virtually unlimited variations of the shape of contact surfaces. The variation in shape allows for variation in geometric distributions of non-covalent bonds. Thus, in principle, a gradient of bonding strengths could be evolutionarily arranged and a cascade of local minima could be evolutionarily constructed to guide the two-dimensional searching process towards the global minimum instead of away from it (biased twodimensional random searching or heuristic searching). This speculative idea is illustrated by a simple diagram which shows the matching of non-covalent bonds (Fig. 10). For simplicity, the bond polarity and the shape-factor of the
46
F. T. Hong
matching surfaces are ignored in the schematic diagram.13 When two (flat) matching surfaces are sliding over each other, down the potential-energy gradient, the initial match involves only one or two matching bonds, then three bonds, and finally all seven bonds. In reality, all of the non-covalent bond interactions are involved. Furthermore, the shape-factor modulates the interactions because non-covalent bond formation requires the proximity of matching sites. The validity of the "gradient" strategy is supported by the following observations. A steering effect based on a two-step strategy has been reported by Colson et al.69 A simulation of the free-energy landscape for two complexing proteins, reported by Camacho et al.,55 showed that electrostatic interactions have a steering effect toward the correct mutual orientation in some cases, whereas desolvation energy (hydrophobic interaction) serves as an attracting and aligning force in other cases. As will be shown in Sec. 7.6, protein folding also exhibits a gradient strategy. Figure 10 shows a steering effect that arises from a preexisting gradient of increasing non-covalent bond interactions. An additional steering effect can take place at a greater distance than is possible to form ionic or hydrogen bonds because the electrostatic force does not suddenly vanish but rather tapers off gradually, albeit at a rate that is still faster than predicted by the inverse square law due to charge screening (Sec. 5.1). Two clusters of charges on two separate molecules can interact electrostatically at a considerably greater distance than possible for other types of non-covalent bond interactions because the collective magnitude of the clustered charges may be sufficiently large to make the force, though attenuated by distance and charge screening, still felt at a distance of more than just a few A. However, the cluster of charges has to be regarded as a point source of charges under this circumstance. This is because the distance of separation between individual charges in the same cluster is small compared to the distance between the two macromolecules. Every charge on a macromolecule is of about equal distance to any charge on its docking partner at a large distance. Therefore, the detailed charge distribution pattern on its surface cannot be recognized by its docking partner at such a distance. This type of electrostatic interaction shall be referred to as global electrostatics. In contrast, when the partners are within a few A apart, each charged residue experiences mainly the attraction of another charged residue that is wellb
The design of the diagram is flawed, as will be discussed in Sec. 6.13 of Chapter 2. However, the flaw does not invalidate the argument presented in this section.
Bicomputing Survey I
47
Fig. 10. A gradient strategy of molecular recognition. A. The schematic diagram shows that any initial imperfect match between two encountering macromolecules locks them together, while the gradient of bonding strengths guides the two encountering molecules to find the "intended match" by means of free energy minimization. Here, the shape factor is ignored, and the search for docking is restricted to one dimension for simplicity. Only one type of non-covalent bond interaction, such as ionic or hydrogen bonding, is considered and the bond polarity is disregarded. The sequence shows unidirectional sliding, but in reality the two encountering molecules slide against each other back and forth in Brownian motion. B. The free energy landscape is therefore represented by a numbers of peaks, which depict bonding at one, two, three and seven sites. The initial search is conducted by means of two-dimensional random diffusion and collisions. When the two encountering parties slide along each other, some local peaks (i.e., local minima in the free energy landscape) of 2- and 3-site bonding are reached. The gradient was evolutionarily constructed so that the gradient guides the search towards the ultimate 7-site bonding. If the two molecules continue to slide in the same direction and overshoot their goal, the number of matching sites will decrease to 3 and 2 (separated by some onesite matches). If thermal agitation dislodges the two molecules from the global minimum, the gradient will "discourage" the two encountering molecules from sliding away from each other, thus prolonging the dwell-time of the encounter. On the other hand, thermal agitation prevents the encountering molecules from being trapped at any of the local minima. (Reproduced from Ref. 188 with permission; Copyright by CRC Press)
aligned to form a complementary pair together; attractions or repulsions due to other charged residues that are not aligned are weak by comparison (charge pairing). It is the pairing of complementary charges that helps define the specificity of the correct docking position. This type of electrostatic interaction shall be referred to as local electrostatics. Of course, other types of non-covalent bond interactions and the shape of the matching docking
48
F. T. Hong
sites also contribute to the local specificity. In particular, hydrogen bonding provides another means of pairing for local specificity. As we shall see, mobile electron carriers often exhibit an asymmetry of charge distribution on its exposed surface so as to form an electric dipole. The interaction of two encountering electric dipoles thus helps align the two approaching partners for preferred mutual orientation prior to a collision. This type of interaction must be distinguished from interactions that form bonafideionic bonds. The dipole-dipole interaction does not require charge pairing.
Thus, electrostatic interactions are invoked twice: for the purpose of homing (oriented collision) and for the purpose of defining the specificity of transient complex formation (docking). It is often referred to as long-range interactions in the biochemistry literature even though it is mesoscopic in origin and it operates at a shorter range than what is dictated by the inverse square law, as explained in Sec. 5.1. The homing action during the first stage of activation of PKC belongs to this type of steering effect (Sec. 5.5). In some cases, complementary shape-fitting takes place only after the substrate is bound to the enzyme (Koshland's231 concept of induced fit; e.g., binding of glycyltyrosine to carboxypeptidase A, see Figs. 8.14 and 9.25 of Ref. 364). In this case, a transient complex of the two encountering partners must form prior to the consummation of the reaction (cf. Type III electron transfer mechanism of Hervas et al.159) The search in the free energy landscape for a complementary match in molecular recognition is therefore similar to the search in the evolutionary fitness landscape: evolution to a new adaptive state by a given organism often alters the fitness landscape (see Sec. 3.4 of Chapter 2). In Fig. 10, interactions other than electrostatic interactions and hydrogen bonding are ignored. The choice was not based on its relative importance among various types of non-covalent bond interactions but was rather motivated by the ease of designing such a diagram (see Sec. 6.13 of Chapter 2 for a discussion of top-down designs). Electrostatic interactions are important mainly as the initial complex formation and crude alignment but are not the sole determinant for the final orientation in an electron transfer reaction. Other types of interactions, such as hydrophobic interactions, are often called upon tofinalizethe docking process, as was demonstrated in the interaction of the following redox partners: plastocyanin and cytochrome / complex (of the cytochrome b$-f complex),100 cytochrome ce and Photosystem I, 279 and ferredoxin and FNR (ferredoxin:NADP+ reductase).193'265
Bicomputing Survey I
49
In fact, direct measurements of the ionic strength dependence of intracomplex electron transfer rate constants for several redox partners, such as yeast or horse cytochrome c-cytochrome c peroxidase, spinach ferredoxinFNR, and bovine cytochrome c-cytochrome c oxidase, have demonstrated that electrostatic forces are not the sole determinant of optimal electron transfer rates (reviewed in Ref. 373). At low ionic strengths, the electrostatic interactions are enhanced but the redox pairs are "frozen" into a non-optimal electrostatically stabilized orientation. This is in part because charge pairing is not highly specific and false matches are common. Excessive electrostatic interactions distort the delicate balance among various types of non-covalent bond interactions and increase the chance of trapping the redox partners in a local minimum, thus preventing them from reaching the global minimum in the free energy landscape. Additional experiments were performed to cross-link redox-pairs at low ionic strengths and lock the pairs into electrostatically stabilized complexes. In all systems examined, which included cytochrome c-cytochrome c peroxidase, flavodoxin-FNR,c and cytochrome c-cytochrome c oxidase, electron transfer rate constants were actually smaller for the covalent complex than for the transient complex formed upon collision at the optimum ionic strength. Apparently, a certain degree of flexibility of the docking process is required to allow for exploration of the optimal orientation. In other words, short-range interactions between the docking partners should be sufficiently strong to link them together so as to increase the contact dwell-time but not so strong as to inhibit two-dimensional explorations for the optimal orientation. Perhaps the transient complexation that involves several mobile electron carriers serves to illustrate the nuance of molecular recognition. 6.2. Molecular recognition between ferredoxin and FNR We shall first consider the interactions between FNR and its redox partners: ferredoxin (Fd) and NADP + . A ternary complex consisting of Fd, FNR and NADP+ has been studied.22'23 It was proposed that a transient ternary complex involving Photosystem I, Fd and FNR could be formed.380 More recently, a complex of Fd and FNR was crystallized.282 The complex is biologically relevant because the structure agrees with what has been inferred from studies in the solution phase. The two proteins can co-crystallize only c
Flavodoxin is an electron carrier, synthesized by cyanobacteria to replace ferredoxin, under a condition of iron deficiency.
50
F. T. Hong
with a molar excess of FNR over Fd, resulting in a ternary complex consisting of two reductases (named FNR1 and FNR2) and one Fd molecule. Fd is bound to a hydrophobic cavity provided by FNR1. The Fd [2Fe-2S] cluster is 7.4 A distant from the exposed C8-isoalloxazine methyl group of the cofactor FAD of FNR1, which is sufficiently close to enable effective fast electron transfers. In contrast, Fd makes a contact with FNR2 at the site where NADP+ is physiologically bound. The Fd iron-cluster is too far from the FNR2-FAD (14.5 A) to enable a fast electron transfer. Therefore, the complexation between Fd and FNR2 is probably a crystallographic artifact; the role of FNR2 could be to stabilize crystal packing by contacts with neighboring proteins. Morales et al.282 pointed out that the interactions between Fd and FNR1 are far more specific than those between Fd and FNR2, as indicated by the following pairs of data: the number of hydrogen bonds and ion pairs (10 vs. 3), van der Waals contacts (< 4.1 A) (54 vs. 21), and buried area upon complex formation, i.e., cavity (1600 A2 vs. 1100 A2). The molecular electric dipoles of Fd and FNR1 are nearly colinearly orientated, resulting in the negative pole of Fd being close to the positive pole of FNR1.296 Additional arguments in support of the biological relevance of the Fd-FNRl pair of the ternary crystal complex can be found in an important article by Gomez-Moreno and coworkers.282 Gomez-Moreno and coworkers have extensively analyzed the effect of site-directed mutagenesis of FNR and/or its redox partners. Charged amino acids were replaced with neutral or amino acids with reversed charge polarity (and sometimes with concurrent side-chain elimination). These investigators found that some charged amino acids are absolutely critical for electron transfers, whereas replacements of other nearby residues have either moderate or no effect. For example, Phe65 and Glu94 on Fd are required for efficient electron transfers between Fd and FNR (Fig. 1A of Ref. 192). In contrast, nearby residues Glu95, Asp67, Asp68 and Asp69 play significant but less dominant roles in maintaining an appropriate protein-protein orientation (Fig. 1A of Ref. 192). These investigators suggested that charge pairing (ionic bonds) involving Glu94 is apparently important for maintaining a productive orientation — ionic bonds for docking — for electron transfers. The exact role of the aromatic residue Phe65 is not certain but is more likely involved in docking (hydrophobic interaction) rather than in the electron transfer pathway. Similarly, a cluster of hydrophobic residues (Leu76, Leu78, and Vall36) on FNR was found to be critical for electron transfers
Bicomputing Survey I
51
between FNR and Fd, but not between FNR and NADP+.265 Likewise, alterations of several basic residues on FNR that line the Fd-binding cavity (Lys75, Lysl38, Lys290 and Lys294) also caused significant impairment of electron transfer between Fd and FNR, but the affinity of FNR for NADPH did not seem to change (NADPH binds to the opposite side of FNR) (see Fig. IB of Ref. 132). An appreciation of the spatial relationship of the two docking partners is facilitated by viewing the stereoscopic structure of Fd and FNR on Fig. 1 of Ref. 132 or Fig. 1 of Ref. 192. A critical role was confirmed for ArglOO on FNR for the FNR-NADP+ interaction, whereas Arg264 is not critical.264 However, the mutant R264E (charge-reversal; positive Arg to negative Glu) showed an altered behavior in its interaction and electron transfer with Fd and flavodoxin. Here, it should be pointed out that ArglOO is near the binding pocket of FNR for NADP+, whereas Arg264 is near the binding pocket of FNR for Fd (see Figs. 1 and 6 of Ref. 264, respectively). In summary, there are two classes of amino acid residues: one involved in critical alignment of docking for electron transfers, and the other involved in crude orientation or transient complex formation. Those involved in critical docking alignment tend to be different for the two substrates, Fd and NADP+, which are bound to opposite sides of FNR. Finally, hydrophobic clusters usually lined the binding cavity and are critical for electron transfer. The situation with plastocyanin and cytochrome c§ to be presented next is similar; the two independent sets of data demonstrate a common design scheme for redox partners of long-distance electron transfers. 6.3. Comparison of plastocyanin and cytochrome c& We shall now consider two mobile electron carriers that feed electrons from the cytochrome b@-f complex to the oxidizing end of Photosystem I: plastocyanin and cytochrome c$ (see Sec. 5.2 for a brief description). In green plants, copper-containing plastocyanin is the sole mobile electron carrier between the cytochrome b$-f complex and Photosystem I. Cyanobacteria and green algae, under the condition of a low copper concentration, can synthesize an alternative heme-containing mobile carrier, cytochrome c$, to replace plastocyanin. 62>289 De la Rosa and coworkers159 compared the structures and functions of these two electron carriers in two cyanobacteria (prokaryotes), Synechocystis and Anabaena, in a green alga (eukaryote) Monoraphidium and in spinach chloroplast (eukaryote). These investigators found three different types of reaction mechanisms of the Photosystem I re-
52
F. T. Hong
duction: Type I (oriented collisional reaction mechanism), which involves an oriented collision between the two redox partners; Type II (a minimal two-step mechanism), which proceeds through the formation of a transient complex prior to electron transfer; and Type III, which requires an additional rearrangement step to make the redox centers orientate properly within the complex. Cytochrome c§ and plastocyanin are quite different in their chemical structures. Their redox centers are heme and copper, respectively. The /?sheet structure of plastocyanin is absent in cytochrome CQ , which has several a-helices instead. However, there is analogous surface topology in these two mobile proteins. Both proteins feature a north hydrophobic pole around the redox center (Site 1), and an east face with charged groups (Site 2). The north pole is important in electron transfer, whereas the east face is important for orientation during the interaction of these proteins with Photosystem I, but is not directly involved in electron transfer. As expected from their equivalent roles, the east face of plastocyanin and that of cytochrome CQ are both acidic, or both basic. In cyanobacterium Synechocystis, both proteins contain an acidic patch at Site 2: the equivalent charges are Asp44 and Asp47 in plastocyanin and Asp70 and Asp72 in cytochrome C6, respectively. When these charges were reversed by site-directed mutagenesis (e.g., plastocyanin mutants D44R and D47R, in which the respective negatively charged aspartate was changed to positively charged arginine), the electron transfer reaction was retarded but not abolished.d The ionic strength dependence became the opposite of the wild type, i.e., the electron transfer rate was increased with increasing ionic strengths. Kinetic analysis revealed that the interactions followed the simple oriented collision (Type I). Apparently, these charged amino acids are not involved directly in the docking of the redox partners but are responsible for the generation of an electric dipole. This electric dipole helps orient the mobile electron carrier with the correct orientation towards the binding site on its redox partner (global electrostatics). There was no evidence of transient complex formations in the interactions of Photosystem I and wildtype or mutant plastocyanin, such as D44R and D47R. The exception was the double mutant D44R/D47R (see later). The prokaryote Anabaena presents a different scenario. Site 2 of both plastocyanin and cytochrome c§ are positively charged. However, the function of Site 2 in plastocyanin is similar in Anabaena and Synechocysd
D and R are single-letter codes for aspartic acid and arginine, respectively.
Bicomputing Survey I
53
tis. Alterations of these charges by site-directed mutagenesis (e.g., D49K, K58A, K58E) alter the surface-potential profile, thus allowing plastocyanin to modulate its kinetic efficiency of electron transfer: the more positively charged, the higher the rate constant.280 Similar changes took place when the positively charged patch of cytochrome c§ of Anabaena was altered by site-directed mutagenesis at Lys62 or Lys66.279 Kinetic analysis by laser flash absorption spectroscopy indicated that these charges in plastocyanin and cytochrome c$ are involved in the formation of a transient complex (Type III mechanism). Some mutations at the east face changed the kinetics to either Type I or Type II. Alterations of charges in the east face modulate the electron transfer rate without completely abolishing electron transfer, whereas alterations of charges at the north hydrophobic region are critical. Arg88 (adjacent to the copper ligand His87) in plastocyanin and Arg64 (close to the heme group) in cytochrome c6 are required for efficient electron transfers.279'280 These charges form part of the binding pocket and are critical for proper orientation of the redox partners. In eukaryote green alga Monoraphidium braunii, both plastocyanin and cytochrome c$ contain an acidic east face and both proteins exhibit a prominent electric dipole moment.114 The reaction mechanism of electron transfer belongs to Type III: an additional arrangement is required after the formation of a transient complex. The postulated rearrangement can be either a conformational change of the induced fit type or elimination of water from the hydrophobic pocket (desolvation, involving reorganization energy, as stipulated by Marcus262), or a two-dimensional random walk, as stipulated in the reduction-of-dimensionality principle,1 or both. As expected, cytochrome / (of the cytochrome 6 6 -/ complex) also possesses an electric dipole moment; its docking surface with plastocyanin or cytochrome CQ is negatively charged.114 In summary, studies of the structure-function relationships in the interactions of plastocyanin/cytochrome CQ and their redox partners reveal the evolution of reaction mechanisms.159 The north hydrophobic region is the cavity for lock-key style docking, whereas the east face is the site responsible for electrostatic interactions for mutual orientation and/or transient complex formation. In prokaryote Synechocystis, electrostatic interactions are invoked as a homing mechanism. The distribution of individual charges is not critical. The electron transfer process is made more deterministic by a proper orientation prior to collision (Type I). The overall electric dipole moment helps orient the mobile carrier via long-range electrostatic
54
F. T. Hong
interactions. The Type II mechanism then evolved to increase the contact dwell-time of the redox partners. In prokaryote Anabaena, eukaryote Monoraphidium and higher plant, the reaction mechanism evolved to three steps: long-range electrostatic interactions for homing, a possible two-dimensional search or conformational rearrangement to refine the docking alignment, which requires shape fitting, and a final step of electron transfer. The mechanism of heuristic searching in molecular recognition is thus a product of evolution rather than an inherent feature of molecular interactions. 6.4. Molecular recognition of transducin and arrestin Let us now resume the discussion of visual transduction in the context of molecular recognition, which was introduced in Sec. 5.3. Three major proteins are involved in the initiation and termination of visual transduction: rhodopsin, transducin and visual arrestin. Rhodopsin belongs to a large family of molecules known as G protein receptors that are characterized by seven transmembrane a-helices. One of the partners, transducin (Gt), belongs to one of the most important classes of molecules in signal transduction: GTP-binding proteins (G proteins; e.g., see Refs. 131 and 66). Visual arrestin is also a member of a large family of molecules that are involved in the deactivation of G proteins. Like other G proteins, inactive transducin is a heterotrimer consisting of three subunits: Ga (which has a GTPase domain that binds a molecule of GDP and two switch regions that initiate a major conformational change, once activated by its receptor), G/3, and G7. Photoactivated rhodopsin — i.e., metarhodopsin II, or Mil — binds the inactive transducin heterotrimer, triggers the switch regions, and causes the bound GDP to be released and a fresh GTP molecule to be bound to Ga. The GDP-GTP exchange then causes the three subunits of transducin to dissociate from metarhodopsin II and from one another, thus activating transducin and forming Ga-GTP and G/?7. The activated Ga-GTP then triggers the cGMP cascade, as described in Sec. 5.3. Subsequent hydrolysis of the bound GTP in Ga then reassembles the three subunits into the inactive transducin heterotrimer. The cGMP cascade is a nonlinear system that greatly amplifies the action of an absorbed photon on rhodopsin. Sitaramayya and Liebman357 demonstrated that the termination of the cGMP cascade requires phosphorylation of rhodopsin. The phosphorylation of photoactivated rhodopsin is catalyzed by rhodopsin kinase356 and takes place at the C-terminal region where nine serine and threonine residues are phosphorylated.390 Phospho-
Bicomputing Survey I
55
rylation of rhodopsin reduces249'235 or even blocks355 Gt activation. This inhibitory effect is greatly enhanced by arrestin,33 which binds specifically to phosphorylated MIL235'332 The investigations of molecular recognition between rhodopsin and its two reaction partners in the cGMP cascade were greatly facilitated by the elucidation of the crystal structures of rhodopsin,306 transducin300'386'238 and arrestin.138'168 Using site-directed cysteine mutagenesis to place crosslinkers on rhodopsin, Khorana and coworkers53'199 identified the contact sites of the photoactivated rhodopsin-transducin transient complex. Ga are cross-linked at residues 310-313 and 342-345 at the C-terminal region, which had previously been known to be the receptor-binding domains,44'148 and at residues 19-28 of the JV-terminal region; both the C- and iV-terminal regions are in contact with the third cytoplasmic loop of photoactivated rhodopsin, which has been postulated to be the site that binds Gt.113 The AT-terminus of Ga and the C-terminus of G7 are relatively close together. Both are sites of lipid modification, and are likely to be the sites of membrane attachment. The region around Glul34-Argl35-Tyrl36 on helix II of rhodopsin is surrounded by hydrophobic residues and is known to bind Gt.306 However, this region is buried in the ground state rhodopsin and is in no way to make contact with Gt. Therefore, this region must become exposed in the photoactivated rhodopsin via a conformational change. Definite conclusions regarding the docking of Gt with Mil must await the elucidation of the crystal structure of photoactivated rhodopsin-transducin complex. The C-terminal of Mil is crucial for arrestin binding and rapid deactivation of the cGMP cascade, as could be demonstrated by abnormally prolonged responses in a rhodopsin mutant of which 15 amino acid residues at the C-terminal region were truncated.60 The truncated segment is apparently not needed for Gt binding and activation.60'356'275 This C-terminal segment of rhodopsin is most likely the initial recognition site but not the ultimate binding site of arrestin, since excess Gt displaces arrestin from phosphorylated rhodopsin. Gt, which binds to both phosphorylated and nonphosphorylated Mil, apparently competes with arrestin for the same binding site.235 Arrestin undergoes a conformational change after binding to the C-terminal of phosphorylated MIL313'144'139 This change exposes a critical buried region of arrestin that enables it to bind to a second binding site on phosphorylated Mil, which also binds Gt competitively. This interpretation is supported by an experiment with a synthetic peptide that mimics the C-terminal tail of phosphorylated MIL This synthetic peptide
56
F. T. Hong
comprises the fully phosphorylated C-terminal phosphorylation region of bovine rhodopsin, residues 330-348 (known as 7P-peptide).313 This peptide binds to arrestin, induces a conformational change that is similar to that induced by binding to phosphorylated Mil, and activates it. Furthermore, this activated arrestin can then bind to photoactivated but nonphosphorylated rhodopsin, i.e., nonphosphorylated Mil. Thus, an electrostatic mechanism is implicated in at least the initial binding of arrestin to the phosphorylated C-terminal of MIL However, the multiple phosphate groups apparently do more than just provide negative charges since synthetic peptides in which all potential phosphorylation sites were substituted with glutamic acid (7E-peptide) or with cysteic acid (7Cya-peptide) did not mimic the negative charge of phosphorylated amino acid residues.271 Evidence of electrostatic effects came from kinetic analysis of the complexation between Gt and Mil and between arrestin and MIL Investigations of the kinetics of rhodopsin-arrestin complexation were hampered by the similarity of the absorption spectra of free Mil, MII-Gt complex and MH-arrestin complex; they all have an absorption maximum at 390 nm; the three forms of Mil are not spectroscopically distinguishable. Since there exists an acid-base equilibrium between MI and Mil, binding of Gt shifts the equilibrium to the right, by virtue of the law of mass action, thus stabilizing highly phosphorylated Mil as a MII-Gt complex.102'103 Similarly, binding of arrestin stabilizes phosphorylated Mil as a Mll-arrestin complex.332 Both complexation processes increase absorption at 390 nm. The situation is further complicated by the finding that phosphorylation increases the MI-MII equilibrium constant.127'128 Thus, the equilibrium of MI-MII is shifted to the right for two reasons: the change of the equilibrium constant and the effect of product removal. As a consequence, the relative proportions of free Mil and its two complexed forms cannot be directly measured spectrophotometrically. These enhanced portions of Mil formation are known as extra-metarhodopsin II. Parkes et al.307 subsequently developed a nonlinear least-square curvefitting procedure (Simplex) to sort out the three forms of Mil amidst three concurrent equilibria. Using this approach, Gibson et al. 129 found that the binding affinity of Gt to Mil is dependent on ionic strengths, with maximum affinity at 200 mM. The affinity decreases toward both higher and lower ionic strengths. Similar ionic strength dependence was found for the binding affinity of arrestin to Mil, at various phosphorylation levels. The decrease of affinity at high ionic strengths is consistent with the effect of charge screening, but the decrease at lower ionic strengths is not. Gibson
Bicomputing Survey I
57
et al.129 attributed the decrease to the possibility of two separate binding processes: binding to Mil and to the photoreceptor membrane. However, similar decreases have been observed in several mobile electron carriers in photosynthetic membranes; there is no compelling evidence to postulate an additional binding site on the photosynthetic membrane. In view of the ubiquity and possible universality of this type of ionic strength dependence among mobile electron carriers in photosynthetic membranes and in the spirit of Ockham's razor, we favor, instead, the interpretation, proposed by Tollin and Hazzard,373 that excessive electrostatic stabilization of a docking complex hampers further interactions between the complexed partners by inhibiting exploration. This is especially relevant since there appears to be two separate stages of arrestin binding to Mil; an excessively stabilized complex of arrestin with the C-terminal binding site of phosphorylated Mil would interfere with its binding to a second site. Tollin and Hazzard's interpretation is further justified by additional independent evidence suggesting that protein flexibility may be a universal necessity in macromolecular reactions. Garbers et al.124 studied the electron transfer from negatively charged semiquinone Q^* to oxidized quinone QB in Photosystem II (see Fig. 7). These investigators found that the extent of re-oxidation of Q^* starts to decrease below 275°K and is almost completely suppressed at 230°K. Detailed analyses of Mossbauer spectra measured at different temperatures in 57Fe-enriched samples indicated that the onset of fluctuations between conformational subsets of the protein matrix occurs also at around 230°K. They suggested that the head-group of plastoquinone-9 (a membrane-bound mobile electron carrier) bound to the Qs-site in Photosystem II requires a structural reorientation for its reduction to the semiquinone. The kinetic analysis of Gibson et al. also showed that Gt affinity for Mil decreases with increasing phosphorylation, whereas arrestin affinity for Mil increases almost linearly with increasing phosphorylation. The data were also consistent with the assumption of 1:1 binding stoichiometry for GtMII and for arrestin-MII. The reciprocal fashion of the phosphorylation dependence of Gt and arrestin binding affinity is in keeping with their respective roles as the activator and the deactivator of the cGMP cascade, thus reflecting Nature's way of optimization by means of concurrent modulation of the two binding processes. The incremental change for each added phosphate indicates that the switches of visual transduction are not simple on-off switches but are similar to the kind of rotary switch (incremental switch) that allows for continuous adjustment of the brightness level of a
58
F. T. Hong
lamp.389 Despite the similarity of affinity changes, the (second-order) binding rates of Gt and arrestin are different at equal concentrations. The kinetics of Gt binding to Mil at 0.6 /xM Gt are exponential with a relaxation time constant near 1 s, whereas arrestin binding to Mil at 0.6 fiM arrestin is much slower, with a relaxation time constant of more than 20 s. 129 This disparity of kinetics allows for a window of time for Gt to take action before deactivation prevails, thus avoiding shutting down the process prematurely. Although phosphorylation does not cause global conformational changes of Mil, local changes that include changes of the membrane surface potential and the membrane surface pH may affect the binding kinetics of both Gt and arrestin.128 As explained in Sec. 5.1, the increased negativity of the membrane surface potential lowers the surface pH relative to the bulk pH. The ensuing lowering of pH can affect the protonation state (ionization state) of exposed charged amino acid residues in two possible ways: increasing reactant (proton) availability by virtue of the law of mass action and the direct effect of pH on the binding constant. The resulting change of the protonation state of charged amino acid residues at the membrane surface further changes the membrane surface potential. The interaction is therefore highly nonlinear. Using the nonlinear least squares fitting scheme, Gibson et al.129 determined the pH dependence of the respective binding affinity of Gt and of arrestin to Mil at various levels of Mil phosphorylation. They found a phosphorylation-dependent shift in the pH maximum for the binding affinity of Gt. The Gt affinity for nonphosphorylated Mil peaks at pH 8, whereas the pH for the maximum binding affinity shifted to the alkaline values with increasing phosphorylation and became immeasurably high at 4.1 PO-4/Rhodopsin or higher. This shift was more apparent than real because the shift disappeared if the binding affinity was plotted against the surface pH instead of the bulk pH. Thus, the Gt-MII interaction depends directly on the membrane surface pH. The maximum Gt affinity now peaks at the membrane -surface pH of 7.5 at all levels of phosphorylation. Gibson et al.129 also determined the pH dependence of the binding affinity of arrestin to Mil, at various levels of Mil phosphorylation. The affinity of arrestin for Mil increases more or less linearly with pH up to pH 8.5, beyond which no data were available because of technical difficulty. The arrestin binding kinetics is also pH-dependent. With increasing pH or decreasing phosphorylation levels, the speed of arrestin binding decreases, so that the reaction does not reach equilibrium in time between flashes of il-
Bicomputing Survey I
59
lumination. The effect of phosphorylation on the arrestin binding kinetics is also mediated via its electrostatic effect on the membrane surface pH, according to the analysis of Gibson et al. Considerably more specific local electrostatic interactions may be involved in arrestin action, as suggested by a model for the rhodopsin phosphorylation dependence of arrestin binding.168'384'385 The model suggests that the negative phosphate charges on the C-terminal tail of Mil destabilizes a series of salt bridges and hydrogen bonds in the polar core of arrestin (switch region), which has a strongly positive local electrostatic potential, thus causing the conformational change of arrestin upon its activation. The recognition of Mil by Gt and by arrestin apparently belongs to a Type III mechanism designated by Hervas et al.159 (transient complex formation with molecular rearrangement). Both Gt and arrestin undergo major conformational changes after initial binding. Furthermore, arrestin eventually binds to a second site that is close to or identical to the binding site of Gt. There are several sequences of contiguous cationic amino acids in arrestin, which can be identified as positively charged patches near the iV-domain of arrestin,138'168 the proposed rhodopsin binding site (see also Fig. 11A of Ref. 129). The key residue Argl75 in the so-called polar core of arrestin allows arrestin to distinguish between phosphorylated and nonphosphorylated rhodopsin.144'139 The complementarity of charge pairing is apparent. The putative binding surface of Gt is mostly negatively charged, with some small patches of positive potentials (Fig. 11B of Ref. 129). Hamm149 pointed out the overall charge complementarity between the cytoplasmic surface of rhodopsin (positively charged residues Lys248, Lysl41 and Argl47) and the receptor-binding surface of Got (negatively charged residues Asp311 and Glu212) (see Fig. 2 of Ref. 149). The charge distribution on the surfaces of Gt and that of arrestin do not suggest the presence of a sufficiently strong electric dipole moment to lead to oriented collisions. However, judging from the contrast of the overall negative surface of Gt and the patchy positive surface of arrestin, we suspect that the membrane surface potential may play an additional role in making the encounter of the partners more deterministic via long-range electrostatic interactions (homing mechanism). The largely positive cytoplasmic surface of rhodopsin favors attraction of Gt but not arrestin (see Fig. 2 of Ref. 149). The additional positive surface potential generated by the ERP (R2 component) probably adds little to the already positive potential. The electrostatic interactions caused by the ERP are probably local in nature. However, its role in triggering Gt binding cannot be completely
60
F. T. Hong
ruled out. The membrane surface potential subsequently turns in favor of arrestin binding; the dramatic buildup of negative surface charges brought about by phosphorylation is probably sufficient to overshadow the positive surface charges that have originally been present on Mil prior to phosphorylation, thus activating a homing mechanism for arrestin. Of course, as suggested by Gibson et al.,129 the opposite surface potentials can also influence the affinity of both proteins to Mil (short-range electrostatic interactions). Their interpretation is supported by the data showing that the affinity of arrestin for Mil increases linearly with pH between pH 7.0 and 8.5,129 and that the negative photoreceptor membrane surface potential also increases linearly within this same pH range.128 In summary, the interactions between rhodopsin and its two partners, transducin and arrestin, echo the general scheme of interactions of mobile electron carriers, discussed earlier in this section, despite the differences in terms of structures and functions. Again, Nature deployed short-range non-covalent bond interactions to make collisions and reactions between encountering partners more deterministic than random processes. Nature also orchestrated the sequence of events with appropriate timing. When the interactions between Gt and Mil need to be more deterministic, the interactions between arrestin and Mil are made more random. Conversely, when the interactions between arrestin and Mil need to be more deterministic, the interactions between Gt and Mil are made more random, all by means of the intricate interplays of the same set of fundamental forces. During visual transduction, electrostatic interactions are invoked in a number of different mechanisms: local and global, nonspecific and specific. Nature seemed to recruit whatever mechanisms that are workable, in a highly flexible way, and did not stick to any particular "ideological" scheme. On the other hand, highly successful schemes were evolutionarily multiplied and perpetuated in different systems in the same organism and among different species of organisms, as exemplified by the huge family of G protein receptors and their partners, G proteins and arrestins. 6.5. Electronic-conformational
interactions
An alternative explanation for the enhancement for the docking speed was proposed by Conrad in terms of electronic-conformational interactions: the quantum speedup principle.79'80'81 In this formulation, the effect stems from the quantum mechanical superposition principle as a result of perturbative
Bicomputing Survey I
61
interactions between non-Born-Oppenheimer electrons and atomic nuclei. Conrad claimed that the interaction has a self-amplifying character, thus leading to ordered conformational motions. Conrad further claimed that the superposition of wavefunctions provides a kind of parallel processing. Furthermore, this process enhances docking speed via an electronic analog of Brownian motion. According to the quantum speedup principle, superposition effects in the electronic system provide a search mechanism for macromolecules, in addition to the use of thermal (Brownian) motion, to explore each other's surface feature.81 Note that the gradient strategy mentioned above is based on short-range non-covalent bond interactions that are also quantum mechanical in origin. However, there is an important difference. Whereas Conrad's quantum speedup principle is a pure physical effect, the gradient strategy is a "product" of evolution. An examination of the interactions between the mobile electron carrier plastocyanin and its redox partner cytochrome / or Photosystem I (PsaF subunit) offers crucial insights into the mechanisms of speeding up of the microscopic dynamics. The general view is that the interactions evolved from a randomly oriented collision (Type I) mechanism in prokaryotes, to binding by electrostatic complementarity in eukaryotes.114'159 Electrostatic complementarity is believed to be achieved by a pair of adjacent negatively charged zones that are conserved in eukaryotes. However, this is not merely a speculative interpretation commonly found in evolutionary arguments. De la Cerda et al. 91 studied site-directed mutagenesis of plastocyanin from a cyanobacterium Synechocystis. These investigators found that, like the wild-type plastocyanin, most mutants of plastocyanin react with the Photosystem I PsaF subunit by following a simple collisional kinetic mechanism, with one exception. The double mutant D44R/D47R of plastocyanin follows a reaction mechanism involving not only a complex formation with PsaF but also further reorientation to properly accommodate the redox center prior to electron transfer (Type III), as is the case in eukaryotes.159'160 This experiment demonstrated that it is realistic to acquire speedup of reactions by structural changes via evolution. Speedup of electron transfer could be acquired through evolution rather than a nonspecific quantum mechanical property of macromolecules. 7. Intracellular and Intramolecular Dynamics The mesoscopic phase refers to the membrane phase and its vicinity roughly defined by the Debye length. Outside of the Debye length is the bulk phase.
62
F. T. Hong
The intracellular dynamics refers to biochemical reactions taking place in the bulk phase of the cytosol or other subcellular compartments such as the matrix of the mitochondria. The intramolecular dynamics refers to the internal dynamics of a macromolecule (conformational dynamics). 7.1. Electrostatic interactions a macromolecule
between a small molecule and
Some biomolecules are too small for shape-matching. However, electrostatic interactions between such a molecule and a macromolecule still play an important role via different mechanisms. Water-soluble macromolecules contain charged groups at their exposed hydrophilic domains and can be treated as polyelectrolytes. The charges on the surface domains prevent aggregation and precipitation of macromolecules in the solution phase. These surface charges give rise to a zeta potential on the surface of macromolecules, and an intense but short-ranged electric field at the external border of the macromolecules for the same reason elaborated in Sec. 5.1. If a small molecule carries charges with polarity opposite to that of a macromolecule with which it is reacting, its local concentration within the range of the encounter will be greatly increased. The electrostatic effect thus makes encounters of small charged molecules with their target macromolecules more deterministic than simple diffusion in the absence of electrostatic effects. A detailed computer simulation of Brownian dynamics of the diffusion of a small negatively charged substrate superoxide radical towards an active site of enzyme superoxide dismutase340 showed that the focusing of electrostatic lines of force towards the active site may guide the diffusion of the superoxide radical towards the active site (cf. gradient strategy in Fig. 10). In this simulation, both the detailed geometric shape of the protein and the accurate description of its electrostatic potential were considered. It was revealed that the electric field of the enzyme enhances the association rate of the anion by a factor of 30 or more. On the other hand, the enhancement of local concentrations of other macromolecules surrounding a particular (central) macromolecule is less pronounced because macromolecules have an increased ionic cloud relaxation time as a result of the decreased diffusion coefficient (see the formula in Sec. 5.1). It is well known that Ca2+ and cyclic AMP, which carry net positive and negative charges, respectively, are second messengers. These second messengers act intracellularly as allosteric effectors. By binding to their target proteins, these second messengers can alter the conformation of the
Bicomputing Survey I
63
target proteins. In addition, activation and inactivation of many proteins are implemented by means of phosphorylation and dephosphorylation. For example, cyclic AMP exerts its effect primarily by activating cyclic AMPdependent protein kinase. The latter enzyme, in its active form, catalyzes the transfer of a phosphate group from ATP to serine or threonine residues in a protein, thus phosphorylating it. Since phosphorylation and dephosphorylation are effective ways of changing the charge density at the surface domain of a protein, I suspect that many regulatory processes mediated by second messengers may be based on electrostatic interactions. Of course, the regulatory mechanisms initiated by phosphorylation are far more complex than the above electrostatic analysis indicates. Exactly how much is due to electrostatic interactions and how much is due to shape-based matching is rather complicated to sort out. The topic of phosphorylation will be treated in detail in Sec. 7.2. There is yet another regulatory role a small divalent cation such as Ca2+ can play in the intracellular dynamics. Multi-valent ions are much more effective in charge screening than monovalent ions such as Na+ and K+. The effect of a trace amount (micromolar range) of Ca2+ is comparable to that of Na+ in the millimolar range (e.g., see Refs. 284 and 285). Thus, Ca2+ is very effective in modulating electrostatic interactions between macromolecules. Of course, Ca2+ has another powerful regulatory role to play via the activation of calmodulin. This latter action of Ca2+ tends to overshadow its charge screening effect. Ca2+ and Mg2+, which have an equivalent role in charge screening, often exhibit opposite physiological effects. Factors other than electrostatic interactions are concurrently at work, e.g., specific binding. Thus, control of the intracellular Ca2+ concentration can be used directly or indirectly to activate a switching process, e.g., muscle contraction and neurotransmitter release. Of course, controlling the intracellular Ca2+ concentration can be a switching process by itself. The cell maintains a steep (free) Ca2+ concentration gradient across the plasma membrane, as well as across the membranes of the intracellular sequestrating compartments, such as the sarcoplasmic reticulum (1 mM vs. 0.1 /iM). This gradient is maintained by active Ca2+ transport (requiring hydrolysis of ATP). The switching function is implemented by means of opening and closing of Ca2+ channels in these membranes. Note that the "turning on" step depends on passive diffusion of Ca2+ down its electrochemical gradient (toward the cytosolic compartment), and is therefore rapid and cost-free — it is tantamount to taking an energy "loan." In contrast, the "turning off" process
64
F. T. Hong
requires active transport of Ca2+ to the extracellular medium or the intracellular compartment of the endoplasmic reticulum (sequestration), and is, therefore, a slower process than "turning on," and is not cost-free — it is "loan" payback time. Surface charges of macromolecules also affect intermolecular interactions by a non-specific mechanism: osmosis. The osmotic effect is secondary to the presence of electrical double layers. As explained above, the presence of surface charges alters the concentrations of small ions (relative to the bulk aqueous phase) in the gap (electrical double layers) between the interacting macromolecules, thus creating an osmotic pressure there.197 This electrostatic double-layer force, as is referred to in the protein chemistry literature, decays exponentially with the distance, as explained in Sec. 5.1. 7.2. Effect of
phosphorylation
Protein phosphorylation is the most common regulatory mechanism in both the mesoscopic and the intracellular dynamics. It regulates metabolic pathways, gene transcription and translation, ion channels and membrane transport, muscle contraction, light harvesting and photosynthesis, synaptic processes, learning and memory, to name a few. Of particular relevance to biocomputing is the role of phosphorylation in synaptic processes (Sec. 5.7) and memory (Sec. 9). The cyclic AMP responsive element binding protein (CREB) is a nuclear protein that may be a universal modulator of processes required for memory formation.347 The crucial event in the activation of CREB is the phosphorylation of Serl33 in the P-Box, or kinase-inducible domain.133 In eukaryotic cells, reversible phosphorylation is catalyzed by protein kinases (for phosphorylation) and phosphatases (for dephosphorylation). Signal transduction in prokaryotes is also mediated by phosphorylation.45 It is instructive to examine how phosphorylation and dephosphorylation actually regulate protein functions. This topic has been reviewed by Johnson and Barford207 and the discussion presented here follows theirs closely. Phosphorylation exhibits a multiplicity of effects. In some enzymes, phosphorylation changes the surface properties that affect self-association or recognition by other proteins (electrostatic and/or steric hindrance effect). In others, phosphorylation may promote conformational changes at domains that are remote from the site of phosphorylation (allosteric effect). Here, we shall illustrate phosphorylation mechanisms in molecular detail by citing rabbit muscle glycogen phosphorylase as an example be-
Bicomputing Survey I
65
cause it exploits all the above-mentioned mechanisms made available by phosphorylation. Other examples which exploit only part of the available mechanisms will also be briefly mentioned. Glycogen phosphorylase exists in an inactive/low affinity T state as the nonphosphorylated phosphorylase b (GPb). Its activation is accomplished by transfer of a phosphate group from Mg2+-ATP to a serine residue, Serl4 (residue No. 14, counting from the iV-terminus), via the catalysis of phosphorylase kinase (another enzyme). Phosphorylation at Serl4 converts GPb into phosphorylase a (GPa), its active/high affinity R state. Shown in Fig. 11 is the enzyme as a dimer exhibiting a two-fold symmetry. The subunit at the top is designated with primed labels, whereas the labels for the bottom subunit are unprimed. For example, Serl4'-P designates the phosphorylated Serl4 residue of the top subunit. Phosphorylation results in a conformational change mainly involving a "swing" of the JV-terminal subunit from a position depicted by a thick black band labeled GPb in the bottom subunit to a position depicted by a thick white band labeled GPa. The TV-terminal segment from residue 10 to 18 is disordered in GPb but becomes more ordered in GPa. In contrast, the C-terminal segment (from residues 838 to 842) undergoes an order-to-disorder transition so as to accommodate the conformational swing of the TV-terminal segment. These interactions, which are crucial to the allosteric action, are a combination of electrostatic interactions made by the Serl4-P, and polar and nonpolar interactions of the surrounding residues. In GPb, the JV-terminal segment lies in the intra-subunit region near three a-helices (thick black band). The sequence of the TV-terminal segment contains a number of positively charged residues around Serl4 (ArglOLysll-Glnl2-Ilel3-Serl4-Vall5-Argl6, where positively charged residues are boldfaced). These positively charged residues are located near a cluster of acidic residues (bearing negative charges) on the protein surfaces, thus stabilizing the positioning of the TV-terminal segment in GPb. Upon phosphorylation, the introduction of negative charges to the Serl4 residue (Serl4-P) causes so much electrostatic repulsion as to offset the preexisting electrostatic attraction and to compel the TV-terminal segment to undergo a dramatic swing; residues 10-22 are rotated by approximately 120° and the Serl4 residue shifts more than 36 A between GPb and GPa. In GPa, these charged amino acid residues now enter a new spatial relationship. For example, Argl6 now interacts electrostatically with the phosphate group on Serl4. Serl4-P also interacts with other nearby arginine groups such as Arg69 and Arg43' (from the other subunit), both of which are actually quite
66
F. T. Hong
Fig. 11. Phosphorylation of rabbit muscle glycogen phosphorylase. The view of the phosphorylase dimer is directed down the two-fold axis with the phosphorylation sites (Ser 14-P and Ser 14'-P) and allosteric sites (AMP and AMP') towards the viewer. Access to the catalytic sites are from the far side of the molecule. The glycogen (substrate) storage sites are also indicated. The subunit at the top is designated with primed labels, whereas the labels for the bottom subunit are unprimed. Phosphorylation results in a swing of the AT-terminal subunit from a position indicated by a thick black band labeled GPb (bottom subunit) to a position depicted by a thick white band labeled GPa. (Reproduced from Ref. 207 with permission; Copyright by Annual Reviews)
remote on the linear sequence but happen to be nearby due to the threedimensional folding. On the other hand, ArglO, which is only 4 residues upstream, makes a hydrogen bond with Glyll6' from the other subunit. It is evident that the conformational changes taking place at the Nterminus and at the C-terminus are highly coordinated and well orchestrated; new ionic and hydrogen bonds form in the right place at the right time as if the molecule anticipated all the requirements of stable bonding after the enzyme activation. It is indeed like a three-dimensional jigsaw puzzle with two acceptable solutions, corresponding to the nonphosphorylated
Bicomputing Survey I
67
form and the phosphorylated form, respectively. Phosphorylation allows GPb to partially disassemble and reassemble into GPa in a smooth fashion; no complete disassembly and reassembly are required. The end result of all these conformational changes is the exposure of the catalytic site. The allosteric effect described for muscle glycogen phosphorylase is, however, not universal, and some proteins exploit only some of the possible effects of phosphorylation. For example, the phosphorylation of isocitrate dehydrogenase (IDH) does not involve global conformational changes that accompany the allosteric effect. Instead, phosphorylation of Serll3 causes the introduction of negative charges of the dianionic phosphate group at the catalytic site and prevents binding of the anion substrate, isocitrate (primarily an electrostatic effect). The inhibition effect can be mimicked by a single mutation of Serll3-to-Asp (thus introducing a negative carboxylate charge). The inhibition of IDH is not purely electrostatic in nature; steric hindrance for substrate binding is an additional factor. In contrast, a Serl4-to-Asp mutation in glycogen phosphorylase is insufficient to generate an enzyme activation because it does not promote conformational changes via an allosteric effect. The diversity of phosphorylation events is further demonstrated by the difference between yeast glycogen phosphorylase, a scantily regulated enzyme, and muscle glycogen phosphorylase, an elaborately regulated enzyme.49 The phosphorylation site at Serl4 of the iV-terminal region is replaced with Asn in yeast glycogen phosphorylase. Phosphorylation thus acts on different sites with surprisingly different mechanisms. Phosphorylation of muscle glycogen phosphorylase is an excellent example of the coherent and concerted interplay between switch-based processing and shape-based processing. The glycogen storage site and the catalytic site utilize the lock-key paradigm for recognition of the correct substrates. Phosphorylation of a single residue Serl4 is the major switching event that precipitates the conformational change leading to activation (exposure) of the catalytic site at a remote location (allosteric effect); the switching effect is transmitted through a change of shape. 7.3. Concept of intelligent materials The allosteric effect caused by the phosphorylation of glycogen phosphorylase exhibits an elaborate process control sequence. The seamless (or, rather, coherent) and concerted movement of polypeptide segments relative to each other leads to exposure of the catalytic site previously hidden in the
68
F. T. Hong
inactive precursor. The new conformation is stabilized with new hydrogen and ionic bonds replacing old ones before the conformational change. Such an elaborate behavior exhibits an element of anticipation as if the entire molecule were aware of the goal of the conformation change, and is, therefore, suggestive of virtual intelligence (cf. final causes in Sec. 6.13 of Chapter 2; see also Ref. 54). Of course, a macromolecule like glycogen phosphorylase has neither consciousness nor intelligence in the conventional sense. It appears as though it had "consciousness" and were able to "anticipate" the outcome and had some crucial groups readily lined up by "having planned ahead." This is an illusion on our part but it is also a testimonial to the power of evolution. The elaborate internal dynamics of macromolecules can be summarized by the concept of intelligent materials. The concept originated from the term "smart materials" coined by the U.S. Army Research Office and was first applied to the materials science of ceramics and composites.320 Intelligent materials or smart materials are defined as composite materials in which sensors and actuators are embedded in the structural components. Subsequently, Japanese investigators extended the idea to single molecules; all the sensor, actuator and even processor capabilities are included and compacted into a single molecule. Ito et al.198 synthesized such a molecule by linking insulin to glucose oxidase via a disulfide bond. Glucose oxidase is the sensor that senses the glucose concentration. The resulting oxidation causes the cleavage of the disulfide bond, thus triggering the actuator and releasing insulin. Such an intelligent molecular complex was intended to be a prototype of drug-delivering devices. According to the Science and Technology Agency (STA) of Japan, intelligent materials are "materials with the ability to respond to environmental conditions intelligently and manifest their functions."368 The definition implies the construction of functional materials in the metaphor of a neural reflex arc. A neural reflex consists of an input neuron (sensor), one or more interneurons (processor) and an output neuron (actuator). These elements are necessary but not sufficient for a useful reflex-like function. An additional element is needed: the control law that specifies the input-output relation. The sensor-processor-actuator assembly constitutes the substrate of an intelligent system. However, the seat of intelligence lies in the control law. The control laws that regulate biochemical reactions and physiological processes often display features that allow biomolecules or biological structures to perform more tasks than are expected from a simple mechanical device. Indeed, a hallmark of the intramolecular dynamics of biomolecules
Bicomputing Survey I
69
is the concerted and interlocking steps of conformational changes that lead to a purposeful action: each part fits spatially and each step fits temporally (kinetically) with an element of anticipation of the purposeful outcome. These concerted and interlocking steps are what Rosen referred to as closed entailment loops (Sec. 6.13 of Chapter 2). The overall process exhibits intentionality that is conducive to the suggestion of a master hand behind the design. Of course, the evolutionary mechanism replaces the need of a master hand. The concept of material intelligence is eminently demonstrated by the oxygen-carrying protein, hemoglobin, of the red blood cell.50 Although other simpler examples may readily come to mind, hemoglobin is selected for a detailed discussion because it has been exhaustively investigated, and some mysteries about its extraordinary properties have been replaced by mechanistic explanations. The detailed molecular mechanisms further illustrate many important features of short-range non-covalent bond interactions. Hemoglobin is a heterotetramer consisting of four subunits, 2 a-chains and 2 /3-chains. Each subunit contains a prosthetic group, heme, that can bind a molecule of oxygen. In addition, binding of the first oxygen molecule enhances the subsequent binding of additional oxygen molecules, and the oxygen binding curve of hemoglobin (fraction of hemoglobin oxygenated vs. oxygen partial pressure) has a characteristic sigmoid-shape (Fig. 12A). A comparison with another oxygen binding protein in muscle cells, myoglobin, reveals the advantage of a sigmoidal oxygen saturation curve (Fig. 12A). Myoglobin is a monomeric protein similar to a single hemoglobin subunit chain. However, myoglobin exhibits a hyperbolic saturation curve, characteristic of a one-to-one binding of oxygen to myoglobin. The oxygen binding curve of myoglobin reaches its half-saturation level at a Po 2 (oxygen partial pressure) of 1 mmHg (half saturation pressure, P50 = 1 mmHg). In contrast, the P 50 of hemoglobin is about 26 mmHg. Thus, the oxygen affinity of hemoglobin is much reduced as compared to myoglobin, and even less as compared to free heme. Since the operating range of hemoglobin is between approximately 20 mmHg in the capillaries of active muscles (where oxygen is released) and 100 mmHg in the capillaries of the alveoli (where oxygen is bound), the reduction of oxygen affinity is necessary for hemoglobin to function effectively. If hemoglobin had an affinity like myoglobin, the binding of oxygen would be too tight for hemoglobin to unload significant amounts of oxygen in the tissues. On the other hand, if hemoglobin had a hyperbolic satura-
70
F. T. Hong
Fig. 12. Cooperative binding of oxygen to hemoglobin. A. The oxygen binding curve for myoglobin and normal hemoglobin. A hypothetical hyperbolic binding curve of myoglobin with the same half-saturation level as hemoglobin is computed and shown as a dotted curve for comparison. The sigmoid-shaped binding curve of normal hemoglobin allows it to bind more oxygen at the lung and to release more oxygen in the tissues than the hypothetical hyperbolic curve. B. The right-shift of the sigmoidal oxygen binding curve under increased Pco2 and/or lowered pH (Bohr effect) allows additional oxygen to be bound at the lung and more oxygen to be released in the tissue. (A. Reproduced from Ref. 50 with permission; Copyright by W. B. Saunders. B. Reproduced from Ref. 226 with permission; Copyright by American College of Chest Physicians)
Bicomputing Survey I
71
tion curve, the oxygen carrying function would be compromised even if the affinity had been reduced. This can be seen from a comparison of the hypothetical (calculated) hyperbolic saturation curve (dotted curve) and the normal sigmoidal curve for hemoglobin shown in Fig. 12A. A hyperbolic saturation curve with the same half saturation level (P50 = 26 mmHg) would allow much less oxygen to be bound in the lungs (reaching about 80% saturation instead of 97%) and significantly less oxygen to be released in the tissues (reaching about 43% saturation instead of about 30% or less) than the sigmoidal saturation curve. As a consequence, the amount of oxygen delivered to the tissues per hemoglobin molecule would be drastically reduced. In other words, the sigmoidal saturation curve significantly enhances the performance of hemoglobin. The performance of hemoglobin is further enhanced by a phenomenon known as the Bohr effect: pH dependence of the oxygen saturation curve. In Fig. 12B, lowering of pH at the tissues (due to an increased CO2 production and/or formation of lactic acid, a glycolytic by-product) shifts the curve to the right relative to the curve at the high pH of the lungs. An oxygen binding function associated with the Bohr effect allows more oxygen to be bound to hemoglobin at the lungs and more oxygen to be unloaded at the tissues. There is a similar effect due to the increase of Pco 2 (CO2 partial pressure). The CO2 effect is primarily due to the acidification of the blood (as a result of carbonic anhydrase-catalyzed formation of carbonic acid). There is a secondary effect due to direct binding of CO2 to hemoglobin as a carbamino derivative, also resulting in a right-shift of the saturation curve, at constant pH. However, this latter effect is relatively minor compared to the pH effect. Increasing temperature also causes a right-shift of the curve. Again, this latter effect favors loading of oxygen at the lungs, and unloading of oxygen at the tissues since the tissue temperature is higher than the temperature at the lungs. The oxygen affinity of hemoglobin in red blood cells is actually lower than purified hemoglobin in a regular electrolyte solution. The reduction of its affinity (a shift of the saturation curve to the right) is the consequence of binding 2,3-diphosphoglycerate (DPG) with a 1:1 stoichiometry. Without DPG, the half saturation level of hemoglobin is the same as myoglobin, 1 mmHg. Incidentally, the concentration of DPG in the red cells is considerably higher than in other cell types in keeping with its unique role. The sigmoidal saturation curve of hemoglobin and related phenomena on the regulation of oxygen binding is a consequence of the intramolecular dynamics; changes in one part of the molecule are transmitted to other
72
F. T. Hong
parts in the form of conformational changes (allosteric effect). First, let us examine the oxygen binding sites in both hemoglobin and myoglobin. The porphyrin ring of heme holds a ferrous ion (a transition metal ion) with four coordination bonds linked to the four pyrrole nitrogen atoms. The remaining two coordination bonds of the ferrous ion are linked to two histidine residues, known as the proximal and the distal histidine. In the deoxygenated form, the ferrous ion is slightly out of the plane of the porphyrin ring of heme. An oxygen molecule approaches the ferrous ion from the side opposite to the proximal histidine. The binding is somewhat weakened by the distal histidine (on the same side) because the latter forces the O-O-Fe bond to bend by virtue of steric hindrance. Furthermore, binding of oxygen causes the ferrous ion to move into the ring plane. This movement is transmitted by the corresponding movement of the proximal histidine to other residues at the subunit interface between al and /32 or al and /31, thus disrupting a number of ionic and hydrogen bonds between the two chains, a l and /32 or al and (31. These bonds are harder to disrupt initially when the first oxygen molecule is bound. As increasing numbers of oxygen molecules are bound, the ionic and hydrogen bonds gradually loosen up (and are replaced with new but weaker hydrogen bonds). The affinity of oxygen binding increases accordingly. The phenomena of the sequential and gradual increase of oxygen affinity of hemoglobin is commonly referred to as cooperativity. The role of DPG in the cooperativity is mediated by the formation of ionic bonds between the highly negative DPG (with 5 titratable acid groups with an average of 3.5 charges due to incomplete ionization) with positively charged histidine and lysine residues from all four subunits at a pocket that is located at the intersection of all four subunits. The ionic bonds are gradually weakened and DPG is eventually extruded from the cavity as a consequence of oxygenation. The (positive) cooperative behavior of hemoglobin allows the molecule to respond to the environment and make appropriate adjustments, resulting in an enhanced function. Hemoglobin's characteristics, therefore, fit the definition of intelligent materials. The elaborate control laws ensure that the performance of hemoglobin is significantly enhanced as compared to that governed by a simpler control law such as a hyperbolic saturation curve. Elaborate control laws that exhibit negative cooperativity are involved in the control of complexation of Fd, FNR, and NADP+ (see Sees. 5.2 and 6.2 for descriptions of these macromolecules). Physiologically, electrons flow from Fd to FNR and then to NADP+. Fd and NADP+ bind to two separate binding sites on the opposite surfaces of FNR. The presence of
Bicomputing Survey I
73
NADP+ destabilizes the Fd-FNR complex. The dissociation constant K& for oxidized binary Fd-FNR complex is less than 50 nM; /Q(Fd) increases with increasing NADP+ concentrations, approaching 0.5-0.6 \iM when the flavoprotein is saturated with NADP + . Likewise, the presence of Fd destabilizes the FNR-NADP"1" complex. The dissociation constant i^NADP+ a l s o increases from 14 fiM to approximately 310 /uM, upon addition of excess Fd. What is the impact of the negative cooperativity on the overall electron transfers from reduced Fd to NADP+? According to Batie and Kamin's interpretation,22 the rate of electron transport may be limited by the dissociation of oxidized Fd from FNR. In other words, oxidized Fd is a potent competitive inhibitor with respect to reduced Fd. Batie and Kamin23 also found that, in the absence of NADP+, the reduction of FNR by Fd was much slower than the catalytic rate: 37-80 e~s~1 versus at least 445 e~s~1; dissociation of oxidized spinach ferredoxin (Fdox) from FNRsq (the one-electron oxidized semiquinone state) limited the rate of reduction of FNR.266 Therefore, destabilization of the Fd-FNR complex by NADP+ may facilitate the overall reaction. Thus, FNR is an intelligent material. The following is another way of looking at negative cooperativity. The dissociation constant is an indication of the probability that the redox partners are in a free state versus a complexed state. As electrons are transferred from Fdred to FNRQX or to FNRsq and then to NADP+, ferredoxin and NADP+/NADPH must come on and off frequently (coming on as Fdred and NADP+ and coming off as Fdox and NADPH). There is a distribution of fractions in a ternary or a binary complex and in the free form. The ternary form is not desirable because it facilitates a back flow of electrons from FNRgq or FNRred back to Fdox (FNR is known to catalyze the reverse electron flow).142'143 From a heuristic point of view, there is no need for FNR to bind Fd when electrons are being transferred to NADP+. Likewise, there is no need for FNR to bind NADP+ when electrons are being transferred from Fd to FNR. The fact that the ternary complex does exist is a consequence of chemical equilibrium between association and dissociation; no dissociation can be complete. Thus, the negative cooperativity means an additional reduction of the fraction of the ternary form, thus enhancing the overall one-way electron flow from Fdred to NADP+. Since the binding sites for Fd and for NADP+ are located at opposite surfaces of FNR, the negative cooperativity is apparently not caused by steric hindrance. Most likely, it is caused by conformational changes of FNR resulting from binding of one or the other redox partner. A confirmation of the conformational changes must await the determination of structures of
74
F. T. Hong
the protein in its various states of binding (free, binary or ternary complex), and, perhaps also in various oxidation states (oxidized, semiquinone, or reduced). Such desired structural information is available for cytochrome CQ, mentioned in Sec. 6.3. Banci et al. have determined the solution structure of cytochrome c6 in the oxidized form16 and in the reduced form.17 The comparison of the solution structure of cytochrome CQ shows that the overall folding of the oxidized form is the same as that of the reduced form. The largest difference between the two structures is the change in the orientation of the C/3-C7 bond of propionate 7, which leads to a different orientation of the carboxylate group of the heme ring. Concomitant with this movement, there is a reorientation of His30 (which, unlike Hisl9, is not an axial ligand of the heme group) and one of the two carboxylate oxygen atoms of propionate 7. The reorientation of His30 is, however, absent in the reduced form in the crystal structure. The change of propionate 7 orientation of the reduced cytochrome c% observed in the solution structure is the same as that observed in the crystal structure.114 However, the data showing changes of binding constants between redox partners upon a conformational change, as a consequence of electron transfer and a change of redox state, are lacking. However, it has been suggested that such a conformational change favors electron transfer rather than the dissociation of redox partners.16 Implicit in our evaluation of the function of hemoglobin is the criterion associated with its intended function: carrying oxygen from the lungs to tissues. The cooperative effect of hemoglobin is Nature's solution to achieve an enhanced function. We have previously pointed out that molecular intelligence must be evaluated with the intended function in mind whenever human beings use biomaterials to construct molecular devices.177'178'179-185'187 Often a biomaterial is used for applications that are only remotely related to its native function. What is considered intelligent for its native function may not be sufficiently intelligent for the intended application, because we must now adopt a completely different set of optimization criteria than Nature did. On the other hand, what is considered epiphenomenal in biological function may be recruited for technological applications (latent function). Sometimes, it is necessary to alter existing biomaterials to enhance certain molecular functionalities and suppress others for specific applications. This approach was once a formidable task due to the complexity of biological macromolecules. However, this situation is partially alleviated by the advent of biotechnology, including site-directed mutagenesis. Several successful applications of bacteriorhodopsin, invoking its latent functions, will
75
Bicomputing Survey I
be described in Sec. 7.8 of Chapter 2. 7.4. Concept of calcium-concentration
microdomain
As a second messenger, Ca2+ is involved in a multitude of intracellular processes. The intracellular Ca2+ concentration is controlled by Ca2+ influxes from the extracellular space or from sequestrated depots of intracellular compartments such as endoplasmic reticulum or sarcoplasmic reticulum (Sec. 7.1). In principle, Ca2+, after entry, can freely diffuse to every part of the cytoplasm. A spatially widespread and unrestricted increase of the cytoplasmic Ca2+concentration is tantamount to a broadcast signal for activating numerous intracellular processes, both wanted and unwanted. In view of the latter possibility, subcellular compartmentalizations as delineated by intracellular membranes may not be sufficient to prevent spurious actions by Ca2+. Normal synaptic transmission is initiated by activation of voltagesensitive Ca2+ channels. The resulting increase of Ca2+ concentration then causes the synaptic vesicles to fuse with the presynaptic membrane (Sec. 5.7). Llinas255 has long speculated that the sharp increase of Ca2+ concentration during synaptic transmission must be spatially restricted near the active zones of a synapse with a high concentration profile that lasts only a short duration. This suspicion was supported by the following experimental observations. The latency for calcium activation of the release process in the squid giant synapse was of the order of 200 [is.256 Measurements with ion-sensitive electrodes suggest rapid changes in the intracellular Ca2+ concentration with a steep spatial profile close to the membrane during the Ca2+ current flow.246'58 This steep profile was once thought to be produced by the retardation of Ca2+ diffusion by the cytoplasmic buffing mechanism. Llinas et al.256 modeled the process in response to the passage of a 200 nA Ca2+ current through a single active zone containing many Ca2+ channels and predicted a steep spatial gradient of Ca2+ even in the absence of a Ca2+ buffering system. As explained in Sec. 5.1, the presence of a negative surface potential also contributes to the maintenance of the transient spatial gradient. The presence of this steep gradient is also supported by the finding that Ca2+entering the presynaptic terminal through Na+ channels did not contribute to transmitter release. 258 Simon and Llinas354 showed, in a comprehensive model, that the opening of Ca2+ channels leads to discrete and spatially restricted peaks of the Ca2+ concentration, which reaches a steady state rapidly relative to the open time of the channels: the Ca2+
76
F. T. Hong
loss to the bulk phase due to diffusion is balanced by the continuing influx through Ca2+ channels. Subsequently, by means of time-resolved imaging of the Ca2+-dependent aequorin luminescence, Silver et al.350 demonstrated the predicted localized transient elevation of the intracellular Ca2+ concentration, with the concentration profiles reaching 200-300 fiM at peak positions. These intracellular Ca2+ concentration profiles are composed of groups of short-lived spatial domains of a diameter of 0.5 fim, which they named quantum emission domains (QEDs). These domains were present in locations close to the active zones of the synapse. The time course of QEDs was found to follow closely the time course of the presynaptic Ca2+ current.367 The Ca2+ concentration microdomains reaches a peak within 200 /xs and has an overall duration of 800 (is.257 Silver348'349 extended the concept of calcium microdomains to the study of the control of cell division in sand dollar blastomeres. He found that the transient increase of Ca2+ concentration, prior to the nuclear envelope breakdown, take places within 1 fim of the nuclear envelope. These calcium microdomains are 3-10 fim in diameter, and last 900-3000 ms in duration, appearing about 6 minutes prior to the nuclear envelope breakdown. Further analysis of the quantum emission domains showed that the calcium signals are modulated in the frequency domain, exhibiting regular periodicity in space-time; the signal pattern appears to be consistent with and necessary for models of frequency or pulse code modulated signals. The restricted window of time, at 6 minutes before the nuclear envelope breakdown, that the Ca2+ signal can act on the target membrane further ensures the specificity of the Ca2+ action. This is similar to the strategy of "gating" in microelectronics. Thus, through spatial juxtaposition of the release and the target sites and through controlled timing of Ca2+ entry, calcium microdomains exert highly specific and deterministic control of intracellular events. These dynamic entities essentially enforce an alternative way of intracellular compartmentalization. The nonrandom space-time patterns confer high specificity to these Ca2+ signals; cross-talks with "unintended" targets are minimized. The transient nature of the space-time pattern of calcium microdomains thus invalidates any attempt to apply the concepts of equilibrium thermodynamics to the analysis.
Bicomputing Sur^uey I
77
7.5. Errors, gradualism and evolution As illustrated by examples presented in previous sections, Nature, through enzyme catalysis, compartmentalization, intervention of electrostatic interactions and other non-covalent bond interactions, manages to rescue biocomputing from the assault of randomness inherent in molecular diffusion and reactions. The mechanisms by which side reactions are minimized and matching reactants are compartmentalized and the mechanisms that enhance the odds of desirable encounters are cumulative improvements made during evolution. However, why did Nature not make it error-free? The answer is obvious with regard to genetic encoding. Were it not for occasional errors in gene replication, there would never be any evolution. However, a computer program can also have occasional errors, i.e., "bugs." Most of the time, a bug causes the entire program to crash. That is, the digital computer often degrades catastrophically upon the encounter of a single programming "bug." In contrast, a living organism usually degrades gracefully with a point mutation. A single point mutation may not threaten the life of a living organism but instead fuels possible improvements through evolution. The peculiar feature of proteins in their relative forgiveness of structural errors is termed gradualism by Conrad.71'72 Conrad defined gradualism as the condition of evolutionary improvements achieved by means of a single point mutation (p. 255 of Ref. 76). He reasoned that if an improvement requires more than one point mutation the likelihood of an intervening lethal mutation would prevent the improvement from being achieved. Whether such a severe restriction is necessary or not may be debatable since concurrent mutations at multiple sites are not uncommon (Sec. 7.6). However, the latter fact and Conrad's claim are not mutually exclusive. It is well known that there are 20 different amino acids that constitute the primary building blocks of proteins. These amino acids are identified by three-letter codons of messenger RNAs, which are polymers of four different kinds of subunits differing only in the attached side chain of one of the four nucleotide bases: A (adenine), C (cytosine), G (guanine) and U (uracil). Permutations of three letters out of four give rise to 64 (43) different three-letter codes (codons). The correspondence between codons and amino acids is therefore not one-to-one; one amino acid is often coded by more than one codon. The advantages of this redundancy were revealed by computer simulation analysis of variant genetic codes. The following summary recapitulates the main points of a recent review article by Preeland
78
F. T. Hong
and Hurst.116 The now-standard genetic code seemed to be shared by a wide range of organisms from bacteria to humans. Investigators once thought that the code was a "frozen" accident, meaning that the code appeared randomly but the appearance of the first workable code made competitive codes difficult to "survive," by virtue of a self-reinforcing mechanism (cf. Sec. 3.4 of Chapter 2). However, molecular biologists now know that there are some variant codes which assign different meanings to certain codons. For example, while many organisms translate the RNA codon "CUG" as the amino acid leucine, many species of the fungus Candida translate CUG as serine, instead. Mitochondrial genomes also exhibit variations that are characteristic of bacterial genomes, thus betraying their bacterial origin (cf. endosymbiont hypothesis; pp. 714-715 of Ref. 3). These discoveries suggested that the genetic code was not frozen but could, in principle, evolve just like proteins, and the emergence of the standard genetic code was perhaps by no means accidental but a consequence of evolutionary improvements of the codes. A detailed comparison of the individual codons revealed several recognizable patterns. First, synonymous codons tend to differ by just a single letter, usually the last. It was previously known that mistakes in translation of a codon in a messenger RNA into the corresponding amino acid occur most frequently at the codon's third letter, because the binding affinity between a messenger RNA and a transfer RNA is weakest at this position ("wobble" phenomenon). Thus, mistranslations often yield the same amino acid meaning. So do mistranscriptions and point mutations at the third position of a codon. Second, codons for amino acids with similar affinities for water (hydrophilicity or hydrophobicity) tend to differ by their last letter. This redundancy ensures that mutations or translation errors involving the third letter result in little change of local hydrophobicity of the affected peptide chain — an important factor for protein folding, in general, and for maintaining the integrity of folding nuclei, in particular (Sec. 7.6). Third, codons sharing the same first letter often code for amino acids that are products or precursors of one another. Again, similar codons code similar amino acids. In summary, a single point mutation — the change of a single codon letter — or a translation error involving a single reading frame (letter) does not cause a catastrophic failure in protein folding or a drastic change of protein properties in case of a successful folding. Just how much did evolution improve the genetic codes in terms of grad-
Bicomputing Survey I
79
Fig. 13. Extradimensional bypass. A. A deep lake is located between two peaks. B. The cross-section shows two peaks and the lake separating them. If paths from one peak to the other are confined to a plane (two dimensions), there is no choice but to go through the lake, which is considered energetically unfavorable. The addition of an extra dimension (in A) provides an additional degree of freedom. The paths along the lake shore, made possible by the additional degree of freedom, are energetically less formidable than the path through the deep lake.
ualism? Computer simulation analysis of a vast number of variant codes furnished some quantitative evaluations. If a mutation or a translation error is evaluated in terms of the degree of change of hydrophobicity of the coded amino acid, and if the computer simulation is based on random sampling (i.e., objective statistics), then only about 100 out of one million alternative codes have a lower error value than the natural code. If additional restrictions are incorporated to reflect observed patterns in the way DNA tends to mutate and the ways in which genes tend to be mistran-
80
F. T. Hong
scribed into RNA (i.e., akin to Bayesian analysis which includes a priori knowledge of the statistical distribution), then the standard genetic code outperforms its variants one in a million — it delivers a grade far better than expected of A + . 115 Proteins are therefore robust enough to tolerate disruptions caused by some unwanted mutations, and/or by mistranscriptions and/or mistranslations. The process of evolution can be pictured as moving from one fitness peak to another on the surface of a metaphoric adaptive landscape or fitness landscaped If two peaks are separated by an unbridgeable abyss, there would be no way to go from one fitness peak to another. Gradualism provides many degrees of freedom in the variation of protein structures and renders proteins amenable to evolutionary improvements. The adaptive landscape is therefore multi-dimensional. This feature has been referred to as extradimensional bypass by Conrad76 (Fig. 13). The idea is illustrated by a three-dimensional fitness landscape with two adaptive peaks separated by an abysmally deep lake. Going from one peak to the other along a plane that cuts through both peaks requires a direct passage across the deep lake and thus would be improbable. If the path is extended from two dimensions to three dimensions, going around the lake shore is favored. In other words, a multi-dimensional adaptive landscape offers additional redundancy making gradualism possible. The protein folding process parallels the event of protein evolution in the sense that extradimensional bypass is at work during the intricate process of folding through free energy-minimization. 7.6. Protein folding The doctrine of modern molecular biology indicates that genetic information provides the linear sequence of the polypeptide chains; no explicit information is provided for the secondary, tertiary or quaternary structures. In other words, the primary sequence is explicitly programmed by the genes, whereas the secondary, tertiary and quaternary structures follow the physico-chemical interactions between amino acid residues in a proper temporal and spatial sequence (implicitly programmed). Most naturally occurring proteins assume two conformations: a native (folded) conformation and a denatured (unfolded) conformation. Many denatured proteins are capable of refolding into their native conformation. Thus, the linear sequence of a polypeptide not only encodes its threedimensional conformation but also contains information about its folding pathway. Protein folding can be regarded as a form of problem solving
Bicomputing Survey I
81
similar to assembling a three-dimensional jigsaw puzzle. Although protein folding remains an unsolved problem, considerable insight has been gained into the major forces and their interplay that makes folding possible and Unique
14 15 84 9
> > > 8,130,274,319,277
Early theories of protein folding consisted of two rival theories about the primary force involved: hydrophobic force222 versus hydrogen bonding.309'308 It is well known that secondary structures, such as a-helices, 310 helicese and /3-sheets, contain numerous hydrogen bonds between the main-chain carbonyl and amide groups. Yet, water molecules also form extensive hydrogen bonding, and thus the most stable state of a soluble protein would be the denatured state if hydrogen bonding were the only important force. Another line of thinking draws inspiration from the finding that nonpolar amino acid residues tend to gather at the interior of a globular protein. This emphasizes the hydrophobic interaction as the primary driving force for protein folding. However, unlike the oil droplet forming by hydrophobic interactions in the presence of water, the protein interior is not disordered but is densely packed into a crystalline or quasi-crystalline state. Thus, it appears that the hydrophobic effect alone is insufficient to account for the self-organized folding of proteins into unique stable structures. Specific internal packing of hydrophobic amino acids is a major factor for specific internal structure. The side chains of amino acid residues of a polypeptide tend to fit together with an amazing complementarity like a threedimensional jigsaw puzzle. As proposed and summarized in a review by Rose and Wolfenden,322 the contemporary view of protein folding centers around a hierarchical process with the hydrophobic effect as the driving force to a globular collapse, forming the so-called molten globule as an intermediate state of folding. Even at this stage, the secondary structures such as a-helices and ^-sheets are already in rudimentary forms, which implies the relative importance of hydrogen bonding as a stabilizing factor. Subsequent folding is built on top of these rudimentary folds and does not require extensive restructuring. Segments of secondary structures associate with each other, thus forming supersecondary structures by fitting an a-helix with another ohelix, a /?sheet with another /?-sheet or a /3-sheet with an a-helix. These supersecondary structures can be categorized into half a dozen three-dimensional e
A 3io helix has a tighter configuration than an a-helix. It contains a n i - » i + 3 hydrogen bonding, instead of an i —» i + 4 hydrogen bonding. 336 ' 216
82
F. T. Hong
basic modules (modularity). These modules exhibit functional versatility and ease of integration into larger units. Some of them with the JV-terminus and the C-terminus located at opposite ends can readily be linked into a longer strand as a result of tandem duplication of the encoding gene ("in line" type). A module with the two termini located at the same end can readily be inserted into a loop region of a protein ("plug-in" type). It is well known that the extensive hydrogen bonding between the acarbonyl and amide groups is involved in both /3-sheet and a-helix formation. These structures are then linked by two other secondary structure motifs: turns and loops. Apparently, these secondary structures maintain considerable stability with tolerance towards amino acid residue substitution because bonding involves primarily main-chain carbonyl and amide groups; side-chain specificity (except proline) is not an issue except near the two peptide terminals. However, amino acid specificity does come into play in the formation of the secondary structures. An examination of the a-helical structure reveals that hydrogen bonding takes place regularly with the amide hydrogen and carbonyl oxygen at a fixed pitch of four, the carbonyl group being approximately four (3.6) residues upstream from the amide residue. As a consequence, the initial four N-H groups and final four >C=O groups lack the intrahelical hydrogen-bonding partners. The hydrogen bonding requirement of these terminal groups is satisfied by capping with side chains of polar residues flanking the two helix termini: Asp, Glu, Ser, Thr, Asn, Gin and neutral His at the JV-terminus, and Lys, Arg, Ser, Thr, Asn, Gin and protonated His at the C-terminus. As for the central residues of a helix, the shape of side chains appears to play a discriminatory role. Studies by means of site-directed mutagenesis of proteins have demonstrated that the buried interior of a protein can tolerate considerable diversity of residue substitution with only minor effects on the structure, stability and function. Despite the three-dimensional jigsaw puzzle analogy, the buried protein is not that tightly packed, but maintains a fluid-like environment, at least for certain parts and at certain times. Activation of an enzyme often involves the conformational change from a taut (tense) form (T state) to a more relaxed form (R state), whereas inactivation involves the reversal of the change (see Sec. 7.2). Presumably, a more relaxed state facilitates molecular recognition by promoting exploration between the enzyme and its substrate. Thus, proteins are endowed with forgiving tolerance to unwanted mutations, and, therefore, with malleability that is compatible with gradualism. Apparently, the tolerance has been built in the
Bicomputing Survey I
83
evolutionary selection of 20 different kinds of amino acids as the building blocks of proteins. How Nature arrived at this particular set of building blocks was once a completely open question.227 Intuitively, the amino acid redundancy with regard to polarity and steric property (shape), when coupled with thefluid-likeenvironment, permits the protein to tolerate a major packing fault most of the time. Thus, a "kink" can be straightened out by a local rearrangement without precipitating a global rearrangement. This intuitive inference remains largely correct, after computer simulation studies of the evolution of genetic codes have partially lifted the "fog" surrounding the problem (Sec. 7.5). Recent advances in protein folding research resulted mainly from experimental and theoretical studies of a broad class of small proteins and simple generic lattice and off-lattice models rather than detailed all-atom models (see p. 176 of Ref. 43 for a brief description of lattice and off-lattice models). Simplicity of these models permitted efficient computations and a huge number of simulations, resulting in statistical descriptions of folding events. These models also made possible simulations of the evolution of proteins under various selection pressures. Such simulations re-affirmed the view that protein folding involves heuristic searching rather than random searching. Some key insights extracted from a review article by Mirny and Shakhnovich277 are presented below. The actual situation of protein folding is more complicated, and rival alternative theories have not been fully rejected. The critical issues are stability and fast folding kinetics. The key concept is cooperativity. Theoretical studies of various approaches converged on the view that amino acid sequences that had undergone evolutionary selections fold cooperatively, whereas random sequences do not. To exhibit a cooperative folding transition and to fold fast, the native structure must reflect a pronounced potential energy minimum separated from the rest of the structure by a large energy gap. Evolutionarily favored sequences fold by a nucleation mechanism whereby a small number of residues (folding nucleus) need to form their native contacts in order for folding reactions to proceed fast into the native folded state. Small single-domain proteins fold like two-state systems with only folded and unfolded states being stable, whereas all intermediate (partly folded) states are unstable. The two-state transition is akin to the first-order phase transition of a finite system. However, the transition state is not a single protein conformation, but is rather an ensemble of conformations (transition state ensemble, TSE). The progress of a simple chemical reaction is characterized by the motion
84
F. T. Hong
along a single reaction coordinate, and the transition state resides at the "great divide," from where the reaction can either go towards the product (forward reaction) or go towards the reactant (reverse reaction). Protein folding reactions have many reaction coordinates in many dimensions, and the TSE is the equivalent of the transition state of a simple reaction. Correct folding occurs when the TSE proceeds in the forward direction towards the native folded state, whereas unfolding occurs when the TSE proceeds in the reverse direction towards the unfolded state. In the language of nonlinear dynamics, the TSE is positioned at or around a separatrix (akin to a "watershed") that separates the two basins of attraction — one for the folded state and the other for the unfolded state — in the multi-dimensional conformational space (see Sec. 2.4 of Chapter 2). The number of conformations constituting the TSE is as important in determining the protein folding rate as the height of the free energy of the TSE does. The multiplicity of the TSE provides the extradimensional bypass, mentioned in Sec. 7.5. That extradimensions are critical is demonstrated by studies of Chan and coworkers.59'223 These investigators found that, of all studied sequence models, only three-dimensional models with twenty types of amino acids feature folding cooperativity comparable to that of naturally occurring proteins. Two-dimensional models and hydrophobic polar models were found to be far less cooperative than real proteins. Protein conformations at the separatrix fluctuate among various members of the TSE. Once a particular conformation passes beyond the separatrix, it no longer encounters any major energy barrier and is well on the path to fast folding. This latter conformation that is committed to fast folding is called a postcritical conformation. What distinguishes a postcritical conformation from those that eventually unfold? The nucleation theory suggests that fast-folding proteins have a small substructure common to most of the conformations constituting the TSE. This substructure is called a folding nucleus. Nucleation in protein folding is thus analogous to nucleation in crystallization. Postcritical conformations are those that are positioned beyond the separatrix and are destined to folding along the steep slope of a single deep U-shaped potential gradient, thus ensuring rapid folding and the stability of the folded protein. The gradient strategy mentioned in Sec. 6.1 is apparently in action (cf. Fig. 10). In most of the studied proteins, the folding nucleus is a dense cluster of amino acid residues stabilized by either hydrophobic or hydrogen bonding interactions (intramolecular recognition). The key residues in a folding nucleus — to be referred to as nucleation residues — are usually scattered
Bicomputing Survey I
85
among several non-contiguous locations on a polypeptide chain (cf. Fig. IB). If so and if the nucleation theory is generally correct, then mutations of the nucleation residues of a protein are less fault-tolerant than mutations of amino acid residues that are not critical to the formation of the folding nucleus (to be referred to as non-nucleation residues). This is because the non-covalent bond interactions that hold a folding nucleus in its native conformation are rather delicately and precariously poised — the nucleation residues, after all, are non-contiguous prior to folding — and a slight misalignment of a single non-covalent bond may knock the rest of non-covalent interactions completely out of alignments. Thus, evolutionarily speaking, a folding nucleus may, in principle, suddenly dissolve and vanish without a trace, as a consequence of mutations that have targeted the folding nucleus per se (see later for a discussion of additional factors that minimize the probability of this occurrence). Therefore, mutant organisms with mutations involving only the non-nucleation residues of a protein have a better chance to reproduce and to perpetuate the new traits in future generations than mutant organisms with mutations affecting the folding nucleus of the same protein. As a consequence, viable mutations of non-nucleation residues of a protein tend to outnumber viable mutations of the corresponding nucleation residues, and organisms preserving an old successful folding nucleus of a given protein tend to outnumber organisms equipped with a newly emerging mutant folding nucleus of the same protein. In other words, a newly emerging folding nucleus faces a formidable competition with an already successful folding nucleus of the same protein, by virtue of a self-reinforcing mechanism mentioned in Sec. 3.4 of Chapter 2. It takes a significant merit for an emerging folding nucleus to attract a sufficient number of "subscribers" — i.e., mutant proteins relying on this emerging folding nucleus to fold — to become established. Another factor that favors the emergence of new folding nuclei may be the law of "diminishing return." Overpopulation with (subscriber) mutants eventually erodes the competitive edge which an existing folding nucleus has enjoyed, thus ushering in the emergence of a new folding nucleus. In the language of search algorithms and search spaces, the subspace corresponding to an old folding nucleus is searched more frequently than the subspace corresponding to an emerging folding nucleus — a biased random search, so to speak. But the encounter with a problem that is refractory to repeated attacks calls for the exploration of new search directions. Apparently, the availability of the nucleation mechanism converted evolution from random searching into focused searching in an apparently more "profitable" sub-
86
F. T. Hong
space (heuristic searching). Since a successful folding nucleus provides a fertile ground for viable mutations, nucleation residues tend to be more evolutionarily conserved than non-nucleation residues. But does this mean that a folding nucleus must remain forever conserved and "frozen" until other folding nuclei emerge by random chance? Insight gained into the evolution of the genetic code may shed some light on the problem and may alleviate this concern. On the other hand, Preeland and Hurst 116 speculated that the optimized genetic code might speed up evolution. In the latter case, it is the nucleation theory that supplies the other half of the story so as to explain how the scenario suggested by Freeland and Hurst could be possible. A merger of insight gained into protein folding and insight gained into the evolution of the genetic code furnishes a more complete picture regarding both problems. As discussed in Sec. 7.5, it is the optimized genetic code that makes mutations of proteins fault-tolerant, whether mutations occur in nucleation or non-nucleation residues. As a consequence, an unwanted mutation of a folding nucleus may not always irrevocably disrupt the existing non-covalent bond interactions that hold the folding nucleus together. Thus, folding nuclei are not "frozen" but can evolve more gradually than abruptly, just like non-nucleation residues. But the evolution of the folding nucleus of a protein is expected to be slower than the evolution of the remaining residues since nucleation residues and non-nucleation residues of a protein belong to two different levels of folding hierarchy, as explained above. Perhaps it was no accident that key proteins, such as G proteins, could be grouped as various tree-like superfamilies. Likewise, the evolution of the genetic code and the evolution of folding nuclei belong to two different levels of evolutionary hierarchy. Therefore, the evolution of the genetic code is expected to be even slower than the evolution of folding nuclei. By pooling together the knowledge regarding folding nuclei and the genetic code, an additional insight can be gained. It is the stratification brought about by the hierarchy of protein folding — nucleation versus nonnucleation residues — and of evolution — proteins versus the genetic code — that is responsible for the implementation of heuristic searching and for the difference in the speed of evolution among these various hierarchical levels. The metaphor of the adaptive (fitness) landscape offers a convenient visualization. But in the present context, it is even more convenient to use the metaphor of the potential energy landscape or, rather in the language of nonlinear dynamics, the metaphor of attractor basins (Sec. 2.4 of Chapter 2). Thus, population growth and land development tend to favor valleys
Bicomputing Survey I
87
(attractor basins) and where water sources are well within reach, rather than high mountain peaks. It is the hierarchy of valleys, subvalleys, and sub-subvalleys, etc, that encourages additional searches within same regions, thus consolidating the geographic differences in terms of population growth, culture and the extent of land development among various valleys, subvalleys and sub-subvalleys. In the above metaphor, if most of the peaks that separate valleys were either difficult to surmount or even insurmountable, evolution would hardly proceed or almost reach a standstill. Apparently, in the case of protein evolution, the redundancy of codons116 and of amino acids and the multiplicity of short-range non-covalent bond interactions provide the needed extradimensional bypass (metaphorically, a mountain pass). Gradualism ensures that two neighboring fitness valleys (or, rather, attractor basins) are not separated by a vast and extended mountain range but rather by isolated peaks surrounded by readily accessible mountain passes. Thus, the folding nucleus exerts a top-down constraint on protein folding, whereas fluctuations of the TSE, facilitated by the fluid-like protein environment, reflect the bottom-up process. The top-down constraint ensures that the search process is not random but rather heuristic. The bottom-up fluctuations explore various avenues of folding beyond the immediate valley so as to avoid being trapped at a local attractor basin. Likewise, the optimized genetic code exerts a top-down constraint on the evolution of proteins, whereas gradualism in the way amino acids are coded in mRNAs facilitates bottom-up explorations, thus speeding up evolution. Apparently, peaks separating various folding nuclei are lower than peaks separating various variant genetic codes. The difference in barrier heights between valleys, subvalleys, etc., is reflected in the difference in speeds of evolution at various hierarchical levels. Folding faults are sometimes inevitable because folding is subject to spatial or temporal variance in the dynamics of physico-chemical interactions (see Sees. 5.6, 5.7 and 5.8 of Chapter 2 for discussions of endogenous noise). Living organisms thus evolved mechanisms to deal with folding errors. This problem is handled in at least two separate ways. First, molecular chaperons (heat shock proteins Hsp60 and Hsp70) are capable of helping an inappropriately folded protein refold.153'314'372 Second, incorrectly folded proteins may be targeted for proteolytic degradation, via ubiquitination,110 as part of a quality control process. A lingering question remains: Why are proteins so uniquely suitable for evolutionary improvements? Partial insights are available from a compar-
88
F. T. Hong
ative study of RNA and protein enzymes. Narlikar and Herschlag288 compared these two types of enzymes from the standpoint of transition-state theory, and found that protein enzymes excel in their ability to position functional groups within the active site and to manipulate and control the electrostatic nature of the active-site environment. On the other hand, the commonality of the two types of enzymes also suggests that the use of binding interactions away from the site of chemical transformation to facilitate reactions is a fundamental principle of biological catalysis, thus allowing exquisite specificity and enormous rate enhancements to be concurrently implemented and separately regulated. However, the ensuing topographical specialization, for separate tasks of catalysis and regulation, in a macromolecule demands proper orientation in molecular recognition (Sec. 6). 8. Stochastic Nature of Neural Events: Controlled Randomness of Macroscopic Dynamics Neural excitation in general is characterized by a switching event known as an action potential (see Ref. 211 or any standard physiology textbook). An action potential in an excitable cell such as a neuron or a muscle cell is preceded by a localized change of the transmembrane electric potential (known as depolarization). If this localized potential change does not reach threshold, no action potential can be initiated, and the electrical change remains localized (known as an electrotonic response). An electrotonic response spreads only over a limited distance from the site of stimulation (governed by a space constant of the order of millimeters), and lingers only briefly after the cessation of the stimulus (governed by a time constant of the order of milliseconds). If this localized change reaches or exceeds the threshold, a full-fledged (non-graded) action potential will then be generated that is capable of traveling over a long distance along a nerve fiber (or a muscle fiber) by means of a regenerative process much like a burning fuse. Once the threshold is exceeded, a stronger stimulus that causes any additional localized potential change makes no difference. Thus, the action potential is a digital process. An action potential in a mammalian cell, however, cannot travel beyond a cell's boundary and reach another cell. Initiation of a new action potential in a neighboring cell requires a mechanism known as synaptic transmission. A synaptic transmission is an analog process because it involves: a) the release of numerous neurotransmitter molecules from the presynaptic cell, b) the diffusion of the transmitter molecules across the synaptic cleft (a 50
Bicomputing Survey I
89
nm aqueous space separating the two excitable cells), c) the binding of the transmitter to a receptor molecule residing on the postsynaptic membrane, and d) the graded (continuous) change of ionic conductance of the postsynaptic membrane caused by binding of the transmitter molecules. The latter step is the predecessor of a new action potential. It is apparent that the process of transmitter release is highly stochastic in nature (see a review by Bennett and Kearns32). It is instructive to examine how these individual mesoscopic stochastic events are integrated into highly deterministic macroscopic signals (action potentials). We shall first consider the neuromuscular junction (known as the motor end-plate) which is the synapse between a motor nerve ending and a skeletal muscle cell.
Fig. 14. End plate potentials and miniature end plate potentials of frog muscles. A. End plate potentials (EPP) from a single motor end plate show variations of amplitude. These potentials were neurally evoked by action potentials arriving at the attached motor nerve ending. In each record, three superimposed responses are seen. B. Spontaneous activity at the motor end plate region leads to the random appearance of numerous miniature end plate potentials (MEPP), which are shown in the upper part (voltage and time scales: 3.6 mV and 47 msec). A full-fledged muscle action potential is also shown in the lower part (voltage and time scales: 50 mV and 2 msec). Note that scattered spontaneous miniature end plate potentials were also recorded along with regular end plate potentials in A. (A. Reproduced from Ref. 95 with permission; Copyright by The Physiological Society. B. Reproduced from Ref. 107 with permission; Copyright by The Physiological Society)
The synaptic process of neuromuscular transmission starts with the arrival of an action potential at the motor nerve ending, which makes a synaptic contact with a muscle cell. The arriving action potential causes
90
F. T. Hong
a momentary rise of the intracellular Ca2+ concentration, which, in turn, causes many synaptic vesicles inside the nerve ending to fuse with the nerve terminal membrane and to release their content, acetylcholine (ACh), into the synaptic cleft (Sec. 5.7). A large number of ACh molecules must then move across the synaptic cleft by random diffusion before they are able to bind to a ACh receptor on the muscle membrane on the other side of the synapse. The subsequent opening of numerous ion channels associated with activated ACh receptors causes a significant increase of the Na+ conductance at the end-plate membrane. Consequently, the membrane potential moves towards and beyond the threshold level, thus generating a new action potential at the muscle membrane. This initial localized membrane potential change at the end-plate muscle membrane, preceding the appearance of the muscle action potential, is called the end plate potential (EPP) (Fig. 14A).
Fig. 15. Statistical control law governing the random appearance of miniature end plate potentials. The number of observed intervals, of duration less than t, has been plotted against interval duration t. Smooth curve: a theoretical curve, y = A^l — exp(—t/T)), where N is the total number of observations, and T the mean interval, marked by arrow. Circles: observed numbers. (Reproduced from Ref. 107 with permission; Copyright by The Physiological Society)
In the absence of stimulation from the motor nerve ending, spontaneous localized changes of the membrane potential can be detected at the endplate membrane.107 These spontaneous electric activities, known as miniature end plate potential (MEPP), are similar to the EPP but are much smaller in amplitude (Fig. 14B). The MEPPs appear randomly. The inter-
Bicomputing Survey I
91
vals between successive MEPPs, in a very large series of observations, is distributed exponentially (Fig. 15). While these results strongly suggest a random distribution of MEPPs, Katz and coworkers were somewhat cautious with this conclusion since the "constituent" causing these MEPPs were not known at that time.
Fig. 16. Histogram of neurally evoked EPPs and spontaneous MEPPs (inset) amplitude distributions in a mammalian skeletal muscle fiber. The neuromuscular transmission was blocked by increasing the magnesium ion concentration of the bathing solution to 12.5 mM. Peaks of neurally evoked EPP amplitude distribution occur at 1, 2, 3, etc., times the mean amplitude of MEPPs. A Gaussian curve is fitted to the spontaneous potential distribution (inset) and used to calculate the theoretical distribution of neurally evoked EPP amplitude (continuous curve), which fits well with the amplitude distribution of those experimentally observed (bar graph). The bar placed at zero indicates the number of failures observed in a series of trials whereas the arrows and the dotted line above the bar indicate the number of failures expected theoretically from the Poisson distribution. (Reproduced from Ref. 46 with permission; Copyright by The Physiological Society)
Katz and coworkers95'218 subsequently demonstrated that the macroscopic EPP was actually the result of summation of many nearly identical MEPPs. By reducing the extracellular Ca2+ concentration, they were able to reduce the amplitude of the neurally evoked EPPs. They found that the amplitude of these EPPs did not vary continuously but rather in steps the size of which is comparable to the amplitude of a single MEPP. That is, the amplitude of EPPs is "quantized." Shown in Fig. 16 is the distribution of the amplitude of the neurally evoked EPPs as a histogram. The superimposed smooth curves are computation based on the prediction of a Poisson distribution. Also shown in the inset is the distribution of the
92
F. T. Hong
amplitude of a single MEPP. Katz and coworkers pointed out that the dispersion of the MEPP amplitude does not necessarily imply a dispersion of the quantal content of an individual synaptic vesicle but could instead be a manifestation of fluctuations of the Ca2+ concentration. Katz and Miledi219'220'221 subsequently analyzed the noise spectrum of the voltage fluctuations appearing at the end plate membrane but continued to interpret the data in terms of the (mesoscopic) change that has the same time course of the MEPPs, namely, a time course with a single exponential decay like the MEPPs. In other words, they treat an EPP as an integral multiple of an MEPP. In what constituted a "paradigm shift," Anderson and Stevens5'292 interpreted the end-plate noise, instead, as the manifestation of the abrupt opening and closing of many individual ion channels. These events of random opening and closing are the "constituents" alluded to by Katz. This prophetic interpretation received a resounding confirmation when rapid fluctuating conductance changes were demonstrated by means of the patch clamp technique.291 When a macroscopic EPP exceeds threshold, it erupts into a new action potential that travels over the entire muscle cell, causing the muscle to contract. The switching event underlying the generation of a new action potential depends on a delicate balance between the K+ and Na+ currents through the membrane. Essentially, the membrane potential is jointly decided by the electrodiffusion of these two current systems which tend to oppose each other as far as their influence on the membrane potential is concerned. Simply put, both current systems strive to maintain their own electrochemical equilibrium by balancing the ionic flow that is driven by the membrane potential against the ionicflowthat is driven by its concentration gradient across the membrane, through their respective specific ion channels. The K+ current pushes the membrane potential toward a negative value, which is dictated by its transmembrane concentration gradient, whereas the Na+ current pushes the membrane potential toward a positive value, which is similarly dictated. Since these two equilibrium values cannot be realized at the same time, the membrane potential that actually prevails is a value resulting from an "arbitration" process that is determined primarily by the relative magnitudes of the permeability of the two ion channels, with due consideration being given to the relative magnitudes of the concentration gradient of the two ions (for a concise summary, see a standard physiology textbook). When a nerve or muscle cell is not excited, the permeability of K+ chan-
Bicomputing Survey I
93
nels is approximately 100 times greater than that of Na+ channels. Therefore, the resting membrane potential settles at a steady negative value. When the threshold is exceeded, the permeability of Na+ channels suddenly and rapidly increases by some 500 fold and thus the ./Va+current exceeds the K+ current momentarily. During this brief moment, the membrane potential swings towards a positive value. The dominance of the Na+ current is however short-lived because the + Na channels spontaneously close after a brief period of opening. The opening and closing of the Na+ channels are well defined kinetic processes known as activation and inactivation of the Na+ conductance. Activation of the Na+ conductance critically depends on the membrane potential, i.e., the iVa+channels are voltage-gated. Below the threshold, activation of the Na+ conductance is insignificant. Thus, the resting membrane potential is fairly stable if the perturbation of the membrane potential is small. When the membrane potential is slightly depolarized — i.e., shifted towards the positive polarity — but still falls far short of the threshold, the K+ current maintains its dominance over the Na+ current, and a net outward current will restore the resting potential once the perturbation ceases (negative feedback regime). If, however, the membrane potential is depolarized substantially so that it goes beyond the threshold potential, the system is transformed into a positive feedback regime with the following cyclic events, in which one event causes the next event to follow, and then starts over again: a) the Na+ channels become activated, b) the enhanced inward Na+ current exceeds the outward K+ current, c) the net inward current causes the membrane potential to depolarize further, and d) the Na+ channels become even more activated by the depolarization of the membrane potential, thus completing the vicious cycle (a positive feedback mechanism known as the Hodgkin cycle). In other words, the threshold is a branching point directly controlled by the membrane potential. The events leading to the generation of a muscle action potential and the subsequent restoration of the resting membrane potential are essentially the same as in a neuronal membrane. The following discussion applies to both the muscle and the neuronal membranes. Inactivation, which is an intrinsic property of Na+ channels, ensures that an action potential has a short duration and allows the K+ current system to regain control of the membrane potential during the interlude between two successive action potentials. A separate kinetics of delayed activation of the K+ conductance speeds up the restoration of the resting potential. However, the activation of the K+ conductance is not absolutely
94
F. T. Hong
needed to restore the resting potential. In the absence of activation of the K+ conductance, the restoration of the resting membrane potential would still take place but it would take a longer time. The K+ current system will be ignored in the subsequent discussion for simplicity.
Fig. 17. Voltage dependence of peak sodium ion conductance (pjvo). Activation of the Na+ conductance in response to a sudden step of depolarization reaches the peak within a couple of milliseconds before the onset of inactivation. The peak Na~*~ conductance is plotted against the depolarization step on a semi-logarithmic scale (A) and a linear scale (B). (A. Reproduced from Ref. 169 with permission; Copyright by The Physiological Society. B. Reproduced from Ref. 324 with permission; Copyright by W. B. Saunders)
In order for the action potential to be a reliable switch, the transition between the negative and positive feedback regimes must be sharp. This
Bicomputing Survey I
95
sharp transition is made possible by a highly nonlinear voltage dependence of the Na+ conductance. If the logarithm of the Na+ conductance is plotted as a function of the membrane potential, the initial portion appears linear but the level ultimately saturates around 0 mV (Fig. 17A). If, however, a linear plot is made instead, the g-V (conductance vs. membrane potential) curve is sigmoidal in shape (Fig. 17B). The g-V curve, though not a stepfunction, is sufficiently steep to guarantee the reliability of its switching function. What is the molecular basis of this sigmoidal activation curve? Considerable insight has been gained from two types of studies: the patch-clamp study and the study of gating currents. The advent of the patch-clamp technique326 made it possible to observe the "constituent" events: the opening and closing of individual ion channels. Shown in Fig. 18 are patch-clamp records of current flow in a small patch of the rat muscle membrane in response to 10 mV of sudden depolarization.346 Record C shows nine individual responses, in which the opening and closing of ion channels appears random and unpredictable at first glance, and the individual response appears irreproducible upon repeated measurements. None of these current traces provides direct clues of the well-defined time course of activation and inactivation of the Na+ conductance. Furthermore, the conductance of a single Na+ channel — the unitary Na+ conductance — is almost voltage-independent. The question is: How does the voltage dependence of the amplitude of the macroscopic Na+ conductance arise from an ensemble of constituent Na+ (single-channel) currents, of which the amplitude is voltage-independent, and how does the well-defined time course of the macroscopic Na+ conductance arise from superficially random opening and closing of an ensemble of individual Na+ channels? It turned out that increasing depolarization of the membrane potential does not increase the amplitude of the conductance of individual channels, but rather increases the probability of opening and closing of these channels (see, for example, Ref. 287). At relatively negative membrane potentials close to the resting potential, the Na+ channels are closed most of the time, whereas the channels open and close more frequently at more positive potentials. Furthermore, the individual channels open abruptly and close abruptly; the time course of the single-channel currents bears no resemblance to that of the macroscopic Na+ current. That the peculiar time course of abrupt activation and more gradual inactivation of the macroscopic Na+ conductance is indeed derived from the probabilistic distribution of opening and closing events in response to the step depolarization can
96
F. T. Hong
Fig. 18. Patch clamp records of sodium ion currents. A small patch of the rat muscle membrane was voltage-clamped, and the Na+ current was recorded. Tetrethylammonium was used to block any if+ channels that were inadvertently included in the patch. A step depolarization of 10 mV was used to activate the sodium channels present in the patch (Record A). The traces in Record C show nine separate responses to the 10 mV depolarization. Record B is the average of 300 individual responses. (Reproduced from Ref. 346 with permission; Copyright by Macmillan Magazines)
be seen from Fig. 18B. The average of 300 patch-clamp current traces gives rise to a time course that strongly resembles that of the macroscopic Na+ current, as is observed by the conventional voltage-clamp technique.169 It appears that the superficially erratic opening and closing of an ensemble of individual Na+ channels are actually orchestrated by a specific probabilistic control law. Alterations of this control law by point mutations could lead to illness: channelopathies (see Fig. 5 of Chapter 2). Note that opening and closing of ion channels, as dictated by the probabilistic control law, is not completely random but is subtly controlled by the membrane potential. Inspection of the nine traces in Fig. 18C reveals that, in this limited number of measured samples, almost all of the opening and closing events take place in the first few milliseconds after the step depolarization but none after 5 milliseconds. In other words, the opening and closing of an individual Na+ channel, following a step depolarization, is governed by a probabilistic control law, which occupies an intermediate position on the gray scale of determinism: relative determinism. In contrast, the control law for the time course of an entire ensemble of Na+ channels is well defined and the collective behavior of a large number of Na+ channels is significantly more deterministic.
Bicomputing Survey I
97
The above discussion about the control law governing the mesoscopic process of opening and closing of individual ion channels illustrates the essence of controlled randomness in biocomputing. Controlled randomness in individual Na+ channels collectively gives rise to a well-defined time course of voltage-dependent activation and inactivation of the Na+ conductance. Likewise, the arrival of neural impulses at the presynaptic terminal of a neuromuscular junction transforms the completely random process of spontaneous neurotransmitter release into a controlled random process of opening and closing of ACh channels, which collectively gives rise to a well defined macroscopic process underlying EPP. What is the source of this controlled randomness? Molecular biology of ion channels is one of the most active areas of investigation in neuroscience, and our conceptual understanding of channel operation continues to evolve and change. The following discussion is intended to capture some insights that are relevant to the elucidation of controlled randomness. It must not be regarded as a definitive answer with regard to the molecular mechanisms of ion channel operation. For further detail, authoritative treatises must be consulted.267-166-145'365'165'36'310 Ion channel fluctuations were often modeled by a Markov process, in which the ion channel was assumed to have a finite number of open and closed discrete conformational states, with characteristic transition probabilities per unit time between these states. Hodgkin and Huxley's study suggests that there are at least three discrete conformational states of the Na+ channel: the closed state, the open state "id the inactivated (closed) state. However, single channel and gating current analysis revealed additional conformational substates. The gating current is an externally measurable capacitative current associated with the charge displacement of the putative voltage sensor of the Na+ channel during opening and closing. This current was predicted by Hodgkin and Huxley and was subsequently discovered by Armstrong and Bezanilla.8'9 These gating charges are thought to be associated with segment 54 of the Na+ channel.366'365'36 By assuming that the charge movements on the voltage sensor are correlated with the transition between different channel states, the gating current analysis provides information about the voltage dependence of the channel states. The analysis was performed by integrating the gating current to obtain the gating charges, which was then plotted as a function of the membrane potential to obtain a Q-v curve. The Q-v curve, which is sigmoidal in shape, allows for the estimation of the charge movement during each transition. Unfortunately, the detailed
98
F. T. Hong
interpretation of the analysis is modd-dependent, and refinement of the analysis often leads to an increasing number of conformation states. An alternative approach was proposed by Liebovitch et al.,251 who discovered a fractal nature of a non-selective ion channel in the corneal epithelium. These investigators found that the time course of ion channel fluctuations exhibits a statistical self-similarity on various scales of time resolution. Liebovitch and Sullivan252 measured currents through K+ channels in hippocampal neurons and found that the effective kinetic rate constant is governed by a power law of the time scale used to analyze the data. The effective kinetic rate constant k is given by k = Atl~D , where A is the kinetic setpoint and D the fractal dimension. Liebovitch and Sullivan found that the fractal dimensions were ~ 2 for the closed times and ~ 1 for the open times and did not depend on the membrane potential. For open and closed times, the logarithm of the kinetic setpoint was found to be proportional to the applied membrane potential. Contrary to conventional wisdom, the fractal model is actually more parsimonious than the Markov model because the latter incurs an excessive number of adjustable parameters250 (cf. analysis in Sec. 20 of Ref. 187). In addition, the fractal model is also consistent with the modern understanding of protein dynamics.57-217'101 Although it is evident that ion channel fluctuations are regulated by the membrane potential, the detailed mechanism of the conductance fluctuation is not known. Using the approach of nonlinear dynamics, Chinarov et al.61 have shown that bistability of ion channels can arise from interactions of the ion flux through ion channels with the conformational degree of freedom for some polar groups that form the ion channels. In essence, the passage of ions through a channel is modulated by both the global electric field imposed by the transmembrane potential and the local electric field generated by the passing ions themselves. Christophorov and coworkers65'63'64 cast this type of interaction in a general formulation of charge-conformation interactions, which has also been invoked to interpret nonlinear light-dependent phenomena in bacterial reaction centers.135'136 This line of thinking is compatible with the fractal model because the fractal behavior is often a manifestation of the self-organization process. Nonlinear processes in ion channels are also suggested by a series of experimental analyses by Matsumoto and coworkers. Kobayashi et al.228 demonstrated that the subaxolemmal cytoskeleton of the squid giant axon
Bicomputing Survey I
99
was highly specialized and mainly composed of tubulin, actin, axolinin, and a 255-kD protein. Tsukita et al.377 further demonstrated that the axolemmal membrane is heterogeneous and is specialized into two domains (microtubule- and microfilament-associated domains). Hanyu and Matsumoto150 also studied the bifurcation property that links the resting and the spontaneous oscillatory states of the squid giant axon. These investigators suggested that this bifurcation property is a consequence of the spatial long-range interactions in the axons, due possibly to the specific distribution of Na+ channels. Electron microscopic evidence points to the possibility of the regulation of Na+ channel distribution by subaxolemmal cytoskeletons. Shcherbatko et al.341 expressed Na+ channel a-subunits in Xenopus oocytes and analyzed ion channel kinetics in such preparations. These investigators compared the "cut-open" recordings from oocytes with the patch-clamp recordings that were made in a macropatch configuration, and found that kinetics in the patch-clamp recordings shifted to a faster time course than the "cut-open" recording kinetics. Furthermore the shift was correlated with the rupture of sites of membrane attachment to cytoskeleton. This finding again suggested that ion channel kinetics are regulated by membrane-cytoskeleton. Interestingly, ion channel fluctuations are also present in artificial pores in synthetic polymer membranes.245 Further discussion of the origin of ion channel fluctuations is given in Sec. 5.8 of Chapter 2. In summary, it is apparent that the mesoscopic controlled randomness is an essential element required for normal operation of Na+ channels. Partial randomness in the ion channel kinetics is not a manifestation of external interference of other concurrent but causally independent processes; it must be regarded as endogenous noise. The key factor regulating the controlled randomness in the Na+ conductance is the membrane potential. A welldefined macroscopic control law thus arises from voltage-controlled randomness at the mesoscopic level. Participation of membrane-cytoskeletons in the underlying nonlinear processes is implicated, i.e., it is a cooperative phenomenon. The mesoscopic event of opening and closing of Na+ channels is highly random and is digital in nature, whereas the macroscopic event of activation and inactivation of the Na+ conductance is reasonably well defined and is analog in nature. Once an action potential is generated, the macroscopic event becomes discrete and once again assumes a digital characteristic. A large number of discrete and well-defined nerve impulses subsequently impinge upon the postsynaptic membrane via synaptic transmission, thus completing the al-
100
F. T. Hong
ternating cycle of digital and analog processing and the alternating cycle of probabilistic and well-defined control laws. In conclusion, information processing at the macroscopic neural network level is neither as random as individual microscopic biochemical reactions suggest nor as deterministic as an all-digital system like a digital computer. Randomness participates in information processing in a peculiar way. When the process appears digital, the amplitude is well denned (digital) but the timing is erratic. In contrast, when the process becomes analog, the timing is well denned but the amplitude then contains a non-zero dispersion. Thus, for a given neuron, partial randomness is introduced at several different levels: a) a variation in the amount of released neurotransmitters leads to fluctuations of the stimulus strength, b) the sigmoidal curve denning the branching point of firing or breaking shifts randomly on the voltage (membrane potential) axis leads to a variation of the threshold level for the initiation of an action potential, and c) ion channel fluctuations lead to a variation of the time course of the action potential after it has been initiated. Partial randomness is indispensable for the ion channel function rather than a mere nuisance for investigators (see Sec. 5.8 of Chapter 2 for its implication to the free will problem). Since action potential generation is a crucial process in macroscopic signal transmission and processing, it is apparent that biocomputing does not strictly adhere to absolute determinism but, instead, it conforms to a weaker form of determinism: relative determinism. The neural signaling mechanism features a probabilistic control law at the mesoscopic level but resumes a well-defined control law at the macroscopic level. Since events at these two levels are connected in series, a probabilitistic control law, once introduced, renders the entire process of biocomputing short of absolutely deterministic, but not completely random.
9. Long-Term Potentiation and Synaptic Plasticity Memory is one of the most important components in biocomputing. It is a prerequisite for higher mental processes such as consciousness and intelligence. With the development of modern neuroscience, memory research has become linked to cellular and molecular processes in the nervous system. The advent of techniques, such as positron emission tomography (PET), event-related brain potential (ERP), and functional magnetic resonance imaging (fMRI), permits accurate localization of brain activities that accompany conscious acts. Although full elucidation remains elusive, consid-
Bicomputing Survey I
101
erable progress has been made to render a discussion at the cellular and molecular level possible. About half a century ago, Hebb157 pioneered a model of memory in which the memory is not stored in a discrete location but rather distributed in the collective property of the synaptic connections in a neural network. In the Hebbian model, processes such as learning lead to changes of synaptic weights (strengths), and the stored information (memory) is represented by the characteristic distribution of synaptic weights of synapses among a population of neurons that form the neural network.121 The model is thus rich with a flavor of parallel distributed processing. The Hebbian model of memory is thus a type of associative memory. The profound influence of the Hebbian model is witnessed by the birth and prosperity of artificial neural network research (Sec. 7.2 of Chapter 2; see also Refs. 189, 99). Presently, memory research is one of the most active areas in neuroscience. The Hebbian model was meant to be a simplified model of neural plasticity. The real neural network and synaptic plasticity is of course far more complicated. Among numerous examples of activity-dependent modifications of synapses, long-term potentiation (LTP) stands out as the most studied candidate of memory substrates.260-24'215'27'25'26'261'31 It provides an excellent example of vertical information coupling involving the microscopic, the mesoscopic and the macroscopic computational dynamics. Long-term potentiation is the collective feature of synaptic processes in which a brief burst of repetitive activation of presynaptic fibers leads to an enhancement of the excitatory synaptic strength that lasts from hours to weeks or longer. LTP was first reported in the hippocampal formation,259 and was subsequently found in other parts of the brain. In one type of LTP, the induction is the result of the activation of the NMDA (iV-methyl-D-aspartate)-receptor (one of several types of glutamate receptors), which was once billed as the "Holy Grail of neurotransmitterreceptor molecular neurobiology." Cloning of the NMDA receptor in 1991 was thus one of the major events of neurobiology.283'236 The induction is peculiar in its requirement of the co-activation of two different types of synaptic activities:260'89'68'298 a) the presence of a neurotransmitter (glutamate), and b) the presence of membrane depolarization. The depolarization is caused by the activation of a non-NMDA glutamate receptor, such as the AMPA (a-amino-3-hydroxy-5-methyl-4-isoxazolepropionate) receptor. The NMDA-receptor channel is blocked by Mg2+, and depolarization relieves the blockade. Thus, the activation of NMDA-receptors is both ligand-dependent and voltage-dependent; it is a cooperative phenomenon.
102
F. T. Hong
The NMDA-channels so opened are permeable to Ca2+. The Ca2+ influx is crucial to the development of LTP; microinjection of a calcium chelator prevents the induction of LTP and the release of Ca2+ via photoactivation of caged Ca2+ leads to potentiation. However, the rise of intracellular Ca2+ concentration is only transient; other processes must be involved in sustaining LTP. The following summary must be considered highly tentative because LTP research is characterized by a lack of consensus and because advances in LTP research are made with a rapid pace. A popular hypothesis links the transient rise of the intracellular Ca2+ concentration to Ca2+-dependent protein kinases such as protein kinase C or Ca2+-calmodulin dependent protein kinase II (CaMK II). CaMK II is known to undergo autophosphorylation (a positive feedback mechanism), making it an effective biochemical switch. Activation of the NMD A-receptor also produces a retrograde signal that acts on the presynaptic terminal. Nitric oxide (NO), carbon monoxide (CO), and a couple of other biomolecules have been implicated as the retrograde diffusible signal.171'269'155 As a result, subsequent activities in the presynaptic terminal release an increased quantity of the neurotransmitter glutamate. An alternative possibility is the induction of an increased number of glutamate receptors.298 The diffusible signal may spread and induce LTP in neighboring synapses directly or indirectly, and neighboring synapses may exert synergistic effect on each other.337'338 This effect that confers spatial uncertainty to synaptic plasticity seems rather general. Barbour and Hausser20 pointed out that a large number of experimental observations are consistent with "cross-talk" or "spill-over" as a result of miersynaptic diffusion of neurotransmitters. These investigators predicted, by means of a simple model, that, during concentrated synaptic activity, a cross-talk between distinct synapses is likely to activate high-affinity receptors and may also desensitize certain receptors. The determinism entailed by specific pathways in a neural network is somewhat degraded (relative determinism). It is an intriguing possibility that the randomness so introduced may contribute to the subtle variability required by creative problem solving (Sec. 4 of Chapter 2). The role of presynaptic protein kinase is implicated in the action of the unknown retrograde messenger. LTP induction also exhibits associativity: a repetitive activation of a weak input that is not strong enough to induce LTP by itself can do so when taking place in close temporal contiguity with repetitive activation of a separate but stronger input to the same neuron. A discussion with regard to the role of CREB (cyclic AMP responsive element binding protein) in long-term potentiation and memory can be found in a
Bicomputing Survey I
103
review article by Silva et al.347 The dynamic state of synaptic plasticity is also reflected in a similar state of cortical sensory maps of adult animals that represent different body parts.51 The cortical maps are continuously modified by experience; the cortex can preferentially allocate cortical areas to represent the selected (and augmented) peripheral inputs. A similar dynamic state of plasticity is also evident in the primary motor cortex.327 Compelling evidence in support of the role of LTP induction in learning is derived from studies of LTP in the amygdala.263 Amygdala is a component of the neural circuit governing emotional learning and memory88'242 (see Sec. 4.17 of Chapter 2 for the self-referential control of knowledge acquisition proposed by Korner and Matsumoto229'230). There are several lines of evidence: a) antagonists of the NMD A receptor block LTP induction in the amygdala and Pavlovian fear conditioning, b) fear conditioning induces increases in synaptic transmission in the amygdala that resembles LTP, and c) genetic manipulations that disrupt LTP induction in the amygdala also eliminate fear conditioning. A role for CaMK II in spatial learning and memory has been demonstrated.120 A similar phenomenon known as the long-term depression (LTD) was first found in the cerebellum, and subsequently in other brain parts such as hippocampus.253'28'86 The induction of LTD is similar. LTD is generally thought to be the reverse process of LTP. That the NMDA receptor is a central player in memory processes was more directly demonstrated by Tsien and coworkers,374 who engineered a mouse named Doogie by modifying subunits of NMDA receptors in the brain region. Doogie exhibited superior ability in learning, as compared to normal mice. 10. Role of Dendrites in Information Processing In the classical picture, dendrites are regarded as the sites of synaptic inputs to a neuron. Interactions of excitatory and inhibitory postsynaptic potentials, which are similar to EPP but appear at synapses between two neurons, constitute the integration within a neuron that determines whether a new action potential is to be initiated at the soma-axon hillock region of the neuron. Dendrites thus assume a passive role in the classical interpretation. However, such a view is no longer tenable in our contemporary understanding. Pribram has previously emphasized the importance of dendritic microprocessing (e.g., see pp. 275-293 of Ref. 312).
104
F. T. Hong
The shapes and sizes of dendrites of different neurons exhibit striking diversity. Dendrites grow significantly during development, especially when the animal is reared in a sensory-rich environment.141 Diverse active properties were found in dendrites, since the advent of the fluorescence imaging and the patch clamp techniques. The subject has been reviewed by Johnston et al.208 The conclusions were based on experiments done in hippocampal pyramidal neurons, cerebellar Purkinje cells, and neocortical pyramidal neurons. Some salient points are summarized below. There is little doubt that dendrites propagate action potentials, in addition to electrotonically spreading postsynaptic potentials to the soma. Action potentials initiated at the soma-axon hillock region propagate antidromically back into dendrites. Action potentials can also start from synapses at dendrites and propagate orthodromically towards the soma. Dendritic membranes contain Na+ channels more or less uniformly. However, the distribution of Ca+2 channels is more varied than Na+ channels and a great deal of diversity of different types of Ca2+ channels appear in different parts of dendrites and in different types of neurons. However, very little is known about K+ channels. Conventional wisdom used to regard the space constant of dendrites as too small to allow local graded postsynaptic potentials generated at the synapses to spread electrotonically to the soma. Precise data of time and space constant measurements revealed that these local potentials do reach the soma electrotonically. The interplay between local graded postsynaptic responses and action potentials that propagate in both orthodromic and antidromic directions essentially creates an intraneuronal network that involves both mesoscopic and microscopic events. Johnston et al.208 speculated about possible roles of dendritic processes in synaptic integration and neuronal plasticity. A possible important role of dendritic voltage-gated (Na+ and Ca2+) channels is boosting local postsynaptic activities. Although excitatory postsynaptic potentials originating in dendrites can reach the soma, they are attenuated several fold before reaching the soma owing to the cable property of dendrites (electrotonic attenuation due to a small space constant). Activation of voltage-gated channels helps sustain these graded responses beyond their "normal" range dictated by the space constant. On the other hand, the antidromic propagation of action potentials from the soma-axon hillock region back to the dendrites serves to reset these local responses. Timing of the interplay between these two types of electrical events critically affects how information processing is carried out within the same
Bicomputing Survey I
105
neuron. The changes of the intracellular Ca2+ concentration is worth noting. A consistent finding in hippocampal pyramidal neurons during trains of action potentials is a characteristic M-shaped profile of the intracellular Ca2+ concentration. The rise in the intracellular Ca2+ concentration is small in the soma, highest in the proximal apical and basal dendrites and small again in the distal apical dendrites. Evidence suggests that the characteristic distribution is not a consequence of a non-uniform distribution of Ca2+ channels, but rather due to the uneven Ca2+ influx driven by iVa+-dependent action potentials. This characteristic is reminiscent of the spike-like Ca2+ concentration profile under the active zone of a synapse during the voltage-gated Ca2+ influx (Sec. 7.4). Both of them are dynamic entities. Voltage-gated Ca2+ channels are present throughout the dendritic tree of hippocampal pyramidal neurons. However, there appears to be a differential distribution of Ca2+ channels types in the soma and dendrites. In contrast, cerebellar Purkinje cell dendrites lack ./Va+-dependent action potentials. However, neocortical dendrites are capable of sustaining action potentials, both Na+ and Ca2+-dependent. The diverse variety of Ca2+ channels (e.g., high-voltage gated vs. lowvoltage gated) and their elaborate distribution along the dendritic tree offers the potential of modulating events such as LTPs and LTDs since activation of these channels will alter the Ca2+ concentration in the dendrites (Sec. 9). Different levels of concentration changes may produce different types of plasticity.10-254 Thus, the dendritic processes may impact on neuronal plasticity in a profound way. In this regard, two types of Ca2+ concentration changes need to be differentiated. The subthreshold Ca2+ entry caused by activation of low-threshold Ca2+ channels tends to be highly localized. The superthreshold Ca2+ entry caused by back propagating action potentials tends to be global. 11. Efficiency of Biocomputing The "disanalogy" between the human brain and a digital computer is summed up in the trade-off principle proposed by Conrad.82'76 The tradeoff principle states that "a computing system cannot have all of the following three properties: structural programmability, high computational efficiency, and high evolutionary adaptability." A von Neumann type sequential machine is structurally programmable mainly because all internal dynamic processes are suppressed and are, in fact, material-independent in
106
F. T. Hong
its operation. A digital computer could employ any kind of switches: from the primitive abacus, or mechanical calculators, to digital computers constructed with vacuum tubes or state-of-the-art solid state components. As a consequence, it is possible for a digital computer to have a finite and simple user manual. The hardware of a digital computer consists of a small number of building blocks such as logic gates and flip-flops, and its complexity lies in the combinations and interconnections. Likewise, the assembly (programming) language consists of a small vocabulary (program instruction set); the complexity lies in the software which is a linear linkage of these codes with well-defined branching sequences. As for a living organism, its operation critically depends on the internal dynamics of its constituents, as depicted by the M-m-m scheme of Conrad. The internal dynamics comprises a myriad of interactions at several different levels of hierarchy. These interactions are what Rosen referred to as causal entailments.323 Now the Human Genome Project has been completed by two competing teams, among bitter disputes, at about the same time,196'382 and a "blue print" for the "design" of human body is now available. However, according to Conrad's interpretation,74'82 it is not a complete user manual in the conventional sense, because the g