Integrated Circuits and Systems
Series Editor Anantha P. Chandrakasan Massachusetts Institute of Technology Cambridge, Massachusetts
For further volumes: http://www.springer.com/series/7236
Abbas Sheibanyrad€•€Frédéric Pétrot€•€Axel Jantsch Editors
3D Integration for NoC-based SoC Architectures
1 3
Editors Abbas Sheibanyrad TIMA Laboratory 46, Avenue Felix Viallet 38000 Grenoble France
[email protected]
Axel Jantsch Royal Institute of Technology Forum 120 SE-16440 Kista Sweden
[email protected]
Frédéric Pétrot TIMA Laboratory 46, Avenue Felix Viallet 38000 Grenoble France
[email protected]
ISSN 1558-9412 ISBN 978-1-4419-7617-8â•…â•…â•…â•… e-ISBN 978-1-4419-7618-5 DOI 10.1007/978-1-4419-7618-5 Springer New York Dordrecht Heidelberg London Library of Congress Control Number: © Springer Science+Business Media, LLC 2011 All rights reserved. This work may not be translated or copied in whole or in part without the written permission of the publisher (Springer Science+Business Media, LLC, 233 Spring Street, New York, NY 10013, USA), except for brief excerpts in connection with reviews or scholarly analysis. Use in connection with any form of information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed is forbidden. The use in this publication of trade names, trademarks, service marks, and similar terms, even if they are not identified as such, is not to be taken as an expression of opinion as to whether or not they are subject to proprietary rights. Printed on acid-free paper Springer is part of Springer Science+Business Media (www.springer.com)
â•…
Preface
3D integration technologies, 3D-Design techniques, and 3D-Architectures are emerging as truly hot and broad research topics. As the end of scaling the CMOS transistor comes in sight, the third dimension may come to the rescue of the industry to allow for a continuing exponential growth of integration during the 2015–2025 period. As such 3D stacking may be the key technology to sustain growth until more exotic technologies such as nanowires, quantum dot devices and molecular computers become sufficiently mature for deployment in main stream application areas. The present book gathers the recent advances in the domain written by renowned experts to build a comprehensive and consistent book around the topics of threedimensional architectures and design techniques. In order to take full advantage of the 3D integration, the decision on the use of in-circuit vertical connection (predominantly Through-Silicon-Vias (TSVs) and Inductive Wireless Interconnects) must come upfront in the architecture planning process rather than as a packaging decision after circuit design is completed. This requires taking the 3D design space into account right from the start of the system design. Previously published books about this active research domain focus on fabrication technologies and physical aspects, rather than network and system-level architectural concerns. In contrast, the present book covers almost all architectural design aspects of 3D-SoCs, and as such can be useful both for introducing the current research topics to researchers and engineers, giving a basis for education and training in M.Sc. and Ph.D. programs. The book is divided into three parts. The first part, which contains two chapters, deals with the promises and challenges of 3D integration. Chapter€1 introduces 3D integration of Integrated Circuits, and as an objective, discusses performance enhancement, as well as new integration capabilities, enabled technology platforms, and potential applications made possible by 3D technology. Chapter€2 elaborates on the promises and limitation of 3D integration by studying the limits of performance under different memory distribution constraints of various 2D and 3D topologies in current and future technology nodes. The second part of the book consists of four chapters. It discusses technology and circuit design of 3D integration. Chapter€3 focuses on the available solutions and open challenges for testing 3D Stacked ICs (3D-SICs). It provides an overview v
vi
Preface
of the manufacturing steps of TSV-based 3D-SICs relevant for the testing issues. Chapter€4 reviews the process of 3D-IC designing exploiting Through-Silicon-Via technology, and introduces the notion of re-architecting systems explicitly to exploit high density TSV processes. Chapter€5 investigates physical properties of NoC topologies for 3D integrated systems. It describes an enhanced physical analysis methodology, providing a means to estimate early in the design cycle the behavior of a 3D topology for an integrated system interconnected with an on-chip network. Chapter€6 characterizes the performance of multiple 3D NoC architectures in the presence of realistic traffic patterns through cycle-accurate simulation and establishes the performance benchmark and related design trade-offs. The last part of the book includes five chapters that globally concern system and architecture design of 3D integration. Chapter€7 makes a case for using asynchronous circuits to implement 3D-NoCs. It claims that asynchronous logic allows for serializing vertical links, leading to the definition of innovative architectures which, by reducing the number of TSVs, can address some critical issues of 3D integration. Chapter€8, by supporting both unicast and multicast traffic flows, considers the problem of designing application-specific 3D-NoC architectures that are optimized for a given application. Chapter€9 presents methodologies and tools for automated 3D interconnect design, focusing on application-specific 3D-NoC synthesis which consists of finding the best NoC topology for the application, computing paths for the communication flows, assigning network components onto the layers of the 3D stack, and placing them in each layer. Chapter€10 describes constructing 3D-NoCs based on inductive-coupled wireless interconnect in which the data modulated by a driver are transferred between two inductors placed at exactly the same position of two stacked dies. Chapter€11 discusses how 3D technology can be implemented in GPUs. It investigates the problems and constraints of implementing such a technology and proposes architectural designs for a GPU that implements 3D technology and evaluates these designs in terms of fabrication cost, power consumption and thermal profile. We greatly appreciate all the authors’ hard work that led to their valuable contributions, whose patience and support are the basis for the production of this book. Their innovations and comprehensive presentations make this book novel, unique and useful. We also thank the publisher for his strong support and quick actions that made a speedy and timely publication possible. We sincerely hope that you will find reading this book as exciting and informative as we have done when selecting and discussing the content. Abbas Sheibanyrad Frédéric Pétrot Axel Jantsch
Contents
I╅╇╛╛3DI Promises and Challenges ����������������������������������尓������������������������������ ╅╇ 1 1╅╇╛Three-Dimensional Integration of Integrated Circuits—an Introduction ����������������������������������尓����������������������������������� ╅╇ 3 Chuan Seng Tan 2╅╇╛The Promises and Limitations of 3-D Integration ������������������������������� â•… 27 Axel Jantsch, Matthew Grange and Dinesh Pamunuwa II╅╛╛╛Technology and Circuit Design ����������������������������������尓��������������������������� â•… 45 3╅╇╛Testing 3D Stacked ICs Containing Through-Silicon Vias ����������������� â•… 47 Erik Jan Marinissen 4╅╇╛Design and Computer Aided Design of 3DIC ����������������������������������尓���� â•… 75 Paul D. Franzon, W. Rhett Davis and Thor Thorolfsson 5╅╇╛Physical Analysis of NoC Topologies for 3-D Integrated Systems ����� â•… 89 Vasilis F. Pavlidis and Eby G. Friedman 6╅╇╛Three-Dimensional Networks-on-Chip: Performance Evaluation ���� ╇ 115 Brett Stanley Feero and Partha Pratim Pande IIIâ•… System and Architecture Design ����������������������������������尓������������������������� ╇ 147 7╅╇╛Asynchronous 3D-NoCs Making Use of Serialized Vertical Links ���� ╇ 149 Abbas Sheibanyrad and Frédéric Pétrot 8╅╇╛Design of Application-Specific 3D Networks-onChip Architectures ����������������������������������尓������������������������������������尓������������ ╇ 167 Shan Yan and Bill Lin
vii
viii
Contents
╇ 9╅3D Network on Chip Topology Synthesis: Designing Custom Topologies for Chip Stacks����������������������������������尓�������������������� ╅ 193 Ciprian Seiculescu, Srinivasan Murali, Luca Benini and Giovanni De Micheli 10╅3-D NoC on Inductive Wireless Interconnect����������������������������������尓���� ╅ 225 Hiroki Matsutani, Michihiro Koibuchi, Tadahiro Kuroda and Hideharu Amano 11╅Influence of Stacked 3D Memory/Cache Architectures on GPUs����� ╅ 249 Ahmed Al Maashri, Guangyu Sun, Xiangyu Dong, Yuan Xie and Narayanan Vijaykrishnan Index ����������������������������������尓������������������������������������尓������������������������������������尓����� ╅ 273
Contributors
Ahmed Al Maashriâ•… The Pennsylvania State University, University Park, PA, USA Hideharu Amanoâ•… Keio University, Yokohama, Japan Luca Beniniâ•… The University of Bologna, Bologna, Italy W. Rhett Davisâ•… The North Carolina State University, Raleigh, NC, USA Giovanni De Micheliâ•… EPFL, Lausanne, Switzerland Xiangyu Dongâ•… The Pennsylvania State University, University Park, PA, USA Brett Stanley Feeroâ•… ARM Inc., Austin, TX, USA Paul D. Franzonâ•… The North Carolina State University, Raleigh, NC, USA Eby G. Friedmanâ•… University of Rochester, Rochester, NY, USA Matthew Grangeâ•… Lancaster University, Lancaster, UK Axel Jantschâ•… Royal Institute of Technology, Sweden Michihiro Koibuchiâ•… Japanese National Institute of Informatics, Tokyo, Japan Tadahiro Kurodaâ•… Keio University, Yokohama, Japan Bill Linâ•… University of California, San Diego, CA, USA Erik Jan Marinissenâ•… IMEC, Leuven, Belgium Hiroki Matsutaniâ•… The University of Tokyo, Tokyo, Japan Srinivasan Muraliâ•… EPFL, Lausanne, Switzerland Dinesh Pamunuwaâ•… Lancaster University, Lancaster, UK Partha Pratim Pandeâ•… Washington State University, Pullman, WA, USA Vasilis F. Pavlidisâ•… EPFL, Lausanne, Switzerland Frédéric Pétrotâ•… TIMA Laboratory, Grenoble, France
ix
x
Contributors
Ciprian Seiculescuâ•… EPFL, Lausanne, Switzerland Abbas Sheibanyradâ•… TIMA Laboratory, Grenoble, France Guangyu Sunâ•… The Pennsylvania State University, University Park, PA, USA Chuan Seng Tanâ•… Nanyang Technological University, Singapore Thorlindur Thorolfssonâ•… The North Carolina State University, Raleigh, NC, USA Narayanan Vijaykrishnanâ•… The Pennsylvania State University, University Park, PA, USA Yuan Xieâ•… The Pennsylvania State University, University Park, PA, USA Shan Yanâ•… University of California, San Diego, CA, USA
â•…
Part I
3DI Promises and Challenges
â•…
Chapter 1
Three-Dimensional Integration of Integrated Circuits—an Introduction Chuan Seng Tan
1.1â•…Background and Introduction Imagine a situation where you need to travel between your home and office every day. You need to put up with time lost during commute as well as paying for the fuel. One possible solution is to have your home in another floor of your office building. In this way, all you need to do is to go up and down between floors and you can save time and cost. This simple idea can similarly be applied to boost the overall performance in future integrated circuits. For the past 40 over years, higher computing power was achieved primarily through commensurate performance enhancement of transistors as a result of continuously scaling down the device dimensions in a harmonious manner. This has resulted in a steady doubling of device density from one technology node to another as famously described by Moore’s Law. Improvement in transistor switching speed and count are two of the most direct contributors to the historical performance growth in integrated circuits (particularly in silicon-based digital CMOS). This scaling approach has been so effective in many aspects (performance and cost) that integrated circuits have essentially remained a planar platform throughout this period of rigorous scaling. As performance enhancement through geometrical scaling becomes more challenging and demand for higher functionality increases, there is tremendous interest and potential to explore the third dimension, i.e., the vertical dimension of the integrated circuits. This was rightly envisioned by Richard Fenyman, physicist and Nobel Laureate, when he delivered a talk on “Computing Machines in the Future” in Japan in 1985. His original text reads: “Another direction of improvement (in computing power) is to make physical machines three dimensional instead of all on a surface of a chip. That can be done in stages instead of all at once—you can have several layers and then add many more layers as time C. S. Tan () School of Electrical and Electronic Engineering, Nanyang Technological University, 50 Nanyang Avenue, 639798 Singapore Tel.: +65-67905636 e-mail:
[email protected] A. Sheibanyrad et al. (eds.), 3D Integration for NoC-based SoC Architectures, Integrated Circuits and Systems, DOI 10.1007/978-1-4419-7618-5_1, ©Â€Springer Science+Business Media, LLC 2011
3
4
C. S. Tan
goes on” [1]. The need for 3D integration has become clear going forward and it was reiterated by Dr. Chang-Gyu Hwang, President and CEO of Samsung Electronics’ Semiconductor Business, when he delivered a keynote speech at the 2006 International Electron Devices Meeting (IEDM) in San Francisco entitled “New Paradigms in the Silicon Industry” [2]. Some important points of his speech are quoted: “The approaching era of electronics technology advancement—the Fusion Era—will be massive in scope, encompassing the fields of information technology (IT), bio-technology (BT), and nano-technology (NT) and will create boundless opportunities for new growth to the semiconductor industry. The core element needed to usher in the new age will be a complex integration of different types of devices such as memory, logic, sensor, processor and software, together with new materials, and advanced die stack technologies, all based on 3-D silicon technology.”
1.2â•…Motivations and Drivers This section examines the role of 3D integration in ensuring that performance growth enjoyed by the semiconductor industry as a direct result of geometrical scaling, coupled with the introduction of performance boosters in more recent nodes, as predicted by Moore’s Law can continue in the future. Scaling alone has met with diminishing return due to fundamental and economics scaling barriers (non-commensurate scaling). 3D integration explores the third dimension of IC integration and offers new dimension for performance growth. 3D integration also enables integration of disparate chips in a more compact form factor and it is touted by many as an attractive method for system miniaturization and functional diversification commonly known as heterogeneous integration.
1.2.1 Sustainable IC Performance Growth Beginning with the invention of the first integrated circuit in 1958 by Kilby and Noyce, the world has witnessed sustainable performance growth in IC. The trend is best exemplified by the exponential improvement in computing power (measured in million instructions per second, MISP) in Intel’s micro-processors over the last 40€years as shown in Fig.€1.1 [3]. This continuous growth is a result of the ability to scale silicon transistor to smaller dimension in every new technology nodes. The growth continued, instead of hitting a plateau, in more recent nodes thanks to the addition of performance boosters (e.g., strained-Si, high-κ and metal gate, etc) on top of conventional geometrical scaling. Scaling doubles the number of transistors on IC (famously described by “Moore’s Law”) in every generation and allows us to integrate more functions on IC and to increase its computing power. We are now in the Giga-scale integration era featured by billions of transistors, GHz operating frequency, etc. Going forward to Tera-scale integration, however, there are a number of imminent show-stoppers (described in the next section) that pose serious threat to continuous performance
1â•… Three-Dimensional Integration of Integrated Circuits—an Introduction Fig. 1.1↜渀 The evolution of computing performance. (Source: Intel)
5
1.E+06 TIPS
1.E+05 1.E+04 MIPS
1.E+03 1.E+02 1.E+01 1.E+00 1.E-01 1.E-02 1960
1980
2000
2020
enhancement in IC and a new paradigm shift in IC technology and architecture is needed to sustain the historical growth. It is widely recognized that the growth can be sustained if one utilizes the vertical (i.e., the third) dimension of IC to build three-dimensional IC, a departure from today’s planar IC as projected in Fig.€1.2. Three-dimensional integrated circuits (3D IC) refers to a stack consists of multiple ultra-thin layers of IC that are vertically bonded and interconnected with through silicon via (TSV) as shown in Fig.€1.3. In 3D implementation, each block can be fabricated and optimized using their respective technologies and assembled to form a vertical stack. 3D stacking of ultra-thin ICs is identified as an inevitable solution for future performance enhancement, system miniaturization, and functional diversification.
Performance
Architectural 3D Integration Business as usual Performance Boosters (Cu/low-k, Strain, HK/MG, High- channels, 3D structures) Business as usual
Geometrical Scaling
1990s
2000s
Year
Fig. 1.2↜渀 Historical IC performance growth can be sustained with a new paradigm shift to 3-D integration
6
C. S. Tan
Fig. 1.3↜渀 A conceptual representation of 3D IC
Device/Interconnect
Through Silicon Via
Layer 4 Layer 3 Layer 2
Bonding Interface
Layer 1 (Substrate)
1.2.2 Show-Stoppers and 3-D Integration as a Remedy 1.2.2.1╅Transistor Scaling Barriers There are at least two barriers that will slow down or impede further geometrical scaling. The first one relates to the fundamental properties of transistor in extremely scaled devices. Experimental and modeling data suggest that performance improvement in devices is no longer commensurate with ideal scaling in the past due to high leakage and parasitic hence they consume more power. This is shown in Fig.€1.4 by Khakifirooz and Antoniadis [4]. The intrinsic delay of n-MOS is shown to increase beyond the 45€nm despite continuous down scaling of the transistor pitch.
RO Stage Delay Intrinsic NMOS
Delay (ps)
10
1
Fig. 1.4↜渀 The intrinsic delay in n-MOS transistor is projected to increase in future nodes despite continuous down scaling of the device pitch [4]
45 nm Target @ 32 nm
10
100 Technology Node (nm)
600
Frequency
0
300
1,500 1,000 500 0
Frequency
7
900
1â•… Three-Dimensional Integration of Integrated Circuits—an Introduction
0
1 2 3 4 Normalized Leakage Current
5
0.7
0.8 0.9 1.0 1.1 1.2 1.3 Normalized Threshold Voltage
Fig. 1.5↜渀 Measured leakage current and threshold voltage in 65€nm devices reported by IBM [6]
Another issue related to scaled devices is variability [5]. Variability in transistor performance and leakage is a critical challenge to the continued scaling and effective utilization of CMOS technologies with nanometer-scale feature sizes. Some of the factors contributing to the variability increase are fundamental to the planar CMOS transistor architecture. Random dopant fluctuations (RDFs) and line-edge roughness (LER) are two examples of such intrinsic sources of variation. Other reasons for the variability increase are the advanced resolution-enhancement techniques (RETs) required to print patterns with feature sizes smaller than the wavelength of lithography. Transistor variation affects many aspects of IC manufacturing and design. Increased transistor variability can have negative impact on product performance and yield. Figure€1.5 shows measurement data reported by IBM on its 65€nm devices that clearly show variation in leakage current and threshold voltage. Variability worsens as we continue to scale in future technology nodes and it is a severe challenge. The second barrier concerns the economic aspect of scaling. The development and manufacturing cost has increased from one node to another making scaling a less favorable option in future nodes of IC. 3D integration on the other hand achieves device density multiplication by stacking IC layers in the third dimension without aggressive scaling. Therefore it can be a viable and immediate remedy as conventional scaling becomes less cost effective. 1.2.2.2â•…On-Chip Interconnect While dimensional scaling has consistently improved device performance in terms of gate switching delay, it has a reverse effect on global interconnect latency [7]. The global interconnect RC delay has increasingly become the circuit performance limiting factor especially in the deep sub-micron regime. Even though Cu/low-κ multilevel interconnect structures improve interconnect RC delay, they are not a long-term solution since the diffusion barrier required with Cu metallization has a finite thickness that is not readily scaled. The effective resistance of the interconnect
8
C. S. Tan
2-D wires C0
C1
C2
C3
C4
C5
C4
C3
C0
C1
C2
C5
3-D wires
Wire Counts
a
b
3-D
2-D
Wire Length
Fig. 1.6↜渀 a Long global wires on IC can be shortened by chip partitioning and stacking. b 3D integration reduces the number of long wires on IC
is larger than would be achieved with bulk copper, and the difference increases with reduced interconnect width. Surface electron scattering further increases the Cu line resistance, and hence the RC delay suffers [8]. When chip size continues to increase to accommodate for more functionalities, the total interconnects length increases at the same time. This causes a tremendous amount of power to be dissipated unnecessarily in interconnects and repeaters used to minimize delay and latency. On-chip signals also require more clock cycles to travel across the entire chip as a result of increasing chip size and operating frequency. Rapid rise in interconnects delay and power consumption due to smaller wire cross-section, tighter wire pitch, and longer lines that transverse across larger chips is severely limiting IC performance enhancement in current and future nodes. 3D IC with multiple active Si layers stacked vertically is a promising method to overcome this scaling barrier as it replaces long inter-block global wires with much shorter vertical inter-layer interconnects as shown in Fig.€1.6. 1.2.2.3â•…Off-Chip Interconnect (Memory Bandwidth Gap) Figure€1.7a depicts the memory hierarchy in today’s computer system in which the processor core is connected to the memory (DRAM) via power-hungry and slower off-chip buses on the board level. Data transmission on these buses experiences
1â•… Three-Dimensional Integration of Integrated Circuits—an Introduction Fig. 1.7↜渀 a Memory Hierarchy in today computer system. b Direct placement of memory on processor improves the data bandwidth
On-chip Wires
Core
9
off-chip Buses
Main Memory (DRAM)
Cache
a TSV
Memory Processor Core
b
severe delay and consumes significant amount of power. The number of available bus channels is also limited by the amount of external pin count available on the packaged chips. As a consequence, the data bandwidth suffers. As the computing power in processor increases in each generation, the limited bandwidth between processor core and memory places a severe limitation on the overall system performance [9]. The problem is even more pressing in multi-core architecture as every core will demand for data supply. To close this gap, the most direct way is to shorten the connections and to increase the number of data channels. By placing memory directly on processor, the close proximity shortens the connections and the density of connections can be increased by using more advanced CMOS processes (as opposed to packaging/assembly processes) to achieve fine-pitch TSV. This massively parallel interconnection is shown in Fig.€1.7b. Table€1.1 is a comparison between 2D and 3D implementations in terms of connection density and power consumption. Clearly, 3D can provide bandwidth enhancement (100X increment at the same frequency) at lower power consumption (10X reduction). Effectively, this translates into 1,000X improvement in bandwidth/power efficiency, an extremely encouraging and impressive number.
Table 1.1↜渀 Comparison of 2D and 3D implementations € 2D Connections density <1e3€per cm2 *Power consumption per pin/via 30–40€mW Total power consumption (per cm2) 30–40€W *Data from Tezzaron [10].
3D ~1e5€per cm2 ~25€µW 2.5€W
Remark 100X increment € 10X reduction
10
C. S. Tan
1.3â•…Options of 3D IC 1.3.1 System Integration Landscape System integration, that is, the integrating together of circuits or intellectual property (IP) blocks, is one of the major applications of 3D integration. As such, 3D integration must compete against a number of established technologies. Figure€1.8 compares the relative capability of several system integration methods (board, 2D multi-chip module—2D-MCM, package-on-package—PoP, system-in-package— SiP, and 2D system-on-chip—2D-SoC) in terms of form factor and interconnects density between circuit blocks [11]. 3D integration offers more compact form factor and higher chip-to-chip interconnects density [11, 12]. Comparing with 2D-SoC, 3D integration shortens time-to-market and lowers the system cost. By using larger number of smaller and shorter through silicon via (TSV) as compared to wire bonding in SiP, performance is enhancement via 3D integration due to smaller latency and higher bandwidth, as well as smaller power consumption.
1.3.2 Classification There are a number of technology options to arrange integrated circuits in a vertical stack. It is possible to stack ICs in a vertical fashion at various stages of process-
larger
Board
Form Factor
2D MCM
smaller
PoP pkg-on-pkg SiP stacked w wirebond
SoC System-on-chip
3D
Circuit-to-Circuit Interconnect Density
increasing
Fig. 1.8↜渀 Comparison of various system integration technologies in terms of form factor and circuit-to-circuit interconnect density [11, 12]
1â•… Three-Dimensional Integration of Integrated Circuits—an Introduction
11
ing: (1) post-singulation 3D packaging (e.g., chip-to-chip), and (2) pre-singulation wafer level 3-D integration (e.g., chip-to-wafer, wafer-to-wafer, and monolithic approaches). Active layers can be vertically interconnected using physical contact such as bond wire or interlayer vertical via (including TSV). It is also possible to establish chip to chip connection via non-contact (or wireless) links such as capacitive and inductive couplings [13]. Capacitive coupling utilizes a pair of electrodes that are formed using conventional IC fabrication. The inductive-coupling I/O is formed by placing two planar coils (planar inductors) above each other and is also made using conventional IC fabrication. The advantages of these approaches are fewer processing steps hence lower cost, no requirement for ESD protection, low power, and smaller area I/O cell. Since there is substantial overlap between various options and lack of standardization in terms of definition, classification of 3D IC technology is often not straight forward. This chapter makes an attempt to classify 3D IC based on the processing stage when stacking takes place.
1.3.3 Monolithic Approaches In these approaches, devices in each active layer are processed sequentially starting from the bottom-most layer. Devices are built on a substrate wafer by mainstream process technology. After proper isolation, a second device layer is formed and devices are processed by conventional means on the second layer. This sequence of isolation, layer formation, and device processing can be repeated to build a multilayer structure. The key technology in this approach is forming a high quality active layer isolated from the bottom substrate. This bottom-up approach has the advantage that precision alignment between layers can be accomplished. However, it suffers from a number of drawbacks. The crystallinity of upper layers is usually low and imperfect. As a result, high performance devices cannot be built in the upper layers. Thermal cycling during upper layer crystallization and device processing can degrade underlying devices and therefore a tight thermal budget must be imposed. Due to the sequential nature of this method, manufacturing throughput is low. A simpler FEOL process flow is feasible if polycrystalline silicon can be used for active devices; however, a major difficulty is to obtain high-quality electrical devices and interconnects. While obtaining single-crystal device layers in a generic IC technology remains in the research stage, polycrystalline devices suitable for non-volatile memory (NVM) have not only been demonstrated but have been commercialized (for example by SanDisk). A key advantage of FEOL-based 3-D integration is that IC BEOL and packaging technologies are unchanged; all the innovation occurs in 3-D stacking of active layers. A number of FEOL techniques include: laser beam recrystallization [14, 15], seeding-assisted recrystallization [16, 17], selective epitaxy and over-growth [18], and grapho-exitaxy [19].
12
C. S. Tan
1.3.4 Assembly Approaches This is a parallel integration scheme in which fully processed or partially processed integrated circuits are assembled in a vertical fashion. Stacking can be achieved with one of these methods: (1) chip-to-chip, (2) chip-to-wafer, and (3) wafer-towafer. Vertical connection in chip to chip stacking can be achieved using wire bond as shown in Fig.€1.9 or through silicon via (TSV) as shown in Fig.€1.10. Wafer level 3D integration, such as chip-to-wafer and wafer-to-wafer stacking, use TSV as the vertical interconnect. This integration approach often involves a sequence of wafer thinning and handling, alignment, TSV formation, and bonding. The key differentiators are: • Bonding medium—metal-to-metal, dielectric-to-dielectric (oxide, adhesive, etc) or hybrid bonding; • TSV formation—via first, via middle or via last; • Stacking orientation—face-to-face or back-to-face stacking; • Singulation level—chip-to-chip, chip-to-wafer or wafer-to-wafer.
Fig. 1.9↜渀 Stacked die with wire bond interconnections in a chip-scale package [20]
Top Chip TSV Bottom Chip
Fig. 1.10↜渀 3D chip stacking using through silicon via [21]
Package
1â•… Three-Dimensional Integration of Integrated Circuits—an Introduction
ILD
ILD
Vertical Via Cu
Dielectric
ILD
Vertical Via Cu
13
Dielectric
Vertical Via Cu
b
c
• Cu-Cu Bonding
• Hybrid Bonding
• Mechanical Bond
• Mechanical and Electrical Bonds
• Mechanical and Electrical Bonds
• Via After Bonding
• Via During Bonding
• Via During Bonding
a
Dielectric = SiO2, BCB
• Dielectric-Dielectric Bonding
Dielectric = SiO2,
Fig. 1.11↜渀 Wafer bonding techniques for wafer-level 3-D integration: a dielectric-to-dielectric, b metal-to-metal, and c dielectric/metal hybrid
The types of wafer bonding potentially suitable for wafer-level 3D integration are depicted in Fig.€1.11. Dielectric-to-dielectric bonding is most commonly accomplished using silicon oxide or BCB polymer as the bonding medium. These types of bonding provide primary function as a mechanical bond and the inter-wafer via is formed after wafer-to-wafer alignment and bonding (Fig.€1.11a). When metallic copper-to-copper bonding is used (Fig.€1.11b), the inter-wafer via is completed during the bonding process; note that appropriate interconnect processing within each wafer is required to enable 3D interconnectivity. Besides providing electrical connections between IC layers, dummy pads can also be inserted at the bonding interface at the same time to enhance the overall mechanical bond strength. This bonding scheme inherently leaves behind isolation gap between Cu pads and this could be a source of concern for moisture corrosion and compromise the structural integrity especially when IC layers above the substrate is thinned down further. Figure€1.11c shows a bonding scheme utilizing a hybrid medium of dielectric and Cu. This scheme in principle provides a seam-less bonding interface consists of dielectric bond (primarily a mechanical bond) and Cu bond (primarily an electrical bond). However, very stringent requirements with regards to surface planarity (dielectric and Cu) and Cu contamination in the dielectric layer due to misalignment are needed. The selection of the optimum technology platform is subject to ongoing development and applications. Cu-to-Cu bonding has significant advantages for highest inter-wafer interconnectivity. As a result, this approach is desirable for microprocessors and digitally-based system-on-a-chip (SoC) technologies. Polymer-to-polymer bonding is attractive when heterogeneous integration of diverse technologies is the driver and the inter-wafer interconnect density is more relaxed; benzocyclobute (BCB) is the polymer most widely investigated. Taking advantage of the viscosity of the polymer, this method is more forgiving in terms of surface planarity and particle contamination. Oxide-to-oxide bonding of fully processed IC wafers requires atomic-scale smoothness of the oxide surface. In addition, wafer distortions
14 Via First
C. S. Tan
TSV
FEOL
BEOL
FEOL
TSV
BEOL
Via Last (front side)
FEOL
BEOL
TSV
Via Last (back side)
FEOL
BEOL
Bonding
Via Middle
Thinning
TSV
Fig. 1.12↜渀 TSV can be formed at various stages of IC processing
introduced by FEOL and BEOL processing introduces sufficient wafer bowing and warping that prevents sufficient contact area to achieve the required bonding strength. While oxide-to-oxide bonding after FEOL and local interconnect processing has been shown to be promising (particularly with SOI wafers that allows for extreme thinning down to the buried oxide layer) the increased wafer distortion and oxide roughness after multilevel interconnect processing require extra attention during processing. TSV can be formed at various stages during the 3D IC process as shown in Fig.€1.12. When TSV is formed before any CMOS processes, the process sequence is known as “via first”. It is also possible to form the TSV when the front end processes are completed. In this “via middle” process, back end processes will continue after the TSV process is completed. When TSV is formed after the CMOS processes are completed, it is known as “via last” process. TSV can be formed from the front side or the back side of the wafer. The above schemes have different requirements in terms of process parameters and materials selection. The choice depends on final application requirements and infrastructures in the supply chain. Another key differentiator in 3D IC integration is related to the stacking orientation. One option is to perform face-to-face (F2F) alignment and bonding with all required I/Os brought to the thinned backside of the top wafer (which becomes the face of the two-wafer stack). Another approach is to temporarily bond the top wafer to a handling wafer, after which the device wafer is thinned from the back side and permanently bonded to the full-thickness bottom wafer; after this permanent bonding the handling wafer is removed. This is also called a back-to-face (B2F) stacking. These two stacking orientations are shown in Fig.€1.13. F2F stacking allows a high density layer to layer interconnection which is limited by the alignment accuracy. Handle wafer is not required in F2F stacking and this imposes more stringent requirement on the mechanical strength of the bonding interface in order to sustain shear force during wafer thinning which is often
1â•… Three-Dimensional Integration of Integrated Circuits—an Introduction
15
ILD2 TSV IC2
TSV
IC2 ILD2
ILD1
ILD1 IC1
a
IC1
b
Fig. 1.13↜渀 a Face-to-face stacking and b back-to-face stacking
achieved by mechanical grinding or polishing. Since one of the IC layer is facing down in the final assembly, F2F stacking also complicates the layout design as opposed to more conventional layout design whereby IC layers are facing up. Another potential disadvantage of F2F stacking relates to the thickening of the ILD layer at the bonding interface which presents higher barrier for effective heat dissipation. B2F stacking requires the use of a temporary handle and the layer to layer interconnection density is limited by the TSV pitch. Since the device layer is bonded to a temporary handle, the final permanent bond does not sustain damage resulting from wafer thinning. It requires the use of a temporary bonding medium that can provide sufficient strength during wafer handling and can be readily released after successful device layer permanent transfer on the substrate. In wafer level 3D integration, permanent bonding can be done either in chipto-wafer (C2W) or wafer-to-wafer (W2W) stacking. A comparison of these two methods is summarized in Table€1.2. As shown in Fig.€1.14, the option of C2W or W2W depends on two key requirements on chip size and alignment accuracy. When high precision alignment is desired in order to achieve high density layer to layer Table 1.2↜渀 Comparison between wafer-to-wafer and chip-to-wafer stacking € Wafer/die size Throughput Yield Alignment accuracy
Wafer-to-wafer Wafer/die of common size in order to avoid silicon area wastage Wafer scale Lower than lowest yield wafer, therefore high yield wafer must be used <2€µm global alignment
Chip-to-wafer Dissimilar wafer/die size is acceptable Die scale Known good die can be used if pre-stacking testing is available ~10€µm for >1,000€dph <2€µm for <100€dph
16
C. S. Tan
Fig. 1.14↜渀 The choice between C2W and W2W depends on the chip size and the required alignment accuracy Chip Size
C2W
W2W
Alignment
interconnections, W2W is a preferred choice to maintain acceptable throughput by performing a wafer level alignment. W2W is also preferred when chip size gets smaller.
1.4â•…Technology Platforms and Strategies A number of new enabling technologies must be developed and introduced into the existing fabrication process flow to make 3D integration a reality. Depending on the level of granularity, new capabilities include wafer bonding (permanent or temporary), through silicon/strata via (TSV), wafer thinning and handling, and precision alignment. There are a number of references on technology platforms available in the literature and the references therein [22, 23]. A brief introduction to TSV process flow is given. This section will primarily discuss low temperature Cu–Cu permanent bonding which is the author’s core research expertise.
1.4.1 Through Silicon Via Figure€ 1.15 is a generic process flow of TSV fabrication flow using Cu as the core metal. It begins with high aspect ratio deep etching of Si. Dielectric liner layer is then deposited on the via sidewall followed by barrier and Cu seed layers deposition. Liner layer, which is made of dielectric layer such as silicon dioxide, provides electrical isolation between Cu core and Si substrate. The liner thickness must be chosen appropriately to control leakage current and capacitance between Cu core and Si substrate. Cu super conformal filling is then achieved
1â•… Three-Dimensional Integration of Integrated Circuits—an Introduction
High aspect ratio Si deep etching
Liner deposition, followed by barrier and seed layers deposition
Super conformal Cu filling
17
Removal of Cu over-burden
Fig. 1.15↜渀 A generic process flow of Cu-filled TSV fabrication
with electro-plating process. Super conformal filling is required to prevent void formation in the Cu TSV. Finally, Cu over-burden is removed by chemical mechanical polishing. More information on TSV fabrication can be found in literature such as [22, 23].
1.4.2 Cu–Cu Permanent Bonding 3D integration of integrated circuits by means of bump-less Cu–Cu direct bonding is an attractive choice as one accomplishes both electrical and mechanical bonds simultaneously. Cu–Cu direct bonding is desired compared to solder-based connections because: (1) Cu–Cu bond is more scalable and ultra-fine pitch can be achieved; (2) Cu has better electrical and thermal conductivities; and (3) Cu has much better electro-migration resistance and can withstand higher current density in future nodes. Direct Cu–Cu bonding has been demonstrated using thermo-compression bonding (also known as diffusion bonding). As the name implies, thermo-compression bonding involves simultaneous mechanical pressing (~200€kPa) and heating of the wafers (~300–400°C). Two wafers can be held together when the Cu thin films bond together to form a uniform bonded layer. In order for this technique to be applicable to wafers that carry device and interconnect layers, an upper bound of temperature step is set at 400°C to prevent undesired damages particularly to the interconnects. The main objective of this Cu thermo-compression bonding study is to explore its suitability for utilization as a permanent bond that holds active device layers together in a multi-layer ICs stack. Cu is a metal of choice for 3-D ICs application because it is a mainstream CMOS material, and it has better electrical and thermal conductivities compared to Al-based interconnect. Most importantly, Cu bonds to itself under conditions compatible with CMOS back-end processes as initially demonstrated by Fan et€al. [24].
18
C. S. Tan
1.4.2.1â•…Wafer Preparation and Bonding Procedures In this section, wafer bonding by Cu thermo-compression is demonstrated and characterized on blank Si wafers. All wafers used in this experiment were p-type 150€mm Si-(100) wafers of 10–20€Ω-cm resistivity. Thermal oxide (5,000€Å) was grown on the wafers. All wafers received a 10€min piranha (H2O2:H2SO4â•›=â•›1:3, by volume) solution clean followed by deionized water rinse and spin-dry prior to metallization. The next step was the deposition of Tantalum (50€nm) and Copper (300€nm) in an e-beam deposition system. Ta was used to prevent Cu out-diffusion into the oxide layer. Chamber pressure during metal deposition was 1â•›×â•›10−6€Torr. The rms roughness of the Cu/Ta/SiO2/Si wafers is estimated to be around 1.99€nm from AFM scan. A pair of wafers was aligned face-to-face in wafer aligner and clamped together on a bonding chuck. Three separation metal flaps were inserted between the wafers at the edges and loaded into bonder. Three cycles of N2 purge ware done, and the chamber was evacuated to ~1â•›×â•›10−3€Torr. At this point, a down force was applied on the wafer pair while the flaps were being pulled out. The temperatures of the chuck and top electrode were ramped up to and maintained at 300°C. The contact force was 4,000€N when the wafer pair was in full contact at 300°C, and the bonding step lasted for 1€h. After bonding, the bonded wafers were annealed in atmospheric N2 ambient for 1€h at 400°C. 1.4.2.2â•…Bonding Mechanism In order to understand the microstructures of the bonded Cu layer, transmission electron microscopy (TEM) analysis was performed on this sample. Note that the two Cu bonding layers merge and a homogeneous bonded layer is obtained as shown in the TEM image in Fig.€1.16. As can be seen from this image, large Cu grains, which often extend beyond the original bonding interface, are obtained after bonding and annealing. Dislocation lines are also found in the Cu grains. A possible bonding mechanism that gives rise to the above grain structures will be proposed in this section. From the TEM image, it is evident that there is substantial grain growth during bonding and annealing. The jagged Cu–Cu interface suggests that inter-diffusion between two Cu layers has taken place. During bonding and subsequent annealing, Cu layers are in intimate contact under the applied pressure. At the bonding temperature, Cu atoms acquire sufficient energy to diffuse rapidly, and Cu grains begin to grow. At the bonding interface, diffusion can happen across the bonding interface and grains growth can progress across the interface. After sufficiently long duration, large Cu grains on the order of 300–500€nm are obtained, and a homogeneous bonded Cu layer is formed. Electron Dispersion Spectroscopy (EDS) analysis of the bonded Cu layer shows that apart from Cu, no appreciable foreign contaminant is found in the bonded layer within the detection limit of EDS. Since e-beam deposition is not used in typical manufacturing environments for metallization, the above demonstration of Cu thermo-compression is
1â•… Three-Dimensional Integration of Integrated Circuits—an Introduction Fig. 1.16↜渀 TEM image of bonded Cu layer. Note that the bonding Cu layers merge and a homogeneous Cu layer is obtained after bonding and anneal. Grain structures that extend across the original bonding interface are observed. Dislocation lines are clearly seen in the grains
19
Ta Cu-Cu Ta
0.2 µm
repeated using Cu deposited by electro-chemical means. The above experiment is repeated using electroplated Cu and similar observation of the bonding characteristic is made. 1.4.2.3â•…Surface Oxide Since the mechanism for Cu thermo-compression bonding is based on Cu interdiffusion and grain growth, surface contaminants such as oxide are detrimental to successful bonding especially at very low temperature. However, there is more often than not a time lag between Cu deposition and bonding, and therefore the formation of surface oxide is inevitable. Excessive oxygen incorporation into the bonded Cu layer might also increase the resistivity of the Cu layers and hence degrade the electrical performance of Cu interconnects. Techniques that can be used to reduce the surface oxide prior to bonding include the use of a chemical clean such as HCl [1] and glacial acetic acid followed by a forming gas purge in the bonding chamber [25] prior to bonding. Forming gas anneal can also be performed on Cu wafers prior to bonding and experimental evidence of the reduction of oxygen content in the bonded Cu layer is reported in [26]. 1.4.2.4â•…Process Parameters There are a number of important process parameters that directly determine the quality of the final bond during Cu thermo-compression bonding. Three important
20
C. S. Tan
bonding parameters, i.e., temperature, duration, and contact pressure, are frequently considered. In the bonding procedures described in above, thermo-compression bonding of Cu is accomplished in two steps, i.e., an initial bonding step to establish bond between pairing wafers and a post-bonding anneal to enhance the bond. Since the bonding step is a single wafer pair step, long bonding duration will decrease through-put in a manufacturing environment. On the other hand, annealing can be accomplished in an atmospheric furnace and it is possible to process batches of wafers during annealing. Therefore, a better way to achieve high through-put Cu wafer bonding is to initiate a preliminary bond with a short bonding step and to enhance the bonding strength with a post-bonding anneal. A number of references that discuss process parameters during thermo-compression bonding of Cu can be found in [27, 28]. 1.4.2.5â•…Observation of Interfacial Voids In order for the bonded Cu layer to act as a reliable electrical or mechanical bond, a defect-free and uniformly bonded Cu layer is desired. Careful examination by SEM analysis across a length of 20€μm reveals large voids in the bonded Cu layers as shown in Fig.€1.17. These voids are located at and near the location of the original bonding interface. These voids can provide nucleation sites for electromigration failure and can lead to open circuit failures. When the void density is too high, the voids can also cause thin film delamination. Therefore, this observation requires
Fig. 1.17↜渀 Interfacial void growth during Cu thermocompression bonding at 300°C for a 10€min b 30€min and c 60€min
1â•… Three-Dimensional Integration of Integrated Circuits—an Introduction
21
Fig. 1.18↜渀 Non-blanket bonding of Cu lines
careful understanding of the origin of these voids so that counter-measures can be implemented [29]. 1.4.2.6â•…Non-Blanket Cu Bonding Since Cu is a conductive medium, a continuous Cu bonding layer between active layers is of no practical application. In an actual multi-layer 3-D ICs implementation having Cu as the bonding medium, Cu bonding should be done in the form of pad-to-pad or line-to-line bonding with proper electrical isolation. Figure€1.18 shows a cross section of Cu lines (2–9€µm) that are successfully bonded [30]. The spacing between bonded lines is 5.3€µm and it is filled with air. Interfacial voids are observed in the bonded lines and they can lead to serious reliability concern. The bonding process should be optimized to minimize the formation of void. Another reliability concern is the empty space between the bonded lines that might reduce mechanical support between the active layers. Moisture in the empty space can also potentially corrode the bonded Cu lines. One solution is to form damascene Cu lines and to perform hybrid bonding of Cu and dielectric. A few examples are: 1. Jourdain et€al. [31] at IMEC have successfully demonstrated the 3-D stacking of an extremely thinned IC chip onto a Cu/oxide landing substrate using simultaneous Cu–Cu thermo-compression and compliant glue-layer (BCB) bonding. The
22
C. S. Tan
goal of this intermediate BCB glue layer between the two dies is to reinforce the mechanical and thermal stability of the bonded stack and to enable separation of die pick-and-place operations from a collective bonding step; 2. Gutmann et€al. [32] at RPI have demonstrated another scheme of hybrid bonding using face-to-face bonding of Cu/BCB redistribution layers. The first step is to prepare the single-level damascene-patterned structures (Cu and BCB) by CMP in the two Si wafers to be bonded. The second step is to align the two wafers and bond the two aligned wafers; 3. Researchers at Ziptronix have developed a Cu/oxide hybrid bonding technology known as Direct Bond Interconnect (DBITM) [33]. Vertical interconnections in direct oxide bond DBI™ are achieved by preparing a heterogeneous surface of non-conductive oxide and conductive Cu. The surfaces are aligned and placed together to effect a bond. The high bond energies possible with the direct oxide bond between the heterogeneous surfaces result in vertical DBI™ electrical interconnections.
1.4.2.7â•…Low Temperature Cu Bonding Thermo-compression bonding of Cu layers is typically performed at a temperature of 300°C or higher. There is strong motivation to move the bonding temperature to even lower range primarily from the point of view of thermal stress induced due to CTE mismatch of dissimilar materials in a multi-layer stack and temperature swing. A number of approaches have been explored: 1. Surface Activated Bonding [34]—In this method, a low energy Ar ion beam is used to activate the Cu surface prior to bonding. Contacting two surface-activated wafers enables successful Cu–Cu direct bonding. The bonding process is carried out under an ultrahigh vacuum (UHV) condition. No thermal annealing is required to increase the bonding strength. Tensile test results show that high bonding strength equivalent to bulk material is achieved at room temperature. In [35], adhesion of Cu–Cu bonded at room temperature in UHV condition was measured to be about ~3€J/m2 using AFM tip pull-off method; 2. Cu Nanorod [36]—Recent investigation on surface melting characteristics of copper nanorod arrays shows that the threshold of the morphological changes of the nanorod arrays occurs at a temperature significantly below the copper bulk melting point. With this unique property of the copper nanorod arrays, wafer bonding using copper nanorod arrays as a bonding intermediate layer is investigated at low temperatures (400°C and lower). Silicon wafers, each with a copper nanorod array layer, are bonded at 200–400°C. The FIB/SEM results show that the copper nanorod arrays fuse together accompanying by a grain growth at a bonding temperature of as low as 200°C; 3. Solid-Liquid Inter-diffusion Bonding (SLID) [37]—This method involves the use of a second solder metal with low melting temperature such as Tin (Sn) in between two sheets of Cu with high melting temperature. Typically a short
1â•… Three-Dimensional Integration of Integrated Circuits—an Introduction
23
reflow step is followed by a longer curing step. The required temperature is often slightly higher than Sn melting temperature (232°C). The advantages of SLID is that the inter-metallic phase is stable up to 600°C and the requirement of contact force is not critical; 4. In the DBITM technology described in [33], a moderate post oxide bonding anneal may be used to effect the desired bonding between Cu. Due to the difference in coefficient of expansion between the oxide and Cu and the constraint of the Cu by the oxide, Cu compresses each other during heating and metallic bond can be formed. 5. Direct Cu–Cu bonding at atmospheric pressure is investigated by researchers at LETI [38]. By means of CMP, the roughness and hydrophily (measure by contact angle) of Cu film are improved from 15 to 0.4€nm and from 50° to 12°. Blanket wafers were successfully bonded at room temperature with an impressive bond strength of 2.8€ J/m2. With a post-bonding annealing at 100°C for 30€ min the bonding strength was improved to 3.2€J/m2; 6. A novel Cu–Cu bonding process has been developed and characterized to create all-copper chip-to-substrate input/output (I/O) connections [39]. Electroless copper plating followed by low temperature annealing in a nitrogen environment was used to create an all-copper bond between copper pillars. The bond strength for the all-copper structure exceeded 165€MPa after annealing at 180°C. While this technique is demonstrated as a packaging solution, it is an attractive low temperature process for Cu–Cu bonding; 7. In the author’s research group, a method of Cu surface passivation using selfassembled monolayer (SAM) of alkane-thiol has been developed. This method has been shown to be effective to protect the Cu surface from particle contamination and to retard surface oxidation. The SAM layer can be thermally desorbed in-situ in the bonding chamber rather effectively hence providing clean Cu surface for successful low temperature bonding. Cu wafers bonded at 250°C present significant reduction in micro-void and substantial Cu grain growth at the bonding interface [40–43].
1.5â•…Applications, Status and Outlook Applications enabled by 3D fall into a few categories depending on the use of TSV and bonding. At the time of this writing, there are already commercial products made with TSV and many others are still under research and development. This section samples a number of closely watched applications enabled by 3D technology including image sensor, high density memory stack, memory/logic integration, and more futuristic ones like 3D heterogeneous systems. It ends with a positive note on the current status and future outlook of 3D integration. The main drivers for 3D applications include: (1) form factor, such as replacing wire bond with TSV in CMOS image sensor, (2) high density, such as stand-alone memory stack, (3) performance, such as bandwidth enhancement in memory on
24
C. S. Tan
Fig. 1.19↜渀 Applications enabled by 3D technology
CMOS Image Sensor
TSV
Backside Ground Si Interposer Memory Stacking with no Redesign Memory/Logic, Logic/Logic Heterogeneous Systems
F2F Chip/Chip Bonding with Conventional I/O at the Periphery
Bonding
logic, and (4) heterogeneous integration of disparate chips. Regardless of the main driver, the feasibility and key consideration of any 3D application for consumer products has always been low cost manufacturing. Broadly, applications enabled by 3D technology can be classified into three categories as shown in Fig.€1.19. The first group of products only utilizes TSV such as CMOS image sensor (at the time of writing, there are commercial products from companies such as ST Microelectronics, Toshiba, OKI, etc), backside ground (e.g., SiGe power amplifier by IBM), and silicon interposer (based on the silicon carrier alone). In this class of devices, chip to chip bonding is not required. In another group, 3D devices are implemented by bonding chip on chip in a face to face fashion. Unlike system shown in Fig.€1.9, chip to chip electrical connections can be established with micro-bump or bump-less metal-metal bonding. I/O is formed using conventional wire bond or flip chip at the non-bonding periphery area. One such example is the Sony Play Station featuring memory on logic. The real 3D devices that make use of both TSV and bonding include stand-alone high density memory stack, memory on logic, logic on logic, and heterogeneous systems. At the time of this writing, there has been announcement from Elpida on a multi-layer DRAM stack using 3D stacking technology. For more than 40€years, performance growth in IC is realized primarily by geometrical scaling. In more recent nodes, performance boosters are used to sustain this historical growth. Moving forward, 3D integration is an inevitable path. There have been significant investment in 3D technology by various sectors and the development has been both rewarding and encouraging. While 3D technology is not without it challenges, it is likely to see wider adoption of 3D technology in the future when solutions for thermal management, EDA tools, testing, and standardization are made available in the IC supply chain. Acknowledgments╇ The author is supported by funding from the Nanyang Technological University through an award of Nanyang Assistant Professorship, Defense Science and Technology Agency (DSTA, Singapore), Semiconductor Research Corporation (SRC, USA) through a subcontract from the Interconnect and Packaging Center at the Georgia Institute of Technology, and Defense Advanced Research Projects Agency (DARPA, USA). The author thanks Professor Rafael Reif of MIT for his constructive and valuable comments on the content of this chapter.
1â•… Three-Dimensional Integration of Integrated Circuits—an Introduction
25
References ╇ 1. R.P. Feynman, The Pleasure of Finding Things Out, Perseus Publishing, Cambridge, p.€28, 2000. ╇ 2. C.G. Hwang, New Paradigms in the Silicon Industry. In: Keynote Speech, IEDM, 2006. ╇ 3. Intel Corporation: http://www.intel.com ╇ 4. A. Khakifirooz, Transport Enhancement Techniques for Nanoscale MOSFETs. PhD Thesis, MIT, Cambridge, MA, 2008. ╇ 5. S. Saxena et€al., Variation in Transistor Performance and Leakage in Nanometer-Scale Technologies. IEEE Transaction on Electron Devices, 55(1), p.€131, 2008. ╇ 6. S. Nassif et€ al., High Performance CMOS Variability in the 65€ nm Regime and Beyond, IEDM, p.€569, 2007. ╇ 7. D. Sylvester and C. Hu, Analytical Modeling and Characterization of Deep-Submicrometer Interconnect. Proceedings of the IEEE, 89(5), p.€634, 2001. ╇ 8. P. Kapur, J.P. McVittie, and K.C. Saraswat, Realistic Copper Interconnect Performance with Technological Constraints. Proceedings of the IEEE Interconnect Technology Conference, p.€233, 2001. ╇ 9. P.G. Emma, Is 3D Chip Technology the Next Growth Engine for Performance Improvement? IBM Journal of Research and Development, 52(6), p.€541, 2008. 10. Tezzaron: http://www.tezzaron.com 11. R.E. Jones et€al., Technology and Application of 3D Interconnect. Proceedings IEEE International Conference Integrated Circuit Design and Technology, p.€176, 2007. 12. S.K. Pozder et€al., Status and Outlook. In: Wafer Level 3-D ICs Process Technology (Edited by C.S. Tan, R.J. Gutmann, and L.R. Reif), Springer, New York, p.€333, 2008. 13. N. Miura et€al., Capacitive and Inductive-Coupling I/Os for 3D Chips. In: Integrated Interconnect Technologies for 3D Nanoelectronic Systems (Edited by M.S. Bakir and J.D. Meindl), Artech House, Boston, MA, p.€449, 2009. 14. S. Kawamura, N. Sasaki, T. Iwai, M. Nakano, and M. Takagi, Three-Dimensional CMOS ICs Fabricated by Using Beal Recrystallization. IEEE Electron Device Letters, 4(10), p.€366, 1983. 15. T. Kunio, K. Oyama, Y. Hayashi, and M. Morimoto, Three Dimensional ICs, Having Four Stacked Active Device Layers. In: IEDM Technical Digest, p.€837, 1989. 16. V. Subramanian, M. Toita, N.R. Ibrahim, S.J. Souri, and K.C. Saraswat, Low-Leakage Germanium-Seeded Laterally-Crystallized Single-Grain 100-nm TFTs for Vertical Integration Applications. IEEE Electron Device Letters, 20(7), p.€341, 1999. 17. V.W.C. Chan, P.C.H. Chan, and M. Chan, Three-Dimensional CMOS SOI Integrated Circuit Using High-Temperature Metal-Induced Lateral Crystallization. IEEE Transaction on Electron Devices, 48(7), p.€1394, 2001. 18. S. Pae, T. Su, J.P. Denton, and G.W. Neudeck, Multiple Layers of Silicon-on-Insulator Islands Fabrication by Selective Epitaxial Growth. IEEE Electron Device Letters, 20(5), p.€194, 1999. 19. B. Rajendran, R.S. Shenoy, D.J. Witte, N.S. Chokshi, R.L. DeLeon, G.S. Tompa, and R.F.W. Pease, Low Temperature Budget Processing for Sequential 3-D IC Fabrication. IEEE Transaction on Electron Devices, 54(4), p.€707, 2007. 20. http://www.flipchips.com/tutorial71.html 21. M. Bohr, The New Era of Scaling in an SoC World. ISSCC, p.€23, 2009. 22. C.S. Tan, R.J. Gutmann, and R. Reif, Wafer Level 3-D ICs Process Technology, Springer, New York, ISBN 978-0-387-76532-7, 2008. 23. P. Garrou, C. Bower, and P. Ramm, Handbook of 3D Integrations: Technology and Applications of 3D Integrated Circuits, Wiley-VCH, Weinheim, ISBN 978-3-527-32034-9, 2008. 24. A. Fan, A. Rahman, and R. Reif, Copper Wafer Bonding. Electrochemical and Solid-State Letters, 2(10), pp. 534–536, 1999.
26
C. S. Tan
25. R. Tadepalli, and Carl V. Thompson, Quantitative Characterization and Process Optimization of Low-Temperature Bonded Copper Interconnects for 3-D Integrated Circuits. Proc. of the IEEE 2003 International Interconnect Technology Conference, pp. 36–38, 2003. 26. C.S. Tan, K.N. Chen, A. Fan, and R. Reif, The Effect of Forming Gas Anneal on the Oxygen Content in Bonded Cu Layer. Journal of Electronic Materials, 34(12), pp. 1598–1602, 2005. 27. K.N. Chen, A. Fan, C.S. Tan, and R. Reif, Temperature and Duration Effect on Microstructure Evolution During Copper Wafer Bonding. Journal of Electronic Materials, 32(12), pp. 1371–1374, 2003. 28. K.N. Chen, C.S. Tan, A. Fan, and R. Reif, Morphology and Bond Strength of Copper Wafer Bonding. Electrochemical and Solid-State Letters, 7(1), pp. G14–G16, 2004. 29. C.S. Tan, R. Reif, D. Theodore, and S. Pozder, Observation of Interfacial Voids Formation in Bonded Copper Layer. Applied Physics Letters, 87(20), p. 201909, 2005. 30. C.S. Tan, K.N. Chen, A. Fan, R. Reif, and A. Chandrakasan, Silicon Layer Stacking Enabled by Wafer Bonding. MRS Symposium Proceedings, 970, pp. 193–204, 2007. 31. A. Jourdain, S. Stoukatch, P. De Moor, W. Ruythooren, S. Pargfrieder, B. Swinnen, and E. Beyne, Simultaneous Cu–Cu and Compliant Dielectric Bonding for 3D Stacking of ICs. Proceedings of IEEE International Interconnect Technology Conference, pp. 207–209, 2007. 32. R.J. Gutmann, J.J. McMahon, and J.-Q. Lu, Damascene-Patterned Metal-Adhesive (CuBCB) Redistribution Layers. Materials Research Society Symposium Proceedings, 970, pp. 205–214, 2007. 33. P. Enquist, High Density Bond Interconnect (DBI) Technology for Three Dimensional Integrated Circuit Applications. Materials Research Society Symposium Proceedings, 970, pp. 13–24, 2007. 34. T.H. Kim, M.M.R. Howlader, T. Itoh, and T. Suga, Room temperature Cu–Cu direct bonding using surface activated bonding method. Journal of Vacuum Science and Technology A: Vacuum, Surfaces and Films, 21(2), pp. 449–453, 2003. 35. R. Tadepalli and Carl V. Thompson, Formation of Cu–Cu Interfaces with Ideal Adhesive Strengths via Room Temperature Pressure Bonding in Ultrahigh Vacuum, Appl. Phys. Lett., 90, p. 151919, 2007. 36. P.-I. Wang, T. Karabacak, J. Yu, H.-F. Li, G.G. Pethuraja, S.H. Lee, M.Z. Liu, and T.-M. Lu, Low Temperature Copper-Nanorod Bonding for 3D Integration. Materials Research Society Symposium Proceedings, 970, pp. 225–230, 2007. 37. P. Benkart, A. Kaiser, A. Munding, M. Bschorr, H.-J. Pfleiderer, E. Kohn, A. Heittmann, and U. Ramacher, 3D Chip Stack Technology using Through-Chip Interconnects. IEEE Design & Test of Computers, 22(6), pp. 512–518, 2005. 38. P. Gueguen, L. Di Cioccio, M. Rivoire, D. Scevola, M. Zussy, A.M. Charvet, L. Bally, and L. Clavelier, Copper direct bonding for 3D integration. IEEE International Interconnect Technology Conference, pp. 61–63, 2008. 39. T. Osborn, A. He, H. Lightsey, and P. Kohl, All-copper chip-to-substrate interconnects. Proceedings of IEEE Electronic Components and Technology Conference, pp. 67–74, 2008. 40. D.F. Lim, S.G. Singh, X.F. Ang, J. Wei, C.M. Ng, and C.S. Tan, Achieving low temperature Cu to Cu diffusion bonding with self assembly monolayer (SAM) passivation. IEEE International Conference on 3D System Integration, art. no. 5306545, 2009. 41. D.F. Lim, S.G. Singh, X.F. Ang, J. Wei, C.M. Ng, and C.S. Tan, Application of Self Assembly Monolayer (SAM) in Cu–Cu Bonding Enhancement at Low Temperature for 3-D Integration, Advanced Metallization Conference, Baltimore, October 13–15, 2009. In: D.C. Edelstein, and S.E. Schulz (Eds), AMC 2009, pp. 259–266, ISBN 978-1-60511-218-3, Materials Research Society, 2010. 42. C.S. Tan, D.F. Lim, S.G. Singh, S.K. Goulet, and M. Bergkvist, Cu–Cu diffusion bonding enhancement at low temperature by surface passivation using self-assembled monolayer of alkane-thiol. Applied Physics Letters, 95(19), p. 192108, 2009. 43. D.F. Lim, J. Wei, C.M. Ng, and C.S. Tan, Low Temperature Bump-less Cu–Cu Bonding Enhancement with Self Assembled Monolayer (SAM) Passivation for 3-D Integration. IEEE Electronic Components and Technology Conference (ECTC), Las Vegas, June 1–4, pp. 1364– 1369, 2010.
Chapter 2
The Promises and Limitations of 3-D Integration Axel Jantsch, Matthew Grange and Dinesh Pamunuwa
2.1â•…Introduction Due to their compact geometry, 3-D integrated systems hold promises to significantly reduce latency, power consumption and area, while increasing bandwidth. In the following we quantify the potential and limits of 3-D integration by analyzing the theoretical performance of various 2-D and 3-D topologies. We adopt T. Claasen’s notion of intrinsic computational efficiency of silicon [1]. The intrinsic computational efficiency is obtained when all the silicon area is filled with elementary operations, say 32-bit adders, and no area is “wasted” for data communication and control. Figure€2.1 shows how the intrinsic computational efficiency, measured in millions of operations per second per Watt, is increasing with technological progress. The left part of the curve is copied from T. Claasen’s original paper [1], while the right part is based on our own model, as introduced below. For comparison we have marked the performance of two recent multi-core processors from Tilera Inc. [2]. Different architectures such as micro-processors, DSPs, FPGAs and custom hardware, will approximate this line to a higher or lower degree depending on how well an application matches the architecture and how much flexibility is built-in. But no real processing unit can match or exceed it. Larger and more general purpose processors exhibit a greater gap because they utilize more area and power on interconnect, control and provision of programmability. Communication performance, area and power consumption directly benefit from 3-D integration due to geometric properties. Figure€2.2 shows how the geometric distance between cores grows very differently in 2-D and 3-D structures with the number of cores. Since for global and long distance communication the geometA. Jantsch () Department of Electronic Systems, School of Information and Communication Technology, Royal Institute of Technology, 120 Forum, 16440 Kista, Sweden Tel.: +46 8 790 4124 e-mail:
[email protected] A. Sheibanyrad et al. (eds.), 3D Integration for NoC-based SoC Architectures, Integrated Circuits and Systems, DOI 10.1007/978-1-4419-7618-5_2, ©Â€Springer Science+Business Media, LLC 2011
27
28
Fig. 2.2↜渀 The average geometric distance for a multicore system for a 2-D and a 3-D realization
Intrinsic Computational Efficiency
1e+07
MOPS/Watt
1e+06
ICE T. Claasen ICE proposed
100,000 10,000
+Tilera 100 core +Tilera 36 core
1,000 100
1,000
100 Technology node [nm]
10
45 Average communication distance
Fig. 2.1↜渀 Computational efficiency vs. minimum feature size is shown here. The discrepancy in the overlapping section between T. Classon’s work and this study is due to the significant variation in the energy consumption of different adder architectures. The performance of the two processors shown fall outside of this range due to the overhead of the control circuitry and interconnect which is not accounted for by this metric
A. Jantsch et al.
40
2D 3D
35 30 25 20 15 10 5
200 400 600 800 No of cores between 16 and 1,024
1,000
ric distance translates linearly to latency, we can expect to cut communication latency by 50%. A number of recent studies of communication performance in 3-D structures [3–7] demonstrate the significant potential of 3-D integration technology for reducing power consumption and increasing performance. 3-D integration enables stacking of memory on top of processors, thus realizing a direct low latency and high bandwidth memory access link. However, to exploit the benefits, the memory architecture has to be adapted to allow for multi-port, parallel memory access. Several recent studies have explored various memory and cache architectures while exploiting the third dimension. For instance Li et€al. [8] propose a 3-D distributed L2 cache and observe a 50% access latency reduction, essentially due to shorter wires within the L2 cache. Loh [9] explores the effect of parallel memory access by means of multiple memory controllers and ranks in a 3-D stacked DRAM based memory architecture and reports a performance increase of more than 280% over a conventional memory architecture for a set of benchmark applications. In our model we assume that in a 3-D topology, DRAM is used as embedded memory because it can be placed on a separate die, thus leveraging on the capability of 3-D to integrate different process technology in the same system.
2â•… The Promises and Limitations of 3-D Integration
29
In Sect.€2.2, we introduce and motivate our analytical model for performance comparison. Then, we describe the technological parameters for performance, power consumption and area for the 2-D and 3-D topologies (Sect.€2.3). Also, we explain our scaling methodology. Section€2.4.1 delves into the impact of how memory is distributed in the system. Not surprisingly a distributed memory exhibits higher performance than a centralized memory. However, after distributing 80% of the memory, further diffusion of the storage has little added benefit. In Sect.€2.4.3 we become more concrete by assuming specific system sizes and frequencies. This allows for analyzing performance limits under power, frequency and area constraints. Finally, we provide further discussions of the model and our conclusions in Sect.€2.5.
2.2â•…Computational Efficiency of Silicon 2.2.1 Computation Intrinsic Computational Efficiency (↜ICE) of silicon [1] is the number of 32-bit add operations per Joule, or the number of operations per second per Watt. As a concrete example, let’s assume one 32-bit adder covers an area of 2956€μm2 and each 32-bit addition consumes 6.9€pJ in 130€nm technology; it covers an area of 437.3€μm2 and consumes 1.85€pJ in 50€nm technology. Thus, we get as intrinsic computational efficiency the following. ICE 130 = 1/(6.9 pJ) = 144 GOPS/W ICE 50 = 1/(1.83 pJ) = 540 GOPS/W
The ICE reflects the amount of computation that can be done within an energy envelope, but it does not measure the amount of computations per area or per volume. We now define the Intrinsic Computational Density (↜ICD) as the number of 32-bit adders that fit into 1€mm2. For instance, with the example above we get ICD130 = 1/(2,956 µm2 ) = 338.3 ICD50 = 1/(437.3 µm2 ) = 2, 286.8
operators mm2 operators mm2
Figure€ 2.1 shows the intrinsic computational efficiency as a function of technology nodes. Theo Claasen’s plot from 1999 is repeated and for comparison the ICE figures of our model (Sect.€2.3) for technology nodes between 180 and 17€nm are added.
30
A. Jantsch et al.
2.2.2 Adding Memory and Communication ICE and ICD give the upper bound of what amount of computation can be done with a given silicon technology under the assumption that the entire area is densely packed with computation units. However, we also need to account for memory, where the data are stored before and after processing, and for interconnect, which allows the data to move between processing units and memory. In the following we study variants of ICE and ICD under less ideal assumptions in different 2-D and 3-D configurations. In particular we explore the following factors and configurations. • Ratio of computation to memory μ: We distinguish between the temporal ratio μT and the spatial ratio μS. The relative number of memory accesses for each operation is μT, while μS is the number of memory words in the system for each operator. With memory we mean SRAM, caches and the like but also off-chip DRAM. If μT€=€1, for each operation there is 1 memory access. Typical values will be between 1 and 3. On the other hand, the amount of memory is usually much higher than the operators. Hence, typical values for μs are between 1,000 and 10,000 as we discuss later. • Ratio of on-chip versus off-chip memory: ω: If ω€=€1, all memory is on-chip; if ω€=€0, all memory is off-chip. In a 3-D topology, with on-chip we mean all dies in the 3-D stack. • Memory distribution factor Δ: − Δ€= 0: completely distributed memory where the distance between a computation unit and the memory is always 0; − Δ€= 1: completely central memory where the distance between a computation unit and the memory is always the diameter of the system (or off-chip) − for example Δ€ = 0.05: models a cache system where 95% of all memory accesses are local and 5% are far away. The idea is to account for the communication required to write to and read from memory. If the memory is completely distributed, we assume all memory reads and writes are local and no long-range communication is required. Obviously, this is a simplification but any specific architecture-application pair can be characterized by a Δ value between 0 and 1, denoting the amount of global on-chip communication occurring. • We explore different 2-D and 3-D topologies but we typically compare systems with the same total silicon area. For example if the total area is 400€mm2, the configurations considered are − − − − −
2D: one plain silicon die of size 20â•›×â•›20€mm2; 3D2: two dies stacked upon each other, each 200€mm2; 3D4: four dies stacked upon each other, each 100€mm2; 3D8: eight dies stacked upon each other, each 50€mm2; 3D16: sixteen dies stacked upon each other, each 25€mm2.
2â•… The Promises and Limitations of 3-D Integration
31
2.2.3 Effective Computational Efficiency To include the effects of memory and interconnect, we define the Effective Energy (↜EE) for a 32-bit addition as follows. tn tn tn tn EEarch = E32 + µT (ω(e1 + × E_intarch ) + (1 − ω)(e1 + E_intarch + Eoffchip ))
for a given technology node, tn, and a given architecture, arch, ∈{2D, 3D2, 3D4, 3D8, 3D16}. The three main terms correspond to the energy consumption of an addition, of on-chip memory access and of off-chip memory access, respectively. • e1 is the amount of energy it takes to read or write one 32-bit word in on-chip SRAM. tn • E_intarch is the energy it takes to transport one 32-bit word from a non-adjacent on-chip memory to the local cache (see Table€2.1). For example, if the total silicon area is 400€mm2, we have (10 + 10)e2 (tn) if arch = 2D (7.07 + 7.07)e2 (tn) + e3 (tn) if arch = 3D2 tn (5 + 5)e2 (tn) + 2e3 (tn) if arch = 3D4 E_intarch = (3.5 + 3.5)e2 (tn) + 4e3 (tn) if arch = 3D8 (2.5 + 2.5)e2 (tn) + 8e3 (tn) if arch = 3D16 • e2 is the energy it takes for a 32-bit word to be transported 1€mm horizontally in a given technology. • e3 is the energy it takes to move a 32-bit word from one vertical level to the next via a set of TSVs. • Eoffchip is the energy it takes to get off-chip and to read or write the off-chip memory. It includes the I/O drivers, the inter-chip communication and the energy consumption of the memory chip. The idea of E_int is to capture the communication energy in different architectures to get from an arbitrary point in the system to a particular point at the system boundary. For a 2-D 20â•›×â•›20€mm2 die, the distance is on average 10€mm in each dimension, hence it is 20€mm. For a 3-D structure we have to traverse half of the vertical levels on average. For example for a 3D4 we have to traverse two vertical levels. Thus, the effective energy EE gives the required energy for a 32-bit addition if memory access and communication is taken into account. The factors μT, ω and Δ are abstractions of architectural choices and features. Based on EE we define the Effective Computational Efficiency (↜ECE) as follows. tn ECEarch =
1 tn EEarch
which gives the amount of computation we can do within the energy envelope of 1€J; or the amount of computations per second we can do within the power envelope of 1€W.
32
A. Jantsch et al.
Table 2.1↜渀 Notation and metrics of comparison Abstraction of architectural design parameters Minimum feature size of a technology node (nm) tn Architecture of system (2D, 3D2, 3D4, 3D8, 3D16) arch ω Ratio of on- to off-chip memory (↜ω€= 1: all memory is on-chip, ω€= 0: all off-chip) Δ Memory distribution factor (Δ€= 1: all centralized memory, Δ€= 0: all local) μT Number of memory accesses per h/w operation (↜μT€= 1: one mem. access per op) μs Amount of memory per h/w operator (typically μs€=€1,000−10,000) σ Interconnect sharing factor (↜σ€= 1: no sharing, σ€=€0: completely shared) Number of die layers for 3-D architectures n Area of die area Technology and architecture dependent parameters E32 Energy for a 32-bit add operation Energy for a 32-bit read/write to local SRAM e1 Energy to transport a 32-bit word over 1€mm on a planar on-chip bus e2 Energy to transport a 32-bit word over one vertical layer across TSVs e3 Area for a 32-bit memory word in SRAM or DRAM a1 Area for a 1€mm long 32-bit planar on-chip bus a2 Area for 32 TSVs a3 Energy to read/write to off-chip memory. Includes I/O drivers, inter-chip comEoffchip munication and memory chip energy consumption Primary comparison metrics Number of 32-bit add operations per Joule ICE Number of 32-bit adders per mm2 ICD tn Interconnect area required totransport a 32-bit word from a non-adjacent on-chip A_intarch a2 + n2 a3 memory to the local cache: area n tn Interconnect energy required to transport a 32-bit word from a non-adjacent onE_intarch c + n2 c3 chip memory to the local cache: area n 2 tn Effective Energy for a 32-bit addition: EEarch tn tn tn tn EEarch = E32 + µT (ω(e1 + E_intarch ) + (1 − ω)(e1 + E_intarch + Eoffchip )) tn ECEarch tn EAarch
Amount of computation achieved with 1€J:
1 tn EEarch
Effective area for a 32-bit addition without off-chip memory: tn tn EAtn arch = A32 + µS ω a1 + σ A_intarch
For example the special case of μT€=€0 (no memory read or write) and 2-D in a 130€nm technology we get 130 ECE2D =
1 1 = 130 = ICE 130 = 144.3 GOPS/W tn EEarch E32
2.2.4 Effective Computational Density Similarly, the area cannot be filled with computational units only. We need to take memory and interconnect into account as well. We define the Effective Area (↜EA) as follows.
2â•… The Promises and Limitations of 3-D Integration
33
tn tn EAtn arch = A32 + µS ω a1 + σ A_intarch
EA is defined similarly to EE (see Table€2.1) but the off-chip component is omitted since we do not include the area for off-chip memory. Again, with “off-chip” we really mean “out-of-package”. Different dies in a 3-D stack are considered “on-chip”. • a1 is the area for a 32-bit memory word. Depending on the geometry we assume either SRAM or DRAM memory. For a 2-D system we use the area of embedded SRAM, while for a 3-D system we use DRAM. Concretely we use 60F2 area for one SRAM cell [10] and between 8F2 and 4F2 for DRAM cells [11], where F is the minimum feature size. tn • A_intarch is the interconnect area required for transporting a 32-bit word to memory. For example, in a 400€mm2 system we have
tn A_intarch
(10 + 10)a2 (tn) (7.07 + 7.07)a2 (tn) + a3 (s) (5 + 5)a2 (tn) + 2a3 (s) = (3.5 + 3.5)a2 (tn) + 4a3 (s) (2.5 + 2.5)a2 (tn) + 8a3 (s)
if arch = 2D if arch = 3D2 if arch = 3D4 if arch = 3D8 if arch = 3D16
• σ is the interconnect sharing factor. If σ€=€1, no sharing takes place and every operator has its own, private interconnect across the system. If σ€=€0, the interconnect is optimally shared and the interconnect area per operator is 0. In analogy to μS it gives the ratio of area occupied by operators versus interconnect. Typical values are between 0.01 and 0.1. For instance the Tilera TILE64 [12] with 64 cores has eight 32-bit operators per core1. For 512 operators on the 64 core Tilera die with an 8â•›×â•›8 mesh interconnect, the sharing factor is σ€=€16/512€= â•›0.031. Note, that only the global interconnect for the dataflow is counted, while the local interconnect and global control lines are ignored. • a2 is the required area for a 1€mm long 32-bit bus. • a3 is the required area for 32 TSVs to connect from one horizontal layer to the next. For instance, if one 32-bit adder has the size 437.5€μm2 in 50€nm technology and μs€= σ€=€0, we get an ECD50€=€ICD50€=€2,286.8€operations/mm2 and we can fill a 400€mm2 chip with 914,720 adders. In a more realistic scenario with μs€= 4,000 and σ€= 0.031 we get 345 operators on a 400€mm2 area.
Again, this is a simplification, because there are fewer operators but they are pipelined. In effect, 8 operations can be completed per cycle in the best case, motivating the number 8 that we use in this example.
1╇
A. Jantsch et al.
34
2.3â•…Technology Parameter Scaling To capture the performance benefits for feature size scaling of each successive generation of technology, physical properties of various on-chip communication transactions and logical operations were modeled for each node. The technology parameters are broken down into several categories; global planar 2-D wires, logical operations, memory transactions and 3-D TSV signaling.
2.3.1 Planar 2-D Wire Models The minimum feature size on a die scales by roughly 0.7 each generation, however global on-chip wires do not scale as aggressively as intermediate or local wires. In Ho et al.’s “The Future of Wires” [13] conservative and aggressive wire scaling trends for decreasing feature sizes are discussed. Capacitance, including parallel plate, fringe and coupling terms, and resistance are extracted from field solver simulations and compact models fitted to extract parameters for future technology nodes given the predicted global wire dimension, barrier thickness, spacing, resistivity of the medium, vertical and horizontal dielectric constants and the switching probability of the surrounding wires. Using the RC characteristics of the wires, typical repeater insertion strategies, and scaling supply voltages, we determine the energy per bit for a requisite wire length across technology nodes from 180€nm down to 17€nm. We assume bus widths of 32 and the percentage of bits switching per transaction to be one half the total number of bits.2 Driver, receiver and repeater energies are also considered for each wire in the bus. The energy consumed in transmitting a 32-bit word per network link is calculated from the following equation: Elink = k
1 2 Vdd Cwself + 2Cc + hCrep × Bus_width × Switch_factor 2
where k is the number of repeaters and h the size of each, Cwself is the self capacitance of a global wire, Cc is the coupling capacitance to neighboring wires, Crep is the total input gate and output drain capacitance of the repeater and Vdd is the supply voltage for a given technology.
2.3.2 3-D TSV Interconnect Models We have conducted field solver simulations of cylindrical, copper-filled through silicon vias to extract the relevant RLC parasitics. TSV electrical characteris2╇ This figure depends less on architectural choices, but more on how information is coded, protected and compressed. Although a simplification, it is important to note that the same assumption is used for all architectures and the relative comparisons and main trends are not sensitive to the chosen value for switching activity.
2â•… The Promises and Limitations of 3-D Integration
35
tics depend on their geometrical parameters as well as material properties such as the dielectric properties of the barrier and insulating layers and the dopant concentration in the substrate. For the purpose of extracting parasitics and subsequent analysis, a representative structure for a TSV is assumed to be a copper-filled via with uniform circular cross-section and an annular dielectric barrier of SiO2 or Si3N4 surrounding the Cu cylinder with a thickness of 0.2€μm [14]. The dimensions vary depending on the technology node; the cross-section is assumed to be uniformly circular, with radii of 10, 8, 6, 4, 2 and 1€μm and a constant length of 50€μm. The pitch of the TSVs is twice the radius to match planar global wire spacing trends. In this work we have considered a substrate conductivity of 10€ S/m representing typical values used in digital processes. The topology considered is three parallel coupled TSVs, a representative unit in any size row of TSVs. We use the extracted parasitics with the same methodology as the planar wires, where the bus width and switch factor match the 2-D parameters. The energy is calculated for a single transaction from one layer to the next adjacent layer, so the hop length is fixed. Driver and receiver energy is also considered, however no repeaters are required for the 3-D interconnect. The TSVs are arranged in a row, thus the total area of the interconnect is a straightforward relationship to the pitch and radius of the TSVs.
2.3.3 Logical Operation and DRAM Scaling We extract the energy per operation of several logic operations such as a 32-bit addition or SRAM read, by using published data [15, 16] for a particular technology node and scaling the energy and area for future or past generations. Dally in [16] publishes the energy per add operation of a 32-bit adder in 130€nm 1.2€V technology as 5€pJ. A reasonable approximation, ignoring leakage, for the energy in other technology nodes can be obtained by scaling according to the following: Energynew = Energy130 nm ×
2 Featuresizenew × Vddnew 2 Featuresize130 nm × Vdd130 nm
.
The area can be scaled in a similar manner by a straightforward relation of the minimum feature sizes between nodes. The off-chip DRAM transaction energy is not a simple function of the feature size, and depends on the DRAM architecture, its peripheral circuitry and also characteristics of off-chip drivers and terminations, and chip, package and board trace parasitics. We have used the Micron System Power Calculator [11] to estimate the average read/write power for different generations of DRAM, from SDRAM to DDR3. We then divide this power by the number of bits and the simulated transaction data rate to determine the energy per bit per generation of off-chip DRAM. We have matched the DRAM generation to the technology node, such that 180€nm corresponds to SDRAM and 17€nm to DDR3. There are a number of complexities
36
A. Jantsch et al.
associated with off-chip transactions, such as bus controller architecture, termination power, transaction delay, and the number of peripheral I/O devices, which cause the energy to vary over a wide range depending on these choices. In our study we have been consistent with the values we use in order to minimize the impact on comparisons between different schemes.
2.4â•…ECE Trends and Dependencies Next, we study the dependency of ECE on parameters like Δ and ω and then we investigate the limits of ECE and raw performance under power, area and frequency constraints. To see the overall trend, Fig.€2.3 illustrates how the ECE, the performance for a given power envelope, will develop as technology scales. As a reference the plot shows the ECE of two recent multi-core Tilera processors. 3-D topologies have a 3 times higher ECE, mainly due to lower communication power consumption in a more compact geometry. Moreover, this increased efficiency of 3-D is gained at a much smaller area and lower frequency for the same performance, as will be illustrated below in Sect.€2.4.3.
2.4.1 Distributed versus Central Memory To study the effect of the memory distribution factor on the ECE we assume that for every operation on average one word has to be read or written from or to memory (or cache)3. Hence, μT€=€1.0. Effective Computational Efficiency
9e+10
Fig. 2.3↜渀 Performance of different topologies at different technology nodes with Δâ•›=â•›0.05, ω€= 1 and μT€=€1. The data for the two Tilera processors are closer to the theoretical performance than in Fig.€2.1 due to the fact that the interconnect overhead has been accounted for, although the control circuitry overhead is neglected
(Operations/sec)/Watt
8e+10 7e+10 6e+10 5e+10
2D 3D2 3D4 3D8 3D16
4e+10 3e+10 2e+10 1e+10
+Tilera 100 core +Tilera 36 core
0 180 160 140 120 100 80 60 40 Technology node [nm]
20
0
3╇ We assume registers and small register files close to the operators. Reading and writing of registers is not considered as memory access.
2â•… The Promises and Limitations of 3-D Integration
37
Figure€2.4 shows the ECE for various topologies when Δ, representing the proportion of centralized memory, varies between 0 and 1. For all topologies a centralized memory drags down ECE significantly from over 60 GOPS/W to about 5–10€GOPS/W. Hence, there is a benefit from distributing memory, but only a distribution of Δâ•›<â•›0.2 gives a significant effect. This benefit from distribution is more pronounced for a 2-D topology. Going from Δ€= 1 to Δ€=€0.1 improves ECE for 3D16 by a factor 5, while the improvement is 8 for 2D. Intuitively the reason for this is that the cost of transporting data across the chip to a central memory is much lower for a 3-D topology. Hence, if it is difficult to decentralize most memory accesses, the penalty will be lower for 3-D. However, the cost of centralized memory becomes steeper for more advanced technologies. Figure€2.5 shows this effect for a 3D16 topology. While the difference between Δ€=€0 and Δ€=€1 is a factor 5.4 for 180€nm technology, it grows to a factor of 34 for a 17€nm technology. Hence, even if a 3-D topology can mitigate the cost of centralized memory, it is still growing exceedingly as technology advances due to the inverse effect on the performance of logic versus interconnect as a result of scaling.
2.4.2 On-chip versus Off-chip Memory While Figs.€2.4 and 2.5 assume all memory to be on-chip (↜ωâ•›=â•›1), Fig.€2.6 shows the cost of having part of the memory off-chip. At ωâ•›=â•›1 all memory is on-chip. ECE for T = 1.0, 50 nm, =1.0
7e+10
2D 3D4 3D8 3D16
(Operations/sec)/Watt
6e+10 5e+10 4e+10 3e+10 2e+10 1e+10 0
1
0.8
0.6
∆
0.4
0.2
Fig. 2.4↜渀 The effect of the memory distribution factor Δ on ECE for different topologies
0
38
A. Jantsch et al. ECE for T = 1.0, = 1.0, 3D16
2.5e+11
180 nm 100 nm 50 nm
2e+11
24 nm
(Operations/sec)/Watt
17 nm 1.5e+11
1e+11
5e+10
0
1
0.8
0.6
∆
0.4
0.2
0
Fig. 2.5↜渀 The effect of the memory distribution factor Δ on ECE for 3D16 topology and various technology nodes with μTâ•›=â•›1.5 and ωâ•›=â•›1 ECE for T = 1.0, 50 nm, ∆ = 0.10
3e+10
2D 3D4 3D8 3D16
(Operations/sec)/Watt
2.5e+10
2e+10
1.5e+10
1e+10
5e+09
0
1
0.95
0.90
0.85
0.80
0.75
0.70
0.65
0.60
Fig. 2.6↜渀 The effect of the on-chip versus off-chip memory with a memory distribution factor Δâ•›=â•›0.1 on ECE for various topologies
2â•… The Promises and Limitations of 3-D Integration
39
As the fraction of on-chip memory accesses decreases, the ECE drops. When 20% of the memory accesses is off-chip (↜ωâ•›=â•›0.8), the ECE drops by a factor 9 for 2-D and by a factor 19 for 3-D16 systems. Intuitively, ECE drops more for 3-D topologies because its ECE figures for all on-chip memory are more favorable, but the ECE figures for all off-chip memory are almost the same for all considered topologies.
2.4.3 Size Constrained System ECE is a metric that does not consider at what frequency or within what space a set of computations is performed. It is an abstract metric for a technology rather than for a concrete system. In order to better understand the limits of performance under given power, area and frequency constraints, we consider systems of a concrete size. Figure€2.7 shows the effect of varying the ratio of memory and operators in a concrete system with 400€mm2 area. To start with the area occupied by operators is relatively small (Fig.€2.7a). Most of the area is covered by memory for realistic memory-operator ratios of 1,000â•›≤â•›μSâ•›≤â•›5,000. For instance TILE64 [12] has a maximum performance of 8 operations per cycle per core yielding 512 operations per System@1 Ghz, 50 nm, T = 1.0,
System@1 Ghz, 50 nm, T = 1.0, 400
∆ = 0.05, =1.0, = 0.031
Area [mm2]
300 250 200 150 100
No of 32bit Operators
350 Computation 2D Computation 3D16 Memory 2D Memory 3D16 Interconnect 2D Interconnect 3D16
50
a
0 5,000
4,000
3,000
s
2,000
1,000
0
b
180,000 160,000 140,000 120,000 100,000 80,000 60,000 40,000 20,000 0 5,000
∆ = 0.1, =1.0, = 0.031
6,000
2D 3D2 3D4 3D8 3D16
4,000
3,000
s
2,000
1,000
0
∆ = 0.1, = 1.0, = 0.031 2D 3D2 3D4 3D8 3D16
5,000 4,000 Watt
Operations/second
c
2e+13 0 5,000
2D 3D2 3D4 3D8 3D16
[email protected] Ghz, 50 nm, T = 1.0,
[email protected] Ghz, 50 nm, T = 1.0, 1.8e+14 1.6e+14 1.4e+14 1.2e+14 1e+14 8e+13 6e+13 4e+13
∆ = 0.1, = 1.000, = 0.031
3,000 2,000 1,000
4,000
3,000 2,000 s
1,000
0
d
0 5,000
4,000
3,000
s
2,000
1,000
0
Fig. 2.7↜渀 Area, performance and power consumption for a concrete 400€mm2 system with μTâ•›=â•›1.0, σ = 0.031 and ω = 1.0, clocked at 1€GHz, with a 50€nm technology. a Area distribution. b Number of operations. c Operations per second. d Power consumption is limiting how densely computational units can be packed
40
A. Jantsch et al.
cycle. It has 4€MB (=1€M Word) of on-chip cache resulting in μs=220/512â•›=â•›2,048. The Niagara 2 [17] processor from Sun Microsystems, which is an 8 core 64 thread processor with 4€MB of on-chip cache, falls into a similar range. Keep in mind that our model illustrates trends and limits but does not account for control logic, decoders, arbiters, etc. The area contribution of that part is not seen in Fig.€2.7a. We usually attribute those elements to the processing units and hence, their area fraction is lower in Fig.€2.7a than we intuitively expect. However, the comparison of 2-D and 3-D topologies is interesting. Due to the higher density of memory in a 3-D architecture (DRAM vs SRAM in 2-D), the area dominance of memory in 2-D is much higher than in 3-D for the same μs. Consequently, more of the area in a 3-D system is filled with computation units and interconnect. (The relative ratio of the two latter is given by σ. A lower σ would reserve more of the area to computation.) Figure€2.7b shows how the area not covered by memory, is used for computation in 2-D and 3-D topologies. For μsâ•›=â•›2,000 we can afford 684 operators in a 2-D system, while we can squeeze in 24,551 operators in a 3D16 system. The reason 35 times more operators fit into the same area is mainly due to the much higher density of DRAM as opposed to SRAM that is common in 2-D based systems. This naturally translates to a similar increase of performance as Fig.€2.7c illustrates. It also results in a prohibitively high power consumption since the computation consumes much more power than the memory. Apparently, we cannot power all these computations in reality, but we can translate the increased potential that 3-D offers into either smaller chips, or lower frequency, or higher memory content. Figure€ 2.8 shows performance and power consumption for a smaller system (100€mm2) clocked at a somewhat lower frequency and at the 35€nm technology node. With μsâ•›>â•›4,000 we get a practical power consumption and still a very respectable tera-scale performance.
a
4.5e+13 4e+13 3.5e+13 3e+13 2.5e+13 2e+13 1.5e+13 1e+13 5e+12 0 5,000 4,000
2D 3D2 3D4 3D8 3D16
3,000 2,000 1,000 s
Watt
Operations/second
System@700 Mhz, 35 nm, T = 1.0, ∆ = 0.1, =1.0, = 0.031
0
b
800 700 600 500 400 300 200 100 0 5,000
System@700 Mhz, 35 nm, T = 1.0, ∆ = 0.1, =1.0, = 0.031 2D 3D2 3D4 3D8 3D16
4,000
3,000
2,000
1,000
0
s
Fig. 2.8↜渀 Performance and power consumption for a concrete 100 mm2 system with μTâ•›=â•›1.0, σâ•›=â•›0.031, ωâ•›=â•›1.0 and Δâ•›=â•›0.1, clocked at 700€ MHz, with a 35€ nm technology. a Operations per second. b Power consumption
2â•… The Promises and Limitations of 3-D Integration
41
2.4.4 Power and Frequency Constrained Systems For a given power budget, the performance is significantly higher for 3-D architectures as shown in Fig.€2.9. However, these performance and power figures are obtainable at small sizes and low frequencies for 3-D topologies. Figure€2.9a gives the maximum performance under a given power budget. A 3D16 topology offers 2.4 times higher performance per Watt than a 2-D topology. Interestingly, for every doubling of the stack height, we see a 20–30% increase of the performance per Watt figure. This trend is only slowly decreasing from 30% (2D–3D2) down to 20% (3D8–3D16) in Fig.€2.9a. The somewhat higher ECE of 3-D topologies are obtainable at significantly lower frequency and smaller area. Figure€2.9b shows the area-frequency trade-off for a given power (100€W) and performance (6,170.5 GOPS). For any given area, the frequency required for a 2D topology is about 25 times the frequency of the 3D16 system. Since frequencies above a few GHz are hard and costly to realize, a 2-D chip faces a tough performance hurdle while 3-D topologies can approach their ECE limits at much lower frequencies.
9e+12 8e+12 7e+12 6e+12 5e+12 4e+12 3e+12 2e+12 1e+12 0
a
= 1,
T
= 4,000, ∆ = 0.050, = 1.0, = 0.031 s
2D 3D2 3D4 3D8 3D16
6e+10
2e+10 1e+10
120
100
80 60 40 Power budget
20
b
0 400 350 300 250 200 150 100 50 Area [mm2 ]
2D 3D2 3D4 3D8 3D16
T
Operations/sec
Operations/sec
c
2D 3D2 3D4 3D8 3D16
3e+10
= 1.0, s = 4,000, ∆ = 0.050, 35 nm, = 1.0, = 0.031, frequency = 1.0 GHz
3e+13 2.5e+13 2e+13 1.5e+13 1e+13 5e+12 0
s
4e+10
T
3.5e+13
= 4,000, ∆ = 0.050, 35 nm, = 1.0, = 0.031, performance = 6,170.5 GOPS, power = 100 W
= 1.0,
5e+10 Frequency
Operations/sec
T
400 350 300 250 200 150 100 50 Area [mm2 ]
d
7e+13 6e+13 5e+13 4e+13 3e+13 2e+13 1e+13 0
= 1.0, =1.0,
= 4,000, ∆ = 0.050, 35 nm, = 0.031, area = 400 mm2
s
2D 3D2 3D4 3D8 3D16
2 1.8 1.6 1.4 1.2 1 0.8 0.6 0.4 0.2 Frequency [GHz]
Fig. 2.9↜渀 Dependences of area, frequency, performance and power consumption of different topologies in a 35€nm technology. a Performance under power constraint of a 400€mm2 system. b Under a given power budget of 100€W the performance is 6,170€GOPS. c Given a frequency of 1€GHz, the performance is a function of the area. d Given an area of 400€mm2 the performance is a function of frequency
42
A. Jantsch et al.
In Fig.€2.9c the frequency is set to 1€GHz and the performance increases with area size. For 3-D systems the performance increase is significantly steeper than for 2-D, because most added area in a 2-D chip is spent on memory and interconnect, and relatively little is invested in additional operators. Figure€2.9d illustrates the same trend; it fixes the area to 400€mm2 and shows how the performance grows with the frequency. Figure€ 2.9 demonstrates clearly the tremendous potential of 3-D stacked systems, which mainly stems from (1) the possibility to integrate dense DRAM tightly into the multi-core architecture, and (2) from the more power efficient interconnection in the third dimension, which essentially is due to shorter geometric distances.
2.5â•…Conclusion Inspired by the intrinsic computational efficiency of silicon proposed by T. Claasen we have developed the concepts effective computational efficiency (↜ECE) and effective computational density (↜ECD). They consider memory and interconnect in addition to computational operators. A small number of parameters allow an abstract characterization of a broad range of architectures and topologies. We have used ECE and ECD to study the limits of performance of 2-D and 3-D topologies with technology down to 17€nm. Our model is an abstraction of real systems and ignores many relevant aspects and details. Thus, it can only give upper bounds on the performance and real systems will not be able to exhibit comparable performance numbers. In particular we have not considered control logic, local interconnect, registers and register files. These components can consume a significant portion of the area and power of a real system. Another limitation is our focus on throughput as the main performance characteristic, while ignoring latency. Latency is much harder to capture at an abstract level since it is influenced strongly by the many details of the architecture, the arbitration policies and resource management. In real systems the theoretical limits of throughput are often not achieved because raw capacity is over-provided and a lot of control logic is spent to keep critical latency figures low. It can be noted however, that a main benefit of 3-D topologies is the lower latency of memory transactions since high capacity memory can be located much closer to the computation units. This may mean that 3-D systems come closer to their intrinsic performance limits than 2-D topologies. In summary, although our model constitutes an idealization of systems, it still expresses correct trends and bounds of real systems and we draw the following main conclusions from our study: • 3-D systems have 2–3 times higher ECE due to lower interconnect power; • 3-D systems have one order of magnitude higher memory density due to DRAM integration;
2â•… The Promises and Limitations of 3-D Integration
43
• Consequently, 3-D systems can accommodate many more computation units in a given area and with the same amount of memory; • This allows for much higher performance but causes also very high power density. • The same performance with the same power can be realized in 3-D topologies with much smaller area and at lower frequency. The last point means a cost advantage for 3-D systems, which may compensate the more expensive 3-D integration technology.
References ╇ 1. T. Claasen. High speed: Not the only way to exploit the intrinsic computational power of silicon. Proceedings of the International Solid State Circuits Conference (↜ISSCC), 1999. ╇ 2. Tilera Corporation. Tilera Home Page. http://www.tilera.com. ╇ 3. W.J. Dally. Performance analysis of k-ary n-cube interconnection networks. IEEE Transactions on Computers, 39(6):775–785, 1990. ╇ 4. A.Y. Weldezion, M. Grange, D. Pamunuwa, Z. Lu, A. Jantsch, R. Weerasekera and H. Tenhunen. Scalability of network-on-chip communication architecture for 3-D meshes. Proceedings of the International Symposium on Networks-on-Chip, 2009. ╇ 5. V.F. Pavlidis and E.G. Friedman. 3-D topologies for networks-on-chip. IEEE Transactions on Very Large Scale Integration Systems, 15(10):1081, 2007. ╇ 6. R. Weerasekera, D. Pamunuwa, L.-R. Zheng and H. Tenhunen. Two-dimensional and threedimensional integration of heterogeneous electronic systems under cost, performance and technological constraints. IEEE Transactions on Computer-Aided Design, 28(8):1237–1250, 2009. ╇ 7. B. Feero and P.P. Pande. Networks on chip in a three dimensional environment: A performance evaluation. IEEE Transactions on Computers, 58(1), 2009. http://www.micron.com/ support/dram/power_calc.html ╇ 8. F. Li, C. Nicopoulos, T. Richardson, Y. Xie, V. Narayanan and M. Kandemir. Design and management of 3 D chip multiprocessors using network-in-memory. ACM SIGARCH Computer Architecture News, 34(2):130–141, 2006. ╇ 9. G. Loh. 3D-stacked memory architectures for multi-core processors. Proceedings for the 35th ACM/IEEE International Symposium on Computer Architecture (ISCA), 2008. 10. S. Lai and T. Lowrey. OUM—A 180€ nm nonvolatile memory cell element technology for stand alone and embedded applications. Proceedings of the International Electronics Device Meeting, 2001. 11. J. Janzen. The micron system-power calculator. Micron web site, 2009. http://www.micron. com/support/dram/power_calc.html 12. S. Bell, B. Edwards, J. Amann, R. Conlin, K. Joyce, V. Leung, J. MacKay, M. Reif, L. Bao, J. Brown, M. Mattina, C.-C. Miao, C. Ramey, D. Wentzlaff, W. Anderson, E. Berger, N. Fairbanks, D. Khan, F. Montenegro, J. Stickney and J. Zook. TILE64TM Processor: A 64-Core SoC with mesh interconnect. Proceedings of the International Solid State Circuits Conference, 2008. 13. R. Ho, K.W. Mai and M.A. Horowitz. The future of wires. Proceedings of the IEEE, 89(4):490–504, 2001. 14. R. Weerasekera, M. Grange, D. Pamunuwa, H. Tenhunen and L.-R. Zheng. Compact modelling of through-silicon vias (TSVs) in three-dimensional (3-D) integrated circuits. Proceedings IEEE International Conference on 3D System Integration (↜3D IC), 2009.
44
A. Jantsch et al.
15. S. Perri, P. Corsonello and G. Staino. A low-power sub-nanosecond standard-cells based adder. Proceedings of the 2003 10th IEEE International Conference on Electronics, Circuits and Systems, 2003. 16. W.J. Dally, U.J. Kapasi, B. Khailany, J.H. Ahn and A. Das. Stream processors: progammability and efficiency. Queue, 2(1):52–62, 2004. 17. U. Nawathe, M. Hassan, K. Yen, L. Warriner, B. Upputuri, D. Greenhill, A. Kumar and H. Park. An 8-Core 64-Thread 64b Power-Efficient SPARC SoC. Proceedings of the Inetrnational Solid State Circuits Conference, 2007.
â•…
Part II
Technology and Circuit Design
Chapter 3
Testing 3D Stacked ICs Containing Through-Silicon Vias Erik Jan Marinissen
3.1â•…Introduction The semiconductor industry is on an ongoing quest to integrate more functionality into a smaller form factor with increased performance, lower power, and reduced cost. Traditionally, only two-dimensional planes were used for this: through conventional CMOS scaling, multiple IP cores in a single die (System-on-Chip, SoC), multiple dies in a single package (Multi-Chip Package, MCP), and multiple ICs on a Printed Circuit Board (PCB). More recently, also the third, vertical dimension started to become exploited: System-in-Package (SiP), in which multiple naked dies are vertically stacked in a single IC package, and interconnected by means of wirebonds to the substrate; and Package-on-Package (PoP), in which multiple packaged chips are vertically stacked. The latest evolution in this list of innovations is the so-called three-dimensional stacked IC (3D-SIC); a single package containing a vertical stack of naked dies which are interconnected by means of Through-Silicon Vias (TSVs) [1–3]. TSVs are conducting nails which extend out of the back-side of a thinned-down die, and which allow that die to be vertically interconnected to another die. TSVs are highdensity, low-capacity interconnects compared to traditional wire-bonds, and hence allow for much more interconnects between stacked dies, and these interconnects can operate at higher speeds and lower power dissipation. TSV-based 3D technologies enable the creation of a new generation of ‘super chips’ by opening up new architectural opportunities [4, 5]. Hence, they allow the semiconductor industry to continue to still its hunger for more functionality, bandwidth, and performance at smaller sizes, power dissipation [6], and cost; even in an era in which conventional feature-size scaling becomes increasingly difficult and expensive.
E. J. Marinissen () IMEC, Kapeldreef 75, 3001 Leuven, Belgium Tel.: +32 16 28-8755 Fax: +32 16 28-1515 e-mail:
[email protected] A. Sheibanyrad et al. (eds.), 3D Integration for NoC-based SoC Architectures, Integrated Circuits and Systems, DOI 10.1007/978-1-4419-7618-5_3, ©Â€Springer Science+Business Media, LLC 2011
47
48
E. J. Marinissen
Like all ICs, also these new TSV-based 3D-SICs need to be tested for manufacturing defects, in order to guarantee sufficient outgoing product quality to the customer. In this chapter, we describe the test needs of 3D-SICs, review to what extent existing test solutions can be used to address those, and discuss what new test challenges come with this new class of products. The remainder of this chapter is organized as follows. Section€ 3.2 positions TSV-based 3D-SICs in the market place and describes various TSV technology options which have a bearing on test technology. Test flows for 2D and 3D ICs are compared in Sect.€3.3. Section€3.4 argues that modular testing is a very appropriate approach for 3D-SICs and lists the required infrastructure for it. Section€3.5 discusses the new test contents we need for intra-die defects due to new 3D processing steps and for the TSV interconnects. Sections€3.6 and 3.7 focus on test access, resp. the chip-external wafer probe access and the chip-internal DfT architecture. Section€3.8 concludes this chapter.
3.2â•…3D-SICs Based on TSV Technology Micro-electronic systems typically consist of multiple integrated circuits (ICs). Traditionally, these ICs were brought together as a system by interconnecting them on a PCB (see Fig.€3.1a). Ongoing integration has brought us SoC, MCP, SiP, and PoP, all with their respective benefits and drawbacks [7]. SoCs integrate all functionality in a single die, with the benefit of fast and abundant inter-module communication; however, SoC integration forces all modules to make use of the same (for some design modules non-optimal) process technology and might lead to large, low-yielding ‘monster’ chips. MCPs, SiPs, and PoPs (see Fig.€3.1b, c) integrate multiple dies, and hence provide advantages over SoCs with respect to heterogeneous system integration, as these dies can be manufactured in different, optimized process technologies. All three integration approaches are based on wiring interconnects, which are limited in number and relatively slow and power-consuming. Only SiP and PoP make use of the vertical dimension, and hence offer the benefit of a smaller footprint. A TSV-based 3D-SIC (see Fig.€3.1d) combines the advantages of the above integration technologies [3]. It integrates multiple dies, with as potential benefits small-
Fig. 3.1↜渀 Ongoing system integration evolution: 2D a PCB, b MCP, and 3D c SiP, and d 3D-SIC
3â•… Testing 3D Stacked ICs Containing Through-Silicon Vias
49
er, high-yielding dies in possibly different, dedicated process technologies [8]. It utilizes the vertical dimension for stacking thinned dies, thereby creating a smaller footprint as well as a higher transistor density per volume unit. And the TSV-based interconnects between the various dies have in number, speed, and power dissipation more similarity to on-chip wires than to off-chip wire bonds [9, 5]. On-chip interconnect wire length, especially of the global and semi-global wires, can be reduced drastically [10]. The process technology for 3D-SICs based on TSVs is becoming available now, design support tools are emerging [11], and first products start to appear on the market. Among the early applications are CMOS image sensors stacked on their corresponding read-out and digital processing circuitry, and stacks of memories [12]. Memory-on-logic [13] and logic-on-logic [14] are expected to follow suit. Through-Silicon Vias provide, as their name indicates, an electrical connection from the active front-side (‘face’) of a silicon die through the silicon substrate to the back-side. This allows to interconnect multiple vertically stacked dies with each other. Below, we describe one of the TSV types developed at IMEC. These TSVs are cylindrical copper nails of 25€μm height, 5€μm diameter (i.e., an aspect ratio of 5:1), and have a minimum pitch of 10€μm [15, 16]. The TSV fabrication steps are depicted in Fig.€3.2 and consist of (1) deep silicon etching of TSV holes, (2) oxide deposition, (3) copper seed deposition, (4) copper plating, and (5) chemicalmechanical polishing (CMP). As can be seen in Fig.€3.2, when the wafer processing is completed, the TSVs are still deeply buried within the wafer; their height is only 25€μm, while the total wafer thickness is around 750€μm. To expose the TSV tips, the wafer needs to be thinned down from the back-side to just below 25€μm thickness. In order to provide sufficient mechanical strength and prevent it from breaking or cracking, the to-bethinned wafer is temporary bonded onto a carrier wafer, prior to thinning [17]. Subsequently, the thinned product wafer on its carrier wafer is permanently bonded to the next die, after which the temporary carrier wafer is removed. The thinning and bonding steps are depicted in Fig.€3.3. This process can be repeated in case more than two dies are stacked. There are many different variants of TSV types, process steps, and stacking options [3, 18, 19]. Below, we describe some of them, in as far as relevant for the remainder of this chapter. The TSVs we described above have a 5€μm diameter, 25€μm height, and 10€μm minimum pitch; TSVs can also be larger or smaller. Taller TSVs cause less problems with respect to wafer thinning, but have a larger aspect ratio and hence are more difficult to properly fill [20]. That is, unless we also make the TSV diameter larger, but that has a negative impact on the silicon area they consume as keep-out
deep silicon etching
via oxide deposition
Fig. 3.2↜渀 Subsequent TSV fabrication steps
Cu seed deposition
Cu plating
CMP
50
E. J. Marinissen
Carrier wafer Carrier wafer temporary carrier bonding
Carrier wafer
Carrier wafer
back-side thinning
expose Cu nails
Carrier wafer
Bottom wafer
Bottom wafer
permanent bonding
temp. carrier de-bonding
Fig. 3.3↜渀 Subsequent wafer thinning and bonding steps
area, the maximum TSV density, and the capacitive load (and performance and power dissipation) of the TSV [7]. TSVs can be fabricated as a ‘via-first’, ‘via-middle’, or ‘via-last’ process. The TSVs described above are fabricated as a ‘via-middle’ process, i.e., after the (FrontEnd-Of-Line, FEOL) transistors are fabricated, but before the (Back-End-Of-Line, BEOL) metal layers [16]. ‘Via-first’ TSVs are fabricated before FEOL, while ‘vialast’ TSVs are fabricated after BEOL. Typically, ‘via-first’ and ‘via-middle’ are quite a lot smaller, denser, and with larger aspect ratios than the rather large ‘vialast’ TSVs. One could say that ‘via-first/middle’ TSVs more follow the characteristics of semiconductor interconnect technology, while ‘via-last’ TSVs are closer to assembly interconnect technology. The orientation of the individual dies in the stack is another item of variation. Dies can be connected ‘face-to-face’, ‘back-to-back’, or ‘face-to-back’ [14], as depicted in Fig.€3.4. ‘Face’ refers to the active front-side of the die, whereas ‘back’ refers to the substrate back-side, where the exposed TSV tips stick out. In ‘face-
face 2 face 1
face 2 face 1
a face 2
face 2
face 1
face 1
b face 3 face 3
Fig. 3.4↜渀 Different stacking orientation variants with wire-bond and flip-chip external connections. a Faceto-face. b Back-to-back. c Face-to-back
face 2 face 2 face 1 face 1
c
3â•… Testing 3D Stacked ICs Containing Through-Silicon Vias
51
to-face’ stacking (Fig.€ 3.4a), the active sides of the two dies are interconnected directly. In case the external I/O is through wire-bonds, no TSVs are necessary; but the bottom die should be slightly larger than the top die to allow space for wire-bonding. In case of flip-chip bumps, TSVs are required make the connection through those. ‘Face-to-face’ stacking does not scale well to stacks of more than two dies. In ‘back-to-back’ stacking (Fig.€3.4b), TSVs in both dies are used to interconnect the two dies, while the external I/O goes via either via wire-bonds from the top die or flip-chip bumps at the bottom die. Also this scenario does not scale well to stacks of more than two dies, and moreover does not provide the minimum amount of TSV-equipped layers (which is important, as the fabrication of TSV comes with extra processing steps and associated costs). ‘Face-to-back’ stacking (Fig.€3.4c) has the advantage that it is scalable to stacks of more than two dies. The TSV tips sticking out of the back of one die connect to dedicated TSV landing pads on the face of the other die. ‘Face-to-back’ stacking can be used with all dies in the stack face-up, while the external I/O is done via wire-bonding from the bottom die; again, it is required that the bottom die is somewhat larger than the other dies. Alternatively, ‘face-to-back’ stacking also works with all dies in the stack face-down, while the external I/O is done via flip-chip bonds at the face-down bottom die. The bonding technology is yet another variation item. The TSVs with 10€ μm minimal pitch described above have been realized with copper-to-copper (Cu–Cu) direct bonding. The TSV tips are cylindric copper nails with a 5€μm diameter (as shown in Fig.€3.5a), and the TSV landing pads are copper rectangles of 9€×€9€μm2. IMEC uses thermo-compression bonding at relatively high temperatures. This bonding technology achieves sub-micron stand-off heights between the two dies, which also means that the bond quality is very sensitive to small particles in between both dies [21]. IMEC also have experimented with bonds based on coppertin (Cu–Sn) micro-bumps between both dies, as depicted in Fig.€3.5b [8]. While enlarging the minimum pitch from 10€ μm to around 40€μm (and hence reducing the maximum TSV density), this bonding type works at much lower temperatures and due to the larger stand-off height between the two dies is far less sensitive to particles in between the dies. We distinguish between Wafer-to-Wafer (W2W), Die-to-Wafer (D2W), and Dieto-Die (D2D) stacking. W2W stacking has the benefit that it avoids the pick-andplace operations required for D2W and D2D stacking; however, W2W stacking has
Fig. 3.5↜渀 Photos of two alternative bonding technologies: a 5€μm-diameter Cu TSV tip of direct Cu–Cu bond process, and b inter-metallic bond of a Cu–Sn–Cu micro-bump process
52
E. J. Marinissen
far less possibilities to exploit pre-bond test results, and hence might suffer from low compound yields and corresponding higher costs. The technology options described in this section (and others we did not discuss) make that right now there is a wide variety of TSV technologies under consideration by the global semiconductor R&D community. Some will prove ineffective or inefficient and will be abandoned; nevertheless, it seems likely that even if this field matures, multiple alternative TSV technologies will continue to exist alongside each other [2].
3.3â•…3D Test Flows A generally-applicable test strategy is to test items as early as possible in their manufacturing flow, in order to prevent additional costs for faulty items in subsequent manufacturing steps, and hence lower the overall production cost.
3.3.1 Prior Art in Test Flows Conventional single-die chips have two natural test moments: (1) wafer test (also referred to as ‘e-sort’) takes place after wafer fabrication and before assembly and packaging, and (2) package test takes place after assembly and packaging (see Fig.€ 3.6a). The outgoing product quality is guaranteed by the final test, i.e., the wafer fab
wafer fab 1
wafer fab 2
wafer fab n
wafer test
pre-bond test 1
pre-bond test 2
pre-bond test n
stacking 1+2
stacking (1 + 2)+...
stacking (1+ 2+...)+n
post-bond test 1 + 2
post-bond test 1 + 2 + 3
post-bond test 1+...+n
assembly & packaging
assembly & packaging
package test
package test
a Fig. 3.6↜渀 Typical 2D test flow (a) and potential 3D test flow (b)
b
3â•… Testing 3D Stacked ICs Containing Through-Silicon Vias
53
package test. The wafer test typically serves merely as an economical optimization to prevent unnecessary package and packaging costs of dies that can be identified as faulty already during wafer test. Hence, the wafer test contents is typically a large subset of the package test. Whether or not wafer testing should be done for a particular product, depends on the wafer fabrication yield y, the fraction d of faulty products that the test can detect (which is determined by the test quality), the costs p that can be prevented per product (here: the cost of packaging a single die), and the cost t of executing a wafer test on a single product (which is typically directly related to the test quality d). Executing a wafer test contributes to overall cost savings if
(1 − y) · d · p > t.
(3.1)
For many conventional ICs, the benefits of wafer testing indeed exceed its execution cost and hence the wafer test is part of their test flow. In recent years, a market has grown for delivery of unpackaged dies, either still in their original wafers or already singulated. These unpackaged dies are delivered by one company (the ‘die provider’) and subsequently used by another company (the ‘die user’), for example for embedding in an MCP or SiP. Suddenly, the naked die is no longer an intermediate product; for the die provider, it is the final product. The die user wants the die provider to deliver high-quality products. This changes the role of the wafer test. Instead of consisting of an economically-justified subset of the (final) package test, it is now the final test. This has led to the concept of Known-Good Die (KGD) tests [22], which should guarantee as much as possible the quality of the outgoing dies. A typical KGD wafer test includes at-speed and burn-in tests, in order to achieve quality levels otherwise known from final tests.
3.3.2 Test Flows for 3D-SICs For 3D-SICs, we distinguish between (1) pre-bond tests, (2) post-bond tests, and (3) the package test [23]. These tests are depicted in Fig.€3.6b. Only the package test is a test on packaged products; all other tests are tests of naked dies and die stacks. As handling and testing individual dies is rather cumbersome, we assume here that all pre-bond and post-bond tests are wafer-level tests. We distinguish between the prebond and post-bond wafer tests, as they are distinctly different, not only in content and purpose, but also in test access. For pre-bond tests, each die requires its own probe access points, while in post-bond tests, all test data is assumed to be pumped in and out through the bottom die of the stack. The package test serves the purpose of guaranteeing the outgoing product quality of the final product. Depending on the relationship and agreements between the die provider(s) and die user, the pre-bond and post-bond tests might have different roles. In the case of a vertically-integrated 3D-SIC maker, wafer tests have the role of economic optimizers only. However, in case die provider and die user are distinct companies, pre-bond and/or post-bond wafer tests might have the role of final test
54
E. J. Marinissen
for a particular company’s product, and hence require Known-Good Die (or KnownGood Stack) quality levels. For the generic case of a 3D-SIC consisting of n dies, as depicted in Fig.€3.6b, we introduce the following notation. • PRE(↜i): Pre-bond test of Die i (for 1 ≤ i ≤ n ). • POST(↜k): Post-bond test of a stack up to level k (for 1 < k ≤ n ). This test potentially consists of the following sub-tests: − POST die (k, i) : test of Die i (for 1 ≤ i ≤ k ). − POST int (k, j) : test of interconnect between Dies j€−€1 and j (for 1 < j ≤ k ).
• PT: Package test of the completed stack. This test potentially consists of the following sub-tests:
− PT die (i) : test of Die i (for 1 ≤ i ≤ n ). − PT int ( j) : test of interconnect between Dies j€−€1 and j (for 1 < j ≤ n ).
A 3D-SIC test flow potentially brings about a tremendous increase in wafer tests, both in number of tester insertions, as well as in number of executed sub-tests, especially for large values of n. Executing all tests leads for pre-bond testing to n tester insertions, and n sub-tests, and for post-bond testing to n€−€1 tester insertions, n and k=2 (k + (k − 1)) sub-tests. Including the Package Test, this would lead to 6 tester insertions and 16 sub-tests for n€=€3 and to 16 tester insertion and 86 subtests for n€=€8! Executing all these tests will certainly lead to a sharp increase in test costs, when compared to conventional 2D chip test flows. Whether or not all these tests make indeed technical and economical sense, is essentially governed by the same trade-off as expressed by Eq. (3.1). For 3D-SICs, the cost p that can be prevented per product by executing a prebond or post-bond wafer test is typically more comprehensive than is the case for conventional single-die chips; it includes all downstream material and processing costs: other dies in the stack, stacking costs, the package, and packaging costs. The parameters y, d, and t are strongly influenced by which faults are targeted during a particular test. For pre-bond tests, important questions are whether or not the test is executed on the thinned die, in order to be able to cover thinning-induced defects, and whether or not the test targets, in addition to the common intra-die defects, TSV faults as well; this increases the number (1 − y) · d of faulty parts we might catch, but at the same time will increase the test execution costs t. For post-bond tests, an important question is whether we only test the newly-made latest bond, or also re-test the previously tested dies and bonds in the stack. Re-testing comes with extra test execution costs t, and hence makes sense only if the latest stacking operation indeed can introduce a significant number of new defects in the already tested items. The cost-benefit trade-off offered by all these wafer test possibilities should by no means be considered static. A typical manufacturing process matures during the life-time of a product, allowing to reduce cost by omitting certain tests on intermediate product stages without reducing the overall product quality. Table€3.1 gives four example test flow scenarios, that allow to reduce the number of tester inser-
3â•… Testing 3D Stacked ICs Containing Through-Silicon Vias
55
Table 3.1↜渀 Various example test flow scenarios and their respective test costs Example test flow scenarios 1. All PRE tests, all POST tests, all PT tests 2. All ‘first-time’ tests€+€all PT tests 3. All PRE tests, final POST test, all PT tests 4. No wafer tests, only all PT tests
Number of (insertions, tests) n€=€3
n€=€5
n€=€8
(6, 16) (6, 10) (5, 13) (1, 5)
(10, 38) (10, 18) (7, 23) (1, 9)
(16, 86) (16, 30) (10, 38) (1, 15)
tions and/or sub-tests. In Scenario 1, all tests of Fig.€3.6b are executed; this might be appropriate in prototype production, where the production process is not stable yet, and the many tests provide valuable opportunities to learn and improve the production process. Scenario 2 is a case in which every ‘item’ is tested upon first opportunity, but never re-tested during wafer testing; this scenario leads to a drastic reduction in the number of sub-tests, but the number of tester insertions remains high, as after every intermediate stacking operation, a test of the newly made interconnects is performed. Scenario 3 includes all pre-bond tests, but does post-bond wafer testing only on the final stack. In this scenario, the dies are re-tested only once, and the number of tester insertions goes down. Scenario 4 is a true low-cost version, in which only Package Tests are executed. In theory, this does not diminish the test quality, but it does requires a very mature production process with high yields in all the subsequent intermediate production steps, in order to be cost-effective. A modular test approach, as discussed in the next section, is very suitable to flexibly adapt a test flow with tests and re-tests of modules.
3.3.3 Pre-Bond Testing for W2W Stacking All dies comprising a 3D stack need to be fault-free to obtain a fault-free stack. In a D2W or D2D stacking approach, pre-bond testing makes sense; utilizing its results, we can avoid stacking good to bad die or vice versa. In a W2W stacking approach, we stack entire wafers, and hence cannot avoid stacking an individual bad die. At first sight, pre-bond testing does not seem to make sense in W2W stacking, as we cannot act on its results. However, pre-bond test results can still be exploited, provided we are capable of performing matching over a repository of pre-tested wafers [24–26]. As depicted in Fig.€ 3.7, the idea is that an algorithm determines which pairs of wafers out of the repository should be stacked in order to maximize the compound yield. The yield increase due to this approach, compared to ‘blind’ stacking, depends on the number of stack tiers, the number of dies per wafer, the number of faulty dies per wafer, and the repository size. Figure€ 3.8 shows, based on Monte-Carlo simulation, the relative and absolute expected yield increase for a realistic example 3D-SIC. We assume a die area A = 50 mm2 , defect density d0 = 0.5 defects/cm2 , and a defect clustering parameter α = 0.5. Assuming a negative binomial defect distribution [27], this
56
fab 1
E. J. Marinissen
sort 1
test 1
bond 1+2
match fab 2
test 2
Fig. 3.7↜渀 Exploitation of pre-bond test results in wafer matching
gives a yield y€ =€ 81.6%. On 300€ mm wafers with 3€ mm edge clearance, we fit about 1,278 dies of size A [28], of which on average 235 (=€81.6%) are faulty. The graph in Fig.€3.8a shows, for a stack of n€=€2 dies and varying die yield y, the relative expected yield increase as a function of the repository size. At the right-hand side of the figure, for the various curves the absolute yields for repository sizes k€=€1 and k€=€50 are given. (Note that a typical wafer cassette holds k€=€25 wafers.) Figure€3.8b shows the same, for a fixed die yield y€=€81.6%, and varying number of stack tiers n. The expected relative yield increases grow with decreasing die yield y and with increasing tier count n. The relative yield increases vary between 0.5 and 10% and hence are significant. In this way, pre-bond test results can be made useful, even in the context of W2W stacking. Obviously, this approach comes with additional costs, in the form of additional tester insertions and test execution costs for the pre-bond tests. However, these costs are not as high as they seem at first sight, as we can save again on postbond test costs. A more in-depth cost-benefit analysis is discussed in [26].
3.4â•…Modular Testing Modular testing refers to an approach in which the various modules that together constitute an IC product are tested as separate, stand-alone units [29]. For complex SoCs, modular testing is increasingly gaining traction, for the following reasons. • Heterogeneous modules contain different circuit structures and exhibit different defects; consequently, they require dedicated fault models and test patterns. For example: embedded memories and mixed-signal blocks are tested separately from the embedding digital logic. • Black-boxed IP cores can only be tested with test patterns as delivered by their core providers, as only they know the implementation details of those cores. • A divide-n-conquer approach in which a monolithic design is broken up into more digestible chunks makes test pattern generation more tractable, and signifi-
3â•… Testing 3D Stacked ICs Containing Through-Silicon Vias 1.06
Absolute Yield
Fixed parameters: n=2; d=1,278 y=~50% y=~60% y=~70% y=~80% y=~90%
1.05 Relative Increase Factor of Expected Yield
57
1.04
one cassette k=25
10,000 simulation runs
k=1
k=50
25.0% 26.2%
36.0% 37.2%
1.03 1.02
49.0% 50.0%
1.01
63.9% 64.7% 81.0% 81.3%
1.00
a
Relative Increase Factor of Expected Yield
1.12
0
5
10
15
20 25 30 35 Repository Size k
40
45
50
Fixed parameters: d=1,278; fi =235 (for 1≤ i ≤6) n=6 n=5 n=4 n=3 n=2
1.10 1.08
Absolute Yield
one cassette 10,000 simulation runs k=25
k=1
k=50
29.6% 32.5%
36.2% 38.7%
1.06
44.4% 46.3%
1.04
54.4% 55.7%
1.02
66.6% 67.3% 1.00
b
0
5
10
15
20 25 30 35 Repository Size k
40
45
50
Fig. 3.8↜渀 Expected yield increases for an example 3D-SICs with a varying die yield y and fixed stack size n€=€2 and b varying stack size n and fixed die yield y€=€81.6% [26]
cantly reduces the resulting test data volume as well, as every module gets only the test patterns it requires, instead of the SoC-wide maximum [30]. • Modular testing allows for easy reuse of tests, throughout the life-cycle of one SoC, and also in subsequent derivate designs that reuse the same design module. The modular test approach is especially suited to 3D-SICs. All four arguments listed above for modular SoC testing apply even stronger to the case of 3D-SICs. In
58
E. J. Marinissen
addition, a modular test approach fits very naturally with the test flow as depicted in Fig.€3.6b. A modular test approach allows to freely decide where in the test flow a certain module is tested and/or re-tested and to adapt that test flow during the life cycle of the product. Finally, in case of a faulty product, a modular test approach provides a first-order diagnosis, sufficient to pin-point the faulty component. This might be crucial, especially if the overall 3D-SIC product is assembled from components of different manufacturing sources. Obvious test modules are the various individual dies, the TSV-based interconnect between dies, and the ‘extra-connect’ to the external world. For example, in a two-die stack, we would consider at least four separate test modules: (1) Die 1, (2) Die 2, (3) the interconnect between Dies 1 and 2, and (4) the extra-connect to the product pins. If the dies themselves are complex, possibly heterogeneous SoCs, the modular test hierarchy can be further extended by dividing them into various sub-modules. Modular testing requires the following infrastructure. 1. A language in which the test description is transferred from one party to the next (standardized as IEEE Std. 1,450.6, Core Test Language (CTL) [31]). 2. On-chip DfT in the form of a core-test wrapper (standardized as IEEE Std. 1,500 [32]) and a Test Access Mechanism (TAM) such as a TestRail or test bus [33]. 3. EDA support for automated test expansion, i.e., the translation from modulelevel test into chip-level test [34]. Section€ 3.7 discusses the on-chip DfT to support modular testing, as part of the overall DfT architecture for 3D-SICs, in more detail.
3.5â•…3D Test Contents The test contents of 3D-SICs is, in a first-order approximation, not very different from conventional 2D ICs. In the (FEOL/BEOL) wafer manufacturing, the same defects can occur, and hence the faults, fault models and test patterns are the same. In this section, we focus on the differences in defects and test content between conventional 2D ICs and new 3D-SICs. The 3D processing might lead to new intra-die defects and faults, that require new tests. Secondly, the TSV-based interconnects constitute a new structure, for which we have to define new tests.
3.5.1 New Intra-Die Defects Commonly used tests for digital logic, memories, analog, and RF modules cover the majority of known defects. However, for 3D-SICs, the question is whether some of the new 3D processing steps cause new defects that are not covered by conventional fault models.
3â•… Testing 3D Stacked ICs Containing Through-Silicon Vias
59
Wafer thinning is such a 3D processing step that can cause new defects. The TSV processing only allows for limited TSV heights (say, 10–100€μm) and aspect ratios (say, 10:1 maximum) [20]. In order to expose the TSV tips at the back-side for bonding to another die, the wafer needs to be thinned down. Although this is an area for further research, early results indicate degradation of some I-V characteristics, shifts in device performances, and limited yield losses due to wafer thinning [35, 36]. Thinning defects might be detected during a post-bond or package test. In case they would form a significant fraction of the total defect population, it might be worthwhile to consider performing pre-bond tests on thinned wafers, in order to increase the compound stack yield; Sect.€3.6.1 discusses the related challenges in more detail. Thermal dissipation and thermo-mechanical stress are other causes of concern. Integrated circuits heat up during operation. In densely packed stacks of thinned dies, the heat density might pile up quite high, and has little way of escaping. The heat generated might easily impact the correct operation of the various dies, especially since some dies (e.g., DRAMs) are more heat-sensitive than others. Due to the different Coefficients of Thermal Expansion (CTEs) of the various materials in the stack, the stack might also suffer from thermo-mechanical stress, causing further malfunction. Tests for these phenomena are executed as part of the post-bond or package tests.
3.5.2 Test of TSV-Based Interconnects The TSV-based interconnect of 3D-SICs constitute a new structure, not existing in conventional 2D ICs. Hence, we need to consider which defects it might suffer from, how these defects behave as faults, how to model these faults, and how to test for them. TSV-related defects might occur either in the fabrication of the TSV themselves (see Fig.€3.9), in the bonding of the TSVs to the next layer, or during the life time of the 3D stack. During the fabrication of TSVs, (micro-)voids, for example due to quasi-conformal plating, might lead to (hard or weak) opens in TSVs. Pinholes in the TSV oxide might lead to shorts between TSV and substrate. Ineffective removal of the seed layer might lead to shorts between neighboring TSVs. The bond quality might be negatively impacted by oxidation or contamination of the bond surface, height variation of the TSVs, or particles in between the two dies. Misalignment during bonding, in either x, y, or (tilted) z direction might lead to opens or shorts. In case of Cu–Sn micro-bumps, the tin might squeeze out due to TSV height variation and cause shorts in between them. During the product’s life time, CTE mismatch might cause the thinned dies to warp, after processing and/or during operation; also, thinned dies might be more susceptible to the effects of mechanical load. TSVs can already be tested during the pre-bond test. If done on not-yet-thinned wafers, we have test access only to one side of the TSV, as the other side is still buried in the thick substrate. Tsai et€al. [37] propose DfT to perform a leakage test
60
E. J. Marinissen
Fig. 3.9↜渀 Examples of TSV defects: a insufficiently filled TSVs, and b TSVs containing microvoids along the axis and at the bottom
for detecting TSV oxide pinholes. Chen et€al. [38] propose DfT to perform a capacitive test for open or shorted TSVs. If we want to test signal propagation through the TSV, we necessarily have to probe on thinned wafers; this is described in more detail in Sect.€3.6. The interconnect is only formed during stacking, which implies that the full interconnect (including TSV and bond) can only be tested during post-bond or package tests. Although the actual defect mechanisms might be different, the resulting faults for TSV-based interconnects are rather similar to the faults normally considered for wiring interconnects: opens, shorts, and delay faults. This means there is also a large body of existing work with respect to test pattern generation [39] which we can leverage, such as the Counting Sequence Algorithm [40], the Modified Counting Sequence Algorithm [41], and the True/ Complement Test Algorithm [42]. These algorithms detect all (hard) open and shorts through a set of digital test patterns that can be kept small, as it grows only logarithmically with the number of interconnects. The test algorithms rely on the fact that we have full controllability at all interconnect inputs and full observability at all interconnect outputs (as is for example the case with Boundary-Scan-Test (IEEE Std. 1,149.1) equipped ICs at a PCB). In Sect.€3.7 of this chapter we discuss this requirement in more detail. Testing delay faults on TSVbased interconnects is not difficult nor test-time consuming either, but requires good synchronization between both dies. The tests described above all rely on the power-, ground-, and clocking infrastructure in the dies across both sides of the TSV-based interconnect to be present and working. All dies in a 3D-SIC stack, apart from the bottom die, receive their power, ground, and clock signals also through TSVs. Typically, multiple redundant TSVs are used to transfer power and ground, and hence that infrastructure might be less sensitive for faults in single TSVs. On the other hand, this redundancy also complicates the detection in power and ground TSVs. Faults in clock-signal TSVs are typically easier to detect, as a non-transferred clock signal often leads to catastrophic results.
3â•… Testing 3D Stacked ICs Containing Through-Silicon Vias
61
3.6â•…3D Wafer Test Challenges Compared to a conventional 2D test flow, a 3D test flow contains potentially many more wafer tests for carrying out pre-bond and post-bond tests on intermediate product stages, which prevent downstream processing of bad products and hence are necessary to keep the overall production cost down. Pre-bond and post-bond wafer tests both have their specific challenges with respect to probe access.
3.6.1 Pre-Bond Wafer Test Access For pre-bond tests, the main wafer test access challenges stem from probing on very many, very small probe points, possibly on thinned wafers on a temporary carrier wafer. Today’s probe technology, using either cantilever or vertical probes, goes down to a minimum pitch of about 35€μm [43], has a maximum probe count of several hundreds, and makes significant scrub marks in order to achieve a proper electrical contact. This is insufficient to probe on TSV tips of 5€μm diameter and 10€μm pitch (or smaller), which might come in several thousands (the 10€μm pitch allows TSV densities up to 10€ k/mm2), are made of fragile copper, and do not tolerate scrub marks that inhibit downstream Cu–Cu bonding on the same surface. Probing on Cu–Sn micro-bumps is also challenging, but nevertheless a bit easier, as the sizes and pitches of the micro-bumps are larger, consequently their numbers smaller, and the constraints on scrub marks less strict. For pre-bond testing of the various dies that will make up a 3D-SIC, we distinguish between the bottom die and the other (non-bottom) dies. The non-bottom dies receive all their functional signals (power, ground, clocks, control, data) exclusively through TSV connections, and hence only possess I/Os which cannot be probed with today’s probe technology. The bottom die is different, in the sense that, next to its TSV connections, it also has wire-bond or flip-chip pads for the extra-connect, which provide an interface probe-able with today’s probe technology and which allows us to get test data in and out of that die and test it. If we want to execute prebond tests on the other, non-bottom dies, new solutions need to be developed. The following solution approaches are being explored. • Additional probe pads Providing dedicated additional probe pads (as a form of DfT) at the side to be probed and sized such that today’s probe technology can handle them. Obviously, this comes with an area penalty, and hence the number of extra pads should be minimized; on-chip DfT can help with this (see Sect.€3.7). • Probe technology improvement Significant improvement of wafer probe technology, scaling down to (in the order of) 25€μm pitch for micro-bump probing or down to (in the order of) 10€μm pitch for TSV tip and TSV landing pad probing, while at the same time increasing the maximum probe count and reducing the scrub mark damage.
62
E. J. Marinissen
• Contactless wafer probing Further development of contactless wafer probe technology, for example based on capacitive [44] or inductive coupling [45, 46]. This technology has the inherent advantage to not cause any scrub marks. However, also this technology needs to scale down in order to probe on micro-bumps and/or TSVs in the sizes and densities they occur. Moreover, DUT power delivery is not contactless and hence still requires conventional contact probes. While the latter two approaches still require further development effort, the first approach is feasible today. As an example, let us consider the flip-chip 3D-SIC depicted in Fig.€ 3.4c. It consists of three dies, which are stacked face-down, and face-to-back. The bottom die and middle die contain TSVs, the top die does not. The bottom die provides the extra-connect by means of flip-chip bumps. Figures€ 3.10–3.12 show the various pre-bond wafer probe options that exist for these three dies. The bottom die can be probed on its (regular-sized) flip-chip pads on the frontside, as shown in Fig.€3.10a. The wafer is not yet thinned, and hence its TSVs are buried within the thick wafer and we cannot test through them yet. Alternatively, it could be attractive to execute the pre-bond tests on a thinned wafer, in order to be allow the pre-bond test to also detect defects due to wafer thinning. A thinned wafer only exists on a carrier wafer, to prevent cracking. The front-side flip-chip pads are now inaccessible, due to the carrier wafer. Wafer probe access could be obtained from the back-side of the thinned wafer, where the exposed TSV tips or microbumps are located. Unfortunately, these are too small and numerous to be probed by today’s probe technology. A solution could be to provide a number of dedicated additional regular-sized probe pads on the back-side (as a form of DfT). This is depicted in Fig.€3.10b, where both the small TSV tips/pads and the larger dedicate probe-able pads are shown. Figure€ 3.11 shows the two similar alternatives (front-side probing on a thick wafer and back-side probing on a thinned wafer on carrier) for the middle die. The difference between bottom die and middle die is that the middle die has functional probe-able pads on neither front- nor back-side. Hence, also for the front-side
face 1 face 1 carrier wafer
a
b
Fig. 3.10↜渀 Wafer probe options for the bottom die. a Front-side on thick wafer. b Back-side on thinned wafer
3â•… Testing 3D Stacked ICs Containing Through-Silicon Vias
63
face 2 face 2 carrier wafer
a
b
Fig. 3.11↜渀 Wafer probe options for the middle die. a Front-side on thick wafer. b Back-side on thinned wafer
Fig. 3.12↜渀 Wafer probe options for the top die. Frontside on thick wafer
face 3
probing (Fig.€3.11a), dedicated additional regular-sized probe pads need to be provided. In our example stacking scenario, the top die does not contain TSVs, and hence will not be thinned. Therefore, probing on its back-side is not an option. As shown in Fig.€3.12, this leaves us only with the possibility to probe on the front-side of the thick wafer, where again dedicated additional regular-sized probe pads need to be provided, as the functional TSV landing pads are too small for today’s probe technology. A question that arises is whether the costs associated to providing additional probe pads to be able to execute a pre-bond test do not entirely consume the benefits of that same pre-bond test. Using IMEC’s elaborate 3D cost model (which accounts for the cost of clean room, equipment, maintenance, materials, and personnel, as well as production yields and test coverage), we have done cost-benefit calculations, which demonstrate that for most manufacturing yields, the costs of providing additional probe pads on the non-bottom dies to enable pre-bond testing, does pay off [47]. As an example, one such trade-off calculation assumed the following case. • A two-die stack in a D2W or D2D stacking process (such that the pre-bond tests results can be fully utilized, and dies failing the pre-bond test are excluded from stacking). • Both dies are full-scan testable digital logic dies. The top die contains 15€M gates (10€×€10€mm2), while the bottom die contains 20€M gates (12€×€12€mm2).
64
E. J. Marinissen
• The bottom die always undergoes a pre-bond test. It contains 100 scan chains, and its pre-bond test uses 2k patterns to achieve 99% test coverage. • The trade-off is about the pre-bond test for the top die. If tested, it uses 13 scan chains, and 2k patterns to achieve 99% test coverage. To be able to do this, it requires 30 additional probe pads (with associated silicon area costs). Alternatively, the top die is not tested; we do not need additional probe pads, but are required to blindly stack both good and bad top dies. • All bad stacks (due to bad top die, bottom die, or TSV interconnect) are detected by the final test. Hence, the decision to execute or not execute the pre-bond test has no impact on the final outgoing product quality. However, the total manufacturing and test cost can only be recuperated by increasing the cost price of good products. The results of the cost model calculations are depicted in Fig.€3.13. The horizontal axis shows the wafer manufacturing yield for both top and bottom die, which is assumed to be equal and in order to take into account the different die sizes expressed in yield per cm2. The vertical axis shows the relative production costs per produced good 3D stack, normalized to the (cheapest) case in which wafer yield is 100% and no pre-bond test for the top die is performed. Figure€3.13 shows that performing the pre-bond test pays off for wafer yields above 98%/cm2, despite the extra test execution costs and the costs for providing extra, probe-able sized pads on the top die.
1.6
1.4
1.3
Relative cost per 3D stack
Relative cost per 3D stack
1.5
20 18 16 14 12 10 8 6 4 2 0
100% 90% 80% 70% 60% 50% 40% 30% 20% 10% Die yield per cm2
1.2
1.1 No Top Die Pre-Bond Test Top Die Pre-Bond Test
1.0 100%
95%
90%
85%
80%
2
Die yield per cm
Fig. 3.13↜渀 Cost comparison between executing a top-die pre-bond test or not, where the first alternative requires extra probe pads
3â•… Testing 3D Stacked ICs Containing Through-Silicon Vias
65
3.6.2 Post-Bond Wafer Handling In post-bond testing, the wafer test access is typically through the regular functional pads of the bottom die of the stack. This is largely ‘business-as-usual’ as far as probe technology is concerned. The challenges for post-bond testing are in the wafer handling within the probe station, especially in the case of D2W stacking. On top of the bottom wafer, stacks consisting of one or multiple dies stick out. If that top side is the probe side of the wafer, the stacks might obstruct the contact view, making probe needle positioning difficult. Also, during probe needle movement, we need to make sure that the needles do not collide with the stacks. On the other side, if we probe on the bottom side of the wafer, the stacks create a very non-planar surface, which is difficult to keep stable on the chuck. It is still a matter of on-going research to resolve these issues.
3.7â•…3D On-Chip DfT Architecture 3.7.1 Hierarchical DfT Requirements The primary role of on-chip Design-for-Testability (DfT) is to provide controllability and observability from the chip I/Os into the heart of the chip design and vice versa. We consider a hierarchical 3D-SIC consisting of multiple stacked dies, which each consist of one or multiple ‘test modules’ (see Sect.€3.4). DfT requirements exist at every level of the design hierarchy. 1. Core-Level DfT DfT within the test modules, e.g., internal scan chains, Test Data Compression (TDC) hardware [48], and/or Built-In Self-Test (BIST). 2. Die-Level DfT DfT to enable modular testing per die, i.e., wrappers around the test modules and TAMs [29]. Wrappers based on IEEE Std. 1,500 [32] provide controllability and observability at the module boundary, for both inward-facing tests (↜InTest) as well as outward-facing tests (↜ExTest). The TAM architecture can be optimized for test bandwidth vs. test length trade-off [33]. 3. SIC-Level DfT This level constitutes the new DfT for TSV-based 3D-SICs. It includes the following. − A wrapper at the die boundary, to support modular testing per die, and allow for both InTest (testing the dies and cores) and ExTest (testing the TSV-based interconnect in between the dies). The wrapper cells could either be based on IEEE Std. 1,149.1 or IEEE Std. 1,500 (see Fig.€3.14). Especially if dies are designed by different teams or companies, and not necessarily ‘friends’ at their interfaces, it is probably a wise thing to equip them with ripple-protected wrapper cells.
66
E. J. Marinissen SO
G – 1 1
PI G – 1 1
a
SO PI G – 1 1
1D Q
1D Q
Clk
Clk
SI
SO G – 1 1
PO
SI
G – 1 1
PI G – 1 1
1D Q Clk
b
PO
c
1D Q
1D Q
Clk
Clk
PO
SI
Fig. 3.14↜渀 Various wrapper cell implementations. a IEEE 1,149.1 default, ripple-free. b IEEE 1,500 default. c IEEE 1,500 special, ripple-free
− For pre-bond tests: dedicated additional probe pads for the non-bottom dies (see Sect.€3.6). − For post-bond tests: TestElevators that transparently pass test stimuli from a lower-level die to a higher-level die and test responses in the opposite direction. − A switch to select between additional probe pad access (for pre-bond tests) and TestElevator access (for post-bond tests). Also, the DfT of a lower-level die should be able to operate independently from the presence (or not) of the die(s) above it in the stack. This requirement allows pre-bond tests, as well as post-bond tests on incomplete stacks. 4. Board-Level DfT DfT to support board-level testing, once the product is soldered to a Printed Circuit Board (PCB). Towards this end, the overall product should be compatible to IEEE Std. 1,149.1/4/6.
3.7.2 Simplified Example DfT Architecture For illustration purposes, Fig.€3.15 shows a simplified example of a DfT architecture that meets the above requirements. It consists of two dies, stacked face-down
3â•… Testing 3D Stacked ICs Containing Through-Silicon Vias
67
scan chain 2 Die 2 (top)
logic scan chain 1 logic
SIt1
SIt2
SOt2
SOt1
Die 1 (bottom)
logic scan chain 2 logic scan chain 1 logic
TD1
D1 SI1
D2 SI2
Q2 SO2
Q1 SO1
TDO
Fig. 3.15↜渀 Simplified example of a 3D DfT architecture
in a face-to-back fashion. Each die is a single scan-testable logic module. The figure shows the functional circuitry and I/Os, as well as the additional DfT: wrapper cells, multiplexers, additional probe pads for pre-bond testing, and TSV-based TestElevators for post-bond testing. The above example is simplified in various ways. Figure€ 3.15 shows only test data, and abstracts from test control signals. The stack consists of two dies only. Each die consists of a single test module only. Each test module has only two scan chains: one wrapper boundary scan chain and one consisting of two concatenated internal scan chains. In reality, many of these parameters will be (significantly) larger. As is the case of DfT architectures for conventional 2D SoCs [33], it is worthwhile for real-life large 3D-SICs to optimize the DfT architecture, such that the corresponding test schedule allows for a minimal test length [49–52]. The example DfT architecture has seven different test access modes, which are enabled by various DfT multiplexer settings. Figure€3.16 shows the active test access paths of the various modes. All modes (except for the board-level test mode) have two scan chains: one for the wrapper boundary register, and one for the module-internal scan chains. • Pre-Bond Tests 1. A mode in which a pre-bond test can be applied before wafer thinning to the bottom die from its front side (Fig.€3.16a). Test access is via two scan
logic scan chain 1
logic
Die 2 (top)
logic
scan chain 1
logic
logic scan chain 2
logic scan chain 1
logic
e
scan chain 2
logic scan chain 1
logic
c scan chain 2
logic scan chain 1
logic
logic scan chain 2
logic scan chain 1
logic
Die 2 (top)
logic
Die 2 (top)
b scan chain 2
d
Die 1 (bottom)
logic scan chain 1
Die 1 (bottom)
Die 1 (bottom)
Die 2 (top)
a
logic scan chain 2
Die 2 (top)
logic scan chain 2
Carrier Glue Die 1 (bottom)
E. J. Marinissen
Die 1 (bottom)
Die 1 (bottom)
68
scan chain 2
logic scan chain 1
logic
logic scan chain 2
logic scan chain 1
logic
f
scan chain 2
logic scan chain 1
logic
logic scan chain 2
logic scan chain 1
logic
g
Fig. 3.16↜渀 The seven test access modes of the example 3D DfT architecture. a Pre-bond test Die 1 (thick). b Pre-bond test Die 1 (thinned). c Pre-bond test Die 2. d Post-bond test Die 1. e Post-bond test Die 2. f Post-bond test interconnect. g PCB test
chains, which are multiplexed onto already-existing functional pads, viz. D1/SI1–Q1/SO1 and D2/SI2–Q2/SO2. Note that in this mode, the wrapper cells at the extra-connect terminals of the bottom die do not need to be included in scan chains, as they are directly controllable and observable from the wafer probes. 2. A mode in which a pre-bond test can be applied after wafer thinning to the bottom die from its back side (Fig.€3.16b). Test access is via two scan chains which connect to dedicated back-side pads, viz. SIb1–SOb1 and SIb2–SOb2. Note that in this mode, the wrapper cells at the extra-connect terminals of the bottom die do need to be included in the wrapper boundary register scan chain. 3. A mode in which a pre-bond test can be applied to the top die from its front side (Fig.€3.16c). Test access is via two scan chains which connect to dedicated front-side pads, viz. SIt1–SOt1 and SIt2–SOt2.
3â•… Testing 3D Stacked ICs Containing Through-Silicon Vias
69
• Post-Bond Wafer and Package Tests For all post-bond wafer and package tests, test access is via two scan chains which are multiplexed onto already-existing functional pads on the front-side of the bottom die, viz. D1/SI1–Q1/SO1 and D2/SI2–Q2/SO2. 4. A mode in which a post-bond wafer or package test can be applied to the bottom die (Fig.€3.16d). 5. A mode in which a post-bond wafer or package test can be applied to the top die (Fig.€3.16e). 6. A mode in which a post-bond wafer or package test can be applied to the TSVbased interconnects between bottom and top die (Fig.€3.16f). • Board-Level Test 7. A mode in which a board-level test is executed (Fig.€3.16g). Test access is via one boundary scan chain along the extra-connect interface of the bottom die which connects to dedicated front-side pads, viz. TDI–TDO (part of the IEEE 1,149.1 Boundary Scan standard).
3.7.3 Advanced DfT Techniques and Test Resource Partitioning The following advanced DfT techniques play a special role in the context of 3DSICs. • Reduced Pad-Count Testing (RPCT) RPCT is a DfT technique to reduce the width of a scan test interface [53]. As discussed in Sect.€3.6, dedicated additional probe pads might need to be provided to execute a pre-bond test on the bottom die after thinning or to execute a pre-bond test on other, non-bottom dies. These extra probe pads are costly in area. RPCT can be exploited to reduce the number of extra pads required. Note that the usage of RPCT does not affect the total test data volume, which implies that a reduced test interface width comes at the expense of an increased test length. • Test Data Compression (TDC) TDC is a DfT technique that exploits the many ‘don’t care’ bits in ATPG-generated test patterns to compress the off-chip test data in a (near-) lossless manner. It allows to reduce the volume of both test stimuli and responses (and the corresponding test length) with one or two orders of magnitude [48]. TDC can play a role in reducing the test data volumes of 3D-SICs. When applied per test module, the TAMs that provide these test modules with stimuli and responses can be scaled down. Also, RPCT and TDC form an attractive DfT combination, as the first scales down the test interface width, while the second prevents the test length from increasing.
70
E. J. Marinissen
• Built-In Self-Test (BIST) BIST is a DfT technique that performs the entire generation of test stimuli and evaluation test responses on chip, such that the IC test becomes completely selfcontained and does not require external test equipment (other than to start the BIST and read out its result). BIST can play a role in reducing the test data volumes of 3D-SIC. Actually, BIST reduces the test data volume even more than TDC, viz. down to (virtually) zero. The price to be paid for this is that LBIST (for digital logic) typically requires more implementation area, the test time can be longer, and/or the test quality less. MBIST for (embedded) memories, on the other hand, does not have these drawbacks and seems very attractive for 3D-SICs containing either memory dies or memories embedded in logic dies. Other benefits of BIST are that it might play a role in protecting proprietary test contents, such that a die user can execute a test without having to know its exact contents, and in re-using tests across the IC’s life time [54, 55]. Just as 3D-SICs offer the opportunity to system architects to re-design and re-optimize their system architecture, these die stacks also offer the opportunity to DfT architects to re-design and re-optimize their DfT architecture. Especially where this involves the decision which DfT resource to put into which die, we refer to this as Test Resource Partitioning. Let us illustrate the possibilities by means of an example. Consider a 3D-SIC product consisting of a memory die stacked on top of a logic die. The memory die provider might be used to make only stand-alone memories, which often do not come with BIST; being stand-alone, the memory I/Os are fully accessible from the test equipment, and the test costs are typically reduced by testing many memory chips in parallel (‘multi-site’). In a 3D-SIC context, for the pre-bond test the memory is still a stand-alone memory, but for the post-bond test that same memory die is actually more similar to an embedded memory. And, for embedded memories, BIST is the DfT methodology of choice. One can envision a scenario in which the memory die comes ‘3D-prepared’, i.e., with an on-chip BIST engine. This scenario has as advantage that any proprietary memory test content does not need to be released. However, the MBIST (logic) might be difficult to implement in the technology of the memory die (probably DRAM). Therefore, an alternative scenario could be that the memory maker provides a ‘drop-in’ description of a MBIST engine, which is actually implemented in the bottom logic die. The MBIST operation is controlled from within the logic die, whereas the stimuli and responses flow over TSV-based interconnect into and out of the memory die.
3.8â•…Conclusion 3D-SICs have many compelling benefits and hence are quickly gaining ground. It is to be expected that soon they will take a significant share of the overall semiconductor market. Test solutions need to be ready for this new generation of ‘super chips’.
3â•… Testing 3D Stacked ICs Containing Through-Silicon Vias
71
3D-SICs are chips where all basic as well as most advanced test technologies come together. In addition, they pose some truly new test challenges. The manufacturing flow for 3D-SICs is more complex than for conventional 2D ICs, and hence offers more natural moments to perform wafer tests. We introduced the notions of pre-bond and post-bond wafer test, in addition to the (final) package test. In case of a disintegrated manufacturing flow, the individual dies and/or notyet-packaged die stacks might be final products for a particular company. In such a setting, high-quality pre-bond and/or post-bond tests might be required to guarantee the outgoing product quality. We typically refer to such tests as Known-Good Die (KGD) and Known-Good Stack (KGS) tests. For an integrated device manufacturer, the main role of wafer tests is merely to prevent costs downstream: stacking a bad to a good die, or packaging a bad stack. Whether or not it is economical to perform pre-bond and/or post-bond wafer tests in that context, depends on factors as yield, preventable downstream costs, and test costs. We have demonstrated that for most die yields, it is indeed economical to perform pre-bond tests, even if this implies that non-bottom dies need to be equipped with additional probe pads. We also showed that even in the case of Wafer-to-Wafer (W2W) stacking, pre-bond testing might pay off, as the additional test costs are surpassed by yield benefits if wafer matching is performed. A modular test approach treats the various components of the product as separate test units and hence fits very well to 3D-SICs. Different dies might contain different circuit structures or come from different fabs, and hence require different tests. In addition, modular testing provides a first-order diagnostic resolution, in case of test failure. The definition of an optimal test flow changes over the life-time of the product, as component yields mature. Modular testing allows to flexibly adjust and optimize the test flow, by freely deciding where in that flow a certain module is tested and/or re-tested. In first-order approximation, the test content for stacked dies is similar to conventional 2D ICs. However, evidence starts to appear for new defects due to novel 3D processing steps such as wafer thinning, as well as thermal and thermo-mechanical stress. The TSV-based interconnects are an entirely new structure, which needs to be tested as well. Wiring interconnect tests for opens and shorts are a good first attempt, but need to be refined for more subtle defects. Wafer test for 3D-SICs is a challenge, as today’s probe solutions do not allow to probe on the I/Os (in the form of TSV tips or micro-bumps) of the non-bottom dies. A way out is to provide extra probeable-sized pads, but a more cost-effective solution can hopefully be found in a significant improvement of wafer probe technologies. As in all ICs, DfT plays a crucial role in transporting test stimuli and responses in and out of the various test modules. Our chapter showed an example DfT architecture that enables modular testing and supports the various pre-bond, post-bond, and package test modes. Die-level test wrappers, additional pads for pre-bond testing, and TestElevators for post-bond testing play a crucial role in this architecture. The architecture can be further augmented with DfT techniques like RPCT, TDC, and BIST. 3D-SICs open the possibility to re-evaluate existing test resource partitions and explore new ones.
72
E. J. Marinissen
Note that this chapter only focused on electrical testing of 3D-SICs. There are also many challenges for 3D-SICs in related areas as design validation, in-line inspection, metrology, diagnosis, failure analysis, redundancy and repair, but they are beyond the scope of this chapter. Acknowledgments╇ We thank many colleagues at IMEC for stimulating discussions, especially Eric Beyne, Ingrid De Wolf, Luc Dupas, Mario Gonzalez, Anne Jourdain, Paresh Limaye, Pol Marchal, Nikolaos Minas, Dan Perry, Philippe Roussel, Geert Van der Plas, Bart Swinnen, Kris Vanstreels, Dimitrios Velenis, and Jouke Verbree.
References 1. Robert S. Patti. Three-Dimensional Integrated Circuits and the Future of System-on-Chip Designs. Proceedings of the IEEE, 94(6):1214–1224, 2006. 2. Eric Beyne and Bart Swinnen. 3D System Integration Technologies. Proceedings of IEEE International Conference on Integrated Circuit Design and Technology (ICICDT), pages 1–3, 2007. 3. Philip Garrou, Christopher Bower and Peter Ramm, Eds. Handbook of 3D Integration—Technology and Applications of 3D Integrated Circuits. Wiley-VCH, Weinheim, Germany, 2008. 4. Gabriel H. Loh, Yuan Xie and Bryan Black. Processor Design in 3D Die-Stacking Technologies. IEEE Micro, 27(3):31–48, 2007. ╇ 5. Roshan Weerasekera, Li-Rong Zheng, Dinesh Pamanuwa and Hannu Tenhunen. Extending Systems-on-Chip to the Third Dimension: Performance, Cost and Technological Tradeoffs. Proceedings International Conference on Computer-Aided Design (ICCAD), pages 212–219, 2007. ╇ 6. James W. Joyner and James D. Meindl. Opportunities for Reduced Power Dissipation Using Three-Dimensional Integration. Proceedings IEEE International Interconnect Technology Conference (IITC), pages 148–150, 2002. ╇ 7. Bart Swinnen. 3D Technologies: Requiring More Than 3 Dimensions from Concept to Product. Proceedings IEEE International Interconnect Technology Conference (IITC), pages 59– 62, 2009. ╇ 8. Eric Beyne et al. Through-Silicon Via and Die Stacking Technologies for Micro Systems Integration. Proceedings IEEE International Electron Devices Meeting (IEDM), pages 1–4, 2008. ╇ 9. Kaustav Banerjee et al. 3-D ICs: A Novel Chip Design for Improving Deep-Submicrometer Interconnect Performance and Systems-on-Chip Integration. Proceedings of the IEEE, 89(5):602–633, 2001. 10. Shamik Das, Anantha Chandrakasan and Rafael Reif. Three-Dimensional Integrated Circuits: Performance, Design Methodology, and CAD Tools. Proceedings of IEEE Computer Society Annual Symposium on VLSI (ISVLSI), pages 13–18, 2003. 11. Shamik Das, Anantha Chandrakasan and Rafael Reif. Design Tools for 3-D Integrated Circuits. Proceedings IEEE Asia South Pacific Design Automation Conference (ASP-DAC), pages 53–56, 2003. 12. Uksong Kang et al. 8€Gb 3D DDR3 DRAM Using Through-Silicon-Via Technology. Proceedings International Solid State Circuits Conference (ISSCC), pages 130–132, 2009. 13. Christianto C. Liu et al. Bridging the Processor-Memory Performance Gap with 3D IC Technology. IEEE Design & Test of Computers, 22(6):556–564, 2005.
3â•… Testing 3D Stacked ICs Containing Through-Silicon Vias
73
14. Bryan Black et al. 3D Processing Technology and its Impact on iA32 Microprocessors. Proceedings International Conference on Computer Design (ICCD), pages 316–318, 2004. 15. Bart Swinnen et al. 3D Integration by Cu–Cu Thermo-Compression Bonding of Extremely Thinned Bulk-Si Die Containing 10€μm Pitch Through-Si Vias. Proceedings IEEE International Electron Devices Meeting (IEDM), pages 1–4, 2006. 16. Jan Van Olmen et al. 3D Stacked IC Demonstration using a Through Silicon Via First Approach. Proceedings IEEE International Electron Devices Meeting (IEDM), pages 1–4, 2008. 17. Anne Jourdain et al. Electrically Yielding Collective Hybrid Bonding for 3D Stacking of ICs. Electronic Components and Technology Conference (ECTC), pages 11–13, 2009. 18. Rafael Reif et al. Fabrication Technologies for Three-Dimensional Integrated Circuits. Proceedings International Symposium on Quality of Electronic Design (ISQED), pages 33–37, 2002. 19. John U. Knickerbocker et al. 3D Silicon Integration. Electronic Components and Technology Conference (ECTC), pages 538–543, 2008. 20. Bioh Kim et al. Factors Affecting Copper Filling Process Within High Aspect Ratio Deep Vias for 3D Chip Stacking. Electronic Components and Technology Conference (ECTC), pages 1–6, 2006. 21. Twan Bearda et al. Post-Dicing Particle Control for 3D Stacked IC Integration Flows. Electronic Components and Technology Conference (ECTC), pages 1513–1516, 2009. 22. Yervant Zorian, Ed. Multi-Chip Module Test Strategies. Kluwer Academic Publishers, 1997. 23. Erik J. Marinissen and Yervant Zorian. Testing 3D Chips Containing Through-Silicon Vias. Proceedings IEEE International Test Conference (ITC), 2009. 24. Greg Smith et al. Yield Considerations in the Choice of 3D Technology. Proceedings International Symposium on Semiconductor Manufacturing (ISSM), pages 1–3, 2007. 25. Sherief Reda, Gregory Smith and Larry Smith. Maximizing the Functional Yield of Wafer-toWafer 3-D Integration. IEEE Transactions on VLSI Systems, 17:1357–1362, 2009. 26. Jouke Verbree et al. On the Cost-Effectiveness of Matching Repositories of Pre-Tested Wafers for Wafer-to-Wafer 3D Chip Stacking. Proceedings IEEE European Test Symposium (ETS), pages 36–41, 2010. 27. Michael Bushnell and Vishwani Agrawal. Essentials of Electronic Testing for Digital, Memory & Mixed-Signal VLSI Circuits. Wiley-VCH, Weinheim, Germany, 2000. 28. Dirk K. de Vries. Investigation of Gross Die Per Wafer Formulas. IEEE Transactions on Semiconductor Manufacturing, 18(1):136–139, 2005. 29. Yervant Zorian, Erik J. Marinissen and Sujit Dey. Testing Embedded-Core Based System Chips. Proceedings IEEE International Test Conference (ITC), pages 130–143, 1998. 30. Ozgur Sinanoglu et al. Test Data Volume Comparison: Monolithic vs. Modular SoC Testing. IEEE Design & Test of Computers, 26(3):25–37, 2009. 31. Rohit Kapur. CTL for Test Information of Digital ICs. Kluwer Academic Publishers, 2003. 32. Francisco da Silva, Teresa McLaurin and Tom Waayers. The Core Test Wrapper Handbook: Rationale and Application of IEEE Std. 1500. Springer, Berlin, Germany, 2006. 33. Sandeep K. Goel and Erik J. Marinissen. SOC Test Architecture Design for Efficient Utilization of Test Bandwidth. ACM Transactions on Design Automation of Electronic Systems, 8(4):399–429, 2003. 34. Erik J. Marinissen. The Role of Test Protocols in Automated Test Generation for Embedded-Core-Based System ICs. Journal of Electronic Testing: Theory and Applications, 18(4/5):435–454, 2002. 35. Akihiro Ikeda et al. Design and Measurements of Test Element Group Wafer Thinned to 10€μm for 3D System in Package. Proceedings IEEE International Conference on Microelectronic Test Structures, pages 161–164, 2004. 36. Dan Perry et al. Impact of Thinning and Packaging on a Deep Sub-Micron CMOS Product. Electronic Workshop Digest of DATE 2009 Friday Workshop on 3D Integration, page 282, 2009. (http://www.date-conference.com/files/file/09-workshops/date09-3dws-digestv2-090504.pdf).
74
E. J. Marinissen
37. Menglin Tsai et al. Through Silicon Via (TSV) Defect/Pinhole Self Test Circuit for 3D-IC. Proceedings IEEE International Conference on 3D System Integration (3DIC), pages 1–8, 2009. 38. Po-Yuan Chen, Cheng-Wen Wu and Ding-Ming Kwai. On-Chip TSV Testing for 3D IC Before Bonding Using Sense Amplification. Proceedings IEEE Asian Test Symposium (ATS), pages 450–455, 2009. 39. Erik J. Marinissen et al. Minimizing Pattern Count for Interconnect Test under a Ground Bounce Constraint. IEEE Design & Test of Computers, 20(2):8–18, 2003. 40. William H. Kautz. Testing of Faults in Wiring Networks. IEEE Transactions on Computers, C-23(4):358–363, 1974. 41. P. Goel and M.T. McMahon. Electronic Chip-in-Place Test. Proceedings IEEE International Test Conference (ITC), pages 83–90, 1982. 42. Paul T. Wagner. Interconnect Testing with Boundary Scan. Proceedings IEEE International Test Conference (ITC), pages 52–57, 1987. 43. William R. Mann et al. The Leading Edge of Production Wafer Probe Test Technology. Proceedings IEEE International Test Conference (ITC), pages 1168–1195, 2004. 44. Gil-Su Kim, Makoto Takamiya and Takayasu Sakurai. A Capacitive Coupling Interface with High Sensitivity for Wireless Wafer Testing. Proceedings IEEE International Conference on 3D System Integration (3DIC), pages 1–5, 2009. 45. Brian Moore et al. High Throughput Non-Contact SIP Testing. Proceedings IEEE International Test Conference (ITC), 2007. Paper 12.3. 46. Erik Jan Marinissen et al. Contactless Testing: Possibility or Pipe-Dream? Proceedings Design, Automation, and Test in Europe (DATE), pages 676–671, 2009. 47. Dimitrios Velenis et al. Impact of 3D Design Choices on Manufacturing Cost. Proceedings IEEE International Conference on 3D System Integration (3DIC), pages 1–5, 2009. 48. Janusz Rajski et al. Embedded Deterministic Test. IEEE Transactions on Computer-Aided Design (TCAD), 23(5):776–792, 2004. 49. Xiaoxia Wu, Paul Falkenstern and Yuan Xie. Scan Chain Design for Three-dimensional Integrated Circuits (3D ICs). Proceedings International Conference on Computer Design (ICCD), pages 208–214, 2007. 50. Xiaoxia Wu et al. Test-Access Mechanism Optimization for Core-Based Three-Dimensional SOCs. Proceedings International Conference on Computer Design (ICCD), pages 212–218, 2008. 51. Xiaoxia Wu et al. Test-Access Solutions for Three-Dimensional SOCs. Proceedings International Test Conference (ITC), page 1, October 2008. 52. Li Jiang, Lin Huang and Qiang Xu. Test Architecture Design and Optimization for ThreeDimensional SoCs. Proceedings Design, Automation, and Test in Europe (DATE), pages 220–225, 2009. 53. Harald Vranken et al. Enhanced Reduced Pin-Count Test for Full-Scan Design. Proceedings IEEE International Test Conference (ITC), pages 738–747, 2001. 54. Yervant Zorian. A Structured Testability Approach for Multi-Chip Modules Based on BIST and Boundary-Scan. IEEE Transactions on Components, Packaging and Manufacturing Technology—Part B, 17(3):283–290, 1994. 55. Yervant Zorian and Hakim Bederr. An Effective Multi-Chip BIST Scheme. Journal of Electronic Testing: Theory and Applications, 10(1–2):87–95, 1997.
Chapter 4
Design and Computer Aided Design of 3DIC Paul D. Franzon, W. Rhett Davis and Thor Thorolfsson
4.1â•…Introduction This chapter reviews the process of 3DIC designing exploiting Through Silicon Via (TSV) technology. The chapter introduces the notion of re-architecting systems explicitly to exploit high density TSV processes. A particular focus is on (redesigned) memory on top of logic. This article also serves as a tutorial for the design of 3D specific systems. The chapter is organized as follows. First 3D technology is briefly reviewed specifically from a designer’s aspect. Then some of the 3D specific optimizations that the designer can explore. The core of this article is the description of a 3D specific design—a radar DSP application. 3D specific CAD is then explored. Finally the outstanding issues in 3D specific design are explored.
4.2â•…Technology Selection Today, there is a wide selection of potential 3DIC technologies and choosing amongst them can be confusing. The details of the technology choice interact strongly with the design intent and design approach. An attempt to categorize the technologies from a designer’s perspective is summarized by considering the following questions:
4.2.1 What Am I Stacking (Fig.€4.1)? The alternatives commonly available are wafer-on-wafer, and die-on-wafer. Both of these exploit similar equipment and processes, though the latter obviously has less
P. D. Franzon () Department of Electrical and Computer Engineering, The North Carolina State University, Box 7914, Raleigh, NC 27695, USA e-mail:
[email protected] A. Sheibanyrad et al. (eds.), 3D Integration for NoC-based SoC Architectures, Integrated Circuits and Systems, DOI 10.1007/978-1-4419-7618-5_4, ©Â€Springer Science+Business Media, LLC 2011
75
P. D. Franzon et al.
76
What am I stacking?
Wafer on wafer
Die on substrate on die
Die on die Chip on wafer
Fig. 4.1↜渀 Stacking alternatives
intrinsic parallelism and is likely to cost more. It is also possible (but not common) to stack die-on-substrate-on-die or die-on-die. Both of these last two processes are more specialized, requiring extra fixtures and steps. Die-on-substrate-on-die is one common configuration in three-D packaging, and can be done using laminate substrates, or potentially, silicon substrates. The best method to perform die-on-die is to reconstitute the die into a wafer using adhesives and fills. The decision as to which is best is fairly straightforward. If stacking wafers, then it is likely that you are working in a homogeneous technology, designing and fabricating complete wafers intended only for stacking with each other. For example, a memory manufacturer fabricating a memory stack. When stacking wafer on wafer, care must be taken with the cumulative yield loss. There is no method to prevent bad chips being stacked on a good chip. Thus, the integrated yield will be less than the single tier yield. (An example is given in Table€4.1.) Alternatively if stacking die to wafer, then there is more flexibility in the technology choice and mix. In addition, the die and wafer sites can be tested before integration, and yield can be maximized. Obviously die-on-die and die-on-substrate-on-die avoid the compounded yield reduction issue though at the expensive of additional assembly cost. In many circumstances chips from different vendors will be integrated. It is very unlikely that the I/O on one chip (stack) are not physically aligned with the I/O on its soon-to-be mate. In that case some pitch matching is needed. The available alternatives are summarized in Fig.€4.2. If the only need is pitch matching, then a RedisTable 4.1↜渀 Reduction of integrated yield with stacking using wafer on wafer Number of tiers 1 2 3 Yield (%) 95 91 85
4 81
4â•… Design and Computer Aided Design of 3DIC
77
Fig. 4.2↜渀 If the IO on two of the chips in a chip stack are not physically aligned either a redistribution layer or intermediate substrate are needed
tribution Layer (RDL) will often suffice. This consists of one or more layers of thin metal, usually integrated via a spun-on dielectric. If an RDL is not possible (e.g. due to vendor limitations), or power and thermal management is needed between the chips then an intermediate substrate is needed. That is a silicon, ceramic or laminate substrate containing through vias and multiple metal layers. Note if a substrate is used then the interconnectivity through it will be limited by its internal via pitch.
4.2.2 Do I Need Through Silicon Vias (Fig.€4.3)? Not all 3DIC stacks need Through Silicon Vias (TSVs). If only two chips are being stacked, and peripheral connections are sufficient for signal I/O, power and ground connections, then only face to face bonding is needed. Several technology options are available including solder bumping, and fine pitch copper-copper bonding. TSVs add considerably to the cost of 3D stacking and integration. They also consume silicon area. If they are not needed, then avoid them. Many lower power two chip stacks can avoid the added costs of TSVs.
4.2.3 Through Silicon Via (TSV) Technology The TSV technology choice has a significant impact on the potential vertical interconnect density and the silicon area overhead of the TSV interconnectivity. One
Fig. 4.3↜渀 Face to face bonding suffices for a two chip stack if the current density is low enough to permit peripheral bonding
78
P. D. Franzon et al.
Table 4.2↜渀 Different TSV technologies from a designer’s perspective Technology Diameter (μm) Pitch (μm) Keepout (μm) “Package scale” 30–50 50–150 >5 today “Package scale” 20–30 50 >5 tomorrow “Chip scale” 1–10 2–50 >5 (Cu) 0 (W)
Capacitance Up to 1€pF, typically <300€fF Up to 300€fF Up to 40€fF
way to categorize TSVs is via their source of manufacture as summarized in Table€4.2 (with reference to Fig.€4.4). “Package scale” vias, as fabricated by a packaging vendor (e.g. [1]), are large and likely to consume significant area. They also add significantly to the vertical interconnect capacitance. These are likely to scale to smaller dimensions in the future but not scale to the tight dimensions possible in “chip scale” TSV technologies. “Chip scale” technologies are usually integrated at the chip fabrication facility. They consume the smallest area, have the smallest capacitance and can achieve the tightest pitch. In contrast to copper TSVs, Tungsten (W) TSVs do not require a transistor keepout rule around them. Copper TSVs need a keepout rule due to the stress induced in the silicon due to the different coefficient of thermal expansion of copper and silicon. The induced stress can change transistor properties. Chip scale technologies provide the most potential for achieving 3D specific optimizations. From a designer’s viewpoint, the differences between the TSV technologies are their pitch, capacitance and total footprint. For example when creating a 3D specific memory interface, the pitch will determine the area over which a bus is spread out. For example, with a 50€μm pitch technology, a x128€bit bus might be arranged in a 4â•›×â•›32 grid over an area of 0.2â•›×â•›1.6€mm. Obviously for an ASIC interfacing with such a memory, there will be considerable wire length required to support this fanout to the (smaller) logic block interfacing with the memory. The capacitance of the TSV is determined by the isolating oxide thickness, the depletion depth in the silicon and the length of the via. The capacitance determines the power and speed potential of the inter-chip interface. A common stated advantage of exploiting 3D technology is a reduction in wire-length. Some of this is lost with high capacitance TSVs. At 32€nm, the capacitance of on-chip wiring is around 300€fF/mm. Thus a Interconnect layers
wafer thickness
Silicon surface TSV Silicon backside
transistor keepout
diameter pitch
Fig. 4.4↜渀 Dimensions referred to in Table 4.2
TSV bond
4â•… Design and Computer Aided Design of 3DIC
79
TSV capacitance is equivalent to that of 0.1–1€mm of on-chip wiring, depending on the TSV technology. In many circumstances, the TSV foot-print matters more than the pitch, as it adds to the total silicon area. For example, in a “package scale” TSV, the x128€bit bus described above would consume a total of 0.2Â€× 1.6€mm of silicon (0.32€mm2), roughly the same area it would consume with conventional packaging. In contrast, if built in a chip-scale TSV (with a 10Â€× 10€μm footprint), the area consumed would be only 0.0128€mm2, assuming that useful circuits can be designed into the space between the TSVs.
4.3â•…3D Specific Optimizations If the chip stack is redesigned to explicitly exploit 3DIC technologies then 3D specific optimizations are possible. Possible optimizations include the following (Table€4.3): • Miniaturization, especially in sensors. • Many studies (e.g. [2, 3]) demonstrate that 3D integration lead to shorter interconnects. Though valuable, the improvement is incremental and has to be judged against the added cost. • Use of 3D stacking to increase memory bandwidth. With future multicore CPUs likely to require memory bandwidths of 1€TB/s or above [4], power efficient methods to provisioning this bandwidth are needed. For example, 1,024 1€Gbps TSV enabled channels are likely to be much more power efficient than 400 20€Gbps channels built in conventional packaging.
Table 4.3↜渀 Potential 3D specific optimizations Driving issue Case for 3D Miniaturization Stacked memories. “Smart dust” sensors Interconnect delay When delay in critical paths can be substantially reduced through 3D integration Memory bandwidth Logic on memory can dramatically improve memory bandwidth Power consumption
Mixed technology (Heterogeneous) integration
Caveats For many cases, stacking and wirebonding is sufficient Not all applications will have a substantial advantage While memory bandwidth can be improved dramatically, memory size can only be improved linearly Limited domain. In many cases, it does not
In certain cases, a 3D architecture might have substantially lower power over a 2D. Memory bandwidth can be provided at a lower bandwidth in 3D Mixing an advanced ASIC technol- Though might justify 3D integration, not all examples might justify ogy with an older or different through-wafer vias analog technology. Incorporating a passives layer
80
P. D. Franzon et al.
• Repartitioning the system to decrease power consumption is a unique opportunity for 3D. One potential is to reorganize the memory stack, not just to decrease interconnect power, but also to decrease memory core power. This is explored further below. • Mixed technology (Heterogeneous) integration is a unique opportunity in 3D. Examples include stacking processing with a sensor array; keeping the hard to redesign analog circuits in an older (cheaper) technology node while moving the digital portion to an advanced node; and moving on-chip passives (inductors, capacitors, decoupling) to a low-loss stacked substrate.
4.3.1 Example of 3D Specific Optimized Design A 3D optimized synthetic aperture radar (SAR) processor has been designed and is currently in fabrication with Lincoln Labs, using their three chip stack 0.18€μm SOI technology [5]. The core of this processor is a 1,024 point, 32€bit floating point FFT. Power was minimized by using small memories that minimize the energy per access. 3D interconnect was employed in order to reduce the length of connections to these highly partitioned memories. The chip layouts are shown in Fig.€4.5. The overall system consists of four different components, eight processing elements, one controller, 32€SRAMs, and eight ROMs and is shown in Fig.€4.6. The system performs 32 memory accesses per cycle (16 reads and 16 writes), completing a 1,024-point FFT in 653 cycles utilizing five pipeline stages. The system is based on a radix-2 Cooley-Tukey FFT algorithm, where every processing element implements a single two-point FFT butterfly. A radix-2 FFT has a data dependency that resembles a hypercube. This hypercube data dependency can be exploited in two ways. First, a radix-2 FFT will require two memory reads every cycle, one of which will have odd parity while the other will have even parity. As a result we can split the processing memory into two independent memory groups that never need to be accessed at the same time. Second, we can sub-divide
Fig. 4.5↜渀 Three-tier layout of the 3D synthetic aperture radar design
Even
Odd
Even
Odd
Even
Fig. 4.6↜渀 3D synthetic aperture radar system block diagram
Controller
Even
Odd
Odd
Even
Odd
Even
Odd
Even
Odd
Even
Odd
Even
Odd
4â•… Design and Computer Aided Design of 3DIC 81
82
P. D. Franzon et al.
the even and odd groups into smaller subgroups where each processing element is only connected to the absolute minimum number of memory locations required to successfully compute the FFT. The benefit of splitting the memories into smaller subgroups is that smaller memories are faster and since each memory subgroup can be accessed simultaneously, the system can perform a greater number of reads and writes per cycle. Conversely, a single memory will require less area as only one set of peripheral logic (write driver and sense amp) is required. In this specific implementation the memory was divided into 32 smaller memories (16 even and 16 odd). We use Cacti 4.1 [6] to assess the architectural benefit of the partitioned design, by comparing the properties of a single 8€kByte memory to sixteen 512€Byte memories. The memory-core area savings of using a single memory would have been 67.6%. By using multiple smaller memories, the energy per read is reduced by 60.8% (from 68.205 to 26.718€pJ), the energy per write was reduced by 57.6% (from 14.48 to 6.142€pJ) and bandwidth increased by 854.9% (13.4–128.4€GBps). The number of wires interconnecting the memory to logic is increased from 150 to 2,272 wires. 3DIC stacking is used to minimize the area impact of the added wires. A summary of the differences between the highly partitioned small memories and the unpartitioned big memories is shown in Table€4.4. As can be seen in Table€4.4, partitioning the FFT in such a manner is greatly beneficial, in terms of bandwidth and read and write energy consumption. However, this comes at high cost increasing the number of memory to logic interconnect wires from 150 to 2,272, leading to an interconnect dominated architecture. Luckily, moving this architecture to 3D ensures that the increase in interconnect power increases does not outweigh the bandwidth and memory access energy consumption gains. This design was conducted using “chip scale” 5€μm pitch high density TSVs. The 2.6â•›×â•›3€mm design has 17,634 TSVs within it, roughly equally split between signal and power/ground vias. If a coarser “package level” TSV was used, the silicon area impact would be substantially larger (Table€4.5). The optimizations achieved in this design require high-density, fine-scale vias. To quantify how much the move to 3D benefits the architecture, we also place and route the design in 2D. In order to ensure a fair comparison between the two circuits, the circuit is not resynthesized, instead the same synthesis output is used. Table 4.4↜渀 Comparison between the highly partitioned small memories and the unpartitioned big memory Metric Big memories Small memories % ╇╇ 2,272 −1,414.7 Wires (#) 150 Bandwidth (GBps) ╇ 13.4 ╇╇╇╛╛128.4 ╇╇╛╛854.9 Energy per write (pJ) ╇ 14.48 ╇╇╇╇╇╛╛6.142 ╇╇╇╛╛57.6 Energy per read (pJ) ╇ 68.205 ╇╇╇╇╛╛26.718 ╇╇╇╛╛60.8 Table 4.5↜渀 Area impact on SAR design of different TSV technologies
TSV technology 6€μm pitch SOI TSV 15€μm pitch (10€μm diameter) intermediate TSV
Area impact 0.14€mm2 (1.7%) 2€mm2 (18%)
4â•… Design and Computer Aided Design of 3DIC Table 4.6↜渀 Comparison of the 3D optimized FFT design in both 2D and 3D technologies Metric 2D 3D ╇ 31.36 ╇ 23.40 Total area (mm2) Core area (mm2) ╇ 29.16 ╇ 20.16 Mean net length (μm) 836.0 392.9 Total wire length (m) ╇ 19.107 ╇╇ 8.238 Max speed (MHz) ╇ 63.7 ╇ 79.4 Critical path (ns) ╇ 15.7 ╇ 12.6 Logic power (mW) 340.0 324.9 FFT logic energy (μJ) ╇╇ 3.552 ╇╇ 3.366
83
% 25.3 30.9 53.0 56.9 24.6 19.7 ╇ 4.4 ╇ 5.2
For comparisons sake, a similar floorplan is used for both the 2D and the 3D design. The metrics of the two designs are summarized in Table€4.6. Due to increased congestion, the 2D design does not route successfully with same total area as its 3D counterpart (4.8 by 4.8€mm). To remedy this, the area used for place and route is grown until the design routes without any design rule violations. Compared to the 3D version, the total area used must be expanded significantly. Also, the 3D design is 24.6% faster, has 56.9% lower total wire length, and uses 5.2% less energy per transform. In order to complete this design using the CAD flow described in the next section, an important step was to determine an appropriate logic partition. Especially with today’s tools higher level partitions are easier to manage than lower level ones. For example in each design each Processing Element is contained within one tier. Furthermore there was only one entry point to the clock tree within each tier. That is within each logic tier, the design was treated as a 2D design, except for the memory interface. This high level partitioning is useful for several reasons. First since commercial grade 3D place and route and clock distribution tools do not exist, we were able to complete the design with available commercial 2D tools. Second, it simplifies early design analysis considerably—2D architectural evaluations can be used at sub-module level. Third, such a position enables each tier to be tested before integration. In contrast, if the partitioning was done at the logic cell level, or the clock tree was distributed between the tiers, integration would be required before testing and the yield would be degraded (see Table€4.1 and discussion). More detail about this design can be found in [3, 7].
4.4╅3D Design and CAD An outline design flow for a 3DIC enabled sub-system is shown in Fig.€4.7. This flow can be executed with available tools, after appropriate integration through scripts. The first step, described above, is technology selection. Until 3D options are offered as standard in semiconductor fabs, this will be a many factored decision. However, even after TSV options are standard, there will be many complex deci-
84 Fig. 4.7↜渀 3DIC CAD flow
P. D. Franzon et al. Technology Choice
High level Chip-Package Floorplan
Chip Floorplans and TSV location assignment
Detailed 2D Design
Test Insertion
Reassemble 3D Chip Stack
3D Verification: DRC, LVS, Performance, Thermal
sions to make. Almost concurrent with this step is the decision making about the overall high level floorplan of the chips and package. There are a lot of issues that have to be concurrently managed in this step, and unfortunately, their analysis has to be largely human driven. The end decision is an overall floorplan—what goes on which layer, and approximately where. Factors in these decisions include the following: • Technology set. Coarse of fine TSVs? Interposer or RDL? Each has different capabilities and thus different options. • Signal flow. Where are the signals originating and terminating in each layer? How wide are the data paths (wider data paths tend to consume less power than narrower, faster ones). What are the implications for interconnect power, wirelength, TSV placement, TSV density and TSV footprint? Can the RDL or substrate support the signal flow? • Power delivery. How is current delivered to the chips in the stack? In performance driven designs, the total current levels can be 100€A or more, and severely constrain the power delivery solutions. • Performance and power enhancements. The TSV technology should be leveraged to deliver unique advantages. For example wide memories with small memory banks consume considerably less power than large memory banks feeding narrow interfaces. Numerous other opportunities exist. • Thermal performance. A key consideration is DRAM operating temperature and refresh time. DRAMs typically operate at 85°C or less in order to guarantee
4â•… Design and Computer Aided Design of 3DIC
85
refresh cycle time. On the other hand, high performance ASICs often operate at 100°C or more. Care must be taken to ensure the DRAM is sufficiently cooled, and is not subject to co-heating by the ASIC. In addition, no component must operate beyond the designed temperature. Unfortunately, there is a direct conflict between power delivery and thermal performance. In a 3D chip stack, power delivery is optimized by putting the highest power closest to the Printed Circuit Board (PCB) delivering power. However the highest power part is best cooled by placing it farthest from the PCB and next to the heat sink. The latter solution would necessitate a large number of TSVs in the lower structure simply for power delivery. The next step is detailed floorplanning and TSV assignment. Considerations here mainly center on wiring delay, thermal and routability considerations. Today there are no true 3D floorplanners so clean partitions are required to make this easy. An example of a clean partition is to keep all the logic in one layer in the chip stack. Then the other portion (e.g. analog or memory) is separately designed and used to designate the TSV locations. They can be propagated through to the logic layer, which is then designed as normal using 2D tools. If there are hot-spots in the nonlogic layers, some thermal design might be needed to ensure that the hot spots are not vertically stacked. The next step is detailed design. If the partitions are simple and clean, this is a relatively straightforward step. As discussed below, test insertion is a critical and complex step in 3D design. However, techniques are starting to emerge that can exploit existing tools to produce a testable design [8–10]. The final steps are verification. It is best to verify the 3D design as one integrated sub-assembly rather than trying to verify each layer independently. This requires obtaining verification decks that include all layers in the 3D stack. It also requires extraction tools that can include reasonable parasitic models for the TSVs. This is all manageable but requires effort from the CAD team.
4.5â•…Outstanding Issues in 3D Design Outstanding issues in 3DIC design include cost management, CAD tools, Test and thermal/power integrity management.
4.5.1 Cost Management Since the 3D integration increases the wafer cost by 5–15% or more, care must be taken to mitigate the added cost elsewhere in the system. Ideally this cost is compensated not just by a performance and/or power improvement but also by cost reduction elsewhere. Opportunities for cost reduction include using a lower cost
86
P. D. Franzon et al.
functionally optimized technology mix, such as moving passives to an interposer, or reduced packaging cost, e.g. by reducing pin count.
4.5.2 Computer Aided Design With care, well partitioned 3DICs can be designed and analyzed with the available tools. However, there are still identifiable pain points that today require heavy human intervention. Also, more complex partitions (e.g. an SOC split across numerous layers) cannot be managed with today’s CAD tools. The biggest single need are better tools and sub-flows for early planning, especially for floorplanning, and chip-package codesign. These issues are especially difficult in 3DIC due to the complex interaction between floorplanning, bandwidth provisioning, signal integrity, power integrity and thermal management. This gets especially difficult when also evaluating different technology options, such as interposers, specialized cooling features, etc.
4.5.3 Thermal Design and Analysis The root need in thermal design and analysis is to predict temperature sufficiently accurately so that the resulting unpredictability in signal path delay and clock path delay (and thus skew), and leakage power can both be brought within their budgets. The accuracy needed depends on the budgets allowed. Thermal analysis is complicated in 3D design as the thinned silicon tiers are no longer as good as spreading heat as in an unthinned 2D tier. This leads to local hot spots on the tiers away from the heat sink. For example, the design described above was taken through a full thermal analysis, as discussed in [11] and presented in Fig.€4.5. The relative coolness of the tier (A) closest to the heatsink is apparent, as is the temperature nonuniformity of the tier farthest from the heatsink (tier C). The heatspikes in Tier C are located at the clock buffers, which have a high activity factor (Fig.€4.8).
4.5.4 Test and Design for Test When stacking die on wafer, it is highly desirable to know which singulated die are good and which locations are good on the wafer. This requires that the test flow yield “Known Good Die” (KGD)—die that can be determined to meet speed and burn-in requirements with wafer test alone. While KGD tools and methods are available today, they are not in common use—most system integrators rely on package level performance test. In a 3D design, KGD tools are essential. An additional complexity are the TSVs—probe cards will not be able to test large numbers of
4â•… Design and Computer Aided Design of 3DIC Tier A
Tier B
87 Tier C
27.00 28.69 30.37 32.06 33.75 35.44 37.12 38.81 40.50 42.18 43.87 45.56 47.25 48.93 50.62 52.31
Fig. 4.8↜渀 Detailed thermal analysis of the three tier FFT design
closely spaced TSVs. Wafer-level self test is needed as described in [9, 10]. The situation is different if wafer on wafer integration is used. In this case, the solution to cope with compounded yield degradation must center on using redundancy and error correction.
4.6â•…Conclusions Designing chips and systems of chips to exploit 3DIC technologies can bring specific advantages in terms of bandwidth and power consumption. A particularly attractive opportunity is redesigning memory for integration with logic functions. An example is given in which power consumption is reduced by 60% compared with the 2D specific design. Outstanding issues in 3DIC design include thermal/power codesign, cost, and test.
References 1. J. Kim, E. Song, J. Cho, J. Pak, J. Lee, H. Lee, K. Park, and J. Kim, “Through Silicon Via Equalizer,” in Proc. IEEE EPEPS ’09, Oct. 2009, pp.€13–16. 2. K. Banerjee, S. Souri, P. Kapur, and K. Saraswat, “3-D ICs: A Novel Chip Design for Improving Deep-Submicrometer Interconnect Performance and Systems-on-Chip Integration,” Proc. IEEE, Vol.€89, No.€5, 2001, pp. 602–633. 3. T. Thorolfsson, K. Gonsalves, and P. Franzon, “Design Automation for a 3DIC Processor for Synthetic Aperture Radar: A Case Study,” in Proc. DAC 2009, July 2009, pp.€51–56. 4. H.P. Hofstee, “Future Microprocessors and Off-Chip SOP Interconnect,” IEEE Trans. Adv. Packag, Vol.€27, No.€2, May 2004, pp.€301–303. 5. J.A. Burns, B.F. Aull, C.K. Chen, C.-L. Chen, C.L. Keast, J.M. Knecht, V. Suntharalinam, K. Warner, P.W. Wyatt, and D. Yost, “A Wafer-Scale 3-D Circuit Integration Technology,” IEEE Trans. ED, Vol.€53, No.€10, Oct. 2006, pp.€2507–2516. 6. S. Wilton and N. Jouppi, “CACTI: An Enhanced Cache Access and Cycle Time Model,” IEEE J Solid-State Circuits, Vol.€31, No.€5, Oct. 1996, pp.€677–688.
88
P. D. Franzon et al.
╇ 7. T. Thorolfsson, S. Melamed, G. Charles, and P. Franzon, “Comparative Analysis of Two 3D Integration Implementations of a SAR Processor,” in Proc. IIII 3DIC, 2009, pp.€1–4. ╇ 8. E. Marinissen and Y. Zorian, “Testing 3D Chips Containing Through-Silicon Vias,” in ITC, 2009, pp.€1–11. ╇ 9. M. Tsai, A. Klooz, A. Leonard, J. Appel, and P. Franzon, “Through Silicon Via (TSV) Defect/ Pinhole Self Test Circuit for 3D-IC,” in IEEE Proc. 3DIC, 2009, pp.€1–8. 10. P.-Y. Chen, C.-W. Wu, and D. Ming, “On-Chip TSV Testing for 3D IC Before Bonding Using Sense Amplification,” in Proc. ATS’09, 2009, pp.€450–455. 11. S. Melamed, T. Thorolfsson, A. Srinivasan, E. Cheng, P. Franzon, and R. Davis, “JunctionLevel Thermal Extraction and Simulation of 3DICs,” in Proc. IEEE 3DIC, 2009, pp.€1–7.
Chapter 5
Physical Analysis of NoC Topologies for 3-D Integrated Systems Vasilis F. Pavlidis and Eby G. Friedman
5.1â•…Introduction Several new topologies for on-chip interconnect networks are supported by vertical integration. These three-dimensional topologies improve the performance of an on-chip network primarily in two ways. The length of the physical links connecting the switches of the network is shorter. Additionally, the data can be routed across the on-chip network through a smaller number of switches. The three-dimensional (3-D) NoC topologies include two types of physical links implemented with horizontal and vertical interconnects. These links exhibit substantially different physical and electrical characteristics. The different 3-D topologies and timing and power models that describe the performance of the resulting 3-D networks are discussed in this chapter. These models emphasize the physical characteristics rather than the architectural details of the network. These models provide useful bounds for improving the performance of on-chip networks by exploiting the third dimension. With these models, the topology that minimizes the latency or power consumption of a network can be determined. As described in this chapter, a network topology can typically enhance one of these two primary design objectives. The thermal behavior of 3-D integrated systems is another important issue due to the increased power densities that can develop. To characterize the thermal effects on the performance of 3-D NoC topologies, the timing and power models are enhanced by including the dependence on temperature of specific parameters, such as the electrical resistance of an interconnect. Consequently, the topology that produces the minimum rise in temperature at the plane located farthest from the heat sink of the system can be selected while satisfying specific performance characteristics.
V. F. Pavlidis () Integrated Systems Laboratory, EPFL, 1015 Lausanne, Switzerland e-mail:
[email protected] E. G. Friedman () University of Rochester, Rochester, NY 14627, USA e-mail:
[email protected] A. Sheibanyrad et al. (eds.), 3D Integration for NoC-based SoC Architectures, Integrated Circuits and Systems, DOI 10.1007/978-1-4419-7618-5_5, ©Â€Springer Science+Business Media, LLC 2011
89
90
V. F. Pavlidis and E. G. Friedman
A first-order thermal model is utilized to determine the rise in temperature in each plane within a 3-D system. Elevated temperatures can affect the performance of the processing elements (PEs) in addition to the performance of the network. Consequently, an enhanced analysis methodology including thermal effects, which provides the interconnect architecture employed in the PEs, is described in this chapter. In this methodology, the number of metal layers, pitch of the interconnect in each metal layer, and number of physical planes are considered. In addition, the rise in temperature due to the heat generated by transistor switching and joule heating of the wires is evaluated. In other words, the methodology described in this chapter provides a means to estimate early in the design cycle the behavior of a 3-D topology for an integrated system interconnected with an on-chip network. This holistic approach in the design of 3-D systems based on networks-on-chip is necessary, as demonstrated in this chapter. Neglecting the effects of the power consumption of the PEs and the related temperature rise can produce a misleading result when selecting the 3-D NoC topology that exhibits the highest performance. The analysis approach presented in this chapter is applied to homogeneous 3-D NoCs (i.e., all of the PEs are assumed identical) exploring diverse objectives, such as speed, power, and temperature. As demonstrated in this analysis, a primary criterion for the design of these 3-D systems is whether the third dimension is used for the on-chip network or the PEs. In the next section, the 3-D NoC topologies investigated in this chapter are described and some notation is introduced. Timing and power models for the on-chip network are presented in Section€5.3. A technique for determining the wiring resources of the PEs within a 3-D system interconnected with an on-chip network and the resulting rise in temperature in the different 3-D NoC topologies is presented in Section€5.4. Several tradeoffs among different characteristics of the topologies including the network size, number of physical planes, and operating frequency of the PEs are discussed in Section€5.5. The primary objectives of the chapter are summarized in the last section of the chapter.
5.2â•…Three-Dimensional On-Chip Network Topologies Primary topologies for 3-D networks are presented and related terminology is introduced in this section. Mesh structures have been a popular network topology for conventional 2-D NoC [1–3]. A fundamental element of a mesh network is illustrated in Fig.€5.1a, where each processing element (PE) is connected to the network through a switch. A PE can be integrated either on a single physical plane (2-D IC) or on several physical planes (3-D IC). Each switch in a 2-D NoC is connected to a neighboring switch in one of four directions. Consequently, each switch has five ports. Alternatively, in a 3-D NoC, the switch typically connects to two additional neighboring switches located on the adjacent physical planes. The switch architecture is considered here to be a canonical switch with input and output buffering [4].
5â•… Physical Analysis of NoC Topologies for 3-D Integrated Systems NoC
2-D
IC
91
3-D
a
b Router
2-D
PE
n3 n 2 n1
c
d np Lv
3-D Lh
Fig. 5.1↜渀 Different NoC topologies (not to scale), (a) 2-D IC – 2-D NoC, (b) 2-D IC – 3-D NoC, (c) 3-D IC – 2-D NoC, and (d) 3-D IC – 3-D NoC [8]
Although a network switch can also be designed in a 3-D manner [5], herein, the switches are considered as two-dimensional (i.e., occupy a single physical plane). Note that if 3-D switches are utilized, the performance of each of the targeted topologies will be improved equally. Consequently, a comparison of the 3-D network topologies is independent of whether a 2-D or 3-D switch is used. The combination of a PE and switch is a network node. For a 2-D mesh network, the total number of nodes N is n1€×€n2, where ni is the number of nodes included in the ith physical dimension. Integration in the third dimension introduces a variety of topological choices for NoCs. For a 3-D NoC, as shown in Fig.€5.1b, the total number of nodes is N€ =€ n1€ ×€ n2€ ×€ n3, where n3 is the number of nodes in the third dimension. In this topology, each PE is on a single yet possibly different physical plane (2-D IC – 3-D NoC). Alternatively, a PE can be implemented on only one of the n3 physical planes. The 3-D system, therefore, contains n1€×€n2 PEs on each of the n3 physical planes, where the total number of nodes is N. This topology is discussed in [6, 7]. A 3-D NoC topology is proposed in Fig.€5.1c, where the interconnect network is contained within one physical plane (i.e., n3€ =€ 1), while each PE is integrated on multiple planes, notated as np (3-D IC – 2-D NoC). Finally, a hybrid 3-D NoC based on the two previous topologies is proposed in Fig.€5.1d. In such an NoC, both the interconnect network and the PEs can span more than one physical plane of the stack (3-D IC – 3-D NoC). In the following section, latency and power expressions for each of the NoC topologies are presented, assuming a zero-load model.
92
V. F. Pavlidis and E. G. Friedman
5.3╅Timing and Power Model for 3-D NoCs In this section both timing and power dissipation models for on-chip networks are described. Modeling specific parameters as a function of temperature is also discussed to investigate thermal effects on different 3-D NoC topologies. The latency and power dissipation models are presented in Sections€5.3.1 and 5.3.2, respectively.
5.3.1 Latency Model for 3-D NoC In this section, analytic models of the zero-load latency of each of the 3-D NoC topologies are described. Zero-load network latency is widely used as a performance metric in traditional interconnection networks [10]. The zero-load latency of a network is the latency where only one packet traverses the network at any one time. Although this model does not consider contention among packets, the zeroload latency can be used to describe the effect of a topology on the performance of a network. The zero-load latency of an NoC with wormhole switching is [10]
Tnetwork = hops · tr + tc +
Lp , b
(5.1)
where the first term represents the routing delay, tc is the propagation delay along the wires of the physical link, which is also called a buss here for simplicity, and the third term is the serialization delay of the packet. hops is the average number of switches that a packet traverses to reach the destination node, tr is the switch delay, Lp is the length of the packet in bits, and b is the bandwidth of the buss defined as b€≡€wc╛╛╛fc, where wc is the width of the link in bits and fc is the inverse of the delay of a bit propagating along the longest physical link. Since the number of planes that can be stacked in a 3-D NoC is constrained by the target technology, n3 is also constrained. Furthermore, n1, n2, and n3 are not necessarily equal. The average number of hops in a 3-D NoC is
hops =
n1 n2 n3 (n1 + n2 + n3 ) − n3 (n1 + n2 ) − n1 n2 , 3(n1 n2 n3 − 1)
(5.2)
assuming dimension-order routing to ensure that minimum distance paths are used for routing packets between any source-destination node pair. Although the average number of hops provides a useful expression for a latency model of an NoC, (5.2) does not characterize all possible traffic scenarios within a network. For example, while uniform traffic among the PEs can be modeled by the average number of hops, applications that favor localized traffic will result in a different number of hops from (5.2). This situation does not lessen the applicability of the models described in this section as long as an expression for the number of hops can be determined. In addition, synthesis tools for on-chip networks typi-
5â•… Physical Analysis of NoC Topologies for 3-D Integrated Systems
93
cally utilize a zero-load model to determine the number of hops within the network, thereby determining the latency of each synthesized topology [9]. In the case, where the network traffic cannot accurately be described in closed form, the inherent characteristics of the topologies depicted in Fig.€5.1 can guide the selection process for a specific topology. For example, consider a highly localized traffic scenario. The vertical channels can be used primarily for high bandwidth data transfer since the vertical links exhibit a considerably lower delay as compared to the horizontal links. This difference in latency suggests that a 2-D IC – 3-D NoC is a better candidate than a 3-D IC – 2-D NoC topology, where the network includes only horizontal links. The criterion for choosing this topology, in this case, would be the short vertical links, not the reduction in the number of hops (due to the larger number of the PEs connected to each switch). To describe this difference in latency between the two types of links, the average number of hops in (5.2) can be divided into two components, the average number of hops within the two dimensions n1 and n2, and the average number of hops within the third dimension n3,
hops2−D =
n3 (n1 + n2 )(n1 n2 − 1) , 3(n1 n2 n3 − 1)
(5.3)
(n23 − 1)n1 n2 . 3(n1 n2 n3 − 1)
(5.4)
hops3−D =
The delay of the switch tr is the sum of the delay of the arbitration logic ta and the delay of the switch ts, which is assumed to be implemented with a classic crossbar switch [10],
tr = ta + ts .
(5.5)
The delay of the arbiter as described in [11] is
ta = 21(1/4)log2 p + 14(1/12) + 9 ,
(5.6)
where p is the number of ports of the switch and τ is the delay of a minimum sized inverter for the target technology. Note that (5.6) exhibits a logarithmic dependence on the number of switch ports. The length of the crossbar switch also depends upon the number of switch ports and the width of the buss,
ls = 2(wt + st )wc p,
(5.7)
tc = tv hops3−D + th hops2−D ,
(5.8)
where wt and st are the width and spacing, respectively, or, alternatively, the pitch of the interconnect and wc is the width of the physical link in bits. Consequently, the worst case delay of the crossbar switch is determined by the longest path within the switch, which is equal to (5.7). The delay of the physical link tc is
94
V. F. Pavlidis and E. G. Friedman
where tv and th are the delay of the vertical and horizontal buss, respectively (see Fig.€5.1b). Note that if n3€=€1, (5.8) describes the propagation delay of a 2-D NoC. Substituting (5.5) and (5.8) into (5.1), the overall zero-load network latency for a 3-D NoC is
Tnetwork = hops(ta + ts ) + hops2−D th + hops3−D tv +
Lp th . wc
(5.9)
To characterize ts, th, and tv, the models described in [12] are adopted, where repeaters implemented as simple inverters are inserted along the interconnect. According to these models, the propagation delay and rise time of a single interconnect stage for a step input, respectively, are
tdi = 0.377
tri = 1.1
ri ci li 2 ki 2
ri ci li 2 ki 2
ri li Cg0 hi Rd0 ci li , + 0.693 Rd0 C0 + + hi ki ki
(5.10)
ri li Cg0 hi Rr0 ci li , + 2.75 Rr0 C0 + + hi ki ki
(5.11)
where ri(↜ci) is the per unit length resistance (capacitance) of the interconnect and li is the total length of the interconnect. The index i is used to notate the interconnect delays included in the network (i.e., i ∈€{s,â•›v,â•›h}). hi and ki denote the size and number of repeaters, respectively, and Cgâ•›0 and C0 represent the gate and total input capacitance of a minimum sized device, respectively. C0 is the summation of the gate and drain capacitance of the device. Rr0 and Rd0 describe the equivalent output resistance of a minimum sized device used to determine the propagation delay and transition time of a minimum sized inverter, respectively, where the output resistance is approximated as
Rr(d)0 = Kr(d)
Vdd . Idn0
(5.12)
K denotes a fitting coefficient and Idn0 is the drain current of an NMOS device where both Vds and Vgs are equal to Vdd. The saturation current for a MOSFET assuming the alpha-power law model [13, 14] is
Idsat = Id0
where
Id0 =
Vgs − Vth Vdd − Vth
a ,
(5.13)
µ0 Cox VD0 [Vdd − Vth − (η/2) VD0 ] , [1 + θ (Vdd − Vth )] [1 + Vdd / (EC L)]
(5.14)
5â•… Physical Analysis of NoC Topologies for 3-D Integrated Systems
95
and VD0 is the drain source voltage at saturation with Vgs equal to Vdd. The parameters θ and μ0 are described in [13], while the technology related constants are from the ITRS report [15] and the MOSFET models [16, 17] are for a 45€nm technology node. The an( p) parameter of the model is 2VD0 [Vdd − Vth_n(p) − (η/2)VD0 ] 1 ln , an(p) = (5.15) ln 2 VDa [Vdd − Vth_n(p) − ηVDa ] where VDa is the drain source voltage at saturation with Vgs equal to (↜Vdd€+€Vth_n(p))/2 [13]. To include the effect of the input slew rate on the total delay of an interconnect stage, (5.10) and (5.11) are further refined by including an additional coefficient as in [18], 1 − Vtn Vdd 1 (5.16) γr = − . 2 1 + an By substituting the subscript n with p, the corresponding value for a falling input transition is obtained. The average value of r and f is , which is used to determine the effect of the input transition time on the interconnect delay. The overall interconnect delay can therefore be described as
ti = ki (tdi + γ tri ) = b1
ri ci li2 R0 ci li + b2 R0 C0 ki + + ri li Cg0 hi , ki hi
(5.17)
where R0, b1, and b2 are described in [19] and the index i denotes the interconnect structures, such as the crossbar switch (↜i€≡€s), horizontal buss (↜i€≡€h), and vertical buss (↜i€≡€v). The interconnect delay also depends upon the temperature during circuit operation. To capture these dependencies, the resistance of the interconnects is
ri = ρ0 1 + βCu T − Tref /Awi ,
(5.18)
where Tref and T are the reference and operating temperature of the circuit, respectively. The resistivity of copper at Tref is ρ0, where a different resistivity is used for each tier according to the ITRS. βCu is the temperature coefficient of resistance for copper, βCu = 3.9 × 10−3 1/◦ C. Awi is the area of the cross-section of the wire. The MOSFET current described by (5.13) and (5.14) also varies with temperature. Analytic expressions for VD0 and Vth as a function of temperature have been adapted from the BSIM User’s manual [20]. The dependence of an(p) on temperature is implicitly captured through those analytic expressions describing VDa and Vth as a function of temperature [13, 20]. For minimum delay, the size hi and number ki of repeaters are determined by setting the partial derivative of ti with respect to hi and ki, respectively, equal to zero and solving for hi and ki [21],
96
V. F. Pavlidis and E. G. Friedman
ki∗ =
h∗i =
a1 ri ci li2 , a2 R0 C0
R0 ci . ri Cg0
(5.19)
(5.20)
The expression in (5.17) only considers RC interconnects. An RC model is sufficiently accurate to characterize the delay of a crossbar switch since the length of the longest wire within the crossbar switch and the signal frequencies are such that inductive behavior is not prominent. For buss lines, however, inductive behavior can appear. For this case, suitable expressions for the delay and repeater insertion characteristics can be adopted from [22, 23]. Additionally, for the vertical buss, kv€=€1 and hv€=€1, meaning that no repeaters are inserted and minimum sized drivers are utilized. Repeaters are not necessary due to the short length of the vertical buss. Note that the latency expressions include the effect of the input slew rate and temperature. Additionally, since a repeater insertion methodology for minimum latency is applied, any further reduction in latency is due to the network topology. The length of the vertical communication channel for the 3-D NoC shown in Fig.€5.1 is Lv , for 2D IC − 3D NoC (5.21a) lv = np Lv , for 3D IC − 3D NoC (5.21b) 0, for 2D IC − 2D NoC and 3DIC − 2D NoC, (5.21c) where Lv is the length of a through-silicon (interplane) via connecting two switches on adjacent physical planes. np is the number of physical planes used to integrate each PE. The length of the horizontal buss is
lh =
√
APE
coef
(5.22a) for 2D IC − 2D NoC and 2D IC − 3D NoC APE , for 3D IC − 2D NoC and 3D IC − 3D NoC (np > 1), np (5.22b)
where APE is the area of the processing element. The area of all of the PEs and, consequently, the length of each horizontal link are assumed to be equal. For those cases where the PE is implemented in multiple physical planes (↜np€ >€ 1), a coefficient coef is used to consider the effect of the interplane vias on the reduction in wirelength due to utilization of the third dimension. This coefficient is based on the layout of a crossbar switch designed [24] with the FDSOI 3-D technology from MIT Lincoln Laboratory (MITLL) [25]. In the following section, expressions for the power consumption of a network with delay constraints are presented.
5â•… Physical Analysis of NoC Topologies for 3-D Integrated Systems
97
5.3.2 Power Consumption Model for 3-D NoC Power dissipation is a critical issue in three-dimensional circuits. Although the total power consumption of a 3-D system is expected to be lower than that of an equivalent 2-D circuit (since the global interconnects are shorter [26]), the increased power density is a challenging issue for this novel design paradigm. Therefore, those 3-D NoC topologies that offer low power characteristics are of significant interest. The different power consumption components for interconnects with repeaters are briefly discussed in this section. Due to specified performance characteristics, a low power design methodology with delay constraints for the interconnect within an NoC is adopted from [19]. An expression for the power consumption per bit of a packet transferred between a source destination node pair is used as the basis for characterizing the power consumption of an NoC for the proposed topologies. The power consumption components of an interconnect line with repeaters are: (a) Dynamic power consumption is the dissipated power due to the charge and discharge of the interconnect and input gate capacitance during a signal transition, and can be described by
2 Pdi = as_noc f (ci li + hi ki C0 )Vdd ,
(5.23)
where f is the clock frequency and as_noc is the switching factor [27]. (b) Short-circuit power is due to the DC current path that exists in a CMOS circuit during a signal transition when the input signal voltage changes between Vtn and Vdd€+€Vtp. The power consumption due to this current is described as shortcircuit power and is modeled in [28] by
Psi =
2 2 4as_noc fId0 tri Vdd ki h2i , Vdsat GCeffi + 2H Id0 tri hi
(5.24)
where Id0 is the average drain current of the NMOS and PMOS devices operating in the saturation region and the value of the coefficients G and H are described in [29]. Due to resistive shielding of the interconnect capacitance, an effective capacitance is used in (5.23) rather than the total interconnect capacitance. Note that resistive shielding results in a smaller capacitive load as seen from the interconnect driver (i.e., Ceff€ ≤€ Ctotal). This effective capacitance is determined from the methodology described in [30, 31]. (c) Leakage power is comprised of two power components, the subthreshold and gate leakage currents. Subthreshold power consumption is due to current flowing where the transistor operates in the cut-off region (below threshold), causing Isub current to flow. The gate leakage component is due to current flowing through the gate oxide, denoted as Ig. The total leakage power can be described as
Pli = hi ki Vdd (Isub0 + Ig0 ),
(5.25)
98
V. F. Pavlidis and E. G. Friedman
where the average subthreshold Isub0 and gate Ig0 leakage current of the NMOS and PMOS transistors is considered in (5.25).
The total power consumption with delay constraint T0 for a single line of a crossbar switch Pstotal, horizontal buss Phtotal, and vertical buss Pvtotal is, respectively,
Pstotal (T0 − ta ) = Pdi + Psi + Pli ,
(5.26)
Phtotal (T0 ) = Pdi + Psi + Pli ,
(5.27)
Pvtotal (T0 ) = Pdi + Psi + Pli .
(5.28)
The power consumed by the arbitration logic is not considered in (5.26)–(5.28) since most of the power is consumed by the crossbar switch and the buss interconnect, as discussed in [32]. Note that for a crossbar switch, the additional delay of the arbitration logic poses a stricter delay constraint on the switch. The minimum power consumption with delay constraints is determined by the methodology described in [19], which is used to determine the optimum size h*powi and number k*powi of repeaters for a single interconnect line. Consequently, the minimum power consumption per bit between a source destination node pair in an NoC with a delay constraint is
Pbit = hopsPstotal + hops2−D Phtotal + hops3−D Pvtotal .
(5.29)
Note that the proposed power expression includes all of the power consumption components in the network, not only the dynamic power. The effect of resistive shielding is also considered in determining the effective interconnect capacitance. Additionally, the effect of temperature on each of the power dissipation components is considered. Furthermore, since the repeater insertion methodology described in [19] minimizes the power consumed by the repeater system, any additional decrease in power consumption is only due to the network topology. In the following section, a technique for analyzing the power dissipation of a PE and the related rise in temperature within an NoC system is described.
5.4â•…Thermal-Aware Analysis Methodology The 3-D NoC topologies and related timing and power models presented in the previous section emphasize performance improvements achieved by including the third dimension within the on-chip network. Vertical integration, however, can significantly enhance the performance of the PEs [33, 34], in addition to the performance of the network. Redesigning a planar PE into several physical planes can greatly decrease the power consumed by the PEs [35]. This reduction, in turn, lowers the temperature rise within the stack leading to tangible benefits in the overall behavior of the system. For example, since the temperature rise is limited, the corresponding increase in the interconnect resistance is lower, decreasing the interconnect delay within the NoC. Excessive increases in leakage power will also be avoided. In this
5â•… Physical Analysis of NoC Topologies for 3-D Integrated Systems
99
section, a methodology for analyzing the overall behavior of a 3-D system interconnected with an on-chip network is presented. Since the systems described in this chapter are presumed to be homogeneous, the power consumed by the entire system can be straightforwardly determined if the power dissipated by an elemental unit, as depicted in Fig.€5.1, is known. The power consumed by a PE and the two physical links that surround the PE is another useful metric for characterizing the different 3-D NoC topologies,
Ptotal = PPE + 2Lp Pbit ,
(5.30)
where PPE is the power consumed by a single PE. PPE includes all of the different energy components described in Section 5.3.2. Different expressions, however, can be used to describe these components. The dynamic power consumption PPE_dyn is separated into the power constituents, Pg and Pint, for driving the capacitance of the logic gates and interconnects, respectively. The dynamic power consumption can therefore be written as 2 PPE_dyn = Pg + Pint = fPE · αs Ntot Cgate + Cint_loc + Cint_semi + Cint_glob Vdd , (5.31)
where Ntot is the number of gates within a PE, as is the switching activity within a PE, and fPE is the operating frequency of the PE. Note that this frequency is typically different from the clock frequency fc of the NoC. Cint_loc, Cint_semi, and Cint_glob, are, respectively, the total capacitance of the local, semi-global, and global interconnects driven by the Ntot gates within the PE. The leakage and short-circuit power dissipation of a PE can be determined similarly to (5.24)–(5.25). The leakage power of the PE is
PPE_leak = Weff (Isub0 + Ig0 ) · Vdd ,
(5.32)
where Weff is the total width of the transistors within a PE. Assuming that the PEs consist of four transistor gates and the transistors are sized to equalize the rise and fall transitions, the width of the four devices is a function of the minimum feature size. Multiplying this width by the number of gates within the PE, Weff is obtained. To determine the interconnect capacitance described in (5.31), the distribution of the interconnect within a PE is required. An enhanced wire distribution model for either 2-D or 3-D circuits based on [36] is utilized in this analysis. This model is further integrated into the methodology described by [37] to produce the number of tiers (i.e., local, semi-global, global) and the pitch of each metal layer. A pair of metal layers routed orthogonally is assumed to comprise a tier. A specific constraint for the interconnect delay is set for each tier to determine the maximum interconnect length that can be placed within that tier. This constraint is set to 25 and 90% of the clock frequency fPE for the local and other tiers, respectively. An interconnect is considered to be placed on the next tier whenever the length of the wire does not satisfy the aforementioned constraint. Although the effect of temperature is considered in these power expressions, the methodology described in [37] does not consider thermal issues. To consider
100
V. F. Pavlidis and E. G. Friedman Q3
I3 ∆T3
∆T3 = Q3(R3+R2+R1) + Q2(R2+R1) + Q1R1
∆T2 = Q3(R2+R1) + Q2(R2+R1) + Q1R1
Q2
Q1
R3 ∆T2 R2 ∆T1
∆T1 = R1(Q3+Q2+Q1)
R1
V3 = I3(R3+R2+R1) + I2(R2+R1) + I1R1 I2
R3 V2 = I3(R2+R1) + I2(R2+R1) + I1R1
I1
R2 V1 = R1(I3+I2+I1) R1
Fig. 5.2↜渀 An example of the duality of thermal and electrical systems
these important 3-D circuit effects, a first-order thermal model of a 3-D circuit has been integrated into this methodology. This model assumes a one-dimensional (1-D) flow of heat throughout a 3-D stack [38, 39]. Note that the model includes both the heat generated by the devices and interconnect. The assumption of a 1-D heat flow is justified as the path towards the heat sink exhibits the lowest thermal resistance, facilitating the removal of heat from the circuit to the ambient. This path is the primary path for the heat to flow in a 3-D circuit [39]. By exploiting the electro-thermal duality, as illustrated in Fig.€5.2, the temperature in each plane and each metal layer within a physical plane of a 3-D circuit can be determined. The number of metal layers, metal pitch within these layers, temperature rise, and power dissipation for a PE can all be determined early in the design cycle by utilizing this thermal-aware interconnect architecture design methodology. The analysis method is depicted in Fig.€5.3. The input parameters are the target technology node, the number of gates Ntot within the PE, the number of physical planes np used for the PE, and the clock frequency fPE. Most of the interconnect and related parameters can be extracted for the target technology node. The complete methodology proceeds as follows: 1. For the clock frequency fPE and nominal temperature, an initial number of metal layers and the interconnect pitch are determined to satisfy the aforementioned delay constraints. 2. For this interconnect architecture and assuming the same average current density for the wires on each metal layer, the rise in temperature is determined. 3. Based on this increase in temperature, the electrical wire resistance, leakage power, and other temperature dependent parameters are updated. The interconnect delay is again evaluated against the input delay constraints. If these specifications are not satisfied, a new interconnect architecture is produced. 4. The iterative process terminates once the circuit has reached a steady state temperature and the delay constraints for each tier is satisfied. The output is the number of metal layers, interconnect pitch, and temperature of the circuit.
5â•… Physical Analysis of NoC Topologies for 3-D Integrated Systems Fig. 5.3↜渀 Analysis flow diagram that produces a first-order interconnect architecture and the steady-state temperature of a PE consisting of np physical planes within a 3-D stack of n planes (↜np€≤€n)
101
fPE, np, Ntot
Determine # of tiers, interconnect pitch, and distribution
Calculate T
Update wire resistance, temperature dependent parameters, leakage power
Are delay specs. met?
NO
YES
NO
Is ΣT < 10–5 °C?
YES Report steady-state temp., interconnect pitch, number of tiers per PE
Once the temperature and interconnect length at each tier have been determined, the power consumed by the PE is readily determined from (5.30)–(5.32). In this manner, the topology that produces the lowest power dissipation for the entire 3-D system rather than the physical link of the on-chip network is determined. Following this procedure, the different 3-D topologies discussed in Section€5.2 are evaluated in terms of the latency and power dissipation of the NoC, the total power dissipation of the system, and the rise in temperature. Various tradeoffs inherent to these topologies are also discussed for a NoC-based 3-D system.
102
V. F. Pavlidis and E. G. Friedman
5.5â•…Latency, Power, and Temperature Tradeoffs in 3-D NoC Topologies The improvement in the performance of traditionally planar on-chip networks by introducing the third-dimension is discussed in this section. Those topologies that produce the highest network performance, the lowest power dissipation of the network and system, and the lowest rise in temperature are evaluated. Different topologies are demonstrated that satisfy each of these objectives. Consequently, the analysis methodology presented in the previous section can be a useful tool to evaluate the improvement in a specific objective offered by a 3-D topology. The effect of the 3-D topologies on the speed, power, and temperature rise of a network is discussed in Sections€5.5.1, 5.5.2, and 5.5.3, respectively. The latency, power, and rise in temperature of a 2-D mesh network with the same number of nodes is used as a reference for the comparisons throughout this section. In all of the on-chip networks, a 45€ nm technology node, as described in the ITRS, is assumed [15]. Consequently, specific interconnect and device parameters, such as the minimum pitch of the horizontal interconnects, the maximum power density, and the dielectric constant k are adopted from this report. A TSV technology is assumed to provide the vertical interconnects, with a TSV pitch of 5€μm and an aspect ratio of five [33]. Finally, a synchronous on-chip network is assumed with a clock frequency of fc€=€1€GHz. A small set of parameters are considered as variables throughout the analysis of the 3-D topologies. These variables include the network size, number of physical planes making up the 3-D system, clock frequency of the PEs fPE, and area of the PEs APE. The range of these variables is listed in Table€5.1. For multi-processor SoC networks, sizes of up to N€=€256 are expected to be feasible within the near future [7, 40], whereas for NoC with a finer granularity, where each PE corresponds to a hardware block of approximately 100 thousand gates, network sizes over a few thousands nodes are predicted at the 45€nm technology node [41]. Furthermore, to apply the thermal model discussed in [38, 39], the nominal temperature is considered to be 300€K and the side and topmost surfaces of the 3-D stack are assumed to be adiabatic. In other words, the heat is assumed to flow from the uppermost to the lowest plane of the multi-plane system.
Table 5.1↜渀 Parameters of the investigated NoCs
Parameter N APE (mm2) fPE (GHz) Max. number of planes, nmax
Values 16, 32, 64, 128, 256, 512 0.64, 0.81, 1.00, 2.25 1, 2, 3 8
5â•… Physical Analysis of NoC Topologies for 3-D Integrated Systems
103
5.5.1 Latency of 3-D NoCs Utilizing the third dimension to implement an on-chip network (i.e., 2-D IC – 3-D NoC topology) by simply stacking the PEs (i.e., n3€>€1, np€=€1) and using network switches with seven ports decrease the average number of hops for packet switching, thereby improving the network latency. Alternatively, utilizing the third dimension to decrease the length of the physical links between adjacent network switches (i.e., 3-D IC – 2-D NoC topology) also reduces the latency of the network. The reduction in buss length is achieved by implementing the PEs in multiple physical planes (i.e., n3€=€1, np€>€1), thereby reducing PE area. Finally, a hybrid topology (i.e., 3-D IC – 3-D NoC topology), which uses the third dimension both for the onchip network and the PEs (i.e., n3€>€1, np€>€1), can result in the greatest reduction in latency. Note that the effect of the various topologies on only the speed of the network, described by fc, is considered, while the operating frequency of the PEs fPE can be different. Although this approach is convenient from an architectural perspective, certain physical design issues can arise due to the multiple clock domains that can co-exist in these topologies. Each of these topologies faces different synchronization challenges. A multi-plane on-chip network can be implemented with various synchronization schemes ranging from a fully synchronous approach (as assumed herein) to an asynchronous network. A potent non-synchronous approach that has been used for PE-to-network communication in planar systems is the globally asynchronous locally synchronous (GALS) approach. An immediate extension of the GALS approach into three physical dimensions could include a number of clock domains equal to the number of planes comprising a 3-D circuit. This synchronization scheme is suitable for the 2-D IC – 3-D NoC topology. Alternatively, for the 3-D IC – 2-D NoC topology where the network is planar, a synchronous clocking scheme is a simpler and efficient solution. The synchronization challenge for this topology is related to the multi-plane PEs. The primary issue is how to efficiently propagate the clock signal across a PE occupying several planes. Recently, several synthesis techniques that produce bounded skew and testable clock trees prior and after bonding have been reported [42]. In addition, preliminary experimental results on multi-plane clock networks demonstrate that operating frequencies in the gigahertz regime are feasible, while the clock skew is manageable [24]. Although functional testing for each plane of a multi-plane PE remains an important problem, early results are encouraging. For the 3-D mesh networks discussed in this chapter, fully synchronous schemes are assumed due to the simplicity of these approaches. In this way, the effect of the topological characteristics rather than the synchronization mechanism on the performance of the network is evaluated, which is the objective of the physical analysis flow discussed in this chapter. The latency for different network sizes and a PE area of 0.64€mm2 and 2.25€mm2 is illustrated in Fig.€5.4a, b, respectively. Note
104 12
20
2D ICs - 2D NoCs 2D ICs - 3D NoCs 3D ICs - 2D NoCs 3D ICs - 3D NoCs
18 16
2D ICs - 2D NoCs 2D ICs - 3D NoCs 3D ICs - 2D NoCs 3D ICs - 3D NoCs
14
8
Latency [ns]
Latency [ns]
10
V. F. Pavlidis and E. G. Friedman
6 4
12 10 8 6 4
2
2 0
a
4
5 6 7 8 Number of nodes log2N
9
0
b
4
5
6
7
8
9
Number of nodes log2N
Fig. 5.4↜渀 Zero-load latency for various network sizes where (a) APE€ =€ 0.64€ mm2 and (b) APE€=€ 2.25€mm2 for fPE€=€1€GHz
that the temperature rise due to stacking or folding the PEs is also considered by the methodology presented in Section€5.4. The latency of the 2-D IC – 3-D NoC topology decreases with increasing network size. For example, for N€=€16, the third dimension does not improve the latency, since the number of hops required for packet switching is small. The increase in the delay of the network switch (due to the increase in the number of switch ports) can outweigh the decrease in latency due to the reduction in the number of hops, which is negligible for this network size. As the network size increases, however, the decrease in latency offered by this topology progressively increases. The improvement in latency increases from 1.08% for N€=€32 to 6.79% for N€=€256, where APE€=€0.64€mm2. In addition, the area of the PE has no significant effect in this improvement, as depicted in Fig.€5.4, since this topology only alters the number of hops for packet switching. Note, however, that the absolute network latency increases for this topology, since the length of the busses increases with the area of the PEs. The 3-D IC – 2-D NoC exhibits the opposite behavior, since this topology reduces the length of the physical links. Thus, the improvement in latency increases in those networks with a large PE area. The latency decreases by 48.97% for APE€=€0.64€mm2 and 60.39% for APE€=€2.25€mm2 for a network size of N€=€256. The reduction in network latency for this topology decreases with increasing network size. As the network size increases, the greatest portion of the latency as described by (5.9) is due to the larger number of hops rather than the buss delay. Consequently, the benefits offered by the reduction in length of the busses decrease with network size for the 3-D IC – 2-D NoC topology. For example, the improvement in latency decreases from 54.12% for N€=€32 to 50.83% for N€=€128, where APE€=€0.64€mm2. The hybrid topology 3-D IC – 3-D NoC demonstrates the greater improvement in latency as compared to a 2-D network, since the third dimension decreases both the length of the busses and the number of hops [43]. Depending upon the network size, the area of the PE, and the interconnect impedance characteristics of the bus-
5â•… Physical Analysis of NoC Topologies for 3-D Integrated Systems
105
ses, n3 and np ensure that the 3-D IC – 3-D NoC topology can support either the 2-D IC – 3-D NoC (i.e., n3€=€nmax) or the 3-D IC – 2-D NoC (i.e., np€=€nmax). The results shown in Fig.€5.4 include the increase in delay caused by the rise in temperature within a 3-D stack. Based on the methodology discussed in the previous section, the resulting temperature rise does not significantly affect the improvement in latency provided by the 3-D topologies. The resulting higher temperatures within the 3-D system cause a small 3% increase in the interconnect latency for all of the investigated networks. The thermal effects are similar to those discussed in [44, 45]. Consequently, the overall effect of the 3-D topologies is that the network latency is significantly decreased, although an inevitable increase in temperature will consume a small portion of this improvement. The effect of the third dimension on the power consumed by the network and the PEs is discussed in the following section.
5.5.2 Power Dissipation of 3-D NoCs The decrease in the power of a conventional 2-D on-chip network achieved by the 3-D topologies is presented in this section. Two different power consumption metrics are used to characterize the benefits of these topologies. First, the 3-D topology that minimizes the power consumed by the network is described by (5.29), ignoring the power of the PEs. For the second metric, the overall power dissipation of the system, including both the power of the network and the PEs, is described by (5.30). Those topologies that minimize each of these two metrics are determined. Furthermore, the distribution of the network nodes in terms of the physical dimensions (i.e., n1, n2, n3, and np) can be quite different for the same 3-D topology. The power consumed by these 3-D topologies is illustrated in Fig.€5.5, where the power dissipated by the PEs is ignored. Similar to the discussion related to latency, the 2-D IC – 3-D NoC and 3-D IC – 2-D NoC topologies lower the power dissipated 0.7 0.6
1
0.4 0.3
0.6 0.4
0.1
0.2 4
5 6 7 8 Number of nodes log2N
9
0
b
2D ICs - 2D NoCs 2D ICs - 3D NoCs 3D ICs - 2D NoCs 3D ICs - 3D NoCs
0.8
0.2
0
a
1.2
Pbit [mW]
Pbit [mW]
0.5
1.4
2D ICs - 2D NoCs 2D ICs - 3D NoCs 3D ICs - 2D NoCs 3D ICs - 3D NoCs
4
5 6 7 8 Number of nodes log2N
9
Fig. 5.5↜渀 Power consumed by the network with delay constraints (↜渀fc€=€1€GHz) for several network sizes where (a) APE€=€0.64€mm2 and (b) APE€=€2.25€mm2 for fPE€=€1€GHz
106
V. F. Pavlidis and E. G. Friedman
by the network through a reduction in the number of hops and the capacitance of the wires, respectively. Note that the y-axis in Fig.€5.5 corresponds to the power required to transfer a single bit over an average distance within the network where this distance is determined by the number of hops for packet switching, as described by (5.2). Comparing Fig.€5.5a, b the power consumed by a planar on-chip network increases with the area of the PEs interconnected by this network. For example, the power almost doubles for the same network size as the area of the PE increases from 0.64€mm2 to 2.25€mm2. Similar to the network latency, the power consumption decreases in the 2-D IC – 3-D NoC topology by reducing the number of hops for packet switching. Again, the increase in the number of ports adds to the power consumed by the crossbar switch; however, the effect of this increase in power is not as significant as the corresponding increase in the latency of the network. A three-dimensional network can therefore reduce power even in small networks. The power savings achieved with this topology is greater in larger networks. This situation occurs because the reduction in the average number of hops for a three-dimensional network increases in larger network sizes. With the 3-D IC – 2-D NoC topology, the number of hops in the network is the same as for a two-dimensional network. The horizontal buss length, however, is shortened by implementing the PEs in more than one physical plane. The greater the number of physical planes that can be integrated in a 3-D system, the larger the power savings; meaning that the optimum value for np with this topology is always nmax regardless of the network size and operating frequency (if temperature is not the target objective). The savings is practically limited by the number of physical planes that can be integrated in a 3-D technology. For this type of NoC, the topology resulting in the maximum speed is identical to the topology minimizing the power consumption, as the key element of either objective originates solely from the shorter buss length. Finally, the 3-D IC – 3-D NoC can achieve the minimum power consumption for a 3-D on-chip network by properly adjusting n3 and np depending upon the interconnect impedance characteristics, the available number of physical planes, and the clock frequency of the network. Interestingly, when the power metric described in (5.30) is utilized, the topologies that minimize the total power are different, as illustrated in Fig.€ 5.6. The distribution of the network nodes within those topologies also changes. The total power of a network-based 3-D system is plotted in Fig.€5.6, where the clock frequency of the network is fc€=€1€GHz and the area of the PE is APE€=€0.64€mm2 and APE€=€2.25€mm2. The clock frequency of the PE is equal to fc in this case. A common characteristic of Fig.€5.6a, b is that for larger network sizes, the topology that produces the lowest power dissipation changes from the 3-D IC – 2-D NoC to the 2-D IC – 3-D NoC topology (for this specific example, the 3-D IC – 3-D NoC coincides with either of these topologies). For small networks and PE area (see Fig.€5.6a), the reduction in power originates from the shorter buss length of the network and the shorter interconnects within the PEs since the PEs are implemented in multiple planes. As the network size increases, however, the number of hops increases considerably, making the power dissipated by the network the dominant
5â•… Physical Analysis of NoC Topologies for 3-D Integrated Systems 5 4.5
8
3.5
7
3
6
2.5 2
4 3
1
2
0.5
1 4
5 6 7 8 Number of nodes log2N
9
0
b
2D ICs - 2D NoCs 2D ICs - 3D NoCs 3D ICs - 2D NoCs 3D ICs - 3D NoCs
5
1.5
0
a
9
Ptotal [W]
Ptotal [W]
4
10
2D ICs - 2D NoCs 2D ICs - 3D NoCs 3D ICs - 2D NoCs 3D ICs - 3D NoCs
107
4
5 6 7 8 Number of nodes log2N
9
Fig. 5.6↜渀 Total power consumed by a PE and the adjacent network busses according to (5.30) with delay constraints (╛fc€ =€ 1€ GHz) for several network sizes where (a) APE€ =€ 0.64€ mm2 and (b) APE€=€2.25€mm2 for fPE€=€1€GHz
power component consumed by the system. Consequently, the 3-D IC – 2-D NoC does not offer the maximum power savings; the maximum savings is now achieved with the 2-D IC – 3-D NoC topology. If the PE is larger, the network size at which the optimum topology changes increases. This behavior occurs since larger PEs include a greater number of gates leading to additional longer interconnections within the PEs, as described by the interconnect distribution model presented in Section€5.4. The greater number and length of the wires within a PE are the primary power component of the entire system. The 3-D IC – 2-D NoC topology offers a greater improvement for even larger network sizes before the power caused by the increasing number of hops starts to dominate. This behavior occurs since the 3-D IC – 2-D NoC topology reduces the length of the interconnects within the PEs in addition to the length of the network busses. Another interesting result is that the clock frequency of the PE fPE affects the overall power dissipation, a factor typically ignored when evaluating the performance of a network-based integrated system. In Fig.€5.7, fPE increases from 1 to 3€GHz. This increase has a profound effect on the overall power of the system. To satisfy this aggressive timing specification while limiting the interconnect power consumption, the 3-D IC – 2-D NoC topology exhibits the best results for most of the network sizes depicted in Fig.€5.7a. Note that this behavior is more pronounced for larger PE areas, as depicted in Fig.€5.7b, where the 3-D IC – 2-D NoC topology performs better than the 2-D IC – 3-D NoC topology for any network size. Furthermore, the 3-D IC – 3-D NoC topology can lead to the lowest power consumption with appropriate adjustment of the parameters n3 and np. To demonstrate the distribution of the networks nodes within the three physical dimensions in addition to the effect on the topology, the node distribution is listed in Table€5.2 for specific network and PE characteristics. From Table€5.2, both the operating frequency and the area of the PEs affect the distribution of nodes within the NoC. Large PE areas (↜APE€=€2.25€mm2) and high operating frequencies (╛↜fPE€=€3€GHz) require 3-D NoC topologies where some of the physical planes are
108
V. F. Pavlidis and E. G. Friedman
6
14
2D ICs - 2D NoCs 2D ICs - 3D NoCs 3D ICs - 2D NoCs 3D ICs - 3D NoCs
5
10 Ptotal [W]
4 Ptotal [W]
2D ICs - 2D NoCs 2D ICs - 3D NoCs 3D ICs - 2D NoCs 3D ICs - 3D NoCs
12
3 2
8 6 4
1
2
0
4
a
5 6 7 8 Number of nodes log2N
0
9
4
b
5 6 7 8 Number of nodes log2N
9
Fig. 5.7↜渀 Total power consumed by a PE and the adjacent network busses according to (5.30) with delay constraints (↜fc€ =€ 1€ GHz) for several network sizes where (a) APE€ =€ 0.64€ mm2 and (b) APE€=€2.25€mm2 for fPE€=€3€GHz
Table 5.2↜渀 Node distribution for minimum power consumption of different network sizes N fPE€=€1€GHz fPE€=€3€GHz APE€=€2.25€mm2
APE€=€0.64€mm2
╇ 16 ╇ 32 ╇ 64 128 256 512
APE€=€0.64€mm2
APE€=€2.25€mm2
n1
n2
n3
np
n1
n2
n3
np
n1
n2
n3
np
n1
n2
n3
np
4 8 8 4 8 8
4 4 8 4 4 8
1 1 1 8 8 8
8 8 8 1 1 1
╇ 4 ╇ 8 ╇ 8 16 16 ╇ 8
╇ 4 ╇ 4 ╇ 8 ╇ 8 16 ╇ 8
1 1 1 1 1 8
8 8 8 8 8 1
╇ 4 ╇ 8 ╇ 8 16 16 ╇ 8
╇ 4 ╇ 4 ╇ 8 ╇ 8 16 ╇ 8
1 1 1 1 1 8
8 8 8 8 8 1
╇ 4 ╇ 8 ╇ 8 16 16 32
╇ 4 ╇ 4 ╇ 8 ╇ 8 16 16
1 1 1 1 1 1
8 8 8 8 8 8
used for the PEs (i.e., np€>€1). For small PEs (↜APE€=€0.64€mm2) and low operating frequencies (↜fPE€=€1€GHz), a simple 3-D network (i.e., n3€>€1 and np€=€1) is typically the best choice. Note that the selection of the optimum topology for either a latency or power objective depends strongly on the interconnect and device characteristics of the specific technology node. Consequently, even for system level exploratory design, the analysis methodology presented in Section€5.4 provides a first estimate of the behavior of a network-based 3-D system. The related temperature rise for these 3-D topologies, which is another design objective for this type of integrated system, is discussed in the following section.
5.5.3 Temperature in 3-D NoCs Elevated temperatures are expected to become an important challenge in vertical integration, specifically where several high performance circuits form a multi-plane
5â•… Physical Analysis of NoC Topologies for 3-D Integrated Systems
109
integrated system. The increased power densities per unit volume can potentially increase the operating temperature of the system to prohibitive levels, greatly affecting the performance characteristics and severely degrading the reliability of this system. Consequently, the temperature rise resulting from these 3-D topologies is of primary interest. Based on the methodology described in Section€5.4, the temperature of the substrate and each metal layer within a physical plane is determined assuming a one-dimensional flow of heat towards the heat sink. The heat sink is assumed to be attached to the lowest plane within the 3-D stack. The change in temperature rise due to the different 3-D topologies, area and operating frequency of the PEs, and number of physical planes are discussed in this section. Considering the 3-D NoC topologies discussed in this chapter, the 2-D IC – 3-D NoC topology will result in higher temperatures as compared to the 3-D IC – 2-D NoC topology since the former topology simply stacks the PEs, while the latter topology utilizes more than one plane to implement a PE. The 2-D IC – 3-D NoC topology leads to higher temperatures for two reasons. Several PEs, determined by n3, are placed adjacent to the vertical direction. Consequently, the power density generated by both the devices and metal layers increases. In addition, each of these PEs is implemented in one physical plane (i.e., np€=€1) and, hence, no reduction in power density is possible. Alternatively, the 3-D IC – 2-D NoC topology utilizes more than one plane for each PE, reducing the interconnect load capacitance and, consequently, the temperature within the 3-D system. The temperature rise resulting from the different 3-D topologies is illustrated in Fig.€ 5.8 for different number of planes. These temperatures correspond to the temperature rise at the topmost metal layer of the uppermost physical plane over the nominal temperature (here assumed to be 27°C). From Fig.€5.8, as the number of planes increases, the temperature naturally increases for the 2-D IC – 3-D NoC topology (for this topology np€=€1). Alternatively, when some or all of the physical planes are used to implement the PEs, as occurs for the 3-D IC – 3-D NoC and 3-D 8
np = 1 np = 2 np = 4 np = 8
10 Temp. rise [°C]
6 Temp. rise [°C]
12
np = 1 np = 2 np = 4 np = 8
7
5 4 3
8 6 4
2 2
1
a
0
1
2
4 # of planes
8
b
0
1
2
4 # of planes
8
Fig. 5.8↜渀 Temperature rise within the 3-D topologies for different combinations of n3 and np. For all of the topologies, n3€×€np€=€n, where n is the number of planes within the 3-D stack. A maximum number of planes nmax€=€8 is assumed, according to Table€5.1. The clock frequency of the PE is fPE€=€1€GHz and the area is (a) APE€=€0.64€mm2 and (b) APE€=€2.25€mm2
110
V. F. Pavlidis and E. G. Friedman
8
np = 1 np = 2 np = 4 np = 8
10 Temp. rise [°C]
6 Temp. rise [°C]
12
np = 1 np = 2 np = 4 np = 8
7
5 4 3
8 6 4
2 2
1 0
a
1
2
4 # of planes
8
0
b
1
2
4 # of planes
8
Fig. 5.9↜渀 Temperature rise within the 3-D topologies for different combinations of n3 and np. For all of the topologies, n3€×€np€=€n; where n is the number of planes in the 3-D stack. A maximum number of planes nmax€=€8 is assumed according to Table€5.1. The area of the PE is APE€=€0.64€mm2 and the clock frequency is (a) fPE€=€1€GHz and (b) fPE€=€3€GHz
IC – 2-D NoC topologies, the temperature rise is considerably smaller. Note, for example, that a 3-D system consisting of eight planes exhibits comparable temperatures to another system comprised of only four planes, as long as the former system uses two physical planes for the PE. This behavior is more pronounced for PEs with larger area, as depicted in Fig.€5.8b. For this case, using more than one plane for the PE significantly reduces the power density per plane. Most importantly, however, the number of metal layers required for a two-plane PE can be smaller [36]. This construction decreases the length and resistance of the vertical thermal path to remove the heat within the 3-D stack. An increase in temperature also occurs when the operating frequency of the PEs increases, as illustrated in Fig.€5.9. This behavior can be explained by noting that an increase in frequency produces a linear increase in the (dynamic) power consumed by the 3-D system. Note that the temperature rise for higher frequencies within the PEs is comparable to the increase observed for PEs with larger areas. In Fig.€5.8, the area of the PE is almost quadrupled, while in Fig.€5.9 the operating frequency is tripled, resulting in approximately the same rise in temperature. This behavior can be explained as follows. A larger PE includes additional gates that require additional wiring resources. Alternatively, tighter timing constraints can be satisfied, in this example, by increasing the wire pitch. If in either case, an additional tier is required, the thermal resistance of the heat flow path increases. Additionally, for both cases, the power consumption increases, resulting in higher temperatures. The increase in temperature shown in Figs.€5.8 and 5.9 is for the highest metal layer of the uppermost physical plane within a 3-D system. Although this increase may not be catastrophic, the timing specifications for the PE or the network can possibly not be satisfied if temperature is ignored. To better explain this situation, the different metal pitches for the PEs considering thermal effects are listed in Table€5.3 for the 2-D IC 3-D NoC topology where n3€=€8. In columns 2 to 7, thermal effects are not considered in the analysis flow diagram depicted in Fig.€5.3, while
5â•… Physical Analysis of NoC Topologies for 3-D Integrated Systems
111
Table 5.3↜渀 Pitch of the interconnect layers for each plane for the 2-D IC – 3-D NoC topology where n3€=€8, APE€=€1€mm2, and fPE€=€3€GHz. Two cases are considered, where the system operates at nominal T0 and at temperature T0€+€ΔΤ. At the uppermost plane ΔΤ€=€20.1°C T0€+€ΔΤ T0 Plane # of Metal pitch (nm) # of Metal pitch (nm) tiers tiers € Tier 1 Tier 2 Tier 3 Tier 4 Tier 5 € Tier 1 Tier 2 Tier 3 Tier 4 Tier 5 1 2 3 4 5 6 7 8
5 5 5 5 5 5 5 5
90 90 90 90 90 90 90 90
270 270 270 270 270 270 270 270
900 900 900 900 900 900 900 900
1,440 1,440 1,440 1,440 1,440 1,440 1,440 1,440
2,000 2,000 2,000 2,000 2,000 2,000 2,000 2,000
5 5 5 5 5 5 5 5
90 90 90 90 90 90 90 90
270 270 270 270 270 270 270 270
900 900 900 900 900 900 900 900
1,280 1,280 1,280 1,280 1,280 1,280 1,280 1,280
2,250 2,500 2,500 2,750 2,750 3,000 3,000 3,000
in columns 8–13, thermal effects are considered. Note that a different temperature is determined for each tier in a plane according to the flow diagram shown in Fig.€5.3. For the uppermost plane, the maximum rise in temperature is ΔΤ€=€20.1°C. As reported in Table€5.3, neglecting the rise in temperature, particularly in the upper planes, results in a smaller interconnect pitch which is insufficient to satisfy the timing requirements. Another tier (not shown in Table€5.3) should be used for the network and, therefore, separate timing specifications would apply for this tier. The pitch of this global interconnect tier is not determined by the analysis procedure described in Section€5.4, but a small pitch is selected to constrain the area allocated for the physical links within the network. The power consumption and related temperature rise also depend upon the switching activity of both the network as_noc and the PEs as. The relative magnitude of these two parameters can greatly affect the behavior of a 3-D topology. In these examples, as_noc€=€0.25 and as€=€0.15 have been assumed. These parameters do not affect those traits of the 3-D topologies that improve the performance of a conventional 2-D network but can considerably affect the extent to which each of the 3-D topologies can improve a specific design objective.
5.6â•…Summary 3-D NoC are a natural evolution of 2-D NoC, exhibiting superior performance. Several 3-D NoC topologies are discussed. Models for the zero-load latency and power consumed by a network are presented for these 3-D topologies. Expressions for the power dissipation of the entire system including the PEs are also provided. A methodology that predicts the distribution of the interconnects within a system based on an on-chip network is extended to accommodate the 3-D nature of the investigated topologies. Thermal effects of the interconnect distribution are also considered in this analysis methodology.
112
V. F. Pavlidis and E. G. Friedman
In 3-D NoCs, the minimum latency and power consumption can be achieved by reducing both the number of hops per packet and the length of the communication channels. The topology that best achieves this reduction, however, changes according to the design objective. The network size, speed, and gate count of the PEs, as well as the particular 3-D technology are some important aspects that need to be considered when a 3-D topology is chosen. Selecting a topology that minimizes the power dissipated by an on-chip network does not necessarily guarantee that the power dissipated by the overall system will be minimized. Consequently, the analysis methodology described in this chapter can be a useful tool for exploring early in the design cycle the topological and architectural choices of a 3-D NoC-based system.
References ╇ 1. G. De Micheli and L. Benini, Networks on Chips: Technology and Tools, Morgan Kaufmann, San Francisco, CA, 2006. ╇ 2. A. Jantsch and H. Tenhunen, Networks on Chip, Kluwer Academic, San Francisco, CA, 2003. ╇ 3. M. Millberg et al., “The Nostrum Backbone—A Communication Protocol Stack for Networks on Chip,” Proceedings of the IEEE International Conference on VLSI Design, pp.€693–696, January 2004. ╇ 4. J. M. Duato, S. Yalamanchili, and L. Ni, Interconnection Networks: An Engineering Approach, Morgan Kaufmann, San Francisco, CA, 2003. ╇ 5. D. Park et al., “MIRA: A Multi-Layered On-Chip Interconnect Router Architecture,” Proceedings of the IEEE International Symposium on Computer Architecture, pp.€251–261, June 2008. ╇ 6. C. Addo-Quaye, “Thermal-Aware Mapping and Placement for 3-D NoC Designs,” Proceedings of the IEEE International System-on-Chip Conference, pp.€25–28, September 2005. ╇ 7. F. Li et al., “Design and Management of 3D Chip Multiprocessors Using Network-in-Memory,” Proceedings of the IEEE International Symposium on Computer Architecture, pp.€130– 142, June 2006. ╇ 8. V. F. Pavlidis and E. G. Friedman, “Three-Dimensional (3-D) Topologies for Networks-onChip,” Proceedings of the IEEE International System-on-Chip Conference, pp.€ 285–288, September 2006. ╇ 9. C. Seiculescu, S. Murali, L. Benini, and G. De Micheli, “SunFloor 3D: A tool for Networks on Chip Topology Synthesis for 3D Systems on Chips,” ACM/IEEE Design, Automation and Test in Europe Conference and Exhibition, pp.€9–14, April 2009. 10. W. J. Dally and B. Towles, Principles and Practices of Interconnection Networks, Morgan Kaufmann, San Francisco, CA, 2004. 11. L.-S. Peh and W. J. Dally, “A Delay Model for Router Microarchitectures,” IEEE Micro, Vol.€21, No.€1, pp.€26–34, January/February 2001. 12. T. Sakurai, “Closed-Form Expressions for Interconnection Delay, Coupling, and Crosstalk in VLSI’s,” IEEE Transactions on Electron Devices, Vol.€40, No.€1, pp.€118–124, January 1993. 13. K. A. Bowman et al., “A Physical Alpha-Power Law MOSFET Model,” IEEE Journal of Solid States Circuits, Vol.€34, No.€10, pp.€1410–1414, October 1999. 14. S. L. Garverick and C. G. Sodini, “A Simple Model for Scaled MOS Transistors that Includes Field-Dependent Mobility,” IEEE Journal of Solid States Circuits, Vol.€SC-22, No.€2, pp.€111–114, February 1987. 15. The International Technology Roadmap for Semiconductors Reports, 2009 [Online]. Available: http://www.itrs.net/Links/2008ITRS/Home2008.htm
5â•… Physical Analysis of NoC Topologies for 3-D Integrated Systems
113
16. Predictive Technology Model [Online]. Available: http://www.eas.asu.edu/~ptm 17. W. Zhao and Y. Cao, “New Generation of Predictive Technology Model for Sub-45€nm Design Exploration,” Proceedings of the IEEE International Symposium on Quality Electronic Design, pp.€585–590, March 2006. 18. T. Sakurai and A. R. Newton, “Alpha-Power Law MOSFET Model and Its Applications to CMOS Inverter Delay and Other Formulas,” IEEE Journal of Solid State Circuits, Vol.€25, No.€2, pp.€584–594, April 1990. 19. G. Chen and E. G. Friedman, “Low-Power Repeaters Driving RC and RLC Interconnects with Delay and Bandwidth Constraints,” IEEE Transactions on Very Large Integration (VLSI) Systems, Vol.€12, No.€2, pp.€161–172, February 2006. 20. X. Xi et al., BSIM4.5.0 MOSFET Model User’s Manual, University of California, Berkeley, CA, 2004. 21. H. B. Bakoglu, Circuits, Interconnections, and Packaging for VLSI, Addison-Wesley, Reading, MA,1990. 22. Y. I. Ismail, E. G. Friedman, and J. L. Neves, “Equivalent Elmore Delay for RLC Trees,” IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, Vol.€19, No.€1, pp.€83–97, January 2000. 23. Y. I. Ismail, E. G. Friedman, and J. L. Neves, “Figures of Merit to Characterize the Importance of On-Chip Inductance,” IEEE Transactions on Very Large Integration (VLSI) Systems, Vol.€7, No.€4, pp.€442–449, December 1999. 24. V. F. Pavlidis, I. Savidis, and E. G. Friedman, “Clock Distribution Networks for 3-D Integrated Circuits,” Proceedings of the IEEE International Conference on Custom Integrated Circuits, pp.€651–654, September 2008. 25. Massachusetts Institute of Technology Lincoln Laboratory, FDSOI Design Guide, Cambridge, 2006. 26. H. Hua et al., “Performance Trends in Three-Dimensional Integrated Circuits,” Proceedings of the International IEEE Interconnect Technology Conference, pp.€45–47, June 2006. 27. K. Banerjee and A. Mehrotra, “A Power-Optimal Repeater Insertion Methodology for Global Interconnects in Nanometer Design,” IEEE Transactions on Electron Devices, Vol.€ 49, No.€11, pp.€2001–2007, November 2002. 28. H. J. M. Veendrick, “Short-Circuit Dissipation of Static CMOS Circuitry and Its Impact on the Design of Buffer Circuits,” IEEE Journal of Solid State Circuits, Vol.€SC-19, No.€4, pp.€468–473, August 1984. 29. K. Nose and T. Sakurai, “Analysis and Future Trend of Short-Circuit Power,” IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, Vol.€ 19, No.€ 9, pp.€1023–1030, September 2000. 30. G. Chen and E. G. Friedman, “Effective Capacitance of Inductive Interconnects for ShortCircuit Power Analysis,” IEEE Transactions on Circuits and Systems I: Brief Papers, Vol.€55, No.€1, pp.€26–30, January 2008. 31. P. R. O’Brien and T. L. Savarino, “Modeling the Driving-Point Characteristic of Resistive Interconnect for Accurate Delay Estimation,” Proceedings of the International IEEE/ACM Conference on Computer-Aided Design, pp.€512–515, April 1989. 32. H. Wang, L.-S. Peh, and S. Malik, “Power-Driven Design of Router Microarchitectures in On-Chip Networks,” Proceedings of the IEEE International Symposium on Microarchitecture, pp.€105–116, December 2003. 33. V. F. Pavlidis and E. G. Friedman, Three-Dimensional Integrated Circuit Design, Morgan Kaufmann, San Francisco, CA, 2009. 34. V. F. Pavlidis and E. G. Friedman, “Interconnect-Based Design Methodologies for ThreeDimensional Integrated Circuits,” Proceedings of the IEEE, Special Issue on 3-D Integration Technology, Vol.€97, No.€1, pp.€123–140, January 2009. 35. J. W. Joyner and J. D. Meindl, “Opportunities for Reduced Power Distribution Using ThreeDimensional Integration,” Proceedings of the IEEE International Interconnect Technology Conference, pp.€148–150, June 2002.
114
V. F. Pavlidis and E. G. Friedman
36. J. W. Joyner et al., “Impact of Three-Dimensional Architectures on Interconnects in Gigascale Integration,” IEEE Transactions on Very Large Scale Integration (VLSI) Systems, Vol.€9, No.€6, pp.€922–927, December 2000. 37. R. Venkatesan, J. A. Davis, K. A. Bowman, and J. D. Meindl, “Optimal n-tier Multilevel Interconnect Architectures for Gigascale Integration (GSI),” IEEE Transactions on Very Large Scale Integration (VLSI) Systems, Vol.€9, No.€6, pp.€899–912, December 2001. 38. T.-Y. Chiang, S. J. Souri, C. O. Chui, and K. C. Saraswat, “Thermal Analysis of Heterogeneous 3D ICs with Various Integration Scenarios,” Proceedings of the IEEE International Electron Device Meeting, pp.€681–684, December 2001. 39. T.-Y. Chiang, K. Banerjee, and K. C. Saraswat, “Analytical Thermal Model for Multilevel VLSI Interconnects Incorporating Via Effect,” IEEE Electron Device Letters, Vol.€23, No.€1, pp.€31–33, January 2002. 40. C. Marcon et al., “Exploring NoC Mapping Strategies: An Energy and Timing Aware Technique,” Proceedings of the ACM/IEEE Design, Automation and Test in Europe Conference and Exhibition, Vol.€1, pp.€502–507, March 2005. 41. P. P. Pande et al., “Performance Evaluation and Design Trade-Offs for Network-on-Chip Interconnect Architectures,” IEEE Transactions on Computers, Vol.€54, No.€8, pp.€1025–1039, August 2005. 42. X. Zhao, D. L. Lewis, H.-S. H. Lee, and S. K. Lim, “Pre-Bond Testable Low-Power Clock Tree Design for 3D Stacked ICs,” Proceedings of the IEEE/ACM International Conference on Computer Aided Design, pp.€184–190, November 2009. 43. V. F. Pavlidis and E. G. Friedman, “3-D Topologies for Networks-on-Chip,” IEEE Transactions on Very Large Scale Integration (VLSI) Systems, Vol.€15, No.€10, pp.€1081–1090, October 2007. 44. A. H. Ajami, K. Banerjee, and M. Pedram, “Modeling and Analysis of Nonuniform Substrate Temperature Effects on Global ULSI Interconnects,” IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, Vol.€24, No.€6, pp.€849–861, June 2005. 45. J. C. Ku and Y. Ismail, “Thermal-Aware Methodology for Repeater Insertion in Low-Power VLSI Circuit,” IEEE Transactions on Very Large Scale Integration (VLSI) Systems, Vol.€15, No.€8, pp.€963–970, August 2007.
Chapter 6
Three-Dimensional Networks-on-Chip: Performance Evaluation Brett Stanley Feero and Partha Pratim Pande
6.1â•…Introduction The current trend in System-on-Chip (SoC) design in the ultra deep sub-micron (UDSM) regime and beyond is to integrate a huge number of functional and storage blocks in a single die [1]. The possibility of this enormous degree of integration gives rise to new challenges in designing the interconnection infrastructure for these big SoCs. Extrapolating from the existing CMOS scaling trends, traditional on-chip interconnect systems have been projected to be limited in their ability to meet the performance needs of SoCs at the UDSM technology nodes and beyond [2]. This limit stems primarily from global interconnect delay significantly exceeding that of gate delays. While copper and low-k dielectrics have been introduced to decrease the global interconnect delay, they only extend the lifetime of conventional interconnect systems a few technology generations. According to the International Technology Roadmap for Semiconductors (ITRS) [2], for the longer term, material innovation with traditional scaling will no longer satisfy the performance requirements. New interconnect paradigms are in need. Continued progress of interconnect performance will require employing approaches that introduce materials and structures beyond the conventional metal/dielectric system, and one of the promising approaches is 3D integration. Shown in Fig.€6.1, three-dimensional (3D) ICs, which contain multiple layers of active devices, have the potential for enhancing system performance [3–6]. According to [3], three-dimensional ICs allow for performance enhancements even in the absence of scaling. A clear way to reduce the burden of high frequency signal propagation across monolithic ICs is to reduce the line length needed, and this can be done by employing stacking of active devices using 3D interconnects. Here, the multiple layers of active
B. S. Feero () ARM Inc., 3711 S. Mopac Expy. Austin, TX 78731, USA e-mail:
[email protected] P. P. Pande () School of Electrical Engineering and Computer Science, Washington State University, PO BOX-642752, Pullman, WA 99164-2752, USA e-mail:
[email protected] A. Sheibanyrad et al. (eds.), 3D Integration for NoC-based SoC Architectures, Integrated Circuits and Systems, DOI 10.1007/978-1-4419-7618-5_6, ©Â€Springer Science+Business Media, LLC 2011
115
116
B. S. Feero and P. P. Pande
Fig. 6.1↜渀 3DIC from a SOI process Second Device Layer Vertical Via
p+
n+ First Device Layer
Silicon
devices are separated by a few tens of micrometers. Consequently, 3D interconnects allow communication among these active devices with smaller distances required for signal propagation. Three-dimensional ICs will have a significant impact on the design of multi-core SoCs. Recently, Network-on-Chip (NoC) has emerged as an effective methodology for designing big multi-core SoCs [7, 8]. However, the conventional two dimensional (2D) IC has limited floor-planning choices and, consequently, limits the performance enhancements arising out of NoC architectures. The performance improvement arising from the architectural advantages of NoCs will be significantly enhanced if 3D ICs are adopted as the basic fabrication methodology. The amalg