Available:*
Library | Item Barcode | Call Number | Material Type | Item Category 1 | Status |
---|---|---|---|---|---|
Searching... | 30000010343209 | QA76.88 H546 2015 | Open Access Book | Book | Searching... |
On Order
Summary
Summary
Gain Critical Insight into the Parallel I/O Ecosystem
Parallel I/O is an integral component of modern high performance computing (HPC), especially in storing and processing very large datasets to facilitate scientific discovery. Revealing the state of the art in this field, High Performance Parallel I/O draws on insights from leading practitioners, researchers, software architects, developers, and scientists who shed light on the parallel I/O ecosystem.
The first part of the book explains how large-scale HPC facilities scope, configure, and operate systems, with an emphasis on choices of I/O hardware, middleware, and applications. The book then traverses up the I/O software stack. The second part covers the file system layer and the third part discusses middleware (such as MPIIO and PLFS) and user-facing libraries (such as Parallel-NetCDF, HDF5, ADIOS, and GLEAN).
Delving into real-world scientific applications that use the parallel I/O infrastructure, the fourth part presents case studies from particle-in-cell, stochastic, finite volume, and direct numerical simulations. The fifth part gives an overview of various profiling and benchmarking tools used by practitioners. The final part of the book addresses the implications of current trends in HPC on parallel I/O in the exascale world.
Author Notes
Prabhat leads the NERSC Data and Analytics Services Group at Lawrence Berkeley National Laboratory. His main research interests include Big Data analytics, scientific data management, parallel I/O, HPC, and scientific visualization. He is also interested in atmospheric science and climate change.
Quincey Koziol is the director of core software development and HPC at The HDF Group, where he leads the HDF5 software project. His research interests include HPC, scientific data storage, and software engineering and management.
Table of Contents
Parallel I/O in Practice |
Parallel I/O at HPC FacilitiesGalen Shipman |
National Energy Research Scientific Computing CenterJason Hick |
National Center for Supercomputing ApplicationsWilliam Kramer and Michelle Butler and Gregory Bauer and Kalyana Chadalavada and Celso Mendes |
Argonne Leadership Computing FacilityWilliam E. Allcock and Kevin Harms |
Livermore Computing CenterRichard Hedges and Blaise Barney |
Los Alamos National LaboratoryGary Grider |
Texas Advanced Computing CenterKarl W. Schulz |
File Systems |
LustreEric Barton and Andreas Dilger |
GPFSDean Hildebrand and Frank Schmuck |
OrangeFSWalt Ligon and Boyd Wilson |
OneFSNick Kirsch |
I/O Libraries |
I/O Libraries: Past, Present and FutureMike Folk |
MPI-IOWei-keng Liao and Rajeev Thakur |
PLFS: Software-Defined Storage for HPCJohn Bent |
Parallel-NetCDFRob Latham |
HDF5Quincey Koziol and Russ Rew and Mark Howison and Prabhat and Marc Poinot |
ADIOSNorbert Podhorszki and Scott Klasky and Qing Liu and Yuan Tian and Manish Parashar and Karsten Schwan and Matthew Wolf and Sriram Lakshminarasimhan |
GLEANVenkatram Vishwanath and Huy Bui and Mark Hereld and Michael E. Papka |
I/O Case Studies |
Parallel I/O for a Trillion-Particle Plasma Physics SimulationSurendra Byna and Prabhat and Homa Karimabadi and William Daughton |
Stochastic Simulation Data ManagementDimitris Servis |
Silo: A General-Purpose API and Scientific DatabaseMark Miller |
Scaling Up Parallel I/O in S3D to 100-K Cores with ADIOSScott Klasky and Gary Liu and Hasan Abbasi and Norbert Podhorszki and Jackie Chen and Hemanth Kolla |
In-Transit Processing: Data Analysis Using Burst BuffersChristopher Mitchell and David Bonnie and Jonathan Woodring |
I/O Profiling Tools |
Overview of I/O BenchmarkingKatie Antypas and Yushu Yao |
TAUSameer Shende and Allen D. Malony |
Integrated Performance MonitoringDavid Skinner |
DarshanPhilip Carns |
IotaMark Howison and Prabhat and Surendra Byna |
Future Trends |
Parallel Computing Trends for the Coming DecadeJohn Shalf |
Storage Models: Past, Present, and FutureDries Kimpe and Robert Ross |
ResilienceGary Grider and Nathan DeBardeleben |
Multi/Many CoreRamon Nou and Toni Cortes and Stelios Mavridis and Yannis Sfakianakis and Angelos Bilas |
Storage Networks and InterconnectsParks Fields and Benjamin McClelland |
Power ConsumptionMatthew L. Curry and H. Lee Ward and David Martinez and Jill Gemmill and Jay Harris and Gary Grider and Anna Maria Bailey |
Index |