Commit 26adea83 authored by rjzamora's avatar rjzamora
Browse files

readme updates

parent 37eb730c
# The Custom-Collective I/O (CCIO) HDF5 VFD
**Authors:**
- Richard J. Zamora (rzamora@anl.gov)
- Paul Coffman (pcoffman@anl.gov)
- Venkatram Vishwanath (venkat@anl.gov)
**Updates:**
- December 18th 2018
This document is intended to provide an overview of the Custom-Collective IO (CCIO)-Enabled MPIO virtual file-driver (VFD) in HDF5. The CCIO features provide an **intuitive** and **topology-aware** interface for the implementation of scalable algorithms and optimizations on *top* of the existing MPIO virtual file driver (VFD).
The CCIO features are all based on the representation of each HDF5 dataset selection as a one-dimensional flattened buffer (**flatbuf**), in both file and memory space. The flatbuf representation, which is essentially a list of contiguous data chunks and file offsets, provides an *intuitive* mechanism for HDF5 developers to implement customized collective I/O algorithms. The data-flattening step is performed within new `select_write` and `select_read` VFD callback functions that have been added specifically for CCIO. While these callback functions are currently set to `NULL` in most file drivers, the MPIO driver can use them to override the default call path for collective I/O.
......
......@@ -4,6 +4,7 @@
- Richard J. Zamora (rzamora@anl.gov)
- Paul Coffman (pcoffman@anl.gov)
- Venkatram Vishwanath (venkat@anl.gov)
**Updates:**
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment