GitLab maintenance scheduled for Today, 2020-08-11, from 17:00 to 18:00 CT - Services will be unavailable during this time.

ChangeLog 7.49 KB
Newer Older
1 2 3
--------------------------
Darshan Release Change Log
--------------------------
4

5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22
darshan-2.2.0
=============
* split darshan into separate packages:
  - darshan-runtime: for runtime instrumentation
  - darshan-utils: for processing darshan log files
* changed default output file name for darshan-job-summary.pl to be based on
  input file name rather than summary.pdf
* reorganized init and finalize routines so that can be linked separately (to
  allow for easier integration with other instrumentation tools)
* add -cc, -cxx, -f77, -f90, and -fc support to compiler scripts generated by
  the darshan-gen-*.pl scripts
* bug fixes:
  - potential MAX_BYTE overflow on 32 bit systems
  - incorrect pread and pwrite offset tracking
  - corrections to darshan-job-summary variance table
  - better runtime error handling if bzip or gnuplot tools are insufficient
  - improvements to time range in darshan-job-summary graphs

23 24 25 26 27
darshan-2.1.2
=============
* improved error handling when writing log files.  If a write fails then the
  log file will be deleted and a warning will be printed to stderr.

28
darshan-2.1.1
29
=============
Philip Carns's avatar
Philip Carns committed
30 31 32 33 34 35 36 37 38
* new darshan-convert command line utility for converting existing log files,
  with optional anonymization and optional bzip2 compression
* bzip2 support in command line utilities (but not in the darshan library
  itself)
* updated log file format that allows for string key/value pairs to be stored
  in the header
* added ability to set MPI-IO hints when writing darshan log
  at configure time: --with-log-hints
  at run time: DARSHAN_LOGHINTS environment variable
39 40
* bug fix contributed by Sandra Schröder: use case-insensitive search for MPI
  symbols in Fortran wrapper script
Philip Carns's avatar
Philip Carns committed
41 42
* performance bug fix: remove unecessary call to MPI_File_set_size when
  writing log
43 44 45
* added --with-logpath-by-env configure option to allow absolute 
  log path to be specified via environment variable

46 47 48 49 50 51 52 53 54 55 56
darshan-2.1.0
=============
* additinoal environment variables to control log, jobid and
  alignment parameters
* additional configure tests to improve portability
* bug fixes for darshan-parser --perf calucations
* support for MPI1.x
* support for OpenMPI
* support for PGI, Intel compilers
* new libdarshan.so dynamic library for use with LD_PRELOAD

57 58 59 60 61 62 63 64 65 66 67 68 69
darshan-2.0.2
=============
* added a random identifier to job logs (to avoid collisions from multiple
  application instances within a single scheduler job)
* improved installation and library path management for darshan-job-summary.pl
* improved error handling in darshan-job-summary.pl
* additional derived statistics categories for darshan-parser output:
    --all   : all sub-options are enabled
    --base  : darshan log field data [default]
    --file  : total file counts
    --perf  : derived perf data
    --total : aggregated darshan field data

70 71
darshan-2.0.1
=============
72 73 74
* bug fix to variance/minimum calculations on shared files
* switch to automatic generation of all MPI compiler scripts using
  darshan-gen-* tools
75 76 77 78
* new run time environment variable: DARSHAN_INTERNAL_TIMING.  If set at job
  execution time, it will cause Darshan to time its own internal data 
  aggregation routines and print the results to stdout at rank 0.

79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94
darshan-2.0.0
=============
* new output file format that is portable across architectures
  NOTE: Darshan 1.x output files are incompatible with the tools in this 
  release unless they were generated on a ppc32 architecture (Blue Gene)
* 8 new counters that record the rank of the fastest and slowest process that
  opened each shared file, along with the number of seconds and number of
  bytes consumed by those processes.  It also reports the variance in both
  time and amount of data.
* new --with-jobid-env configure argument to support recording job identifiers
  from different schedulers
* job ID is now recorded within the Darshan log in addition to in the file
  name
* darshan-job-summary.pl:
  * opens output files directly without using intermediate darshan-parser output
  * table showing data usage per file system
Philip Carns's avatar
Philip Carns committed
95
  * table showing I/O variance in shared files
96 97 98
* Fixes for bugs reported by Noah Watkins: 
  * avoid name collision in hashing function
  * divide by zero error in darshan-job-summary.pl
99

100 101 102 103
darshan-1.1.14
==============
* fixed erroneous incompatibility warning when opening old logs in darshan-parser

104 105 106 107
darshan-1.1.13
==============
* updated compiler scripts to fix link order in some cases with -lhdf5

108 109 110 111 112 113 114
darshan-1.1.12
==============
* improved mapping of file records to mount points
* new page in darshan-job-summary.pl output showing timelines of file access
* bug fix to "fast" mpif90 script
* checkpoint/restart ability in parallel fsstats script

Philip Carns's avatar
Philip Carns committed
115 116 117 118 119
darshan-1.1.11
==============
* Bug fix for lseek, pread, and pwrite when used in 32 applications without large file support
* Improved experimental darshan-gen-cc.pl script
* Added new experimental darshan-gen-cxx.pl script
120

121 122 123 124 125
darshan-1.1.10
==============
* Bug fix for files that are accessed with stat() but never opened
* Workaround zlib problems with 64 bit offsets on 32 bit architectures

126 127 128 129 130 131 132
darshan-1.1.9
=============
* Added "fast" version of each BG/P compiler
* Added experimental scripts in test directory to run fsstats in parallel
* Kevin Harms: Added experimental utilities for loading darshan results into SQL
* Use exclusive flag when opening output file (to protect against file name collision)
* Rob Ross: updates to allow command line tools to build on Darwin
133
* Bug fix for pnetcdf configure problem reported by Rob Latham; darshan now always pulls in MPI_Wtime() symbol at link time
134

135 136 137
darshan-1.1.8
=============
* Added tracking of file system type and mount point for each file
138 139 140
* Added tracking of file size at open time (CP_SIZE_AT_OPEN)
* Moved sync cost to be counted in cumulative write time rather than cumulative metadata time
* Added sync as a separate category in darshan-job-summar.pl counters
141 142 143 144 145 146
* Bug fix to most frequent access size table in darshan-job-summary.pl
* Converted all utilities to use darshan-logutils api for reading output files
* Added backwards compatibility to darshan-logutils routines
* Kevin Harms: Added darshan-analyzer utility to summarize usage of MPI-IO, pNetCDF, HDF5, and shared files across a set of output files
* Fixed bug field listing for darshan-diff utility

147 148 149 150
darshan-1.1.7
=============
* Minor fix for a compile warning

151 152 153 154
darshan-1.1.6
=============
* Kevin Harms: bug fix for segfault in apps that use MPI_Init_thread()

155 156 157 158 159
darshan-1.1.5
=============
* Limit PMPI usage in library to fewer functions
* Update PMPI detection in compiler scripts to ignore functions unused by Darshan

Philip Carns's avatar
Philip Carns committed
160 161 162 163 164 165 166 167 168 169
darshan-1.1.4
=============
* Track files opened via Parallel NetCDF
* Track files opened via HDF5
* Record slowest individual POSIX read and write times along with access size for those operations
* Inspect symbols at compile time to determine whether to enable Darshan or not based on the presence of MPI and PMPI symbols
* Use GNU and IBM compilers from path rather than hard coded location
* Simplify warning message if unable to open log file
* Remove unused internal benchmark routines

Philip Carns's avatar
Philip Carns committed
170 171 172 173
darshan-1.1.3
=============
* Updated compiler scripts for V1R4 driver on BlueGene/P

174 175 176 177
darshan-1.1.2
=============
* Added *_r versions of each IBM compiler script on BlueGene/P

178 179 180 181 182 183 184 185 186
darshan-1.1.1
=============
* Set default permissions to 0400 (user read only) for output files
* Automatically disable Darshan at link time if common PMPI libraries are detected in the command line
* Experimental tool (darshan-gen-cc.pl) to automatically generate Darshan-enabled mpicc scripts

darshan-1.1.0
=============
* Initial public release