Dynamic I/O Budget Reallocation For In Situ Wavelet Compression

Simple item page
dc.contributor.authorMarsaglia, Nicole J.en_US
dc.contributor.authorLi, Shaomengen_US
dc.contributor.authorBelcher, Kristien_US
dc.contributor.authorLarsen, Matthewen_US
dc.contributor.authorChilds, Hanken_US
dc.contributor.editorChilds, Hank and Frey, Steffenen_US
dc.date.accessioned2019-06-02T18:25:45Z
dc.date.available2019-06-02T18:25:45Z
dc.date.issued2019
dc.description.abstractIn situ wavelet compression is a potential solution for enabling post hoc visualization on supercomputers with slow I/O systems. While this in situ compression is typically accomplished by allocating an equal storage budget to each parallel process, we propose an adaptive approach. With our approach, we introduce an assessment step prior to compression, where each process characterizes the variation in its portion of the data, and then dynamically adapts storage budgets to the processes with the most variation. We conducted experiments comparing our adaptive approach with the traditional, non-adaptive approach, on two different simulation codes with concurrencies of 512 cores and mesh resolutions of one billion cells. Our findings show that our adaptive approach yields three orders of magnitude of improvement for one simulation and is not harmful for the other.en_US
dc.description.sectionheadersSession 1
dc.description.seriesinformationEurographics Symposium on Parallel Graphics and Visualization
dc.identifier.doi10.2312/pgv.20191104
dc.identifier.isbn978-3-03868-079-6
dc.identifier.issn1727-348X
dc.identifier.pages1-5
dc.identifier.urihttps://doi.org/10.2312/pgv.20191104
dc.identifier.urihttps://diglib.eg.org:443/handle/10.2312/pgv20191104
dc.publisherThe Eurographics Associationen_US
dc.titleDynamic I/O Budget Reallocation For In Situ Wavelet Compressionen_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
001-005.pdf
Size:
610.57 KB
Format:
Adobe Portable Document Format
Download
Collections
EGPGV19: Eurographics Symposium on Parallel Graphics and Visualization