Skip to main navigation Skip to search Skip to main content

AEflow (Autoencoder fluid flow compression network) [SWR-22-29]

Research output: Non-textual form › Software

Abstract

As the size of turbulent flow simulations continues to grow, in situ data compression is becoming increasingly important for visualization, analysis, and restart checkpointing. For these applications, single-pass compression techniques with low computational and communication overhead are crucial. In this paper we present a deep-learning approach to in situ compression using an autoencoder architecture that is customized for three-dimensional turbulent flows and is well suited for contemporary heterogeneous computing resources. The autoencoder is compared against a recently introduced randomized single-pass singular value decomposition (SVD) for three different canonical turbulent flows: decaying homogeneous isotropic turbulence, a Taylor-Green vortex, and turbulent channel flow. Our proposed fully convolutional autoencoder architecture compresses turbulent flow snapshots by a factor of 64 with a single pass, allows for arbitrarily sized input fields, is cheaper to compute than the randomized single-pass SVD for typical simulation sizes, performs well on unseen flow configurations, and has been made publicly available. The results reported here show that the autoencoder dramatically outperforms a randomized single-pass SVD with similar compression ratio and yields comparable performance to a higher-rank decomposition with an order of magnitude less compression in regard to preserving a number of important statistical quantities such as turbulent kinetic energy, enstrophy, and Reynolds stresses.
Original languageAmerican English
PublisherNational Laboratory of the Rockies (NLR)
DOIs
StatePublished - 2023

Other Report Number

  • SWR-22-29
  • 62413

License

  • Apache License 2.0

Programming Language

  • Python

Fingerprint

Dive into the research topics of 'AEflow (Autoencoder fluid flow compression network) [SWR-22-29]'. Together they form a unique fingerprint.

Cite this