No article text was recorded for this version.
scientific data storage bottleneck
Version 2 of 2109 papers125 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Melissa: large scale in transit sensitivity analysis avoiding intermediate files
- Blog: Towards Specialized Supercomputers for Climate Sciences: Computational Requirements of the Icosahedral Nonhydrostatic Weather and Climate Model
- Blog: MDSuite: comprehensive post-processing tool for particle simulations
- Blog: The VOLNA-OP2 tsunami code (version 1.5)
- Blog: Interpolation of scientific image databases
- Blog: Approximate ad-hoc query engine for simulation data
- Blog: In Situ Statistical Analysis for Parametric Studies
- Blog: SimFS: A Simulation Data Virtualizing File System Interface
- Blog: Ten simple rules on how to create open access and reproducible molecular simulations of biological systems
- Blog: CEAZ: accelerating parallel I/O via hardware-algorithm co-designed adaptive lossy compression
- Blog: PCCM2: A GCM adapted for scalable parallel computers
- Blog: The framework for approximate queries on simulation data
- Blog: DCMS: A data analytics and management system for molecular simulation
- Blog: Generation of Belle II Pixel Detector Background Data with a GAN
- Blog: Super-resolution in Molecular Dynamics Trajectory Reconstruction with Bi-Directional Neural Networks
- Blog: Novel Data Reduction Based on Statistical Similarity
- Blog: LCP: Enhancing Scientific Data Management with Lossy Compression for Particles
- Blog: Dynamic Nested Tracking Graphs
- Blog: V2V: Scaling Event-Based Vision through Efficient Video-to-Voxel Simulation
- Blog: A fast input/output library for high-resolution climate models
- Blog: Trigger Detection for Adaptive Scientific Workflows Using Percentile Sampling
- Blog: FLARE: A Dataflow-Aware and Scalable Hardware Architecture for Neural-Hybrid Scientific Lossy Compression
- Blog: Z-checker: A Framework for Assessing Lossy Compression of Scientific Data
- Blog: SDRBench: Scientific Data Reduction Benchmark for Lossy Compressors
- Blog: Deep Learning-Enabled Supercritical Flame Simulation at Detailed Chemistry and Real-Fluid Accuracy Towards Trillion-Cell Scale
- Blog: Adaptive Configuration of In Situ Lossy Compression for Cosmology Simulations via Fine-Grained Rate-Quality Modeling
- Blog: Enhancing Lossy Compression Through Cross-Field Information for Scientific Applications
- Blog: Supporting correlation analysis on scientific datasets in parallel and distributed settings
- Blog: MDRepo—an open data warehouse for community-contributed molecular dynamics simulations of proteins
- Blog: InSituNet: Deep Image Synthesis for Parameter Space Exploration of Ensemble Simulations
- Blog: Continual learning autoencoder training for a particle-in-cell simulation via streaming
- Blog: Data Compression for the Exascale Computing Era - Survey
- Blog: FFEINR: Flow Feature-Enhanced Implicit Neural Representation for Spatio-temporal Super-Resolution
- Blog: In Situ Training of Implicit Neural Compressors for Scientific Simulations via Sketch-Based Regularization
- Blog: Einstein Fields: A Neural Perspective To Computational General Relativity
- Blog: Efficient Interpolation-based Pathline Tracing with B-spline Curves in Particle Dataset
- Blog: CFIO2: Overlapping Communications and I/O with Computations Using RDMA Technology
- Blog: A Framework for Automatic Validation and Application of Lossy Data Compression in Ensemble Data Assimilation
- Blog: Neural Stress Fields for Reduced-order Elastoplasticity and Fracture
- Blog: TAC+: Drastically Optimizing Error-Bounded Lossy Compression for 3D AMR Simulations
- Blog: Supplementary material to "Scalable Diagnostics and Data Compression for Global Atmospheric Chemistry using Ristretto Library (version 1.0)"
- Blog: Application of Wavelet Technique to False Vector Correction and Data Compression in PIV.
- Blog: Exploration of Pattern-Matching Techniques for Lossy Compression on Cosmology Simulation Data Sets
- Blog: Physics informed Neural Networks applied to the description of wave-particle resonance in kinetic simulations of fusion plasmas
- Blog: Near-global climate simulation at 1 km resolution: establishing a performance baseline on 4888 GPUs with COSMO 5.0
- Blog: FZ-GPU: A Fast and High-Ratio Lossy Compressor for Scientific Computing Applications on GPUs
- Blog: Einstein Fields: A Neural Perspective To Computational General Relativity
- Blog: ASC ATDM Level 2 Milestone #6358: Assess Status of Next Generation Components and Physics Models in EMPIRE
- Blog: Understanding GPU-Based Lossy Compression for Extreme-Scale Cosmological Simulations
- Blog: Asynchronous in Situ Processing with Gromacs: Taking Advantage of GPUs
- Blog: Compressing multidimensional weather and climate data into neural networks
- Blog: MGARD+: Optimizing Multilevel Methods for Error-Bounded Scientific Data Reduction
- Blog: InSituNet: Deep Image Synthesis for Parameter Space Exploration of Ensemble Simulations
- Blog: cuSZ-i: High-Ratio Scientific Lossy Compression on GPUs with Optimized Multi-Level Interpolation
- Blog: Huge ensembles – Part 2: Properties of a huge ensemble of hindcasts generated with spherical Fourier neural operators
- Blog: Framework for Interactive Million-Neuron Simulation
- Blog: AMRIC: A Novel In Situ Lossy Compression Framework for Efficient I/O in Adaptive Mesh Refinement Applications
- Blog: Unlocking massively parallel spectral proper orthogonal decompositions in the PySPOD package
- Blog: A Physics-Informed Vector Quantized Autoencoder for Data Compression of Turbulent Flow
- Blog: Design and implementation of "many parallel task" hybrid subsurface model
Showing 60 of 109 papers.
History & citation
Current · Permanent link
- in-transit data processing split from this direction (50% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_scientific_data_storage_bottleneck_ccdfb92d,
title = {scientific data storage bottleneck},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/scientific-data-storage-bottleneck/rdr_ccdfb92d025043079bdffd06d831b7ac},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-21},
}This exact version (version 2, frozen text):
@misc{lacuna_scientific_data_storage_bottleneck_ccdfb92d_v2,
title = {scientific data storage bottleneck},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/scientific-data-storage-bottleneck/rdr_ccdfb92d025043079bdffd06d831b7ac/v/2},
note = {Version 2, frozen 2026-10-04. Accessed 2026-11-21},
}