No article text was recorded for this version.
memory wall (hardware memory constraints)
Version 1 of 149 papers51 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Large Scale Distributed Deep Networks
- Blog: FuncPipe: A Pipelined Serverless Framework for Fast and Cost-efficient Training of Deep Learning Models
- Blog: Database Meets Deep Learning: Challenges and Opportunities
- Blog: Pinpointing the Memory Behaviors of DNN Training
- Blog: Scaling Distributed Deep Learning Workloads beyond the Memory Capacity with KARMA
- Blog: Efficient Algorithms for Device Placement of DNN Graph Operators
- Blog: Cost-Efficient LLM Training with Lifetime-Aware Tensor Offloading via GPUDirect Storage
- Blog: Winning the Lottery Ahead of Time: Efficient Early Network Pruning
- Blog: ZeroSearch: Incentivize the Search Capability of LLMs without Searching
- Blog: AxoNN: An asynchronous, message-driven parallel framework for extreme-scale deep learning
- Blog: A Survey: Collaborative Hardware and Software Design in the Era of Large Language Models
- Blog: Klotski: Efficient Mixture-of-Expert Inference via Expert-Aware Multi-Batch Pipeline
- Blog: G10: Enabling An Efficient Unified GPU Memory and Storage Architecture with Smart Tensor Migrations
- Blog: FlexQuant: A Flexible and Efficient Dynamic Precision Switching Framework for LLM Quantization
- Blog: BasisN: Reprogramming-Free RRAM-Based In-Memory-Computing by Basis Combination for Deep Neural Networks
- Blog: SuperNeurons: Dynamic GPU Memory Management for Training Deep Neural Networks
- Blog: A Computational-Graph Partitioning Method for Training Memory-Constrained DNNs
- Blog: Beyond human-level accuracy: computational challenges in deep learning
- Blog: ZeRO-Offload: Democratizing Billion-Scale Model Training
- Blog: Pre-gated MoE: An Algorithm-System Co-Design for Fast and Scalable Mixture-of-Expert Inference
- Blog: Mixed Precision Training
- Blog: Easy and Efficient Transformer: Scalable Inference Solution For Large NLP Model
- Blog: ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning
- Blog: MODeL: Memory Optimizations for Deep Learning
- Blog: SpecExec: Massively Parallel Speculative Decoding For Interactive LLM Inference on Consumer Devices
- Blog: ZeRO: memory optimizations toward training trillion parameter models
- Blog: Optimizing Distributed Training on Frontier for Large Language Models
- Blog: Adam Accumulation to Reduce Memory Footprints of both Activations and Gradients for Large-scale DNN Training
- Blog: Overcoming barriers to scalability in variational quantum Monte Carlo
- Blog: Compressing DMA Engine: Leveraging Activation Sparsity for Training Deep Neural Networks
- Blog: Ouroboros: On Accelerating Training of Transformer-Based Language Models
- Blog: Merak: An Efficient Distributed DNN Training Framework with Automated 3D Parallelism for Giant Foundation Models
- Blog: Angel-PTM: A Scalable and Economical Large-scale Pre-training System in Tencent
- Blog: Memory safe computations with XLA compiler
- Blog: Local Critic Training for Model-Parallel Learning of Deep Neural Networks
- Blog: Exploiting Intel Advanced Matrix Extensions (AMX) for Large Language Model Inference
- Blog: Efficient Combination of Rematerialization and Offloading for Training DNNs
- Blog: Training and Serving System of Foundation Models: A Comprehensive Survey
- Blog: HAS-GPU: Efficient Hybrid Auto-scaling with Fine-Grained GPU Allocation for SLO-Aware Serverless Inferences
- Blog: Deep Generative Models that Solve PDEs: Distributed Computing for Training Large Data-Free Models
- Blog: Automatic Graph Partitioning for Very Large-scale Deep Learning
- Blog: NeuZip: Memory-Efficient Training and Inference with Dynamic Compression of Neural Networks
- Blog: Zico: Efficient GPU Memory Sharing for Concurrent DNN Training
- Blog: Training Behavior of Sparse Neural Network Topologies
- Blog: Whale: Efficient Giant Model Training over Heterogeneous GPUs
- Blog: Supporting Very Large Models using Automatic Dataflow Graph Partitioning
- Blog: Flexible and Efficient Systems for Training Emerging Deep Neural Networks
- Blog: Survey on Efficient Training of Large Neural Networks
- Blog: SSDTrain: An Activation Offloading Framework to SSDs for Faster Large Language Model Training
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_memory_wall_hardware_memory_constraints_0f9247eb,
title = {memory wall (hardware memory constraints)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/memory-wall-hardware-memory-constraints/rdr_0f9247ebf6eb4d288c54f3e8b7b83d6e},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-22},
}This exact version (version 1, frozen text):
@misc{lacuna_memory_wall_hardware_memory_constraints_0f9247eb_v1,
title = {memory wall (hardware memory constraints)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/memory-wall-hardware-memory-constraints/rdr_0f9247ebf6eb4d288c54f3e8b7b83d6e/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-22},
}