No article text was recorded for this version.
vanishing gradient problem (long-term dependency learning)
Version 2 of 2392 papers409 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
- Blog: Liquid Structural State-Space Models
- Blog: Target Propagation in Recurrent Neural Networks
- Blog: Analyzing and Exploiting NARX Recurrent Neural Networks for Long-Term Dependencies
- Blog: Analyzing and Exploiting NARX Recurrent Neural Networks for Long-Term Dependencies
- Blog: Investigating Backpropagation Alternatives when Learning to Dynamically Count with Recurrent Neural Networks
- Blog: High Order Recurrent Neural Networks for Acoustic Modelling
- Blog: A bio-inspired bistable recurrent cell allows for long-lasting memory
- Blog: On the difficulty of training recurrent neural networks
- Blog: A Comparative Exploration of BERT, RNN, and GRU for Sentiment Classification
- Blog: Understanding the exploding gradient problem
- Blog: Brundlefly at SemEval-2016 Task 12: Recurrent Neural Networks vs. Joint Inference for Clinical Temporal Information Extraction
- Blog: Dilated Convolutions for Modeling Long-Distance Genomic Dependencies
- Blog: Diffusion of Context and Credit Information in Markovian Models
- Blog: Towards Non-Saturating Recurrent Units for Modelling Long-Term Dependencies
- Blog: Learning representations for multivariate time series with missing data using Temporal Kernelized Autoencoders
- Blog: Modeling systems with internal state using evolino
- Blog: Recurrent Neural Networks for Learning Long-term Temporal Dependencies with Reanalysis of Time Scale Representation
- Blog: Enhanced Real-Time Threat Detection in 5G Networks: A Self-Attention RNN Autoencoder Approach for Spectral Intrusion Analysis
- Blog: Warming up recurrent neural networks to maximise reachable multistability greatly improves learning
- Blog: A Grammar-Based Structural CNN Decoder for Code Generation
- Blog: Tracking domain knowledge in Chinese language education based on graph neural networks
- Blog: Temporal Convolutional Networks and Dynamic Time Warping can Drastically Improve the Early Prediction of Sepsis
- Blog: Prediction of Sea Surface Temperature Using Long Short-Term Memory
- Blog: DeepVecFont-v2: Exploiting Transformers to Synthesize Vector Fonts with Higher Quality
- Blog: Quantifying the vanishing gradient and long distance dependency problem in recursive neural networks and recursive LSTMs
- Blog: Revisiting NARX Recurrent Neural Networks for Long-Term Dependencies
- Blog: Generating Text with Recurrent Neural Networks
- Blog: Hierarchical Recurrent Neural Encoder for Video Representation with Application to Captioning
- Blog: Gating Revisited: Deep Multi-layer RNNs That Can Be Trained
- Blog: GAT-DNS: DNS Multivariate Time Series Prediction Model Based on Graph Attention Network
- Blog: Recognizing Long Grammatical Sequences Using Recurrent Networks Augmented With An External Differentiable Stack
- Blog: Sequence Modeling using Gated Recurrent Neural Networks
- Blog: Unfolded Deep Recurrent Convolutional Neural Network with Jump Ahead Connections for Acoustic Modeling
- Blog: Learning long-term dependencies is not as difficult with NARX networks
- Blog: Convolutional Image Captioning
- Blog: Long Short-Term Memory Over Recursive Structures
- Blog: Learning long-term dependencies with gradient descent is difficult
- Blog: A Read-Write Memory Network for Movie Story Understanding
- Blog: Attention mechanism enhanced LSTM with residual architecture and its application for protein-protein interaction residue pairs prediction
- Blog: Learning by Directional Gradient Descent
- Blog: Refined Gate: A Simple and Effective Gating Mechanism for Recurrent Units
- Blog: Semantic Modelling with Long-Short-Term Memory for Information Retrieval
- Blog: LSTBM: A Novel Sequence Representation of Speech Spectra Using Restricted Boltzmann Machine with Long Short-Term Memory
- Blog: Confining Pressure Forecasting of Shield Tunnel Lining Based on GRU Model and RNN Model
- Blog: Gated Orthogonal Recurrent Units: On Learning to Forget
- Blog: Gated Residual Recurrent Graph Neural Networks for Traffic Prediction
- Blog: Scene Text Recognition with Temporal Convolutional Encoder
- Blog: LSTM Networks for Music Generation
- Blog: Agent-State Construction with Auxiliary Inputs
- Blog: PredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learning
- Blog: Semi-Supervised Adaptation of RNNLMs by Fine-Tuning with Domain-Specific Auxiliary Features
- Blog: Benchmarking Quantum and Classical Sequential Models for Urban Telecommunication Forecasting
- Blog: Incremental Training of a Recurrent Neural Network Exploiting a Multi-Scale Dynamic Memory
- Blog: Complexity-calibrated Benchmarks for Machine Learning Reveal When Next-Generation Reservoir Computer Predictions Succeed and Mislead
- Blog: A Unified Tagging Solution: Bidirectional LSTM Recurrent Neural Network with Word Embedding
- Blog: Research on Unstructured Text Data Mining and Fault Classification Based on RNN-LSTM with Malfunction Inspection Report
- Blog: The Statistical Recurrent Unit
- Blog: Constructing Gradient Controllable Recurrent Neural Networks Using\n Hamiltonian Dynamics
- Blog: Cached Long Short-Term Memory Neural Networks for Document-Level Sentiment Classification
Showing 60 of 392 papers.
History & citation
Current · Permanent link
- Spectral Regulation for Stable Recurrent Dynamics merged into this direction (53% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_vanishing_gradient_problem_long_term_dep_b04573c4,
title = {vanishing gradient problem (long-term dependency learning)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/vanishing-gradient-problem-long-term-dependency-learning/rdr_b04573c486024857bd671a0b05e46c1f},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 2, frozen text):
@misc{lacuna_vanishing_gradient_problem_long_term_dep_b04573c4_v2,
title = {vanishing gradient problem (long-term dependency learning)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/vanishing-gradient-problem-long-term-dependency-learning/rdr_b04573c486024857bd671a0b05e46c1f/v/2},
note = {Version 2, frozen 2026-10-04. Accessed 2026-11-20},
}