Introduction
Traditional time series forecasting primarily focuses on point prediction—estimating the exact value of a variable at a future time step. However, in many industrial and financial applications, such as capacity planning or algorithmic trading, the underlying trend (characterized by slope and duration) is often more critical and less susceptible to high-frequency noise. Predicting these trends in multivariate settings presents significant challenges: temporal and spatial patterns are often deeply entangled, and the relationships between different time series can be highly dynamic.
Methodology: The DeepTrends Architecture
To address these challenges, we propose DeepTrends, a novel neural network architecture designed for multivariate trend forecasting. DeepTrends employs a dual-pathway approach to capture both long-term dependencies and short-term local fluctuations.
Tensorized LSTM with Adaptive Shared Memory (TLASM)
The core of DeepTrends is the TLASM module. Unlike standard LSTMs that collapse all variables into a single hidden state vector, TLASM represents the hidden state as a matrix (tensor). This "tensorization" preserves the individual dynamics of each time series. Furthermore, an Adaptive Shared Memory mechanism is introduced. Instead of static parameter sharing, an attention-based router dynamically determines how much information should be shared between different time series at each time step, effectively mitigating "negative transfer" between unrelated tasks.
Multi-task 1dCNN and Feature Fusion
While the TLASM handles long-term trend sequences, a parallel Multi-task 1dCNN extracts local features from raw data to account for sudden, short-term shifts. Finally, task-specific Multi-Layer Perceptrons (MLPs) fuse these long-term and short-term features to generate the final predictions for slope and duration.
Experimental Evaluation
The model was evaluated on three diverse multivariate datasets: Traffic (hourly road occupancy), Exchange-Rate (daily currency rates), and Solar-Power (high-frequency production records). DeepTrends was compared against seven baseline models, including standard recurrent and convolutional architectures, as well as TreNet, the previous state-of-the-art for univariate trend prediction.
Results and Discussion
Experimental results demonstrate that DeepTrends consistently outperforms all baselines, achieving the lowest Root Mean Square Error (RMSE) and Root Relative Squared Error (RRSE) across all datasets for both slope and duration prediction.
Ablation studies confirmed the necessity of each component: removing either the tensorized states or the local 1dCNN led to a significant drop in performance. Visual analysis of specific cases showed that DeepTrends successfully identifies trend reversals by leveraging long-term dependencies that simpler models overlook.
Conclusion
DeepTrends introduces a robust framework for multivariate trend forecasting by combining tensorized hidden states with adaptive information sharing. While the model exhibits superior accuracy, future work will address its increased computational complexity and explore its scalability to datasets with thousands of concurrent time series.
Summary updated