No article text was recorded for this version.
orthogonal weight constraints
Version 1 of 127 papers29 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Deeply Shared Filter Bases for Parameter-Efficient Convolutional Neural Networks
- Blog: Better Training using Weight-Constrained Stochastic Dynamics
- Blog: CWY Parametrization: a Solution for Parallelized Optimization of Orthogonal and Stiefel Matrices
- Blog: Orthogonal Convolutional Neural Networks
- Blog: Deep Isometric Learning for Visual Recognition
- Blog: All You Need is Beyond a Good Init: Exploring Better Solution for Training Extremely Deep Convolutional Neural Networks with Orthonormality and Modulation
- Blog: Singular Value Perturbation and Deep Network Optimization
- Blog: Simple Orthogonal Graph Representation Learning (Student Abstract)
- Blog: Preventing Gradient Attenuation in Lipschitz Constrained Convolutional Networks
- Blog: Improving Training of Deep Neural Networks via Singular Value Bounding
- Blog: Stochastic Flows and Geometric Optimization on the Orthogonal Group
- Blog: projUNN: efficient method for training deep networks with unitary matrices
- Blog: Neural Photo Editing with Introspective Adversarial Networks
- Blog: Orthogonal Weight Normalization: Solution to Optimization Over Multiple Dependent Stiefel Manifolds in Deep Neural Networks
- Blog: CWY Parametrization for Scalable Learning of Orthogonal and Stiefel Matrices
- Blog: Unsupervised Energy-based Out-of-distribution Detection using Stiefel-Restricted Kernel Machine
- Blog: Proximity Variational Inference
- Blog: Large Scale GAN Training for High Fidelity Natural Image Synthesis
- Blog: Efficient Riemannian Optimization on the Stiefel Manifold via the Cayley Transform
- Blog: DP-SGD Without Clipping: The Lipschitz Neural Network Way
- Blog: Fine-Grained Emotion Classification of Chinese Microblogs Based on Graph Convolution Networks
- Blog: Better Training using Weight-Constrained Stochastic Dynamics
- Blog: NCVX: A General-Purpose Optimization Solver for Constrained Machine and Deep Learning
- Blog: Local Linear Convergence of Infeasible Optimization with Orthogonal Constraints
- Blog: Deep Feedback Models
- Blog: What if Neural Networks had SVDs?
- Blog: Towards Training Without Depth Limits: Batch Normalization Without Gradient Explosion
History & citation
Current · Permanent link
- This direction split from Orthogonality Regularization for Stable and Low Rank Neural Networks (70% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_orthogonal_weight_constraints_489d8c9b,
title = {orthogonal weight constraints},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/orthogonal-weight-constraints/rdr_489d8c9b713242bbbdc54b16eeb72284},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-19},
}This exact version (version 1, frozen text):
@misc{lacuna_orthogonal_weight_constraints_489d8c9b_v1,
title = {orthogonal weight constraints},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/orthogonal-weight-constraints/rdr_489d8c9b713242bbbdc54b16eeb72284/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-19},
}