ICML 2024

2,660 papers

Top Research Directions

Research directions most represented by ICML 2024 papers.

Overcoming the Iterative Inference Latency of Diffusion Models 24
Safe Reinforcement Learning via Constrained Markov Decision Processes 21
The Non-Linear Function Approximation Gap in Reinforcement Learning 21
Sample Efficient Reinforcement Learning 21
Clean Accuracy Degradation in Machine Learning Defenses 21
Overcoming the Homophily Assumption in Graph Neural Networks 18
The Mechanics of Backdoor Attacks in Neural Networks 17
The Weisfeiler Lehman Expressivity Bottleneck 16
The Function Approximation Gap in Reinforcement Learning Theory 16
Mitigating Gradient Variance in Policy Optimization 14
Matrix-Free Curvature Estimation for Deep Learning 14
Optimization and Generalization with Non-Smooth Activations 14
Accelerating Sparse Neural Networks on Dense Hardware 14
Scaling Gaussian Processes Beyond Cubic Complexity 14
Bypassing the Computational Bottleneck of Adversarial Training 14

Top Authors

AuthorPapers
Bo Li12
James Y. Zou12
Jianye HAO12
Pin-Yu Chen11
Tongliang Liu11
James Zou10
Junchi Yan10
Sergey Levine10
Stan Z. Li10
Volkan Cevher10
Zhangyang Wang10
Dacheng Tao9
Furong Huang9
Rongrong Ji9
Taiji Suzuki9
Andrew Gordon Wilson8
Bo Han8
David Woodruff8
Dawn Song8
De-Chuan Zhan8

Impactful Papers

Papers from ICML 2024 that shaped research clusters.

Foundational

Influential

Papers

Title
VideoPrism: A Foundational Visual Encoder for Video Understanding
video-SALMONN: Speech-Enhanced Audio-Visual Large Language Models
Viewing Transformers Through the Lens of Long Convolutions Layers
VinT-6D: A Large-Scale Object-in-hand Dataset from Vision, Touch and Proprioception
ViP: A Differentially Private Foundation Model for Computer Vision
VisionGraph: Leveraging Large Multimodal Models for Graph Theory Problems in Visual Context
Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model
Vision Transformers as Probabilistic Expansion from Learngene
Visual Representation Learning with Stochastic Frame Prediction
Visual-Text Cross Alignment: Refining the Similarity Score in Vision-Language Models
Visual Transformer with Differentiable Channel Selection: An Information Bottleneck Inspired Approach
VNN: Verification-Friendly Neural Networks with Hard Robustness Guarantees
Vocabulary for Universal Approximation: A Linguistic Perspective of Mapping Compositions
VoroNav: Voronoi-based Zero-shot Object Navigation with Large Language Model
VQDNA: Unleashing the Power of Vector Quantization for Multi-Species Genomic Sequence Modeling
WARM: On the Benefits of Weight Averaged Reward Models
Wasserstein Wormhole: Scalable Optimal Transport Distance with Transformer
Watermarks in the Sand: Impossibility of Strong Watermarking for Language Models
Watermark Stealing in Large Language Models
WAVES: Benchmarking the Robustness of Image Watermarks
Weakly Convex Regularisers for Inverse Problems: Convergence of Critical Points and Primal-Dual Optimisation
Weakly-Supervised Residual Evidential Learning for Multi-Instance Uncertainty Estimation
Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervision
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue
Weighted distance nearest neighbor condensing
Weisfeiler-Leman at the margin: When more expressivity matters
Weisfeiler Leman for Euclidean Equivariant Machine Learning
What Can Transformer Learn with Varying Depth? Case Studies on Sequence Learning Tasks
What Improves the Generalization of Graph Transformers? A Theoretical Dive into the Self-attention and Positional Encoding
What is Dataset Distillation Learning?
What is the Long-Run Distribution of Stochastic Gradient Descent? A Large Deviations Analysis
What needs to go right for an induction head? A mechanistic study of in-context learning circuits and their formation
What's the score? Automated Denoising Score Matching for Nonlinear Diffusions
What’s the score? Automated Denoising Score Matching for Nonlinear Diffusions
What Will My Model Forget? Forecasting Forgotten Examples in Language Model Refinement
What Would Gauss Say About Representations? Probing Pretrained Image Models using Synthetic Gaussian Benchmarks
When and How Does In-Distribution Label Help Out-of-Distribution Detection?
When Do Skills Help Reinforcement Learning? A Theoretical Analysis of Temporal Abstractions
When is Transfer Learning Possible?
When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models
When Representations Align: Universality in Representation Learning Dynamics
When Will Gradient Regularization Be Harmful?
Which Frequencies do CNNs Need? Emergent Bottleneck Structure in Feature Learning
Whispering Experts: Neural Interventions for Toxicity Mitigation in Language Models
Why Do Animals Need Shaping? A Theory of Task Composition and Curriculum Learning
Why do Variational Autoencoders Really Promote Disentanglement?
Why Do You Grok? A Theoretical Analysis on Grokking Modular Addition
Why Larger Language Models Do In-context Learning Differently?
Winner-takes-all learners are geometry-aware conditional density estimators
WISER: Weak Supervision and Supervised Representation Learning to Improve Drug Response Prediction in Cancer

« prev Page 53/54 next »