No article text was recorded for this version.
head-of-line blocking
Version 1 of 128 papers31 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Queue Management for SLO-Oriented Large Language Model Serving
- Blog: Characterization and Prediction of Deep Learning Workloads in Large-Scale GPU Datacenters
- Blog: A Queueing Theoretic Perspective on Low-Latency LLM Inference with Variable Token Length
- Blog: MAPS: Memory-Aware Predictive Scheduling Framework for Large Language Model Serving
- Blog: Enabling Efficient Batch Serving for LMaaS via Generation Length Prediction
- Blog: EdgeLoRA: An Efficient Multi-Tenant LLM Serving System on Edge Devices
- Blog: AugServe: Adaptive Request Scheduling for Augmented Large Language Model Inference Serving
- Blog: OSMOSIS: Enabling Multi-Tenancy in Datacenter SmartNICs
- Blog: HeraSys: Collaborative Serving of Multiple LLM Workflows via Fine-Grained End-to-End Optimization
- Blog: ALISE: Accelerating Large Language Model Serving with Speculative Scheduling
- Blog: HyGen: Efficient LLM Serving via Elastic Online-Offline Request Co-location
- Blog: Fast Inference for Augmented Large Language Models
- Blog: ConServe: Fine-Grained GPU Harvesting for LLM Online and Offline Co-Serving
- Blog: Scheduling Deep Learning Jobs in Multi-Tenant GPU Clusters via Wise Resource Sharing
- Blog: Continuum: Efficient and Robust Multi-Turn LLM Agent Scheduling with KV Cache Time-to-Live
- Blog: Héron: Taming Tail Latencies in Key-Value Stores Under Heterogeneous Workloads
- Blog: Efficient LLM Scheduling by Learning to Rank
- Blog: Zero Queueing for Multi-Server Jobs
- Blog: DON’T STOP ME NOW: EMBEDDING BASED SCHEDULING FOR LLMS
- Blog: Fine-Grained GPU Sharing Primitives for Deep Learning Applications
- Blog: SOLA: Optimizing SLO Attainment for Large Language Model Serving with State-Aware Scheduling
- Blog: Scheduling LLM Inference with Uncertainty-Aware Output Length Predictions
- Blog: Beyond Prediction: Tail-Aware Scheduling for LLM Inference
- Blog: Priority-Aware Preemptive Scheduling for Mixed-Priority Workloads in MoE Inference
- Blog: EWSJF: An Adaptive Scheduler with Hybrid Partitioning for Mixed-Workload LLM Inference
- Blog: RT-LM: Uncertainty-Aware Resource Management for Real-Time Inference of Language Models
- Blog: Apt-Serve: Adaptive Request Scheduling on Hybrid Cache for Scalable LLM Inference Serving
- Blog: Queues with Small Advice
History & citation
Current · Permanent link
- This direction split from Preemptive and Predictive Scheduling for LLM Serving (82% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_head_of_line_blocking_aac4103f,
title = {head-of-line blocking},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/head-of-line-blocking/rdr_aac4103f9c4c47e8831e9fbaef906983},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-19},
}This exact version (version 1, frozen text):
@misc{lacuna_head_of_line_blocking_aac4103f_v1,
title = {head-of-line blocking},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/head-of-line-blocking/rdr_aac4103f9c4c47e8831e9fbaef906983/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-19},
}