No article text was recorded for this version.
server-side dynamic batching
Version 1 of 111 papers18 conceptsfrozen 2026-10-04
Papers in this version
- Blog: GPU coprocessors as a service for deep learning inference in high energy physics
- Blog: Torpor: GPU-Enabled Serverless Computing for Low-Latency, Resource-Efficient Inference
- Blog: GPU-accelerated machine learning inference as a service for computing in neutrino experiments
- Blog: A Queueing Theoretic Perspective on Low-Latency LLM Inference with Variable Token Length
- Blog: RoutIR: Fast Serving of Retrieval Pipelines for Retrieval-Augmented Generation
- Blog: Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRA
- Blog: BATON: Enhancing Batch-wise Inference Efficiency for Large Language Models via Dynamic Re-batching
- Blog: Cavs: An Efficient Runtime System for Dynamic Neural Networks
- Blog: Fiddler: CPU-GPU Orchestration for Fast Inference of Mixture-of-Experts Models
- Blog: VER: Scaling On-Policy RL Leads to the Emergence of Navigation in Embodied Rearrangement
- Blog: SEED RL: Scalable and Efficient Deep-RL with Accelerated Central Inference
History & citation
Current · Permanent link
- This direction split from Dynamic Batching for High Throughput Machine Learning Inference (55% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_server_side_dynamic_batching_22f81e21,
title = {server-side dynamic batching},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/server-side-dynamic-batching/rdr_22f81e21f79c4a3caf2e8522c2190413},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_server_side_dynamic_batching_22f81e21_v1,
title = {server-side dynamic batching},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/server-side-dynamic-batching/rdr_22f81e21f79c4a3caf2e8522c2190413/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}