No article text was recorded for this version.
inference latency constraints
Version 1 of 1120 papers127 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Comparative Analysis of Large Language Models for Context-Aware Code Completion using SAFIM Framework
- Blog: Toward Interactive Dictation
- Blog: Efficient Neural Query Auto Completion
- Blog: When Large Language Models Meet Speech: A Survey on Integration Approaches
- Blog: Sequential Neural Networks for Noetic End-to-End Response Selection
- Blog: A Unified Approach to Nested and Non-Nested Slots for Spoken Language Understanding
- Blog: Precise N-Gram Probabilities from Stochastic Context-Free Grammars
- Blog: A New Generation of Perspective API: Efficient Multilingual Character-level Transformers
- Blog: Transformation-based learning for semantic parsing
- Blog: Generative Speech Recognition Error Correction with Large Language Models and Task-Activating Prompting
- Blog: Multi-teacher Distillation for Multilingual Spelling Correction
- Blog: Low-Resource Compositional Semantic Parsing with Concept Pretraining
- Blog: Discovering Better Model Architectures for Medical Query Understanding
- Blog: Semantic Ads Retrieval at Walmart eCommerce with Language Models Progressively Trained on Multiple Knowledge Domains
- Blog: Towards Boosting LLMs-driven Relevance Modeling with Progressive Retrieved Behavior-augmented Prompting
- Blog: AutoADR: Automatic Model Design for Ad Relevance
- Blog: A Two-Stage Prediction-Aware Contrastive Learning Framework for Multi-Intent NLU
- Blog: CFO: A Framework for Building Production NLP Systems
- Blog: Two-Pass Low Latency End-to-End Spoken Language Understanding
- Blog: Leveraging Large Language Models for Integrated Satellite-Aerial-Terrestrial Networks: Recent Advances and Future Directions
- Blog: Fast Inference from Transformers via Speculative Decoding
- Blog: Practical Edge Detection via Robust Collaborative Learning
- Blog: SONAR: A Synthetic AI-Audio Detection Framework and Benchmark
- Blog: DUN: Dual-Path Temporal Matching Network for Natural Language-Based Vehicle Retrieval
- Blog: Model Compression with Two-stage Multi-teacher Knowledge Distillation for Web Question Answering System
- Blog: CCBERT: Self-Supervised Code Change Representation Learning
- Blog: A Comparison of Deep Learning Methods for Language Understanding
- Blog: CodeGemma: Open Code Models Based on Gemma
- Blog: Cascade RNN-Transducer: Syllable Based Streaming On-device Mandarin Speech Recognition with a Syllable-to-Character Converter
- Blog: Toward Interactive Dictation
- Blog: A Flexible, Efficient and Accurate Framework for Community Question Answering Pipelines
- Blog: A Word is Worth 4-bit: Efficient Log Parsing with Binary Coded Decimal Recognition
- Blog: Greedy Flipping for Constrained Word Deletion
- Blog: Copilot Arena: A Platform for Code LLM Evaluation in the Wild
- Blog: DynaVis: Dynamically Synthesized UI Widgets for Visualization Editing
- Blog: KV Pareto: Systems-Level Optimization of KV Cache and Model Compression for Long Context Inference
- Blog: How ChatGPT is Robust for Spoken Language Understanding?
- Blog: Improving Intent Classification in an E-commerce Voice Assistant by Using Inter-Utterance Context
- Blog: Human I/O: Towards a Unified Approach to Detecting Situational Impairments
- Blog: Can Relevance Feedback, Conversational Search and Foundation Models Work Together for Interactive Video Search and Exploration?
- Blog: aiXcoder-7B: A Lightweight and Effective Large Language Model for Code Completion
- Blog: INDUS: Effective and Efficient Language Models for Scientific Applications
- Blog: Learning LLM Preference over Intra-Dialogue Pairs: A Framework for Utterance-level Understandings
- Blog: Xavier: Toward Better Coding Assistance in Authoring Tabular Data Wrangling Scripts
- Blog: DispatchQA: A Benchmark for Small Function Calling Language Models in E-Commerce Applications
- Blog: Correcting Chinese Spelling Errors with Phonetic Pre-training
- Blog: Massively Multilingual Natural Language Understanding 2022 (MMNLU-22) Workshop and Competition
- Blog: A Diverse and Effective Retrieval-Based Debt Collection System with Expert Knowledge
- Blog: Knowledge Distillation from Internal Representations
- Blog: Distilling Multilingual Transformers into CNNs for Scalable Intent Classification
- Blog: A Study of All-Convolutional Encoders for Connectionist Temporal Classification
- Blog: Hybrid Retrieval-Augmented Generation for Real-time Composition Assistance
- Blog: Zero-shot Slot Filling in the Age of LLMs for Dialogue Systems
- Blog: When does text prediction benefit from additional context? An exploration of contextual signals for chat and email messages
- Blog: A Real-World Human-Machine Interaction Platform in Insurance Industry
- Blog: Domain-aware Neural Language Models for Speech Recognition
- Blog: Discriminative Transfer Learning for Optimizing ASR and Semantic Labeling in Task-Oriented Spoken Dialog
- Blog: A Fast, Compact, Accurate Model for Language Identification of Codemixed Text
- Blog: Plots Made Quickly: An Efficient Approach for Generating Visualizations from Natural Language Queries
- Blog: No Need to Pay Attention: Simple Recurrent Neural Networks Work!
Showing 60 of 120 papers.
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_inference_latency_constraints_bdabaf63,
title = {inference latency constraints},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/inference-latency-constraints/rdr_bdabaf632abc413398a695cb0014f432},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_inference_latency_constraints_bdabaf63_v1,
title = {inference latency constraints},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/inference-latency-constraints/rdr_bdabaf632abc413398a695cb0014f432/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}