Calibration of Large Model Quantization based on HiFloat4 Format

Jing Huang, Yu Cheng, Ziwei Yu, Lan Zhao, Sitan Li, Guangxiu Yao, Xin Wang, Yuanyong Luo, Hengyi Liang, Ting Li, Bo Liu, Hu Liu, Michael Bi Mi, Heng Liao

TL;DR

This paper introduces three novel calibration methods—HiGPTQ, HiAutoRound, and HiFlatQuant—specifically designed for the HiFloat4 (HiF4) 4-bit quantization format. By adapting popular post-training quantization (PTQ) techniques to HiF4’s unique hierarchical structure, the authors reduce the accuracy gap between 4-bit models and their 16-bit counterparts to less than 1%, outperforming existing industry standards like NVFP4.

What Problem Does This Paper Address?

As Large Language Models (LLMs) grow, the pressure to compress them for deployment increases. Moving from 8-bit to 4-bit quantization can halve memory usage, but it often comes at a steep cost to model accuracy.

Standard 4-bit integer formats (like INT4) often struggle to represent the vast dynamic range of LLM weights and activations. To solve this, new formats like HiFloat4 (HiF4) have emerged. HiF4 uses a "Block Floating-Point" (BFP) approach with a three-level scaling hierarchy, allowing it to capture both tiny and huge values more effectively than simple integers.

However, existing calibration tools—the "fine-tuning" step that minimizes quantization error—were built for simple integer formats. They don't understand HiF4's complex, shared scaling structure. This paper bridges that gap by redesigning calibration algorithms to be "HiF4-aware."

Methods

The authors propose three distinct calibration strategies, each adapting a well-known PTQ algorithm to the HiF4 format:

  1. HiGPTQ: Based on the GPTQ algorithm, which uses second-order information (the Hessian matrix) to compensate for quantization errors. The "Hi" version modifies the process to quantize weights in groups of 64, matching HiF4’s shared scaling metadata (see Figure 2a).
  2. HiAutoRound: This method introduces learnable parameters to adjust how weights are rounded. Specifically, it learns offsets for the micro-exponents ($K$) and mantissas ($M$) within the HiF4 block to minimize the difference between the original and quantized outputs (see Figure 2b).
  3. HiFlatQuant: This approach learns affine transformations to "flatten" the distribution of weights and activations, making them easier to quantize without losing information to outliers. Interestingly, because HiF4 has a naturally large dynamic range, the authors found they could omit the complex "learnable clipping" required for integer formats, simplifying the process (see Figure 2c).
Figure 1: HiFloat4 Block Floating-Point (BFP) data struc- ture.

Datasets

The researchers evaluated their methods across five major LLM families (Llama2-7B/13B, Llama3-8B, and Qwen2.5-7B/14B) using a suite of standard benchmarks:

  • Common Sense & Reasoning: ARC-Challenge, ARC-Easy, BoolQ, HellaSwag, Piqa, and WinoGrande.
  • Language Modeling: Lambada (OpenAI version).
  • Calibration Data: A small subset (128 sentences) of the WikiText2 training set was used to calibrate the models.

Key Insights and Ideas

  • Hierarchy Matters: HiF4’s three-level scaling (Level-1 FP8, Level-2/3 micro-exponents) is inherently superior to 4-bit formats like MXFP4 and NVFP4 because it provides a much broader dynamic range.
  • Structural Alignment: Calibration isn't one-size-fits-all. For HiGPTQ to work, the quantization block size must be a multiple of the HiF4 group size (64). This ensures the shared scaling factors are derived from the same elements the algorithm is currently optimizing.
  • Outlier Resilience: One of the most interesting findings is that HiF4 is so robust to outliers that the "learnable clipping" parameters used in FlatQuant for INT4 are unnecessary. This reduces calibration complexity while maintaining high accuracy.
  • HiGPTQ is the All-Rounder: While all three methods improved performance, HiGPTQ generally provided the most consistent gains across different models and tasks (see Figure 3).
Table 3: Comparison of three calibration approaches

Key Results

The experimental results demonstrate a clear win for HiF4-based calibration:

  • Closing the Gap: Across all models, the proposed methods reduced the accuracy gap between 4-bit HiF4 and 16-bit BF16 to less than 1%.
  • Superiority over NVFP4: HiF4 calibrated with HiGPTQ outperformed the state-of-the-art NVFP4 format. For example, on Llama2-13B, HiGPTQ achieved an average accuracy of 73.86%, actually slightly surpassing the BF16 baseline of 73.71% in some instances.
  • Consistency: The improvements were not limited to one model; they were observed across Llama and Qwen architectures, proving the methods are generalizable.
Table 1: Experimental results on diverse models and tasks.

Limitations and Future Work

  • Inference Overhead: The paper notes that HiFlatQuant's performance depends on "transformation folding." If the learned transformations cannot be efficiently folded into existing layers, it could introduce inference latency.
  • Hardware Specifics: While the experiments were conducted on simulated 4-bit formats on Huawei Ascend NPUs, the paper does not provide extensive real-world wall-clock speedup data for diverse hardware targets.
  • PTQ vs. QAT: The study focuses entirely on Post-Training Quantization. Exploring how these hierarchical formats behave in Quantization-Aware Training (QAT) remains an open area for research.

Summary updated

Abstract

Quantization of Large Language Models (LLMs) has be- coming increasingly important for reducing the computa- tional costs and resource requirements for practical deploy- ment.Growinginterestinthisareahasmotivatedthecommu- nity to move beyond 8-bit quantization towards 4-bit preci- sion, leading to the development of customized 4-bit formats such as MXFP4 and NVFP4. Recently, HiFloat4 (HiF4) has emerged as a competitive alternative which adopts a Block Floating-Point(BFP)formatwithathree-levelscalinghierar- chy, thereby achieving a significantly larger dynamic range. While quantization can substantially reduce memory usage and accelerate inference, it frequently introduces accuracy degradation. Calibration is therefore essential for narrowing theperformancegapbetweenlow-precisionquantizedmodels and their full-precision counterparts. Nevertheless, existing calibration methods are mainly designed and validated us- ing integer-precision formats, such as INT4, lacking support for HiF4 due to its hierarchical BFP structure. In this paper, weinvestigatethreecalibrationapproaches,namelyHiGPTQ, HiAutoRound, and HiFlatQuant, to further enhance model quantizationbasedontheHiF4format.Extensiveexperiments demonstratethatallthreeproposedapproachesimproveinfer- ence accuracy compared with direct HiF4 conversion, reduc- ing the gap between HiF4 and BF16 to less than 1% and out- performing the state-of-the-art NVFP4 format across various models and downstream tasks.
BibTeX
@misc{huang2026calibration,
  author = {Jing Huang and Yu Cheng and Ziwei Yu and Lan Zhao and Sitan Li and Guangxiu Yao and Xin Wang and Yuanyong Luo and Hengyi Liang and Ting Li and Bo Liu and Hu Liu and Michael Bi Mi and Heng Liao},
  title = {{Calibration of Large Model Quantization based on HiFloat4 Format}},
  year = {2026},
  eprint = {2610.41112},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2610.41112},
}
Figure