Airside HVAC BESTEST. Adaptation of ASHRAE RP 865 Airside HVAC Equipment Modeling Test Cases for ASHRAE Standard 140. Volume 1, Cases AE101-AE445

J. Neymark, Michael Kennedy, R. Judkoff, Jüergen Gall, D.e. Knebel, R. Henninger, Michael J. Witte, Tianzhen Hong, Thomas W. McDowell, Da Yan, Xiaojie Zhou2016 · DOI

TL;DR

This paper presents a comprehensive set of diagnostic test cases for evaluating the accuracy of building energy simulation software in modeling HVAC air distribution systems. By adapting and expanding upon existing ASHRAE standards, the authors provide a robust benchmark for ensuring that simulation tools can reliably predict the performance of these critical building components, leading to more accurate energy savings predictions and better building designs.

What Problem Does This Paper Address?

Accurately modeling HVAC air distribution systems is crucial for predicting building energy performance, especially in larger buildings with significant cooling loads. Existing standards, like ASHRAE Standard 140, primarily focus on the heat-transfer fluid side of HVAC equipment, with only superficial testing of air distribution systems. This leaves a gap in verifying the ability of whole-building energy simulation software to accurately model the complex interactions within ducted air distribution systems, which are essential for both typical building designs and the evaluation of advanced HVAC systems. This paper addresses this gap by developing and validating a new suite of test cases specifically designed for airside HVAC equipment modeling.

Methods

The core of this work involves adapting and expanding upon ASHRAE Research Project 865 (RP 865) to create a set of 24 diagnostic test cases for airside HVAC distribution system models. The methodology follows the BESTEST (Building Energy Simulation Test and Diagnostic Method) approach, which involves:

  • Analytical Verification: Developing a quasi-analytical solution (QAS) as a "secondary mathematical truth standard" by reconciling and merging two independently developed spreadsheet solutions from RP 865. This QAS serves as a benchmark for comparison.
  • Test Specification Refinement: Reworking the original RP 865 test specifications to be unambiguous for a wide range of building energy simulation programs, particularly those with hourly or sub-hourly time steps.
  • Field Trials: Conducting iterative simulation trials with various state-of-the-art building energy simulation programs from around the world. This process helped refine the test cases, identify and debug models, and document improvements.
  • Comparative Analysis: Comparing simulation results against the QAS and against each other to identify modeling differences and potential areas for improvement.

The test cases cover four main system types: Four-Pipe Fan Coil (FC), Single-Zone Air Conditioner (SZ), Constant Volume Terminal Reheat (CV), and Variable Air Volume Reheat (VAV). These systems are tested under various steady-state outdoor and zone conditions, including heating, dry-coil cooling, and wet-coil cooling modes, with different economizer control strategies.

Datasets

The primary dataset used for evaluation is the quasi-analytical solution (QAS), which was developed by merging and reconciling two independent spreadsheet solutions from the original ASHRAE RP 865 project. This QAS serves as the benchmark for comparison.

Additionally, the study utilized TMY2 (Typical Meteorological Year 2) format weather data files for specific test cases where constant steady-state ambient conditions could not be directly input. These weather data files are based on Miami.TM2 but have modified elements to align with the test specifications.

The paper also references original RP 865 models (PSU and TAMU) and simulation results from various building energy simulation programs (DEEAP, DeST, DOE-2.2, EnergyPlus, IES-VE, LCEM, and TRNSYS) as part of the evaluation and comparison process.

Key Insights and Ideas

  • The Power of QAS as a Benchmark: The development and use of a quasi-analytical solution proved invaluable for identifying errors and potential improvements in simulation software that might have been missed in purely comparative studies. It provided a reliable "mathematical truth standard" for verification.
  • Iterative Vetting is Crucial: The field trial process, involving multiple revisions of test specifications and re-execution of simulations, was essential for refining the test suite and ensuring its clarity and applicability across a wide range of simulation programs.
  • Complexity Matters: Initial simulation results showed larger disagreements for more complex systems (CV and VAV with reheat) compared to simpler systems (FC and SZ), highlighting the importance of testing a variety of system types.
  • Software Bugs and Ambiguities Uncovered: The process successfully identified numerous software bugs, input errors, and ambiguities in the test specifications, leading to significant improvements in both the simulation tools and the testing methodology itself.
  • Industry Collaboration is Key: The project's success was heavily reliant on the voluntary participation and continuous feedback from software developers and international experts, underscoring the value of collaborative efforts in developing robust validation standards.

Key Results

  • Improved Model Accuracy: After iterative testing and model improvements, the mean of all simulated results for total cooling coil load across tested programs was within 1.3% of the QAS results, with average variations among test cases for a given program of up to 3%.
  • Bug Identification and Fixes: Out of 26 identified program errors or potential improvements, 17 were diagnosed and fixed, 2 were planned for investigation, and 7 remained unresolved. Several errors affected results by over 20%.
  • Input Error Correction: 17 input errors were found and corrected, which helped clarify test specification ambiguities.
  • Test Specification Refinement: The test specifications were made more unambiguous, allowing a wider variety of simulation programs to perform the tests.
  • New Test Suite Developed: A new test suite was developed, suitable for initiating the ANSI/ASHRAE process for inclusion in Standard 140.

Limitations and Future Work

Limitations: * The current test cases are steady-state analytical verification tests. The impact of disagreements identified in these tests on typical annual simulations, especially concerning hourly varying weather data, is not yet scaled. * The use of constant system air density by some simulation programs causes modeling disagreements at extreme-low outdoor air temperatures for the specified CV system. * The QAS contains idealized simplifying assumptions (e.g., zero bypass factor, constant air properties) that may not be exactly reproduced by all simulation programs.

Future Work: * Develop an airside HVAC comparative test suite with annual hourly varying weather data, analogous to the HVAC BESTEST Volume 2 working-fluid side test suite. * Continue to produce analytical verification tests where possible. * Develop diagnostic comparative tests that emphasize modeling issues important in large commercial buildings, including more tests for HVAC systems and other mechanical equipment. * Develop a sequentially ordered series of high-quality diagnostic data sets for empirical validation. * Consider developing test cases that emphasize less idealized testing parameters (e.g., realistic coil bypass factors, typical hourly varying weather data). * Explore more complex building types and HVAC systems in future test cases. * Consider additional test cases for inclusion in ASHRAE Standard 140, such as multi-zone non-airflow in-depth diagnostic cases and building thermal fabric test cases for existing homes.

Summary updated

Abstract

This report documents a set of diagnostic analytical verification cases for testing the ability of whole building simulation software to model the air distribution side of typical heating, ventilating and air conditioning (HVAC) equipment. These cases complement the unitary equipment cases included in American National Standards Institute (ANSI)/American Society of Heating, Refrigerating, and Air-Conditioning Engineers (ASHRAE) Standard 140, Standard Method of Test for the Evaluation of Building Energy Analysis Computer Programs, which test the ability to model the heat-transfer fluid side of HVAC equipment.
BibTeX
@misc{neymark2016airside,
  author = {J. Neymark and Michael Kennedy and R. Judkoff and Jüergen Gall and D.E. Knebel and R. Henninger and Michael J. Witte and Tianzhen Hong and Thomas W. McDowell and Da Yan and Xiaojie Zhou},
  title = {{Airside HVAC BESTEST. Adaptation of ASHRAE RP 865 Airside HVAC Equipment Modeling Test Cases for ASHRAE Standard 140. Volume 1, Cases AE101-AE445}},
  year = {2016},
  doi = {10.2172/1244668},
}
Figure