TADA: Technology Aware DNN Accelerator Performance and Energy Estimator

Tanvi Sharma, Surya Selvam, Anand Raghunathan, Kaushik RoyarXiv 2026 · DOI · arXiv

TL;DR

TADA is a fast, machine-learning-powered estimator that predicts the performance and energy of DNN accelerators while treating memory technology as a continuous, first-class design variable. By training on a diverse synthetic dataset of "physically plausible" memory characteristics, TADA achieves over $10^4\times$ speedup compared to traditional simulators, enabling rapid exploration of emerging technologies like ReRAM and PCM without the need for constant retraining.

What Problem Does This Paper Address?

Designing efficient Deep Neural Network (DNN) accelerators for edge devices is a balancing act between energy, latency, and area (EDP). While researchers have spent years optimizing compute arrays and dataflow mappings, the underlying memory technology (e.g., SRAM, eDRAM, or non-volatile memories like STTRAM) is often treated as a fixed choice or a secondary concern.

However, memory choice isn't just a label; it's a fundamental constraint. Increasing memory capacity can improve data reuse (saving energy), but it consumes area that could have been used for more compute units. Furthermore, different technologies have wildly different read/write energy profiles. Existing Design Space Exploration (DSE) tools are typically "technology-blind"—if you want to evaluate a new memory type, you often have to re-run thousands of slow architectural simulations and retrain your ML models from scratch.

TADA addresses this "technology-fixed" bottleneck by creating a generalizable model that understands the physics of memory trade-offs rather than just memorizing specific hardware configurations.

Methods

The core innovation of TADA lies in how it represents and learns about memory.

  1. Technology Signatures: Instead of identifying a memory as "SRAM," TADA uses a technology signature. This is a vector of physical characteristics—read energy, write energy, and storage capacity—characterized across a range of silicon areas. This allows the model to treat memory as a continuous design space.
  2. Synthetic Technology Space: To ensure the model can generalize to future or proprietary technologies, the authors developed a pipeline to generate a "synthetic corpus" of 240 technology curves. These aren't random; they are perturbed versions of real technology trends, filtered by "physics-based guardrails" to ensure they remain realistic (e.g., you can't have a memory that is both infinitely dense and zero-energy).
  3. The TADA Surrogate: The authors used the ZigZag architectural simulator to label 1.5 million configurations. They then trained a regression model (the surrogate) to map the workload, hardware configuration, and technology signature to the final system latency and energy.
Figure 3: Overview of TADA. (1) Synthetic technology dataset is created by using real technology for baseline sampling, then perturbed and filtered by physics-aware constraints to form a diverse synthetic corpus; the inset shows representative read-energy, write-energy, and capacity profiles. (2) Each technology signature is combined with a workload and DCIM-array configuration, labeled by ZigZag, and used to train the TADA surrogate. (3) At evaluation, the frozen surrogate estimates energy and latency for unseen technology–workload–hardware candidates and supports iterative area-constrained search; the inset summarizes the energy and latency distribution of the simulator-labeled training corpus.

Datasets

  • Synthetic Corpus: 240 unique technology curves, each with 10 area points, designed to span current and future memory trends.
  • Training Dataset: 129,600 workload-hardware-technology configurations, resulting in over 1.5 million simulation points generated via the ZigZag analytical simulator.
  • Evaluation Set: 21 "unseen" real-world technology curves, including various flavors of SRAM (6T/8T), STTRAM, ReRAM, PCM, FeFET, eDRAM, and CTT. These were characterized using tools like CACTI and NVSim.
Figure 2: Area-dependent signatures for 21 evaluation curves, combining CACTI, NVSim/NVMExplorer, and independently characterized inputs [4, 16, 18].

Key Insights and Ideas

  • The "Best" Technology is Budget-Dependent: One of the most striking findings is that no single memory technology is universally superior. As shown in Figure 1, the optimal choice shifts from eDRAM to PCM to SRAM as the available chip area budget increases. TADA captures this shifting landscape effortlessly.
  • Generalization through Synthesis: By training on "fake but realistic" data, the model learns the underlying relationship between memory metrics and system performance. This allows it to accurately predict the performance of a technology it has never seen before, like the Charge-Trap Transistor (CTT).
  • Sensitivity Analysis: Using SHAP (SHapley Additive exPlanations), the authors found that sequence length and write energy are the dominant factors for total energy, while array size and workload shape dominate latency.
Figure 1: Best EDP for each technology after jointly opti- mizing compute array size and buffer capacity at each area budget for a transformer-based prefill workload. Bars are normalized to the best technology at each budget; the dashed line shows that the budget-best EDP decreases as area in- creases.

Key Results

  • High Accuracy: On unseen technologies, TADA predicts system energy with 1.5–4.4% Mean Absolute Percentage Error (MAPE) and latency with 0.7–1.2% MAPE.
  • Massive Speedup: TADA evaluates configurations over $10^4\times$ faster than the parallelized analytical simulator it was trained on (milliseconds vs. seconds per configuration).
  • Effective Design Search: In pairwise case studies (e.g., SRAM vs. ReRAM), TADA matched the simulator’s optimal technology choice in 98.7–100% of area budgets, with a negligible EDP loss (max 0.21%).

Limitations and Future Work

While TADA is a significant step forward, the authors note a few areas for expansion:

  • Architecture Scope: The current instantiation focuses on Digital Compute-In-Memory (DCIM) designs. While the methodology is general, future work could validate it on a wider variety of PE-array-based accelerators.
  • Signature Complexity: The technology signature currently focuses on energy and capacity. Future versions could include metrics like endurance (crucial for non-volatile memories) and temperature sensitivity.
  • Workload Targets: The authors suggest using TADA in reverse—starting with a workload-level EDP target and deriving the necessary memory-macro characteristics to meet it.

For those interested in the intersection of AI hardware and emerging memory, TADA provides a powerful, open-ended framework for exploring the next generation of edge AI accelerators.

Summary updated

Abstract

Deep neural network (DNN) accelerators for edge inference must meet tight energy, latency, and area (EDP) constraints, and their optimal hardware architecture and dataflow configuration is typically identified through design space exploration (DSE). However, on-chip memory technology including cell type, bank organization, and process node, is rarely treated as a first-class citizen in DSE. For example, increasing memory capacity can reduce memory accesses through greater data reuse, but at the cost of higher area and access energy, thereby limiting the compute units budget. Consequently, memory technology can fundamentally shift the optimal accelerator architecture for a given area and EDP budget. Existing machine learning (ML)-based DSE methods require repeating simulation, data generation, and model training for each new memory technology. We present TADA, a memory technology-aware DNN accelerator performance and energy estimator that predicts system latency and energy for a given workload, hardware configuration, and memory technology. TADA is trained on a synthetic dataset that generalizes across memory technologies. The dataset spans current and future technology trends while enforcing physics-based guardrails to preserve realistic area-energy trade-offs. Each memory technology is represented by a technology signature, a vector of read energy, write energy, and storage capacity across a range of areas, provided as input alongside the workload and hardware configuration. Across 21 unseen technology curves spanning SRAM, STTRAM, ReRAM, PCM, FeFET, eDRAM, and CTT, TADA predicts system energy and latency with 1.5-4.4% and 0.7-1.2% mean absolute percentage error, respectively. In three pairwise case studies, it matches the simulator-selected memory technology at 98.7-100% of area budgets, with a mean EDP loss of at most 0.21%, while achieving over 10^4x higher evaluation throughput.
BibTeX
@misc{sharma2026tada,
  author = {Tanvi Sharma and Surya Selvam and Anand Raghunathan and Kaushik Roy},
  title = {{TADA: Technology Aware DNN Accelerator Performance and Energy Estimator}},
  year = {2026},
  eprint = {2611.00292},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.00292},
}
Figure