OACAL: Finding Module-consistent Specifications to Secure Systems from Weakened User Obligations

Pengcheng Jiang, Kenji Tei

Abstract

OACAL (Obligation, Attack scenario, model Checking And machine Learning) is a novel framework designed to automate the redesign of software specifications to ensure security even when users fail to adhere to security protocols, such as leaving a terminal unattended. By integrating module-based recomposition with machine learning-accelerated model checking, OACAL identifies functional and secure system designs up to 20 times faster than existing state-of-the-art methods while maintaining superior solution coverage.

The Problem: Weakened User Obligations

In security-critical systems, developers typically design workflows under the assumption that users will follow specific "obligations"—sequences of actions required to maintain safety. However, human behavior is often unpredictable; users may become distracted or deviate from intended workflows, creating vulnerabilities that malicious actors or automated threats like Remote Access Trojans (RATs) can exploit.

A security-critical system scenario where a malicious user exploits a weakened user obligation.

The challenge for developers is to make systems resilient to these "weakened obligations" by redesigning the system's specification—the logic governing state transitions—so it remains secure without sacrificing core functionality. Previous tools, such as OASIS, often struggle with slow processing speeds, limited search ranges, and the accidental removal of essential features during the redesign process.

The OACAL Framework

OACAL addresses these challenges through three primary innovations designed to streamline the search for secure specifications:

  1. Module-based Recomposition: Rather than shuffling individual low-level actions, OACAL groups actions into "modules" representing specific UI screens or interfaces. Reordering these modules ensures that the internal logic of each interface remains intact, preventing the functional inconsistency common in earlier approaches.
  2. Machine Learning-Accelerated Model Checking: Exhaustive testing of every possible redesign is computationally prohibitive. OACAL uses a hybrid approach: it performs traditional model checking on a small subset of designs to train a Gradient Boosted Trees (GBT) model. This model then acts as a high-speed filter, predicting which other designs are likely to satisfy security requirements.
  3. Requirement Degradation: In cases where no design meets every requirement, OACAL allows developers to prioritize and "degrade" or waive lower-priority requirements to find the best possible suboptimal solution.
The OACAL architecture, illustrating the flow from module-based recomposition to machine learning-accelerated prediction and final revision.

Key Results and Insights

The framework was evaluated using ticket-booking and online gifting systems, as well as synthetic benchmarks. Key findings include:

  • Superior Coverage: In an online gifting case study, OACAL identified 46 valid revisions that satisfied all requirements. In contrast, the previous state-of-the-art tool found only one, which was practically unusable as it required users to pay after logging out.
  • Massive Speedup: OACAL's efficiency scales significantly better than previous methods. For a system with 9 modules, OACAL was approximately 10 times faster in the average case and 20 times faster in the worst-case scenario compared to the OASIS baseline.
  • High Predictive Accuracy: The machine learning component achieved an F1-score between 0.96 and 1.0, demonstrating that formal model checking results are highly learnable and that ML can effectively serve as a proxy for rigorous formal methods in large search spaces.

Conclusion

OACAL demonstrates that preserving the internal logic of UI components while optimizing their sequence is key to maintaining user-friendly, secure software. By treating model checking as a learning task, the framework overcomes the redundancy traps of previous methods, offering a scalable solution for modern software architecture security.

Summary updated

Abstract

Users interacting with a system through UI are typically obliged to perform their actions in a pre-determined order, to successfully achieve certain functional goals. However, such obligations are often not followed strictly by users, which may lead to the violation to security properties, especially in security-critical systems. To improve the security with the awareness of unexpected user behaviors, a system can be redesigned to a more robust one by changing the order of actions in its specification. Meanwhile, we anticipate that the functionalities would remain consistent following the modifications. In this paper, we propose an efficient algorithm to automatically produce specification revisions tackling the attack scenarios caused by weakened user obligations. By our algorithm, all the revisions would be generated to maintain the integrity of the functionalities using a novel recomposition approach. Then, the eligible revisions that can satisfy the security requirements would be efficiently spotted by a hybrid approach combining model checking and machine learning techniques. We evaluate our algorithm by comparing its performance with a state-of-the-art approach regarding their coverage and searching speed of the desirable revisions.
BibTeX
@inproceedings{jiang2021oacal,
  author = {Pengcheng Jiang and Kenji Tei},
  title = {{OACAL: Finding Module-consistent Specifications to Secure Systems from Weakened User Obligations}},
  booktitle = {SSCI},
  year = {2021},
  url = {https://openreview.net/forum?id=49X8TuC2W6H},
}
Figure