System support for ubiquitous human-cyber-physical fusion applications

Y Cao, Chaoyi Zhao, Hanzhi Liu, Jiayi Wang, Huiyan Wang, Yu Ping, Chun Cao, Chang Xu, Xiaoxing Ma, Yanyan JiangScientia 2025 · DOI

This paper, published in Scientia Sinica Informationis, presents a forward-looking architectural framework for the next generation of ubiquitous computing. Researchers from Nanjing University propose a "meta-level software-defined" approach to bridge the gap between messy physical environments, diverse human needs, and the growing power of AI.

TL;DR

The authors propose a meta-level software-defined ubiquitous operating system (uOS) that uses "Software Twins" to abstract heterogeneous hardware and a "Report and Issuance" hierarchy to manage complex human-machine-physical interactions. This architecture aims to simplify the development of intelligent, cross-device applications like smart assistants and city-wide monitoring systems.

What Problem Does This Paper Address?

We are entering an era of "Human-Cyber-Physical" fusion where computing is embedded everywhere (IoT). However, developers face three major "bottlenecks":

  1. Heterogeneity: Managing thousands of different devices with varying protocols and limited resources.
  2. Complexity: Traditional OS abstractions (like files and processes) are too rigid for dynamic environments where "humans are in the loop."
  3. AI Integration: While AI models are powerful, they are often "brittle" when facing out-of-distribution (OOD) data and are difficult to integrate into traditional, deterministic software engineering workflows.

Current solutions, like middleware or specific IoT frameworks, are often siloed. The authors argue we need a fundamental shift in how the operating system itself supports these fused applications.

Methods

The paper introduces three core design pillars for a meta-level uOS:

  • Software Twin (The "God's Eye View"): Instead of just controlling a device, the system maintains a time-evolving digital mirror of every entity (human, device, environment). This allows developers to move from "programming by addition" (handling every edge case) to "programming by subtraction" (filtering the full-scene log to make decisions).
  • Report and Issuance (上传下达): To handle complex requirements, the system organizes software components into a social-like hierarchy of "Agents." Lower-level agents report status and data upward; higher-level agents issue goals and commands downward. This tree-like structure allows for the recursive decomposition of massive tasks.
  • AI-Native Design: The system standardizes communication using a "4W" data abstraction (When, Where, Whom, What). By making these interfaces uniform and "explainable" in a way that both humans and LLMs can understand, AI models can be plugged directly into the hierarchy as decision-making units.

Datasets

As a system architecture and position paper, it does not introduce a new training dataset. Instead, it validates the concepts through three detailed architectural case studies:

  1. Intelligent OS Assistant: Breaking down complex natural language requests (e.g., "create a travel diary") into sub-tasks for various app-agents.
  2. "Skynet" Traffic Monitoring: Abstracting city-wide cameras and sensors to provide a unified view for traffic flow statistics and accident detection.
  3. Disease Prevention and Control: Integrating heterogeneous medical records, GPS data, and wearable device logs for real-time epidemic tracking.

Key Insights and Ideas

  • From Implementation to Decision-Making: The authors argue that in a ubiquitous world, the developer's job shouldn't be writing the logic for every interaction, but rather defining the "specification" and letting the system use full-scene logs to make the best decision.
  • The "Agent" as the Basic Unit: By treating software components as autonomous agents that can "report" and "issue," the system naturally scales to handle the unpredictability of human behavior and hardware failure.
  • Standardizing the "4Ws": By reducing all environmental interactions to Time, Location, Subject, and Event, the authors provide a "lingua franca" that bridges the gap between deterministic code and probabilistic AI models.

Key Results

The paper provides a qualitative evaluation of the proposed architecture's benefits:

  • Reduced Development Cost: In the "Intelligent Assistant" scenario, the hierarchical agent structure allows for low-code or even no-code integration of new capabilities.
  • System Resilience: The "Software Twin" approach allows the system to remain functional even when specific sensors fail, as it can infer state from the broader "full-scene" data.
  • Efficiency Gains: While primarily a conceptual paper, the authors reference their related work (the "Tai-e" and "Taiao" frameworks), noting that their specialized context-consistency detection methods achieved a two-order-of-magnitude speedup over baseline methods in open environments.

Limitations and Future Work

The authors acknowledge several hurdles for the widespread adoption of a meta-level uOS:

  • Legacy Transformation: How to "ubiquitize" existing software that wasn't designed for this agent-based, twin-centric model.
  • Privacy and Security: A "God's Eye View" of all data raises massive privacy concerns. Future work must integrate "security-by-design" to protect the "Software Twins."
  • Performance: Maintaining real-time consistency across a massive, distributed hierarchy of agents requires high-performance communication protocols that are still under development.

Summary updated

Abstract

Ubiquitous computing brings new possibilities for human-cyber-physical fusion applications, but it also faces the problems of heterogeneous resource management, diversity of requirements and limited computing resources. Meanwhile, the rapid development of artificial intelligence models presents both opportunities and challenges to the development of intelligent applications. To this end, this paper proposes the design concept of meta-level software-defined ubiquitous operating system, which introduces the “software twin” technology to realize the abstract management of heterogeneous resources, utilizes the “report and issuance” hierarchical structure to decompose complex requirements, and supports AI models through AI-native design. This paper further illustrates the practical advantages and potential value of this ubiquitous operating system design concept through three typical ubiquitous computing application scenarios: an intelligent OS assistant, a Skynet monitoring system, and a disease prevention and control system, highlighting the broad application prospects of human-cyber-physical fusion in the intelligent era.
BibTeX
@inproceedings{cao2025system,
  author = {Y CAO and Chaoyi Zhao and Hanzhi Liu and Jiayi Wang and Huiyan Wang and Yu Ping and Chun Cao and Chang Xu and Xiaoxing Ma and Yanyan Jiang},
  title = {{System support for ubiquitous human-cyber-physical fusion applications}},
  booktitle = {Scientia},
  year = {2025},
  doi = {10.1360/ssi-2024-0338},
}
Figure