Abstract
The transition from grid computing to cloud computing represents a fundamental shift in resource management and application deployment. Central to this evolution is Virtualization Technology (VT), which serves as the essential decoupling mechanism between software and hardware. This paper outlines the research framework and experiences gained through the "973 project," a major Chinese national initiative focused on addressing the architectural, security, and operational challenges of VT.
Introduction
In the late 2000s, the computing landscape began a significant migration from the distributed, heterogeneous model of grid computing toward the centralized, scalable, and service-oriented model of cloud computing. While grid computing focused on sharing resources across administrative domains, cloud computing aimed to provide these resources as a seamless utility.
The realization of this "cloud" vision required more than just increased bandwidth or larger data centers; it necessitated a robust method to abstract system software from the underlying physical infrastructure. Virtualization Technology (VT) emerged as the critical "decoupling" foundation, allowing applications to run pervasively and efficiently across diverse hardware environments.
The 973 Project: A Multi-Layered Research Framework
To address the gaps in VT research, the Chinese Ministry of Science and Technology initiated the 973 project in 2007. This collaborative effort involved six universities and two research institutes, focusing on a comprehensive research stack designed to move VT from an emerging concept to a production-ready infrastructure.
The project’s methodology was structured around four primary pillars:
- Architectural Philosophy: Defining the structural requirements for VT across both individual machines and large-scale clusters.
- System Design: Developing specialized VT implementations for single and multi-node computing systems.
- Operational Optimization: Tackling the practical hurdles of cloud environments, including power management, memory/IO virtualization, and virtual machine (VM) live migration.
- Trust and Security: Establishing frameworks to ensure reliability and security within virtualized environments.
Key Insights: VT as the "Great Decoupler"
The core insight of the 973 project is the role of VT as the "Great Decoupler." By separating the execution environment from the physical hardware, VT enables the "pervasive" execution of applications. This decoupling is what allows cloud providers to offer resources that are elastic, portable, and hardware-agnostic.
Furthermore, the research emphasized that VT is not merely a layer for running guest operating systems. Instead, it requires a holistic rethink of the entire computing stack. This includes:
- Operational Efficiency: Prioritizing power management and live migration to ensure the economic and operational viability of large-scale data centers.
- Performance Evaluation: Developing new benchmarking standards specifically for virtualized environments, as traditional metrics often fail to capture the nuances of resource contention and abstraction overhead.
Research Outcomes and Experiences
While the 973 project was visionary and ongoing at the time of this report, several key areas of progress were identified:
- VM Live Migration: Successful implementation of techniques to move running VMs between physical hosts with minimal downtime, a cornerstone of cloud load balancing.
- Resource Virtualization: Significant advancements in memory and I/O virtualization, reducing the performance penalty typically associated with abstraction layers.
- Desktop Virtualization: The development of solutions that extend cloud benefits to end-user hardware, paving the way for "thin client" architectures.
- Benchmarking Frameworks: The creation of specialized tools to evaluate the performance and reliability of VT-based systems.
Challenges and Future Directions
Despite these advancements, the project identified "trust and reliability" as persistent challenges. Ensuring that a virtualized environment is as secure and dependable as a physical one remains a complex task, particularly in multi-tenant cloud scenarios.
Future work within the 973 project framework points toward refining VT architectures and improving the user environment. The goal is to make virtualized resources as seamless and performant as local resources, eventually blurring the line between local and cloud-based computing through advanced desktop virtualization.
Conclusion
The shift from grid to cloud computing is more than a change in scale; it is a paradigm shift in resource allocation. By focusing on Virtualization Technology as the foundational decoupling layer, the 973 project has provided a roadmap for building scalable, efficient, and secure cloud infrastructures.
Summary updated