Introduction
Detecting "tunnelling"—where an attacker moves through a network using legitimate credentials—is a computationally expensive "needle in a haystack" problem. In modern cyber defense, while powerful statistical and machine learning models exist to detect subtle anomalies, they are often too computationally "heavy" to run across an entire enterprise network in real-time. This paper proposes a multilevel statistical framework that uses a fast "telescoping" algorithm to filter massive netflow data, allowing complex, high-fidelity statistical models to focus only on the most suspicious session chains.
The Tunnelling Problem
Tunnelling occurs when an attacker gains legitimate credentials and creates a chain of connections (e.g., SSH sessions) to move from an entry point to a target. Because the attacker uses valid logins, signature-based detection fails. Detection requires analyzing the timing and structure of connections. However, on a network with hundreds of thousands of IPs and millions of edges, comparing every possible connection pair for timing correlations is mathematically infeasible.
Methodology: A Multilevel Approach
The authors introduce a multilevel modelling approach designed to be "conservative," filtering out uninteresting data while retaining potential threats for deeper analysis.
- Sessionization: Raw netflow data is grouped into "sessions" using a 125-second time-out. If two records on the same edge occur within this window, they belong to the same session.
- Telescoping Discovery: The core innovation is "telescoping." If Node B receives an incoming session from Node A and initiates an outgoing session to Node C entirely contained within the first session's timeframe, these are "telescoped." A linear-time algorithm efficiently identifies these pairs.
- Statistical Scoring:
- Session Level: A p-value ($p_{lm}$) is calculated to determine if telescoping happened by chance, using resampling to account for seasonal traffic.
- Chain Level: Fisher’s method combines p-values for longer paths (e.g., a 4-node chain).
- Netflow Level: Highly suspicious sessions undergo high-resolution correlation analysis of flow volumes (e.g., log-transformed flows per minute) to confirm if the data moving in matches the data moving out.
Experimental Evaluation
The study utilized real-world traffic from the Imperial College London network, containing approximately 345,098 IPs. To evaluate the framework, the authors simulated an SSH tunnel from a home PC (T1) through intermediate servers (T2, T3) to a target machine (T4), where malicious activity (software installation and video streaming) was performed to mimic data exfiltration.
Key Results and Insights
The framework achieved significant computational triage, reducing the data volume by 100x before applying expensive models.
- SSH Analysis: In a dataset of 6,569 SSH records over 48 hours, the algorithm successfully identified the true attack path (T1-T2-T3-T4) with a highly significant p-value of 0.00011.
- Action Identification: In an all-protocol study, the framework correctly identified a specific Google IP involved in simulated exfiltration with a correlation score of 0.96.
Conclusion
By shifting the goal from "detect everything at once" to "filter fast, then model deep," this framework enables the use of sophisticated statistical models at scale. The temporal "telescoping" signature provides a powerful structural filter that is both physically grounded and computationally efficient, making it suitable for MapReduce environments and real-world big data volumes.
Summary updated