When tracking the movement of a crawling insect, a running rodent, or the stroke of a physical paintbrush, traditional cameras face a fundamental challenge: noise. Incident light reflects off the subject's body, casting shadows and obscuring the precise boundaries where the subject actually touches the surface.
To capture true physical contact with high fidelity, researchers use a mechanism that turns the problem of illumination on its head. Instead of shining light onto a subject, light is trapped inside a transparent substrate, escaping only at the exact coordinates of physical contact. This technique is known as frustrated Total Internal Reflection (fTIR) imaging.
The Mechanics of Trapped Light
To understand why fTIR imaging produces such high-contrast images, we must first look at how light behaves inside an optical waveguide, such as a sheet of glass or acrylic.
When light travels through a dense medium and strikes the boundary of a less dense medium (like air) at a shallow angle—specifically, an angle greater than the "critical angle"—it does not pass through. Instead, 100% of the light reflects back into the denser medium. This is total internal reflection.
Total Internal Reflection (No Contact):
--------------------------------- Boundary (Glass/Air)
/\ /\ /\ /\ /\
/ \ / \ / \ / \ / \ Light trapped inside glass
/ \/ \/ \/ \/ \
===================================
Frustrated Total Internal Reflection (Contact):
[ Object ]
-----------|--------|------------ Boundary (Glass/Air)
/\ | |
/ \ | Scatter| Light escapes into sensor
/ \ v v
===================================
If you place a camera beneath a glass plate filled with internally reflecting light, the camera sees absolute darkness. Because the light is completely trapped within the glass matrix, no photons escape downward toward the camera lens. The substrate acts as a silent conduit for the light.
Frustrating the Boundary
The magic of fTIR happens when an object makes contact with the surface of the substrate. When a material with a different refractive index—such as the soft tissue of an animal's foot or the wet bristles of a brush—presses against the glass, it disrupts the boundary layer.
This physical intrusion "frustrates" the total internal reflection. Instead of bouncing cleanly back into the substrate, the light waves are disrupted and scattered out of the waveguide at the precise points of contact. As highlighted by Risse et al., this mechanism produces a bright, high-contrast signal against a pitch-black background, completely eliminating the reflections, glare, and shadows that plague traditional incident or transmitted lighting setups.
Tracking Locomotion Without Body Occlusion
This optical isolation is incredibly valuable for biological locomotion analysis. In traditional video tracking, an animal's body often blocks the camera's view of its feet, making it difficult to determine exactly when and where a limb makes contact with the ground.
By using an fTIR setup, researchers can isolate the footprint from the rest of the body. For example, Mendes et al. (2013) and Mendes et al. (2014) utilized a glass plate setup to study the gait parameters of Drosophila melanogaster. When the fruit fly walks across the plate, only its tiny leg contact points scatter the light, allowing a high-speed camera to capture precise spatial and temporal footprint data without interference from the fly's torso or wings.
The authors later extended this capability to larger organisms with "MouseWalker" (Mendes et al., 2015), a system that guides infrared light through an acrylic walkway to track the distinct footfalls of freely walking rodents. Because the signal is generated purely by contact scattering, the system delivers clean, high-resolution kinematic data ripe for automated thresholding and analysis.
Capturing Continuous Physical Deformations
Frustrated TIR is not merely a binary sensor for touch; it can also capture the nuanced, continuous variations of physical deformation. When a flexible or wet object presses against the substrate, the surface area and intimacy of the contact dictate how much light is frustrated and scattered.
This property was leveraged by Claesen et al. to build a real-time digital painting system called "FluidPaint." By using an fTIR glass canvas, the system captures the complex, shifting footprints and physical deformations of real wet paintbrushes. The varying intensity of the scattered light maps directly to the pressure and spread of the bristles, bridging the gap between physical tactile feedback and digital visual rendering with single-frame latency.
The Broader Paradigm: Selective Scattering Contrast
The core intuition behind fTIR imaging belongs to a broader family of imaging philosophies: selective contrast via scattering. The goal is always to suppress the background matrix entirely so that only structural anomalies or contact points redirect energy into the detector.
We see this exact principle applied at different scales across imaging science:
- Microscopic Defect Detection: In industrial quality control, Yin et al. employ dark-field scattering imaging to detect microscopic surface flaws on optical components. By configuring the illumination so that specular reflection misses the camera lens, the camera records a near-black background. Only the microscopic scratches and point defects redirect and scatter the light, making them instantly visible.
- Atomic-Scale Electron Microscopy: At the sub-nanometer scale, Zheng et al. demonstrate a conceptually parallel approach in scanning transmission electron microscopy (STEM). By precisely adjusting the focus of a coherent electron probe and aligning the detector to specific diffraction conditions, they can isolate the spatial frequencies associated with lattice distortions. This allows them to preferentially image individual crystal defects while suppressing the background signal of the perfect crystal matrix.
Whether tracking a mouse's paw on an acrylic runway, a paintbrush on a digital canvas, or a defect in a crystal lattice, the underlying strategy remains the same: manipulate the illumination environment so that the background stays dark, leaving scattered energy to reveal the precise geometry of the interaction.
Key Foundational Work
Fourier images in coherent convergent beam electron diffraction and atomic resolution scanning transmission electron microscopy (2011) — contributed 6 concept elements to this direction.
Smart Camera System-on-Chip Architecture for Real-Time Brush Based Interactive Painting Systems (2010) — contributed 2 concept elements to this direction.