Pinpoint: trajectory planning for multi-probe electrophysiology and injections in an interactive web-based 3D environment

Daniel Birman, Kenneth J. Yang, Steven J. West, Bill Karsh, Yoni Browning, Joshua H. Siegle, Nicholas A. Steinmetz2023 · DOI

TL;DR

Pinpoint is a new open-source, web-based 3D environment designed to simplify and enhance the planning of complex multi-probe electrophysiology and injection experiments. It offers interactive visualization, collision detection, and integration with hardware, making precise targeting more accessible and reproducible.

What Problem Does This Paper Address?

Planning precise insertions of electrophysiology probes or injection needles into deep brain structures is a critical but challenging aspect of neuroscience research. This task requires extensive training and expertise, especially as experiments involve more probes simultaneously. Even experienced researchers can struggle with accurately placing probes, and the complexity scales significantly with the number of probes. Traditional methods often rely on 2D atlases, which are difficult to use for planning 3D trajectories and ensuring physical feasibility with experimental setups. This leads to time-consuming planning, potential targeting errors, and reduced experimental efficiency.

Methods

Pinpoint tackles this challenge by providing an interactive 3D environment built on the Unity game engine. Key features include:

  • 3D Brain Atlases: Transparent 3D models of the mouse brain, based on the Allen Common Coordinate Framework (CCF) and its deformations (e.g., Dorr2008, Qiu2018), allow users to visualize target regions.
  • Interactive Probe and Hardware Modeling: Users can add 3D models of probes (Neuropixels, UCLA, pipettes) and experimental hardware (craniotomy tools, headbars, imaging lenses) to the scene.
  • Trajectory Planning and Visualization: Intuitive click-and-drag or keyboard controls allow users to plan and optimize probe insertion trajectories. Visualizations like "channel maps" and "in-plane slices" help users understand probe placement relative to brain regions.
  • Collision Detection: Pinpoint automatically detects collisions between probes and between probes and hardware, alerting users to potential problems.
  • Stereotaxic Coordinate System: The software calculates and displays stereotaxic coordinates (AP, ML, DV, Yaw, Pitch, Roll) for precise surgical planning.
  • Hardware and Software Integration:
    • API for Data Acquisition: Pinpoint can send planned anatomical targets to data acquisition software (e.g., Open Ephys, SpikeGLX) for real-time comparison with electrophysiological signals.
  • Electrophysiology Manipulator Link (Ephys Link): This Python package enables communication with micro-manipulators, allowing live probe positions to be echoed in Pinpoint for real-time visualization and automated control.
  • Copilot Mode: An automated insertion sequence that simplifies and parallelizes multi-probe insertions, minimizing user error and maximizing efficiency.

Datasets

Not discussed in the paper. The paper focuses on the software's functionality and integration with existing anatomical atlases.

Key Insights and Ideas

  • Bridging the Gap: Pinpoint effectively bridges the gap between anatomical knowledge and the technical skills required for complex probe insertions, making advanced neuroscience techniques more accessible.
  • The Power of 3D Visualization: Moving from 2D atlases to an interactive 3D environment dramatically improves the ability to plan and visualize complex multi-probe trajectories, preventing collisions and ensuring physical feasibility.
  • Real-time Integration is Crucial: The integration with data acquisition software and hardware manipulators is a game-changer, allowing for real-time feedback and automation that significantly enhances experimental efficiency and reproducibility.
  • Democratizing Advanced Techniques: By offering a web-based, easy-to-use interface, Pinpoint lowers the barrier to entry for researchers wanting to perform large-scale electrophysiology experiments.

Key Results

  • Pinpoint provides an intuitive 3D environment for planning stereotaxic insertions.
  • It allows for the visualization of probes alongside anatomical brain structures and experimental hardware.
  • The software includes automatic collision detection to prevent physical conflicts.
  • It offers integration with data acquisition software for real-time anatomical targeting information.
  • The Ephys Link package enables real-time position echoing from hardware manipulators and supports automated control.
  • The "Copilot" mode automates multi-probe insertion sequences, improving efficiency and reproducibility.
  • Users can save and share insertion plans via permanent URLs and an account system.

Limitations and Future Work

  • Individual Brain Variability: While Pinpoint can account for isometric scaling (e.g., skull size), it currently cannot fully account for nonlinear differences or uncorrelated variability across individual mouse brains.
  • Future Work: The authors suggest several avenues for future development:
  • Inclusion of additional brain atlases (e.g., developmental mouse atlases, Waxholm rat atlas).
  • Capability to load individual anatomical MRI data, which is critical for targeting in non-human primates.
  • Continued development of the API and hardware integrations.

Summary updated

Abstract

Abstract Targeting deep brain structures during electrophysiology and injections requires intensive training and expertise. Even with experience, researchers often can’t be certain that a probe is placed precisely in a target location and this complexity scales with the number of simultaneous probes used in an experiment. Here, we present Pinpoint, open-source software that allows for interactive exploration of stereotaxic insertion plans. Once an insertion plan is created, Pinpoint allows users to save these online and share them with collaborators. 3D modeling tools allow users to explore their insertions alongside rig and implant hardware and ensure plans are physically possible. Probes in Pinpoint can be linked to electronic micro-manipulators allowing real-time visualization of current brain region targets alongside neural data. In addition, Pinpoint can control manipulators to automate and parallelize the insertion process. Compared to previously available software, Pinpoint’s easy access through web browsers, extensive features, and real-time experiment integration enable more efficient and reproducible recordings.
BibTeX
@misc{birman2023pinpoint,
  author = {Daniel Birman and Kenneth J. Yang and Steven J. West and Bill Karsh and Yoni Browning and Joshua H. Siegle and Nicholas A. Steinmetz},
  title = {{Pinpoint: trajectory planning for multi-probe electrophysiology and injections in an interactive web-based 3D environment}},
  year = {2023},
  doi = {10.7554/elife.91662.1},
}
Figure