Research Groups

Interactive virtual-reality microscopy and image analysis

In addition to predictive forward simulations, reverse-engineering the “algorithms of tissue formation” also requires real-time microscopy, so that we are able to directly overlay simulation results with observations and tune the former using guided black-box optimization algorithms.

A mid-term goal of ours is the development of immersive virtual-reality visualization and hand gesture control for 3D microscopy. Interpretation of user gestures requires real-time image analysis. The short-term goal is hence to develop a novel image analysis framework that enables us to process and visualize the data in real time.

We believe that this could become a new standard for the field, in addition to our earlier contributions to image analysis and tracking as available in the MOSAICsuite software package, which is downloaded about 3000 times per month world-wide.

Collaborators:

  • Prof. Dr. Eugene W. Myers (MPI-CBG)
  • Dr. Pavel Tomancak (MPI-CBG)
  • Dr. Jan Huisken (MPI-CBG)
  • Prof. PhD Carsten Rother (Computer Vision Group, TU Dresden)
  • Prof. Dr. Stephan Gumhold (Computer Graphics Chair, TU Dresden)
  • Prof. Dr. Raimund Dachselt (Chair for Human/Computer Interaction, TU Dresden)
SPIM (light-sheet microscopy) image of a D.melanogaster embryo, recorded with an OpenSPIM system in the Tomancak lab and then segmented in real-time using our particle-based segmentation algorithm on a parallel computer cluster. The segmentation shown took less time to be computed than the microscope needed to acquire the 32 GB of raw image data. Figure from Yaser Afshar.