Novel 3D Interaction Techniques for Collaborative, Immersive Scientific Visualization
Doctoral Researcher:
Supervisors:
Prof. Dr. Colin W. Devey, GEOMAR Helmholtz Centre for Ocean Research Kiel, Magmatic and Hydrothermal Systems, cdevey@geomar.de
Prof. Dr. Gabriel Zachmann, University of Bremen, Department of Computer Science and Mathematics, zach@cs.uni-bremen.de
Location: Kiel
Disciplines: virtual reality, computer science
Keywords: immersive scientific visualization, collaborative 3D interaction in VR with scientific data
ARENA2 projection dome at GEOMAR (Mars scene courtesy NSC Creative).
Motivation: The seafloor is practically inaccessible to humans, so researchers rely on unmanned probes and elaborate robotics even to get a time-limited, incomplete view of this remote world. Most often, this is not enough to build a mental map and, as a result, a spatial understanding of the seafloor, in particular for geologists, benthic habitat mappers and many other field researchers who are trained to work on site from their personal perspective. Fortunately, research has shown that immersive visualization techniques can create that sense of presence and, thus, increase efficiency. However, much needs to be improved in immersive scientific visualization in order to achieve a level of presence and collaboration close to real-life experiences. These improvements are fundamentally concerned with data science: how to manage and present the vast quantities of visual data available from the seafloor in a seamless, realistic and multi-user way across multiple locations. Building on the state of the art in virtual reality research, including latest developments of production-quality game engines, this PhD project shall develop concepts, scientific visualization methods, 3D interaction metaphors, and immersive virtual reality tools for geographically remote researchers to share and explore a meaningful virtual environment for collaborative virtual fieldwork on the seafloor.
The project will evolve around the visualization of cutting-edge, large scale photogrammetric scans of hydrothermal (black smoker) vent fields and related volcanic structures of the midoceanic ridges. These spatially complex outcrops have never been visualized yet in enough detail and completeness, including powerful terrain visualization, so as to answer important scientific questions and even spark new ones. This requires interactive queries on the model and its underlying meta data, performant real-time collaboration of virtual working groups of up to four researchers, and an agile, but clean and sustainable annotation recording and session management - all major data science challenges presently unsolved in the visualization realm. The scientific goal is to ultimately prove that such methodologies and tools can provide a quantitative added value to field researchers. Therefore, we will also consider usability studies with partnering researchers in that field.
Large-screen, two-user stereo projection wall (Powerwall) at U. Bremen.
Aim: This PhD project will draw upon visualization resources both at the CGVR lab at University of Bremen (in particular, the two-user powerwall, i.e., large-screen stereoscopic projection wall with tracking and correct projection for two users simultaneously), and at GEOMAR (the ARENA2 visualization dome theatre) as well as head-mounted display “satellite systems” (e.g., wireless VIVE at CGVR), to form a connected ecosystem. Where suitable, we will rely on existing frameworks such as Unreal, Unity, or OpenSpace. For real-time rendering, we will develop multi-user compatible level-of-detail techniques for tiled terrain, the black smokers, and meta-data. In order to mitigate effects of latency between sites, our approach will be to develop predictive interaction techniques and suitable local proxy metaphors. For co-located, immersive 3D interaction, we will explore techniques that allow each user to be fully aware of the other user’s state and intentions at all times.
References:
Lange, Weller, Zachmann: GraphPool: A High Performance Data Management for 3D Simulations. ACM SIGSIM PADS , Banff, AB, Canada, May 15 - 18, 2016.
Kwasnitschka, T., 2017, Planetariums - not just for kids.: Nature, v. 544, p. 395, doi: 10.1038/544395a.
Kaluschke, Weller, Zachmann: A Volumetric Penetration Measure for 6-DOF Haptic Rendering of Streaming Point Clouds. IEEE World Haptics Conference 2017, June 6 - 9, 2017.
Cohrs, Kremer, Klimke, Zachmann: Time-efficient and Accurate Spatial Localization of Automotive Function Architectures with Function-oriented 3D Visualization. Computer-Aided Design and Applications 2015, CAD'15 Journal, Taylor & Francis.