Comparing Completion Time, Accuracy, and Satisfaction in Virtual Reality vs. Desktop Implementation of the Common Coordinate Framework Registration User Interface (CCF RUI)

AI-generated keywords: HuBMAP RUI VR tissue blocks user study

AI-generated Key Points

  • The Registration User Interface (RUI) was developed for stakeholders in the Human Biomolecular Atlas Program (HuBMAP) to register tissue blocks by size, position, and orientation.
  • RUI has been used by tissue mapping centers across the HuBMAP consortium to register a total of 45 kidney, spleen, and colon tissue blocks.
  • A user study involving 42 human subjects was conducted to compare the performance of three setups: traditional 2D Desktop implementation, VR Tabletop, and VR Standup.
  • Results showed that while VR Tabletop and VR Standup users were about three times as fast and about a third more accurate in terms of rotation than 2D Desktop users, there were no significant differences for position accuracy.
  • The 2D Desktop version is well-suited for registering tissue blocks at a speed and accuracy that meets the needs of experts performing tissue dissection. It is also cheaper, easier to learn, and more practical for wet-bench environments than the VR setups.
  • Future work includes testing interventions to help users improve their performance during the experiment by running a study with a “reflective” phase where the user sees a visualization of their own performance data from previous tasks before completing a second set of tasks.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Andreas Bueckle, Kilian Buehling, Patrick C. Shih, Katy Börner

34 pages/9 figures in main text; 6 pages/1 figure/2 tables in Supporting Information
License: CC BY 4.0

Abstract: Working with organs and tissue blocks is an essential task in medical environments. In order to prepare specimens for further analysis, wet-bench workers must dissect tissue and collect spatial metadata. The Registration User Interface (RUI) was developed to allow stakeholders in the Human Biomolecular Atlas Program (HuBMAP) to register tissue blocks by size, position, and orientation. The RUI has been used by tissue mapping centers across the HuBMAP consortium to register a total of 45 kidney, spleen, and colon tissue blocks. In this paper, we compare three setups for registering one 3D tissue block object to another 3D reference organ (target) object. The first setup is a 2D Desktop implementation featuring a traditional screen, mouse, and keyboard interface. The remaining setups are both virtual reality (VR) versions of the RUI: VR Tabletop, where users sit at a physical desk; VR Standup, where users stand upright. We ran a user study involving 42 human subjects completing 14 increasingly difficult and then 30 identical tasks and report position accuracy, rotation accuracy, completion time, and satisfaction. We found that while VR Tabletop and VR Standup users are about three times as fast and about a third more accurate in terms of rotation than 2D Desktop users, there are no significant differences for position accuracy. The performance values for the 2D Desktop version (22.6 seconds per task, 5.9 degrees rotation, and 1.32 mm position accuracy) confirm that the 2D Desktop interface is well-suited for registering tissue blocks at a speed and accuracy that meets the needs of experts performing tissue dissection. In addition, the 2D Desktop setup is cheaper, easier to learn, and more practical for wet-bench environments than the VR setups. All three setups were implemented using the Unity game engine, and study materials were made available, alongside videos documenting our setups.

Submitted to arXiv on 24 Feb. 2021

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2102.12030v1

The Registration User Interface (RUI) was developed to enable stakeholders in the Human Biomolecular Atlas Program (HuBMAP) to register tissue blocks by size, position, and orientation. The RUI has been used by tissue mapping centers across the HuBMAP consortium to register a total of 45 kidney, spleen, and colon tissue blocks. In this paper, the authors compare three setups for registering one 3D tissue block object to another 3D reference organ (target) object. The first setup is a traditional 2D Desktop implementation featuring a screen, mouse, and keyboard interface. The remaining setups are both virtual reality (VR) versions of the RUI: VR Tabletop, where users sit at a physical desk; VR Standup, where users stand upright. A user study involving 42 human subjects completing increasingly difficult tasks was conducted to compare the performance of these three setups. Results showed that while VR Tabletop and VR Standup users were about three times as fast and about a third more accurate in terms of rotation than 2D Desktop users, there were no significant differences for position accuracy. The performance values for the 2D Desktop version confirm that it is well-suited for registering tissue blocks at a speed and accuracy that meets the needs of experts performing tissue dissection. Additionally, the 2D Desktop setup is cheaper, easier to learn, and more practical for wet-bench environments than the VR setups. The paper also presents an overview of materials and methods used in conducting this study including task difficulty metrics generation using synthetic tasks generation; human performance metrics such as plateau; satisfaction score computation; power analysis conducted prior to running the experiment to determine the number of subjects required to achieve significant results; typical user study design featuring pre- and post-questionnaires with tutorial and experiment tasks; all subjects using Alienware laptop running Unity game engine on Windows 10 with secondary monitor attached for ease of configuring individual steps of the experiment; and data collection using a custom C# script writing data to a CSV file at a frequency of 10 Hz every time the user pressed a button. Future work includes testing how interventions could help users improve their performance during the experiment by running a study with a “reflective” phase where the user sees a visualization of their own performance data from previous tasks before completing a second set of tasks. The authors aim to use interactive data visualizations to help users formulate strategies to improve their performance in terms of position accuracy, rotation accuracy, and completion time. Additionally, given the detailed telemetry data collected from RUI users (especially those in VR), an intervention where users can see their own movement as well as the position and rotation of the tissue and target blocks over time is planned. The HuBMAP project aims to create an unprecedented reference atlas of healthy human bodies at single-cell resolution which will capture spatial information about cells and tissues in detail so as develop novel approaches towards curing diseases through hundreds researchers from several dozen institutions across U.S., Europe & other countries worldwide .
Created on 11 Apr. 2023

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.