Comparing 2D and Augmented Reality Visualizations for Microservice System Understandability: A Controlled Experiment

AI-generated keywords: Augmented Reality Microservices Visualization Software Engineering Experiment

AI-generated Key Points

  • The study explores the use of augmented reality (AR) as a visualization tool for microservices in service-oriented design.
  • The experiment followed a 2x2 crossover design where each participant group used both visualization tools - 2D and AR.
  • The study aimed to prevent one tool from exerting more influence than the other by using abstract names for the two tools and randomly ordering the order of tool execution.
  • Results show that the 3D visualization enables novices to perform as well as experts in detecting service dependencies, especially in large systems while no differences are reported for identifying service cardinality or bottlenecks.
  • Due to compatibility issues with six participants' mobile devices not meeting minimum OS requirements, they struggled to use the AR tool resulting in a lack of AR tool results for four small and two large participants; therefore participant assignments were slightly adjusted.
  • The study recommends industry and researchers further investigate AR for microservice architectural analysis, especially to ease the onboarding of new developers in microservice projects.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Amr S. Abdelfattah, Tomas Cerny, Davide Taibi, Sira Vegas

The paper (10 pages) is accepted in ICPC 2023
License: CC BY 4.0

Abstract: Microservice-based systems are often complex to understand, especially when their sizes grow. Abstracted views help practitioners with the system understanding from a certain perspective. Recent advancement in interactive data visualization begs the question of whether established software engineering models to visualize system design remain the most suited approach for the service-oriented design of microservices. Our recent work proposed presenting a 3D visualization for microservices in augmented reality. This paper analyzes whether such an approach brings any benefits to practitioners when dealing with selected architectural questions related to system design quality. For this purpose, we conducted a controlled experiment involving 20 participants investigating their performance in identifying service dependency, service cardinality, and bottlenecks. Results show that the 3D enables novices to perform as well as experts in the detection of service dependencies, especially in large systems, while no differences are reported for the identification of service cardinality and bottlenecks. We recommend industry and researchers to further investigate AR for microservice architectural analysis, especially to ease the onboarding of new developers in microservice~projects.

Submitted to arXiv on 03 Mar. 2023

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2303.02268v1

This paper presents a study that explores the use of augmented reality (AR) as a visualization tool for microservices in service-oriented design. Microservice-based systems can be complex to understand, especially as they grow in size, and abstracted views can help practitioners gain system understanding from a certain perspective. Recent advancements in interactive data visualization have led to questions about whether established software engineering models remain the most suited approach for visualizing system design in microservices. The study proposes presenting a 3D visualization for microservices in AR and analyzes whether such an approach brings any benefits to practitioners when dealing with selected architectural questions related to system design quality. The experiment followed a 2x2 crossover design where each participant group used both visualization tools - 2D and AR. The participants were balanced based on system size and experience level, with ten small and ten large systems, and novice and experienced participants assigned to each system. The study aimed to prevent one tool from exerting more influence than the other by using abstract names for the two tools. Additionally, the order of tool execution was randomly ordered so that some participants completed the study in reverse order from others. The experiment duration was one hour, which included ten minutes for training, thirty minutes for executing the experiment and answering tasks related to identifying service dependency, service cardinality, and bottlenecks, and ten minutes for filling out feedback forms. The feedback step consisted of usage-related criteria questions using an ordinal 5-point Likert scale (1 is worst; 5 is best) and open-opinion questions that were analyzed to extract common thoughts and recommendations. Results show that the 3D visualization enables novices to perform as well as experts in detecting service dependencies, especially in large systems while no differences are reported for identifying service cardinality or bottlenecks. Due to compatibility issues with six participants' mobile devices not meeting minimum OS requirements (minimum Android 8 or iOS 11), they struggled to use the AR tool resulting in a lack of AR tool results for four small and two large participants; therefore participant assignments were slightly adjusted. In conclusion, the study recommends industry and researchers further investigate AR for microservice architectural analysis, especially to ease the onboarding of new developers in microservice projects. The assessment of the procedure indicated that all participants were able to carry out the 2D experiment successfully; nonetheless six participants could not install the AR tool due to compatibility issues with their mobile devices.
Created on 11 Apr. 2023

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.