Internship Project

True VROOM
Usability Testing

In brief

  • Internship Project.

  • Lead Usability Testing.

  • Remote & in-person usability testing.

  • Task-based usability testing & interview.

  • Internal & External users

  • Duration April - May 2023.

  • I created and planned for prototyping.

  • I re-designed it based on user feedback and presented it to the PO, PM, and Developers.

My internship with True Digital Group occurred from March to June 2023. Although most of the internship was conducted remotely, I was fortunate to visit my hometown during this period. While there, I conducted in-person usability testing sessions with internal users. Upon returning to Chicago, I continued conducting remote usability testing, engaging both internal and external users.

Project Overview

True VROOM is the online meeting platform developed by True Digital Group, which has already undergone two versions: VROOM versions 1 and 2. Our goal is to gather early feedback on the recent design improvements we made in True VROOM 2.1. Based on the users' feedback regarding their experience with usability and any problems or challenges they might encounter, it will help us enhance the design of version 2.1.

Problem

Users have reported design issues in the user experience (UX) and user interface (UI) of VROOM versions 1 and 2, leading to difficulties in navigation and usability. We are introducing the design of version 2.1 and conducting user testing and interviews to gather user feedback.

Based on this feedback, we will make design recommendations to enhance the usability of VROOM 2.1.

We divided the users into two groups:

Group 1 consists of three internal users and two external users.

Tasks

  • Sign up / sign in

  • Sign out

  • Join a meeting

  • Pin someone (as Focus mode)

  • Share presentation

  • Change the virtual background

  • Share meeting

  • Chat - Texting and replying

Group 2 is composed of a moderator and five internal users.

Tasks

  • Sign in/Create an instant room/Schedule a room

  • View participants

  • Mute everyone/Mute participant

  • Pin yourself/Pin participant

  • Start recording/Stop recording

  • Share a meeting/Share livestream

  • Setting - No distraction/Watermark

After conducting the task-based usability testing, I interviewed all the users regarding their overall experience with V.2 and V.2.1. During these interviews, I asked for additional suggestions and ideas. I compiled all the gathered suggestions and ideas to facilitate a redesign based on the results obtained from the usability testing.

Design based on Usability Testing results

Group 1 - All Users

Usability Test Results

Group 1 - All Users

We conducted testing with Group 1, which included 5 participants performing 8 tasks. Here are the results:

  • Tasks completed by all 5 users: Sign up / sign in, Pin someone (as Focus mode), Share presentation, Change the virtual background, Share meeting, Chat - Texting and replying.

  • Tasks uncompleted by all 5 users: Sign out.

  • Tasks completed by 4 out of 5 users: Join a meeting

Design based on Usability Testing results

Group 2 - Moderator

Usability Test Results

Group 2 - Moderator

We conducted testing with Group 1, which included 5 participants performing 7 tasks. Here are the results:

  • Tasks completed by all 5 users: Sign in/Create an instant room/Schedule a room, View participants, Pin yourself/Pin participant, Start recording/Stop recording, Share a meeting, Setting - No distraction/Watermark

  • Tasks completed by 4 out of 5 users: Mute participant

  • Tasks completed by 2 out of 5 users: Share livestream

  • Tasks uncompleted by 1 out of 5 users: Mute everyone

Tasks uncompleted by all 5 users: Sign out.

The findings indicate that 5 users attempted to sign out using the 'Setting icon'. It would be beneficial to have either the 'Profile icon' or the 'Setting icon' accessible on the same screen, as users naturally expect to find the sign-out function within the settings.

Tasks completed by 4 out of 5 users: Join a meeting

Out of 5 users, 1 clicked on ‘Room name’ to join a meeting, while 3 out of 5 users perceived that 'recent room' referred to previous meetings rather than ongoing ones.

1 user said that to mitigate confusion, it's advisable to replace the 'VDO icon' with the text 'join' as using the video icon might mislead users to assume it involves turning on the camera.

Moreover, making the room name clickable would enhance user interaction and ease of joining meetings.

Tasks completed by 4 out of 5 users: Mute participant

Regarding muting individual participants, it was suggested to integrate 'Mute participant' as a primary function in the tile view. This way, moderators can simply click on a specific participant in the tile view and immediately mute them, as muting someone should be an immediate action.

Tasks completed by 1 out of 5 users: Mute everyone

While one participant managed to mute everyone, it took some time to locate this function. The remaining participants anticipated muting everyone from the room option.

All participants recommended including the 'Mute everyone' feature within the room option for easier access, as they considered muting everyone a primary function for the moderator.

Tasks completed by 2 out of 5 users: Share livestream

Most participants thought live streaming would be part of the room options. They wanted a different way to share live streams compared to regular meetings.

They suggested keeping live streaming separate from regular sharing. They wanted live streaming to have its own feature, not mixed with regular sharing.

Next Steps

Based on the feedback from user testing version 2.1, we have gathered all the findings and insights. We have identified three features that require improvement:

  1. Number of characters on the top navigation bar

  2. Re-locating the icons on the top navigation bar

  3. Re-prioritizing the functions in the room option

We aim to simplify the user experience and make the app more effective and user-friendly.