Usability Testing

One of the key strategies for making decentralized applications commercially successful is to create an intuitive user experience for different audiences.

Photo by Robin Worrall

At æternity, we test all key user interfaces, which we design against the expectations of users with varying levels of experience with blockchain technology.

The experience which you, the user, have is of the highest importance in our design process!

Usability Testing Process

So how do we make sure we create the most intuitive user experience? Our approach consists of identifying all the areas where users might be struggling with the complexity of applications running on the blockchain and improving their experience. We do this following the process outlined below.

Prep Work

First we identify the user pathways that we’d like to test/improve. Then we prepare a script with these pathways. In the script we have to articulate the pathways as user stories. After we have included all the user stories, which we would like to test in the script, we use them to create a prototype.

Selecting Testers

Depending on what æpp and which functionality from an æpp we are testing, we look for the appropriate audiences we would like to test with. As mentioned previously, we want to cover audiences from all levels of experience and varying demographics. For example, in testing our Token Migration web application, we were interested in users who are:

  • æternity token holders
  • spread across the globe
  • not super advanced blockchain users, as we want to make sure that the migration interface is intuitive for all levels of experience with blockchain technology.

In general, we always have the option of conducting user testing sessions in person or virtually. In the example above, it made more sense to source testers all over the globe and do the testing virtually.

During the Sessions

The sessions are always done in real time with screen and audio recording. During each session, a host from æternity asks the tester to go through the user stories in the script, gathering feedback about the friction or smooth experience of these pathways. Additionally, we gather general and free-form feedback, which users are usually keen to provide.

Screengrab from a recording of a usability testing session of our Token Migration web application click-through prototype.

Analyzing the Input

After all sessions are conducted, we extract the feedback that was received during the sessions.

We prioritize all input points based on the severity of barriers that users encounter.

For example, if a user story includes the user navigating from one section of the æpp, let’s say the account manager in the Bаse æpp, to another, the æpps browser, and for whatever reason they do not realize where to tap to open the æpps browser, we consider this a rather severe barrier, as it prevents them from completing the task outlined by the user story (in this case switching from the account manager to the æpps browser functionality).

Once we have a list of items we would like to work on, we turn them into concrete tasks. We do this by going back to the user story stating that “as a user I would like to be able to do X for reasons Y, Z,” and identify the task of coming up with a different solution to the task which the user would like to complete.

Cycle Types

We choose different iteration types depending on the severity of the barriers/friction which users encounter during the testing sessions. For example, if a user is unable to complete a fundamental pathway and we need to propose a new solution to a story from our script, it makes sense to create a new prototype and get user feedback from it (arrow #2: prototype => feedback, in the diagram above).

However, if we are not fundamentally changing our approach, say we are redesigning an icon, the function of which some users easily understood, while others struggled to comprehend, we may decide to simply request internal feedback on the redesign and test the icon with users at a later time, when we have more fundamental barriers to test (arrow #1: design => feedback). In some cases, we only need to make small refinements (ex. text changes, adding clarifications). If this is the case, we can adjust our designs, and then go straight to implementing the designs and preparing them for a release (arrow #3: design => build => release).

Iterate, Iterate, Iterate

We work using a highly iterative process, at the center of which is the user — it is paramount to us that users experience intuitive and seamless æpps, which allow them to complete the tasks they are interested in. Depending on what æpp and æpp functionality we are working on, we might go through multiple iteration/repetitions in the loops illustrated above until we reach a version of the design and build, which we would like to release. Additionally, at the end of each sprint, we present the design updates which we made to our æpps and get feedback on them internally.

The Value of User Testing

The observations which, you, the users, have provided have already been invaluable.

We care deeply about providing a frictionless user experience and the insights we have gathered during our usability testing sessions have greatly influenced our user experience design decisions.

Conclusion

We hope that this insight into our usability testing process has provided an opportunity for readers to understand the importance and inner workings of our design and testing cycles. If you have any questions or comments related to this, feel free to ask them in æpps category in the Forum.


Interested in æternity? Get in touch:

GitHub | Forum | Reddit | Telegram | Twitter | Facebook | Mail


Leave a Reply

Your email address will not be published. Required fields are marked *