Evaluating Screen-less Facebook for Blind & Visually impaired (BVI)
Discovery of customers’ mindset and then service evaluation for a redesign project

1. Overview

I joined Prof Davide’s (founding Chair for the Department of Human-Centred Computing) research lab as a UX Research assistant in Aug'21 2021. This project is under NSF (National Science Foundation) grant to explore navigating technology without screens.

Role & Responsibilities:

As an independent researcher, I was responsible to create a prototype simulation and perform evaluative studies with blind & Visually impaired people.

Timeline:

Nov’21 - Jan’21 | 15 months

Project Type:

Accessibility | Academic project

Why Screen-less?

It’s natural to pull out your smartphone and check a notification or message. But what if you could do these things without picking up the phone — or even looking at it?
The intent is to make social media accessible for blind and visually impaired (BVI) people especially when they are travelling from one place to another. We are aiming to make technology usage easier on the go.

The Problem

From the previous research, we found that Blind and visually impaired people are facing privacy-related problems while using technology in their day-to-day life.

Design Challenge

How might we help blind and visually impaired people to navigate through Facebook using a single hand while keeping their content/conversations private?

The Solution

Designing a novel concept - an aural navigational platform for blind or visually impaired people to use Facebook without any screen involvement. Meaning BVI can use Facebook when their device is either in a bag or in their pockets.

2. Concept Development

When I looked on the internet, there was no such product existed to take inspiration from. Not much work has been done in the screen-less area.

So I decided to backtrack the whole project where I will create the novel product first and then conduct the evaluative study to validate the usability and efficiency of the product.

Task selection for concept development

Because Facebook is very vast and has numerous features, it was a bit tough to decide what to design and where to start. Looking at the insights from secondary research, ‘sharing a post' is the most used feature by blind and visually impaired people. So, I decided to consider a scenario considering a few features including sharing and messaging.

Jonathan (blind since birth) is travelling to office on a bus.

He is scrolling through a Facebook news feed using TapStrap device.

He found an interesting post & thought of sharing it with his friend

He shares the post with his friend Ryan Skinner.

Concept Demo

Click here is see the process of concept making

3. Concept Evaluation

Making a fully developed concept would have taken a lot of time. So, I decide to mimic the entire concept by using the Wizard of Oz method where users will perform the actions and the researcher (the wizard) will operate the system manually. Below is the snapshot of how I created the environment within lab.

🎯 User Testing Goals

The overarching goal of this study is to understand the users’ perception on the newly designed Screen-less approach to use social media. We are specifically looking to get feedback on:

  • Overall experience of using screen-less approach
  • Interaction experience with navigational flow
  • Familiarity with the audio cues

Methodology

Why -
To understand the users’ feedback and perception on the newly designed Screen-less approach to use social media.
Whom -
8 Blind & Visually Impaired people
What -
Summative Research using Wizard of Oz
Where -
Usability lab at IUPUI [In-person research within controlled settings]

💻 Voiceflow Prototype

I replicate the entire concept on a Voiceflow tool which is originally used to create the conversational prototypes. Voiceflow is robust enough to provide the audio feedback to the participant who is performing the task.

🧙 Wizard of Oz Setup

✏️ Insights from Wizard of Oz

  • Non-familiarity with the audio icons -
    Some audio icons were not familiar to the participants. It was difficult for them to map such audio icons with the associated interactions.
    Quote- "It makes me hesitate to do that gesture because of the non-familiarity of audio cues.”
  • Treatment for Selectable & Non-selectable -
    Participants suggested to add an indication to understand what is selectable and non-selectable. For example, On mobile screens - we know buttons can be selected and texts can be read out. Treatment for texts and buttons should be different here.
  • Additional gestures required -
    There should be some gesture to hear the post/item text again. Currently, participants are required to go forward or backward to hear the text again.
    Quote - “I missed few parts of post. how can I hear it again?”
  • Terminology mismatched -
    Participants got confused about the "Facebook home page - 9 items" command with the "Facebook icon notification" from the Mobile App drawer. They thought they had 9 notifications within Facebook App. It was not clear that they already had entered in the Facebook app.

4. Impact & Status

✍🏻 Impact

  • The research findings helped team fill knowledge gaps and understand user's perspective and necessary improvements needed to make on concept simulation.
  • Difficulties we faced during WoZ testing were helpful to learn new problem solving skills.
  • The research activity helped researchers and designers to collaborate effectively with front end developers.

⚡️ Current Status

I am improving the screen-less concept by incorporating the feedback I've got so far. At the same time, developers has started building the real prototype to perform the second rounds of testing with BVIs.

Stay tuned for the updates!

5. Learnings

High level view of  AePS functionality
  • Structured approach helped me to sustain -
    Structural work is important when the project is complex and has a number of different moving parts. It helped me to plan everything in advance and make progress as per the timeline.
  • Familiarity with assistive technology saved me -
    It is important to get familiar with the basic ways people use assistive technology. It helps to gain empathy for the user and helps to understand the technology itself.
  • Personal growth is important to me -
    I would have never realised my potential unless I pushed my boundaries. I was anxious when I started the project because of the entirely new domain. But eventually, I worked hard once I dive deeper into the subject. At last, this was the most excited project I worked during my master's degree.

6. Toolstack

High level view of  AePS functionality
  • Voiceflow
  • Adobe XD
  • Zoom
  • Pen & Paper
  • Figma
  • Miro
See More Projects