iOS 15 Music Widget Redesign
Inclusive design for users who can't use their fingers to precisely control the phone screen.
（This project is stilll under constraction.）
Role
UX/UI Designer
Front-End Developer
Tools
Adobe XD, HTML/CSS/Javascript
Timeline
1.5 month - Nov 2021
Introduction
Inclusive design means designing with the diverse needs of users in mind. While it is particularly important for people with disabilities, inclusive design benefits everyone. This project is a redesign of the iOS lock screen music playback widget to address the challenge of imprecise touch control for users who are unable to use their fingers with accuracy.
Inspiration
When I was in my host family, I had to wash dishes every day. I have a habit of listening to music while doing the dishes, which allows me to enjoy a moment of solitude. However, when I want to switch songs, my watery hands with rubber gloves can't press the buttons on the screen precisely. I even have to use my elbow to tap the screen. This makes me think of people who have similar needs to me, whether they are permanently, temporarily, or in situations where they can't use their fingers to control the screen with precision.
Problem
How might we switch songs on our iPhones when we have no way to use both hands?
Research: KWHL
What do I know?
Possible methods currently used to solve this problem:
- Tap the “next” button on the screen;
- Call Siri to change the song for you;
- If you have a pair of wired headphones with iPhone support, press the “talk” button(usually the middle button of headphones) twice to change to the next song and three times to change to the previous song;
- If you’re using AirPods, tap the headphones twice to change the song;
- Or consider using Workflow to create shortcut commands to quickly switch songs, for example, connect tapping the phone’s back twice or thrice action to song switching.
What do I need to find out?
- What kind of state are people in when they can’t use their hands to control their phones to change songs? What are the other possible ways for them to control or touch their phone?
- Are these scenes private or public? Consider one problem: People may not want to call out for Siri in public. It is also important to take into account whether people wear headphones in different situations.
- How do other smart applications deal with situations where it is difficult for users to use their hands?
- Is the “cannot use hands” situation too absolute? Consider using any method other than hands to simply operate the phone to switch songs. Can this approach be made without any external devices (such as AirPods)
- Can we focus on the phone’s default music mode or a specific application of this instruction?
- Is the default music playback interface on phones other than Apple as difficult to operate without hands as it is on Apple systems?
How will I find the information I need?
- Look for information on the web and use search sites like Google to gather information about voice control and touch-less operation. Find everything related to “What do I need to find out”?
- Do some direct interviews with people who regularly use music apps to listen to songs.
- Use and test some mainstream music applications to record and analyze information related to contactless song-switching interaction in them.
What have I learned?
- In assumptive situations where hands are not available (holding something with both hands, driving, eating, etc.), some people would rather put up with not being able to respond instantly (answering a call, hitting the alarm, skipping a song) than immediately struggle to release their hands to touch the phone. This is a subconscious action that does not change the consciousness of the people, and is based on the long-standing “cell phone is a device you have to touch to use it”. In the same scenario without the difficulty of not being able to use their hands, people are happy to go easy on fixing these glitches.
- The contactless operation, is often referred to as “hands-free”. Currently, there are many Android phones that support screen control via overhead gestures. But this technology is also being seen as less valuable. Users need to learn more complicated posture operation to use this feature. Using hand gestures is about as troublesome as people overcoming the difficulty of not being able to use their hands.
- IPhone has a powerful voice control function, which has fully realized the operation of smoothly switching songs by customizing voice control commands without Siri. But there are still many problems with this feature. First of all, it is rather hidden, not easy to find, and not friendly to newbies. It took me a long time to learn to operate it. Secondly, turning on voice control means that the phone’s voice recognition function will be constantly on, and the iPhone will always collect the user’s voice. This may have cause power consumption issues, privacy concerns, and may also conflict with the phone’s daily use (perhaps you may say something unintentionally that your phone mistakenly thinks it’s receiving a command).
- In addition, people are often reluctant to use the hands-free function via voice control in public places. In the interview, one participant mentioned that using Siri outside would make her feel embarrassed.
- An important scenario in which you cannot use your hands is when you are driving. As someone who doesn’t own a car, this is a difficult point for me to think about beforehand.
- This is an interaction related to listening to songs, but it is also an issue related to any interaction where you cannot use your hands.
- After testing, it occurs to me that the sliding control is more sensitive on the touch screen than tapping, and does not require precise control and a very small contact area like a finger.
User Journey Map
Low Fidelity Wireframes
High Fidelity Wireframe
