iOS 15 Music Widget Redesign
Inclusive design for users who can't use their fingers to precisely control the phone screen.
（This project is stilll under constraction.）
Role
UX/UI Designer
Front-End Developer
Tools
Adobe XD, HTML/CSS/Javascript
Timeline
1.5 month - Nov 2021
Introduction
Inclusive design means designing with the diverse needs of users in mind. While it is particularly important for people with disabilities, inclusive design benefits everyone. This project is a redesign of the iOS lock screen music playback widget to address the challenge of imprecise touch control for users who are unable to use their fingers with accuracy.
Inspiration
When I was in my host family, I had to wash dishes every day. I have a habit of listening to music while doing the dishes, which allows me to enjoy a moment of solitude. However, when I want to switch songs, my watery hands with rubber gloves can't press the buttons on the screen precisely. I even have to use my elbow to tap the screen. This makes me think of people who have similar needs to me, whether they are permanently, temporarily, or in situations where they can't use their fingers to control the screen with precision.
Problem
How might we switch songs on our iPhones when we have no way to use both hands?
Research: KWHL
What do I know?
(Current Solutions)
- Tap on-screen “Next” or “Previous” buttons.
- Use Siri voice commands.
- Wired headphones: double-press or triple-press the control button.
- AirPods: double-tap to switch songs.
- Use shortcuts (e.g. iOS "Back Tap" feature via Workflow/Shortcuts app) for quick control.
What do I need to find out?
(Research Questions)
- In what situations do people struggle to use their hands to control music (e.g. driving, eating, carrying items)?
- Are these situations public or private? (Some may avoid using voice controls like Siri in public.)
- What alternative interaction methods exist beyond hand control?
- Can solutions work without requiring external devices (AirPods, smartwatches, etc.)?
- Should the solution focus on Apple’s native system or explore cross-platform challenges?
- How do other music apps (non-Apple) handle hands-free interactions?
How will I find the information I need?
(Research Methods)
- Search for articles and existing solutions on hands-free, gesture, and voice controls.
- Interview frequent music app users about their real-life experiences.
- Test and analyze popular music apps to review existing hands-free interaction models.
What have I learned?
In many “hands-busy” situations (driving, eating, carrying objects), users often tolerate the inconvenience rather than struggle to operate their phones.
Many Android phones offer overhead gesture controls, but these require users to learn complex gestures and often feel equally inconvenient.
- iPhone’s voice control (without Siri) allows full music control but has major usability concerns:
- Hidden feature, difficult to discover and learn
- Always-on voice detection raises power, privacy, and usability concerns
- Risk of unintentional activation in daily conversations - Users feel awkward using voice control in public due to social discomfort.
- Driving presents a critical hands-free scenario that’s challenging for non-drivers to evaluate fully.
- While the problem starts with music interaction, it's part of a broader category of hands-free mobile interactions.
- Sliding gestures are easier to perform than precise tapping — they allow less accurate input while still being effective.
