Pinch / clench

May 20, 2021 7:18 AM

Among a collection of upcoming improvements for people with disabilities is an amazing demo of AssistiveTouch features on Apple Watch supporting people with limb differences.
posted by Stark (17 comments total)

this is really neat, but my ability to teach my mother this is still incredibly unlikely.
posted by zsh2v1 at 7:21 AM on May 20, 2021

Another assistive feature that's only getting noticed now is the addition of image descriptions to the camera app on iOS.
posted by JoeZydeco at 7:23 AM on May 20, 2021 [5 favorites]

Holy shit.

I mean, it's "just" sensing minute differences in skin resistance from how tight the watch is on your wrist. The clench being a large difference, the pinch being a smaller one. (Watch your wrist as you make these movements, as the tendons tighten, the circumference of your wrist changes.) And the timing of these motions differences being a reasonably clear indicator of intentionality.

It's just, like, someone noticed this and said, hey, we could do something with it, and then they went ahead and actually did it. I know it's just "we're going to sell more watches" but the benefits are real.

(I bought an Apple watch to check my ecg because of a family history of heart problems, and based on some long QT events realized my SSRI dose was probably too high.)

Anyway.
posted by seanmpuckett at 7:23 AM on May 20, 2021 [3 favorites]

Another assistive feature that's only getting noticed now is the addition of image descriptions to the camera app on iOS.

I tried several image description programs out on this optical illusion and the iOS description was the only one remotely close to accurate. iOS described it as "an illustration of multi-colored balls on a green background." Other models called it things like "a neon sign with neon lights on it" or "two young girls are throwing the grass".
posted by jedicus at 7:47 AM on May 20, 2021 [2 favorites]

I watched this and thought: I want a watch (or pair of watches) that can replace my keyboard! But then I tried "typing" in the air and I'm not sure I really do. It would take some getting used to, at least.
posted by ropeladder at 8:57 AM on May 20, 2021

But then I tried "typing" in the air and I'm not sure I really do. It would take some getting used to, at least.

For whatever reason, the algorithms have been heavily advertising this wearable "air" keyboard to me. I have no idea if it is any good but I imagine it being annoying after the novelty has worn off.
posted by gauche at 10:21 AM on May 20, 2021

Wow! I'll be interested to learn what people with limb differences think as the feature rolls out (this week, if I gather correctly?) and they get to experience it.
posted by brainwane at 10:47 AM on May 20, 2021 [1 favorite]

I bought an Apple watch to check my ecg because of a family history of heart problems, and based on some long QT events realized my SSRI dose was probably too high.

Press X to reduce dosage?
posted by fullerine at 10:54 AM on May 20, 2021

1. Oh hey that's really cool
2. I really disliked the touchscreen on the Apple Watch and I could find a use for this
3. I would have to disable this immediately because all these "smart" gestures make the behavior of "smart" devices incomprehensible
posted by meowzilla at 12:15 PM on May 20, 2021

Yet another case of accessible design making the whole thing better for everybody. If I ever get an Apple Watch, I am for sure going to turn some of these features on.
posted by Happy Dave at 12:38 PM on May 20, 2021 [3 favorites]

I'm impressed that not only they managed to interpret the signal coming from the phone's sensors accurately enough to capture these gestures, but that they managed to do so reliably enough to be more useful than annoying (which I'm assuming, because this is Apple and they'd kill it if it was only 95% functional).

Also, when did Apple Watch get a skin resistance sensor? I was under the impression that they were limited to an accelerometer and an optical pulse sensor. (Mind you, my Apple Watch is a 2nd-generation one, which doesn't get the new WatchOS releases any more.)
posted by acb at 1:22 PM on May 20, 2021 [1 favorite]

According to the press release, they're using the LED pulse sensor. (I was guessing resistance, and was wrong.)
posted by seanmpuckett at 1:42 PM on May 20, 2021

My main objection to Apple Watch has been that it requires two hands to operate (the hand wearing it and the hand touching it) as compared to my phone where I can do most things with one hand. This is the first time I’ve thought that maybe it’s worth a second look.
posted by cali at 1:47 PM on May 20, 2021

I have an apple watch and I run into times I wish I could do stuff on it while my other hand is occupied--like when I'm holding a baby. I've gotten decently adept at using my nose to turn off alarms. I cannot wait to try this out.
posted by sleeping bear at 2:21 PM on May 20, 2021 [4 favorites]

I work in the accessibility field and nearly everybody who can afford one uses apple devices for the voice over service. Those improvement to Voice Over reading real objects is probably the biggest real world update, followed by the eye-tracking on the iPad. They are leading with the other stuff cause the ongoing cost of Sign Language will be high and they will want folks to actually utilize that service but also because they know google/MS doesn't have anything like it. So that is also bit of marketing, which good, market the hell out of it and maybe google will feel inclined to actually join the effort and not relegate it to moonshot projects.
posted by zenon at 6:18 AM on May 21, 2021 [1 favorite]

In 2014 a right-wing group of investors challenged Apple on doing things for accessibility and sustainability, arguing that they don’t contribute to the bottom line (tho it sounds like the group also is committed to the lie that humans are not responsible for climate change). Here’s a bit on Tim Cook’s response — this moment has always stuck with me:

"When we work on making our devices accessible by the blind," he said, "I don't consider the bloody ROI." He said that the same thing about environmental issues, worker safety, and other areas where Apple is a leader.

As evidenced by the use of "bloody" in his response—the closest thing to public profanity I've ever seen from Mr. Cook–it was clear that he was quite angry. His body language changed, his face contracted, and he spoke in rapid fire sentences compared to the usual metered and controlled way he speaks.

He didn't stop there, however, as he looked directly at the NCPPR representative and said, "If you want me to do things only for ROI reasons, you should get out of this stock."

Link
posted by wemayfreeze at 7:11 AM on May 21, 2021 [7 favorites]

For whatever reason, the algorithms have been heavily advertising this wearable "air" keyboard to me. I have no idea if it is any good but I imagine it being annoying after the novelty has worn off.

Ever since I learned to touch type 30 years ago, I've found my fingers regularly air typing my stream of consciousness. I don't think I'm ready to see my entire thought stream captured in text.
posted by penguin pie at 11:49 AM on May 23, 2021