One swipe decoder for many XR keyboards
Gesture keyboards in AR and VR produce very different swipe data. Snapping swipes to coarse key regions let us pre-train one decoder that works across them without retraining.
Smartphone typing without the smartphone
STAR turns the sides of your index fingers into an AR keyboard you type on with both thumbs, reusing smartphone skills. It reached 21.9 WPM after 30 minutes.
Switch menu modes with a glance
On tablets, a glance at a menu item can replace the hand's trip to the menu, and a gaze-and-drag variant cut mode-switching time by almost half.
Dropping in on a friend's smartglasses
ARcall lets a friend on a phone see a smartglasses wearer's view, send AR content into their world, and talk, in short sessions the wearer controls.
Keyboard shortcuts without pressing a key
Typealike turns 36 hand postures on, beside, or below a laptop keyboard into commands, recognized by the built-in webcam and a mirror reflector.
