The Vision Pro uses 3D avatars on calls and for streaming. These researchers used eye tracking to work out the passwords and PINs people typed with their avatars.
  • subignition@fedia.io
    0·
    8 days ago

    From the article:

    Your eyes are your mouse when using the Vision Pro. When typing, you look at a virtual keyboard that hovers around, and can be moved and resized. When you’re looking at the right letter, tapping two fingers together works as a click.

    So they were working backwards to determine the inputs based off of the observed eye motion.

    I have a much less modern VR headset and you can definitely still type on a regular keyboard while you’re wearing it. You can’t see the keyboard though, so you need to be skilled enough to touch type. I can’t find any reliable-looking statistics on it with a quick search, but it seems like that is not a very common skill

    • noughtnaut@lemmy.worldEnglish
      0·
      8 days ago

      … Like what is not a very common skill? Touch typing in general? Or doing it under VR specifically?

      • The latter would be quite niche I suppose.
      • The former? I cry for the current and future generations. It really is not very hard to learn, realistic to master, and incredibly useful in daily (professional and personal) life.