Apple has unveiled new accessibility features for its Vision Pro headset that will significantly enhance its capabilities as a tool for eyesight assistance. These features, set to launch with visionOS later this year, leverage the headset’s primary camera to magnify both real-world and virtual objects and offer live, machine-learning-driven descriptions of the user’s environment. The magnification feature allows users to zoom in on objects, such as a recipe book or an app interface, making it easier to read and interact with them. This functionality is particularly useful for tasks that typically require holding a device in one hand and performing actions with the other, offering a more hands-free and convenient experience. Apple’s VoiceOver, a well-established accessibility tool, will be integrated into visionOS to provide detailed descriptions of surroundings, assist in finding objects, and read documents aloud. This will greatly aid individuals with visual impairments, enabling them to navigate and engage with their environment more independently. To further expand these capabilities, Apple plans to release an API granting approved developers access to the Vision Pro’s camera for building custom accessibility applications. This could open the door to innovative solutions like live, person-to-person visual assistance through apps such as Be My Eyes, allowing users to receive real-time help with understanding their surroundings without needing to hold a smartphone. While the Vision Pro has seen relatively limited sales, these advanced features hint at broader applications in future Apple wearables. There are rumors of upcoming products like camera-equipped AirPods and smart glasses similar to those developed by Meta and Ray-Ban, which could benefit from these accessibility enhancements. Additionally, Apple is introducing a new protocol in visionOS, iOS, and iPadOS to support brain-computer interfaces (BCIs). This protocol, which builds on the existing Switch Control feature, will allow for various alternative input methods, such as controlling the device through head movements captured by the iPhone’s camera. The development is a result of collaboration between Apple and Synchron, a company specializing in brain implant technology. Synchron’s brain implants can enable users to select icons on a screen simply by thinking about them, though they currently do not support more complex functions like mouse movement, which competitors like Elon Musk’s Neuralink have demonstrated. This integration marks a significant step towards making Apple devices more accessible to users with severe motor disabilities. Overall, these new features underscore Apple’s commitment to advancing accessibility in its technology and pave the way for innovative applications in future products.