Researchers at the University of Arizona have developed a groundbreaking 3D sensing technology capable of accurately mapping environments containing both matte and highly reflective surfaces. Published in Nature Communications, the study details a method that turns entire surroundings into a virtual screen, overcoming a major limitation in current machine vision systems. While human eyes effortlessly adjust to glare from shop windows or dark underpasses, existing 3D sensors struggle with mixed reflectance scenes found in real-world settings like self-driving car interiors or surgical sites. Most current technologies are optimized for either diffuse matte surfaces or specular reflective ones, failing when both appear in the same frame. The team, led by Florian Willomitzer, addressed this by adapting a technique called deflectometry. Traditionally, this method requires a large physical screen to project patterns onto reflective objects to measure their shape. To avoid the cost and bulk of such setups, the researchers proposed using the room's own matte surfaces as a virtual screen. A laser scanner captures the entire environment, including walls and objects with varying textures. Advanced algorithms then computationally separate the matte areas from the specular ones. The 3D shape of the matte parts is evaluated directly, while the reflective parts are measured by analyzing how they reflect the light patterns off the surrounding matte surfaces. This effectively repurposes the entire scene into a giant display for measurement. To enhance performance, the system utilizes a neuromorphic event camera rather than a conventional frame-based camera. This specialized sensor captures only changes in the scene at extremely high speeds, allowing it to handle vast differences in lighting conditions and capture 3D video of moving objects. Aniket Dashpute, the study's first author, explained that this approach enables high-resolution imaging regardless of whether an object is glossy metal, wet tissue, or a dark fabric. Jiazhang Wang, a co-author, noted that the event camera's ability to manage varying light levels ensures high accuracy across all surface types. Currently demonstrated in a laboratory setting, the technology is designed to be scalable for diverse applications. Potential uses range from navigating autonomous vehicles through complex city streets to guiding robotic surgery with precision on glistening organs. It could also improve industrial inspection of freshly painted car bodies and the digitization of entire buildings. By enabling machines to see in 3D better than humans in challenging conditions, this innovation paves the way for more reliable navigation, medical guidance, and industrial sensing. The research highlights a shift from mimicking human vision to significantly augmenting machine capabilities through computational separation and environmental repurposing.