[ad_1]
Scientists at Tokyo Institute of Technology have developed a novel hybrid light field technology that utilizes a mixture of light-controlled ambient illumination and projection mapping (PM) to acquire PM in bright environments. This innovative technology utilizes a novel kaleidoscope array to achieve light-controlled illumination and a binary search algorithm to eliminate ambient illumination of PM targets. It provides an immersive augmented reality experience and has applications in various fields.
Projection mapping (PM) is a fascinating technology that smoothly blends real and virtual worlds by projecting computer-generated images onto physical surfaces, providing an immersive visual experience. It allows us to experience augmented reality without the need for special glasses. Therefore, PMs are in high demand in various fields such as stage production, fitting, makeup, and educational demonstrations.
Despite their potential, current PM methods still face challenges in bright environments with ambient lighting. Ambient lighting drowns the entire scene in light, reducing the contrast of the PM target. This is why traditional PM solutions mostly operate in dark environments. However, PM cannot provide natural scenes even in dark environments, because in dimly lit scenes, only the PM target is illuminated, while other surrounding parts remain dark, causing it to appear too bright. Additionally, non-PM objects appear too dark, breaking immersion.
To solve these problems, a Japanese research team led by Associate Professor Yoshihiro Watanabe of the Department of Information and Communication Engineering, Tokyo Institute of Technology, recently developed an innovative hybrid light field method to achieve PM in bright environments. “In this approach, instead of using normal ambient light, we introduce a hybrid light field, where a controlled light avoids the PM target while fully illuminating other areas within the scene, while the PM projector specifically illuminates the PM target. Bright target,” Dr. Watanabe.Their findings were published in the journal IEEE Transactions on Visualization and Computer Graphics and will be in No. 31 The IEEE Virtual Reality and 3D User Interface Conference will be held in Orlando, Florida, USA. The briefing is scheduled for 1:30 pm local time on March 19 (UTC-4).
At the heart of this novel approach is a lighting unit with controllable light. The device can reproduce a range of ambient lighting scenarios while avoiding illuminating PM targets. To achieve this, the researchers developed a novel kaleidoscope array that includes an array of mirrors behind a lens array that is in turn placed in front of the projector. This setup enables the projector to produce a high-density light field, which is essential for light-controlled lighting.
Additionally, to avoid illuminating the PM target, the researchers deployed a camera to capture the scene and identify pixels from the projector that illuminated the PM target and then turned it off. To identify these pixels, they used a simple binary search-based approach, resulting in an efficient hybrid light field.
This innovative approach allowed them to achieve high-contrast PM presentations in bright environments. Notably, it preserves the natural appearance and shadows of ordinary non-PM objects, solving a key challenge of PM technology. Through several fascinating augmented scenes, the researchers demonstrated the seamless coexistence of PM targets and ordinary objects, providing an immersive visual experience.
While the researchers identified some limitations, such as artifacts and inefficiencies of the binary search algorithm with large PM targets, they have identified potential solutions and are actively working to expand this approach in the future.
“Our experiments demonstrate that using this technology can effectively achieve natural PM rendering and provide accurate illumination for all objects. Mixed light fields have the potential to introduce PM into a variety of practical daily applications, such as attractions, support manufacturing and makeup try-on ,” Dr. Watanabe emphasized the application of their technology.
Overall, this approach marks an important step for PM technology, paving the way for future immersive augmented experiences.
Movie: Projection mapping in bright environments using mixed light field methods
Watanabe Laboratory
YouTube – Watanabe Labs
Magazine
IEEE Transactions on Visualization and Computer Graphics
Research methods
Experimental Study
Research Topics
not applicable
Article title
Projection mapping in bright environments using mixed light field methods
Article publication date
March 6, 2024
Disclaimer: The American Association for the Advancement of Science (AAAS) and EurekAlert! are not responsible for the accuracy of press releases posted to EurekAlert! Use any information through the contributing organization or through the EurekAlert system.
[ad_2]
Source link