ToF Returns
ToF (Time of Flight) sensors were a hot topic two years ago, and we admit we were certainly intrigued by the ability of these devices to create an image map that allows for accurate depth resolution that can be used by imaging applications to make adjustments to focus based on object location. LG Electronics was the first to incorporate such sensors in 2014 as part of the LG G3 smartphone, but the first well-known application for ToF in CE products was the Microsoft (MSFT) Kinect motion sensor used in conjunction with Xbox consoles back in 2010, which was a major hit for the company from a publicity perspective. The real kicker came when Apple adopted the technology in the iPhone, and dozens of smartphone brands have adopted the technology to assist camera applications.
The problem came when Samsung Electronics revealed that the Galaxy Note 20 would not contain a ToF sensor and the Galaxy S21 would also abandon the technology, with Samsung saying it lacked a ‘clear advantage’ for the consumer, which took much of the ToF momentum out of the market. There was a good reason why Samsung did not focus its attention on ToF, and that has to do with a decision the company made as to the type of ToF sensor it would produce years before, but leave us say that it was not based on a lack of consumer interest but on a profit motive for Samsung. While not carrying the cache of Samsung’s marketing, ToF sensors are still found in a wide variety of smartphones by Apple, Sony (SNE), Honor (pvt), Motorola (MSI), Huawei (pvt) and others, but are more the focus of those in the automotive space, tying them in to obstacle recognition systems, but it seems they have also found a new home.
Infineon (IFX.GR) and PMD Technologies (pvt) have developed a 3D depth sensing ToF system that will be used in the Magic Leap 2 (pvt), an AR headset designed for enterprise customers that is due out later this year, which will ‘capture the physical environment around the user’ to give the device an understanding of how to interact with the environment. The system will give the device accurate image coordinates and mapping of hands, faces, and objects in real-time, and is able to work in both bright light and complete darkness. The sensor chip itself has been optimized to reduce heat and power consumption to maintain battery life.
One feature of the Magic Leap 2 AR headset is its ability to reduce the ambient light surrounding a projected image without changing the image itself. This allows for better focus on the AR image but also makes it necessary to maintain some perspective on distances without the light that would normally illuminate other objects. Given that ToF is UV laser based, the lack of light does not affect its ranging capabilities and can provide the necessary depth information to keep users from losing track of where they are relative to the projected image, almost converting the device from an AR to a VR headset.
As a specialty device, especially one geared toward business use, the Magic Leap 2 will not push ToF sensors back into the limelight, but can bring ToF back into the CE nomenclature. While there will be other silicon based features in the Magic Leap 2 and other AR/VR headsets, the fact that an AR headset can be ‘dimmed’ without losing the depth perception necessary for safe use, is a step toward expanding the use of ToF sensors in the CE space, and we expect over time to see ToF sensors become an integral part of the XR world.
The problem came when Samsung Electronics revealed that the Galaxy Note 20 would not contain a ToF sensor and the Galaxy S21 would also abandon the technology, with Samsung saying it lacked a ‘clear advantage’ for the consumer, which took much of the ToF momentum out of the market. There was a good reason why Samsung did not focus its attention on ToF, and that has to do with a decision the company made as to the type of ToF sensor it would produce years before, but leave us say that it was not based on a lack of consumer interest but on a profit motive for Samsung. While not carrying the cache of Samsung’s marketing, ToF sensors are still found in a wide variety of smartphones by Apple, Sony (SNE), Honor (pvt), Motorola (MSI), Huawei (pvt) and others, but are more the focus of those in the automotive space, tying them in to obstacle recognition systems, but it seems they have also found a new home.
Infineon (IFX.GR) and PMD Technologies (pvt) have developed a 3D depth sensing ToF system that will be used in the Magic Leap 2 (pvt), an AR headset designed for enterprise customers that is due out later this year, which will ‘capture the physical environment around the user’ to give the device an understanding of how to interact with the environment. The system will give the device accurate image coordinates and mapping of hands, faces, and objects in real-time, and is able to work in both bright light and complete darkness. The sensor chip itself has been optimized to reduce heat and power consumption to maintain battery life.
One feature of the Magic Leap 2 AR headset is its ability to reduce the ambient light surrounding a projected image without changing the image itself. This allows for better focus on the AR image but also makes it necessary to maintain some perspective on distances without the light that would normally illuminate other objects. Given that ToF is UV laser based, the lack of light does not affect its ranging capabilities and can provide the necessary depth information to keep users from losing track of where they are relative to the projected image, almost converting the device from an AR to a VR headset.
As a specialty device, especially one geared toward business use, the Magic Leap 2 will not push ToF sensors back into the limelight, but can bring ToF back into the CE nomenclature. While there will be other silicon based features in the Magic Leap 2 and other AR/VR headsets, the fact that an AR headset can be ‘dimmed’ without losing the depth perception necessary for safe use, is a step toward expanding the use of ToF sensors in the CE space, and we expect over time to see ToF sensors become an integral part of the XR world.
RSS Feed