Microsoft and Volkswagen are developing a system to run HoloLens in cars

In partnership with Volkswagen, Microsoft has improved its mixed reality glasses, the HoloLens 2, to allow the device to work in cars. The technology solves an age-old problem where equipment sensors did not work properly in moving environments.

According to information released by the company on Thursday (5), the HoloLens 2 tracks movement from a combination of camera sensors and an inertial measurement unit with accelerometers and gyroscopes. In a car, however, the two fields collided due to the continuous action and the holograms disappeared with the confusion of signals.

advertisement

That’s where Volkswagen came in, building a prototype that allowed the car to display real-time information over a two-way data connection. At the same time, Microsoft has developed an algorithm that models the gaps between sensors and stabilizes HoloLens 2 tracking in an automobile. The partnership between the two companies began in 2018.

“We connect a positioning system that tracks the position of the vehicle,” says Michael Wittkamper, augmented reality specialist at Volks. “This way we were also able to place 3D elements, such as POI information outside the car. This opens up completely new possibilities for displaying holograms not only in the driver’s field of vision, but also for the eyeglass wearer watching.

Virtual objects can be placed inside and outside the vehicle. In an image released by Microsoft (see below)HoloLens projects a virtual map onto a car’s dashboard. Another displays an alert to the driver so that he is aware of the segment with passengers.

Heads-up display with Microsoft HoloLens (Microsoft/Disclosure)

It should be remembered in this sense that the ID family of Volkswagen cars already has elements of augmented reality. The ID.3, for example, has a head-up display that projects data onto the car’s windshield, including speed and navigation instructions. In this way, the driver can analyze the information without taking his eyes off the road.

No release date for the feature

It’s still unclear when HoloLens 2 will be available to consumers — initially, Microsoft is focusing on business users. According to the American company, the first beneficiaries of the resource should be shipping companies, which will be able to connect workers with remote mechanical specialists to diagnose possible problems with the glasses. Currently, it costs around US$3,500 (around R$17,600 in direct conversion).

After the news that the project was in trouble, HoloLens2 seems to be rising from the ashes. Earlier this year, Microsoft reportedly lost 70 project employees, including some who went on to work for Meta on the Metaverse initiative.

Main image credit: Microsoft/Disclosure

Read more:

Have you watched our new videos on Youtube? Subscribe to our channel!

Leave a Comment

This site uses Akismet to reduce spam. Learn how your comment data is processed.