MSFT Patent Application for MEMS Scanning Display with Integrated Object Tracking

Reddit: MSFT Patent Application for MEMS Scanning Display with Integrated Object Tracking

USPTO: Compact optical system with MEMS scanners for image generation and object tracking

References MVIS Patent Application: Mixed-Mode Depth Detection 

United States Patent	10,175,489
Robbins ,   et al.	January 8, 2019

---

Compact optical system with MEMS scanners for image generation and object tracking

Abstract An optical system that deploys micro electro mechanical system (MEMS) scanners to contemporaneously generate CG images and to scan a terrain of a real-world environment. An illumination engine emits a first spectral bandwidth and a second spectral bandwidth into an optical assembly along a common optical path. The optical assembly then separates the spectral bandwidth by directing the first spectral bandwidth onto an image-generation optical path and the second spectral bandwidth onto a terrain-mapping optical path. The optical system deploys the MEMS scanners to generate CG images by directing the first spectral bandwidth within the image-generation optical path and also to irradiate a terrain by directing the second spectral bandwidth within the terrain-mapping optical path. Accordingly, the disclosed system provides substantial reductions in both weight and cost for systems such as, for example, augmented reality and virtual reality systems.

===
This patent application by MSFT describes a MEMS scanning engine that both creates images for the wearer of an augmented reality headset and scans the environment by using wavelength-specific optical paths for the lasers coming off of the scanner. This integrates an external environment-facing LiDAR capability using a given frequency of laser with the user-facing image display capability using RGB lasers all packaged inside a MEMS scanner module embedded in a near eye display. Amazing stuff.

Also, it's worth noting that MVIS refers to their AR/MR module offering as "Integrated Display and Sensor Module for Binocular Headset" in their December 2018 presentation.