Microsoft AR/VR patent proposes method to improve display component misalignment correction

CheckCitation/SourcePlease click:XR Navigation Network

Methods to facilitate display component misalignment correction

(XR Navigation Network November 24, 2023）MR系统通常包括单独的显示组件，并分别配置在用户的眼睛前面。然而，立体错位经常发生在MR系统中，亦即通过单独显示组件显示的内容没有正确对齐。立体错位可能导致用户在混合现实场景中以不期望的方式感知显示内容，并导致用户误解全息图或虚拟对象的大小和/或空间位置。立体错位同时会导致使用者的视觉紧张、视觉不适和前庭不适。

所以在名为“Systems and methods for facilitating display misalignment correction”的专利申请中，MicrosoftIntroduces a method for promoting display misalignment.

The head-mounted display 200 shown in FIG. 2A includes a detector for detecting display misalignment 202 . Based on the detected display deviation 202, the headset 200 may determine display deviation correction operations 204 configured to correct the display deviation 202 to restore or improve the user experience.

As shown in FIG. 2 , display misalignment correction operation 204 may include various components, such as pitch component 204A, pitch component 204B, and/or roll component 204C. The tilt component 204A of the display misalignment correction operation 204 may include correction configured to handle distance/depth errors of displayed virtual objects.

Spacing component 204B of display misalignment correction operation 204 may include corrections configured to handle errors in vertical positioning of display virtual objects. The roll component 204C of the display misalignment correction operation 204 may include correction configured to handle combined pitch and yaw misalignment based on the display center eccentricity of the displayed virtual object.

Immediately applying the display bias correction operation 204 may cause user discomfort. For example, sudden corrections to the position of the hologram/virtual object may be disorienting, confusing, and/or unsafe for the user. Therefore, the invention applies the display offset correction operation 204 in a manner that reduces user discomfort throughout the correction application process.

FIG. 2B illustrates translational head positioning and/or rotational head positioning of a user operating the headset. Such movement and/or other physical/positional changes of the headset 200 may be quantified as activity attributes 210 . Activity attributes 210 may include, for example, motion attributes 212 of the headset 200 . Motion attributes may include various metrics related to motion/operation of the headset 200, such as amount of motion, linear velocity, linear acceleration, angular velocity, angular acceleration, and/or others.

The motion attributes 212 described above may be obtained through the IMU 112 and/or other sensors 110 . Activity attributes 210 may additionally or optionally include other components such as the virtual experience/environment, the prevalence of the hologram/virtual object in the scene, whether the user's gaze coincides with the hologram/virtual object location, etc.

Activity attributes 210 associated with the headset 200 (or other system) may provide a basis for determining a manner of applying bias correction such that application of such bias correction is less disruptive to the user experience.

FIG. 2C illustrates a correction application attribute 214 that may define a manner in which the display misalignment correction operation 204 is applied. Correction application properties 214 may be determined based on activity properties 210 and/or display bias correction operations 204 to be performed.

Correction application properties 214 may include various components such as correction constraints 216, correction speed 218, correction time 220, and/or others. Correction constraints 216 may include whether application of the display bias correction operation 204 should be substantially immediate or at least partially limited.

Correction constraints 216 may be determined based on the type of display misalignment correction operations 204 to be performed to display content on the headset 200 . For example, vertical differences caused by pitch misalignment can be associated with extreme user discomfort, which can increase expectations for immediate performance of display bias correction operations 204 with a large or dominant pitch component 204B.

In other words, the system may avoid causing restricted application of the display bias correction operation 204 when the display bias correction operation 204 includes a pitch component 204B that satisfies one or more pitch thresholds d.

In one embodiment, modification constraints 216 are additionally or alternately affected by active attributes 210 . For example, where motion attributes 212 indicate that a high threshold amount of motion is met, correction constraints 216 may be selected to cause display bias correction operations 204 to be applied without constraints.

Correction application properties 214 may include the speed of correction 218 and/or the time of correction 220 . The speed of correction 218 may define the rapidity, rate, gradualness, or burstiness of display bias correction operations 204 for correcting the content of headset 200 . High-speed corrections 218 may cause changes in hologram/virtual object position/rendering to appear instantaneous or rapid, while low-speed corrections may cause changes to hologram/virtual object position/rendering to appear gradual or slow.

In one embodiment, the correction speed 218 is selected based on an activity attribute 210, such as a motion attribute 212 of the headset 200. The amount of motion indicated by the motion attribute 212 and the speed of the correction 218 may be positively correlated, such that the speed of the correction 218 increases in response to a high detected amount of motion and the speed of the correction 218 decreases in response to a low detected amount of motion.

During periods of high motion, the user's focus and/or gaze on the hologram/virtual content is typically less suggestive, providing an opportunity to institute faster display bias correction operations 204 . In contrast, at low levels of motion, the user's focus and/or gaze on the hologram/virtual content tends to be more purposeful, which may lead to sudden modifications to the presentation of the hologram/virtual object, thereby disrupting the user experience. In this case, a low speed correction 218 may be selected so that application of the display misalignment correction operation 204 is more gradual and less disruptive to the user experience.

The relationship between the speed of the correction 218 and the amount of motion indicated by the motion attribute 212 may be defined in any suitable manner, such as by a linear or other function.

Modifying the speed of correction 218 based on motion attributes 212 may be beneficial for at least some types of display misalignment correction operations 204 . For example, when the display misalignment correction operation 204 includes or consists primarily of a yaw component 204A and the motion attribute 212 indicates a low amount of motion, a low speed correction 218 may be selected to prevent user distraction/discomfort due to sudden changes in hologram presentation.

Conversely, when display misalignment correction operation 204 includes or consists primarily of a yaw component 204A and motion attributes 212 indicate substantial motion, high-speed correction 218 may be selected to avoid or reduce motion-related artifacts, such as swimming or hologram instability, thereby Achieve fast locking of holograms.

As discussed above, the speed of correction 218 may be selectively modified in response to detection that the display bias correction operation 204 includes a pitch component 204B that fails to meet a pitch threshold.

In one embodiment, the system may avoid applying the display misalignment correction operation 204 until the threshold motion attribute 212 is met. For example, when display bias correction operation 204 omits one pitch component 204B, the system may forgo applying display bias correction until a threshold amount of system motion is detected.

FIG. 2D illustrates action 230 , which conceptually represents performing display correction operation 204 based on correction application attributes 214 . By applying display bias correction operations 204 using dynamically determined correction application attributes 214, the system can implement stereoscopic display offset correction functionality in a manner that advantageously reduces or avoids disruption to the user experience caused by the correction operations themselves.

Act 302 of flowchart 300 of Figure 3 includes determining one or more user activity attributes associated with user operation of the stereoscopic display system.

Act 304 of flowchart 300 includes determining, based on one or more user activity attributes, one or more correction application attributes that indicate applying one or more display bias correction operations to align the stereoscopic display system The way the content in is represented.

One or more calibration application properties include calibration speed. There may be a positive correlation between the amount of user actions and the speed of correction. Determining the one or more correction application attributes includes selecting a correction speed from a plurality of correction speeds based on one or more user motion thresholds satisfied by an amount of user motion. Correction speeds and one or more user motion thresholds may be positively correlated.

In response to determining that the spacing component satisfies one or more spacing thresholds, the one or more correction application attributes cause the one or more display bias correction operations to be applied without constraint. In response to determining that the pitch component satisfies the one or more pitch thresholds, the one or more corrective application attributes do not result in the one or more amounts of user motion based on the one or more user activity attributes. Several restricted applications of display misalignment correction operations.

In one embodiment, in response to determining that a pitch component fails to meet one or more pitch thresholds, one or more correction application attributes are determined based on an amount of user movement indicated by one or more user activity attributes.

In response to determining that the spacing component fails to satisfy one or more pitch thresholds, the one or more correction application attributes cause application of the one or more display misalignment correction operations to be abandoned until the one or more user activities until the amount of user motion indicated by the attribute meets one or more user motion thresholds.

Act 306 of flowchart 300 includes applying one or more display misalignment correction operations to align the representation of the content in the stereoscopic display system according to one or more correction application attributes.

Act 402 of flowchart 400 of Figure 4 includes determining one or more display misalignment correction operations.

Act 404 of flowchart 400 includes determining one or more correction application attributes based on one or more display bias correction operations, the one or more correction application attributes indicating applying the one or more display bias correction operations to align the stereoscopic display system. The way the content is presented.

Act 406 of flowchart 400 includes applying one or more display misalignment correction operations to align the representation of the content in the stereoscopic display system according to one or more correction application attributes.

Related patents:Microsoft Patent | Systems and methods for facilitating display misalignment correction

Titled "Systems and methods for facilitating display misalignment correction"Microsoft patentThe application was originally submitted in April 2022 and was recently published by the US Patent and Trademark Office.