Excerpts from New AR/VR Patent Applications filed at the USPTO on January 20, 2024
Article related citations and references:XR Navigation Network
(XR Navigation Network January 20, 2024) Recently, the U.S. Patent and Trademark Office announced a batch of newAR/VRPatents, the following is compiled by the XR Navigation Network (please click on the patent title for details), a total of 51 articles. For more patent disclosures, please visit the patent section of XR Navigation Networkhttps://patent.nweon.com/To search, you can also join the XR Navigation Network AR/VR patent exchange WeChat group (see the end of the article for details).
1. "Meta Patent | Multi-color pixels》
In one embodiment, the light source described in the patent includes a substrate, an array of semiconductor structures grown on the substrate, and a multicolored Micro LED grown on a surface of the array of semiconductor structures. each of the semiconductor structures of the array of semiconductor structures has a shape of a truncated cone. The light source includes a plurality of Micro LEDs formed on top surfaces of the plurality of semiconductor structures of the array of semiconductor structures. the plurality of Micro LEDs are configured to emit a plurality of colors of light.
2. "Meta Patent | Strain-tunable light-emitting diodes formed using mesa sidewall epitaxy》
在一个实施例中,专利描述的LED器件可以包括具有侧壁的台面,侧壁包括第一半导体层、第二半导体层以及在第一半导体层和第二半导体之间的有源区。第一半导体层和第二半导体层相反地掺杂。有源区包括量子阱。LED器件可以进一步包括在台面的侧壁上生长的至少一个外延层。至少一个外延层包括具有比量子阱的半导体材料更宽的带隙的半导体材料,并且配置为在量子阱中引起压缩或拉伸应变。压缩或拉伸应变导致量子阱的外围部分的带隙与量子阱的中心部分的带间隙不同,从而调谐LED器件的波长和/或强度。
In one embodiment, the method described in the patent comprises, while presenting an artificial reality environment comprising a representation of a virtual object and a physical object, detecting, based on data from a first set of sensors of the wrist-wearable device, that the wrist-wearable device is within a first distance of the electronic device responsive to the user's gesture and within another threshold distance of the virtual object; and when the wrist-wearable device is within the first activation threshold distance of the electronic device and also within a second activation threshold distance of the virtual object, determining that the gesture corresponds to an operation at the electronic device based on the data from the second set of sensors of the wrist wearable device.
4.《Meta Patent | Haptic device with multiple fluidically-controlled voids》
In one embodiment, the patent describes a method for large-scale integration of a haptic device. Said method comprises forming a first elastomer layer of a large-scale integration (LSI) device on a substrate according to a specified fabrication process, the first elastomer having a plurality of fluid-based circuits; curing the first elastomer layer; and one or more additional elastomer layers of the LSI device being formed with the first elastomer layer according to the specified fabrication process, said one or more additional elastomer layers having a plurality of fluid-based circuits .
5.《Meta Patent | Shock absorbers in an optical assembly for a wearable display device》
In one embodiment, an optical assembly for use in a head-mounted display device or the like may include a first optical assembly and a second optical assembly, wherein the first optical assembly is laminated with the second optical component in the optical assembly. The optical assembly may also include a waveguide positioned between the first optical component and the second optical component. One or more shock absorbers may be positioned on waveguide-facing surfaces of the first optical component and the second optical component. The shock absorbers may be support members that contact the surfaces of the waveguide, or standoffs that extend toward the waveguide and have a gap.
In one embodiment, a non-normal bottom emitting vertical cavity surface emitting laser (VCSEL) is integrated with a photonic integrated circuit (PIC) for incident light from the VCSEL to be efficiently coupled to the waveguide via a grating coupler in the PIC. The grating coupler diffracts the light in a direction aligned with the input of the waveguide such that most or all of the light enters the waveguide. The non-normal VCSEL output is achieved by arranging the output vignette at the bottom surface of the VCSEL having an eccentric microlens, a microprism, a grating, a diffractive optical element, and/or a hypersurface. The diffractive optics or the hypersurface may also be used for beam divergence mitigation and/or polarization control.
In one embodiment, the system described in the patent includes an encoder, the encoder being configured to compress and encode data for a three-dimensional mesh. To compress the three-dimensional mesh, the encoder determines a compressed basic mesh bitstream and a compressed motion bitstream. A network abstraction layer syntax defined for the compressed fundamental mesh bitstream and the compressed motion bitstream allows various parameters to be defined and applied to both bitstreams.
8. "Apple Patent | Granular motion control for a virtual agent》
In one embodiment, the method described in the patent includes obtaining an action of a virtual agent, said action being associated with a plurality of time frames. ; for a first time frame of the plurality of time frames, determining a corresponding confidence score for a plurality of fine-grained motions that move the virtual agent in the direction of completing the action; and then selecting a subset of the plurality of granular motions based on the respective confidence scores.
In one embodiment, the method described in the patent comprises: at a computer system in communication with one or more display generation components and one or more input devices: detecting a request from an authenticated user via said one or fewer input devices; in response to detecting the request from the authenticated user: displaying a first authenticated user interface comprising a first user interface object in a three-dimensional environment via said one or more display generation components user interface, wherein: said first user interface object is a viewpoint-locked object that stays in a corresponding region of said user's field of view as said user's viewpoint moves relative to said three-dimensional environment; and wherein said first user interface object is part of a user interface for biometric authentication; and after displaying the first authenticated user interface in the three-dimensional environment, performing a first authentication of a user; and, based on said user's first authentication failing to authenticate said user is determined, a second authentication user interface different from said first authentication user interface is displayed via said one or more display generation components, wherein said second authentication user interface comprises a second user interface object.
10.《Apple Patent | Wearable device for facilitating enhanced interaction》
In one embodiment, a wearable head-mounted display such as a virtual reality system presents an immersive experience and environment to a user. However, head-mounted displays and the immersive environments they produce limit a user's ability to interact with an external observer. Accordingly, the head-mounted device may include an outward-facing display and be configured to display information to an external observer, such as an image of the wearer's face or an image indicating or indicative of a state of the wearer and/or the head-mounted display.
11.《Apple Patent | User interface for interacting with an affordance in an environment》
In one embodiment, the method described in the patent includes displaying a graphical environment including a virtual surface, wherein at least a portion of the virtual surface is selectable; determining a distance between the collider object and the selectable portion of the virtual surface; displaying a depth indicator associated with the collider object; and a visual characteristic of the depth indicator being selected based on the distance between the collider object and the selectable portion of the virtual surface.
12.《Apple Patent | Multi-input for rotating and translating crown modules》
In one embodiment, the wearable device described in the patent includes a housing and a display carried by the housing, a capacitive sensor carried by the housing and including a removable outer surface. The capacitive sensor may include a first set of conductors forming a first electrical path, a second set of conductors forming a second electrical path, and a set of non-conductive insulators isolating the first set of conductors from the second set of conductors. The processor may be carried by the housing and may be in communication with the display and the capacitive sensor.
13.《Apple Patent | Gaze and head pose interaction》
In one embodiment, the patent describes a device comprising a sensor for sensing a head posture of a user, a display, one or more processors, and a memory. One method described in the patent includes displaying a set of virtual objects. Determining, based on a gaze vector, that the user's gaze is directed to a first virtual object in the set of virtual objects. Obtaining a head pose value corresponding to a head pose of the user. Performing an action relative to the first virtual object based on the head pose value that satisfies a head pose criterion.
14.《Sony Patent | Validating a real-world object's digital twin》
In one embodiment, the patent describes a method of providing access to a digital twin of a real-world object used in a meta-universe system. Said method includes receiving a request to validate the real world object. A plurality of physical attributes of the real world object are used to validate the real world object. Upon successful validation, the digital twin is unlocked to allow use of the digital twin in the meta-universe system.
15.《Sony Patent | Server, client terminal, control method, and storage medium》
In one embodiment, the server described in the patent comprises a communication unit and a control unit, said communication unit being configured to receive information related to an image acquired by an imaging unit of a client terminal, said control unit being configured to be able to extract information corresponding to an object based on said information related to said image and to send to said client terminal information related to said object, said object being located outside the user's gaze area and related to user information outside of the user's viewing area and associated with user information.
16.《Sony Patent | Systems and methods for communicating audio data》
In one embodiment, the method described in the patent comprises accessing at least one identifier of at least one source of at least one of said plurality of sounds, and accessing at least one identifier of at least one emotion conveyed by said at least one of said plurality of sounds. Said method further comprises sending the at least one identifier of the at least one source and the at least one identifier of the at least one emotion to display the at least one identifier of the at least one source and the at least one mid-identifier of the at least one emotion in an output of the scene.
17.《Sony Patent | Systems and methods for communicating audio data via a display device》
In one embodiment, the patent describes a method for transmitting audio data via a display device. Said method includes accessing a first user profile within a first user account, and accessing display data generated based on one of a plurality of voices when accessing the first user profile. Said method further comprises outputting the display data in a language, wherein the language is determined based on the first user profile. Said method then comprises sending display data to display the display data in said language at the first display device.
18.《Sony Patent | Haptic device, control device for haptic device, and control method for haptic device》
In one embodiment, the patent describes a haptic device comprising an external gripping body, a motion detection unit and an internal actuator body, said external gripping body being positioned externally to form a gripping portion of a hypothetical object and to be gripped by an operator. Said motion detection unit is provided in said external gripping body to detect motion of said external gripping body and to move relative to the external gripping body based on the detection result of the motion detection unit.
19.《Sony Patent | Information processing apparatus, method, computer program and system》
In one embodiment, the information processing apparatus described in the patent comprises processing circuitry, said processing circuitry configured to perform control to display a user interface in response to detecting a first trigger condition, said user interface comprising a plurality of items arranged in a ring, said plurality of items being highlightable for selection by a user, receiving an input signal from a user input device, analyzing said input signal to determine a degree of rotation of a portion of a user arm a portion of the user's arm, and performing control to update said user interface to highlight one of said plurality of items for selection based on said degree of rotation of said portion of the user's arm as determined.
In one embodiment, the patent describes an information processing apparatus for controlling the movement of a robot having a torso and a head. Said information processing apparatus includes an acquiring portion that acquires an image of a face of a user captured by a camera of a mobile terminal device, a motion detection portion that detects an orientation of the face of the user from the acquired image, a control signal generating portion that generates a control signal for rotating a first or second rotating device of a robot based on the detected orientation of the face of the user, and a transmitting portion that sends the generated control signal to the robot. portion of the robot.
twenty one. "Samsung Patent | Immersive display controller interface》
In one embodiment, the device described in the patent includes a communication interface and a processor operably coupled to the communication interface. The communication interface is configured to communicate with the display controller. The processor is configured to receive, via the communication interface, display characteristics of the display controller, said display characteristics comprising a plurality of views that the display controller is capable of rendering. The processor is also configured to determine an amount of views to be generated based on a number of views that the display controller is capable of rendering. The processor is further configured to send the determined amount of views to be generated to the display controller via the communication interface. Additionally, the processor is configured to generate the views based on the determined amount of views.
twenty two. "Samsung Patent | Layout of xr content in xr space》
In one embodiment, the method described in the patent includes determining a location of a user of the XR system; determining, based on the determined location, a location-specific layout of one or more XR objects in the XR environment to be displayed to the user, and displaying the location-specific layout in the XR environment via a display of the XR system.
twenty three. "Samsung Patent | Control-deck graphical user interface in xr》
In one embodiment, the method described in the patent includes presenting a persistent GUI element including a control panel to a user in an XR environment. The control panel includes one or more first interaction elements, each first interaction element being associated with a particular function. The described method also includes locking the control deck to the user in a first control deck mode such that the control deck appears in the same relative position to the user regardless of the user's movement in the XR environment.
twenty four. "Samsung Patent | Method and equipment for measuring quality in mobile communication system》
In one embodiment, the patent describes a method for configuring a quality measurement by a network node in a mobile communication system. Said method comprises: receiving performance information from a user equipment (UE) indicative of a quality of experience (QoE) measurement of the UE's support of an extended reality (XR) service, sending to the UE a QoE metric configuration indicative of a parameter of the QoE measurement to be reported, and receiving a report of the QoE measurement from the UE.
25.《Google Patent | Generative model for 3d face synthesis with hdri relighting》
In one embodiment, the techniques described in the patent include introducing a neural generator configured to generate novel faces that can be rendered at a free camera viewpoint and re-illuminated under any high dynamic range (HDR) light map. The neural implicit intrinsic field takes as input a randomly sampled latent vector and generates any query of the3DThe per-point albedo, bulk density, and reflectivity characteristics of the location are used as output. The output is aggregated by volume rendering to produce low-resolution albedo, diffuse reflection coloring, specular reflection coloring, and neural feature maps. The low-resolution maps are then upsampled to produce high-resolution maps, which are fed into the neural renderer to produce a relighting image.
26.《Google Patent | Multi-pivot hinge for head mounted wearable device》
In one embodiment, the patent describes a head-mounted wearable computing device comprising a frame, said frame comprising an arm portion rotatably coupled to a front frame portion, with electronic components housed in and/or on the front frame portion and the arm portion. A cable passes through a hinge mechanism, the hinge mechanism rotatably coupling the arm portion to the front frame portion and for connecting the arm portion to the electronic components in the front frame portion. The hinge mechanism includes a dual pivot structure, the dual pivot structure guiding the cable through two pivot points to bend through the hinge mechanism by approximately 90 degrees. The dual pivot structure reduces localized strain on the cable through the range of motion of the hinge mechanism.
In one embodiment, the patent describes a diffraction grating used as an output element of a diffraction waveguide combiner for an augmented reality or virtual reality display. The grating comprises an interlaced rectangular grating, the interlaced rectangular grating comprising a first rectangular periodic array of optical structures arranged in a plane and a second rectangular periodic array of optical structures. The first array of the optical structure and the second array of the optical structure such that said first array of the optical structure and said second array of the optical configuration are configured to receive light from an input direction and to couple the order of said light in a direction angular to said input direction.
28.《Snap Patent | Incremental scanning for custom landmarkers》
In one embodiment, the patent describes a method for generating an updated locator map of a reference scene. Said method may comprise: obtaining a preliminary locator map of a reference scene, the preliminary locator map comprising preliminary frames each associated with a set of preliminary data points; capturing a plurality of new data points on said reference scene; determining a pose of said capturing device associated with the capture of said plurality of new data points; creating at least one new frame; selecting one or more target frames from said preliminary frames and said new frames; and generating said updated localizer map based on said one or more target frames.
29.《Snap Patent | Blending body mesh into external mesh》
In one embodiment, the patent describes operations comprising: receiving a video including a depiction of a real-world object; generating a 3D body mesh associated with said real-world object, said 3D body mesh tracking the movement of said real-world object between frames of said video; obtaining an external mesh associated with the AR element; automatically establishing a correspondence between a portion of said 3D body mesh and said external mesh; blending said portion of said 3D body mesh into said external mesh based on a blending parameter; and, when said portion of said 3D body mesh is blended into said external mesh, modifying said video to depict a portion of said real-world object being altered into said AR element.
30.《Qualcomm Patent | Priority handling for extended reality traffic》
In one embodiment, a user equipment (UE) may determine two or more conflicting uplink transmissions, wherein said two or more conflicting downlink transmissions comprise a first traffic and a second traffic. the UE may select, based at least in part on a first stage prioritization process and a second stage prioritization process, from the two or more conflicting uplink transmissions the first traffic or one of the second traffic, wherein said first traffic or said second traffic is selected based at least in part on one of three possible priorities assigned to each of said two or more conflicting uplink transmissions.The UE may send to the network node the selected first traffic or the second traffic one.
31.《Qualcomm Patent | Repetition of xr information》
In one embodiment total, the method described in the patent may include receiving XR data associated with an XR application from a network entity; sending a first transmission for the network entity including a first instance of the XR information and a second instance of the XR information at a first time; and sending a second transmission for the network entity including a second instance of the XR information and a third instance of the XR information at a second time, wherein a time difference may be based on a periodicity associated with the XR information.
32.《Qualcomm Patent | Techniques to facilitate a cloud-based vehicle xr experience》
In one embodiment, the patent describes a method for wireless communication at a user equipment (UE), said method comprising sending a request for a vehicle XR session. The vehicle XR session may be based on a first user XR stream including a vehicle XR component associated with a vehicle and a first user XR component associated with a first user. The first user may have an association with the vehicle. The described method also includes sending uplink information associated with the first user XR stream and receiving rendering information associated with the first user XR stream. The rendering information may be based on the uplink information.
33.《Magic Leap Patent | Low profile interconnect for light emitter》
In one embodiment, the interconnect circuitry connects the optical emitter to the wiring of the substrate. The interconnect circuitry may be deposited by 3D printing and placed flat on top of the light emitter and the substrate. In one embodiment, the interconnect circuitry has a cross-sectional profile that is generally rectangular or elliptical in shape and extends above the light emitter to a height of about 50.mu.m or less. Said height permits close spacing to be achieved between the overlying optical structure and the light emitter, thereby providing high efficiency in injecting light from the light emitter into the optical structure.
34.《HTC Patent | Virtual reality system and object detection method applicable to virtual reality system》
In one embodiment, the patent describes an object detection method applicable to a virtual reality system. The described object detection method includes a plurality of first cameras in a head-mounted display to capture a plurality of first frames. A plurality of third frames are captured by a plurality of second cameras in a tracker, wherein the object detector searches for an object location in the first and second frames.
35.《Lumus Patent | Optical systems with compact image projector》
In one embodiment, the patent describes an optical system having a hollow mechanical body, the mechanical body having a first end and a second end. The optical assembly has a plurality of optical components arranged in a stacked configuration. Each optical component has a set of engagement configurations. For each pair of neighboring optical components in the stacked configuration, at least some of the engagement configurations of the first optical component engage at least some of the engagement configurations of the second optical component. Some of the engagement configurations of the optical components at the first end of the stacked configuration engage corresponding engagement configurations of the hollow mechanical body at the first end of the hollow mechanical body to position other optical components of the stacked configuration within the hollow mechanical body. The emission display device is deployed at the second end of the hollow mechanical body.
36.《DigiLens Patent | Waveguide based display device (DigiLens Patent: Waveguide based display device)》
In one embodiment, the patent describes a wearable waveguide display having a plurality of input projection arrays and configured to project an image into the waveguide via a separate input coupler and project an image via an output element. The wearable display may be configured in a variety of configurations that minimize the weight of the projected image and maximize comfort and resolution. In one embodiment, the wearable waveguide display includes a first Micro LED array that outputs light to a first coupler and a second Micro LED array that outputs light to a second coupler. Both the first coupler and the second coupler couple the light into total internal reflection in the waveguide. The inwardly coupled light is coupled outwardly through the output optics.
37.《DigiLens Patent | Waveguide grating device (DigiLens Patent: Waveguide grating device)》
In one embodiment, the optical waveguide described in the patent includes at least two TIR surfaces and contains gratings. Input TIR light having a first angular range along a first propagation direction undergoes at least two diffractions at the gratings. Each diffraction directs the light along a second propagation direction into a unique TIR angular range.