Excerpts from New AR/VR Patent Applications filed at the USPTO on December 23, 2023
Article related citations and references:XR Navigation Network
(XR Navigation Network December 23, 2023) Recently, the U.S. Patent and Trademark Office announced a batch of newAR/VR patents, the following is a compilation of XR navigation network (for details, please click on the title of the patent), a total of 66. For more patent disclosures, please visit the patent section of XR Navigator.comhttps://patent.nweon.com/To search, you can also join the XR Navigation Network AR/VR patent exchange WeChat group (see the end of the article for details).
1. "Meta Patent | Controlling an augmented call based on user gaze》
在一个实施例中，当接收用户没有专注于由数据产生的全息图时，系统可以缓和表示发送用户的全息图数据的捕获或生成。当接收用户没有查看发送用户的全息图时，例如当发送用户在接收用户的外围或接收用户的视场之外时，这种调节可以减少人工现实系统所需的功耗、带宽、热产生和/或处理功率。
2. "Meta Patent | Tunable laser array》
In one embodiment, the tunable laser array described in the patent may include a plurality of lasers, said plurality of lasers including at least a first laser and a second laser. The tunable laser array may also include at least one coupler/separator. In the tunable laser array, a first wavelength of emitted light from the first laser and a second wavelength of emitted light of a different wavelength from the second laser may be combined and then split at the coupler/splitter. Alternatively, the lasers may have at least a minimal amount of thermal resistance.
3.《Meta Patent | Antenna for wearable electronic devices》
In one embodiment, the antenna architecture described in the patent may include a magnetic dipole antenna, the magnetic dipole antenna including a radiating element formed in an open loop, the radiating element including at least first and second portions positioned relative to each other. The magnetic dipole antenna may further include a conductive pathway connecting the first and second opposing portions of the radiating element. The magnetic dipole antenna may further include an antenna feed line provided within the conductive aperture. A length of the first portion of the radiating element may be shorter than an opposing second portion of the radiating element, and a difference in length between the second and first portions of the radiating element may form a capacitive gap on the radiating element.
4.《Meta Patent | Apparatus, system, and method for achieving flexibility and durability in batteries》
In one embodiment, the patent describes a flexible battery comprising (1) at least one positively charged layer, (2) at least one negatively charged layer, (3) a coated electrode segment comprising a segment of the positively charged layer and a segment of the negatively charged layer, and (4) additional coated electrode segments removably attached to the coated electrode segments. Wherein said additional coated electrode segments include said additional segment with a positively charged layer and said additional segment with a negatively charged layer.
5.《Meta Patent | Systems and methods for providing user experiences on smart assistant systems》
In one embodiment, the patent describes a system comprising an automatic speech recognition (ASR) module, a natural language understanding (NLU) module, a dialog manager, one or more agents, a delivery system, one or more processors, and non-transitory memory coupled to the processors, said non-transitory memory comprising instructions executable by said processors, said processors being operable in executing said instructions to receive user input, process the user input using one or more of an ASR module, an NLU module, a dialog manager, an agent, and a delivery system, and provide a response to the user input.
6.《Meta Patent | Augmented reality content creation》
In one embodiment, the patent describes a system and method for generating virtual content to a physical object. The system accesses a video captured by a camera. The video depicts a user performing a physical operation associated with the physical object. The system determines metadata identifying the position of the camera relative to the physical object during capture of the video, identifies characteristic points of the physical object in the video, and retrieves the virtual object based on the characteristic points of the physical object. The system generates virtual content based on the video, the metadata, and the virtual object, and stores the object identifier and the virtual content relative to each other in a data store.
7.《Meta Patent | Thermal management system for electronic devices》
In one embodiment, the head unit described in the patent includes a thermal frame disposed within a housing. A printed circuit board (PCB) is thermally coupled to the thermal frame.Heat generated by one or more electrical components on the PCB is transferred to the thermal frame, which distributes the heat evenly throughout the head unit. A first heat pipe is provided on a first side of the PCB in contact with at least a portion of the thermal frame, the PCB, and/or the electrical component(s) disposed on the PCB to draw heat from the electrical component(s), and a second heat pipe is provided proximate to a second side of the PCB and configured to draw heat from a third side of the PCB.
8. "Meta Patent | Apparatuses and systems including ultra-thin adjustable lenses》
In one embodiment, the method described in the patent may comprise combining a deformable boundary element to a structural support element, wherein the deformable boundary unit and the cavity-adjacent side of the structural support element define the cavity. The described method may also include filling the cavity with a deformable medium by injecting the deformable medium past the opposite side of the cavity of the structural support element and toward the cavity-adjacent side of the structural support element. Alternatively, sealing the inlet point of the deformable medium injected into the cavity.
9. "Meta Patent | Near-eye display architectures》
In one embodiment, the patent describes the present near-eye display architecture, including geometric waveguide displays with improved optical pupil replication density and liquid crystal displays with improved luminance uniformity, among others.
10.《Microsoft Patent | Wearable device enabling multi-finger gestures》
In one embodiment, the patent describes a wearable device that implements multi-finger gestures. The wearable device typically includes a first sensor, a second sensor, and a controller. The first sensor may detect a first set of one or more movements of a first finger of a user. The second sensor may detect a second set of one or more movements of a second finger different from the first finger. The controller is configured to detect a multi-finger gesture by determining a relative movement between the first finger and the second finger based on the first and second sets of movements, and to control a terminal device associated with the wearable device based on the multi-finger gesture.
11.《Microsoft Patent | Error recovery and power management between nodes of an interconnection network》
In one embodiment, the patent describes techniques for recovering from an error state without the need to retransmit data over a high-speed data link, and improved techniques for improving power usage. Data streaming is initiated. Said data streaming includes different types of packets. Error correction codes (ECC) are selectively applied to control the data type packet. the transmitter node and receiver node are connected through a hard link having multiple virtual channels. Each virtual channel is associated with the corresponding power consumption node. When a receiver node receives a control data type packet, it performs error correction without retransmitting it, if required. When a final data type packet is sent for each virtual channel, the transmitter node sends an end condition type packet.The corresponding power node corresponding to the corresponding virtual channel transitions from an active state to a low power state.
12.《Apple Patent | Structured display shutdown for video pass-through electronic devices》
In one embodiment, the electronic device described in the patent may provide a video view of a portion of a physical setup at a first power consumption rate. When the electronic device determines that it is in a low power or faulty state, a structured off-mode version of the video view may be provided to a display of the electronic device at a second power consumption rate that is lower than the first power consumption rate. In this way, the electronic device may reduce the functionality and power consumption of the display in a structured manner to continue to provide a version of the video view to the user in the low power or fault mode state.
13.《Apple Patent | Device with speaker and image sensor》
In one embodiment, a method of playing audio data is performed at a device. Said device includes a frame, a speaker coupled to the frame, an image sensor coupled to the frame, one or more processors, and a non-transient memory. A related method includes capturing one or more images of a physical environment using an image sensor; generating audio data based on the one or more images of the physical environment; and playing the audio data through a speaker.
14.《Apple Patent | Home automation device control and designation》
In one embodiment, the patent describes systems and processes for operating an intelligent automated digital assistant at an electronic device. In particular, the invention describes how an intelligent automated digital assistant can be used with other types of commands to control a home with multiple home automation devices. Portable electronic devices are used to provide an extended reality environment to a user, and the user can manage and control the home automation devices within the extended reality environment.
15.《Apple Patent | Home automation device control and designation》
In one embodiment, the patent describes systems and processes for operating an intelligent automated digital assistant at an electronic device. In particular, the invention describes how an intelligent automated digital assistant can be used with other types of commands to control a home with multiple home automation devices. Portable electronic devices are used to provide an extended reality environment to a user, and the user can manage and control the home automation devices within the extended reality environment.
16.《Apple Patent | Fabric-covered electronic device with touch sensor》
In one embodiment, an electronic device such as a speaker device may have a curved housing characterized by a vertical longitudinal axis. A layer of fabric may cover the curved housing. A touch sensor may be used to detect a touch input on the layer of fabric. The touch sensor may include capacitive touch sensor electrodes, the capacitive touch sensing electrodes including a drive line and a sense line. Light-emitting components and/or fabrics with different visual characteristics may be used to mark the location of touch-sensitive regions of the fabric. The touch sensitive regions may be shaped into media control symbols.
17.《Apple Patent | Electrode driving schemes for tunable lens systems》
In one embodiment, a pair of eyeglasses described in the patent may include one or more adjustable lenses. The adjustable lens may include an electrically modulated optical material, such as one or more liquid crystal units having a phase profile adjusted using patterned electrodes. A digital-to-analog converter circuit may provide a voltage to the electrodes. To save space in the lens, by sequentially coupling and decoupling the digital-to-analog converter circuits to different groups of electrodes, a smaller number of digital-to-analog converter circuits may provide voltage to a larger number of electrodes, with fewer electrodes advancing from one group to the other at each clock cycle than the number of digital-to-analog converter circuits. At least one electrode in each group may drive two consecutive clock cycles at the same voltage to avoid erroneous voltages caused by parasitic capacitance between neighboring fingers.
18.《Apple Patent | Object detection outside a user field-of-view》
In one embodiment, a method of playing an audio notification is performed at a device comprising one or more image sensors, one or more speakers, one or more processors, and non-transient memory. Said method includes receiving, from the one or more image sensors, an image of a physical environment having a field of view of the device that is different from a field of view of a user; detecting, in the image of the physical environment, an object at a location in the physical environment; determining that the location in the physical environment is outside of an area of the user's field of view; and, in response to determining that the location in the physical environment is outside of an area of the user's field of view, playing, via the speaker, a detected audio notification.
19.《Apple Patent | Hand-gesture activation of actionable items》
In one embodiment, a method of performing an action is performed at a device comprising an image sensor, one or more processors, and a non-transient memory, said method comprising receiving, from the image sensor, one or more images of a physical environment; detecting, in the one or more images of the physical environment, one or more actionable items associated with one or more actions, respectively; in the one or more images of the physical environment detecting a gesture indicative of the particular operable item(s); in response to detecting the gesture(s), performing the action(s) associated with the particular operable item(s).
20.《Apple Patent | Occlusion classification and feedback》
In one embodiment, a method of detecting an occlusion of an image sensor is performed at a device comprising one or more image sensors, one or more speakers, one or more processors, and a non-transient memory. Said method includes receiving an image of a physical environment from the one or more image sensors; detecting, based on the image of the physical environment, an occlusion that at least partially occludes the one or more image sensors; categorizing the occlusion into one of a plurality of types of occlusion; and broadcasting a notification of the categorization-based occlusion via the one or more speakers.
twenty one. "Google Patent | Detection of scale based on image data and position/orientation data》
In one embodiment, the patent describes a system for detecting a ruler from image data obtained by a computing device, as well as the position and orientation of the computing device. Said system may be used to virtually select and/or fit wearable devices, such as head-mounted wearable devices and other such wearable devices. Said system and method may include capturing a series of image data frames, and detecting one or more fixed features in the series of image data. Position and orientation data associated with the capture of the image data is combined with position data associated with the one or more fixed features to set a scale applicable to the image data. The ratio can be determined without using a reference object having a known ratio, a specialized device, or the like.
twenty two. "Google Patent | Predicting sizing and/or fitting of head mounted wearable devices》
In one embodiment, the patent describes a system for predicting the suitability of a head-mounted wearable device for a user. Said system detects a fixed facial landmark in image data captured by a computing device of a user.Measurements associated with the detected fixed facial landmark may be processed by one or more machine learning models and associated algorithms to predict the probability that a head-mounted wearable device will fit correctly on a user's head.
twenty three. "Google Patent | Warning light thwart detection for recording devices》
In one embodiment, the techniques described in the patent enable obstruction detection of a warning light associated with a recording device such as a camera. The warning light may be used to alert a bystander that recording is in progress, but an operator of the recording device may attempt to avoid the warning light by obstructing the warning light. A light or other light-guiding element may be used to direct the redirection of the warning light to the light sensor. The recording operation of the recording device can then be automatically de-activated when the redirection exceeds a threshold that can be determined based in part on a baseline level of ambient light.
twenty four. "Samsung Patent | Wearable Devices (Samsung Patent: Wearable Devices)》
In one embodiment, the wearable device described in the patent comprises a sensing block and a connecting member connecting the sensing block, said sensing block comprising a first sensing block and a second sensing block connected to said first sensing block by said connecting member, said first sensing block comprising an induced electric potential sensing module. Said induced electric potential sensing module comprises a magnetic body, a coil not touching said magnetic body and facing inside said magnetic body, a rod attached to the outside of said magnetic body and guiding a path of movement of said coil, and an induced electric potential sensor. Said induced electromotive force senses an induced electromotive force generated in said coil by said coil and said magnetic body.
25.《Samsung Patent | Display device and method of controlling the same》
In one embodiment, the patent describes a display device comprising: a first display panel having a first resolution; a second display panel having a second resolution; and a first multi-channel lens and a second multi-channel lens. Wherein the second resolution is higher than the first resolution. As an example, said device may be a head-mounted device mounted on the head of a wearer.
In one embodiment, fast link adaptation may be performed by detecting reference signal (SRS) listening when a user equipment (UE) is moving in a wireless communication system and needs to switch. Said method comprises sending configuration information for at least one measurement report to a UE served by a first base station BS, receiving from the UE a measurement report associated with an event detected by the UE on the basis of the configuration information for said at least one measurement report, and sending a first message to at least one second BS comprising listening configuration information associated with an SRS sent from said UE to said first BS.
In one embodiment, the patent describes a method for a base station (BS) to update an autoencoder (AE) for channel state information (CSI) feedback in a wireless communication system. Said method includes sending a data collection command message to a user equipment (UE) indicating collection of pre-compression data corresponding to compressed data, receiving pre-compression data from the UE, and updating the AE based on the data received prior to compression.
28.《Samsung Patent | Method and system for designing security protocol for 6g network architecture》
In one embodiment, the patent describes a system and method for a security protocol implemented in a communication network. The method performed by a first network entity includes determining, based on a HUB that is in a trusted region or an untrusted region, whether one or more network functions (NFs) are configured to perform a security operation based on a message generated by the corresponding one or more NFs. Determining one or more network entities configured to perform the security operation based on a determination that the one or more NFs are not configured to perform the security operation. Wherein said one or fewer network entities include at least one of a HUB, a central unit user plane (CU-UP), and a distributed unit (DU). The plurality of security keys are generated by the identified one or more network entities, and wherein the generated plurality of security keywords are shared with the user equipment (UE).
In one embodiment, the method of a wireless communication system described in the patent comprises obtaining network state information from a second device by a first device, determining forward error correction (FEC) parameters based on the network state information by the first device, generating a FEC packet based on the FEC parameters by the first device, transmitting said FEC packet by said first device and to a second device, sending a plurality of frame packets corresponding to image contents based on a finite number of retransmissions by said first device and to said second device sending a plurality of frame packets corresponding to image content based on a finite number of retransmissions.
In one embodiment, the method described in the patent includes a user equipment (UE) of the encoder transmitting or receiving, in a wireless communication system, data for use in an artificial intelligence-based (AI) of channel state information (CSI) feedback information. Said method may include receiving a CSI-reported configuration message from a base station (BS), generating compressed CSI-feedback data via an encoder based on the CSI-reported configuration message, and generating auxiliary information associated with the compressed CSI-feedback data, and sending the compressed CSI-feedback data and the auxiliary information to the BS.
31.《Samsung Patent | Method and electronic device for determining user's hand in video》
In one embodiment, the patent describes a method comprising obtaining a video comprising a plurality of frames; estimating a field of view trajectory indicative of camera movement by using frames of the video; detecting a feature point of one or more objects in each frame of the video; estimating an object trajectory indicative of movement of the one or more objects based on the feature point(s); tracking a hand of a user identified in each frame of the video, based on said field of view trajectory of said camera and said object trajectory, from said one or more objects to determine a hand candidate of a user; obtaining a head movement trajectory indicative of a movement of a user's head, determining said user's hand based on said head movement trajectory and an object trajectory corresponding to said user's hand candidate, tracking the user's hand identified in the video and recognizing a gesture.
32.《Samsung Patent | Method and system for video transformation for video see-through augmented reality》
In one embodiment, the method described in the patent includes obtaining video frames from a plurality of cameras associated with an AR device, wherein each video frame is associated with positional data; generating a depth map of camera viewpoints associated with the video frames based on the video frames and the positional data; performing a depth reprojection to transform the video frames from camera viewpoints to rendered viewpoints using the depth map of camera viewpoints; performing hole filling during the depth reprojection on the one or more holes created in one or more occluded regions of at least one of the transformed video frames to perform hole filling to generate at least one hole-filled video frame. Alternatively, said method comprises displaying the transformed video frame comprising the at least one hole-filled video frame on a plurality of displays associated with the AR device.
33.《Samsung Patent | Method and apparatus for rendering content in mobile communication system》
In one embodiment, the patent describes a method for capturing and rendering content in an AR. Said method may comprise: obtaining video information about an object; obtaining environmental information about a rendering space in which said object is to be output; determining an output state of said object in said rendering space based on a comparison between said video information and said environmental information; and rendering the object based on the determined output state.
34.《Samsung Patent | Electronic device for generating depth map and operation method thereof》
In one embodiment, the patent describes a method of generating a depth map corresponding to input data. Said method comprises providing light to a target object in a plurality of patterns varying over time, obtaining a plurality of captured images corresponding respectively to the plurality of patterns by photographing the target object to which the light is provided, obtaining said input data by pre-processing said plurality of captured images, and generating said depth map based on said input data.
35.《Samsung Patent | Method and apparatus for correcting vision based on focus adjustable lens》
In one embodiment, the patent describes a method of correcting vision by means of a vision correction device comprising a focal adjustable lens, said method comprising: determining, based on a user's farsightedness, a first refractive error that matches the farsightedness; determining, based on said user's corrected nearsightedness measured based on said first refractive error, a second refractive error that matches the nearsightedness; determining, based on said first refractive error and said second refractive error, a second refractive error to be imposed to the said focal adjustable lens; and controlling said focal adjustable lens based on said at least one third diopter; and controlling said focal adjustable lens based on said at least one third diopter.
In one embodiment, the patent describes a display device capable of suppressing fluctuations in luminous brightness. Said display device includes: a first electrode layer having a plurality of electrodes arranged in two dimensions; a second electrode layer provided to face said first electrode layer; an electroluminescent layer provided between said first electrode layer and said second electrode layer; and an insulating layer provided between adjacent electrodes. The insulating layer has a plurality of openings, and each of the plurality of openings is provided corresponding to each electrode. The insulating layer comprises a plurality of localized portions, and each localized portion of said plurality of localized portions is disposed around each of the openings. The insulating layer forms a barrier between the electroluminescent layer and the localized portions.
37.《Sony Patent | Near infrared (nir) transparent organic light emitting diode (oled) display》
In one embodiment, the patent describes the Micro OLEDThe display includes a substrate having a coating made of an IR transparent material such as zinc selenide or zinc sulfide to allow an optical pupil tracking camera, which may include a photodiode, to be mounted directly behind the display. Said coating is transparent to near-infrared (NIR) radiation but opaque to visible light.
38.《Sony Patent | Audio personalisation method and system》
In one embodiment, the method of audio personalization described in the patent comprises: testing a first user in a calibration test, said calibration test comprising requiring the user to match a test sound to a test location by controlling the position of a presented sound or controlling the position of a presented location to match a series of test matches, each test sound being presented using a default head-related transfer function "HRTF " presented at a location, receiving from the first user an estimate of each matching location and computing a corresponding error for each estimate to generate a sequence of location estimation errors for the first user; and comparing at least some of the first user's location estimation errors with estimation errors for the same locations previously generated for at least a subset of a reference individual corpus; recognizing a sequence of location estimation errors having a value equal to that of said reference individual having a closest match to the comparative positional estimation errors of the positional estimation errors of the first user; and using for the first user an HRTF previously obtained for the identified reference individual.
39.《Sony Patent | Wearable device and control method thereof》
In one embodiment, the patent describes a wearable device comprising a body; a first proximity sensor disposed on a first side surface of said body; a second proximity sensor disposed on a second side of said body; and a determination unit. The determining unit determines whether the body is worn on a user's body based on sensor signals from each of the first proximity sensor and the second proximity sensor.
40.《Sony Patent | Display control apparatus and display control method》
In one embodiment, generating a virtual space image by specifying from among a plurality of viewpoint locations and a plurality of line of sight directions in a virtual space; and displaying said virtual space image at a head-mounted display. Wherein, when generating the virtual space image in response to a change to a newly selected viewpoint location, the display control portion specifies a new line of sight direction among the plurality of line of sight directions, and at least some of the plurality of viewpoint locations are separated from each other.
41.《Sony Patent | System and method for providing driving assistance to safely overtake a vehicle》
In one embodiment, an electronic control unit used in the first vehicle is configured to detect a second vehicle ahead of the first vehicle. A first position associated with the first vehicle and a second position associated with the detected second vehicle are determined for a first time instance. It may be determined whether a lateral distance between the determined first position and the determined second position is below a predefined threshold distance. When the determined lateral distance is below the predefined threshold distance, a first alarm is generated.
42.《Sony Patent | Systems and methods for enabling predictive assistance during gameplay》
In one embodiment, the patent describes a method for providing assistance during a game. Said method includes accessing a profile model associated with a user account of a user. The short-file model is used to generate one or more predictive indicators based on a plurality of game scenarios for one or more games; to receive a request via the user account for accessing a game for a game session, and to generate an auxiliary input for the user in response to one or more predictive indicators that the user will not be able to complete a task in the game. The auxiliary input is provided prior to the user performing the task.
43.《Qualcomm Patent | View dependent three-dimensional morphable models》
In one embodiment, the patent describes systems and techniques for generating a three-dimensional (3D) facial model. For example, the process may include obtaining at least one input image associated with the face; obtaining a pose of the 3D facial model associated with the face; generating a 3D facial model associated with the face via a machine learning model; and the 3D facial model being configured to change shape based on the pose of the 3D facial model associated with the face.
In one embodiment, the patent describes a user role management system and techniques. A system recognizes a brief profile associated with a first user. The brief profile includes data defining each Avatar representing the first user and conditions for displaying the corresponding Avatar. The system determines that at least a first condition is satisfied based on a characteristic associated with the first user. The system selects a display Avatar in the avatar based on determining that at least the first condition is satisfied. the system outputs the display Avatar for presentation to the second user. The display Avatar may be presented based on the characteristics associated with the first user.
45.《Qualcomm Patent | Extended reality power savings enhancements》
In one embodiment, the patent describes a method of wireless communication by a user equipment (UE). Said method generally comprises receiving signaling for receiving a configuration of semicontinuous scheduling (SPS) timing of a physical downlink shared channel (PDSCH), determining a number of PDSCHs to be monitored during the SPS timing, and monitoring the PDSCHs during the SPS timing based on said determination.
46.《Snap Patent | Camera timestamp validation》
In one embodiment, the patent describes a method of determining an image capture timestamp offset or error, said method comprising generating an optical flash at an optical flash rate. A set of images of the optical flash are captured at an image capture rate. The image capture rate is different from the optical flash rate and each image includes an associated image timestamp. A signal associated with the generation of the optical flash is simultaneously time-stamped. An intensity is determined for each image in the set of images, and an image with maximum intensity in the set of images is identified. A timestamp offset or error is determined as a difference between the timestamp of the image having the maximum intensity and the timestamp of the corresponding optical flash.
In one embodiment, a device for mounting on the head is patented. Said device comprises a frame, a face wearable proximity optics device and a microdisplay for displaying data in front of the eyes. A computing device is coupled to the microdisplay. At least one sensor is coupled to the computing device and is used to receive biometric body information.
48.《Snap Patent | Shared augmented reality session creation》
In one embodiment, the patent describes a head-mounted device system including one or more cameras, one or more display devices, and one or more processors. The system also includes a memory storing instructions, the associated instructions causing the system to be configured to perform an operation of initiating or joining a joint visual computing session. Said method may include receiving user input to initiate a federated session of the visual computing experience, monitoring a short-range data transmission including data indicative of the presence of a current session of the visual computing experience, and providing a user input option to join a current session of the visual computing experience based on determining that the current session is in progress.
49.《Snap Patent | Augmented reality-based translation of speech in association with travel》
In one embodiment, the system described in the patent includes storing a program for providing augmented reality content associated with travel. Said program is provided for receiving, via a message sending and receiving application, a request to perform a scanning operation associated with an image captured by a camera of a device; determining a travel parameter and an attribute of an object depicted in said image associated with said request; selecting an item of augmented reality content based on at least one of said travel parameter or said attribute, and said item of augmented reality content is configured to present, based on voice input, augmented reality content; receiving said voice input; obtaining a translation of said voice input; and presenting the augmented reality content item comprising the translation in association with the image.
50.《Snap Patent | Beautification techniques for 3d data in a messaging system》
In one embodiment, the technology described in the patent applies a 3D effect comprising at least one beautification operation based on an augmented reality content generator to image data and depth data. the 3D effect comprises a beautification operation, the beautification operation comprising modifying the image data, the image data comprising regions corresponding to a representation of a face. Said beautification operation comprises applying the machine learning model to at least one of smoothing imperfections or maintaining facial skin texture. The patent describes techniques for generating a depth map using at least depth data; generating a segmentation mask based at least on the image data; performing background repair and blurring of the image data using at least the segmentation mask to generate background repaired image data; and generating a 3D message based at least in part on the applied 3D effect including said at least one beautification operation.
51.《Snap Patent | Augmented reality content generators including 3d data in a messaging system》
In one embodiment, the patent describes techniques for generating a segmentation mask based on the first image data; applying the segmentation mask to the first depth data to reduce a set of artifacts in the depth map based on the first depth data; generating a packaged depth map based at least in part on the depth map; converting a single-channel floating-point texture to a raw depth map; generating a plurality of channels; applying to the first optional graphic item corresponding to the selected first augmented reality content generator applied to the first image data and the first depth data; generating a message including the first augmented reality content generator applied to the first image data and the first depth data.
52.《Snap Patent | Generating user interfaces displaying augmented reality graphics》
In one embodiment, the AR graphics system described in the patent may detect objects in a real-world scene that correspond to an AR graphics display surface.The AR graphics system may generate an AR graphic that is displayed as an overlay of the AR graphics display surface.The AR graphics system may track movement of the graphics input tool relative to the AR graphics display surface in order to generate an AR graphic based on the movement of the graphics input tool.The AR graphic may include a plurality of markers generated based on the movement of the graphics input tool.
53.《Snap Patent | Integrating augmented reality experiences with other components》
In one embodiment, the patent describes a system accessing a first component of a plurality of components implemented by a message sending and receiving application, said plurality of components comprising an AR experience, each of said plurality of components configured to be individually initiated by the message sending and receiving application. The system stores a first state of the first component in a data structure shared across the plurality of components; initiates a second component of said plurality of components by said message transceiver application in response to determining that an interaction has been performed using said first component; and configures a second state of the second component based on the interaction that has been performed using the first component.
54.《Snap Patent | Augmented reality object rendering based on camera quality》
In one embodiment, the patent describes an AR object rendering system. the AR object rendering system receives an image, generates a set of noise parameters and a set of blurring parameters for the image using a neural network trained on pairs of image datasets, recognizes an AR object associated with the image, modifies the AR object using the noise parameters and the blurring parameters, and displays the modified augmented reality object within the image.
In one embodiment, the patent describes structures for selectively outputting light rays to form an image, said light rays having different wavelengths and being output with a low level of crosstalk. In some embodiments, light rays are coupled into a waveguide, are deflected and propagate in different directions depending on the wavelength. The coupled light is then coupled outwardly through coupled optical elements. In some embodiments, a color filter is disposed between the waveguide and the out-coupling element. The color filter limits the wavelength of the coupled out light that interacts with the out-coupling element. In other embodiments, a different waveguide is provided for each wavelength range to be output. The coupling optics selectively couple light of the appropriate wavelength range into the corresponding waveguide.
56.《Magic Leap Patent | Voice onset detection》
In one embodiment, a first audio signal is received via a first microphone and a first probability of voice activity is determined based on the first audio signal. A second audio signal is received via a second microphone and a second probability of the voice activity is determined based on the first and second audio signals. Determining whether a first threshold of the voice activity is satisfied based on the first and second probabilities of the voice activity. Based on the determination that the first threshold of voice activity is satisfied, it is determined that a voice onset has occurred, and an alert is sent to the processor based on the determination that the voice onset has occurred. Based on the determination that the first threshold of voice activity is not satisfied, the voice onset is not considered to have occurred.
In one embodiment, the patent describes a system and method for presenting an output audio signal to a listener located at a first location in a virtual environment. The method includes receiving an input audio signal; for each sound source in a plurality of sound sources in the virtual environment, determining each sound source corresponding to the input audio signal according to the position of each sound source in the virtual environment and each first intermediate audio. The first intermediate audio signal. The signal is associated with the first bus. For each of the plurality of sound sources in the virtual environment, a corresponding second intermediate audio signal is determined. Each second intermediate audio signal corresponds to the reverberation of the input audio signal in the virtual environment. According to the position of the corresponding sound source and at the same time according to the acoustic characteristics of the virtual environment, the corresponding second intermediate audio signal is determined. Each second intermediate audio signal is associated with the second bus. The output audio signal is presented to the listener through the first bus and the second bus.
58.《Magic Leap Patent | Methods And Systems For Audio Signal Filtering》
In one embodiment, the patent describes systems and methods for rendering audio signals. In one embodiment, the patent describes a method that may receive an input signal including a first portion and a second portion. A first processing stage including a first filter is applied to the first portion to generate a first filtered signal. A second processing stage including a second filter is applied to the first portion to generate a second filtered signal. A third processing stage including a third filter is applied to the second portion to generate a third filtered signal. A fourth processing stage including a fourth filter is applied to the second portion to generate a fourth filtered signal. Determining a first output signal based on a sum of the first filtered signal and the third filtered signal. A second output signal is determined based on the sum of the second filtered signal and the fourth filtered signal. The first output signal is presented to a first ear of the user, and the second output signal is presented to a second ear of the user. A first portion of the input signal corresponds to a first position in the virtual environment, and a second portion of the input signal corresponds to a second position in the virtual environment.
59.《Magic Leap Patent | Converting a 2d positional input into a 3d point in space》
In one embodiment, a user may be able to arbitrarily interact and select locations in a three-dimensional space by converting two-dimensional location inputs to three-dimensional points in space. The system may allow a user to use one or more user input devices to reference the location of a 3D point in space within an augmented reality or mixed reality session and point, annotate, or draw on a virtual object, a real object, or a blank space.
60.《Magic Leap Patent | Power supply assembly with fan assembly for electronic devices》
In one embodiment, the patent describes a fan assembly. The fan assembly may include a first support frame. The fan assembly may include a shaft assembly, the shaft assembly having a first end coupled to the first support frame and a second end arranged away from the first end. A second support frame may be coupled to the first support frame and arranged at or above the second end of the shaft assembly. The impeller may have fan blades coupled to a hub, which is arranged on the shaft assembly for rotation about a longitudinal axis between the first and second support frames. The transverse load of the shaft assembly may be controlled by the first and second support frames.
61.《Magic Leap Patent | Eye tracking based video transmission and compression》
In one embodiment, the method described in the patent comprises receiving user gaze information about a video stream; determining a video compression space map for said video stream based on the received gaze information and performance characteristics of the connection to the network; compressing the video stream based on the video compression space map; and sending the compressed video stream to the user.
62.《Niantic Patent | Map-free visual relocalization》
In one embodiment, the patent describes a system for mapless visual repositioning of a device. Said system obtains a reference image of an environment captured by a reference pose; receives a query image captured by a device camera; determines a camera pose of the device camera with respect to the reference camera based in part on the reference image and the query image; and determines a pose of the query camera in the environment based on the reference pose and the relative pose.
65.《Niantic Patent | Player device proximity detection for a location-based game》
In one embodiment, a client device associated with a player of a location-based game detects client devices associated with other players in the vicinity of that player's device. Such detection of other player client devices may result in various game actions occurring, such as the exchange of game elements between players, the progress of a player's game, access to game features, or the establishment of a connection between players. Detection of a player device may be performed using a personal area network device (e.g., Bluetooth) of the client device. Proximity detection can occur when a player client device is disconnected from an online system hosting a location-based game, wherein the detection is later reported to the online system by one or both devices.
64.《HTC Patent | Virtual reality display (HTC Patent: VR display)》
In one embodiment, the virtual reality display described in the patent includes a display module and an optical module. The display module includes a display, a liquid crystal unit, a first phase delayer, and a polarizing directional lens. The optical module includes a transmission and reflection lens, a second phase delayer, a reflection polarizer, and a lens element. The liquid crystal unit is disposed between the display and the first phase delay, and the polarization directional lens is disposed between the first phase delay and the transreflective lens. The transreflective lens is disposed between the polarization directional lens and the second phase delay, and the reflective polarizer is disposed between the second phase phase delay and the lens element.
66.《HTC Patent | Head-mounted display device (HTC Patent: Head-mounted device)》
In one embodiment, the patent describes a head-mounted display device comprising a main body and a first simulator coupled to the main body. The first simulator includes a plurality of nozzles, a plurality of air channels, a first fan, and a plurality of regulators. The nozzles face a user's eyes. The first fan is configured to drive a flow of external air through the air channels to the corresponding nozzles. Regulators are provided between the air passages and the corresponding nozzles to independently regulate a flow rate of air ejected from the nozzles.
66.《Lumus Patent | Optical device alignment methods》
In one embodiment, a display source aligned with the illuminating prism assembly is displaced along the displacement axis to adjust the distance between the display source and the collimating prism assembly. The display source, the illuminating prism assembly, and the illumination module move in unison translationally in a plane perpendicular to the displacement axis. In another method, components of the optical device are coupled to the mechanical assembly in a known orientation. The mechanical assembly has a test pattern in the known orientation. An image sensor is aligned with the test pattern and the image sensor captures an image of the test pattern. The captured image is analyzed to determine an estimated orientation of the test pattern. An orientation parameter of the image sensor is adjusted based on a comparison between the known orientation of the test pattern and the estimated orientation of the test pattern.
EN_US 
ZH