Facebook Patent | Providing an Augmented Reality Overlay for Display Over a View of a User

Patent: Providing an Augmented Reality Overlay for Display Over a View of a User

Publication Number: 20190035153

Publication Date: 2019-01-31

Applicants: Facebook

Abstract

The present disclosure is directed toward systems and methods for generating and providing an augmented reality overlay for display in connection with an augmented reality display device. For example, systems and methods described herein identify a user being viewed through an augmented reality display device, and builds an augmented reality overlay for the user that is displayed on a view of the user through the augmented reality display device. Systems and methods described herein build the augmented reality overlay based on the location of the augmented reality display device, and on other networking system information including a networking system relationship between the user wearing the augmented reality display device and the user who is being looked at through the augmented reality display device.

Background

Augmented reality provides users with views of physical, real-world environments that have been augmented by sound, video, and/or graphics. Augmented reality systems and applications provide a number of advantages in technology areas, such as entertainment and gaming. To illustrate, augmented reality games, such as those playable using mobile devices (e.g., smartphones), are becoming increasingly commonplace and popular. However, the boundaries of augmented reality have just begun to be explored. In particular, conventional augmented reality systems have merely scratched the surface with regard to the application of augmented reality in the day-to-day activities of user. Thus, there are a number of disadvantages corresponding to conventional augmented reality systems.

Summary

One or more embodiments described herein provide benefits and/or solve one or more of the foregoing or other problems in the art with augmented reality systems. For example, the present application discloses various embodiments of systems, methods, and computer-readable media that provide an augmented reality framework that alters the way a networking system user looks and speaks. The systems and methods described herein utilize information associated with a user (e.g., as collected by a social networking system) to generate an augmented reality overlay for the user to alter the user’s appearance. To illustrate, the augmented reality overlay can include attire, jewelry, makeup, hairstyle choices, etc. that are appropriate for the user’s circumstances. The systems and methods described herein then anchor the augmented reality overlay to the user within a display of an augmented reality device, such that the user appears to be wearing the attire, along with the makeup, hairstyle, etc. that are included in the augmented reality overlay.

Additionally, in at least one embodiment, an augmented reality overlay is customized based on the identity of a viewing user. In other words, each viewing user can be provided a unique view of the user based on a variety of factors and other information associated with a relationship between the viewing user and the user being viewed. For example, the disclosed augmented reality system can utilize networking system relationship information to determine that a first attire choice for the user is appropriate to display to the user’s employer, while a second attire choice for the user is appropriate to display to the user’s friend. Thus, the disclosed augmented reality system takes an additional layer of social factors into account beyond simple location considerations when generating a user’s augmented reality overlay.

Furthermore, the disclosed augmented reality system includes an auditory element that enables seamless and instantaneous speech translation within the augmented reality framework. For example, one or more embodiments include translation services that enable a first user and a second user to hold a normal conversation, even though both users speak different languages. In at least one embodiment, systems and methods described herein include a graphical augmented reality element that makes a user’s mouth appear to be synchronized to machine-translated speech. Thus, systems and methods described herein provide the appearance that the user is speaking the language of the listening user, regardless of the actual language being spoken by the speaking user.

The following description sets forth additional features and advantages of one or more embodiments of the disclosed systems and methods. In some cases, such features and advantages will be obvious to a skilled artisan from the description or may be learned by the practice of the disclosed embodiments.