Apple Patent | Method of displaying user interfaces in an environment and corresponding electronic device and computer readable storage medium

Patent: Method of displaying user interfaces in an environment and corresponding electronic device and computer readable storage medium

Publication Number: 20250291470

Publication Date: 2025-09-18

Assignee: Apple Inc

Abstract

Methods for displaying user interfaces in a computer-generated environment provide for an efficient and intuitive user experience. In some embodiments, user interfaces can have different immersion levels. In some embodiments, a user interface can have a respective immersion level based on its location in the three-dimensional environment or distance from the user. In some embodiments, a user interface can have a respective immersion level based on the state of the user interface. In some embodiments, a user interface can switch from one immersion level to another in response to the user's interaction with the user interface.

Claims

1. A method comprising:at an electronic device in communication with a display:presenting, via the display, a three-dimensional environment including a user interface, the user interface including:a first user interface object, with a first immersion level, at a first depth in the three-dimensional environment relative to a location corresponding to the location of the electronic device in the three-dimensional environment; andwhile displaying first user interface object at the first depth, receiving a first user input, performed by a hand of a user directed at the first user interface object; andin response to receiving the first user input:in accordance with a determination that the first user input satisfies one or more first criteria, and that the hand of the user moves more than a first threshold amount and less than a second threshold amount, greater than the first threshold amount;moving the first user interface object to a second depth, different than the first depth, relative to the location corresponding to the electronic device in the three-dimensional environment, based on the first user input; andupdating the first user interface object from the first immersion level to a second immersion level, different than the first immersion level; andin accordance with a determination that the first user input satisfies the one or more first criteria, and that the hand of the user moves more than the second threshold amount:moving the first user interface object to a third depth, different than the first depth and the second depth, relative to the location corresponding to the electronic device in the three-dimensional environment, based on the first user input; andupdating the first user interface object from the first immersion level to a third immersion level, different than the first immersion level and the second immersion level.

2. The method of claim 1, further comprising:after updating the first user interface object from the first immersion level to a respective immersion level based on the first user input, while displaying the first user interface object within the respective immersion level, receiving a second user input corresponding to a request to display content via a first application; andin response to receiving the second user input, configuring the first application to have the respective immersion level.

3. The method of claim 2, wherein the first application is located within an effective boundary of the first user interface object.

4. The method of claim 1, further comprising:in accordance with a determination that the first user input satisfies the one or more first criteria, and that hand of the user moves less than the first threshold amount, and less than the second threshold amount:moving the first user interface object to a respective depth, different than the first depth, different than the second depth and different than the third depth, relative to the location corresponding to the electronic device in the three-dimensional environment, based on the first user input; andforgoing updating the first user interface object from the first immersion level to a respective immersion level, different than the first immersion level.

5. The method of claim 1, wherein the first user input includes a selection input followed by a movement of the hand of the user.

6. The method of claim 1, wherein the first user input includes movement of the hand in a first direction, and wherein moving the first user interface object to the second depth includes moving the first user interface object in a first depth direction, the method further comprising:after the first user input, while displaying first user interface object at the second depth, receiving a second user input, performed by the hand of a user directed at the first user interface object; andin response to receiving the second user input:in accordance with a determination that the second user input satisfies one or more second criteria, and that the hand of the user moves in a second direction, opposite the first direction, more than the first threshold amount:moving the first user interface object in a second depth direction, opposite to the first depth direction, to a fourth depth, different than the second depth, relative to the location corresponding to the electronic device in the three-dimensional environment, based on the second user input; andupdating the first user interface object from the second immersion level or the third immersion level to a fourth immersion level, different than the second immersion level.

7. The method of claim 1, further comprising:while detecting the first user input, displaying a first target in the three-dimensional environment indicative of a placement location for the first user interface object in response to a termination of the user interface;while displaying the first target, detecting the termination of the first user input; andin response to detecting the termination of the first user input, moving the first user interface object to the placement location and ceasing displaying the first target.

8. An electronic device, comprising:one or more processors;memory; andone or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:presenting, via the display, a three-dimensional environment including a user interface, the user interface including:a first user interface object, with a first immersion level, at a first depth in the three-dimensional environment relative to a location corresponding to the location of the electronic device in the three-dimensional environment; andwhile displaying first user interface object at the first depth, receiving a first user input, performed by a hand of a user directed at the first user interface object; andin response to receiving the first user input:in accordance with a determination that the first user input satisfies one or more first criteria, and that the hand of the user moves more than a first threshold amount and less than a second threshold amount, greater than the first threshold amount:moving the first user interface object to a second depth, different than the first depth, relative to the location corresponding to the electronic device in the three-dimensional environment, based on the first user input; andupdating the first user interface object from the first immersion level to a second immersion level, different than the first immersion level; andin accordance with a determination that the first user input satisfies the one or more first criteria, and that the hand of the user moves more than the second threshold amount:moving the first user interface object to a third depth, different than the first depth and the second depth, relative to the location corresponding to the electronic device in the three-dimensional environment, based on the first user input; andupdating the first user interface object from the first immersion level to a third immersion level, different than the first immersion level and the second immersion level.

9. The electronic device of claim 8, the one or more programs including instructions for:after updating the first user interface object from the first immersion level to a respective immersion level based on the first user input, while displaying the first user interface object within the respective immersion level, receiving a second user input corresponding to a request to display content via a first application; andin response to receiving the second user input, configuring the first application to have the respective immersion level.

10. The electronic device of claim 9, wherein the first application is located within an effective boundary of the first user interface object.

11. The electronic device of claim 8, the one or more programs including instructions for:in accordance with a determination that the first user input satisfies the one or more first criteria, and that hand of the user moves less than the first threshold amount, and less than the second threshold amount:moving the first user interface object to a respective depth, different than the first depth, different than the second depth and different than the third depth, relative to the location corresponding to the electronic device in the three-dimensional environment, based on the first user input; andforgoing updating the first user interface object from the first immersion level to a respective immersion level, different than the first immersion level.

12. The electronic device of claim 8, wherein the first user input includes a selection input followed by a movement of the hand of the user.

13. The electronic device of claim 8, wherein the first user input includes movement of the hand in a first direction, and wherein moving the first user interface object to the second depth includes moving the first user interface object in a first depth direction, the one or more programs including instructions for:after the first user input, while displaying first user interface object at the second depth, receiving a second user input, performed by the hand of a user directed at the first user interface object; andin response to receiving the second user input:in accordance with a determination that the second user input satisfies one or more second criteria, and that the hand of the user moves in a second direction, opposite the first direction, more than the first threshold amount:moving the first user interface object in a second depth direction, opposite to the first depth direction, to a fourth depth, different than the second depth, relative to the location corresponding to the electronic device in the three-dimensional environment, based on the second user input; andupdating the first user interface object from the second immersion level or the third immersion level to a fourth immersion level, different than the second immersion level.

14. The electronic device of claim 8, the one or more programs including instructions for:while detecting the first user input, displaying a first target in the three-dimensional environment indicative of a placement location for the first user interface object in response to a termination of the user interface;while displaying the first target, detecting the termination of the first user input; andin response to detecting the termination of the first user input, moving the first user interface object to the placement location and ceasing displaying the first target.

15. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:present, via the display, a three-dimensional environment including a user interface, the user interface including:a first user interface object, with a first immersion level, at a first depth in the three-dimensional environment relative to a location corresponding to the location of the electronic device in the three-dimensional environment; andwhile displaying first user interface object at the first depth, receive a first user input, performed by a hand of a user directed at the first user interface object; andin response to receiving the first user input:in accordance with a determination that the first user input satisfies one or more first criteria, and that the hand of the user moves more than a first threshold amount and less than a second threshold amount, greater than the first threshold amount:move the first user interface object to a second depth, different than the first depth, relative to the location corresponding to the electronic device in the three-dimensional environment, based on the first user input; andupdate the first user interface object from the first immersion level to a second immersion level, different than the first immersion level; andin accordance with a determination that the first user input satisfies the one or more first criteria, and that the hand of the user moves more than the second threshold amount:move the first user interface object to a third depth, different than the first depth and the second depth, relative to the location corresponding to the electronic device in the three-dimensional environment, based on the first user input; andupdate the first user interface object from the first immersion level to a third immersion level, different than the first immersion level and the second immersion level.

16. The non-transitory computer readable storage medium of claim 15, wherein the instructions, when executed by the one or more processors, cause the electronic device to:after updating the first user interface object from the first immersion level to a respective immersion level based on the first user input, while displaying the first user interface object within the respective immersion level, receive a second user input corresponding to a request to display content via a first application; andin response to receiving the second user input, configure the first application to have the respective immersion level.

17. The non-transitory computer readable storage medium of claim 16, wherein the first application is located within an effective boundary of the first user interface object.

18. The non-transitory computer readable storage medium of claim 15, wherein the instructions, when executed by the one or more processors, cause the electronic device to:in accordance with a determination that the first user input satisfies the one or more first criteria, and that hand of the user moves less than the first threshold amount, and less than the second threshold amount:move the first user interface object to a respective depth, different than the first depth, different than the second depth and different than the third depth, relative to the location corresponding to the electronic device in the three-dimensional environment, based on the first user input; andforgo updating the first user interface object from the first immersion level to a respective immersion level, different than the first immersion level.

19. The non-transitory computer readable storage medium of claim 15, wherein the first user input includes a selection input followed by a movement of the hand of the user.

20. The non-transitory computer readable storage medium of claim 15, wherein the first user input includes movement of the hand in a first direction, and wherein moving the first user interface object to the second depth includes moving the first user interface object in a first depth direction, wherein the instructions, when executed by the one or more processors, cause the electronic device to:after the first user input, while displaying first user interface object at the second depth, receive a second user input, performed by the hand of a user directed at the first user interface object; andin response to receiving the second user input:in accordance with a determination that the second user input satisfies one or more second criteria, and that the hand of the user moves in a second direction, opposite the first direction, more than the first threshold amount:move the first user interface object in a second depth direction, opposite to the first depth direction, to a fourth depth, different than the second depth, relative to the location corresponding to the electronic device in the three-dimensional environment, based on the second user input; andupdate the first user interface object from the second immersion level or the third immersion level to a fourth immersion level, different than the second immersion level.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No. 18/668,032, filed May 17, 2024, and published on Sep. 12, 2024 as U.S. Publication No. 2024-0302948, which is a continuation of U.S. patent application Ser. No. 18/182,304, filed Mar. 10, 2023, and issued on May 28, 2024 as U.S. Pat. No. 11,995,301, which is a continuation of International Application No. PCT/US2021/049130, filed Sep. 3, 2021, which claims the benefit of U.S. Provisional Application No. 63/077,104, filed Sep. 11, 2020, the contents of which are incorporated herein by reference in their entireties for all purposes.

FIELD OF THE DISCLOSURE

This relates generally to methods for displaying user interfaces in a computer-generated environment.

BACKGROUND OF THE DISCLOSURE

Computer-generated environments are environments where at least some objects displayed for a user's viewing are generated using a computer. Users may interact with a computer-generated environment, such as by causing display of a user interface for an application.

SUMMARY OF THE DISCLOSURE

Some embodiments described in this disclosure are directed to methods of displaying user interfaces of an application in a computer-generated environment. Some embodiments described in this disclosure are directed to different immersion levels for user interfaces in a computer-generated environment. These interactions provide a more efficient and intuitive user experience. The full descriptions of the embodiments are provided in the Drawings and the Detailed Description, and it is understood that this Summary does not limit the scope of the disclosure in any way.

BRIEF DESCRIPTION OF THE DRAWINGS

For a better understanding of the various described embodiments, reference should be made to the Detailed Description below, in conjunction with the following drawings in which like reference numerals refer to corresponding parts throughout the figures.

FIG. 1 illustrates an electronic device displaying a computer-generated environment according to some embodiments of the disclosure.

FIGS. 2A-2B illustrate block diagrams of exemplary architectures for a device or devices in accordance with some embodiments of the disclosure.

FIGS. 3A-3C illustrate a method of displaying a user interface of an application in a three-dimensional environment according to some embodiments of the disclosure.

FIGS. 4A-4B illustrate a method of displaying objects on a user interface of an application according to some embodiments of the disclosure.

FIGS. 5A-5B illustrate a method of switching from one immersion level to another immersion level according to some embodiments of the disclosure.

FIGS. 6A-6B illustrate a method of switching from one immersion level to another immersion level according to some embodiments of the disclosure.

FIG. 7 is a flow diagram illustrating a method of displaying a user interface of an application in a three-dimensional environment according to some embodiments of the disclosure.