WEARABLE USER DEVICE ENHANCED DISPLAY SYSTEM

• US 20150062160A1
• Filed: 09/27/2013
• Published: 03/05/2015
• Est. Priority Date: 08/30/2013
• Status: Active Grant

• Current Assignee: PayPal, Inc. (PayPal Holdings, Inc.)
• Original Assignee: PayPal, Inc. (PayPal Holdings, Inc.)
• Inventors: Sakamoto, Ares, Gaines, Cory
• Granted Patent: US 9,448,689 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: H04N 17/002 for television cameras

Abstract

Systems and methods for displaying information on a wearable user device include determining calibration information based on user actions and information from images captured by a camera on a wearable user device. A field of view calibration may then be performed on a display engine in the wearable user device using the calibration information. Graphical information may then be displayed on a display device on the wearable user device according to a user field of view using the display engine in the wearable user. Field of view calibrations may be performed using calibration information that is based on: a user'"'"'s head range of motion such that displayed graphical information conforms to that head range of motion, calibration objects by themselves that indicate a user'"'"'s perspective in a user field of view, and calibration objects that allow the size of a user'"'"'s hands to be determined and used to measure objects.

Claims

1. A system, comprising:

a non-transitory memory;

one or more hardware processors coupled to the memory and operable to read instructions from the memory to perform the steps of;

determining calibration information based on at least one user action and information from at least one image captured by a camera;

performing a field of view calibration on a display engine using the calibration information; and

displaying graphical information on a display device according to a user field of view using the display engine.

2. The system of claim 1, wherein the at least one user action includes at least one head movement over a range of head motion, and wherein the information from the at least one image includes information from images captured at opposite ends of the range of head motion by the camera.

3. The system of claim 2, wherein the performing the field of view calibration on the display engine using the calibration information includes determining the user field of view based on the range of head motion, and wherein the displaying graphical information on the display device according to the user field of view using the display engine further includes:

determining at least one icon detail based on the user field of view; and

displaying at least one icon on the display device using the display engine according to the at least one icon detail.

4. The system of claim 1, wherein the at least one user action includes a user positioning themselves a known distance from a primary calibration object, and wherein the information from the at least one image includes information from at least one image captured of the primary calibration object by the camera.

5. The system of claim 4, wherein the performing the field of view calibration on the display engine using the calibration information includes determining a size of the primary calibration object using the known distance and the information from the at least one image captured of the primary calibration object by the camera, and wherein the displaying graphical information on the display device according to the user field of view using the display engine further includes:

receiving at least one image captured of the user field of view by the camera that includes at least one secondary calibration object; and

displaying perspective enhanced graphical information on the display device using the at least one secondary calibration object.

6. The system of claim 1, wherein the at least one user action includes a user placing their hands on a calibration object, and wherein the information from the at least one image includes information from at least one image captured of the user'"'"'s hands on the calibration object by the camera, and wherein the performing the field of view calibration on the display engine using the calibration information includes determining a size of the user'"'"'s hands using the information from the at least one image of the user'"'"'s hands on the calibration object, and wherein the displaying graphical information on the display device according to the user field of view using the display engine further includes:

receiving at least one image captured by the camera of the user field of view that includes the user'"'"'s hands; and

determining, using the calibration information, a measurement distance between the user'"'"'s hands in the at least one image of the user field of view;

displaying measurement graphical information on the display device based on the measurement distance.

7. A method for displaying information on a wearable user device, comprising:

determining calibration information based on at least one user action and information from at least one image captured by a camera on a wearable user device;

performing a field of view calibration on a display engine in the wearable user device using the calibration information; and

displaying graphical information on a display device on the wearable user device according to a user field of view using the display engine in the wearable user.

8. The method of claim 7, wherein the at least one user action includes at least one head movement over a range of head motion, and wherein the information from the at least one image includes information from images captured by the camera in the wearable user device at opposite ends of the range of head motion.

9. The method of claim 8, wherein the performing the field of view calibration on the display engine in the wearable user device using the calibration information includes determining the user field of view based on the range of head motion, and wherein the displaying graphical information on the display device on the wearable user device according to the user field of view using the display engine in the wearable user device further includes:

determining at least one icon detail based on the user field of view; and

displaying at least one icon according to the at least one icon detail on the display device on the wearable user device using the display engine in the wearable user device.

10. The method of claim 7, wherein the at least one user action includes a user positioning themselves a known distance from a primary calibration object, and wherein the information from the at least one image includes information from at least one image captured by the camera on the wearable user device of the primary calibration object.

11. The method of claim 10, wherein the performing the field of view calibration on the display engine in the wearable user device using the calibration information includes determining a size of the primary calibration object using the known distance and the information from the at least one image captured by the camera on the wearable user device of the primary calibration object, and wherein the displaying graphical information on the display device on the wearable user device according to the user field of view using the display engine in the wearable user device further includes:

receiving at least one image captured by the camera on the wearable user device of the user field of view that includes at least one secondary calibration object; and

displaying perspective enhanced graphical information on the display device on the wearable user device using the at least one secondary calibration object.

12. The method of claim 7, wherein the at least one user action includes a user placing their hands on a calibration object, and wherein the information from the at least one image includes information from at least one image captured by the camera on the wearable user device of the user'"'"'s hands on the calibration object.

13. The method of claim 12, wherein the performing the field of view calibration on the display engine in the wearable user device using the calibration information includes determining a size of the user'"'"'s hands using the information from the at least one image captured by the camera on the wearable user device of the user'"'"'s hands on the calibration object, and wherein the displaying graphical information on the display device on the wearable user device according to the user field of view using the display engine in the wearable user device further includes:

receiving at least one image captured by the camera on the wearable user device of the user field of view that includes the user'"'"'s hands; and

determining, using the calibration information, a measurement distance between the user'"'"'s hands in the at least one image captured by the camera on the wearable user device of the user field of view;

displaying measurement graphical information on the display device on the wearable user device based on the measurement distance.

14. A non-transitory machine-readable medium comprising a plurality of machine-readable instructions which, when executed by one or more processors, are adapted to cause the one or more processors to perform a method comprising:

determining calibration information based on at least one user action and information from at least one image captured by a camera on a wearable user device;

performing a field of view calibration on a display engine in the wearable user device using the calibration information; and

displaying graphical information on a display device on the wearable user device according to a user field of view using the display engine in the wearable user.

15. The non-transitory machine-readable medium of claim 14, wherein the at least one user action includes at least one head movement over a range of head motion, and wherein the information from the at least one image includes information from images captured by the camera in the wearable user device at opposite ends of the range of head motion.

16. The non-transitory machine-readable medium of claim 15, wherein the performing the field of view calibration on the display engine in the wearable user device using the calibration information includes determining the user field of view based on the range of head motion, and wherein the displaying graphical information on the display device on the wearable user device according to the user field of view using the display engine in the wearable user device further includes:

determining at least one icon detail based on the user field of view; and

displaying at least one icon according to the at least one icon detail on the display device on the wearable user device using the display engine in the wearable user device.

17. The non-transitory machine-readable medium of claim 14, wherein the at least one user action includes a user positioning themselves a known distance from a primary calibration object, and wherein the information from the at least one image includes information from at least one image captured by the camera on the wearable user device of the primary calibration object.

18. The non-transitory machine-readable medium of claim 17, wherein the performing the field of view calibration on the display engine in the wearable user device using the calibration information includes determining a size of the primary calibration object using the known distance and the information from the at least one image captured by the camera on the wearable user device of the primary calibration object, and wherein the displaying graphical information on the display device on the wearable user device according to the user field of view using the display engine in the wearable user device further includes:

receiving at least one image captured by the camera on the wearable user device of the user field of view that includes at least one secondary calibration object; and

displaying perspective enhanced graphical information on the display device on the wearable user device using the at least one secondary calibration object.

19. The non-transitory machine-readable medium of claim 14, wherein the at least one user action includes a user placing their hands on a calibration object, and wherein the information from the at least one image includes information from at least one image captured by the camera on the wearable user device of the user'"'"'s hands on the calibration object.

20. The non-transitory machine-readable medium of claim 19, wherein the performing the field of view calibration on the display engine in the wearable user device using the calibration information includes determining a size of the user'"'"'s hands using the information from the at least one image captured by the camera on the wearable user device of the user'"'"'s hands on the calibration object, and wherein the displaying graphical information on the display device on the wearable user device according to the user field of view using the display engine in the wearable user device further includes:

receiving at least one image captured by the camera on the wearable user device of the user field of view that includes the user'"'"'s hands; and

determining, using the calibration information, a measurement distance between the user'"'"'s hands in the at least one image captured by the camera on the wearable user device of the user field of view;

displaying measurement graphical information on the display device on the wearable user device based on the measurement distance.