Systems and methods for task-based adjustable focal distance for heads-up displays

• US 10,634,913 B2
• Filed: 01/22/2018
• Issued: 04/28/2020
• Est. Priority Date: 01/22/2018
• Status: Active Grant

• Current Assignee: Symbol Technologies, LLC (Zebra Technologies Corporation)
• Original Assignee: Symbol Technologies, LLC (Zebra Technologies Corporation)
• Inventors: Nair, Chandra M., Sun, Wenjun, Croley, Curt D., Sieckowski, Steven D.
• Primary Examiner(s): Davis, Tony O
• Application Number:
  US15/877,080
• Publication Number:
  US 20190227311A1
• Time in Patent Office: 827 Days
• Field of Search: 345419, 345633
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06Q 10/1097 Task assignment
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/80 Recognising image objects characterised by unique random patterns

Abstract

Systems and methods are provided for task-based modification of visual media in a heads-up display. An example system includes a heads-up display assembly configured to be worn by a user, the heads-up display assembly including a head mount and a presentation generator configured to display visual media to the user. The example system further includes a memory, and a processor configured to interface with the presentation generator and the memory. The processor identifies a current task associated with the user, and obtains a focal distance at which the visual media is to be displayed to the user during the performance of the current task. The processor causes the presentation to display the visual media at the obtained focal distance during performance of the current task.

Claims

1. A system for task-based control of visual media in a heads-up display, the system comprising:

a heads-up display assembly configured to be worn by a user, the heads-up display assembly comprising

a head mount, and

a presentation generator configured to display visual media to the user;

a memory configured to store computer executable instructions; and

a processor configured to interface with the presentation generator and the memory, and configured to execute the computer executable instructions to cause the processor to;

access a schedule of tasks associated with the user;

determine a period of time;

identify a current task associated with the user based on the schedule of tasks associated with the user and the current period of time;

obtain a focal distance at which the visual media is to be displayed during the performance of the current task; and

cause the presentation generator to display the visual media at the obtained focal distance during performance of the current task.

2. The system of claim 1, wherein the computer executable instructions, when executed, cause the processor to obtain the focal distance by:

identifying a physical object associated with the current task;

determining a distance between the user and the physical object; and

calculating, based on the distance between the user and the physical object associated with the current task, the focal distance at which the visual media is to be displayed during the performance of the current task.

3. The system of claim 1, further comprising an accelerometer carried by the heads-up display assembly, the accelerometer configured to detect an indication of motion associated with the user;

wherein the processor is configured to interface with the accelerometer, and the computer executable instructions, when executed, cause the processor to identify the current task associated with the user by analyzing the detected indication of motion associated with the user.

4. The system of claim 1, further comprising a sensor carried by the heads-up display assembly, the sensor configured to detect an indication of motion associated with the eyes of the user;

wherein the processor is configured to interface with the sensor, and the computer executable instructions, when executed, cause the processor to identify the current task associated with the user by analyzing the indication of motion associated with the eyes of the user.

5. The system of claim 4, wherein the indication of motion associated with the eyes of the user is a pupil dilation or a pupil constriction.

6. The system of claim 4, wherein the indication of motion associated with the eyes of the user is one or more of a horizontal motion of pupils or a vertical motion of the pupils.

7. The system of claim 1, wherein the computer executable instructions, when executed, cause the processor to:

receive credential information from the user; and

identify the current task associated with the user based on the credential information from the user.

8. The system of claim 1, further comprising:

a camera carried by the heads-up display assembly, the camera configured to capture image data associated with an environment including the user;

wherein the processor is configured to interface with the camera, and the computer executable instructions, when executed, cause the processor to;

analyze the image data associated with the environment; and

identify the current task associated with the user based on the analysis of the image data associated with the environment.

9. The system of claim 8, wherein the computer executable instructions, when executed, cause the processor to:

analyze the image data associated with the environment to identify a physical object associated with the current task; and

identify the current task associated with the user based on one or more of;

(i) apparent dimensions of the identified physical object;

(ii) a position of the identified physical object;

(iii) a speed of the identified physical object;

or (iv) a label attached to the physical object.

10. A computer-implemented method for task-based control of visual media in a heads-up display assembly configured to be worn by a user, the method comprising:

identifying, by a processor, a current task associated with a user of a heads-up display assembly;

obtaining, by the processor, a focal distance at which the visual media is to be displayed by a presentation generator of the heads-up display assembly during the performance of the current task; and

causing, by the processor, the presentation generator to display the visual media during the performance of the current task at the obtained the focal distance,

wherein identifying the current task associated with the user of the heads-up display assembly comprises;

accessing a schedule of tasks associated with the user;

determining a current period of time; and

identifying the current task associated with the user based on the schedule of tasks associated with the user and the current period of time.

11. The computer-implemented method of claim 10, wherein obtaining the focal distance comprises:

identifying a physical object associated with the current task;

determining a distance between the user and the physical object; and

calculating, based on the distance between the user and the physical object, a desirable focal distance at which the visual media is to be displayed during the performance of the current task.

12. The computer-implemented method of claim 10, wherein identifying the current task associated with the user of the heads-up display assembly comprises:

detecting, by an accelerometer carried by the heads-up display assembly, an indication of motion associated with the user; and

identifying, by the processor, the current task associated with the user by analyzing the detected indication of motion associated with the user.

13. The computer-implemented method of claim 10, wherein identifying the current task associated with the user of the heads-up display assembly comprises:

detecting, by a sensor carried by the heads-up display assembly, an indication of motion associated with eyes of the user; and

identifying, by the processor, the current task associated with the user by analyzing the indication of motion associated with the eyes of the user.

14. The computer-implemented method of claim 13, wherein the indication of motion associated with the eyes of the user is a pupil dilation or a pupil constriction.

15. The computer-implemented method of claim 13, wherein the indication of motion associated with the eyes of the user is one or more of a horizontal motion of pupils or a vertical motion of the pupils.

16. The computer-implemented method of claim 10, wherein identifying the current task associated with the user of the heads-up display assembly further comprises:

receiving credential information from the user; and

identifying the current task associated with the user based on the credential information from the user.

17. The computer-implemented method of claim 10, wherein identifying the current task associated with the user of the heads-up display assembly further comprises:

capturing, by a camera carried by the heads-up display assembly, image data associated with an environment including the user;

analyzing, by the processor, the image data associated with the environment; and

identifying, by the processor, the current task associated with the user based on the analysis of the image data.

18. The computer-implemented method of claim 17, wherein identifying the current task associated with the user based on the analysis of the image data associated with the user'"'"'s environment comprises:

analyzing, by the processor, the image data associated with the user'"'"'s environment to identify a physical object; and

identifying, by the processor, the current task associated with the user based on one or more of;

(i) apparent dimensions of the identified physical object;

(ii) a position of the identified physical object;

(iii) a speed of the identified physical object;

or (iv) a label attached to the physical object.