Techniques for occlusion accomodation

• US 9,317,746 B2
• Filed: 09/25/2012
• Issued: 04/19/2016
• Est. Priority Date: 09/25/2012
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Shoemaker, Garth
• Primary Examiner(s): Wu, Xiao
• Assistant Examiner(s): ELBINGER, STEVEN Z
• Application Number:
  US13/626,725
• Publication Number:
  US 20140085342A1
• Time in Patent Office: 1,302 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06V 40/18 Eye characteristics, e.g. of the iris
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: G09G 2340/0464 Positioning
• CPC Class Codes: G09G 2340/14 Solving problems related to the presentation of information to be displayed
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 5/14 Display of multiple viewports

Abstract

Techniques may be used to accommodate occlusion. An occlusion accommodation application may determine a display position of a display of a computing device, an eye position of an eye of a user and an object position of an object. The object may be positioned between the display and the eye of the user. The occlusion accommodation application may identify, in real-time, an occluded area based on the display position, object position and the eye position.

Claims

1. An apparatus, comprising:

a processor circuit; and

an occlusion accommodation application operative on the processor circuit to determine an occluded area on a display, the occlusion accommodation application comprising;

a viewing perspective component operative to determine an eye position of at least one eye of a user, a display position of the display, and an object position of an object positioned in an area physically away from the display and between the display and the at least one eye of the user, the object not touching the at least one eye of the user;

an occlusion warning component operative to determine a sensing modality position of a sensing modality, determine whether the sensing modality is occluded from tracking the eye position of the at least one eye of the user as a result of the object position and send a warning to the sensing modality if the sensing modality is occluded;

an occluded area determination component operative to determine the occluded area based on the object position, the display position and the eye position; and

a content adjustment component operative to determine content presented on the display that is located in the determined occluded area and present the occluded content in a different area on the display.

2. The apparatus of claim 1, the object comprises one or more hands of the user, an item, or an item held by the user.

3. The apparatus of claim 1, the sensing modality comprising a gaze tracking detection device, an eye movement detection device or a camera.

4. The apparatus of claim 1, the viewing perspective component operative to determine the object position of the object based on a geometric model, a volumetric model or a skeletal model.

5. The apparatus of claim 1, the occluded area determination component operative to apply a geometric perspective projection to the object position based on the eye position and the display position.

6. The apparatus of claim 1, the occluded area determination component operative to mathematically determine one or more bounds of the occluded area.

7. The apparatus of claim 1, comprising the display, the display comprises a digital display operatively coupled to the processor circuit.

8. The apparatus of claim 1, comprising one or more cameras operatively coupled to the processor circuit, the one or more cameras comprising one or more of a depth camera, a stereo camera, an infrared camera and a Red-Green-Blue camera.

9. The apparatus of claim 1, comprising one or more sensors or cameras to determine the object position of an object.

10. At least one non-transitory machine readable medium comprising a plurality of instructions that in response to being executed on a computing device cause the computing device to:

determine a display position of a display of a computing device, an eye position of an eye of a user and an object position of an object positioned in an area physically away from the display and between the display and the eye of the user, the object not touching the at least one eye of the user;

determine a sensing modality position of a sensing modality, determine whether the sensing modality is occluded from tracking the eye position of the at least one eye of the user as a result of the object position and send a warning to the sensing modality if the sensing modality is occluded;

identify, in real-time, an occluded area based on the display position, object position and the eye position; and

cause the computing device to present content from the occluded area on the display in a different area on the display.

11. The least one non-transitory machine readable medium of claim 10, comprising a plurality of instructions that in response to being executed on a computing device cause the computing device to apply a geometric perspective projection to the object position based on the eye position and the display position.

12. The least one non-transitory machine readable medium of claim 10, comprising a plurality of instructions that in response to being executed on a computing device cause the computing device to receive the object position based on one or more of a geometric model, a volumetric model or a skeletal model.

13. The least one non-transitory machine readable medium of claim 10, comprising a plurality of instructions that in response to being executed on a computing device cause the computing device to determine an object position of an object, wherein the object position comprises three dimensional data about a position of the object relative to the display.

14. The least one non-transitory machine readable medium of claim 10, comprising a plurality of instructions that in response to being executed on a computing device cause the computing device to determine content of the occluded area.

15. The least one non-transitory machine readable medium of claim 10, the sensing modality comprising a gaze tracking detection device, an eye movement detection device or a camera.

16. A system, comprising:

a processor circuit;

a display operatively coupled to the processor circuit; and

an occlusion accommodation application operative on the processor circuit to determine an occluded area on the display, the occlusion accommodation application comprising;

a viewing perspective component to determine an eye position of at least one eye of a user, a display position of the display, and an object position of an object positioned in an area physically away from the display and between the display and the at least one eye of the user, the object not touching the at least one eye of the user;

an occlusion warning component operative to determine a sensing modality position of a sensing modality, determine whether the sensing modality is occluded from tracking the eye position of the at least one eye of the user as a result of the object position and send a warning to the sensing modality if the sensing modality is occluded;

an occluded area determination component to determine, in real-time, an occluded area of the display based on the eye position, the display position and the object position of the object positioned between the display and the at least one eye of the user; and

a content adjustment component to determine occluded content based on the determined occluded area on the display and present the occluded content in a different area on the display.

17. The system of claim 16, the occluded area determination component to mathematically determine one or more bounds of the occluded area.

18. The system of claim 16, the occluded area determination component to apply a geometric perspective projection to the object position.

19. The system of claim 16, the sensing modality comprising a gaze tracking detection device, an eye movement detection device or a camera.

20. A computer-implemented method comprising:

determining an eye position of a user and an object position of an object positioned in an area physically away from the display and between a display and at least one eye of the user, the object not touching the at least one eye of the user;

determining a sensing modality position of a sensing modality, determine whether the sensing modality is occluded from tracking the eye position of the at least one eye of the user as a result of the object position and send a warning to the sensing modality if the sensing modality is occluded;

identifying an occluded area on the display based on the eye position, a display position of the display and the object positioned in an area physically away from the display and between the display and at least one eye of the user; and

presenting content from the occluded area on the display in a different area on the display.

21. The computer-implemented method of claim 20, determining one or more of a shape and extent of the occluded area.

22. The computer-implemented method of claim 20, comprising:

determining the eye position, the display position and the object position in real-time.

23. The computer-implemented method of claim 20, the object position comprises three dimensional data about a position of the object relative to the display.

24. The computer-implemented method of claim 20, the object comprises one or more hands of the user, an item, or an item held by the user.

25. The computer-implemented method of claim 20, comprising:

determining the object position based on one or more of a geometric model, a volumetric model, or a skeletal model.

26. The computer-implemented method of claim 20, the sensing modality comprising a gaze tracking detection device, an eye movement detection device or a camera.

27. The computer-implemented method of claim 20, comprising:

applying a geometric perspective projection to the object position.