TECHNIQUES FOR OCCLUSION ACCOMODATION

• US 20140085342A1
• Filed: 09/25/2012
• Published: 03/27/2014
• Est. Priority Date: 09/25/2012
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Shoemaker, Garth
• Granted Patent: US 9,317,746 B2
• Time in Patent Office: Days
• US Class Current: 345/672
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06V 40/18 Eye characteristics, e.g. of the iris
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: G09G 2340/0464 Positioning
• CPC Class Codes: G09G 2340/14 Solving problems related to the presentation of information to be displayed
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 5/14 Display of multiple viewports

Abstract

Techniques may be used to accommodate occlusion. An occlusion accommodation application may determine a display position of a display of a computing device, an eye position of an eye of a user and an object position of an object. The object may be positioned between the display and the eye of the user. The occlusion accommodation application may identify, in real-time, an occluded area based on the display position, object position and the eye position.

Claims

1. An apparatus, comprising:

a processor circuit; and

an occlusion accommodation application operative on the processor circuit to determine an occluded area on a display, the occlusion accommodation application comprising;

a viewing perspective component operative to determine an eye position of at least one eye of a user and a display position of the display; and

an occluded area determination component operative to determine the occluded area based on an object position of an object positioned between the display and the at least one eye of the user, the display position and the eye position.

2. The apparatus of claim 1, the object comprises one or more hands of the user, an item, or an item held by the user.

3. The apparatus of claim 1, the occlusion accommodation application comprising an occlusion warning component operative to:

determine a sensing modality position of a sensing modality; and

determine whether the sensing modality is occluded from tracking the eye position as a result of the object position.

4. The apparatus of claim 1, the occlusion accommodation application comprising a content adjustment component operative to:

determine content presented on the display that is located in the determined occluded area; and

present the occluded content in a different area on the display.

5. The apparatus of claim 1, the viewing perspective component operative to determine the object position of the object based on a geometric model, a volumetric model or a skeletal model.

6. The apparatus of claim 1, the occluded area determination component operative to apply a geometric perspective projection to the object position based on the eye position and the display position.

7. The apparatus of claim 1, the viewing perspective component operative to determine an object position when the object is arranged in midair proximate to the computing device.

8. The apparatus of claim 1, the occluded area determination component operative to mathematically determine one or more bounds of the occluded area.

9. The apparatus of claim 1, comprising the display, the display comprises a digital display operatively coupled to the processor circuit.

10. The apparatus of claim 1, comprising one or more cameras operatively coupled to the processor circuit, the one or more cameras comprising one or more of a depth camera, a stereo camera, an infrared camera and a Red-Green-Blue camera.

11. The apparatus of claim 1, comprising one or more sensors or cameras to determine the object position of an object.

12. At least one machine readable medium comprising a plurality of instructions that in response to being executed on a computing device cause the computing device to:

determine a display position of a display of a computing device, an eye position of an eye of a user and an object position of an object positioned between the display and the eye of the user; and

identify, in real-time, an occluded area based on the display position, object position and the eye position.

13. The least one machine readable medium of claim 12, comprising a plurality of instructions that in response to being executed on a computing device cause the computing device to apply a geometric perspective projection to the object position based on the eye position and the display position.

14. The least one machine readable medium of claim 12, comprising a plurality of instructions that in response to being executed on a computing device cause the computing device to present content from the occluded area on the display in a different area on the display.

15. The least one machine readable medium of claim 12, comprising a plurality of instructions that in response to being executed on a computing device cause the computing device to receive the object position based on one or more of a geometric model, a volumetric model or a skeletal model.

16. The least one machine readable medium of claim 12, comprising a plurality of instructions that in response to being executed on a computing device cause the computing device to determine an object position of an object arranged in midair proximate to the computing device.

17. The least one machine readable medium of claim 12, comprising a plurality of instructions that in response to being executed on a computing device cause the computing device to determine an object position of an object, wherein the object position comprises three dimensional data about a position of the object relative to the computing device.

18. The least one machine readable medium of claim 12, comprising a plurality of instructions that in response to being executed on a computing device cause the computing device to determine content of the occluded area.

19. A system, comprising:

a processor circuit;

a display operatively coupled to the processor circuit; and

an occlusion accommodation application operative on the processor circuit to determine an occluded area on the display, the occlusion accommodation application comprising;

a viewing perspective component to determine an eye position of at least one eye of a user and the display position of the display; and

an occluded area determination component to determine, in real-time, an occluded area of the display based on the eye position, the display position and an object position of an object positioned between the display and the at least one eye of the user.

20. The system of claim 19, the occlusion accommodation application comprising a content adjustment component to:

determine occluded content based on the determined occluded area of the display; and

present the occluded content in a different area on the display.

21. The system of claim 19, the occluded area determination component to mathematically determine one or more bounds of the occluded area.

22. The system of claim 19, the occluded area determination component to apply a geometric perspective projection to the object position.

23. A computer-implemented method comprising:

determining an eye position of a user and an object position of an object positioned midair between a display and at least one eye of the user;

identifying an occluded area on the display based on the eye position, a display position of the display and the object position; and

presenting content from the occluded area on the display in a different area on the display.

24. The computer-implemented method of claim 23, determining one or more of the shape and extent of the occluded area.

25. The computer-implemented method of claim 23, comprising:

determining the eye position, the display position and the object position in real-time.

26. The computer-implemented method of claim 23, the object position comprises three dimensional data about a position of the object relative to the computing device.

27. The computer-implemented method of claim 23, the object comprises one or more hands of the user, an item, or an item held by the user.

28. The computer-implemented method of claim 23, comprising:

determining the object position based on one or more of a geometric model, a volumetric model, or a skeletal model

29. The computer-implemented method of claim 23, comprising

determining the eye position based on one or more of sensors or cameras coupled to the computing device.

30. The computer-implemented method of claim 23, comprising:

applying a geometric perspective projection to the object position.