Method and apparatus for push interaction

• US 10,511,778 B2
• Filed: 04/05/2019
• Issued: 12/17/2019
• Est. Priority Date: 02/28/2011
• Status: Active Grant

• Current Assignee: AIC Innovations Group, Inc.
• Original Assignee: AIC Innovations Group, Inc.
• Inventors: Hanina, Adam, Kessler, Gordon, Guan, Lei
• Primary Examiner(s): Parikh, Dakshesh D
• Application Number:
  US16/376,195
• Publication Number:
  US 20190238755A1
• Time in Patent Office: 256 Days
• Field of Search: None
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

A method and apparatus for determining an indication of interaction in a direction towards a webcam. The method includes the steps of determining an object in a region of interest, determining a first size of the object in the region of interest and tracking the object in the region of interest. A second size of the object in the region of interest is then determined, and a push interaction is confirmed as having taken place if the ratio of the second size to the first size is greater than a predetermined value.

Claims

1. A method for determining proper positioning of an object relative to a camera, comprising:

presenting, on a display, an indication of a desired location for placement of the object relative to a field of view of the camera;

determining a movement of the object towards the camera when it appears that the object is moving angularly away from the camera but its size is not changing materially;

determining a position of the object within the field of view of the camera relative to the desired location for placement of the object based on at least the determined movement of the object towards the camera; and

providing one or more instructions in response to the determination of the position of the object to the desired location to aid in guiding the user to move the object within the field of view of the camera towards the desired location.

2. The method of claim 1, wherein guiding placement of the object relative to the indication of desired location for placement of the object is repeated until it is confirmed that the object is properly placed.

3. The method of claim 1, further comprising employing the determined movement of the object towards the camera to aid in determining positioning of the object relative to the desired location for placement of the object.

4. The method of claim 1, further comprising displaying an image of the desired location for the placement of the object.

5. The method of claim 4, wherein the desired location for the placement of the object is displayed to a user to aid in properly placing the object.

6. The method of claim 1, wherein if the object is removed from a field of view of the camera and then repositioned within the field of view of the camera, determining a position of the object is performed again.

7. The method of claim 1, wherein the object is a medication pill.

8. The method of claim 1, wherein the object is a free standing object.

9. A system for determining proper positioning of an object relative to a camera, comprising:

a webcam for capturing one or more images;

a display arranged to present an indication of a desired location for placement of the object relative to a field of view of the camera; and

a processor arranged to process the one or more captured images, the processor operable to present on the display an indication of a desired location for placement of the object relative to the field of view of the camera, provide an instruction guiding in the field of view of the camera placement of the object relative to the indication of desired location for placement of the object, determine a movement of the object towards the camera when it appears that the object is moving angularly away from the camera but its size is not changing materially, and determine a position of the object in the field of view of the camera relative to the desired location for placement of the object based on at least the determined movement of the object towards the camera.

10. The system of claim 9, wherein the object is a medication pill.

11. The system of claim 9, wherein the processor is operable to guide repeatedly placement of the object relative to the indication of desired location for placement of the object until the processor confirms that the object is properly placed.

12. The system of claim 9, wherein the processor employs the determined movement of the object towards the camera to aid in determining positioning of the object relative to the desired location for placement of the object.

13. The system of claim 9, wherein the processor is arranged to cause to be displayed on the display an image of the desired location for the placement of the object.

14. The system of claim 13, wherein the desired location for the placement of the object is displayed to a user to aid in properly placing the object.

15. The system of claim 9, wherein if the object is removed from a field of view of the camera and then repositioned within the field of view of the camera, the processor determines the first size of the object.

16. The system of claim 9, wherein the object is a free standing object.

17. The system of claim 9, wherein the processor is arranged to repeatedly provide an instruction guiding in the field of view of the camera placement of the object relative to the indication of desired location for placement of the object until the processor confirms that the object is properly placed.

18. The system of claim 9, wherein if the object is removed from a field of view of the camera and then repositioned within the field of view of the camera, the processor determines a position of the object again.