METHOD AND SYSTEM FOR DETERMINING PROPER POSITIONING OF AN OBJECT

• US 20150326835A1
• Filed: 07/15/2015
• Published: 11/12/2015
• Est. Priority Date: 02/28/2011
• Status: Active Grant

• Current Assignee: China Academy of Telecom Technology (China Information Communication Technology Group Co. Ltd.)
• Original Assignee: AI CURE Technologies Incorporated
• Inventors: Hanina, Adam, Kessler, Gordon, Guan, Lei
• Granted Patent: US 9,538,147 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

A method and apparatus for determining an indication of interaction in a direction towards a webcam. The method includes the steps of determining an object in a region of interest, determining a first size of the object in the region of interest and tracking the object in the region of interest. A second size of the object in the region of interest is then determined, and a push interaction is confirmed as having taken place if the ratio of the second size to the first size is greater than a predetermined value.

Claims

1-20. -20. (canceled)

21. A method for determining proper positioning of an object held in a hand by a user relative to a camera, comprising:

presenting on a display of a device an indication of a desired location for placement of the object held in the hand of the user relative to a field of view of the camera;

displaying an indicator on the display of the device for guiding placement of the object held in the hand of the user within the field of view of the camera relative to the indication of desired location for placement of the object;

determining a position of the object in the hand of the user within the field of view of the camera relative to the desired location for placement of the object;

adjusting the indicator on the display in response to the determination of the position of the object to the desired location to aid in guiding the user to move the object within the field of view of the camera towards the desired location;

after adjusting the indicator on the display in response to the determination of the position of the object to the desired location, determining a position of the object in the hand of the user within the field of view of the camera relative to the desired location for placement of the object; and

presenting on the display an indication of proper positioning of the object in the hand of the user within the field of view of the camera relative to the desired position of the location for placement of the object.

22. The method of claim 21, wherein guiding placement of the object held in the hand of the user relative to the indication of desired location for placement of the object is repeated until it is confirmed that the object is properly placed.

23. The method of claim 21, further comprising determining a parallax angle of movement of the object.

24. The method of claim 23, further comprising employing the determined parallax angle to aid in determining positioning of the object in the hand of the user relative to the desired location for placement of the object.

25. The method of claim 21, further comprising displaying an image of the desired location for the placement of the object.

26. The method of claim 25, wherein the desired location for the placement of the object is displayed to a user to aid in properly placing the object held in the hand of the user.

27. The method of claim 21, wherein if the object held in the hand of the user is removed from a field of view of the camera and then repositioned within the field of view of the camera, determining a position of the object is performed again.

28. The method of claim 21, wherein the object is a medication pill.

29. The method of claim 21, wherein the object is a free standing object held in the hand of the user.

30. A system for determining proper positioning of an object held in the hand of the user relative to a camera, comprising:

a webcam for capturing one or more images;

a display arranged to present an indication of a desired location for placement of the object in the hand of the user relative to a field of view of the camera, and to display an indicator for guiding placement of the object held in the hand of the user relative to the field of view of the camera so that the display of the object is guided towards the indication of the desired location; and

a processor arranged to process the one or more captured images, the processor operable to present on the display an indication of a desired location for placement of the object held in the hand of the user relative to the field of view of the camera, display an indicator on the display guiding in the field of view of the camera placement of the object held in the hand of the user relative to the indication of desired location for placement of the object, determine a position of the object in the hand of the user in the field of view of the camera relative to the desired location for placement of the object, adjust the indicator on the display in response to the determination of the position of the object to the desired location to aid in guiding the user to move the object towards the desired location, determine a position of the object in the hand of the user in the field of view of the camera relative to the desired location for placement of the object, and present on the display an indication of proper positioning of the object in the hand of the user in the field of view of the camera relative to the desired position for placement of the object.

31. The system of claim 30, wherein the object is a medication pill.

32. The system of claim 30, wherein the processor is operable to guide repeatedly placement of the object held in the hand of the user relative to the indication of desired location for placement of the object until the processor confirms that the object is properly placed.

33. The system of claim 30, wherein the processor is arranged to determine a parallax angle of movement of the object.

34. The system of claim 33, wherein the processor employs the determined parallax angle to aid in determining positioning of the object in the hand of the user relative to the desired location for placement of the object.

35. The system of claim 30, wherein the processor is arranged to cause to be displayed on the display an image of the desired location for the placement of the object.

36. The system of claim 35, wherein the desired location for the placement of the object is displayed to a user to aid in properly placing the object held in the hand of the user.

37. The system of claim 30, wherein if the object held in the hand of the user is removed from a field of view of the camera and then repositioned within the field of view of the camera, the processor determines the first size of the object in the hand of the user.

38. The system of claim 30, wherein the object is a free standing object held in the hand of the user.

39. The system of claim 30, wherein the processor is arranged to display repeatedly an indicator on the display guiding in the field of view of the camera placement of the object held in the hand of the user relative to the indication of desired location for placement of the object until the processor confirms that the object is properly placed.

40. The system of claim 30, wherein if the object held in the hand of the user is removed from a field of view of the camera and then repositioned within the field of view of the camera, the processor determines a position of the object again.