User centric interface for interaction with visual display that recognizes user intentions

• US 8,933,882 B2
• Filed: 12/30/2013
• Issued: 01/13/2015
• Est. Priority Date: 12/31/2012
• Status: Expired due to Fees

• Current Assignee: Intentiva Inc.
• Original Assignee: Intentive Incorporated
• Inventors: Burachas, Giedrius Tomas
• Primary Examiner(s): SHAH, PRIYANK J
• Application Number:
  US14/144,515
• Publication Number:
  US 20140184494A1
• Time in Patent Office: 379 Days
• Field of Search: 345156-158, 382/181, 382185-189, 715/780, 715/863
• US Class Current: 345/157
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042

Abstract

Systems, methods, means and computer program products for identifying graphical objects are disclosed. Certain systems, methods, means and computer program products may identify a graphical object based on geometric relationships between two or more user body parts and the graphical object. Certain systems, methods, means and computer program products identify a graphical object based on analysis of pictorial images depicting positions of user body parts relative to each other.

Claims

1. A system for identifying a target object that is displayed on a screen, the system comprising at least one processor that:

determines a position of a first body part of a user using a first video frame from a camera;

determines a position of a second body part of the user using the first video frame;

identifies a region of a screen based on the position of the first body part and the position of the second body part;

identifies a target object, from among graphical objects displayed on the screen, that corresponds to the region on the screen;

identifies a first point on an image plane associated with the camera, wherein the first point corresponds to a location of the second body part along a calibration sight line between the first body part and a calibration object displayed on the screen;

identifies a second point on the image plane, wherein the second point corresponds to a location of the second body part along a target sight line between the first body part and a target point on the screen;

identifies a third point on a second plane that corresponds to the second point on the image plane, wherein the second plane is parallel to the screen and intersects the image plane;

identifies a fourth point on the second plane that corresponds to the first point on the image plane;

determines a scaling factor based on a position of the calibration object relative to a position of the camera, and further based on a location of the fourth point on the second plane; and

identifies the target object based on the scaling factor and the location of the third point on the second plane.

2. The system of claim 1, wherein the processor:

identifies a fifth point on the image plane, wherein the fifth point corresponds to a location of the first body part on at least one of the calibration sight line and the target sight line, wherein the second plane intersects the fifth point on the image plane, and wherein the scaling factor is determined based on the position of the calibration object relative to the position of the camera, and further based on the location of the fourth point relative to the fifth point on the second plane.

3. The system of claim 1, wherein the processor:

detects a gesture made by the second body part when positions of the second body part corresponding to a plurality of video frames indicate an acceleration pattern of movement followed by a period of quiescence.

4. The system of claim 3, wherein the gesture manipulates the target object.

5. The system of claim 3, wherein the gesture includes the position of the second body part of the user that was determined using the first video frame.

6. The system of claim 4, wherein the acceleration pattern of movement is associated with movement of the second body part in at least two dimensions.

7. The system of claim 5, wherein the acceleration pattern of movement is associated with movement of the second body part in at least two dimensions.