Device interaction with spatially aware gestures

• US 9,671,873 B2
• Filed: 09/01/2015
• Issued: 06/06/2017
• Est. Priority Date: 12/31/2013
• Status: Expired due to Fees

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Kauffmann, Alejandro Jose, Plagemann, Christian
• Primary Examiner(s): Cheng, Joe H
• Application Number:
  US14/841,978
• Publication Number:
  US 20150370336A1
• Time in Patent Office: 644 Days
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

Described is a system and technique for providing the ability for a user to interact with one or more devices by performing gestures that mimic real-world physical analogies. More specifically, the techniques described herein provide the ability for a user to interact with a device by limiting the conscious gesturing for a computer component by camouflaging computer-recognizable gestures within manipulations of a physical objects.

Claims

1. A computer-implemented method comprising:

detecting a first user in an image;

detecting, by one or more processors, that the first user in the image has performed a gesture that involves the first user passing a mobile computing device to a second user, or about to pass the mobile computing device to the second user;

in response to detecting that the first user in the image has performed the gesture, identifying, by the one or more processors, (i) content on the mobile computing device, and (ii) a computing device associated with the second user; and

providing the computing device associated with the second user with access to at least a portion of the content.

2. The computer-implemented method of claim 1, wherein detecting, by the one or more processors, that the first user in the image has performed the gesture that involves the first user passing the mobile computing device to the second user, or about to pass the mobile computing device to the second user, further comprises:

determining that a hand of the second user is oriented in a manner such as to allow the hand of the second user to receive the mobile computing device.

3. The computer-implemented method of claim 1, further comprising:

transmitting, to the mobile computing device, a request to identify the content on the mobile computing device, and receiving, in response to the request, a response that identifies the content.

4. The computer-implemented method of claim 1, further comprising:

determining an identity of the first user of the mobile computing device,

wherein the content on the mobile computing device is identified based at least on the identity of the first user of the mobile computing device.

5. The computer-implemented method of claim 1, further comprising:

before identifying content on the mobile computing device, transmitting an instruction to the mobile computing device to request access by the computing device associated with the second user to content on the mobile computing device.

6. The computer-implemented method of claim 5, further comprising:

receiving the identified content from a remote source that is other than the mobile computing device.

7. The computer-implemented method of claim 1, wherein:

identifying content on the mobile computing device comprises identifying (i) a video item including content that is being played on the mobile computing device at a particular point in time, and (ii) a playback position of the video item that corresponds to the content that is being played on the mobile computing device at the particular point in time; and

providing the computing device associated with the second user with access to at least a portion of the content comprises providing the computing device associated with the second user with (i) access to the video item, and (ii) data that indicates the playback position of the video item.

8. A non-transitory computer-readable storage device having instructions stored thereon that, when executed by a computing device, cause the computing device to perform operations comprising:

detecting a first user in an image;

detecting that the first user in the image has performed a gesture that involves the first user passing a mobile computing device to a second user, or about to pass the mobile computing device to the second user;

in response to detecting that the first user in the image has performed the gesture, identifying (i) content on the mobile computing device, and (ii) a computing device associated with the second user; and

providing the computing device associated with the second user with access to at least a portion of the content.

9. The storage device of claim 8, wherein detecting that the first user in the image has performed the gesture that involves the first user passing the mobile computing device to the second user, or about to pass the mobile computing device to the second user, further comprises:

determining that a hand of the second user is oriented in a manner such as to allow the hand of the second user to receive the mobile computing device.

10. The storage device of claim 8, wherein the operations further comprise:

transmitting, to the mobile computing device, a request to identify the content on the mobile computing device, and receiving, in response to the request, a response that identifies the content.

11. The storage device of claim 8, wherein the operations further comprise:

determining an identity of the first user of the mobile computing device; and

wherein the content on the mobile computing device is identified based at least on the identity of the first user of the mobile computing device.

12. The storage device of claim 8, wherein the operations further comprise:

before identifying content on the mobile computing device, transmitting an instruction to the mobile computing device to request access by the computing device associated with the second user to content on the mobile computing device.

13. The computer-implemented method of claim 12, wherein the operations further comprise:

receiving the identified content from a remote source that is other than the mobile computing device.

14. The storage device of claim 8, wherein:

identifying content on the mobile computing device comprises identifying (i) a video item including content that is being played on the mobile computing device at a particular point in time, and (ii) a playback position of the video item that corresponds to the content that is being played on the mobile computing device at the particular point in time; and

providing the computing device associated with the second user with access to at least a portion of the content comprises providing the computing device associated with the second user with (i) access to the video item, and (ii) data that indicates the playback position of the video item.

15. A system comprising:

one or more data processing apparatus; and

a non-transitory computer-readable storage device having stored thereon instructions that, when executed by the one or more data processing apparatus, cause the one or more data processing apparatus to perform operations comprising;

detecting a first user in an image;

detecting that the first user in the image has performed a gesture that involves the first user passing a mobile computing device to a second user, or about to pass the mobile computing device to the second user;

in response to detecting that the first user in the image has performed the gesture, identifying (i) content on the mobile computing device, and (ii) a computing device associated with the second user; and

providing the computing device associated with the second user with access to at least a portion of the content.

16. The system of claim 15, wherein detecting that the first user in the image has performed the gesture that involves the first user passing the mobile computing device to the second user, or about to pass the mobile computing device to the second user, comprises:

determining that a hand of the second user is oriented in a manner such as to allow the hand of the second user to receive the mobile computing device.

17. The system of claim 15, wherein the operations further comprise:

transmitting, to the mobile computing device, a request to identify the content on the mobile computing device, and receiving, in response to the request, a response that identifies the content.

18. The system of claim 15, wherein the operations further comprise:

determining an identity of the first user of the mobile computing device; and

wherein the content on the mobile computing device is identified based at least on the identity of the first user of the mobile computing device.

19. The system of claim 15, wherein the operations further comprise:

before identifying content on the mobile computing device, transmitting an instruction to the mobile computing device to request access by the computing device associated with the second user to content on the mobile computing device.

20. The system of claim 19, wherein the operations further comprise:

receiving the identified content from a remote source that is other than the mobile computing device.