Device Interaction with Spatially Aware Gestures

• US 20150185854A1
• Filed: 12/31/2013
• Published: 07/02/2015
• Est. Priority Date: 12/31/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Kauffmann, Alejandro Jose, Plagemann, Christian
• Granted Patent: US 9,213,413 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

Described is a system and technique for providing the ability for a user to interact with one or more devices by performing gestures that mimic real-world physical analogies. More specifically, the techniques described herein provide the ability for a user to interact with a device by limiting the conscious gesturing for a computer component by camouflaging computer-recognizable gestures within manipulations of a physical objects.

Claims

1-18. -18. (canceled)

19. A computer-implemented method comprising:

obtaining an image by a first computing device that includes at least a first camera and a first display;

determining that the image shows a user performing a gesture that involves the user holding a second display of a second computing device toward the first camera of the first computing device;

in response to determining that the image shows the user performing the gesture, identifying content that is displayed on the second display of the second computing device; and

providing, for display, at least a portion of the content on the first display of the first computing device.

20. The computer-implemented method of claim 19, comprising transmitting, to the second computing device, a request to identify the content that is displayed on the second display of the second computing device, and receiving, in response to the request, a response that identifies the content.

21. The computer-implemented method of claim 19, comprising:

receiving data generated by a first sensor of the second computing device;

determining, based at least on the received data, that the second display of the second computing device is facing the first computing device; and

wherein the content that is displayed on the second display of the second computing device is identified further in response to determining that the second display of the second computing device is facing the first computing device.

22. The computer-implemented method of claim 19, comprising:

determining an identity of the user that is holding the second computing device; and

wherein identifying content that is displayed on the second display of the second computing device comprises identifying content that is displayed on the second display of the second computing device based at least on the identity of the user that is holding the second computing device.

23. The computer-implemented method of claim 19, comprising, before identifying content that is displayed on the second display of the second computing device, transmitting an instruction to the second computing device to request access by the first computing device to content that is displayed on the second display of the second computing device.

24. The computer-implemented method of claim 23, comprising receiving the identified content from a remote source that is other than the second computing device.

25. A computer-implemented method comprising:

obtaining an image;

determining that the image shows a first user performing a gesture that involves the first user passing a mobile computing device, or about to pass the mobile computing device, to a second user; and

in response to determining that the image shows the user performing the gesture, identifying (i) content on the mobile computing device, and (ii) a computing device associated with the second user; and

providing the computing device associated with the second user with access to at least a portion of the content.

26. The computer-implemented method of claim 25, wherein determining that the image shows a first user performing a gesture that involves the first user passing a mobile computing device, or about to pass the mobile computing device, to a second user, further comprises determining that a hand of the second user is oriented in a manner such as to allow the hand of the second user to receive the mobile computing device.

27. The computer-implemented method of claim 25, comprising transmitting, to the mobile computing device, a request to identify the content on the mobile computing device, and receiving, in response to the request, a response that identifies the content.

28. The computer-implemented method of claim 25, comprising:

determining an identity of the first user of the mobile device; and

wherein the content on the mobile computing device is identified based at least on the identity of the first user of the mobile device.

29. The computer-implemented method of claim 25, comprising, before identifying content on the mobile computing device, transmitting an instruction to the mobile computing device to request access by the computing device associated with the second user to content on the mobile device.

30. The computer-implemented method of claim 29, comprising receiving the identified content from a remote source that is other than the mobile computing device

31. A computer-implemented method comprising:

obtaining multiple images;

determining that the multiple images include (i) a first image that shows a user performing a gesture that involves the user touching a first display of a first computing device, and (ii) a second image that shows the user performing a gesture that involves the user touching a second display of a second computing device;

in response to determining that the multiple images include (i) the first image that shows a user performing a gesture that involves the user touching the first display of the first computing device, and (ii) the second image that shows the user performing a gesture that involves the user touching the second display of the second computing device, identifying content that is displayed on the first display of the first computing device; and

providing the second computing device with access to at least a portion of the content.

32. The computer-implemented method of claim 31, comprising transmitting, to the first computing device, a request to identify the content that is displayed on the first display of the first computing device, and receiving, in response to the request, a response that identifies the content.

33. The computer-implemented method of claim 31, comprising:

determining an identity of the user; and

wherein identifying content that is displayed on the first display of the first computing device comprises identifying content that is displayed on the first display of the first computing device based at least on the identity of the user.

34. The computer-implemented method of claim 31, comprising, before identifying content that is displayed on the first display of the first computing device, transmitting an instruction to the first computing device to request access by the second computing device to content that is displayed on the first display of the first computing device.

35. The computer-implemented method of claim 34, comprising receiving the identified content from a remote source that is other than the first computing device

36. The computer-implemented method of claim 31, wherein the portion of the content comprises a content item associated with an area of the first display touched by the user.