Enabling gesture input for controlling a presentation of content
First Claim
1. A computer implemented method for determining user input to a mobile computing device, the method comprising:
- under control of one or more computer systems configured with executable instructions,communicating with an automobile to determine that a mobile computing device is located within a detection range relative to the automobile;
determining a movement of the automobile;
causing the mobile computing device to activate an air gesture input mode in association with the mobile computing device;
disabling a touch input mode of the mobile computing device based at least in part on the movement of the automobile;
determining a movement of a user using an infrared detector of the mobile computing device, the infrared detector having a resolution;
activating a first front-facing camera of the mobile computing device, the first front-facing camera having a first resolution higher than the resolution of the infrared detector;
activating a second front facing camera of the mobile computing device, the second front-facing camera having a second resolution higher than the resolution of the infrared detector;
obtaining a first image using the first front-facing camera of the mobile computing device, the first front-facing camera having a first field of view;
obtaining a second image using the second front-facing camera of the mobile computing device, the second front-facing camera separated a distance from the first front-facing camera and having a second field of view that partially overlaps the first field of view;
analyzing the first image to determine a feature point corresponding to a representation of a hand of the user with respect to the mobile computing device, the hand being located within an area relative to the mobile computing device;
analyzing the second image to determine a same feature point;
determining a first location of the feature point in the first image and a second location of the same feature point in the second image;
determining a path of the feature point, the path corresponding to a gesture, the gesture being one of a plurality of gestures associated with controlling presentation of media content; and
causing a function to be performed with respect to the media content being presented, the function corresponding to the gesture.
1 Assignment
0 Petitions
Accused Products
Abstract
Approaches are described for providing input to a portable computing device, such as a mobile phone. A user'"'"'s hand can be detected based on data (e.g., one or more images) obtained by at least one sensor of the device, such as camera, and the images can be analyzed to locate the hand of the user. As part of the location computation, the device can determine a motion being performed by the hand of the user, and the device can determine a gesture corresponding to the motion. In the situation where the device is controlling a media player capable of playing media content, the gesture can be interpreted by the device to cause the device to, e.g., pause a media track or perform another function with respect to the media content being presented via the device.
-
Citations
25 Claims
-
1. A computer implemented method for determining user input to a mobile computing device, the method comprising:
under control of one or more computer systems configured with executable instructions, communicating with an automobile to determine that a mobile computing device is located within a detection range relative to the automobile; determining a movement of the automobile; causing the mobile computing device to activate an air gesture input mode in association with the mobile computing device; disabling a touch input mode of the mobile computing device based at least in part on the movement of the automobile; determining a movement of a user using an infrared detector of the mobile computing device, the infrared detector having a resolution; activating a first front-facing camera of the mobile computing device, the first front-facing camera having a first resolution higher than the resolution of the infrared detector; activating a second front facing camera of the mobile computing device, the second front-facing camera having a second resolution higher than the resolution of the infrared detector; obtaining a first image using the first front-facing camera of the mobile computing device, the first front-facing camera having a first field of view; obtaining a second image using the second front-facing camera of the mobile computing device, the second front-facing camera separated a distance from the first front-facing camera and having a second field of view that partially overlaps the first field of view; analyzing the first image to determine a feature point corresponding to a representation of a hand of the user with respect to the mobile computing device, the hand being located within an area relative to the mobile computing device; analyzing the second image to determine a same feature point; determining a first location of the feature point in the first image and a second location of the same feature point in the second image; determining a path of the feature point, the path corresponding to a gesture, the gesture being one of a plurality of gestures associated with controlling presentation of media content; and causing a function to be performed with respect to the media content being presented, the function corresponding to the gesture. - View Dependent Claims (2, 3, 4, 5)
-
6. A computer implemented method, comprising:
under control of one or more computer systems configured with executable instructions, detecting a connection with an electronic media system of an automobile by a computing device; determining a movement of the automobile; causing the computing device to activate an air gesture input mode based at least in part on detecting the connection; disabling a touch input mode of the computing device based at least in part on the movement of the automobile; determining a movement of a user using an infrared detector of the computing device, the infrared detector having a resolution; activating a first front-facing camera of the computing device, the first front-facing camera having a first resolution higher than the resolution of the infrared detector; activating a second front-facing camera of the computing device, the second front-facing camera having a second resolution higher than the resolution of the infrared detector; obtaining a first image using the first front-facing camera of the computing device, the first front-facing camera having a first field of view; obtaining a second image using the second front-facing camera of the computing device, the second front-facing camera separated a distance from the first front-facing camera and having a second field of view that partially overlaps the first field of view; analyzing the first image to determine a feature point corresponding to a representation of a hand of the user with respect to the computing device, the hand being located within an area relative to the computing device; analyzing the second image to determine a same feature point; determining a first location of the feature point in the first image and a second location of the same feature point in the second image; determining a path of the feature point, the path corresponding to a motion being performed by the user; determining a gesture corresponding to the motion, the gesture being one of a plurality of gestures corresponding to one or more actions to be performed by the computing device; and performing the one or more actions corresponding to the gesture. - View Dependent Claims (7, 8, 9, 10, 11, 12, 13, 14, 15)
-
16. A computing system, comprising:
-
at least one processor; and memory including instructions that, when executed by the processor, cause the computing system to; detect a connection with an electronic media system of an automobile by a computing device; determining a movement of the automobile; cause the computing device to activate an air gesture input mode based at least in part on detecting the connection; disabling a touch input mode of the computing device based at least in part on the movement of the automobile; determining a movement of a user using an infrared detector of the computing device, the infrared detector having a resolution; activating a first front-facing camera of the computing device, the first front-facing camera having a first resolution higher than the resolution of the infrared detector; activating a second front-facing camera of the computing device, the second front-facing camera having a second resolution higher than the resolution of the infrared detector; obtain a first image using the first front-facing camera of the computing device, the first front-facing camera having a first field of view; obtain a second image using the second front-facing camera of the computing device, the second front-facing camera separated a distance from the first front-facing camera and having a second field of view that partially overlaps the first field of view; analyze the first image to determine a feature point corresponding to a representation of a hand of the user with respect to the mobile computing device, the hand being located within an area relative to the mobile computing device; analyze the second image to determine a same feature point; determine a first location of the feature point in the first image and a second location of the same feature point in the second image; determine a path of the feature point, the path corresponding to a gesture, the gesture being one of a plurality of gestures corresponding to one or more actions to be performed by the computing device; and perform the one or more actions corresponding to the gesture. - View Dependent Claims (17, 18, 19, 20, 21)
-
-
22. A non-transitory computer readable storage medium storing one or more sequences of instructions executable by one or more processors to perform a set of operations comprising:
-
detecting a connection with an electronic media system of an automobile by a computing device; determining a movement of the automobile; causing the computing device to activate an air gesture input mode based at least in part on detecting the connection; disabling a touch input mode of the computing device based at least in part on the movement of the automobile; determining a movement of a user using an infrared detector of the computing device, the infrared detector having a resolution; activating a first front-facing camera of the computing device, the first front-facing camera having a first resolution higher than the resolution of the infrared detector; activating a second front-facing camera of the computing device, the second front-facing camera having a second resolution higher than the resolution of the infrared detector; obtaining a first image using the first front-facing camera of the computing device, the first front-facing camera having a first field of view; obtaining a second image using the second front-facing camera of the computing device, the second front-facing camera separated a distance from the first front-facing camera and having a second field of view that partially overlaps the first field of view; analyzing the first image to determine a feature point corresponding to a representation of a hand of the user with respect to the computing device, the hand being located within a gesture area relative to the computing device; analyzing the second image to determine a same feature point; determining a first location of the feature point in the first image and a second location of the same feature point in the second image; determining a path of the feature point, the path corresponding to a gesture, the gesture being one of a plurality of gestures corresponding to one or more actions to be performed by the computing device; and performing the one or more actions corresponding to the gesture. - View Dependent Claims (23, 24)
-
-
25. A computer implemented method for determining user input to a mobile computing device, the method comprising:
under control of one or more computer systems configured with executable instructions, communicating with an automobile to determine that a mobile computing device is located within a detection range relative to the automobile; causing the mobile computing device to activate an air gesture input mode in association with the mobile computing device; disabling a touch input mode of the mobile computing device; determining a movement of a user using an infrared detector of the mobile computing device, the infrared detector having a resolution; activating a first front-facing camera of the mobile computing device the first front-facing camera having a first resolution higher than the resolution of the infrared detector; activating a second front facing camera of the mobile computing device, the second front-facing camera having a second resolution higher than the resolution of the infrared detector; obtaining a first image using the first front-facing camera of the mobile computing device, the first front-facing camera having a first field of view; obtaining a second image using the second front-facing camera of the mobile computing device, the second front-facing camera separated a distance from the first front-facing camera and having a second field of view that partially overlaps the first field of view; analyzing the first image to determine a feature point corresponding to a representation of a hand of the user with respect to the mobile computing device, the hand being located within an area relative to the mobile computing device; analyzing the second image to determine a same feature point; determining a first location of the feature point in the first image and a second location of the same feature point in the second image; determining a path of the feature point, the path corresponding to a gesture, the gesture being one of a plurality of gestures associated with controlling presentation of media content; and causing a function to be performed with respect to the media content being presented, the function corresponding to the gesture.
Specification