Object Occlusion to Initiate a Visual Search
First Claim
Patent Images
1. A method comprising:
- receiving video data recorded by a camera on a wearable computing device, wherein the video data comprises at least a first frame and a second frame;
detecting a pinch gesture, wherein detecting the pinch gesture comprises both;
(a) detecting an area in the first frame that is at least partially bounded by a pointing device; and
(b) within a predetermined period of time from detecting the area in the first frame that is at least partially bounded by the pointing device, detecting in the second frame that the area is at least partially occluded by the pointing device; and
in response to detecting the pinch gesture, initiating a search on image content in the detected area in the first frame.
2 Assignments
0 Petitions
Accused Products
Abstract
Methods and devices for initiating a search of an object are disclosed. In one embodiment, a method is disclosed that includes receiving video data recorded by a camera on a wearable computing device, where the video data comprises at least a first frame and a second frame. The method further includes, based on the video data, detecting an area in the first frame that is at least partially bounded by a pointing device and, based on the video data, detecting in the second frame that the area is at least partially occluded by the pointing device. The method still further includes initiating a search on the area.
-
Citations
20 Claims
-
1. A method comprising:
-
receiving video data recorded by a camera on a wearable computing device, wherein the video data comprises at least a first frame and a second frame; detecting a pinch gesture, wherein detecting the pinch gesture comprises both; (a) detecting an area in the first frame that is at least partially bounded by a pointing device; and (b) within a predetermined period of time from detecting the area in the first frame that is at least partially bounded by the pointing device, detecting in the second frame that the area is at least partially occluded by the pointing device; and in response to detecting the pinch gesture, initiating a search on image content in the detected area in the first frame. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A wearable computing device comprising:
-
a camera configured to record video data comprising at least a first frame and a second frame; at least one processor; and data storage comprising instructions executable by the at least one processor to; detect a pinch gesture, wherein detection of the pinch gesture comprises both; (a) detection of an area in the first frame that is at least partially bounded by a pointing device; and (b) within a predetermined period of time from detection of the area in the first frame that is at least partially bounded by the pointing device, detection in the second frame that the area is at least partially occluded by the pointing device; and in response to detecting the pinch gesture, initiate a search on image content in the detected area in the first frame. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A method comprising:
-
receiving video data recorded by a camera on a computing device, wherein the video data comprises at least a first frame and a second frame; detecting a pinch gesture, wherein detecting the pinch gesture comprises both; (a) detecting a first area in the first frame that is at least partially bounded by a pointing device; and (b) within a predetermined period of time from detecting the first area in the first frame that is at least partially bounded by the pointing device, detecting in the second frame that the first area is at least partially occluded by the pointing device; and determining an adjustment based at least in part on a location of the camera relative to an eye location; applying the determined adjustment to the first area to determine a second area in the first frame that corresponds to the pinch gesture in a field of view associated with the computing device; and in response to detecting the pinch gesture, initiating a search on image content corresponding to the second area in the first frame. - View Dependent Claims (20)
-
Specification