Device control utilizing optical flow
First Claim
Patent Images
1. A computing device comprising:
- a camera configured to capture image data indicative of a wearer field-of-view associated with a wearable computing device when worn; and
a computing system configured to;
determine optical flow from the image data;
determine, based on the optical flow, that the wearable computing device is associated with movement of a vehicle;
responsive to the determination that the wearable computing device is associated with movement of the vehicle;
detect, from the image data, one or more objects in the wearer field-of-view that are indicative of an operator location in the vehicle;
detect gaze data from a gaze tracking sensor that is indicative of focus on a side-view mirror, a rear-view mirror, a speedometer, or other operator-side instrument of the vehicle;
determine, based at least in part on the detection of the one or more objects in the wearer field-of-view and the detection of gaze data indicative of focus on the side-view mirror, the rear-view mirror, the speedometer, or the other operator-side instrument of the vehicle, that the wearable computing device is positioned at the operator location in the vehicle;
control a display to display information in a first mode, when the wearable computing device is associated with the operation of the vehicle; and
control the display to display information in a second mode different from the first mode, when the wearable computing device is not associated with the operation of the vehicle.
2 Assignments
0 Petitions
Accused Products
Abstract
A computing device includes an interface configured to receive image data that is indicative of a field-of-view (FOV) that is associated with a head-mountable display (HMD). The computing device also includes a computing system configured to determine optical flow from the image data and to determine, based on the optical flow, whether or not the HMD is associated with operation of a vehicle. Further, the computing device is configured to control the HMD to display information in a first mode, if the HMD is associated with the operation of the vehicle, and to control the HMD to display information in a second mode, if the HMD is not associated with the operation of the vehicle.
-
Citations
17 Claims
-
1. A computing device comprising:
-
a camera configured to capture image data indicative of a wearer field-of-view associated with a wearable computing device when worn; and a computing system configured to; determine optical flow from the image data; determine, based on the optical flow, that the wearable computing device is associated with movement of a vehicle; responsive to the determination that the wearable computing device is associated with movement of the vehicle; detect, from the image data, one or more objects in the wearer field-of-view that are indicative of an operator location in the vehicle; detect gaze data from a gaze tracking sensor that is indicative of focus on a side-view mirror, a rear-view mirror, a speedometer, or other operator-side instrument of the vehicle; determine, based at least in part on the detection of the one or more objects in the wearer field-of-view and the detection of gaze data indicative of focus on the side-view mirror, the rear-view mirror, the speedometer, or the other operator-side instrument of the vehicle, that the wearable computing device is positioned at the operator location in the vehicle; control a display to display information in a first mode, when the wearable computing device is associated with the operation of the vehicle; and control the display to display information in a second mode different from the first mode, when the wearable computing device is not associated with the operation of the vehicle. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A computer-implemented method comprising:
-
receiving image data that is associated with a wearable computing device, wherein the wearable computing device is operatively coupled to a camera, and wherein the camera captures the image data; processing the image data to determine optical flow; determining, based on the optical flow, that the wearable computing device is associated with movement of a vehicle; and responsive to the determination that the wearable computing device is associated with movement of the vehicle; detecting, in the image data, one or more objects in a wearer field-of-view that are indicative of an operator location in the vehicle; detecting gaze data from a gaze tracking sensor that is indicative of focus on a side-view mirror, a rear-view mirror, a speedometer, or another operator-oriented instrument of the vehicle; and determining, based at least in part on the detection of the one or more objects in the wearer field-of-view and the detection of gaze data indicative of periodic focus on the side-view mirror, the rear-view mirror, the speedometer, or the other operator-side instrument of the vehicle, that the wearable computing device is positioned at the operator location in the vehicle as opposed to a passenger location in the vehicle; identifying an activity based on the optical flow and the position of the wearable computing device in the vehicle, wherein the activity is associated with operation of the vehicle; and controlling the wearable computing device in response to the identified activity, wherein controlling the wearable computing device includes adjusting information displayed by the wearable computing device. - View Dependent Claims (9, 10, 11, 12)
-
-
13. A wearable computing device comprising:
-
a display; an imaging device; and a computing system coupled to the display and the imaging device, wherein the computing system is configured to; determine optical flow by processing image data captured by the imaging device, determine, based on the optical flow, that the wearable computing device is associated with movement of a vehicle; and responsive to the determination that the wearable computing device is associated with movement of the vehicle; detect, from the image data, one or more objects in a wearer field-of-view that are indicative of an operator location in the vehicle; detect gaze data from a gaze tracking sensor that is indicative of periodic focus on a side-view mirror, a rear-view mirror, a speedometer, or other operator-side instrument of the vehicle; determine, based at least in part on the detection of the one or more objects in the wearer field-of-view and the detection of gaze data indicative of periodic focus on the side-view mirror, the rear-view mirror, the speedometer, or the other operator-side instrument of the vehicle, that the imaging device is positioned at the operator location in the vehicle as opposed to a passenger location in the vehicle, identify an activity based on the optical flow and the position of the imaging device in the vehicle, wherein the activity is associated with operation of the vehicle, and control the display to display information in response to the identified activity. - View Dependent Claims (14, 15, 16, 17)
-
Specification