Systems and methods of interfacing with a machine
First Claim
1. A method of interfacing with a machine, comprising:
- at each of multiple capture times, contemporaneously acquiring a respective image from each of multiple fields of view defining an interactive space to create a respective set of contemporaneous images;
detecting an input target in the acquired images;
computing two-dimensional coordinates of the input target detected in the acquired images;
constructing a spatiotemporal input data structure linking each of the capture times to the computed two-dimensional coordinates of the input target in each of the contemporaneously acquired images in a respective one of the sets of contemporaneous images;
processing the spatiotemporal input data structure to identify an input instruction; and
executing the identified input instruction on the machine.
1 Assignment
0 Petitions
Accused Products
Abstract
Systems and methods of interfacing with a machine are described. In one aspect, sets of contemporaneous images of an interactive space are acquired from multiple respective fields of view. An input target is detected in the acquired images. Coordinates of the input target detected in the acquired images are computed. A spatiotemporal input data structure linking input target coordinates computed from contemporaneous images to respective reference times is constructed. The spatiotemporal input data structure is processed to identify an input instruction. The identified input instruction is executed on a machine. In another aspect, an image is displayed at a display location disposed between a viewing space and an interactive space, wherein the displayed image is viewable from a perspective in the viewing space. Images of the interactive space are acquired from at least one field of view. An input target is detected in the acquired images. Coordinates of the input target detected in the acquired images are computed. An input instruction is identified based on the computed input coordinates. The identified input instruction is executed on a machine.
-
Citations
63 Claims
-
1. A method of interfacing with a machine, comprising:
-
at each of multiple capture times, contemporaneously acquiring a respective image from each of multiple fields of view defining an interactive space to create a respective set of contemporaneous images; detecting an input target in the acquired images; computing two-dimensional coordinates of the input target detected in the acquired images; constructing a spatiotemporal input data structure linking each of the capture times to the computed two-dimensional coordinates of the input target in each of the contemporaneously acquired images in a respective one of the sets of contemporaneous images; processing the spatiotemporal input data structure to identify an input instruction; and executing the identified input instruction on the machine. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29)
-
-
30. A method of interfacing with a machine, comprising:
-
acquiring sets of contemporaneous images of an interactive space from multiple respective fields of view; detecting an input target in the acquired images; computing coordinates of the input target detected in the acquired images; constructing a spatiotemporal input data structure linking input target coordinates computed from contemporaneous images to respective reference times; processing the spatiotemporal input data structure to identify an input instruction; and executing the identified input instruction on the machine; and interpolating between fields of view to generate a synthetic view of the interactive space.
-
-
31. A system for interfacing with a machine, comprising:
-
multiple imaging devices configured to contemporaneously acquire, at each of multiple capture times, a respective image from each of multiple fields of view defining an interactive space to create a respective set of contemporaneous images; and a processing module configured to detect an input target in the acquired images, compute two-dimensional coordinates of the input target detected in the acquired images, construct a spatiotemporal input data structure linking each of the capture times to the computed two-dimensional coordinates of the input target in each of the contemporaneously acquired images in a respective one of the sets of contemporaneous images, process the spatiotemporal input data structure to identify an input instruction, and execute the identified input instruction on the machine.
-
-
32. A machine-readable medium storing machine-readable instructions for causing a machine to:
-
at each of multiple capture times, contemporaneously acquire a respective image from each of multiple fields of view defining an interactive space to create a respective set of contemporaneous images; detect an input target in the acquired images; compute two-dimensional coordinates of the input target detected in the acquired images; construct a spatiotemporal input data structure linking each of the capture times to the computed two-dimensional coordinates of the input target in each of the contemporaneously acquired images in a respective one of the sets of contemporaneous images; process the spatiotemporal input data structure to identify an input instruction; and execute the identified input instruction on the machine.
-
-
33. A method of interfacing with a machine, comprising:
-
displaying an image at a display location disposed between a viewing space and an interactive space, wherein the displayed image is viewable from a perspective in the viewing space; acquiring images of the interactive space from a field of view directed toward the interactive space along an optical axis intersecting a central area of the display location; detecting an input target in the acquired images; computing coordinates of the input target detected in the acquired images; identifying an input instruction based on the computed input coordinates; and executing the identified input instruction on the machine. - View Dependent Claims (34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61)
-
-
62. A system of interfacing with a machine, comprising:
-
a display configured to present an image at a display location disposed between a viewing space and an interactive space, wherein the displayed image is viewable from a perspective in the viewing space; at least one imaging device configured to acquire images of the interactive space from a field of view directed toward the interactive space along an optical axis intersecting a central area of the display location; and a processing system configured to detect an input target in the acquired images, compute coordinates of the input target detected in the acquired images, identify an input instruction based on the computed input coordinates, and execute the identified input instruction on the machine.
-
-
63. A machine-readable medium storing machine-readable instructions for causing a machine to:
-
display an image at a display location disposed between a viewing space and an interactive space, wherein the displayed image is viewable from a perspective in the viewing space; acquire images of the interactive space from a field of view directed toward the interactive space along an optical axis intersecting a central area of the display location; detect an input target in the acquired images; compute coordinates of the input target detected in the acquired images; identify an input instruction based on the computed input coordinates; and execute the identified input instruction on the machine.
-
Specification