Navigable telepresence method and system utilizing an array of cameras
First Claim
1. A telepresence system for providing a first user with a first display of an environment and a second user with a second display of the environment, the system comprising:
- an array of cameras, each camera having an associated view of the environment and an associated camera output representing the associated view, the array including at least one camera path and a first camera having a first output and a second camera having a second output;
a first user interface device associated with the first user having first user inputs associated with movement along a first path in the array;
a second user interface device associated with the second user having second user inputs associated with movement along a second path in the array;
at least one processing element coupled to the user interface devices for receiving user inputs, the processing element configured to interpret received first inputs and select outputs of cameras in the first path, interpret received second inputs and select outputs of cameras in the second path independently of the first inputs, thereby allowing the first user and second user to navigate simultaneously and independently through the array, and the processing element is configured to mix the first and second outputs in accordance with the received first user inputs by mosaicing the view associated with the first camera with the view of the second camera.
0 Assignments
0 Petitions
Accused Products
Abstract
A telepresence system for providing users with displays of a remote environment. In certain embodiments, the system includes a plurality of arrays of cameras, with each arrays are situated at varying lengths from the environment. Users navigate the arrays via interface devices. The system interprets the user inputs and selects camera outputs based thereon. Multiple users are able to navigate simultaneously and independently through the environment. In embodiments having overlapping camera views, the system effectuates seamless motion along camera paths by processing the camera outputs corresponding to the views.
-
Citations
30 Claims
-
1. A telepresence system for providing a first user with a first display of an environment and a second user with a second display of the environment, the system comprising:
-
an array of cameras, each camera having an associated view of the environment and an associated camera output representing the associated view, the array including at least one camera path and a first camera having a first output and a second camera having a second output;
a first user interface device associated with the first user having first user inputs associated with movement along a first path in the array;
a second user interface device associated with the second user having second user inputs associated with movement along a second path in the array;
at least one processing element coupled to the user interface devices for receiving user inputs, the processing element configured to interpret received first inputs and select outputs of cameras in the first path, interpret received second inputs and select outputs of cameras in the second path independently of the first inputs, thereby allowing the first user and second user to navigate simultaneously and independently through the array, and the processing element is configured to mix the first and second outputs in accordance with the received first user inputs by mosaicing the view associated with the first camera with the view of the second camera. - View Dependent Claims (2, 3)
-
-
4. A device for providing a user with a display of an environment in response to user inputs, the system comprising:
-
an array of cameras, each camera having an associated view of the environment and an associated camera output representing the associated view;
memory storing an additional source output; and
at least one processing element coupled to the memory for receiving the additional source output, the processing element configured to interptet user inputs and select, based on the user inputs, a camera output to provide to the user, the additional source output to provide to the user, or both a camera view and the additional source output to provide to the user, and the processing element is configured to mix the additional source output with camera output by mosaicing from the camera output to the additional source output.
-
-
5. A system for remote seamless viewing of an environment from an array of cameras, each having an output representing an image of the environment, the device comprising:
-
an interface device having inputs for selecting a path through at least a portion of the array from which to view the environment, the path including a sequence of cameras, each camera in the sequence having a different point perspective and a field of view that overlaps that of an adjacent cameras; and
a display device for sequentially displaying the image from each camera in the sequence by mosaicing the image of a current camera in the sequence to the image of a next camera in the sequence, thereby providing the user a seamless view of the environment.
-
-
6. A method for seamless viewing of an environment, the method comprising:
-
receiving electronically a first image from an array of cameras, the first image having a first field of view;
receiving electronically a second image from the array, the second image having a second field of view that overlaps the first field of view;
receiving electronically a third image from the array, the third image having a third field of view that overlaps the second field of view;
mosaicing the first image with the second image and then mosaicing the second image with the third image; and
displaying the first, second, third and mosaic images in sequence to obtaining a seamless view through the environment. - View Dependent Claims (7, 8, 9)
-
-
10. A telepresence system for providing a first user with a first display of an environment and a second user with a second display of the environment, the system comprising:
-
an array of cameras, each camera having an associated view of the environment and an associated camera output representing the associated view, the array including at least one camera path and a first camera having a first output and a second camera having a second output;
a first user interface device associated with the first user having first user inputs associated with movement along a first path in the array;
a second user interface device associated with the second user having second user inputs associated with movement along a second path in the array;
at least one processing element coupled to the user interface devices for receiving user inputs, the processing element configured to interpret received first inputs and select outputs of cameras in the first path, interpret received second inputs and select outputs of cameras in the second path independently of the first inputs, thereby allowing the first user and second user to navigate simultaneously and independently through the array, and the processing element is configured to mix the first and second outputs in accordance with the received first user inputs by tweening the view associated with the first camera with the view of the second camera. - View Dependent Claims (11, 12)
-
-
13. A device for providing a user with a display of an environment in response to user inputs, the system comprising:
-
an array of cameras, each camera having an associated view of the environment and an associated camera output representing the associated view;
memory storing an additional source output; and
at least one processing element coupled to the memory for receiving the additional source output, the processing element configured to interpret user inputs and select, based on the user inputs, a camera output to provide to the user, the additional source output to provide to the user, or both a camera view and the additional source output to provide to the user, and the processing element is configured to mix the additional source output with camera output by tweening from the camera output to the additional source output.
-
-
14. A system for remote seamless viewing of an environment from an array of cameras, each having an output representing an image of the environment, the device comprising:
-
an interface device having inputs for selecting a path through at least a portion of the array from which to view the environment, the path including a sequence of cameras, each camera in the sequence having a different point perspective and a field of view that overlaps that of an adjacent cameras; and
a display device for sequentially displaying the image from each camera in the sequence by tweening the image of a current camera in the sequence to the image of a next camera in the sequence, thereby providing the user a seamless view of the environment.
-
-
15. A method for seamless viewing of an environment, the method comprising:
-
receiving electronically a first image from an array of cameras, the first image having a first field of view;
receiving electronically a second image from the array, the second image having a second field of view that overlaps the first field of view;
receiving electronically a third image from the array, the third image having a third field of view that overlaps the second field of view;
tweening the first image with the second image and then mosaicing the second image with the third image; and
displaying the first, second, third and tweened images in sequence to obtaining a seamless view through the environment. - View Dependent Claims (16, 17, 18)
-
-
19. A method of providing users with real time views of a remote environment, the method comprising:
-
receiving electronic images of the environment from an array of cameras, the array including at least one camera path through the environment;
receiving a first input -from a first-user interface device associated with a first user, the first input indicating movement along a first path;
receiving a second input from a second user interface device associated with a second user, the second input indicating movement along a second path;
obtaining a first mixed image by mosaicing or tweening, with a first processing element, a first image with a second image in accordance with the first input;
obtaining a second mixed image by mosaicing or tweening, with a second processing element, a third image with a fourth image in accordance with the second input;
providing the first user with the first mixed image in substantially real time, thereby simulating movement along the first path; and
providing the second user with the second mixed image substantially in real time and simultaneous to providing the first user with the first mixed image, thereby independently and simulating movement along the second path. - View Dependent Claims (20, 21)
-
-
22. A telepresence system for providing a first user with a first display of an environment and a second user with a second display of the environment, the system comprising:
-
a plurality of removable arrays of cameras, each camera having an associated view of the environment and an associated camera output representing the associated view;
at least one storage device including a plurality of storage nodes wherein the output of each camera is stored in an associated storage node, the storage nodes are accessible to permit at least one path for viewing the environment;
a first user interface device associated with the first user having first user inputs associated with movement along a first path in the environment;
a second user interface device associated with the second user having second user inputs associated with movement along a second path in the environment;
at least one processing element coupled to the user interface devices for receiving user inputs including moving up down, clockwise around an environment, counter-clockwise around an environment, forward and backward through the environment, the processing element configured to interpret received first inputs and select outputs of the storage nodes forming the first path, and interpret received second inputs and select outputs of storage nodes forming the second path independently of the first inputs, thereby allowing the first user and second user to navigate simultaneously and independently through the environment. - View Dependent Claims (23, 24, 25, 26)
-
-
27. A telepresence system for providing a first user with a first display of an environment and a second user with a second display of the environment, the system comprising:
-
a plurality of removable arrays of cameras, each camera having an associated view of the environment and an associated camera output representing the associated view, the arrays situated at varying lengths from the environment and including at least one path for viewing the environment, said arrays are removed after the cameras in the array have transmitted the output to an associated storage node;
at least one storage device including a plurality of storage nodes wherein the output of each camera is stored in an associated storage node, the storage nodes are accessible to permit at least one path for viewing the environment;
a first user interface device associated with the first user having first user inputs associated with movement along a first path in the environment;
a second user interface device associated with the second user having second user inputs associated with movement along a second path in the environment;
at least one processing element coupled to the user interface devices for receiving user inputs including moving up down, clockwise around an environment, counter-clockwise around an environment, forward and backward through the environment, the processing element configured to interpret received first inputs and select outputs of the storage node forming the first path, and interpret received second inputs and select outputs of the storage node forming the second path independently of the first inputs, thereby allowing the first user and second user to navigate simultaneously and independently through the environment.
-
-
28. A method of providing users with views of a remote environment, the method comprising:
-
receiving electronic images of the environment from a plurality of array of cameras;
storing the image of the environment in storage nodes associated with each camera, the storage nodes are accessible to permit at least one path for viewing the environment;
removing the array of cameras after storing the image in the associated storage node;
receiving a first input from a first user interface device associated with a first user, the first input indicating movement along a first path;
receiving a second input from a second user interface device associated with a second user, the second input indicating movement along a second path;
obtaining a first mixed image by mixing, with a first processing element, a first image with a second image in accordance with the first input;
obtaining a second mixed image by mixing, with a second processing element, a third image with a fourth image in accordance with the second input;
providing the first user with the first mixed image thereby simulating movement along the first path; and
providing the second user with the second mixed image thereby independently and simulating movement along the second path. - View Dependent Claims (29, 30)
-
Specification