Augmented collaboration system

• US 9,113,050 B2
• Filed: 01/13/2011
• Issued: 08/18/2015
• Est. Priority Date: 01/13/2011
• Status: Active Grant

• Current Assignee: The Boeing Co.
• Original Assignee: The Boeing Co.
• Inventors: Laughlin, Brian Dale
• Primary Examiner(s): RAHAMAN, MOHAMMED S
• Application Number:
  US13/005,753
• Publication Number:
  US 20120183137A1
• Time in Patent Office: 1,678 Days
• Field of Search: 348/143, 348/E7.085, 345/633
• US Class Current: 1/1
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control

Abstract

A method and apparatus for displaying information. A camera system generates video data for an object from a viewpoint of the camera system at a location of the object. Information is identified about the object. The information is displayed on images in the video data on a display system at a number of locations. The display of the images with the information on the images in the video data at the number of locations is from the viewpoint of the camera system.

Claims

1. An apparatus comprising:

a computer system configured to receive video data comprising images of an object from a camera system at a location of the object;

identify the object using the video data and an object recognition process;

identify information about the object using a database of objects including the object, wherein identification of the information is made by the object recognition process, wherein the information comprises first information and second information different from the first information;

add the information to the video data;

identify a first portion of the images for a first user and a second portion of the images for a second user, the first portion of the images different from the second portion of the images; and

concurrently display the first portion of the images and the first information to the first user on a first display system at a first location and the second portion of the images and the second information to the second user on a second display system at a second location, wherein the first location is different from the location of the object and the second location is different from the first location and the location of the object;

wherein the first user has a first security clearance and the second user has a second security clearance higher than the first security clearance; and

the computer system is configured to identify the first information and the first portion of the images for the first user based on the first security clearance and identify the second information and the second portion of the images for the second user based on the second security clearance.

2. The apparatus of claim 1,

wherein the camera system is worn by a third user at the location of the object and comprises:

a display device configured to be worn by the third user at the location of the object and display the information on the images in the video data on the display device worn by the third user at the location of the object.

3. The apparatus of claim 1, wherein the computer system is configured to decrypt the information about the object using a set of keys, wherein the set includes a first key for the first security clearance and a second key for the second security clearance.

4. The apparatus of claim 1, wherein the images in the video data are for a portion of the object and wherein at least one of the first display system and the second display system is configured to display a larger portion of the object including the portion and display a graphical indicator on the larger portion in addition to being configured to display the information on the images in the video data of the portion of the object, wherein the graphical indicator identifies the portion within the larger portion.

5. The apparatus of claim 1, wherein the information presented to the first user is based on a profile for the first user and the information presented to the second user is based on a profile for the second user.

6. A method for displaying information, the method comprising:

generating, by a camera system, video data comprising images of an object from a viewpoint of the camera system at a location of the object;

identifying the object using the video data and an object recognition process executed by a computer system;

identifying the information about the object using a database of objects including the object, wherein identification of the information is made by the object recognition process wherein the information comprises first information and second information different from the first information;

adding the information to the video data;

identifying a first portion of the images for a first user and a second portion of the images for a second user, the first portion being different from the second portion; and

concurrently displaying the first portion of the images and the first information to the first user on a first display system at a first location and the second portion of the images and the second information to the second user on a second display system at a second location, wherein the first location is different from the location of the object and the second location is different from the first location and the location of the object;

wherein the first user has a first security clearance and the second user has a second security clearance higher than the first security clearance;

and

identifying the first information and the first portion of the images for the first user based on the first security clearance and identifying the second information and the second portion of the images for the second user based on the second security clearance.

7. The method of claim 6,

wherein the camera system is worn by a third user at the location of the object and further comprising:

displaying the information on the images in the video data on a display device worn by the third user.

8. The method of claim 6 further comprising, decrypting the information about the object using a set of keys, wherein the set includes a first key for the first security clearance and a second key for the second security clearance.

9. The method of claim 6, wherein the images in the video data are for a portion of the object and further comprising:

displaying a larger portion of the object including the portion in addition to displaying the information on the images of the portion of the object; and

displaying a graphical indicator on the larger portion, wherein the graphical indicator identifies the portion within the larger portion.