Active fiducials for augmented reality

• US 7,127,082 B2
• Filed: 09/27/2002
• Issued: 10/24/2006
• Est. Priority Date: 09/27/2002
• Status: Expired due to Fees

• Current Assignee: HRL Laboratories LLC (The Boeing Co.)
• Original Assignee: HRL Laboratories LLC (The Boeing Co.)
• Inventors: Neely, Howard
• Primary Examiner(s): Wu, Jingge
• Assistant Examiner(s): Tabatabai, Abolfazl
• Application Number:
  US10/259,948
• Publication Number:
  US 20040071315A1
• Time in Patent Office: 1,488 Days
• Field of Search: 382/103, 382/307, 342/57, 342/357.1, 342/357.16, 342/361, 342/367, 348/14.01, 348/14.02, 348/169, 348/211.3, 348/231.9, 348/724, 348/14.1, 348/140.2, 709/203, 715/744, 725/81, 725/123
• US Class Current: 382/103
• CPC Class Codes: G01S 13/74 Systems using reradiation of radio waves, e.g. secondary radar systems; Analogous systems

Abstract

The present invention provides active fiducials for use with augmented reality client systems. A computer system, a method, and a computer program product are presented, which provide location-registered patterns for providing information regarding objects in an area. The computer system comprises a memory for storing information regarding at least one object, the information including the location of an object. A processor is connected with the memory to retrieve a portion of the information, including the location of the object, from the memory for transmission to the client system via a wireless communication module which is connected with the processor and is configured to detect a compatible client system within communication range of the wireless communication module, and if a compatible client system is detected, to transmit a portion of the information regarding the object, including the location of the object, from the computer system to the client system.

Claims

1. A computer system for providing location-registered patterns for providing information regarding objects in an area, the computer system comprising:

a. a memory for storing information, with the information regarding at least one object, and with the information including a location of each object;

b. a processor connected with the memory to retrieve at least a portion of the information regarding the object, including the location of the object, from the memory in preparation for transmission to the client system via a wireless communication module; and

c. a wireless communication module connected with the processor and configured to detect the presence of a compatible client system within a communication range of the wireless communication module, and if a compatible client system is detected, to transmit at least a portion of the information regarding the object, including the location of the object, from the computer system to the client system.

2. A computer system for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 1, wherein the information regarding the object includes information regarding the appearance of the object.

3. A computer system for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 2, wherein the information regarding the object is a three-dimensional representation of the object computed such that the client system can use the location of the object, the known or estimated location of the client system, and the three-dimensional representation of the object in order to provide a user with a visual representation of the object from a the point of view of the client system.

4. A computer system for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 1, wherein the information regarding the object includes an object identification, which when received by the client system may be used to obtain further information regarding the object from a database.

5. A computer system for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 1, wherein the object has a state and where the information regarding the object includes a representation of the object state.

6. A computer system for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 5, wherein the computer system is configured to receive a signal from a client system at the wireless communication module and to use the information to alter the state of the object.

7. A computer system for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 5, wherein the computer system is configured to receive a system identifier from a client system and to send selective information to the client system based on the system identifier, whereby different client systems may have access to different information regarding the object.

8. A computer system for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 7, wherein the computer system is configured to receive a note from a client system with at least one target client system identifier and to transmit the note to client systems that provide a system identifier matching the target client system identifier.

9. A computer system for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 1, wherein the information is in the form of multimedia information including information selected from the group consisting of audio, video, and text information.

10. A computer system for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 1, wherein the computer system is coupled with a specific object and wherein the information is regarding that object.

11. A computer system for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 10, wherein the information regarding the object includes information regarding the appearance of the object.

12. A computer system for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 11, wherein the information regarding the object is a three-dimensional representation of the object computed such that the client system can use the location of the object, the known or estimated location of the client system, and the three-dimensional representation of the object in order to provide a user with a visual representation of the object from a the point of view of the client system.

13. A computer system for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 12, wherein the object has a state and where the information regarding the object includes a representation of the object state.

14. A computer system for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 13, wherein the computer system is configured to receive a signal from a client system at the wireless communication module and to use the information to alter the state of the object.

15. A computer system for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 13, wherein the computer system is configured to receive a system identifier from a client system and to send selective information to the client system based on the system identifier, whereby different client systems may have access to different information regarding the object.

16. A computer system for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 15, wherein the computer system is configured to selectively send information based on the system identifier of a client system.

17. A computer system for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 15, wherein the computer system is configured to receive information from a client system and to use the information to customize the state information sent to the client system.

18. A computer system for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 17, wherein the computer system further comprises a network interface connected with the processor for networking with other computer systems, whereby the computer system can interact with computer systems in other objects or other computer systems such as those on the Internet.

19. A computer system for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 18, wherein computer system is configured to interact with other computer systems in other objects in order to facilitate communications between client systems located near different objects.

20. A computer system for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 15, wherein the memory of the computer system is operative to store the system identifiers of client systems that have come within communication range of the computer system.

21. A computer system for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 20, wherein the computer system further comprises a network interface for communication with other computer systems and wherein the computer system provides the system identifiers of client systems that have come within communication range of the computer system to another computer.

22. A computer system for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 10, wherein the computer system further comprises a network interface connected with the processor for networking with other computer systems, whereby the computer system can interact with computer systems in other objects or other computer systems such as those on the Internet.

23. A computer system for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 1, wherein the computer system further comprises a network interface connected with the processor for networking with other computer systems, and wherein the computer system is configured to connect with a data server to download updated information regarding the object.

24. A computer system for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 1, wherein at least a portion of the objects are virtual objects and wherein at least a portion of the information transmitted to the client receiver is display information provided to facilitate the display of a representation of the object in a computerized display at its appropriate location within the field of view of the client system.

25. A computer system for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 24, wherein the computer system is configured to receive a system identifier from the client system and to customize the information, including the display information to facilitate a customized representation of the object for the client system.

26. A computer system for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 1, wherein the computer system is configured to receive a request for information from a client system and to send information to the client system based on the request from the client system.

27. A method for providing location-registered patterns for providing information regarding objects in an area, with the method being performed by a computer system comprising a memory, a processor coupled with the memory, and a wireless communication module connected with the processor, the method comprising the steps of:

a. storing information in the memory regarding at least one object, with the information including a location of each object;

b. retrieving at least a portion of the information regarding the object into the processor from the memory, including the location of the object in preparation for transmission to a client system via the wireless communication module; and

c. detecting, at the wireless communication module, the presence of a compatible client system within a communication range of the wireless communication module, and if a compatible client system is detected, transmitting at least a portion of the information regarding the object, including the location of the object, from the computer system to the client system.

28. A method for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 27, wherein the information stored in the storing information step includes information regarding the appearance of the object.

29. A method for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 28, wherein the information stored in the storing information step is a three-dimensional representation of the object computed such that the client system can use the location of the object, the known or estimated location of the client system, and the three-dimensional representation of the object in order to provide a user with a visual representation of the object from a the point of view of the client system.

30. A method for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 27, wherein the information stored in the storing information step includes an object identification, which when received by the client system may be used to obtain further information regarding the object from a database.

31. A method for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 27, wherein the object has a state and where the information stored in the storing information step regarding the object includes a representation of the object state.

32. A method for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 31, wherein the computer system is configured to facilitate additional steps of receiving a signal from a client system at the wireless communication module and to using the information to alter the state of the object.

33. A method for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 31, wherein the computer system is configured facilitate additional steps of receiving a system identifier from a client system and of sending selective information to the client system based on the system identifier, whereby different client systems may have access to different information regarding the object.

34. A method for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 33, wherein the computer system is configured to facilitate additional steps of receiving a note from a client system with at least one target client system identifier and of transmitting the note to client systems that provide a system identifier matching the at least one target client system identifier.

35. A method for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 27, wherein the information stored in the storing information step is in the form of multimedia information including information selected from the group consisting of audio, video, and text information.

36. A method for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 27, wherein the computer system operating the steps in the method is coupled with a specific object and wherein the information stored in the storing information step is regarding that particular object.

37. A method for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 36, wherein the information stored in the storing information step regarding the object includes information regarding the appearance of the object.

38. A method for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 37, wherein the information stored in the storing information step regarding the object is a three-dimensional representation of the object computed such that the client system can use the location of the object, the known or estimated location of the client system, and the three-dimensional representation of the object in order to provide a user with a visual representation of the object from a point of view of the client system.

39. A method for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 38, wherein the object has a state and where the information stored in the storing information step regarding the object includes a representation of the object state.

40. A method for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 39, wherein the computer system used for performing the method is configured to facilitate the steps of receiving a signal from a client system at the wireless communication module, with the signal including information, and using the information to alter the state of the object.

41. A method for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 39, wherein the computer system used for performing the method is configured to facilitate the steps of receiving a system identifier from a client system and of sending selective information to the client system based on the system identifier, whereby different client systems may have access to different information regarding the object.

42. A method for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 41, wherein the computer system used for performing the method is configured to facilitate the step of selectively sending information based on the system identifier of a client system.

43. A method for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 41, wherein the computer system used for performing the method is configured to facilitate the steps of receiving information from a client system and to using the information to customize the state information sent to the client system.

44. A method for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 43, wherein the computer system used for performing the steps of the method further comprises a network interface connected with the processor to facilitate the step of networking with other computer systems, whereby the computer system can interact with computer systems in other objects or other computer systems such as those on the Internet.

45. A method for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 44, wherein the computer system used for performing the steps of the method is configured to facilitate the step of interacting with other computer systems in other objects in order to facilitate communications between client systems located near different objects.

46. A method for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 41, wherein the memory of the computer system is operative to facilitate the step of storing the system identifiers of client systems that have come within communication range of the computer system.

47. A method for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 46, wherein the computer system further comprises a network interface for facilitating the steps of communicating with other computer systems and providing the system identifiers of client systems that have come within communication range of the computer system to another computer.

48. A method for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 36, wherein the computer system further comprises a network interface connected with the processor to facilitate a step of networking with other computer systems, whereby the computer system can interact with computer systems in other objects or other computer systems such as those on the Internet.

49. A method for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 27, wherein the computer system further comprises a network interface connected with the processor to facilitate a step of networking with other computer systems, and wherein the computer system is configured to connect with a data server to download updated information regarding the object.

50. A method for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 27, wherein at least a portion of the objects are virtual objects and wherein at least a portion of the information transmitted to the client receiver is display information provided to facilitate the display of a representation of the object in a computerized display at its appropriate location within the field of view of the client system.

51. A method for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 50, wherein the computer system is configured to facilitate a step of receiving a system identifier from the client system and to customize the information, including the display information to facilitate a customized representation of the object for the client system.

52. A method for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 27, wherein the computer system is configured to facilitate a step of receiving a request for information from a client system and to send information to the client system based on the request from the client system.

53. A computer program product for providing location-registered patterns for providing information regarding objects in an area, with the computer program product comprising a computer-readable medium for use in a computer system comprising a memory, a processor coupled with the memory, and a wireless communication module connected with the processor, computer program product comprising computer readable means including:

a. means for storing information in the memory regarding at least one object, with the information including a location of each object;

b. means for retrieving at least a portion of the information regarding the object into the processor from the memory, including the location of the object in preparation for transmission to the client system via the wireless communication module; and

c. means for detecting, at the wireless communication module, the presence of a compatible client system within a communication range of the wireless communication module, and if a compatible client system is detected, transmitting at least a portion of the information regarding the object, including the location of the object, from the computer system to the client system.

54. A computer program product for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 53, wherein the means for storing information stores information regarding the appearance of the object.

55. A computer program product for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 54, wherein the information stored by the means for storing information is a three-dimensional representation of the object computed such that the client system can use the location of the object, the known or estimated location of the client system, and the three-dimensional representation of the object in order to provide a user with a visual representation of the object from a the point of view of the client system.

56. A computer program product for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 53, wherein the information stored by the means for storing information includes an object identification, which when received by the client system may be used to obtain further information regarding the object from a database.

57. A computer program product for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 53, wherein the object has a state and where the information stored by the means for storing information regarding the object includes a representation of the object state.

58. A computer program product for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 57, wherein the computer system further includes means for receiving a signal from a client system at the wireless communication module and means for using the information to alter the state of the object.

59. A computer program product for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 57, wherein the computer system further includes means for receiving a system identifier from a client system and means for sending selective information to the client system based on the system identifier, whereby different client systems may have access to different information regarding the object.

60. A computer program product for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 59, wherein the computer system further includes means for receiving a note from a client system with at least one target client system identifier and means for transmitting the note to client systems that provide a system identifier matching the target client system identifier.

61. A computer program product for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 53, wherein the information stored by the information storing means is in the form of multimedia information including information selected from the group consisting of audio, video, and text information.

62. A computer program product for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 53, wherein the computer system is coupled with a specific object and wherein the information stored by the information storing means is regarding that particular object.

63. A computer program product for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 62, wherein the information stored by the information storing means regarding the object includes information regarding the appearance of the object.

64. A computer program product for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 63, wherein the information stored by the information storing means regarding the object is a three-dimensional representation of the object computed such that the client system can use the location of the object, the known or estimated location of the client system, and the three-dimensional representation of the object in order to provide a user with a visual representation of the object from a the point of view of the client system.

65. A computer program product for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 64, wherein the object has a state and where the information stored by the information storing means regarding the object includes a representation of the object state.

66. A computer program product for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 65, wherein the computer system further includes means receiving a signal from a client system at the wireless communication module, with the signal including information, and using the information to alter the state of the object.

67. A computer program product for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 65, wherein the computer system further includes a means for receiving a system identifier from a client system and means for sending selective information to the client system based on the system identifier, whereby different client systems may have access to different information regarding the object.

68. A computer program product for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 67, wherein the computer system further includes a means for selectively sending information based on the system identifier of a client system.

69. A computer program product for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 67, wherein the computer system used for performing the method further includes means for receiving information from a client system and means for using the information to customize the state information sent to the client system.

70. A computer program product for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 69, wherein the computer system further includes a network interface connected with the processor to facilitate means for networking with other computer systems, whereby the computer system can interact with computer systems in other objects or other computer systems such as those on the Internet.

71. A computer program product for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 70, wherein the computer system is configured to facilitate the means for interacting with other computer systems in other objects in order to facilitate communications between client systems located near different objects.

72. A computer program product for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 67, wherein the memory of the computer system is operative to facilitate the means for storing the system identifiers of client systems that have come within communication range of the computer system.

73. A computer program product for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 72, wherein the computer system further comprises a network interface for facilitating the means for communicating with other computer systems and the means for providing the system identifiers of client systems that have come within communication range of the computer system to another computer.

74. A computer program product for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 62, wherein the computer system further comprises a network interface connected with the processor to facilitate a means for networking with other computer systems, whereby the computer system can interact with computer systems in other objects or other computer systems such as those on the Internet.

75. A computer program product for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 53, wherein the computer system further comprises a network interface connected with the processor to facilitate a means for networking with other computer systems, and wherein the computer system is configured to connect with a data server to download updated information regarding the object.

76. A computer program product for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 53, wherein at least a portion of the objects are virtual objects and wherein at least a portion of the information transmitted to the client receiver is display information provided to facilitate the display of a representation of the object in a computerized display at its appropriate location within the field of view of the client system.

77. A computer program product for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 76, wherein the computer system is configured to facilitate means for receiving a system identifier from the client system and means for customizing the information, including the display information to facilitate a customized representation of the object for the client system.

78. A computer program product for providing location-registered patterns for providing information regarding objects in an area as set forth in claim 53, wherein the computer system is configured to facilitate means for receiving a request for information from a client system and means for sending information to the client system based on the request from the client system.