System and method for social networking gaming with an augmented reality

• US 8,814,691 B2
• Filed: 03/16/2011
• Issued: 08/26/2014
• Est. Priority Date: 02/28/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Haddick, John D., Osterhout, Ralph F., Lohse, Robert Michael
• Primary Examiner(s): CUFF, MICHAEL A
• Application Number:
  US13/049,851
• Publication Number:
  US 20110221657A1
• Time in Patent Office: 1,259 Days
• Field of Search: 463/30, 463/36, 463/42
• US Class Current: 463/42
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02C 11/10 Electronic devices other than hearing aids
• CPC Class Codes: G06F 1/1673 Arrangements for projecting a virtual keyboard
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0261 based on user location
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G06V 40/197 Matching; Classification
• CPC Class Codes: H04N 23/55 Optical parts specially adapted for electronic image sensors; Mounting thereof
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 5/44 Receiver circuitry for the reception of television signals according to analogue transmission standards H04N5/14 takes precedence

Abstract

This disclosure concerns an interactive, head-mounted eyepiece with an integrated processor for handling content for display and an integrated image source for introducing the content to an optical assembly through which the user views a surrounding environment and the displayed content. A wireless communications facility assesses a database of second user profiles, and the user contacts an online gaming site using the eyepiece to initiate or join a game of the online gaming site with a second user, each user viewing game content with through their head-mounted eyepiece.

Claims

1. A system, comprising:

an interactive head-mounted device configured to be worn by a user, wherein the device includes an optical assembly configured to display virtual content and through which at least a portion of a surrounding environment is viewable, a camera mounted on the device, an integrated processor for processing content for display to the user, and an integrated image source for introducing the content to the optical assembly; and

a wireless communications facility that accesses a database of users,

wherein the interactive head-mounted device is adapted for at least one of initiating and joining a game of an online gaming site with at least one additional interactive head-mounted device, and

wherein the integrated processor and the camera are adapted for capturing and interpreting gestures of a user during use and for receiving gesture-related data from the at least one additional interactive head-mounted device during the game.

2. The system of claim 1, wherein the game is configured to be playable by manipulation of at least one body-mounted control device.

3. The system of claim 1, wherein the game is configured to be playable by manipulation of at least one sensor for detecting motion.

4. The system of claim 1, further comprising at least one game controller, the game controller configured to be in communication with the integrated processor.

5. The system of claim 4, wherein the game controller further comprises at least one sensor for attachment to a wrist or fingers.

6. The system of claim 4, wherein the game controller further comprises at least one sensor for attachment to a hand.

7. The system of claim 6, wherein the sensor is selected from the group consisting of an accelerometer, a gyroscope, a vibration sensor, a force sensor, a sensor for detecting an electrical impulse, a sensor for sensing an electrical field and a temperature sensor.

8. The system of claim 1, wherein the database is adapted for storing a current location for each interactive head-mounted device during the game.

9. The system of claim 1, wherein the system is adapted to accommodate at least one smart phone used in the game.

10. The system of claim 1, wherein the wireless communications facility is mounted on the interactive head-mounted device.

11. The system of claim 1, wherein the wireless communications facility is configured to be mounted on a body of a user at a separate location from the interactive head-mounted device.

12. The system of claim 1, wherein at least a portion of the displayed content is viewable in 3D.

13. A system, comprising:

an interactive head-mounted device configured to be worn by a user, wherein the device includes an optical assembly configured to display virtual content and through which at least a portion of a surrounding environment is viewable, a camera mounted on the device, an integrated processor for processing content for display to the user, and an integrated image source for introducing the content to the optical assembly; and

a wireless communications facility adapted for accessing a database of users,

wherein the interactive head-mounted device is adapted for contacting an online gaming site via the wireless communications facility, and is adapted for at least one of initiating and joining a game of the online gaming site with an additional interactive head-mounted device locatable via the online gaming site, and

wherein the integrated processor and the camera are adapted for capturing and interpreting gestures of a user during use and for receiving gesture-related data from the additional interactive head-mounted device during a game.

14. The system according to claim 13, wherein an objective of at least one game on the gaming site depends on a location of the interactive head-mounted device.

15. The system of claim 13, further comprising at least one game controller in communication with the integrated processor.

16. The system of claim 15, wherein the game controller is selected from the group consisting of a joystick, a control module and a mouse.

17. The system of claim 15, wherein the game controller further comprises at least one sensor for attachment to a hand, wrist, or finger.

18. The system of claim 17, wherein the at least one sensor is selected from the group consisting of an accelerometer, a gyroscope, a vibration sensor, a force sensor, a sensor for detecting an electrical impulse, a sensor for sensing an electrical field and a temperature sensor.

19. The system of claim 13, wherein the system is adapted to accommodate at least one smart phone used in the game.

20. The system of claim 13, wherein the wireless communications facility is mounted on the interactive head-mounted device.

21. The system of claim 13, wherein the wireless communications facility is configured to be mounted on a body of a user at a separate lovation from the interactive head-mounted device.

22. The system of claim 13, wherein at least a portion of the displayed content is viewable in 3D.

23. A system, comprising:

an interactive head-mounted device configured to be worn by a user, wherein the device includes an optical assembly configured to display virtual content and through which at least a portion of a surrounding environment is viewable, an integrated processor for handling content for display to the user, and an integrated image source for introducing the content to the optical assembly;

a camera in communication with the integrated processor; and

a wireless communications facility adapted for contacting an online gaming site via the wireless communications facility,

wherein the wireless communications facility is adapted for accessing the gaming site and the interactive head-mounted device is adapted for at least one of initiating and joining a game of the online gaming site with at least one additional interactive head-mounted device, the optical assembly of the interactive head-mounted device adapted for viewing game content during use,

wherein the integrated processor and the camera are adapted for capturing and interpreting gestures of the user and

wherein the at least one additional interactive head-mounted device includes a camera in communication with an integrated processor of the at least one additional interactive head-mounted device, the at least one additional interactive head-mounted device also having a wireless communications facility, the wireless communications facility adapted for contacting the online gaming site, and wherein the integrated processor and camera of the at least one additional interactive head-mounted device are adapted for capturing and interpreting gestures of at least one additional user for playing the game.

24. The system of claim 23, wherein the online gaming site is adapted for games with a plurality of interactive head-mounted devices for viewing game content during use.

25. The system according to claim 23, wherein the interactive head-mounted device further includes a GPS locator for use in locating a location of the interactive head-mounted device as part of a game.

26. The system of claim 23, further comprising a game controller in communication with the integrated processor.

27. The system of claim 26, wherein the game controller is selected from the group consisting of a joystick, a control module and a mouse.

28. The system of claim 23, wherein a database comprises a location for each interactive head-mounted device during the game, a location determined by a GPS locator or a cellular phone.

29. The system of claim 23, wherein the system is adapted to accommodate at least one smart phone used in the game.

30. The system of claim 23, wherein the wireless communications facility is mounted on the interactive head-mounted device.

31. The system of claim 23, wherein the wireless communication facility is configured to be mounted on a body of a user at a separate location from the interactive head-mounted device.

32. The system of claim 23, wherein at least a portion of the game content is viewable in 3D.