Virtual navigation system for virtual and real spaces

• US 10,120,440 B2
• Filed: 05/11/2015
• Issued: 11/06/2018
• Est. Priority Date: 03/30/2006
• Status: Active Grant

• Current Assignee: Arjuna Indraeswaran Rajasingham
• Original Assignee: Arjuna Indraeswaran Rajasingham
• Inventors: Rajasingham, Arjuna Indraeswaran
• Primary Examiner(s): Marinelli, Patrick F
• Application Number:
  US14/708,584
• Publication Number:
  US 20150286278A1
• Time in Patent Office: 1,275 Days
• Field of Search: 345 8
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04N 13/218 using spatial multiplexing
• CPC Class Codes: H04N 13/221 using the relative movement between cameras and objects
• CPC Class Codes: H04N 13/243 using three or more 2D image sensors
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control
• CPC Class Codes: H04R 1/08 Mouthpieces; Microphones; Attachments therefor

Abstract

A system for Virtual Navigation in real and Virtual Spaces. Such navigation in Virtual spaces may be applied particularly in 3D computer games and 3D programming of motion pictures. Such navigation in real spaces creates a new paradigm in communication and media particularly with unique 3 D video interface devices disclosed in this invention.

Claims

1. A system for virtual navigation of a real space comprising:

a User Member with a user interface that comprises of a display, wherein said User Member is connected to an Active Network hosted by computing resources to enable a virtual navigation infrastructure for a real space comprising a plurality of Sources, wherein said infrastructure is enabled by at least one of internet and cellular networks with at least one digital communications protocol;

a plurality of Source Members, each comprising at least one of said Sources, and each Source comprising one or more cameras;

wherein each of the Sources are at Source Points;

wherein said Source Points are configured to move;

wherein the Active Network provides Source physical location information derived from their Source Members in the Active Network;

wherein locations of each of said Sources is determined by the Active Network;

wherein a first field of view, at a Source Point of one of the at least one Source of the plurality of Source Members, comprises a plurality of icons, representing locations of other Sources of the plurality of Source Members that each offer stimuli comprising a field of view, for selection;

wherein a selection of an icon representing a desired Source of the plurality of Source Members offering desired stimuli comprising a desired second field of view, in said first field of view is performed at the icon'"'"'s location of its corresponding Source with the desired stimuli comprising the desired field of view;

wherein said selection of the icon representing a desired Source of the plurality of Source Members offering desired stimuli comprising a desired second field of view, in said first field of view is performed at the location of its corresponding Source with the desired stimuli comprising the desired field of view;

wherein said Active Network locates Sources, that will appear on the display as icons, in response to the User Member choosing a physical location or special interest location;

wherein virtual navigation of the User Member comprises changing the displaying of the first field of view, at the Source Point of one of the at least one Source of the plurality of Source Members, to the displaying of the desired second field of view of the desired Source of the plurality of Source Members, which is enabled by said User Member selecting said icon of the desired Source with desired stimuli comprising the desired field of view;

wherein the User Member is enabled to select a starting point of a local environment;

wherein upon selection of the starting point, it is displayed as the first field of view that comprises of the plurality of icons that represent locations of other Sources available for selection and navigation thereto.

2. A system for virtual navigation as in claim 1, wherein at least one of the plurality of Sources comprises a pair of cluster World Cameras that gives a 3D virtual space rendition.

3. A system for virtual navigation as in claim 1:

wherein the stimuli, that is provided by each of the plurality of Sources, further comprises of audio stimuli from the direction of each of the plurality of Sources; and

wherein said Sources further comprises of one or more World Microphones;

wherein the User Member is enabled to conduct dialogs with said plurality of Source Members.

4. A system for virtual navigation as in claim 1, wherein at least one Source comprises one or both of a pair of cluster World cameras that gives a 3D virtual space rendition

and World microphone sets.

5. A system for virtual navigation as in claim 1, wherein the virtual navigation of a real space is enabled to provide one or more of:

verifiable Truth Media for an event, wherein the User Member navigates to one or more of said Sources of Source Members at the location of said event and thereby views a corresponding field of view of World Cameras and audio input of microphones of said one or more Sources of said Source Members at the location of the event;

Virtual Tours, wherein the User Member navigates on a tour or an expedition wherein a Source Member acts as a tour guide; and

Interview a selected Source Member.

6. A system for virtual navigation as in claim 1, further comprising recreating a fixed 3D local landscape and utilizing it for navigation by:

capturing time lagged images from the Sources of one or more Source Members;

creating parallax information from said time lagged images;

reconstructing a 3D landscape of fixed objects, and

creating an image of fixed landscapes in 3D space thereby enabling navigation.

7. A system for virtual navigation as in claim 1, wherein said navigation from the first field of view, of the Source of a Source Member of the plurality of Source Members to the desired second field of view of the desired Source, is enabled by selection of the icon, representing the desired Source, with signaling gestures appendages concurrent with pointing with a gaze of the User on the icon.

8. A system for virtual navigation as in claim 1,

wherein each Source in a Neighborhood has a Source Node comprising a field of view, and

wherein the Active Network is enabled to interpolate by stitching together the fields of view of said Source Nodes to form fixed landscapes, in order to create Real Maps, for the subsequent navigation of User Members from one neighborhood to another.

9. A system for virtual navigation as in claim 1, wherein said interpolation of fields available from said Sources a neighborhood on the Active Network enables reconstruction of a continuous or a near continuous range of view points and fields.

10. A system for virtual navigation as in claim 1, wherein said Active Network is hosted by computing resources comprising a community of distributed wireless hub providers that provide local wireless bandwidth.

11. A system for virtual navigation as in claim 1, wherein user interfaces of User Members and Source Members utilize clients and protocols to connect directly with the user interfaces of other User Members and Source Members while said User Members and Source Members are in a common local neighborhood for peer to peer connection without channeling through the Active Network, thereby enabling direct communication.

12. A system for virtual navigation as in claim 11, wherein the peer to peer connection is preceded by a command by either the User Member or the Source Members subject to authentication to be part of a trusted network by the User Member or the Source Member.

13. A system for virtual navigation as in claim 1, wherein the User Member is a Source Member and at least one of the plurality of Source Members is a second User Member.

14. A system for virtual navigation as in claim 1, wherein at least one of the plurality of Sources is a mobile phone comprising a camera.

15. A system for virtual navigation as in claim 1, wherein the plurality of icons are color coded to represent at least one of cost and programming quality.

16. A system for virtual navigation as in claim 6, wherein said Active Network is hosted in part by a community of distributed wireless hub providers and other network resource providers that provide distributed computational resources for reconstruction of 3D local neighborhoods.

17. A system for virtual navigation as in claim 1, wherein said Active Network is hosted in part by a community of distributed wireless hub providers and other network resource providers, that provide local bandwidth to User Members for a fee.

18. A system for virtual navigation as in claim 1, wherein said Active Network is hosted in part by a community of distributed network resource providers that provide distributed computational resources for reconstruction of 3D local neighborhoods.

19. A system for virtual navigation as in claim 2, wherein the plurality of icons are in a 3D field of view.