Audio-visual navigation and communication

• US 9,766,774 B2
• Filed: 05/02/2014
• Issued: 09/19/2017
• Est. Priority Date: 09/26/2007
• Status: Active Grant

• Current Assignee: AQ Media, Inc.
• Original Assignee: AQ Media, Inc.
• Inventors: Roos, Jan Peter
• Primary Examiner(s): Vu, Kieu
• Assistant Examiner(s): CHAUDHURI, ANITA
• Application Number:
  US14/268,017
• Publication Number:
  US 20140245146A1
• Time in Patent Office: 1,236 Days
• CPC Class Codes: G06F 15/16 Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs coordinating program control therefor G06F9/52; in regulating and control system G05B
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06F 3/162 Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06Q 30/0273 Determination of fees for advertising
• CPC Class Codes: G06Q 30/08 Auctions
• CPC Class Codes: G06T 13/20 3D [Three Dimensional] animation
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02

Abstract

Communicating information through a user platform by representing, on a user platform visual display, spatial publishing objects as entities at locations within a three-dimensional spatial publishing object space. Each spatial publishing object associated with information, and each presenting a subset of the associated information. Establishing a user presence at a location within the spatial publishing object space. The user presence, in conjunction with a user point-of-view, being navigable by the user in at least a two-dimensional sub-space of the spatial publishing object space.

Claims

1. A computer-implemented method for establishing two-way communication between a subject entity and at least one of a plurality of object entities via navigation in a three-dimensional spatial publishing object space, the method comprising the steps of:

providing the subject entity with a display of each of the object entities in the three-dimensional spatial publishing object space on a processor-based device connected to a display device, wherein each of the object entities and the subject entity comprises a spatial publishing object that is presented on the display in response to a selection by a user, and wherein the display presents the spatial publishing objects in an arrangement comprising at least three dimensions in the three-dimensional spatial publishing object space,

providing the user with a presence as a virtual entity, within the subject entity in the three-dimensional spatial publishing object space, and as a separable point-of-view with respect to each of the object entities on the display device, wherein the separable point-of-view permits the subject entity to switch from a navigable first person vantage point to a navigable third person vantage point separate from the subject entity within the three-dimensional spatial publishing object space, wherein the display provides audio and visual fields for receipt of two-way audio and visual information, via a communication channel, between each of the spatial publishing objects and the subject entity;

accepting navigation input from the user, via a user input device connected to the processor-based device, the navigation input for rearranging the spatial publishing objects with respect to the subject entity in the three-dimensional spatial publishing object space; and

rearranging on the display, responsive to the navigation input from the user, a position of each of the spatial publishing objects in the at least three dimensions of the three-dimensional spatial publishing object space with respect to the subject entity, the rearrangement affecting a proximity between the spatial publishing object of the subject entity or the separable point of view of the subject entity and at least one of the plurality of object entities, the proximity thereby establishing two-way communication in the three-dimensional spatial publishing object space between the user, via the subject entity or the separable point of view of the subject entity, and the spatial publishing objects, via the at least one of the object entities.

2. The method according to claim 1, further comprising computing, on the processor-based device, measures of the proximity of the subject entity with respect to at least a subset of the spatial publishing objects.

3. The method according to claim 1, wherein the selection by the user comprises an initiation of a search by the processor-based device.

4. The method according to claim 1, further comprising the step of:

presenting, via the display on the display device, audio information corresponding to each of the spatial publishing objects, wherein the presentation of the audio information and at least one of the characteristics of the presentation corresponds at least in part to a measure of the proximity of each of a subset of spatial publishing objects relative to the subject entity,

and wherein the user is presented with one or more audio fields, via a speaker connected to the processor-based device, for output audio that fades in as each of the spatial publishing objects moves closer to the user and that fades out as each of the spatial publishing objects moves further from the user.

5. A computer program product, disposed on a non-transitory computer-readable medium, the computer program product including:

computer code for causing a processor-based device to establish two-way communication between a subject entity and at least one of a plurality of object entities via navigation in an a three-dimensional spatial publishing object space;

computer code for providing the subject entity with a display of each of the object entities in the three-dimensional spatial publishing object space, each of the object entities and the subject entity comprising a spatial publishing object, wherein the spatial publishing objects are presented on the display in response to a selection by the user and wherein the display presents the spatial publishing objects in an arrangement comprising at least three dimensions in the three-dimensional spatial publishing object space;

computer code for providing the user with a presence as a virtual entity, within the subject entity in the three-dimensional spatial publishing object space, and as a separable point-of-view with respect to each of the object entities on the display, wherein the separable point-of-view permits the subject entity to switch from a navigable first person vantage point to a navigable third person vantage point separate from the subject entity within the three-dimensional spatial publishing object space, wherein the computer code for providing the user with a presence also provides the display with audio and visual fields for receipt and transfer of two-way audio and visual information, via a communication channel, between each of the spatial publishing objects and the subject entity;

computer code for accepting navigation input from the user, the navigation input for rearranging the spatial publishing objects with respect to the subject entity in the three-dimensional spatial publishing object space; and

computer code for rearranging, responsive to the navigation input from the user, the position of each of the spatial publishing objects in the at least three dimensions with respect to the subject entity in the three-dimensional spatial publishing object space, the rearrangement affecting a proximity between the spatial publishing object of the subject entity or the separable point of view of the subject entity and at least one of the object entities, the proximity thereby establishing two-way communication in the three-dimensional spatial publishing object space between the user, via the subject entity or the separable point of view of the subject entity, and the spatial publishing objects, via the at least one of the object entities.

6. The computer program product according to claim 5, further comprising computer code for computing measures of the proximity of the subject entity with respect to at least a subset of the spatial publishing objects.

7. The computer program product according to claim 5, wherein the computer code for accepting navigation input from the user accepts the selection by the user as an instruction to initiate a computer-implemented search.

8. The computer program product according to claim 5, further comprising:

computer code for presenting, via the display on the display device, audio information corresponding to each of the spatial publishing objects, wherein the computer code for presenting is configured to present the audio information and at least one of the characteristics of the presentation corresponding, at least in part, to a measure of the proximity of each of a subset of spatial publishing objects relative to the subject entity,

and wherein the computer code for presenting presents the user with one or more audio fields, via a speaker connected to the processor-based device, for output audio that fades in as each of the spatial publishing objects moves closer to the user and that fades out as each of the spatial publishing objects moves further from the user.

9. A computer-implemented system for establishing two-way communication between a subject entity and at least one of a plurality of object entities in a three-dimensional spatial publishing object space, the system comprising the steps of:

a processor-based device connected to a display device for providing the subject entity with a display of each of the object entities in the three-dimensional spatial publishing object space, wherein each of the object entities and the subject entity comprises a spatial publishing object that is presented on the display in response to a selection by a user, and wherein the display presents the spatial publishing objects in an arrangement comprising at least three dimensions in the three-dimensional spatial publishing object space,

the display device for providing the user with a presence as a virtual entity, within the subject entity in the three-dimensional spatial publishing object space, and as a separable point-of-view with respect to each of the object entities, wherein the separable point-of-view permits the subject entity to switch from a navigable first person vantage point to a navigable third person vantage point separate from the subject entity within the three-dimensional spatial publishing object space, wherein the display provides audio and visual fields for receipt of two-way audio and visual information, via a communication channel, between each of the spatial publishing objects and the subject entity;

a user input device connected to the processor-based device for accepting navigation input from the user, the navigation input for rearranging the spatial publishing objects with respect to the subject entity in the three-dimensional spatial publishing object space; and

the display device for rearranging, responsive to the navigation input from the user, a position of each of the spatial publishing objects in the at least three dimensions of the three-dimensional spatial publishing object space with respect to the subject entity, the rearrangement affecting a proximity between the spatial publishing object of the subject entity or the separable point of view of the subject entity and at least one of a plurality of object entities, the proximity thereby establishing two-way communication in the three-dimensional spatial publishing object space between the user, via the subject entity or the separable point of view of the subject entity, and the spatial publishing objects, via at least one of the plurality of object entities.

10. The system according to claim 9, further comprising the processor-based device for computing measures of the proximity of the user with respect to at least a subset of the spatial publishing objects.

11. The system according to claim 9, wherein the user input device accepts the selection by the user and the selection comprises an initiation of a search by the processor-based device.

12. The system according to claim 9, further comprising:

the display device for presenting, via the display, audio information corresponding to each of the spatial publishing objects to the user, wherein the presentation of the audio information and at least one of the characteristics of the presentation corresponds at least in part to a measure of the proximity of each of a subset of spatial publishing objects relative to the subject entity; and

a speaker connected to the processor-based device for presenting the user with one or more audio fields, for output audio that fades in as each of the spatial publishing objects moves closer to the user and that fades out as each of the spatial publishing objects moves further from the user.

13. The system according to claim 9, wherein the user input device and the display device are integral parts of the processor-based device.