Computerized information and display methods

• US 8,712,777 B1
• Filed: 01/25/2013
• Issued: 04/29/2014
• Est. Priority Date: 06/10/1999
• Status: Expired due to Fees

• Current Assignee: West View Research LLC
• Original Assignee: West View Research LLC
• Inventors: Gazdzinski, Robert F.
• Primary Examiner(s): Abebe, Daniel D
• Application Number:
  US13/750,583
• Time in Patent Office: 459 Days
• Field of Search: 704/270, 704/275, 187/396, 369/30.01
• US Class Current: 704/270
• CPC Class Codes: B66B 1/24 Control systems with regulation, i.e. with retroactive action, for influencing travelling speed, acceleration, or deceleration
• CPC Class Codes: B66B 1/3415 Control system configuration and the data transmission or communication within the control system
• CPC Class Codes: B66B 2201/463 Wherein the call is registered through physical contact with the elevator system
• CPC Class Codes: B66B 3/00 Applications of devices for indicating or signalling operating conditions of elevators
• CPC Class Codes: B66B 3/002 Indicators
• CPC Class Codes: B66B 3/006 for guiding passengers to their assigned elevator car
• CPC Class Codes: B66B 3/008 Displaying information not related to the elevator, e.g. weather, publicity, internet or TV
• CPC Class Codes: G01C 21/206 specially adapted for indoor navigation
• CPC Class Codes: G05B 15/02 electric
• CPC Class Codes: G05D 23/1917 using digital means
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: G06F 21/44 Program or device authentication
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 2203/0383 Remote input, i.e. interface arrangements in which the signals generated by a pointing device are transmitted to a PC at a remote location, e.g. to a PC in a LAN
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/0481 : based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 : Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 : Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 : using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04886 : by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/14 : Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 3/167 : Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 40/134 : Hyperlinking
• CPC Class Codes: G06F 40/30 : Semantic analysis
• CPC Class Codes: G06Q 20/00 : Payment architectures, schemes or protocols apparatus for performing or posting payment transactions G07F7/08, G07F19/00; electronic cash registers G07G1/12
• CPC Class Codes: G06Q 30/02 : Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0251 : Targeted advertisements
• CPC Class Codes: G06Q 30/0252 : based on events or environment, e.g. weather or festivals
• CPC Class Codes: G06Q 30/0254 : based on statistics
• CPC Class Codes: G06Q 30/0256 : User search
• CPC Class Codes: G06Q 30/0259 : based on store location
• CPC Class Codes: G06Q 30/0261 : based on user location
• CPC Class Codes: G06Q 30/0264 : based upon schedule
• CPC Class Codes: G06Q 30/0265 : Vehicular advertisement
• CPC Class Codes: G06Q 30/0266 : based on the position of the vehicle
• CPC Class Codes: G06Q 90/20 : Destination assistance within a business structure or complex
• CPC Class Codes: G06T 1/20 : Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G10L 13/00 : Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 13/02 : Methods for producing synthetic speech; Speech synthesisers
• CPC Class Codes: G10L 13/027 : Concept to speech synthesisers; Generation of natural phrases from machine-based concepts generation of parameters for speech synthesis out of text G10L13/08
• CPC Class Codes: G10L 15/00 : Speech recognition G10L17/00 takes precedence
• CPC Class Codes: G10L 15/02 : Feature extraction for speech recognition; Selection of recognition unit
• CPC Class Codes: G10L 15/08 : Speech classification or search
• CPC Class Codes: G10L 15/22 : Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 : Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 17/22 : Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 2015/025 : Phonemes, fenemes or fenones being the recognition units
• CPC Class Codes: G10L 2015/223 : Execution procedure of a spoken command
• CPC Class Codes: G10L 21/10 : Transforming into visible information
• CPC Class Codes: G10L 25/48 : specially adapted for particular use
• CPC Class Codes: H04L 12/40 : Bus networks
• CPC Class Codes: H04L 41/22 : comprising specially adapted graphical user interfaces [GUI]
• CPC Class Codes: H04L 67/01 : Protocols
• CPC Class Codes: H04L 67/02 : based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/10 : in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04N 23/00 : Cameras or camera modules comprising electronic image sensors; Control thereof
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/183 : for receiving images from a single remote source
• CPC Class Codes: H04W 12/068 : using credential vaults, e.g. password manager applications or one time password [OTP] applications
• CPC Class Codes: H04W 8/08 : Mobility data transfer
• CPC Class Codes: H04W 84/12 : WLAN [Wireless Local Area Networks]
• CPC Class Codes: Y10S 707/99933 : Query processing, i.e. searching

Abstract

Methods for obtaining and displaying information, such as directions to a desires entity or organization. In one embodiment, the method makes use of a computerized apparatus configured to receive user speech input and enable performance of various tasks, such as obtaining desired information relating to indoor entities, maps or directions, or any number of other topics. The obtained data may also, in one variant, be displayed with contextually related advertising or other content.

Claims

1. A method of directing a user to an organization or entity, the organization or entity being disposed within a building or structure, the method comprising:

receiving a digitized speech input generated via a speech digitization apparatus, the input relating to an organization or entity which the user wishes to locate;

based at least in part on the input, causing recognition of at least one word therein relating to the organization or entity, and causing identification of a location associated with the organization or entity based at least in part on the at least one recognized word, the location being inside of the building or structure; and

causing provision of a graphical or visual representation of the location on a touch-screen input and display device accessible to the user in order to aid the user in finding the organization or entity, the graphical or visual representation of the location also comprising a graphical or visual representation of at least the immediate surroundings of the organization or entity, the immediate surroundings being inside the building or structure.

2. The method of claim 1, wherein the causing provision of the graphical or visual representation of the location further comprises causing provision of a graphical representation of directions from a known location inside of the building or structure to the organization or entity.

3. The method of claim 1, further comprising causing display of advertising that is contextually related to the organization or entity.

4. The method of claim 1, further comprising causing display of advertising that is contextually related to an attribute or type of the organization or entity.

5. The method of claim 3, wherein the advertising is displayed on the touch-screen input and display device substantially contemporaneously with displaying the graphical or visual representation of the location.

6. The method of claim 1, further comprising generating the digitized speech based at least in part on user speech received via a microphone associated with the speech digitization apparatus, the microphone being mounted within a computerized apparatus proximate the touch-screen input and display device so that the user can speak into the microphone while viewing the touch-screen input and display device.

7. The method of claim 1, further comprising causing display of advertising for at least one organization or entity which is disposed proximate to the organization or entity at the location and within the building or structure.

8. The method of claim 1, further comprising moving at least the touch-screen input and display device from one location to another while the user provides both the speech input and accesses the touch-screen input and display device.

9. The method of claim 1, wherein the moving at least the touch-screen input and display device from one location to another while the user provides both the speech input and accesses the touch-screen input and display device comprises moving at least the device within a transport apparatus having a passenger compartment.

10. The method of claim 9, wherein the touch-screen input and display device is configured to be mounted on or proximate to a surface of the transport apparatus such that an operator of the transport apparatus can view and access a touch-screen of the touch-screen input and display device, and make input to the speech digitization apparatus, and the method further comprises operating the transport apparatus.

11. The method of claim 1, wherein the touch-screen input and display is mounted on or proximate to a surface of a land-mobile transport apparatus such that an operator of the transport apparatus can view and access a touch-screen of the touch-screen input and display device, and make input to the speech digitization apparatus, and the method further comprises receiving at least one subsequent input via the device.

12. The method of claim 1, wherein the causing identification of the location comprises causing access of a remote server via a network in data communication with a host computerized apparatus having the touch-screen input and display device, the causing access occurring via a wireless interface of the host apparatus, the remote server configured to serve a plurality of wireless-enabled computerized apparatus simultaneously.

13. The method of claim 1, wherein the causing identification of the location comprises accessing a local storage device which is part of a host computerized apparatus of which the touch-screen input and display device is part as well.

14. The method of claim 1, further comprising receiving and utilizing at least one subsequent input from the user, so as to progress through a menu structure comprising multiple possible matching organizations or entities.

15. The method of claim 1, further comprising causing display of advertising content that has been selected based at least in part on an industry or occupation of the organization or entity.

16. The method of claim 15, wherein the industry or occupation of the organization or entity is selected from the group consisting of:

(i) restaurants, and (ii) public transportation.

17. The method of claim 1, further comprising displaying advertising content selected by one or more remote servers that have been accessed via a network in data communication with a location-portable computerized apparatus of which the touch-screen input and display device is part, via a wireless interface of the host apparatus.

18. The method of claim 1, further comprising utilizing digitized speech in an iterative or hierarchical fashion to progress through a menu structure comprising multiple possible matching entities or organizations.

19. The method of claim 1, further comprising:

generating a listing of a plurality of possible matches to said input, thereby creating an ambiguity; and

receiving further input regarding at least one of the listed plurality of possible matches to resolve the ambiguity.

20. The method of claim 1, further comprising:

generating audible speech signals relating to a plurality of possible matches to said input; and

receiving at least a further input regarding at least one of the plurality of possible matches so as to enable determination of the location.

21. The method of claim 1, further comprising providing a user a graphical representation of directions from their current location to the organization or entity inside of the building or structure, the graphical representation comprising a map graphic to be displayed on the touch-screen input and display device and having at least one line or arrow showing the path for the user to follow.

22. The method of claim 21, wherein the at least one line or arrow showing the path for the user to follow comprises a line or arrow at least partly rendered in a color different than a background of the map graphic so as to make the line or arrow more easily visible to the user.

23. The method of claim 21, wherein the providing a graphical representation having at least one line or arrow comprises providing a line or arrow at least partly rendered in a color or luminosity different than a background of the map graphic so as to make the line or arrow more easily visible to the user.

24. The method of claim 1, further comprising causing generating, on the touch-screen input and display device, a plurality of soft function keys or icons, at least one of the soft function keys or icons having a function associated therewith relating to obtaining directions, and at least one of the soft function keys or icons having a function associated therewith relating to points of interest.

25. The method of claim 24, wherein the at least one of the soft function keys or icons having a function associated therewith relating to obtaining directions comprises a function for obtaining directions from a current location of the user.

26. The method of claim 24, wherein the at least one of the soft function keys or icons having a function associated therewith relating to directions comprises a function for obtaining directions from a known location inside of the building or structure to the organization or entity via one or more established pathways within the building or structure.

27. The method of claim 1, further comprising causing generation on the touch-screen input and display device a plurality of soft function keys or icons, at least one of the soft function keys or icons having a function associated therewith relating to obtaining directions inside of a building or structure using one or more existing pathways thereof.

28. The method of claim 1, further comprising using video data apparatus to generate video data and display the video data on the touch-screen input and display device.

29. The method of claim 28, wherein the generating video data comprises generating the video data using one or more cameras in data communication with the touch-screen input and display device.

30. The method of claim 29, wherein the generating video data comprises generating the video data using one or more cameras in data communication with the touch-screen input and display device, the generating the video data performed so as to enable monitoring of one or more portions of a premises for security purposes.

31. The method of claim 1, further comprising using video data apparatus in data communication with a host device with which the touch-screen input and display device is associated to generate video data, and sending the data to a remote location for viewing thereat.

32. The method of claim 31, further comprising generating one or more hyperlinks relating to topics of interest to the user in their travels and displaying them on the touch-screen input and display device.

33. The method of claim 32, wherein the one or more hyperlinks relating to topics of interest to the user in their travels are configured to access respective universal resource locators (URLs) when selected by the user via the touch-screen input and display device.

34. The method of claim 33, wherein the URLs relate to content for directions to local transportation facilities.

35. The method of claim 1, further comprising generating one or more hyperlinks relating to topics of interest to the user in their travels and displaying them on the touch-screen input and display device.

36. A method of providing directions, the method comprising:

receiving a digitized speech input via a speech recognition apparatus, the input relating to an organization or entity disposed within a building or structure which a user wishes to locate, the building or structure having a plurality of other organizations or entities disposed therein;

based at least in part on the input, causing identification of a location inside of the building or structure particularly associated with the organization or entity;

providing a graphical or visual representation of the location on a touch-screen input and display device viewable by the user in order to aid the user in finding the organization or entity, the providing a graphical or visual representation of the location comprising providing a map graphic showing the location of the organization or entity relative to other organizations or entities proximate thereto inside of the building or structure; and

contemporaneously with the providing, providing the user with a graphical representation of directions from their current location within the building or structure to the organization or entity, the graphical representation of directions comprising the map graphic displayed on the touch-screen input and display device and having at least one color- or luminosity-contrasted arrow showing the path for the user to follow inside of the building or structure; and

wherein the digitized speech is generated based at least in part on user speech received via a microphone in communication with the speech recognition apparatus, the microphone being mounted proximate the touch-screen input and display device so that the user can speak into the microphone while viewing the touch-screen input and display device.

37. The method of claim 36, wherein:

the identification of the location comprises accessing a remote server via a network and a wireless interface; and

the method further comprises receiving and utilizing at least one other input to progress through a listing comprising multiple possible matching organizations or entities to enable identification of the location by the user, and navigation thereto.

38. A computerized method of providing directions, the method comprising:

generating a digitized representation of a user'"'"'s speech input relating to an organization or entity within a building to which the user wishes to obtain directions;

utilizing a speech recognition apparatus to cause identification of at least one word or phrase within the digitized representation;

causing identification of the organization or entity and a location relating thereto based at least in part on the at least one word or phrase;

displaying directions from a user'"'"'s current location within the building to the organization or entity on a touch-screen input and display device accessible to the user; and

providing a graphical or visual representation of the location of the organization or entity on the touch-screen input and display device in order to aid the user in finding the organization or entity, the graphical or visual representation of the location also comprising a graphical or visual representation of the immediate surroundings of the organization or entity within the building, including other entities or organizations proximate thereto.

39. The method of claim 38, wherein the causing identification comprises:

generating a listing of a plurality of possible matches, thereby creating an ambiguity as to which of the plurality is the organization or entity which the user desires; and

receiving further input from the user regarding at least one of the listed plurality of possible matches to resolve the ambiguity and enable the identification.

40. The method of claim 39, wherein the receiving further input comprises receiving at least one additional digitized speech representation.

41. The method of claim 39, wherein the receiving further input comprises receiving at least one additional input via a soft function key on the touch-screen input and display device.

42. The method of claim 41, further comprising generating one or more hyperlinks relating to information which can further aid the user in finding the organization or entity within the building.

43. The method of claim 38, further comprising generating one or more hyperlinks relating to information which can further aid the user in finding the organization or entity within the building.

44. The method of claim 38, further comprising generating one or more hyperlinks relating to topics of interest to the user in their travels.

45. The method of claim 38, further comprising using video data apparatus in data communication with the touch-screen device to cause display of video data on the display device.

46. The method of claim 38, further comprising using video data apparatus in data communication with the touch-screen device to cause video data to be generated and sent to a remote location for viewing thereat.

47. The method of claim 38, further comprising using a speech synthesis apparatus to generate audible sounds for the user, the sounds comprising human-intelligible words relating to the user'"'"'s speech input, the words being useful to the user to enter at least one subsequent speech input so as to resolve an ambiguity between two or more possible matching entities or organizations.

48. The method of claim 38, further comprising providing data to a portable computerized device of the user via a data link established in an ad hoc or temporary manner.

49. The method of claim 48, wherein the providing the data to the portable device comprises providing data that at least a portion of which has been configured according to a previously stored user-specific profile.

50. The method of claim 48, wherein the data provided to the portable device is provided in response to a request from an application program running on the portable device.

51. A method of navigating to a desired entity or organization disposed within a building, the building having a plurality of other organizations or entities disposed therein, the method comprising:

a user speaking at least a name of the desired entity or organization into a microphone in communication with a speech recognition apparatus, the speech recognition apparatus being in data communication with a processing apparatus, the processing apparatus being in data communication with a touch-screen input and display device viewable when speaking into the microphone;

the user perceiving a listing of two or more possible matching organizations or entities;

the user providing an input to select one of the two or more possible matching organizations or entities from the list so as to resolve ambiguity as to which of the two or more organizations or entities is the desired organization or entity;

the user viewing a graphical or visual representation of a location of the desired organization or entity on the touch-screen input and display device in order to assist in finding the desired organization or entity, the graphical or visual representation of the location comprising a map showing the location of the desired organization or entity relative to other organizations or entities proximate thereto inside of the building; and

contemporaneously with the viewing, the user viewing a graphical representation of directions from a current location of the user to the desired organization or entity, the graphical representation of directions comprising the map displayed on the touch-screen input and display device and having at least one highlighted line or arrow showing the path for the user to follow inside of the building or structure.

52. The method of claim 51, wherein the user perceiving a listing of two or more possible matching organizations or entities comprises the user audibly hearing a sequential listing of the two or more organizations or entities played out over at least one speaker.

53. The method of claim 51, wherein the user providing an input to select one of the two or more possible matching organizations or entities from the list so as to resolve ambiguity as to which of the two or more organizations or entities is the desired organization or entity comprises the user speaking at least a portion of identifying information of one of the one or more possible matching organizations or entities into the microphone.

54. The method of claim 51, wherein the user perceiving a listing of two or more possible matching organizations or entities comprises the user viewing a sequential listing of the two or more organizations or entities displayed on the touch-screen input and display device.

55. The method of claim 54, wherein the user providing an input to select one of the two or more possible matching organizations or entities from the list so as to resolve ambiguity as to which of the two or more organizations or entities is the desired organization or entity comprises the user speaking at least a portion of identifying information of one of the one or more possible matching organizations or entities into the microphone.

56. The method of claim 54, wherein the user providing an input to select one of the two or more possible matching organizations or entities from the list so as to resolve ambiguity as to which of the two or more organizations or entities is the desired organization or entity comprises the user selecting one of the one or more possible matching organizations or entities by touching a corresponding portion of the touch-screen input and display device.

57. The method of claim 56, further comprising the user visually perceiving contextual advertising displayed on the touch-screen input and display device, the advertising being selected based at least in part on the user'"'"'s selecting the one of the one or more possible matching organizations or entities via the corresponding portion.

58. The method of claim 51, further comprising the user ambulating to the desired organization or entity via the path.

59. The method of claim 51, further comprising the user visually perceiving advertising displayed on the touch-screen input and display device, the advertising having at least one contextual relationship to an attribute of the resolved desired organization or entity.

60. A method of navigating to a desired entity or organization using a transport device having a passenger compartment and a computerized touch-screen input and display device disposed substantially within the passenger compartment, the desired entity or organization having a plurality of other organizations or entities disposed proximate thereto, the method comprising:

a user entering the passenger compartment;

the user speaking at least a name of the desired entity or organization into a microphone in communication with a speech recognition apparatus, the speech recognition apparatus being in data communication with a processing apparatus, the processing apparatus being in data communication with the touch-screen input and display device viewable when speaking into the microphone;

the user perceiving a listing of two or more possible matching organizations or entities;

the user providing an input to select one of the two or more possible matching organizations or entities from the list so as to resolve ambiguity as to which of the two or more organizations or entities is the desired organization or entity;

the user viewing a graphical or visual representation of a location of the desired organization or entity on the touch-screen input and display device in order to assist in finding the desired organization or entity, the graphical or visual representation of the location comprising a map showing the location of the desired organization or entity relative to at least one other organization or entity proximate thereto; and

contemporaneously with the viewing, the user viewing a graphical representation of directions to the desired organization or entity, the graphical representation of directions comprising the map displayed on the touch-screen input and display device and having at least one highlighted line or arrow showing the path for the user to follow; and

the user causing the transport device to move from a current location to a location at least more proximate to the location of the desired organization or entity.

61. The method of claim 60, further comprising the user ambulating from the at least proximate location to the location of the desired organization or entity.

62. A computerized method of providing directions, the method comprising:

receiving an input from a user, the input causing a computerized information apparatus to enter an operational mode, the mode enabled to receive one or more speech inputs relating to an organization or entity which the user wishes to find;

receiving a speech input from the user naming the organization or entity;

using at least the speech input, generating a digitized representation of the speech input;

utilizing a speech recognition apparatus to cause identification of at least one word or phrase within the digitized representation;

causing identification of the organization or entity and a location relating thereto based at least in part on accessing a remote server using the at least one word or phrase;

displaying directions to the organization or entity on a touch-screen input and display device accessible to the user; and

contemporaneously with the displaying, providing a graphical or visual representation of the location of the organization or entity on the touch-screen input and display device in order to aid a user in finding the organization or entity, the graphical or visual representation of the location also comprising a graphical or visual representation of the immediate surroundings of the organization or entity, including other entities or organizations proximate thereto.

63. The method of claim 62, wherein the receiving an input from a user, the input causing a computerized information apparatus to enter an operational mode, the mode enabled to receive one or more speech inputs relating to an organization or entity which a user wishes to find, comprises receiving the input via a soft function key generated on the touch-screen input and display device, the soft function key invoking a direction or map functionality.

64. The method of claim 62, further comprising, upon entering the operational mode, issuing a synthesized speech prompt to the user in order to prompt the user to provide the speech input.

65. The method of claim 62, wherein the organization or entity and the other entities or organizations proximate thereto are all disposed within a common building or structure having multiple floors and tenants.

66. The method of claim 65, wherein the displaying directions to the organization or entity on the touch-screen input and display device accessible to the user comprises displaying at least a path from a current user location to the location of the organization or entity and within the building or structure, for the user to follow.