Computerized information and display apparatus

• US 8,781,839 B1
• Filed: 01/21/2013
• Issued: 07/15/2014
• Est. Priority Date: 06/10/1999
• Status: Expired due to Fees

• Current Assignee: West View Research LLC
• Original Assignee: West View Research LLC
• Inventors: Gazdzinski, Robert F.
• Primary Examiner(s): Abebe, Daniel D
• Application Number:
  US13/746,266
• Time in Patent Office: 540 Days
• Field of Search: 704/270, 704/275, 369/30.01
• US Class Current: 704/270
• CPC Class Codes: B66B 1/24 Control systems with regulation, i.e. with retroactive action, for influencing travelling speed, acceleration, or deceleration
• CPC Class Codes: B66B 1/3415 Control system configuration and the data transmission or communication within the control system
• CPC Class Codes: B66B 2201/463 Wherein the call is registered through physical contact with the elevator system
• CPC Class Codes: B66B 3/00 Applications of devices for indicating or signalling operating conditions of elevators
• CPC Class Codes: B66B 3/002 Indicators
• CPC Class Codes: B66B 3/006 for guiding passengers to their assigned elevator car
• CPC Class Codes: B66B 3/008 Displaying information not related to the elevator, e.g. weather, publicity, internet or TV
• CPC Class Codes: G01C 21/206 specially adapted for indoor navigation
• CPC Class Codes: G05B 15/02 electric
• CPC Class Codes: G05D 23/1917 using digital means
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: G06F 21/44 Program or device authentication
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 2203/0383 Remote input, i.e. interface arrangements in which the signals generated by a pointing device are transmitted to a PC at a remote location, e.g. to a PC in a LAN
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/0481 : based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 : Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 : Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 : using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04886 : by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/14 : Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 3/167 : Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 40/134 : Hyperlinking
• CPC Class Codes: G06F 40/30 : Semantic analysis
• CPC Class Codes: G06Q 20/00 : Payment architectures, schemes or protocols apparatus for performing or posting payment transactions G07F7/08, G07F19/00; electronic cash registers G07G1/12
• CPC Class Codes: G06Q 30/02 : Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0251 : Targeted advertisements
• CPC Class Codes: G06Q 30/0252 : based on events or environment, e.g. weather or festivals
• CPC Class Codes: G06Q 30/0254 : based on statistics
• CPC Class Codes: G06Q 30/0256 : User search
• CPC Class Codes: G06Q 30/0259 : based on store location
• CPC Class Codes: G06Q 30/0261 : based on user location
• CPC Class Codes: G06Q 30/0264 : based upon schedule
• CPC Class Codes: G06Q 30/0265 : Vehicular advertisement
• CPC Class Codes: G06Q 30/0266 : based on the position of the vehicle
• CPC Class Codes: G06Q 90/20 : Destination assistance within a business structure or complex
• CPC Class Codes: G06T 1/20 : Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G10L 13/00 : Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 13/02 : Methods for producing synthetic speech; Speech synthesisers
• CPC Class Codes: G10L 13/027 : Concept to speech synthesisers; Generation of natural phrases from machine-based concepts generation of parameters for speech synthesis out of text G10L13/08
• CPC Class Codes: G10L 15/00 : Speech recognition G10L17/00 takes precedence
• CPC Class Codes: G10L 15/02 : Feature extraction for speech recognition; Selection of recognition unit
• CPC Class Codes: G10L 15/08 : Speech classification or search
• CPC Class Codes: G10L 15/22 : Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 : Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 17/22 : Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 2015/025 : Phonemes, fenemes or fenones being the recognition units
• CPC Class Codes: G10L 2015/223 : Execution procedure of a spoken command
• CPC Class Codes: G10L 21/10 : Transforming into visible information
• CPC Class Codes: G10L 25/48 : specially adapted for particular use
• CPC Class Codes: H04L 12/40 : Bus networks
• CPC Class Codes: H04L 41/22 : comprising specially adapted graphical user interfaces [GUI]
• CPC Class Codes: H04L 67/01 : Protocols
• CPC Class Codes: H04L 67/02 : based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/10 : in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04N 23/00 : Cameras or camera modules comprising electronic image sensors; Control thereof
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/183 : for receiving images from a single remote source
• CPC Class Codes: H04W 12/068 : using credential vaults, e.g. password manager applications or one time password [OTP] applications
• CPC Class Codes: H04W 8/08 : Mobility data transfer
• CPC Class Codes: H04W 84/12 : WLAN [Wireless Local Area Networks]
• CPC Class Codes: Y10S 707/99933 : Query processing, i.e. searching

Abstract

Computerized apparatus useful for obtaining and displaying information. In one embodiment, the computerized apparatus includes a network interface, display device, and speech recognition apparatus configured to receive user speech input and enable performance of various tasks, such as obtaining desired information relating to indoor entities, maps or directions, or any number of other topics. The downloaded data may also, in one variant, be displayed with contextually related advertising or other content.

Claims

1. Computerized apparatus useful for locating an organization or entity, the organization or entity being disposed within a building or structure, the apparatus comprising:

a wireless interface;

data processing apparatus;

a touch-screen input and display device;

a speech digitization apparatus in data communication with the data processing apparatus; and

a storage apparatus in data communication with the data processing apparatus, said storage apparatus comprising at least one computer program, said at least one program being configured to;

receive a digitized speech input via the speech digitization apparatus, the input relating to an organization or entity which a user wishes to locate;

based at least in part on the input, causing recognition of at least one word therein relating to the organization or entity, and identification of a location associated with the organization or entity based at least in part on the at least one recognized word, the location being inside of the building or structure; and

provide a graphical or visual representation of the location on the touch screen input and display device in order to aid a user in finding the organization or entity, the graphical or visual representation of the location also comprising a graphical or visual representation of at least the immediate surroundings of the organization or entity, the immediate surroundings being inside the building or structure.

2. The apparatus of claim 1, wherein the graphical or visual representation of the location further comprises a graphical representation of directions from a known location inside of the building or structure to the organization or entity.

3. The apparatus of claim 1, wherein the at least one program is further configured to cause display of advertising that is contextually related to the organization or entity.

4. The apparatus of claim 1, wherein the at least one program is further configured to cause display of advertising that is contextually related to an attribute or type of the organization or entity.

5. The apparatus of claim 3, wherein the advertising is displayed on the touch-screen input and display device substantially contemporaneous with a display of the graphical or visual representation of the location.

6. The apparatus of claim 1, wherein the digitized speech is generated based at least in part on user speech received via a microphone associated with the speech digitization apparatus, the microphone being mounted within the computerized apparatus proximate the touch-screen input and display device so that the user can speak into the microphone while viewing the touch-screen input and display device.

7. The apparatus of claim 1, wherein the at least one program is further configured to cause display of advertising for at least one organization or entity which is disposed proximate to the organization or entity at the location and within the building or structure.

8. The apparatus of claim 1, wherein the computerized apparatus is configured to be transportable from one location to another within a transport apparatus having a passenger compartment.

9. The apparatus of claim 8, wherein the configuration to be transportable from one location to another within a transport apparatus comprises the capability of the computerized apparatus to be mounted on or proximate to a surface of the transport apparatus such that an operator of the transport apparatus can view and access a touch screen of the touch screen input and display device, and make input to the speech digitization apparatus, while operating the transport apparatus.

10. The apparatus of claim 1, wherein the computerized apparatus is mounted on or proximate to a surface of a land-mobile transport apparatus such that an operator of the transport apparatus can view and access a touch screen of the touch screen input and display device, and make input to the speech digitization apparatus, while operating the transport apparatus.

11. The apparatus of claim 1, wherein the identification of the location comprises accessing a remote server via a network in data communication with the computerized apparatus via the wireless interface.

12. The apparatus of claim 1, wherein the identification of the location comprises accessing a local storage device which is part of the computerized apparatus.

13. The apparatus of claim 1, wherein the at least one computer program is further configured to receive and utilize at least one subsequent input to progress through a menu structure comprising multiple possible matching organizations or entities.

14. The apparatus of claim 1, wherein the computerized apparatus is further configured to display advertising content selected based at least in part on an industry or occupation of the organization or entity.

15. The apparatus of claim 14, wherein the industry or occupation of the organization or entity is selected from the group consisting of:

(i) restaurants, and (ii) public transportation.

16. The apparatus of claim 1, wherein the computerized apparatus is further configured to display advertising content selected by one or more remote servers accessed via a network in data communication with the computerized apparatus via the wireless interface.

17. The apparatus of claim 1, wherein the at least one computer program is further configured to receive and utilize digitized speech in an iterative or hierarchical fashion to progress through a menu structure comprising multiple possible matching entities or organizations.

18. The apparatus of claim 1, where the at least one computer program is further configured to:

generate a listing of a plurality of possible matches to said input, thereby creating an ambiguity; and

receive further input regarding at least one of the listed plurality of possible matches to resolve the ambiguity.

19. The apparatus of claim 1, where the at least one computer program is further configured to:

generate audible speech signals relating to a plurality of possible matches to said input; and

receive at least a further input regarding at least one of the plurality of possible matches so as to enable determination of the location.

20. The apparatus of claim 1, wherein the computerized apparatus is further configured to provide a user a graphical representation of directions from their current location to the organization or entity inside of the building or structure, the graphical representation comprising a map graphic displayed on the touch-screen input and display device and having at least one line or arrow showing a path for the user to follow.

21. The apparatus of claim 20, wherein the at least one line or arrow showing the path for the user to follow comprises the line or arrow at least partly rendered in a color different than a background of the map graphic so as to make the line or arrow more easily visible to the user.

22. The apparatus of claim 1, wherein the at least one computer program is further configured to generate on the touch-screen input and display device a plurality of soft function keys or icons, at least one of the soft function keys or icons having a function associated therewith relating to obtaining directions, and at least one of the soft function keys or icons having a function associated therewith relating to points of interest.

23. The apparatus of claim 22, wherein the at least one of the soft function keys or icons having a function associated therewith relating to directions comprises a function for obtaining directions from a current location of the user.

24. The apparatus of claim 22, wherein the at least one of the soft function keys or icons having a function associated therewith relating to directions comprises a function for obtaining directions from a known location inside of the building or structure to the organization or entity.

25. The apparatus of claim 1, wherein the at least one computer program is further configured to generate on the touch-screen input and display device a plurality of soft function keys or icons, at least one of the soft function keys or icons having a function associated therewith relating to obtaining directions inside of a building or structure.

26. The apparatus of claim 25, wherein the wireless interface comprises an interface compliant with an IEEE 802.11 standard.

27. The apparatus of claim 25, wherein the computerized apparatus comprises an interface compliant with an IEEE 802.11 standard.

28. The apparatus of claim 27, wherein the computerized apparatus and interface compliant with an IEEE 802.11 standard are collectively configured to permit communication of at least the digitized speech input between the computerized apparatus and one or more remote networked servers.

29. The apparatus of claim 1, further comprising video data apparatus in data communication with the processing apparatus and configured to enable video data to be generated and displayed on the display device.

30. The apparatus of claim 29, wherein the video data is generated by one or more cameras positioned on a premises on which the computerized information and display apparatus is disposed, so as to enable monitoring of one or more portions of the premises for security purposes.

31. The apparatus of claim 1, further comprising video data apparatus in data communication with the processing apparatus and configured to enable video data to be generated and sent to a remote location for viewing thereat.

32. The apparatus of claim 31, wherein the computerized apparatus is further configured to generate one or more hyperlinks relating to topics of interest to the user in their travels and display them on the touch screen input and display device.

33. The apparatus of claim 32, wherein the one or more hyperlinks relating to topics of interest to the user in their travels are configured to access respective universal resource locators (URLs) when selected by the user via the touch screen input and display device.

34. The apparatus of claim 33, wherein the URLs relate to content for directions to local transportation facilities.

35. Computerized apparatus comprising:

a wireless interface;

data processing apparatus;

a touch-screen input and display device;

a speech recognition apparatus in data communication with the data processing apparatus; and

a storage apparatus in data communication with the data processing apparatus, said storage apparatus comprising at least one computer program, said at least one program being configured to;

receive a digitized speech input via the speech recognition apparatus, the input relating to an organization or entity disposed within a building or structure which a user wishes to locate;

based at least in part on the input, cause identification of a location inside of the building or structure associated with the organization or entity; and

provide a graphical or visual representation of the location on the touch screen input and display device in order to aid a user in finding the organization or entity, the graphical or visual representation of the location comprising a map graphic showing the location of the organization or entity relative to other organizations or entities proximate thereto inside of the building or structure;

wherein the digitized speech is generated based at least in part on user speech received via a microphone in communication with the speech recognition apparatus, the microphone being mounted within the computerized apparatus proximate the touch-screen input and display device so that the user can speak into the microphone while viewing the touch-screen input and display device; and

wherein the computerized apparatus;

is further configured to provide a user a graphical representation of directions from their current location to the organization or entity, the graphical representation of directions comprising the map graphic displayed on the touch-screen input and display device having at least one arrow showing the path for the user to follow inside of the building or structure; and

comprises an interface compliant with an IEEE 802.11 standard.

36. The computerized apparatus of claim 35, wherein the identification of the location comprises accessing a remote server via a network in data communication with the computerized apparatus via the wireless interface;

and

the at least one computer program is further configured to receive and utilize at least one other input to progress through a menu structure comprising multiple possible matching organizations or entities to enable identification of the location.

37. Computerized apparatus comprising:

a wireless interface;

data processing apparatus;

a touch-screen input and display device;

a speech recognition apparatus in data communication with the data processing apparatus; and

a storage apparatus in data communication with the data processing apparatus, said storage apparatus comprising at least one computer program, said at least one program being configured to;

generate a digitized speech input relating to an organization or entity within a building to which a user wishes to obtain directions;

utilize the speech recognition apparatus to cause identification of at least one word or phrase within the digitized speech input;

cause determination of a location associated with the organization or entity, the location having been determined based at least in part on the at least one word or phrase;

display said directions from the user'"'"'s current location within the building to the organization or entity on the touch screen input and display device; and

provide a graphical or visual representation of the location of the organization or entity on the touch screen input and display device in order to aid a user in finding the organization or entity, the graphical or visual representation of the location also comprising a graphical or visual representation of the immediate surroundings of the organization or entity within the building, including other entities or organizations proximate thereto.

38. The apparatus of claim 37, wherein the computerized apparatus is further configured to:

generate a listing of a plurality of possible matches to said input, thereby creating an ambiguity; and

receive further input regarding at least one of the listed plurality of possible matches to resolve the ambiguity.

39. The apparatus of claim 38, wherein the computerized apparatus is further configured to generate one or more hyperlinks relating to information which can further aid the user in finding the organization or entity within the building.

40. The apparatus of claim 37, wherein the computerized apparatus is further configured to generate one or more hyperlinks relating to topics of interest to the user in their travels.

41. The apparatus of claim 37, further comprising video data apparatus in data communication with the processing apparatus and configured to enable video data to be generated and displayed on the display device.

42. The apparatus of claim 37, further comprising video data apparatus in data communication with the processing apparatus and configured to enable video data to be generated and sent to a remote location for viewing thereat.

43. The apparatus of claim 37, wherein the computerized apparatus further comprises a speech synthesis apparatus which is configured to generate audible sounds for the user, the sounds comprising human-intelligible words relating to the user'"'"'s digitized speech input.

44. The apparatus of claim 37, wherein the computerized apparatus is further configured to provide data to a portable computerized device via a data link established in an ad hoc manner.

45. The apparatus of claim 44, wherein the data provided to the portable device is configured according to a user-specific profile.

46. The apparatus of claim 44, wherein the data provided to the portable device is provided in response to a request from an application program running on the portable device.

47. Computerized apparatus configured to help a user navigate indoors, comprising:

a wireless interface;

means for data processing;

a capacitive touch-screen input and display means;

a speech recognition apparatus in data communication with the means for data processing; and

computerized logic configured to;

produce a digitized speech input, and identify via at least the speech recognition apparatus at least one word or phrase therein, the at least one word or phrase relating to an organization or entity disposed within a building and to which a user wishes to obtain directions;

receive from a remote network entity via the wireless interface, a location associated with the organization or entity, the location having been determined based at least in part on the input;

display said directions from the user'"'"'s current location to the organization or entity on the capacitive touch screen input and display means; and

provide a graphical or visual representation of the location on the touch screen input and display means in order to aid a user in finding the organization or entity, the graphical or visual representation of the location also comprising a graphical or visual representation of the immediate surroundings of the organization or entity within the building, including one or more other organizations or entities proximate thereto.