Reverse natural guidance

• US 9,372,093 B2
• Filed: 04/22/2014
• Issued: 06/21/2016
• Est. Priority Date: 03/26/2012
• Status: Active Grant

• Current Assignee: HERE Global B.V. (Nokia Corporation)
• Original Assignee: HERE Global B.V. (Nokia Corporation)
• Inventors: Slusar, Mark
• Primary Examiner(s): HOLLOWAY, JASON R
• Application Number:
  US14/258,205
• Publication Number:
  US 20140229110A1
• Time in Patent Office: 791 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G01C 21/3484 Personalized, e.g. from learned user behaviour or user-defined profiles
• CPC Class Codes: G01C 21/36 Input/output arrangements for on-board computers
• CPC Class Codes: G01C 21/3608 using speech input, e.g. using speech recognition
• CPC Class Codes: G01C 21/3626 Details of the output of route guidance instructions traffic control systems for road vehicles involving transmission of navigation instructions to the vehicle G08G1/0968
• CPC Class Codes: G01C 21/3664 Details of the user input interface, e.g. buttons, knobs or sliders, including those provided on a touch screen; remote controllers; input using gestures
• CPC Class Codes: G06F 16/24 Querying
• CPC Class Codes: G06F 17/00 Digital computing or data processing equipment or methods, specially adapted for specific functions information retrieval, database structures or file system structures therefor G06F16/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G08G 1/096872 where instructions are given per voice
• CPC Class Codes: G08G 1/096894 where input is assisted by the navigation device, i.e. the user does not type the complete name of the destination, e.g. using zip codes, telephone numbers, progressively selecting from initial letters
• CPC Class Codes: G10L 15/18 using natural language modelling
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

The disclosed embodiments relate to recognition of navigation and/or guidance related information within an expressed conversational narrative between a provider of the narrative and a receiver thereof. The recognized navigation and/or guidance related information is then converted into navigation data which may be used to present a navigation route and/or guidance information related thereto to the receiver.

Claims

1. A computer implemented method comprising:

receiving, by a processor, at least a portion of a conversational narrative descriptive of a route to a destination expressed by a provider, the expressed conversational narrative comprising a plurality of conversational elements, a portion of which includes at least one non-verbal physical movement of a portion of a human body, wherein the plurality of conversational elements includes a plurality of navigation oriented conversational elements and at least one descriptive element characterizing at least one other of the plurality of conversational elements;

receiving, by the processor, the portion of the conversational narrative comprising the at least one non-verbal physical movement of a portion of a human body via an optical sensor, a motion sensor, or a combination thereof, coupled therewith;

identifying, by the processor, the plurality of navigation oriented conversational elements of the plurality of conversational elements as well as any of the at least one descriptive elements characterizing thereof;

converting, by the processor, each of the plurality of navigation oriented conversational elements into an associated navigation data element representative thereof based on the identified descriptive elements;

compiling, by the processor, the navigation data elements into a navigation route; and

presenting, by the processor, at least a portion of the navigation route.

2. The computer implemented method of claim 1 wherein the converting further comprises accessing a navigation database operative to relate one or more of the plurality of navigation oriented conversational elements to one or more navigation data elements.

3. The computer implemented method of claim 1 wherein the conversational narrative further comprises at least one implied navigation oriented conversational element wherein the at least one implied navigation oriented conversational element is one of omitted, ambiguous, inaccurate, incomplete, grammatically miss-specified, irrelevant, incorrect, contradictory, misleading or a combination thereof.

4. The computer implemented method of claim 3 further comprising deriving, by the processor, an associated navigation data element associated with the at least one implied navigation oriented element based on a contextual profile of the provider of the conversational narrative.

5. The computer implemented method of claim 1 wherein the conversational narrative comprises a vocal narrative including a spoken natural language the method further comprising receiving, by the processor, the conversational narrative via an audio sensor coupled therewith and converting the received conversational narrative to data representative thereof.

6. The computer implemented method of claim 1 wherein the at least one non-verbal physical movement of a portion of a human body comprises pointing with a finger or other body part, waving, a mannerism, lip movement, eye movement, drawing a picture, drawing a map, drawing symbols, drawing text, or combinations thereof.

7. A system comprising:

a processor;

a memory coupled with the processor;

first logic stored in the memory and executable by the processor to cause the processor to receive at least a portion of a conversational narrative descriptive of a route to a destination expressed by a provider, the expressed conversational narrative comprising a plurality of conversational elements, a portion of which includes at least one non-verbal physical movement of a portion of a human body, wherein the plurality of conversational elements includes a plurality of navigation oriented conversational elements and at least one descriptive element characterizing at least one other of the plurality of conversational elements, the first logic being further executable by the processor to cause the processor to receive the portion of the conversational narrative comprising the at least one non-verbal physical movement of a portion of a human body via an optical sensor, a motion sensor, or a combination thereof;

second logic stored in the memory and executable by the processor to cause the processor to identify the plurality of navigation oriented conversational elements of the plurality of conversational elements as well as any of the at least one descriptive elements characterizing thereof;

third logic stored in the memory and executable by the processor to cause the processor to convert each of the plurality of navigation oriented conversational elements into an associated navigation data element representative thereof based on the identified descriptive and relational elements;

fourth logic stored in the memory and executable by the processor to cause the processor to compile the navigation data elements into a navigation route; and

fifth logic stored in the memory and executable by the processor to cause the processor to present at least a portion of the navigation route.

8. The system of claim 7 wherein the third logic is further executable by the processor to cause the processor to access a navigation database operative to relate one or more navigation oriented conversational elements to one or more navigation data elements.

9. The system of claim 7 wherein the conversational narrative comprises at least one implied navigation oriented conversational element wherein the at least one implied navigation oriented conversational element is one of omitted, ambiguous, inaccurate, incomplete, grammatically miss-specified, irrelevant, incorrect, contradictory, misleading or a combination thereof.

10. The system of claim 9 wherein the third logic is further executable by the processor to cause the processor to derive the at least one implied navigation oriented element from a context in which the conversational narrative is occurring wherein the context comprises one of a geographic location, other navigation oriented element, temporal characteristic, or combinations thereof.

11. The system of claim 9 wherein the third logic is further executable by the processor to cause the processor to derive an associated navigation data element associated with the at least one implied navigation oriented element based on a contextual profile of the provider of the conversational narrative.

12. The system of claim 7 wherein the conversational narrative comprises a vocal narrative including a spoken natural language, the first logic being further executable by the processor to cause the processor to receive the conversational narrative via an audio sensor and convert the received conversational narrative to data representative thereof.

13. The system of claim 7 wherein the at least one non-verbal physical movement of a portion of a human body comprises pointing with a finger or other body part, waving, a mannerism, lip movement, eye movement, drawing a picture, drawing a map, drawing symbols, drawing text, or combinations thereof.

14. A mobile device comprising:

an input operative to receive at least a portion of a conversational narrative descriptive of a route to a destination expressed by a provider, wherein the conversational narrative includes a plurality elements, a portion of which includes at least one non-verbal physical movement of a portion of a human body, the plurality of elements including a plurality of navigation oriented elements and at least one descriptive element characterizing another of the plurality of elements, the input being further operative to receive the portion of the conversational narrative comprising the at least one non-verbal physical movement of a portion of a human body via an optical sensor, a motion sensor, or a combination thereof;

a converter coupled with the input and operative to convert the received portion of the expressed conversational narrative to data representative thereof;

a parser coupled with the converter and operative to identify the plurality of navigation oriented conversational elements represented within the data, as well as any descriptive elements associated therewith;

a navigation processor coupled with the parser and operative to convert each of the plurality of navigation oriented conversational elements into an associated navigation data element representative thereof based on the identified descriptive elements associated therewith, if any;

a route generator coupled with the navigation processor and operative to compile the navigation elements into a navigation route; and

an output coupled with the route generator and operative to present the navigation route.

15. The mobile device of claim 14 wherein the navigation processor is further coupled with a navigation database operative to relate one or more navigation oriented conversational elements to one or more navigation data elements.

16. The mobile device of claim 14 wherein the conversational narrative comprises at least one implied navigation oriented conversational element wherein the at least one implied navigation oriented conversational element is one of omitted, ambiguous, inaccurate, incomplete, grammatically miss-specified, irrelevant, incorrect, contradictory, misleading or a combination thereof.

17. The mobile device of claim 16 wherein the navigation processor is further operative to derive an associated navigation data element associated with the at least one implied navigation oriented element based on a contextual profile of the provider of the conversational narrative.

18. The mobile device of claim 14 wherein the conversational narrative comprises a vocal narrative, the input being operative to receive the conversational narrative via an audio sensor and convert the received conversational narrative to data representative thereof.

19. The mobile device of claim 14 wherein the at least one non-verbal physical movement of a portion of a human body comprises pointing with a finger or other body part, waving, a mannerism, lip movement, eye movement, drawing a picture, drawing a map, drawing symbols, drawing text, or combinations thereof.

20. The mobile device of claim 14 wherein the output is operative to audibly present, visually present, tactically present, or a combination thereof, the navigation route or a portion thereof.