Method for assisting a person in acting in a dynamic environment and corresponding system

• US 10,475,348 B2
• Filed: 06/05/2018
• Issued: 11/12/2019
• Est. Priority Date: 06/09/2017
• Status: Active Grant

• Current Assignee: Honda Research Institute Europe GmbH (Honda Motor Company)
• Original Assignee: Honda Research Institute Europe GmbH (Honda Motor Company)
• Inventors: Kruger, Matti
• Primary Examiner(s): Akki, Munear T
• Application Number:
  US15/997,930
• Publication Number:
  US 20180357913A1
• Time in Patent Office: 525 Days
• CPC Class Codes: G08G 1/161 Decentralised systems, e.g. inter-vehicle communication
• CPC Class Codes: G08G 1/165 for passive traffic, e.g. including static obstacles, trees
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: G08G 9/02 Anti-collision systems

Abstract

The invention regards a method and a system for assisting a person in acting in a dynamic environment. At first, information on states at least two entities in a common environment is obtained. A future behaviour of each of the entities is then predicted based on the obtained information and a time to event for at least one predetermined event involving the at least two entities and a position of occurrence of the event relative to the person is estimated. Then, a signal indicative of the relative direction of the predicted event with respect to the person and indicative of the time to event for driving an actuator is generated, the signal causing a stimulation being perceivable by the person by its perceptual capabilities, wherein the time to event is encoded such that the signal'"'"'s saliency is the higher the smaller the time to event is.

Claims

1. A method for assisting a person in assessing a dynamic environment, comprising steps of:

obtaining information on states of at least two entities in a common environment;

predicting a future behavior of each of the entities based on the obtained information and at least one event involving the at least two entities;

estimating a time to event for the at least one predicted event involving the at least two entities and a position of occurrence of the at least one predicted event relative to the person or to a predetermined entity associated with the person; and

generating a signal for driving an actuator indicative of a relative direction of the predicted event with respect to the person and indicative of the time to event, the signal causing a stimulation being perceivable by the person by its perceptual capabilities,

wherein the stimulation is a stimulation signal causing the stimulation of the person at a dedicated location of the person'"'"'s body to encode the relative direction, and

one or more parameters of the stimulation signal encode the time to event such that the signal'"'"'s saliency is higher the smaller the time to event is.

2. The method according to claim 1, wherein

the time to event estimation or the signal is adapted to a context for which an estimation of the time to event is performed.

3. The method according to claim 1, wherein

the stimulation is a tactile stimulation signal.

4. The method according to claim 1, wherein

the stimulation comprises an auditory stimulation signal causing sound to be generated at a location representative for the relative direction, wherein one or more parameters of the sound encode the time to event.

5. The method according to claim 1, wherein

the stimulation comprises a visual stimulation signal causing a visual stimulus to be generated at a location representative for the relative direction, wherein one or more parameters of the visual stimulation signal encode the time to event.

6. The method according to claim 1, wherein

the stimulation signal comprises an electromagnetic stimulation signal interacting with the person'"'"'s nervous system or body parts, the electromagnetic stimulation signal being applied to the person such that it stimulates at a location of the body representative for the relative direction, wherein one or more parameters of the electromagnetic stimulation signal encode the time to event.

7. The method according to claim 1, wherein

the stimulation signal comprises a chemical stimulation signal which is applied to the person such that it stimulates at a location of the body representative for the relative direction, wherein one or more parameters of the chemical stimulation signal encode the time to event.

8. The method according to claim 1, wherein

the stimulation signal comprises a heat stimulation signal which is applied to the person at a dedicated location of the person'"'"'s body to encode the relative direction, wherein a level of heat encodes the time to event.

9. The method according to claim 8, wherein

the stimulation signal'"'"'s saliency is compensated for different sensitivity of different locations of a body where it is applied and for different environmental conditions.

10. The method according to claim 1, wherein

the at least one predicted event is a collision between at least two of the entities.

14. The method according to claim 1, further comprising:

selecting a basis for generating the signal from at least one of event, time to event, and direction.

15. The method according to claim 14, wherein

the selecting is based on at least one of an availability of predictions in a given direction, context dependent criteria, a proximity of event, relevance of an entity, certainty of prediction, impact of false signals, and result of a comparison of a time to event with a threshold.

16. The method according to claim 1, further comprising:

adapting a stimulus frequency range and a stimulus amplitude range to a preference and a sensitivity of the person.

11. A system for assisting a person in assessing a dynamic environment, the system comprising:

a state information obtaining unit for obtaining information on states of at least two entities in a common environment;

processor for predicting a future behavior of each of the entities based on the obtained information, for predicting at least one event involving the at least two entities, and for estimating a time to event for the at least one predicted event and a position of occurrence of the at least one predicted event relative to the person; and

signal generator for generating a signal indicative of the relative direction of the event with respect to the person and indicative of the time to event, the signal causing an actuator to stimulate the person such that the stimulation is perceivable by the person using its perceptual capabilities,

wherein the signal is a stimulation signal causing the stimulation of the person at a dedicated location of the person'"'"'s body to encode the relative direction, and

one or more parameters of the stimulation signal encode the time to event,

wherein the time to event being encoded such that the signal'"'"'s saliency is higher the smaller the time to event is.

12. The system according to claim 11, wherein

the system comprises a plurality of actuator elements of at least one of the following types vibrotactile actuator, pressure-applying actuator, loudspeaker, light emitter, electrode, induction coil, chemical emitter/agent, and heating element.

13. The system according to claim 12, wherein

the plurality of actuator elements is arranged as an array.