Three-dimensional holographic visual and haptic object warning based on visual recognition analysis

• US 10,339,771 B2
• Filed: 02/03/2017
• Issued: 07/02/2019
• Est. Priority Date: 02/03/2017
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Bostick, James E., Ganci, Jr., John M., Keen, Martin G., Rakshit, Sarbajit K.
• Primary Examiner(s): Aghevli, Reza
• Application Number:
  US15/423,652
• Publication Number:
  US 20180225935A1
• Time in Patent Office: 879 Days
• Field of Search: None
• CPC Class Codes: F24C 7/083 on tops, hot plates
• CPC Class Codes: G03H 1/0005 Adaptation of holography to specific applications holographic optical element G02B5/32; holographic scanner G02B26/106; recognition using holographic mask G06V10/88; holographic memories G11B7/0065, G11C13/042
• CPC Class Codes: G03H 1/2249 Holobject properties
• CPC Class Codes: G03H 2001/0061 in haptic applications when the observer interacts with the holobject
• CPC Class Codes: G03H 2001/226 Virtual or real
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: G08B 5/36 using visible light sources
• CPC Class Codes: G08B 6/00 Tactile signalling systems, e.g. personal calling systems

Abstract

Presenting a haptic hologram warning is provided. An indication that a first individual who needs supervision is approaching a situation is received. A haptic hologram is presented to the first individual who needs supervision prior to the first individual reaching the situation.

Claims

1. A computer-implemented method for presenting a haptic hologram warning, the computer-implemented method comprising:

receiving, by a computer, an indication that a first individual who needs supervision is approaching a situation; and

presenting, by the computer, the haptic hologram warning to the first individual who needs supervision prior to the first individual reaching the situation, wherein the computer modifies an intensity of the haptic hologram warning based on the computer determining a level of danger posed to the first individual by the situation.

2. The computer-implemented method of claim 1 further comprising:

receiving, by the computer, an indication that a second individual who does not need supervision is approaching the situation; and

refraining, by the computer, from presentation of the haptic hologram warning to the second individual who does not need supervision.

3. The computer-implemented method of claim 1, wherein the situation is one of a group consisting of a potentially dangerous inanimate object and a user-designated inanimate object with restricted access.

4. The computer-implemented method of claim 1 further comprising:

receiving, by the computer, image data of an area surrounding an object from an image capturing device; and

performing, by the computer, an analysis of the image data using a visual recognition analysis component of the computer.

5. The computer-implemented method of claim 4, wherein the image data is real time streaming image data of the area surrounding the object.

6. The computer-implemented method of claim 4 further comprising:

identifying, by the computer, the object, a current status of the object, a set of individuals in the area surrounding the object, age of each individual in the set, activity of each individual in the set, and direction of movement of each individual in the set based on the analysis of the image data.

10. The computer-implemented method of claim 1, wherein the haptic hologram warning comprises a three-dimensional (3-D) holographic visual and haptic warning that is presented spatially-adjacent to a potentially dangerous object.

21. The computer-implemented method of claim 4, wherein the object is an inanimate object, and further comprising:

determining whether to present the haptic hologram warning based on the analysis of the area surrounding the inanimate object.

7. A computer-implemented method for presenting a haptic hologram warning, the computer-implemented method comprising:

receiving, by a computer, an indication that a first individual who needs supervision is approaching a situation;

presenting, by the computer, a haptic hologram to the first individual who needs supervision prior to the first individual reaching the situation

receiving, by the computer, image data of an area surrounding an object from an image capturing device;

performing, by the computer, an analysis of the image data using a visual recognition analysis component of the computer;

identifying, by the computer, the object, a current status of the object, a set of individuals in the area surrounding the object, age of each individual in the set, activity of each individual in the set, and direction of movement of each individual in the set based on the analysis of the image data;

determining, by the computer, whether generating a three-dimensional (3D) holographic visual and haptic warning is pertinent to the object based on the current status of the object and the age, activity, and direction of movement of each individual in the set of individuals within the area surrounding the object; and

responsive to the computer determining that generating a 3D holographic visual and haptic warning is pertinent to the object based on the current status of the object and the age, activity, and direction of movement of each individual in the set of individuals within the area surrounding the object, determining, by the computer, a size and a shape of the 3D holographic visual and haptic warning to generate between the object and one or more individuals in the set of individuals.

8. The computer-implemented method of claim 7 further comprising:

generating, by the computer, the 3D holographic visual and haptic warning between the object and the one or more individuals in the set of individuals in accordance with the determined size and shape using an ultrasound transducer array in the area.

9. The computer-implemented method of claim 8 further comprising:

determining, by the computer, whether the generating of the 3D holographic visual and haptic warning is still pertinent to the object based on analyzing new image data of the area surrounding the object; and

responsive to the computer determining that the generating of the 3D holographic visual and haptic warning is not pertinent to the object based on the analyzing of the new image data of the area surrounding the object, stopping, by the computer, generation of the 3D holographic visual and haptic warning.

11. A computer system for presenting a haptic hologram warning, the computer system comprising:

a bus system;

a storage device connected to the bus system, wherein the storage device stores program instructions; and

a processor connected to the bus system, wherein the processor executes the program instructions to;

receive an indication that a first individual who needs supervision is approaching a situation; and

present the haptic hologram warning to the first individual who needs supervision prior to the first individual reaching the situation, wherein the computer modifies an intensity of the haptic hologram based on the computer determining a level of danger posed to the first individual by the situation.

12. The computer system of claim 11, wherein the processor further executes the program instructions to:

receive an indication that a second individual who does not need supervision is approaching the situation; and

refrain from presentation of the haptic hologram warning to the second individual who does not need supervision.

22. The computer system of claim 11, further comprising:

an ultrasound transducer array comprising a plurality of ultrasound transducers.

13. A computer program product for presenting a haptic hologram warning, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to cause the computer to perform a method comprising:

receiving, by the computer, an indication that a first individual who needs supervision is approaching a situation; and

presenting, by the computer, the haptic hologram warning to the first individual who needs supervision prior to the first individual reaching the situation, wherein the computer modifies an intensity of the haptic hologram based on the computer determining a level of danger posed to the first individual by the situation.

14. The computer program product of claim 13 further comprising:

receiving, by the computer, an indication that a second individual who does not need supervision is approaching the situation; and

refraining, by the computer, from presentation of the haptic hologram warning to the second individual who does not need supervision.

15. The computer program product of claim 13, wherein the situation is one of a group consisting of a potentially dangerous inanimate object and a user-designated inanimate object with restricted access.

16. The computer program product of claim 13 further comprising:

receiving, by the computer, image data of an area surrounding an object from an image capturing device; and

performing, by the computer, an analysis of the image data using a visual recognition analysis component of the computer.

17. The computer program product of claim 16, wherein the image data is real time streaming image data of the area surrounding the object.

18. The computer program product of claim 16 further comprising:

identifying, by the computer, the object, a current status of the object, a set of individuals in the area surrounding the object, age of each individual in the set, activity of each individual in the set, and direction of movement of each individual in the set based on the analysis of the image data.

19. A computer program product for presenting a haptic hologram warning, the computer program product comprising a non-transitory computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to cause the computer to perform a method comprising:

receiving, by the computer, an indication that a first individual who needs supervision is approaching a situation;

presenting, by the computer, a haptic hologram to the first individual who needs supervision prior to the first individual reaching the situation;

receiving, by the computer, image data of an area surrounding an object from an image capturing device;

performing, by the computer, an analysis of the image data using a visual recognition analysis component of the computer;

identifying, by the computer, the object, a current status of the object, a set of individuals in the area surrounding the object, age of each individual in the set, activity of each individual in the set, and direction of movement of each individual in the set based on the analysis of the image data;

determining, by the computer, whether generating a three-dimensional (3D) holographic visual and haptic warning is pertinent to the object based on the current status of the object and the age, activity, and direction of movement of each individual in the set of individuals within the area surrounding the object; and

responsive to the computer determining that generating a 3D holographic visual and haptic warning is pertinent to the object based on the current status of the object and the age, activity, and direction of movement of each individual in the set of individuals within the area surrounding the object, determining, by the computer, a size and a shape of the 3D holographic visual and haptic warning to generate between the object and one or more individuals in the set of individuals.

20. The computer program product of claim 19 further comprising:

generating, by the computer, the 3D holographic visual and haptic warning between the object and the one or more individuals in the set of individuals in accordance with the determined size and shape using an ultrasound transducer array in the area.

23. A computer-implemented method for presenting a three-dimensional (3-D) holographic visual and haptic warning, the computer-implemented method comprising:

receiving, by a computer, an indication that a first individual who needs supervision is approaching a situation;

presenting, by the computer, the 3-D holographic visual and haptic warning to the first individual who needs supervision prior to the first individual reaching the situation;

receiving, by the computer, image data of an area surrounding an object from an image capturing device; and

performing, by the computer, an analysis of the image data using a visual recognition analysis component of the computer, wherein the object is an inanimate object, and further comprising;

determining whether to present the 3-D holographic visual and haptic warning based on the analysis of the area surrounding the inanimate object.

24. The computer-implemented method of claim 23, further comprising:

accessing a user profile comprising information corresponding to the first individual and an object access rule associated with the inanimate object.

25. The computer-implemented method of claim 24, further comprising:

differentiating between different individuals and potentially dangerous and safe situations in the area surrounding the object.