Method and Apparatus for Recognizing Behavior and Providing Information

• US 20190019343A1
• Filed: 09/20/2018
• Published: 01/17/2019
• Est. Priority Date: 03/04/2013
• Status: Active Grant

• Current Assignee: Alex C. Chen
• Original Assignee: Alex C. Chen
• Inventors: Chen, Alex C.
• Granted Patent: US 11,200,744 B2
• Time in Patent Office: Days
• CPC Class Codes: A61B 2560/0242 adapted to measure environmental factors, e.g. temperature, pollution
• CPC Class Codes: A61B 5/0022 Monitoring a patient using a global network, e.g. telephone networks, internet
• CPC Class Codes: A61B 5/082 Evaluation by breath analysis, e.g. determination of the chemical composition of exhaled breath A61B5/083, A61B5/091 take precedence
• CPC Class Codes: A61B 5/0823 Detecting or evaluating cough events
• CPC Class Codes: A61B 5/11 Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb for measuring pulse A61B5/02 ;A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721
• CPC Class Codes: A61B 5/1116 Determining posture transitions
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/18 for vehicle drivers or machine operators
• CPC Class Codes: A61B 5/6803 Head-worn items, e.g. helmets, masks, headphones or goggles
• CPC Class Codes: A61B 5/745 using a holographic display
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06Q 30/0267 Wireless devices
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces
• CPC Class Codes: H04M 2250/52 including functional features of a camera constructional features concerning the integration of cameras in portable phones H04M1/0264
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay

Abstract

A method and apparatus may capture a video of a crowd of people near a first person, transmit the video of the crowd to a second device, and receive, from the second device, an indication that a second person in the crowd appears to be at least one of (a) interested in meeting the first person, and (b) a threat to the first person. A display on the frame may display the received indication to the first person.

Claims

1. An apparatus comprising:

a frame configured to be worn on a first person'"'"'s head;

a camera on the frame configured to capture a video of a crowd of people near the first person;

a transceiver on the frame configured to (a) transmit the video of the crowd to a second device, and (b) receive, from the second device, an indication that a second person in the crowd appears to be at least one of (a) interested in meeting the first person, and (b) a threat to the first person; and

a display on the frame configured to display the received indication to the first person.

2. The apparatus of claim 1, wherein the indication comprises at least one of a word, an image, a second video, a halo around the second person, a glowing outline, an icon, a flashing light, and a symbol.

3. The apparatus of claim 1, wherein the transceiver is configured to receive a recommendation for the first person on how to interact with the second person based on the indication, wherein the recommendation comprises at least one of an audible sound, an image, a video, a symbol, and text.

4. The apparatus of claim 1, further comprising cameras on sides of the frames configured to capture videos of people on the sides of the first person.

5. The apparatus of claim 1, wherein the transceiver is configured to receive information related to a game, and the display is configured to display the information to the first person, wherein the information comprises at least one of a word, an image, a video, a halo around the second person, a glowing outline, an icon, a flashing light, and a symbol.

6. The apparatus of claim 1, further comprising a user interface configured to allow the first person to select a mode from a plurality of modes, each mode being associated with a type of information that the first person wishes to see on the display, wherein the modes comprise at least two of a help mode, a warning mode, and a sales mode, wherein the transceiver is configured to receive a recommendation, based on a mode selected by the first person, for the first person to interact with the second person.

7. The apparatus of claim 1, wherein the indication comprises a warning to the first person that the second person appears to be at least one of (a) carrying a weapon and (b) reaching for a weapon.

8. The apparatus of claim 1, wherein the transceiver is configured to further receive a health condition of the second person.

9. The apparatus of claim 1, further comprising a sensor configured to sense a condition, the condition comprising at least one of temperature, humidity, particles in the air, sounds of the second person, a temperature of the second person, perspiration of the second person, and speed of movement of the second person.

10. A method comprising:

capturing, with a camera on a frame worn on a head of a first person, a video of a crowd of people near the first person;

transmitting, from a transceiver on the frame, the video of the crowd to a second device,

receiving, at the transceiver from the second device, an indication that a second person in the crowd appears to be at least one of (a) interested in meeting the first person, and (b) a threat to the first person; and

displaying, with a display on the frame, the received indication to the first person.

11. The method of claim 10, wherein the indication comprises at least one of a word, an image, a second video, a halo around the second person, a glowing outline, an icon, a flashing light, and a symbol.

12. The method of claim 10, further comprising receiving, at the transceiver, a recommendation for the first person on how to interact with the second person based on the indication, wherein the recommendation comprises at least one of audible instructions and visual instructions.

13. The method of claim 10, further comprising capturing, with cameras on the side of the frames, videos of people on the sides of the first person.

14. The method of claim 10, further comprising allowing the first person to select a mode from a plurality of modes, each mode being associated with a type of information that the first person wishes to see on the display, wherein the modes comprise at least two of a help mode, a warning mode, and a sales mode, wherein the transceiver is configured to receive a recommendation, based on a mode selected by the first person, for the first person to interact with the second person.

15. The method of claim 10, wherein the indication comprises a warning to the first person that the second person appears to be at least one of (a) carrying a weapon and (b) reaching for a weapon.

16. An apparatus comprising:

a first transceiver configured to receive, from a second transceiver on a frame worn on a head of a first person, a video of a crowd of people near the first person;

a processor configured to analyze the crowd to determine a second person in the crowd who appears to be at least one of (a) interested in meeting the first person, and (b) a threat to the first person; and

wherein the first transceiver is configured to transmit an indication of the second person who appears to be at least one of (a) interested in meeting the first person, and (b) a threat to the first person to the second transceiver to inform the first person.

17. The apparatus of claim 16, wherein the processor is configured to recognize a behavior of the second person comprising at least one of eyes opened wide, rapid hand motions, a hand of a person person checking a pocket, a hand of a person behind the person'"'"'s back, and a hand reaching for a weapon.

18. The apparatus of claim 16, wherein the first transceiver is configured to transmit a recommendation to the first person on how to interact with the second person based on the indication, wherein the recommendation comprises at least one of an audible sound, an image, a video, a symbol, and text.

19. The apparatus of claim 16, wherein the processor is configured to recognize a weapon on the second person.

20. The apparatus of claim 16, wherein the processor is configured to recognize a sick person in the crowd and an object that they touch.