Method and apparatus for recognizing behavior and providing information

• US 10,115,238 B2
• Filed: 10/22/2016
• Issued: 10/30/2018
• Est. Priority Date: 03/04/2013
• Status: Active Grant

• Current Assignee: Alexander C. Chen
• Original Assignee: Alexander C. Chen
• Inventors: Chen, Alexander C.
• Primary Examiner(s): VILLECCO, JOHN M
• Application Number:
  US15/331,834
• Publication Number:
  US 20170069139A1
• Time in Patent Office: 738 Days
• CPC Class Codes: A61B 2560/0242 adapted to measure environmental factors, e.g. temperature, pollution
• CPC Class Codes: A61B 5/0022 Monitoring a patient using a global network, e.g. telephone networks, internet
• CPC Class Codes: A61B 5/082 Evaluation by breath analysis, e.g. determination of the chemical composition of exhaled breath A61B5/083, A61B5/091 take precedence
• CPC Class Codes: A61B 5/0823 Detecting or evaluating cough events
• CPC Class Codes: A61B 5/11 Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb for measuring pulse A61B5/02 ;A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721
• CPC Class Codes: A61B 5/1116 Determining posture transitions
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/18 for vehicle drivers or machine operators
• CPC Class Codes: A61B 5/6803 Head-worn items, e.g. helmets, masks, headphones or goggles
• CPC Class Codes: A61B 5/745 using a holographic display
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06Q 30/0267 Wireless devices
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces
• CPC Class Codes: H04M 2250/52 including functional features of a camera constructional features concerning the integration of cameras in portable phones H04M1/0264
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay

Abstract

A method and apparatus may capture an image of a second person with a camera on a frame worn by a user, transmit the image to a second device, receive a recommendation for the user to interact with the second person in response to a behavior of the second person, and display the recommendation to the user on how to interact with the second person in response to the second person'"'"'s behavior.

Claims

1. An apparatus comprising:

a frame configured to be worn on a user'"'"'s head;

a camera on the frame configured to capture a video of a second person;

a display on the frame configured to play the video for the user to see;

a processor on the frame configured to receive a user command to pause the video being played on the display, rewind the video, and at least one of (1) play the video slowly on the display, and (2) zoom in on the second person and play the video on the display;

a transceiver on the frame configured to transmit the video to a second device and receive, from the second device, information about a behavior of the second person determined from the video,

wherein the display is configured to display the received information.

2. The apparatus of claim 1, wherein the processor is configured to allow the user to select a part of the video that the user zoomed in on the second person for the transceiver to transmit to the second device to determine the behavior of the second person.

3. The apparatus of claim 1, wherein the received information comprises at least one of a word, an image, a second video, a halo around the second person, a glowing outline, an icon, a flashing light, and a symbol.

4. The apparatus of claim 1, wherein the received information comprises a recommendation to the user to interact with the second person based on the determined behavior of the second person.

5. The apparatus of claim 1, further comprising a memory configured to record and erase a loop of the captured video.

6. The apparatus of claim 1, wherein the transceiver is configured to receive, from the second device, information about two behaviors of the second person determined from the video, the display being configured to display the information about the two behaviors to the user.

7. The apparatus of claim 1,

wherein the transceiver on the frame is configured to receive from the second device (1) a health condition of the second person based on the behavior of the second person determined from the transmitted video, and (2) a plurality of recommendations to the user to help the second person in response to the health condition;

and

wherein the display on the frame is configured to display the health condition and the plurality of recommendations to the user, each recommendation comprises at least one of a word, a phrase, a symbol, a second image, or a video.

8. The apparatus of claim 7, wherein the processor is further configured to scan a crowd of people and identify a person in the crowd for the user to help.

9. The apparatus of claim 7, further comprising a sensor configured to sense a condition, the condition comprising at least one of temperature, humidity, particles in the air, sounds of the second person, a temperature of the second person, perspiration of the second person, and speed of movement of the second person.

10. The apparatus of claim 7, wherein the processor is further configured to determine a location of the apparatus, wherein the transceiver is configured to transmit the location of the apparatus to the second device, and receive recommendations for the user based on the second person'"'"'s behavior and the location of the apparatus.

11. The apparatus of claim 7, further comprising a speaker configured to play audio recommendations to the user to help the second person in response to the health condition.

12. The apparatus of claim 1, further comprising a speaker configured to emit sounds related to the information received by the transceiver.

13. The apparatus of claim 1, wherein the processor is configured to determine a location of the apparatus, wherein the transceiver is configured to transmit the location of the apparatus to the second device, and receive information about the second person'"'"'s behavior determined from the video and the location of the apparatus.

14. The apparatus of claim 1, wherein the transceiver is configured to receive information related to a game that the user is playing, wherein the display is configured to display the received information related to the game.

15. The apparatus of claim 1, further comprising a sensor configured to sense a condition, the condition comprising at least one of lighting, temperature, humidity, particles in the air, sounds of the second person, a temperature of the second person, a heart rate of the second person, perspiration of the second person, and speed of movement of the second person.

16. The apparatus of claim 1, wherein the transceiver is configured to receive information about an object near the second person in the video, wherein the display is configured to display the received information about the object.

17. The apparatus of claim 1, wherein the processor is configured to receive an input from the user to select at least one mode from at least two modes for displaying different types of information.

18. The system of claim 17, wherein the second device is configured to (1) analyze an object near the second person in the video and (2) transmit information about the object to the transceiver, wherein the transceiver is configured to receive information about the object from the second device, wherein the display is configured to display the received information about the object.

19. A method comprising:

capturing a video of a second person with a camera on a frame worn on a user'"'"'s head;

playing the video on a display on the frame for the user to see;

receiving a user command at a processor on the frame to pause the video being played on the display, rewind the video, and at least one of (1) play the video slowly on the display, and (2) zoom in on the second person and play the video on the display;

transmitting the video from a transceiver on the frame to a second device;

receiving, from the second device, information about a behavior of the second person determined from the video; and

displaying the received information on the display.

20. A system comprising:

a first device; and

a second device in communication with the first device;

wherein the first device comprises;

a frame configured to be worn on a user'"'"'s head;

a camera on the frame configured to capture a video of a second person;

a display on the frame configured to play the video for the user to see;

a processor on the frame configured to receive a user command to pause the video being played on the display, rewind the video, and at least one of (1) play the video slowly on the display, and (2) zoom in on the second person and play the video on the display;

a transceiver on the frame configured to transmit the video to the second device and receive, from the second device, information about a behavior of the second person determined from the video,

wherein the display is configured to display the received information.