COGNITIVE RECORDING AND SHARING

• US 20170006214A1
• Filed: 06/30/2015
• Published: 01/05/2017
• Est. Priority Date: 06/30/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Andreassen, Elisabeth, Ranck, Andrew R., Hagleitner, Avery W., Parida, Pritish R.
• Granted Patent: US 9,894,266 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/783 using metadata automatically derived from the content
• CPC Class Codes: G06V 10/768 using context analysis, e.g. recognition aided by known co-occurring patterns
• CPC Class Codes: G06V 20/30 in albums, collections or shared content, e.g. social network photos or video
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 20/44 Event detection
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G11B 27/36 Monitoring, i.e. supervising the progress of recording or reproducing for digital recording G11B20/00 and s.gr.; for monitoring, testing or measuring of TV recorders of the type covered by H04N5/76 and subgroups, see H04N17/06
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus

Abstract

A system and method and computer program product for cognitive recording and sharing of live events. The system includes: a sensing and transmitting device that can sense the biometric signatures of an individual; a processing unit that analyses the sensed signal and initiate a set of actions; a recording device or the like to record the event; and a networked sharing device configured to subsequently share recorded event content. The system further identifies individuals'"'"' pre-cognitive inputs and additional external and internal factor input signals that are precursors to cognitive affirmation of an emotional response. These inputs will be identified, correlated, and used in training the system for subsequent identification and correlation between input factors and resulting emotional state. External factors may include: recognized emotional states, biometric inputs, and/or precognition inputs of other individuals in proximity to the subject individual. Other factors may include an individual'"'"'s context.

Claims

1. An apparatus for cognitive recording and sharing of live events comprising:

a processing unit;

a recording device to record a live event;

one or more sensors, each configured for obtaining a biometric signal data from an individual;

a transmitting device for communicating the one or more biometric signals for receipt at the processing unit, the processing unit configured to;

obtain a biometric signature of the individual based on a received biometric signal data;

obtain a signal representing one or more of;

a recognized emotional state of, a biometric signature of, and a determined precognition input of one or more other individuals in proximity to the individual;

determine an individual'"'"'s emotional state based on the signature in combination with the obtained signals of said one or more other individuals; and

record the live event by said recording device in response to said determined emotional state.

2. The apparatus as claimed in claim 1, configured as a networked sharing device including a further processing unit configured to:

receive the recording of said live event,

analyze aspects of said recording, and

automatically initiate a sharing of said recording via network connection with other individuals based on said analysis.

3. The apparatus as claimed in claim 1, where the processing unit is further configured to:

correlate biometric signals of the individual with a cognitive state or emotional state of said individual.

4. The apparatus as claimed in claim 3, where the processing unit is further configured to:

receive further input signals representing one or more of;

internal factors or external factors, and

use said received internal factor or external factors in determining said individual'"'"'s emotional state.

5. The apparatus as claimed in claim 1, where the processing unit is further configured to:

receive further input signals representing a context of the individual; and

use said context of the individual in determining said individual'"'"'s emotional state.

6. The apparatus as claimed in claim 4, where a received signal representing an internal factor comprises:

a signal representing one or more of;

a hormone change and a biochemical change of the individual in a time period before, during, and after determining an emotional state change,

a signal representing a detected change in an electromagnetic field in close proximity to the subject individual in the time period and context before, during, and after determining an emotional state change.

7. The apparatus as claimed in claim 4, where a received signal representing an external factor comprises one or more of:

audible sound, the processor unit further configured to process said received audible signal and determine one or more of;

a sound frequency, a volume, and a proximity of the sound source in proximity to the individual; and

a signal having light or visual content, the processor unit further configured to process said received visual content and determine one or more of;

a visual light intensity, a color, and a movement in proximity to the individual.

8. The apparatus as claimed in claim 7, where said processing unit is further configured to:

apply a weighting to a received external factor according to a characteristic of the received audible sound or visual characteristic, said characteristic including a direction or a locality from where a sound or visual content is occurring.

9. The apparatus as claimed in claim 2, wherein to analyze aspects of said recording, said further processing unit is further configured to one or more of:

tag or annotate key features and personnel with said recorded event content; and

characterize the recorded event as being personal to the individual or work-related, and based on that characterization, either share the recorded event with a social contact or work related contact associated with the individual via a network communication.

10. A method for cognitive recording and sharing of live events comprising:

receiving, at a processing device, a biometric signal from an individual;

obtaining a biometric signature of the individual based on a received biometric signal data;

obtaining, at the processing device, a signal representing one or more of;

a recognized emotional state of, a biometric signature of, and a determined precognition input of one or more other individuals in proximity to the individual;

determining, at said processing device, an individual'"'"'s emotional state based on the signature in combination with the obtained signals of said one or more other individuals; and

triggering a recording device to record a live event responsive to determined emotional state.

11. The method as claimed in claim 10, further comprising:

configuring a processing device to further receive a recording of said live event, analyzing at said processing device, aspects of said recording, and

automatically sharing said recording via a network connection with other individuals based on said analysis.

12. The method as claimed in claim 10, further comprising:

correlating received biometric signals of the individual with a cognitive state or emotional state of said individual.

13. The method as claimed in claim 12, further comprising:

receiving, at the processing unit, further input signals representing one or more of;

internal factors or external factors, and

further using said received internal factor or external factors in determining said individual'"'"'s emotional state.

14. The method as claimed in claim 10, further comprising:

receiving, at the processing unit, further input signals representing a context of the individual; and

further using said context of the individual in determining said individual'"'"'s emotional state.

15. The method as claimed in claim 13, where a received signal representing an internal factor comprises:

a signal representing one or more of;

a hormone change and a biochemical change of the individual in a time period before, during, and after determining an emotional state change,

a signal representing a detected change in an electromagnetic field in close proximity to the subject individual in the time period and context before, during, and after determining an emotional state change.

16. The method as claimed in claim 13, where a received signal representing an external factor comprises one or more of:

audible sound, the processor unit further configured to process said received audible signal and determine one or more of;

a sound frequency, a volume, and a proximity of the sound source in proximity to the individual; and

a signal having light or visual content, the processor unit further configured to process said received visual content and determine one or more of;

a visual light intensity, a color, and a movement in proximity to the individual.

17. The method as claimed in claim 16, further comprising:

applying a weighting to a received external factor according to a characteristic of the received audible sound or visual characteristic, said characteristic including a direction or a locality from where a sound or visual content is occurring.

18. The method as claimed in claim 11, wherein said analyzing aspects of said recording comprises one or more of:

tagging or annotating key features/personnel with said recorded event content; and

characterizing the recorded event as being personal to the individual or work-related, and based on that characterization, sharing the recorded event with a social contact or work related contact associated with the individual via a network communication.

19. A computer program product comprising a non-transitory computer readable medium embodying computer program instructions being run by a processor device for causing a computer system to perform method steps for cognitive recording and sharing of live events, said method steps comprising:

receiving a biometric signal from an individual;

obtaining a biometric signature of the individual based on a received biometric signal data;

obtaining, at the processing device, a signal representing one or more of;

a recognized emotional state of, a biometric signature of, and a determined precognition input of one or more other individuals in proximity to the individual;

determining, at said processing device, an individual'"'"'s emotional state based on the signature in combination with the obtained signals of said one or more other individuals; and

triggering a recording device to record and store a live event responsive to determined emotional state.

20. The computer program product as claimed in claim 19, wherein the method further comprises:

obtaining the recording of said live event;

analyzing aspects of said recording; and

automatically initiate a sharing of said recording via network connection with other individuals based on said analysis, wherein said analyzing aspects of said recording comprises one or more of;

tagging or annotating key features/personnel with said recorded event content; and

characterizing the recorded event as being personal to the individual or work-related, and based on that characterization, sharing the recorded event with a social contact or work related contact associated with the individual via a network communication.