Systems and Methods Providing En Mass Collection and Centralized Processing of Physiological Responses from Viewers

• US 20090131764A1
• Filed: 10/31/2008
• Published: 05/21/2009
• Est. Priority Date: 10/31/2007
• Status: Active Grant

• Current Assignee: Nielsen Consumer LLC (Nielsen Holdings plc)
• Original Assignee: Nielsen Company (US) LLC (RR Donnelley & Sons Company)
• Inventors: Lee, Hans C., Hong, Timmie T., Munoz, Juan C.
• Granted Patent: US 9,521,960 B2
• Time in Patent Office: Days
• US Class Current: 600/301
• CPC Class Codes: A61B 5/0006 ECG or EEG signals
• CPC Class Codes: A61B 5/0205 Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
• CPC Class Codes: A61B 5/11 Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb for measuring pulse A61B5/02 ;A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721
• CPC Class Codes: A61B 5/16 Devices for psychotechnics using teaching or educational appliances G09B1/00 - G09B7/00; Testing reaction times ; Devices for evaluating the psychological state
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/377 using evoked responses
• CPC Class Codes: A61B 5/6803 Head-worn items, e.g. helmets, masks, headphones or goggles
• CPC Class Codes: A61B 5/6814 Head
• CPC Class Codes: G06Q 30/0201 Market modelling; Market analysis; Collecting market data
• CPC Class Codes: G06Q 30/0204 Market segmentation
• CPC Class Codes: H04H 60/33 Arrangements for monitoring the users' behaviour or opinions
• CPC Class Codes: H04N 21/25866 Management of end-user data customer care in data networks H04L41/5077
• CPC Class Codes: H04N 21/42201 biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user input arrangements for interaction with the human body based on nervous system activity detection G06F3/015
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/4758 for providing answers, e.g. voting
• CPC Class Codes: H04N 7/16 Analogue secrecy systems; Analogue subscription systems

Abstract

Embodiments described herein enable “in situ” sensing, which collects and analyzes physiological responses from a large group of viewers/audiences who watch a same media instance together at a single venue. Each of the group of viewers is fitted with physiological sensors with communication capabilities to communicate with a signal collection device at or near the venue. The signal collection device collects the physiological data of the viewers from the sensors, and transmits the physiological data to a processing module at another location via a network for storage and further analysis.

Claims

1. A system comprising:

a plurality of headsets, wherein each headset is worn by a viewer of a plurality of viewers located at a venue, each headset including at least one sensor and a transmitter, wherein the plurality of viewers is watching a media instance, wherein each headset receives physiological data from the corresponding viewer;

a signal collection device located at the venue, the signal collection device receiving the physiological data transmitted by the plurality of headsets via a wireless coupling; and

a processing module that receives the physiological data from the signal collection device, wherein the processing module derives from the physiological data a plurality of physiological responses of the plurality of viewers to the media instance.

2. The system of claim 1, wherein the processing module synchronizes the physiological data from the plurality of viewers.

3. The system of claim 1, wherein the processing module synchronizes the media instance and the physiological data from the plurality of viewers.

4. The system of claim 1, wherein the signal collection device synchronizes the physiological data from the plurality of viewers.

5. The system of claim 1, wherein the signal collection device synchronizes the media instance and the physiological data from the plurality of viewers.

6. The system of claim 1, wherein the signal collection device removes data from the corresponding physiological data for a time period during which a viewer of the plurality of viewers is not paying attention to the media instance before transferring the data to the processing module.

7. The system of claim 6, wherein the processing module interpolates physiological data from the time period when a viewer of the plurality of viewers is paying attention to cover the data that has been removed.

8. The system of claim 1, wherein the physiological data is at least one of heart rate, brain waves, EEG signals, blink rate, breathing, motion, muscle movement, galvanic skin response, and a response correlated with change in emotion.

9. The system of claim 8, wherein the processing module removes artifacts of the physiological data.

10. The system of claim 1, wherein the anomaly is detected using at least one of heart rate, brain waves, EEG signals, blink rate, breathing, motion, muscle movement, and galvanic skin response.

11. The system of claim 1, wherein the physiological data is heart rate.

12. The system of claim 1, wherein the physiological data is brain waves.

13. The system of claim 1, wherein the physiological data is EEG signals.

14. The system of claim 1, wherein the physiological data is blink rate.

15. The system of claim 1, wherein the physiological data is breathing.

16. The system of claim 1, wherein the physiological data is motion.

17. The system of claim 1, wherein the physiological data is muscle movement.

18. The system of claim 1, wherein the physiological data is galvanic skin response.

19. The system of claim 1, wherein the physiological data is a response correlated with change in emotion.

20. The system of claim 1, wherein the at least one sensor includes a physiological sensor.

21. The system of claim 1, wherein the at least one sensor includes an electroencephalogram.

22. The system of claim 1, wherein the at least one sensor includes an accelerometer.

23. The system of claim 1, wherein the at least one sensor includes a blood oxygen sensor.

24. The system of claim 1, wherein the at least one sensor includes a galvanometer.

25. The system of claim 1, wherein the at least one sensor includes a electromygraph.

26. The system of claim 1, wherein the headset includes at least one dry EEG electrode.

27. The system of claim 1, wherein the headset includes at least one heart rate sensor.

28. The system of claim 1, wherein the headset includes at least one accelerometer.

29. The system of claim 1, wherein the headset includes at least one processor.

30. The system of claim 1, wherein the headset includes at least one wireless communication device.

31. The system of claim 1, wherein the plurality of physiological responses includes liking.

32. The system of claim 1, wherein the plurality of physiological responses includes thought.

33. The system of claim 1, wherein the plurality of physiological responses includes adrenaline.

34. The system of claim 1, wherein the plurality of physiological responses includes engagement.

35. The system of claim 1, wherein the plurality of physiological responses includes immersion in the media instance.

36. The system of claim 1, comprising a rating module that rates the media instance based on the plurality of physiological responses from the plurality of viewers.

37. The system of claim 1, comprising a reaction database that stores at least one of the physiological data, the plurality of physiological responses, and analysis results of the physiological responses.

38. The system of claim 37, wherein the reaction database stores at least one of data of the media instance, and results of surveys presented to the plurality of viewers and corresponding to the media instance.

39. The system of claim 1, wherein the media instance is at least one of a television program, an advertisement, a movie, printed media, a website, a computer application, a video game, and a live performance.

40. The system of claim 1, wherein the media instance is representative of a product.

41. The system of claim 1, wherein the media instance is at least one of product information and product content.

42. The system of claim 1, wherein the plurality of viewers includes a plurality of sets of viewers, wherein a first set of viewers is located in a first region of the venue and a second set of viewers is located in a second region of the venue, wherein the first region is different from the second region.

43. The system of claim 1, comprising a tutorial, wherein a computer coupled to the processing module automatically receives and installs the tutorial, wherein the tutorial comprises information relating to watching of the media instance and data collection during the watching.

44. The system of claim 43, wherein the tutorial automatically instructs the plurality of viewers in use of the headsets.

45. The system of claim 43, wherein the tutorial automatically determines a data quality of the physiological data received from the plurality of headsets.

46. A system comprising:

a plurality of headsets, wherein each headset is worn by a viewer of a plurality of viewers located at a venue, each headset including at least one sensor and a transmitter, wherein the plurality of viewers is watching a media instance, wherein each headset receives physiological data from the corresponding viewer;

a signal collection device located at the venue, the signal collection device receiving the physiological data transmitted by the plurality of headsets via a wireless coupling, wherein the signal collection device generates aggregated data by aggregating the physiological data of the plurality of viewers; and

a processing module that receives the physiological data from the signal collection device, wherein the processing module derives from the physiological data a plurality of physiological responses of the plurality of viewers to the media instance.

47. A system comprising:

a plurality of headsets, wherein each headset is worn by a viewer of a plurality of viewers located at a venue, each headset including at least one sensor and a transmitter, wherein the plurality of viewers is watching a media instance, wherein each headset receives physiological data from the corresponding viewer;

a signal collection device coupled to the plurality of headsets, the signal collection device receiving the physiological data transmitted by the plurality of headsets via a plurality of wireless couplings, wherein the signal collection device controls data quality of the physiological data; and

a processing module that receives the physiological data from the signal collection device, wherein the processing module generates aggregated data by aggregating the physiological data of the plurality of viewers, wherein the processing module provides controlled access to the aggregated data and the media instance.

48. A system comprising:

a plurality of headsets, wherein each headset is worn by a viewer of a plurality of viewers located at a venue, each headset including at least one sensor and a transmitter, wherein the plurality of viewers is watching a media instance, wherein each headset receives physiological data from the corresponding viewer;

a signal collection device located at the venue, the signal collection device receiving the physiological data transmitted by the plurality of headsets and generating aggregated data by aggregating the data from the plurality of viewers and synchronizing the physiological data received from each viewer with the physiological data received from every other viewer; and

a processing module that receives the physiological data from the signal collection device, wherein the processing module generates synchronized data by synchronizing the aggregated data with the media instance.

49. A system comprising:

a plurality of headsets, wherein each headset is worn by a viewer of a plurality of viewers located at a venue, each headset including at least one sensor and a transmitter, wherein the plurality of viewers is watching a media instance, wherein each headset receives physiological data from the corresponding viewer;

a signal collection device coupled to the plurality of headsets; and

a processing module that receives the physiological data from the signal collection device, wherein the processing module generates synchronized data by synchronizing the physiological data from the plurality of viewers, and synchronizing the synchronized data with the media instance.

50. A system comprising:

a plurality of headsets, wherein each headset is worn by a viewer of a plurality of viewers located at a venue, each headset including at least one sensor and a transmitter, wherein the plurality of viewers is watching a media instance, wherein each headset receives physiological data from the corresponding viewer;

a signal collection device located at the venue and receiving the physiological data transmitted by the plurality of headsets via a wireless coupling, wherein the signal collection device removes data from the corresponding physiological data for a time period during which the corresponding viewer is not paying attention to the media instance; and

a processing module that receives the physiological data from the signal collection device, wherein the processing module generates synchronized data by synchronizing the physiological data from the plurality of viewers with the media instance.

51. A system comprising:

a plurality of headsets, wherein each headset is worn by a viewer of a plurality of viewers located at a venue, each headset including at least one sensor and a transmitter, wherein the plurality of viewers is watching a media instance, wherein each headset receives physiological data from the corresponding viewer;

a signal collection device located at the venue and receiving the physiological data transmitted by the plurality of headsets via a wireless coupling; and

a processing module that receives the physiological data from the signal collection device, wherein the processing module removes data from the corresponding physiological data for a time period during which the corresponding viewer is not paying attention to the media instance, wherein the processing module generates synchronized data by synchronizing the physiological data from the plurality of viewers with the media instance.

52. A method comprising:

receiving physiological data from a plurality of viewers via a plurality of headsets worn by each of the plurality of viewers, the plurality of viewers watching a media instance;

receiving the physiological data from the plurality of headsets at a signal collection device, wherein the signal collection device receives the physiological data transmitted by the plurality of headsets; and

receiving the physiological data from the signal collection device at a processing module and deriving from the physiological data a plurality of physiological responses of the plurality of viewers to the media instance.

53. The method of claim 52, comprising synchronizing the physiological data from the plurality of viewers.

54. The method of claim 52, comprising synchronizing the media instance and the physiological data from the plurality of viewers.

55. The method of claim 52, comprising removing data from the corresponding physiological data for a time period during which the corresponding viewer is not paying attention to the media instance.

56. The method of claim 55, comprising interpolating physiological data from the time period when the viewer is paying attention to cover the data that has been removed.

57. The method of claim 52, comprising detecting an anomaly in the physiological data of a viewer using at least one of heart rate, brain waves, EEG signals, blink rate, breathing, motion, muscle movement, and galvanic skin response.

58. The method of claim 52, comprising removing artifacts of the physiological data.

59. The method of claim 52, comprising rating the media instance based on the plurality of physiological responses from the plurality of viewers.

60. The method of claim 52, comprising storing at least one of the physiological data, the plurality of physiological responses, and analysis results of the physiological responses.

61. The method of claim 60, comprising storing at least one of data of the media instance, and results of surveys presented to the plurality of viewers and corresponding to the media instance.

62. The method of claim 52, wherein the physiological data is at least one of heart rate, brain waves, electroencephalogram (EEG) signals, blink rate, breathing, motion, muscle movement, galvanic skin response, and a response correlated with change in emotion.

63. The method of claim 52, wherein receiving physiological data comprises sensing the physiological data using at least one of a physiological sensor, an electroencephalogram (EEG), an accelerometer, a blood oxygen sensor, a galvanometer, an electromygraph, a dry EEG electrode, and a heart rate sensor.

64. The method of claim 52, wherein the plurality of physiological responses includes at least one of liking, thought, adrenaline, engagement, and immersion in the media instance.

65. The method of claim 52, wherein the media instance is at least one of a television program, an advertisement, a movie, printed media, a website, computer application, a video game, live performance, product information, and product content.

66. The method of claim 52, comprising automatically providing a tutorial to the plurality of viewers via a computer, wherein the computer automatically receives and installs the tutorial, wherein the tutorial comprises information relating to watching of the media instance and data collection during the watching.

67. The method of claim 66, comprising automatically instructing the plurality of viewers in use of the headsets.

68. The method of claim 66, comprising automatically determining a data quality of the physiological data.