Personalized meeting event capture using egocentric tracking in smart spaces
First Claim
1. A system to determine viewer attention to presented content, comprising:
- one or more processors; and
memory storing one or more programs to be executed by the one or more processors, the one or more programs comprising instructions for;
applying first markers to a first set of content to be presented to a plurality of viewers, wherein each of the first markers includes first metadata that identifies at least a content ID associated with the first set of content and a respective presentation unit of a presentation;
displaying the presentation on the presentation unit to the plurality of viewers with the applied first markers;
receiving head orientation information from a body mounted camera worn by a first viewer of a plurality of viewers and determining from the head orientation information a sequence of head orientations of the first viewer and associating each of the sequence of head orientations with an identifier associated with the first viewer and a corresponding sequence of first time stamps;
receiving a sequence of images captured by the body mounted camera worn by the first viewer, wherein the sequence of images are of in-room visuals/information presented to and viewable by the first viewer, and to associate the sequence of images with an identifier associated with the first viewer and the body mounted camera and a corresponding sequence of second time stamps;
storing and associating respective members of the sequence of images and the sequence of head orientations;
identifying presentation content by evaluating the metadata of a marker in the captured sequence of images; and
measuring viewing activities of the first viewer, wherein the viewing activity measurements include when the first viewer is or is not attending to the displayed content.
2 Assignments
0 Petitions
Accused Products
Abstract
A system to determine viewer attention to presented content. Markers are applied to a presentation. Head orientation information is received from a body mounted camera worn by a viewer and is used to determine a sequence of head orientations of the viewer. The sequence of head orientations is associated with an identifier of the viewer and a corresponding sequence of first time stamps. A sequence of images is captured by the body mounted camera worn by the viewer. The sequence of images is associated with an identifier of the viewer and the body mounted camera and a corresponding sequence of second time stamps. Respective members of the sequences of images and head orientations are associated, and the presentation content is identified by evaluating information from visible markers in the captured sequence of images. Viewer attention to different elements can then be determined.
14 Citations
20 Claims
-
1. A system to determine viewer attention to presented content, comprising:
-
one or more processors; and memory storing one or more programs to be executed by the one or more processors, the one or more programs comprising instructions for; applying first markers to a first set of content to be presented to a plurality of viewers, wherein each of the first markers includes first metadata that identifies at least a content ID associated with the first set of content and a respective presentation unit of a presentation; displaying the presentation on the presentation unit to the plurality of viewers with the applied first markers; receiving head orientation information from a body mounted camera worn by a first viewer of a plurality of viewers and determining from the head orientation information a sequence of head orientations of the first viewer and associating each of the sequence of head orientations with an identifier associated with the first viewer and a corresponding sequence of first time stamps; receiving a sequence of images captured by the body mounted camera worn by the first viewer, wherein the sequence of images are of in-room visuals/information presented to and viewable by the first viewer, and to associate the sequence of images with an identifier associated with the first viewer and the body mounted camera and a corresponding sequence of second time stamps; storing and associating respective members of the sequence of images and the sequence of head orientations; identifying presentation content by evaluating the metadata of a marker in the captured sequence of images; and measuring viewing activities of the first viewer, wherein the viewing activity measurements include when the first viewer is or is not attending to the displayed content. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method to determine viewer attention to presented content, comprising:
at a computer system with a processor and a memory; applying first markers to a first set of content to be presented to a plurality of viewers, wherein each of the first markers includes first metadata that identifies at least a content ID associated with the first set of content and a respective presentation unit of a presentation; displaying the presentation on the presentation unit to the plurality of viewers with the applied first markers; receiving head orientation information from a body mounted camera worn by a first viewer of a plurality of viewers and determining from the head orientation information a sequence of head orientations of the first viewer and associating each of the sequence of head orientations with an identifier associated with the first viewer and a corresponding sequence of first time stamps; receiving a sequence of images captured by the body mounted camera worn by the first viewer, wherein the sequence of images are of in-room visuals/information presented to and viewable by the first viewer, and to associate the sequence of images with an identifier associated with the first viewer and the body mounted camera and a corresponding sequence of second time stamps; storing and associating respective members of the sequence of images and the sequence of head orientations; identifying presentation content by evaluating the metadata of a marker in the captured sequence of images; and measuring viewing activities of the first viewer, wherein the viewing activity measurements include when the first viewer is or is not attending to the displayed content. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19)
-
20. A non-transitory computer readable storage medium storing one or more programs to be executed by a computer system with memory, and one or more processors, the one or more programs comprising:
-
instructions for applying first markers to a first set of content to be presented to a plurality of viewers, wherein each of the first markers includes first metadata that identifies at least a content ID associated with the first set of content and a respective presentation unit of a presentation; instructions for displaying the presentation on the presentation unit to the plurality of viewers with the applied first markers; instructions for receiving head orientation information from a body mounted camera worn by a first viewer of a plurality of viewers and determining from the head orientation information a sequence of head orientations of the first viewer and associating each of the sequence of head orientations with an identifier associated with the first viewer and a corresponding sequence of first time stamps; instructions for receiving a sequence of images captured by the body mounted camera worn by the first viewer, wherein the sequence of images are of in-room visuals/information presented to and viewable by the first viewer, and to associate the sequence of images with an identifier associated with the first viewer and the body mounted camera and a corresponding sequence of second time stamps; instructions for storing and associating respective members of the sequence of images and the sequence of head orientations; instructions for identifying presentation content by evaluating the metadata of a marker in the captured sequence of images; and instructions for measuring viewing activities of the first viewer, wherein the viewing activity measurements include when the first viewer is or is not attending to the displayed content.
-
Specification