Methods and apparatus to detect user attentiveness to handheld computing devices

• US 9,485,534 B2
• Filed: 09/24/2014
• Issued: 11/01/2016
• Est. Priority Date: 04/16/2012
• Status: Active Grant

• Current Assignee: The Nielsen Company LLC (MOOD Media Corporation)
• Original Assignee: The Nielsen Company LLC (MOOD Media Corporation)
• Inventors: Besehanic, Jan
• Primary Examiner(s): Trab, Hai V
• Assistant Examiner(s): Nguyen, Tien M
• Application Number:
  US14/495,323
• Publication Number:
  US 20150012927A1
• Time in Patent Office: 769 Days
• US Class Current: 1/1
• CPC Class Codes: G06Q 30/0272 Period of advertisement exposure
• CPC Class Codes: H04H 60/32 Arrangements for monitoring conditions of receiving stations, e.g. malfunction or breakdown of receiving stations
• CPC Class Codes: H04H 60/33 Arrangements for monitoring the users' behaviour or opinions
• CPC Class Codes: H04N 21/4126 The peripheral being portable, e.g. PDAs or mobile phones
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/6175 involving transmission via Internet broadcast-related systems characterised by the transmission system being the Internet H04H60/82

Abstract

Methods and apparatus to detect user attentiveness to handheld computing devices are disclosed. An example handheld computing device includes a detector to detect an orientation of the handheld computing and a distance between the handheld computing device and a user; an index associating a plurality of spatial combinations with respective levels of user attentiveness to a presentation on the handheld computing device; and a comparator to compare the orientation and the distance between the handheld computing device and the user to the spatial combinations to identify a level of attentiveness of the user.

Claims

1. A method, comprising:

obtaining data from an orientation sensor and a position sensor with an attentiveness detector in a handheld computing device;

determining an orientation change of the handheld computing device from a starting orientation to an ending orientation based on the data, the starting orientation and the ending orientation being angular orientations relative to a first reference orientation as determined by an orientation detector;

determining a position change of the handheld computing device from a starting position to an ending position based on the data, wherein the position change occurs at a same time as the orientation change, the starting position and the ending positions being positions relative to a user;

querying, via a logic circuit, an index associating a plurality of spatial condition change combinations with respective likelihoods indicative of user attentiveness to a presentation on the handheld computing device to determine if the index includes an entry having both the determined-orientation change and the determined relative position change; and

determining a likelihood of attentiveness of the user to the presentation based on the entry.

2. The method as defined in claim 1, wherein the starting position and the ending position are distances between the handheld computing device and the user.

3. The method as defined in claim 1, wherein the starting orientation and the ending orientation are at least one of a horizontal orientation or a vertical orientation.

4. The method as defined in claim 1, wherein a first plurality of the likelihoods includes respective engagement likelihoods representing how likely a particular orientation change occurring with a particular position change is to correspond to the user paying attention to the presentation on the handheld computing device.

5. The method as defined in claim 1, wherein a first plurality of the likelihoods includes respective engagement likelihoods representing how likely a particular orientation change occurring with a particular position change is to correspond to the user beginning to pay attention to the presentation on the handheld computing device.

6. The method as defined in claim 1, wherein a first plurality of the likelihoods includes respective disengagement likelihoods representing how likely a particular orientation change occurring with a particular position change is to correspond to the user not paying attention to the presentation on the handheld computing device.

7. The method as defined in claim 1, wherein a first plurality of the likelihoods includes respective disengagement likelihoods representing how likely a particular orientation change occurring with a particular position change is to correspond to the user beginning to not pay attention to the presentation on the handheld computing device.

15. The device as defined in claim 1, wherein the orientation change is a horizontal orientation or a vertical orientation change relative to the user.

16. The device as defined in claim 1, wherein the likelihoods respectively represent how likely a particular orientation change coinciding with a particular distance change between the handheld computing device and the user corresponds to the user paying attention to the presentation on the handheld computing device.

17. The device as defined in claim 1, wherein the likelihoods respectively represent how likely a particular orientation change coinciding with a particular distance change between the handheld computing device and the user corresponds to the user beginning to pay attention to the presentation on the handheld computing device.

18. The device as defined in claim 1, wherein the likelihoods respectively represent how likely a particular orientation change coinciding with a particular distance change between the handheld computing device and the user corresponds to the user not paying attention to the presentation on the handheld computing device.

19. The device as defined in claim 1, wherein the likelihoods respectively represent how likely a particular orientation change coinciding with a particular distance change between the handheld computing device and the user corresponds to the user beginning to not pay attention to the presentation on the handheld computing device.

8. A tangible computer readable storage medium comprising instructions that, when executed, cause a processor to at least:

obtain data from an orientation sensor and a position sensor in a handheld computing device;

determine an orientation change of the handheld computing device from a starting orientation to an ending orientation based on the data, the starting orientation and the ending orientation being angular orientations relative to a reference position orientation;

determine a position change of the handheld computing device from a starting position to an ending position based on the data, the position change occurring at a same time as the orientation change, the starting position and the ending positions being distances between the handheld computing device and a user;

reference an index associating a plurality of spatial condition change combinations with respective likelihoods indicative of user attentiveness to a presentation on the handheld computing device to identify an entry having both the determined orientation change and the determined position change; and

determine a likelihood of attentiveness of the user to the presentation based on the entry.

9. The computer readable storage medium as defined in claim 8, wherein the starting orientation and the ending orientation are at least one of a horizontal orientation or a vertical orientation.

10. The computer readable storage medium as defined in claim 8, wherein a first plurality of the likelihoods includes respective engagement likelihoods representing how likely a particular orientation change occurring with a particular position change is to correspond to the user paying attention to the presentation on the handheld computing device.

11. The computer readable storage medium as defined in claim 8, wherein a first plurality of the likelihoods includes respective engagement likelihoods representing how likely a particular orientation change occurring with a particular position change is to correspond to the user beginning to pay attention to the presentation on the handheld computing device.

12. The computer readable storage medium as defined in claim 8, wherein a first plurality of the likelihoods includes respective disengagement likelihoods representing how likely a particular orientation change occurring with a particular position change is to correspond to the user not paying attention to the presentation on the handheld computing device.

13. The computer readable storage medium as defined in claim 8, wherein a first plurality of the likelihoods includes respective disengagement likelihoods representing how likely a particular orientation change occurring with a particular position change is to correspond to the user beginning to not pay attention to the presentation on the handheld computing device.

14. A handheld computing device, comprising:

a detector to detect an orientation change of the handheld computing device and a distance change between the handheld computing device and a user;

an index associating a plurality of spatial combinations having both orientation change and distance change with respective levels of user attentiveness to a presentation on the handheld computing device; and

a comparator to compare the orientation change and the distance change between the handheld computing device and the user to the spatial combinations to identify a level of attentiveness of the user.