Display control apparatus and method for estimating attribute of a user based on the speed of an input gesture

• US 10,133,481 B2
• Filed: 03/10/2016
• Issued: 11/20/2018
• Est. Priority Date: 01/15/2013
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Sako, Yoichiro, Takehara, Mitsuru, Sakoda, Kazuyuki, Watanabe, Kazuhiro, Nakamura, Takatoshi, Asada, Kohei, Hayashi, Kazunori, Kamada, Yasunori, Kon, Takayasu, Tange, Akira, Hanaya, Hiroyuki, Onuma, Tomoya, Koga, Yuki
• Primary Examiner(s): Lee, Larry
• Application Number:
  US15/066,887
• Publication Number:
  US 20160196061A1
• Time in Patent Office: 985 Days
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06V 40/107 Static hand or arm
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/178 estimating age from face image; using age information for improving recognition
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G10L 25/51 for comparison or discrimination
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18

Abstract

A display control apparatus comprising circuitry configured to obtain information of an input speed of a gesture input of at least one user from a sensor configured to detect a hand of the user, estimate an attribute of the user based on the input speed, control a display apparatus to display a layout image for the gesture input based on the estimated attribute of the user.

Claims

1. A display control apparatus, comprising:

circuitry configured to;

obtain information, of an input speed of a gesture input of at least one user of a plurality of users, from a sensor that detects a hand of the at least one user;

estimate an attribute of the at least one user based on the input speed; and

control a display screen to display a layout image for the gesture input based on the estimated attribute of the at least one user.

2. The display control apparatus according to claim 1, wherein the circuitry is further configured to:

estimate, based on the input speed, a level of familiarity that the at least one user has with the display control apparatus as the attribute of the at least one user; and

change an image included in the layout image based on the level of familiarity.

3. The display control apparatus according to claim 1, wherein the estimated attribute of the at least one user indicates age or age range of the at least one user.

4. The display control apparatus according to claim 3, wherein the circuitry is configured to estimate the age or age range of the at least one user based on content of the gesture input, a name, or a facial image of the at least one user.

5. The display control apparatus according to claim 1, wherein the estimated attribute indicates race or nationality of the at least one user.

6. The display control apparatus according to claim 1, wherein the estimated attribute of the at least one user indicates eyesight.

7. The display control apparatus according to claim 1,

wherein the circuitry is configured to detect information for estimating the attribute of the at least one user,

wherein the circuitry is configured to estimate the attribute of the at least one user based on the detected information.

8. The display control apparatus according to claim 1, wherein the circuitry is configured to display a software keyboard in the layout image based on the input speed.

9. The display control apparatus according to claim 8, wherein the circuitry is configured to set a key layout on the displayed software keyboard based on the input speed.

10. The display control apparatus according to claim 9, wherein setting the software keyboard includes a language setting of the key layout of the software keyboard.

11. The display control apparatus according to claim 1, wherein the layout image is displayed on a display screen connected to the display control apparatus.

12. The display control apparatus according to claim 1, wherein the circuitry is further configured to:

obtain a first image of the at least one user, wherein the first image includes a facial image of the at least one user; and

estimate the attribute based on the input speed and the first image.

13. The display control apparatus according to claim 1, further comprising:

a camera configured to capture a first image of the at least one user,

wherein the circuitry is further configured to estimate the attribute based on the input speed and the first image.

14. The display control apparatus according to claim 13, wherein the circuitry is further configured to, based on the first image that includes the plurality of users, estimate the attribute of each of the plurality of users to set a competition game mode.

15. The display control apparatus according to claim 1, further comprising a terminal configured to receive the gesture input.

16. The display control apparatus according to claim 1, wherein the circuitry is configured to output a thread corresponding to the attribute to show information input by the at least one user.

17. A non-transitory computer-readable storage medium having stored thereon, computer-executable instructions for causing a computer to execute operations, the operations comprising:

obtaining information of an input speed of a gesture input of at least one user of a plurality of users from a sensor that detects a hand of the at least one user;

estimating an attribute of the at least one user based on the input speed; and

controlling a display screen to display a layout image for the gesture input based on the estimated attribute of the at least one user.

18. The non-transitory computer-readable storage medium according to claim 17,

wherein the estimated attribute indicates a level of familiarity that the at least one user has with the display control apparatus, and

wherein the operations further comprising changing an image included in the layout image based on the level of familiarity.

19. The non-transitory computer-readable storage medium according to claim 17, wherein the operations further comprising receiving an input to the layout image.

20. A display control method, comprising

obtaining information associated with an input speed of a gesture input of at least one user of a plurality of users from a sensor that detects a hand of at least one user;

estimating an attribute of the at least one user based on the input speed; and

controlling a display screen to display a layout image for the gesture input based on the estimated attribute of the at least one user.