Display control system and recording medium for displaying a guide image

• US 10,204,293 B2
• Filed: 08/12/2016
• Issued: 02/12/2019
• Est. Priority Date: 12/21/2012
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Watanabe, Kazuhiro, Sako, Yoichiro, Tange, Akira, Sakoda, Kazuyuki, Asada, Kohei, Nakamura, Takatoshi, Takehara, Mitsuru, Kamada, Yasunori, Kon, Takayasu, Hayashi, Kazunori, Hanaya, Hiroyuki, Koga, Yuki, Onuma, Tomoya
• Primary Examiner(s): Pringle-Parker, Jason
• Application Number:
  US15/235,406
• Publication Number:
  US 20160350621A1
• Time in Patent Office: 914 Days
• Field of Search: None
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/60 Analysis of geometric attributes
• CPC Class Codes: G06V 40/113 Recognition of static hand signs
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation
• CPC Class Codes: G06V 40/25 Recognition of walking or running movements, e.g. gait recognition
• CPC Class Codes: H04N 9/3185 Geometric adjustment, e.g. keystone or convergence optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14

Abstract

There is provided a display control system including a plurality of display units, an imaging unit configured to capture a subject, a predictor configured to predict an action of the subject according to a captured image captured by the imaging unit, a guide image generator configured to generate a guide image that guides the subject according to a prediction result from the predictor, and a display controller configured to, on the basis of the prediction result from the predictor, select a display unit capable of displaying an image at a position corresponding to the subject from the plurality of display units, and to control the selected display unit to display the guide image at the position corresponding to the subject.

Claims

1. A display control system comprising:

a processing device and a memory including instructions which, when executed by the processing device, control;

displaying, in front of a same subject, a plurality of guide images simultaneously and arranged together with each other, in which the plurality of guide images indicates a plurality of different first goals displayed extending from the front of the same subject to guide the same subject to the respective first goals;

acquiring, as an action history information, a recognized reaction of the same subject selecting one displayed guide image of the plurality of the simultaneously displayed guide images, based on a determination whether a captured image indicates a predetermined action by the same subject with respect to the one displayed guide image; and

displaying, in front of the same subject, at least one updated guide image indicating at least one second goal displayed extending from the front of the same subject to guide the same subject to the at least one second goal, in which the at least one second goal is different from each goal of the one displayed guide image, so as to provide an interactive guide arrangement which enables a given goal to be changed based on the recognized reaction of the subject, in which a number of goals displayed as the at least one second goal is less than a number of goals displayed as the plurality of different first goals.

2. The display control system according to claim 1, wherein the instructions, when executed by the processing device, control capturing an image of the same subject.

3. The display control system according to claim 1, wherein the instructions, when executed by the processing device, control display of a first guide image at a position according to a physical characteristic of the same subject.

4. The display control system according to claim 1, wherein the instructions, when executed by the processing device, control display of a first guide image configured according to a physical characteristic of the same subject.

5. The display control system according to claim 4, wherein the physical characteristic of the subject is a height of the same subject, and

the instructions, when executed by the processing device, control displaying a large guide image in proportion to the height of the same subject.

6. The display control system according to claim 4, wherein

the physical characteristic of the same subject is a height of the same subject, and

the instructions, when executed by the processing device, control display of the first guide image at a position distanced in proportion to the height of the same subject.

7. The display control system according to claim 1, wherein the instructions, when executed by the processing device, control display of a first guide image at a position distanced in proportion to a movement speed of the same subject.

8. The display control system according to claim 1, wherein the instructions, when executed by the processing device, in a case in which another person is present near the same subject, control display of a first guide image for the subject distinguishably from another guide image displayed for the other person.

9. The display control system according to claim 1, wherein the instructions, when executed by the processing device, control display of a first guide image including a guide display to a goal of the same subject indicated by a prediction result.

10. The display control system according to claim 1, wherein the instructions, when executed by the processing device, control learning an action pattern of the same subject from the action history information and predicting a reaction of the same subject based on the action pattern.

11. The display control system according to claim 10, wherein the instructions, when executed by the processing device, control display of a first guide image including a display suggesting an action to the same subject according to a prediction reaction based on the action pattern.

12. The display control system according to claim 1, wherein the recognized reaction of the same subject is based on walking of the same subject.

13. The display control system according to claim 1, wherein the recognized reaction of the same subject is based on stopping of the same subject.

14. The display control system according to claim 1, wherein the recognized reaction of the same subject is based on a hand gesture of the same subject.

15. The display control system according to claim 1, wherein the recognized reaction of the same subject is based on a path selection of the same subject.

16. The display control system according to claim 1,

wherein the number of goals displayed as the plurality of first goals is two and the number of goals displayed as the at least one second goal is one.

17. The display control system according to claim 1,

wherein a number of goals displayed by the selected one displayed guide image is at least two.

18. A display control method comprising:

controlling displaying, in front of a same subject, a plurality of guide images simultaneously and arranged together with each other, in which the plurality of guide images indicates a plurality of different first goals displayed extending from the front of the same subject to guide the subject to the respective first goals;

controlling acquiring, as an action history information, a recognized reaction of the same subject selecting one displayed guide image of the plurality of the simultaneously displayed guide images, based on determination whether a captured image indicates a predetermined action by the same subject with respect to the one displayed guide image; and

controlling displaying, in front of the same subject, at least one updated guide image indicating at least one second goal displayed extending from the front of the same subject to guide the same subject to the at least one second goal, in which the at least one second goal is different from each of the one displayed guide image, so as to provide an interactive guide arrangement which enables a given goal to be changed based on the recognized reaction of the subject, in which a number of goals displayed as the at least one second goal is less than a number of goals displayed as the plurality of different first goals.

19. A non-transitory computer-readable recording medium configured to store a program, the program causing a computer to execute:

controlling displaying, in front of a same subject, a plurality of guide images simultaneously and arranged together with each other, in which the plurality of guide images indicates a plurality of different first goals displayed extending from the front of the same subject to guide the same subject to the respective first goals;

acquiring, as an action history information, a recognized reaction of the same subject selecting one displayed guide image of the plurality of the simultaneously displayed guide images based on a determination whether a captured image indicates a predetermined action by the same subject with respect to the one displayed guide image; and

controlling displaying, in front of the same subject, at least one updated guide image indicating at least one second goal displayed extending from the front of the same subject to guide the same subject to the at least one second goal, in which the at least one second goal is different from each goal of the one displayed guide image, so as to provide an interactive guide arrangement which enables a given goal to be changed based on the recognized reaction of the subject, in which a number of goals displayed as the at least one second goal is less than a number of goals displayed as the plurality of different first goals.