DISPLAY CONTROL METHOD AND DEVICE

• US 20170269683A1
• Filed: 03/13/2017
• Published: 09/21/2017
• Est. Priority Date: 03/17/2016
• Status: Abandoned Application

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: SEGAWA, Takafumi, AOYAMA, Takeyoshi, FUJIWARA, SUSUMU, FUJII, Yukinobu
• Application Number:
  US15/456,645
• Publication Number:
  US 20170269683A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06Q 30/0261 based on user location
• CPC Class Codes: G06Q 30/0272 Period of advertisement exposure

Abstract

A computer-implemented method includes receiving a request from a user for a first product via a terminal installed on a place, allocating identification information to the user, tracking a user movement of the user during a time period between when the request is received and when the first product is provided to the user, identifying a second product that interests the user based on the tracked user movement, a plurality of product including the second product being presented to the user during the time period, associating the second product that interest the user with the identification information, and controlling a display device to display information regarding the second product, the display device being allocated to the identification information of the user.

Claims

1. A computer-implemented method executed by a processor, the computer-implemented method comprising:

receiving a request from a user for a first product via a terminal installed on a place;

allocating identification information to the user;

tracking a user movement of the user during a time period between when the request is received and when the first product is provided to the user;

identifying a second product that interests the user based on the tracked user movement, a plurality of product including the second product being presented to the user during the time period;

associating the second product that interest the user with the identification information; and

controlling a display device to display information regarding the second product, the display device being allocated to the identification information of the user.

2. The computer-implemented method according to claim 1, wherein the identification information indicates a user order within a queue of users in the place.

3. The computer-implemented method according to claim 1, further comprising:

acquiring an image of the user when the request for the first product is received; and

creating an reception data entry within a reception data table associating the identification information, the image of the user, and the first product.

4. The computer-implemented method according to claim 3, wherein the tracking of the user movement is executed using the image of the user.

5. The computer-implemented method according to claim 4, further comprising:

acquiring another image of a second user when it is determined that the second user is interested in the second product;

creating an interest data table including the information of the second product and the other image of the second user;

comparing the image of the user to the other image of the second user; and

creating notification data when it is determined that the user in the image matches the second user in the another image, the notification data including the identification information, image of the user, information of the first product, and information of the second product.

6. The computer-implemented method according to claim 5, wherein

the plurality of products is displayed on an advertising device, and

the notification data links interest in the second product to advertising displayed on the advertising device during the time period.

7. The computer-implemented method according to claim 4, wherein

the tracking of the user movement includes:

tracking head positions of the user during the time period using the image of the user and other images captured by at least one of cameras, and

determining whether the user travels into an area of interest of an advertising device which presents a plurality of contents corresponding to the plurality of products based on the tracked head positions, and

the identifying of the second product that interests the user includes;

determining the user stays within the area of interest for a retention period and that a content, from among the plurality of contents, displayed on the advertising device does not change during the retention period, and

identifying the content displayed on the advertising device during the retention period in which the user remained in the area of interest as the second product that interests the user.

8. The computer-implemented method according to claim 1, wherein

the tracking of the user movement includes:

capturing images of an eye of the user, and

determining, based on the images, sight line positions on a screen of an advertising device which presents a plurality of contents corresponding to the plurality of products, and

the identifying of the second product that interests the user includes;

determining whether the sight line positions corresponds to a target area on the advertising device for a duration equal to a retention period, and

identifying content, from among the plurality of contents, associated with the target area as the second product that interests the user when the determining determines the sight line positions correspond to the target area for the duration equal to the retention period.

9. The computer-implemented method according to claim 1, wherein each of the first product and the second product include physical products, services or a combination of products and services provided by a business.

10. A system comprising:

a first device installed on a place and including first circuitry configured to;

receive a request for a product or service from a user who check-in the place and has to wait to receive the product or service, and

allocate identification information to the user; and

a second device including second circuitry configured to;

track line-of-sights of the user to a plurality of content to be provided to the user at the place during a waiting time for the product or service,

identify a content that the user is interested n based on the tracked line-of sights, the content being from among the plurality of contents,

associate the identification information and the identified content, and

control a display device to display information regarding the content when the user receive the product or service, the display device being allocated to the identification information of the user.

11. A system comprising:

a first device including;

a first image sensor configured to capture a first image including a face of a first user, and

a first processor configured to;

generate identification information that identifies the first user included in the image, and

transmit first data including the identification information and the first image to a third device;

a second device including;

a second image sensor configured to capture a plurality of second images including a face of a second user,

a second display device configured to display a plurality of pieces of content, and

a second processor configured to;

track a sight line position of the second user based on the plurality of second images,

determine a content to be associated with the second user, from among the plurality of contents, based on a tracking result of the sight line position, and

transmit the content and second data including at least one of second images from among the plurality of second images to the third device;

the third device including;

a memory configured to store the first data and the second data, and

a third processor configured to;

when the first data and the, second data are received, compare the first image included in the first data, and at least one of the second images included in the second data,

determine whether to associate the identification information identifying the first user and the content associated with the second user based on a comparison result, and

when it is determined that the identification information is associated with the content, transmit the identification information and third data including the content to a fourth device as information regarding the first user associated with the identification information; and

the fourth device including;

a fourth display device configured to display information of the content, and

a fourth processor configured to;

obtain the content from the third data, and

display the content on the fourth display device.

12. The system according to claim 11, wherein

the first processor in the first device is configured to:

obtain service information indicating a service input from the first user, and

transmit the first data further including the service information to the third device,

the third processor in the third device is configured to;

when it is determined that the identification information is associated with the content, transmit the third data further including the service information included in the first data to the fourth device, and

the fourth processor in the fourth device is configured to;

display the service information with the content to the fourth display device,

13. The system according to claim 11, wherein

the second device includes a second display device,

the second display device is configured to display the plurality pieces of content at first time intervals, and

the second processor in the second device is configured to;

detect that the sight line position of the second user is retained on the second display device for a predetermined time or more, and

associate the content displayed on the second display device out of the plurality pieces of content at a point in time when the retention of the sight line position is detected with the second user.

14. The system according to claim 13, wherein

the second processor in the second device is configured to;

when the retention of the sight line position is detected, perform control to display the content on the second display device at second time intervals, and

the second time intervals is longer than the first time intervals.

15. The system according to claim 11, wherein the identification number is a number indicating a user order within a queue of users in a place having the first device.

16. The system according to claim 15, wherein the fourth device is operated as an operator at the place.

17. The system according to claim 16, wherein the fourth display displays the content as a product that interests the first user to the operator in charge of the first user.