INFORMATION PROCESSING DEVICE, DATA PROCESSING METHOD THEREOF, AND PROGRAM

• US 20150181126A1
• Filed: 07/19/2013
• Published: 06/25/2015
• Est. Priority Date: 07/24/2012
• Status: Active Grant

• Current Assignee: NEC Corporation
• Original Assignee: NEC Corporation
• Inventors: Harada, Hiroo
• Granted Patent: US 9,491,368 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/7837 using objects detected or recognised in the video content
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: G06F 3/002 Specific input/output arrangements not covered by G06F3/01 - G06F3/16 other optical apparatus G02B27/00
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06Q 30/00 Commerce
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06T 3/14 Transformations for image registration, e.g. adjusting or mapping for alignment of images
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/68 Food, e.g. fruit or vegetables
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof

Abstract

This information processing device (100) comprises: a video data acquisition unit (102) that sequentially acquires video data resulting from a portion of an imaging subject being imaged by an imaging unit; an image recognition unit (104) that detects that a portion of a pre-registered image is included in the video data, and recognizes the images therein; an appended data extraction unit (108) that extracts the respective appended data of each image from an appended data storage unit (106) that stores appended data corresponding to each of a plurality of recognized images; an appended data display unit (110) that displays the extracted appended data of each image at each relevant image position of the video data; and a display control unit (112) that, in accordance with a user operation, switches from a process that successively displays a synthesized video, which is on the basis of synthesized video data, at the display unit of a portable terminal, to a process that, as a still image at the display unit of the portable terminal, fixedly displays the synthesized video at the point in time corresponding to the user operation.

Claims

1. An information processing device comprising:

a video data acquirer that sequentially acquires video data which is picked up by an imager and which contains at least a part of imaging subject where a plurality of items are presented on display;

an image recognizer which detects that at least a part of a pre-registered image is contained in the video data, and which recognizes the images therein;

an appended data extractor that extracts, from an appended data storage which stores appended data corresponding to each of the plurality of images recognized by the image recognizer, the appended data of each image;

an appended data display that displays the appended data of each image extracted by the appended data extractor at each relevant image position of the video data; and

a display controller that switches, in response to a user operation, a process from a process of successively displaying, on a display of a mobile terminal, a synthesized video based on synthesized video data sequentially acquired by the appended data display to a process of fixedly displaying, as a still image, the synthesized video at a time point corresponding to the user operation.

2. The information processing device according to claim 1, wherein the display controller changes, in response to a user operation given to the appended data in the fixedly displayed synthesized video, a display form of the appended data subjected to the user operation in the fixedly displayed synthesized video.

3. The information processing device according to claim 1, further comprising a data transmitter that transmits data on an image selected through a user operation among images displayed on the display of the mobile terminal.

4. The information processing device according to claim 1, wherein at least a part of the video data acquirer, the image recognizer, the appended data extractor or the appended data display suspends an operation thereof while the display controller maintains the fixed display.

5. The information processing device according to claim 1, wherein the appended data includes recommendation information, discount information, coupon information, allergy information, evaluation information, or option-service information all related to the image.

6. The information processing device according to claim 1, wherein the information processing device comprises the mobile terminal or a server device communicable therewith.

7. A data processing method of an information processing device, the method causing the information processing device to:

sequentially acquire video data which is picked up by an imager and which contains at least a part of imaging subject where a plurality of items are presented on display;

detect that at least a part of a pre-registered image is contained in the video data, and recognize the images therein;

extract, from an appended data storage which stores appended data corresponding to each of the plurality of recognized images, the appended data of each image;

display the appended data of each extracted image at each relevant image position of the video data; and

switch, in response to a user operation, a process from a process of successively displaying, on a display of a mobile terminal, a synthesized video based on sequentially acquired synthesized video data to a process of fixedly displaying, as a still image, the synthesized video at a time point corresponding to the user operation.

8. A non-transitory computer readable medium program that causes a computer serving as an information processing device storing a program for causing a computer to execute a process to:

sequentially acquire video data which is picked up by an imager and which contains at least a part of imaging subject where a plurality of items are presented on display;

detect that at least a part of a pre-registered image is contained in the video data, and recognize the images therein;

extract, from an appended data storage which stores appended data corresponding to each of the plurality of recognized images, the appended data of each image;

display the extracted appended data of each image extracted at each relevant image position of the video data; and

switch, in response to a user operation, a process from a process of successively displaying, on a display of a mobile terminal, a synthesized video based on sequentially acquired synthesized video data to a process of fixedly displaying, as a still image, the synthesized video at a time point corresponding to the user operation.