Method and apparatus for producing communication data, method and apparatus for reproducing communication data, and program storage medium

• US 6,801,663 B2
• Filed: 02/26/2001
• Issued: 10/05/2004
• Est. Priority Date: 02/25/2000
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Rekimoto, Junichi, Ayatsuka, Yuji, Matsushita, Nobuyuki
• Primary Examiner(s): Patel, Jayanti K.
• Application Number:
  US09/793,266
• Publication Number:
  US 20030038884A1
• Time in Patent Office: 1,317 Days
• Field of Search: 382/103, 382/107, 382/232, 382/236, 382/305, 382/235, 382/229, 345/2.2, 345/418, 345/547, 348/14.1, 348/374, 348/402.1, 348/699, 348/700, 379/93.14, 379/93.21, D14/130
• US Class Current: 382/236
• CPC Class Codes: H04N 1/32144 embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
• CPC Class Codes: H04N 1/42 Systems for two-way working , e.g. conference systems H04N1/32 takes precedence
• CPC Class Codes: H04N 2201/0015 Control of image communication with the connected apparatus, e.g. signalling capability
• CPC Class Codes: H04N 2201/0034 Details of the connection, e.g. connector, interface
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 5/781 on disks or drums
• CPC Class Codes: H04N 5/85 on discs or drums

Abstract

Communication data including actually-photographed pictures is provided. The communication data consists of text data such as a sentence input by a user and a plurality of still pictures obtained by taking a picture of the user a plurality of times. Because the communication data includes visual information provided by a picture of a user, the communication data can more stimulate a user who receives the communication data than text-base communication data can. Furthermore, it is possible to represent a motion using a plurality of still pictures thereby transmitting a large amount of information. Because the motion is represented using only a plurality of still pictures, the data size is much smaller than is required to represent a motion using a moving picture.

Claims

1. A communication data producing apparatus for producing communication data including a photographed picture, the communication data producing apparatus comprising:

a sentence inputting unit used by a user to input a sentence;

an imaging unit for taking a picture of the user a plurality of times in a predetermined period of time;

a processing unit for producing communication data including the sentence input via the sentence inputting unit and the plurality of pictures taken by the imaging unit; and

a sentence analyzer for analyzing the sentence input via the sentence inputting unit,

wherein the sentence analyzer extracts a mark comprising one of an exclamation mark, a guestion mark, a face mark, and an escape sequence from the sentence input via the sentence inputting unit and determines a meaning of the sentence based upon the extracted mark in addition to a result of analysis of one of a word and an expression in the sentence.

2. The communication data producing apparatus according to claim 1, wherein in response to an operation performed by the user to input the sentence via the sentence inputting unit, said processing unit starts taking a plurality of pictures using the imaging unit and produces the communication data.

3. The communication data producing apparatus according to claim 1, further comprising an indicator for indicating to the user a timing of the plurality of pictures taken by the imaging unit.

4. The communication data producing apparatus according to claim 1, further comprising:

an image processing unit for processing one of the plurality of pictures taken by the imaging unit, in accordance with the result of analysis performed by the sentence analyzer.

5. The communication data producing apparatus according to claim 1, wherein the sentence inputting unit is capable of inputting either of a mark and an escape sequence indicating a meaning of the sentence.

6. The communication data producing apparatus according to claim 1, further comprising a communication unit for transferring produced communication data outside the communication data producing apparatus.

7. The communication data producing apparatus according to claim 1, further comprising a data storage unit for storing produced communication data.

8. A communication data producing apparatus for producing communication data including a photographed picture, the communication data producing apparatus comprising:

a sentence inputting unit used by a user to input a sentence;

an imaging unit for taking a picture of the user a plurality of times in a predetermined period of time;

a processing unit for producing communication data including the sentence input via the sentence inputting unit and the plurality of pictures taken by the imaging unit;

a sentence analyzer for analyzing the sentence input via the sentence inputting unit; and

an image processing unit for processing one of the plurality of pictures taken by the imaging unit, in accordance with the result of analysis performed by the sentence analyzer,

wherein the image processing unit performs modification comprising at least one of a setting of a background;

an adjustment of lightness, luminance, and contrast;

a superimposing upon a CG image;

a conversion by means of synthesis into a sepia color form, an oil painting like form, a watercolor painting like form, or a mosaic form; and

a positive to negative reversion upon a picture depending on one of a feeling of the user and a purpose of the sentence detected as a result of the sentence analysis performed by the sentence analyzer.

9. A communication data producing apparatus for producing communication data including a photographed picture, the communication data producing apparatus comprising:

a sentence inputting unit used by a user to input a sentence;

an imaging unit for taking a picture of the user a plurality of times in a predetermined period of time;

a processing unit for producing communication data including the sentence input via the sentence inputting unit and the plurality of pictures taken by the imaging unit;

a user location registration unit for registration of a set of location information and a user identifier for each of a plurality of users; and

a driving unit for moving an imaging area of the imaging unit to a specified location,

wherein in response to an operation performed by the user to input the sentence via the sentence inputting unit the processing unit queries the user location registration unit to acquire location information associated with the user and commands the driving unit to move the imaging area of the imaging unit in accordance with the acquired location information, and the processing unit produces communication data including the sentence input via the sentence inputting unit and the plurality of pictures taken by the imaging unit.

10. The communication data producing apparatus according to claim 9, wherein the user location registration unit is connected to a main unit of the communication data producing apparatus via a network.

11. A communication data producing method for producing communication data including a photographed picture, the method comprising the steps of:

inputting a sentence, the sentence being input by a user;

imaging the user by taking a picture of the user a plurality of times in a predetermined period of time;

producing the communication data, including the sentence input in the sentence inputting step and the plurality of pictures taken in the imaging step;

a user location registration step in which a set of location information and a user identifier is registered for each of a plurality of users; and

a driving step in which an imaging area in the imaging step is moved to a specified location,

wherein in the producing step, in response to an operation performed by the user to input the sentence, location information associated with the user is acquired;

the imaging area taken in the imaging step is moved in accordance with the acquired location information; and

communication data including the sentence input by the user and the plurality of pictures taken is produced.

12. The communication data producing method according to claim 11, wherein in the producing step, in response to an operation performed by the user to input the sentence, the imaging step is started to take a plurality of pictures and the communication data is produced.

13. The communication data producing method according to claim 11, wherein in the imaging step, timing of the plurality of pictures is indicated to the user.

14. The communication data producing method according to claim 11, further comprising the steps of:

analyzing the sentence input in the sentence inputting step; and

processing the picture taken in the imaging step in accordance with a result of the analysis performed in the sentence analyzing step.

15. The communication data producing method according to claim 11, wherein in the sentence inputting step one of a mark and an escape sequence indicating a meaning of the input sentence is input.

16. The communication data producing method according to claim 11, further comprising a communication step in which produced communication data is transferred outside.

17. The communication data producing method according to claim 11, further comprising a data storing step in which produced communication data is stored.

18. A communication data producing method for producing communication data including a photographed picture, the method comprising the steps of:

inputting a sentence, the sentence being input by a user;

imaging the user by taking a picture of the user a plurality of times in a predetermined period of time;

producing the communication data, including the sentence input in the sentence inputting step and the plurality of pictures taken in the imaging step;

analyzing the sentence input in the sentence inputting step; and

processing the picture taken in the imaging step in accordance with a result of the analysis performed in the sentence analyzing step,

wherein in the sentence analyzing step, a mark comprising one of an exclamation mark, a question mark, a face mark, and an escape sequence is extracted from the sentence input in the sentence inputting step and a meaning of the sentence is determined based upon the extracted mark in addition to a result of analysis of one of a word and an expression in the input sentence.

19. A communication data producing method for producing communication data including a photographed picture, the method comprising the steps of:

inputting a sentence, the sentence being input by a user;

imaging the user by taking a picture of the user a plurality of times in a predetermined period of time;

producing the communication data, including the sentence input in the sentence inputting step and the plurality of pictures taken in the imaging step;

analyzing the sentence input in the sentence inputting step; and

processing the picture taken in the imaging step in accordance with a result of the analysis performed in the sentence analyzing step,

wherein the picture processing step performs modification comprising at least one of a setting of a background;

an adjustment of lightness, luminance, and contrast;

superimposing upon a CG image;

conversion by means of synthesis into a sepia color form, an oil painting like form, a watercolor painting like form, or a mosaic form; and

positive to negative reversion upon the picture depending one of a feeling of the user and a purpose of the sentence detected as a result of the sentence analysis performed by the sentence analyzer.