Method and apparatus for producing communication data, method and apparatus for reproducing communication data, and program storage medium

• US 20030038884A1
• Filed: 02/26/2001
• Published: 02/27/2003
• Est. Priority Date: 02/25/2000
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Rekimoto, Junichi, Ayatsuka, Yuji, Matsushita, Nobuyuki
• Granted Patent: US 6,801,663 B2
• Time in Patent Office: Days
• US Class Current: 348/211.5
• CPC Class Codes: H04N 1/32144 embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
• CPC Class Codes: H04N 1/42 Systems for two-way working , e.g. conference systems H04N1/32 takes precedence
• CPC Class Codes: H04N 2201/0015 Control of image communication with the connected apparatus, e.g. signalling capability
• CPC Class Codes: H04N 2201/0034 Details of the connection, e.g. connector, interface
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 5/781 on disks or drums
• CPC Class Codes: H04N 5/85 on discs or drums

Abstract

Communication data including actually-photographed pictures is provided. The communication data consists of text data such as a sentence input by a user and a plurality of still pictures obtained by taking a picture of the user a plurality of times. Because the communication data includes visual information provided by a picture of a user, the communication data can more stimulate a user who receives the communication data than text-base communication data can. Furthermore, it is possible to represent a motion using a plurality of still pictures thereby transmitting a large amount of information. Because the motion is represented using only a plurality of still pictures, the data size is much smaller than is required to represent a motion using a moving picture.

Claims

1. A communication data producing apparatus for producing communication data including an actually-photographed picture, said communication data producing apparatus comprising:

a sentence inputting unit used by a user to input a sentence or a statement;

an imaging unit for taking a picture of the user a plurality of times in a predetermined period of time; and

a processing unit for producing communication data including the sentence or the statement input via said sentence inputting unit and the plurality of pictures taken by said imaging unit.

2. A communication data producing apparatus according to claim 1, wherein in response to an operation performed by the user to input a sentence or a statement via the sentence inputting unit, said processing unit starts taking a plurality of pictures using the imaging unit and produces communication data.

3. A communication data producing apparatus according to claim 1, further comprising an indicator for indicating to the user the timings of the respective pictures taken by said imaging unit.

4. A communication data producing apparatus according to claim 1, further comprising:

a sentence analyzer for analyzing the sentence input via the sentence inputting unit; and

an image processing unit for processing a picture taken by said imaging unit, in accordance with the result of analysis performed by said sentence analyzer.

5. A communication data producing apparatus according to claim 1, wherein, said sentence analyzer extracts a mark such as an exclamation mark, a question mark and a face mark or an escape sequence from the sentence input via said sentence inputting unit and determines the meaning or content of the sentence on the basis of the extracted mark in addition to a result of analysis of a word or an expression in the input sentence.

6. A communication data producing apparatus according to claim 4, wherein said image processing unit performs synthesis and/or modification, such as setting of a background, adjustment of lightness, luminance, and contrast, superimposing upon a CG image, conversion by means of synthesis into a sepia-color form, oil-painting-like form, watercolor-painting-like form, or mosaic form, and/or positive-to-negative reversion, upon a picture depending upon a feeling of a user or the purpose of a sentence detected as a result of the sentence analysis performed by said sentence analyzer.

7. A communication data producing apparatus according to claim 1, wherein said sentence inputting unit is capable of inputting a mark or an escape sequence indicating the meaning or intention of the input sentence.

8. A communication data producing apparatus according to claim 1, further comprising a communication unit for transferring produced communication data to the outside of said communication data producing apparatus.

9. A communication data producing apparatus according to claim 1, wherein further comprising a data storage unit for storing produced communication data.

10. A communication data producing apparatus according to claim 1, further comprising:

a user location registration unit for registration of a set of location information and a user identifier for each of a plurality of users; and

a driving unit for moving an imaging area of said imaging unit to a specified location,

wherein in response to an operation performed by a user to input a sentence via said sentence inputting unit, said processing unit queries said user location registration unit to acquire location information associated with the user and commands said driving unit to move the imaging area of said imaging unit in accordance with the acquired location information, and said processing unit produces communication data including the sentence or statement input via said sentence inputting unit and a plurality of pictures taken by said imaging unit.

11. A communication data producing apparatus according to claim 10, wherein said user location registration unit is connected to a main unit of said communication data producing apparatus via a network.

12. A communication data producing method for producing communication data including an actually-photographed picture, said method comprising:

a sentence inputting step in which a user inputs a sentence or a statement;

an imaging step in which a picture of the user is taken a plurality of times in a predetermined period of time; and

a processing step in which communication data, including the sentence or the statement input in said sentence inputting step and the plurality of pictures taken in said imaging step, is produced.

13. A communication data producing method according to claim 12, wherein in said processing step, in response to an operation performed by the user to input a sentence or a statement, said imaging step is started to take a plurality of pictures and communication data is produced.

14. A communication data producing method according to claim 12, wherein in said imaging step, the timings of the respective pictures are indicated to the user.

15. A communication data producing method according to claim 12, further comprising:

a sentence analyzing step in which the sentence input in said sentence inputting step is analyzed; and

an image processing step in which a picture taken in said imaging step is processed in accordance with the result of analysis performed in said sentence analyzing step.

16. A communication data producing method according to claim 15, wherein in said sentence analyzing step, a mark such as an exclamation mark, a question mark and a face mark or an escape sequence is extracted from the sentence input in said sentence inputting step and the meaning or intention of the sentence is determined on the basis of the extracted mark in addition to a result of analysis of a word or an expression in the input sentence.

17. A communication data producing method according to claim 15, wherein said image processing step performs synthesis and/or modification, such as setting of a background, adjustment of lightness, luminance, and contrast, superimposing upon a CG image, conversion by means of synthesis into a sepia-color form, oil-painting-like form, watercolor-painting-like form, or mosaic form, and/or positive-to-negative reversion, upon a picture depending upon a feeling of a user or the purpose of a sentence detected as a result of the sentence analysis performed by said sentence analyzer.

18. A communication data producing method according to claim 12, wherein in said sentence inputting step, it is allowed to input a mark or an escape sequence indicating the meaning or intention of the input sentence.

19. A communication data producing method according to claim 12, further comprising a communication step in which produced communication data is transferred to the outside.

20. A communication data producing method according to claim 12, further comprising a data storing step in which produced communication data is stored.

21. A communication data producing method according to claim 12, further comprising:

a user location registration step in which a set of location information and a user identifier is registered for each of a plurality of users; and

a driving step in which an imaging area in said imaging step is moved to a specified location,

wherein, in said processing step, in response to an operation performed by a user to input a sentence, location information associated with the user is acquired, the imaging area taken in said imaging step is moved in accordance with the acquired location information, and communication data including the sentence or statement input by the user and a plurality of pictures taken is produced.

22. A communication data reproducing apparatus for reproducing communication data including sentence data and a plurality of image data, said communication data reproducing apparatus comprising:

a display unit including a display screen; and

a display controller which sets a frame for displaying communication data therein on said display screen and which displays in said frame a sentence and one of a plurality of pictures contained in communication data.

23. A communication data reproducing apparatus according to claim 22, further comprising a communication unit for receiving communication data from the outside.

24. A communication data reproducing apparatus according to claim 22, further comprising a data storage unit capable of storing a plurality of communication data.

25. A communication data reproducing apparatus according to claim 22, wherein said display controller switches the picture displayed in the frame.

26. A communication data reproducing apparatus according to claim 22, wherein said display controller switches the picture displayed in the frame at random intervals of time.

27. A communication data reproducing apparatus according to claim 22, wherein said display controller allocates a plurality of frames for displaying respective plural communication data on said display screen.

28. A communication data reproducing apparatus according to claim 27, wherein said display controller disposes the respective frames such that they have different horizontal or vertical sizes and/or they are disposed at different locations on the screen.

29. A communication data reproducing method for reproducing communication data including sentence data and a plurality of image data, said method comprising a display controlling step in which a frame for displaying communication data therein is set on said display screen, and a sentence and one of a plurality of pictures contained in communication data are displayed in said frame.

30. A communication data reproducing method according to claim 29, further comprising a communication step in which communication data is received from the outside.

31. A communication data reproducing method according to claim 29, further comprising a data storing step in which a plurality of communication data are stored.

32. A communication data reproducing method according to claim 29, wherein in said display controlling step, the picture displayed in the frame is switched.

33. A communication data reproducing method according to claim 29, wherein in said display controlling step, the picture displayed in the frame is switched at random intervals of time.

34. A communication data reproducing method according to claim 29, in said display controlling step, a plurality of frames for displaying respective plural communication data are allocated on said display screen.

35. A communication data reproducing method according to claim 34, wherein in said display controlling step, the respective frames are disposed such that they have different horizontal or vertical sizes and/or they are disposed at different locations on the screen.

36. A program storage medium on which a software program is stored in a computer-readable form, said software program describing, in a computer language, a process of producing communication data including an actually-photographed picture, said software program comprising:

a sentence inputting step in which a user inputs a sentence or a statement;

an imaging step in which a picture of the user is taken a plurality of times in a predetermined period of time; and

a processing step in which communication data, including the sentence or the statement input in said sentence inputting step and the plurality of pictures taken in said imaging step, is produced.

37. A program storage medium on which a software program is stored in a computer-readable form, said software program describing, in a computer language, a process of reproducing communication data including sentence data and an actually-photographed picture on a display screen, said software program comprising a display controlling step in which a frame for displaying communication data therein is set on said display screen, and a sentence and one of a plurality of pictures contained in communication data are displayed in said frame.