Data transmission method, apparatus using same, and data transmission system

• US 6,947,601 B2
• Filed: 05/22/2001
• Issued: 09/20/2005
• Est. Priority Date: 05/24/2000
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Ishida, Yoshihiro, Aoki, Keisuke, Hiranaka, Daisuke, Takashima, Masatoshi, Morimoto, Hirofumi, Narita, Hideyuki
• Primary Examiner(s): Do, Anh Hong
• Application Number:
  US09/862,834
• Publication Number:
  US 20020054032A1
• Time in Patent Office: 1,582 Days
• Field of Search: 382/235, 382/236, 382/209, 382/232, 382/238, 600/443, 736/07, 375/240.03, 348/22, 348/169, 348/143, 348/151, 348/172, 356/437, 356/139.08, 396/324
• US Class Current: 382/235
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 2007/145 Handheld terminals
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q

Abstract

A data transmission method able to maintain the quality of a transmitted image substantially same as that of one'"'"'s own image and an apparatus using the method and a data transmission system, transmitting image data accommodated in a frame of a preset frame during communication between terminals, comprising capturing an image including a target image to be transmitted, making adjustments so that the target image to be transmitted from the obtained image substantially fully fills the image frame, and compressing and transmitting the adjusted image data in the image frame.

Claims

1. A data transmission method for transmitting at least image data accommodated in an image frame of a present size, comprising the steps of:

capturing an image including a target image to be transmitted;

making adjustments so that the target image to be transmitted from the captured image substantially fully fills the image frame; and

compressing and transmitting the adjusted image data in the image frame.

2. A data transmission method as set forth in claim 1, wherein when making adjustments so that a target image fully fills an image frame, comprising using an image of a characteristic portion of the image to be transmitted for matching and cutting out the image around the part with the best match for tracking of the image.

3. A data transmission method as set forth in claim 1, wherein when making adjustments so that a target image fully fills an image frame, comprising using an image of a characteristic portion of the image to be transmitted to calculate a distance in the characteristic portion and using this for enlargement, reduction, and tracking of the image.

4. A data transmission method as set forth in claim 2, wherein when detecting a characteristic portion of an image, comprising locking an image in a desired image state while monitoring a state of input of the image to be transmitted and using a center portion of the locked image as the characteristic portion of the image.

5. A data transmission method as set forth in claim 3, wherein when detecting a characteristic portion of an image, comprising locking an image in a desired image state while monitoring a state of input of the image to be transmitted and using a center portion of the locked image as the characteristic portion of the image.

6. A data transmission method as set forth in claim 2, wherein when detecting a characteristic portion of an image, comprising displaying a state of input of the image to be transmitted, specifying a certain location on the display screen, and using the portion around the specified point as the characteristic portion of the image.

7. A data transmission method as set forth in claim 3, wherein when detecting a characteristic portion of an image, comprising displaying a state of input of the image to be transmitted, specifying a certain location on the display screen, and using the portion around the specified point as the characteristic portion of the image.

8. A data transmission method as set forth in claim 4, wherein when locking a target image by using a characteristic portion of an image, comprising fetching and tracking the image at a frame rate the same as or higher than the image to be transmitted and refreshing a reference image serving as a reference for tracking at a rate the same as or higher than the transmission frame rate.

9. A data transmission method as set forth in claim 5, wherein when locking a target image by using a characteristic portion of an image, comprising fetching and tracking the image at a frame rate the same as or higher than the image to be transmitted and refreshing a reference image serving as a reference for tracking at a rate the same as or higher than the transmission frame rate.

10. A data transmission method as set forth in claim 1, comprising displaying a state of input of the image to be transmitted and specifying a range to be transmitted on the display to determine the range of transmission of the image.

11. A data transmission method for transmitting at least image data, comprising the steps of:

capturing an image including a target image to be transmitted;

making adjustments so that the target image to be transmitted from the captured image has a preset size; and

compressing and transmitting the adjusted image data in the image frame.

12. A data transmission method as set forth in claim 11, wherein when making adjustments so that a target image has a preset size, comprising using an image of a characteristic portion of the image to be transmitted for matching and cutting out the image around the part of the best match for tracking of the image.

13. A data transmission method as set forth in claim 11, wherein when making adjustments so that a target image has a preset size, comprising using an image of a characteristic portion of the image to be transmitted to calculate a distance in the characteristic portion and using this for enlargement, reduction, and tracking of the image.

14. A data transmission method as set forth in claim 12, wherein when detecting a characteristic portion of an image, comprising locking an image in a desired image state while monitoring a state of input of the image to be transmitted and using a center portion of the locked image as the characteristic portion of the image.

15. A data transmission method as set forth in claim 13, wherein when detecting a characteristic portion of an image, comprising locking an image in a desired image state while monitoring a state of input of the image to be transmitted and using a center portion of the locked image as the characteristic portion of the image.

16. A data transmission method as set forth in claim 12, wherein when detecting a characteristic portion of an image, comprising displaying a state of input of the image to be transmitted, specifying a certain location on the display screen, and using the portion around the specified point as the characteristic portion of the image.

17. A data transmission method as set forth in claim 13, wherein when detecting a characteristic portion of an image, comprising displaying a state of input of the image to be transmitted, specifying a certain location on the display screen, and using the portion around the specified point as the characteristic portion of the image.

18. A data transmission method as set forth in claim 14, wherein when locking a target image by using a characteristic portion of an image, comprising fetching and tracking the image at a frame rate the same as or higher than the image to be transmitted and refreshing a reference image serving as a reference for tracking at a rate the same as or higher than the transmission frame rate.

19. A data transmission method as set forth in claim 15, wherein when locking a target image by using a characteristic portion of an image, comprising fetching and tracking the image at a frame rate the same as or higher than the image to be transmitted and refreshing a reference image serving as a reference for tracking at a rate the same as or higher than the transmission frame rate.

20. A data transmission method as set forth in claim 11, comprising displaying a state of input of a transmitted image and specifying a range to be transmitted on the display to determine the range of transmission of the image.

21. A data transmission method for displaying at least image data of a user on a display screen among a plurality of terminals and transmitting at least image data while displaying received image data on the display screen, comprising

capturing an image including a target image of a user to be transmitted from substantially the center of the display screen.

22. A data transmission method for displaying at least image data of a user on a display screen among a plurality of terminals and transmitting at least image data while displaying received image data of another party on the display screen and displaying content for common discussion on the display screen, comprising the steps of:

Capturing an image including a target image of a user to be transmitted from substantially a center of the display screen and

displaying the image data at one of an upper portion or a lower portion of the display screen from the substantially center portion of the display screen serving as the capturing portion and displaying the content at the other portion.

23. A data transmission method as set forth in claim 22, comprising displaying image data above the content on the display screen.

24. A data transmission method as set forth in claim 22, comprising displaying image data below the content on the display screen.

25. A data transmission apparatus for transmitting at least image data accommodated in an image frame of a preset size, comprising

an imaging means for capturing an image including a target image to be transmitted;

a first circuit for making adjustments so that the target image to be transmitted from the captured image by the imaging means substantially fully fills the image frame; and

a second circuit for compressing and transmitting the adjusted image data in the image frame.

26. A data transmission apparatus as set forth in claim 25, wherein when making adjustments so that the target image to be transmitted fully fills the image frame, said first circuit uses an image of a characteristic portion of the image to be transmitted for matching and cuts out the image around the part with the best match for tracking of the image.

27. A data transmission apparatus as set forth in claim 25, wherein when making adjustments so that the target image to be transmitted frilly fills the image frame, said first circuit uses an image of a characteristic portion of the image to be transmitted to calculate a distance in the characteristic portion and uses this for enlargement, reduction, and tracking of the image.

28. A data transmission apparatus as set forth in claim 26, comprising a displaying means for displaying image data and a locking means able to lock an image displayed by the displaying means in a desired image state, wherein when detecting a characteristic portion of an image, said first circuit uses the center portion of the image locked by the locking image as the characteristic portion of the image.

29. A data transmission apparatus as set forth in claim 27, comprising a displaying means for displaying image data and a locking means able to lock an image displayed by the displaying means in a desired state, wherein when detecting a characteristic portion of an image, said first circuit uses the center portion of the image locked by the lacking image as the characteristic portion of the image.

30. A data transmission apparatus as set forth in claim 26, comprising

a displaying means for displaying image data and including a pointer able to specify a certain location and a specifying means able to specify a certain location of the image displayed on the displaying means by the pointer, wherein when detecting a characteristic portion of an image, said first circuit uses a portion around the point specified by the specifying means as the characteristic portion of the image.

31. A data transmission apparatus as set forth in claim 27, comprising a displaying means for displaying image data and including a pointer able to specify a certain location and a specifying means able to specify a certain location of the image displayed on the displaying means by the pointer, wherein when detecting a characteristic portion of an image, said first circuit uses a portion around the point specified by the specifying means as the characteristic portion of the image.

32. A data transmission apparatus as set forth in claim 28, wherein when locking a target image by using a characteristic portion of the image, said first circuit fetches the image and performs a tracking operation at a frame rate the same as or higher than the image to be transmitted and refreshes a reference image serving as a reference for tracking at a rate the same as or higher than the transmission frame rate.

33. A data transmission apparatus as set forth in claim 29, wherein when locking a target image by using a characteristic portion of the image, said first circuit fetches the image and performs a tracking operation at a frame rate the same as or higher than the image to be transmitted and refreshes a reference image serving as a reference for tracking at a rate the same as or higher than the transmission frame rate.

34. A data transmission apparatus as set forth in claim 25, comprising a displaying means for displaying image data and including a pointer able to specify a certain location and a specifying means able to specify a certain location of the image displayed by the displaying means by the pointer, wherein said first circuit decides on the range specified by the specifying means as the range for transmission of the image.

35. A data transmission apparatus for transmitting at least image data, comprising

an imaging means for capturing an image including a target image to be transmitted;

a first circuit for making adjustments so that the target image to be transmitted from the captured image has a preset size; and

a second circuit for compressing and transmitting the adjusted image data in the image frame.

36. A data transmission apparatus as set forth in claim 35, wherein when making adjustments so that the target image has a preset size, said first circuit uses an image of a characteristic portion of the image to be transmitted for matching and cuts out the image around the part with the best match for tracking of the image.

37. A data transmission apparatus as set forth in claim 35, wherein when making adjustments so that the target image has a preset size, said first circuit uses an image of a characteristic portion of the image to be transmitted to calculate a distance in the characteristic portion and uses this for enlargement, reduction, and tracking of the image.

38. A data transmission apparatus as set forth in claim 36, comprising a displaying means for displaying image data and a locking means able to lock an image displayed by the displaying means in a desired state, wherein when detecting a characteristic portion of an image, said first circuit uses a center portion of the image locked by the locking image as the characteristic portion of the image.

39. A data transmission apparatus as set forth in claim 37, comprising a displaying means for displaying image data and a locking means able to lock an image displayed by the displaying means in a desired state, wherein when detecting a characteristic portion of an image, said first circuit uses a center portion of the image locked by the locking image as the characteristic portion of the image.

40. A data transmission apparatus as set forth in claim 36, comprising a displaying means for displaying image data and including a pointer able to specify a certain location and a specifying means able to specify a certain location of the image displayed on the displaying means by the pointer, wherein when detecting a characteristic portion of an image, said first circuit uses a portion around the point specified by the specifying means as the characteristic portion of the image.

41. A data transmission apparatus as set forth in claim 37, comprising a displaying means for displaying image data and including a pointer able to specify a certain location and a specifying means able to specify a certain location of the image displayed on the displaying means by the pointer, wherein when detecting a characteristic portion of an image, said first circuit uses a portion around the point specified by the specifying means as the characteristic portion of the image.

42. A data transmission apparatus as set forth in claim 38, wherein when locking a target image by using a characteristic portion of the image, said first circuit fetches the image and performs a tracking operation at a frame rate the same as or higher than the image to be transmitted and refreshes a reference image serving as a reference for tracking at a rate the same as or higher than the transmission frame rate.

43. A data transmission apparatus as set forth in claim 39, wherein when locking a target image by using a characteristic portion of the image, said first circuit fetches the image and performs a tracking operation at a frame rate the same as or higher than the image to be transmitted and refreshes a reference image serving as a reference for tracking at a rate the same as or higher than the transmission frame rate.

44. A data transmission apparatus as set forth in claim 35, comprising a displaying means for displaying image data and including a pointer able to specify a certain location and a specifying means able to specify a certain location of the image displayed by the displaying means 5 by the pointer, wherein said first circuit decides on the range specified by the specifying means as the range for transmission of the image.

45. A data transmission system for displaying at least image data of a user on a display screen among a plurality of terminals and transmitting at least image data while displaying received image data of another party on the display screen, wherein a terminal comprises

an imaging means for capturing an image including a target image to be transmitted;

a first circuit for making adjustments so that the target image to be transmitted from the captured image by the imaging means substantially fully fills an image frame; and

a second circuit for compressing and transmitting the adjusted image data in the image frame.

46. A data transmission system for displaying at least image data of a user on a display screen among a plurality of terminals and transmitting at least image data while displaying received image data of another party on the display screen, wherein a terminal comprises

an imaging means for capturing an image including a target image to be transmitted;

a first circuit for making adjustments so that the target image to be transmitted from the captured image becomes a preset size; and

a second circuit for compressing and transmitting the adjusted image data in an image frame.

47. A data transmission system for displaying at least image data of a user on a display screen among a plurality of terminals and for transmitting at least image data while displaying received image data on the display screen, wherein an imaging means for capturing an image including a target image to be transmitted is provided substantially at the center of the display screen.

48. A data transmission system for displaying at least image data of a user on a display screen among a plurality of terminals and for transmitting at least image data while displaying received image data of another party on the display screen and displaying content for common discussion on the display screen comprising

an imaging means provided substantially at the center of the display screen and capturing an image including a target image to be transmitted and

a displaying means for displaying the image data at one of an upper portion or a lower portion of the display screen from the substantially center portion of the display screen serving as the capturing portion and displaying the content at the other portion.