System and method for recording moving images

• US 7,271,827 B2
• Filed: 10/11/2001
• Issued: 09/18/2007
• Est. Priority Date: 11/16/2000
• Status: Expired due to Fees

• Current Assignee: Telefonaktienbolaget L.M. Ericsson
• Original Assignee: Telefonaktiebolaget LM Ericsson
• Inventors: Nister, David
• Primary Examiner(s): Srivastava; Vivek
• Assistant Examiner(s): WHIPKEY, JASON T
• Application Number:
  US10/416,640
• Publication Number:
  US 20040008264A1
• Time in Patent Office: 2,168 Days
• Field of Search: 348169-172, 348/208.11
• US Class Current: 348/169
• CPC Class Codes: H04N 2007/145 Handheld terminals
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display

Abstract

The present invention relates to the recording of moving images by means of a portable communication device, such as a videophone. The communication device includes a main device (101), comprising a video camera (105). Furthermore, an accessory device (102), such as a headset, is also associated with the main device (101) and co-located with a relevant object (103). The video camera (105) records an original image of the relevant object (103). At least one tracking point (107a ) is located on the accessory device (102) and at least one automatic tracking sensor (108a-108c) responsive to the at least one tracking point is located on the main device (101). The main device (101) further comprises a tracking data generator, which receives signals from the automatic tracking sensor(s) (108a-108c) and generates in response thereto tracking data representing a target direction (104) between the main device (101) and the accessory device (102). An image controller in the main device (101) creates a stabilized image of the relevant object (103) based on the target direction (104) and an original image recorded by the video camera (105 ).

Claims

1. A method of producing an enhanced image of a relevant object recorded by a video camera in a main device, an accessory device being associated with the main device and co-located with the relevant object wherein,

locating at least one tracking point on at least a first device of the main device and the accessory device, wherein the at least one tracking point is a magnetic component, and

locating at least one automatic tracking sensor having a magnetic field sensor, responsive to the at least one tracking point, on at least a second device of the main device and the accessory device the method comprising the steps of:

generating tracking data representative of a target direction between the main device and the accessory device based on signals received by the at least one automatic tracking sensor;

creating a stabilized image of the relevant object by processing an original image recorded by the video camera on basis of the target direction; and

adaptively selecting a particular portion of the original image recorded by the video camera based on the target direction.

2. A method according to claim 1 wherein the step of generating the tracking data involves triangulation of signals received from at least three automatic tracking sensors.

3. A method according to claim 1, wherein said step of creating the stabilized image involves tilting at least an image-forming element in the video camera around at least a first axis relative to the main device.

4. A method according to claim 1, further comprising an image processing step in which the stabilized image is produced by utilising data from at least two consecutively recorded images.

5. A method according to claim 1, further comprising the step of generating an alerting signal indicating that the video camera is unable to record the original image of the relevant object when at least a part of the relevant object is estimated to be located outside a recording range of the video camera.

6. A method according to claim 1, wherein the at least one tracking point being located in the accessory device.

7. A method according to claim 1, wherein the at least one automatic tracking sensor being located in the main device.

8. A method according to claim 1, wherein the at least one tracking point being located in the main device.

9. A method according to claim 1, wherein the at least one automatic tracking sensor being located in the accessory device, and the method involving transferring tracking signals from the accessory device to the main device.

10. A method according to claim 1, wherein the accessory device being a headset for duplex exchange of audio information with the main device.

11. A communication arrangement including a main device and an associated accessory device, the main device including a video camera to record an original image of a relevant object, the accessory device being co-located with the relevant object comprising:

at least one tracking point located on at least a first device of the main device and the accessory device, wherein the at least one tracking point is a magnetic component,

at least one automatic tracking sensor, responsive to the at least one tracking point, located on at least a second device of the main device and the accessory device, wherein the at least one automatic tracking sensor includes a magnetic field sensor,

the main device comprises a tracking data generator, which receives at least one signal from the at least one automatic tracking sensor and generates in response thereto tracking data representing a target direction between the main device and the accessory device, and

the main device comprises an image controller, which creates a stabilized image of the relevant object based on the target direction and an original image recorded by the video camera, wherein the image controller produces the stabilized image of the relevant object by adaptively selecting a particular portion of the original image recorded by the video camera.

12. A communication arrangement according to claim 11, wherein

the second device includes at least three automatic tracking sensors which each generates a tracking signal, and wherein

the tracking data generator producing the tracking data by triangulation of the tracking signals.

13. A communication arrangement according to claim 11, wherein at least one image forming element in the video camera is tiltable around at least a first axis relative to the main device such that the image controller can create the stabilized image of the relevant object by processing an image recorded by the image forming element when being placed in a tilted position.

14. A communication arrangement according to claim 11, wherein the image controller includes an image processor for producing the stabilized image from data recorded in at least two consecutively recorded images.

15. A communication arrangement according to claim 11, wherein at least one automatic tracking sensor is constituted by the video camera.

16. A communication arrangement according to claim 15, wherein at least one tracking point is constituted by a marker that has a known and well defined appearance.

17. A communication arrangement according to claim 16, wherein the marker is located on the accessory device.

18. A communication arrangement according to claim 17, wherein the marker is adapted to reflect light that is emitted from a light source in the main device.

19. A communication arrangement according to claim 18, wherein the light source emits a flashing light according to a particular sequence, which is to be reflected by the tracking point.

20. A communication arrangement according to claim 15, wherein at least one tracking point being constituted by a pulsating light source that emits a flashing light according to a particular sequence, which is to be registered by the video camera.

21. A communication arrangement according to claim 11, wherein

at least one tracking point is a light source, and

at least one automatic tracking sensor includes a light sensor.

22. A communication arrangement according to claim 11, wherein

at least one tracking point is an ultra-sound generator, and

at least one automatic tracking sensor includes a microphone for reception of ultra-sonic sounds.

23. A communication arrangement according to claim 11, wherein

at least one tracking point is a radio transmitter, and

at least one automatic tracking sensor includes a radio receiver.

24. A communication arrangement according to claim 11, wherein at least one tracking point is located in the accessory device.

25. A communication arrangement according to claim 11, wherein at least one automatic tracking sensor is located in the main device.

26. A communication arrangement according to claim 11, wherein at least one tracking point is located in the main device.

27. A communication arrangement according to claim 11, wherein at least one automatic tracking sensor is located in the accessory device, and the accessory device includes a transmitter for transferring tracking signals to the main device.

28. A communication arrangement according to claim 11, wherein the main device is a mobile videophone.

29. A communication arrangement including a main device and an associated accessory device, the main device including a video camera to record an original image of a relevant object, the accessory device being co-located with the relevant object comprising:

at least one tracking point located on at least a first device of the main device and the accessory device, wherein the at least one tracking point includes an accelerometer,

at least one automatic tracking sensor, responsive to the at least one tracking point, located on at least a second device of the main device and the accessory device, wherein the at least one automatic tracking sensor includes an accelerometer,

the main device comprises a tracking data generator, which receives at least one signal from the at least one automatic tracking sensor and generates in response thereto tracking data representing a target direction between the main device and the accessory device, the tracking data being generated from an estimated positional-directional relationship between the main device and the accessory device, the positional-directional relationship being derived from a comparison of signals generated by the at least one tracking point accelerometer with signals generated by the at least one automatic tracking sensor accelerometer, and

the main device comprises an image controller, which creates a stabilized image of the relevant object based on the target direction and an original image recorded by the video camera, wherein the image controller produces the stabilized image of the relevant object by adaptively selecting a particular portion of the original image recorded by the video camera.

30. A method of producing an enhanced image of a relevant object recorded by a video camera in a main device, an accessory device being associated with the main device and co-located with the relevant object wherein,

locating at least one tracking point having an accelerometer on at least a first device of the main device and the accessory device and

locating at least one automatic tracking sensor having an accelerometer, responsive to the at least one tracking point, on at least a second device of the main device and the accessory device the method comprising the steps of:

generating tracking data representative of a target direction between the main device and the accessory device based on signals received by the at least one automatic tracking sensor, the tracking data being generated from an estimated positional-directional relationship between the main device and the accessory device, the positional-directional relationship being derived from a comparison of signals generated by the at least one tracking point accelerometer with signals generated by the at least one automatic tracking sensor accelerometer;

creating a stabilized image of the relevant object by processing an original image recorded by the video camera on basis of the target direction; and

adaptively selecting a particular portion of the original image recorded by the video camera based on the target direction.