APPARATUS AND METHOD FOR MANIPULATING IMAGE

• US 20110310094A1
• Filed: 06/13/2011
• Published: 12/22/2011
• Est. Priority Date: 06/21/2010
• Status: Active Grant

• Current Assignee: Korea Advanced Institute of Science and Technology
• Original Assignee: Korea Advanced Institute of Science and Technology
• Inventors: PARK, Ji Hyung, YOON, Dong Wook, LEE, Joong-Ho, YEOM, Ki Won
• Granted Patent: US 8,878,875 B2
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1643 the display being associated to a digitizer, e.g. laptops that can be used as penpads details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling

Abstract

An image manipulation apparatus for displaying a three-dimensional image of an object displayed on a display apparatus in correspondence with orientation of a mobile apparatus includes: an orientation information processor configured to generate orientation displacement information corresponding to orientation of the mobile apparatus; a renderer configured to generate a rendering image of the three-dimensional image using the three-dimensional image of the object and the orientation displacement information; and a transmitter configured to transmit the rendering image to the display apparatus. An image manipulation method of displaying a three-dimensional image of an object displayed on a display apparatus in correspondence with orientation of a mobile apparatus includes: generating orientation displacement information corresponding to orientation of the mobile apparatus; generating a rendering image of the three-dimensional image using the three-dimensional image and the orientation displacement information; and transmitting the rendering image to the display apparatus.

Claims

1. An image manipulation apparatus for displaying a three-dimensional image of an object displayed on a display apparatus in correspondence with orientation of a mobile apparatus, comprising:

an orientation information processor configured to generate orientation displacement information corresponding to orientation of the mobile apparatus;

a renderer configured to generate a rendering image of the three-dimensional image using the three-dimensional image of the object and the orientation displacement information; and

a transmitter configured to transmit the rendering image to the display apparatus.

2. The image manipulation apparatus according to claim 1, wherein the orientation information processor receives orientation sensor information corresponding to orientation of the mobile apparatus from the mobile apparatus and generates the orientation displacement information using the orientation sensor information.

3. The image manipulation apparatus according to claim 2, wherein the orientation information processor includes:

a noise attenuator configured to receive the orientation sensor information and eliminate noise; and

a three-dimensional displacement information calculator configured to receive the orientation sensor information from which noise is eliminated, calculate an orientation displacement from an initial orientation to a current orientation of the mobile apparatus, and generate the orientation displacement information.

4. The image manipulation apparatus according to claim 2, wherein the orientation information processor includes:

a three-dimensional displacement information calculator configured to receive the orientation sensor information, calculate an orientation displacement from an initial orientation to a current orientation of the mobile apparatus, and generate the orientation displacement information; and

a noise attenuator configured to receive the orientation displacement information and eliminate noise.

5. The image manipulation apparatus according to claim 4, wherein the noise attenuator eliminates noise using a spherical linear interpolation (SLERP) method which is a quaternion interpolation method.

6. The image manipulation apparatus according to claim 4, wherein the noise or includes one or more selected from a group including a low pass filter (LPF), a Kalman filter, an extended Kalman filter, a unscented Kalman filter and a particle filter.

7. The image manipulation apparatus according to claim 4, further comprising a touch event processor configured to receive touch operation information corresponding to a touch of the mobile apparatus from the mobile apparatus and generate touch event occurrence information using the touch operation information,

wherein the renderer generates the rendering information of the three-dimensional image using the three-dimensional image, the orientation displacement information and the touch event occurrence information.

8. The image manipulation apparatus according to claim 7, wherein the renderer includes:

a three-dimensional image converter configured to convert the three-dimensional image in a space using the orientation displacement information and the touch event occurrence information and generate three-dimensional image conversion information;

a rendering controller configured to control a physical property and rendering characteristics of the three-dimensional image to be rendered and transmit or receive the three-dimensional image conversion information to or from the three-dimensional image converter; and

a rendering calculator configured to perform rendering and generate and transmit rendering information.

9. The image manipulation apparatus according to claim 8, further comprising a first controller configured to generate and transmit or receive a first control signal for controlling the three-dimensional image generator, the orientation information processor, the touch event processor and the renderer.

10. The image manipulation apparatus according to claim 9, which further comprises a system chip including:

a processor configured to perform operations of the three-dimensional image generator, the orientation information processor, the touch event processor and the renderer;

a second controller configured to generate and transmit or receive a second control signal for controlling the three-dimensional image generator, the orientation information processor, the touch event processor, the renderer and the first controller; and

a peripheral device interface for receiving and transmitting the orientation sensor information and the touch operation information to the second controller.

11. The image manipulation apparatus according to claim 10, further comprising a communication module configured to receive the orientation sensor information and the touch operation information from the mobile apparatus and transmit the orientation sensor information and the touch operation information to the peripheral device interface.

12. The image manipulation apparatus according to claim 11, wherein the communication module performs communication using one or more communication methods selected from a group including wireless Local Area Network (LAN), Metropolitan Area Network (MAN), Global System for Mobile Communication (GSM), Enhanced Data GSM Environment (EDGM), High Speed Downlink Packet Access (HSDPA), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Zigbee, Wi-Fi, Voice over Internet Protocol (VoIP), World Interoperability for Microwave Access (Wi-MAX), and ultrasonic communication method.

13. The image manipulation apparatus according to claim 7, further comprising a memory,

wherein the three-dimensional image generator, the orientation information processor, the touch event processor and the renderer are included in the memory.

14. The image manipulation apparatus according to claim 1, wherein the transmitter transmits the rendering image to a plurality of mobile apparatuses.

15. The image manipulation apparatus according to claim 1, wherein the transmitter transmits the rendering image to another display apparatus.

16. An image manipulation method of displaying a three-dimensional image of an object displayed on a display apparatus in correspondence with orientation of a mobile apparatus, comprising:

generating orientation displacement information corresponding to orientation of the mobile apparatus;

generating a rendering image of the three-dimensional image using the three-dimensional image and the orientation displacement information; and

transmitting the rendering image to the display apparatus.

17. The image manipulation method according to claim 16, wherein the generating orientation displacement information includes calculating an orientation displacement from an initial orientation to a current orientation of the mobile apparatus and generating the orientation displacement information.

18. The image manipulation method according to claim 17, wherein the generating of the orientation displacement information includes:

receiving orientation sensor information and eliminating noise; and

receiving the orientation sensor information from which noise is eliminated, calculating an orientation displacement from an initial orientation to a current orientation of the mobile apparatus, and generating the orientation displacement information.

19. The image manipulation method according to claim 17, wherein the generating orientation displacement information includes:

receiving orientation sensor information, calculating an orientation displacement from an initial orientation to a current orientation of the mobile apparatus, and generating the orientation displacement information; and

receiving the orientation displacement information and eliminating noise.

20. The image manipulation method according to claim 19, wherein the eliminating noise uses a SLERP method which is a quaternion interpolation method.

21. The image manipulation method according to claim 19, wherein, in the eliminating nose, noise is eliminated using one or more selected from a group including a LPF, a Kalman filter, an extended Kalman filter, a unscented Kalman filter and a particle filter.

22. The image manipulation method according to claim 19, further comprising:

receiving touch operation information corresponding to a touch of the mobile apparatus from the mobile apparatus; and

generating touch event occurrence information using the touch operation information,

wherein the generating a rendering image includes generating the rendering information of the three-dimensional image using the three-dimensional image, the orientation displacement information and the touch event occurrence information.

23. The image manipulation method according to claim 16, wherein the transmitting includes transmitting the rendering image to a plurality of mobile apparatuses.

24. The image manipulation method according to claim 16, wherein the transmitting includes transmitting the rendering image to another display apparatus.