System and method of remote operation using visual code

• US 20100225580A1
• Filed: 07/30/2009
• Published: 09/09/2010
• Est. Priority Date: 03/06/2009
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Choi, Chang Kyu, Yoon, Hyung Min
• Application Number:
  US12/461,078
• Publication Number:
  US 20100225580A1
• Time in Patent Office: Days
• US Class Current: 345/157
• CPC Class Codes: G06F 21/35 communicating wirelessly
• CPC Class Codes: G06F 21/36 by graphic or iconic representation
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry

Abstract

A remote operation method using a visual code, and an apparatus executing the method. A mobile device encodes unique data into the visual code, and displays the visual code, and a display apparatus recognizes the displayed visual code, and performs a wireless connection with the mobile device. The mobile device remotely operates a pointer of the display apparatus mapped with the visual code when the wireless connection with the display apparatus is performed. In the display apparatus without a separate operation means, a remote operation is performed using the visual code of the mobile device.

Claims

1. A display apparatus, comprising:

a code decoding unit to decode a visual code, received from an image sensor, displayed on a mobile device;

a connection performing unit to operate a wireless connection with the mobile device using a wireless connection address extracted from the visual code; and

a pointer displaying unit to display a pointer in accordance with movement of the mobile device by tracking the movement of the mobile device.

2. The display apparatus of claim 1, wherein the code decoding unit decodes the visual code in which the wireless connection address of the mobile device, a user operation plane, and a user identification (ID) are encoded.

3. The display apparatus of claim 1, wherein the pointer displaying unit includes:

an ID determining unit to determine whether a user ID extracted from the visual code of the mobile device is stored;

a location extracting unit to extract an absolute location of the mobile device using the visual code when the user ID is stored; and

a mapping unit to map a movement range of the mobile device to a movement range of the pointer using a virtual operation plane of the mobile device.

4. The display apparatus of claim 3, wherein the location extracting unit calculates a distance in which the mobile device is moved by a user based on a size or a shape of the visual code and extracts the absolute location of the mobile device.

5. The display apparatus of claim 4, wherein

the mapping unit sets the virtual operation plane based on the distance with respect to a point where the visual code displayed on the mobile device is recognized, and determines a ratio of the movement range of the pointer based on the movement range of the mobile device in the virtual operation plane, and wherein

the virtual operation plane corresponds to an overall size of the display apparatus.

6. The display apparatus of claim 1, further comprising:

a content processing unit to process contents corresponding to a location of the pointer when receiving a content process input from the mobile device.

7. A mobile device comprising:

an input unit to receive an input for displaying a visual code;

an encoding unit to read stored unique data and to encode the read data into a visual code when receiving the input; and

a visual code displaying unit to convert the visual code into an image, and to display the image so that an image sensor of a display apparatus captures the image and recognizes the visual code.

8. The mobile device of claim 7, further comprising:

a processing command transmission unit to transmit a processing command of contents corresponding to a pointer mapped with the visual code displayed on the display apparatus, upon a wireless connection with the display apparatus having been performed using the visual code converted into the image.

9. The mobile device of claim 7, wherein the display apparatus displays a pointer in accordance with movement of the mobile device by tracking the movement of the mobile device.

10. The mobile device of claim 9, wherein the display apparatus detects a location of the mobile device using the visual code of the mobile device, and maps a movement range of the mobile device to a movement range of the pointer of the display apparatus.

11. A remote operation method, comprising:

decoding a visual code, received from an image sensor, displayed on a mobile device;

operating a wireless connection with the mobile device using a wireless connection address extracted from the visual code; and

displaying a pointer in accordance with movement of the mobile device by tracking the movement of the mobile device.

12. The remote operation method of claim 11, wherein the decoding decodes the visual code in which the wireless connection address of the mobile device, a user operation plane, and a user identification (ID) are encoded.

13. The remote operation method of claim 11, wherein the displaying includes:

determining whether a user ID extracted from the visual code of the mobile device is stored;

extracting an absolute location of the mobile device using the visual code upon determining that the user ID is stored; and

mapping a movement range of the mobile device to a movement range of the pointer using a virtual operation plane of the mobile device.

14. The remote operation method of claim 13, wherein the extracting calculates a distance in which the mobile device is moved by a user based on a size or a shape of the visual code and extracts the absolute location of the mobile device.

15. The remote operation method of claim 14, wherein the mapping includes:

setting the virtual operation plane based on the distance with respect to a point where the visual code displayed on the mobile device is recognized; and

determining a ratio of the movement range of the pointer based on the movement range of the mobile device in the virtual operation plane,

wherein the virtual operation plane corresponds to an overall size of a display apparatus.

16. The remote operation method of claim 11, further comprising:

processing contents corresponding to a location of the pointer when receiving a content processing input from the mobile device.

17. A remote operation method, comprising:

receiving an input for displaying a visual code;

reading stored unique data, and encoding the read data into the visual code upon receiving the input; and

converting the visual code into an image, and displaying the image so that an image sensor of a display apparatus captures the image and recognizes the visual code.

18. The remote operation method of claim 17, further comprising:

transmitting a processing command of contents corresponding to a pointer mapped with the visual code displayed on the display apparatus, upon a wireless connection with the display apparatus having been performed using the visual code converted into the image.

19. The remote operation method of claim 17, wherein the display apparatus displays a pointer in accordance with movement of a mobile device by tracking the movement of the mobile device.

20. The remote operation method of claim 19, wherein the display apparatus detects a location of the mobile device using the visual code of the mobile device, and maps a movement range of the mobile device to a movement range of the pointer of the display apparatus.