Method for controlling a display apparatus using a camera based device and mobile device, display apparatus, and system thereof

• US 8,922,482 B2
• Filed: 05/07/2013
• Issued: 12/30/2014
• Est. Priority Date: 05/07/2012
• Status: Expired due to Fees

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Jayachandran, Prasanth, Subramanian, Muthukumar
• Primary Examiner(s): Shankar, Vijay
• Application Number:
  US13/888,911
• Publication Number:
  US 20130293458A1
• Time in Patent Office: 602 Days
• Field of Search: 345156-169, 345204-215
• US Class Current: 345/156
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/1462 with means for detecting differences between the image stored in the host and the images displayed on the remote displays
• CPC Class Codes: G09G 2320/0693 Calibration of display systems
• CPC Class Codes: G09G 2340/0492 Change of orientation of the displayed image, e.g. upside-down, mirrored
• CPC Class Codes: G09G 2370/02 Networking aspects
• CPC Class Codes: G09G 2370/22 Detection of presence or absence of input display information or of connection or disconnection of a corresponding information source
• CPC Class Codes: H04M 1/72415 for remote control of appliances

Abstract

A method of controlling a display apparatus using a camera based device and a mobile device, display apparatus, and system applying the same are provided. The method for controlling the display apparatus with the mobile device includes capturing an entity displayed which is on the display apparatus, in response to a movement of the mobile device, sensing at least one of a movement and a change of size of the captured entity, generating a control signal for controlling the display apparatus based on at least one of the sensed movement, and change of size of the entity and transmitting the generated control signal to the display apparatus.

Claims

1. A method of controlling a display apparatus of a system which includes a mobile device and display apparatus, the method comprising:

displaying an entity by the display apparatus;

capturing, by the mobile device, the entity displayed on the display apparatus;

sensing, by the mobile device at least one of a movement of the captured entity and a change of size of the captured entity according to a movement of the mobile device;

generating, by the mobile device, a first control signal based on the least one of the movement of the captured entity and the change of size of the captured entity, the control signal controlling the display apparatus;

controlling, by the display apparatus, at least one of the size and position of the displayed entity according to the first control signal;

in response to a size of the captured entity being changed, generating, by the mobile device, a second control signal to change a size of the entity displayed on the display apparatus and changing, by the display apparatus the size of the entity displayed on the display apparatus according to the second control signal; and

in response to a position of the captured entity being changed, generating, by the mobile device, a third control signal to change a position of the entity displayed on the display apparatus and changing, by the display apparatus, the position of the entity displayed on the display apparatus according to the third control signal.

2. A device comprising:

a display configured to displays a first image which is a mirror image of a second image displayed on the second device;

a sensor configured to sense a movement of the device relative to the second device;

a processor configured to generate a control signal for controlling the second device to move the second image, in response to the sensor sensing the movement of the device;

a transmitter configured to transmit the control signal to the second device;

wherein, in response to a size of the first image being changed, the processor generates a control signal for controlling the second device to change a size of the second image according to the change of size of the first image; and

wherein, in response to a position of the first image being changed, the processor generates a control signal for controlling the second device to change a position of the second image according to the change of position of the first image.

3. A method of controlling a display apparatus controlled by a mobile device, the method comprising:

displaying an entity;

receiving, from the mobile device, a first control signal which is generated based a movement of the mobile device relative to the display apparatus and indicates a movement of the displayed entity as it relates to the movement of the mobile device;

controlling at least one of a size and a position of the displayed entity according to the first control signal;

receiving, from the mobile device, a second control signal to change a size of the entity being displayed on the display apparatus in response to a change of a size of the captured entity, and changing the size of the entity displayed on the display apparatus according to the second control signal; and

receiving, from the mobile device, a third control signal to change a position of the entity displayed on the display apparatus in response to a position of the captured entity being changed, and changing the position of the entity displayed on the display apparatus according to the third control signal.

4. A method for controlling a display apparatus with a mobile device, the method comprising:

capturing an entity which is displayed on the display apparatus;

in response to a movement of the mobile device, sensing at least one of a movement of the captured entity and a change of size of the captured entity;

generating a control signal for controlling the display apparatus based on the at least one of the movement of the captured entity and the change of size of the sensed entity;

transmitting the generated control signal to the display apparatus;

in response to a size of the captured entity being changed, changing with the control signal a size of the entity displayed on the display apparatus according to the change of the size of the captured entity; and

in response to a position of the captured entity being changed, changing with the control signal a position of the entity displayed on the display apparatus according to the change of the position of the captured entity.

5. The method according to claim 4,

wherein the capturing the entity comprises:

displaying an initial calibration gradation line; and

displaying a gesture gradation line associated with the entity displayed on the display apparatus.

6. The method according to claim 5, further comprising moving the gesture gradation line according to the movement of the mobile device.

7. The method according to claim 6, wherein the sensing comprises determining at least one of a movement and a change of size of the gesture gradation line with respect to the initial calibration gradation line.

8. The method according to claim 4, further comprising:

in response to the size of the captured entity being increased according to the movement of the mobile device towards the display apparatus, increasing with the control signal the size of the entity displayed on the display apparatus; and

in response to the size of the captured entity being decreased according to the movement of the mobile device away from the display apparatus, decreasing with use of the control signal the size of the entity displayed on the display apparatus.

9. The method according to claim 4,

wherein the control signal causes the entity displayed on the display apparatus to move in a direction which is opposite to the movement of the gesture gradation line as it relates to the initial calibration gradation line.

10. The method according to claim 4, wherein the entity displayed on the display apparatus includes a pointer.

11. A mobile device for controlling a display apparatus, the mobile device comprising:

a camera which is configured to capture an entity displayed on the display apparatus;

a display which is configured to display the entity captured by the camera;

a communicator which is configured to communicate with the display apparatus; and

a controller which is configured to control the camera to capture the entity displayed on the display apparatus, sense a movement of the captured entity according to a movement of the mobile device, generate a control signal based on the sensed movement of the captured entity, and control the communicator to transmit the generated control signal to the display apparatus;

wherein, in response to a size of the captured entity being changed, the controller is further configured to generate a control signal to change a size of the entity displayed on the display apparatus according to the change of the size of the captured entity, and

in response to a position of the captured entity being changed, the controller is further configured to generate the control signal to change a position of the entity displayed on the display apparatus. apparatus according to the change of the size of the captured entity.

12. The mobile device according to claim 11,

wherein the controller is further configured to control the display to display an initial calibration gradation line and a gesture gradation line, the gesture gradation line being associated with the entity displayed on the display while the camera captures the entity of the display apparatus.

13. The mobile device according to claim 12,

wherein the gesture gradation line moves according to the movement of the mobile device.

14. The mobile device according to claim 13,

wherein the controller is further configured to determine at least one of the movement and a change of size of the gesture gradation line with respect to the initial calibration gradation line in order to sense at least one of the movement and a change of size of the captured entity

15. The mobile device according to claim 11,

wherein, in response to the size of the captured entity being increased according to the movement of the mobile device towards the display apparatus, the controller is further configured to generate the control signal to increase the size of the entity displayed on the display apparatus, and

in response to the size of the captured entity being decreased according to the movement of the mobile device away from the display apparatus, the controller is further configured to generate the control signal to decrease the size of the entity displayed on the display apparatus.

16. The mobile device according to claim 11,

wherein the controller is further configured to generate the control signal to move the entity displayed on the display apparatus in a direction which is opposite to the movement of the gesture gradation line with respect to the initial calibration gradation line.

17. The mobile device according to claim 11,

wherein the entity displayed on the display apparatus includes a pointer.