Multi-directional remote control system and method

• US 20070058047A1
• Filed: 10/21/2005
• Published: 03/15/2007
• Est. Priority Date: 10/25/2004
• Status: Active Grant

• Current Assignee: I-Interactive LLC
• Original Assignee: I-Interactive LLC
• Inventors: Henty, David
• Granted Patent: US 8,456,534 B2
• Time in Patent Office: Days
• US Class Current: 348/211.990
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G08C 17/00 Arrangements for transmitting signals characterised by the use of a wireless electrical link
• CPC Class Codes: G08C 2201/32 Remote control based on movements, attitude of remote control device
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42206 characterized by hardware details
• CPC Class Codes: H04N 21/42212 Specific keyboard arrangements
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/42225 characterized by types of remote control, e.g. universal remote control
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/4781 Games
• CPC Class Codes: H04N 21/4782 Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/4786 e-mailing message switching systems, e.g. electronic mail systems H04L51/00

Abstract

A multi-directional remote control system and method is adapted for use with an entertainment system of a type including a display such as a monitor or TV and having display functions employing a mouse type control. The remote controller may be conveniently held in one hand of a user and still provides full mouse type functionality. The remote control system and method images the screen of the TV or other display to detect relative motion between the controller and screen. This position information is transmitted to the entertainment system for control of a cursor or other GUI interface.

Claims

1. A method for remote control of a media system including a display using a remote control having a camera, comprising:

displaying an image on the display using the display;

capturing image data of the displayed image and display screen using the camera on the remote control;

determining image position information from the captured image data; and

controlling at least a portion of the displayed image in response to movement of the remote control using the detected position information.

2. A method for remote control of a media system as set out in claim 1, wherein displaying an image comprises displaying a graphical user interface or video game.

3. A method for remote control of a media system as set out in claim 2, wherein the image displayed by the display includes a distinctive boundary or marker and wherein said determining image position information comprises detecting said distinctive border or marker.

4. A method for remote control of a media system as set out in claim 3, wherein the displayed image comprises externally provided images and wherein said method comprises superimposing said distinctive boundary or marker on said externally provided images.

5. A method for remote control of a media system as set out in claim 2, wherein the graphical user interface includes a cursor and wherein said controlling at least a portion of said displayed image comprises controlling the position of said displayed cursor.

6. A method for remote control of a media system as set out in claim 2, wherein controlling at least a portion of said displayed image comprises selectively highlighting portions of the graphical user interface or control of motion in the video game.

7. A method for remote control of a media system as set out in claim 1, wherein controlling at least a portion of the displayed image using said position information comprises wirelessly transmitting said position information from the remote control to the display or a device coupled to the display.

8. A method for remote control of a media system as set out in claim 1, wherein said position information is derived from offset information of a detected characteristic feature of the imager data from the camera optical axis.

9. A method for remote control of a media system as set out in claim 1, wherein said determining image position information comprises detecting the display screen boundary.

10. A method for remote control of an entertainment system including a television display, comprising:

displaying an image comprising a menu on the television display in response to activation of a control input on the remote, the menu including channel information, entertainment system control information, or internet access information;

capturing image data of the television display including the menu using an imager in a freely movable remote control;

detecting characteristic image features of the menu or the display screen boundary; and

providing multi-directional control of the display from changes in the detected characteristic image features due to movement of the remote control.

11. A method for remote control of a media system as set out in claim 10, wherein providing multi-directional control of the display comprises providing rapid scrolling through listed TV channels in response to movement of the remote control.

12. A method for remote control of a media system as set out in claim 10, wherein said characteristic image features of the menu comprise a menu boundary or a marker displayed on the menu.

13. A method for remote control of a media system as set out in claim 11, wherein said characteristic image features of the menu comprise a characteristic color of said boundary or marker.

14. A method for remote control of a media system as set out in claim 10, wherein providing multi-directional control comprises converting detected motion of the remote control to a sequence of up, down, left or right coded control pulses and transmitting said sequence of pulses to said television display or device coupled to said display.

15. An entertainment system and remote control combination, comprising:

a television display;

a device integrated with, or separate and coupled to, the display for controlling display of images on the display including externally provided internet information and television images, the device including processing circuitry for providing a distinctive boundary or marker on the displayed image; and

a freely movable remote control including an on board imager and optics adapted to capture image data including the displayed image, processing circuitry for detecting the distinctive boundary or marker and deriving multi-directional position control information, and transmission circuitry for transmitting the position control information to said device or display.

16. An entertainment system and remote control combination as set out in claim 15, wherein the distinctive boundary or marker comprises a boundary or marker with a characteristic brightness, color or shape.

17. An entertainment system and remote control combination as set out in claim 16, wherein the distinctive boundary has a brightness allowing distinctive detection of the edge of the display surrounding all or part of the image.

18. A remote control adapted for use with a television display providing a displayed image on a television screen, comprising:

an imager;

optics associated with the imager allowing a field of view including the television screen;

processing circuitry for detecting at least one of the screen boundary, a distinctive boundary displayed on the screen or a distinctive marker displayed on the screen and detecting movement of the remote control using the detected information; and

transmission circuitry for transmitting multi-dimensional control information derived from the detected movement.

19. A remote control as set out in claim 18, further comprising processing circuitry for providing universal remote control pulses in addition to said multi-directional control information.

20. A remote control as set out in claim 18, further comprising processing circuitry for providing universal remote control pulses derived from said detected movement.