3D remote control system employing absolute and relative position detection

• US 20080106517A1
• Filed: 11/07/2006
• Published: 05/08/2008
• Est. Priority Date: 11/07/2006
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Computer Incorporated (Apple Inc.)
• Inventors: King, Nicholas Vincent, Kerr, Duncan Robert, Low, Wing Kong, Bronstein, Chad
• Granted Patent: US 8,291,346 B2
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G09G 5/373 for modifying the size of the graphic pattern

Abstract

The present invention can include three-dimensional remote control systems that can detect an absolute location to which a remote control is pointing in first and second orthogonal axes and an absolute position of the remote control in a third orthogonal axis. Remote control systems of the present invention can employ absolute position detection with relative position detection. Absolute position detection can indicate an initial absolute position of the remote control and relative position detection can indicate changes in the position of the remote control. By combining absolute and relative position detection, remote control systems of the present invention can track remote controls more precisely than systems that only employ absolute position detection. The present invention also can include methods and apparatus for zooming in and out of an image shown on a display based on the absolute position of the remote control in the third axis.

Claims

1. A system comprising:

a remote control having a relative motion sensor, wherein the relative motion sensor outputs data indicative of a change in a position of the remote control;

at least one predetermined light source;

a photodetector that detects light from the at least one predetermined light source and outputs data indicative of the detected light; and

at least one controller configured to determine an absolute position of the remote control based on the data output by the relative motion sensor and the photodetector, wherein the absolute position is determined with respect to a reference location.

2. The system of claim 1, wherein the relative motion sensor comprises an accelerometer.

3. The system of claim 1, wherein the system is coupled to a display that shows an image substantially defined by first and second orthogonal axes, and wherein:

the at least one controller is configured to generate signals for rendering the display;

the signals are a function of the absolute position of the remote control in a third axis; and

the third axis is orthogonal to the first and second axes.

4. The system of claim 3, further comprising a console, wherein:

the at least one controller comprises first and second controllers;

the first controller is disposed in the remote control;

the second controller is disposed in the console; and

the console comprises one or more connectors configured to be coupled to one or more accessories.

5. The system of claim 1, wherein the system is coupled to a display that shows an image substantially defined by first and second orthogonal axes, and wherein:

the at least one controller is configured to generate signals for zooming in on or zooming out of at least a portion of the image shown on the display;

the signals are a function of the absolute position of the remote control in a third axis; and

the third axis is orthogonal to the first and second axes.

6. The system of claim 1, wherein the system is coupled to a display that shows an image substantially defined by first and second orthogonal axes, and wherein the at least one controller is configured to:

determine an initial absolute position of the remote control in a third axis, wherein the third axis is orthogonal to the first and second axes;

determine a change in a position of the remote control in the third axis; and

combine the initial absolute position of the remote control with the change in the position of the remote control.

7. The system of claim 1, wherein the system is coupled to a display that shows an image substantially defined by first and second orthogonal axes, and wherein:

the at least one controller is configured to determine an absolute position of the remote control in a third axis; and

the third axis is orthogonal to the first and second axes.

8. A method for use with a system having a remote control, the method comprising:

accepting light data indicative of light detected by a photodetector;

accepting relative motion data from a relative motion sensor indicative of a change in a position of the remote control; and

determining an absolute position of the remote control based on the light data and the relative motion data, wherein the absolute position is determined with respect to a reference location.

9. The method of claim 8, wherein the system is coupled to a display that shows an image substantially defined by first and second orthogonal axes, and wherein determining an absolute position of the remote control comprises determining an absolute position of the remote control in a third axis that is orthogonal to the first and second axes.

10. The method of claim 9, further comprising generating signals for rendering the display based on the absolute position of the remote control in the third axis.

11. The method of claim 10, wherein generating signals for rendering the display comprises generating signals to zoom in on or zoom out of at least a portion of the image shown on the display.

12. The method of claim 8, further comprising performing a predetermined action when a user input component is actuated.

13. A method for use with a system having a remote control, the method comprising:

determining an initial absolute position of the remote control with respect to a reference location;

determining a change in a position of the remote control; and

determining an updated absolute position of the remote control with respect to the reference location by combining the initial absolute position of the remote control with the change in the position of the remote control.

14. The method of claim 13, wherein determining an initial absolute position of the remote control comprises determining an average position of the remote control over a predetermined amount of time.

15. The method of claim 13, wherein the system is coupled to a display that shows an image substantially defined by first and second orthogonal axes, and wherein:

determining an initial absolute position of the remote control comprises determining an initial absolute position of the remote control in a third axis that is orthogonal to the first and second axes;

determining a change in a position of the remote control comprises determining a change in a position of the remote control in the third axis; and

determining an updated absolute position of the remote control comprises determining an updated absolute position of the remote control in the third axis.

16. The method of claim 15, further comprising generating signals for rendering the display based on the updated absolute position of the remote control in the third axis.

17. The method of claim 16, wherein generating signals for rendering the display comprises generating signals to zoom in on or zoom out of at least a portion of the image shown on the display.

18. The method of claim 13, further comprising accepting light data from a photodetector, wherein the light data is representative of light detected by the photodetector, and wherein determining an initial absolute position of the remote control comprises determining an initial absolute position of the remote control based on the light data.

19. The method of claim 13, further comprising accepting relative motion data from a relative motion sensor, wherein the relative motion data is representative of a change in a position of the remote control, and wherein determining a change in a position of the remote control comprises determining a change in a position of the remote control based on the relative motion data.

20. The method of claim 13, further comprising weighting at least the initial absolute position of the remote control or the change in the position of the remote control before the combining step.

21. A method for use with a system coupled to a display, wherein the display shows an image substantially defined by first and second orthogonal axes, the system having a remote control, the method comprising:

detecting a first absolute position of the remote control in a third axis with respect to a reference location, wherein the third axis is orthogonal to the first and second axes;

generating first signals for rendering the image shown on the display based on the first absolute position of the remote control in the third axis with respect to the reference location;

detecting a second absolute position of the remote control in the third axis; and

generating second signals for zooming in on or zooming out of at least a portion of the image based on the second absolute position of the remote control in the third axis.

22. The method of claim 21, wherein generating signals for zooming in on at least a portion of the image comprises generating signals for enlarging a cursor in the image.

23. The method of claim 21, wherein generating signals for zooming out of at least a portion of the image comprises generating signals for shrinking a cursor in the image.

24. The method of claim 21, further comprising detecting a location in the first and second axes to which the remote control is pointing.

25. The method of claim 24, wherein generating second signals for zooming in on or zooming out of at least a portion of the image comprises generating second signals based on the location to which the remote control is pointing.

26. The method of claim 24, wherein generating second signals for zooming in on or zooming out of at least a portion of the image comprises generating second signals for zooming in on or zooming out of a focal point coincident with the location to which the remote control is pointing.

27. A remote control comprising:

an absolute position detection component of an absolute position detection sub-system, wherein the absolute position detection sub-system detects an initial absolute position of the remote control, the absolute position detection component comprising one or more electro-optical components;

a relative position detection component of a relative position detection sub-system, wherein the relative position detection sub-system detects a change in a position of the remote control, the relative position detection component comprising a relative motion sensor; and

a controller disposed in communication with the absolute and relative position detection components, wherein data from the relative position detection sub-system is combined with data from the absolute position detection sub-system to determine an updated absolute position of the remote control.

28. The remote control of claim 27, wherein the relative motion sensor comprises an accelerometer.

29. The remote control of claim 27, wherein the remote control is configured to communicate with at least one other electronic device using one or more wireless communication protocols.

30. The remote control of claim 27, further comprising a user input component that provides an interface through which a user can interact with the remote control, wherein the controller is disposed in communication with the user input component.

31. The remote control of claim 27, wherein the one or more electro-optical components comprises a photodetector.

32. The remote control of claim 27, wherein the one or more electro-optical components comprises one or more light sources.

33. The remote control of claim 27, wherein the one or more electro-optical components comprises a photodetector and one or more light sources.