HANDHELD ELECTRONIC DEVICES WITH BIMODAL REMOTE CONTROL FUNCTIONALITY

• US 20090153289A1
• Filed: 12/12/2007
• Published: 06/18/2009
• Est. Priority Date: 12/12/2007
• Status: Abandoned Application

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Wood, Policarpo, Cannistraro, Alan, Hope, Eric James
• Application Number:
  US11/955,385
• Publication Number:
  US 20090153289A1
• Time in Patent Office: Days
• US Class Current: 340/5.100
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G08C 17/02 using a radio link
• CPC Class Codes: G08C 2201/32 Remote control based on movements, attitude of remote control device
• CPC Class Codes: G08C 2201/92 Universal remote control
• CPC Class Codes: H04M 1/72415 for remote control of appliances
• CPC Class Codes: H04M 2250/22 including a touch pad, a touch sensor or a touch detector digitizers for touch screens G06F3/041

Abstract

Handheld electronic devices are provided that have bimodal remote control functionality and gesture recognition features. The handheld electronic device may have gestural interface functionality in a first mode and graphical interface functionality in a second mode. The handheld electronic device may have remote control functionality in addition to cellular telephone, music player, or handheld computer functionality. The handheld electronic devices may have a touch sensitive display screen. The handheld electronic devices may recognize gestures performed by a user on the touch sensitive display screen. The handheld electronic devices may generate remote control signals from gestures that the handheld electronic device may recognize. A media system may receive the remote control signals and may take appropriate action. The touch sensitive display screen may be used to present the user with information about the media system such as listings of media on the media system and system parameters such as the current volume.

Claims

1. A handheld electronic device that remotely controls a media system comprising:

an orientation sensing device that determines the orientation of the handheld electronic device relative to a horizontal plane;

processing circuitry that generates remote control command information for the media system based on user input; and

wireless communications circuitry that transmits the remote control command information to the media system to remotely control the media system.

2. The handheld electronic device defined in claim 1 wherein the wireless communications circuitry is configured to operate in at least one cellular telephone communications band.

3. The handheld electronic device defined in claim 1 wherein the wireless communications circuitry is configured to operate in a local area network radio-frequency communications band and in at least one cellular telephone communications band.

4. The handheld electronic device defined in claim 1 wherein the processing circuitry is configured to implement a media player.

5. The handheld electronic device defined in claim 1 further comprising a touch screen display that receives the user input, wherein the processing circuitry is configured to switch between a first mode of operation and a second mode of operation based on the orientation of the handheld electronic device.

6. The handheld electronic device defined in claim 5 wherein in the first mode of operation the processing circuitry is configured to operate in a graphical interface mode in which the user selects media items for playback by the media system using on-screen options displayed on the touch screen display.

7. The handheld electronic device defined in claim 6 wherein the user input comprises user input generated when the user selects an icon displayed on the touch screen display and wherein in the first mode of operation the processing circuitry is configured to generate the icons that are displayed on the touch screen display.

8. The handheld electronic device defined in claim 5 wherein in the second mode of operation the processing circuitry is configured to operate in a gestural interface mode in which the user controls the media system by making media system remote control gestures on the touch screen display.

9. The handheld electronic device defined in claim 5 wherein in the first mode the processing circuitry generates icons that are displayed on the touch screen display, wherein the user input comprises a user selection of an icon displayed on the touch screen display, and wherein in the second mode the user input comprises a swipe gesture made on the touch screen display.

10. The handheld electronic device defined in claim 5 wherein in the first mode of operation the processing circuitry is configured to operate in a graphical interface mode in which the user selects media items for playback by the media system using on-screen options displayed on the touch screen display, wherein the user input comprises user input generated when the user selects an icon displayed on the touch screen display, wherein in the first mode of operation the processing circuitry is configured to generate the icons that are displayed on the touch screen display, and wherein in the second mode of operation the processing circuitry is configured in a gestural interface mode in which the user controls the media system by making media system remote control gestures including swipe gestures on the touch screen display.

11. The handheld electronic device defined in claim 5 wherein the processing circuitry is configured to switch from the first mode to the second mode when the orientation of the handheld electronic device becomes less than a given angle with respect to the horizontal plane.

12. The handheld electronic device defined in claim 5 wherein the processing circuitry is configured to switch from the second mode to the first mode when the orientation of the handheld electronic device exceeds a given angle with respect to the horizontal plane.

13. A method of remotely controlling a media system with a handheld electronic device that has a touch screen display and wireless communications circuitry, the method comprising:

with an orientation sensor in the handheld electronic device, determining the orientation of the handheld electronic device relative to a horizontal plane;

automatically operating in a first remote control user interface mode or a second remote control user interface mode based on the orientation of the handheld electronic device relative to the horizontal plane;

receiving user input from a user with the touch screen display;

generating remote control command information based on the received user input and based on the remote control user interface mode of the handheld electronic device; and

wirelessly transmitting the remote control command information to the media system with the wireless communications circuitry.

14. The method defined in claim 13 wherein the second remote control user interface mode is a gestural interface mode, the method further comprising converting a user gesture into a remote control command for the media system when in the gestural interface mode.

15. The method defined in claim 13 wherein the first remote control user interface mode is a graphical interface mode, the method further comprising displaying a global footer of options on the touch screen display in the graphical interface mode.

16. The method defined in claim 15 further comprising displaying icons on the touch screen display that may be selected by a user, wherein in the graphical interface mode the user input comprises selection by the user of one of the displayed icons on the touch screen display.

17. The method defined in claim 13 further comprising displaying icons on the touch screen display that may be selected by the user, wherein in the first remote control user interface mode the user input comprises selection by the user of one of the displayed icons on the touch screen display, and wherein in the second remote control user interface mode the user input comprises a swipe gesture made by the user on the touch screen display

18. The method defined in claim 13 further comprising:

switching from the first to the second remote control user interface mode when the orientation of the handheld electronic device relative to the horizontal plane becomes less than a first angle; and

switching from the second to the first remote control user interface mode when the orientation of the handheld electronic device relative to the horizontal plane exceeds a second angle that is larger than the first angle.

19. The method defined in claim 13 further comprising displaying a list of media systems that have available media system remotes, wherein the media system that is being remotely controlled has been selected by a user from the list of media systems that have available media system remotes.

20. A method of remotely controlling a media system with a handheld electronic device that has a touch screen display, an orientation sensor, and wireless communications circuitry, the method comprising:

with the orientation sensor in the handheld electronic device, determining the orientation of the handheld electronic device relative to a horizontal plane; and

automatically switching operation of the handheld electronic device between a graphical remote control user interface mode and a gestural remote control user interface mode based on orientation information from the orientation sensor.

21. The method defined in claim 20 further comprising:

in the gestural remote control user interface mode, receiving a gesture made on the touch screen display, wherein the gesture comprises a swipe gesture.

22. The method defined in claim 20 further comprising:

in the graphical remote control user interface mode, displaying a list of selectable media items on the touch screen display.

23. The method defined in claim 20 further comprising:

in the graphical remote control user interface mode, displaying selectable on-screen menu options.

24. The method defined in claim 20 further comprising:

in the gestural remote control user interface mode, receiving a gesture made on the touch screen display, wherein the gesture comprises a swipe gesture;

displaying a list of selectable media items on the touch screen display; and

displaying selectable on-screen menu options.