APPARATUS AND METHOD FOR EXECUTING A MENU IN A WIRELESS TERMINAL

• US 20100103105A1
• Filed: 10/28/2009
• Published: 04/29/2010
• Est. Priority Date: 10/28/2008
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Park, Se-Hwan
• Granted Patent: US 10,048,782 B2
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: G06F 3/0386 for light pen
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42206 characterized by hardware details
• CPC Class Codes: H04N 21/42209 for displaying non-command information, e.g. electronic program guide [EPG], e-mail, messages or a second television channel
• CPC Class Codes: H04N 21/4222 Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy remote control device for a television receiver integrated into a mobile phone H04M1/72415
• CPC Class Codes: H04N 21/42221 Transmission circuitry, e.g. infrared [IR] or radio frequency [RF]
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/43637 involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11] arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 5/144 Movement detection for video coding H04N19/503; analysis of motion in general G06T7/20

Abstract

A menu execution apparatus and method for conveniently providing a menu in a wireless terminal are provided. The apparatus includes a pointer unit for indicating a specific object in a menu execution recognition mode. A camera photographs the object indicated by the pointer unit in the menu execution recognition mode. A controller controls an operation for recognizing the object indicated by the pointer unit and photographed by the camera and displaying a menu for controlling the recognized object.

Claims

1. An apparatus for executing a menu in a wireless terminal, comprising:

a pointer unit for indicating a specific object in a menu execution recognition mode;

a camera for photographing the object indicated by the pointer unit in the menu execution recognition mode; and

a controller for controlling an operation for recognizing the object indicated by the pointer unit and photographed by the camera, and displaying a menu for controlling the recognized object.

2. The apparatus of claim 1, further comprising:

a sensor for sensing motion of the wireless terminal.

3. The apparatus of claim 1, wherein the pointer unit and the camera are mounted at a same position.

4. The apparatus of claim 1, wherein the controller controls the camera to operate when no motion of a user is sensed during a given time after the pointer unit operates in the menu execution recognition mode, and controls an operation for comparing a first image, captured by photographing the object indicated by a pointer of the pointer unit using the camera, to a second image captured by photographing the object after the pointer unit is terminated, and extracting values of pixels hidden by the pointer displayed on the first image from the second image.

5. The apparatus of claim 4, wherein the controller controls an operation for setting a minimal unit area around the pointer displayed on the first image and determining a recognition type through an image included in the minimal unit area.

6. The apparatus of claim 5, wherein the recognition type is determined by applying a priority for recognition.

7. The apparatus of claim 5, wherein the controller controls an operation for recognizing letters by extending the minimal unit area in a given area unit when the recognition type is letters and displaying a menu for controlling the letters, and controls an operation for recognizing an external device corresponding to a shape by extending the minimal unit area in a given area unit when the recognition type is the shape and displaying a menu for controlling the external device.

8. The apparatus of claim 1, wherein the controller controls the pointer unit and the camera to simultaneously operate in the menu execution recognition mode, and controls an operation for displaying a menu to control an image included in a specific area when the specific area is designated by the pointer unit on an image captured by photographing a specific object using the camera.

9. The apparatus of claim 8, wherein the controller controls an operation for storing an image of the specific object photographed by the camera and extracting the specific area having pixel values, corresponding to a plurality of points indicated by the pointer unit, as boundary values from the image.

10. A method for executing a menu in a wireless terminal including a pointer unit and camera, the method comprising:

indicating a specific object by the pointer unit when the wireless terminal switches to a menu execution recognition mode;

photographing the object indicated by the pointer unit using the camera; and

recognizing, by the wireless terminal, the photographed object and displaying a menu for controlling the recognized object.

11. The method of claim 10, further comprising:

sensing motion of the wireless terminal when the pointer unit operates to indicate the specific object; and

operating the camera for photographing the object indicated by the pointer unit when no motion of the wireless terminal is sensed during a given time.

12. The method of claim 10, wherein displaying the menu includes:

storing a first image captured by photographing the object indicated by a pointer of the pointer unit;

terminating an operation of the pointer unit after the first image is captured;

storing a second image captured by photographing the same object as the first image after the pointer unit is terminated;

extracting pixel values of a portion hidden by the pointer displayed on the first image from the second image by comparing the first image to the second image; and

extracting an image included in an area set around the pointer displayed on the first image and displaying a menu for controlling the extracted image.

13. The method of claim 12, wherein displaying the menu includes:

setting a minimal unit area around the pointer displayed on the first image;

extracting an image included in a minimal unit area and determining a recognition type through the extracted image;

extracting letters while extending the minimal unit area in a given area unit when the recognition type is the letters, and displaying a menu for controlling the extracted letters; and

determining an external device corresponding to a shape while extending the minimal unit area in a given area unit when the recognition type is the shape and displaying a menu for controlling the external device.

14. The method of claim 12, wherein the recognition type is determined by applying a priority for recognition.

15. A method for executing a menu in a wireless terminal, comprising:

simultaneously operating a pointer unit and a camera when the wireless terminal switches to a menu execution recognition mode;

designating a specific area by the pointer unit on an image captured by photographing a specific object using the camera; and

displaying a menu for controlling an image included in the specific area.

16. The method of claim 15, wherein designating the specific area includes:

storing an image captured by photographing a specific object using the camera;

extracting pixel values, corresponding to a plurality of points indicated by the pointer unit, from the captured image; and

extracting a specific area having the pixel values at boundary points.