METHOD FOR REALIZING USER INTERFACE USING CAMERA AND MOBILE COMMUNICATION TERMINAL FOR THE SAME

• US 20180088782A1
• Filed: 12/04/2017
• Published: 03/29/2018
• Est. Priority Date: 06/20/2005
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: KIM, Soon-Ok, KIM, Dae-Gyu, PARK, Yong-Soo
• Granted Patent: US 10,545,645 B2
• Time in Patent Office: Days
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/332 using wireless networks, e.g. cellular phone networks
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/533 for prompting the player, e.g. by displaying a game menu
• CPC Class Codes: A63F 13/57 Simulating properties, behaviour or motion of objects in the game world, e.g. computing tyre load in a car race game A63F13/56 takes precedence
• CPC Class Codes: A63F 13/92 Video game devices specially adapted to be hand-held while playing
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/204 the platform being a handheld device
• CPC Class Codes: A63F 2300/308 Details of the user interface
• CPC Class Codes: A63F 2300/406 Transmission via wireless network, e.g. pager or GSM
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/6063 for sound processing
• CPC Class Codes: A63F 2300/64 for computing dynamical parameters of game objects, e.g. motion determination or computation of frictional forces for a virtual car
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 1/72469 for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q

Abstract

A method for realizing a user interface using a camera module and a mobile communication terminal for the same. If a user makes a predetermined motion in a state in which the camera module of the mobile communication terminal is activated, the mobile communication terminal performs a predetermined action according to the motion pattern by recognizing the user motion and patterning the motion. In this case, the action performed according to the motion pattern corresponds to mouse control in a mouse mode, game control in a game mode, and character input in a character input mode.

Claims

1. An apparatus comprising:

a processor-implemented controller configured to;

identify an application activated in relation with the apparatus;

identify a gesture using a camera operatively coupled with the apparatus;

perform a first function in response to the gesture if the application is a first application; and

perform a second function in response to the gesture if the application is a second application.

2. The apparatus of claim 1, wherein the controller is configured to:

determine activation of the camera based at least in part on a type of the application.

3. The apparatus of claim 1, wherein a corresponding one of the first function and the second function is to be performed as if the gesture were an input received via a mouse associated with the apparatus.

4. The apparatus of claim 1, wherein a corresponding one of the first function and the second function is to be performed as if the gesture were an input received via a key associated with the apparatus.

5. The apparatus of claim 1, wherein the processor-implemented controller is configured to:

present, via a display operatively coupled with the apparatus, an indication corresponding to the gesture.

6. The apparatus of claim 5, wherein the processor-implemented controller is configured to:

move, via the display, the indication from a first location to a second location in response to the gesture.

7. The apparatus of claim 1, wherein the processor-implemented controller is configured to:

select a menu or an icon in relation with the application as at least part of a corresponding one of the first function and the second function.

8. The apparatus of claim 1, wherein the processor-implemented controller is configured to:

determine a character corresponding to the gesture as at least part of a corresponding one of the first function and the second function.

9. The apparatus of claim 8, wherein the controller is configured to:

provide the character to the application as an input.

10. The apparatus of claim 8, wherein the controller is configured to:

transmit the character to an electronic device external to the apparatus.

11. The apparatus of claim 1, wherein at least one of the first application or the second application comprises a game application, a message application, a memo application, an internet application, or a schedule application.

12. A method comprising:

identifying, at an electronic device, an application activated in relation with the electronic device;

identifying a gesture using a camera operatively coupled with the electronic device;

performing a first function in response to the gesture if the application is a first application; and

performing a second function in response to the gesture if the application is a second application.

13. The method of claim 12, wherein the identifying of the application comprises:

activating the camera based at least in part on a determination that the application is a first type of application; and

refraining from activating the camera based at least in part on a determination that the application is a second type of application.

14. The method of claim 12, wherein a corresponding one of the first function and the second function is performed as if the gesture were an input received via a mouse associated with the electronic device.

15. The method of claim 12, wherein a corresponding one of the first function and the second function being performed comprises:

presenting, via a display operatively coupled with the electronic device, an indication corresponding to the gesture.

16. The method of claim 15, wherein a corresponding one of the first function and the second function being performed comprises:

moving, via the display, the indication from a first location to a second location in response to the gesture.

17. The method of claim 12, wherein a corresponding one of the first function and the second function being performed comprises:

determining a character corresponding to the gesture.

18. The method of claim 17, wherein the corresponding one of the first function and the second function being performed comprises:

providing the character to the application as an input.

19. The method of claim 12, wherein a corresponding one of the first function and the second function being performed comprises:

providing, via an output device operatively coupled with the electronic device, a user interface in relation with the application, the user interface representing an action corresponding to the gesture.

20. A non-transitory machine-readable storage device storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

identifying an application activated in relation with an electronic device;

identifying a gesture using a gesture sensor operatively coupled with the electronic device;

performing a first function in response to the gesture if the application is a first application; and

performing a second function in response to the gesture if the application is a second application.