Method for realizing user interface using camera and mobile communication terminal for the same

• US 10,545,645 B2
• Filed: 12/04/2017
• Issued: 01/28/2020
• Est. Priority Date: 06/20/2005
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Kim, Soon-Ok, Kim, Dae-Gyu, Park, Yong-Soo
• Primary Examiner(s): Patel, Mahendra R
• Application Number:
  US15/830,751
• Publication Number:
  US 20180088782A1
• Time in Patent Office: 785 Days
• Field of Search: 455566, 4555661, 4555662, 370335, 370342
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/332 using wireless networks, e.g. cellular phone networks
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/533 for prompting the player, e.g. by displaying a game menu
• CPC Class Codes: A63F 13/57 Simulating properties, behaviour or motion of objects in the game world, e.g. computing tyre load in a car race game A63F13/56 takes precedence
• CPC Class Codes: A63F 13/92 Video game devices specially adapted to be hand-held while playing
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/204 the platform being a handheld device
• CPC Class Codes: A63F 2300/308 Details of the user interface
• CPC Class Codes: A63F 2300/406 Transmission via wireless network, e.g. pager or GSM
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/6063 for sound processing
• CPC Class Codes: A63F 2300/64 for computing dynamical parameters of game objects, e.g. motion determination or computation of frictional forces for a virtual car
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 1/72469 for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q

Abstract

A method for realizing a user interface using a camera module and a mobile communication terminal for the same. If a user makes a predetermined motion in a state in which the camera module of the mobile communication terminal is activated, the mobile communication terminal performs a predetermined action according to the motion pattern by recognizing the user motion and patterning the motion. In this case, the action performed according to the motion pattern corresponds to mouse control in a mouse mode, game control in a game mode, and character input in a character input mode.

Claims

1. An apparatus comprising:

a memory configured to store a first instruction corresponding to a first function to be provided by the apparatus, and a second instruction corresponding to a second function to be provided by the apparatus; and

a controller configured to;

activate a camera operatively coupled with the apparatus based at least in part on a specified application;

analyze images obtained by the camera;

recognize a user motion represented in the images based at least on the analyzing;

perform the first function according to the first instruction in response to the user motion if the specified application is a first specified application; and

perform the second function according to the second instruction in response to the user motion if the specified application is a second specified application.

2. The apparatus of claim 1, wherein the controller is further configured to:

perform a corresponding one of the first function and the second function according to the user motion as if the user motion is received via a mouse operatively coupled with the apparatus.

3. The apparatus of claim 1, wherein the controller is further configured to:

perform a corresponding one of the first function and the second function according to the user motion as if the user motion were an input received via a key operatively coupled with the apparatus.

4. The apparatus of claim 1, wherein the controller is further configured to:

present, via a display operatively coupled with the apparatus, an indication corresponding to the user motion.

5. The apparatus of claim 4, wherein the controller is further configured to:

move, as at least part of the presenting, the indication from a first location to a second location in the display in response to the user motion.

6. The apparatus of claim 1, wherein the controller is further configured to:

present, via a display operatively coupled with the apparatus, one or more menus or one or more icons as at least part of executing of the specified application; and

select a menu of the one or more menus or an icon of the one or more icons, as at least part of the performing of a corresponding one of the first function and the second function.

7. The apparatus of claim 1, wherein the controller is further configured to:

determine a character based at least in part on a trace corresponding to the user motion, as at least part of the performing of a corresponding one of the first function and the second function.

8. The apparatus of claim 7, wherein the controller is further configured to:

provide the character to the apparatus as at least part of an input.

9. The apparatus of claim 7, further comprising a transceiver, wherein the controller is further configured to:

transmit, using the transceiver, the character to an external electronic device.

10. A method comprising:

activating, at an electronic device, a camera operatively coupled with the electronic device based at least in part on a specified application;

analyzing images obtained by the camera;

recognizing a user motion represented in the images based at least on the analyzing;

performing a first function in response to the user motion if the specified application is a first specified application; and

performing a second function in response to the user motion if the specified application is a second specified application.

11. The method of claim 10, wherein performing a corresponding one of the first function and the second function comprises:

presenting, via a display operatively coupled with the electronic device, an indication corresponding to the user motion.

12. The method of claim 11, wherein the presenting comprises:

moving the indication from a first location to a second location in the display in response to the user motion.

13. The method of claim 10, wherein performing a corresponding one of the first function and the second function comprises:

presenting a character pattern based at least in part on a trace corresponding to the user motion.

14. The method of claim 10, wherein performing a corresponding one of the first function and the second function comprises:

selecting a menu of one or more menus or an icon of one or more icons presented via a display operatively coupled with the apparatus.

15. A non-transitory machine-readable storage device storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

identifying, at an electronic device, a camera operatively coupled with the electronic device based at least in part on a specified application;

analyzing images obtained by the camera;

recognizing a user motion represented in the images based at least on the analyzing;

performing a first function in response to the user motion if the specified application is a first specified application; and

performing a second function in response to the user motion if the specified application is a second specified application.

16. The non-transitory machine-readable storage device of claim 15, wherein the identifying comprises:

activating the camera based at least in part on a determination that the specified application corresponds to a specified game application.

17. The non-transitory machine-readable storage device of claim 15, wherein the performing of a corresponding one of the first function and the second function comprises:

providing, via an output device operatively coupled with the electronic device, a user interface in relation with the specified application, the user interface representing an action corresponding to the user motion.

18. The non-transitory machine-readable storage device of claim 15, wherein the performing of a corresponding one of the first function and the second function comprises:

presenting, via a display operatively coupled with the electronic device, an indication corresponding to the user motion.

19. The non-transitory machine-readable storage device of claim 18, wherein the presenting comprises:

moving the indication from a first location to a second location in the display in response to the user motion.

20. The non-transitory machine-readable storage device of claim 15, wherein performing a corresponding one of the first function and the second function comprises:

selecting a menu of one or more menus or an icon of one or more icons presented via a display operatively coupled with the apparatus.