Method and apparatus for performing communication service based on gesture

• US 10,019,067 B2
• Filed: 06/04/2014
• Issued: 07/10/2018
• Est. Priority Date: 06/11/2013
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Yoon, Yeo-jun, Kumar, Nipun, Lee, Yong-yeon, Choi, Young-joon
• Primary Examiner(s): Choi, David
• Application Number:
  US14/295,387
• Publication Number:
  US 20140365979A1
• Time in Patent Office: 1,497 Days
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/015 Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions
• CPC Class Codes: H04M 2250/64 file transfer between terminals download of applications H04M1/72406; transfer of messages, e.g. SMS, e-mail or MMS H04M1/7243
• CPC Class Codes: H04W 4/21 for social networking applications

Abstract

A method and an apparatus for performing gesture-based communication service are provided, in which a first device detects a first motion, and when the first motion corresponds to a first gesture that belongs to a gesture group, receives information about a second motion from a second device. The first device may perform an event that corresponds to a combination of the first and second gestures, when the received information corresponds to the second gesture that belongs to the gesture group.

Claims

1. A method for performing a communication service at a first device with a second device, the method comprising:

detecting, by the first device, a first motion of the first device in a state that a communication link with the second device is not established;

when the first motion of the first device corresponds to a first gesture that belongs to a predetermined gesture group, establishing, by the first device, the communication link with the second device;

receiving, by the first device, information on a second motion of the second device through the communication link from the second device;

determining, by the first device, whether the second motion of the second device corresponds to a second gesture that belongs to the predetermined gesture group based on the received information; and

when the second motion of the second device corresponds to the second gesture that belongs to the predetermined gesture group, transmitting, by the first device, a condition match reply indicating that the second motion of the second device corresponds to the second gesture, to the second device and performing, by the first device, an event that corresponds to a combination of the first gesture and the second gesture.

2. The method of claim 1, wherein the first motion of the first device comprises at least one from among:

first acceleration information with respect to the first device; and

first direction information representing a direction where the first device moves, and

the second motion of the second device comprises at least one from among;

second acceleration information with respect to the second device; and

second direction information representing a direction where the second device moves.

3. The method of claim 1, wherein the detecting the first motion comprises detecting at least one from among:

first acceleration information with respect to the first device and first direction information representing a direction where the first device moves.

4. The method of claim 1, wherein the first device and the second device have at least one form from among a band shape, a wrist watch shape and a bracelet shape.

5. The method of claim 1, wherein the performing the event is implemented when the received information corresponds to the second gesture and when a difference between a time point of detecting the first motion of the first device that corresponds to the first gesture and a time point of detecting the second motion of the second device that corresponds to the second gesture, is smaller than a time.

6. The method of claim 1, wherein the receiving the information about the second motion of the second device comprises:

searching a service set identifier (SSID); and

when failing to find the SSID, broadcasting the SSID.

7. The method of claim 1, wherein the combination of the first gesture and the second gesture comprises first and second gestures which are substantially identical to each other.

8. The method of claim 1, wherein the combination of the first gesture and the second gesture comprises first and second gestures with substantially identical trajectory and opposite directions of motion.

9. The method of claim 1, further comprising:

prior to the detecting the first motion of the first device, retaining, at a memory, one or more combinations of a plurality of gestures comprising the first gesture and the second gesture that belong to the gesture group.

10. The method of claim 9, wherein the one or more combinations comprise sub gestures generated at two or more different devices, and when the sub gestures are generated together, a corresponding event is performed.

11. The method of claim 9, further comprising additionally retaining, at the memory, one or more independent gestures that are generated at one device and that correspond to an input event made to a user interface of the one device, separately from the one or more combinations.

28. The method of claim 1, wherein the second device is located adjacent to the first device.

29. The method of claim 1, wherein the first gesture and the second gesture are performed substantially simultaneously.

12. A first device for performing a communication service with a second device, the first device comprising:

a sensor which detects a first motion of the first device in a state that a communication link with the second device is not established;

a communication protocol module which, when the first motion of the first device corresponds to a first gesture that belongs to a predetermined gesture group, establishes the communication link with the second device and receives information on a second motion of the second device through the communication link from the second device; and

a processor which, when the received information corresponds to a second gesture that belongs to the predetermined gesture group, transmits a condition match reply indicating that the second motion of the second device corresponds to the second gesture, to the second device, and causes an event that corresponds to a combination of the first gesture and the second gesture to be performed.

13. The first device of claim 12, wherein the first motion of the first device comprises at least one from among:

first acceleration information with respect to the first device; and

first direction information representing a direction where the first device moves, and

the second motion of the second device comprises at least one from among;

second acceleration information with respect to the second device; and

second direction information representing a direction where the second device moves.

14. The first device of claim 13, wherein the sensor and another sensor of the second device each comprise at least one from among an optical sensor and an electromyogram sensor.

15. The first device of claim 12, wherein the sensor detects the first motion by detecting at least one from among:

first acceleration information with respect to the first device and first direction information representing a direction where the first device moves.

16. The first device of claim 12, wherein the first device and the second device have at least one form from among a band shape, a wrist watch shape and a bracelet shape.

17. The first device of claim 12, wherein the processor controls so that the event is implemented when the received information corresponds to the second gesture and when a difference between a time point of detecting the first motion of the first device that corresponds to the first gesture and a time point of detecting the second motion of the second device that corresponds to the second gesture, is smaller than a time.

18. The first device of claim 12, wherein, prior to receiving the information about the second motion of the second device, the communication protocol module searches a service set identifier (SSID), and when failing to find the SSID, broadcasts the SSID.

19. The first device of claim 12, wherein the combination of the first gesture and the second gesture comprises first and second gestures which are substantially identical to each other.

20. The first device of claim 12, wherein the combination of the first gesture and the second gesture comprises first and second gestures with substantially identical trajectory and opposite directions of motion.

21. The first device of claim 12, further comprising a memory configured to retain one or more combinations of a plurality of gestures comprising the first and second gestures that belong to the gesture group, prior to the detecting the first motion of the first device.

22. The first device of claim 21, wherein the one or more combinations comprise sub gestures generated at two or more different devices, and when the sub gestures are generated together, a corresponding event is performed.

23. The first device of claim 21, wherein the memory additionally retains one or more independent gestures that are generated at one device and that correspond to an input event made to a user interface of the one device, separately from the one or more combinations.

30. The first device of claim 12, wherein the second device is located adjacent to the first device.

31. The first device of claim 12, wherein the first gesture and the second gesture are performed substantially simultaneously.

24. A method for performing a communication service at a first device with a second device, the method comprising:

storing, by the first device, a gesture group that comprises a plurality of gestures corresponding to sequential events, the plurality of gestures including a first gesture and a second gesture;

detecting, by the first device, a motion at the first device in a state that a communication link with the second device is not established;

when identifying from the detected motion the first gesture that corresponds to a first event among the plurality of gestures, establishing, by the first device, the communication link with the second device and performing, by the first device, the first event by transmitting request information to the second device; and

when the second gesture corresponding to a second event following the first event is generated at the second device among the plurality of gestures, performing, by the first device, the second event of receiving reply information transmitted from the second device.

25. A first device for performing a communication service with a second device, the first device comprising:

a memory which stores a gesture group that comprises a plurality of gestures corresponding to sequential events, the plurality of gestures including a first gesture and a second gesture;

a sensor which detects a motion in a state that a communication link with the second device is not established;

a processor which, when identifying, from the detected motion, the first gesture that corresponds to a first event among the plurality of gestures, establishes the communication link with the second device and causes the first event to be performed, in which request information is transmitted to the second device; and

a communication protocol module which, when the second gesture corresponding to a second event following the first event is generated at the second device among the plurality of gestures, performs the second event of receiving reply information transmitted from the second device.

26. A method for performing a communication service at a second device with a first device, the method comprising:

detecting, by the second device, a second motion of the second device in a state that a communication link with the first device is not established;

when the second motion of the second device corresponds to a second gesture that belongs to a gesture group, establishing, by the second device, the communication link with the first device and transmitting, by the second device, information about the second motion of the second device through the communication link to the first device; and

when detecting, at the first device, a first motion of the first device that corresponds to a first gesture belonging to the gesture group within a set time before or after detecting the second motion of the second device, performing, by the second device, an event that corresponds to a combination of the first and second gestures.

27. A second device for performing a communication service with a first device, the second device comprising:

a sensor which detects a second motion of the second device in a state that a communication link with the second device is not established;

a communication protocol module which, when the second motion corresponds to a second gesture that belongs to a gesture group, establishes the communication link with the first device and transmits information about the second motion through the communication link to the first device; and

a processor which, when detecting, at the first device, a first motion of the first device that corresponds to a first gesture belonging to the gesture group within a time before or after detecting the second motion of the second device, causes an event that corresponds to a combination of the first gesture and the second gesture to be performed.