Method for capturing and transmitting motion data

• US 9,335,829 B2
• Filed: 07/10/2015
• Issued: 05/10/2016
• Est. Priority Date: 02/17/2010
• Status: Active Grant

• Current Assignee: RingCentral Incorporated
• Original Assignee: Unify GmbH & Co. KG (Atos SE)
• Inventors: Bozionek, Bruno, Klaghofer, Karl, Prange, Holger, Tietsch, Michael
• Primary Examiner(s): Lubit, Ryan A
• Application Number:
  US14/795,998
• Publication Number:
  US 20150316997A1
• Time in Patent Office: 305 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: H04L 65/1096 Supplementary features, e.g. call forwarding or call holding systems providing special services or facilities to telephony subscribers H04M3/42
• CPC Class Codes: H04Q 2209/82 where the sensing device takes the initiative of sending data
• CPC Class Codes: H04Q 9/00 Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom
• CPC Class Codes: H04W 4/21 for social networking applications

Abstract

In a method for capturing and transmitting motion data (s1) from a transmitter (103, 203) to a receiver (104, 204), motion data is captured by a capturing device (102, 202) at the transmitter end, said capturing device (102, 202) registering the motion of an object (106, 206) by means of at least one sensor (101, 201) and converting the registered motion into a digital signal (i2). Said digital signal is fed to the receiver, which embeds the data of the digital signal (i2) in a series (i3) of data and transmits said series of data to a receiver. In addition to or instead of the data of the digital signal, the series of data transmitted by the transmitter contains context data which the receiver uses to interpret and process the originally captured motion data within a defined context.

Claims

1. A method for capturing and transmitting motion information, comprising:

receiving, by a first communication terminal, a digital signal, data of the digital signal comprising features derived or extracted from video sequences;

determining context data based on the data of the digital signal by the first communication terminal;

sending the context data by the first communication terminal together with the data from the digital signal or instead of the data from the digital signal, to a receiver, the context data describing a gesture made by the object by identifying a relative change in a relative direction of the object and a meaning of that identified relative change, the first communication terminal having a Voice-over-IP function to transmit the context data,

wherein at least one action by the receiver is triggered based on the context data.

2. The method of claim 1, wherein the receiver is a second communication terminal or a server communication device.

3. The method of claim 2, wherein the transmitted data sent to the receiver enables the receiver to output user information corresponding to the captured motion information.

4. The method of claim 2, comprising:

outputting, by the receiver, the user information visually or audio-visually.

5. The method of claim 1, comprising transmitting data of the captured motion information via a packet-based network.

6. The method of claim 2, comprising agreeing upon communications modalities between the first communication terminal and the receiver via a protocol that enables the context data to be transmitted using a pre-selected data format.

7. The method of claim 6, wherein the pre-selected data format enables the transmission of the context data to include spatial coordinates and time inputs.

8. The method of claim 7, wherein the communications modalities are agreed upon using Session Initiation Protocol and the data of the digital signal is transmitted using Real-Time Transport Protocol.

9. The method of claim 1, wherein the data from the digital signal comprises information of at least one member of the group consisting of motion vectors, spatial coordinates, velocities, acceleration rates of the moved object, and time information associated with at least one of the motion vectors, the spatial coordinates, the velocities, and the acceleration rates.

10. The method of claim 1, wherein the context data comprises a textual description of a motion sequence and a meaning of the motion sequence.

11. The method of claim 2, comprising:

capturing motion information via a capturing device registering motion of an object via at least one sensor and converting the registered motion into the digital signal that is sent to a first communication terminal.

12. The method of claim 11, wherein the capturing device is comprised of a video camera, and wherein the context data is comprised of information identifying an affirmative response based on data of the digital signal indicating the object moved upward and downwards received by the first communication terminal.

13. The method of claim 2, wherein at least the first communication terminal is comprised of a computer device equipped with software that provides the Voice-over-IP function.

14. The method of claim 1, wherein the context data is sent by the first communication terminal in a message that includes information identifying a direction of motion and information defining a context of that motion information, the information defining the context of the motion comprises one of:

(i) information identifying that a yes response is indicated by upward motion or downward motion and that a no response is indicated by leftward motion or rightward motion, and

(ii) information identifying that a response to direct attention to an observer of the object is indicated by upward motion, downward motion, or sideward motion.

15. A system for capturing and transmitting motion data, comprising:

a first communication terminal configured to receive a digital signal, data of the digital signal comprising features derived or extracted from video sequences, the first communication terminal configured to determine context data based on the data of the digital signal by the first communication terminal, and the first communication terminal configured to send the context data together with the data from the digital signal or instead of the data from the digital signal to a receiver, the context data describing a gesture made by an object by identifying a relative change in a relative direction of the object and a meaning of that identified relative change, the first communication terminal having a Voice-over-IP function to transmit the context data,

wherein at least one action by the receiver is triggered based on the context data.

16. The system of claim 15, comprising the receiver, the receiver being a second communication terminal or a server computer device, the receiver being communicatively connectable to the first communication terminal.

17. The system of claim 15, comprising:

a capturing device communicatively connectable to the first communication terminal, the capturing device configured to send the digital signal to the first communication terminal.

18. The system of claim 15, wherein the first communication terminal is configured so that the context data is sent by the first communication terminal in a message that includes information identifying a direction of motion and information defining a context of that motion information;

and

wherein the first communication terminal is comprised of a computer device equipped with software that provides the Voice-over-IP function.

19. The system of claim 18, wherein the information defining the context of the motion comprises information identifying that a yes response is indicated by upward motion or downward motion and that a no response is indicated by leftward motion or rightward motion.

20. The system of claim 18, wherein the information defining the context of the motion comprises information identifying that a response to direct attention to an observer of the object is indicated by upward motion, downward motion, or sideward motion.