Method for capturing and transmitting motion data

• US 9,110,511 B2
• Filed: 01/28/2011
• Issued: 08/18/2015
• Est. Priority Date: 02/17/2010
• Status: Active Grant

• Current Assignee: RingCentral Incorporated
• Original Assignee: Unify GmbH & Co. KG (Atos SE)
• Inventors: Bozionek, Bruno, Klaghofer, Karl, Prange, Holger, Tietsch, Michael
• Primary Examiner(s): Lubit, Ryan A
• Application Number:
  US13/263,832
• Publication Number:
  US 20120119993A1
• Time in Patent Office: 1,663 Days
• Field of Search: 345156-184, 715/863
• US Class Current: 1/1
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: H04L 65/1096 Supplementary features, e.g. call forwarding or call holding systems providing special services or facilities to telephony subscribers H04M3/42
• CPC Class Codes: H04Q 2209/82 where the sensing device takes the initiative of sending data
• CPC Class Codes: H04Q 9/00 Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom
• CPC Class Codes: H04W 4/21 for social networking applications

Abstract

In a method for capturing and transmitting motion data (s1) from a transmitter (103, 203) to a receiver (104, 204), motion data is captured by a capturing device (102, 202) at the transmitter end, said capturing device (102, 202) registering the motion of an object (106, 206) by means of at least one sensor (101, 201) and converting the registered motion into a digital signal (i2). Said digital signal is fed to the receiver, which embeds the data of the digital signal (i2) in a series (i3) of data and transmits said series of data to a receiver. In addition to or instead of the data of the digital signal, the series of data transmitted by the transmitter contains context data which the receiver uses to interpret and process the originally captured motion data within a defined context.

Claims

1. A method for capturing and transmitting motion information from a transmitter to a receiver, comprising:

capturing motion information via a capturing device at a transmitter location registering motion of an object via at least one sensor and converting the registered motion into a digital signal that is sent to a first communication terminal at the transmitter location, data of the digital signal comprising features derived or extracted from video sequences;

determining context data based on the data of the digital signal by the first communication terminal;

sending the context data by the first communication terminal together with the data from the digital signal or instead of the data from the digital signal, to a receiver, the receiver being a

second communication terminal or a server communication device, the context data describing a gesture made by the object by identifying a relative change in a relative direction of the object and a meaning of that identified relative change, at least one of the first communication terminal and the receiver having a Voice-over-IP function to transmit or receive the context data;

triggering, by the receiver, at least one action based on the context data that is sent by the first communication terminal to the receiver.

2. The method of claim 1, wherein the transmitted data sent to the receiver enables the receiver to output user information corresponding to the captured motion information.

3. The method of claim 2, wherein the user information is output audio-visually.

4. The method of claim 1, comprising transmitting data of the captured motion information via a packet-based network.

5. The method of claim 4, comprising agreeing upon communications modalities between the first communication terminal and the receiver via a protocol that enables the context data to be transmitted using a specialized data format.

6. The method of claim 5, wherein the specialized data format enables the transmission of the context data to include spatial coordinates and time inputs.

7. The method of claim 5, wherein the communications modalities are agreed upon using Session Initiation Protocol and the data of the digital signal is transmitted using Real-Time Transport Protocol.

8. The method of claim 1, wherein the data from the digital signal comprises information of at least one member of the group consisting of motion vectors, spatial coordinates, velocities, acceleration rates of the moved object, and time information associated with at least one of the motion vectors, the spatial coordinates, the velocities, and the acceleration rates.

9. The method of claim 1, wherein the context data comprises a textual description of a motion sequence and a meaning of the motion sequence.

10. The method of claim 1, wherein at least one of the data of the digital signal and the context data are transmitted from the first communication terminal to the receiver in a data stream via events and wherein the receiver is the second communication terminal.

11. The method of claim 1, wherein the capturing device is comprised of a headset equipped with motion sensors for recording movements of a person wearing the headset.

12. The method of claim 1, wherein the first communication terminal is a Session Initiation Protocol phone.

13. The method of claim 1, wherein at least one of the first communication terminal and the receiver is comprised of a computer or personal digital assistant equipped with software that provides the Voice-over-IP function.

14. The method of claim 1, wherein receiver is a telephone, the at least one sensor comprises a video camera, and wherein the context data is comprised of information identifying an affirmative response based on data of the digital signal indicating the object moved upward and downwards received by the first communication terminal from the capturing device.

15. The method of claim 1, wherein the context data is sent by the first communication terminal in a message formed in accordance with Session Initiation Protocol (SIP) having a motion header field and includes information identifying a direction of motion and information defining a context of that motion information.

16. The method of claim 15, wherein the information defining the context of the motion comprises information identifying that a yes response is indicated by upward motion or downward motion and that a no response is indicated by leftward motion or rightward motion.

17. The method of claim 15, wherein the information defining the context of the motion comprises information identifying that a response to direct a focus of attention to an observer of the object is indicated by upward motion, downward motion, or sideward motion.

18. A system for capturing and transmitting motion data, comprising:

a capturing device;

at least one sensor communicatively connected to the capturing device, the sensor configured to generate motion data based on motion of an object detected by the sensor, the sensor configured to send the generated motion data to the capturing device;

the capturing device configured to register motion of the object based on the motion data received from the sensor and convert the motion data into a digital signal, data of the digital signal comprising features derived or extracted from video sequences;

a first communication terminal communicatively connected to the capturing device;

the capturing device configured to send the digital signal to the first communication terminal;

the first communication terminal configured to generate context data based on the received digital signal, the context data describing a gesture made by the object by identifying a meaning of a motion detected by the capturing device based on the digital signal;

a receiver communicatively connected to the first communication terminal, the receiver being a second communication terminal or a server computer device, the receiver configured to receive the context data from the first communication terminal and generate at least one piece of information based on the received context data for sending to an output device; and

wherein at least one of the first communication terminal and the receiver has a Voice-over-IP function to transmit or receive the context data.

19. The system of claim 18, wherein the receiver is a telephone or a computer and the output device is communicatively connected to the computer or the telephone.

20. The system of claim 18, wherein the first communication terminal is a telephone and the receiver is a telephone, and wherein the at least one sensor is comprised of a video camera.

21. The system of claim 20, wherein the context data is comprised of information indicating that an affirmative response is indicated by data of the digital signal indicating the object moved upward and downwards and a negative response is indicated by data of the digital signal indicating the object moved right and left.

22. The system of claim 18, wherein the receiver is the server computer device.

23. The system of claim 18, wherein the context data comprises:

at least one of motion vectors, spatial coordinates, velocities, and acceleration rates of the moved object, and the context data also comprises time information associated with at least one of the motion vectors, the spatial coordinates, the velocities, and the acceleration rates.

24. The system of claim 18, wherein the context data is sent by the first communication terminal in a message formed in accordance with Session Initiation Protocol (SIP) having a motion header field and includes information identifying a direction of motion and information defining a context of that motion information.

25. The system of claim 24, wherein the information defining the context of the motion comprises information identifying that a yes response is indicated by upward motion or downward motion and that a no response is indicated by leftward motion or rightward motion.

26. The system of claim 24, wherein the information defining the context of the motion comprises information identifying that a response to direct attention to an observer of the object is indicated by upward motion, downward motion, or sideward motion.