Virtual world processing device and method

• US 9,108,106 B2
• Filed: 06/23/2010
• Issued: 08/18/2015
• Est. Priority Date: 06/25/2009
• Status: Active Grant

• Current Assignee: Myongji University Industry and Academia Cooperation Foundation, Samsung Electronics Co. Ltd.
• Original Assignee: Myongji University Industry and Academia Cooperation Foundation, Samsung Electronics Co. Ltd.
• Inventors: Han, Seung Ju, Han, Jae Joon, Bang, Won Chul, Kim, Do Kyoon, Kim, Sang Kyun
• Primary Examiner(s): Uddin, Mohammed R
• Application Number:
  US13/380,743
• Publication Number:
  US 20120191737A1
• Time in Patent Office: 1,882 Days
• Field of Search: 707/756, 707/601, 707/805, 707/999.101
• US Class Current: 1/1
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/215 comprising means for detecting acoustic signals, e.g. using a microphone
• CPC Class Codes: A63F 13/216 using geographical information, e.g. location of the game device or player using GPS
• CPC Class Codes: A63F 13/217 using environment-related information, i.e. information generated otherwise than by the player, e.g. ambient temperature or humidity
• CPC Class Codes: A63F 13/218 using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
• CPC Class Codes: A63F 13/219 for aiming at specific areas on the display, e.g. light-guns
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/44 involving timing of operations, e.g. performing an action within a time slot
• CPC Class Codes: A63F 13/65 automatically by game devices or servers from real world data, e.g. measurement in live racing competition
• CPC Class Codes: A63F 13/825 Fostering virtual characters
• CPC Class Codes: A63F 2300/534 for network load management, e.g. bandwidth optimization, latency reduction
• CPC Class Codes: A63F 2300/69 Involving elements of the real world in the game world, e.g. measurement in live races, real video
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

Disclosed are a virtual world processing device and method. By way of example, data collected from the real world is converted to binary form data which is then transmitted, or is converted to XML data, or the converted XML data is further converted to binary form data which is then transmitted, thereby allowing the data transmission rate to be increased and a low bandwidth to be used, and, in the case of a data-receiving adaptation RV engine, the complexity of the adaptation RV engine can be reduced as there is no need to include an XML parser.

Claims

1. A virtual world processing apparatus comprising:

a sensor implemented as a hardware component to encode sensor capability data and sensor information collected from a real world into first metadata comprising the sensor capability data and the sensor information;

an adaptation virtual world to real world (VR) unit to encode information on a virtual world into second metadata; and

an adaptation real world to virtual world (RV) unit to generate information to be applied to the virtual world based on the first metadata and the second metadata and to encode the generated information into third metadata,

wherein the sensor generates the first metadata by encoding the information collected from the real world into data of a binary form, and transmits the binary-encoded first metadata to the adaptation RV unit, the binary-encoded first metadata comprising a binary encoding syntax, a number of bits of attributes of the binary encoding syntax, and a mnemonic of the attributes.

2. The virtual world processing apparatus of claim 1, wherein the sensor generates the first metadata by encoding the information collected from the real world into data of an extensible markup language (XML) form, and transmits the XML-encoded first metadata to the adaptation RV unit.

3. The virtual world processing apparatus of claim 1, wherein the sensor generates the first metadata by encoding the information collected from the real world into data of an XML form and encoding the XML-encoded data into data of a binary form, and transmits the binary-encoded first metadata to the adaptation RV unit.

4. The virtual world processing apparatus of claim 1, wherein the adaptation VR unit generates the second metadata by encoding the information on the virtual world into data of a binary form, and transmits the binary-encoded second metadata to the adaptation RV unit.

5. The virtual world processing apparatus of claim 4, wherein the binary-encoded second metadata comprises a binary encoding syntax, a number of bits of attributes of the binary encoding syntax, and a mnemonic of the attributes.

6. The virtual world processing apparatus of claim 1, wherein the adaptation VR unit generates the second metadata by encoding the information on the virtual world into data of an XML form, and transmits the XML-encoded second metadata to the adaptation RV unit.

7. The virtual world processing apparatus of claim 1, wherein the adaptation VR unit generates the second metadata by encoding the information on the virtual world into data of an XML form and encoding the XML-encoded data to data of a binary form, and transmits the binary-encoded second metadata to the adaptation RV unit.

8. A virtual world processing method comprising:

encoding information collected from a real world into first metadata comprising sensor capability data and sensor information, wherein the encoding of the information collected from the real world into the first metadata comprises;

generating the first metadata by encoding the information collected from the real world into data of a binary form comprising a binary encoding syntax, a number of bits of attributes of the binary encoding syntax, and a mnemonic of the attributes and by further encoding the information collected from the real world into data of an XML form and encoding the XML-encoded data into data of a binary form;

encoding information on a virtual world into second metadata;

generating information to be applied to the virtual world based on the first metadata and the second metadata; and

encoding the generated information into third metadata.

9. The virtual world processing method of claim 8, wherein the encoding of the information on the virtual world into the second metadata comprises:

generating the second metadata by encoding the information on the virtual world into data of a binary form comprising a binary encoding syntax, a number of bits of attributes of the binary encoding syntax, and a mnemonic of the attributes.

10. The virtual world processing method of claim 8 wherein the encoding of the information on the virtual world into the second metadata comprises:

generating the second metadata by encoding the information on the virtual world into data of an XML form and encoding the XML-encoded data to data of a binary form.

11. A non-transitory computer-readable recording medium storing instructions for a computer to implement the method of claim 8.

12. A sensor comprising:

an encoder configured to generate sensed information based on a predefined representation syntax,

wherein the predefined representation syntax defines elements, mnemonics of the elements, flags corresponding to the elements, wherein the elements comprise an ID element, a sensor ID reference element, a linked list element, a group ID element, a priority element, and an activation element, and

wherein the sensed information includes the flags corresponding to the elements, and at least one element corresponding to at least one of the flags having a predefined logic value.

13. The sensor of claim 12, wherein the elements comprise a facial animation ID element, a body animation ID element, a facial feature element, and a body feature element.

14. The sensor of claim 12, wherein the elements comprise a position element, an orientation element, a velocity element, an angular velocity element, an acceleration element, and an angular acceleration element.

15. An apparatus for enabling interoperability between virtual world and real world, the apparatus comprising:

a processor comprising;

an adaptation unit configured to acquire sensed information of a predefined representation syntax from a sensor,

wherein the predefined representation syntax defines elements, mnemonics of the elements, flags corresponding to the elements, and mnemonics of the flags,

wherein the elements comprise an ID element, a sensor ID reference element, a linked list element, a group ID element, a priority element, and an activation element, and

wherein the sensed information includes the flags corresponding to the elements, and at least one element corresponding to at least one flag having a predefined logic value.

16. The apparatus of claim 15,

wherein the elements comprise a facial animation ID element, a body animation ID element, a facial feature element, and a body feature element.

17. The apparatus of claim 15, wherein the elements comprise a position element, an orientation element, a velocity element, an angular velocity element, an acceleration element.