METHOD OF INTEGRATING AD HOC CAMERA NETWORKS IN INTERACTIVE MESH SYSTEMS

• US 20120120201A1
• Filed: 07/26/2011
• Published: 05/17/2012
• Est. Priority Date: 07/26/2010
• Status: Abandoned Application

• Current Assignee: Tekamaki Ventures
• Original Assignee: Tekamaki Ventures
• Inventors: Ward, Matthew
• Application Number:
  US13/190,995
• Publication Number:
  US 20120120201A1
• Time in Patent Office: Days
• US Class Current: 348/47
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/215 comprising means for detecting acoustic signals, e.g. using a microphone
• CPC Class Codes: A63F 13/216 using geographical information, e.g. location of the game device or player using GPS
• CPC Class Codes: A63F 13/355 Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
• CPC Class Codes: A63F 2300/105 using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/538 for performing operations on behalf of the game client, e.g. rendering
• CPC Class Codes: A63F 2300/5553 user representation in the game field, e.g. avatar
• CPC Class Codes: A63F 2300/6072 of an input signal, e.g. pitch and rhythm extraction, voice recognition
• CPC Class Codes: A63F 2300/6081 generating an output signal, e.g. under timing constraints, for spatialization
• CPC Class Codes: A63F 2300/69 Involving elements of the real world in the game world, e.g. measurement in live races, real video
• CPC Class Codes: A63F 2300/8082 Virtual reality
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/243 using three or more 2D image sensors
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet

Abstract

An entertainment system has a first recording device that records digital images, a server that receives the images from the first device, wherein the second device, based on data from another source, enhances the images from the first device for display.

Claims

1. A system for creating images for display comprising:

a first recording device that records digital images;

a server that receives the images from the first device;

wherein the server, based on digital image data from a source remote to the server and the first recording device, adds visual content to the received digital images from the first device to create an image for display.

2. The system of claim 1, wherein the server receives GPS information received from the first recording device.

3. The system of claim 1, wherein the server receives accelerometer data received from the first recording device.

4. The system of claim 1, wherein the server receives sound signal data received from the first recording device.

5. The system of claim 1, wherein the data from a source remote to the server comprises digital images received from a second recording device that records digital images.

6. The system of claim 5, wherein the server uses image data received from both the first recording device and second recording device to create a wireframe image.

7. The system of claim 5, wherein the server includes a video game engine and the image data from the first recording device and second recording device has been mapped into the video game engine.

8. The system of claim 7, wherein a user can move the recording device'"'"'s positions within the video game engine to create new perspectives.

9. The system of claim 5, wherein the first and second recording devices record sound data and the server combines the sound data to create a sound output.

10. The system of claim 5, wherein the server uses image data received from both the first recording device and second recording device to create a single video stream.

11. The system of claim 2, wherein the server compares metadata from a plurality of recording devices to determine location of the recording devices and the server creates a digital environment based on image data from the plurality of recording devices.

12. A method for creating displayable video from multiple recordings comprising:

creating a sensor mesh wherein the sensors record video from multiple perspectives on multiple sensors;

comparing the multiple recorded videos to one another on a server networked to the multiple sensors;

based on the comparison, creating a video stream that is comprised of data from the multiple perspectives from the multiple sensors.

13. The method of claim 12, wherein based on the comparison, creating multiple video streams for display.

14. The method of claim 13, wherein the multiple video streams comprise multiple perspectives.