Method and mechanism for performing cloud image display and capture with mobile devices

• US 9,128,897 B1
• Filed: 07/30/2013
• Issued: 09/08/2015
• Est. Priority Date: 05/07/2010
• Status: Active Grant

• Current Assignee: Enconcert Incorporated
• Original Assignee: Enconcert Incorporated
• Inventors: Vucurevich, Ted
• Primary Examiner(s): SHINGLES, KRISTIE D
• Application Number:
  US13/954,583
• Time in Patent Office: 770 Days
• Field of Search: 709/204
• US Class Current: 1/1
• CPC Class Codes: G06F 15/17306 Intercommunication techniques
• CPC Class Codes: G06F 3/1446 display composed of modules, e.g. video walls
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: G06Q 10/101 Collaborative creation, e.g. joint development of products or services
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G09G 2356/00 Detection of the display position w.r.t. other display screens
• CPC Class Codes: G09G 2370/04 Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller
• CPC Class Codes: G09G 2370/16 Use of wireless transmission of display information
• CPC Class Codes: G09G 5/12 Synchronisation between the display unit and other units, e.g. other display units, video-disc players
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/25841 involving the geographical location of the client retrieval from the Internet by querying based on geographical locations G06F16/9537; arrangements for identifying locations of receiving stations in broadcast systems H04H60/51; location of the user terminal in data switching networks H04L67/52; services making use of the location of users or terminals in wireless networks H04W4/02; locating users or terminals in wireless networks H04W64/00
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/41415 involving a public display, viewable by several users in a public space outside their home, e.g. movie theatre, information kiosk
• CPC Class Codes: H04N 21/4305 Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets arrangements for synchronising receiver with transmitter by comparing receiver clock with transmitter clock H04L7/0012; arrangements for synchronising receiver with transmitter wherein the receiver takes measures against momentary loss of synchronisation H04L7/0083
• CPC Class Codes: H04N 21/6543 for forcing some client operations, e.g. recording remote booting in general G06F9/4416
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 25/41 Extracting pixel data from a plurality of image sensors simultaneously picking up an image, e.g. for increasing the field of view by combining the outputs of a plurality of sensors
• CPC Class Codes: H04N 5/44 Receiver circuitry for the reception of television signals according to analogue transmission standards H04N5/14 takes precedence
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/188 : Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253
• CPC Class Codes: H04W 4/08 : User group management
• CPC Class Codes: H04W 4/21 : for social networking applications
• CPC Class Codes: H04W 4/60 : Subscription-based services using application servers or record carriers, e.g. SIM application toolkits

Abstract

Disclosed is an improved approach for implementing participatory interaction at events using mobile devices. One approach is to utilize distributed display screens for the mobile devices in an audience to display a much larger collective image. Another approach is to utilize the distributed cameras of mobile devices in an audience to form a massive capture device from the different locations and perspectives of the audience members. Yet another approach is directed to the use of mobile devices in the audience to capture motion events among the audience, which are then used to synthesize new media items and types for the event.

Claims

1. A method implemented with a computing system having a processor for implementing participation at an event using mobile devices, comprising:

registering a mobile device at an event, wherein the mobile device comprises an image device;

performing device location calibration to establish a location for the mobile device at the event;

determining an orientation of the image device of the mobile device at the event;

sending participation data to the mobile device; and

utilizing the participation data at the mobile device to allow the mobile device to participate in the event by coordinating image data across multiple image devices for multiple mobile devices at the event, wherein the image devices comprise image capture devices to capture the image data, and the image devices for the multiple mobile devices at the event are coordinated to capture the image data from multiple locations or viewing perspectives.

2. The method of claim 1, wherein the device location calibration is performed to determine an X, Y, and Z location for the mobile device relative to an origin point at the event.

3. The method of claim 2, wherein the origin point corresponds to a location for a controller device at the event.

4. The method of claim 1, wherein the orientation for the mobile device is determined by analyzing images captured by the mobile device.

5. The method of claim 1, wherein the device location calibration is performed by instructing the mobile device to listen for an audio signal, and calculating the location for the mobile device based at least in part on a receipt time of the audio signal at the mobile relative to a transmission time for the audio signal from a source for the audio signal.

6. The method of claim 1, wherein the device location calibration is performed by displaying one or more calibration images at a designated location, and calculating the location for the mobile device based at least in part on analysis of an image frame captured at the mobile device showing the one or more calibration images.

7. The method of claim 6, wherein the analysis is performed based at least in part on size, position, or orientation of the one or more calibration images in the image frame.

8. The method of claim 1, wherein the image devices comprise image display devices to display the image data, and the image devices for the multiple mobile devices at the event are coordinated to display a collective image across the multiple mobile devices.

9. A system, comprising:

a processor;

a memory for holding programmable code;

wherein the programmable code includes instructions for registering a mobile device at an event where the mobile device comprises an image device, performing device location calibration to establish a location for the mobile device at the event, determining an orientation of the image device of the mobile device at the event, sending participation data to the mobile device, and utilizing the participation data at the mobile device to allow the mobile device to participate in the event by coordinating image data across multiple image devices for multiple mobile devices at the event; and

wherein the image devices comprise image capture devices to capture the image data, and the image devices for the multiple mobile devices at the event are coordinated to capture the image data from multiple locations or viewing perspectives.

10. The system of claim 9, wherein the device location calibration is performed to determine an X, Y, and Z location for the mobile device relative to an origin point at the event.

11. The system of claim 10, wherein the origin point corresponds to a location for a controller device at the event.

12. The system of claim 9, wherein the orientation for the mobile device is determined by analyzing images captured by the mobile device.

13. The system of claim 9, wherein the device location calibration is performed by instructing the mobile device to listen for an audio signal, and calculating the location for the mobile device based at least in part on a receipt time of the audio signal at the mobile relative to a transmission time for the audio signal from a source for the audio signal.

14. The system of claim 9, wherein the device location calibration is performed by displaying one or more calibration images at a designated location, and calculating the location for the mobile device based at least in part on analysis of an image frame captured at the mobile device showing the one or more calibration images.

15. The system of claim 14, wherein the analysis is performed based at least in part on size, position, or orientation of the one or more calibration images in the image frame.

16. The system of claim 9, wherein the image devices comprise image display devices to display the image data, and the image devices for the multiple mobile devices at the event are coordinated to display a collective image across the multiple mobile devices.

17. A computer program product embodied on a computer readable medium, the computer readable medium having stored thereon a sequence of instructions which, when executed by a processor causes the processor to execute a method for implementing participation at an event using mobile devices, the method comprising:

registering a mobile device at an event, wherein the mobile device comprises an image device;

performing device location calibration to establish a location for the mobile device at the event;

determining an orientation image device of the of the mobile device at the event;

sending participation data to the mobile device; and

utilizing the participation data at the mobile device to allow the mobile device to participate in the event by coordinating image data across multiple image devices for multiple mobile devices at the event, wherein the image devices comprise image capture devices to capture the image data, and the image devices for the multiple mobile devices at the event are coordinated to capture the image data from multiple locations or viewing perspectives.

18. The computer program product of claim 17, wherein the device location calibration is performed to determine an X, Y, and Z location for the mobile device relative to an origin point at the event.

19. The computer program product of claim 17, wherein the orientation for the mobile device is determined by analyzing images captured by the mobile device.

20. The computer program product of claim 17, wherein the device location calibration is performed by instructing the mobile device to listen for an audio signal, and calculating the location for the mobile device based at least in part on a receipt time of the audio signal at the mobile relative to a transmission time for the audio signal from a source for the audio signal.

21. The computer program product of claim 17, wherein the device location calibration is performed by displaying one or more calibration images at a designated location, and calculating the location for the mobile device based at least in part on analysis of an image frame captured at the mobile device showing the one or more calibration images.

22. The computer program product of claim 21, wherein the analysis is performed based at least in part on size, position, or orientation of the one or more calibration images in the image frame.

23. The computer program product of claim 17, wherein the image devices comprise image display devices to display the image data, and the image devices for the multiple mobile devices at the event are coordinated to display a collective image across the multiple mobile devices.