Apparatus and method for video display and control for portable device

• US 8,340,654 B2
• Filed: 05/26/2009
• Issued: 12/25/2012
• Est. Priority Date: 05/26/2009
• Status: Expired due to Fees

• Current Assignee: Lextech Labs, LLC
• Original Assignee: Lextech Labs, LLC
• Inventors: Bratton, R. Alex, Petersen, Nathan Robbins
• Primary Examiner(s): Gelin, Jean
• Assistant Examiner(s): Sarwar, Babar
• Application Number:
  US12/471,584
• Publication Number:
  US 20100304731A1
• Time in Patent Office: 1,309 Days
• Field of Search: 455/420, 455/457, 455/550.1, 3482111-2118, 348/211.12, 348/211.99, 348/208.3, 348/143, 725/62
• US Class Current: 455/420
• CPC Class Codes: H04M 1/72415 for remote control of appliances
• CPC Class Codes: H04M 2250/22 including a touch pad, a touch sensor or a touch detector digitizers for touch screens G06F3/041
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/4227 Providing Remote input by a user located remotely from the client device, e.g. at work
• CPC Class Codes: H04N 23/632 for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/695 Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control

Abstract

An apparatus and method for display and control of video data on a mobile device provides simultaneous multiple video data display of groups of video sources and selection of video data for single, larger viewing. Control of the camera source of the video data is provided for the mobile device user, such as by manipulation of a multi-touch sensitive screen to pan, tilt and zoom. Image capture from the video screen and marking of the captured image is provided. Activation of video data streams and groups of video data streams for display on the mobile device is provided by transfer of activation information to the mobile device via email. Notification of events monitored by the video source or by other sensors is sent to users of the mobile devices.

Claims

1. An apparatus for display and control of video data, comprising:

a mobile client having a touch sensitive display, said mobile client being operable to connect to a wireless network over which is available video data; and

non-transitory computer readable storage media in said mobile client having stored thereon a video command application, said video command application being operable to simultaneously display video data of a predetermined number of video sources received over the wireless network from a plurality of video sources on said touch sensitive display, said plurality of video sources exceeding said predetermined number of displayed video sources, wherein said plurality of video sources that are not currently displayed on said simultaneous display are off-screen video sources being periodically updated with still images, said video command application being operable to display video data from a single video source on said touch sensitive display, said video command application being operable to generate command instructions from user contact with said touch sensitive display to cause said single video source to change a characteristic of the video data being generated by the video source in accordance with the user contact, said video command application being operable to monitor a latency of said wireless network to which said mobile client is connected, and send a command to at least one of said plurality of video sources to reduce the network bandwidth usage by the video sources, thereby reducing the latency of said network connection, if the latency exceeds a predetermined threshold.

2. An apparatus as claimed in claim 1, wherein said characteristic is at least one of pan, tilt, or zoom.

3. An apparatus as claimed in claim 1, wherein said touch sensitive display is a multi-touch sensitive display and wherein said video command application generates zoom commands for the single video source from multi-touch contact with said multi-touch sensitive display.

4. An apparatus as claimed in claim 1, wherein said video command application groups said plurality of video sources into a plurality of groups, said simultaneous display displaying only video data of a single group.

5. An apparatus as claimed in claim 4, wherein said video command application is operable to flip pages of video data in a group, and wherein said video command application updates non-displayed video fields of the group on a periodic basis.

6. An apparatus as claimed in claim 1, wherein said mobile client is a first mobile client, and further comprising:

a further mobile client having a touch sensitive display and being operable to connect to a wireless network over which is available video data, said further mobile client being operable to transmit video source configuration information to said first mobile client; and

said first mobile client being operable to receive the video source configuration information and to display video data of the video source corresponding to the transmitted video source configuration information.

7. A method of displaying and controlling video data on a mobile client, comprising the steps of:

receiving video data over a network connection from a plurality of video sources;

displaying the video data as a simultaneous display of a plurality of video fields on a display panel of the mobile client;

displaying video data of a single video source as a single video display in a full screen mode on the display panel of the mobile client, in response to selection of one of the plurality of video fields by a user;

controlling directional movement of said single video source in response to touch contact of the display panel by a user;

monitoring latency over the network connection, said monitoring being performed by at least one of the mobile client or a server; and

transmitting a command from at least one of the mobile client or the server to a video source to reduce data volume of video data carried over the network if the latency exceeds a predetermined threshold, wherein said command to reduce data volume includes at least one of;

reduce resolution of the video signal, increase compression of the video signal, and reduce frame rate of the video signal.

8. A method as claimed in claim 7, wherein said step of controlling directional movement comprises the steps of:

receiving user contact with the display panel as a swipe having a direction;

translating the swipe contact into a camera movement command;

moving a camera in a direction corresponding the swipe contact, said camera being said single video source, said direction of moving said camera being one of pan and tilt; and

displaying video data from said camera after said moving step.

9. A method as claimed in claim 8, further comprising the steps of:

displaying an on screen icon in response to the user contact with the display panel;

receiving user contact at said icon; and

transmitting a continuous movement command to said camera as long as the user contacts remains at said icon.

10. A method as claimed in claim 7, further comprising the steps of:

receiving simultaneous multiple contact with the display panel by the user, said multiple contact including changing a distance between contact locations on said display panel; and

transmitting a zoom command to said single video source in response to the changing distance.

11. A method as claimed in claim 7, further comprising the steps of:

receiving a tap contact at the display panel from the user; and

transmitting a centering command to said single video source in response to the tap contact.

12. A method as claimed in claim 7, further comprising the steps of:

receiving a selection of video source definitions of a video source;

preparing an encrypted data bundle from said selected video source definitions;

transmitting the encrypted data bundle to a mobile client;

decrypting the encrypted data bundle in the mobile client;

viewing video data from the selected video source using the mobile client.

13. A method as claimed in claim 7, further comprising the steps of:

receiving groupings of video data sources into a plurality of groups;

receiving a label for each of the groups;

displaying the label for a selected group on the mobile client; and

displaying video data from the video data sources of the selected group on the mobile client.

14. A method as claimed in claim 7, further comprising the steps of:

displaying a predetermined number of video fields on the display panel as displayed video fields;

defining a group of video sources that are greater in number than said predetermined number;

displaying video data of the predetermined number of the video sources of the group in the displayed video fields;

associating the video sources of the group that are not being displayed in displayed video fields with background video fields;

updating the background video fields periodically with image data from the video sources;

receiving a command to change displayed video fields; and

in response to the command, displaying video data of the video sources associated with the background video fields in the displayed video fields and reassigning the video sources of the displayed video fields to background video fields.

15. A method as claimed in claim 14, wherein said command is a sliding contact movement on the display panel.

16. A method as claimed in claim 7, wherein said step of receiving video date includes receiving the video data wirelessly over a wireless communication that is at least one of a WiFi network and cellular network.

17. A method as claimed in claim 7, further comprising the steps of:

sensing a predetermined condition at a location;

generating an alert associated with the predetermined condition;

transmitting the alert to a user of a mobile client;

transmitting video source configuration information to the mobile client, the video source configuration information being for video sources providing video data at the location;

activating a video field on the mobile client for the video source at the location; and

displaying the video data of the location on the mobile client.

18. A method as claimed in claim 17, wherein said step of transmitting the alert includes transmitting the alert to the mobile client if the mobile client is connected to a server, and transmitting the alert as at least one of email and SMS message to the user if the mobile client is not connected to the server.

19. A method of displaying video data and optimizing latency of the displayed video data on a mobile client, comprising the steps of:

receiving video data on the mobile client from a plurality of video sources, said video data being sent over a network connection;

displaying said video data on a display panel of the mobile client;

monitoring latency over the network connection to which the mobile client is connected, said monitoring being performed by at least one of the mobile client or a server;

transmitting a command from at least one of the mobile client or the server to the plurality of video sources to reduce the network bandwidth usage by the video sources, thereby reducing network latency, if the latency exceeds a predetermined threshold, wherein said command to reduce data volume includes at least one of;

reduce resolution of the video signal, increase compression of the video signal, and reduce frame rate of the video signal.

20. A method as claimed in claim 19, wherein said step of monitoring latency comprises the steps of:

periodically sending a data packet over the network connection, at predetermined intervals of time;

measuring a network response time to receive a response over the network, in reply to each of the sent data packets;

determining whether the network latency has increased to an unacceptable level, based on at least one of;

a comparison of the network response time, for each data packet sent, to a predetermined acceptable threshold response time, wherein response times greater than the threshold response time are considered latent responses,

a determination of whether any of the response times have been less than the threshold response time, and

a determination of whether a number of consecutive latent responses exceeds a threshold number of latent responses, wherein a number of consecutive latent responses exceeding the threshold number is considered an unacceptable level of latency; and

notifying the mobile client when the determining step determines that the network latency has increased to an unacceptable level.

21. A method as claimed in claim 20, wherein said data packet is sent from the mobile client to a server, and wherein said response is returned to the mobile client from said outside server.

22. A method as claimed in claim 19, wherein said command to reduce the network bandwidth usage includes at least one of:

reduce resolution of the video signal, increase compression of the video signal, and reduce frame rate of the video signal.