Apparatus and method for video display and control for portable device

• US 9,167,213 B2
• Filed: 11/16/2012
• Issued: 10/20/2015
• Est. Priority Date: 05/26/2009
• Status: Expired due to Fees

• Current Assignee: Lextech Labs, LLC
• Original Assignee: Lextech Labs, LLC
• Inventors: Bratton, Raymond Alex, Petersen, Nathan Robbins
• Primary Examiner(s): Sarwar, Babar
• Application Number:
  US13/679,166
• Publication Number:
  US 20130076908A1
• Time in Patent Office: 1,068 Days
• Field of Search: 455/420, 455/457, 455/550.1, 455/422.1, 455/412.2, 348/159
• US Class Current: 1/1
• CPC Class Codes: H04M 1/72415 for remote control of appliances
• CPC Class Codes: H04M 2250/22 including a touch pad, a touch sensor or a touch detector digitizers for touch screens G06F3/041
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/4227 Providing Remote input by a user located remotely from the client device, e.g. at work
• CPC Class Codes: H04N 23/632 for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/695 Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control

Abstract

An apparatus and method for display and control of video data on a mobile device provides simultaneous multiple video data display of groups of video sources and selection of video data for single, larger viewing. Control of the camera source of the video data is provided for the mobile device user, such as by manipulation of a multi-touch sensitive screen to pan, tilt and zoom. Image capture from the video screen and marking of the captured image is provided. Activation of video data streams and groups of video data streams for display on the mobile device is provided by transfer of activation information to the mobile device via email. Notification of events monitored by the video source or by other sensors is sent to users of the mobile devices.

Claims

1. An apparatus for display and control of video data, comprising;

a mobile client device having a touch sensitive display, said mobile client device being operable to connect to a wireless network and receive video data from a plurality of video sources over the wireless network; and

non-transitory computer readable storage media in said mobile client device having stored thereon a video command application,

said video command application being operable to simultaneously display on said touch sensitive display at least a portion of the video data from a predetermined number of said plurality of video sources, said plurality of video sources exceeding said predetermined number of displayed video sources, wherein said plurality of video sources that are not currently displayed on said touch sensitive display are off-screen video sources that are periodically updated with current video data, said video command application being operable to simultaneously display video data from multiple video sources having multiple differing video formats, said video command application being operable to display video data from a single video source on said touch sensitive display, and

said video command application being operable to generate command instructions from user contact with said touch sensitive display to change a characteristic of said single video source, and thereby change the video data being generated by the video source, in accordance with the user contact.

2. The apparatus of claim 1, wherein said single video source is a video camera and said video data includes live video images generated by said video camera.

3. An apparatus as claimed in claim 2, wherein said characteristic is at least one of camera direction, camera elevation, or camera zoom level.

4. The apparatus of claim 3, wherein said touch sensitive display is a multi-touch sensitive display, and wherein double-tap contact with said multi-touch sensitive display, at a location in said displayed video data, triggers said video command application to generate a re-center command transmitted to the single video source to cause the single video source to re-center the displayed video data at the location of the video data that was double-tapped on the multi-touch sensitive display.

5. The apparatus of claim 2, wherein said touch sensitive display is a multi-touch sensitive display, and wherein contacting said multi-touch display at two separate locations and increasing the distance between said contact locations while maintaining contact with said display triggers said video command application to generate a zoom-in command instruction transmitted to said video camera to cause said video camera to zoom-in to a location in the camera'"'"'s view centered between said contact locations.

6. The apparatus of claim 2, wherein said touch sensitive display is a multi-touch sensitive display, and wherein contacting said multi-touch display at two separate locations and decreasing the distance between said contact locations while maintaining contact with said display triggers said video command application to generate a zoom-out command instruction transmitted to said video camera to cause said video camera to zoom-out at as location in the camera'"'"'s view centered between said contact locations.

7. The apparatus of claim 2, wherein said touch sensitive display is a multi-touch sensitive display, and wherein tapping said multi-touch display with two points of contact at a first location triggers said video command application to generate a zoom-in command instruction transmitted to said video camera to cause said video camera to zoom-in a pre-set zoom level for each time said first location is contacted by the two points of contact, and wherein tapping said multi-touch display with two points of contact at a second location triggers said video command application to generate a zoom-out command instruction transmitted to said video camera to cause said video source to zoom-out the pre-set zoom level for each time said second location is contacted by the two points of contact.

8. The apparatus of claim 7, wherein said first location is an area located at an upper end of said multi-touch display screen and said second location is an area located at a lower end of said multi-touch display screen.

9. The apparatus of claim 2, wherein said user contact is a dragging movement on said displayed video image on said touch-sensitive display, said dragging movement having a drag direction, and wherein said dragging movement triggers said video command application to generate a command to cause a said video camera to move in the direction of drag relative to the displayed video image.

10. The apparatus of claim 9, wherein said camera movement continues in the direction of dragging movement until said dragging movement terminates.

11. The apparatus of claim 9, wherein an icon is generated on said touch sensitive display at a last location of said user contact with said display in response to said dragging movement, and wherein said camera movement continues until user contact with said icon terminates.

12. The apparatus of claim 1, wherein said mobile client device is a first mobile client device, and further comprising:

a further mobile client device having a touch sensitive display and being operable to connect to a wireless network over which is available video data, said further mobile client device being operable to transmit video source configuration information to said first mobile client device; and

said first mobile client device being operable to receive the video source configuration information and to display video data of the video source corresponding to the transmitted video source configuration information.

13. The apparatus of claim 1, wherein said video command application is operable to display on said touch sensitive display at least one of a real-time frame rate and data rate of the video data for each of the plurality of video sources having video data displayed on said touch sensitive display.

14. The apparatus of claim 1, wherein said video data includes recorded video images, and wherein said video command application is operable to permit control of playback said recorded video images by user contact with said touch sensitive display.

15. An apparatus for display and control of video data, comprising:

a mobile client device having a touch sensitive display, said mobile client device being operable to connect to a wireless network, and receive video data from a plurality of video sources over the wireless network; and

non-transitory computer readable storage media in said mobile client device having stored thereon a video command application,

said video command application being operable to simultaneously display on said touch of said plurality of video sources, said plurality of video sources exceeding said predetermined number of displayed video sources, wherein said plurality of video sources that are not currently displayed on said touch sensitive display are off-screen video sources that are periodically updated with current video data,

said video command application being operable to simultaneously display video data from multiple video sources having multiple differing video formats, said video command application being operable to display video data from a single video source on said touch sensitive display, and

said video command application being operable to generate command instructions from user contact with said touch sensitive display to change a characteristic of said single video source, and thereby change the video data being generated by the video source, in accordance with the user contact;

wherein said video command application is operable to monitor a latency of said wireless network to which said mobile client device is connected, and send a command to at least one of said plurality of video sources to reduce the network bandwidth usage by the video sources, thereby reducing the latency of said network connection, if the latency exceeds a predetermined threshold.

16. The apparatus of claim 15, wherein said video data includes at least video images, and wherein said video command application is operable to permit a user to pause, rewind, or fast forward the video images from said single displayed video source, and generate a command to pause, fast forward, or rewind said video images of said off-screen video sources simultaneously and in a time synchronized fashion with said paused, rewound, or fast-forwarded single displayed video source.

17. The apparatus of claim 15, wherein said video command application groups said plurality of video sources into a plurality of groups, said simultaneous display displaying only video data of a single group.

18. The apparatus of claim 17, wherein said video data includes at least video images, and wherein said video command application is operable to permit a user to pause, rewind, or fast forward the video images from a first displayed video sources in said displayed single group and, and generate a command to pause, fast forward, or rewind said video images of said remaining video sources in said displayed single group simultaneously and in a time synchronized fashion with said paused, rewound, or fast-forwarded first displayed video source.

19. The apparatus of claim 17, wherein said video command application is operable to flip pages of video data in a group, and wherein said video command application updates non-displayed video fields of the group on a periodic basis.

20. A method of displaying and controlling video data on a mobile client device, comprising the steps of:

receiving video data, including at least a video feed, over a network connection from a plurality of video sources;

displaying the video data, as a simultaneous display of a plurality of video fields on a display panel of the mobile client device;

controlling directional movement and video feed rewind of at least one of the plurality of video sources in response to touch contact of the display panel by a user;

monitoring latency over the network connection, said monitoring being performed by at least one of the mobile client device or a server; and

transmitting a command from at least one of the mobile client device or the server to a video source to reduce data volume of video data carried over the network if the latency exceeds a predetermined threshold, wherein said command to reduce data volume includes at least one of;

reduce resolution of the video signal., increase compression of the video signal, and reduce frame rate of the video signal.

21. The apparatus of claim 20, further comprising the steps of;

sensing a predetermined condition at a location;

generating a real time alert associated with the predetermined condition;

transmitting the real time alert to a user of a mobile client device;

transmitting video source configuration information to the mobile client device, the video source configuration information being for video sources providing video data at the location;

activating a video field on the mobile client device for the video source at the location; and

displaying the video data of the location on the mobile client device.