Identification and Sharing of Selections within Streaming Content

• US 20150012840A1
• Filed: 07/02/2013
• Published: 01/08/2015
• Est. Priority Date: 07/02/2013
• Status: Abandoned Application

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Maldari, Mario Alessandro, Shah, Bhavin H., Ramamoorthy, Anuradha
• Application Number:
  US13/933,939
• Publication Number:
  US 20150012840A1
• Time in Patent Office: Days
• US Class Current: 715/748
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04N 21/23109 by placing content in organized collections, e.g. EPG data repository details of retrieval of video data and associated meta data in video databases G06F16/739
• CPC Class Codes: H04N 21/266 Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
• CPC Class Codes: H04N 21/4126 The peripheral being portable, e.g. PDAs or mobile phones
• CPC Class Codes: H04N 21/422 Input-only peripherals , i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] input devices also receiving signals from specially adapted client devices H04N21/4104
• CPC Class Codes: H04N 21/472 End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/4728 for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/488 Data services, e.g. news ticker systems specially adapted for using meteorological information in broadcast systems H04H60/71
• CPC Class Codes: H04N 21/658 Transmission by the client directed to the server

Abstract

A tool for identifying selections of streaming content such as video, movies, and audio, establishes connections to an input device (stylus, mouse, trackball, a touch screen, etc.) and an output device (smart television, computer screen, etc.) or a streaming content server (on-demand server, cable TV decoder, online radio station, etc.). A user selects a portion of the streaming content such as by tapping or circling a person, place or thing in a video, using the input device, and the selection criteria are used to look up pre-tagged content or to submit to image or audio recognition services. The resulting identification is shown to the user on an output device, and may be instantly shared with collaborators on the same streaming content.

Claims

1. A method for identifying selections of streaming content comprising:

establishing a first connection by a computing platform with at least one user input device having a user-operated selection means for selecting a portion of displayed visual streaming content;

establishing at least second connection by a computing platform to a user output device and optionally a third connection to a visual streaming content server;

receiving by a computing platform from the user input device a selection of a portion less than all of the visual streaming content currently streaming to the at least one user output device;

via the second or third connection, collecting by a computing platform one more selection criteria corresponding to the visual portion selected;

submitting by a computing platform the one or more selection criteria to one or more identification services;

receiving from the identification services by a computing platform one or more identification results corresponding to the submitted selection criteria;

sending by a computing platform to the user output device the identification results; and

displaying to the user the identification results.

2. The method as set forth in claim 1 wherein the user input device is selected from the group consisting of a stylus, a mouse, a trackball, a joystick, a keyboard, a touch-sensitive screen, a microphone and a voice command recognizer.

3. The method as set forth in claim 1 wherein the user output device is selected from the group consisting of a desktop computer display, a table computer screen, a smart telephone screen, a smart television, a touch-sensitive display, and a video projector.

4. The method as set forth in claim 1 wherein the streaming content server is selected from the group consisting of an on-demand movie server, an on-demand video server, a computer, a cable television decoder, a game console, a digital video recorder, a video disk player, a satellite video service, an audio streaming service, a virtual radio station, a personal audio player and a satellite audio service.

5. The method as set forth in claim 1 wherein the portion is selected from the group consisting of a video frame number, a timestamp, a screen coordinate of a point selection, a set of screen coordinates of an area selection, an audio segment and an image portion.

6. The method as set forth in claim 1 wherein the one or more identification services is selected from the group consisting of a database of pre-tagged audio, a database of pre-tagged video, a database of pre-tagged photographs, a facial recognition service, a landscape recognition service, a building recognition service, a voice recognition service, a product recognition service, and a song recognition service.

7. The method as set forth in claim 1 wherein the sending of the identification results comprises causing an information sidebar to be shown on a user output device.

8. The method as set forth in claim 1 wherein the sending of the identification results comprises causing pop-up information box to be shown on a user output device.

9. The method as set forth in claim 1 wherein the second connection comprises accessing streaming content being presented on user output device, and wherein the collecting one more selection criteria comprises extracting a portion of the streaming content corresponding to one or more of a frame number, a timestamp, a screen coordinate point and a screen area circumscribed by a set of coordinate points, and wherein the submitting of selection criteria to an identification service comprises submitting the extracted portion of content.

10. The method as set forth in claim 8 wherein the extracted portion of the streaming content comprises at least one content type selected from the group consisting of a video clip and a cropped photograph.

11. The method as set forth in claim 1 further comprising registering by a computing platform a plurality of user output devices associated with a commonly consumed streaming content, and wherein the sending of the identification results further comprises sending to the plurality of registered user devices.

12. A computer program product for identifying selections of streaming content, said computer program product comprising:

a computer readable storage medium having encoded or stored thereon;

first program instructions executable by a computing device to cause the device to establish a first connection by a computing platform with at least one user input device having a user-operated selection means for selecting a portion of displayed visual streaming content;

second program instructions executable by a computing device to cause the device to establish at least second connection by a computing platform to a user output device and optionally a third connection to a visual streaming content server;

third program instructions executable by a computing device to cause the device to receive by a computing platform from the user input device a selection of a portion less than all of the visual streaming content currently streaming to the at least one user output device;

fourth program instructions executable by a computing device to cause the device to, via the second or third connection, collect by a computing platform one more selection criteria corresponding to the visual portion selected;

fifth program instructions executable by a computing device to cause the device to submit by a computing platform the one or more selection criteria to one or more identification services;

sixth program instructions executable by a computing device to cause the device to receive from the identification services by a computing platform one or more identification results corresponding to the submitted selection criteria;

seventh program instructions executable by a computing device to cause the device to send by a computing platform to the user output device the identification results; and

eighth program instructions executable by a computing device to cause the device to display to the user the identification results.

13. The computer program product as set forth in claim 12 wherein the user input device is selected from the group consisting of a stylus, a mouse, a trackball, a joystick, a keyboard, a touch-sensitive screen, a microphone and a voice command recognizer, wherein the user output device is selected from the group consisting of a desktop computer display, a table computer screen, a smart telephone screen, a smart television, a touch-sensitive display, and a video projector, wherein the streaming content server is selected from the group consisting of an on-demand movie server, an on-demand video server, a computer, a cable television decoder, a game console, a digital video recorder, a video disk player, a satellite video service, an audio streaming service, a virtual radio station, a personal audio player and a satellite audio service, wherein the portion is selected from the group consisting of a video frame number, a timestamp, a screen coordinate of a point selection, a set of screen coordinates of an area selection, an audio segment and an image portion, wherein the identification service is selected from the group of consisting of a database of pre-tagged audio, a database of pre-tagged video, a database of pre-tagged photographs, a facial recognition service, a landscape image recognition service, a building image recognition service, a product image recognition service, and a song recognition service, and wherein the sending of the identification results comprises one or more actions selected from the group comprising causing an information sidebar to be shown on a user output device and causing pop-up information box to be shown on a user output device.

14. The computer program product as set forth in claim 12 wherein the second connection comprises a connection to streaming content being presented on user output device, and wherein the collecting one more selection criteria comprises extracting a portion of the streaming content corresponding to one or more of a frame number, a timestamp, a screen coordinate point and a screen area circumscribed by a set of coordinate points, and wherein the submitting of selection criteria to an identification service comprises submitting the extracted portion of content.

15. The computer program product as set forth in claim 12 further comprising ninth program instructions executable by a computing device to cause the device to register a plurality of user output devices associated with a commonly consumed streaming content, and wherein the program instructions for sending of the identification results further comprises program instructions for sending to the plurality of registered user devices.

16. A system for identifying selections of streaming content, said computer program product comprising:

a computing platform having a processor;

a computer readable storage medium readable by the processor and having encoded or stored thereon;

first program instructions executable by the processor to cause the computing platform to establish a first connection by a computing platform with at least one user input device having a user-operated selection means for selecting a portion of displayed visual streaming content;

second program instructions executable by the processor to cause the computing platform to establish at least second connection by a computing platform to a user output device and optionally a third connection to a visual streaming content server;

third program instructions executable by the processor to cause the computing platform to receive by a computing platform from the user input device a selection of a portion less than all of the visual streaming content currently streaming to the at least one user output device;

fourth program instructions executable by the processor to cause the computing platform to, via the second or third connection, collect by a computing platform one more selection criteria corresponding to the visual portion selected;

fifth program instructions executable by the processor to cause the computing platform to submit by a computing platform the one or more selection criteria to one or more identification services;

sixth program instructions executable by the processor to cause the computing platform to receive from the identification services by a computing platform one or more identification results corresponding to the submitted selection criteria;

seventh program instructions executable by the processor to cause the computing platform to send by a computing platform to the user output device the identification results; and

eighth program instructions executable by the processor to cause the computing platform to display to the user the identification results.

17. The system as set forth in claim 16 wherein the user input device is selected from the group consisting of a stylus, a mouse, a trackball, a joystick, a keyboard, a touch-sensitive screen, a microphone and a voice command recognizer, wherein the user output device is selected from the group consisting of a desktop computer display, a table computer screen, a smart telephone screen, a smart television, a touch-sensitive display, and a video projector, wherein the streaming content server is selected from the group consisting of an on-demand movie server, an on-demand video server, a computer, a cable television decoder, a game console, a digital video recorder, a video disk player, a satellite video service, an audio streaming service, a virtual radio station, a personal audio player and a satellite audio service, wherein the portion is selected from the group consisting of a video frame number, a timestamp, a screen coordinate of a point selection, a set of screen coordinates of an area selection, an audio segment and an image portion, wherein the identification service is selected from the group of consisting of a database of pre-tagged audio, a database of pre-tagged video, a database of pre-tagged photographs, a facial recognition service, a landscape image recognition service, a building image recognition service, a product image recognition service, and a song recognition service, and wherein the sending of the identification results comprises one or more actions selected from the group comprising causing an information sidebar to be shown on a user output device and causing pop-up information box to be shown on a user output device.

18. The system as set forth in claim 16 wherein the second connection comprises a connection to streaming content being presented on user output device, and wherein the collecting one more selection criteria comprises extracting a portion of the streaming content corresponding to one or more of a frame number, a timestamp, a screen coordinate point and a screen area circumscribed by a set of coordinate points, and wherein the submitting of selection criteria to an identification service comprises submitting the extracted portion of content.

19. The system as set forth in claim 16 further comprising ninth program instructions executable by the processor to cause the computing platform to register a plurality of user output devices associated with a commonly consumed streaming content, and wherein the program instructions for sending of the identification results further comprises program instructions for sending to the plurality of registered user devices.