Remote object sensing in video

• US 9,270,940 B1
• Filed: 09/30/2014
• Issued: 02/23/2016
• Est. Priority Date: 09/30/2014
• Status: Active Grant

• Current Assignee: Generac Power Systems Incorporated (Generac Holdings Incorporated)
• Original Assignee: International Business Machines Corporation
• Inventors: Aravkin, Aleksandr Y., Basu, Anirban, Kanevsky, Dimitri, Sainath, Tara N.
• Primary Examiner(s): Anwah, Olisa
• Application Number:
  US14/502,110
• Time in Patent Office: 511 Days
• Field of Search: 348/14.01, 348/14.04, 348/14.03
• US Class Current: 1/1
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06V 10/235 based on user input or interaction
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q

Abstract

A method comprises obtaining an input comprising audio and visual data for display on a first device, receiving data associated with one or more sensory properties of one or more objects in the input, and reconstructing the one or more sensory properties at the first device based on the data received.

Claims

1. A method, comprising:

obtaining an input comprising audio and visual data for display on a first device;

receiving data associated with one or more sensory properties of one or more user-selected objects in the input; and

reconstructing the one or more sensory properties at the first device based on the data received.

2. The method of claim 1, wherein the one or more sensory properties comprises at least one of a temperature, a texture and a movement associated with the one or more.

3. The method of claim 1, wherein the data is captured by one or more sensors on the first device, the one or more sensors comprising at least one of an infrared sensor and a tactile sensor.

4. The method of claim 1, wherein the data is captured by one or more sensors on a second device, the one or more sensors comprising at least one of an infrared sensor and a tactile sensor.

5. The method of claim 1, wherein reconstructing the one or more sensory properties comprises translating the sensory data into metrics for reconstruction.

6. The method of claim 5, wherein a controller regulates a gridded interface to produce the one or more sensory properties based on the metrics.

7. The method of claim 6, wherein the gridded interface comprises at least one of an array of micro pipes, a hot air reservoir, a cold air reservoir and a tactile simulator.

8. The method of claim 7, wherein the gridded interface is located on an enclosure of the first device.

9. The method of claim 1, wherein the input is one of pre-recorded or live.

10. The method of claim 1, further comprising segmenting the input based on user selection, wherein the input is at least one of segmented temporally and segmented spatially.

11. The method of claim 10, wherein the one or more sensory properties are reconstructed based on the user selection for at least one of a given duration and a given region of the input.

12. A method, comprising:

obtaining an input comprising visual and audio data for display on a device;

detecting user selection of one or more objects in the visual input;

identifying the one or more selected objects and surroundings of the one or more objects;

obtaining data associated with one or more sensory properties of the identified one or more objects and the surroundings; and

reconstructing the one or more sensory properties associated with the identified one or more objects and the surroundings based on the data received.

13. The method of claim 12, wherein identifying the one or more selected objects comprises one of an image recognition software and a user input.

14. The method of claim 12, wherein the data is obtained from a database comprising objects indexed with sensory information.

15. The method of claim 14, wherein the data is estimated based on historical information stored in the database.

16. The method of claim 12, wherein the sensory properties comprises at least one of a temperature, a texture and a movement associated with the one or more objects and surroundings.

17. The method of claim 12, wherein reconstructing the one or more sensory properties comprises translating the data into metrics.

18. The method of claim 17, wherein a controller regulates a gridded interface to produce the one or more sensory properties based on the metrics.

19. A method, comprising:

obtaining an input comprising visual and audio data for display on a first device;

detecting sensory input from a user of the first device with respect to one or more user-selected objects in the input;

capturing data associated with the sensory input from the user of the first device; and

transmitting the captured data to a second device for reconstruction of one or more sensory properties associated with the user of the first device.

20. The method of claim 19, wherein detecting sensory input from a user comprises detecting user contact with one or more sensors on the first device.

21. The method of claim 19, wherein capturing data associated with the sensory input comprises recording and storing data generated by the one of more sensors on the first device.

22. An apparatus, comprising:

a memory; and

a processor operatively coupled to the memory and configured to;

obtain an input comprising audio and visual data for display on a first device;

receive data associated with one or more sensory properties of one or more user-selected objects in the input; and

reconstruct the one or more sensory properties at the first device based on the data received.

23. The apparatus of claim 22, wherein a controller regulates a gridded interface to produce one or more sensory properties based on one or more metrics.

24. The apparatus of claim 23, wherein the gridded interface comprises at least one of an array of micro pipes, a hot air reservoir, a cold air reservoir and a tactile simulator.

25. The apparatus of claim 24, wherein the gridded interface is located on an enclosure of the first device.