ADVANCED INPUT CONTROLLER FOR MULTIMEDIA PROCESSING

• US 20090073267A1
• Filed: 10/10/2007
• Published: 03/19/2009
• Est. Priority Date: 09/19/2007
• Status: Active Grant

• Current Assignee: Fujifilm Business Innovation Corp. (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Xerox Company Limited (Xerox Holdings Corp.)
• Inventors: CARTER, Scott, DENOUE, Laurent
• Granted Patent: US 8,054,332 B2
• Time in Patent Office: Days
• US Class Current: 348/207.100
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image

Abstract

The system and method enables people to use their webcam as a virtual flashlight over their screen as a picture or video clip is playing. The position, tilt and rotation of the flashlight over the screen is recorded and smoothed to generate a compelling movie. Users move the webcam closer to the screen to focus on a specific area; users can rotate the webcam to generate compelling rotations, and users can pan the webcam to simulate looking at objects from a side.

Claims

1. An input control system comprising:

a. an processing controller operable to cause an image feature to be created on a display showing a multimedia material; and

b. a camera operatively coupled to the processing controller and operable to generate an image of the image feature, wherein the processing controller is operable to;

i. use the image of the image feature to iteratively update a position of the image feature on the display, the position of the image feature being determined by a position of the camera;

ii. record the position of the image feature for each iteration; and

iii. transform the multimedia material based on the recorded position of the image feature.

2. The input control system of claim 1, wherein the image feature comprises a colored circle, a colored rectangle or a colored quadrilateral.

3. The input control system of claim 1, wherein the processing controller is further operable to calculate a surface area of the image feature and to use the calculated surface area to determine a distance between the camera and the display.

4. The input control system of claim 1, wherein using the image comprises filtering out a color of the image feature from the multimedia material shown on the display.

5. The input control system of claim 1, wherein the camera is a webcam.

6. The input control system of claim 1, wherein the processing controller is further operable to smooth the position of the image feature on the display using a spline.

7. The input control system of claim 1, wherein the multimedia material comprises at least two frames and wherein transforming the multimedia material comprises cropping the at least two frames of the multimedia material in accordance with the position and a size of the image feature.

8. The input control system of claim 7, further comprising assembling the cropped at least two frames into a video clip.

9. The input control system of claim 1, wherein the processing controller is further operable to use the image of the image feature to determine an angle of the camera with respect to the display and to transform the multimedia material based on the determined angle.

10. The input control system of claim 1, wherein the multimedia material comprises multiple frames and wherein the processing controller is further operable to generate at least two video clips using the transformed multimedia material and wherein the processing controller is further operable to interpolate a transition between the at least two video clips.

11. A method comprising:

a. Creating an image feature on a display showing a multimedia material;

b. Generating an image of the image feature using a camera;

c. Using the image of the image feature to iteratively update a position of the image feature on the display, the position of the image feature being determined by a position of the camera;

d. Recording the position of the image feature for each iteration; and

e. Transforming the multimedia material based on the recorded position of the image feature.

12. The method of claim 11, wherein the image feature comprises a colored circle, a colored rectangle or a colored quadrilateral.

13. The method of claim 11, further comprising calculating a surface area of the image feature and using the calculated surface area to determine a distance between the camera and the display.

14. The method of claim 11, wherein using the image comprises filtering out a color of the image feature from the multimedia material shown on the display.

15. The method of claim 11, wherein the camera is a webcam.

16. The method of claim 11, further comprising smoothing the position of the image feature on the display using a spline.

17. The method of claim 11, wherein the multimedia material comprises at least two frames and wherein transforming the multimedia material comprises cropping the at least two frames of the multimedia material in accordance with the position and a size of the image feature.

18. The method of claim 17, further comprising assembling the cropped at least two frames into a video clip.

19. The method of claim 11, further comprising using the image of the image feature to determine an angle of the camera with respect to the display and to transform the multimedia material based on the determined angle.

20. The method of claim 11, wherein the multimedia material comprises multiple frames and wherein the method further comprises generating at least two video clips using the transformed multimedia material and interpolating a transition between the at least two video clips.

21. A computer-readable medium embodying computer-readable instructions implementing a method comprising:

a. Creating an image feature on a display showing a multimedia material;

b. Generating an image of the image feature using a camera;

c. Using the image of the image feature to iteratively update a position of the image feature on the display, the position of the image feature being determined by a position of the camera;

d. Recording the position of the image feature for each iteration; and

e. Transforming the multimedia material based on the recorded position of the image feature.