Advanced input controller for multimedia processing

• US 8,054,332 B2
• Filed: 10/10/2007
• Issued: 11/08/2011
• Est. Priority Date: 09/19/2007
• Status: Active Grant

• Current Assignee: Fujifilm Business Innovation Corp. (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Xerox Company Limited (Fujifilm Holdings Corporation)
• Inventors: Denoue, Laurent, Carter, Scott
• Primary Examiner(s): Pasiewicz; Daniel M
• Application Number:
  US11/869,979
• Publication Number:
  US 20090073267A1
• Time in Patent Office: 1,490 Days
• Field of Search: 348/207.1, 348/211.4, 348/211.7, 348/211.9, 34833301-33303, 348/333.12, 345/157, 345/158, 345/162
• US Class Current: 348/207.1
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image

Abstract

The system and method enables people to use their webcam as a virtual flashlight over their screen as a picture or video clip is playing. The position, tilt and rotation of the flashlight over the screen is recorded and smoothed to generate a compelling movie. Users move the webcam closer to the screen to focus on a specific area; users can rotate the webcam to generate compelling rotations, and users can pan the webcam to simulate looking at objects from a side.

Claims

1. An input control system comprising:

a. a processing controller operable to cause an image feature to be created on a display showing a multimedia material; and

b. a camera operatively coupled to the processing controller and operable to generate an image of the image feature, wherein the processing controller is operable to;

i. use the image of the image feature to iteratively update a position of the image feature on the display, the position of the image feature being determined by a position of the camera;

ii. record the position of the image feature for each iteration; and

iii. transform the multimedia material based on the recorded position of the image feature;

wherein the multimedia material comprises at least two frames and wherein transforming the multimedia material comprises cropping the at least two frames of the multimedia material in accordance with the position and a size of the image feature;

wherein the processing controller is further operable to smooth the position of the image feature on the display using a spline.

2. The input control system of claim 1, wherein the image feature comprises a colored circle, a colored rectangle or a colored quadrilateral.

3. The input control system of claim 1, wherein the processing controller is further operable to calculate a surface area of the image feature and to use the calculated surface area to determine a distance between the camera and the display.

4. The input control system of claim 1, wherein using the image comprises filtering out a color of the image feature from the multimedia material shown on the display.

5. The input control system of claim 1, wherein the camera is a webcam.

6. The input control system of claim 1, further comprising assembling the cropped at least two frames into a video clip.

7. The input control system of claim 1, wherein the processing controller is further operable to use the image of the image feature to determine an angle of the camera with respect to the display and to transform the multimedia material based on the determined angle.

8. The input control system of claim 1, wherein the multimedia material comprises multiple frames and wherein the processing controller is further operable to generate at least two video clips using the transformed multimedia material and wherein the processing controller is further operable to interpolate a transition between the at least two video clips.

18. The method of claim 1, wherein the position of the image feature is derived from a two dimensional spline and the size of the image feature is derived from a one dimensional spline, and wherein the cropping is conducted based on an area determined from the size and position of the image feature.

9. A method comprising:

a. Creating an image feature on a display showing a multimedia material;

b. Generating an image of the image feature using a camera;

c. Using the image of the image feature to iteratively update a position of the image feature on the display, the position of the image feature being determined by a position of the camera;

d. Recording the position of the image feature for each iteration;

Transforming the multimedia material based on the recorded position of the image feature; and

,

smoothing the position of the image feature on the display using a spline;

wherein the multimedia material comprises at least two frames and wherein transforming the multimedia material comprises cropping the at least two frames of the multimedia material in accordance with the position and a size of the image feature.

10. The method of claim 9, wherein the image feature comprises a colored circle, a colored rectangle or a colored quadrilateral.

11. The method of claim 9, further comprising calculating a surface area of the image feature and using the calculated surface area to determine a distance between the camera and the display.

12. The method of claim 9, wherein using the image comprises filtering out a color of the image feature from the multimedia material shown on the display.

13. The method of claim 9, wherein the camera is a webcam.

14. The method of claim 9, further comprising assembling the cropped at least two frames into a video clip.

15. The method of claim 9, further comprising using the image of the image feature to determine an angle of the camera with respect to the display and to transform the multimedia material based on the determined angle.

16. The method of claim 9, wherein the multimedia material comprises multiple frames and wherein the method further comprises generating at least two video clips using the transformed multimedia material and interpolating a transition between the at least two video clips.

17. A non-transitory computer-readable medium embodying computer-readable instructions implementing a method comprising:

a. Creating an image feature on a display showing a multimedia material;

b. Generating an image of the image feature using a camera;

c. Using the image of the image feature to iteratively update a position of the image feature on the display, the position of the image feature being determined by a position of the camera;

d. Recording the position of the image feature for each iteration;

Transforming the multimedia material based on the recorded position of the image feature; and

smoothing the position of the image feature on the display using a spline;

wherein the multimedia material comprises at least two frames and wherein transforming the multimedia material comprises cropping the at least two frames of the multimedia material in accordance with the position and a size of the image feature.