Interface

• US 20060044280A1
• Filed: 08/31/2004
• Published: 03/02/2006
• Est. Priority Date: 08/31/2004
• Status: Abandoned Application

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Blythe, Michael M., Huddleston, Wyatt Allen, McNew, John R., Robideaux, Richard A.
• Application Number:
  US10/930,987
• Publication Number:
  US 20060044280A1
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G10H 1/34 Switch arrangements, e.g. keyboards or mechanical switches specially adapted for electrophonic musical instruments
• CPC Class Codes: G10H 2220/005 Non-interactive screen display of musical or status data graphical user interfaces specifically adapted for electrophonic musical instruments G10H2220/091; fingering displays G10H2220/041
• CPC Class Codes: G10H 2220/096 using a touch screen touch screen note input, e.g. using a displayed keyboard G10H2220/241; personal digital assistant [PDA] G10H2230/015
• CPC Class Codes: G10H 2220/241 on touchscreens, i.e. keys, frets, strings, tablature or staff displayed on a touchscreen display for note input purposes
• CPC Class Codes: G10H 2220/455 Camera input, e.g. analyzing pictures from a video camera and using the analysis results as control data

Abstract

An attribute of an image of an object produced by placing the object on an exterior surface of a touch screen of an interface is determined, and a property of an input to the interface is determined based on the attribute of the image.

Claims

1. A method of operating an interface, comprising:

determining an attribute of an image of an object produced by placing the object on an exterior surface of a touch screen; and

determining a property of an input to the interface based on the attribute of the image.

2. The method of claim 1, wherein determining the property comprises comparing the attribute of the image to an attribute of an image that is pre-calibrated to the property.

3. The method of claim 1, wherein determining an attribute of an image of an object produced by placing the object on an exterior surface of the touch screen comprises photographing the image though an interior surface of the touch screen.

4. The method of claim 1, wherein the object is a user'"'"'s finger, and the property is pressure exerted by the finger on the touch screen.

5. The method of claim 4, wherein the pressure corresponds to a volume of a musical note.

6. The method of claim 1 further comprises comparing the attribute of the image to an attribute of an image of the object at an earlier time.

7. The method of claim 1, wherein the object is positioned within a region of at least part of an image of a musical instrument projected onto a rear side of the touch-screen.

8. The method of claim 7 further comprises re-projecting the region onto the rear side of the touch-screen in response to changing a pressure exerted on the object positioned within the region.

9. The method of claim 1, wherein determining the property further comprises determining the property based on a location of the object on the exterior surface.

10. The method of claim 1, wherein the attribute comprises a geometrical attribute.

11. A method of operating a touch-screen interface, comprising:

projecting an image of at least a part of at least one musical instrument onto a rear side of a projection screen of the touch-screen interface;

determining a geometrical attribute of an image of each of one or more objects placed onto a front side of the projection screen respectively within one or more regions of the image of the at least part of at least one musical instrument; and

producing a musical sound based on the geometrical attribute of the image of each of the one or more objects that corresponds to the at least one musical instrument.

12. The method of claim 11 further comprises changing the musical sound by moving at least one of the one or more objects to another region of the image of the at least one musical instrument.

13. The method of claim 11 further comprises changing the musical sound by changing the geometrical attribute of the image of at least one of the one or more objects by changing a pressure applied to that object or rolling that object.

14. The method of claim 13 further comprises re-projecting the region of the image of the at least part of at least one musical instrument containing the at least one of the one or more objects onto the rear side of the projection screen in response to changing the size of the image.

15. The method of claim 11 further comprises receiving musical inputs from one or more external sources.

16. The method of claim 15, wherein the one or more external sources comprise at least one or more other touch-screen interfaces and a Musical Instrument Digital Interface.

17. An interface comprising:

a means for determining an attribute of an image of an object produced by placing the object on an exterior surface of a touch screen; and

a means for determining a property of an input to the interface based on the attribute of the image.

18. The interface of claim 17 further comprises a means for creating an image of at least a part of at least one musical instrument on the touch screen.

19. The interface of claim 17 further comprises a means for producing a musical sound based on the attribute of the image.

20. The interface of claim 17 further comprises a means for determining a rate of change of the attribute of the image.

21. The interface of claim 17 further comprises a means for changing an attribute of a region of the touch-screen in response to changing a pressure exerted on the object positioned within the region.

22. An interface comprising:

a rear projection screen;

a projector directed at a rear surface of the rear projection screen;

a camera directed at the rear surface of the rear projection screen for detecting attributes of images of objects positioned on a front surface of the rear projection screen; and

an image-capturer connected to the camera for receiving the attributes of the images of the objects from the camera.

23. The interface of claim 22, wherein the attributes comprise a geometrical attributes.

24. The interface of claim 22 further comprises a processor connected to the image-capturer and the projector.

25. The interface of claim 24, wherein the processor is adapted to instruct the projector to project images of at least a portion of one or more musical instruments onto the rear projection screen.

26. The interface of claim 24, wherein the processor is adapted to assign musical sounds in response to the shapes of the objects during time periods.

27. The interface of claim 22 further comprises a sound system.

28. A computer-usable media containing computer-readable instructions for causing an interface to perform a method, comprising:

determining an attribute of an image of an object produced by placing the object on an exterior surface of a touch screen; and

determining a property of an input to the interface based on the attribute of the image.

29. The method of claim 28, wherein the attribute comprises a geometrical attribute.

30. The computer-usable media of claim 28, wherein, in the method, the object is a user'"'"'s finger, and the property is pressure exerted by the finger on the touch screen.

31. The computer-usable media of claim 28, wherein the method further comprises comparing the attribute of the image to an attribute of an image of the object at an earlier time.

32. The computer-usable media of claim 28, wherein the method further comprises re-projecting a region onto a rear side of the touch screen in response to changing a pressure exerted on the object.

33. The computer-usable media of claim 28, wherein, in the method, determining the property further comprises determining the property based on a location of the object on the exterior surface.

34. A computer-usable media containing computer-readable instructions for causing a touch-screen interface to perform a method, comprising:

projecting an image of at least a part of at least one musical instrument onto a rear side of a projection screen of the touch-screen interface;

determining a geometrical attribute of an image of each of one or more objects placed onto a front side of the projection screen respectively within one or more regions of the image of the at least a part of at least one musical instrument; and

producing a musical sound based on the geometrical attribute of the image of each of the one or more objects that corresponds to the at least one musical instrument.

35. The computer-usable media of claim 34, wherein the method further comprises changing the musical sound by moving at least one of the one or more objects to another region of the image of the at least one musical instrument.

36. The computer-usable media of claim 34, wherein the method further comprises changing the musical sound by changing the geometrical attribute of the image of at least one of the one or more objects by changing a pressure applied to that object or rolling that object.