ACCESSORY TO IMPROVE USER EXPERIENCE WITH AN ELECTRONIC DISPLAY

• US 20130088434A1
• Filed: 10/06/2011
• Published: 04/11/2013
• Est. Priority Date: 10/06/2011
• Status: Abandoned Application

• Current Assignee: Sony Ericsson Mobile Communications USA Incorporated (Sony Group Corp.)
• Original Assignee: Sony Ericsson Mobile Communications USA Incorporated (Sony Group Corp.)
• Inventors: Masuda, Takefumi, Okuda, Tetsuya, Subba, Chandrashekar
• Application Number:
  US13/267,881
• Publication Number:
  US 20130088434A1
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 1/3212 Monitoring battery levels, e.g. power saving mode being initiated when battery voltage goes below a certain level
• CPC Class Codes: G06F 1/3262 Power saving in digitizer or tablet
• CPC Class Codes: G06F 2203/0383 Remote input, i.e. interface arrangements in which the signals generated by a pointing device are transmitted to a PC at a remote location, e.g. to a PC in a LAN
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/0393 Accessories for touch pads or touch screens, e.g. mechanical guides added to touch screens for drawing straight lines, hard keys overlaying touch screens or touch pads
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04M 1/72415 for remote control of appliances
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

Embodiments of the invention are directed to systems, methods and computer program products for determining positional data associated with a hand or a finger that interacts with a touch panel device. In some embodiments, a method includes determining, with respect to a touch panel device, positional data associated with a user'"'"'s first hand that interacts with the touch panel device. Additionally, the method includes creating an image of the user'"'"'s first hand using the positional data. Additionally, the method includes transmitting the image of the user'"'"'s first hand to a display device. Additionally, the method includes presenting the image of the user'"'"'s hand on the display device. Additionally, the method includes identifying a finger of the user'"'"'s first hand based at least partially on the determining, with respect to a touch panel device, positional data associated with a user'"'"'s first hand that interacts with the touch panel device.

Claims

1. A method comprising:

determining, with respect to a touch panel device, positional data associated with a user'"'"'s first hand that interacts with the touch panel device;

creating an image of the user'"'"'s first hand using the positional data; and

transmitting the image of the user'"'"'s first hand to a display device, wherein the display device is separate from the touch panel device, wherein the image of the user'"'"'s first hand is presented on the display device, and wherein the image of the user'"'"'s first hand overlaps other visual information presented on the display device.

2. The method of claim 1, further comprising:

determining whether the user'"'"'s first hand is a right hand or a left hand based on the determining positional data associated with the user'"'"'s first hand that interacts with the touch panel device.

3. The method of claim 1, further comprising:

determining, with respect to the touch panel device, positional data associated with the user'"'"'s second hand that interacts with the touch panel device.

4. The method of claim 3, further comprising:

identifying a finger of the user'"'"'s first hand or the user'"'"'s second hand based on the determining positional data associated with the user'"'"'s first hand and the determining positional data associated with the user'"'"'s second hand.

5. The method of claim 4, further comprising:

performing a function associated with the touch panel device based on the identifying a finger of the user'"'"'s first hand or the user'"'"'s second hand.

6. The method of claim 3, wherein the determining positional data associated with the user'"'"'s first hand and the determining positional data associated with the user'"'"'s second hand are executed using one or more sensors or one or more image capturing components associated with the touch panel device, wherein the touch panel device includes a display and a frame, and wherein one or more sensors sense interactions associated with the display and the frame.

7. The method of claim 1, wherein the user'"'"'s first hand interacts with the touch panel device when the user performs at least one of:

touching the touch panel device using the user'"'"'s first hand, bringing the user'"'"'s first hand in close proximity to the touch panel device, or grabbing the touch panel device using the user'"'"'s first hand, wherein grabbing comprises touching at least a part of a front surface of the touch panel device using the user'"'"'s first hand and touching at least a part of a back surface of the touch panel device using the user'"'"'s first hand.

8. The method of claim 1, wherein the transmitting further comprises transmitting a continuous stream of images of the user'"'"'s first hand, and wherein the presenting comprises presenting the continuous stream of images.

9. The method of claim 4, wherein the identifying further comprises identifying a part of the finger, wherein the identified part is at least one of:

a top portion of the finger, a middle portion of the finger, or a bottom portion of the finger.

10. The method of claim 4, wherein the identifying is based at least partially on predetermined kinematic data or on data input by the user.

11. The method of claim 1, further comprising:

disabling the determining when the amount of determined positional data is greater than a predetermined threshold amount of positional data.

12. The method of claim 1, wherein the determining further comprises determining positional data associated with the user'"'"'s first hand in response to one or more triggering events.

13. The method of claim 4, wherein the identifying is based at least partially on a software application that is executed on the touch panel device.

14. The method of claim 4, wherein the identifying is based at least partially on at least one of:

a probability map associated with the touch panel device, or a ring associated with a finger.

15. The method of claim 4, wherein the identifying is based at least partially on at least one of:

an orientation of the touch panel device or dimensions associated with the touch panel device.

16. The method of claim 1, further comprising:

determining, using a sensor associated with the touch panel device, a pressure associated with an interaction, with the touch panel device, of a finger of the user'"'"'s first hand; and

in response to determining the pressure associated with the interaction is greater than a threshold pressure, registering a touch event.

17. The method of claim 1, wherein the positional data includes positional data along the x-axis, the y-axis, and the z-axis with respect to the touch panel device surface.

18. The method of claim 1, further comprising:

determining an amount of energy remaining in a power source associated with the touch panel device, wherein an amount of positional data determined by the touch panel device is based partially on the amount of energy remaining in the power source.

19. A system comprising:

a touch panel device that comprises a memory and a processor;

a module stored in the memory, executable by the processor, and configured to;

determine, with respect to the touch panel device, positional data associated with a user'"'"'s first hand that interacts with the touch panel device; and

transmit the positional data to the display device, wherein an image of the user'"'"'s first hand is created at the display device using the positional data, wherein the display device is separate from the touch panel device, wherein the image of the user'"'"'s first hand is presented on the display device, and wherein the image of the user'"'"'s first hand overlaps other visual information presented on the display device.

20. A computer program product comprising:

a non-transitory medium comprising a set of codes that cause a computer to;

determine, with respect to a touch panel device, positional data associated with a user'"'"'s first hand that interacts with the touch panel device;

create an image of the user'"'"'s first hand using the positional data; and

transmit the image of the user'"'"'s first hand to a display device, wherein the display device is separate from the touch panel device, wherein the image of the user'"'"'s first hand is presented on the display device, and wherein the image of the user'"'"'s first hand overlaps other visual information presented on the display device.