Method and apparatus for determining the presence of a device for executing operations

• US 9,170,607 B2
• Filed: 10/17/2011
• Issued: 10/27/2015
• Est. Priority Date: 10/17/2011
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Bose, Raja, Park, Keun-Young, Brakensiek, Jrg, Lester, Jonathan
• Primary Examiner(s): Elahi, Towfiq
• Application Number:
  US13/274,820
• Publication Number:
  US 20130093713A1
• Time in Patent Office: 1,471 Days
• Field of Search: 345173-174
• US Class Current: 1/1
• CPC Class Codes: G01S 5/0072 Transmission between mobile stations, e.g. anti-collision systems
• CPC Class Codes: G06F 1/1632 External expansion units, e.g. docking stations
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/04162 for exchanging data with external devices, e.g. smart pens, via the digitiser sensing hardware
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces
• CPC Class Codes: H04M 1/72415 for remote control of appliances
• CPC Class Codes: H04M 2250/04 including near field communication means, e.g. RFID
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion
• CPC Class Codes: H04M 2250/22 including a touch pad, a touch sensor or a touch detector

Abstract

An apparatus, method, and computer program product are described that can detect the presence of a tangible object without using computer vision. The apparatus receives a signal from a device proximate the apparatus, where the signal includes at least one of a proximity component and an orientation component, and also receives a touch input from the associated display. The apparatus then determines whether there is an association between the signal and the touch input based on the proximity component and/or the orientation component. If the signal and the touch input are associated, it is an indication that the device is disposed on the display, operations may be executed, such as to facilitate interaction between the apparatus and the device. As a result, any object capable of providing a signal having a proximity component or an orientation component can be detected (e.g., without the use of cameras or fiducial markers).

Claims

1. An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the processor, cause the apparatus to at least:

receive a signal transmitted by a device proximate the apparatus, wherein the signal includes at least one of a proximity component or an orientation component;

receive a touch input resulting from contact between an object and a display associated with the apparatus;

determine whether the object causing the touch input is the device that transmitted the signal by determining whether there is an association between the signal and the touch input based on at least one of the proximity component or the orientation component, wherein the association is indicative of the device being disposed on the display;

receive content from the device in response to the determination that there is an association between the signal and the touch input;

provide for presentation of the content on the display associated with the apparatus;

provide for presentation of a list of user options on the display; and

perform an action on the content based at least in part on movement of the device with respect to the display associated with the apparatus and with respect to the content presented thereon, wherein contact between the device and the display associated with the apparatus is maintained during the movement of the device, and wherein the action is performed on the content based at least in part on selection of one of the user options.

2. The apparatus of claim 1, wherein the signal received from the device is a radio frequency signal.

3. The apparatus of claim 1, wherein the memory and computer program code are configured to, with the processor, cause the apparatus to transmit an inquiry signal, and wherein the signal transmitted by the device is transmitted in response to the inquiry signal.

4. The apparatus of claim 3, wherein the inquiry signal is transmitted in response to the receipt of the touch input.

5. The apparatus of claim 1, wherein the touch input is received in response to the receipt of the signal transmitted by the device.

6. The apparatus of claim 1, wherein the touch input comprises detection of a force applied to the display.

7. The apparatus of claim 1, wherein the touch input comprises information received from a capacitive or resistive touch sensor associated with the display.

8. The apparatus of claim 1, wherein the signal received from the device includes an identity component, wherein the memory and computer program code are configured to, with the processor, cause the apparatus to exchange data with the device at least partly based on the identity component.

9. The apparatus of claim 1, wherein the memory and computer program code are configured to, with the processor, cause the apparatus to determine a relative orientation of the display with respect to a known magnetic field.

10. The apparatus of claim 9, wherein the orientation component comprises an indication of a relative orientation of the device with respect to the known magnetic field, and wherein the memory and computer program code are configured to, with the processor, cause the apparatus to determine an orientation of the device with respect to the display based on a comparison of the relative orientation of the display with the relative orientation of the device.

11. A method comprising:

receiving a signal transmitted by a device proximate an apparatus, wherein the signal includes at least one of a proximity component or an orientation component;

receiving a touch input resulting from contact between an object and a display associated with the apparatus;

determining, via a processor, whether the object causing the touch input is the device that transmitted the signal by determining whether there is an association between the signal and the touch input based on at least one of the proximity component or the orientation component, wherein the association is indicative of the device being disposed on the display;

receiving content from the device in response to the determination that there is an association between the signal and the touch input;

providing for presentation of the content on the display associated with the apparatus;

providing for presentation of a list of user options on the display; and

performing an action on the content based at least in part on movement of the device with respect to the display associated with the apparatus and with respect to the content presented thereon, wherein contact between the device and the display associated with the apparatus is maintained during the movement of the device, and wherein the action is performed on the content based at least in part on selection of one of the user options.

12. The method of claim 11 further comprising transmitting an inquiry signal, wherein the signal transmitted by the device is transmitted in response to the inquiry signal.

13. The method of claim 12, wherein the inquiry signal is transmitted in response to the receipt of the touch input.

14. The method of claim 11, wherein the touch input is received in response to the receipt of the signal transmitted by the device.

15. The method of claim 11 further comprising determining a relative orientation of the display with respect to a known magnetic field.

16. The method of claim 15, wherein the orientation component comprises an indication of a relative orientation of the device with respect to the known magnetic field, and wherein the method further comprises determining an orientation of the device with respect to the display based on a comparison of the relative orientation of the display with the relative orientation of the device.

17. A computer program product comprising at least one non-transitory computer-readable storage medium having computer-executable program code portions stored therein, the computer-executable program code portions comprising program code instructions for:

receiving a signal transmitted by a device, wherein the signal includes at least one of a proximity component or an orientation component;

receiving a touch input resulting from contact between an object and a display;

determining whether the object causing the touch input is the device that transmitted the signal by determining whether there is an association between the signal and the touch input based on at least one of the proximity component or the orientation component, wherein the association is indicative of the device being disposed on the display;

receiving content from the device in response to the determination that there is an association between the signal and the touch input;

providing for presentation of the content on the display;

providing for presentation of a list of user options on the display; and

performing an action on the content based at least in part on movement of the device with respect to the display and with respect to the content presented thereon, wherein contact between the device and the display is maintained during the movement of the device, and wherein the action is performed on the content based at least in part on selection of one of the user options.

18. The computer program product of claim 17 further comprising program code instructions for transmitting an inquiry signal, wherein the signal transmitted by the device is transmitted in response to the inquiry signal.

19. The computer program product of claim 18, wherein the inquiry signal is transmitted in response to the receipt of the touch input.

20. The computer program product of claim 17, wherein the touch input is received in response to the receipt of the signal transmitted by the device.

21. The computer program product of claim 17 further comprising program code instructions for determining a relative orientation of the display with respect to a known magnetic field.

22. The computer program product of claim 21, wherein the orientation component comprises an indication of a relative orientation of the device with respect to the known magnetic field, and wherein further comprising program code instructions for determining an orientation of the device with respect to the display based on a comparison of the relative orientation of the display with the relative orientation of the device.