System and method for controlling remote devices from a client computer using digital images

• US 6,463,343 B1
• Filed: 08/10/1999
• Issued: 10/08/2002
• Est. Priority Date: 08/10/1999
• Status: Expired due to Term

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Sundaresan, Neelakantan, Kraft, Reiner, Emens, Michael Lawrence
• Primary Examiner(s): PATEL, RAMESH B
• Application Number:
  US09/371,739
• Time in Patent Office: 1,155 Days
• Field of Search: 700/17, 700/18, 700/19, 700/20, 700/59, 700/65, 700/66, 700/83, 700/86, 700/87, 700/88, 709/201, 709/203, 709/217, 709/218, 709/219, 709/204, 382/115, 382/119, 382/232, 707/10, 707/104.1, 707/201
• US Class Current: 700/83
• CPC Class Codes: G05B 19/042 using digital processors G05B19/05 takes precedence
• CPC Class Codes: G05B 2219/23051 Remote control, enter program remote, detachable programmer
• CPC Class Codes: G05B 2219/25168 Domotique, access through internet protocols
• CPC Class Codes: G05B 2219/32126 Hyperlink, access to program modules and to hardware modules in www, web server, browser

Abstract

A method, apparatus, and article of manufacture for controlling a remote device from a client computer using a digital image of a remote location associated with the remote device. Using graphical user interface (GUI) provided by a client computer, the user select areas in the digital image for mapping to control functions for the remote device. These control functions are associated with command objects downloaded from a server computer and displayed on the graphical user interface. The control functions for the remote device can then be selected by moving a cursor over the selected areas of the digital image. When a control function is selected, the client computer formulates a request that the server computer and/or remote device can understand. Instantaneous feedback is provided by the digital image for any control functions that may be invoked by the user.

Claims

1. A method for controlling remote devices using a computer, comprising:

(a) displaying a digital image of a remote location associated with a remote device on a user interface of the computer;

(b) selecting at least one area in the displayed digital image, wherein the selected area is associated with the remote device;

(c) mapping the selected area to at least one control function for the remote device; and

(d) invoking the control function for the remote device via the selected area.

2. The method of claim 1, wherein the digital image is a live digital image.

3. The method of claim 1, wherein the digital image is displayed by a Web browser.

4. The method of claim 1, wherein the computer is connected to a server that controls a remote camera for generating the digital image.

5. The method of claim 4, wherein the camera is positioned at the remote location with the remote device.

6. The method of claim 4, wherein the server controls the remote device.

7. The method of claim 1, wherein the selecting step comprises moving a cursor over the displayed digital image to designate the selected area.

8. The method of claim 1, wherein the selected area of the digital image defines a “

hot spot”

.

9. The method of claim 8, wherein the “

hot spot”

is visually identified on the display.

10. The method of claim 1, wherein the mapping step comprises displaying a list of command objects representing a plurality of control functions for one or more remote devices and selecting at least one of the command objects from the list in order to associate at least one control function for a remote device with the selected area.

11. The method of claim 10, wherein the list of command objects is managed by a server connected to the computer that controls the remote device.

12. The method of claim 11, wherein the list of command objects is downloaded from the server to the computer.

13. The method of claim 1, wherein the invoking step comprises formulating a request into a command language for the remote device, and transmitting the request to a server computer managing the remote device.

14. The method of claim 1, further comprising displaying a response to the invoked command on the computer.

15. The method of claim 1, further comprising downloading a client coordinator to the computer from a server connected to the computer.

16. A system for controlling remote devices, comprising:

(a) a computer; and

(b) a graphical user interface (GUI), performed by the computer, for displaying a digital image of a remote location associated with a remote device for an operator, for accepting input from the operator selecting at least one area in the displayed digital image, wherein the selected area is associated with the remote device, for mapping the selected area to at least one control function for the remote device, and for accepting input from the operator invoking the control function for the remote device via the selected area.

17. The system of claim 16, wherein the digital image is a live digital image.

18. The system of claim 16, wherein the digital image is displayed by a Web browser.

19. The system of claim 16, wherein the computer is connected to a server that controls a remote camera for generating the digital image.

20. The system of claim 19, wherein the camera is positioned at the remote location with the remote device.

21. The system of claim 19, wherein the server controls the remote device.

22. The system of claim 16, wherein the means for selecting comprises means for moving a cursor over the displayed digital image to designate the selected area.

23. The system of claim 16, wherein the selected area of the digital image defines a “

hot spot”

.

24. The system of claim 23, wherein the “

hot spot”

is visually identified on the display.

25. The system of claim 16, wherein the means for mapping comprises means for displaying a list of command objects representing a plurality of control functions for one or more remote devices and for selecting at least one of the command objects from the list in order to associate at least one control function for a remote device with the selected area.

26. The system of claim 25, wherein the list of command objects is managed by a server connected to the computer that controls the remote device.

27. The system of claim 26, wherein the list of command objects is downloaded from the server to the computer.

28. The system of claim 16, wherein the means for invoking comprises means for formulating a request into a command language for the remote device, and for transmitting the request to a server computer managing the remote device.

29. The system of claim 16, further comprising means for displaying a response to the invoked command on the computer.

30. The system of claim 16, further comprising means for downloading a client coordinator to the computer from a server connected to the computer.

31. An article of manufacture embodying logic for performing a method for controlling remote devices using a computer, the method comprising the steps of:

(a) displaying a digital image of a remote location associated with a remote device on a user interface of the computer;

(b) selecting at least one area in the displayed digital image, wherein the selected area is associated with the remote device;

(c) mapping the selected area to at least one control function for the remote device; and

(d) invoking the control function for the remote device via the selected area.

32. The method of claim 31, wherein the digital image is a live digital image.

33. The method of claim 31, wherein the digital image is displayed by a Web browser.

34. The method of claim 31, wherein the computer is connected to a server that controls a remote camera for generating the digital image.

35. The method of claim 34, wherein the camera is positioned at the remote location with the remote device.

36. The method of claim 34, wherein the server controls the remote device.

37. The method of claim 31, wherein the selecting step comprises moving a cursor over the displayed digital image to designate the selected area.

38. The method of claim 31, wherein the selected area of the digital image defines a “

hot spot”

.

39. The method of claim 38, wherein the “

hot spot”

is visually identified on the display.

40. The method of claim 31, wherein the mapping step comprises displaying a list of command objects representing a plurality of control functions for one or more remote devices and selecting at least one of the command objects from the list in order to associate at least one control function for a remote device with the selected area.

41. The method of claim 40, wherein the list of command objects is managed by a server connected to the computer that controls the remote device.

42. The method of claim 41, wherein the list of command objects is downloaded from the server to the computer.

43. The method of claim 31, wherein the invoking step comprises formulating a request into a command language for the remote device, and transmitting the request to a server computer managing the remote device.

44. The method of claim 31, further comprising displaying a response to the invoked command on the computer.

45. The method of claim 31, further comprising downloading a client coordinator to the computer from a server connected to the computer.