REMOTE CONTROL SYSTEM

• US 20150181200A1
• Filed: 09/14/2012
• Published: 06/25/2015
• Est. Priority Date: 09/14/2012
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Corporation
• Inventors: Arrasvuori, Juha, Piippo, Petri, Vaittinen, Toumas
• Granted Patent: US 9,204,131 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/64 Three-dimensional objects
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: H04N 13/275 from 3D object models, e.g. computer-generated stereoscopic image signals
• CPC Class Codes: H04N 23/632 for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters

Abstract

A method comprising: capturing, by a device equipped with a camera, at least one image about a physical object; recognizing the physical object on the basis of the at least one captured image; retrieving a 3-dimensional (3D) model of the physical object from a memory; and showing the 3D model of the physical object on a display of the device.

Claims

1. A method comprising:

capturing, by a device equipped with a camera, at least one image about a physical object;

recognizing the physical object on the basis of the at least one captured image;

retrieving a 3-dimensional (3D) model of the physical object from a memory; and

displaying the 3D model of the physical object on a display of the device.

2. A method according to claim 1, further comprising

recognizing the physical object by computer vision.

3. A method according to claim 2, further comprising

providing an estimation of confidence of recognition of the physical object, indicated as proportional to a perfect match.

4. A method according to claim 3, further comprising

in response to the estimation of confidence of recognition of the physical object indicating a non-perfect match, prompting a plurality of 3D models of physical objects on the display of the device for a user to select.

5. A method according to any preceding claim, further comprising

providing means for rotating the 3D model on the display.

6. A method according to claim 5, wherein

the display is a touch screen and said means for rotating the 3D model are responsive to a touch detected on the screen.

7. A method according to any preceding claim, further comprising

providing the 3D model with additional information about the physical object to be shown on the display.

8. A method according to any preceding claim, further comprising

obtaining identification data of an apparatus recognized as the physical object via an Internet connection or a close-proximity radio connection.

9. A method according to claim 8, further comprising

establishing a connection between the device and the apparatus recognized as the physical object based on the identification data.

10. A method according to claim 9, wherein the establishing the connection includes performing authentication and authorization between the device and the apparatus to check the access rights of the user of the device.

11. A method according to claim 9 or 10, further comprising

providing the 3D model with at least one interactive user interface of the apparatus for controlling the operation of apparatus remotely.

12. A method according to claim 11, further comprising

displaying an area of the at least one interactive user interface of the apparatus highlighted on the 3D model;

and

in response to a user command detected on said area, displaying the corresponding interactive user interface of the apparatus on the display of the device.

13. A method according to claim 11 or 12, further comprising

in response to a user command detected on said interactive user interface, transmitting a corresponding command to the apparatus via the connection established between the device and the apparatus.

14. An apparatus comprising at least one processor, memory including computer program code, the memory and the computer program code configured to, with the at least one processor, cause the apparatus to at least:

capturing, by a camera, at least one image about a physical object;

recognizing the physical object on the basis of the at least one captured image;

retrieving a 3-dimensional (3D) model of the physical object from a memory; and

displaying the 3D model of the physical object on a display of the apparatus.

15. An apparatus according to claim 14, further comprising computer program code configured to, with the at least one processor, cause the apparatus to at least:

recognizing the physical object by computer vision.

16. An apparatus according to claim 15, further comprising computer program code configured to, with the at least one processor, cause the apparatus to at least:

providing an estimation of confidence of recognition of the physical object, indicated as proportional to a perfect match.

17. An apparatus according to claim 16, further comprising computer program code configured to, with the at least one processor, cause the apparatus to at least:

in response to the estimation of confidence of recognition of the physical object indicating a non-perfect match, prompting a plurality of 3D models of physical objects on the display of the device for a user to select.

18. An apparatus according to any of claims 14-17, further comprising computer program code configured to, with the at least one processor, cause the apparatus to at least:

providing means for rotating the 3D model on the display.

19. An apparatus according to claim 18, wherein

the display is a touch screen and said means for rotating the 3D model are responsive to a touch detected on the screen.

20. An apparatus according to any of claims 14-19, further comprising computer program code configured to, with the at least one processor, cause the apparatus to at least:

providing the 3D model with additional information about the physical object to be shown on the display.

21. An apparatus according to any of claims 14-20, further comprising computer program code configured to, with the at least one processor, cause the apparatus to at least:

obtaining identification data of an apparatus recognized as the physical object via an Internet connection or a close-proximity radio connection.

22. An apparatus according to claim 21, further comprising computer program code configured to, with the at least one processor, cause the apparatus to at least:

establishing a connection between the device and the apparatus recognized as the physical object based on the identification data.

23. An apparatus according to claim 22, wherein the establishing the connection includes performing authentication and authorization between the device and the apparatus to check the access rights of the user of the device.

24. An apparatus according to claim 22 or 23, further comprising providing the 3D model with at least one interactive user interface of the apparatus for controlling the operation of apparatus remotely.

25. An apparatus according to claim 24, further comprising computer program code configured to, with the at least one processor, cause the apparatus to at least:

displaying an area of the at least one interactive user interface of the apparatus highlighted on the 3D model; and

in response to a user command detected on said area, displaying the corresponding interactive user interface of the apparatus on the display of the device.

26. An apparatus according to claim 24 or 25, further comprising computer program code configured to, with the at least one processor, cause the apparatus to at least:

in response to a user command detected on said interactive user interface, transmitting a corresponding command to the apparatus via the connection established between the device and the apparatus.

27. A computer program embodied on a non-transitory computer readable medium, the computer program comprising instructions causing, when executed on at least one processor, at least one apparatus to:

capturing, by a camera, at least one image about a physical object;

recognizing the physical object on the basis of the at least one captured image;

retrieving a 3-dimensional (3D) model of the physical object from a memory; and

displaying the 3D model of the physical object on a display of the apparatus.

28. An apparatus comprising:

means for capturing at least one image about a physical object;

means for recognizing the physical object on the basis of the at least one captured image;

means for retrieving a 3-dimensional (3D) model of the physical object from a memory; and

means for displaying the 3D model of the physical object.

29. An apparatus according to claim 28, further comprising

means for recognizing the physical object by computer vision.

30. An apparatus according to claim 29, further comprising

means for providing an estimation of confidence of recognition of the physical object, indicated as proportional to a perfect match.

31. An apparatus according to claim 30, further comprising

means for prompting, responsive to the estimation of confidence of recognition of the physical object indicating a non-perfect match, a plurality of 3D models of physical objects on the display of the device for a user to select.

32. An apparatus according to any of claims 28-31, further comprising

means for providing means for rotating the 3D model on the display.

33. An apparatus according to claim 32, wherein

said means for displaying is a touch screen and said means for rotating the 3D model are responsive to a touch detected on the screen.

34. An apparatus according to any of claims 28-33, further comprising

means for providing the 3D model with additional information about the physical object to be shown on the display.

35. An apparatus according to any of claims 28-34, further comprising

means for obtaining identification data of an apparatus recognized as the physical object via an Internet connection or a close-proximity radio connection.

36. An apparatus according to claim 35, further comprising

means for establishing a connection between the device and the apparatus recognized as the physical object based on the identification data.

37. An apparatus according to claim 36, further comprising

means for performing authentication and authorization between the device and the apparatus to check the access rights of the user of the device.

38. An apparatus according to claim 36 or 37, further comprising

means for providing the 3D model with at least one interactive user interface of the apparatus for controlling the operation of apparatus remotely.

39. An apparatus according to claim 38, further comprising

means for displaying an area of the at least one interactive user interface of the apparatus highlighted on the 3D model;

and

means for displaying, responsive to a user command detected on said area, the corresponding interactive user interface of the apparatus on the display of the device.

40. An apparatus according to claim 38 or 39, further comprising

means for transmitting, responsive to a user command detected on said interactive user interface, a corresponding command to the apparatus via the connection established between the device and the apparatus.