REGION OF INTEREST CLASSIFICATION

• US 20190332177A1
• Filed: 12/21/2016
• Published: 10/31/2019
• Est. Priority Date: 12/21/2016
• Status: Active Grant

• Current Assignee: Telefonaktiebolaget LM Ericsson
• Original Assignee: Telefonaktiebolaget LM Ericsson
• Inventors: ARAUJO, Jose, ANDERSSON, Lars, TAYAMON, Soma
• Granted Patent: US 10,831,277 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06V 10/25 Determination of region of interest [ROI] or a volume of interest [VOI]

Abstract

There is provided mechanisms for region of interest classifying a region. The region is represented by haptic data and visual data. The method is performed by a controller. The method comprises obtaining the haptic data and the visual data of the region. The method comprises quality rating the haptic data in at least part of the region based on at least one property of the haptic data and with respect to the visual data in said at least part of the region. The method comprises defining at least one region of interest in the region by modifying at least one of the haptic data and the visual data of said at least part of the region according to the quality rating of the haptic data, thereby region of interest classifying the region.

Claims

1. A method for region of interest classifying a region, the region being represented by haptic data and visual data, the method being performed by a controller, the method comprising:

obtaining the haptic data and the visual data of the region;

quality rating the haptic data in at least part of the region based on at least one property of the haptic data and with respect to the visual data in said at least part of the region; and

defining at least one region of interest in the region by modifying at least one of the haptic data and the visual data of said at least part of the region according to the quality rating of the haptic data, thereby region of interest classifying the region.

2. The method according to claim 1, further comprising:

obtaining, from a haptic user interface device, an indication of user intent for haptic interaction with an object in said at least part of the region.

3. The method according to claim 2, wherein the haptic data and the visual data of the object are obtained in response thereto.

4. The method according to claim 1, wherein said at least part of the region comprises an object having and an interior and a surface enclosing the interior, and wherein the haptic data and the visual data of said at least part of the region relate to the surface of the object or the interior of the object.

5. The method according to claim 1, wherein said at least one property of the haptic data relates to amount of details in the haptic data.

6. The method according to claim 1, wherein the quality rating the haptic data is based on amount of details in the visual data.

7. The method according to claim 2, wherein the quality rating of the haptic data is based on at least one property of the haptic user interface device.

8. The method according to claim 1, wherein the quality rating of the haptic data is based on visual information of said at least part of the region, said visual information being received from a visual user interface device.

9. The method according to claim 1, wherein said quality rating of the haptic data is time dependent.

10. The method according to claim 1, wherein said quality rating of the haptic data relates to at least one haptic property in a group of stiffness, friction, texture, temperature, vibration, force, and weight.

11. The method according to claim 1, wherein said quality rating of the haptic data depends on colour and depth information in the visual data in said at least part of the region.

12. The method according to claim 1, further comprising:

assigning labels to the haptic data with respect to the quality rating of the haptic data.

13. The method according to claim 12, wherein each label is associated with a respective level importance indication, and wherein said quality rating of the haptic data depends on said level of importance indication.

14. The method according to claim 12, wherein the at least one of the haptic data and the visual data is modified according to the labels.

15. The method according to claim 1, wherein said quality rating comprises correlating the haptic data said in at least part of the region with the visual data in said at least part of the region.

16. The method according to claim 1, wherein said modifying comprises:

changing a transparency parameter of at least one of the visual data and the haptic data of said at least part of the region.

17. The method according to claim 1, wherein said modifying comprises:

creating an outline around said at least part of the region in at least one of the haptic data and the visual data.

18. The method according to claim 1, wherein the quality rating of the haptic data in the at least part of the region indicates that the at least part of the region has higher haptic quality than an adjoining part of the region, and wherein said modifying comprises:

removing haptic data from said adjoining part.

19. (canceled)

20. (canceled)

21. (canceled)

22. A controller for region of interest classifying a region, the region being represented by haptic data and visual data, the controller comprising:

processing circuitry; and

a storage medium storing instructions that, when executed by the processing circuitry, cause the controller to;

obtain the haptic data and the visual data of the region;

quality rate the haptic data in at least part of the region based on at least one property of the haptic data and with respect to the visual data in said at least part of the region; and

define at least one region of interest in the region by modifying at least one of the haptic data and the visual data of said at least part of the region according to the quality rating of the haptic data, thereby region of interest classifying the region.

23. (canceled)

24. A computer program product for region of interest classifying a region, the region being represented by haptic data and visual data, the computer program product comprising a non-transitory computer readable medium storing computer code which, when run on processing circuitry of a controller, causes the controller to:

obtain the haptic data and the visual data of the region;

quality rate the haptic data in at least part of the region based on at least one property of the haptic data and with respect to the visual data in said at least part of the region; and

define at least one region of interest in the region by modifying at least one of the haptic data and the visual data of said at least part of the region according to the quality rating of the haptic data, thereby region of interest classifying the region.

25. (canceled)