Image processing system and method using device rotation

• US 10,373,375 B2
• Filed: 03/30/2012
• Issued: 08/06/2019
• Est. Priority Date: 04/08/2011
• Status: Active Grant

• Current Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips N.V.
• Inventors: Wenzel, Fabian, Truyen, Roel, Ermes, Jean-Pierre Franciscus Alexander Maria, Den Harder, Johan Michiel
• Primary Examiner(s): Hajnik, Daniel F
• Application Number:
  US14/007,698
• Publication Number:
  US 20140022242A1
• Time in Patent Office: 2,685 Days
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: H04N 13/349 Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking for viewing without the aid of special glasses using fly-eye lenses H04N13/307
• CPC Class Codes: H04N 13/388 Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof

Abstract

Image processing system 100 for enabling a user to navigate through image data having at least three spatial dimensions by displaying views 155 of the image data, the image processing system comprising an image device 110 comprising a display 130 for displaying the views of the image data and an orientation sensor 120 for measuring an orientation of the image device with respect to a reference orientation for providing rotation data 125 indicative of a device rotation of the image device, means 140 for establishing a center of rotation in the image data, and an image processor 150 for establishing the views of the image data in relation to the device rotation by, for establishing a current view, (i) receiving the rotation data from the orientation sensor, (ii) establishing a view rotation in relation to the device rotation, and (iii) establishing the current view in dependence on the view rotation around the center of rotation with respect to a reference view.

Claims

1. An image processing system for enabling a user to navigate through image data having at least three spatial dimensions by displaying views of the image data, the image processing system comprising:

an image device comprising a display for displaying the views of the image data and an orientation sensor for measuring an orientation of the image device with respect to a reference orientation and for providing rotation data indicative of a device rotation of the image device;

means for establishing, in the image data, a center of rotation about which the views of the image data from the image device rotate in the device rotation; and

an image processor for establishing the views of the image data in relation to the device rotation by;

(i) receiving the rotation data from the orientation sensor, (ii) establishing a view rotation in relation to the device rotation, and (iii) establishing a current view in dependence on the view rotation around the center of rotation with respect to a reference view;

wherein;

the means for establishing the center of rotation comprises a region of interest detector for detecting a medical anomaly as a region of interest in the image data,

enabling the means for establishing the center of rotation to establish the center of the region of interest as the center of rotation, and

the region of interest is imagery of a physical object within the image data.

2. The image processing system according to claim 1, wherein:

the image processing system further comprises a user input for receiving selection data from the user, and

the means for establishing the center of rotation is arranged for establishing the center of rotation in further dependence on the selection data so as to enable the user to influence a manner in which the center of rotation is established.

3. The image processing system according to claim 2, wherein:

the user input is arranged for receiving navigation data from the user, and

the image processor is arranged for establishing the views of the image data in dependence on the navigation data.

4. The image processing system according to claim 3, wherein the navigation data comprises a pan or a zoom navigation command.

5. The image processing system according to claim 1, wherein the image data comprises volumetric image data and the image processor is arranged for said establishing the current view by using at least one of a group of:

multi-planar reformatting, volume rendering, and surface rendering, to generate the current view.

6. The image processing system according to claim 1, wherein the image data comprises three-dimensional graphics data and the image processor is arranged for said establishing the current view by using graphics rendering to generate the current view.

7. The image processing system according to claim 1, wherein said establishing the current view comprises (i) establishing a 4×

4 transformation matrix in dependence on the view rotation and the center of rotation, and (ii) generating the current view using the 4×

4 transformation matrix.

8. The image processing system according to claim 1, wherein the image processor is arranged for establishing the view rotation in relation to the device rotation by applying a direct mapping to the device rotation to obtain the view rotation.

9. The image processing system according to claim 1, wherein the image processing system is arranged for receiving a reset command from the user for resetting the reference orientation or the reference view.

10. The image processing system according to claim 1, wherein the image processing system is arranged for receiving a pause command from the user for pausing said establishing the views of the image data in relation to the device rotation.

11. The image processing system of claim 1, wherein the image processor establishes the view rotation in relation to the device rotation by applying a gain to the device rotation to obtain the view rotation.

12. The image processing system of claim 1, wherein the image processor establishes the view rotation in relation to the device rotation by applying an offset to the device rotation to obtain the view rotation.

13. The image processing system of claim 1, wherein the image processor establishes the view rotation in relation to the device rotation by applying a threshold to the device rotation to obtain the view rotation.

14. The image processing system of claim 1, wherein the image processor establishes the view rotation in relation to the device rotation by applying a non-linear function to the device rotation to obtain the view rotation.

15. A handheld device comprising the image processing system of claim 1.

16. A handheld or an imaging apparatus comprising the image processing system of claim 1.

17. A method of enabling a user to navigate through image data having at least three spatial dimensions by displaying views of the image data on a display of an image device, the method comprising:

measuring, by an orientation sensor, an orientation of the image device with respect to a reference orientation for providing rotation data indicative of a device rotation of the image device;

establishing, in the image data, a center of rotation about which the views of the image data from the image device rotate in the device rotation; and

establishing the views of the image data in relation to the device rotation by;

(i) receiving the rotation data from the orientation sensor, (ii) establishing a view rotation in relation to the device rotation, and (iii) establishing a current view in dependence on the view rotation around the center of rotation with respect to a reference view, wherein;

establishing the center of rotation in the image data comprises;

automatically detecting a medical anomaly as a region of interest in the image data;

identifying a center of the region of interest; and

establishing the center of the region of interest as the center of rotation, and

the region of interest is imagery of a physical object within the image data.

18. A non-transitory computer-readable medium executable on a processor of an image processing system, which when executed by the image processing system cause the image processing system to perform the method according to claim 17.