AUGMENTED REALITY VIRTUAL AUTOMOTIVE X-RAY HAVING SERVICE INFORMATION

• US 20130301875A1
• Filed: 03/15/2013
• Published: 11/14/2013
• Est. Priority Date: 05/11/2012
• Status: Active Grant

• Current Assignee: Robert Bosch GmbH, Bosch Automotive Service Solutions LLC (SPX Corporation)
• Original Assignee: Service Solutions US LLC
• Inventors: Schumacher, Darren
• Granted Patent: US 8,948,456 B2
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 2380/10 Automotive applications

Abstract

A tool for providing a user with information on a particular object related to a position and an orientation of the tool with respect to the object includes an image capturing device configured to capture an image of the object. The tool further includes a position and orientation sensor configured to determine the position of the tool with respect to the object, a processor configured to determine from the image the type of object, a display configured to display the image of the object, the display further configured to display additional information in addition to the image of the object in response to the determination of the type of object, and the processor further configured to determine a change in one of the position and the orientation of the sensor and the tool and further configured to modify the display.

Claims

1. A tool for providing a user with information on a particular object related to a position and an orientation of the tool with respect to the object comprising:

an image capturing device configured to capture an image of the object;

a position and orientation sensor configured to determine the position of the tool with respect to the object;

a processor configured to determine from the image the type of object;

a display configured to display the image of the object;

the display further configured to display additional information in addition to the image of the object in response to the determination of the type of object; and

the processor further configured to determine a change in one of the position and the orientation of the sensor and the tool and further configured to modify the display to display additional information in addition to the image of the object in response to the determination of the change in one of the position and the orientation.

2. The tool according to claim 1 wherein the image capturing device comprises a camera.

3. The tool according to claim 1 wherein the processor is further configured to at least one of receive diagnostic information from the object and conduct diagnostic tests on the object.

4. The tool according to claim 1 wherein the processor is further configured to determine the type of object based on at least one of the image of the object, information received from the object, and information received from the user about the object.

5. The tool according to claim 1 wherein the position and orientation sensor comprises one of a camera, a GPS device, and an inertial sensor.

6. The tool according to claim 1 wherein the object comprises a vehicle and wherein the additional information comprises at least one of schematics, wiring systems diagrams, internal images, and external images.

7. The tool according to claim 1 wherein the object comprises one of a patient, a power tool, and an appliance.

8. A process for operating a tool for providing a user with information on a particular object related to a position and orientation of the tool with respect to the object comprising:

capturing an image of the object;

sensing a position and orientation to determine the position of the tool with respect to the object;

determining from the image the type of object;

displaying the image of the object;

displaying additional information in addition to the image of the object in response to the determination of the type of object; and

determining a change in one of the position and orientation of the tool and further in displaying additional information in addition to the image of the object in response to the determination of the change in one of position and orientation.

9. The process according to claim 8 wherein the capturing the image comprises capturing the image with a camera.

10. The process according to claim 8 further comprising at least one of receiving diagnostic information from the object and conducting diagnostic tests on the object.

11. The process according to claim 8 further comprising determining the type of object based on at least one of the image of the object, information received from the object, and information received from the user about the object.

12. The process according to claim 8 wherein determining the position and orientation of the tool comprises determining the orientation and position of the tool with a position and orientation sensor that comprises one of a camera, a GPS device, and an inertial sensor.

13. The process according to claim 8 wherein the object comprises a vehicle and wherein the additional information comprises at least one of schematics, wiring systems diagrams, internal images, and external images.

14. The process according to claim 8 wherein the object comprises one of a patient, a power tool, and an appliance.

15. A tangible storage medium device storing computer executable instructions for a tool for providing a user with information on a particular object related to a position and orientation of the tool with respect to the object comprising:

instructions for capturing an image of the object;

instructions for sensing a position and orientation to determine the position of the tool with respect to the object;

instructions for determining from the image the type of object;

instructions for displaying the image of the object;

instructions for displaying additional information in addition to the image of the object in response to the determination of the type of object; and

instructions for determining a change in one of the position and orientation of the tool and further in displaying additional information in addition to the image of the object in response to the determination of the change in one of position and orientation.

16. The tangible storage medium device storing computer executable instructions for a tool according to claim 15 wherein the instructions for capturing the image comprises instructions for capturing the image with a camera.

17. The tangible storage medium device storing computer executable instructions for a tool according to claim 15 further comprising at least one of instructions for receiving diagnostic information from the object and instructions for conducting diagnostic tests on the object.

18. The tangible storage medium device storing computer executable instructions for a tool according to claim 15 further comprising instructions for determining the type of object based on at least one of the image of the object, information received from the object, and information received from the user about the object.

19. The tangible storage medium device storing computer executable instructions for a tool according to claim 15 wherein instructions for determining the position and orientation of the tool comprises instructions for determining the orientation and position of the tool with a position and orientation sensor that comprises one of a camera, a GPS device, and an inertial sensor.

20. The tangible storage medium device storing computer executable instructions for a tool according to claim 15 wherein the object comprises a vehicle and wherein the additional information comprises at least one of schematics, wiring systems diagrams, internal images, and external images.