AUGMENTED REALITY DEVICE INTERFACING

• US 20160217617A1
• Filed: 08/30/2013
• Published: 07/28/2016
• Est. Priority Date: 08/30/2013
• Status: Abandoned Application

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: BARRIBEAU, Jeremy Edward Kark
• Application Number:
  US14/914,555
• Publication Number:
  US 20160217617A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/1204 resulting in reduced user or operator actions, e.g. presetting, automatic actions, using hardware token storing data
• CPC Class Codes: G06F 3/1268 Job submission, e.g. submitting print job order or request not the print data itself
• CPC Class Codes: G06F 3/1292 Mobile client, e.g. wireless printing
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: H04N 1/00307 with a mobile telephone apparatus constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00
• CPC Class Codes: H04N 2201/0094 Multifunctional device, i.e. a device capable of all of reading, reproducing, copying, facsimile transception, file transception
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof

Abstract

Implementations of the present disclosure disclose an augmented reality interface. According to one implementation, an optical sensor is activated on a portable electronic device. A communicable object is connected with the portable electronic device upon being detected by the optical sensor. Moreover, a designated action is executed on the communicable object upon receiving input associated with the graphical representation of the communicable object on the user interface of the portable electronic device.

Claims

1. A method for providing augmented reality device interfacing comprising:

activating, via a processing unit, an optical sensor on a portable electronic device;

detecting, via the optical sensor, an communicable object;

providing for a connection between the portable electronic device and the communicable object upon detection, and

receiving, via a user interface associated with the portable electronic device, input associated with a graphical representation of the communicable object, wherein said input serves to execute a designated action on the communicable object.

2. The method of claim 1, further comprising:

displaying, via an augmented reality application installed on the processing unit, relevant information associated with the communicable object based on the user interaction with the graphical representation of the communicable device on the user interface.

3. The method of claim 1, wherein the communicable object is detected via fiducial markers affixed on the communicable object and recognizable by the portable electronic device when within the field of view of the camera.

4. The method of claim 1, wherein the communicable object is a printer device.

5. The method of claim 4, wherein the input comprises dragging an electronic document on the user interface onto the graphical representation of the printer device so as to cause the electronic document to print on physical media associated with the printer device.

6. The method of claim 4, wherein the input comprises touch selection of the graphical representation of the printer device on the user interface activates a scan operation by the printer device.

7. The method of claim 1, wherein the connection between the portable electronic device and the communicable device is established over a wireless network.

8. The method of claim 1, wherein the optical sensor is a rear-facing camera integrated within the portable electronic device.

9. An augmented reality device interfacing system comprising:

a tablet device having a rear-facing camera and an user interface for facilitating touch input from an operating user; and

an augmented reality application installed on the tablet device and configured to overlay graphics onto an image of a physical environment captured by the camera,

wherein a connection between the tablet device and the peripheral device is established upon the peripheral device being detected by the camera, and

wherein touch input associated with a graphical representation of the peripheral device on the user interface causes a designated action to execute on the peripheral device.

10. The system of claim 9, wherein the augmented reality application is configured to display relevant information associated with the peripheral device based on the user interaction with the graphical representation of the peripheral device on the user interface.

11. The system of claim 9, wherein the peripheral device is detected via fiducial markers affixed on peripheral device and recognizable by the tablet device when within a field of view of the camera.

12. The system of claim 9, wherein the peripheral device is a printer.

13. The system of claim 12, wherein when the touch input comprises dragging an electronic document on the user interface onto the graphical representation of the printer, a print operation is executed by the printer such that the electronic document is printed on physical media associated with the printer, and

wherein when the touch input comprises touch selection of the graphical representation of the printer device on the user interface, a scan operation is executed by the printer.

14. A non-transitory computer readable storage medium having stored executable instructions, that when executed by a processor, causes the processor to:

activate an integrated camera on a mobile computing device, wherein the mobile computing device includes an user interface for facilitating touch input from an operating user;

provide for connection between the mobile computing device and a printer device upon detection of a fiducial marker affixed onto the printer device, wherein the detection is made via the integrated camera of the mobile device;

provide for execution of a designated action on the printer device based upon touch input on the user interface associated with the graphical representation of the printer device, and

display relevant information associated with the printer device based on the user interaction with the graphical representation of the printer device on the user interface.

15. The computer readable storage medium of claim 14, wherein provide for execution of designated action on the printer includes executable instructions that further cause the processor to:

print an electronic document on physical media associated with the printer device when the touch input on the user interface comprises dragging the electronic document onto the graphical representation of the printer, and

scan a physical document on the printer device when the touch input on the user interface comprises touch selection of the graphical representation of the printer device.