CLOSED-LOOP DISPLAY CONTROL FOR MULTI-DIMENSIONAL USER INTERFACE GENERATION

• US 20180095645A1
• Filed: 09/01/2017
• Published: 04/05/2018
• Est. Priority Date: 09/02/2016
• Status: Active Grant

• Current Assignee: Accenture Global Solutions Limited (Accenture PLC)
• Original Assignee: Accenture Global Solutions Limited (Accenture PLC)
• Inventors: SUBUDHI, Chinu, JOGARAJU, Raghavender
• Granted Patent: US 10,628,013 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 2203/04802 3D-info-object: information is displayed on the internal or external surface of a three dimensional manipulable object, e.g. on the faces of a cube that can be rotated by the user
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 15/005 General purpose rendering architectures
• CPC Class Codes: G06T 15/80 Shading
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2215/12 Shadow map, environment map
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling
• CPC Class Codes: G06T 2219/2021 Shape modification
• CPC Class Codes: G09G 3/003 to produce spatial visual effects

Abstract

A system includes a holographic display that may create multi-dimensional images. The holographic display may be coupled to processing circuitry and display controller circuitry that may generate a multi-dimensional interface. The multi-dimensional interface may accept input from human interface devices that may translate human motion in multi-dimensional space into the multi-dimensional space of the multi-dimensional interface. The multi-dimensional interface may be generated by a holographic interface stack executing on the processing circuitry.

Claims

1. A system comprising:

display controller circuitry configured to drive a holographic display to render a 3D interface object responsive to a scene state indicator;

processing circuitry in data communication with the display controller circuitry, the processing circuitry configured to implement closed-loop state control over the display controller circuitry by;

at a base class layer of an holographic interface stack executing on the processing circuitry, selecting a specific user-interface (UI) object class for the 3D interface object from among multiple UI object classes;

responsive to the specific UI object class;

generating, at a renderer layer of the holographic interface stack, a graphical state indicator for 3D interface object; and

determining to associate the 3D interface object with a selected object property from a group of properties including a transform property, a gesture response property, and a widget property;

when the selected object property includes the transform property;

requesting a transform attribute value from a shape descriptor layer of the holographic interface stack;

responsive to the transform attribute value, updating the graphical state indicator by performing a scaling operation, a rotation operation, a positioning operation, or any combination thereof on the 3D interface object at the renderer layer;

when the selected object property includes the gesture response property;

requesting, from a gesture responder layer of the holographic interface stack, a gesture indicator for the 3D interface object, the gesture indicator comprising;

an indication of an associated gesture for the 3D interface object;

and

an indication of a preset response for the associated gesture;

when the selected object property includes the widget property;

associating an input channel, an output channel, or both with the 3D interface object;

updating, at the renderer layer, the graphical state indicator of the 3D interface object to include a graphical representation of the input channel, the output channel;

receiving, from the renderer layer, the graphical state indicator at a scene controller layer of the holographic interface stack;

responsive to the graphical state indicator, generating a scene state indicator responsive to a compiled holographic scene including the 3D interface object; and

sending the scene state indicator to the display controller circuitry.

2. The system of claim 1, where the input channel, the output channel, or both comprise an image channel, an audio channel, a text interface, or any combination thereof.

3. The system of claim 1, where processing circuitry is further configured to associate the input channel, the output channel, or both with a media control console renderable on the 3D interface object.

4. The system of claim 1, where the widget property further comprises an association with a memory access resource provided by a storage layer of the holographic interface stack.

5. The system of claim 1, where, responsive to the renderer layer performing the rotation operation, the processing circuitry is configured to change an activation orientation of the 3D interface object.

6. The system of claim 5, where the change to the activation orientation is configured to activate the widget property.

7. The system of claim 1, where the preset response is configured to alter the transform attribute value.

8. The system of claim 1, where the preset response comprises selection of one of multiple position-designated user input options.

9. The system of claim 1, where the holographic display comprises a 360 degree viewable angle range.

10. The system of claim 1, where the scene controller layer is configured to compile the complied holographic scene by accessing a lighting tool from a graphics language layer of the holographic interface stack.

11. The system of claim 10, where the renderer layer is configured to generate the graphical state indicator for the 3D interface object by accessing a shader tool from the graphics language layer of the holographic interface stack.

12. The system of claim 1, where processing circuitry is configured to receive a designation of the selected object property from a holographic interface design application.

13. The system of claim 12, where the holographic interface design application comprises an application programming interface (API) associated with the holographic interface stack.

14. A method comprising:

at display controller circuitry, driving a holographic display to render a 3D interface object responsive to a scene state indicator;

at processing circuitry in data communication with the display controller circuitry, implementing closed-loop state control over the display controller circuitry by;

at a base class layer of an holographic interface stack executing on the processing circuitry, selecting a specific user-interface (UI) object class for the 3D interface object among multiple UI object classes;

responsive to the specific UI object class;

generating, at a renderer layer of the holographic interface stack, a graphical state indicator for 3D interface object; and

determining to associate the 3D interface object with a selected object property from a group of properties including a transform property, a gesture response property, and a widget property;

when the selected object property includes the transform property;

requesting a transform attribute value from a shape descriptor layer of the holographic interface stack;

responsive to the transform attribute, updating the graphical state indicator by performing a scaling operation, a rotation operation, a positioning operation, or any combination thereof on the 3D interface object at the renderer layer;

when the selected object property includes the gesture response property;

requesting, from a gesture responder layer of the holographic interface stack, a gesture indicator for the 3D interface object, the gesture indicator comprising;

an indication of an associated gesture for the 3D interface object; and

an indication of preset response for the associated gesture;

when the selected object property includes the widget property;

associating an input channel, an output channel, or both with the 3D interface object;

updating, at the renderer layer, the graphical state indicator of the 3D interface object to include a graphical representation of the input channel, the output channel;

receiving, from the renderer layer, the graphical state indicator at a scene controller layer of the holographic interface stack;

responsive to the graphical state indicator, generating a scene state indicator responsive to a compiled holographic scene including the 3D interface object; and

sending the scene state indicator to the display controller circuitry.

15. The method of claim 14, where the input channel, the output channel, or both comprise an image channel, an audio channel, a text interface, or any combination thereof.

16. The method of claim 14, further comprising associating the input channel, the output channel, or both with a media control console renderable on the 3D interface object.

17. The method of claim 14, where the widget property further comprises an association with a memory access resource provided by a storage layer of the holographic interface stack.

18. A product comprising:

a machine-readable medium other than a transitory signal;

instructions stored on the machine-readable medium, the instructions configured to, when executed, cause processing circuitry to;

implement closed-loop state control over display controller circuitry configured to drive a holographic display to render a 3D interface object responsive to a scene state indicator by;

at a base class layer of an holographic interface stack executing on the processing circuitry, selecting a specific user-interface (UI) object class for the 3D interface object among multiple UI object classes;

responsive to the specific UI object class;

generating, at a renderer layer of the holographic interface stack, a graphical state indicator for 3D interface object; and

determining to associate the 3D interface object with a selected object property from a group of properties including a transform property, a gesture response property, and a widget property;

when the selected object property includes the transform property;

requesting a transform attribute value from a shape descriptor layer of the holographic interface stack;

responsive to the transform attribute, updating the graphical state indicator by performing a scaling operation, a rotation operation, a positioning operation, or any combination thereof on the 3D interface object at the renderer layer;

when the selected object property includes the gesture response property;

requesting, from a gesture responder layer of the holographic interface stack, a gesture indicator for the 3D interface object, the gesture indicator comprising;

 

an indication of an associated gesture for the 3D interface object; and

 

an indication of preset response for the associated gesture;

when the selected object property includes the widget property;

associating an input channel, an output channel, or both with the 3D interface object;

updating, at the renderer layer, the graphical state indicator of the 3D interface object to include a graphical representation of the input channel, the output channel;

receiving, from the renderer layer, the graphical state indicator at a scene controller layer of the holographic interface stack;

responsive to the graphical state indicator, generating a scene state indicator responsive to a compiled holographic scene including the 3D interface object; and

sending the scene state indicator to the display controller circuitry.

19. The product of claim 18, where instructions are further configured to cause the processing circuitry to receive a designation of the selected property from a holographic interface design application.

20. The product of claim 19, where the holographic interface design application comprises an application programming interface (API) associated with the holographic interface stack.