Application operation responsive to object spatial status

• US 10,031,724 B2
• Filed: 07/08/2015
• Issued: 07/24/2018
• Est. Priority Date: 07/08/2015
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Mital, Vijay, Anuar, Nizam, Poozhiyil, Suraj T., Pan, Henry Hun-Li Reid, Nguyen, Bao Quoc, Reddish, Andrew
• Primary Examiner(s): Wu, Qing Yuan
• Application Number:
  US14/794,751
• Publication Number:
  US 20170010590A1
• Time in Patent Office: 1,112 Days
• Field of Search: None
• CPC Class Codes: G05B 13/0205 not using a model or a simulator of the controlled system
• CPC Class Codes: G06F 8/20 Software design
• CPC Class Codes: G06F 8/35 model driven
• CPC Class Codes: G06F 8/36 Software reuse
• CPC Class Codes: G06F 8/48 Incremental compilation software reuse G06F8/36
• CPC Class Codes: G06F 9/4494 data driven
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling

Abstract

Operating an application in response to spatial status of objects within a physical environment in which the application operates. A system detects the spatial status (e.g., orientation, movement, position, and so forth) of multiple environmental objects that operate within a physical environment from which input is provided to, and to which output is provided from, an application. The relationship between at least some different environmental objects result in altered a behavior of the application. The spatial status of at least some of the environmental objects is subject to change. Thus, a mechanism is described that allows an application to adjust in a manner that is highly responsive to the physical environment in which the application interfaces.

Claims

1. A method for operating an application in response to spatial status of a plurality of objects within a physical environment in which the application operates, the method comprising:

monitoring a plurality of nodes within a universal canvas, each of the plurality of nodes comprising independently executable code configured to at least receive input from or provide output to a plurality of environmental objects operating within an environment;

automatically detecting an initial spatial status of each of at least some of the plurality of environmental objects operating within the environment;

as a result of detecting the initial spatial status, combining at least some of the plurality of nodes within the universal canvas to generate an application comprising one or more transformation chain classes, wherein the application is configured to interact with the plurality of environmental objects operating within the environment according to the one or more transformation chain classes;

detecting that the initial spatial status of at least some of the plurality of environmental objects has changed;

as a result of detecting that the initial spatial status has changed, altering the relationship between at least some of the plurality of nodes within the application, including at least altering one of the one or more transformation chain classes by removing a node from the transformation chain class or adding a new node to the transformation chain class from the universal canvas, wherein as a result of altering the transformation chain class, the behavior of the application is modified.

2. The method in accordance with claim 1, further comprising:

the computing system evaluating relationships between the spatial statuses of different environmental objects of the plurality of environmental objects, wherein at least one of the evaluated relationships alters the behavior of the application.

3. The method in accordance with claim 2, further comprising:

the computing system altering a behavior of the application based on the at least one of the evaluated relationships.

4. The method in accordance with claim 1, the plurality of environmental objects comprising a plurality of users.

5. The method in accordance with claim 1, the plurality of environment objects comprising a plurality of input devices.

6. The method in accordance with claim 1, the plurality of environment objects comprising a plurality of output devices.

7. The method in accordance with claim 1, the detected spatial status of at least one of the plurality of environment objects comprising an orientation of the environment object.

8. The method in accordance with claim 1, the detected spatial status of at least one of the plurality of environment objects comprising a position of the environment object.

9. The method in accordance with claim 1, the detected spatial status comprising a change rate in orientation of the environmental object.

10. The method in accordance with claim 1, the detected spatial status comprising a velocity of the environmental object.

11. The method in accordance with claim 1, the behavior of the application being altered by joining the application with one or more additional application portions in the form of one or more new transformation chain classes.

12. The method in accordance with claim 1, the behavior of the application being altered by splitting the application, wherein splitting the application includes at least removing one or more nodes from the one or more transformation chains of the application such that the application no longer includes the executable code corresponding to the node.

13. The method in accordance with claim 1, the behavior of the application being altered by changing an output status of an output device within the environment.

14. The method in accordance with claim 1, the behavior of the application being altered by changing an input status of an input device within the environment.

15. A computing system comprising:

one or more processors;

one or more computer-readable storage media having thereon one or more computer-executable instructions that are structured such that, when executed by the one or more processors of the computing system, configure the computing system to perform the following in response to accessing an initial spatial status of each of at least some of a plurality of environmental objects that operate within an environment from which input is provided to, and to which output is provided from, an application comprising one or more transformation chain classes, wherein the spatial status of at least some of the plurality of environmental objects is subject to change;

an act of monitoring a plurality of nodes within a universal canvas, each of the plurality of nodes comprising independently executable code configured to at least receive input from or provide output to at least some of the plurality of environmental objects operating within the environment;

as a result of accessing the initial spatial status, an act of combining at least some of the plurality of nodes within the universal canvas to generate the application comprising one or more transformation chain classes, wherein the application is configured to interact with the plurality of environmental objects operating within the environment according to the one or more transformation chain classes;

an act of evaluating relationships between the spatial statuses of different environmental objects of the plurality of environmental objects, wherein at least one of the evaluated relationships alters the behavior of the application, the altering of the behavior of the application comprising altering one of the one or more transformation chain classes of the application by removing a node from the transformation chain class or adding a new node to the transformation chain class from the universal canvas, wherein as a result of altering the transformation chain class, the behavior of the application is modified.

16. The computing system in accordance with claim 15, the computing system further configured to perform the following in response to evaluating the relationships:

an act of the computing system altering a behavior of the application based on the at least one of the evaluated relationships.

17. The computing system in accordance with claim 16, the behavior of the application being altered by joining the application with one or more additional application portions.

18. The computing system in accordance with claim 16, the behavior of the application being altered by splitting the application.

19. A method for a computing system to operate an application, the method comprising:

monitoring a plurality of nodes within a universal canvas, each of the plurality of nodes comprising independently executable code configured to at least receive input from or provide output to a plurality of environmental objects operating within an environment;

automatically detecting an initial spatial status for each of at least some of a plurality of environmental objects that operate within an environment from which input is provided to, and to which output is provided from, an application comprising one or more transformation chain classes, wherein the initial spatial status of at least some of the plurality of environmental objects is subject to change;

as a result of detecting the initial spatial status, combining at least some of the plurality of nodes within the universal canvas to generate the application comprising the one or more transformation chain classes, wherein the application is configured to interact with the plurality of environmental objects operating within the environment according to the one or more transformation chain classes;

detecting that the initial spatial status of at least some of the plurality of environmental objects has changed;

as a result of detecting that the initial spatial status of at least some of the plurality of environmental objects has changed, altering one or more relationships between the initial spatial statuses of at least some of the plurality of environmental objects of, including at least altering at least one of the one or more transformation chain classes of the application by removing a node from the transformation chain class or adding a new node to the transformation chain class from the universal canvas, wherein as a result of altering the at least one transformation chain class, the behavior of the application is modified.

20. The method in accordance with claim 19, further comprising:

the computing system altering a behavior of the application based on the at least one of the evaluated relationships.