Method and system for describing consumer electronics using separate task and device descriptions

• US 20060069602A1
• Filed: 09/24/2004
• Published: 03/30/2006
• Est. Priority Date: 09/24/2004
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Messer, Alan, Kunjithapatham, Anugeetha
• Granted Patent: US 8,412,554 B2
• Time in Patent Office: Days
• US Class Current: 705/9
• CPC Class Codes: G06F 9/453 Help systems
• CPC Class Codes: G06Q 10/06311 Scheduling, planning or task assignment for a person or group
• CPC Class Codes: G06Q 10/06316 Sequencing of tasks or work

Abstract

A method of representing user tasks to be performed by one or more of a plurality of electronic devices in a task orchestration system. Each device includes therein a function description specifying a function that the device can perform. The function descriptions are obtained from one or more of the devices, task descriptions that describe device functionalities required for certain tasks are obtained, and task suggestion are generated based on the obtained device function descriptions and task descriptions. Each task suggestion represents a user task as an abstraction of on or more of the obtained device descriptions and task descriptions. The tasks suggestion are displayed on a display for the user to select from, wherein the user selected task suggestion is to be performed by orchestration (automation) of one or more of the devices based on task descriptions that use device functionalities described in the device function descriptions.

Claims

1. A method of representing user tasks to be performed by interaction of a plurality of electronic devices in a task orchestration system, the method comprising the steps of:

expressing device functionality as a device description specifying a function that the device can perform; and

generating task suggestions based on device descriptions, wherein each task suggestion represents a user task as an abstraction of one or more of the device descriptions;

whereby user tasks are decoupled from the devices.

2. The method of claim 1, further including the steps of expressing device interactions based on device descriptions and abstract device interactions, whereby device functionality and device interactions are logically separated, allowing description of the devices and a set of possible ways that the devices they may interact.

3. The method of claim 1, wherein the step of generating task suggestions further includes the steps of generating tasks suggestions based on task descriptions, wherein a task description comprises task external description, task properties, task functionalities and task actions.

4. The method of claim 3, wherein the task external description outlines task suggestions for interaction with a user.

5. The method of claim 3, wherein the task properties express information about the user task.

6. The method of claim 3, wherein task functionalities express functionality required to perform the user task.

7. The method of claim 3, wherein the task action describe the sequencing and combinations of the devices that fulfill the required functionalities.

8. The method of claim 1 wherein device description comprises device functionality description and device grounding.

9. The method of claim 8, wherein the functionality description outlines functionality of a device.

10. The method of claim 8, wherein the device grounding describes device control based on the functionality description.

11. The method of claim 3 further including the steps of using task descriptions and device descriptions to determine a set of devices that can perform a user task.

12. The method of claim 3 wherein a user task description comprises a semantic ontology that provides interoperable description and interchange of descriptions.

13. The method of claim 1 further including the steps of:

expressing sequential, parallel and coordinated device interactions to orchestrate functionality of the devices into performing user tasks.

14. A task orchestration system for a network of interconnected devices, comprising:

a task-driven controller that obtains function descriptions from one or more of the devices, and generates task suggestions based on the obtained device function descriptions, such that each task suggestion represents a user task as an abstraction of on or more of the obtained device descriptions, wherein device function is expressed as a device description specifying a function that a device can perform, whereby user tasks are decoupled from the devices; and

a user interface device that displays the task suggestions on a display for the user to select from, wherein the user task represented by the selected task suggestion is to be performed by one or more of the devices.

15. The system of claim 14, wherein in the controller device interactions are expressed based on device descriptions and abstract device interactions, whereby device functionality and device interactions are logically separated, allowing description of the devices and a set of possible ways that the devices they may interact.

16. The system of claim 14, wherein the controller further generates task suggestion based on task descriptions, wherein a task description comprises task external description, task properties, task functionalities and task actions.

17. The system of claim 16, wherein the task external description outlines task suggestions for interaction with a user.

18. The system of claim 16, wherein the task properties express information about the user task.

19. The system of claim 16, wherein task functionalities express functionality required to perform the user task.

20. The system of claim 16, wherein the task action describe the sequencing and combinations of the devices that fulfill the required functionalities.

21. The system of claim 14 wherein device description comprises device functionality description and device grounding.

22. The system of claim 21, wherein the functionality description outlines functionality of a device.

23. The system of claim 21, wherein the device grounding describes device control based on the functionality description.

24. The system of claim 16 wherein the controller uses the task description and device descriptions to determine a set of devices that can perform a user task.

25. The system of claim 16 wherein the user task description comprises a semantic ontology that provides interoperable description and interchange of descriptions.

26. The system of claim 14 wherein the controller expresses sequential, parallel and coordinated device interactions to orchestrate functionality of the devices into performing user tasks.

27. The system of claim 16, wherein the controller further:

frames device function descriptions as device ontologies;

frames task descriptions as task ontologies; and

uses the device and task ontologies to map the user selected task suggestion to tasks that can be performed by the available devices.

28. The method of claim 16, wherein the controller further:

frames device function descriptions as device ontologies;

frames task descriptions as task ontologies;

frames device instances based on device ontologies;

frames task instances based on task ontologies; and

uses the device and task ontologies and instances to map the user selected task suggestions to tasks that can be performed by the available devices.

29. The system of claim 16, wherein controller further controls the device combinations to perform the selected user task suggestions.

30. The system of claim 16, wherein in conjunction with the controller, the user interface device displays task suggestions that are possible given the available devices, tasks and device functionality.

31. The system of claim 16, wherein in conjunction with the controller, the user interface device displays available task suggestions and options based on the device descriptions.

32. The system of claim 16, wherein each task description is expressed in an ontology language wherein devices express tasks to the controller, such that the controller determines the user task desired and matches the user task descriptions to devices for performing the user task.