Method and system for describing consumer electronics using separate task and device descriptions

• US 8,412,554 B2
• Filed: 09/24/2004
• Issued: 04/02/2013
• Est. Priority Date: 09/24/2004
• Status: Expired due to Fees

• Current Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Original Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Inventors: Messer, Alan, Kunjithapatham, Anugeetha
• Primary Examiner(s): Loftis, Johnna
• Assistant Examiner(s): Parker, Brandi P
• Application Number:
  US10/950,121
• Publication Number:
  US 20060069602A1
• Time in Patent Office: 3,112 Days
• Field of Search: 705/7.21
• US Class Current: 705/7.21
• CPC Class Codes: G06F 9/453 Help systems
• CPC Class Codes: G06Q 10/06311 Scheduling, planning or task assignment for a person or group
• CPC Class Codes: G06Q 10/06316 Sequencing of tasks or work

Abstract

A method of representing user tasks to be performed by one or more of a plurality of electronic devices in a task orchestration system. Each device includes therein a function description specifying a function that the device can perform. The function descriptions are obtained from one or more of the devices, task descriptions that describe device functionalities required for certain tasks are obtained, and task suggestion are generated based on the obtained device function descriptions and task descriptions. Each task suggestion represents a user task as an abstraction of on or more of the obtained device descriptions and task descriptions. The tasks suggestion are displayed on a display for the user to select from, wherein the user selected task suggestion is to be performed by orchestration (automation) of one or more of the devices based on task descriptions that use device functionalities described in the device function descriptions.

Claims

1. A method of representing user tasks to be performed by interaction of a plurality of electronic devices in a task orchestration system, the method comprising:

employing a controller device for;

expressing device functionality as a device description specifying a function that the device can perform;

generating task suggestions based on task descriptions obtained from multiple electronic devices of the plurality of electronic devices, wherein task descriptions are dynamically determined at run-time of the task orchestration system, and a task description comprises task external description outlining task suggestions for interaction with a user, task properties, task functionalities and task actions, wherein each task suggestion represents a user task as an abstraction of one or more of the device descriptions;

applying user preferences over the generated task suggestions to determine a rank order for the generated task suggestions; and

displaying task suggestions in the rank order on a display for the user to select from,

whereby user tasks are decoupled from the devices.

2. The method of claim 1, further including expressing device interactions based on device descriptions and abstract device interactions, whereby device functionality and device interactions are logically separated, allowing description of the devices and a set of possible ways that the devices may interact.

3. The method of claim 2, wherein the task external description outlines task suggestions for interaction with a user.

4. The method of claim 3, wherein the task properties express information about the user task.

5. The method of claim 4, wherein task functionalities express functionality required to perform the user task.

6. The method of claim 5, wherein the task action describe the sequencing and combinations of the devices that fulfill the required functionalities.

7. The method of claim 1 wherein the device description comprises a device functionality description and device grounding.

8. The method of claim 7, wherein the functionality description outlines functionality of a device.

9. The method of claim 7, wherein the device grounding describes device control based on the functionality description.

10. The method of claim 6, further including using task descriptions and device descriptions to determine a set of devices that can perform a user task.

11. The method of claim 10, wherein a user task description comprises a semantic ontology that provides interoperable description and interchange of descriptions.

12. The method of claim 1, further including:

expressing sequential, parallel and coordinated device interactions to orchestrate functionality of the devices into performing user tasks.

33. The method of claim 1, wherein the modifiers describe a time of day to apply to the task suggestions.

34. The method of claim 1, wherein the modifiers describe a particular location to apply to the task suggestions.

36. The method of claim 11, wherein generating task suggestions further comprises:

querying devices to obtain a set of terms for each position in a pseudo-sentence and modifiers that are possible for task suggestions.

37. The method of claim 36, wherein task suggestions comprise word combinations filled by descriptions of tasks located in devices.

38. The method of claim 37, wherein new devices having task descriptions are dynamically added at run-time of the task orchestration system.

13. A task orchestration system for a network of interconnected devices, comprising:

a task-driven controller device configured to obtain function descriptions from the interconnected devices, and to generate task suggestions based on the obtained device function descriptions, wherein function descriptions are dynamically determined at run-time of the task orchestration system, where the device function descriptions comprise task external description outlining task suggestions for interaction with a user, task properties, task functionalities and task actions, such that each task suggestion represents a user task as an abstraction of one or more of the obtained device descriptions, wherein device function is expressed as a device description specifying a function that a device can perform, whereby user tasks are decoupled from the devices; and

a user interface device that displays the task suggestions in rank order on a display for the user to select from, wherein the user task represented by the selected task suggestion is to be performed by one or more of the devices, and the rank order is based on user preferences.

14. The system of claim 13, wherein in the controller processor device interactions are expressed based on device descriptions and abstract device interactions, whereby device functionality and device interactions are logically separated, allowing description of the devices and a set of possible ways that the devices may interact.

15. The system of claim 13, wherein the controller processor device further generates task suggestion based on task descriptions, wherein a task description comprises task external description, task properties, task functionalities and task actions.

16. The system of claim 15, wherein the task external description outlines task suggestions for interaction with a user.

17. The system of claim 15, wherein the task properties express information about the user task.

18. The system of claim 15, wherein task functionalities express functionality required to perform the user task.

19. The system of claim 15, wherein the task action describe the sequencing and combinations of the devices that fulfill the required functionalities.

20. The system of claim 13 wherein the device description comprises a device functionality description and device grounding.

21. The system of claim 20, wherein the functionality description outlines functionality of a device.

22. The system of claim 20, wherein the device grounding describes device control based on the functionality description.

23. The system of claim 15 wherein the controller processor device uses the task description and device descriptions to determine a set of devices that can perform a user task.

24. The system of claim 15 wherein the user task description comprises a semantic ontology that provides interoperable description and interchange of descriptions.

25. The system of claim 13 wherein the controller processor device expresses sequential, parallel and coordinated device interactions to orchestrate functionality of the devices into performing user tasks.

26. The system of claim 15, wherein the controller processor device further:

frames device function descriptions as device ontologies;

frames task descriptions as task ontologies; and

uses the device and task ontologies to map the user selected task suggestion to tasks that can be performed by the available devices.

27. The method of claim 15, wherein the controller processor device further:

frames device function descriptions as device ontologies;

frames task descriptions as task ontologies;

frames device instances based on device ontologies;

frames task instances based on task ontologies; and

uses the device and task ontologies and instances to map the user selected task suggestions to tasks that can be performed by the available devices.

28. The system of claim 15, wherein the controller processor device further controls the device combinations to perform the selected user task suggestions.

29. The system of claim 15, wherein in conjunction with the controller processor device, the user interface device displays task suggestions that are possible given the available devices, tasks and device functionality.

30. The system of claim 15, wherein in conjunction with the controller processor device, the user interface device displays available task suggestions and options based on the device descriptions.

31. The system of claim 15, wherein each task description is expressed in an ontology language wherein devices express tasks to the controller processor device, such that the controller processor device determines the user task desired and matches the user task descriptions to devices for performing the user task.

32. The system of claim 15, wherein task properties express information useful about the task.

35. A task orchestration system for a network of interconnected devices, comprising:

a task-driven controller device configured to obtain function descriptions from the interconnected devices, and generate task suggestions based on the obtained device function descriptions, wherein task descriptions are dynamically determined at run-time of the task orchestration system such that each task suggestion is in a pseudo-sentence form and represents a user task as an abstraction of one or more of the obtained device descriptions, wherein device function is expressed as a device description specifying a device functionality description and device grounding, and task actions describe sequencing and combinations of the devices that fulfill the required functionalities, whereby user tasks are decoupled from the devices; and

a user interface device that displays the task suggestions in rank order on a display for the user to select from, wherein the user task represented by the selected task suggestion is to be performed by one or more of the devices, and the rank order is based on user preferences.

39. A method of representing user tasks to be performed by interaction of a plurality of electronic devices in a task orchestration system, the method comprising:

employing a controller device for;

expressing device functionality as a device description specifying a function that the device can perform;

generating task suggestions based on task suggestions obtained from multiple electronic devices of the plurality of electronic devices, wherein task descriptions are dynamically determined at runt-time of the task orchestration system, and a task description comprises task external description outlining task suggestions for interaction with a user, task properties, task functionalities and task actions, wherein each task suggestion represents a user task as an abstraction of one or more of the device descriptions;

applying user preferences over the generated task suggestions to determine a rank order for the generated task suggestions; and

causing task suggestions to be displayed in the rank order on a display for the user to select from,

wherein user tasks are decoupled from the devices.

40. The method of claim 39, wherein the device description comprises a device functionality description and device grounding.

41. The method of claim 39, wherein the functionality description outlines functionality of a device.

42. The method of claim 39, wherein the device grounding describes device control based on the functionality description.