System and method for touch/gesture based device control

• US 10,437,427 B2
• Filed: 07/15/2016
• Issued: 10/08/2019
• Est. Priority Date: 07/15/2016
• Status: Active Grant

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation), Toshiba Tec Corporation (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Su, William
• Primary Examiner(s): Dasgupta, Shourjo
• Application Number:
  US15/211,119
• Publication Number:
  US 20180018064A1
• Time in Patent Office: 1,180 Days
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
• CPC Class Codes: H04N 1/00408 Display of information to the user, e.g. menus
• CPC Class Codes: H04W 4/80 Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication

Abstract

A system and method for document processing includes a three-dimensional touch interface, a processor and associated memory. The processor generates thumbnail image data from received electronic document data and document format data corresponding to the electronic document data and the thumbnail image data. The memory stores associatively the electronic document data, the thumbnail image data and the document format data. The touch interface displays a thumbnail image from the thumbnail image data and generates user input data in accordance with application of one of a plurality of detectable pressure levels to the thumbnail image. The processor commences a document processing operation in accordance with the user input data and the document format data.

Claims

1. A system comprising:

an input configured to receive electronic document data comprising a plurality of electronic documents;

a scanner configured to generate scan document data from a scanned document;

a printer configured to generate a printout of an electronic document;

a processor and associated memory,

the processor configured to generate thumbnail image data from received electronic document data and scan document data,

the processor further configured to generate document format data corresponding to the electronic document data, the scan document data and associated thumbnail image data, and

the memory configured to associatively store the electronic document data, the scan document data, the thumbnail image data and the document format data as a unique, three-dimensional touch file; and

an output configured to communicate each three-dimensional touch file to an associated user device including a three-dimensional touch interface configured to display a plurality of thumbnail images corresponding to the plurality of electronic documents and the scanned document from the thumbnail image data,

the touch interface further configured to receive user input selecting a subset of the plurality of the thumbnail images,

the touch interface further configured generate user input data in accordance with application of one of a plurality of detectable pressure levels to a selected subset of thumbnail images,

wherein the processor is further configured to commence a document processing operation to generate a printout of each electronic document associated with the selected subset of thumbnail images via the print engine in accordance with the user input data and the document format data.

2. The system of claim 1 wherein the user input data includes data corresponding to a first force level associated with the application of a pressure on a surface of the touch interface indicative of a selected document processing operation.

3. The system of claim 2 wherein the touch interface is configured to receive the user input selecting the subset of thumbnail images in accordance with a tracing around corresponding thumbnail images and the user input data is generated in accordance with the sensed pressure level associated with a user touch within a boundary formed by the tracing.

4. The system of claim 3 wherein the user input data includes data corresponding to a second force level associated with the application of pressure on the surface of the touch interface.

5. The system of claim 4 wherein the touch interface is further configured to display an image of the electronic document data in accordance with the second force level.

6. The system of claim 5 wherein the user input data includes data corresponding to movement over the surface of the touch interface.

7. The system of claim 6 wherein the processor is further configured to commence a second document processing operation in accordance with movement over the surface of the touch interface.

8. A method comprising:

receiving electronic document data comprising a plurality of electronic documents into a memory;

scanning a tangible document to generate scan document data;

generating, via a processor, thumbnail image data from received electronic document data and scan document data;

generating document format data corresponding to the electronic document data, the scan document data and the thumbnail image data as a unique, three-dimensional touch file;

storing the electronic document data, the scan document data, the thumbnail image data and the document format data associatively in the memory;

communicating the three-dimensional touch file to an associated user device including a three-dimensional touch interface;

displaying a plurality of thumbnail images corresponding to the plurality of electronic documents and the tangible document from the thumbnail image data on the three-dimensional touch interface;

receiving user input via the three-dimensional touch interface selecting a subset of the plurality of thumbnail images;

sensing, on the touch interface, one of a plurality of detectable pressure levels applied to a selected subset of thumbnail images;

generating user input data in accordance with a sensed pressure level; and

commencing a selected document processing operation in accordance with the user input data and the document format data, wherein the document processing operation includes printing of each electronic document associated with the selected subset of thumbnail images the electronic document data.

9. The method of claim 8 wherein the user input data is generated in accordance with a first force level associated with the sensed pressure level.

10. The method of claim 9 further comprising receiving the user input selecting the subset of thumbnail images in accordance with a tracing around corresponding thumbnail images and generating the user input data in accordance with the sensed pressure level associated with a user touch within a boundary formed by the tracing.

11. The method of claim 10 wherein the user input data is generated in accordance with a second force level associated with the sensed pressure level.

12. The method of claim 11 further comprising displaying an image of the electronic document data in accordance with the second force level.

13. The method of claim 12 further comprising sensing movement across a surface of the touch interface and wherein the user input data is generated in accordance with the sensed movement across the surface of the touch interface.

14. The method of claim 13 further comprising commencing a second document processing operation in accordance with the sensed movement across the surface of the touch interface.

15. A system comprising:

a scanner configured to generate a first electronic document data from a scanned document;

an input configured to receive at least two additional electronic documents;

a controller including processor and associated memory,

the controller configured to generate thumbnail image data for each electronic document,

the controller configured to generate document format data corresponding to each electronic document and its associated thumbnail image data, and

the memory configured to associatively store each electronic document, its associated thumbnail image data and its associated document format data as a unique three-dimensional touch file;

an output configured to communicate each three-dimensional touch file to an associated user device;

an input configured to receive a user selection of a subset of the electronic documents on the user device;

an input configured to receive selection data corresponding to a pressure application level received from a three-dimensional user interface on the user device,

wherein the controller is further configured to generate a printout of each electronic document of the subset of electronic documents via a print engine in accordance with received selection data.

16. The system of claim 15 wherein the printout of the electronic documents is commenced when the selection data includes data corresponding to a first pressure level.

17. The system of claim 16 wherein the printout is commenced as a facsimile transmission when the selection data includes data corresponding to a second pressure level.

18. The system of claim 15 wherein the printout is commenced when the selection data includes data corresponding a gesture received by the three-dimensional user interface on the user device.

19. The system of claim 15 wherein the controller is further configured to generate the document format data as an extensible markup language file.