System and method for initiating actions and providing feedback by pointing at object of interest
First Claim
Patent Images
1. A computer-implemented method for identifying an object in a real-world scene by pointing at the object with an electronic pointing device and electronically attaching feedback to the object in a digital representation of the object stored in system storage, comprising the steps of:
- (A) mapping a three-dimensional representation of the real-world scene containing at least one object and transmitting the three-dimensional representation to a system server;
(B) inputting feedback relating to the at least one object to the pointing device;
(C) inputting command statements relating to the at least one object to the pointing device;
(D) generating a request at the pointing device that includes at least the feedback and/or command statements, and transmitting the request to the system server along with a pointing device geodetic position and pointing direction; and
(E) the system server performing the Substeps of,(1) generating a two-dimensional digital representation of the three-dimensional scene mapped at Step (A), with the two-dimensional digital representation including at least a digital representation of the at least one object,(2) identifying the at least one object according to the pointing device geodetic position and pointing direction applied to the two-dimensional digital representation,(3) processing the request and separating command statements and feedback from the request,(4) if the request includes only at least the command statement, executing the at least command statement and then performing Substep (E)(6),(5) if the request includes only feedback, linking the feedback to the digital representation of the at least one object stored in system storage and then performing Substep (E)(7),(6) if the request does not include at least one command statement than (E)(7), otherwise if the request includes at least one command statement and feedback, executing the at least one command statement and linking feedback to the digital representation of the at least one object stored in system storage and then performing Substep (E)(7),(7) the system server communicating to the pointing device execution of at least one command statement and/or the linking of feedback.
4 Assignments
0 Petitions
Accused Products
Abstract
A system and method as described for compiling feedback in command statements that relate to applications or services associated with spatial objects or features, pointing at such spatial object or feature order to identify the object of interest, and executing the command statements on a system server and attaching feedback information to their representation of this object or feature in a database of the system server.
102 Citations
28 Claims
-
1. A computer-implemented method for identifying an object in a real-world scene by pointing at the object with an electronic pointing device and electronically attaching feedback to the object in a digital representation of the object stored in system storage, comprising the steps of:
-
(A) mapping a three-dimensional representation of the real-world scene containing at least one object and transmitting the three-dimensional representation to a system server; (B) inputting feedback relating to the at least one object to the pointing device; (C) inputting command statements relating to the at least one object to the pointing device; (D) generating a request at the pointing device that includes at least the feedback and/or command statements, and transmitting the request to the system server along with a pointing device geodetic position and pointing direction; and (E) the system server performing the Substeps of, (1) generating a two-dimensional digital representation of the three-dimensional scene mapped at Step (A), with the two-dimensional digital representation including at least a digital representation of the at least one object, (2) identifying the at least one object according to the pointing device geodetic position and pointing direction applied to the two-dimensional digital representation, (3) processing the request and separating command statements and feedback from the request, (4) if the request includes only at least the command statement, executing the at least command statement and then performing Substep (E)(6), (5) if the request includes only feedback, linking the feedback to the digital representation of the at least one object stored in system storage and then performing Substep (E)(7), (6) if the request does not include at least one command statement than (E)(7), otherwise if the request includes at least one command statement and feedback, executing the at least one command statement and linking feedback to the digital representation of the at least one object stored in system storage and then performing Substep (E)(7), (7) the system server communicating to the pointing device execution of at least one command statement and/or the linking of feedback. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A computer-implemented method for identifying an object in a real-world scene by pointing at the object with an electronic pointing device and electronically attaching feedback information to the object in a digital representation of the object stored in system storage, comprising the steps of:
-
(A) mapping a three-dimensional representation of the real-world scene containing at least one object and transmitting the three-dimensional representation to the system server; (B) inputting feedback relating to the at least one object to the pointing device; (C) generating a request at the pointing device that includes at least the feedback input at Step (B) and transmitting the request to the system server along with a geodetic pointing device position and pointing direction; and (D) the system server performing the Substeps of, (1) generating a two-dimensional digital representation of the three-dimensional scene mapped at Step (A), with the two-dimensional digital representation including at least a digital representation of the at least one object, (2) identifying the at least one object according to the pointing device geodetic position and pointing direction applied to the two-dimensional digital representation, (3) linking the feedback to the digital representation of the at least one object stored in system server, and (4) the system server communicating to the pointing device the linking of feedback. - View Dependent Claims (14, 15, 16, 17, 18, 19, 20, 21, 22, 23)
-
-
24. A system for identifying and attaching feedback to an object in a real-world scene, comprising,
(A) a pointing device for pointing at an object of interest in a real-world scene and having input therein feedback and/or command statements with respect to the object of interest, with the pointing device determining a pointing device geodetic position and pointing direction, and generating a request including feedback and/or command statements, and communicating the request and pointing device geodetic position and pointing direction to a system server; -
(B) the system server further comprising, (1) a mapping module for receiving and processing a three-dimensional representation that contains the real-world scene including the object of interest, (2) a scene generator that connects to the mapping module and receives an output from the mapping module for generating a two-dimensional digital representation of the real-world scene including the object of interest and identifies the object of interest according to the pointing device geodetic position and pointing direction applied to the two-dimensional digital representation, (3) a linker module for linking feedback from the request to the digital representation of the object of interest stored in system storage, (4) a command parser module for parsing command statements from the request, (5) a communications module for receiving requests, and the pointing device geodetic position and pointing direction from the pointing device, and transmitting at least retrieved feedback and/or command statement execution status to the pointing device; and (C) system storage in communication with the system server for storing feedback relating to objects, including the object of interest, and two-dimensional digital environment information relating to the real-world scene containing objects, including the object interest; and (D) an execution module in communications with the system server for executing command statements that affect a real-world state of the object of interest or subpart of the object of interest. - View Dependent Claims (25, 26, 27, 28)
-
Specification