Mobile robotic assistant for multipurpose applications

• US 8,977,396 B2
• Filed: 03/20/2012
• Issued: 03/10/2015
• Est. Priority Date: 03/20/2012
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Smith, David
• Primary Examiner(s): HOLLOWAY, JASON R
• Application Number:
  US13/425,252
• Publication Number:
  US 20130253703A1
• Time in Patent Office: 1,085 Days
• Field of Search: 901/1, 901/46, 901/47, 901/50, 700/250, 700/257, 700/258, 700/262
• US Class Current: 700/258
• CPC Class Codes: B25J 19/023 including video camera means
• CPC Class Codes: B25J 5/00 Manipulators mounted on wheels or on carriages B25J1/00 takes precedence; programme-controlled manipulators B25J9/00 ; vehicle aspects B60, B62, e.g. remote-controlled steering for motor vehicles B62D1/24; control of position of vehicles G05D1/00
• CPC Class Codes: H04N 9/3185 Geometric adjustment, e.g. keystone or convergence optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

Embodiments of the present invention relate to a robotic assistant comprising a projector for projecting media on a surface, a sensor for sensing the media, and a motion control module for moving the robotic assistant.

Claims

1. A robotic assistant comprising:

a surface detection module configured to detect a surface and dimensions and geometry of the surface;

a projector configured to project media in accord with proportions of the media on the surface;

a sensor configured to sense audio and video data in the surrounding environment, wherein the audio data is used to control the robotic assistant and is stored for later use; and

a motion control module configured to move the robotic assistant according to the sensed audio and video data based on the dimensions and geometry of the surface and the media proportions, and to modify projection calibrations.

2. The robotic assistant of claim 1, wherein the projector is detachable from an enclosure of the robotic assistant.

3. The robotic assistant of claim 1, wherein the sensor senses a user-performed gesture on the surface by capturing touch points relative to the surface, a video capture module forms a matrix transform of the touch points and alters the media, and the projector projects the altered media.

4. The robotic assistant of claim 1, wherein the motion control module controls movement of the robotic assistant horizontally, vertically, and rotationally in iterations so as to fit the media onto the flat surface with proper proportions.

5. The robotic assistant of claim 4, further comprising an audio capture module coupled to the sensor that interprets the audio data as voice commands.

6. The robotic assistant of claim 5 further comprising a command module that executes the voice commands to control at least one of the projector and the motion control module.

7. The robotic assistant of claim 1 wherein the media projected by the projector comprises a clone of a user display.

8. The robotic assistant of claim 1 wherein the motion control module comprises two sets of wheels.

9. The robotic assistant of claim 1 wherein the surface detection module searches for surfaces which have dimensions proportional to those of the projected media.

10. The robotic assistant of claim 9 wherein the surface detection module commands the motion control module to relocate the robotic assistant to a new location.

11. A method of utilizing a robotic assistant, the method being executed by at least one processor, comprising the steps of:

scanning, using a video sensor, an environment for a surface and dimensions and geometry of the surface;

projecting, using a projector, media in accord with proportions of the media on the surface;

sensing audio and video data in the surrounding environment, wherein the audio data is used to control the robotic assistant and is stored for later use as the media to be projected; and

moving the robotic assistant according to the sensed audio and video data based on the dimensions and geometry of the surface and the media proportions, and modifying projection calibrations.

12. The method of claim 11, wherein the projector is detachable from an enclosure of the robotic assistant.

13. The method of claim 11, further comprising:

sensing a user-performed gesture on the surface by capturing touch points relative to the surface; and

forming a matrix transform of the touch points, altering the media based on the matrix transform, and the projecting the altered media.

14. The method of claim 11, further comprising moving the robotic assistant horizontally, vertically, and rotationally in iterations so as to fit the media onto the flat surface with proper proportions.

15. The method of claim 14, further comprising interpreting the audio data as voice commands.

16. The method of claim 15 further comprising executing the voice commands to control at least one of the projecting and the moving.

17. The method of claim 11 further comprising detecting a second surface on which to display the media.

18. The method of claim 11 further comprising projecting one of 2D and 3D projecting.

19. The method of claim 17 further comprises searching for surfaces which have dimensions proportional to those of the projected media.

20. The method of claim 19 further comprising relocating the robotic assistant to a new location in response to the searching.