DETECTING EGO-MOTION ON A MOBILE DEVICE DISPLAYING THREE-DIMENSIONAL CONTENT

• US 20100053322A1
• Filed: 08/31/2009
• Published: 03/04/2010
• Est. Priority Date: 09/02/2008
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Chae, Han Joo, Marti, Stefan, Kim, Seung Wook
• Granted Patent: US 8,310,537 B2
• Time in Patent Office: Days
• US Class Current: 348/135
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/1446 display composed of modules, e.g. video walls
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling
• CPC Class Codes: G06T 2219/2021 Shape modification
• CPC Class Codes: G09G 2356/00 Detection of the display position w.r.t. other display screens
• CPC Class Codes: G09G 3/002 to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT
• CPC Class Codes: H04M 2203/359 Augmented reality
• CPC Class Codes: H04N 13/279 the virtual viewpoint locations being selected by the viewers or determined by tracking

Abstract

A method of measuring ego-motion speed of a mobile device is described. The linear motion of the device is measured using an image sensor component, thereby creating linear motion data. The rotational or angular motion of the device is measured using an inertial sensor component, thereby creating rotational motion data. The rotational and linear motion data of the device are used to calculate the ego-motion speed of the mobile device. This ego-motion speed can then be used to control a virtual camera control module for adjusting the view of 3D content viewed by the user on the mobile device as the user moves the device, changing the position of the virtual camera.

Claims

1. A method of measuring ego-motion speed of a mobile device, the method comprising:

measuring linear motion of the mobile device using an image sensor component, thereby creating linear motion data;

measuring rotational motion of the mobile device using an inertial sensor component, thereby creating rotational motion data;

utilizing the rotational motion data and the shifting motion data to calculate ego-motion speed of the mobile device.

2. A method as recited in claim 1 wherein the linear motion data includes optic flow vector values.

3. A method as recited in claim 2 further comprising:

calculating linear speed using the optic flow vector values.

4. A method as recited in claim 1 wherein the rotational motion data includes roll data of the device and pitch data of the device.

5. A method as recited in claim 1 further comprising:

utilizing the rotational motion data if linear motion data and rotational motion data are produced.

6. A mobile device comprising:

one or more processors;

a data storage component;

an image sensor hardware component and image sensor software;

an inertial sensor hardware component and inertial sensor software; and

an ego-motion speed calculation module for calculating the speed of the mobile device using linear motion data from the image sensor software and rotational motion data from the inertial sensor software.