Extracting 3-D depth information from 2-D movies using the properties of neurons along the primate visual motion pathway.

old_uid14306
titleExtracting 3-D depth information from 2-D movies using the properties of neurons along the primate visual motion pathway.
start_date2014/07/10
schedule11h-12h
onlineno
location_infosalle de réunion du DEC
summaryMobile robots and autonomous vehicle systems currently rely on a multitude of sensors to extract information about the environment in front of them. It would be advantageous to be able to use a single video camera to capture this information. 3-D depth information can be determined from a movie if the 2-D image motion can be measured and if one has an estimate of the camera’s own motion (heading direction and rotation). However estimating the camera’s heading and rotation from its video output is a difficult problem with a long history. It is also difficult to obtain accurate measurements of the image motion occurring in the video. Despite these obstacles many animals, including humans, are able to solve this ‘depth from motion’ problem, and can safely navigate through complex environments using just the moving 2-D images projected onto the back of a single eye. It remains an open question as to how this is achieved. Over the years we have developed a model of the V1-Middle Temporal (MT/V5)-Medial Superior Temporal (MST) motion pathway that is considered to be the locus of many of the mechanisms responsible for extracting depth from motion.   We have recently completed some initial successful tests of a system that uses the properties of V1, MT and MST neurons to extract depth from 2-D video sequences.  This scheme represents a possible neural mechanism by which our visual system is able to generate depth maps that correspond to our perception of a 3-dimensional world.
responsiblesMamassian