We developed and tested navigation mechanisms inspired by the hippocampus of mammals' brain, that has the advantage of being robust and tolerant to errors. This mechanism uses 'place cells' that characterize areas in space, the set of place cells characterizing a topological (and non-topographic) map of the environment that is very tolerant to motion drift.
In this model, each place cell characterizes a unique position in space, and indicates the direction to reach its neighbour cells. The place cells are added when changing direction, allowing an adapted discretization of the environment. We tested this model on a RI agent, that does not have preconceptions about space, but also in a real environment, using a camera.
We first tested the navigation system on a RI agent based on my PhD work. The agent is placed in a large environment that its space memory cannot fully integrate. Its interactional system defines that it likes to eat food in the order red-green-blue. It is also equipped with a mechanism implementing a form of curiosity, leading the agent to explore undiscovered directions around place cells. Note that this experiment only aims to test the construction and navigation mechanisms, the place recognition is hard-coded to not interfere measures with wrong detections.
After a training period in a small environment, the agent is placed in the large environment. The curiosity mechanism leads the agent to explore the environment until a point of food of each color is discovered. The agent then navigates from a food point to another one, exploiting the navigation graph.
Construction of the graph during exploration. The agent starts on the top-left corner. It first discovers the room with green food, but ignore it. Later, it discovers red food. It thus eats red, then immediately move towards green food that it discovered, before continuing its exploration. When it finally finds the blue food point, the agent starts to navigate between food points to eat in the right order.
We then tested this mechanism in a real environment, with a recognition system based on visual interest point detection. We move around a room, then return to the starting point. The system added four place cells to characterize the traveled path. We can observe on the graph that the first place cell was recognized, allowing to connect it to the fourth one. We can also note that because of the motion drift, place cells are not correctly aligned. However, as each place cell defines its own local reference, cells 1 and 4 indicate the right direction to reach their neighbour cells..
Although its efficiency and drift tolerance, this system will not be robust in redundant environment. We then proposed a system using both visual recognition and path integration through a visual odometry mechanism inspired by Grid Cells.