The Neural Turing Machine is a neural network architecture inspired by biological working memory and digital computers that is differentiable end-to-end and can be trained with gradient descent. Experiments showed it is capable of learning simple algorithms from example data and generalizing well outside its training data.

2. We have introduced the Neural Turing Machine, a neural network
architecture that takes inspiration from both models of biological
working memory and the design of digital computers. Like
conventional neural networks, the architecture is differentiable
end-to-end and can be trained with gradient descent. Our
experiments demonstrate that it is capable of learning simple
algorithms from example data and of using these algorithms to
generalise well outside its training regime."