Convolutional neural networks (CNNs) are inspired by biological processes in the visual cortex and contain simple and complex cells that detect visual features. CNNs use convolution layers to extract low level features from input data and pooling layers to combine similar features into higher level representations. Fully connected neural networks differ from CNNs by not taking spatial data as input.