Feature visualization of a car neuron.Feature visualizations of the vector over input neurons at each spatial position of the car neuron’s weights. As we mentioned earlier, sometimes the meaningful weight interactions are between neurons which aren’t literally adjacent in a neural network, or where the weights aren’t directly represented in a single weight tensor. If two layers interact linearly , the expanded weights will give the true linear map, even if the model doesn’t explicitly represent the weights in a single weight matrix.