None
EN
Zoom In: An Introduction to Circuits
['Olah', 'Cammarata', 'Schubert', 'Goh', 'Petrov', 'Carter']
Distill
Early layers contain features like edge or curve detectors, while later layers have features like floppy ear detectors or wheel detectors. We can think of this as meaning that, at each point along the curve, our curve detector is looking for a “tangent curve” using the earlier curve detector. The raw weights between the early curve detector and late curve detector in the same orientation are a curve of positive weights surrounded by small negative or zero weights.