Original model Buzzsaw obstacle blindness Enemy moving left blindness 0% 2% 4% 6% 8% 10% 12% Percentage of levels failed Failure rate by cause Causes Buzzsaw obstacle Enemy moving left Enemy moving right Multiple or other Results of testing each model on 10,000 levels. 10 2 10 3 10 4 10 5 60% 70% 80% 90% 100% Percentage of levels completed Generalization Train Test 10 2 10 3 10 4 10 5 0% 20% 40% 60% 80% 100% Percentage of features interpretable Interpretable features 0.0 0.2 0.4 0.6 0.8 1.0 Number of training levels 0.0 0.2 0.4 0.6 0.8 1.0 Comparison of models trained on different numbers of levels. Two models were trained for each number of levels, and two researchers independently evaluated how interpretable the features of each model were, without being shown the number of levels.