{"final":true,"runs":[{"run_id":"pilot-source-plain","spec":{"run_id":"pilot-source-plain","stage":"pilot","recipe":"plain","pmax":0.0,"input_scale":1.0,"output_relu":true,"lr":0.001,"shrinkage":2e-05,"seed":1,"epochs":5,"batch_size":64,"eval_every":1,"train_size":50000,"timeout_seconds":180,"gpu":"A100"},"history":[{"epoch":1,"stochastic_training_loss":0.2631579637527466,"dense_train_probe":{"loss":0.1103273681640625,"accuracy":0.9657,"n":10000},"validation":{"loss":0.14433408203125,"accuracy":0.9558,"n":10000},"training_seconds":1.8874719939999993,"epoch_training_seconds":1.8874719939999993,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.3453613221645355,"validation_probe_prediction_counts":[231,210,225,190,217,208,191,179,195,202]},{"epoch":2,"stochastic_training_loss":0.08809839934110641,"dense_train_probe":{"loss":0.050644351196289066,"accuracy":0.9862,"n":10000},"validation":{"loss":0.09241936645507813,"accuracy":0.9709,"n":10000},"training_seconds":3.0852927469999996,"epoch_training_seconds":1.1978207530000002,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.3575683534145355,"validation_probe_prediction_counts":[222,206,218,182,213,210,193,188,217,199]},{"epoch":3,"stochastic_training_loss":0.05155850574374199,"dense_train_probe":{"loss":0.028196710205078124,"accuracy":0.9928,"n":10000},"validation":{"loss":0.07860947265625,"accuracy":0.9753,"n":10000},"training_seconds":4.2945567460000005,"epoch_training_seconds":1.209263999000001,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.353759765625,"validation_probe_prediction_counts":[220,210,223,181,212,211,192,183,212,204]},{"epoch":4,"stochastic_training_loss":0.02827163226902485,"dense_train_probe":{"loss":0.01831869812011719,"accuracy":0.995,"n":10000},"validation":{"loss":0.08253602294921875,"accuracy":0.9755,"n":10000},"training_seconds":5.466817083,"epoch_training_seconds":1.172260336999999,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.35986328125,"validation_probe_prediction_counts":[216,213,219,182,212,210,193,189,215,199]},{"epoch":5,"stochastic_training_loss":0.017597535625100136,"dense_train_probe":{"loss":0.009754230499267578,"accuracy":0.9984,"n":10000},"validation":{"loss":0.07544132080078125,"accuracy":0.9788,"n":10000},"training_seconds":6.652748309999999,"epoch_training_seconds":1.1859312269999993,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.37895509600639343,"validation_probe_prediction_counts":[218,210,219,186,212,202,196,184,222,199]}],"best_epoch":5,"best_validation_loss":0.07544132080078125,"training_seconds":6.652748309999999,"total_run_seconds":9.562714048,"hardware":{"device":"cuda","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.8.0+cu128","tf32":true,"dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"df8ef46c69011718b66e38f100c668736a2aeb36fd131152f01cd2416b04dacc","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[0,0,0,0]},{"run_id":"pilot-source-residual","spec":{"run_id":"pilot-source-residual","stage":"pilot","recipe":"residual","pmax":0.0,"input_scale":1.0,"output_relu":true,"lr":0.001,"shrinkage":2e-05,"seed":1,"epochs":5,"batch_size":64,"eval_every":1,"train_size":50000,"timeout_seconds":180,"gpu":"A100"},"history":[{"epoch":1,"stochastic_training_loss":4.152968883514404,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":3.472561788,"epoch_training_seconds":3.472561788,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":2,"stochastic_training_loss":2.3025851249694824,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":6.066919798000001,"epoch_training_seconds":2.5943580100000005,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":3,"stochastic_training_loss":2.3025851249694824,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":8.643333216000002,"epoch_training_seconds":2.5764134180000013,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":4,"stochastic_training_loss":2.3025851249694824,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":11.065321781000002,"epoch_training_seconds":2.4219885649999995,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":5,"stochastic_training_loss":2.3025851249694824,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":13.431386436,"epoch_training_seconds":2.366064654999999,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]}],"best_epoch":1,"best_validation_loss":2.302585546875,"training_seconds":13.431386436,"total_run_seconds":18.363070248,"hardware":{"device":"cuda","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.8.0+cu128","tf32":true,"dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"df8ef46c69011718b66e38f100c668736a2aeb36fd131152f01cd2416b04dacc","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[0,0,0,0]},{"run_id":"pilot-normalized-plain","spec":{"run_id":"pilot-normalized-plain","stage":"pilot","recipe":"plain","pmax":0.0,"input_scale":0.00392156862745098,"output_relu":false,"lr":0.03,"shrinkage":0.0,"seed":1,"epochs":5,"batch_size":64,"eval_every":1,"train_size":50000,"timeout_seconds":180,"gpu":"A100"},"history":[{"epoch":1,"stochastic_training_loss":0.5983408093452454,"dense_train_probe":{"loss":0.136126171875,"accuracy":0.959,"n":10000},"validation":{"loss":0.16874775390625,"accuracy":0.9488,"n":10000},"training_seconds":1.8200692049999994,"epoch_training_seconds":1.8200692049999994,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[227,217,215,192,213,209,189,198,195,193]},{"epoch":2,"stochastic_training_loss":0.11862491816282272,"dense_train_probe":{"loss":0.07586035766601562,"accuracy":0.9783,"n":10000},"validation":{"loss":0.11106556396484375,"accuracy":0.9677,"n":10000},"training_seconds":2.995951633999999,"epoch_training_seconds":1.1758824289999996,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[214,207,219,179,202,210,194,185,226,212]},{"epoch":3,"stochastic_training_loss":0.07736190408468246,"dense_train_probe":{"loss":0.04896069030761719,"accuracy":0.9849,"n":10000},"validation":{"loss":0.0896385498046875,"accuracy":0.9741,"n":10000},"training_seconds":4.167373469999998,"epoch_training_seconds":1.1714218359999986,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,217,172,213,222,195,183,213,203]},{"epoch":4,"stochastic_training_loss":0.05427844449877739,"dense_train_probe":{"loss":0.04473319702148437,"accuracy":0.9862,"n":10000},"validation":{"loss":0.09868544921875,"accuracy":0.972,"n":10000},"training_seconds":5.303092645999998,"epoch_training_seconds":1.1357191760000003,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[219,211,212,193,210,214,189,188,213,199]},{"epoch":5,"stochastic_training_loss":0.04113011062145233,"dense_train_probe":{"loss":0.022877607727050782,"accuracy":0.9934,"n":10000},"validation":{"loss":0.0866325439453125,"accuracy":0.9773,"n":10000},"training_seconds":6.3803317949999965,"epoch_training_seconds":1.0772391489999986,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[218,210,217,182,216,210,194,188,219,194]}],"best_epoch":5,"best_validation_loss":0.0866325439453125,"training_seconds":6.3803317949999965,"total_run_seconds":9.243859507,"hardware":{"device":"cuda","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.8.0+cu128","tf32":true,"dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"df8ef46c69011718b66e38f100c668736a2aeb36fd131152f01cd2416b04dacc","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[0,0,0,0]},{"run_id":"pilot-normalized-residual","spec":{"run_id":"pilot-normalized-residual","stage":"pilot","recipe":"residual","pmax":0.0,"input_scale":0.00392156862745098,"output_relu":false,"lr":0.03,"shrinkage":0.0,"seed":1,"epochs":5,"batch_size":64,"eval_every":1,"train_size":50000,"timeout_seconds":180,"gpu":"A100"},"history":[{"epoch":1,"stochastic_training_loss":0.25003981590270996,"dense_train_probe":{"loss":0.09767464599609375,"accuracy":0.9696,"n":10000},"validation":{"loss":0.1303823486328125,"accuracy":0.9598,"n":10000},"training_seconds":3.338808856,"epoch_training_seconds":3.338808856,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,232,184,210,200,203,180,208,199]},{"epoch":2,"stochastic_training_loss":0.09213462471961975,"dense_train_probe":{"loss":0.06589056396484375,"accuracy":0.9779,"n":10000},"validation":{"loss":0.10006766967773438,"accuracy":0.9697,"n":10000},"training_seconds":5.716759723000001,"epoch_training_seconds":2.377950867000001,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[219,204,220,184,211,205,197,188,215,205]},{"epoch":3,"stochastic_training_loss":0.05913219973444939,"dense_train_probe":{"loss":0.025550897216796875,"accuracy":0.9934,"n":10000},"validation":{"loss":0.07315656127929687,"accuracy":0.9785,"n":10000},"training_seconds":8.028379462000002,"epoch_training_seconds":2.311619739000001,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[219,209,219,182,216,210,190,186,214,203]},{"epoch":4,"stochastic_training_loss":0.03969665989279747,"dense_train_probe":{"loss":0.04468595581054687,"accuracy":0.9861,"n":10000},"validation":{"loss":0.10845537109375,"accuracy":0.9689,"n":10000},"training_seconds":10.330895319000001,"epoch_training_seconds":2.3025158569999995,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[217,214,217,184,204,227,186,193,207,199]},{"epoch":5,"stochastic_training_loss":0.03323053568601608,"dense_train_probe":{"loss":0.021345994567871094,"accuracy":0.9927,"n":10000},"validation":{"loss":0.09070322875976562,"accuracy":0.9758,"n":10000},"training_seconds":12.568252603000003,"epoch_training_seconds":2.2373572840000016,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[219,209,216,189,211,207,194,184,219,200]}],"best_epoch":3,"best_validation_loss":0.07315656127929687,"training_seconds":12.568252603000003,"total_run_seconds":16.866292398,"hardware":{"device":"cuda","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.8.0+cu128","tf32":true,"dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"df8ef46c69011718b66e38f100c668736a2aeb36fd131152f01cd2416b04dacc","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[0,0,0,0]},{"run_id":"pilot-source-linear","spec":{"run_id":"pilot-source-linear","stage":"pilot","recipe":"plain","pmax":0.0,"input_scale":1.0,"output_relu":false,"lr":0.001,"shrinkage":2e-05,"seed":1,"epochs":5,"batch_size":64,"eval_every":1,"train_size":50000,"timeout_seconds":180,"gpu":"A100"},"history":[{"epoch":1,"stochastic_training_loss":0.2505957782268524,"dense_train_probe":{"loss":0.105465185546875,"accuracy":0.9697,"n":10000},"validation":{"loss":0.1394934326171875,"accuracy":0.9563,"n":10000},"training_seconds":2.7925591270000005,"epoch_training_seconds":2.7925591270000005,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[231,211,223,189,219,207,194,185,193,196]},{"epoch":2,"stochastic_training_loss":0.0869896411895752,"dense_train_probe":{"loss":0.04851778259277344,"accuracy":0.9868,"n":10000},"validation":{"loss":0.090691943359375,"accuracy":0.9724,"n":10000},"training_seconds":4.583892157999999,"epoch_training_seconds":1.7913330309999989,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,208,220,178,214,211,194,186,218,198]},{"epoch":3,"stochastic_training_loss":0.05224576219916344,"dense_train_probe":{"loss":0.02639283447265625,"accuracy":0.9941,"n":10000},"validation":{"loss":0.077679638671875,"accuracy":0.9765,"n":10000},"training_seconds":6.377197839999999,"epoch_training_seconds":1.7933056819999997,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[218,207,220,184,213,209,192,185,217,203]},{"epoch":4,"stochastic_training_loss":0.028218528255820274,"dense_train_probe":{"loss":0.019404409790039063,"accuracy":0.9953,"n":10000},"validation":{"loss":0.0846132568359375,"accuracy":0.9742,"n":10000},"training_seconds":8.147663718000002,"epoch_training_seconds":1.770465878000003,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[216,211,219,180,209,216,192,193,212,200]},{"epoch":5,"stochastic_training_loss":0.017660746350884438,"dense_train_probe":{"loss":0.008843421936035156,"accuracy":0.9986,"n":10000},"validation":{"loss":0.07600885009765625,"accuracy":0.9782,"n":10000},"training_seconds":9.913843123000001,"epoch_training_seconds":1.766179404999999,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[218,210,222,184,210,202,194,184,225,199]}],"best_epoch":5,"best_validation_loss":0.07600885009765625,"training_seconds":9.913843123000001,"total_run_seconds":14.348990537999999,"hardware":{"device":"cuda","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.8.0+cu128","tf32":true,"dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"df8ef46c69011718b66e38f100c668736a2aeb36fd131152f01cd2416b04dacc","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[0,0,0,0]},{"run_id":"pilot-normalized-sd","spec":{"run_id":"pilot-normalized-sd","stage":"pilot","recipe":"sd_annealed","pmax":0.8,"input_scale":0.00392156862745098,"output_relu":false,"lr":0.03,"shrinkage":0.0,"seed":1,"epochs":5,"batch_size":64,"eval_every":1,"train_size":50000,"timeout_seconds":180,"gpu":"A100"},"history":[{"epoch":1,"stochastic_training_loss":0.5742323994636536,"dense_train_probe":{"loss":0.239109521484375,"accuracy":0.9421,"n":10000},"validation":{"loss":0.258082763671875,"accuracy":0.9378,"n":10000},"training_seconds":1.9733614350000002,"epoch_training_seconds":1.9733614350000002,"drop_probabilities":[0.2,0.4,0.6000000000000001,0.8],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[226,222,232,172,200,227,182,189,191,207]},{"epoch":2,"stochastic_training_loss":0.15936505794525146,"dense_train_probe":{"loss":0.115599462890625,"accuracy":0.967,"n":10000},"validation":{"loss":0.1327555419921875,"accuracy":0.9614,"n":10000},"training_seconds":3.2489230539999996,"epoch_training_seconds":1.2755616189999994,"drop_probabilities":[0.15000000000000002,0.30000000000000004,0.45000000000000007,0.6000000000000001],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[216,204,220,179,211,202,201,184,211,220]},{"epoch":3,"stochastic_training_loss":0.10311129689216614,"dense_train_probe":{"loss":0.08002186279296875,"accuracy":0.9749,"n":10000},"validation":{"loss":0.10878944091796874,"accuracy":0.9675,"n":10000},"training_seconds":4.639149632,"epoch_training_seconds":1.390226578,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,207,218,172,224,226,189,178,214,200]},{"epoch":4,"stochastic_training_loss":0.07509957998991013,"dense_train_probe":{"loss":0.0596731201171875,"accuracy":0.9817,"n":10000},"validation":{"loss":0.110605419921875,"accuracy":0.9685,"n":10000},"training_seconds":6.134109006,"epoch_training_seconds":1.4949593740000005,"drop_probabilities":[0.05,0.1,0.15000000000000002,0.2],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[219,212,222,200,218,211,189,181,198,198]},{"epoch":5,"stochastic_training_loss":0.04879908263683319,"dense_train_probe":{"loss":0.0312780517578125,"accuracy":0.9896,"n":10000},"validation":{"loss":0.0906310302734375,"accuracy":0.9758,"n":10000},"training_seconds":7.649306611999999,"epoch_training_seconds":1.5151976059999992,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,209,214,188,218,206,193,185,218,197]}],"best_epoch":5,"best_validation_loss":0.0906310302734375,"training_seconds":7.649306611999999,"total_run_seconds":10.414212812999999,"hardware":{"device":"cuda","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.8.0+cu128","tf32":true,"dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"df8ef46c69011718b66e38f100c668736a2aeb36fd131152f01cd2416b04dacc","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[404,781,1200,1584]},{"run_id":"graph-eval-plain-s101","spec":{"run_id":"graph-eval-plain-s101","stage":"evaluate","cohort":"main","recipe":"plain","pmax":0.0,"input_scale":0.00392156862745098,"output_relu":false,"lr":0.03,"shrinkage":0.0,"seed":101,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"timeout_seconds":180,"gpu":"A100","precision":"fp32"},"history":[{"epoch":1,"stochastic_training_loss":0.6117299795150757,"dense_train_probe":{"loss":0.11696241455078125,"accuracy":0.9665,"n":10000},"validation":{"loss":0.1397569580078125,"accuracy":0.9609,"n":10000},"training_seconds":0.6692661919999994,"epoch_training_seconds":0.6692661919999994,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[228,209,216,186,207,203,186,186,231,196]},{"epoch":5,"stochastic_training_loss":0.040546271950006485,"dense_train_probe":{"loss":0.028665936279296873,"accuracy":0.9909,"n":10000},"validation":{"loss":0.09530687255859376,"accuracy":0.9738,"n":10000},"training_seconds":3.1668497759999985,"epoch_training_seconds":0.6246888039999998,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[218,209,220,186,216,199,198,186,220,196]},{"epoch":10,"stochastic_training_loss":0.01421570498496294,"dense_train_probe":{"loss":0.02798346862792969,"accuracy":0.9913,"n":10000},"validation":{"loss":0.1158449462890625,"accuracy":0.9735,"n":10000},"training_seconds":6.300219998,"epoch_training_seconds":0.6237602639999995,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,218,214,177,217,205,196,191,216,194]},{"epoch":15,"stochastic_training_loss":0.007035445887595415,"dense_train_probe":{"loss":0.006470633697509766,"accuracy":0.9983,"n":10000},"validation":{"loss":0.1074722900390625,"accuracy":0.9804,"n":10000},"training_seconds":9.425200231999998,"epoch_training_seconds":0.6236098260000027,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,210,224,178,213,206,194,183,220,199]},{"epoch":20,"stochastic_training_loss":0.0012695144396275282,"dense_train_probe":{"loss":0.00016567851305007936,"accuracy":1.0,"n":10000},"validation":{"loss":0.105684716796875,"accuracy":0.9822,"n":10000},"training_seconds":12.544218691999998,"epoch_training_seconds":0.6237227839999981,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,211,222,174,216,211,193,187,217,197]},{"epoch":25,"stochastic_training_loss":1.877739305200521e-05,"dense_train_probe":{"loss":1.9567452371120453e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.11243682861328125,"accuracy":0.9829,"n":10000},"training_seconds":15.67120211,"epoch_training_seconds":0.6237845769999986,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,222,174,216,210,193,187,217,197]},{"epoch":30,"stochastic_training_loss":1.0562717761786189e-05,"dense_train_probe":{"loss":1.145658865571022e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.117010205078125,"accuracy":0.9831,"n":10000},"training_seconds":18.802640983,"epoch_training_seconds":0.6285284100000013,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,222,174,216,210,193,187,217,197]},{"epoch":35,"stochastic_training_loss":7.319724318222143e-06,"dense_train_probe":{"loss":7.966576516628265e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.12020692138671875,"accuracy":0.9832,"n":10000},"training_seconds":21.936311507999996,"epoch_training_seconds":0.638448223000001,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,222,174,216,210,193,187,217,197]},{"epoch":40,"stochastic_training_loss":5.571911060542334e-06,"dense_train_probe":{"loss":6.155073270201683e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.122629541015625,"accuracy":0.9832,"n":10000},"training_seconds":25.066905287,"epoch_training_seconds":0.6239828320000029,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,222,174,216,210,193,187,217,197]},{"epoch":45,"stochastic_training_loss":4.48362607130548e-06,"dense_train_probe":{"loss":4.964428395032883e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1246245849609375,"accuracy":0.983,"n":10000},"training_seconds":28.226940484,"epoch_training_seconds":0.623606848999998,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,222,174,216,209,193,187,218,197]},{"epoch":50,"stochastic_training_loss":3.7382708342192927e-06,"dense_train_probe":{"loss":4.155942797660828e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1262875,"accuracy":0.9831,"n":10000},"training_seconds":31.366053897999986,"epoch_training_seconds":0.6238235040000006,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,222,174,216,209,193,186,218,198]},{"epoch":55,"stochastic_training_loss":3.1989786748454208e-06,"dense_train_probe":{"loss":3.558337315917015e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.127736328125,"accuracy":0.9831,"n":10000},"training_seconds":34.48486298299997,"epoch_training_seconds":0.6237041439999942,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,222,174,216,209,193,186,218,198]},{"epoch":60,"stochastic_training_loss":2.7896110168512678e-06,"dense_train_probe":{"loss":3.1032443046569825e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.12901680908203125,"accuracy":0.9831,"n":10000},"training_seconds":37.60800967899996,"epoch_training_seconds":0.6236457500000014,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,222,174,216,209,193,186,218,198]},{"epoch":65,"stochastic_training_loss":2.473429049132392e-06,"dense_train_probe":{"loss":2.7560099959373473e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.13015531005859374,"accuracy":0.9831,"n":10000},"training_seconds":40.76140501599996,"epoch_training_seconds":0.644881900999998,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,222,174,216,209,193,186,218,198]},{"epoch":70,"stochastic_training_loss":2.217332621512469e-06,"dense_train_probe":{"loss":2.4682579562067985e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.13121051025390626,"accuracy":0.9831,"n":10000},"training_seconds":43.89658996799996,"epoch_training_seconds":0.6236662049999993,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,222,174,216,209,193,186,218,198]},{"epoch":75,"stochastic_training_loss":2.006747081395588e-06,"dense_train_probe":{"loss":2.234898880124092e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.132157373046875,"accuracy":0.9831,"n":10000},"training_seconds":47.01626528899996,"epoch_training_seconds":0.6238406089999984,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,222,174,216,209,193,186,218,198]},{"epoch":80,"stochastic_training_loss":1.8324487882637186e-06,"dense_train_probe":{"loss":2.042067609727383e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1330212890625,"accuracy":0.9831,"n":10000},"training_seconds":50.136851290999964,"epoch_training_seconds":0.6236363120000021,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,222,174,216,209,193,186,218,198]},{"epoch":85,"stochastic_training_loss":1.684341782492993e-06,"dense_train_probe":{"loss":1.8781125545501708e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1338297607421875,"accuracy":0.9831,"n":10000},"training_seconds":53.26255099599996,"epoch_training_seconds":0.6233958659999956,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,222,174,216,209,193,186,218,198]},{"epoch":90,"stochastic_training_loss":1.5578339116473217e-06,"dense_train_probe":{"loss":1.7380207777023316e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.134574072265625,"accuracy":0.9832,"n":10000},"training_seconds":56.416254197999955,"epoch_training_seconds":0.6235506360000045,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,222,174,216,209,193,186,218,198]},{"epoch":95,"stochastic_training_loss":1.4475683656201e-06,"dense_train_probe":{"loss":1.6155041754245757e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1352760986328125,"accuracy":0.9832,"n":10000},"training_seconds":59.53487990899996,"epoch_training_seconds":0.6235090389999982,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,222,174,216,209,193,186,218,198]},{"epoch":100,"stochastic_training_loss":1.3511548786482308e-06,"dense_train_probe":{"loss":1.508619450032711e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1359433837890625,"accuracy":0.9832,"n":10000},"training_seconds":62.66078952299994,"epoch_training_seconds":0.6307469690000005,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,222,174,216,209,193,186,218,198]}],"best_epoch":5,"best_validation_loss":0.09530687255859376,"training_seconds":62.66078952299994,"total_run_seconds":65.040802399,"hardware":{"device":"cuda:0","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"e1efb33081a653eb2db13a44aa7d20f3f16925ea1dc8bc2e91ed2f639a3974ae","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[0,0,0,0],"final_train":{"loss":1.3377690315246583e-06,"accuracy":1.0,"n":50000},"selected_train":{"loss":0.0309840185546875,"accuracy":0.99052,"n":50000},"final_test":{"loss":0.10615570068359376,"accuracy":0.9855,"n":10000,"wrong_indices":[115,149,151,247,259,340,445,449,551,582,646,659,720,938,947,951,1014,1039,1044,1112,1156,1192,1194,1224,1226,1232,1242,1247,1299,1319,1328,1393,1395,1522,1530,1549,1569,1570,1681,1717,1754,1901,1941,2024,2043,2053,2098,2109,2130,2135,2293,2369,2387,2408,2488,2597,2607,2648,2654,2720,2810,2863,2877,2921,2927,2939,2953,3005,3030,3073,3117,3225,3388,3422,3503,3520,3533,3558,3597,3767,3776,3780,3808,3906,3941,3985,4065,4075,4078,4199,4248,4259,4289,4497,4504,4536,4601,4731,4761,4807,4823,4880,4966,5331,5457,5642,5676,5936,5937,5955,5973,5982,6011,6059,6166,6555,6597,6625,6755,6783,7216,7434,8094,8246,8325,8408,8456,8527,9009,9015,9024,9280,9587,9634,9664,9669,9679,9729,9770,9792,9808,9839,9856,9858,9944],"errors":145},"selected_test":{"loss":0.08981358642578124,"accuracy":0.9756,"n":10000,"wrong_indices":[149,247,259,321,326,340,381,412,432,445,447,490,582,646,659,674,691,707,720,844,924,951,956,1014,1039,1044,1112,1128,1178,1182,1192,1224,1226,1232,1242,1247,1253,1299,1315,1319,1328,1337,1393,1395,1438,1441,1466,1494,1500,1522,1527,1530,1531,1549,1554,1570,1611,1621,1670,1681,1737,1754,1772,1901,1941,1970,2024,2025,2035,2044,2053,2073,2098,2109,2130,2135,2162,2182,2185,2186,2266,2291,2293,2369,2387,2422,2454,2488,2560,2578,2597,2607,2631,2635,2648,2654,2720,2721,2743,2810,2863,2877,2921,2939,2952,2953,2970,3012,3023,3030,3073,3117,3225,3289,3330,3336,3384,3388,3475,3503,3520,3534,3558,3597,3681,3727,3756,3767,3776,3780,3796,3808,3818,3855,3869,3876,3893,3902,3906,3941,3943,3985,4007,4065,4075,4131,4163,4224,4248,4259,4289,4306,4359,4360,4374,4400,4477,4497,4504,4536,4601,4690,4731,4735,4807,4823,4830,4874,4876,4880,4966,5331,5457,5634,5642,5734,5757,5806,5922,5937,5955,5972,5973,5981,5997,6042,6053,6059,6093,6166,6351,6390,6392,6555,6560,6571,6576,6597,6598,6603,6625,6651,6706,6755,6906,7208,7216,7256,7259,7434,7511,8072,8094,8325,8408,8453,8502,8527,8584,8639,9009,9024,9280,9427,9482,9544,9587,9634,9642,9664,9679,9700,9729,9741,9745,9768,9770,9777,9792,9808,9839,9858,9944,9980],"errors":244}},{"run_id":"graph-eval-plain-s102","spec":{"run_id":"graph-eval-plain-s102","stage":"evaluate","cohort":"main","recipe":"plain","pmax":0.0,"input_scale":0.00392156862745098,"output_relu":false,"lr":0.03,"shrinkage":0.0,"seed":102,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"timeout_seconds":180,"gpu":"A100","precision":"fp32"},"history":[{"epoch":1,"stochastic_training_loss":0.5933034420013428,"dense_train_probe":{"loss":0.1448070068359375,"accuracy":0.9547,"n":10000},"validation":{"loss":0.1688236328125,"accuracy":0.9498,"n":10000},"training_seconds":0.6763970490000002,"epoch_training_seconds":0.6763970490000002,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[215,215,214,194,209,207,195,177,196,226]},{"epoch":5,"stochastic_training_loss":0.04254896938800812,"dense_train_probe":{"loss":0.029962387084960938,"accuracy":0.9903,"n":10000},"validation":{"loss":0.08726602783203125,"accuracy":0.9748,"n":10000},"training_seconds":3.1500230749999982,"epoch_training_seconds":0.618402549999999,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[219,213,223,181,220,210,194,179,212,197]},{"epoch":10,"stochastic_training_loss":0.01573232375085354,"dense_train_probe":{"loss":0.005651724243164062,"accuracy":0.9986,"n":10000},"validation":{"loss":0.082777001953125,"accuracy":0.9808,"n":10000},"training_seconds":6.242367563,"epoch_training_seconds":0.6181762279999994,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,215,220,183,210,207,193,189,213,198]},{"epoch":15,"stochastic_training_loss":0.005531815346330404,"dense_train_probe":{"loss":0.007481535339355469,"accuracy":0.9986,"n":10000},"validation":{"loss":0.09262522583007812,"accuracy":0.9812,"n":10000},"training_seconds":9.362669141000001,"epoch_training_seconds":0.625324139,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[218,210,218,182,212,208,192,185,216,207]},{"epoch":20,"stochastic_training_loss":0.006428040564060211,"dense_train_probe":{"loss":0.008443861389160156,"accuracy":0.9978,"n":10000},"validation":{"loss":0.1066483642578125,"accuracy":0.9798,"n":10000},"training_seconds":12.463453008000005,"epoch_training_seconds":0.6181961370000018,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,211,225,179,220,205,192,182,217,195]},{"epoch":25,"stochastic_training_loss":0.002426150254905224,"dense_train_probe":{"loss":0.005983114624023437,"accuracy":0.9987,"n":10000},"validation":{"loss":0.1027915283203125,"accuracy":0.9826,"n":10000},"training_seconds":15.565033357,"epoch_training_seconds":0.6180991800000015,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,211,227,181,219,209,187,180,217,195]},{"epoch":30,"stochastic_training_loss":4.1757768485695124e-05,"dense_train_probe":{"loss":3.2590317726135256e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.1024658447265625,"accuracy":0.9834,"n":10000},"training_seconds":18.661650867,"epoch_training_seconds":0.6180042450000016,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,211,223,180,213,210,192,185,217,197]},{"epoch":35,"stochastic_training_loss":1.3913897419115528e-05,"dense_train_probe":{"loss":1.3246965408325195e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.10784552001953125,"accuracy":0.9837,"n":10000},"training_seconds":21.76969556300001,"epoch_training_seconds":0.6180569610000006,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,211,222,180,213,210,192,185,218,197]},{"epoch":40,"stochastic_training_loss":8.553824955015443e-06,"dense_train_probe":{"loss":8.422558009624481e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.11170347900390624,"accuracy":0.9835,"n":10000},"training_seconds":24.86877480500001,"epoch_training_seconds":0.6179973009999955,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,211,222,180,213,210,192,185,218,197]},{"epoch":45,"stochastic_training_loss":6.141267476778012e-06,"dense_train_probe":{"loss":6.159985065460205e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.114512451171875,"accuracy":0.9836,"n":10000},"training_seconds":27.973740503000013,"epoch_training_seconds":0.6279527750000042,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,211,222,180,213,210,192,185,218,197]},{"epoch":50,"stochastic_training_loss":4.768806775246048e-06,"dense_train_probe":{"loss":4.839690774679184e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.116732666015625,"accuracy":0.9836,"n":10000},"training_seconds":31.078673112000008,"epoch_training_seconds":0.6185644830000001,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,211,222,180,213,210,192,185,218,197]},{"epoch":55,"stochastic_training_loss":3.88365333492402e-06,"dense_train_probe":{"loss":3.976913914084434e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1185611328125,"accuracy":0.9836,"n":10000},"training_seconds":34.17479305500001,"epoch_training_seconds":0.6180840399999994,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,211,222,180,213,210,192,185,218,197]},{"epoch":60,"stochastic_training_loss":3.2688672035874333e-06,"dense_train_probe":{"loss":3.370622545480728e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.12011275634765625,"accuracy":0.9839,"n":10000},"training_seconds":37.26630195400001,"epoch_training_seconds":0.6182936109999986,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,211,222,180,213,210,192,185,218,197]},{"epoch":65,"stochastic_training_loss":2.8169538381916936e-06,"dense_train_probe":{"loss":2.9205730184912683e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1214745361328125,"accuracy":0.9839,"n":10000},"training_seconds":40.357505138000015,"epoch_training_seconds":0.6180976660000042,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,210,222,180,214,210,192,185,218,197]},{"epoch":70,"stochastic_training_loss":2.470951812938438e-06,"dense_train_probe":{"loss":2.5742501020431518e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.12266922607421875,"accuracy":0.9838,"n":10000},"training_seconds":43.459937366,"epoch_training_seconds":0.6181282019999941,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,210,222,180,214,210,192,185,218,197]},{"epoch":75,"stochastic_training_loss":2.1980172277835663e-06,"dense_train_probe":{"loss":2.2986497730016707e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.12375101318359374,"accuracy":0.9838,"n":10000},"training_seconds":46.5510442,"epoch_training_seconds":0.6180856360000035,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,210,222,180,214,210,192,185,218,197]},{"epoch":80,"stochastic_training_loss":1.9776875888055656e-06,"dense_train_probe":{"loss":2.0757928490638734e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1247295654296875,"accuracy":0.984,"n":10000},"training_seconds":49.65241368599998,"epoch_training_seconds":0.6180772779999941,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,210,222,180,214,210,192,185,218,197]},{"epoch":85,"stochastic_training_loss":1.7959256410904345e-06,"dense_train_probe":{"loss":1.8915707245469094e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1256232666015625,"accuracy":0.9839,"n":10000},"training_seconds":52.76083796799998,"epoch_training_seconds":0.6265876900000009,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,210,222,180,214,210,192,185,218,197]},{"epoch":90,"stochastic_training_loss":1.6434298686363036e-06,"dense_train_probe":{"loss":1.7347704619169235e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1264510498046875,"accuracy":0.984,"n":10000},"training_seconds":55.85200098199999,"epoch_training_seconds":0.6183469680000044,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,210,222,180,214,210,192,185,218,197]},{"epoch":95,"stochastic_training_loss":1.5141492895054398e-06,"dense_train_probe":{"loss":1.602746918797493e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.12721856689453126,"accuracy":0.984,"n":10000},"training_seconds":58.96285086199998,"epoch_training_seconds":0.6258520579999924,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,210,222,180,214,210,192,185,218,197]},{"epoch":100,"stochastic_training_loss":1.4032017361387261e-06,"dense_train_probe":{"loss":1.4887548983097076e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.12793756103515624,"accuracy":0.984,"n":10000},"training_seconds":62.06725023199999,"epoch_training_seconds":0.6185122340000078,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,210,222,180,214,210,192,185,218,197]}],"best_epoch":10,"best_validation_loss":0.082777001953125,"training_seconds":62.06725023199999,"total_run_seconds":64.380409661,"hardware":{"device":"cuda:0","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"4d0ac269167486811a0086108ca56313016afcebfc075d45e09455c228dee75b","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[0,0,0,0],"final_train":{"loss":1.389368176460266e-06,"accuracy":1.0,"n":50000},"selected_train":{"loss":0.00522846435546875,"accuracy":0.99846,"n":50000},"final_test":{"loss":0.118670654296875,"accuracy":0.9857,"n":10000,"wrong_indices":[247,259,321,340,445,449,582,646,691,720,938,947,951,1014,1039,1112,1156,1182,1192,1224,1226,1232,1242,1247,1299,1319,1328,1393,1494,1522,1530,1549,1553,1681,1754,1878,1901,1982,2053,2109,2130,2135,2293,2325,2369,2387,2408,2422,2426,2488,2597,2607,2648,2654,2720,2863,2877,2921,2927,2939,2953,3030,3073,3172,3225,3405,3422,3475,3503,3520,3558,3597,3767,3776,3780,3808,3811,3906,3941,3976,3985,4065,4075,4078,4176,4201,4248,4497,4536,4639,4740,4807,4823,4860,4879,4880,4966,5331,5457,5642,5734,5936,5937,5955,5973,6011,6023,6045,6059,6555,6572,6576,6597,6651,6755,6783,7216,7434,7886,8094,8246,8325,8408,8527,9009,9015,9019,9024,9587,9634,9664,9669,9679,9729,9742,9745,9768,9770,9792,9808,9839,9856,9858],"errors":143},"selected_test":{"loss":0.074681591796875,"accuracy":0.9822,"n":10000,"wrong_indices":[8,104,247,259,340,381,445,449,495,582,619,646,674,707,720,740,881,938,947,956,965,1014,1039,1112,1156,1181,1224,1226,1232,1242,1247,1260,1319,1328,1393,1395,1494,1522,1530,1549,1569,1611,1626,1681,1901,1911,1941,1987,2004,2024,2035,2053,2098,2109,2118,2130,2135,2182,2185,2272,2280,2293,2369,2387,2405,2408,2488,2597,2607,2654,2877,2921,2927,2939,2953,3030,3117,3172,3218,3225,3422,3474,3475,3490,3503,3520,3533,3534,3558,3726,3757,3776,3780,3808,3811,3893,3906,3941,3976,4065,4075,4078,4176,4194,4201,4248,4271,4289,4306,4382,4437,4487,4497,4500,4504,4536,4639,4671,4731,4740,4761,4807,4814,4823,4879,4880,4966,4978,4990,5201,5331,5457,5634,5642,5676,5926,5936,5937,5955,5973,6011,6023,6045,6059,6174,6555,6572,6576,6597,6783,7121,7216,7259,7434,8094,8311,8325,8408,8527,9009,9015,9024,9280,9517,9544,9587,9634,9664,9669,9679,9729,9745,9755,9768,9770,9792,9839,9888],"errors":178}},{"run_id":"graph-eval-plain-s103","spec":{"run_id":"graph-eval-plain-s103","stage":"evaluate","cohort":"main","recipe":"plain","pmax":0.0,"input_scale":0.00392156862745098,"output_relu":false,"lr":0.03,"shrinkage":0.0,"seed":103,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"timeout_seconds":180,"gpu":"A100","precision":"fp32"},"history":[{"epoch":1,"stochastic_training_loss":0.589407205581665,"dense_train_probe":{"loss":0.1407733642578125,"accuracy":0.958,"n":10000},"validation":{"loss":0.1614127685546875,"accuracy":0.9521,"n":10000},"training_seconds":0.6693417780000006,"epoch_training_seconds":0.6693417780000006,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[224,206,211,165,219,234,199,190,210,190]},{"epoch":5,"stochastic_training_loss":0.04294468089938164,"dense_train_probe":{"loss":0.03961064453125,"accuracy":0.9877,"n":10000},"validation":{"loss":0.1086410400390625,"accuracy":0.9698,"n":10000},"training_seconds":3.1392973400000024,"epoch_training_seconds":0.6174135420000013,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[219,210,225,179,227,205,193,185,221,184]},{"epoch":10,"stochastic_training_loss":0.012632125988602638,"dense_train_probe":{"loss":0.010275442504882812,"accuracy":0.9969,"n":10000},"validation":{"loss":0.09482418212890625,"accuracy":0.9784,"n":10000},"training_seconds":6.247140233000003,"epoch_training_seconds":0.6192141620000005,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,209,220,179,217,220,186,187,210,198]},{"epoch":15,"stochastic_training_loss":0.011491830460727215,"dense_train_probe":{"loss":0.012692303466796876,"accuracy":0.996,"n":10000},"validation":{"loss":0.0982379638671875,"accuracy":0.9774,"n":10000},"training_seconds":9.343583100000005,"epoch_training_seconds":0.6176158000000012,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,207,223,178,218,204,193,182,225,198]},{"epoch":20,"stochastic_training_loss":0.0027015109080821276,"dense_train_probe":{"loss":0.003719793701171875,"accuracy":0.9991,"n":10000},"validation":{"loss":0.10504315185546875,"accuracy":0.9806,"n":10000},"training_seconds":12.442976295000003,"epoch_training_seconds":0.6174082179999978,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[219,211,225,179,217,203,194,181,225,194]},{"epoch":25,"stochastic_training_loss":2.574847894720733e-05,"dense_train_probe":{"loss":2.533249855041504e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.098930615234375,"accuracy":0.9847,"n":10000},"training_seconds":15.536243499000003,"epoch_training_seconds":0.6174953599999995,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,220,178,217,207,192,187,219,196]},{"epoch":30,"stochastic_training_loss":1.2865998542110901e-05,"dense_train_probe":{"loss":1.3288512825965882e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.1039811767578125,"accuracy":0.9847,"n":10000},"training_seconds":18.624983506000003,"epoch_training_seconds":0.6175444989999974,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,220,178,217,207,192,187,219,196]},{"epoch":35,"stochastic_training_loss":8.458977390546352e-06,"dense_train_probe":{"loss":9.007527679204941e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.107475830078125,"accuracy":0.9847,"n":10000},"training_seconds":21.735275215,"epoch_training_seconds":0.6396653370000003,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,220,178,217,207,192,187,219,196]},{"epoch":40,"stochastic_training_loss":6.259558176680002e-06,"dense_train_probe":{"loss":6.689354777336121e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1100485595703125,"accuracy":0.9845,"n":10000},"training_seconds":24.823220736,"epoch_training_seconds":0.6175987270000007,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,220,178,217,207,192,187,219,196]},{"epoch":45,"stochastic_training_loss":4.944760803482495e-06,"dense_train_probe":{"loss":5.352460220456123e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.11214964599609376,"accuracy":0.9844,"n":10000},"training_seconds":27.932881432999988,"epoch_training_seconds":0.6196627129999968,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,220,178,217,207,192,187,219,196]},{"epoch":50,"stochastic_training_loss":4.068130238010781e-06,"dense_train_probe":{"loss":4.4162113219499585e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.11388077392578125,"accuracy":0.9845,"n":10000},"training_seconds":31.031616559999993,"epoch_training_seconds":0.6175634129999992,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,220,178,217,207,192,187,219,196]},{"epoch":55,"stochastic_training_loss":3.4495710679038893e-06,"dense_train_probe":{"loss":3.7490084767341614e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.11537412109375,"accuracy":0.9844,"n":10000},"training_seconds":34.12655307799998,"epoch_training_seconds":0.6174350349999997,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,210,220,178,217,207,192,187,220,196]},{"epoch":60,"stochastic_training_loss":2.985910896313726e-06,"dense_train_probe":{"loss":3.259475529193878e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.116708154296875,"accuracy":0.9844,"n":10000},"training_seconds":37.24618986199999,"epoch_training_seconds":0.6174795989999993,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,210,220,178,217,207,192,187,220,196]},{"epoch":65,"stochastic_training_loss":2.6270513444615062e-06,"dense_train_probe":{"loss":2.8715645894408226e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.117875244140625,"accuracy":0.9844,"n":10000},"training_seconds":40.343722587999984,"epoch_training_seconds":0.617640889999997,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,210,220,178,217,207,192,187,220,196]},{"epoch":70,"stochastic_training_loss":2.343007508898154e-06,"dense_train_probe":{"loss":2.5641895830631255e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.11892666015625,"accuracy":0.9844,"n":10000},"training_seconds":43.44284563599998,"epoch_training_seconds":0.6177632119999998,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,210,220,178,217,207,192,187,220,196]},{"epoch":75,"stochastic_training_loss":2.1063240183138987e-06,"dense_train_probe":{"loss":2.3190200328826905e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.11989903564453125,"accuracy":0.9844,"n":10000},"training_seconds":46.56049964799999,"epoch_training_seconds":0.6470163749999998,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,210,220,178,217,207,192,187,220,196]},{"epoch":80,"stochastic_training_loss":1.920263684951351e-06,"dense_train_probe":{"loss":2.1081838756799697e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.120778955078125,"accuracy":0.9843,"n":10000},"training_seconds":49.65915806999999,"epoch_training_seconds":0.6275812740000006,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,210,220,178,217,207,192,187,220,196]},{"epoch":85,"stochastic_training_loss":1.7598100612303824e-06,"dense_train_probe":{"loss":1.932598277926445e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.12160460205078125,"accuracy":0.9843,"n":10000},"training_seconds":52.75525427199999,"epoch_training_seconds":0.6177067659999977,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,210,220,178,217,207,192,187,220,196]},{"epoch":90,"stochastic_training_loss":1.6191492022699094e-06,"dense_train_probe":{"loss":1.784273609519005e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1223707275390625,"accuracy":0.9843,"n":10000},"training_seconds":55.84343606799999,"epoch_training_seconds":0.617531225999997,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,210,220,178,217,207,192,187,220,196]},{"epoch":95,"stochastic_training_loss":1.5043516441437532e-06,"dense_train_probe":{"loss":1.6564562916755675e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1230846435546875,"accuracy":0.9843,"n":10000},"training_seconds":58.95023423899998,"epoch_training_seconds":0.6176448000000079,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,210,220,178,217,207,192,187,220,196]},{"epoch":100,"stochastic_training_loss":1.3994722394272685e-06,"dense_train_probe":{"loss":1.5430828556418418e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.12374986572265625,"accuracy":0.9843,"n":10000},"training_seconds":62.069416075999996,"epoch_training_seconds":0.6179652799999928,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,210,220,178,217,207,192,187,220,196]}],"best_epoch":10,"best_validation_loss":0.09482418212890625,"training_seconds":62.069416075999996,"total_run_seconds":64.464765977,"hardware":{"device":"cuda:0","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"316aa46c9e0a65fa375b579be0871a16f447d396fe64f85e2063ee6ef8c8dd5d","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[0,0,0,0],"final_train":{"loss":1.3874831795692444e-06,"accuracy":1.0,"n":50000},"selected_train":{"loss":0.012568994140625,"accuracy":0.9963,"n":50000},"final_test":{"loss":0.109908544921875,"accuracy":0.986,"n":10000,"wrong_indices":[115,247,259,321,340,381,445,449,495,582,646,674,720,844,938,947,951,956,1014,1039,1112,1156,1226,1232,1242,1247,1319,1328,1393,1395,1522,1530,1549,1569,1681,1878,1901,1941,1982,1987,2024,2035,2053,2098,2109,2130,2135,2293,2387,2408,2488,2597,2607,2648,2654,2720,2877,2896,2921,2939,2953,3005,3030,3117,3225,3289,3405,3422,3475,3503,3520,3533,3558,3776,3780,3796,3808,3869,3893,3906,3941,3976,3985,4065,4075,4078,4156,4176,4201,4248,4360,4497,4500,4536,4639,4761,4807,4814,4823,4880,4966,5331,5457,5642,5676,5936,5937,5955,5973,6011,6059,6166,6555,6572,6597,6625,6651,6755,6783,7216,7434,8094,8325,8408,8527,9009,9015,9024,9280,9587,9634,9664,9669,9679,9729,9745,9770,9808,9839,9858],"errors":140},"selected_test":{"loss":0.09139046630859375,"accuracy":0.9796,"n":10000,"wrong_indices":[217,247,259,290,321,340,381,445,449,495,582,646,674,691,720,844,877,947,951,956,1014,1039,1112,1128,1156,1178,1182,1192,1194,1226,1232,1242,1247,1299,1319,1328,1393,1395,1522,1530,1549,1626,1678,1681,1717,1730,1761,1828,1901,1941,1982,2004,2016,2024,2035,2053,2098,2109,2118,2125,2130,2135,2280,2293,2387,2408,2414,2426,2488,2597,2607,2654,2720,2721,2758,2863,2877,2896,2927,2939,2953,2979,3030,3117,3218,3225,3289,3342,3422,3475,3503,3520,3558,3762,3767,3780,3808,3869,3871,3906,3941,3985,4063,4065,4075,4140,4176,4201,4211,4248,4271,4294,4306,4317,4360,4369,4497,4536,4571,4619,4639,4671,4712,4807,4814,4823,4830,4838,4880,4918,4956,4966,5138,5331,5457,5634,5642,5676,5734,5936,5937,5955,5973,5982,5997,6009,6011,6023,6045,6059,6555,6560,6572,6597,6603,6625,6641,6651,6735,6740,6755,6783,6817,7216,7434,7580,7713,7921,8059,8094,8246,8255,8277,8311,8325,8339,8408,8413,8527,9009,9015,9019,9024,9280,9316,9587,9607,9634,9664,9669,9679,9692,9712,9741,9745,9755,9768,9770,9792,9808,9839,9858,9904,9944],"errors":204}},{"run_id":"graph-eval-residual-s101","spec":{"run_id":"graph-eval-residual-s101","stage":"evaluate","cohort":"main","recipe":"residual","pmax":0.0,"input_scale":0.00392156862745098,"output_relu":false,"lr":0.01,"shrinkage":0.0,"seed":101,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"timeout_seconds":180,"gpu":"A100","precision":"fp32"},"history":[{"epoch":1,"stochastic_training_loss":0.30294060707092285,"dense_train_probe":{"loss":0.1211160888671875,"accuracy":0.9631,"n":10000},"validation":{"loss":0.148240283203125,"accuracy":0.9562,"n":10000},"training_seconds":0.7113338709999999,"epoch_training_seconds":0.7113338709999999,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[229,212,212,185,212,207,189,204,207,191]},{"epoch":5,"stochastic_training_loss":0.026821494102478027,"dense_train_probe":{"loss":0.024110069274902345,"accuracy":0.9926,"n":10000},"validation":{"loss":0.09463363647460937,"accuracy":0.9736,"n":10000},"training_seconds":3.363970260000002,"epoch_training_seconds":0.6632258190000009,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,209,226,176,224,206,194,184,224,185]},{"epoch":10,"stochastic_training_loss":0.002672010799869895,"dense_train_probe":{"loss":0.0005857361793518066,"accuracy":0.9999,"n":10000},"validation":{"loss":0.07871497802734374,"accuracy":0.9824,"n":10000},"training_seconds":6.697065197000002,"epoch_training_seconds":0.6630832729999998,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,212,222,181,217,202,195,186,217,195]},{"epoch":15,"stochastic_training_loss":0.00010328114149160683,"dense_train_probe":{"loss":8.944253325462342e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.08909278564453126,"accuracy":0.983,"n":10000},"training_seconds":10.013325719000001,"epoch_training_seconds":0.6632885860000002,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,210,219,180,214,204,193,188,222,197]},{"epoch":20,"stochastic_training_loss":5.8103349147131667e-05,"dense_train_probe":{"loss":5.4524981975555417e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.09360984497070313,"accuracy":0.983,"n":10000},"training_seconds":13.329959119999994,"epoch_training_seconds":0.6631929949999993,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,210,219,180,215,204,193,188,222,196]},{"epoch":25,"stochastic_training_loss":4.15696413256228e-05,"dense_train_probe":{"loss":3.9919477701187135e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.0967906982421875,"accuracy":0.9828,"n":10000},"training_seconds":16.646403496999998,"epoch_training_seconds":0.6631409720000008,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,210,220,182,215,202,193,187,222,196]},{"epoch":30,"stochastic_training_loss":3.239838406443596e-05,"dense_train_probe":{"loss":3.166499137878418e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.09907424926757813,"accuracy":0.983,"n":10000},"training_seconds":19.962406366,"epoch_training_seconds":0.6630608110000011,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,210,220,180,215,204,193,187,222,196]},{"epoch":35,"stochastic_training_loss":2.6493977202335373e-05,"dense_train_probe":{"loss":2.614303231239319e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.10090643310546875,"accuracy":0.9829,"n":10000},"training_seconds":23.278204528,"epoch_training_seconds":0.6630561939999993,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,210,220,181,215,203,193,187,222,196]},{"epoch":40,"stochastic_training_loss":2.2436899598687887e-05,"dense_train_probe":{"loss":2.2103288769721986e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.1026928955078125,"accuracy":0.9828,"n":10000},"training_seconds":26.594797579999994,"epoch_training_seconds":0.6637321729999996,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,220,181,215,204,193,187,220,196]},{"epoch":45,"stochastic_training_loss":1.9435772628639825e-05,"dense_train_probe":{"loss":1.9182732701301575e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.1042656982421875,"accuracy":0.9828,"n":10000},"training_seconds":29.91093698,"epoch_training_seconds":0.6631998169999989,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,220,182,215,203,193,187,220,196]},{"epoch":50,"stochastic_training_loss":1.714486461423803e-05,"dense_train_probe":{"loss":1.695121228694916e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.10538909912109375,"accuracy":0.9826,"n":10000},"training_seconds":33.22704521399999,"epoch_training_seconds":0.6632364920000029,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,220,182,215,203,193,187,220,196]},{"epoch":55,"stochastic_training_loss":1.5316678400267847e-05,"dense_train_probe":{"loss":1.5216878056526184e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.106618115234375,"accuracy":0.9827,"n":10000},"training_seconds":36.54341103,"epoch_training_seconds":0.6631916510000053,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,220,182,215,203,193,187,220,196]},{"epoch":60,"stochastic_training_loss":1.3841923646396026e-05,"dense_train_probe":{"loss":1.3808938860893249e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.10733359375,"accuracy":0.9827,"n":10000},"training_seconds":39.860235010000004,"epoch_training_seconds":0.6632595909999992,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,220,182,215,203,193,187,220,196]},{"epoch":65,"stochastic_training_loss":1.2622924259630963e-05,"dense_train_probe":{"loss":1.2595191597938538e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.1084853515625,"accuracy":0.9826,"n":10000},"training_seconds":43.177236668,"epoch_training_seconds":0.663429598999997,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,220,182,215,203,193,187,220,196]},{"epoch":70,"stochastic_training_loss":1.1594713214435615e-05,"dense_train_probe":{"loss":1.1583641171455383e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.1092086181640625,"accuracy":0.9825,"n":10000},"training_seconds":46.494173466,"epoch_training_seconds":0.6634217939999942,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,220,182,215,203,193,187,220,196]},{"epoch":75,"stochastic_training_loss":1.0693183867260814e-05,"dense_train_probe":{"loss":1.0725399106740952e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.110045751953125,"accuracy":0.9826,"n":10000},"training_seconds":49.81086529499999,"epoch_training_seconds":0.6631139819999987,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,220,182,215,203,193,187,220,196]},{"epoch":80,"stochastic_training_loss":9.947970283974428e-06,"dense_train_probe":{"loss":9.99981164932251e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1106861572265625,"accuracy":0.9825,"n":10000},"training_seconds":53.126875778000006,"epoch_training_seconds":0.6630243370000031,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,220,182,215,203,193,187,220,196]},{"epoch":85,"stochastic_training_loss":9.288766705140006e-06,"dense_train_probe":{"loss":9.289927035570145e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.11143675537109375,"accuracy":0.9825,"n":10000},"training_seconds":56.44315333800001,"epoch_training_seconds":0.6631129760000007,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,220,182,215,203,193,187,220,196]},{"epoch":90,"stochastic_training_loss":8.701389560883399e-06,"dense_train_probe":{"loss":8.726482093334197e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.111939013671875,"accuracy":0.9825,"n":10000},"training_seconds":59.75936204800001,"epoch_training_seconds":0.6632661560000059,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,220,182,215,203,193,187,220,196]},{"epoch":95,"stochastic_training_loss":8.184779289877042e-06,"dense_train_probe":{"loss":8.224327862262726e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1125825927734375,"accuracy":0.9825,"n":10000},"training_seconds":63.076160754000036,"epoch_training_seconds":0.6633152120000005,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,220,182,215,203,193,187,220,196]},{"epoch":100,"stochastic_training_loss":7.716164873272646e-06,"dense_train_probe":{"loss":7.73824155330658e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1132458740234375,"accuracy":0.9825,"n":10000},"training_seconds":66.39346609800003,"epoch_training_seconds":0.6637595700000105,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,220,182,215,203,193,187,220,196]}],"best_epoch":10,"best_validation_loss":0.07871497802734374,"training_seconds":66.39346609800003,"total_run_seconds":69.289195148,"hardware":{"device":"cuda:0","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"e1efb33081a653eb2db13a44aa7d20f3f16925ea1dc8bc2e91ed2f639a3974ae","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[0,0,0,0],"final_train":{"loss":7.610405683517456e-06,"accuracy":1.0,"n":50000},"selected_train":{"loss":0.0006481150817871094,"accuracy":0.9999,"n":50000},"final_test":{"loss":0.09158612060546875,"accuracy":0.984,"n":10000,"wrong_indices":[247,259,321,340,381,445,449,582,646,659,720,938,947,951,956,965,1014,1039,1112,1156,1181,1182,1224,1226,1232,1242,1247,1319,1328,1393,1395,1494,1522,1530,1549,1609,1681,1754,1828,1901,1941,1984,1987,2024,2035,2044,2053,2070,2098,2109,2130,2135,2182,2272,2293,2369,2387,2408,2414,2422,2488,2597,2607,2648,2654,2877,2921,2927,2939,2953,3073,3117,3225,3422,3503,3520,3558,3597,3727,3776,3780,3808,3818,3853,3893,3906,3941,3976,3985,4065,4075,4078,4163,4176,4199,4201,4248,4271,4497,4536,4639,4740,4807,4814,4823,4860,4879,4880,4966,5331,5457,5634,5642,5676,5734,5936,5937,5955,5972,5973,5982,6011,6024,6059,6555,6571,6597,6608,6625,6755,6783,7216,7259,7434,8094,8246,8325,8408,8456,8519,8527,9009,9015,9024,9280,9587,9634,9664,9669,9679,9692,9729,9745,9768,9770,9792,9808,9839,9858,9944],"errors":160},"selected_test":{"loss":0.06685361328125,"accuracy":0.9843,"n":10000,"wrong_indices":[247,259,340,381,445,449,582,646,659,720,938,947,1014,1039,1112,1156,1226,1232,1242,1247,1260,1319,1328,1393,1395,1414,1494,1522,1530,1549,1609,1681,1754,1828,1901,1941,1982,1984,1987,2004,2024,2035,2044,2098,2109,2118,2130,2135,2272,2293,2369,2387,2408,2422,2488,2597,2607,2648,2654,2896,2921,2927,2939,2953,3073,3117,3225,3422,3503,3520,3558,3597,3727,3776,3780,3808,3818,3893,3906,3941,3976,3985,4065,4075,4078,4176,4199,4201,4248,4271,4289,4497,4536,4578,4639,4671,4740,4761,4807,4814,4823,4860,4880,4966,5331,5457,5642,5676,5734,5936,5937,5955,5973,6011,6045,6059,6532,6555,6559,6571,6572,6597,6608,6621,6625,6651,6755,6783,7216,7259,7434,8094,8246,8325,8408,8456,8519,8527,9009,9015,9024,9280,9587,9634,9664,9669,9679,9692,9729,9745,9768,9770,9792,9808,9839,9858,9944],"errors":157}},{"run_id":"graph-eval-residual-s102","spec":{"run_id":"graph-eval-residual-s102","stage":"evaluate","cohort":"main","recipe":"residual","pmax":0.0,"input_scale":0.00392156862745098,"output_relu":false,"lr":0.01,"shrinkage":0.0,"seed":102,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"timeout_seconds":180,"gpu":"A100","precision":"fp32"},"history":[{"epoch":1,"stochastic_training_loss":0.29650989174842834,"dense_train_probe":{"loss":0.1111904052734375,"accuracy":0.9658,"n":10000},"validation":{"loss":0.131219677734375,"accuracy":0.9613,"n":10000},"training_seconds":0.714433519,"epoch_training_seconds":0.714433519,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[219,210,216,184,215,215,195,179,205,210]},{"epoch":5,"stochastic_training_loss":0.026141608133912086,"dense_train_probe":{"loss":0.022509915161132814,"accuracy":0.9926,"n":10000},"validation":{"loss":0.0871175048828125,"accuracy":0.976,"n":10000},"training_seconds":3.378569396999998,"epoch_training_seconds":0.6659055509999998,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[216,205,223,184,221,206,197,178,225,193]},{"epoch":10,"stochastic_training_loss":0.0013442746130749583,"dense_train_probe":{"loss":0.0010311304092407226,"accuracy":0.9999,"n":10000},"validation":{"loss":0.086232080078125,"accuracy":0.9813,"n":10000},"training_seconds":6.709153070999998,"epoch_training_seconds":0.6659261099999991,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,210,220,179,221,204,192,186,221,194]},{"epoch":15,"stochastic_training_loss":0.00010047519026556984,"dense_train_probe":{"loss":9.103205800056458e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.089098876953125,"accuracy":0.9828,"n":10000},"training_seconds":10.040048021999997,"epoch_training_seconds":0.6659209019999999,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,220,179,215,207,192,187,220,198]},{"epoch":20,"stochastic_training_loss":5.970794154563919e-05,"dense_train_probe":{"loss":5.5880576372146605e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.09420256958007812,"accuracy":0.983,"n":10000},"training_seconds":13.370342716999993,"epoch_training_seconds":0.6658818510000017,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,180,215,206,192,187,221,198]},{"epoch":25,"stochastic_training_loss":4.2709940316854045e-05,"dense_train_probe":{"loss":4.0630877017974854e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.09763074951171875,"accuracy":0.9829,"n":10000},"training_seconds":16.700398642999996,"epoch_training_seconds":0.665914260000001,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,180,215,206,192,187,221,198]},{"epoch":30,"stochastic_training_loss":3.326795558677986e-05,"dense_train_probe":{"loss":3.1758278608322146e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.09985843505859375,"accuracy":0.9829,"n":10000},"training_seconds":20.030770177999997,"epoch_training_seconds":0.6659907820000015,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,180,215,206,192,187,221,198]},{"epoch":35,"stochastic_training_loss":2.7225352823734283e-05,"dense_train_probe":{"loss":2.648061513900757e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.10189639282226562,"accuracy":0.983,"n":10000},"training_seconds":23.360917115000003,"epoch_training_seconds":0.6660081210000008,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,180,215,206,192,187,221,198]},{"epoch":40,"stochastic_training_loss":2.3076801880961284e-05,"dense_train_probe":{"loss":2.2312477231025696e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.10360537109375,"accuracy":0.983,"n":10000},"training_seconds":26.690882053000003,"epoch_training_seconds":0.6659134800000004,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,181,215,205,192,187,221,198]},{"epoch":45,"stochastic_training_loss":1.9946583051932976e-05,"dense_train_probe":{"loss":1.9344250857830046e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.10494884033203125,"accuracy":0.9829,"n":10000},"training_seconds":30.02094728,"epoch_training_seconds":0.6659215120000042,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,181,215,205,192,187,221,198]},{"epoch":50,"stochastic_training_loss":1.758096186676994e-05,"dense_train_probe":{"loss":1.702602803707123e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.1064130859375,"accuracy":0.983,"n":10000},"training_seconds":33.350841689,"epoch_training_seconds":0.6658543809999955,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,181,215,205,192,187,221,198]},{"epoch":55,"stochastic_training_loss":1.5666413673898205e-05,"dense_train_probe":{"loss":1.5256142616271973e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.10726204833984375,"accuracy":0.983,"n":10000},"training_seconds":36.680555761,"epoch_training_seconds":0.6658748320000001,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,181,215,205,192,187,221,198]},{"epoch":60,"stochastic_training_loss":1.416557643096894e-05,"dense_train_probe":{"loss":1.3778163492679595e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.10841630859375,"accuracy":0.9829,"n":10000},"training_seconds":40.010955868,"epoch_training_seconds":0.6660094630000017,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,181,215,205,192,187,221,198]},{"epoch":65,"stochastic_training_loss":1.2889991012343671e-05,"dense_train_probe":{"loss":1.2527239322662354e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.1094739501953125,"accuracy":0.9829,"n":10000},"training_seconds":43.341461636000005,"epoch_training_seconds":0.6660743039999986,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,181,215,205,192,187,221,198]},{"epoch":70,"stochastic_training_loss":1.1826562513306271e-05,"dense_train_probe":{"loss":1.1528758704662324e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.11029244384765625,"accuracy":0.9831,"n":10000},"training_seconds":46.672013739,"epoch_training_seconds":0.6660075659999976,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,181,215,205,192,187,221,198]},{"epoch":75,"stochastic_training_loss":1.0923584341071546e-05,"dense_train_probe":{"loss":1.06255441904068e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.11111107177734375,"accuracy":0.9831,"n":10000},"training_seconds":50.002406255000004,"epoch_training_seconds":0.6660414420000009,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,181,215,205,192,187,221,198]},{"epoch":80,"stochastic_training_loss":1.0144550287805032e-05,"dense_train_probe":{"loss":9.880374372005463e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.11171298828125,"accuracy":0.983,"n":10000},"training_seconds":53.332320847999995,"epoch_training_seconds":0.6658927109999979,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,181,215,205,192,187,221,198]},{"epoch":85,"stochastic_training_loss":9.456258339923806e-06,"dense_train_probe":{"loss":9.223413467407227e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1124836669921875,"accuracy":0.9831,"n":10000},"training_seconds":56.662125421999995,"epoch_training_seconds":0.6659275159999964,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,181,215,205,192,187,221,198]},{"epoch":90,"stochastic_training_loss":8.855929991113953e-06,"dense_train_probe":{"loss":8.634325861930847e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1130916259765625,"accuracy":0.983,"n":10000},"training_seconds":59.99192913799998,"epoch_training_seconds":0.66594006199999,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,181,215,205,192,187,221,198]},{"epoch":95,"stochastic_training_loss":8.331656317750458e-06,"dense_train_probe":{"loss":8.127444982528686e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.113713427734375,"accuracy":0.983,"n":10000},"training_seconds":63.32167134099999,"epoch_training_seconds":0.6658770629999964,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,181,215,205,192,187,221,198]},{"epoch":100,"stochastic_training_loss":7.856979209464043e-06,"dense_train_probe":{"loss":7.656004279851914e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1143310546875,"accuracy":0.983,"n":10000},"training_seconds":66.65198389999996,"epoch_training_seconds":0.6663499969999975,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,181,215,205,192,187,221,198]}],"best_epoch":10,"best_validation_loss":0.086232080078125,"training_seconds":66.65198389999996,"total_run_seconds":69.40373477499999,"hardware":{"device":"cuda:0","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"4d0ac269167486811a0086108ca56313016afcebfc075d45e09455c228dee75b","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[0,0,0,0],"final_train":{"loss":7.733514308929443e-06,"accuracy":1.0,"n":50000},"selected_train":{"loss":0.0013115446472167969,"accuracy":0.99974,"n":50000},"final_test":{"loss":0.10281859130859375,"accuracy":0.984,"n":10000,"wrong_indices":[247,259,321,340,381,445,449,495,582,646,659,684,691,720,883,938,947,951,965,1014,1039,1112,1156,1178,1192,1224,1226,1242,1247,1299,1319,1393,1395,1444,1522,1530,1549,1569,1609,1681,1717,1901,1941,1984,2016,2024,2035,2044,2053,2070,2098,2109,2130,2135,2182,2293,2369,2387,2405,2408,2414,2426,2488,2597,2607,2648,2654,2877,2896,2921,2939,2953,3073,3114,3117,3289,3422,3503,3520,3533,3558,3597,3727,3776,3780,3808,3818,3838,3853,3893,3906,3941,3976,3985,4065,4075,4078,4163,4176,4199,4201,4248,4289,4437,4497,4536,4731,4740,4807,4814,4823,4860,4880,4956,4966,5331,5457,5642,5676,5734,5757,5936,5937,5955,5973,6011,6045,6059,6555,6571,6597,6608,6625,6651,6755,6783,6847,7216,7434,8094,8246,8325,8408,8456,8527,9009,9015,9024,9280,9587,9634,9664,9679,9729,9745,9770,9792,9808,9839,9944],"errors":160},"selected_test":{"loss":0.08115352172851563,"accuracy":0.983,"n":10000,"wrong_indices":[247,259,321,340,381,445,449,582,646,659,684,691,720,883,947,951,1014,1039,1112,1156,1182,1192,1224,1226,1232,1242,1247,1260,1299,1319,1328,1393,1395,1444,1500,1522,1530,1549,1569,1609,1681,1709,1901,1941,1982,2016,2024,2033,2035,2044,2070,2098,2109,2118,2130,2135,2182,2185,2224,2293,2369,2387,2405,2408,2414,2422,2426,2488,2597,2607,2648,2654,2713,2720,2743,2810,2863,2877,2921,2939,2953,3030,3073,3114,3117,3422,3503,3520,3558,3597,3727,3776,3780,3808,3818,3838,3853,3869,3893,3906,3941,3968,3976,3985,4027,4065,4078,4176,4199,4248,4259,4289,4425,4437,4497,4500,4536,4601,4731,4740,4807,4814,4823,4880,4956,4966,5331,5457,5642,5676,5734,5937,5955,5973,6011,6045,6059,6555,6571,6576,6597,6625,6651,6755,6783,6817,6847,7216,7434,8094,8246,8325,8408,8527,9009,9015,9024,9280,9587,9634,9664,9679,9729,9745,9770,9792,9808,9839,9944,9975],"errors":170}},{"run_id":"graph-eval-residual-s103","spec":{"run_id":"graph-eval-residual-s103","stage":"evaluate","cohort":"main","recipe":"residual","pmax":0.0,"input_scale":0.00392156862745098,"output_relu":false,"lr":0.01,"shrinkage":0.0,"seed":103,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"timeout_seconds":180,"gpu":"A100","precision":"fp32"},"history":[{"epoch":1,"stochastic_training_loss":0.2959757149219513,"dense_train_probe":{"loss":0.1131392333984375,"accuracy":0.9661,"n":10000},"validation":{"loss":0.14022728271484375,"accuracy":0.9574,"n":10000},"training_seconds":0.7186917950000007,"epoch_training_seconds":0.7186917950000007,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[223,210,220,173,222,222,190,199,210,179]},{"epoch":5,"stochastic_training_loss":0.0267766322940588,"dense_train_probe":{"loss":0.02074333953857422,"accuracy":0.9933,"n":10000},"validation":{"loss":0.09462907104492188,"accuracy":0.9737,"n":10000},"training_seconds":3.356926261,"epoch_training_seconds":0.6595695250000002,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[217,208,222,195,220,206,194,187,209,190]},{"epoch":10,"stochastic_training_loss":0.0034319129772484303,"dense_train_probe":{"loss":0.0009086164474487305,"accuracy":0.9998,"n":10000},"validation":{"loss":0.08150302734375,"accuracy":0.9818,"n":10000},"training_seconds":6.654841128000001,"epoch_training_seconds":0.6593093999999997,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,209,220,178,214,209,192,189,218,199]},{"epoch":15,"stochastic_training_loss":9.894140384858474e-05,"dense_train_probe":{"loss":9.182301759719848e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.09081783447265625,"accuracy":0.9835,"n":10000},"training_seconds":9.962172164,"epoch_training_seconds":0.6592908079999997,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,181,216,207,192,187,220,196]},{"epoch":20,"stochastic_training_loss":5.770545976702124e-05,"dense_train_probe":{"loss":5.670015811920166e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.09611214599609375,"accuracy":0.9833,"n":10000},"training_seconds":13.258981707999999,"epoch_training_seconds":0.6591713850000005,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,181,215,207,192,187,220,197]},{"epoch":25,"stochastic_training_loss":4.113374961889349e-05,"dense_train_probe":{"loss":4.1705626249313354e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.09921038208007812,"accuracy":0.9833,"n":10000},"training_seconds":16.567672052,"epoch_training_seconds":0.6710654010000034,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,180,215,208,192,187,220,197]},{"epoch":30,"stochastic_training_loss":3.212321098544635e-05,"dense_train_probe":{"loss":3.284826874732971e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.10162777099609376,"accuracy":0.9831,"n":10000},"training_seconds":19.876619588999997,"epoch_training_seconds":0.6593014120000014,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,180,216,208,192,187,220,196]},{"epoch":35,"stochastic_training_loss":2.6249483198625967e-05,"dense_train_probe":{"loss":2.720460295677185e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.10369775390625,"accuracy":0.9831,"n":10000},"training_seconds":23.184944456999997,"epoch_training_seconds":0.6593329590000003,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,180,215,208,192,187,220,197]},{"epoch":40,"stochastic_training_loss":2.2274512957665138e-05,"dense_train_probe":{"loss":2.307799756526947e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.10529796142578125,"accuracy":0.983,"n":10000},"training_seconds":26.501315005000002,"epoch_training_seconds":0.6712754059999995,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,180,215,208,192,187,220,197]},{"epoch":45,"stochastic_training_loss":1.930139296746347e-05,"dense_train_probe":{"loss":1.9997167587280274e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.1067673095703125,"accuracy":0.9829,"n":10000},"training_seconds":29.798924815,"epoch_training_seconds":0.6593800329999979,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,180,215,208,192,187,220,197]},{"epoch":50,"stochastic_training_loss":1.7013888282235712e-05,"dense_train_probe":{"loss":1.76820307970047e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.10800833740234375,"accuracy":0.9828,"n":10000},"training_seconds":33.09821268899999,"epoch_training_seconds":0.659150455999999,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,180,215,208,192,187,220,197]},{"epoch":55,"stochastic_training_loss":1.5235137652780395e-05,"dense_train_probe":{"loss":1.5898972749710083e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.10908076171875,"accuracy":0.9828,"n":10000},"training_seconds":36.405772129000006,"epoch_training_seconds":0.6697720370000013,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,180,216,208,192,186,220,197]},{"epoch":60,"stochastic_training_loss":1.3770079931418877e-05,"dense_train_probe":{"loss":1.4397048950195312e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.11014527587890625,"accuracy":0.9828,"n":10000},"training_seconds":39.703958844000006,"epoch_training_seconds":0.6593248860000003,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,180,216,208,192,186,220,197]},{"epoch":65,"stochastic_training_loss":1.2532163054856937e-05,"dense_train_probe":{"loss":1.31291463971138e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.11111722412109375,"accuracy":0.9826,"n":10000},"training_seconds":43.0029224,"epoch_training_seconds":0.659227309000002,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,180,216,208,192,186,220,197]},{"epoch":70,"stochastic_training_loss":1.1513010576891247e-05,"dense_train_probe":{"loss":1.2081803381443024e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.11205709228515626,"accuracy":0.9825,"n":10000},"training_seconds":46.30031077500001,"epoch_training_seconds":0.6593016469999995,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,180,216,208,192,186,220,197]},{"epoch":75,"stochastic_training_loss":1.0634374120854773e-05,"dense_train_probe":{"loss":1.1170071363449097e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.11288509521484374,"accuracy":0.9826,"n":10000},"training_seconds":49.599114428000014,"epoch_training_seconds":0.6593900889999986,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,180,216,208,192,186,220,197]},{"epoch":80,"stochastic_training_loss":9.881499863695353e-06,"dense_train_probe":{"loss":1.0376796871423721e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.113612939453125,"accuracy":0.9826,"n":10000},"training_seconds":52.89668210300001,"epoch_training_seconds":0.659458880999999,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,180,216,208,192,186,220,197]},{"epoch":85,"stochastic_training_loss":9.232352567778435e-06,"dense_train_probe":{"loss":9.689617902040481e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.11430655517578125,"accuracy":0.9827,"n":10000},"training_seconds":56.19410613200002,"epoch_training_seconds":0.6594093960000009,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,180,216,208,192,186,220,197]},{"epoch":90,"stochastic_training_loss":8.651576536067296e-06,"dense_train_probe":{"loss":9.09423679113388e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.114949169921875,"accuracy":0.9826,"n":10000},"training_seconds":59.49150897800001,"epoch_training_seconds":0.6594431540000016,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,180,216,208,192,186,220,197]},{"epoch":95,"stochastic_training_loss":8.126812645059545e-06,"dense_train_probe":{"loss":8.5531085729599e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.11571029052734375,"accuracy":0.9826,"n":10000},"training_seconds":62.789216938999985,"epoch_training_seconds":0.6595544629999921,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,180,216,208,192,186,220,197]},{"epoch":100,"stochastic_training_loss":7.685952368774451e-06,"dense_train_probe":{"loss":8.095967769622803e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1161923583984375,"accuracy":0.9826,"n":10000},"training_seconds":66.08704199600002,"epoch_training_seconds":0.6597901450000023,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,180,216,208,192,186,220,197]}],"best_epoch":10,"best_validation_loss":0.08150302734375,"training_seconds":66.08704199600002,"total_run_seconds":68.436189201,"hardware":{"device":"cuda:0","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"316aa46c9e0a65fa375b579be0871a16f447d396fe64f85e2063ee6ef8c8dd5d","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[0,0,0,0],"final_train":{"loss":7.571223378181458e-06,"accuracy":1.0,"n":50000},"selected_train":{"loss":0.0009604203796386719,"accuracy":0.99988,"n":50000},"final_test":{"loss":0.09727741088867188,"accuracy":0.984,"n":10000,"wrong_indices":[115,151,247,259,321,340,381,445,447,449,582,646,659,720,938,947,951,956,1014,1039,1112,1156,1192,1226,1232,1242,1247,1319,1328,1393,1395,1444,1522,1530,1549,1569,1681,1754,1790,1901,1941,1984,1987,2004,2035,2053,2070,2098,2109,2118,2130,2135,2182,2272,2293,2369,2387,2405,2414,2426,2488,2597,2607,2635,2648,2654,2720,2743,2877,2896,2921,2939,2953,2979,3030,3073,3117,3189,3225,3422,3503,3520,3533,3558,3597,3727,3780,3808,3853,3893,3906,3941,3943,3976,3985,4065,4075,4078,4140,4163,4176,4199,4201,4248,4271,4289,4497,4536,4740,4807,4814,4823,4860,4880,4966,5331,5457,5642,5676,5936,5937,5955,5972,5973,5982,6011,6045,6059,6555,6576,6597,6651,6755,6783,7216,7434,8094,8246,8325,8408,8527,9009,9015,9024,9280,9587,9634,9664,9669,9679,9729,9742,9745,9768,9770,9792,9808,9839,9858,9944],"errors":160},"selected_test":{"loss":0.0732955322265625,"accuracy":0.9839,"n":10000,"wrong_indices":[115,247,259,321,340,381,445,449,582,659,720,844,947,951,956,1014,1039,1112,1156,1226,1232,1242,1247,1319,1328,1393,1522,1530,1549,1626,1681,1717,1754,1790,1828,1901,1941,1984,2004,2035,2053,2098,2109,2130,2135,2148,2182,2185,2224,2272,2293,2369,2387,2405,2408,2414,2426,2488,2597,2607,2635,2648,2654,2720,2743,2877,2896,2921,2927,2939,2953,2979,3030,3073,3117,3172,3225,3388,3405,3422,3503,3520,3533,3549,3558,3727,3780,3808,3853,3893,3906,3941,3976,3985,4065,4075,4078,4140,4176,4201,4248,4271,4317,4350,4497,4536,4639,4761,4807,4823,4860,4879,4880,4966,4990,5331,5457,5642,5676,5734,5936,5937,5955,5972,5973,5982,6011,6045,6059,6555,6576,6597,6621,6651,6755,6783,6945,7216,7434,8094,8246,8325,8408,8527,9009,9015,9019,9024,9280,9587,9634,9664,9669,9679,9729,9742,9745,9768,9770,9792,9944],"errors":161}},{"run_id":"graph-eval-sd_constant-s101","spec":{"run_id":"graph-eval-sd_constant-s101","stage":"evaluate","cohort":"main","recipe":"sd_constant","pmax":0.4,"input_scale":0.00392156862745098,"output_relu":false,"lr":0.01,"shrinkage":0.0,"seed":101,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"timeout_seconds":180,"gpu":"A100","precision":"fp32"},"history":[{"epoch":1,"stochastic_training_loss":0.36740195751190186,"dense_train_probe":{"loss":0.1350373291015625,"accuracy":0.9586,"n":10000},"validation":{"loss":0.152347216796875,"accuracy":0.9559,"n":10000},"training_seconds":0.5798752649999983,"epoch_training_seconds":0.5798752649999983,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[223,213,208,182,222,204,194,186,211,205]},{"epoch":5,"stochastic_training_loss":0.05210796371102333,"dense_train_probe":{"loss":0.030873800659179686,"accuracy":0.9903,"n":10000},"validation":{"loss":0.08439702758789062,"accuracy":0.9763,"n":10000},"training_seconds":2.846230949999992,"epoch_training_seconds":0.5637058970000055,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[218,209,225,179,215,200,197,186,221,198]},{"epoch":10,"stochastic_training_loss":0.0228594858199358,"dense_train_probe":{"loss":0.011969097900390625,"accuracy":0.9967,"n":10000},"validation":{"loss":0.09212659301757813,"accuracy":0.9779,"n":10000},"training_seconds":5.726416931999992,"epoch_training_seconds":0.5706167689999972,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,213,223,181,213,199,195,188,217,199]},{"epoch":15,"stochastic_training_loss":0.009860983118414879,"dense_train_probe":{"loss":0.0029598888397216797,"accuracy":0.9991,"n":10000},"validation":{"loss":0.098627783203125,"accuracy":0.9812,"n":10000},"training_seconds":8.56321889500002,"epoch_training_seconds":0.5635038100000003,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,212,227,177,215,208,196,180,215,198]},{"epoch":20,"stochastic_training_loss":0.0030472681391984224,"dense_train_probe":{"loss":0.00011181420087814331,"accuracy":1.0,"n":10000},"validation":{"loss":0.09866104736328125,"accuracy":0.9833,"n":10000},"training_seconds":11.401570027000034,"epoch_training_seconds":0.5645283239999941,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[219,210,221,181,213,202,195,185,223,199]},{"epoch":25,"stochastic_training_loss":0.009132780134677887,"dense_train_probe":{"loss":0.04501445922851562,"accuracy":0.99,"n":10000},"validation":{"loss":0.21905400390625,"accuracy":0.9669,"n":10000},"training_seconds":14.23958450400005,"epoch_training_seconds":0.5658170310000088,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,204,237,183,219,200,189,177,225,192]},{"epoch":30,"stochastic_training_loss":0.0025622346438467503,"dense_train_probe":{"loss":9.186972975730895e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.1081595458984375,"accuracy":0.9829,"n":10000},"training_seconds":17.082011734000048,"epoch_training_seconds":0.5683631929999962,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,210,221,183,215,202,194,187,220,195]},{"epoch":35,"stochastic_training_loss":0.0024627854581922293,"dense_train_probe":{"loss":0.00028608469963073733,"accuracy":0.9999,"n":10000},"validation":{"loss":0.121559912109375,"accuracy":0.9822,"n":10000},"training_seconds":19.92616700300006,"epoch_training_seconds":0.571830282999997,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,212,221,180,216,204,195,187,218,195]},{"epoch":40,"stochastic_training_loss":0.0007165924762375653,"dense_train_probe":{"loss":1.1709295213222504e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.1271603515625,"accuracy":0.9822,"n":10000},"training_seconds":22.77158445200007,"epoch_training_seconds":0.573874998000008,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,211,222,180,215,205,194,185,221,195]},{"epoch":45,"stochastic_training_loss":0.001408236799761653,"dense_train_probe":{"loss":6.694512069225311e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.13621640625,"accuracy":0.9823,"n":10000},"training_seconds":25.583846975000043,"epoch_training_seconds":0.5674063679999932,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,212,220,181,215,204,194,188,218,195]},{"epoch":50,"stochastic_training_loss":0.0012183822691440582,"dense_train_probe":{"loss":2.1569395437836647e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1410757568359375,"accuracy":0.9828,"n":10000},"training_seconds":28.419360476000037,"epoch_training_seconds":0.5686158409999962,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,213,222,181,216,203,194,188,218,193]},{"epoch":55,"stochastic_training_loss":0.0009502427419647574,"dense_train_probe":{"loss":1.9010290503501893e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.145492529296875,"accuracy":0.9823,"n":10000},"training_seconds":31.257479739000033,"epoch_training_seconds":0.561786687999998,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,212,224,179,215,204,194,184,221,195]},{"epoch":60,"stochastic_training_loss":0.0008391274604946375,"dense_train_probe":{"loss":1.8725097179412843e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.14672978515625,"accuracy":0.983,"n":10000},"training_seconds":34.10393218800003,"epoch_training_seconds":0.5664793490000051,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,222,180,215,204,194,184,221,196]},{"epoch":65,"stochastic_training_loss":0.022643141448497772,"dense_train_probe":{"loss":0.015005583190917968,"accuracy":0.9952,"n":10000},"validation":{"loss":0.135663525390625,"accuracy":0.9766,"n":10000},"training_seconds":36.94004160600004,"epoch_training_seconds":0.5716328370000099,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[218,211,220,192,213,201,195,184,220,194]},{"epoch":70,"stochastic_training_loss":0.0012777354568243027,"dense_train_probe":{"loss":2.1644929051399233e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.10974774169921875,"accuracy":0.9847,"n":10000},"training_seconds":39.773524217000045,"epoch_training_seconds":0.5627481589999945,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,220,181,215,205,193,186,220,198]},{"epoch":75,"stochastic_training_loss":0.0006936741410754621,"dense_train_probe":{"loss":7.732153683900832e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.12353485107421874,"accuracy":0.9842,"n":10000},"training_seconds":42.60740009000003,"epoch_training_seconds":0.5689260939999912,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,210,221,183,216,204,193,185,219,196]},{"epoch":80,"stochastic_training_loss":0.0005527118337340653,"dense_train_probe":{"loss":4.1857261210680004e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1271656494140625,"accuracy":0.9841,"n":10000},"training_seconds":45.439710367000046,"epoch_training_seconds":0.5706533480000076,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,221,183,215,204,193,185,218,197]},{"epoch":85,"stochastic_training_loss":0.005342571530491114,"dense_train_probe":{"loss":0.006676605987548828,"accuracy":0.9984,"n":10000},"validation":{"loss":0.116986376953125,"accuracy":0.9813,"n":10000},"training_seconds":48.27458877000004,"epoch_training_seconds":0.5739181690000095,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,208,219,185,216,207,190,189,218,194]},{"epoch":90,"stochastic_training_loss":0.0006204501842148602,"dense_train_probe":{"loss":1.1788208782672882e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.11176693115234375,"accuracy":0.9844,"n":10000},"training_seconds":51.10918404600004,"epoch_training_seconds":0.5665383440000085,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,209,221,182,215,205,193,184,220,197]},{"epoch":95,"stochastic_training_loss":0.0005832117749378085,"dense_train_probe":{"loss":4.912671446800232e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.11857392578125,"accuracy":0.9852,"n":10000},"training_seconds":53.950811499000054,"epoch_training_seconds":0.5708118659999855,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,213,222,181,215,205,193,185,215,197]},{"epoch":100,"stochastic_training_loss":0.0006054788245819509,"dense_train_probe":{"loss":2.94302012771368e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.129225,"accuracy":0.9848,"n":10000},"training_seconds":56.78209531600007,"epoch_training_seconds":0.5691145230000245,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,209,222,182,213,204,193,185,220,198]}],"best_epoch":5,"best_validation_loss":0.08439702758789062,"training_seconds":56.78209531600007,"total_run_seconds":58.152022927999994,"hardware":{"device":"cuda:0","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"e1efb33081a653eb2db13a44aa7d20f3f16925ea1dc8bc2e91ed2f639a3974ae","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[7719,15527,23589,31320],"final_train":{"loss":2.671930193901062e-06,"accuracy":1.0,"n":50000},"selected_train":{"loss":0.02965966796875,"accuracy":0.99028,"n":50000},"final_test":{"loss":0.1167528076171875,"accuracy":0.9847,"n":10000,"wrong_indices":[115,247,259,340,381,445,449,495,582,646,659,720,844,883,947,951,1014,1039,1044,1112,1156,1192,1224,1226,1242,1247,1319,1328,1393,1395,1494,1522,1527,1530,1549,1681,1717,1878,1901,1941,1987,2004,2024,2035,2044,2053,2070,2098,2109,2118,2130,2135,2182,2272,2387,2408,2414,2422,2426,2488,2597,2607,2648,2654,2720,2877,2896,2921,2927,2939,2953,3030,3117,3225,3405,3422,3503,3520,3533,3558,3727,3780,3808,3893,3906,3941,3976,3985,4065,4078,4163,4176,4201,4248,4289,4306,4497,4536,4601,4639,4761,4807,4814,4823,4860,4880,5331,5457,5642,5734,5936,5937,5955,5972,5973,5982,6011,6023,6024,6059,6166,6555,6558,6571,6572,6597,6625,6755,6783,6817,7216,7259,7434,8094,8246,8325,8408,8456,8527,9009,9015,9024,9587,9634,9664,9669,9679,9729,9742,9745,9770,9839,9858],"errors":153},"selected_test":{"loss":0.0757639404296875,"accuracy":0.9776,"n":10000,"wrong_indices":[8,247,321,340,358,381,445,449,490,495,582,619,646,659,694,707,717,720,740,795,844,938,947,951,956,965,1014,1032,1039,1044,1112,1128,1156,1178,1182,1192,1226,1232,1242,1247,1253,1260,1289,1299,1319,1328,1378,1393,1500,1522,1527,1530,1549,1609,1621,1681,1717,1754,1761,1790,1901,1911,1940,1941,2024,2029,2035,2043,2044,2053,2070,2073,2109,2118,2125,2129,2135,2182,2224,2266,2272,2293,2369,2387,2408,2414,2488,2573,2597,2607,2648,2654,2713,2720,2743,2810,2863,2877,2896,2921,2927,2939,2953,3073,3114,3117,3189,3225,3369,3405,3503,3520,3549,3558,3597,3767,3776,3780,3808,3818,3838,3850,3853,3869,3893,3906,3941,3976,3985,4027,4065,4075,4078,4093,4176,4199,4248,4259,4289,4306,4360,4369,4374,4400,4425,4435,4437,4443,4477,4497,4536,4551,4575,4578,4601,4635,4731,4751,4761,4807,4823,4880,4956,4966,4990,5331,5409,5457,5600,5642,5654,5676,5734,5936,5937,5955,5973,6045,6046,6059,6166,6390,6555,6571,6576,6597,6651,6755,6783,6817,7216,7268,7434,7451,7921,8020,8062,8094,8325,8339,8408,8410,8502,8522,8863,9009,9015,9024,9280,9513,9587,9634,9664,9679,9692,9729,9733,9745,9770,9777,9808,9839,9888,9944],"errors":224}},{"run_id":"graph-eval-sd_constant-s102","spec":{"run_id":"graph-eval-sd_constant-s102","stage":"evaluate","cohort":"main","recipe":"sd_constant","pmax":0.4,"input_scale":0.00392156862745098,"output_relu":false,"lr":0.01,"shrinkage":0.0,"seed":102,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"timeout_seconds":180,"gpu":"A100","precision":"fp32"},"history":[{"epoch":1,"stochastic_training_loss":0.3607751429080963,"dense_train_probe":{"loss":0.13471611328125,"accuracy":0.9594,"n":10000},"validation":{"loss":0.151883056640625,"accuracy":0.955,"n":10000},"training_seconds":0.5917628380000082,"epoch_training_seconds":0.5917628380000082,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[219,211,215,179,223,222,195,184,203,197]},{"epoch":5,"stochastic_training_loss":0.050449542701244354,"dense_train_probe":{"loss":0.03068314208984375,"accuracy":0.9908,"n":10000},"validation":{"loss":0.08423145141601562,"accuracy":0.9744,"n":10000},"training_seconds":2.865269929000007,"epoch_training_seconds":0.5673058750000024,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,205,229,178,214,211,191,180,217,202]},{"epoch":10,"stochastic_training_loss":0.020846037194132805,"dense_train_probe":{"loss":0.0058496265411376955,"accuracy":0.998,"n":10000},"validation":{"loss":0.08735496826171875,"accuracy":0.9793,"n":10000},"training_seconds":5.7102477619999945,"epoch_training_seconds":0.5683288639999944,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,222,178,218,207,192,188,219,194]},{"epoch":15,"stochastic_training_loss":0.018031766638159752,"dense_train_probe":{"loss":0.00460088882446289,"accuracy":0.9983,"n":10000},"validation":{"loss":0.09046175537109374,"accuracy":0.9809,"n":10000},"training_seconds":8.546816665999998,"epoch_training_seconds":0.5675586440000018,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,209,217,180,217,207,191,188,219,198]},{"epoch":20,"stochastic_training_loss":0.004967667628079653,"dense_train_probe":{"loss":0.00036339800357818605,"accuracy":0.9999,"n":10000},"validation":{"loss":0.09697706298828125,"accuracy":0.9832,"n":10000},"training_seconds":11.389498874000012,"epoch_training_seconds":0.5699275740000047,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,208,223,185,216,205,192,183,220,196]},{"epoch":25,"stochastic_training_loss":0.010969425551593304,"dense_train_probe":{"loss":0.0026507747650146483,"accuracy":0.9993,"n":10000},"validation":{"loss":0.10206529541015626,"accuracy":0.9811,"n":10000},"training_seconds":14.226243664999984,"epoch_training_seconds":0.5651424009999886,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[218,212,224,180,217,207,196,181,217,196]},{"epoch":30,"stochastic_training_loss":0.0022368733771145344,"dense_train_probe":{"loss":5.976975560188293e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.1051555908203125,"accuracy":0.9838,"n":10000},"training_seconds":17.05020206600001,"epoch_training_seconds":0.564883437000006,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,210,220,181,216,206,192,187,220,196]},{"epoch":35,"stochastic_training_loss":0.0010892202844843268,"dense_train_probe":{"loss":0.00022279160022735595,"accuracy":0.9999,"n":10000},"validation":{"loss":0.1152578125,"accuracy":0.9831,"n":10000},"training_seconds":19.881580441000025,"epoch_training_seconds":0.5717348030000124,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,210,219,183,216,206,192,187,217,196]},{"epoch":40,"stochastic_training_loss":0.0061340113170444965,"dense_train_probe":{"loss":0.0028800779342651366,"accuracy":0.9989,"n":10000},"validation":{"loss":0.108834375,"accuracy":0.9807,"n":10000},"training_seconds":22.71201150900002,"epoch_training_seconds":0.5660605820000058,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,206,221,176,208,209,193,185,224,205]},{"epoch":45,"stochastic_training_loss":0.0010812408290803432,"dense_train_probe":{"loss":1.8269121646881103e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.11756768798828125,"accuracy":0.9838,"n":10000},"training_seconds":25.53143447500001,"epoch_training_seconds":0.5663572469999991,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,210,222,185,216,207,192,184,215,195]},{"epoch":50,"stochastic_training_loss":0.000982358935289085,"dense_train_probe":{"loss":4.9785066395998e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1239960693359375,"accuracy":0.984,"n":10000},"training_seconds":28.36072411400002,"epoch_training_seconds":0.5648388400000073,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,210,221,183,216,207,192,184,218,196]},{"epoch":55,"stochastic_training_loss":0.0011105084558948874,"dense_train_probe":{"loss":5.650562047958374e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1385870361328125,"accuracy":0.9836,"n":10000},"training_seconds":31.19821842600001,"epoch_training_seconds":0.5644736899999998,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,210,221,186,215,207,192,184,215,196]},{"epoch":60,"stochastic_training_loss":0.0009896797128021717,"dense_train_probe":{"loss":4.0105390548706056e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.150750341796875,"accuracy":0.9826,"n":10000},"training_seconds":34.03437827200001,"epoch_training_seconds":0.5688122980000117,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,211,220,180,216,207,192,187,219,194]},{"epoch":65,"stochastic_training_loss":0.0008718138560652733,"dense_train_probe":{"loss":3.240864723920822e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.145888623046875,"accuracy":0.9842,"n":10000},"training_seconds":36.86678286500002,"epoch_training_seconds":0.5678611030000127,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,211,220,183,215,206,192,187,216,196]},{"epoch":70,"stochastic_training_loss":0.0006162302452139556,"dense_train_probe":{"loss":1.4599068090319634e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1473818115234375,"accuracy":0.984,"n":10000},"training_seconds":39.70391615800003,"epoch_training_seconds":0.5685093299999977,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,208,221,183,216,207,192,187,217,196]},{"epoch":75,"stochastic_training_loss":0.0005582299781963229,"dense_train_probe":{"loss":4.905180539935827e-07,"accuracy":1.0,"n":10000},"validation":{"loss":0.14938233642578125,"accuracy":0.9841,"n":10000},"training_seconds":42.521094373000025,"epoch_training_seconds":0.5646153210000051,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,208,221,182,216,206,192,187,220,196]},{"epoch":80,"stochastic_training_loss":0.0006880551227368414,"dense_train_probe":{"loss":9.785939939320087e-07,"accuracy":1.0,"n":10000},"validation":{"loss":0.15416173095703126,"accuracy":0.9847,"n":10000},"training_seconds":45.35255022800003,"epoch_training_seconds":0.5675463879999967,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,210,223,182,216,206,192,185,218,196]},{"epoch":85,"stochastic_training_loss":0.0006147531094029546,"dense_train_probe":{"loss":4.2552114464342596e-07,"accuracy":1.0,"n":10000},"validation":{"loss":0.15950455322265625,"accuracy":0.9841,"n":10000},"training_seconds":48.19186254100002,"epoch_training_seconds":0.5763676619999956,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,221,182,216,205,192,187,218,195]},{"epoch":90,"stochastic_training_loss":0.000554452242795378,"dense_train_probe":{"loss":3.231220878660679e-07,"accuracy":1.0,"n":10000},"validation":{"loss":0.16501025390625,"accuracy":0.984,"n":10000},"training_seconds":51.02912179500002,"epoch_training_seconds":0.5709362310000046,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,222,184,215,203,192,186,217,197]},{"epoch":95,"stochastic_training_loss":0.0002927638706751168,"dense_train_probe":{"loss":1.7398925498127938e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1618099365234375,"accuracy":0.9836,"n":10000},"training_seconds":53.86100428900005,"epoch_training_seconds":0.567946223000007,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,210,220,184,216,206,192,186,216,196]},{"epoch":100,"stochastic_training_loss":0.0006684671971015632,"dense_train_probe":{"loss":9.336449205875397e-07,"accuracy":1.0,"n":10000},"validation":{"loss":0.1662599365234375,"accuracy":0.9841,"n":10000},"training_seconds":56.69546716900007,"epoch_training_seconds":0.5664548500000137,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,210,220,182,215,205,192,186,220,197]}],"best_epoch":5,"best_validation_loss":0.08423145141601562,"training_seconds":56.69546716900007,"total_run_seconds":57.99291641699999,"hardware":{"device":"cuda:0","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"4d0ac269167486811a0086108ca56313016afcebfc075d45e09455c228dee75b","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[7773,15460,23463,31533],"final_train":{"loss":5.373771861195564e-07,"accuracy":1.0,"n":50000},"selected_train":{"loss":0.029500888671875,"accuracy":0.99086,"n":50000},"final_test":{"loss":0.159143896484375,"accuracy":0.9841,"n":10000,"wrong_indices":[115,151,247,259,340,381,445,447,449,582,646,659,691,720,947,951,1014,1039,1112,1128,1156,1178,1192,1224,1226,1242,1247,1299,1319,1328,1393,1395,1522,1530,1549,1609,1681,1717,1901,1941,1984,2018,2024,2035,2070,2073,2098,2109,2118,2130,2135,2182,2293,2387,2405,2408,2414,2426,2488,2597,2607,2635,2648,2654,2877,2896,2921,2939,2953,3073,3117,3189,3225,3289,3405,3422,3441,3451,3503,3520,3534,3558,3727,3776,3780,3808,3818,3838,3893,3906,3941,3976,3985,4027,4065,4078,4163,4176,4199,4201,4248,4360,4497,4504,4731,4807,4814,4823,4860,4880,4966,5199,5331,5676,5936,5937,5955,5973,5982,6011,6030,6045,6059,6166,6555,6571,6576,6597,6625,6651,6755,6783,6847,7216,7259,7434,8094,8246,8325,8408,8456,8527,9009,9015,9024,9280,9587,9634,9664,9679,9729,9742,9745,9768,9770,9792,9808,9839,9975],"errors":159},"selected_test":{"loss":0.07578109130859376,"accuracy":0.9765,"n":10000,"wrong_indices":[115,151,217,247,259,274,340,381,445,449,495,582,610,619,646,691,707,720,810,895,900,938,947,951,956,965,1014,1032,1039,1044,1112,1156,1166,1178,1182,1194,1224,1226,1242,1247,1283,1299,1319,1326,1328,1364,1414,1500,1520,1522,1530,1549,1569,1581,1600,1609,1681,1717,1754,1790,1880,1901,1903,1941,1955,1984,2004,2016,2018,2024,2053,2070,2098,2109,2118,2125,2129,2130,2182,2185,2195,2224,2266,2272,2293,2299,2308,2369,2405,2426,2488,2582,2597,2607,2648,2654,2720,2721,2736,2877,2921,2927,2939,2952,2953,2995,3073,3117,3189,3289,3333,3388,3422,3441,3503,3520,3525,3542,3549,3558,3567,3597,3755,3767,3776,3808,3838,3869,3893,3906,3941,3943,3985,3995,4063,4065,4078,4140,4176,4199,4201,4224,4248,4289,4306,4344,4369,4374,4400,4425,4437,4487,4497,4534,4536,4571,4578,4601,4639,4690,4735,4740,4807,4814,4823,4833,4876,4880,4956,4966,4990,5246,5331,5457,5600,5642,5676,5734,5835,5887,5955,5973,6011,6045,6046,6059,6071,6166,6173,6505,6560,6571,6572,6576,6597,6608,6625,6651,6755,6783,6817,6847,7216,7432,7434,7823,8008,8030,8094,8246,8277,8311,8316,8325,8408,9009,9015,9019,9024,9036,9163,9280,9587,9634,9679,9692,9729,9745,9749,9770,9792,9808,9856,9888,9944],"errors":235}},{"run_id":"graph-eval-sd_constant-s103","spec":{"run_id":"graph-eval-sd_constant-s103","stage":"evaluate","cohort":"main","recipe":"sd_constant","pmax":0.4,"input_scale":0.00392156862745098,"output_relu":false,"lr":0.01,"shrinkage":0.0,"seed":103,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"timeout_seconds":180,"gpu":"A100","precision":"fp32"},"history":[{"epoch":1,"stochastic_training_loss":0.35908976197242737,"dense_train_probe":{"loss":0.12443800048828126,"accuracy":0.9627,"n":10000},"validation":{"loss":0.14581513671875,"accuracy":0.9565,"n":10000},"training_seconds":0.5944830920000044,"epoch_training_seconds":0.5944830920000044,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,208,227,171,218,220,190,187,211,196]},{"epoch":5,"stochastic_training_loss":0.05284269526600838,"dense_train_probe":{"loss":0.03044433288574219,"accuracy":0.9901,"n":10000},"validation":{"loss":0.08969136962890625,"accuracy":0.9743,"n":10000},"training_seconds":2.9040208250000035,"epoch_training_seconds":0.6038256799999999,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,206,226,184,219,202,194,188,218,190]},{"epoch":10,"stochastic_training_loss":0.020655980333685875,"dense_train_probe":{"loss":0.012710030364990235,"accuracy":0.9957,"n":10000},"validation":{"loss":0.08811070556640625,"accuracy":0.9794,"n":10000},"training_seconds":5.7411300360000155,"epoch_training_seconds":0.5615863980000029,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[216,210,221,178,216,211,193,189,216,198]},{"epoch":15,"stochastic_training_loss":0.010656221769750118,"dense_train_probe":{"loss":0.0035974273681640624,"accuracy":0.9989,"n":10000},"validation":{"loss":0.09642869262695312,"accuracy":0.9814,"n":10000},"training_seconds":8.589205075000024,"epoch_training_seconds":0.5697770649999967,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,218,187,213,206,191,184,216,203]},{"epoch":20,"stochastic_training_loss":0.0052973623387515545,"dense_train_probe":{"loss":0.0010640790939331055,"accuracy":0.9996,"n":10000},"validation":{"loss":0.1031694091796875,"accuracy":0.982,"n":10000},"training_seconds":11.424774080000063,"epoch_training_seconds":0.5711812390000119,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[218,211,223,175,217,206,196,188,219,195]},{"epoch":25,"stochastic_training_loss":0.008419168181717396,"dense_train_probe":{"loss":0.001040852928161621,"accuracy":0.9996,"n":10000},"validation":{"loss":0.09853394165039063,"accuracy":0.9821,"n":10000},"training_seconds":14.26927479800004,"epoch_training_seconds":0.5685644999999937,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,210,220,181,210,207,193,187,217,201]},{"epoch":30,"stochastic_training_loss":0.002597059356048703,"dense_train_probe":{"loss":2.391721159219742e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.114735009765625,"accuracy":0.9841,"n":10000},"training_seconds":17.16904910600003,"epoch_training_seconds":0.564480747999994,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,210,220,180,216,206,192,187,220,197]},{"epoch":35,"stochastic_training_loss":0.004462195560336113,"dense_train_probe":{"loss":0.000751452112197876,"accuracy":0.9999,"n":10000},"validation":{"loss":0.125215576171875,"accuracy":0.981,"n":10000},"training_seconds":20.01186559300004,"epoch_training_seconds":0.5696694860000093,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,213,221,180,219,208,191,190,215,191]},{"epoch":40,"stochastic_training_loss":0.0013090645661577582,"dense_train_probe":{"loss":1.4306040108203888e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.12624619140625,"accuracy":0.9837,"n":10000},"training_seconds":22.86957108200005,"epoch_training_seconds":0.569477849000009,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,210,220,181,216,207,191,187,219,196]},{"epoch":45,"stochastic_training_loss":0.001021531643345952,"dense_train_probe":{"loss":4.938272759318352e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.13837958984375,"accuracy":0.9832,"n":10000},"training_seconds":25.716543059000045,"epoch_training_seconds":0.5725197969999982,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,212,220,181,216,208,190,187,217,196]},{"epoch":50,"stochastic_training_loss":0.0012418776750564575,"dense_train_probe":{"loss":3.195488452911377e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1472687744140625,"accuracy":0.9828,"n":10000},"training_seconds":28.583104718000058,"epoch_training_seconds":0.5851447170000057,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,221,180,216,207,191,187,218,196]},{"epoch":55,"stochastic_training_loss":0.00042830401798710227,"dense_train_probe":{"loss":1.5388833358883857e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1479293212890625,"accuracy":0.9829,"n":10000},"training_seconds":31.426654535000054,"epoch_training_seconds":0.5689040319999918,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,210,220,181,216,208,190,187,219,196]},{"epoch":60,"stochastic_training_loss":0.001053778687492013,"dense_train_probe":{"loss":2.5057090446352957e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.15369593505859375,"accuracy":0.9828,"n":10000},"training_seconds":34.281233036000046,"epoch_training_seconds":0.5662602940000028,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,212,221,179,217,207,191,188,217,195]},{"epoch":65,"stochastic_training_loss":0.0009605471277609468,"dense_train_probe":{"loss":1.2877963483333588e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.15608359375,"accuracy":0.9835,"n":10000},"training_seconds":37.14021603000005,"epoch_training_seconds":0.5618326799999949,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,212,222,180,216,208,190,186,217,196]},{"epoch":70,"stochastic_training_loss":0.0008732712594792247,"dense_train_probe":{"loss":1.3221888802945613e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1662379150390625,"accuracy":0.9835,"n":10000},"training_seconds":39.98489628100005,"epoch_training_seconds":0.5647010320000021,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,212,222,180,216,208,190,186,216,196]},{"epoch":75,"stochastic_training_loss":0.0010542505187913775,"dense_train_probe":{"loss":1.3476081192493438e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.17095731201171874,"accuracy":0.9829,"n":10000},"training_seconds":42.81892391500003,"epoch_training_seconds":0.5674103350000053,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,212,221,180,216,207,191,187,217,196]},{"epoch":80,"stochastic_training_loss":0.027489006519317627,"dense_train_probe":{"loss":0.006676416015625,"accuracy":0.9983,"n":10000},"validation":{"loss":0.120540576171875,"accuracy":0.9795,"n":10000},"training_seconds":45.66346733000002,"epoch_training_seconds":0.571769321000005,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[219,213,220,182,220,208,189,187,215,195]},{"epoch":85,"stochastic_training_loss":0.0011771144345402718,"dense_train_probe":{"loss":1.7031189799308777e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.119484521484375,"accuracy":0.9831,"n":10000},"training_seconds":48.52326782900002,"epoch_training_seconds":0.5676756640000065,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,222,178,216,209,191,187,219,196]},{"epoch":90,"stochastic_training_loss":0.000596006226260215,"dense_train_probe":{"loss":5.439481139183044e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1286814453125,"accuracy":0.9835,"n":10000},"training_seconds":51.359569336999996,"epoch_training_seconds":0.566502813999989,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,210,222,178,218,209,191,187,219,194]},{"epoch":95,"stochastic_training_loss":0.0007734463433735073,"dense_train_probe":{"loss":2.5173546746373177e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1345489013671875,"accuracy":0.9834,"n":10000},"training_seconds":54.202077828999975,"epoch_training_seconds":0.5670137239999917,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,212,222,179,217,210,191,186,217,194]},{"epoch":100,"stochastic_training_loss":0.0006976648001000285,"dense_train_probe":{"loss":4.725553095340729e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.139342626953125,"accuracy":0.9838,"n":10000},"training_seconds":57.04250599799998,"epoch_training_seconds":0.5664268870000058,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,212,221,178,216,209,190,188,217,197]}],"best_epoch":10,"best_validation_loss":0.08811070556640625,"training_seconds":57.04250599799998,"total_run_seconds":58.59628729100001,"hardware":{"device":"cuda:0","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"316aa46c9e0a65fa375b579be0871a16f447d396fe64f85e2063ee6ef8c8dd5d","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[7857,15464,23550,31175],"final_train":{"loss":3.2176196575164796e-06,"accuracy":1.0,"n":50000},"selected_train":{"loss":0.01180263671875,"accuracy":0.99598,"n":50000},"final_test":{"loss":0.12501793212890625,"accuracy":0.9845,"n":10000,"wrong_indices":[247,321,340,381,445,449,495,582,646,659,720,844,938,947,951,1014,1039,1112,1156,1192,1224,1226,1242,1247,1299,1319,1328,1393,1395,1414,1494,1522,1530,1549,1609,1681,1790,1878,1901,1941,1987,2004,2035,2093,2098,2109,2118,2130,2135,2182,2280,2293,2369,2371,2387,2414,2426,2488,2597,2607,2648,2654,2720,2743,2877,2896,2921,2927,2939,2953,3030,3117,3189,3225,3422,3503,3520,3558,3597,3727,3776,3780,3818,3838,3893,3941,3968,3976,3985,4027,4065,4078,4102,4163,4176,4201,4248,4289,4306,4360,4497,4504,4536,4740,4761,4807,4823,4860,4880,4966,5331,5642,5676,5936,5937,5955,5972,5973,6011,6023,6045,6059,6555,6560,6571,6597,6608,6625,6651,6755,6783,7216,7434,8059,8246,8325,8408,8527,9009,9015,9024,9280,9587,9634,9664,9669,9679,9729,9745,9770,9792,9808,9839,9856,9944],"errors":155},"selected_test":{"loss":0.0855085205078125,"accuracy":0.98,"n":10000,"wrong_indices":[125,233,247,321,340,381,445,449,495,530,582,610,613,659,720,844,882,938,947,951,956,965,1014,1039,1112,1128,1156,1181,1226,1242,1247,1319,1378,1393,1395,1441,1444,1468,1522,1530,1549,1553,1569,1609,1621,1678,1681,1737,1754,1790,1850,1878,1901,1913,1941,1984,1987,2004,2024,2033,2040,2044,2049,2053,2070,2093,2098,2109,2118,2135,2185,2224,2293,2326,2369,2387,2408,2414,2433,2488,2597,2607,2648,2654,2713,2720,2743,2877,2921,2927,2939,2953,3030,3073,3117,3130,3189,3225,3251,3266,3289,3503,3520,3533,3549,3565,3567,3574,3597,3674,3727,3780,3796,3808,3818,3853,3869,3893,3906,3941,3968,3985,4027,4065,4075,4078,4159,4199,4248,4289,4306,4350,4369,4382,4425,4497,4504,4578,4601,4639,4731,4740,4807,4814,4823,4879,4880,4956,4978,5165,5331,5450,5457,5642,5676,5734,5757,5936,5955,5973,5997,6011,6015,6024,6045,6059,6173,6400,6555,6558,6571,6590,6597,6621,6625,6651,6755,7121,7216,7434,8094,8325,8408,8527,9009,9015,9024,9280,9587,9634,9664,9679,9729,9742,9745,9770,9839,9858,9944,9975],"errors":200}},{"run_id":"graph-eval-sd_annealed-s101","spec":{"run_id":"graph-eval-sd_annealed-s101","stage":"evaluate","cohort":"main","recipe":"sd_annealed","pmax":0.8,"input_scale":0.00392156862745098,"output_relu":false,"lr":0.01,"shrinkage":0.0,"seed":101,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"timeout_seconds":180,"gpu":"A100","precision":"fp32"},"history":[{"epoch":1,"stochastic_training_loss":0.47884249687194824,"dense_train_probe":{"loss":0.1595685791015625,"accuracy":0.9537,"n":10000},"validation":{"loss":0.1756636962890625,"accuracy":0.9504,"n":10000},"training_seconds":0.5061935269999935,"epoch_training_seconds":0.5061935269999935,"drop_probabilities":[0.2,0.4,0.6000000000000001,0.8],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,215,205,181,217,218,188,187,211,205]},{"epoch":5,"stochastic_training_loss":0.07194050401449203,"dense_train_probe":{"loss":0.04201461791992187,"accuracy":0.9883,"n":10000},"validation":{"loss":0.0847978515625,"accuracy":0.9738,"n":10000},"training_seconds":2.4407823679999865,"epoch_training_seconds":0.47737779499999533,"drop_probabilities":[0.19191919191919193,0.38383838383838387,0.5757575757575758,0.7676767676767677],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,211,222,179,217,199,193,185,228,194]},{"epoch":10,"stochastic_training_loss":0.030231919139623642,"dense_train_probe":{"loss":0.01586862487792969,"accuracy":0.9947,"n":10000},"validation":{"loss":0.084309619140625,"accuracy":0.9792,"n":10000},"training_seconds":4.907239025999999,"epoch_training_seconds":0.5017784930000033,"drop_probabilities":[0.18181818181818182,0.36363636363636365,0.5454545454545454,0.7272727272727273],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,211,222,180,214,205,193,186,218,199]},{"epoch":15,"stochastic_training_loss":0.018753517419099808,"dense_train_probe":{"loss":0.00715621337890625,"accuracy":0.9973,"n":10000},"validation":{"loss":0.0818095947265625,"accuracy":0.9809,"n":10000},"training_seconds":7.405219249000012,"epoch_training_seconds":0.4983856919999994,"drop_probabilities":[0.1717171717171717,0.3434343434343434,0.5151515151515151,0.6868686868686869],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,211,221,180,211,207,192,182,218,204]},{"epoch":20,"stochastic_training_loss":0.010069592855870724,"dense_train_probe":{"loss":0.014221287536621094,"accuracy":0.9945,"n":10000},"validation":{"loss":0.1149618896484375,"accuracy":0.9779,"n":10000},"training_seconds":9.95121527100001,"epoch_training_seconds":0.5119200950000078,"drop_probabilities":[0.16161616161616163,0.32323232323232326,0.48484848484848486,0.6464646464646465],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,209,214,179,212,205,193,185,226,205]},{"epoch":25,"stochastic_training_loss":0.0030978962313383818,"dense_train_probe":{"loss":0.00023784141540527344,"accuracy":1.0,"n":10000},"validation":{"loss":0.09324064331054688,"accuracy":0.9825,"n":10000},"training_seconds":12.583128673000004,"epoch_training_seconds":0.5585491309999924,"drop_probabilities":[0.15151515151515152,0.30303030303030304,0.4545454545454546,0.6060606060606061],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,179,215,206,193,187,222,197]},{"epoch":30,"stochastic_training_loss":0.00193729717284441,"dense_train_probe":{"loss":7.222663164138794e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.102895361328125,"accuracy":0.983,"n":10000},"training_seconds":15.220719821000003,"epoch_training_seconds":0.5275724180000054,"drop_probabilities":[0.1414141414141414,0.2828282828282828,0.4242424242424242,0.5656565656565656],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,220,179,217,208,192,186,220,196]},{"epoch":35,"stochastic_training_loss":0.0014615363907068968,"dense_train_probe":{"loss":2.3375189304351805e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.10911922607421876,"accuracy":0.9831,"n":10000},"training_seconds":17.916311129000007,"epoch_training_seconds":0.5460890960000029,"drop_probabilities":[0.13131313131313133,0.26262626262626265,0.393939393939394,0.5252525252525253],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,220,181,214,207,193,186,217,198]},{"epoch":40,"stochastic_training_loss":0.00572943314909935,"dense_train_probe":{"loss":0.004934964370727539,"accuracy":0.9982,"n":10000},"validation":{"loss":0.106981689453125,"accuracy":0.9794,"n":10000},"training_seconds":20.660236085000022,"epoch_training_seconds":0.5592453250000062,"drop_probabilities":[0.12121212121212122,0.24242424242424243,0.36363636363636365,0.48484848484848486],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,216,183,219,204,194,185,212,203]},{"epoch":45,"stochastic_training_loss":0.0013112914748489857,"dense_train_probe":{"loss":3.0855569243431094e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.112428564453125,"accuracy":0.9828,"n":10000},"training_seconds":23.414869263000043,"epoch_training_seconds":0.5597858150000121,"drop_probabilities":[0.11111111111111112,0.22222222222222224,0.33333333333333337,0.4444444444444445],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,208,218,185,212,205,193,185,219,202]},{"epoch":50,"stochastic_training_loss":0.0007210391340777278,"dense_train_probe":{"loss":1.2370342761278153e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.1155552734375,"accuracy":0.9828,"n":10000},"training_seconds":26.23794543500003,"epoch_training_seconds":0.5694442359999954,"drop_probabilities":[0.101010101010101,0.202020202020202,0.303030303030303,0.404040404040404],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,210,219,184,214,207,193,184,217,199]},{"epoch":55,"stochastic_training_loss":0.0003853467060253024,"dense_train_probe":{"loss":7.946869730949401e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1230110107421875,"accuracy":0.9826,"n":10000},"training_seconds":29.10969010300002,"epoch_training_seconds":0.5745607429999922,"drop_probabilities":[0.09090909090909093,0.18181818181818185,0.27272727272727276,0.3636363636363637],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,211,219,183,215,203,194,185,220,198]},{"epoch":60,"stochastic_training_loss":0.00031819549622014165,"dense_train_probe":{"loss":5.080926045775413e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.122999560546875,"accuracy":0.9831,"n":10000},"training_seconds":32.03632480000003,"epoch_training_seconds":0.5865855650000071,"drop_probabilities":[0.08080808080808083,0.16161616161616166,0.2424242424242425,0.3232323232323233],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,210,219,182,214,207,193,185,219,199]},{"epoch":65,"stochastic_training_loss":0.00016852862609084696,"dense_train_probe":{"loss":3.3360451459884642e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.127404296875,"accuracy":0.9824,"n":10000},"training_seconds":35.00291628000005,"epoch_training_seconds":0.6012773180000011,"drop_probabilities":[0.0707070707070707,0.1414141414141414,0.2121212121212121,0.2828282828282828],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,220,181,213,206,194,186,217,199]},{"epoch":70,"stochastic_training_loss":0.00013983910321258008,"dense_train_probe":{"loss":2.626994252204895e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.127913623046875,"accuracy":0.9836,"n":10000},"training_seconds":38.00908375300003,"epoch_training_seconds":0.6040416490000098,"drop_probabilities":[0.0606060606060606,0.1212121212121212,0.1818181818181818,0.2424242424242424],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,211,218,184,214,204,194,186,219,198]},{"epoch":75,"stochastic_training_loss":0.00011326111416565254,"dense_train_probe":{"loss":1.7097940668463708e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1324430908203125,"accuracy":0.9828,"n":10000},"training_seconds":41.06467916300002,"epoch_training_seconds":0.6148960889999984,"drop_probabilities":[0.0505050505050505,0.101010101010101,0.1515151515151515,0.202020202020202],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,211,220,180,213,206,194,187,218,199]},{"epoch":80,"stochastic_training_loss":7.562050450360402e-05,"dense_train_probe":{"loss":1.7933106049895286e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.13183935546875,"accuracy":0.983,"n":10000},"training_seconds":44.16831042300002,"epoch_training_seconds":0.6285267760000011,"drop_probabilities":[0.0404040404040404,0.0808080808080808,0.1212121212121212,0.1616161616161616],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,210,219,180,213,206,194,187,219,200]},{"epoch":85,"stochastic_training_loss":3.303886842331849e-05,"dense_train_probe":{"loss":1.374064665287733e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.131898046875,"accuracy":0.9833,"n":10000},"training_seconds":47.31976728799998,"epoch_training_seconds":0.6374056429999939,"drop_probabilities":[0.0303030303030303,0.0606060606060606,0.0909090909090909,0.1212121212121212],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,210,219,181,215,206,193,187,218,199]},{"epoch":90,"stochastic_training_loss":1.8207967514172196e-05,"dense_train_probe":{"loss":1.2840814888477325e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1341087646484375,"accuracy":0.9828,"n":10000},"training_seconds":50.519656405999996,"epoch_training_seconds":0.6436990249999894,"drop_probabilities":[0.0202020202020202,0.0404040404040404,0.0606060606060606,0.0808080808080808],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,211,220,180,214,206,194,187,218,198]},{"epoch":95,"stochastic_training_loss":5.58561123398249e-06,"dense_train_probe":{"loss":1.034161075949669e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.13457744140625,"accuracy":0.9834,"n":10000},"training_seconds":53.76589843199997,"epoch_training_seconds":0.6531321469999796,"drop_probabilities":[0.0101010101010101,0.0202020202020202,0.0303030303030303,0.0404040404040404],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,211,220,181,214,206,194,186,218,198]},{"epoch":100,"stochastic_training_loss":9.261892159884155e-07,"dense_train_probe":{"loss":9.382639080286026e-07,"accuracy":1.0,"n":10000},"validation":{"loss":0.134895361328125,"accuracy":0.9835,"n":10000},"training_seconds":57.05315608299995,"epoch_training_seconds":0.6620189740000058,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,211,219,181,214,206,194,187,218,198]}],"best_epoch":15,"best_validation_loss":0.0818095947265625,"training_seconds":57.05315608299995,"total_run_seconds":59.033537945000006,"hardware":{"device":"cuda:0","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"e1efb33081a653eb2db13a44aa7d20f3f16925ea1dc8bc2e91ed2f639a3974ae","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[7686,15519,23418,31322],"final_train":{"loss":9.178103506565094e-07,"accuracy":1.0,"n":50000},"selected_train":{"loss":0.0073738916015625,"accuracy":0.9978,"n":50000},"final_test":{"loss":0.12641207275390626,"accuracy":0.9847,"n":10000,"wrong_indices":[96,115,247,259,340,445,449,495,582,646,720,883,938,947,951,965,1014,1039,1112,1156,1226,1242,1247,1299,1319,1328,1393,1395,1444,1522,1530,1549,1681,1901,1911,1941,1984,2004,2024,2035,2053,2070,2093,2098,2109,2118,2130,2135,2182,2272,2293,2369,2387,2408,2414,2488,2597,2607,2635,2648,2654,2720,2877,2896,2915,2921,2927,2939,2953,2979,2995,3073,3117,3189,3405,3422,3503,3520,3533,3558,3727,3776,3780,3808,3818,3893,3906,3941,3976,3985,4065,4078,4176,4201,4248,4265,4271,4289,4497,4504,4536,4601,4731,4807,4814,4823,4860,4880,5331,5457,5642,5676,5936,5937,5955,5973,6011,6023,6045,6059,6555,6597,6625,6755,6783,6817,7216,7259,7434,7492,7886,8094,8246,8277,8325,8408,8456,8527,9009,9015,9024,9280,9500,9587,9664,9679,9729,9742,9745,9770,9808,9839,9944],"errors":153},"selected_test":{"loss":0.0753540283203125,"accuracy":0.9822,"n":10000,"wrong_indices":[115,149,247,259,340,445,449,582,646,684,707,720,726,740,938,947,951,965,1014,1039,1112,1156,1181,1226,1242,1247,1319,1328,1393,1395,1494,1522,1530,1549,1569,1609,1681,1709,1721,1790,1883,1901,1911,1941,1984,1987,2024,2053,2070,2093,2098,2109,2118,2130,2135,2148,2182,2189,2272,2293,2369,2371,2387,2408,2447,2488,2514,2597,2607,2630,2648,2654,2877,2896,2921,2927,2939,2953,3030,3117,3189,3333,3388,3405,3422,3503,3520,3533,3549,3558,3565,3580,3597,3681,3776,3780,3808,3853,3893,3906,3941,3943,3976,4007,4065,4078,4102,4176,4199,4248,4265,4317,4443,4497,4536,4567,4578,4635,4639,4807,4823,4860,4880,5331,5457,5600,5642,5676,5734,5835,5926,5936,5955,5973,6011,6023,6030,6035,6045,6046,6059,6166,6555,6572,6597,6662,6755,6783,6847,7098,7216,7434,7451,8061,8255,8321,8408,8520,8527,8584,9009,9015,9024,9280,9587,9664,9669,9679,9729,9742,9745,9770,9792,9808,9839,9858,9944,9975],"errors":178}},{"run_id":"graph-eval-sd_annealed-s102","spec":{"run_id":"graph-eval-sd_annealed-s102","stage":"evaluate","cohort":"main","recipe":"sd_annealed","pmax":0.8,"input_scale":0.00392156862745098,"output_relu":false,"lr":0.01,"shrinkage":0.0,"seed":102,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"timeout_seconds":180,"gpu":"A100","precision":"fp32"},"history":[{"epoch":1,"stochastic_training_loss":0.43916577100753784,"dense_train_probe":{"loss":0.14436007080078125,"accuracy":0.9583,"n":10000},"validation":{"loss":0.1593893310546875,"accuracy":0.9537,"n":10000},"training_seconds":0.47953857299999925,"epoch_training_seconds":0.47953857299999925,"drop_probabilities":[0.2,0.4,0.6000000000000001,0.8],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[219,208,210,181,213,214,199,186,217,201]},{"epoch":5,"stochastic_training_loss":0.07478492707014084,"dense_train_probe":{"loss":0.0401638427734375,"accuracy":0.9882,"n":10000},"validation":{"loss":0.080600244140625,"accuracy":0.9758,"n":10000},"training_seconds":2.394592239000005,"epoch_training_seconds":0.48589517599999965,"drop_probabilities":[0.19191919191919193,0.38383838383838387,0.5757575757575758,0.7676767676767677],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[218,208,223,177,219,217,193,181,214,198]},{"epoch":10,"stochastic_training_loss":0.033270396292209625,"dense_train_probe":{"loss":0.01628696594238281,"accuracy":0.9944,"n":10000},"validation":{"loss":0.08638349609375,"accuracy":0.9779,"n":10000},"training_seconds":4.834057134999995,"epoch_training_seconds":0.48912182000000826,"drop_probabilities":[0.18181818181818182,0.36363636363636365,0.5454545454545454,0.7272727272727273],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,206,230,178,218,205,194,182,222,193]},{"epoch":15,"stochastic_training_loss":0.017502443864941597,"dense_train_probe":{"loss":0.006913496398925781,"accuracy":0.9984,"n":10000},"validation":{"loss":0.08702890625,"accuracy":0.9799,"n":10000},"training_seconds":7.321026922999991,"epoch_training_seconds":0.5045948070000037,"drop_probabilities":[0.1717171717171717,0.3434343434343434,0.5151515151515151,0.6868686868686869],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,223,180,208,206,193,188,220,198]},{"epoch":20,"stochastic_training_loss":0.007057159673422575,"dense_train_probe":{"loss":0.002658833885192871,"accuracy":0.9995,"n":10000},"validation":{"loss":0.09423568115234375,"accuracy":0.9823,"n":10000},"training_seconds":9.844686377000002,"epoch_training_seconds":0.5069024020000086,"drop_probabilities":[0.16161616161616163,0.32323232323232326,0.48484848484848486,0.6464646464646465],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,208,223,183,212,208,192,182,215,203]},{"epoch":25,"stochastic_training_loss":0.013260169886052608,"dense_train_probe":{"loss":0.001837320327758789,"accuracy":0.9994,"n":10000},"validation":{"loss":0.09871585083007813,"accuracy":0.982,"n":10000},"training_seconds":12.403636735999982,"epoch_training_seconds":0.5148050929999926,"drop_probabilities":[0.15151515151515152,0.30303030303030304,0.4545454545454546,0.6060606060606061],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[219,213,222,182,218,206,193,184,217,194]},{"epoch":30,"stochastic_training_loss":0.003446736605837941,"dense_train_probe":{"loss":0.0002293553352355957,"accuracy":0.9999,"n":10000},"validation":{"loss":0.1007837646484375,"accuracy":0.9838,"n":10000},"training_seconds":15.02628620999998,"epoch_training_seconds":0.5445118669999971,"drop_probabilities":[0.1414141414141414,0.2828282828282828,0.4242424242424242,0.5656565656565656],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,209,220,185,216,206,192,188,216,196]},{"epoch":35,"stochastic_training_loss":0.0010595937492325902,"dense_train_probe":{"loss":7.765019536018372e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.11492955322265624,"accuracy":0.9833,"n":10000},"training_seconds":17.694417780999984,"epoch_training_seconds":0.5433543110000016,"drop_probabilities":[0.13131313131313133,0.26262626262626265,0.393939393939394,0.5252525252525253],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[223,211,219,185,215,206,192,186,214,197]},{"epoch":40,"stochastic_training_loss":0.0011141246650367975,"dense_train_probe":{"loss":2.2179733216762542e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.1211069580078125,"accuracy":0.9829,"n":10000},"training_seconds":20.407296067999994,"epoch_training_seconds":0.5472476510000064,"drop_probabilities":[0.12121212121212122,0.24242424242424243,0.36363636363636365,0.48484848484848486],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,219,184,217,205,192,185,219,195]},{"epoch":45,"stochastic_training_loss":0.004652603529393673,"dense_train_probe":{"loss":0.00037194085121154783,"accuracy":0.9999,"n":10000},"validation":{"loss":0.11419063720703125,"accuracy":0.9818,"n":10000},"training_seconds":23.161925623999977,"epoch_training_seconds":0.5565230589999999,"drop_probabilities":[0.11111111111111112,0.22222222222222224,0.33333333333333337,0.4444444444444445],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,210,220,182,217,206,193,187,218,195]},{"epoch":50,"stochastic_training_loss":0.0007377369911409914,"dense_train_probe":{"loss":2.2179435193538665e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.118433154296875,"accuracy":0.9832,"n":10000},"training_seconds":25.96461739599998,"epoch_training_seconds":0.5671756249999902,"drop_probabilities":[0.101010101010101,0.202020202020202,0.303030303030303,0.404040404040404],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,220,185,216,208,191,186,217,195]},{"epoch":55,"stochastic_training_loss":0.0005365790566429496,"dense_train_probe":{"loss":1.2616206705570221e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.1269767822265625,"accuracy":0.9834,"n":10000},"training_seconds":28.824966891999978,"epoch_training_seconds":0.5728975660000089,"drop_probabilities":[0.09090909090909093,0.18181818181818185,0.27272727272727276,0.3636363636363637],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,209,219,182,215,212,191,185,216,197]},{"epoch":60,"stochastic_training_loss":0.0002713362337090075,"dense_train_probe":{"loss":5.904184281826019e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1327488037109375,"accuracy":0.9831,"n":10000},"training_seconds":31.73297285199999,"epoch_training_seconds":0.5869700900000083,"drop_probabilities":[0.08080808080808083,0.16161616161616166,0.2424242424242425,0.3232323232323233],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,219,181,216,209,192,187,219,195]},{"epoch":65,"stochastic_training_loss":0.0003188661648891866,"dense_train_probe":{"loss":4.369991272687912e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.13736007080078125,"accuracy":0.9837,"n":10000},"training_seconds":34.690202852999974,"epoch_training_seconds":0.5921975239999995,"drop_probabilities":[0.0707070707070707,0.1414141414141414,0.2121212121212121,0.2828282828282828],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,209,219,182,215,209,191,188,217,196]},{"epoch":70,"stochastic_training_loss":0.00012663932284340262,"dense_train_probe":{"loss":3.1477238982915877e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.13849676513671874,"accuracy":0.9836,"n":10000},"training_seconds":37.691740831000004,"epoch_training_seconds":0.6069533220000096,"drop_probabilities":[0.0606060606060606,0.1212121212121212,0.1818181818181818,0.2424242424242424],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,209,219,183,214,207,192,188,218,196]},{"epoch":75,"stochastic_training_loss":0.00010845910583157092,"dense_train_probe":{"loss":4.122854769229889e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1440551513671875,"accuracy":0.9829,"n":10000},"training_seconds":40.74050779699999,"epoch_training_seconds":0.6131694139999979,"drop_probabilities":[0.0505050505050505,0.101010101010101,0.1515151515151515,0.202020202020202],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,209,219,182,216,208,191,189,217,195]},{"epoch":80,"stochastic_training_loss":6.506373756565154e-05,"dense_train_probe":{"loss":2.4469003081321715e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1425060546875,"accuracy":0.9837,"n":10000},"training_seconds":43.82452959399998,"epoch_training_seconds":0.6228615609999935,"drop_probabilities":[0.0404040404040404,0.0808080808080808,0.1212121212121212,0.1616161616161616],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,209,219,182,216,206,192,187,219,196]},{"epoch":85,"stochastic_training_loss":3.368072066223249e-05,"dense_train_probe":{"loss":1.8593654036521911e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1443682373046875,"accuracy":0.9837,"n":10000},"training_seconds":46.96560667899996,"epoch_training_seconds":0.6298317249999883,"drop_probabilities":[0.0303030303030303,0.0606060606060606,0.0909090909090909,0.1212121212121212],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,209,219,183,216,207,192,188,217,195]},{"epoch":90,"stochastic_training_loss":1.4186570297169965e-05,"dense_train_probe":{"loss":1.795041561126709e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.145215673828125,"accuracy":0.9838,"n":10000},"training_seconds":50.15341455999997,"epoch_training_seconds":0.6415141360000121,"drop_probabilities":[0.0202020202020202,0.0404040404040404,0.0606060606060606,0.0808080808080808],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,209,219,183,216,206,192,187,218,196]},{"epoch":95,"stochastic_training_loss":8.462729056191165e-06,"dense_train_probe":{"loss":1.5677789226174354e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.14584976806640626,"accuracy":0.9837,"n":10000},"training_seconds":53.38351629199998,"epoch_training_seconds":0.6490524969999854,"drop_probabilities":[0.0101010101010101,0.0202020202020202,0.0303030303030303,0.0404040404040404],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,210,220,183,216,206,192,186,217,196]},{"epoch":100,"stochastic_training_loss":1.006537672765262e-06,"dense_train_probe":{"loss":1.3413389213383198e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.1462005126953125,"accuracy":0.9834,"n":10000},"training_seconds":56.70104473499994,"epoch_training_seconds":0.6819937100000004,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,209,219,183,216,206,192,188,218,195]}],"best_epoch":5,"best_validation_loss":0.080600244140625,"training_seconds":56.70104473499994,"total_run_seconds":57.97499664500002,"hardware":{"device":"cuda:0","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"4d0ac269167486811a0086108ca56313016afcebfc075d45e09455c228dee75b","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[7895,15464,23344,31254],"final_train":{"loss":9.956718981266022e-07,"accuracy":1.0,"n":50000},"selected_train":{"loss":0.03972373779296875,"accuracy":0.98842,"n":50000},"final_test":{"loss":0.125885546875,"accuracy":0.9856,"n":10000,"wrong_indices":[247,259,340,381,445,449,582,619,646,684,720,947,951,965,1014,1039,1112,1156,1178,1224,1226,1232,1242,1247,1299,1319,1328,1393,1395,1414,1522,1530,1549,1569,1609,1681,1717,1901,1911,1941,1984,2004,2035,2070,2098,2109,2118,2130,2135,2182,2272,2293,2369,2387,2414,2426,2488,2597,2607,2648,2654,2720,2877,2896,2921,2939,2953,3073,3117,3422,3451,3475,3503,3520,3558,3727,3776,3780,3808,3818,3853,3906,3941,3976,3985,4065,4078,4163,4176,4199,4201,4248,4289,4497,4536,4551,4731,4761,4807,4814,4823,4860,4880,5331,5642,5676,5936,5937,5955,5973,6011,6035,6045,6059,6166,6555,6571,6574,6597,6625,6783,6817,6847,7434,8094,8246,8325,8408,8456,8527,9009,9024,9280,9587,9634,9664,9679,9692,9729,9742,9770,9792,9808,9839],"errors":144},"selected_test":{"loss":0.073514599609375,"accuracy":0.9767,"n":10000,"wrong_indices":[151,217,247,321,340,381,445,449,495,582,619,646,691,707,720,740,900,938,947,951,1014,1039,1044,1112,1128,1156,1166,1182,1194,1224,1226,1247,1260,1283,1299,1319,1328,1364,1393,1395,1414,1444,1494,1522,1530,1549,1553,1569,1609,1681,1717,1754,1790,1878,1880,1901,1909,1941,1952,1973,1982,1984,1987,2016,2018,2024,2033,2035,2040,2043,2044,2053,2098,2109,2118,2129,2130,2135,2182,2272,2293,2299,2369,2387,2406,2408,2422,2454,2488,2582,2597,2607,2648,2654,2721,2730,2760,2896,2921,2927,2939,2952,2953,2995,3030,3062,3073,3117,3206,3289,3333,3422,3441,3451,3475,3503,3520,3558,3559,3567,3597,3681,3767,3776,3808,3818,3853,3869,3906,3926,3941,3985,3995,4000,4063,4065,4075,4078,4093,4140,4154,4176,4199,4201,4248,4259,4289,4306,4317,4369,4435,4497,4534,4536,4547,4571,4578,4635,4639,4690,4731,4735,4807,4814,4823,4838,4876,4880,4956,4966,5046,5140,5199,5331,5634,5642,5676,5734,5749,5887,5955,5972,5973,6011,6035,6045,6059,6166,6505,6555,6560,6571,6572,6574,6597,6608,6625,6632,6641,6651,6783,6847,7216,7434,8094,8246,8277,8293,8311,8325,8408,8504,8520,9009,9015,9019,9024,9036,9280,9587,9634,9669,9679,9692,9698,9729,9749,9768,9770,9808,9856,9892,9944],"errors":233}},{"run_id":"graph-eval-sd_annealed-s103","spec":{"run_id":"graph-eval-sd_annealed-s103","stage":"evaluate","cohort":"main","recipe":"sd_annealed","pmax":0.8,"input_scale":0.00392156862745098,"output_relu":false,"lr":0.01,"shrinkage":0.0,"seed":103,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"timeout_seconds":180,"gpu":"A100","precision":"fp32"},"history":[{"epoch":1,"stochastic_training_loss":0.44943803548812866,"dense_train_probe":{"loss":0.1524846923828125,"accuracy":0.9567,"n":10000},"validation":{"loss":0.16810791015625,"accuracy":0.9507,"n":10000},"training_seconds":0.4999884900000069,"epoch_training_seconds":0.4999884900000069,"drop_probabilities":[0.2,0.4,0.6000000000000001,0.8],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[223,209,230,172,217,211,193,184,209,200]},{"epoch":5,"stochastic_training_loss":0.0703391283750534,"dense_train_probe":{"loss":0.040451123046875,"accuracy":0.9886,"n":10000},"validation":{"loss":0.08571429443359375,"accuracy":0.9743,"n":10000},"training_seconds":2.414285583999998,"epoch_training_seconds":0.4837500349999999,"drop_probabilities":[0.19191919191919193,0.38383838383838387,0.5757575757575758,0.7676767676767677],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[217,208,227,182,216,204,197,184,220,193]},{"epoch":10,"stochastic_training_loss":0.03467870503664017,"dense_train_probe":{"loss":0.0138310546875,"accuracy":0.9956,"n":10000},"validation":{"loss":0.07372632446289062,"accuracy":0.9795,"n":10000},"training_seconds":4.8572008109999985,"epoch_training_seconds":0.4893971210000103,"drop_probabilities":[0.18181818181818182,0.36363636363636365,0.5454545454545454,0.7272727272727273],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,207,220,177,212,210,193,192,220,197]},{"epoch":15,"stochastic_training_loss":0.015419130213558674,"dense_train_probe":{"loss":0.005751602172851563,"accuracy":0.9981,"n":10000},"validation":{"loss":0.08844318237304688,"accuracy":0.9795,"n":10000},"training_seconds":7.34460218400001,"epoch_training_seconds":0.49962818500000594,"drop_probabilities":[0.1717171717171717,0.3434343434343434,0.5151515151515151,0.6868686868686869],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,206,221,179,212,206,194,188,225,196]},{"epoch":20,"stochastic_training_loss":0.00773804634809494,"dense_train_probe":{"loss":0.0016759017944335938,"accuracy":0.9996,"n":10000},"validation":{"loss":0.08571009521484375,"accuracy":0.9818,"n":10000},"training_seconds":9.871929855000033,"epoch_training_seconds":0.5131978050000043,"drop_probabilities":[0.16161616161616163,0.32323232323232326,0.48484848484848486,0.6464646464646465],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[218,210,222,181,216,210,193,185,218,195]},{"epoch":25,"stochastic_training_loss":0.0049003176391124725,"dense_train_probe":{"loss":0.0005359292984008789,"accuracy":1.0,"n":10000},"validation":{"loss":0.0919744873046875,"accuracy":0.9822,"n":10000},"training_seconds":12.453461821000047,"epoch_training_seconds":0.5205093070000117,"drop_probabilities":[0.15151515151515152,0.30303030303030304,0.4545454545454546,0.6060606060606061],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,223,181,214,207,192,187,216,196]},{"epoch":30,"stochastic_training_loss":0.002619884442538023,"dense_train_probe":{"loss":0.00015530400276184082,"accuracy":0.9999,"n":10000},"validation":{"loss":0.10188898315429687,"accuracy":0.9825,"n":10000},"training_seconds":15.085373838000052,"epoch_training_seconds":0.5258680980000037,"drop_probabilities":[0.1414141414141414,0.2828282828282828,0.4242424242424242,0.5656565656565656],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,220,179,216,209,192,186,219,195]},{"epoch":35,"stochastic_training_loss":0.0013039294863119721,"dense_train_probe":{"loss":4.1963565349578856e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.1121018798828125,"accuracy":0.9829,"n":10000},"training_seconds":17.761932956000052,"epoch_training_seconds":0.5406726360000107,"drop_probabilities":[0.13131313131313133,0.26262626262626265,0.393939393939394,0.5252525252525253],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,213,218,177,215,210,192,189,217,196]},{"epoch":40,"stochastic_training_loss":0.0011517005041241646,"dense_train_probe":{"loss":5.454140305519104e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.11587254638671875,"accuracy":0.9837,"n":10000},"training_seconds":20.490863584000067,"epoch_training_seconds":0.5486763320000136,"drop_probabilities":[0.12121212121212122,0.24242424242424243,0.36363636363636365,0.48484848484848486],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,220,178,215,211,191,184,221,198]},{"epoch":45,"stochastic_training_loss":0.0007293313974514604,"dense_train_probe":{"loss":1.5181052684783935e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.12181015625,"accuracy":0.9832,"n":10000},"training_seconds":23.266295810000088,"epoch_training_seconds":0.5591075310000093,"drop_probabilities":[0.11111111111111112,0.22222222222222224,0.33333333333333337,0.4444444444444445],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,213,221,179,215,208,192,184,218,197]},{"epoch":50,"stochastic_training_loss":0.0007506875554099679,"dense_train_probe":{"loss":6.309223920106888e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.12935230712890625,"accuracy":0.9835,"n":10000},"training_seconds":26.08238013600007,"epoch_training_seconds":0.5585515810000032,"drop_probabilities":[0.101010101010101,0.202020202020202,0.303030303030303,0.404040404040404],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,212,221,178,215,210,192,184,217,198]},{"epoch":55,"stochastic_training_loss":0.00030311438604258,"dense_train_probe":{"loss":4.337877035140991e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.133634619140625,"accuracy":0.9831,"n":10000},"training_seconds":28.946443665000075,"epoch_training_seconds":0.5768398530000098,"drop_probabilities":[0.09090909090909093,0.18181818181818185,0.27272727272727276,0.3636363636363637],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,212,222,178,217,211,191,184,217,195]},{"epoch":60,"stochastic_training_loss":0.0005788164562545717,"dense_train_probe":{"loss":3.5662777721881865e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.13469952392578124,"accuracy":0.9827,"n":10000},"training_seconds":31.86632921800006,"epoch_training_seconds":0.5828419999999994,"drop_probabilities":[0.08080808080808083,0.16161616161616166,0.2424242424242425,0.3232323232323233],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,212,221,178,218,209,192,184,219,194]},{"epoch":65,"stochastic_training_loss":0.00018191868730355054,"dense_train_probe":{"loss":2.236868441104889e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.13589639892578126,"accuracy":0.9831,"n":10000},"training_seconds":34.81918887600004,"epoch_training_seconds":0.5883914950000104,"drop_probabilities":[0.0707070707070707,0.1414141414141414,0.2121212121212121,0.2828282828282828],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,212,221,178,217,209,192,184,219,195]},{"epoch":70,"stochastic_training_loss":0.00029945970163680613,"dense_train_probe":{"loss":1.8078021705150605e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.14040184326171876,"accuracy":0.9829,"n":10000},"training_seconds":37.81848188300003,"epoch_training_seconds":0.6024628280000002,"drop_probabilities":[0.0606060606060606,0.1212121212121212,0.1818181818181818,0.2424242424242424],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,214,221,179,216,208,192,185,217,195]},{"epoch":75,"stochastic_training_loss":6.708304863423109e-05,"dense_train_probe":{"loss":1.4144415035843848e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.14137823486328124,"accuracy":0.9829,"n":10000},"training_seconds":40.864327392000035,"epoch_training_seconds":0.6149229039999966,"drop_probabilities":[0.0505050505050505,0.101010101010101,0.1515151515151515,0.202020202020202],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,214,221,178,217,209,192,184,217,195]},{"epoch":80,"stochastic_training_loss":5.7050543546210974e-05,"dense_train_probe":{"loss":1.044315006583929e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.142310009765625,"accuracy":0.9834,"n":10000},"training_seconds":43.99891203300004,"epoch_training_seconds":0.62781084800001,"drop_probabilities":[0.0404040404040404,0.0808080808080808,0.1212121212121212,0.1616161616161616],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,213,221,178,217,209,192,184,218,195]},{"epoch":85,"stochastic_training_loss":0.007387823425233364,"dense_train_probe":{"loss":0.058097454833984374,"accuracy":0.9875,"n":10000},"validation":{"loss":0.226636767578125,"accuracy":0.9692,"n":10000},"training_seconds":47.14588761800003,"epoch_training_seconds":0.6329085469999995,"drop_probabilities":[0.0303030303030303,0.0606060606060606,0.0909090909090909,0.1212121212121212],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[214,216,219,178,225,208,201,182,205,200]},{"epoch":90,"stochastic_training_loss":0.00011438522778917104,"dense_train_probe":{"loss":4.865619540214539e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.10771549072265625,"accuracy":0.9828,"n":10000},"training_seconds":50.33880813400002,"epoch_training_seconds":0.6433693600000083,"drop_probabilities":[0.0202020202020202,0.0404040404040404,0.0606060606060606,0.0808080808080808],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,221,180,213,208,192,185,220,197]},{"epoch":95,"stochastic_training_loss":4.831911064684391e-05,"dense_train_probe":{"loss":1.9579324126243593e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.11347708740234375,"accuracy":0.9823,"n":10000},"training_seconds":53.57599834500003,"epoch_training_seconds":0.6509389830000032,"drop_probabilities":[0.0101010101010101,0.0202020202020202,0.0303030303030303,0.0404040404040404],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,222,180,214,207,192,185,220,196]},{"epoch":100,"stochastic_training_loss":1.2222410077811219e-05,"dense_train_probe":{"loss":1.2217939645051956e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.11486622314453125,"accuracy":0.9829,"n":10000},"training_seconds":56.86089320400008,"epoch_training_seconds":0.6612328590000232,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,221,181,214,207,192,185,220,196]}],"best_epoch":10,"best_validation_loss":0.07372632446289062,"training_seconds":56.86089320400008,"total_run_seconds":58.654153147,"hardware":{"device":"cuda:0","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"316aa46c9e0a65fa375b579be0871a16f447d396fe64f85e2063ee6ef8c8dd5d","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[7810,15508,23505,31406],"final_train":{"loss":1.161283016204834e-05,"accuracy":1.0,"n":50000},"selected_train":{"loss":0.013546199951171876,"accuracy":0.99588,"n":50000},"final_test":{"loss":0.09863500366210938,"accuracy":0.985,"n":10000,"wrong_indices":[151,247,259,340,381,445,447,449,495,582,646,659,720,883,938,947,951,965,1014,1039,1112,1156,1192,1224,1226,1232,1242,1247,1299,1319,1328,1393,1395,1414,1522,1530,1549,1609,1681,1709,1901,1941,1984,2018,2024,2035,2098,2118,2125,2130,2135,2182,2272,2293,2369,2371,2387,2426,2488,2597,2607,2648,2654,2720,2743,2810,2877,2896,2921,2939,2953,3030,3405,3422,3503,3520,3533,3558,3597,3776,3780,3808,3893,3906,3941,3976,3985,4027,4065,4075,4078,4156,4163,4176,4201,4248,4497,4536,4671,4690,4731,4740,4761,4807,4814,4823,4880,4966,5331,5457,5642,5676,5757,5936,5937,5973,5982,6011,6045,6059,6555,6558,6597,6651,6755,6783,7216,7434,8094,8325,8408,8456,8527,9009,9015,9019,9024,9587,9634,9664,9669,9679,9729,9742,9770,9792,9839,9856,9858,9975],"errors":150},"selected_test":{"loss":0.06864859008789062,"accuracy":0.981,"n":10000,"wrong_indices":[125,247,259,321,340,381,445,448,449,495,582,610,720,882,883,900,938,947,951,965,1014,1039,1112,1226,1232,1242,1247,1299,1319,1364,1378,1395,1522,1530,1549,1609,1678,1681,1709,1717,1754,1790,1901,1984,1987,2016,2035,2053,2070,2093,2098,2109,2118,2125,2130,2135,2182,2185,2272,2293,2299,2387,2408,2414,2488,2597,2607,2635,2654,2720,2743,2769,2863,2877,2896,2921,2927,2939,2953,3030,3117,3189,3225,3289,3405,3422,3503,3520,3533,3549,3558,3597,3767,3776,3780,3796,3808,3853,3869,3893,3906,3941,3985,4065,4075,4078,4156,4176,4199,4201,4248,4271,4289,4306,4425,4435,4497,4521,4578,4635,4639,4671,4731,4740,4761,4807,4814,4823,4860,4879,4880,4956,4990,5046,5140,5165,5331,5457,5564,5642,5649,5676,5734,5749,5757,5936,5937,5955,5973,6011,6030,6045,6046,6059,6173,6555,6558,6559,6572,6597,6625,6651,6783,7216,7434,7451,7492,7595,7849,8094,8246,8325,8408,8522,8527,9009,9022,9024,9280,9587,9634,9664,9669,9679,9729,9745,9755,9770,9792,9944],"errors":190}},{"run_id":"graph-eval-residual_unit_dropout-s101","spec":{"run_id":"graph-eval-residual_unit_dropout-s101","stage":"evaluate","cohort":"main","recipe":"residual_unit_dropout","pmax":0.2,"input_scale":0.00392156862745098,"output_relu":false,"lr":0.01,"shrinkage":0.0,"seed":101,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"timeout_seconds":180,"gpu":"A100","precision":"fp32"},"history":[{"epoch":1,"stochastic_training_loss":0.3604459762573242,"dense_train_probe":{"loss":0.12472921142578125,"accuracy":0.9619,"n":10000},"validation":{"loss":0.148590869140625,"accuracy":0.9557,"n":10000},"training_seconds":0.715678534999995,"epoch_training_seconds":0.715678534999995,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[231,211,210,180,216,211,190,195,212,192]},{"epoch":5,"stochastic_training_loss":0.057525381445884705,"dense_train_probe":{"loss":0.02910301513671875,"accuracy":0.9907,"n":10000},"validation":{"loss":0.08925932006835938,"accuracy":0.9744,"n":10000},"training_seconds":3.465094186999977,"epoch_training_seconds":0.6850666560000036,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[219,209,224,176,221,204,197,186,222,190]},{"epoch":10,"stochastic_training_loss":0.02441594749689102,"dense_train_probe":{"loss":0.009862776947021484,"accuracy":0.9968,"n":10000},"validation":{"loss":0.083398388671875,"accuracy":0.9788,"n":10000},"training_seconds":6.944290984999981,"epoch_training_seconds":0.6877963849999844,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,211,222,176,216,211,191,188,213,198]},{"epoch":15,"stochastic_training_loss":0.017445523291826248,"dense_train_probe":{"loss":0.0023075422286987306,"accuracy":0.9994,"n":10000},"validation":{"loss":0.07943436889648438,"accuracy":0.9814,"n":10000},"training_seconds":10.387162182999987,"epoch_training_seconds":0.6851392650000037,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,225,180,213,211,190,183,216,200]},{"epoch":20,"stochastic_training_loss":0.009986862540245056,"dense_train_probe":{"loss":0.004295299530029297,"accuracy":0.9989,"n":10000},"validation":{"loss":0.09273493041992187,"accuracy":0.9816,"n":10000},"training_seconds":13.831537245999982,"epoch_training_seconds":0.6849333570000056,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,206,222,178,218,208,193,184,221,197]},{"epoch":25,"stochastic_training_loss":0.00652936240658164,"dense_train_probe":{"loss":0.0019501220703125,"accuracy":0.9995,"n":10000},"validation":{"loss":0.10688597412109375,"accuracy":0.9806,"n":10000},"training_seconds":17.313724899999983,"epoch_training_seconds":0.7275205480000011,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,208,225,180,216,204,195,182,219,199]},{"epoch":30,"stochastic_training_loss":0.0033768839202821255,"dense_train_probe":{"loss":0.00022832050323486327,"accuracy":1.0,"n":10000},"validation":{"loss":0.0996593994140625,"accuracy":0.9832,"n":10000},"training_seconds":20.755477320999944,"epoch_training_seconds":0.6850830839999844,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,213,220,185,220,204,193,189,211,193]},{"epoch":35,"stochastic_training_loss":0.004019336309283972,"dense_train_probe":{"loss":0.0014360698699951173,"accuracy":0.9995,"n":10000},"validation":{"loss":0.1151316162109375,"accuracy":0.9822,"n":10000},"training_seconds":24.20306704999993,"epoch_training_seconds":0.6850497920000009,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,210,222,178,217,203,192,187,221,196]},{"epoch":40,"stochastic_training_loss":0.0036756708286702633,"dense_train_probe":{"loss":0.0003495140075683594,"accuracy":1.0,"n":10000},"validation":{"loss":0.10215264892578126,"accuracy":0.984,"n":10000},"training_seconds":27.657142563999912,"epoch_training_seconds":0.6871618589999855,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[219,208,220,184,215,205,195,186,215,201]},{"epoch":45,"stochastic_training_loss":0.0025628043804317713,"dense_train_probe":{"loss":0.0009448660850524903,"accuracy":0.9998,"n":10000},"validation":{"loss":0.10894349365234375,"accuracy":0.9825,"n":10000},"training_seconds":31.08283062399991,"epoch_training_seconds":0.6850790679999932,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[219,209,220,180,213,205,194,188,223,197]},{"epoch":50,"stochastic_training_loss":0.0016433304408565164,"dense_train_probe":{"loss":4.7472965717315674e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.10234427490234375,"accuracy":0.9851,"n":10000},"training_seconds":34.51416002199986,"epoch_training_seconds":0.6907681799999921,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,209,218,180,219,206,192,186,218,198]},{"epoch":55,"stochastic_training_loss":0.0007957954658195376,"dense_train_probe":{"loss":0.0003577975034713745,"accuracy":0.9999,"n":10000},"validation":{"loss":0.1112574951171875,"accuracy":0.984,"n":10000},"training_seconds":37.96032887999988,"epoch_training_seconds":0.6850087489999908,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,211,222,181,218,209,192,185,214,196]},{"epoch":60,"stochastic_training_loss":0.0019827645737677813,"dense_train_probe":{"loss":0.0001274673104286194,"accuracy":1.0,"n":10000},"validation":{"loss":0.11488016357421875,"accuracy":0.9833,"n":10000},"training_seconds":41.412825429999856,"epoch_training_seconds":0.7062656549999815,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,213,220,179,217,205,191,188,214,200]},{"epoch":65,"stochastic_training_loss":0.003606598824262619,"dense_train_probe":{"loss":0.00015313947200775146,"accuracy":1.0,"n":10000},"validation":{"loss":0.09836180419921875,"accuracy":0.9837,"n":10000},"training_seconds":44.879656614999845,"epoch_training_seconds":0.6850403350000249,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[218,212,223,177,217,210,193,184,220,194]},{"epoch":70,"stochastic_training_loss":0.0019348855130374432,"dense_train_probe":{"loss":0.0002350288152694702,"accuracy":0.9999,"n":10000},"validation":{"loss":0.1117077880859375,"accuracy":0.9831,"n":10000},"training_seconds":48.31734579599987,"epoch_training_seconds":0.6937081670000111,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,221,180,215,208,192,189,216,195]},{"epoch":75,"stochastic_training_loss":0.0017133670626208186,"dense_train_probe":{"loss":3.1738775968551635e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.114454248046875,"accuracy":0.9836,"n":10000},"training_seconds":51.78764281699986,"epoch_training_seconds":0.6850897010000097,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[219,209,224,178,218,205,194,185,219,197]},{"epoch":80,"stochastic_training_loss":0.0005545763415284455,"dense_train_probe":{"loss":1.3777373731136322e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.1087165771484375,"accuracy":0.9858,"n":10000},"training_seconds":55.246680792999825,"epoch_training_seconds":0.6999602420000031,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,221,179,217,206,193,187,217,198]},{"epoch":85,"stochastic_training_loss":0.001349673722870648,"dense_train_probe":{"loss":0.0009677434921264649,"accuracy":0.9998,"n":10000},"validation":{"loss":0.10954296875,"accuracy":0.9834,"n":10000},"training_seconds":58.72637635999985,"epoch_training_seconds":0.7216071690000092,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[219,210,221,179,219,205,193,185,222,195]},{"epoch":90,"stochastic_training_loss":0.0007107535493560135,"dense_train_probe":{"loss":8.18755328655243e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.11548697509765625,"accuracy":0.9839,"n":10000},"training_seconds":62.15345138699985,"epoch_training_seconds":0.6859005809999985,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[219,208,221,182,214,206,195,185,217,201]},{"epoch":95,"stochastic_training_loss":0.0004315256664995104,"dense_train_probe":{"loss":2.123296856880188e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.10492158203125,"accuracy":0.9839,"n":10000},"training_seconds":65.59127778899983,"epoch_training_seconds":0.6850834789999851,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,211,217,185,214,206,194,186,216,199]},{"epoch":100,"stochastic_training_loss":0.00178746716119349,"dense_train_probe":{"loss":5.356653928756714e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.1133442626953125,"accuracy":0.983,"n":10000},"training_seconds":69.06684382699984,"epoch_training_seconds":0.6977953889999924,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,210,220,181,214,205,194,186,219,198]}],"best_epoch":15,"best_validation_loss":0.07943436889648438,"training_seconds":69.06684382699984,"total_run_seconds":70.44327690200001,"hardware":{"device":"cuda:0","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"e1efb33081a653eb2db13a44aa7d20f3f16925ea1dc8bc2e91ed2f639a3974ae","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[0,0,0,0],"final_train":{"loss":0.00013944978713989259,"accuracy":0.99996,"n":50000},"selected_train":{"loss":0.00284011474609375,"accuracy":0.99928,"n":50000},"final_test":{"loss":0.09737022094726562,"accuracy":0.9851,"n":10000,"wrong_indices":[115,247,320,340,381,445,447,449,495,582,619,646,720,947,956,1014,1039,1044,1112,1156,1192,1226,1232,1242,1247,1319,1328,1393,1395,1522,1527,1530,1549,1553,1554,1609,1681,1717,1790,1828,1878,1901,1941,2004,2024,2035,2043,2053,2098,2109,2130,2135,2182,2293,2369,2387,2406,2408,2422,2426,2488,2597,2607,2635,2648,2654,2877,2896,2921,2927,2939,2953,3005,3073,3225,3289,3388,3405,3422,3475,3503,3520,3558,3727,3776,3780,3808,3818,3853,3893,3906,3941,3976,3985,4065,4078,4140,4176,4201,4248,4289,4497,4536,4671,4740,4761,4807,4823,4860,4876,4879,4880,5199,5331,5457,5676,5936,5937,5955,5973,6011,6045,6059,6166,6173,6572,6597,6755,6783,7208,7259,7434,7964,8094,8408,8527,9009,9024,9587,9634,9664,9679,9729,9742,9745,9770,9792,9839,9858],"errors":149},"selected_test":{"loss":0.070423388671875,"accuracy":0.9849,"n":10000,"wrong_indices":[8,115,247,259,320,445,449,582,646,667,684,707,720,938,947,956,1014,1039,1112,1156,1182,1192,1226,1242,1247,1260,1319,1328,1393,1522,1527,1530,1549,1553,1609,1681,1754,1790,1878,1901,1911,1941,1987,2004,2035,2053,2070,2109,2130,2135,2272,2293,2387,2408,2447,2488,2597,2607,2654,2877,2896,2921,2927,2939,2953,2995,3073,3114,3117,3289,3422,3475,3503,3520,3558,3597,3776,3780,3808,3853,3893,3906,3941,3976,3985,4027,4065,4176,4199,4207,4248,4289,4487,4497,4578,4731,4740,4807,4823,4860,4880,4966,4990,5331,5457,5642,5676,5887,5936,5937,5973,5982,6011,6045,6059,6166,6555,6571,6597,6651,6755,6783,6847,7216,7259,7434,7902,7915,8061,8094,8277,8325,8408,8527,9009,9015,9019,9024,9280,9587,9634,9664,9729,9742,9745,9749,9770,9808,9839,9867,9944],"errors":151}},{"run_id":"graph-eval-residual_unit_dropout-s102","spec":{"run_id":"graph-eval-residual_unit_dropout-s102","stage":"evaluate","cohort":"main","recipe":"residual_unit_dropout","pmax":0.2,"input_scale":0.00392156862745098,"output_relu":false,"lr":0.01,"shrinkage":0.0,"seed":102,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"timeout_seconds":180,"gpu":"A100","precision":"fp32"},"history":[{"epoch":1,"stochastic_training_loss":0.3511812090873718,"dense_train_probe":{"loss":0.1178658935546875,"accuracy":0.9628,"n":10000},"validation":{"loss":0.1390599365234375,"accuracy":0.9598,"n":10000},"training_seconds":0.7098235199999863,"epoch_training_seconds":0.7098235199999863,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[219,209,217,182,219,215,198,183,201,205]},{"epoch":5,"stochastic_training_loss":0.05836861953139305,"dense_train_probe":{"loss":0.03005115661621094,"accuracy":0.9907,"n":10000},"validation":{"loss":0.0808576171875,"accuracy":0.9757,"n":10000},"training_seconds":3.4820775899999603,"epoch_training_seconds":0.6844296239999892,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[218,209,223,178,222,204,196,183,222,193]},{"epoch":10,"stochastic_training_loss":0.022163596004247665,"dense_train_probe":{"loss":0.01123970947265625,"accuracy":0.9965,"n":10000},"validation":{"loss":0.09164425659179687,"accuracy":0.9783,"n":10000},"training_seconds":6.934600053999958,"epoch_training_seconds":0.6940587290000053,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,211,220,177,214,202,196,191,219,196]},{"epoch":15,"stochastic_training_loss":0.018479302525520325,"dense_train_probe":{"loss":0.0034024448394775393,"accuracy":0.999,"n":10000},"validation":{"loss":0.07700753784179687,"accuracy":0.9824,"n":10000},"training_seconds":10.391320092999962,"epoch_training_seconds":0.6842057280000233,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,222,179,213,206,192,187,217,202]},{"epoch":20,"stochastic_training_loss":0.010381671600043774,"dense_train_probe":{"loss":0.00444824333190918,"accuracy":0.9986,"n":10000},"validation":{"loss":0.097434326171875,"accuracy":0.9794,"n":10000},"training_seconds":13.892637908999973,"epoch_training_seconds":0.7035776949999786,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,213,223,180,214,204,193,186,217,197]},{"epoch":25,"stochastic_training_loss":0.007329522166401148,"dense_train_probe":{"loss":0.003303656005859375,"accuracy":0.9994,"n":10000},"validation":{"loss":0.1080920166015625,"accuracy":0.9796,"n":10000},"training_seconds":17.314960618999976,"epoch_training_seconds":0.6843581150000091,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,212,223,177,220,205,194,188,215,193]},{"epoch":30,"stochastic_training_loss":0.00474544009193778,"dense_train_probe":{"loss":0.0006803538799285888,"accuracy":0.9998,"n":10000},"validation":{"loss":0.09758504638671875,"accuracy":0.9819,"n":10000},"training_seconds":20.776532512999978,"epoch_training_seconds":0.7031624029999932,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,209,222,177,214,208,194,186,219,199]},{"epoch":35,"stochastic_training_loss":0.004816781263798475,"dense_train_probe":{"loss":0.000432736873626709,"accuracy":0.9999,"n":10000},"validation":{"loss":0.10022122802734375,"accuracy":0.9829,"n":10000},"training_seconds":24.216930559999952,"epoch_training_seconds":0.6844128359999786,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,214,220,179,213,204,194,190,215,199]},{"epoch":40,"stochastic_training_loss":0.0030849305912852287,"dense_train_probe":{"loss":0.00018078025579452514,"accuracy":1.0,"n":10000},"validation":{"loss":0.1004294189453125,"accuracy":0.9829,"n":10000},"training_seconds":27.668425939999878,"epoch_training_seconds":0.6917399649999822,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[218,209,224,182,217,204,193,185,220,196]},{"epoch":45,"stochastic_training_loss":0.0033858497627079487,"dense_train_probe":{"loss":0.0009836664199829102,"accuracy":0.9999,"n":10000},"validation":{"loss":0.10263369140625,"accuracy":0.9841,"n":10000},"training_seconds":31.132338643999844,"epoch_training_seconds":0.6843685439999945,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,208,222,180,217,205,193,185,219,198]},{"epoch":50,"stochastic_training_loss":0.0019276710227131844,"dense_train_probe":{"loss":0.00014637192487716675,"accuracy":0.9999,"n":10000},"validation":{"loss":0.10760166015625,"accuracy":0.9834,"n":10000},"training_seconds":34.57187169999986,"epoch_training_seconds":0.6844605120000153,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,211,221,177,217,206,191,188,221,196]},{"epoch":55,"stochastic_training_loss":0.004356106743216515,"dense_train_probe":{"loss":0.0015942590713500977,"accuracy":0.9996,"n":10000},"validation":{"loss":0.11173795166015625,"accuracy":0.9815,"n":10000},"training_seconds":38.02701548899989,"epoch_training_seconds":0.6845968110000058,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,212,218,180,220,209,190,189,215,194]},{"epoch":60,"stochastic_training_loss":0.003369959071278572,"dense_train_probe":{"loss":0.000262353253364563,"accuracy":0.9999,"n":10000},"validation":{"loss":0.10130488891601562,"accuracy":0.9843,"n":10000},"training_seconds":41.47691041999988,"epoch_training_seconds":0.6994768679999765,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,212,221,181,217,206,192,187,216,196]},{"epoch":65,"stochastic_training_loss":0.0016719645354896784,"dense_train_probe":{"loss":8.077845573425293e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.113310986328125,"accuracy":0.984,"n":10000},"training_seconds":44.9101977629999,"epoch_training_seconds":0.6846613980000029,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,212,221,178,217,207,192,188,215,197]},{"epoch":70,"stochastic_training_loss":0.0026560472324490547,"dense_train_probe":{"loss":0.0002336331844329834,"accuracy":0.9999,"n":10000},"validation":{"loss":0.11304227294921874,"accuracy":0.984,"n":10000},"training_seconds":48.356172317999864,"epoch_training_seconds":0.6922300489999884,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,210,219,180,215,208,192,184,221,198]},{"epoch":75,"stochastic_training_loss":0.0018620564369484782,"dense_train_probe":{"loss":0.00017809244394302367,"accuracy":0.9999,"n":10000},"validation":{"loss":0.120904833984375,"accuracy":0.9841,"n":10000},"training_seconds":51.78693957399986,"epoch_training_seconds":0.6844234259999951,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,223,182,218,204,192,188,213,196]},{"epoch":80,"stochastic_training_loss":0.0007864119252189994,"dense_train_probe":{"loss":5.4099762439727786e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.1141373046875,"accuracy":0.9844,"n":10000},"training_seconds":55.223878123999896,"epoch_training_seconds":0.6991419280000173,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[219,210,222,182,215,204,193,186,217,200]},{"epoch":85,"stochastic_training_loss":0.0006016411352902651,"dense_train_probe":{"loss":3.794419467449188e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.1182548095703125,"accuracy":0.9848,"n":10000},"training_seconds":58.661386982999886,"epoch_training_seconds":0.6842189300000143,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,220,181,215,204,194,186,218,198]},{"epoch":90,"stochastic_training_loss":0.0010423925705254078,"dense_train_probe":{"loss":0.00012409214973449706,"accuracy":0.9999,"n":10000},"validation":{"loss":0.1225460205078125,"accuracy":0.9854,"n":10000},"training_seconds":62.10278155699987,"epoch_training_seconds":0.6845054659999903,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,212,223,180,213,206,194,184,217,199]},{"epoch":95,"stochastic_training_loss":0.001308679347857833,"dense_train_probe":{"loss":0.0004935344219207763,"accuracy":0.9999,"n":10000},"validation":{"loss":0.123772802734375,"accuracy":0.9841,"n":10000},"training_seconds":65.5483274819999,"epoch_training_seconds":0.6896649299999922,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,212,220,179,216,208,193,189,216,195]},{"epoch":100,"stochastic_training_loss":0.00023923903063405305,"dense_train_probe":{"loss":3.8077834993600845e-06,"accuracy":1.0,"n":10000},"validation":{"loss":0.12150003662109375,"accuracy":0.9848,"n":10000},"training_seconds":68.9706536939999,"epoch_training_seconds":0.6846843829999898,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,212,220,182,215,204,193,187,217,197]}],"best_epoch":15,"best_validation_loss":0.07700753784179687,"training_seconds":68.9706536939999,"total_run_seconds":70.302410441,"hardware":{"device":"cuda:0","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"4d0ac269167486811a0086108ca56313016afcebfc075d45e09455c228dee75b","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[0,0,0,0],"final_train":{"loss":4.563659131526947e-06,"accuracy":1.0,"n":50000},"selected_train":{"loss":0.0042043408203125,"accuracy":0.9989,"n":50000},"final_test":{"loss":0.10340599365234375,"accuracy":0.9862,"n":10000,"wrong_indices":[115,151,247,259,340,445,449,495,582,646,720,844,877,883,947,956,1014,1039,1112,1156,1192,1226,1232,1242,1247,1319,1328,1393,1395,1522,1530,1549,1681,1717,1901,1941,2004,2035,2053,2093,2098,2109,2130,2135,2182,2293,2369,2387,2408,2462,2488,2597,2607,2648,2654,2720,2877,2921,2927,2939,2953,3073,3117,3225,3289,3422,3475,3503,3520,3558,3662,3776,3780,3808,3893,3906,3941,3985,4065,4078,4176,4248,4437,4497,4639,4671,4731,4807,4823,4880,4978,5331,5457,5642,5676,5734,5887,5936,5937,5955,5973,6011,6023,6045,6059,6166,6555,6576,6597,6598,6651,6755,6783,7259,7434,7451,7849,8094,8246,8325,8408,8527,9009,9015,9019,9024,9587,9634,9664,9679,9729,9745,9749,9770,9792,9808,9839,9888],"errors":138},"selected_test":{"loss":0.07600043334960938,"accuracy":0.9828,"n":10000,"wrong_indices":[151,233,247,259,321,445,447,449,582,583,646,659,691,720,844,846,877,1014,1039,1044,1112,1156,1192,1224,1226,1242,1247,1260,1319,1328,1393,1414,1444,1494,1522,1530,1549,1569,1717,1721,1782,1790,1850,1878,1901,1911,1941,1987,2004,2024,2053,2073,2098,2109,2118,2130,2135,2148,2224,2272,2293,2369,2387,2422,2426,2488,2597,2607,2630,2648,2654,2720,2863,2877,2896,2915,2921,2927,2939,2953,2990,3030,3117,3172,3225,3289,3422,3503,3520,3533,3558,3597,3727,3776,3780,3808,3818,3853,3893,3906,3941,3968,3976,3985,4007,4027,4065,4116,4176,4199,4248,4289,4374,4497,4536,4578,4740,4807,4823,4876,4880,4966,5046,5140,5331,5457,5547,5600,5642,5676,5734,5887,5937,5955,5973,5982,6011,6023,6035,6059,6555,6576,6597,6625,6755,6783,7216,7434,7886,8094,8294,8321,8325,8408,8456,8527,9009,9024,9587,9634,9664,9669,9679,9729,9742,9745,9770,9792,9839,9922,9944,9975],"errors":172}},{"run_id":"graph-eval-residual_unit_dropout-s103","spec":{"run_id":"graph-eval-residual_unit_dropout-s103","stage":"evaluate","cohort":"main","recipe":"residual_unit_dropout","pmax":0.2,"input_scale":0.00392156862745098,"output_relu":false,"lr":0.01,"shrinkage":0.0,"seed":103,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"timeout_seconds":180,"gpu":"A100","precision":"fp32"},"history":[{"epoch":1,"stochastic_training_loss":0.3533483147621155,"dense_train_probe":{"loss":0.1174819091796875,"accuracy":0.9625,"n":10000},"validation":{"loss":0.13878890380859374,"accuracy":0.9583,"n":10000},"training_seconds":0.719369348000015,"epoch_training_seconds":0.719369348000015,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[224,211,222,173,220,220,190,188,210,190]},{"epoch":5,"stochastic_training_loss":0.05556783080101013,"dense_train_probe":{"loss":0.03767455749511719,"accuracy":0.9883,"n":10000},"validation":{"loss":0.101563818359375,"accuracy":0.9725,"n":10000},"training_seconds":3.482334476000034,"epoch_training_seconds":0.6866591950000043,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[219,208,230,181,219,213,194,187,207,190]},{"epoch":10,"stochastic_training_loss":0.023269619792699814,"dense_train_probe":{"loss":0.006542992401123047,"accuracy":0.9979,"n":10000},"validation":{"loss":0.07913580322265625,"accuracy":0.9802,"n":10000},"training_seconds":6.922194121000075,"epoch_training_seconds":0.6865447840000058,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,208,218,178,218,205,195,186,218,201]},{"epoch":15,"stochastic_training_loss":0.012058431282639503,"dense_train_probe":{"loss":0.004400091934204101,"accuracy":0.9985,"n":10000},"validation":{"loss":0.0872943603515625,"accuracy":0.9802,"n":10000},"training_seconds":10.387098715000064,"epoch_training_seconds":0.7006627979999962,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,206,225,175,216,207,193,181,223,201]},{"epoch":20,"stochastic_training_loss":0.008840391412377357,"dense_train_probe":{"loss":0.007462289428710938,"accuracy":0.9977,"n":10000},"validation":{"loss":0.1118962890625,"accuracy":0.9796,"n":10000},"training_seconds":13.834950009000067,"epoch_training_seconds":0.6865717309999866,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,205,222,177,220,206,192,188,223,195]},{"epoch":25,"stochastic_training_loss":0.007807475980371237,"dense_train_probe":{"loss":0.0009270092010498046,"accuracy":0.9997,"n":10000},"validation":{"loss":0.095213671875,"accuracy":0.9826,"n":10000},"training_seconds":17.33516469500009,"epoch_training_seconds":0.6902690930000119,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[219,210,220,180,216,203,197,187,220,196]},{"epoch":30,"stochastic_training_loss":0.005465653724968433,"dense_train_probe":{"loss":0.002111593246459961,"accuracy":0.9996,"n":10000},"validation":{"loss":0.10863978271484374,"accuracy":0.9811,"n":10000},"training_seconds":20.768279992000117,"epoch_training_seconds":0.6865039090000096,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[219,208,219,181,214,206,193,193,222,193]},{"epoch":35,"stochastic_training_loss":0.00545171182602644,"dense_train_probe":{"loss":0.0017628700256347657,"accuracy":0.9998,"n":10000},"validation":{"loss":0.11723692626953125,"accuracy":0.9799,"n":10000},"training_seconds":24.208748830000133,"epoch_training_seconds":0.6947334869999793,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,212,221,175,217,208,191,188,214,201]},{"epoch":40,"stochastic_training_loss":0.002278139814734459,"dense_train_probe":{"loss":0.0016375225067138672,"accuracy":0.9995,"n":10000},"validation":{"loss":0.10998602294921875,"accuracy":0.9815,"n":10000},"training_seconds":27.661776982000077,"epoch_training_seconds":0.6866484899999818,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,212,222,181,215,201,195,186,217,199]},{"epoch":45,"stochastic_training_loss":0.0028890783432871103,"dense_train_probe":{"loss":0.00036949057579040525,"accuracy":0.9999,"n":10000},"validation":{"loss":0.1030281005859375,"accuracy":0.9831,"n":10000},"training_seconds":31.128705754000066,"epoch_training_seconds":0.6866704809999931,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,209,227,179,217,205,193,184,217,196]},{"epoch":50,"stochastic_training_loss":0.003120899200439453,"dense_train_probe":{"loss":0.0004188443660736084,"accuracy":0.9999,"n":10000},"validation":{"loss":0.1075563720703125,"accuracy":0.9844,"n":10000},"training_seconds":34.575778934000084,"epoch_training_seconds":0.6865872120000063,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,208,219,179,215,209,193,186,219,199]},{"epoch":55,"stochastic_training_loss":0.0017385422252118587,"dense_train_probe":{"loss":0.0002705559492111206,"accuracy":0.9999,"n":10000},"validation":{"loss":0.1031611328125,"accuracy":0.9845,"n":10000},"training_seconds":38.01364946600006,"epoch_training_seconds":0.6864109879999774,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,210,219,179,216,207,194,187,219,197]},{"epoch":60,"stochastic_training_loss":0.0025244562420994043,"dense_train_probe":{"loss":0.0003531423330307007,"accuracy":0.9999,"n":10000},"validation":{"loss":0.119424853515625,"accuracy":0.9817,"n":10000},"training_seconds":41.461560439000095,"epoch_training_seconds":0.6866098660000262,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[220,213,220,182,219,203,195,185,215,196]},{"epoch":65,"stochastic_training_loss":0.0026245617773383856,"dense_train_probe":{"loss":0.00014279558658599853,"accuracy":1.0,"n":10000},"validation":{"loss":0.1239729248046875,"accuracy":0.9819,"n":10000},"training_seconds":44.92279582000006,"epoch_training_seconds":0.6944833399999766,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,211,225,178,221,205,192,185,216,194]},{"epoch":70,"stochastic_training_loss":0.0005798874190077186,"dense_train_probe":{"loss":5.0383687019348145e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.1101016845703125,"accuracy":0.9831,"n":10000},"training_seconds":48.363213133000045,"epoch_training_seconds":0.6866157089999945,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[219,211,222,182,217,203,193,187,218,196]},{"epoch":75,"stochastic_training_loss":0.0009865766623988748,"dense_train_probe":{"loss":0.00030260617733001707,"accuracy":0.9999,"n":10000},"validation":{"loss":0.1349580322265625,"accuracy":0.9817,"n":10000},"training_seconds":51.797363793000045,"epoch_training_seconds":0.6869026109999936,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[223,210,223,178,214,205,193,188,215,199]},{"epoch":80,"stochastic_training_loss":0.002238103887066245,"dense_train_probe":{"loss":4.125906825065613e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.112013720703125,"accuracy":0.9842,"n":10000},"training_seconds":55.23538033400004,"epoch_training_seconds":0.68952074500001,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[221,208,222,179,214,206,192,187,220,199]},{"epoch":85,"stochastic_training_loss":0.0013910429552197456,"dense_train_probe":{"loss":0.00020040490627288817,"accuracy":0.9999,"n":10000},"validation":{"loss":0.11203746337890624,"accuracy":0.9836,"n":10000},"training_seconds":58.701351844000044,"epoch_training_seconds":0.6864861180000048,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[224,211,220,176,213,207,192,187,217,201]},{"epoch":90,"stochastic_training_loss":0.00120515504386276,"dense_train_probe":{"loss":1.3425186276435851e-05,"accuracy":1.0,"n":10000},"validation":{"loss":0.1110240966796875,"accuracy":0.9838,"n":10000},"training_seconds":62.15321981500006,"epoch_training_seconds":0.6959158589999959,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,211,222,180,217,205,193,185,218,195]},{"epoch":95,"stochastic_training_loss":0.0020452486351132393,"dense_train_probe":{"loss":0.0006800207614898682,"accuracy":0.9998,"n":10000},"validation":{"loss":0.1266265380859375,"accuracy":0.9819,"n":10000},"training_seconds":65.5945438390001,"epoch_training_seconds":0.6867359330000227,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[223,211,218,182,215,203,194,188,216,198]},{"epoch":100,"stochastic_training_loss":0.0007256848039105535,"dense_train_probe":{"loss":0.0022846445083618164,"accuracy":0.9994,"n":10000},"validation":{"loss":0.13693134765625,"accuracy":0.9814,"n":10000},"training_seconds":69.05123090900008,"epoch_training_seconds":0.6909601970000097,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.0,"validation_probe_prediction_counts":[222,216,215,179,220,207,193,187,215,194]}],"best_epoch":10,"best_validation_loss":0.07913580322265625,"training_seconds":69.05123090900008,"total_run_seconds":70.41408692899998,"hardware":{"device":"cuda:0","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"316aa46c9e0a65fa375b579be0871a16f447d396fe64f85e2063ee6ef8c8dd5d","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[0,0,0,0],"final_train":{"loss":0.004401022338867188,"accuracy":0.99904,"n":50000},"selected_train":{"loss":0.00696410400390625,"accuracy":0.99766,"n":50000},"final_test":{"loss":0.1084447509765625,"accuracy":0.9839,"n":10000,"wrong_indices":[247,321,381,445,449,456,495,583,646,659,720,947,1014,1039,1044,1112,1156,1181,1192,1194,1226,1232,1242,1247,1299,1311,1319,1393,1395,1500,1522,1530,1549,1553,1570,1609,1642,1681,1717,1754,1871,1878,1901,1941,1984,1987,2004,2024,2035,2053,2093,2098,2109,2130,2135,2272,2293,2387,2408,2414,2426,2433,2462,2488,2597,2607,2648,2654,2720,2863,2877,2921,2939,2953,3114,3225,3422,3475,3503,3520,3558,3776,3780,3796,3808,3818,3838,3853,3906,3941,3976,3985,3986,4065,4156,4163,4176,4199,4201,4205,4248,4289,4350,4360,4497,4500,4504,4536,4633,4668,4671,4740,4761,4807,4823,4880,4966,5331,5457,5634,5642,5734,5936,5937,5955,5972,5973,5997,6011,6023,6030,6059,6166,6555,6597,6632,6755,6817,7434,7886,8059,8069,8091,8094,8246,8325,8408,8527,9009,9024,9587,9634,9664,9669,9679,9729,9770,9792,9808,9839,9847],"errors":161},"selected_test":{"loss":0.06777940673828126,"accuracy":0.9822,"n":10000,"wrong_indices":[115,149,247,321,381,445,447,449,495,582,583,646,659,674,707,720,740,947,951,956,1014,1039,1044,1112,1156,1194,1226,1242,1247,1319,1328,1356,1378,1393,1395,1414,1444,1522,1530,1549,1569,1609,1678,1681,1901,1941,1984,1987,2004,2024,2035,2044,2053,2063,2098,2109,2118,2125,2130,2135,2148,2224,2293,2369,2387,2405,2408,2488,2597,2607,2648,2654,2730,2743,2877,2921,2927,2939,2953,3012,3030,3073,3117,3225,3422,3475,3503,3520,3533,3558,3681,3780,3796,3808,3838,3853,3876,3893,3906,3941,3946,3985,4065,4156,4201,4248,4271,4289,4350,4497,4504,4536,4571,4578,4639,4668,4740,4807,4876,4880,4956,4966,5331,5450,5457,5600,5634,5642,5676,5936,5937,5955,5973,5982,6011,6023,6030,6045,6046,6059,6555,6572,6597,6621,6625,6755,6783,7216,7434,8094,8115,8246,8277,8290,8311,8325,8339,8522,8527,8584,9009,9015,9024,9168,9280,9500,9587,9634,9664,9669,9679,9729,9742,9768,9770,9811,9839,9867],"errors":178}},{"run_id":"graph-fidelity-source-plain-s101","spec":{"run_id":"graph-fidelity-source-plain-s101","stage":"evaluate","cohort":"fidelity","variant":"source-plain","recipe":"plain","pmax":0.0,"input_scale":1.0,"output_relu":true,"lr":0.001,"momentum":0.9,"shrinkage":2e-05,"seed":101,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"timeout_seconds":180,"gpu":"A100","precision":"fp32"},"history":[{"epoch":1,"stochastic_training_loss":0.5163975358009338,"dense_train_probe":{"loss":0.1294001953125,"accuracy":0.9628,"n":10000},"validation":{"loss":0.162353076171875,"accuracy":0.9515,"n":10000},"training_seconds":0.7062708509999993,"epoch_training_seconds":0.7062708509999993,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.3997558653354645,"validation_probe_prediction_counts":[230,210,222,198,205,201,187,201,198,196]},{"epoch":5,"stochastic_training_loss":0.019349519163370132,"dense_train_probe":{"loss":0.012327566528320313,"accuracy":0.9978,"n":10000},"validation":{"loss":0.08671405029296875,"accuracy":0.9759,"n":10000},"training_seconds":3.430855912000027,"epoch_training_seconds":0.6811440540000149,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.38164064288139343,"validation_probe_prediction_counts":[223,210,224,179,220,206,192,185,218,191]},{"epoch":10,"stochastic_training_loss":0.001955068204551935,"dense_train_probe":{"loss":0.0020642864227294923,"accuracy":0.9999,"n":10000},"validation":{"loss":0.07419190673828124,"accuracy":0.9799,"n":10000},"training_seconds":6.837041830999993,"epoch_training_seconds":0.681060384999995,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.423095703125,"validation_probe_prediction_counts":[221,211,223,183,215,206,192,184,216,197]},{"epoch":15,"stochastic_training_loss":0.0019414661219343543,"dense_train_probe":{"loss":0.0019061067581176757,"accuracy":1.0,"n":10000},"validation":{"loss":0.0742111572265625,"accuracy":0.9807,"n":10000},"training_seconds":10.243587533999943,"epoch_training_seconds":0.6812113959999806,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.4202636778354645,"validation_probe_prediction_counts":[221,211,223,183,211,206,192,185,217,199]},{"epoch":20,"stochastic_training_loss":0.0020863390527665615,"dense_train_probe":{"loss":0.0019419858932495117,"accuracy":1.0,"n":10000},"validation":{"loss":0.0721573974609375,"accuracy":0.9799,"n":10000},"training_seconds":13.649988165999986,"epoch_training_seconds":0.6812150089999989,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.42460939288139343,"validation_probe_prediction_counts":[221,211,221,182,214,207,193,185,217,197]},{"epoch":25,"stochastic_training_loss":0.002181555377319455,"dense_train_probe":{"loss":0.0019953866958618166,"accuracy":1.0,"n":10000},"validation":{"loss":0.072332568359375,"accuracy":0.9794,"n":10000},"training_seconds":17.05652102100001,"epoch_training_seconds":0.6813584909999975,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.42631837725639343,"validation_probe_prediction_counts":[221,211,221,183,214,205,194,185,217,197]},{"epoch":30,"stochastic_training_loss":0.0021653587464243174,"dense_train_probe":{"loss":0.002265719985961914,"accuracy":1.0,"n":10000},"validation":{"loss":0.07486793212890624,"accuracy":0.9806,"n":10000},"training_seconds":20.462736551000035,"epoch_training_seconds":0.6812536500000022,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.4256347715854645,"validation_probe_prediction_counts":[222,208,221,183,214,204,191,186,222,197]},{"epoch":35,"stochastic_training_loss":0.002219513989984989,"dense_train_probe":{"loss":0.001986318588256836,"accuracy":1.0,"n":10000},"validation":{"loss":0.07321603393554688,"accuracy":0.9798,"n":10000},"training_seconds":23.869440758000025,"epoch_training_seconds":0.6813050099999884,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.424072265625,"validation_probe_prediction_counts":[221,211,222,182,217,206,193,185,216,195]},{"epoch":40,"stochastic_training_loss":0.0022382098250091076,"dense_train_probe":{"loss":0.002112250328063965,"accuracy":1.0,"n":10000},"validation":{"loss":0.07277801513671875,"accuracy":0.9791,"n":10000},"training_seconds":27.276621852000034,"epoch_training_seconds":0.6812490540000056,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.4198242127895355,"validation_probe_prediction_counts":[221,211,222,181,215,209,193,185,215,196]},{"epoch":45,"stochastic_training_loss":0.0024631868582218885,"dense_train_probe":{"loss":0.0027466629028320313,"accuracy":1.0,"n":10000},"validation":{"loss":0.0764109619140625,"accuracy":0.9782,"n":10000},"training_seconds":30.68314967500001,"epoch_training_seconds":0.6810873639999784,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.4224609434604645,"validation_probe_prediction_counts":[221,211,222,182,214,211,192,186,212,197]},{"epoch":50,"stochastic_training_loss":0.002105953637510538,"dense_train_probe":{"loss":0.0013691188812255859,"accuracy":1.0,"n":10000},"validation":{"loss":0.07054011840820312,"accuracy":0.9811,"n":10000},"training_seconds":34.090737864999994,"epoch_training_seconds":0.6811537520000002,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.43110352754592896,"validation_probe_prediction_counts":[221,208,221,182,213,209,192,185,218,199]},{"epoch":55,"stochastic_training_loss":0.001683643669821322,"dense_train_probe":{"loss":0.0015659025192260741,"accuracy":1.0,"n":10000},"validation":{"loss":0.0684181640625,"accuracy":0.9806,"n":10000},"training_seconds":37.49954679099997,"epoch_training_seconds":0.6811077979999993,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.4154296815395355,"validation_probe_prediction_counts":[221,211,220,184,215,205,193,185,217,197]},{"epoch":60,"stochastic_training_loss":0.001946677453815937,"dense_train_probe":{"loss":0.0020700408935546877,"accuracy":1.0,"n":10000},"validation":{"loss":0.07433489990234375,"accuracy":0.9797,"n":10000},"training_seconds":40.906334877000006,"epoch_training_seconds":0.6814035550000028,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.4156738221645355,"validation_probe_prediction_counts":[222,211,223,185,215,205,191,186,215,195]},{"epoch":65,"stochastic_training_loss":0.0019393987022340298,"dense_train_probe":{"loss":0.0020453712463378904,"accuracy":1.0,"n":10000},"validation":{"loss":0.072823486328125,"accuracy":0.9797,"n":10000},"training_seconds":44.315733854,"epoch_training_seconds":0.6811549660000082,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.41279298067092896,"validation_probe_prediction_counts":[221,212,224,185,215,205,191,185,214,196]},{"epoch":70,"stochastic_training_loss":0.01025824248790741,"dense_train_probe":{"loss":0.021397216796875,"accuracy":0.993,"n":10000},"validation":{"loss":0.10565966796875,"accuracy":0.9711,"n":10000},"training_seconds":47.74520042000003,"epoch_training_seconds":0.6812466809999762,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.43413087725639343,"validation_probe_prediction_counts":[217,215,218,170,223,222,193,187,215,188]},{"epoch":75,"stochastic_training_loss":0.0011934532085433602,"dense_train_probe":{"loss":0.0011584625244140626,"accuracy":1.0,"n":10000},"validation":{"loss":0.06670652465820312,"accuracy":0.981,"n":10000},"training_seconds":51.15088855100001,"epoch_training_seconds":0.6809720630000129,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.41279298067092896,"validation_probe_prediction_counts":[221,211,220,184,214,207,192,186,216,197]},{"epoch":80,"stochastic_training_loss":0.0016695677768439054,"dense_train_probe":{"loss":0.0015338704109191894,"accuracy":1.0,"n":10000},"validation":{"loss":0.06852384033203125,"accuracy":0.9799,"n":10000},"training_seconds":54.55683349300003,"epoch_training_seconds":0.6810147150000034,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.4091796875,"validation_probe_prediction_counts":[221,212,220,185,215,207,191,186,214,197]},{"epoch":85,"stochastic_training_loss":0.001824364298954606,"dense_train_probe":{"loss":0.0017868942260742188,"accuracy":1.0,"n":10000},"validation":{"loss":0.06837960205078125,"accuracy":0.9809,"n":10000},"training_seconds":57.96253352800002,"epoch_training_seconds":0.6812479920000101,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.406982421875,"validation_probe_prediction_counts":[221,211,224,183,215,205,193,184,216,196]},{"epoch":90,"stochastic_training_loss":0.001812959904782474,"dense_train_probe":{"loss":0.0016808847427368164,"accuracy":1.0,"n":10000},"validation":{"loss":0.069124267578125,"accuracy":0.9801,"n":10000},"training_seconds":61.36852208299996,"epoch_training_seconds":0.6810839609999846,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.4056640565395355,"validation_probe_prediction_counts":[221,212,220,184,214,205,193,187,215,197]},{"epoch":95,"stochastic_training_loss":0.007781030144542456,"dense_train_probe":{"loss":0.0056186393737792965,"accuracy":0.9987,"n":10000},"validation":{"loss":0.0833590087890625,"accuracy":0.9772,"n":10000},"training_seconds":64.77413286899994,"epoch_training_seconds":0.6810909200000026,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.424560546875,"validation_probe_prediction_counts":[221,211,229,183,213,206,190,182,215,198]},{"epoch":100,"stochastic_training_loss":0.001167256967164576,"dense_train_probe":{"loss":0.0011736854553222656,"accuracy":1.0,"n":10000},"validation":{"loss":0.06887960205078125,"accuracy":0.9814,"n":10000},"training_seconds":68.18079109299993,"epoch_training_seconds":0.6813200670000015,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.4041503965854645,"validation_probe_prediction_counts":[221,210,221,182,216,204,192,185,220,197]}],"best_epoch":75,"best_validation_loss":0.06670652465820312,"training_seconds":68.18079109299993,"total_run_seconds":70.683689947,"hardware":{"device":"cuda:0","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"e1efb33081a653eb2db13a44aa7d20f3f16925ea1dc8bc2e91ed2f639a3974ae","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[0,0,0,0],"final_train":{"loss":0.001150615997314453,"accuracy":1.0,"n":50000},"selected_train":{"loss":0.0011725679016113281,"accuracy":1.0,"n":50000},"final_test":{"loss":0.06090704956054688,"accuracy":0.9828,"n":10000,"wrong_indices":[149,241,247,259,321,340,381,445,449,495,551,582,619,646,659,684,720,938,947,951,956,965,1014,1039,1112,1156,1178,1192,1224,1226,1232,1242,1247,1299,1319,1328,1393,1444,1500,1522,1530,1549,1569,1681,1717,1754,1901,1941,1984,1987,2004,2024,2035,2043,2053,2098,2109,2130,2135,2182,2272,2293,2387,2408,2414,2422,2426,2488,2597,2607,2648,2654,2760,2863,2896,2915,2921,2927,2939,2953,2979,3073,3117,3189,3422,3503,3520,3533,3549,3558,3727,3751,3776,3780,3808,3818,3838,3893,3906,3941,3943,3976,3985,4065,4078,4163,4199,4248,4497,4500,4504,4536,4601,4731,4740,4761,4807,4814,4823,4880,4966,5078,5331,5457,5642,5676,5936,5937,5955,5973,5982,6011,6023,6045,6046,6059,6555,6560,6571,6576,6597,6608,6651,6755,6783,6847,7216,7268,7434,8094,8246,8277,8325,8408,8527,9009,9015,9019,9024,9587,9634,9664,9669,9679,9692,9729,9745,9768,9770,9779,9839,9944],"errors":172},"selected_test":{"loss":0.05650311889648438,"accuracy":0.9834,"n":10000,"wrong_indices":[149,151,247,259,321,340,445,449,495,582,646,659,684,691,720,938,947,951,956,965,1014,1039,1112,1156,1178,1192,1226,1232,1242,1247,1299,1319,1328,1393,1444,1500,1522,1530,1549,1569,1681,1754,1901,1941,1984,1987,2024,2044,2053,2070,2098,2109,2130,2135,2182,2272,2293,2387,2408,2414,2422,2488,2597,2607,2648,2654,2896,2915,2927,2939,2953,3073,3117,3422,3503,3520,3533,3549,3558,3597,3727,3767,3776,3780,3808,3818,3838,3853,3893,3906,3941,3943,3976,3985,4065,4075,4078,4163,4176,4199,4201,4248,4289,4497,4504,4536,4578,4639,4731,4740,4761,4807,4814,4823,4860,4880,4966,5331,5457,5642,5676,5734,5936,5937,5955,5973,5982,6011,6045,6046,6059,6532,6555,6571,6576,6597,6608,6651,6755,6783,6847,7216,7434,8094,8246,8325,8408,8519,8527,9009,9015,9019,9024,9280,9587,9634,9664,9669,9679,9729,9745,9768,9770,9779,9839,9944],"errors":166}},{"run_id":"graph-fidelity-source-plain-s102","spec":{"run_id":"graph-fidelity-source-plain-s102","stage":"evaluate","cohort":"fidelity","variant":"source-plain","recipe":"plain","pmax":0.0,"input_scale":1.0,"output_relu":true,"lr":0.001,"momentum":0.9,"shrinkage":2e-05,"seed":102,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"timeout_seconds":180,"gpu":"A100","precision":"fp32"},"history":[{"epoch":1,"stochastic_training_loss":0.5795682668685913,"dense_train_probe":{"loss":0.3757917236328125,"accuracy":0.8543,"n":10000},"validation":{"loss":0.3798895751953125,"accuracy":0.8547,"n":10000},"training_seconds":0.6949002079999786,"epoch_training_seconds":0.6949002079999786,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.5492187738418579,"validation_probe_prediction_counts":[416,0,218,203,208,215,193,181,200,214]},{"epoch":5,"stochastic_training_loss":0.2795098125934601,"dense_train_probe":{"loss":0.286519091796875,"accuracy":0.8787,"n":10000},"validation":{"loss":0.3269234375,"accuracy":0.8699,"n":10000},"training_seconds":3.414441257999954,"epoch_training_seconds":0.6798291559999825,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.625244140625,"validation_probe_prediction_counts":[417,0,220,182,217,207,196,186,233,190]},{"epoch":10,"stochastic_training_loss":0.2639484107494354,"dense_train_probe":{"loss":0.2732464599609375,"accuracy":0.8821,"n":10000},"validation":{"loss":0.3144971923828125,"accuracy":0.8752,"n":10000},"training_seconds":6.814492010999999,"epoch_training_seconds":0.6798916340000005,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.642822265625,"validation_probe_prediction_counts":[420,0,224,179,215,208,194,187,220,201]},{"epoch":15,"stochastic_training_loss":0.2638857364654541,"dense_train_probe":{"loss":0.273230078125,"accuracy":0.8821,"n":10000},"validation":{"loss":0.314177587890625,"accuracy":0.8758,"n":10000},"training_seconds":10.214518656999985,"epoch_training_seconds":0.6799822710000001,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.6451660394668579,"validation_probe_prediction_counts":[418,0,224,180,215,208,196,186,220,201]},{"epoch":20,"stochastic_training_loss":0.26376551389694214,"dense_train_probe":{"loss":0.27327021484375,"accuracy":0.8821,"n":10000},"validation":{"loss":0.312763623046875,"accuracy":0.8762,"n":10000},"training_seconds":13.61439546599999,"epoch_training_seconds":0.6798515540000096,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.6504883170127869,"validation_probe_prediction_counts":[421,0,225,181,216,205,193,186,222,199]},{"epoch":25,"stochastic_training_loss":0.2640514075756073,"dense_train_probe":{"loss":0.2730520263671875,"accuracy":0.8823,"n":10000},"validation":{"loss":0.311465283203125,"accuracy":0.8755,"n":10000},"training_seconds":17.014430619999985,"epoch_training_seconds":0.6798818850000146,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.6529297232627869,"validation_probe_prediction_counts":[413,0,224,178,221,208,195,189,221,199]},{"epoch":30,"stochastic_training_loss":0.26356086134910583,"dense_train_probe":{"loss":0.2727953857421875,"accuracy":0.8823,"n":10000},"validation":{"loss":0.31158154296875,"accuracy":0.8761,"n":10000},"training_seconds":20.414131991999966,"epoch_training_seconds":0.6798792599999786,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.642333984375,"validation_probe_prediction_counts":[420,0,224,179,216,207,193,186,224,199]},{"epoch":35,"stochastic_training_loss":0.26355263590812683,"dense_train_probe":{"loss":0.272621826171875,"accuracy":0.8824,"n":10000},"validation":{"loss":0.3114080810546875,"accuracy":0.8764,"n":10000},"training_seconds":23.814353749999952,"epoch_training_seconds":0.6799527750000038,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.648681640625,"validation_probe_prediction_counts":[419,0,223,181,216,205,195,187,223,199]},{"epoch":40,"stochastic_training_loss":0.2636716961860657,"dense_train_probe":{"loss":0.2726168701171875,"accuracy":0.8824,"n":10000},"validation":{"loss":0.311942236328125,"accuracy":0.8755,"n":10000},"training_seconds":27.21463111899996,"epoch_training_seconds":0.6798664849999909,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.6455078125,"validation_probe_prediction_counts":[416,0,225,181,217,206,194,187,223,199]},{"epoch":45,"stochastic_training_loss":0.26314908266067505,"dense_train_probe":{"loss":0.27181962890625,"accuracy":0.8825,"n":10000},"validation":{"loss":0.311260986328125,"accuracy":0.8764,"n":10000},"training_seconds":30.614664930000004,"epoch_training_seconds":0.6799170550000042,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.655566394329071,"validation_probe_prediction_counts":[422,0,226,178,215,206,194,186,222,199]},{"epoch":50,"stochastic_training_loss":0.2629830837249756,"dense_train_probe":{"loss":0.2721522216796875,"accuracy":0.8825,"n":10000},"validation":{"loss":0.3086169921875,"accuracy":0.8764,"n":10000},"training_seconds":34.01507250700001,"epoch_training_seconds":0.6799203790000092,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.654980480670929,"validation_probe_prediction_counts":[416,0,222,177,219,211,194,188,223,198]},{"epoch":55,"stochastic_training_loss":0.2633429169654846,"dense_train_probe":{"loss":0.27219775390625,"accuracy":0.8825,"n":10000},"validation":{"loss":0.3109256103515625,"accuracy":0.8763,"n":10000},"training_seconds":37.415144294000015,"epoch_training_seconds":0.679987495000006,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.643750011920929,"validation_probe_prediction_counts":[418,0,224,179,216,210,192,187,223,199]},{"epoch":60,"stochastic_training_loss":0.26328346133232117,"dense_train_probe":{"loss":0.2727970703125,"accuracy":0.8825,"n":10000},"validation":{"loss":0.312607470703125,"accuracy":0.876,"n":10000},"training_seconds":40.82332826300001,"epoch_training_seconds":0.6798222380000141,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.6563476920127869,"validation_probe_prediction_counts":[420,0,224,182,217,208,189,187,220,201]},{"epoch":65,"stochastic_training_loss":0.2634608745574951,"dense_train_probe":{"loss":0.2726553955078125,"accuracy":0.8825,"n":10000},"validation":{"loss":0.31457939453125,"accuracy":0.8758,"n":10000},"training_seconds":44.22294960700003,"epoch_training_seconds":0.6798059290000253,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.6573730707168579,"validation_probe_prediction_counts":[419,0,224,181,219,206,194,189,219,197]},{"epoch":70,"stochastic_training_loss":0.28149598836898804,"dense_train_probe":{"loss":0.2786278076171875,"accuracy":0.8812,"n":10000},"validation":{"loss":0.317796337890625,"accuracy":0.8734,"n":10000},"training_seconds":47.62294674800003,"epoch_training_seconds":0.6798595449999993,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.66650390625,"validation_probe_prediction_counts":[411,0,220,177,216,209,194,192,231,198]},{"epoch":75,"stochastic_training_loss":0.26261481642723083,"dense_train_probe":{"loss":0.2716294921875,"accuracy":0.8825,"n":10000},"validation":{"loss":0.309922607421875,"accuracy":0.8768,"n":10000},"training_seconds":51.022703697000054,"epoch_training_seconds":0.6798623779999957,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.67333984375,"validation_probe_prediction_counts":[418,0,223,182,218,206,193,189,221,198]},{"epoch":80,"stochastic_training_loss":0.26265326142311096,"dense_train_probe":{"loss":0.27186025390625,"accuracy":0.8825,"n":10000},"validation":{"loss":0.3095319580078125,"accuracy":0.8771,"n":10000},"training_seconds":54.42490897600007,"epoch_training_seconds":0.6800004899999976,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.659375011920929,"validation_probe_prediction_counts":[419,0,223,179,215,210,194,187,223,198]},{"epoch":85,"stochastic_training_loss":0.26295700669288635,"dense_train_probe":{"loss":0.27224873046875,"accuracy":0.8825,"n":10000},"validation":{"loss":0.3107764892578125,"accuracy":0.8764,"n":10000},"training_seconds":57.825084202000056,"epoch_training_seconds":0.6799428269999908,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.6648926138877869,"validation_probe_prediction_counts":[418,0,224,182,216,208,193,187,221,199]},{"epoch":90,"stochastic_training_loss":0.26297813653945923,"dense_train_probe":{"loss":0.27218466796875,"accuracy":0.8825,"n":10000},"validation":{"loss":0.309852734375,"accuracy":0.8764,"n":10000},"training_seconds":61.22518523900004,"epoch_training_seconds":0.6800081439999985,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.6600586175918579,"validation_probe_prediction_counts":[413,0,225,181,220,206,196,188,221,198]},{"epoch":95,"stochastic_training_loss":0.2631984353065491,"dense_train_probe":{"loss":0.27205966796875,"accuracy":0.8825,"n":10000},"validation":{"loss":0.3117293212890625,"accuracy":0.8766,"n":10000},"training_seconds":64.62512391200005,"epoch_training_seconds":0.6799784589999831,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.657177746295929,"validation_probe_prediction_counts":[417,0,223,183,216,206,195,189,222,197]},{"epoch":100,"stochastic_training_loss":0.26543089747428894,"dense_train_probe":{"loss":0.273406982421875,"accuracy":0.8824,"n":10000},"validation":{"loss":0.3184699951171875,"accuracy":0.8749,"n":10000},"training_seconds":68.02555690100002,"epoch_training_seconds":0.680408602,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.679638683795929,"validation_probe_prediction_counts":[420,0,220,184,215,208,190,185,223,203]}],"best_epoch":50,"best_validation_loss":0.3086169921875,"training_seconds":68.02555690100002,"total_run_seconds":69.73668832800001,"hardware":{"device":"cuda:0","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"4d0ac269167486811a0086108ca56313016afcebfc075d45e09455c228dee75b","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[0,0,0,0],"final_train":{"loss":0.2641787890625,"accuracy":0.8864,"n":50000},"selected_train":{"loss":0.26284958984375,"accuracy":0.88654,"n":50000},"final_test":{"loss":0.32996171875,"accuracy":0.8687,"n":10000,"wrong_indices":[2,5,14,29,31,37,39,40,46,57,74,89,94,96,107,115,135,137,143,145,149,154,168,176,178,180,189,190,191,196,202,203,204,224,228,239,247,251,259,265,267,272,276,279,288,302,314,321,329,330,332,340,342,345,348,350,354,357,377,378,385,388,393,409,416,419,427,430,435,445,447,455,473,476,480,489,504,506,523,529,537,551,582,584,615,619,640,646,647,652,663,672,675,682,684,695,696,700,707,716,720,725,735,745,749,754,755,767,768,772,777,783,790,798,809,818,824,826,831,835,836,840,844,848,850,889,900,907,918,920,924,929,938,947,948,949,951,956,963,964,965,967,977,979,984,988,994,1004,1008,1011,1014,1019,1025,1027,1030,1037,1038,1039,1040,1044,1054,1075,1083,1097,1112,1129,1136,1137,1139,1156,1179,1180,1182,1189,1192,1193,1194,1201,1211,1213,1214,1224,1226,1232,1236,1238,1240,1242,1247,1254,1257,1280,1295,1299,1302,1305,1316,1318,1319,1326,1328,1329,1338,1350,1351,1358,1360,1368,1392,1393,1397,1403,1424,1430,1434,1444,1448,1464,1483,1484,1494,1500,1515,1522,1527,1528,1530,1548,1549,1555,1569,1582,1603,1609,1621,1626,1630,1633,1643,1646,1657,1659,1667,1673,1674,1681,1691,1704,1707,1715,1722,1728,1729,1736,1753,1754,1760,1766,1773,1780,1785,1791,1820,1829,1830,1834,1835,1836,1838,1844,1861,1867,1868,1876,1884,1885,1897,1900,1901,1909,1922,1934,1939,1941,1945,1984,1986,1988,1993,1994,2004,2010,2013,2015,2017,2018,2024,2027,2034,2035,2041,2051,2053,2070,2071,2098,2109,2130,2136,2137,2154,2164,2166,2171,2175,2182,2221,2228,2235,2239,2245,2258,2261,2266,2272,2273,2276,2277,2283,2287,2293,2302,2315,2316,2324,2335,2343,2355,2356,2357,2358,2359,2366,2369,2379,2398,2408,2409,2411,2416,2418,2421,2434,2444,2454,2473,2488,2504,2510,2519,2524,2529,2541,2553,2576,2590,2597,2599,2607,2612,2626,2648,2654,2655,2661,2674,2676,2688,2693,2704,2705,2706,2719,2722,2725,2734,2746,2753,2757,2786,2788,2789,2803,2810,2815,2816,2822,2825,2827,2867,2868,2877,2878,2880,2885,2902,2912,2915,2928,2939,2943,2946,2950,2965,2974,2982,2984,2995,2997,3003,3014,3019,3026,3027,3030,3039,3050,3070,3073,3092,3097,3099,3115,3117,3124,3126,3132,3143,3148,3152,3175,3196,3203,3211,3214,3225,3227,3230,3231,3237,3244,3253,3255,3259,3264,3268,3272,3276,3281,3289,3314,3320,3330,3333,3351,3353,3354,3379,3380,3386,3405,3419,3420,3421,3422,3430,3433,3434,3438,3452,3454,3455,3457,3464,3471,3480,3503,3520,3532,3533,3546,3550,3558,3562,3582,3586,3593,3598,3601,3605,3606,3625,3638,3639,3641,3648,3649,3651,3652,3669,3673,3679,3689,3699,3727,3733,3741,3745,3747,3761,3765,3767,3777,3779,3780,3784,3786,3789,3796,3808,3809,3811,3815,3818,3843,3851,3852,3858,3866,3893,3894,3900,3906,3919,3922,3925,3930,3937,3941,3974,3983,3985,3990,4005,4006,4010,4013,4014,4021,4025,4032,4035,4036,4039,4050,4057,4065,4069,4074,4075,4077,4078,4085,4104,4105,4110,4138,4144,4147,4153,4163,4168,4169,4170,4171,4176,4178,4179,4181,4185,4190,4191,4195,4199,4201,4212,4216,4232,4248,4249,4262,4264,4267,4273,4289,4292,4303,4304,4308,4318,4328,4331,4337,4349,4350,4355,4360,4386,4409,4428,4450,4491,4497,4504,4507,4516,4524,4525,4533,4536,4538,4551,4563,4564,4574,4578,4580,4588,4589,4595,4597,4602,4603,4606,4619,4639,4643,4646,4651,4653,4655,4670,4674,4676,4685,4687,4691,4708,4717,4719,4729,4731,4732,4733,4740,4754,4759,4764,4774,4778,4806,4807,4814,4823,4847,4853,4858,4859,4860,4864,4869,4871,4872,4877,4880,4903,4909,4917,4924,4927,4930,4931,4932,4949,4951,4953,4966,4972,4977,4984,5005,5013,5014,5025,5036,5044,5052,5072,5081,5090,5091,5092,5093,5112,5113,5128,5132,5148,5156,5166,5186,5193,5203,5208,5211,5227,5232,5252,5254,5258,5271,5281,5291,5314,5316,5318,5323,5327,5331,5350,5361,5370,5384,5399,5406,5416,5431,5442,5453,5457,5460,5461,5477,5486,5490,5499,5506,5514,5520,5524,5534,5535,5544,5550,5552,5553,5566,5588,5590,5594,5604,5614,5630,5634,5637,5642,5646,5651,5661,5666,5679,5689,5699,5722,5732,5734,5738,5746,5759,5762,5776,5783,5786,5794,5809,5811,5831,5839,5848,5859,5872,5873,5880,5887,5889,5893,5896,5902,5915,5917,5933,5936,5937,5943,5953,5955,5970,5972,5973,5978,5982,5984,5991,5997,5998,6005,6008,6011,6012,6044,6046,6058,6059,6060,6063,6073,6083,6092,6101,6108,6110,6115,6125,6135,6141,6159,6162,6182,6192,6202,6222,6224,6231,6232,6233,6239,6254,6276,6278,6308,6310,6320,6329,6338,6356,6374,6375,6397,6407,6408,6419,6430,6438,6445,6456,6468,6472,6482,6484,6502,6506,6515,6527,6533,6540,6545,6555,6556,6572,6597,6601,6604,6618,6622,6623,6628,6634,6644,6651,6652,6661,6670,6673,6678,6680,6683,6688,6694,6702,6712,6720,6726,6729,6733,6743,6748,6751,6755,6757,6758,6783,6789,6799,6809,6819,6829,6847,6848,6868,6869,6883,6891,6901,6902,6913,6917,6928,6938,6948,6961,6969,6976,7000,7005,7014,7019,7023,7048,7053,7063,7073,7087,7091,7123,7138,7150,7165,7167,7171,7173,7176,7183,7191,7216,7217,7223,7226,7228,7232,7247,7253,7259,7262,7268,7270,7280,7290,7299,7303,7319,7323,7325,7340,7344,7353,7373,7395,7399,7405,7411,7418,7422,7424,7434,7442,7447,7453,7463,7468,7480,7507,7517,7527,7556,7561,7563,7567,7581,7582,7591,7600,7608,7618,7626,7636,7638,7658,7661,7665,7686,7708,7717,7722,7725,7728,7738,7748,7783,7784,7790,7802,7806,7811,7812,7822,7832,7839,7847,7856,7869,7881,7890,7896,7899,7900,7911,7916,7920,7927,7928,7934,7944,7954,7969,7973,7980,7990,8004,8005,8020,8022,8045,8048,8058,8068,8078,8086,8088,8090,8091,8094,8099,8100,8113,8118,8128,8138,8159,8164,8166,8187,8219,8229,8231,8233,8239,8244,8246,8252,8261,8268,8286,8289,8303,8305,8306,8324,8325,8340,8344,8352,8360,8367,8376,8390,8396,8408,8418,8420,8427,8432,8439,8443,8449,8459,8469,8488,8491,8493,8509,8526,8527,8536,8538,8540,8543,8545,8549,8559,8568,8575,8586,8600,8604,8633,8636,8650,8658,8659,8666,8672,8682,8692,8708,8715,8720,8724,8729,8740,8745,8758,8768,8776,8799,8809,8819,8850,8862,8873,8875,8887,8892,8905,8914,8922,8930,8938,8971,8976,8979,8980,8986,8988,8995,9002,9003,9005,9009,9015,9017,9019,9024,9025,9030,9039,9049,9051,9061,9071,9081,9090,9096,9112,9120,9121,9124,9140,9143,9155,9171,9180,9190,9200,9222,9233,9241,9249,9258,9265,9274,9282,9291,9295,9301,9313,9324,9335,9336,9345,9348,9356,9368,9378,9388,9395,9401,9407,9415,9434,9435,9438,9443,9444,9464,9485,9489,9499,9509,9518,9520,9540,9549,9556,9570,9587,9591,9593,9594,9599,9602,9612,9622,9634,9641,9643,9645,9649,9653,9657,9661,9664,9669,9674,9679,9682,9689,9699,9705,9715,9725,9729,9737,9745,9760,9768,9770,9772,9774,9779,9792,9795,9796,9799,9802,9810,9819,9836,9838,9839,9844,9845,9846,9848,9858,9867,9876,9878,9888,9896,9898,9903,9912,9922,9923,9931,9946,9950,9955,9956,9969,9978,9984,9994],"errors":1313},"selected_test":{"loss":0.320281689453125,"accuracy":0.87,"n":10000,"wrong_indices":[2,5,14,29,31,37,39,40,46,57,74,89,94,96,107,135,137,143,145,149,154,168,176,178,180,189,190,191,196,202,203,204,224,228,239,247,251,259,265,267,272,276,279,288,302,314,321,329,330,332,340,342,345,348,350,354,357,377,378,381,385,388,393,409,416,419,427,430,445,449,455,473,476,480,489,495,504,506,523,529,537,582,584,615,619,640,646,647,652,663,672,675,682,684,691,695,696,700,716,720,725,735,745,749,754,755,767,768,772,777,783,790,798,809,818,824,826,831,835,836,840,844,848,850,883,889,900,907,918,920,929,938,947,948,949,951,956,963,964,965,967,977,979,984,988,994,1004,1008,1011,1014,1019,1025,1027,1030,1037,1038,1039,1040,1054,1075,1083,1097,1112,1129,1136,1137,1139,1156,1179,1180,1189,1192,1193,1201,1211,1213,1214,1224,1226,1232,1236,1238,1240,1242,1247,1254,1257,1280,1295,1299,1302,1305,1316,1318,1319,1328,1329,1338,1350,1351,1358,1360,1368,1392,1397,1403,1414,1424,1430,1434,1444,1448,1483,1484,1515,1522,1527,1528,1530,1548,1549,1555,1569,1582,1603,1609,1630,1633,1643,1646,1657,1659,1667,1673,1674,1681,1691,1704,1707,1715,1717,1728,1729,1736,1753,1754,1760,1766,1773,1780,1785,1790,1791,1820,1829,1830,1834,1835,1836,1838,1844,1861,1867,1868,1876,1884,1885,1897,1900,1901,1909,1922,1934,1939,1941,1945,1984,1986,1988,1993,1994,2004,2010,2013,2015,2017,2018,2024,2027,2034,2035,2041,2051,2070,2071,2098,2109,2136,2137,2154,2164,2166,2171,2175,2182,2221,2228,2235,2239,2245,2258,2261,2266,2272,2273,2276,2277,2283,2287,2293,2302,2315,2316,2324,2335,2343,2355,2356,2357,2358,2359,2366,2379,2398,2406,2408,2409,2411,2414,2416,2418,2421,2422,2434,2444,2473,2488,2504,2510,2519,2524,2529,2541,2553,2576,2590,2597,2599,2607,2612,2626,2648,2654,2655,2661,2674,2676,2688,2693,2704,2705,2706,2719,2722,2725,2734,2746,2753,2757,2786,2788,2789,2803,2815,2816,2822,2825,2827,2867,2868,2877,2878,2880,2885,2896,2902,2912,2928,2939,2943,2946,2950,2953,2965,2974,2982,2984,2997,3003,3014,3019,3026,3027,3039,3050,3070,3073,3092,3097,3099,3117,3124,3126,3132,3143,3148,3152,3172,3175,3196,3203,3211,3214,3225,3227,3230,3231,3237,3244,3253,3255,3259,3264,3268,3272,3276,3281,3314,3320,3351,3353,3354,3379,3380,3386,3419,3420,3421,3422,3430,3433,3434,3438,3452,3454,3455,3457,3464,3471,3480,3520,3532,3546,3549,3558,3562,3582,3586,3593,3597,3598,3601,3605,3606,3625,3638,3639,3641,3648,3649,3651,3652,3669,3673,3679,3681,3689,3699,3727,3733,3741,3745,3747,3751,3761,3765,3776,3777,3779,3780,3784,3786,3789,3796,3808,3809,3815,3818,3843,3851,3852,3853,3858,3866,3893,3894,3900,3906,3919,3922,3925,3930,3937,3941,3943,3974,3983,3985,3990,4005,4006,4010,4013,4014,4021,4025,4032,4035,4036,4039,4050,4057,4065,4069,4074,4075,4077,4078,4085,4104,4105,4110,4138,4144,4147,4153,4163,4168,4169,4170,4171,4176,4178,4179,4181,4185,4190,4191,4195,4199,4201,4212,4216,4232,4248,4249,4262,4264,4267,4273,4292,4303,4304,4308,4318,4328,4331,4337,4349,4350,4386,4409,4428,4450,4491,4497,4504,4507,4516,4524,4525,4533,4536,4538,4551,4563,4564,4574,4578,4580,4588,4589,4595,4597,4601,4602,4603,4606,4639,4643,4646,4651,4653,4655,4670,4674,4676,4685,4687,4691,4708,4717,4719,4729,4731,4732,4733,4740,4754,4759,4764,4774,4778,4806,4807,4814,4823,4847,4853,4858,4859,4860,4864,4869,4871,4872,4877,4880,4903,4909,4917,4924,4927,4930,4931,4932,4949,4951,4953,4956,4966,4972,4977,4984,5005,5013,5014,5025,5036,5044,5046,5052,5072,5081,5090,5091,5092,5093,5112,5113,5128,5132,5140,5148,5156,5166,5186,5193,5203,5208,5211,5227,5232,5252,5254,5258,5271,5281,5291,5314,5316,5318,5323,5327,5331,5350,5361,5370,5384,5399,5406,5416,5431,5442,5453,5457,5460,5461,5477,5486,5490,5499,5506,5514,5520,5524,5534,5535,5544,5550,5552,5553,5566,5588,5590,5594,5604,5614,5630,5634,5637,5642,5646,5651,5661,5666,5676,5679,5689,5699,5722,5732,5734,5738,5746,5759,5762,5776,5783,5786,5794,5809,5811,5831,5839,5848,5859,5872,5873,5880,5887,5889,5893,5896,5902,5915,5917,5933,5936,5943,5953,5955,5970,5972,5973,5978,5984,5991,5998,6005,6008,6011,6012,6023,6030,6044,6045,6046,6058,6059,6060,6063,6073,6083,6092,6101,6108,6110,6115,6125,6135,6141,6159,6162,6166,6182,6192,6202,6222,6224,6231,6232,6233,6239,6254,6276,6278,6308,6310,6320,6329,6338,6356,6374,6375,6397,6407,6408,6419,6430,6438,6445,6456,6468,6472,6482,6484,6502,6506,6515,6527,6533,6540,6545,6555,6556,6572,6597,6601,6604,6608,6618,6622,6623,6628,6634,6644,6651,6652,6661,6670,6673,6678,6680,6683,6688,6694,6702,6712,6720,6726,6729,6733,6743,6748,6751,6755,6757,6758,6783,6789,6799,6809,6819,6829,6847,6848,6868,6869,6883,6891,6901,6902,6913,6917,6928,6938,6948,6961,6969,6976,7000,7005,7014,7019,7023,7048,7053,7063,7073,7087,7091,7123,7138,7150,7165,7167,7171,7173,7176,7183,7191,7217,7223,7226,7228,7232,7247,7253,7262,7270,7280,7290,7299,7303,7319,7323,7325,7340,7344,7353,7373,7395,7399,7405,7411,7418,7422,7424,7434,7442,7447,7451,7453,7463,7468,7480,7507,7517,7527,7556,7561,7563,7567,7581,7582,7591,7600,7608,7618,7626,7636,7638,7658,7661,7665,7686,7708,7717,7722,7725,7728,7738,7748,7783,7784,7790,7802,7806,7811,7812,7822,7832,7839,7847,7856,7869,7881,7886,7890,7896,7899,7900,7911,7916,7920,7928,7934,7944,7954,7969,7973,7980,7990,8004,8005,8020,8022,8045,8048,8058,8068,8078,8086,8088,8090,8094,8099,8100,8113,8118,8128,8138,8159,8164,8166,8187,8219,8229,8231,8233,8239,8244,8246,8252,8261,8268,8277,8286,8289,8303,8305,8306,8324,8325,8340,8344,8352,8360,8367,8376,8390,8396,8408,8418,8420,8427,8432,8439,8443,8449,8456,8459,8469,8488,8491,8493,8509,8526,8527,8536,8538,8540,8543,8545,8549,8559,8568,8575,8586,8600,8604,8633,8636,8650,8658,8659,8666,8672,8682,8692,8708,8715,8720,8724,8729,8740,8745,8758,8768,8776,8799,8809,8819,8850,8862,8873,8875,8887,8892,8905,8914,8922,8930,8938,8971,8976,8979,8980,8986,8988,8995,9002,9003,9005,9009,9015,9017,9019,9024,9025,9030,9039,9049,9051,9061,9071,9081,9090,9096,9112,9120,9121,9124,9140,9143,9155,9171,9180,9190,9200,9222,9233,9241,9249,9258,9265,9274,9280,9282,9291,9295,9301,9313,9324,9335,9336,9345,9348,9356,9368,9378,9388,9395,9401,9407,9415,9434,9435,9438,9443,9444,9464,9485,9489,9499,9509,9518,9520,9540,9549,9556,9570,9587,9591,9593,9594,9599,9602,9612,9622,9634,9641,9643,9645,9649,9653,9657,9661,9664,9669,9674,9679,9682,9689,9699,9705,9715,9725,9729,9737,9742,9745,9760,9768,9770,9772,9774,9779,9795,9796,9799,9802,9808,9810,9819,9836,9838,9839,9844,9845,9846,9848,9876,9878,9896,9898,9903,9912,9923,9931,9944,9946,9950,9955,9956,9969,9978,9984,9994],"errors":1300}},{"run_id":"graph-fidelity-source-plain-s103","spec":{"run_id":"graph-fidelity-source-plain-s103","stage":"evaluate","cohort":"fidelity","variant":"source-plain","recipe":"plain","pmax":0.0,"input_scale":1.0,"output_relu":true,"lr":0.001,"momentum":0.9,"shrinkage":2e-05,"seed":103,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"timeout_seconds":180,"gpu":"A100","precision":"fp32"},"history":[{"epoch":1,"stochastic_training_loss":0.7244935035705566,"dense_train_probe":{"loss":0.54504931640625,"accuracy":0.7876,"n":10000},"validation":{"loss":0.5678349609375,"accuracy":0.7837,"n":10000},"training_seconds":0.7046211300000209,"epoch_training_seconds":0.7046211300000209,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.7589355707168579,"validation_probe_prediction_counts":[512,212,218,176,275,250,194,211,0,0]},{"epoch":5,"stochastic_training_loss":0.47837159037590027,"dense_train_probe":{"loss":0.461666064453125,"accuracy":0.8029,"n":10000},"validation":{"loss":0.51142158203125,"accuracy":0.794,"n":10000},"training_seconds":3.4295402120000062,"epoch_training_seconds":0.6810934680000003,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.7772461175918579,"validation_probe_prediction_counts":[599,209,220,190,228,218,194,190,0,0]},{"epoch":10,"stochastic_training_loss":0.23613837361335754,"dense_train_probe":{"loss":0.231224755859375,"accuracy":0.9015,"n":10000},"validation":{"loss":0.294296435546875,"accuracy":0.8861,"n":10000},"training_seconds":6.8360010640000155,"epoch_training_seconds":0.6811558919999925,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.6685547232627869,"validation_probe_prediction_counts":[394,209,219,173,216,207,193,194,243,0]},{"epoch":15,"stochastic_training_loss":0.23295366764068604,"dense_train_probe":{"loss":0.2278503173828125,"accuracy":0.9017,"n":10000},"validation":{"loss":0.29027431640625,"accuracy":0.8879,"n":10000},"training_seconds":10.242296583000012,"epoch_training_seconds":0.6813101109999877,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.6683593988418579,"validation_probe_prediction_counts":[402,209,220,182,222,205,192,189,227,0]},{"epoch":20,"stochastic_training_loss":0.23293645679950714,"dense_train_probe":{"loss":0.227844287109375,"accuracy":0.9018,"n":10000},"validation":{"loss":0.291991845703125,"accuracy":0.8875,"n":10000},"training_seconds":13.648865684000015,"epoch_training_seconds":0.6812755280000147,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.6705078482627869,"validation_probe_prediction_counts":[399,209,219,176,226,210,191,191,227,0]},{"epoch":25,"stochastic_training_loss":0.23333041369915009,"dense_train_probe":{"loss":0.228198486328125,"accuracy":0.9018,"n":10000},"validation":{"loss":0.2923021484375,"accuracy":0.8873,"n":10000},"training_seconds":17.055500497000054,"epoch_training_seconds":0.681167146000007,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.666015625,"validation_probe_prediction_counts":[401,211,222,182,222,206,191,189,224,0]},{"epoch":30,"stochastic_training_loss":0.23340195417404175,"dense_train_probe":{"loss":0.2280875244140625,"accuracy":0.9019,"n":10000},"validation":{"loss":0.291878759765625,"accuracy":0.8869,"n":10000},"training_seconds":20.48072968100007,"epoch_training_seconds":0.6996104899999978,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.6717773675918579,"validation_probe_prediction_counts":[398,213,221,178,224,209,191,195,219,0]},{"epoch":35,"stochastic_training_loss":0.2338518649339676,"dense_train_probe":{"loss":0.22960888671875,"accuracy":0.9019,"n":10000},"validation":{"loss":0.3005009765625,"accuracy":0.8849,"n":10000},"training_seconds":23.887365489000075,"epoch_training_seconds":0.681279805999992,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.651318371295929,"validation_probe_prediction_counts":[396,212,224,184,224,202,194,194,218,0]},{"epoch":40,"stochastic_training_loss":0.2327268421649933,"dense_train_probe":{"loss":0.22767578125,"accuracy":0.9019,"n":10000},"validation":{"loss":0.290370751953125,"accuracy":0.8872,"n":10000},"training_seconds":27.294311006000072,"epoch_training_seconds":0.681338774000011,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.6659179925918579,"validation_probe_prediction_counts":[399,210,221,185,225,206,191,188,223,0]},{"epoch":45,"stochastic_training_loss":0.23295298218727112,"dense_train_probe":{"loss":0.2279331298828125,"accuracy":0.9019,"n":10000},"validation":{"loss":0.291915380859375,"accuracy":0.8873,"n":10000},"training_seconds":30.702000431000073,"epoch_training_seconds":0.6814031739999962,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.6675781607627869,"validation_probe_prediction_counts":[400,210,220,181,227,206,193,191,220,0]},{"epoch":50,"stochastic_training_loss":0.23315298557281494,"dense_train_probe":{"loss":0.227805224609375,"accuracy":0.9019,"n":10000},"validation":{"loss":0.294168994140625,"accuracy":0.8866,"n":10000},"training_seconds":34.10975180200006,"epoch_training_seconds":0.6814781909999965,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.66015625,"validation_probe_prediction_counts":[397,212,222,179,225,212,195,187,219,0]},{"epoch":55,"stochastic_training_loss":0.23215003311634064,"dense_train_probe":{"loss":0.2271051025390625,"accuracy":0.902,"n":10000},"validation":{"loss":0.2905942138671875,"accuracy":0.8874,"n":10000},"training_seconds":37.51688243700002,"epoch_training_seconds":0.6812967170000093,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.6812988519668579,"validation_probe_prediction_counts":[405,210,220,181,228,207,191,185,221,0]},{"epoch":60,"stochastic_training_loss":0.23224377632141113,"dense_train_probe":{"loss":0.2272456298828125,"accuracy":0.902,"n":10000},"validation":{"loss":0.2938759765625,"accuracy":0.8871,"n":10000},"training_seconds":40.92448836900002,"epoch_training_seconds":0.6814539570000022,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.6536621451377869,"validation_probe_prediction_counts":[393,213,221,183,230,206,191,190,221,0]},{"epoch":65,"stochastic_training_loss":0.23600150644779205,"dense_train_probe":{"loss":0.227704345703125,"accuracy":0.902,"n":10000},"validation":{"loss":0.29086064453125,"accuracy":0.8872,"n":10000},"training_seconds":44.35175522399999,"epoch_training_seconds":0.6813741659999835,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.670605480670929,"validation_probe_prediction_counts":[413,211,221,185,214,203,193,188,220,0]},{"epoch":70,"stochastic_training_loss":0.2319679856300354,"dense_train_probe":{"loss":0.227018115234375,"accuracy":0.902,"n":10000},"validation":{"loss":0.291453076171875,"accuracy":0.8886,"n":10000},"training_seconds":47.759018427,"epoch_training_seconds":0.6814092059999837,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.653369128704071,"validation_probe_prediction_counts":[400,211,221,182,227,206,192,187,222,0]},{"epoch":75,"stochastic_training_loss":0.23846998810768127,"dense_train_probe":{"loss":0.238138720703125,"accuracy":0.8998,"n":10000},"validation":{"loss":0.307528662109375,"accuracy":0.8824,"n":10000},"training_seconds":51.16641152400001,"epoch_training_seconds":0.6813842509999972,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.657470703125,"validation_probe_prediction_counts":[397,210,216,181,224,204,205,183,228,0]},{"epoch":80,"stochastic_training_loss":0.2315472662448883,"dense_train_probe":{"loss":0.2267541015625,"accuracy":0.902,"n":10000},"validation":{"loss":0.29025126953125,"accuracy":0.888,"n":10000},"training_seconds":54.59058265300004,"epoch_training_seconds":0.6812923560000002,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.65185546875,"validation_probe_prediction_counts":[401,211,221,183,223,207,193,186,223,0]},{"epoch":85,"stochastic_training_loss":0.231888547539711,"dense_train_probe":{"loss":0.2271350830078125,"accuracy":0.902,"n":10000},"validation":{"loss":0.291237451171875,"accuracy":0.887,"n":10000},"training_seconds":57.99804601300005,"epoch_training_seconds":0.6812884560000043,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.6548828482627869,"validation_probe_prediction_counts":[397,212,221,184,225,208,194,187,220,0]},{"epoch":90,"stochastic_training_loss":0.23186643421649933,"dense_train_probe":{"loss":0.22755400390625,"accuracy":0.902,"n":10000},"validation":{"loss":0.293718603515625,"accuracy":0.8874,"n":10000},"training_seconds":61.40543861200004,"epoch_training_seconds":0.6813789039999847,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.655322253704071,"validation_probe_prediction_counts":[394,212,221,183,228,205,193,191,221,0]},{"epoch":95,"stochastic_training_loss":0.2554837167263031,"dense_train_probe":{"loss":0.2357739501953125,"accuracy":0.9009,"n":10000},"validation":{"loss":0.300976123046875,"accuracy":0.8855,"n":10000},"training_seconds":64.81233612400001,"epoch_training_seconds":0.6812637949999782,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.644775390625,"validation_probe_prediction_counts":[403,209,221,181,227,204,193,187,223,0]},{"epoch":100,"stochastic_training_loss":0.2315184324979782,"dense_train_probe":{"loss":0.22643203125,"accuracy":0.9021,"n":10000},"validation":{"loss":0.2914208251953125,"accuracy":0.8873,"n":10000},"training_seconds":68.21973519100001,"epoch_training_seconds":0.6816606170000057,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.662304699420929,"validation_probe_prediction_counts":[407,210,221,180,223,207,193,187,220,0]}],"best_epoch":80,"best_validation_loss":0.29025126953125,"training_seconds":68.21973519100001,"total_run_seconds":69.996755812,"hardware":{"device":"cuda:0","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"316aa46c9e0a65fa375b579be0871a16f447d396fe64f85e2063ee6ef8c8dd5d","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[0,0,0,0],"final_train":{"loss":0.2311497265625,"accuracy":0.90006,"n":50000},"selected_train":{"loss":0.2313259765625,"accuracy":0.90002,"n":50000},"final_test":{"loss":0.2918354248046875,"accuracy":0.8862,"n":10000,"wrong_indices":[7,9,12,16,20,58,62,73,78,92,99,104,105,108,113,118,125,150,151,185,193,206,209,212,214,235,241,247,252,259,264,273,274,281,284,292,315,320,321,322,336,340,359,389,394,414,417,422,426,434,445,448,449,454,471,479,481,487,488,495,496,501,521,530,551,558,560,562,575,582,593,598,599,616,627,630,634,639,646,659,662,671,673,678,681,706,720,733,758,759,773,788,813,833,844,862,874,882,893,906,913,928,938,947,951,954,956,962,965,966,992,999,1000,1005,1013,1014,1039,1045,1048,1058,1063,1081,1086,1088,1090,1103,1105,1107,1112,1130,1152,1156,1165,1178,1183,1192,1217,1226,1228,1232,1247,1255,1277,1282,1299,1304,1308,1309,1311,1319,1322,1327,1328,1343,1380,1385,1393,1396,1414,1417,1418,1423,1428,1429,1435,1439,1449,1452,1455,1481,1486,1492,1501,1508,1512,1522,1530,1532,1545,1549,1553,1554,1559,1569,1594,1596,1597,1622,1627,1631,1640,1645,1647,1648,1655,1666,1668,1681,1695,1697,1709,1714,1717,1732,1743,1745,1754,1781,1787,1788,1793,1801,1812,1821,1825,1851,1853,1869,1873,1881,1894,1901,1904,1906,1911,1941,1952,1964,1979,1992,1998,2009,2014,2019,2035,2049,2054,2068,2070,2088,2089,2098,2109,2129,2135,2147,2161,2181,2182,2189,2196,2212,2216,2224,2227,2232,2244,2250,2257,2259,2263,2274,2292,2293,2310,2313,2320,2323,2341,2342,2345,2361,2380,2387,2406,2414,2420,2426,2438,2443,2448,2456,2472,2477,2478,2488,2493,2494,2497,2516,2528,2538,2544,2548,2570,2582,2585,2589,2597,2603,2607,2633,2637,2648,2654,2673,2685,2692,2694,2696,2720,2735,2740,2742,2755,2760,2769,2781,2792,2812,2845,2854,2857,2858,2863,2870,2875,2883,2892,2908,2916,2921,2923,2926,2927,2929,2934,2939,2941,2958,2964,2966,2970,2973,2979,2983,3001,3005,3006,3008,3030,3034,3041,3056,3060,3073,3075,3147,3149,3160,3165,3168,3189,3190,3200,3240,3241,3286,3287,3289,3338,3369,3385,3387,3392,3394,3404,3411,3422,3426,3459,3460,3467,3472,3475,3477,3478,3483,3485,3491,3501,3503,3504,3507,3520,3526,3529,3538,3549,3553,3558,3587,3592,3597,3618,3664,3666,3687,3693,3709,3711,3716,3723,3751,3755,3759,3760,3767,3780,3783,3791,3798,3808,3818,3820,3821,3831,3838,3840,3842,3850,3853,3856,3857,3859,3861,3869,3872,3874,3879,3881,3884,3885,3888,3889,3891,3906,3924,3926,3927,3941,3943,3950,3966,3967,3970,3976,3981,3984,3985,3992,3999,4000,4009,4015,4016,4030,4040,4047,4065,4078,4088,4093,4095,4101,4111,4122,4129,4134,4143,4154,4158,4163,4174,4182,4183,4184,4198,4201,4210,4213,4224,4235,4237,4240,4245,4248,4257,4259,4272,4280,4283,4284,4287,4289,4293,4294,4298,4299,4301,4309,4314,4316,4319,4321,4325,4333,4344,4358,4363,4369,4383,4405,4407,4408,4410,4417,4424,4425,4426,4436,4437,4444,4454,4479,4480,4489,4497,4500,4502,4504,4505,4511,4534,4536,4550,4551,4553,4555,4556,4560,4570,4584,4585,4592,4610,4616,4633,4644,4648,4659,4662,4663,4665,4673,4679,4681,4682,4683,4692,4700,4701,4706,4731,4735,4740,4752,4761,4769,4786,4795,4799,4807,4823,4835,4840,4843,4846,4856,4874,4880,4884,4901,4910,4918,4919,4945,4947,4963,4966,4967,4968,4975,4988,4989,5001,5002,5009,5015,5017,5022,5026,5029,5042,5050,5060,5070,5073,5080,5100,5106,5130,5135,5137,5140,5144,5164,5182,5210,5219,5220,5233,5242,5247,5262,5268,5269,5279,5289,5299,5311,5315,5331,5333,5344,5352,5373,5375,5377,5386,5388,5404,5414,5424,5429,5447,5456,5457,5491,5503,5523,5527,5537,5546,5565,5575,5580,5582,5587,5602,5612,5622,5627,5639,5642,5645,5671,5672,5676,5683,5704,5705,5707,5719,5730,5753,5754,5757,5781,5784,5787,5790,5800,5805,5813,5837,5856,5868,5869,5871,5887,5894,5897,5908,5919,5936,5937,5941,5951,5955,5961,5968,5971,5973,5977,5982,5996,6000,6022,6032,6039,6047,6055,6071,6081,6091,6112,6124,6126,6157,6166,6168,6172,6173,6190,6200,6210,6214,6221,6228,6230,6235,6247,6249,6302,6303,6318,6376,6393,6394,6401,6409,6411,6416,6420,6422,6436,6443,6451,6487,6496,6505,6507,6508,6512,6520,6524,6555,6560,6565,6568,6571,6576,6592,6597,6608,6610,6625,6627,6632,6642,6650,6651,6655,6656,6658,6671,6682,6692,6710,6718,6740,6747,6755,6772,6778,6783,6784,6787,6793,6807,6817,6827,6870,6887,6888,6895,6903,6905,6910,6914,6916,6919,6936,6946,6956,6967,6980,6984,6988,6996,6998,7008,7025,7043,7044,7061,7071,7081,7089,7095,7106,7107,7118,7128,7132,7136,7148,7174,7182,7199,7224,7227,7236,7242,7243,7246,7254,7256,7259,7278,7288,7298,7318,7322,7336,7347,7357,7360,7377,7380,7382,7384,7426,7434,7459,7462,7464,7471,7487,7489,7495,7496,7499,7515,7525,7535,7557,7562,7571,7579,7580,7588,7592,7594,7616,7624,7634,7640,7641,7651,7652,7680,7682,7697,7700,7707,7736,7746,7756,7769,7786,7795,7799,7800,7807,7813,7827,7828,7837,7854,7863,7864,7867,7874,7884,7886,7892,7895,7931,7942,7952,7962,7964,7991,8001,8002,8006,8017,8028,8044,8053,8066,8076,8084,8093,8094,8101,8109,8126,8136,8146,8150,8181,8182,8184,8207,8210,8213,8227,8230,8250,8259,8267,8274,8277,8288,8298,8319,8322,8325,8332,8334,8358,8371,8372,8374,8383,8404,8408,8422,8426,8431,8436,8457,8467,8477,8479,8503,8504,8506,8523,8527,8534,8537,8557,8590,8593,8596,8599,8623,8640,8642,8663,8670,8680,8690,8700,8705,8717,8723,8750,8751,8762,8781,8782,8784,8796,8807,8817,8827,8839,8841,8846,8882,8893,8897,8899,8900,8906,8920,8928,8933,8935,8949,8953,8955,8962,8977,8994,8998,9009,9015,9019,9023,9024,9026,9028,9054,9057,9069,9079,9089,9093,9094,9142,9144,9153,9165,9170,9188,9198,9206,9214,9216,9218,9245,9250,9252,9254,9255,9272,9280,9287,9292,9293,9299,9319,9357,9362,9376,9386,9397,9404,9408,9416,9423,9432,9466,9467,9472,9483,9497,9507,9517,9530,9539,9544,9553,9554,9562,9571,9580,9587,9610,9620,9634,9638,9642,9659,9664,9668,9669,9676,9679,9692,9701,9713,9719,9723,9729,9733,9740,9741,9742,9745,9767,9769,9770,9784,9785,9808,9825,9829,9839,9843,9856,9867,9888,9890,9891,9901,9918,9924,9932,9945,9973,9992],"errors":1138},"selected_test":{"loss":0.292572412109375,"accuracy":0.8867,"n":10000,"wrong_indices":[7,9,12,16,20,58,62,73,78,92,99,104,105,108,113,118,125,150,151,185,193,206,209,212,214,235,241,247,252,259,264,273,274,281,284,292,315,320,321,322,336,340,359,389,394,414,417,422,426,434,445,448,449,454,471,479,481,487,488,495,496,501,521,530,558,560,562,575,582,593,598,599,616,627,630,634,639,646,659,662,671,673,678,681,684,706,720,733,758,759,773,788,813,833,844,862,874,882,893,906,913,928,938,951,954,956,962,965,966,992,999,1000,1005,1013,1014,1039,1044,1045,1048,1058,1063,1081,1086,1088,1090,1103,1105,1107,1112,1130,1152,1156,1165,1178,1183,1192,1217,1226,1228,1232,1247,1255,1277,1282,1299,1304,1308,1309,1311,1319,1322,1327,1343,1380,1385,1393,1396,1414,1417,1418,1423,1428,1429,1435,1439,1444,1449,1452,1455,1481,1486,1492,1494,1500,1501,1508,1512,1530,1532,1545,1549,1553,1554,1559,1569,1594,1596,1597,1622,1627,1631,1640,1645,1647,1648,1655,1666,1668,1681,1695,1697,1709,1714,1717,1732,1743,1745,1754,1781,1787,1788,1793,1801,1812,1821,1825,1851,1853,1869,1873,1881,1894,1901,1904,1906,1941,1952,1964,1979,1984,1992,1998,2009,2014,2016,2019,2035,2049,2054,2068,2088,2089,2098,2109,2129,2135,2147,2161,2181,2182,2189,2196,2212,2216,2224,2227,2232,2244,2250,2257,2259,2263,2274,2292,2293,2310,2313,2320,2323,2325,2341,2342,2345,2361,2380,2387,2406,2414,2420,2426,2438,2443,2448,2456,2472,2477,2478,2488,2493,2494,2497,2516,2528,2538,2544,2548,2570,2582,2585,2589,2597,2603,2607,2633,2637,2648,2654,2673,2685,2692,2694,2696,2720,2735,2740,2742,2755,2760,2769,2781,2792,2812,2845,2854,2857,2858,2863,2870,2875,2883,2892,2908,2916,2921,2923,2926,2927,2929,2934,2939,2941,2953,2958,2964,2966,2973,2979,2983,3001,3005,3006,3008,3030,3034,3041,3056,3060,3073,3075,3114,3147,3149,3160,3165,3168,3190,3200,3240,3241,3286,3287,3338,3369,3385,3387,3392,3394,3404,3411,3422,3426,3459,3460,3467,3472,3477,3478,3483,3485,3491,3501,3503,3504,3507,3520,3526,3529,3538,3549,3553,3558,3587,3592,3597,3618,3664,3666,3687,3693,3709,3711,3716,3723,3751,3755,3759,3760,3767,3776,3780,3783,3791,3796,3798,3808,3818,3820,3821,3831,3838,3840,3842,3850,3853,3856,3857,3859,3861,3869,3872,3874,3879,3881,3884,3885,3888,3889,3891,3906,3924,3926,3927,3941,3943,3950,3966,3967,3970,3976,3981,3984,3985,3992,3999,4000,4009,4015,4016,4030,4040,4047,4065,4075,4078,4088,4093,4095,4101,4111,4122,4129,4134,4143,4154,4158,4163,4174,4182,4183,4184,4198,4201,4210,4213,4224,4235,4237,4240,4245,4248,4257,4259,4272,4280,4283,4284,4287,4289,4293,4294,4298,4299,4301,4309,4314,4316,4319,4321,4325,4333,4344,4358,4363,4369,4383,4405,4407,4408,4410,4417,4424,4425,4426,4436,4444,4454,4479,4480,4489,4497,4500,4502,4504,4505,4511,4534,4536,4550,4553,4555,4556,4560,4570,4584,4585,4592,4610,4616,4633,4644,4648,4659,4662,4663,4665,4673,4679,4681,4682,4683,4692,4700,4701,4706,4731,4735,4740,4752,4761,4769,4786,4795,4799,4807,4823,4835,4840,4843,4846,4856,4874,4880,4884,4901,4910,4918,4919,4945,4947,4963,4966,4967,4968,4975,4988,4989,5001,5002,5009,5015,5017,5022,5026,5029,5042,5050,5060,5070,5073,5080,5100,5106,5130,5135,5137,5144,5164,5182,5210,5219,5220,5233,5242,5247,5262,5268,5269,5279,5289,5299,5311,5315,5331,5333,5344,5352,5373,5375,5377,5386,5388,5404,5414,5424,5429,5447,5456,5457,5491,5503,5523,5527,5537,5546,5565,5575,5580,5582,5587,5602,5612,5622,5627,5639,5642,5645,5671,5672,5676,5683,5704,5705,5707,5719,5730,5734,5753,5754,5757,5781,5784,5787,5790,5800,5805,5813,5837,5856,5868,5869,5871,5894,5897,5908,5919,5937,5941,5951,5955,5961,5968,5971,5973,5977,5982,5996,6000,6011,6022,6032,6039,6047,6055,6059,6071,6081,6091,6112,6124,6126,6157,6166,6168,6172,6173,6190,6200,6210,6214,6221,6228,6230,6235,6247,6249,6302,6303,6318,6376,6393,6394,6401,6409,6411,6416,6420,6422,6436,6443,6451,6487,6496,6505,6507,6508,6512,6520,6524,6555,6560,6565,6568,6571,6576,6592,6597,6608,6610,6625,6627,6632,6642,6650,6651,6655,6656,6658,6671,6682,6692,6710,6718,6740,6747,6755,6772,6778,6784,6787,6793,6807,6817,6827,6870,6887,6888,6895,6903,6905,6910,6914,6916,6919,6936,6946,6956,6967,6980,6984,6988,6996,6998,7008,7025,7043,7044,7061,7071,7081,7089,7095,7106,7107,7118,7128,7132,7136,7148,7174,7182,7199,7224,7227,7236,7242,7243,7246,7254,7256,7278,7288,7298,7318,7322,7336,7347,7357,7360,7377,7380,7382,7384,7426,7434,7459,7462,7464,7471,7487,7489,7495,7496,7499,7515,7525,7535,7557,7562,7571,7579,7580,7588,7592,7594,7616,7624,7634,7640,7641,7651,7652,7680,7682,7697,7700,7707,7736,7746,7756,7769,7786,7795,7799,7807,7813,7827,7828,7837,7854,7863,7864,7867,7874,7884,7892,7895,7931,7942,7952,7962,7964,7991,8001,8002,8006,8017,8028,8044,8053,8066,8076,8084,8093,8094,8101,8109,8126,8136,8146,8150,8181,8182,8184,8207,8210,8213,8227,8230,8250,8259,8267,8274,8288,8298,8319,8322,8325,8332,8334,8358,8371,8372,8374,8383,8404,8408,8422,8426,8431,8436,8457,8467,8477,8479,8503,8504,8506,8523,8527,8534,8537,8557,8590,8593,8596,8599,8623,8640,8642,8663,8670,8680,8690,8700,8705,8717,8723,8750,8751,8762,8781,8782,8784,8796,8807,8817,8827,8839,8841,8846,8882,8893,8897,8899,8900,8906,8920,8928,8933,8935,8949,8953,8955,8962,8977,8994,8998,9009,9015,9019,9023,9024,9026,9028,9054,9057,9069,9079,9089,9093,9094,9142,9144,9153,9165,9170,9188,9198,9206,9214,9216,9218,9245,9250,9252,9254,9255,9272,9287,9292,9293,9299,9319,9357,9362,9376,9386,9397,9404,9408,9416,9423,9432,9466,9467,9472,9483,9497,9507,9517,9530,9539,9544,9553,9554,9562,9571,9580,9587,9610,9620,9634,9638,9642,9659,9664,9668,9669,9676,9679,9692,9701,9713,9723,9729,9733,9740,9741,9742,9745,9767,9769,9770,9784,9785,9808,9825,9829,9839,9843,9856,9858,9867,9888,9890,9891,9901,9918,9924,9932,9945,9973,9992],"errors":1133}},{"run_id":"graph-fidelity-source-residual-s101","spec":{"run_id":"graph-fidelity-source-residual-s101","stage":"evaluate","cohort":"fidelity","variant":"source-residual","recipe":"residual","pmax":0.0,"input_scale":1.0,"output_relu":true,"lr":0.001,"momentum":0.9,"shrinkage":2e-05,"seed":101,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"timeout_seconds":180,"gpu":"A100","precision":"fp32"},"history":[{"epoch":1,"stochastic_training_loss":2.3447282314300537,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":0.7475144489999934,"epoch_training_seconds":0.7475144489999934,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":5,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":3.6291001199999755,"epoch_training_seconds":0.7203500499999791,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":10,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":7.248408979000004,"epoch_training_seconds":0.7375617659999989,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":15,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":10.850778969000032,"epoch_training_seconds":0.7203518950000216,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":20,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":14.453301355000036,"epoch_training_seconds":0.720318251000009,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":25,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":18.069767642999977,"epoch_training_seconds":0.7202885889999777,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":30,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":21.67189907400001,"epoch_training_seconds":0.7203111059999969,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":35,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":25.27410405499998,"epoch_training_seconds":0.7203727979999996,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":40,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":28.87630747199998,"epoch_training_seconds":0.7203486410000153,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":45,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":32.478763209999954,"epoch_training_seconds":0.720308996,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":50,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":36.08083221399994,"epoch_training_seconds":0.7204165130000035,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":55,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":39.683233574999974,"epoch_training_seconds":0.7203511369999944,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":60,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":43.28521379099996,"epoch_training_seconds":0.7203209049999941,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":65,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":46.88735263399997,"epoch_training_seconds":0.7203435270000114,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":70,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":50.48972478399992,"epoch_training_seconds":0.7204869669999994,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":75,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":54.09889957699994,"epoch_training_seconds":0.7202625330000387,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":80,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":57.70088409999988,"epoch_training_seconds":0.7202371569999855,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":85,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":61.30315553199995,"epoch_training_seconds":0.7203191870000296,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":90,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":64.90530355399983,"epoch_training_seconds":0.7202997059999916,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":95,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":68.50742862799973,"epoch_training_seconds":0.7203534099999729,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":100,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":72.10991571299974,"epoch_training_seconds":0.7207074259999899,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]}],"best_epoch":1,"best_validation_loss":2.302585546875,"training_seconds":72.10991571299974,"total_run_seconds":73.22089794199997,"hardware":{"device":"cuda:0","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"e1efb33081a653eb2db13a44aa7d20f3f16925ea1dc8bc2e91ed2f639a3974ae","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[0,0,0,0],"final_train":{"loss":2.3025853125,"accuracy":0.09802,"n":50000},"selected_train":{"loss":2.3025853125,"accuracy":0.09802,"n":50000},"final_test":{"loss":2.302585546875,"accuracy":0.098,"n":10000,"wrong_indices":[0,1,2,4,5,6,7,8,9,11,12,14,15,16,17,18,19,20,21,22,23,24,26,27,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,56,57,58,59,60,61,62,63,64,65,66,67,68,70,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,127,128,129,130,131,132,133,134,135,137,138,139,140,141,142,143,144,145,146,147,149,150,151,152,153,154,155,156,158,159,160,161,162,163,164,165,166,167,168,169,170,171,172,173,174,175,176,177,178,179,180,181,182,184,185,186,187,189,190,191,193,195,196,197,198,199,200,201,202,203,204,205,206,207,208,209,210,211,212,213,214,216,217,218,219,220,221,222,223,224,225,226,227,228,229,230,231,232,233,234,235,236,237,238,239,240,241,242,243,244,245,247,248,249,250,251,252,253,254,255,256,257,258,259,260,261,262,263,264,265,266,267,268,270,272,273,274,275,276,277,278,279,280,281,282,283,284,285,286,287,288,289,290,291,292,293,295,298,299,300,301,302,303,304,306,307,308,309,310,313,314,315,316,317,318,319,320,321,322,323,325,326,328,329,330,331,332,333,334,335,336,337,338,339,340,341,342,343,344,345,347,348,349,350,351,352,353,354,355,356,357,358,359,360,361,362,363,364,366,367,368,369,370,371,373,374,375,376,377,378,379,381,382,383,384,385,386,387,388,389,390,391,392,393,394,395,396,397,398,399,400,401,402,403,404,405,406,408,409,410,411,412,413,414,415,416,417,418,419,420,421,422,423,425,426,427,428,429,430,431,432,433,434,435,436,437,438,439,442,444,445,446,447,448,449,450,451,452,453,454,455,456,457,458,460,461,462,463,464,465,466,467,468,469,470,471,472,473,474,475,476,477,478,479,480,481,482,483,484,486,487,488,489,491,492,493,494,495,496,497,499,500,501,502,503,504,505,506,507,508,509,510,511,512,513,514,515,516,517,518,519,520,521,522,523,524,526,527,528,529,530,531,532,533,534,535,536,537,538,539,540,541,542,543,544,547,548,549,550,551,553,554,555,556,557,558,559,560,562,563,565,566,568,569,570,571,572,573,574,575,576,577,578,579,580,582,583,584,585,587,588,589,590,591,593,594,595,596,598,599,600,601,602,603,604,605,606,607,609,610,612,613,614,615,616,617,618,619,621,622,623,624,625,626,627,628,629,630,631,632,633,634,635,636,637,638,639,640,641,643,645,646,647,648,649,650,651,652,653,654,655,657,658,659,660,662,663,664,665,666,667,668,669,670,671,672,673,674,675,676,677,678,679,680,681,682,683,684,685,686,687,688,689,690,691,692,693,694,695,696,697,698,699,700,702,703,705,706,707,708,709,710,711,712,714,715,716,718,719,720,722,724,725,726,727,728,729,730,731,732,733,734,735,736,737,738,739,740,741,743,744,745,746,747,748,749,751,752,753,754,755,756,757,758,759,760,761,762,764,765,766,767,768,769,770,771,772,773,774,775,776,777,778,779,780,781,782,783,784,785,786,787,788,789,790,791,792,793,795,796,797,798,799,800,801,802,803,805,806,807,808,809,810,811,812,813,814,815,816,817,818,819,820,822,823,824,825,826,827,828,829,830,831,832,833,834,835,836,837,838,839,840,841,842,843,844,846,847,848,849,850,852,853,855,856,857,858,859,860,861,862,863,864,865,866,867,868,869,870,872,873,874,875,876,877,878,879,880,881,882,883,885,886,887,888,889,890,891,892,893,894,897,898,899,900,901,902,903,905,906,907,908,909,910,911,912,913,914,915,916,917,918,919,920,921,922,923,924,925,926,927,928,929,930,931,933,934,935,936,937,938,939,940,941,942,943,944,945,946,947,948,949,950,951,952,953,954,955,956,957,958,959,960,961,962,963,964,965,966,967,968,969,970,971,973,974,975,976,977,978,979,980,982,983,984,985,986,987,988,989,990,991,992,994,995,996,998,999,1000,1002,1003,1004,1005,1006,1007,1008,1010,1011,1012,1013,1014,1015,1016,1017,1018,1019,1020,1021,1022,1023,1024,1025,1026,1027,1028,1029,1030,1031,1032,1033,1035,1036,1037,1038,1039,1040,1041,1042,1043,1044,1045,1046,1048,1049,1050,1051,1052,1053,1054,1055,1056,1057,1058,1059,1060,1062,1063,1064,1065,1066,1067,1068,1069,1070,1071,1072,1073,1074,1075,1076,1077,1078,1079,1080,1081,1082,1083,1085,1086,1087,1088,1089,1090,1091,1092,1093,1095,1096,1097,1098,1099,1100,1101,1102,1103,1104,1105,1106,1107,1108,1109,1110,1111,1112,1113,1114,1115,1116,1117,1118,1119,1120,1122,1123,1124,1125,1126,1127,1128,1129,1130,1131,1132,1133,1134,1135,1136,1137,1138,1139,1140,1141,1142,1143,1144,1145,1146,1147,1149,1150,1151,1152,1153,1155,1156,1157,1158,1159,1160,1161,1162,1163,1164,1165,1166,1167,1168,1169,1170,1171,1172,1173,1174,1175,1177,1178,1179,1180,1181,1182,1183,1184,1185,1186,1187,1189,1190,1192,1193,1194,1196,1198,1199,1200,1201,1202,1204,1205,1206,1207,1208,1209,1210,1211,1212,1213,1214,1215,1216,1217,1219,1221,1222,1224,1225,1226,1227,1228,1229,1230,1232,1233,1234,1235,1236,1237,1238,1239,1240,1241,1242,1243,1244,1245,1247,1248,1249,1250,1251,1252,1253,1254,1255,1256,1257,1258,1259,1260,1262,1263,1264,1265,1266,1267,1268,1269,1270,1272,1274,1275,1276,1277,1278,1279,1280,1281,1282,1283,1284,1285,1286,1287,1289,1290,1291,1292,1293,1295,1296,1298,1299,1300,1301,1302,1303,1304,1305,1306,1307,1308,1309,1310,1311,1312,1313,1314,1315,1316,1317,1318,1319,1320,1321,1322,1323,1324,1325,1326,1327,1328,1329,1330,1331,1332,1334,1335,1336,1337,1338,1339,1340,1341,1342,1343,1344,1345,1346,1347,1348,1349,1350,1351,1352,1353,1354,1355,1356,1357,1358,1359,1360,1361,1362,1363,1364,1365,1366,1367,1368,1369,1370,1371,1372,1373,1374,1375,1376,1377,1378,1380,1381,1382,1383,1384,1385,1386,1387,1388,1389,1391,1392,1393,1394,1395,1396,1397,1398,1400,1401,1402,1403,1405,1406,1407,1409,1410,1412,1413,1414,1415,1417,1418,1419,1420,1421,1422,1423,1424,1425,1426,1427,1428,1429,1430,1431,1432,1433,1434,1435,1436,1437,1439,1440,1441,1442,1443,1444,1446,1447,1448,1449,1450,1451,1452,1453,1455,1456,1458,1459,1460,1461,1462,1463,1464,1465,1466,1467,1469,1470,1471,1472,1473,1474,1475,1476,1477,1478,1479,1480,1481,1482,1483,1484,1485,1486,1488,1489,1490,1491,1492,1493,1494,1495,1496,1497,1498,1499,1500,1501,1502,1503,1505,1506,1507,1508,1509,1510,1511,1512,1513,1514,1515,1516,1518,1519,1520,1521,1522,1523,1524,1525,1527,1528,1529,1530,1531,1532,1536,1537,1538,1539,1540,1541,1542,1543,1544,1545,1546,1547,1548,1549,1550,1551,1552,1553,1554,1555,1556,1557,1559,1560,1561,1562,1563,1564,1566,1567,1568,1569,1571,1572,1573,1574,1575,1576,1577,1578,1579,1580,1581,1582,1583,1584,1585,1586,1587,1588,1591,1592,1593,1594,1595,1596,1597,1598,1599,1600,1601,1602,1603,1604,1605,1606,1607,1608,1609,1611,1612,1613,1614,1615,1616,1617,1618,1620,1622,1624,1625,1626,1627,1628,1629,1630,1631,1632,1633,1634,1635,1636,1637,1639,1640,1641,1642,1643,1644,1645,1646,1647,1648,1649,1651,1652,1653,1654,1655,1656,1657,1658,1659,1660,1661,1662,1663,1664,1665,1666,1667,1668,1669,1670,1671,1672,1673,1674,1675,1676,1677,1678,1679,1680,1681,1682,1683,1684,1685,1686,1687,1688,1689,1690,1691,1693,1694,1695,1696,1697,1698,1699,1701,1702,1703,1704,1705,1706,1707,1709,1710,1711,1714,1715,1716,1717,1718,1719,1720,1721,1722,1724,1725,1727,1728,1729,1730,1731,1732,1733,1734,1735,1736,1737,1738,1740,1741,1742,1743,1744,1745,1746,1747,1749,1750,1751,1752,1753,1754,1755,1756,1758,1759,1760,1761,1763,1765,1766,1767,1769,1770,1771,1772,1773,1774,1776,1778,1779,1780,1781,1782,1783,1784,1785,1786,1787,1788,1789,1790,1791,1792,1793,1795,1797,1798,1799,1800,1801,1802,1803,1804,1805,1806,1809,1810,1811,1812,1813,1814,1815,1816,1817,1818,1819,1820,1821,1822,1823,1824,1825,1827,1828,1829,1830,1831,1832,1833,1834,1835,1836,1837,1838,1839,1840,1842,1844,1845,1846,1847,1848,1849,1850,1851,1852,1853,1854,1855,1856,1857,1858,1859,1860,1861,1862,1863,1864,1865,1866,1867,1868,1869,1871,1872,1873,1874,1875,1876,1877,1878,1879,1880,1881,1882,1883,1884,1885,1886,1887,1888,1889,1890,1891,1893,1894,1895,1896,1897,1899,1900,1901,1902,1903,1904,1905,1906,1908,1909,1910,1911,1912,1913,1914,1915,1916,1917,1919,1920,1921,1922,1923,1924,1925,1926,1927,1928,1929,1930,1931,1932,1933,1934,1935,1936,1937,1938,1939,1940,1941,1942,1943,1945,1946,1947,1948,1949,1950,1951,1952,1953,1954,1955,1956,1957,1958,1960,1961,1962,1963,1964,1965,1966,1967,1968,1969,1970,1971,1973,1974,1975,1976,1977,1978,1979,1980,1981,1982,1983,1984,1985,1986,1988,1989,1990,1991,1992,1993,1994,1996,1997,1998,1999,2000,2001,2002,2003,2004,2005,2006,2007,2008,2009,2010,2011,2012,2013,2014,2015,2016,2017,2018,2019,2020,2021,2022,2024,2025,2026,2027,2028,2029,2030,2031,2032,2034,2035,2036,2037,2038,2039,2040,2041,2043,2044,2045,2046,2047,2048,2049,2050,2051,2052,2053,2054,2055,2056,2057,2058,2059,2062,2063,2064,2065,2066,2068,2069,2070,2071,2072,2073,2074,2075,2076,2077,2078,2079,2080,2082,2083,2084,2085,2086,2088,2089,2090,2091,2092,2093,2094,2095,2097,2098,2099,2100,2101,2102,2103,2104,2105,2107,2108,2109,2110,2111,2112,2113,2114,2115,2116,2117,2118,2119,2120,2121,2122,2123,2124,2125,2126,2128,2129,2130,2131,2132,2133,2134,2135,2136,2137,2138,2139,2140,2141,2142,2143,2144,2145,2146,2147,2148,2149,2150,2151,2152,2153,2154,2156,2157,2158,2159,2160,2161,2162,2163,2164,2165,2166,2167,2168,2169,2170,2171,2172,2173,2174,2175,2176,2177,2179,2180,2181,2182,2183,2184,2186,2187,2189,2191,2192,2193,2194,2195,2196,2197,2198,2199,2200,2201,2202,2203,2205,2206,2207,2208,2210,2211,2212,2213,2214,2215,2216,2218,2219,2220,2221,2222,2223,2224,2225,2227,2228,2229,2230,2231,2232,2233,2234,2235,2237,2238,2239,2240,2241,2242,2243,2244,2245,2246,2247,2248,2249,2250,2251,2252,2253,2254,2255,2256,2257,2258,2259,2260,2261,2262,2263,2264,2265,2266,2267,2268,2269,2270,2271,2272,2273,2274,2275,2276,2277,2278,2279,2280,2281,2282,2283,2284,2285,2286,2287,2288,2289,2290,2291,2292,2293,2296,2297,2298,2299,2300,2301,2302,2303,2305,2306,2307,2308,2309,2310,2311,2312,2313,2314,2315,2316,2317,2319,2320,2321,2322,2323,2324,2325,2327,2330,2331,2332,2334,2335,2336,2337,2338,2339,2340,2341,2342,2343,2344,2345,2346,2347,2348,2349,2350,2351,2352,2353,2354,2355,2356,2357,2358,2359,2360,2361,2362,2363,2364,2365,2366,2367,2368,2369,2371,2372,2373,2374,2375,2377,2379,2380,2381,2382,2383,2386,2387,2388,2389,2390,2391,2392,2393,2394,2395,2396,2397,2398,2399,2400,2401,2402,2404,2405,2406,2407,2408,2409,2411,2412,2413,2414,2415,2416,2418,2419,2420,2421,2422,2423,2424,2425,2426,2427,2428,2429,2430,2431,2432,2433,2434,2436,2437,2438,2439,2440,2441,2442,2443,2444,2445,2446,2447,2448,2450,2451,2452,2453,2454,2456,2457,2458,2459,2460,2462,2463,2464,2465,2466,2467,2468,2469,2470,2471,2472,2473,2474,2475,2476,2477,2478,2480,2481,2482,2483,2484,2486,2487,2488,2489,2490,2491,2493,2494,2495,2496,2497,2498,2499,2500,2501,2502,2503,2504,2505,2507,2508,2509,2510,2511,2512,2513,2514,2515,2516,2517,2518,2519,2520,2521,2522,2523,2524,2525,2526,2528,2529,2530,2532,2533,2534,2535,2537,2538,2539,2540,2541,2542,2543,2544,2545,2546,2547,2548,2549,2550,2551,2552,2553,2554,2555,2556,2558,2559,2560,2561,2562,2563,2564,2565,2566,2567,2569,2570,2572,2573,2574,2575,2576,2577,2578,2579,2580,2581,2582,2583,2584,2585,2586,2587,2588,2589,2590,2591,2594,2595,2596,2597,2598,2599,2600,2601,2602,2603,2604,2605,2606,2607,2608,2609,2610,2611,2612,2613,2614,2615,2616,2617,2618,2620,2621,2622,2623,2624,2625,2626,2628,2629,2630,2632,2633,2634,2635,2636,2637,2639,2640,2642,2643,2644,2645,2646,2647,2648,2650,2651,2652,2653,2654,2655,2658,2659,2661,2662,2663,2664,2665,2666,2667,2668,2669,2670,2671,2672,2673,2674,2675,2676,2677,2678,2679,2680,2681,2682,2683,2684,2685,2686,2688,2689,2690,2691,2692,2693,2694,2695,2696,2697,2698,2699,2700,2701,2702,2704,2705,2706,2708,2709,2710,2711,2712,2715,2716,2718,2719,2720,2721,2722,2723,2724,2725,2726,2727,2728,2729,2730,2731,2732,2734,2735,2736,2737,2738,2739,2740,2741,2742,2743,2744,2745,2746,2749,2750,2751,2752,2753,2754,2755,2756,2757,2758,2759,2760,2762,2766,2767,2768,2769,2770,2771,2772,2773,2774,2775,2776,2778,2780,2781,2782,2783,2784,2785,2786,2787,2788,2789,2790,2791,2792,2793,2795,2796,2797,2798,2799,2800,2801,2802,2803,2804,2805,2806,2807,2808,2809,2810,2812,2813,2814,2815,2816,2818,2819,2820,2822,2823,2825,2826,2827,2828,2829,2830,2831,2832,2833,2834,2835,2836,2837,2838,2839,2840,2841,2843,2844,2845,2846,2847,2848,2849,2850,2851,2852,2853,2854,2855,2856,2857,2858,2859,2860,2861,2862,2863,2864,2865,2866,2867,2868,2869,2870,2871,2872,2874,2875,2876,2877,2878,2879,2880,2881,2882,2883,2884,2885,2886,2887,2888,2889,2890,2891,2892,2893,2895,2896,2897,2898,2900,2901,2902,2903,2904,2905,2906,2907,2908,2909,2910,2911,2912,2913,2914,2915,2916,2917,2918,2919,2920,2921,2922,2923,2924,2925,2926,2927,2928,2929,2930,2931,2933,2934,2935,2936,2938,2939,2940,2941,2943,2945,2946,2947,2948,2949,2950,2951,2952,2953,2955,2956,2957,2958,2959,2960,2961,2963,2964,2965,2966,2967,2968,2969,2970,2971,2973,2974,2975,2976,2977,2978,2979,2980,2981,2982,2983,2984,2985,2986,2987,2989,2990,2991,2992,2993,2994,2995,2997,2998,3000,3001,3002,3003,3004,3005,3006,3007,3008,3009,3010,3011,3012,3014,3015,3017,3018,3019,3021,3022,3023,3024,3025,3026,3027,3028,3029,3030,3031,3033,3034,3035,3036,3037,3038,3039,3040,3041,3042,3045,3046,3047,3048,3049,3050,3051,3053,3054,3055,3056,3057,3058,3059,3060,3061,3062,3063,3064,3065,3066,3067,3068,3069,3070,3071,3072,3073,3074,3075,3076,3078,3079,3080,3081,3082,3083,3084,3085,3086,3088,3089,3091,3092,3093,3094,3095,3096,3097,3098,3099,3100,3101,3102,3103,3104,3105,3106,3107,3108,3109,3110,3111,3112,3113,3114,3115,3116,3117,3118,3119,3120,3121,3122,3123,3124,3125,3126,3127,3128,3129,3130,3131,3132,3133,3134,3135,3136,3137,3138,3139,3141,3142,3143,3144,3145,3146,3147,3148,3149,3150,3151,3152,3153,3154,3155,3156,3157,3158,3159,3160,3161,3162,3163,3164,3165,3166,3167,3168,3169,3171,3172,3173,3174,3175,3176,3177,3180,3181,3182,3183,3184,3186,3187,3188,3189,3190,3192,3193,3194,3195,3196,3197,3198,3199,3200,3201,3202,3203,3204,3205,3206,3207,3208,3209,3211,3212,3213,3214,3216,3217,3218,3220,3221,3222,3223,3224,3225,3227,3228,3229,3230,3231,3232,3233,3234,3235,3236,3237,3238,3239,3240,3241,3244,3245,3246,3247,3248,3249,3250,3252,3253,3254,3255,3256,3257,3258,3259,3260,3261,3262,3263,3264,3267,3268,3269,3270,3272,3273,3274,3275,3276,3277,3278,3279,3280,3281,3282,3283,3284,3285,3286,3287,3288,3289,3290,3291,3292,3293,3294,3295,3296,3298,3299,3300,3301,3302,3303,3304,3307,3308,3309,3311,3312,3313,3314,3316,3318,3319,3320,3321,3323,3324,3326,3327,3328,3329,3330,3331,3332,3333,3334,3335,3336,3337,3338,3339,3340,3341,3342,3343,3344,3345,3348,3349,3350,3351,3352,3353,3354,3355,3356,3357,3360,3361,3362,3363,3364,3365,3366,3367,3369,3370,3372,3373,3374,3375,3376,3377,3378,3379,3380,3381,3382,3383,3384,3385,3386,3387,3388,3389,3390,3391,3392,3393,3394,3395,3396,3397,3398,3399,3400,3402,3403,3404,3405,3406,3407,3408,3409,3410,3411,3414,3415,3416,3418,3419,3420,3421,3422,3423,3424,3425,3426,3427,3428,3429,3430,3431,3432,3433,3434,3435,3436,3437,3438,3440,3441,3442,3443,3444,3447,3448,3449,3451,3452,3453,3454,3455,3456,3457,3459,3460,3461,3462,3463,3464,3465,3466,3467,3468,3469,3470,3471,3472,3473,3474,3475,3476,3477,3478,3480,3482,3483,3484,3485,3486,3487,3488,3489,3490,3491,3492,3493,3494,3495,3497,3498,3499,3500,3501,3502,3503,3504,3505,3506,3507,3508,3509,3510,3511,3513,3514,3515,3516,3517,3518,3519,3520,3521,3522,3523,3524,3525,3526,3527,3528,3529,3530,3531,3532,3533,3534,3535,3537,3538,3539,3541,3542,3543,3544,3545,3546,3547,3548,3549,3550,3551,3552,3553,3554,3555,3556,3557,3558,3559,3560,3561,3562,3563,3564,3565,3566,3567,3568,3569,3570,3571,3572,3573,3575,3576,3577,3578,3579,3580,3582,3583,3585,3586,3587,3588,3589,3590,3591,3592,3593,3594,3595,3596,3597,3598,3599,3600,3601,3602,3603,3604,3605,3606,3607,3609,3610,3611,3612,3614,3615,3616,3617,3618,3619,3620,3621,3622,3623,3625,3626,3627,3628,3629,3630,3631,3632,3633,3635,3636,3637,3638,3639,3641,3642,3643,3644,3645,3647,3648,3649,3651,3652,3653,3654,3655,3656,3657,3658,3659,3661,3662,3663,3664,3665,3666,3667,3668,3669,3670,3671,3672,3673,3674,3675,3676,3678,3679,3681,3682,3683,3684,3685,3686,3687,3688,3689,3690,3691,3692,3693,3694,3696,3697,3699,3700,3701,3702,3703,3704,3705,3707,3708,3709,3711,3712,3713,3714,3715,3716,3717,3718,3719,3720,3721,3722,3723,3725,3726,3727,3728,3729,3730,3731,3732,3733,3736,3737,3738,3739,3740,3741,3742,3743,3744,3745,3746,3747,3748,3749,3750,3751,3752,3753,3754,3755,3756,3757,3758,3759,3760,3761,3762,3763,3765,3766,3767,3769,3770,3771,3772,3773,3775,3776,3777,3778,3779,3780,3781,3782,3783,3784,3785,3786,3787,3788,3789,3791,3792,3793,3794,3795,3796,3797,3798,3799,3800,3801,3802,3806,3807,3808,3809,3810,3811,3812,3813,3814,3815,3816,3817,3819,3820,3821,3822,3823,3824,3825,3826,3827,3828,3829,3831,3832,3833,3834,3835,3836,3837,3838,3839,3840,3841,3842,3843,3844,3845,3846,3848,3850,3851,3852,3853,3854,3855,3856,3857,3858,3859,3860,3861,3862,3863,3865,3866,3868,3869,3871,3872,3873,3874,3875,3876,3877,3878,3879,3880,3881,3882,3884,3885,3886,3887,3888,3889,3890,3891,3892,3893,3894,3896,3897,3898,3899,3900,3901,3902,3904,3905,3906,3907,3908,3909,3910,3912,3913,3914,3915,3916,3917,3918,3919,3920,3921,3922,3923,3924,3925,3926,3927,3928,3929,3930,3931,3932,3933,3934,3935,3936,3937,3938,3939,3941,3943,3944,3945,3946,3947,3948,3949,3950,3951,3952,3953,3954,3955,3956,3957,3958,3960,3961,3962,3963,3964,3965,3966,3967,3968,3969,3970,3971,3972,3973,3974,3975,3976,3977,3978,3979,3981,3983,3984,3985,3986,3987,3988,3990,3991,3992,3993,3994,3995,3996,3997,3998,3999,4000,4001,4002,4003,4004,4005,4006,4007,4008,4009,4010,4011,4012,4013,4014,4015,4016,4017,4018,4019,4020,4021,4022,4024,4025,4026,4027,4028,4029,4030,4031,4032,4035,4036,4037,4038,4039,4040,4041,4042,4044,4045,4046,4047,4049,4050,4051,4052,4053,4054,4055,4056,4057,4058,4059,4060,4061,4063,4064,4066,4067,4068,4069,4071,4072,4073,4074,4075,4076,4077,4078,4081,4083,4084,4085,4086,4087,4088,4089,4092,4093,4094,4095,4096,4097,4098,4099,4100,4101,4102,4103,4104,4105,4106,4107,4108,4109,4110,4111,4112,4113,4114,4115,4116,4117,4118,4119,4120,4121,4122,4123,4124,4125,4126,4127,4128,4129,4130,4131,4132,4133,4134,4135,4136,4137,4138,4139,4140,4141,4142,4143,4144,4145,4147,4148,4149,4151,4152,4153,4154,4156,4158,4159,4160,4161,4162,4163,4164,4165,4167,4168,4169,4170,4171,4172,4173,4174,4175,4176,4177,4178,4179,4180,4181,4182,4183,4184,4185,4187,4189,4190,4191,4192,4193,4194,4195,4196,4197,4198,4199,4200,4201,4202,4203,4204,4205,4206,4207,4209,4210,4211,4212,4213,4214,4215,4216,4217,4218,4219,4220,4221,4222,4223,4224,4225,4226,4228,4229,4230,4231,4232,4233,4234,4235,4236,4237,4238,4239,4240,4242,4243,4244,4245,4246,4247,4248,4249,4250,4251,4252,4253,4254,4255,4256,4257,4258,4259,4260,4261,4262,4263,4264,4265,4266,4267,4268,4269,4270,4271,4272,4273,4274,4275,4276,4277,4279,4280,4283,4284,4285,4287,4288,4289,4290,4291,4292,4293,4294,4295,4296,4297,4298,4299,4300,4301,4302,4303,4304,4305,4306,4307,4308,4309,4310,4311,4312,4313,4314,4315,4316,4317,4318,4319,4321,4322,4323,4324,4325,4326,4328,4330,4331,4332,4333,4334,4335,4336,4337,4338,4339,4340,4341,4342,4344,4345,4346,4347,4349,4350,4352,4354,4355,4356,4357,4358,4359,4360,4362,4363,4364,4366,4367,4368,4369,4371,4372,4373,4374,4375,4376,4377,4378,4379,4380,4381,4382,4383,4384,4385,4386,4387,4388,4389,4390,4391,4393,4394,4395,4396,4397,4398,4399,4400,4401,4402,4405,4406,4407,4408,4409,4410,4411,4412,4413,4414,4415,4416,4417,4418,4419,4420,4421,4422,4423,4424,4425,4426,4427,4428,4429,4430,4431,4433,4434,4435,4436,4437,4438,4439,4440,4441,4442,4443,4444,4445,4446,4449,4450,4451,4452,4453,4454,4455,4456,4458,4459,4460,4461,4463,4464,4465,4466,4467,4468,4469,4471,4472,4474,4475,4476,4478,4479,4480,4481,4482,4483,4484,4485,4486,4487,4488,4489,4490,4491,4492,4493,4494,4496,4497,4498,4499,4500,4501,4502,4503,4504,4505,4506,4507,4508,4509,4510,4511,4512,4513,4514,4516,4517,4518,4519,4520,4521,4522,4523,4524,4525,4526,4528,4529,4530,4532,4533,4534,4535,4536,4537,4538,4539,4540,4541,4543,4544,4545,4546,4547,4548,4549,4550,4551,4552,4553,4555,4556,4557,4558,4559,4560,4561,4562,4563,4564,4565,4566,4567,4568,4569,4570,4571,4572,4573,4574,4575,4576,4577,4578,4579,4580,4581,4582,4583,4584,4585,4586,4587,4588,4589,4590,4591,4592,4593,4594,4595,4596,4597,4598,4599,4600,4601,4602,4603,4605,4606,4607,4608,4609,4610,4612,4613,4615,4616,4618,4619,4620,4621,4622,4623,4624,4625,4626,4627,4629,4630,4632,4633,4634,4635,4636,4637,4638,4639,4640,4643,4644,4645,4646,4647,4648,4649,4651,4652,4653,4654,4655,4656,4657,4658,4659,4660,4661,4662,4663,4664,4665,4666,4667,4668,4669,4670,4671,4673,4674,4676,4677,4678,4679,4680,4681,4682,4683,4684,4685,4686,4687,4688,4689,4690,4691,4692,4693,4694,4695,4696,4697,4698,4699,4700,4701,4702,4703,4704,4705,4706,4707,4708,4709,4710,4711,4712,4713,4714,4715,4716,4717,4719,4721,4722,4723,4724,4725,4726,4727,4728,4729,4730,4731,4732,4733,4734,4735,4736,4737,4738,4740,4742,4743,4744,4745,4746,4747,4748,4749,4750,4751,4752,4753,4754,4755,4756,4758,4759,4760,4761,4762,4763,4764,4765,4766,4767,4768,4769,4770,4771,4772,4773,4774,4775,4777,4778,4779,4781,4782,4783,4784,4785,4786,4787,4789,4790,4791,4792,4793,4794,4795,4796,4797,4798,4799,4800,4801,4802,4803,4805,4806,4807,4808,4809,4810,4811,4812,4813,4814,4815,4816,4817,4818,4820,4821,4822,4823,4825,4826,4827,4828,4829,4830,4831,4832,4833,4835,4836,4837,4838,4839,4840,4841,4842,4843,4844,4845,4846,4847,4848,4849,4850,4851,4852,4853,4854,4855,4856,4858,4859,4860,4861,4863,4864,4865,4866,4867,4868,4869,4870,4871,4872,4873,4874,4875,4876,4877,4878,4879,4881,4882,4883,4884,4885,4886,4888,4889,4890,4892,4893,4894,4895,4896,4897,4898,4899,4900,4901,4902,4903,4904,4905,4906,4907,4908,4909,4910,4911,4912,4913,4914,4915,4916,4917,4918,4919,4920,4921,4922,4924,4925,4926,4927,4928,4929,4930,4931,4932,4933,4934,4936,4938,4939,4940,4941,4942,4943,4944,4945,4946,4947,4948,4949,4950,4951,4952,4953,4954,4955,4956,4960,4961,4962,4963,4964,4965,4966,4967,4968,4969,4970,4971,4972,4973,4974,4975,4976,4977,4978,4979,4980,4981,4982,4983,4984,4985,4986,4987,4988,4989,4990,4991,4993,4994,4995,4996,4997,4998,5000,5001,5002,5003,5004,5005,5007,5009,5010,5011,5012,5013,5014,5015,5016,5017,5018,5019,5020,5021,5022,5023,5024,5025,5026,5027,5028,5029,5030,5032,5034,5036,5037,5038,5039,5040,5041,5042,5044,5045,5046,5047,5048,5049,5050,5052,5053,5054,5055,5056,5057,5058,5059,5060,5061,5062,5063,5064,5065,5066,5067,5068,5070,5071,5072,5073,5074,5075,5076,5077,5078,5080,5081,5082,5083,5084,5085,5086,5088,5089,5090,5091,5092,5093,5094,5095,5096,5097,5098,5099,5100,5101,5102,5103,5104,5105,5106,5107,5110,5111,5112,5113,5114,5115,5116,5117,5118,5119,5120,5121,5122,5123,5125,5126,5127,5128,5129,5130,5131,5132,5134,5135,5136,5137,5138,5140,5142,5143,5144,5145,5146,5148,5149,5150,5151,5152,5153,5154,5156,5157,5158,5159,5160,5161,5162,5163,5164,5166,5167,5168,5169,5170,5171,5172,5173,5174,5175,5176,5177,5178,5179,5180,5181,5182,5183,5184,5185,5186,5187,5188,5189,5190,5191,5192,5193,5194,5195,5196,5197,5198,5199,5200,5201,5202,5203,5204,5205,5206,5207,5208,5209,5210,5211,5212,5213,5214,5215,5216,5217,5218,5219,5220,5221,5222,5223,5224,5225,5226,5227,5228,5229,5230,5231,5232,5233,5234,5235,5236,5237,5238,5239,5240,5242,5245,5246,5247,5248,5250,5252,5254,5256,5258,5260,5261,5262,5263,5264,5265,5266,5267,5268,5269,5271,5272,5273,5274,5275,5276,5277,5278,5279,5281,5282,5283,5284,5285,5286,5287,5288,5289,5291,5292,5293,5294,5295,5296,5297,5298,5299,5300,5302,5303,5304,5306,5308,5309,5310,5311,5312,5313,5314,5315,5316,5317,5318,5319,5322,5323,5324,5325,5326,5327,5328,5329,5330,5331,5332,5333,5334,5335,5336,5338,5339,5340,5341,5343,5344,5345,5346,5347,5348,5349,5350,5351,5352,5354,5355,5356,5357,5358,5359,5360,5361,5362,5363,5364,5365,5366,5367,5370,5371,5372,5373,5374,5375,5376,5377,5378,5379,5380,5381,5382,5383,5384,5385,5386,5387,5388,5389,5390,5391,5392,5393,5394,5395,5396,5397,5399,5400,5401,5402,5403,5404,5406,5407,5408,5409,5410,5411,5412,5413,5414,5416,5417,5418,5419,5420,5421,5422,5423,5424,5425,5426,5427,5429,5431,5432,5433,5434,5436,5437,5438,5439,5440,5441,5442,5444,5445,5446,5447,5448,5449,5451,5453,5454,5455,5456,5457,5458,5460,5461,5462,5464,5465,5466,5467,5468,5469,5471,5472,5473,5474,5475,5476,5477,5478,5479,5480,5481,5482,5484,5485,5486,5487,5488,5489,5490,5491,5492,5493,5494,5495,5496,5497,5498,5499,5500,5501,5502,5503,5504,5506,5507,5508,5509,5510,5511,5512,5514,5515,5516,5517,5518,5520,5521,5522,5523,5524,5525,5527,5528,5530,5532,5533,5534,5535,5536,5537,5538,5539,5540,5541,5542,5543,5544,5545,5546,5547,5548,5549,5550,5551,5552,5553,5555,5556,5557,5558,5559,5560,5561,5562,5563,5564,5565,5566,5568,5569,5570,5571,5572,5573,5574,5575,5576,5577,5578,5579,5580,5581,5582,5583,5585,5586,5587,5588,5589,5590,5591,5594,5595,5596,5597,5598,5599,5600,5601,5602,5604,5605,5606,5607,5608,5609,5610,5611,5612,5614,5615,5616,5617,5618,5619,5620,5621,5622,5623,5624,5625,5626,5627,5628,5629,5630,5631,5632,5633,5634,5635,5636,5637,5638,5639,5640,5641,5642,5643,5644,5645,5646,5647,5648,5649,5650,5651,5654,5655,5656,5657,5658,5660,5661,5662,5663,5664,5665,5666,5667,5668,5670,5671,5672,5674,5675,5676,5677,5678,5679,5680,5681,5682,5683,5687,5688,5689,5690,5691,5692,5693,5694,5696,5697,5698,5699,5700,5701,5702,5703,5704,5705,5706,5707,5708,5709,5710,5711,5712,5713,5714,5715,5716,5717,5719,5720,5722,5723,5724,5725,5726,5727,5728,5729,5730,5732,5733,5734,5735,5736,5738,5739,5740,5741,5742,5743,5744,5745,5746,5747,5748,5749,5751,5752,5753,5754,5755,5757,5758,5759,5760,5761,5762,5763,5764,5765,5766,5767,5768,5769,5770,5771,5772,5773,5774,5775,5776,5777,5779,5780,5781,5782,5783,5784,5785,5786,5787,5788,5789,5790,5792,5793,5794,5795,5796,5797,5798,5799,5800,5801,5802,5803,5804,5805,5807,5808,5809,5810,5811,5813,5814,5815,5816,5817,5819,5820,5821,5822,5823,5824,5825,5826,5829,5831,5832,5833,5834,5835,5836,5837,5839,5840,5841,5842,5843,5844,5845,5846,5848,5849,5850,5851,5852,5853,5854,5855,5856,5857,5858,5859,5860,5861,5862,5863,5864,5866,5867,5868,5869,5871,5872,5873,5874,5875,5876,5877,5878,5879,5880,5881,5882,5883,5884,5885,5886,5887,5888,5889,5891,5892,5893,5894,5895,5896,5897,5898,5900,5901,5902,5903,5904,5905,5906,5907,5908,5909,5910,5911,5912,5913,5914,5915,5916,5917,5919,5920,5921,5922,5923,5924,5925,5926,5927,5928,5931,5933,5934,5935,5936,5937,5938,5939,5940,5941,5943,5944,5945,5946,5947,5948,5949,5950,5951,5953,5954,5955,5956,5957,5958,5959,5960,5961,5962,5963,5964,5966,5967,5968,5969,5970,5971,5972,5973,5975,5976,5977,5978,5979,5981,5982,5983,5984,5985,5986,5988,5989,5991,5992,5994,5995,5996,5997,5998,5999,6000,6001,6002,6004,6005,6006,6007,6008,6009,6010,6011,6012,6013,6014,6017,6018,6019,6020,6021,6022,6023,6024,6025,6026,6027,6028,6029,6030,6031,6032,6033,6034,6035,6036,6037,6038,6039,6041,6042,6043,6044,6045,6046,6047,6048,6049,6050,6051,6052,6053,6054,6055,6056,6057,6058,6059,6060,6061,6063,6064,6065,6066,6067,6068,6069,6070,6071,6073,6074,6075,6076,6077,6078,6079,6080,6081,6083,6084,6085,6086,6087,6088,6089,6090,6091,6092,6093,6094,6095,6096,6098,6100,6101,6102,6103,6104,6105,6106,6107,6108,6109,6110,6111,6112,6113,6115,6116,6118,6119,6120,6121,6122,6123,6124,6125,6126,6128,6130,6132,6134,6135,6136,6137,6138,6139,6141,6142,6143,6144,6145,6146,6147,6148,6149,6150,6151,6152,6153,6154,6155,6156,6157,6158,6159,6160,6161,6162,6164,6165,6166,6167,6168,6169,6170,6171,6172,6173,6174,6175,6176,6177,6178,6179,6180,6182,6183,6184,6185,6186,6187,6188,6189,6190,6192,6193,6194,6195,6196,6197,6198,6199,6200,6202,6203,6204,6205,6206,6207,6208,6209,6210,6212,6213,6214,6215,6216,6217,6218,6219,6220,6221,6222,6223,6224,6225,6226,6227,6228,6229,6230,6231,6232,6233,6234,6235,6236,6237,6238,6239,6240,6242,6243,6244,6245,6246,6247,6248,6249,6251,6252,6253,6254,6255,6256,6257,6258,6260,6261,6262,6263,6265,6266,6267,6268,6269,6270,6271,6272,6273,6274,6275,6276,6277,6278,6279,6281,6282,6283,6284,6285,6289,6290,6291,6292,6294,6295,6296,6297,6298,6299,6300,6301,6302,6303,6304,6305,6306,6307,6308,6310,6311,6312,6313,6314,6315,6316,6317,6318,6320,6321,6322,6323,6324,6325,6326,6327,6329,6330,6331,6332,6333,6334,6335,6336,6337,6338,6339,6340,6341,6343,6345,6346,6347,6348,6349,6350,6352,6353,6354,6355,6356,6357,6358,6359,6360,6361,6362,6363,6364,6365,6366,6367,6368,6369,6370,6371,6372,6373,6374,6375,6376,6377,6378,6379,6380,6381,6382,6384,6385,6386,6387,6388,6389,6390,6391,6392,6393,6394,6395,6396,6397,6399,6401,6402,6403,6404,6405,6406,6407,6408,6409,6410,6411,6412,6413,6414,6415,6416,6417,6418,6419,6420,6421,6422,6423,6425,6427,6430,6431,6432,6433,6434,6435,6436,6438,6439,6440,6441,6442,6443,6445,6446,6447,6448,6449,6450,6451,6452,6453,6455,6456,6457,6458,6459,6460,6462,6463,6464,6465,6466,6467,6468,6469,6471,6472,6474,6475,6476,6477,6479,6480,6481,6482,6483,6484,6485,6486,6487,6488,6490,6491,6492,6493,6494,6495,6496,6497,6498,6499,6500,6501,6502,6503,6504,6505,6506,6507,6508,6509,6511,6512,6513,6514,6515,6516,6517,6518,6519,6520,6521,6522,6523,6524,6525,6527,6528,6529,6530,6531,6533,6534,6535,6536,6537,6538,6539,6540,6541,6542,6543,6544,6545,6547,6548,6549,6550,6551,6552,6553,6554,6555,6556,6558,6559,6560,6561,6562,6563,6564,6565,6566,6568,6569,6570,6571,6572,6573,6574,6575,6576,6577,6578,6579,6581,6582,6584,6585,6586,6587,6589,6591,6592,6593,6594,6595,6596,6598,6599,6600,6601,6603,6604,6605,6606,6607,6608,6609,6610,6611,6612,6613,6614,6615,6616,6617,6618,6619,6620,6622,6623,6624,6625,6626,6627,6628,6629,6630,6631,6632,6634,6635,6636,6637,6638,6639,6640,6641,6642,6644,6645,6646,6647,6648,6649,6650,6652,6653,6654,6655,6656,6657,6658,6659,6660,6661,6662,6663,6664,6665,6666,6667,6668,6669,6670,6671,6673,6674,6675,6676,6677,6678,6679,6680,6681,6682,6683,6684,6685,6686,6687,6688,6689,6690,6691,6692,6693,6694,6695,6696,6697,6698,6699,6700,6702,6703,6704,6705,6706,6707,6708,6709,6710,6712,6713,6714,6715,6716,6717,6718,6720,6721,6722,6723,6724,6725,6726,6727,6728,6729,6730,6731,6732,6733,6734,6735,6736,6737,6738,6739,6740,6741,6742,6743,6744,6745,6746,6747,6748,6749,6751,6754,6755,6756,6757,6758,6759,6761,6762,6763,6764,6765,6767,6768,6769,6771,6772,6773,6774,6775,6776,6777,6778,6780,6782,6783,6784,6785,6787,6788,6789,6790,6791,6792,6793,6794,6796,6797,6799,6800,6801,6802,6803,6804,6805,6806,6807,6809,6810,6811,6812,6813,6814,6815,6816,6817,6819,6820,6821,6822,6823,6824,6825,6826,6827,6828,6829,6830,6831,6832,6834,6836,6837,6838,6839,6840,6842,6844,6845,6846,6847,6848,6849,6850,6851,6852,6853,6854,6855,6856,6857,6858,6859,6860,6861,6862,6863,6864,6865,6866,6867,6868,6869,6870,6871,6872,6873,6874,6875,6876,6878,6879,6880,6881,6882,6883,6884,6885,6886,6887,6888,6889,6890,6891,6893,6895,6896,6897,6898,6899,6900,6901,6902,6903,6904,6905,6906,6907,6908,6909,6910,6911,6912,6913,6914,6915,6916,6917,6918,6919,6920,6922,6924,6926,6928,6929,6930,6931,6932,6933,6934,6935,6936,6938,6939,6940,6941,6942,6943,6944,6945,6946,6948,6949,6950,6951,6952,6953,6954,6955,6956,6957,6958,6960,6961,6963,6964,6965,6966,6967,6969,6972,6973,6974,6975,6976,6977,6980,6981,6982,6983,6984,6985,6986,6987,6988,6989,6990,6991,6992,6993,6994,6995,6996,6997,6998,6999,7000,7001,7002,7003,7004,7005,7006,7007,7008,7009,7010,7011,7012,7013,7014,7015,7016,7017,7018,7019,7020,7021,7022,7023,7024,7025,7026,7027,7028,7029,7030,7032,7033,7034,7035,7036,7038,7039,7040,7041,7042,7043,7044,7045,7046,7047,7048,7050,7051,7053,7054,7055,7056,7057,7058,7059,7060,7061,7063,7064,7065,7066,7067,7068,7069,7070,7071,7073,7074,7075,7076,7077,7078,7079,7080,7081,7082,7083,7085,7087,7088,7089,7090,7091,7092,7093,7094,7095,7096,7097,7098,7099,7100,7101,7102,7103,7104,7105,7106,7107,7108,7109,7110,7111,7113,7114,7115,7116,7117,7118,7119,7120,7121,7122,7123,7124,7125,7126,7127,7128,7130,7131,7132,7134,7135,7136,7137,7138,7140,7141,7142,7143,7144,7145,7146,7147,7148,7149,7150,7151,7152,7153,7154,7155,7156,7157,7158,7159,7160,7163,7164,7165,7166,7167,7169,7170,7171,7172,7173,7174,7176,7177,7178,7179,7180,7181,7182,7183,7184,7185,7186,7187,7188,7189,7191,7192,7193,7194,7195,7196,7197,7198,7199,7200,7201,7204,7205,7206,7207,7208,7209,7210,7211,7212,7213,7214,7215,7217,7218,7219,7220,7222,7223,7224,7226,7227,7228,7229,7230,7232,7233,7234,7235,7236,7237,7238,7239,7240,7241,7242,7243,7244,7245,7246,7247,7248,7249,7250,7251,7252,7253,7254,7256,7257,7258,7259,7260,7262,7264,7265,7266,7267,7268,7270,7271,7272,7273,7274,7275,7276,7277,7278,7280,7281,7282,7283,7284,7285,7286,7287,7288,7290,7291,7292,7293,7294,7295,7296,7297,7298,7299,7300,7301,7302,7303,7304,7305,7306,7307,7308,7309,7310,7311,7312,7313,7314,7315,7316,7318,7319,7320,7321,7322,7323,7324,7325,7326,7327,7328,7329,7331,7332,7333,7334,7335,7336,7338,7339,7340,7341,7343,7344,7345,7346,7347,7348,7349,7350,7351,7352,7353,7355,7356,7357,7358,7359,7360,7361,7362,7364,7365,7366,7369,7370,7371,7372,7373,7374,7375,7376,7377,7378,7379,7380,7382,7383,7384,7386,7387,7388,7389,7390,7391,7392,7393,7394,7395,7396,7397,7398,7399,7400,7401,7402,7403,7404,7405,7406,7407,7408,7409,7411,7412,7413,7414,7415,7416,7417,7418,7419,7420,7421,7422,7423,7424,7425,7426,7427,7428,7429,7430,7431,7432,7433,7434,7435,7436,7437,7438,7439,7441,7442,7443,7444,7445,7447,7448,7450,7451,7453,7454,7455,7456,7457,7458,7459,7460,7461,7462,7463,7464,7466,7467,7468,7469,7470,7471,7472,7473,7474,7475,7476,7477,7478,7479,7480,7481,7482,7483,7484,7486,7487,7488,7489,7490,7492,7493,7494,7495,7496,7497,7498,7499,7500,7501,7502,7503,7504,7507,7508,7509,7510,7511,7512,7513,7514,7515,7517,7518,7519,7520,7521,7522,7523,7524,7525,7527,7528,7529,7530,7531,7532,7533,7534,7535,7538,7539,7540,7541,7542,7543,7544,7545,7546,7547,7548,7549,7550,7551,7552,7553,7554,7556,7557,7559,7560,7561,7562,7563,7564,7565,7567,7568,7569,7570,7571,7572,7573,7574,7575,7576,7577,7578,7579,7580,7581,7582,7583,7584,7585,7586,7587,7588,7589,7590,7591,7592,7594,7595,7596,7597,7598,7600,7602,7603,7604,7605,7606,7608,7609,7610,7611,7612,7613,7614,7615,7616,7618,7619,7620,7621,7622,7623,7624,7626,7627,7628,7629,7630,7631,7632,7633,7634,7635,7636,7637,7638,7639,7640,7641,7642,7643,7644,7645,7647,7648,7649,7650,7651,7652,7653,7654,7656,7657,7658,7659,7660,7661,7662,7663,7664,7665,7666,7667,7668,7669,7670,7672,7673,7674,7675,7676,7677,7678,7679,7680,7681,7682,7683,7684,7685,7686,7687,7689,7690,7691,7692,7694,7695,7696,7697,7698,7700,7701,7704,7705,7707,7708,7709,7710,7711,7712,7713,7714,7715,7716,7717,7718,7719,7720,7721,7722,7724,7725,7726,7728,7729,7730,7731,7732,7733,7734,7735,7736,7738,7739,7740,7741,7742,7743,7744,7745,7746,7748,7749,7750,7751,7752,7753,7754,7755,7756,7757,7758,7759,7760,7761,7762,7763,7764,7765,7766,7767,7768,7769,7770,7771,7772,7773,7774,7775,7776,7777,7778,7779,7781,7783,7784,7785,7786,7787,7788,7789,7790,7792,7793,7794,7795,7796,7797,7798,7799,7800,7801,7802,7803,7804,7805,7806,7807,7808,7809,7811,7812,7813,7814,7815,7816,7818,7819,7821,7822,7823,7824,7825,7826,7827,7828,7829,7831,7832,7833,7834,7836,7837,7839,7840,7841,7842,7843,7844,7845,7847,7848,7849,7850,7851,7852,7853,7854,7856,7857,7858,7859,7860,7861,7862,7863,7864,7865,7867,7869,7870,7871,7872,7874,7875,7876,7877,7878,7879,7880,7881,7883,7884,7885,7886,7888,7890,7891,7892,7893,7894,7895,7896,7897,7899,7900,7901,7902,7903,7904,7905,7906,7908,7909,7910,7911,7912,7914,7915,7916,7917,7918,7919,7920,7921,7922,7923,7924,7925,7926,7927,7928,7929,7930,7931,7932,7934,7935,7936,7937,7938,7939,7940,7941,7942,7944,7945,7946,7947,7948,7949,7950,7951,7952,7954,7955,7956,7957,7958,7959,7960,7961,7962,7963,7964,7965,7966,7968,7969,7970,7971,7972,7973,7974,7975,7976,7977,7978,7979,7980,7981,7982,7983,7984,7985,7986,7988,7990,7991,7992,7993,7994,7995,7996,7997,7998,7999,8000,8001,8002,8003,8004,8005,8006,8008,8009,8010,8011,8012,8013,8014,8015,8017,8018,8019,8020,8022,8024,8025,8026,8027,8028,8030,8031,8032,8033,8034,8035,8036,8037,8038,8039,8040,8041,8042,8043,8044,8045,8046,8047,8048,8049,8050,8051,8052,8053,8054,8058,8059,8060,8061,8062,8063,8064,8065,8066,8068,8069,8070,8071,8072,8073,8074,8075,8076,8078,8079,8080,8081,8082,8083,8084,8086,8087,8088,8089,8090,8091,8092,8093,8094,8095,8096,8097,8099,8100,8101,8102,8103,8104,8105,8106,8107,8108,8109,8110,8112,8113,8115,8116,8118,8119,8120,8121,8122,8123,8124,8125,8126,8128,8129,8130,8131,8132,8133,8134,8135,8136,8138,8139,8140,8141,8142,8143,8144,8145,8146,8147,8148,8149,8150,8151,8153,8154,8155,8156,8157,8158,8159,8160,8161,8162,8164,8165,8166,8167,8168,8169,8170,8171,8173,8174,8175,8176,8177,8178,8180,8181,8182,8183,8184,8185,8186,8187,8188,8189,8190,8191,8192,8193,8196,8197,8198,8200,8201,8202,8203,8204,8205,8206,8207,8208,8209,8210,8211,8213,8214,8215,8216,8217,8218,8219,8220,8222,8223,8224,8225,8226,8227,8229,8230,8231,8232,8233,8234,8235,8236,8237,8238,8239,8240,8241,8242,8244,8245,8246,8247,8248,8249,8250,8252,8253,8254,8255,8256,8257,8258,8259,8261,8262,8263,8264,8265,8266,8267,8268,8269,8270,8271,8272,8274,8275,8276,8277,8279,8280,8281,8282,8284,8285,8286,8287,8288,8289,8290,8291,8292,8293,8294,8295,8296,8297,8298,8299,8300,8301,8302,8303,8304,8305,8306,8308,8309,8310,8311,8312,8313,8314,8315,8316,8317,8318,8319,8320,8321,8322,8323,8324,8326,8327,8328,8329,8330,8331,8332,8333,8334,8336,8337,8339,8340,8341,8344,8345,8346,8347,8348,8349,8350,8352,8353,8354,8355,8356,8357,8358,8360,8361,8362,8363,8364,8365,8366,8367,8368,8369,8370,8371,8372,8374,8375,8376,8377,8378,8379,8380,8381,8383,8384,8385,8386,8387,8390,8391,8392,8393,8394,8395,8396,8397,8398,8399,8400,8401,8402,8403,8404,8405,8406,8407,8408,8409,8410,8411,8412,8413,8415,8416,8417,8418,8419,8420,8421,8422,8423,8424,8426,8427,8428,8429,8430,8431,8432,8433,8434,8435,8436,8437,8438,8439,8440,8441,8442,8443,8444,8445,8446,8447,8449,8450,8451,8452,8453,8454,8455,8456,8457,8459,8460,8461,8462,8463,8464,8465,8466,8467,8469,8470,8471,8472,8473,8474,8475,8476,8477,8478,8479,8480,8482,8483,8484,8485,8486,8487,8488,8489,8491,8492,8493,8494,8495,8497,8498,8499,8500,8502,8503,8504,8505,8506,8507,8508,8509,8510,8511,8512,8515,8516,8517,8518,8519,8520,8521,8522,8523,8524,8525,8526,8527,8529,8530,8531,8532,8533,8534,8536,8537,8538,8539,8540,8541,8542,8543,8544,8545,8546,8547,8549,8550,8551,8552,8553,8554,8555,8556,8557,8559,8560,8561,8562,8563,8564,8565,8566,8568,8569,8570,8571,8572,8573,8574,8575,8577,8578,8579,8580,8581,8582,8583,8584,8585,8586,8588,8589,8590,8591,8592,8593,8594,8596,8597,8598,8599,8600,8601,8602,8603,8604,8605,8606,8607,8608,8609,8610,8612,8613,8615,8616,8617,8618,8620,8622,8623,8624,8625,8626,8627,8628,8630,8631,8632,8633,8635,8636,8637,8638,8639,8640,8641,8642,8643,8644,8645,8646,8647,8648,8649,8650,8651,8652,8653,8654,8655,8656,8658,8659,8660,8661,8662,8663,8664,8665,8666,8667,8668,8669,8670,8672,8673,8674,8675,8676,8677,8678,8679,8680,8682,8683,8684,8685,8686,8687,8688,8689,8690,8692,8693,8694,8695,8696,8697,8698,8699,8700,8701,8702,8703,8704,8705,8706,8707,8708,8709,8710,8711,8712,8713,8714,8715,8716,8717,8718,8719,8720,8721,8722,8723,8724,8725,8726,8727,8728,8729,8732,8733,8734,8735,8736,8737,8739,8740,8741,8742,8743,8744,8745,8746,8747,8749,8750,8751,8753,8754,8755,8756,8757,8758,8759,8760,8761,8762,8766,8767,8768,8769,8770,8771,8773,8774,8775,8776,8777,8778,8779,8780,8781,8782,8783,8784,8785,8786,8787,8788,8789,8790,8791,8792,8793,8794,8796,8797,8799,8800,8801,8802,8803,8804,8805,8806,8807,8809,8810,8811,8812,8813,8814,8815,8816,8817,8819,8820,8821,8822,8823,8824,8825,8826,8827,8828,8829,8830,8831,8832,8833,8834,8835,8836,8837,8838,8839,8840,8841,8842,8843,8844,8846,8847,8848,8850,8852,8853,8854,8855,8856,8857,8860,8861,8862,8863,8864,8866,8867,8869,8870,8871,8872,8873,8874,8875,8876,8877,8878,8879,8880,8882,8883,8884,8885,8886,8887,8888,8889,8890,8891,8892,8893,8894,8896,8897,8898,8899,8900,8901,8902,8903,8904,8905,8906,8907,8908,8909,8910,8911,8912,8914,8915,8916,8917,8918,8919,8920,8922,8923,8924,8925,8926,8927,8928,8930,8931,8932,8933,8934,8935,8936,8937,8938,8939,8940,8941,8942,8943,8944,8945,8946,8947,8948,8949,8950,8952,8953,8954,8955,8956,8957,8958,8959,8960,8961,8962,8963,8964,8965,8966,8967,8968,8969,8970,8971,8972,8973,8974,8975,8976,8977,8979,8980,8981,8982,8984,8985,8986,8987,8988,8989,8990,8993,8994,8995,8996,8997,8998,9000,9001,9002,9003,9005,9006,9007,9008,9009,9010,9011,9012,9013,9014,9015,9017,9018,9019,9020,9021,9022,9023,9024,9025,9026,9027,9028,9029,9030,9031,9032,9033,9034,9035,9036,9039,9040,9041,9042,9043,9044,9045,9046,9047,9048,9049,9050,9051,9053,9054,9055,9056,9057,9058,9059,9061,9062,9063,9064,9065,9066,9067,9068,9069,9071,9072,9073,9074,9075,9076,9077,9078,9079,9081,9082,9083,9084,9085,9086,9087,9088,9089,9090,9091,9092,9093,9094,9096,9097,9098,9099,9100,9101,9102,9103,9104,9106,9107,9108,9109,9110,9111,9112,9113,9114,9115,9116,9117,9118,9119,9120,9121,9122,9123,9124,9125,9126,9127,9128,9129,9130,9131,9132,9133,9135,9136,9138,9139,9140,9141,9142,9143,9144,9145,9146,9147,9148,9149,9150,9151,9152,9153,9154,9155,9156,9157,9159,9160,9161,9163,9164,9165,9166,9168,9169,9170,9171,9172,9173,9175,9176,9177,9178,9180,9181,9182,9183,9184,9185,9186,9187,9188,9190,9191,9192,9193,9194,9195,9196,9197,9198,9200,9201,9202,9203,9204,9205,9206,9207,9208,9209,9210,9211,9212,9213,9214,9215,9216,9217,9218,9219,9222,9224,9225,9226,9227,9228,9229,9231,9232,9233,9234,9235,9237,9238,9240,9241,9242,9243,9245,9246,9247,9248,9249,9250,9251,9252,9253,9254,9255,9256,9257,9258,9259,9260,9261,9262,9263,9265,9266,9267,9268,9269,9270,9271,9272,9274,9275,9276,9277,9278,9279,9280,9282,9283,9284,9285,9286,9287,9288,9289,9290,9291,9292,9293,9294,9295,9298,9299,9300,9301,9302,9303,9304,9305,9306,9307,9308,9309,9312,9313,9314,9315,9316,9317,9318,9319,9320,9321,9322,9323,9324,9326,9327,9328,9329,9330,9331,9332,9333,9334,9335,9336,9337,9338,9340,9341,9342,9343,9344,9345,9346,9347,9348,9349,9350,9351,9353,9354,9355,9356,9357,9359,9360,9361,9362,9363,9364,9365,9366,9368,9369,9370,9371,9372,9373,9374,9375,9376,9378,9379,9380,9381,9382,9383,9384,9385,9386,9388,9389,9390,9391,9392,9393,9394,9395,9397,9398,9399,9400,9401,9402,9403,9404,9406,9407,9408,9409,9410,9411,9412,9413,9415,9416,9417,9418,9419,9420,9421,9422,9423,9424,9426,9427,9428,9429,9430,9431,9432,9433,9434,9435,9437,9438,9441,9442,9443,9444,9445,9446,9447,9448,9449,9450,9451,9452,9453,9454,9456,9458,9460,9461,9462,9463,9464,9465,9466,9467,9468,9469,9470,9471,9472,9473,9474,9475,9476,9477,9478,9479,9480,9481,9482,9483,9484,9485,9486,9487,9489,9490,9491,9492,9493,9494,9495,9496,9497,9499,9500,9501,9502,9503,9504,9505,9506,9507,9509,9510,9511,9512,9513,9514,9515,9516,9517,9518,9520,9521,9522,9523,9524,9525,9526,9529,9530,9531,9532,9533,9534,9535,9536,9537,9538,9539,9540,9541,9543,9544,9545,9546,9547,9548,9549,9550,9551,9553,9554,9555,9556,9557,9558,9559,9560,9561,9562,9563,9564,9565,9566,9567,9568,9569,9570,9571,9572,9573,9574,9575,9576,9577,9578,9579,9580,9581,9582,9583,9584,9586,9587,9588,9589,9590,9591,9592,9593,9594,9595,9596,9597,9598,9599,9600,9602,9603,9604,9605,9606,9607,9608,9609,9610,9612,9613,9614,9615,9616,9617,9618,9619,9620,9622,9623,9624,9625,9626,9627,9628,9629,9630,9632,9635,9636,9637,9638,9639,9640,9641,9642,9643,9644,9645,9646,9649,9650,9651,9652,9653,9654,9655,9656,9657,9658,9659,9660,9661,9662,9664,9665,9667,9668,9669,9670,9671,9672,9673,9674,9675,9676,9678,9679,9680,9681,9682,9683,9684,9685,9686,9689,9690,9691,9692,9693,9694,9695,9696,9697,9698,9699,9700,9701,9702,9703,9705,9706,9707,9708,9709,9710,9711,9712,9713,9715,9716,9717,9718,9719,9720,9721,9722,9723,9725,9726,9727,9728,9729,9730,9731,9732,9733,9734,9735,9736,9737,9738,9740,9741,9742,9743,9744,9745,9746,9747,9748,9749,9750,9751,9752,9754,9755,9756,9758,9759,9760,9762,9764,9765,9766,9767,9768,9769,9770,9771,9772,9773,9774,9775,9776,9777,9778,9779,9780,9781,9782,9783,9784,9785,9786,9787,9788,9789,9790,9792,9793,9794,9795,9796,9797,9798,9799,9802,9803,9804,9805,9806,9807,9808,9810,9811,9812,9813,9814,9815,9816,9817,9819,9820,9821,9822,9823,9824,9825,9827,9828,9829,9830,9831,9832,9833,9834,9835,9836,9837,9838,9839,9840,9841,9842,9843,9844,9845,9846,9847,9848,9849,9851,9852,9853,9854,9855,9856,9857,9858,9859,9860,9861,9862,9863,9864,9866,9867,9868,9869,9870,9871,9872,9873,9874,9875,9876,9877,9878,9880,9881,9882,9883,9884,9886,9887,9888,9889,9890,9891,9892,9893,9894,9895,9896,9898,9899,9900,9901,9903,9904,9905,9906,9907,9908,9909,9910,9912,9913,9914,9915,9916,9917,9918,9919,9920,9921,9922,9923,9924,9925,9926,9927,9928,9929,9931,9932,9933,9934,9935,9936,9937,9938,9940,9941,9942,9943,9944,9945,9946,9947,9949,9950,9953,9954,9955,9956,9957,9958,9959,9960,9961,9963,9965,9966,9967,9968,9969,9970,9971,9972,9973,9974,9975,9976,9977,9978,9979,9980,9981,9982,9984,9985,9986,9987,9988,9989,9990,9991,9992,9994,9995,9996,9997,9998,9999],"errors":9020},"selected_test":{"loss":2.302585546875,"accuracy":0.098,"n":10000,"wrong_indices":[0,1,2,4,5,6,7,8,9,11,12,14,15,16,17,18,19,20,21,22,23,24,26,27,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,56,57,58,59,60,61,62,63,64,65,66,67,68,70,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,127,128,129,130,131,132,133,134,135,137,138,139,140,141,142,143,144,145,146,147,149,150,151,152,153,154,155,156,158,159,160,161,162,163,164,165,166,167,168,169,170,171,172,173,174,175,176,177,178,179,180,181,182,184,185,186,187,189,190,191,193,195,196,197,198,199,200,201,202,203,204,205,206,207,208,209,210,211,212,213,214,216,217,218,219,220,221,222,223,224,225,226,227,228,229,230,231,232,233,234,235,236,237,238,239,240,241,242,243,244,245,247,248,249,250,251,252,253,254,255,256,257,258,259,260,261,262,263,264,265,266,267,268,270,272,273,274,275,276,277,278,279,280,281,282,283,284,285,286,287,288,289,290,291,292,293,295,298,299,300,301,302,303,304,306,307,308,309,310,313,314,315,316,317,318,319,320,321,322,323,325,326,328,329,330,331,332,333,334,335,336,337,338,339,340,341,342,343,344,345,347,348,349,350,351,352,353,354,355,356,357,358,359,360,361,362,363,364,366,367,368,369,370,371,373,374,375,376,377,378,379,381,382,383,384,385,386,387,388,389,390,391,392,393,394,395,396,397,398,399,400,401,402,403,404,405,406,408,409,410,411,412,413,414,415,416,417,418,419,420,421,422,423,425,426,427,428,429,430,431,432,433,434,435,436,437,438,439,442,444,445,446,447,448,449,450,451,452,453,454,455,456,457,458,460,461,462,463,464,465,466,467,468,469,470,471,472,473,474,475,476,477,478,479,480,481,482,483,484,486,487,488,489,491,492,493,494,495,496,497,499,500,501,502,503,504,505,506,507,508,509,510,511,512,513,514,515,516,517,518,519,520,521,522,523,524,526,527,528,529,530,531,532,533,534,535,536,537,538,539,540,541,542,543,544,547,548,549,550,551,553,554,555,556,557,558,559,560,562,563,565,566,568,569,570,571,572,573,574,575,576,577,578,579,580,582,583,584,585,587,588,589,590,591,593,594,595,596,598,599,600,601,602,603,604,605,606,607,609,610,612,613,614,615,616,617,618,619,621,622,623,624,625,626,627,628,629,630,631,632,633,634,635,636,637,638,639,640,641,643,645,646,647,648,649,650,651,652,653,654,655,657,658,659,660,662,663,664,665,666,667,668,669,670,671,672,673,674,675,676,677,678,679,680,681,682,683,684,685,686,687,688,689,690,691,692,693,694,695,696,697,698,699,700,702,703,705,706,707,708,709,710,711,712,714,715,716,718,719,720,722,724,725,726,727,728,729,730,731,732,733,734,735,736,737,738,739,740,741,743,744,745,746,747,748,749,751,752,753,754,755,756,757,758,759,760,761,762,764,765,766,767,768,769,770,771,772,773,774,775,776,777,778,779,780,781,782,783,784,785,786,787,788,789,790,791,792,793,795,796,797,798,799,800,801,802,803,805,806,807,808,809,810,811,812,813,814,815,816,817,818,819,820,822,823,824,825,826,827,828,829,830,831,832,833,834,835,836,837,838,839,840,841,842,843,844,846,847,848,849,850,852,853,855,856,857,858,859,860,861,862,863,864,865,866,867,868,869,870,872,873,874,875,876,877,878,879,880,881,882,883,885,886,887,888,889,890,891,892,893,894,897,898,899,900,901,902,903,905,906,907,908,909,910,911,912,913,914,915,916,917,918,919,920,921,922,923,924,925,926,927,928,929,930,931,933,934,935,936,937,938,939,940,941,942,943,944,945,946,947,948,949,950,951,952,953,954,955,956,957,958,959,960,961,962,963,964,965,966,967,968,969,970,971,973,974,975,976,977,978,979,980,982,983,984,985,986,987,988,989,990,991,992,994,995,996,998,999,1000,1002,1003,1004,1005,1006,1007,1008,1010,1011,1012,1013,1014,1015,1016,1017,1018,1019,1020,1021,1022,1023,1024,1025,1026,1027,1028,1029,1030,1031,1032,1033,1035,1036,1037,1038,1039,1040,1041,1042,1043,1044,1045,1046,1048,1049,1050,1051,1052,1053,1054,1055,1056,1057,1058,1059,1060,1062,1063,1064,1065,1066,1067,1068,1069,1070,1071,1072,1073,1074,1075,1076,1077,1078,1079,1080,1081,1082,1083,1085,1086,1087,1088,1089,1090,1091,1092,1093,1095,1096,1097,1098,1099,1100,1101,1102,1103,1104,1105,1106,1107,1108,1109,1110,1111,1112,1113,1114,1115,1116,1117,1118,1119,1120,1122,1123,1124,1125,1126,1127,1128,1129,1130,1131,1132,1133,1134,1135,1136,1137,1138,1139,1140,1141,1142,1143,1144,1145,1146,1147,1149,1150,1151,1152,1153,1155,1156,1157,1158,1159,1160,1161,1162,1163,1164,1165,1166,1167,1168,1169,1170,1171,1172,1173,1174,1175,1177,1178,1179,1180,1181,1182,1183,1184,1185,1186,1187,1189,1190,1192,1193,1194,1196,1198,1199,1200,1201,1202,1204,1205,1206,1207,1208,1209,1210,1211,1212,1213,1214,1215,1216,1217,1219,1221,1222,1224,1225,1226,1227,1228,1229,1230,1232,1233,1234,1235,1236,1237,1238,1239,1240,1241,1242,1243,1244,1245,1247,1248,1249,1250,1251,1252,1253,1254,1255,1256,1257,1258,1259,1260,1262,1263,1264,1265,1266,1267,1268,1269,1270,1272,1274,1275,1276,1277,1278,1279,1280,1281,1282,1283,1284,1285,1286,1287,1289,1290,1291,1292,1293,1295,1296,1298,1299,1300,1301,1302,1303,1304,1305,1306,1307,1308,1309,1310,1311,1312,1313,1314,1315,1316,1317,1318,1319,1320,1321,1322,1323,1324,1325,1326,1327,1328,1329,1330,1331,1332,1334,1335,1336,1337,1338,1339,1340,1341,1342,1343,1344,1345,1346,1347,1348,1349,1350,1351,1352,1353,1354,1355,1356,1357,1358,1359,1360,1361,1362,1363,1364,1365,1366,1367,1368,1369,1370,1371,1372,1373,1374,1375,1376,1377,1378,1380,1381,1382,1383,1384,1385,1386,1387,1388,1389,1391,1392,1393,1394,1395,1396,1397,1398,1400,1401,1402,1403,1405,1406,1407,1409,1410,1412,1413,1414,1415,1417,1418,1419,1420,1421,1422,1423,1424,1425,1426,1427,1428,1429,1430,1431,1432,1433,1434,1435,1436,1437,1439,1440,1441,1442,1443,1444,1446,1447,1448,1449,1450,1451,1452,1453,1455,1456,1458,1459,1460,1461,1462,1463,1464,1465,1466,1467,1469,1470,1471,1472,1473,1474,1475,1476,1477,1478,1479,1480,1481,1482,1483,1484,1485,1486,1488,1489,1490,1491,1492,1493,1494,1495,1496,1497,1498,1499,1500,1501,1502,1503,1505,1506,1507,1508,1509,1510,1511,1512,1513,1514,1515,1516,1518,1519,1520,1521,1522,1523,1524,1525,1527,1528,1529,1530,1531,1532,1536,1537,1538,1539,1540,1541,1542,1543,1544,1545,1546,1547,1548,1549,1550,1551,1552,1553,1554,1555,1556,1557,1559,1560,1561,1562,1563,1564,1566,1567,1568,1569,1571,1572,1573,1574,1575,1576,1577,1578,1579,1580,1581,1582,1583,1584,1585,1586,1587,1588,1591,1592,1593,1594,1595,1596,1597,1598,1599,1600,1601,1602,1603,1604,1605,1606,1607,1608,1609,1611,1612,1613,1614,1615,1616,1617,1618,1620,1622,1624,1625,1626,1627,1628,1629,1630,1631,1632,1633,1634,1635,1636,1637,1639,1640,1641,1642,1643,1644,1645,1646,1647,1648,1649,1651,1652,1653,1654,1655,1656,1657,1658,1659,1660,1661,1662,1663,1664,1665,1666,1667,1668,1669,1670,1671,1672,1673,1674,1675,1676,1677,1678,1679,1680,1681,1682,1683,1684,1685,1686,1687,1688,1689,1690,1691,1693,1694,1695,1696,1697,1698,1699,1701,1702,1703,1704,1705,1706,1707,1709,1710,1711,1714,1715,1716,1717,1718,1719,1720,1721,1722,1724,1725,1727,1728,1729,1730,1731,1732,1733,1734,1735,1736,1737,1738,1740,1741,1742,1743,1744,1745,1746,1747,1749,1750,1751,1752,1753,1754,1755,1756,1758,1759,1760,1761,1763,1765,1766,1767,1769,1770,1771,1772,1773,1774,1776,1778,1779,1780,1781,1782,1783,1784,1785,1786,1787,1788,1789,1790,1791,1792,1793,1795,1797,1798,1799,1800,1801,1802,1803,1804,1805,1806,1809,1810,1811,1812,1813,1814,1815,1816,1817,1818,1819,1820,1821,1822,1823,1824,1825,1827,1828,1829,1830,1831,1832,1833,1834,1835,1836,1837,1838,1839,1840,1842,1844,1845,1846,1847,1848,1849,1850,1851,1852,1853,1854,1855,1856,1857,1858,1859,1860,1861,1862,1863,1864,1865,1866,1867,1868,1869,1871,1872,1873,1874,1875,1876,1877,1878,1879,1880,1881,1882,1883,1884,1885,1886,1887,1888,1889,1890,1891,1893,1894,1895,1896,1897,1899,1900,1901,1902,1903,1904,1905,1906,1908,1909,1910,1911,1912,1913,1914,1915,1916,1917,1919,1920,1921,1922,1923,1924,1925,1926,1927,1928,1929,1930,1931,1932,1933,1934,1935,1936,1937,1938,1939,1940,1941,1942,1943,1945,1946,1947,1948,1949,1950,1951,1952,1953,1954,1955,1956,1957,1958,1960,1961,1962,1963,1964,1965,1966,1967,1968,1969,1970,1971,1973,1974,1975,1976,1977,1978,1979,1980,1981,1982,1983,1984,1985,1986,1988,1989,1990,1991,1992,1993,1994,1996,1997,1998,1999,2000,2001,2002,2003,2004,2005,2006,2007,2008,2009,2010,2011,2012,2013,2014,2015,2016,2017,2018,2019,2020,2021,2022,2024,2025,2026,2027,2028,2029,2030,2031,2032,2034,2035,2036,2037,2038,2039,2040,2041,2043,2044,2045,2046,2047,2048,2049,2050,2051,2052,2053,2054,2055,2056,2057,2058,2059,2062,2063,2064,2065,2066,2068,2069,2070,2071,2072,2073,2074,2075,2076,2077,2078,2079,2080,2082,2083,2084,2085,2086,2088,2089,2090,2091,2092,2093,2094,2095,2097,2098,2099,2100,2101,2102,2103,2104,2105,2107,2108,2109,2110,2111,2112,2113,2114,2115,2116,2117,2118,2119,2120,2121,2122,2123,2124,2125,2126,2128,2129,2130,2131,2132,2133,2134,2135,2136,2137,2138,2139,2140,2141,2142,2143,2144,2145,2146,2147,2148,2149,2150,2151,2152,2153,2154,2156,2157,2158,2159,2160,2161,2162,2163,2164,2165,2166,2167,2168,2169,2170,2171,2172,2173,2174,2175,2176,2177,2179,2180,2181,2182,2183,2184,2186,2187,2189,2191,2192,2193,2194,2195,2196,2197,2198,2199,2200,2201,2202,2203,2205,2206,2207,2208,2210,2211,2212,2213,2214,2215,2216,2218,2219,2220,2221,2222,2223,2224,2225,2227,2228,2229,2230,2231,2232,2233,2234,2235,2237,2238,2239,2240,2241,2242,2243,2244,2245,2246,2247,2248,2249,2250,2251,2252,2253,2254,2255,2256,2257,2258,2259,2260,2261,2262,2263,2264,2265,2266,2267,2268,2269,2270,2271,2272,2273,2274,2275,2276,2277,2278,2279,2280,2281,2282,2283,2284,2285,2286,2287,2288,2289,2290,2291,2292,2293,2296,2297,2298,2299,2300,2301,2302,2303,2305,2306,2307,2308,2309,2310,2311,2312,2313,2314,2315,2316,2317,2319,2320,2321,2322,2323,2324,2325,2327,2330,2331,2332,2334,2335,2336,2337,2338,2339,2340,2341,2342,2343,2344,2345,2346,2347,2348,2349,2350,2351,2352,2353,2354,2355,2356,2357,2358,2359,2360,2361,2362,2363,2364,2365,2366,2367,2368,2369,2371,2372,2373,2374,2375,2377,2379,2380,2381,2382,2383,2386,2387,2388,2389,2390,2391,2392,2393,2394,2395,2396,2397,2398,2399,2400,2401,2402,2404,2405,2406,2407,2408,2409,2411,2412,2413,2414,2415,2416,2418,2419,2420,2421,2422,2423,2424,2425,2426,2427,2428,2429,2430,2431,2432,2433,2434,2436,2437,2438,2439,2440,2441,2442,2443,2444,2445,2446,2447,2448,2450,2451,2452,2453,2454,2456,2457,2458,2459,2460,2462,2463,2464,2465,2466,2467,2468,2469,2470,2471,2472,2473,2474,2475,2476,2477,2478,2480,2481,2482,2483,2484,2486,2487,2488,2489,2490,2491,2493,2494,2495,2496,2497,2498,2499,2500,2501,2502,2503,2504,2505,2507,2508,2509,2510,2511,2512,2513,2514,2515,2516,2517,2518,2519,2520,2521,2522,2523,2524,2525,2526,2528,2529,2530,2532,2533,2534,2535,2537,2538,2539,2540,2541,2542,2543,2544,2545,2546,2547,2548,2549,2550,2551,2552,2553,2554,2555,2556,2558,2559,2560,2561,2562,2563,2564,2565,2566,2567,2569,2570,2572,2573,2574,2575,2576,2577,2578,2579,2580,2581,2582,2583,2584,2585,2586,2587,2588,2589,2590,2591,2594,2595,2596,2597,2598,2599,2600,2601,2602,2603,2604,2605,2606,2607,2608,2609,2610,2611,2612,2613,2614,2615,2616,2617,2618,2620,2621,2622,2623,2624,2625,2626,2628,2629,2630,2632,2633,2634,2635,2636,2637,2639,2640,2642,2643,2644,2645,2646,2647,2648,2650,2651,2652,2653,2654,2655,2658,2659,2661,2662,2663,2664,2665,2666,2667,2668,2669,2670,2671,2672,2673,2674,2675,2676,2677,2678,2679,2680,2681,2682,2683,2684,2685,2686,2688,2689,2690,2691,2692,2693,2694,2695,2696,2697,2698,2699,2700,2701,2702,2704,2705,2706,2708,2709,2710,2711,2712,2715,2716,2718,2719,2720,2721,2722,2723,2724,2725,2726,2727,2728,2729,2730,2731,2732,2734,2735,2736,2737,2738,2739,2740,2741,2742,2743,2744,2745,2746,2749,2750,2751,2752,2753,2754,2755,2756,2757,2758,2759,2760,2762,2766,2767,2768,2769,2770,2771,2772,2773,2774,2775,2776,2778,2780,2781,2782,2783,2784,2785,2786,2787,2788,2789,2790,2791,2792,2793,2795,2796,2797,2798,2799,2800,2801,2802,2803,2804,2805,2806,2807,2808,2809,2810,2812,2813,2814,2815,2816,2818,2819,2820,2822,2823,2825,2826,2827,2828,2829,2830,2831,2832,2833,2834,2835,2836,2837,2838,2839,2840,2841,2843,2844,2845,2846,2847,2848,2849,2850,2851,2852,2853,2854,2855,2856,2857,2858,2859,2860,2861,2862,2863,2864,2865,2866,2867,2868,2869,2870,2871,2872,2874,2875,2876,2877,2878,2879,2880,2881,2882,2883,2884,2885,2886,2887,2888,2889,2890,2891,2892,2893,2895,2896,2897,2898,2900,2901,2902,2903,2904,2905,2906,2907,2908,2909,2910,2911,2912,2913,2914,2915,2916,2917,2918,2919,2920,2921,2922,2923,2924,2925,2926,2927,2928,2929,2930,2931,2933,2934,2935,2936,2938,2939,2940,2941,2943,2945,2946,2947,2948,2949,2950,2951,2952,2953,2955,2956,2957,2958,2959,2960,2961,2963,2964,2965,2966,2967,2968,2969,2970,2971,2973,2974,2975,2976,2977,2978,2979,2980,2981,2982,2983,2984,2985,2986,2987,2989,2990,2991,2992,2993,2994,2995,2997,2998,3000,3001,3002,3003,3004,3005,3006,3007,3008,3009,3010,3011,3012,3014,3015,3017,3018,3019,3021,3022,3023,3024,3025,3026,3027,3028,3029,3030,3031,3033,3034,3035,3036,3037,3038,3039,3040,3041,3042,3045,3046,3047,3048,3049,3050,3051,3053,3054,3055,3056,3057,3058,3059,3060,3061,3062,3063,3064,3065,3066,3067,3068,3069,3070,3071,3072,3073,3074,3075,3076,3078,3079,3080,3081,3082,3083,3084,3085,3086,3088,3089,3091,3092,3093,3094,3095,3096,3097,3098,3099,3100,3101,3102,3103,3104,3105,3106,3107,3108,3109,3110,3111,3112,3113,3114,3115,3116,3117,3118,3119,3120,3121,3122,3123,3124,3125,3126,3127,3128,3129,3130,3131,3132,3133,3134,3135,3136,3137,3138,3139,3141,3142,3143,3144,3145,3146,3147,3148,3149,3150,3151,3152,3153,3154,3155,3156,3157,3158,3159,3160,3161,3162,3163,3164,3165,3166,3167,3168,3169,3171,3172,3173,3174,3175,3176,3177,3180,3181,3182,3183,3184,3186,3187,3188,3189,3190,3192,3193,3194,3195,3196,3197,3198,3199,3200,3201,3202,3203,3204,3205,3206,3207,3208,3209,3211,3212,3213,3214,3216,3217,3218,3220,3221,3222,3223,3224,3225,3227,3228,3229,3230,3231,3232,3233,3234,3235,3236,3237,3238,3239,3240,3241,3244,3245,3246,3247,3248,3249,3250,3252,3253,3254,3255,3256,3257,3258,3259,3260,3261,3262,3263,3264,3267,3268,3269,3270,3272,3273,3274,3275,3276,3277,3278,3279,3280,3281,3282,3283,3284,3285,3286,3287,3288,3289,3290,3291,3292,3293,3294,3295,3296,3298,3299,3300,3301,3302,3303,3304,3307,3308,3309,3311,3312,3313,3314,3316,3318,3319,3320,3321,3323,3324,3326,3327,3328,3329,3330,3331,3332,3333,3334,3335,3336,3337,3338,3339,3340,3341,3342,3343,3344,3345,3348,3349,3350,3351,3352,3353,3354,3355,3356,3357,3360,3361,3362,3363,3364,3365,3366,3367,3369,3370,3372,3373,3374,3375,3376,3377,3378,3379,3380,3381,3382,3383,3384,3385,3386,3387,3388,3389,3390,3391,3392,3393,3394,3395,3396,3397,3398,3399,3400,3402,3403,3404,3405,3406,3407,3408,3409,3410,3411,3414,3415,3416,3418,3419,3420,3421,3422,3423,3424,3425,3426,3427,3428,3429,3430,3431,3432,3433,3434,3435,3436,3437,3438,3440,3441,3442,3443,3444,3447,3448,3449,3451,3452,3453,3454,3455,3456,3457,3459,3460,3461,3462,3463,3464,3465,3466,3467,3468,3469,3470,3471,3472,3473,3474,3475,3476,3477,3478,3480,3482,3483,3484,3485,3486,3487,3488,3489,3490,3491,3492,3493,3494,3495,3497,3498,3499,3500,3501,3502,3503,3504,3505,3506,3507,3508,3509,3510,3511,3513,3514,3515,3516,3517,3518,3519,3520,3521,3522,3523,3524,3525,3526,3527,3528,3529,3530,3531,3532,3533,3534,3535,3537,3538,3539,3541,3542,3543,3544,3545,3546,3547,3548,3549,3550,3551,3552,3553,3554,3555,3556,3557,3558,3559,3560,3561,3562,3563,3564,3565,3566,3567,3568,3569,3570,3571,3572,3573,3575,3576,3577,3578,3579,3580,3582,3583,3585,3586,3587,3588,3589,3590,3591,3592,3593,3594,3595,3596,3597,3598,3599,3600,3601,3602,3603,3604,3605,3606,3607,3609,3610,3611,3612,3614,3615,3616,3617,3618,3619,3620,3621,3622,3623,3625,3626,3627,3628,3629,3630,3631,3632,3633,3635,3636,3637,3638,3639,3641,3642,3643,3644,3645,3647,3648,3649,3651,3652,3653,3654,3655,3656,3657,3658,3659,3661,3662,3663,3664,3665,3666,3667,3668,3669,3670,3671,3672,3673,3674,3675,3676,3678,3679,3681,3682,3683,3684,3685,3686,3687,3688,3689,3690,3691,3692,3693,3694,3696,3697,3699,3700,3701,3702,3703,3704,3705,3707,3708,3709,3711,3712,3713,3714,3715,3716,3717,3718,3719,3720,3721,3722,3723,3725,3726,3727,3728,3729,3730,3731,3732,3733,3736,3737,3738,3739,3740,3741,3742,3743,3744,3745,3746,3747,3748,3749,3750,3751,3752,3753,3754,3755,3756,3757,3758,3759,3760,3761,3762,3763,3765,3766,3767,3769,3770,3771,3772,3773,3775,3776,3777,3778,3779,3780,3781,3782,3783,3784,3785,3786,3787,3788,3789,3791,3792,3793,3794,3795,3796,3797,3798,3799,3800,3801,3802,3806,3807,3808,3809,3810,3811,3812,3813,3814,3815,3816,3817,3819,3820,3821,3822,3823,3824,3825,3826,3827,3828,3829,3831,3832,3833,3834,3835,3836,3837,3838,3839,3840,3841,3842,3843,3844,3845,3846,3848,3850,3851,3852,3853,3854,3855,3856,3857,3858,3859,3860,3861,3862,3863,3865,3866,3868,3869,3871,3872,3873,3874,3875,3876,3877,3878,3879,3880,3881,3882,3884,3885,3886,3887,3888,3889,3890,3891,3892,3893,3894,3896,3897,3898,3899,3900,3901,3902,3904,3905,3906,3907,3908,3909,3910,3912,3913,3914,3915,3916,3917,3918,3919,3920,3921,3922,3923,3924,3925,3926,3927,3928,3929,3930,3931,3932,3933,3934,3935,3936,3937,3938,3939,3941,3943,3944,3945,3946,3947,3948,3949,3950,3951,3952,3953,3954,3955,3956,3957,3958,3960,3961,3962,3963,3964,3965,3966,3967,3968,3969,3970,3971,3972,3973,3974,3975,3976,3977,3978,3979,3981,3983,3984,3985,3986,3987,3988,3990,3991,3992,3993,3994,3995,3996,3997,3998,3999,4000,4001,4002,4003,4004,4005,4006,4007,4008,4009,4010,4011,4012,4013,4014,4015,4016,4017,4018,4019,4020,4021,4022,4024,4025,4026,4027,4028,4029,4030,4031,4032,4035,4036,4037,4038,4039,4040,4041,4042,4044,4045,4046,4047,4049,4050,4051,4052,4053,4054,4055,4056,4057,4058,4059,4060,4061,4063,4064,4066,4067,4068,4069,4071,4072,4073,4074,4075,4076,4077,4078,4081,4083,4084,4085,4086,4087,4088,4089,4092,4093,4094,4095,4096,4097,4098,4099,4100,4101,4102,4103,4104,4105,4106,4107,4108,4109,4110,4111,4112,4113,4114,4115,4116,4117,4118,4119,4120,4121,4122,4123,4124,4125,4126,4127,4128,4129,4130,4131,4132,4133,4134,4135,4136,4137,4138,4139,4140,4141,4142,4143,4144,4145,4147,4148,4149,4151,4152,4153,4154,4156,4158,4159,4160,4161,4162,4163,4164,4165,4167,4168,4169,4170,4171,4172,4173,4174,4175,4176,4177,4178,4179,4180,4181,4182,4183,4184,4185,4187,4189,4190,4191,4192,4193,4194,4195,4196,4197,4198,4199,4200,4201,4202,4203,4204,4205,4206,4207,4209,4210,4211,4212,4213,4214,4215,4216,4217,4218,4219,4220,4221,4222,4223,4224,4225,4226,4228,4229,4230,4231,4232,4233,4234,4235,4236,4237,4238,4239,4240,4242,4243,4244,4245,4246,4247,4248,4249,4250,4251,4252,4253,4254,4255,4256,4257,4258,4259,4260,4261,4262,4263,4264,4265,4266,4267,4268,4269,4270,4271,4272,4273,4274,4275,4276,4277,4279,4280,4283,4284,4285,4287,4288,4289,4290,4291,4292,4293,4294,4295,4296,4297,4298,4299,4300,4301,4302,4303,4304,4305,4306,4307,4308,4309,4310,4311,4312,4313,4314,4315,4316,4317,4318,4319,4321,4322,4323,4324,4325,4326,4328,4330,4331,4332,4333,4334,4335,4336,4337,4338,4339,4340,4341,4342,4344,4345,4346,4347,4349,4350,4352,4354,4355,4356,4357,4358,4359,4360,4362,4363,4364,4366,4367,4368,4369,4371,4372,4373,4374,4375,4376,4377,4378,4379,4380,4381,4382,4383,4384,4385,4386,4387,4388,4389,4390,4391,4393,4394,4395,4396,4397,4398,4399,4400,4401,4402,4405,4406,4407,4408,4409,4410,4411,4412,4413,4414,4415,4416,4417,4418,4419,4420,4421,4422,4423,4424,4425,4426,4427,4428,4429,4430,4431,4433,4434,4435,4436,4437,4438,4439,4440,4441,4442,4443,4444,4445,4446,4449,4450,4451,4452,4453,4454,4455,4456,4458,4459,4460,4461,4463,4464,4465,4466,4467,4468,4469,4471,4472,4474,4475,4476,4478,4479,4480,4481,4482,4483,4484,4485,4486,4487,4488,4489,4490,4491,4492,4493,4494,4496,4497,4498,4499,4500,4501,4502,4503,4504,4505,4506,4507,4508,4509,4510,4511,4512,4513,4514,4516,4517,4518,4519,4520,4521,4522,4523,4524,4525,4526,4528,4529,4530,4532,4533,4534,4535,4536,4537,4538,4539,4540,4541,4543,4544,4545,4546,4547,4548,4549,4550,4551,4552,4553,4555,4556,4557,4558,4559,4560,4561,4562,4563,4564,4565,4566,4567,4568,4569,4570,4571,4572,4573,4574,4575,4576,4577,4578,4579,4580,4581,4582,4583,4584,4585,4586,4587,4588,4589,4590,4591,4592,4593,4594,4595,4596,4597,4598,4599,4600,4601,4602,4603,4605,4606,4607,4608,4609,4610,4612,4613,4615,4616,4618,4619,4620,4621,4622,4623,4624,4625,4626,4627,4629,4630,4632,4633,4634,4635,4636,4637,4638,4639,4640,4643,4644,4645,4646,4647,4648,4649,4651,4652,4653,4654,4655,4656,4657,4658,4659,4660,4661,4662,4663,4664,4665,4666,4667,4668,4669,4670,4671,4673,4674,4676,4677,4678,4679,4680,4681,4682,4683,4684,4685,4686,4687,4688,4689,4690,4691,4692,4693,4694,4695,4696,4697,4698,4699,4700,4701,4702,4703,4704,4705,4706,4707,4708,4709,4710,4711,4712,4713,4714,4715,4716,4717,4719,4721,4722,4723,4724,4725,4726,4727,4728,4729,4730,4731,4732,4733,4734,4735,4736,4737,4738,4740,4742,4743,4744,4745,4746,4747,4748,4749,4750,4751,4752,4753,4754,4755,4756,4758,4759,4760,4761,4762,4763,4764,4765,4766,4767,4768,4769,4770,4771,4772,4773,4774,4775,4777,4778,4779,4781,4782,4783,4784,4785,4786,4787,4789,4790,4791,4792,4793,4794,4795,4796,4797,4798,4799,4800,4801,4802,4803,4805,4806,4807,4808,4809,4810,4811,4812,4813,4814,4815,4816,4817,4818,4820,4821,4822,4823,4825,4826,4827,4828,4829,4830,4831,4832,4833,4835,4836,4837,4838,4839,4840,4841,4842,4843,4844,4845,4846,4847,4848,4849,4850,4851,4852,4853,4854,4855,4856,4858,4859,4860,4861,4863,4864,4865,4866,4867,4868,4869,4870,4871,4872,4873,4874,4875,4876,4877,4878,4879,4881,4882,4883,4884,4885,4886,4888,4889,4890,4892,4893,4894,4895,4896,4897,4898,4899,4900,4901,4902,4903,4904,4905,4906,4907,4908,4909,4910,4911,4912,4913,4914,4915,4916,4917,4918,4919,4920,4921,4922,4924,4925,4926,4927,4928,4929,4930,4931,4932,4933,4934,4936,4938,4939,4940,4941,4942,4943,4944,4945,4946,4947,4948,4949,4950,4951,4952,4953,4954,4955,4956,4960,4961,4962,4963,4964,4965,4966,4967,4968,4969,4970,4971,4972,4973,4974,4975,4976,4977,4978,4979,4980,4981,4982,4983,4984,4985,4986,4987,4988,4989,4990,4991,4993,4994,4995,4996,4997,4998,5000,5001,5002,5003,5004,5005,5007,5009,5010,5011,5012,5013,5014,5015,5016,5017,5018,5019,5020,5021,5022,5023,5024,5025,5026,5027,5028,5029,5030,5032,5034,5036,5037,5038,5039,5040,5041,5042,5044,5045,5046,5047,5048,5049,5050,5052,5053,5054,5055,5056,5057,5058,5059,5060,5061,5062,5063,5064,5065,5066,5067,5068,5070,5071,5072,5073,5074,5075,5076,5077,5078,5080,5081,5082,5083,5084,5085,5086,5088,5089,5090,5091,5092,5093,5094,5095,5096,5097,5098,5099,5100,5101,5102,5103,5104,5105,5106,5107,5110,5111,5112,5113,5114,5115,5116,5117,5118,5119,5120,5121,5122,5123,5125,5126,5127,5128,5129,5130,5131,5132,5134,5135,5136,5137,5138,5140,5142,5143,5144,5145,5146,5148,5149,5150,5151,5152,5153,5154,5156,5157,5158,5159,5160,5161,5162,5163,5164,5166,5167,5168,5169,5170,5171,5172,5173,5174,5175,5176,5177,5178,5179,5180,5181,5182,5183,5184,5185,5186,5187,5188,5189,5190,5191,5192,5193,5194,5195,5196,5197,5198,5199,5200,5201,5202,5203,5204,5205,5206,5207,5208,5209,5210,5211,5212,5213,5214,5215,5216,5217,5218,5219,5220,5221,5222,5223,5224,5225,5226,5227,5228,5229,5230,5231,5232,5233,5234,5235,5236,5237,5238,5239,5240,5242,5245,5246,5247,5248,5250,5252,5254,5256,5258,5260,5261,5262,5263,5264,5265,5266,5267,5268,5269,5271,5272,5273,5274,5275,5276,5277,5278,5279,5281,5282,5283,5284,5285,5286,5287,5288,5289,5291,5292,5293,5294,5295,5296,5297,5298,5299,5300,5302,5303,5304,5306,5308,5309,5310,5311,5312,5313,5314,5315,5316,5317,5318,5319,5322,5323,5324,5325,5326,5327,5328,5329,5330,5331,5332,5333,5334,5335,5336,5338,5339,5340,5341,5343,5344,5345,5346,5347,5348,5349,5350,5351,5352,5354,5355,5356,5357,5358,5359,5360,5361,5362,5363,5364,5365,5366,5367,5370,5371,5372,5373,5374,5375,5376,5377,5378,5379,5380,5381,5382,5383,5384,5385,5386,5387,5388,5389,5390,5391,5392,5393,5394,5395,5396,5397,5399,5400,5401,5402,5403,5404,5406,5407,5408,5409,5410,5411,5412,5413,5414,5416,5417,5418,5419,5420,5421,5422,5423,5424,5425,5426,5427,5429,5431,5432,5433,5434,5436,5437,5438,5439,5440,5441,5442,5444,5445,5446,5447,5448,5449,5451,5453,5454,5455,5456,5457,5458,5460,5461,5462,5464,5465,5466,5467,5468,5469,5471,5472,5473,5474,5475,5476,5477,5478,5479,5480,5481,5482,5484,5485,5486,5487,5488,5489,5490,5491,5492,5493,5494,5495,5496,5497,5498,5499,5500,5501,5502,5503,5504,5506,5507,5508,5509,5510,5511,5512,5514,5515,5516,5517,5518,5520,5521,5522,5523,5524,5525,5527,5528,5530,5532,5533,5534,5535,5536,5537,5538,5539,5540,5541,5542,5543,5544,5545,5546,5547,5548,5549,5550,5551,5552,5553,5555,5556,5557,5558,5559,5560,5561,5562,5563,5564,5565,5566,5568,5569,5570,5571,5572,5573,5574,5575,5576,5577,5578,5579,5580,5581,5582,5583,5585,5586,5587,5588,5589,5590,5591,5594,5595,5596,5597,5598,5599,5600,5601,5602,5604,5605,5606,5607,5608,5609,5610,5611,5612,5614,5615,5616,5617,5618,5619,5620,5621,5622,5623,5624,5625,5626,5627,5628,5629,5630,5631,5632,5633,5634,5635,5636,5637,5638,5639,5640,5641,5642,5643,5644,5645,5646,5647,5648,5649,5650,5651,5654,5655,5656,5657,5658,5660,5661,5662,5663,5664,5665,5666,5667,5668,5670,5671,5672,5674,5675,5676,5677,5678,5679,5680,5681,5682,5683,5687,5688,5689,5690,5691,5692,5693,5694,5696,5697,5698,5699,5700,5701,5702,5703,5704,5705,5706,5707,5708,5709,5710,5711,5712,5713,5714,5715,5716,5717,5719,5720,5722,5723,5724,5725,5726,5727,5728,5729,5730,5732,5733,5734,5735,5736,5738,5739,5740,5741,5742,5743,5744,5745,5746,5747,5748,5749,5751,5752,5753,5754,5755,5757,5758,5759,5760,5761,5762,5763,5764,5765,5766,5767,5768,5769,5770,5771,5772,5773,5774,5775,5776,5777,5779,5780,5781,5782,5783,5784,5785,5786,5787,5788,5789,5790,5792,5793,5794,5795,5796,5797,5798,5799,5800,5801,5802,5803,5804,5805,5807,5808,5809,5810,5811,5813,5814,5815,5816,5817,5819,5820,5821,5822,5823,5824,5825,5826,5829,5831,5832,5833,5834,5835,5836,5837,5839,5840,5841,5842,5843,5844,5845,5846,5848,5849,5850,5851,5852,5853,5854,5855,5856,5857,5858,5859,5860,5861,5862,5863,5864,5866,5867,5868,5869,5871,5872,5873,5874,5875,5876,5877,5878,5879,5880,5881,5882,5883,5884,5885,5886,5887,5888,5889,5891,5892,5893,5894,5895,5896,5897,5898,5900,5901,5902,5903,5904,5905,5906,5907,5908,5909,5910,5911,5912,5913,5914,5915,5916,5917,5919,5920,5921,5922,5923,5924,5925,5926,5927,5928,5931,5933,5934,5935,5936,5937,5938,5939,5940,5941,5943,5944,5945,5946,5947,5948,5949,5950,5951,5953,5954,5955,5956,5957,5958,5959,5960,5961,5962,5963,5964,5966,5967,5968,5969,5970,5971,5972,5973,5975,5976,5977,5978,5979,5981,5982,5983,5984,5985,5986,5988,5989,5991,5992,5994,5995,5996,5997,5998,5999,6000,6001,6002,6004,6005,6006,6007,6008,6009,6010,6011,6012,6013,6014,6017,6018,6019,6020,6021,6022,6023,6024,6025,6026,6027,6028,6029,6030,6031,6032,6033,6034,6035,6036,6037,6038,6039,6041,6042,6043,6044,6045,6046,6047,6048,6049,6050,6051,6052,6053,6054,6055,6056,6057,6058,6059,6060,6061,6063,6064,6065,6066,6067,6068,6069,6070,6071,6073,6074,6075,6076,6077,6078,6079,6080,6081,6083,6084,6085,6086,6087,6088,6089,6090,6091,6092,6093,6094,6095,6096,6098,6100,6101,6102,6103,6104,6105,6106,6107,6108,6109,6110,6111,6112,6113,6115,6116,6118,6119,6120,6121,6122,6123,6124,6125,6126,6128,6130,6132,6134,6135,6136,6137,6138,6139,6141,6142,6143,6144,6145,6146,6147,6148,6149,6150,6151,6152,6153,6154,6155,6156,6157,6158,6159,6160,6161,6162,6164,6165,6166,6167,6168,6169,6170,6171,6172,6173,6174,6175,6176,6177,6178,6179,6180,6182,6183,6184,6185,6186,6187,6188,6189,6190,6192,6193,6194,6195,6196,6197,6198,6199,6200,6202,6203,6204,6205,6206,6207,6208,6209,6210,6212,6213,6214,6215,6216,6217,6218,6219,6220,6221,6222,6223,6224,6225,6226,6227,6228,6229,6230,6231,6232,6233,6234,6235,6236,6237,6238,6239,6240,6242,6243,6244,6245,6246,6247,6248,6249,6251,6252,6253,6254,6255,6256,6257,6258,6260,6261,6262,6263,6265,6266,6267,6268,6269,6270,6271,6272,6273,6274,6275,6276,6277,6278,6279,6281,6282,6283,6284,6285,6289,6290,6291,6292,6294,6295,6296,6297,6298,6299,6300,6301,6302,6303,6304,6305,6306,6307,6308,6310,6311,6312,6313,6314,6315,6316,6317,6318,6320,6321,6322,6323,6324,6325,6326,6327,6329,6330,6331,6332,6333,6334,6335,6336,6337,6338,6339,6340,6341,6343,6345,6346,6347,6348,6349,6350,6352,6353,6354,6355,6356,6357,6358,6359,6360,6361,6362,6363,6364,6365,6366,6367,6368,6369,6370,6371,6372,6373,6374,6375,6376,6377,6378,6379,6380,6381,6382,6384,6385,6386,6387,6388,6389,6390,6391,6392,6393,6394,6395,6396,6397,6399,6401,6402,6403,6404,6405,6406,6407,6408,6409,6410,6411,6412,6413,6414,6415,6416,6417,6418,6419,6420,6421,6422,6423,6425,6427,6430,6431,6432,6433,6434,6435,6436,6438,6439,6440,6441,6442,6443,6445,6446,6447,6448,6449,6450,6451,6452,6453,6455,6456,6457,6458,6459,6460,6462,6463,6464,6465,6466,6467,6468,6469,6471,6472,6474,6475,6476,6477,6479,6480,6481,6482,6483,6484,6485,6486,6487,6488,6490,6491,6492,6493,6494,6495,6496,6497,6498,6499,6500,6501,6502,6503,6504,6505,6506,6507,6508,6509,6511,6512,6513,6514,6515,6516,6517,6518,6519,6520,6521,6522,6523,6524,6525,6527,6528,6529,6530,6531,6533,6534,6535,6536,6537,6538,6539,6540,6541,6542,6543,6544,6545,6547,6548,6549,6550,6551,6552,6553,6554,6555,6556,6558,6559,6560,6561,6562,6563,6564,6565,6566,6568,6569,6570,6571,6572,6573,6574,6575,6576,6577,6578,6579,6581,6582,6584,6585,6586,6587,6589,6591,6592,6593,6594,6595,6596,6598,6599,6600,6601,6603,6604,6605,6606,6607,6608,6609,6610,6611,6612,6613,6614,6615,6616,6617,6618,6619,6620,6622,6623,6624,6625,6626,6627,6628,6629,6630,6631,6632,6634,6635,6636,6637,6638,6639,6640,6641,6642,6644,6645,6646,6647,6648,6649,6650,6652,6653,6654,6655,6656,6657,6658,6659,6660,6661,6662,6663,6664,6665,6666,6667,6668,6669,6670,6671,6673,6674,6675,6676,6677,6678,6679,6680,6681,6682,6683,6684,6685,6686,6687,6688,6689,6690,6691,6692,6693,6694,6695,6696,6697,6698,6699,6700,6702,6703,6704,6705,6706,6707,6708,6709,6710,6712,6713,6714,6715,6716,6717,6718,6720,6721,6722,6723,6724,6725,6726,6727,6728,6729,6730,6731,6732,6733,6734,6735,6736,6737,6738,6739,6740,6741,6742,6743,6744,6745,6746,6747,6748,6749,6751,6754,6755,6756,6757,6758,6759,6761,6762,6763,6764,6765,6767,6768,6769,6771,6772,6773,6774,6775,6776,6777,6778,6780,6782,6783,6784,6785,6787,6788,6789,6790,6791,6792,6793,6794,6796,6797,6799,6800,6801,6802,6803,6804,6805,6806,6807,6809,6810,6811,6812,6813,6814,6815,6816,6817,6819,6820,6821,6822,6823,6824,6825,6826,6827,6828,6829,6830,6831,6832,6834,6836,6837,6838,6839,6840,6842,6844,6845,6846,6847,6848,6849,6850,6851,6852,6853,6854,6855,6856,6857,6858,6859,6860,6861,6862,6863,6864,6865,6866,6867,6868,6869,6870,6871,6872,6873,6874,6875,6876,6878,6879,6880,6881,6882,6883,6884,6885,6886,6887,6888,6889,6890,6891,6893,6895,6896,6897,6898,6899,6900,6901,6902,6903,6904,6905,6906,6907,6908,6909,6910,6911,6912,6913,6914,6915,6916,6917,6918,6919,6920,6922,6924,6926,6928,6929,6930,6931,6932,6933,6934,6935,6936,6938,6939,6940,6941,6942,6943,6944,6945,6946,6948,6949,6950,6951,6952,6953,6954,6955,6956,6957,6958,6960,6961,6963,6964,6965,6966,6967,6969,6972,6973,6974,6975,6976,6977,6980,6981,6982,6983,6984,6985,6986,6987,6988,6989,6990,6991,6992,6993,6994,6995,6996,6997,6998,6999,7000,7001,7002,7003,7004,7005,7006,7007,7008,7009,7010,7011,7012,7013,7014,7015,7016,7017,7018,7019,7020,7021,7022,7023,7024,7025,7026,7027,7028,7029,7030,7032,7033,7034,7035,7036,7038,7039,7040,7041,7042,7043,7044,7045,7046,7047,7048,7050,7051,7053,7054,7055,7056,7057,7058,7059,7060,7061,7063,7064,7065,7066,7067,7068,7069,7070,7071,7073,7074,7075,7076,7077,7078,7079,7080,7081,7082,7083,7085,7087,7088,7089,7090,7091,7092,7093,7094,7095,7096,7097,7098,7099,7100,7101,7102,7103,7104,7105,7106,7107,7108,7109,7110,7111,7113,7114,7115,7116,7117,7118,7119,7120,7121,7122,7123,7124,7125,7126,7127,7128,7130,7131,7132,7134,7135,7136,7137,7138,7140,7141,7142,7143,7144,7145,7146,7147,7148,7149,7150,7151,7152,7153,7154,7155,7156,7157,7158,7159,7160,7163,7164,7165,7166,7167,7169,7170,7171,7172,7173,7174,7176,7177,7178,7179,7180,7181,7182,7183,7184,7185,7186,7187,7188,7189,7191,7192,7193,7194,7195,7196,7197,7198,7199,7200,7201,7204,7205,7206,7207,7208,7209,7210,7211,7212,7213,7214,7215,7217,7218,7219,7220,7222,7223,7224,7226,7227,7228,7229,7230,7232,7233,7234,7235,7236,7237,7238,7239,7240,7241,7242,7243,7244,7245,7246,7247,7248,7249,7250,7251,7252,7253,7254,7256,7257,7258,7259,7260,7262,7264,7265,7266,7267,7268,7270,7271,7272,7273,7274,7275,7276,7277,7278,7280,7281,7282,7283,7284,7285,7286,7287,7288,7290,7291,7292,7293,7294,7295,7296,7297,7298,7299,7300,7301,7302,7303,7304,7305,7306,7307,7308,7309,7310,7311,7312,7313,7314,7315,7316,7318,7319,7320,7321,7322,7323,7324,7325,7326,7327,7328,7329,7331,7332,7333,7334,7335,7336,7338,7339,7340,7341,7343,7344,7345,7346,7347,7348,7349,7350,7351,7352,7353,7355,7356,7357,7358,7359,7360,7361,7362,7364,7365,7366,7369,7370,7371,7372,7373,7374,7375,7376,7377,7378,7379,7380,7382,7383,7384,7386,7387,7388,7389,7390,7391,7392,7393,7394,7395,7396,7397,7398,7399,7400,7401,7402,7403,7404,7405,7406,7407,7408,7409,7411,7412,7413,7414,7415,7416,7417,7418,7419,7420,7421,7422,7423,7424,7425,7426,7427,7428,7429,7430,7431,7432,7433,7434,7435,7436,7437,7438,7439,7441,7442,7443,7444,7445,7447,7448,7450,7451,7453,7454,7455,7456,7457,7458,7459,7460,7461,7462,7463,7464,7466,7467,7468,7469,7470,7471,7472,7473,7474,7475,7476,7477,7478,7479,7480,7481,7482,7483,7484,7486,7487,7488,7489,7490,7492,7493,7494,7495,7496,7497,7498,7499,7500,7501,7502,7503,7504,7507,7508,7509,7510,7511,7512,7513,7514,7515,7517,7518,7519,7520,7521,7522,7523,7524,7525,7527,7528,7529,7530,7531,7532,7533,7534,7535,7538,7539,7540,7541,7542,7543,7544,7545,7546,7547,7548,7549,7550,7551,7552,7553,7554,7556,7557,7559,7560,7561,7562,7563,7564,7565,7567,7568,7569,7570,7571,7572,7573,7574,7575,7576,7577,7578,7579,7580,7581,7582,7583,7584,7585,7586,7587,7588,7589,7590,7591,7592,7594,7595,7596,7597,7598,7600,7602,7603,7604,7605,7606,7608,7609,7610,7611,7612,7613,7614,7615,7616,7618,7619,7620,7621,7622,7623,7624,7626,7627,7628,7629,7630,7631,7632,7633,7634,7635,7636,7637,7638,7639,7640,7641,7642,7643,7644,7645,7647,7648,7649,7650,7651,7652,7653,7654,7656,7657,7658,7659,7660,7661,7662,7663,7664,7665,7666,7667,7668,7669,7670,7672,7673,7674,7675,7676,7677,7678,7679,7680,7681,7682,7683,7684,7685,7686,7687,7689,7690,7691,7692,7694,7695,7696,7697,7698,7700,7701,7704,7705,7707,7708,7709,7710,7711,7712,7713,7714,7715,7716,7717,7718,7719,7720,7721,7722,7724,7725,7726,7728,7729,7730,7731,7732,7733,7734,7735,7736,7738,7739,7740,7741,7742,7743,7744,7745,7746,7748,7749,7750,7751,7752,7753,7754,7755,7756,7757,7758,7759,7760,7761,7762,7763,7764,7765,7766,7767,7768,7769,7770,7771,7772,7773,7774,7775,7776,7777,7778,7779,7781,7783,7784,7785,7786,7787,7788,7789,7790,7792,7793,7794,7795,7796,7797,7798,7799,7800,7801,7802,7803,7804,7805,7806,7807,7808,7809,7811,7812,7813,7814,7815,7816,7818,7819,7821,7822,7823,7824,7825,7826,7827,7828,7829,7831,7832,7833,7834,7836,7837,7839,7840,7841,7842,7843,7844,7845,7847,7848,7849,7850,7851,7852,7853,7854,7856,7857,7858,7859,7860,7861,7862,7863,7864,7865,7867,7869,7870,7871,7872,7874,7875,7876,7877,7878,7879,7880,7881,7883,7884,7885,7886,7888,7890,7891,7892,7893,7894,7895,7896,7897,7899,7900,7901,7902,7903,7904,7905,7906,7908,7909,7910,7911,7912,7914,7915,7916,7917,7918,7919,7920,7921,7922,7923,7924,7925,7926,7927,7928,7929,7930,7931,7932,7934,7935,7936,7937,7938,7939,7940,7941,7942,7944,7945,7946,7947,7948,7949,7950,7951,7952,7954,7955,7956,7957,7958,7959,7960,7961,7962,7963,7964,7965,7966,7968,7969,7970,7971,7972,7973,7974,7975,7976,7977,7978,7979,7980,7981,7982,7983,7984,7985,7986,7988,7990,7991,7992,7993,7994,7995,7996,7997,7998,7999,8000,8001,8002,8003,8004,8005,8006,8008,8009,8010,8011,8012,8013,8014,8015,8017,8018,8019,8020,8022,8024,8025,8026,8027,8028,8030,8031,8032,8033,8034,8035,8036,8037,8038,8039,8040,8041,8042,8043,8044,8045,8046,8047,8048,8049,8050,8051,8052,8053,8054,8058,8059,8060,8061,8062,8063,8064,8065,8066,8068,8069,8070,8071,8072,8073,8074,8075,8076,8078,8079,8080,8081,8082,8083,8084,8086,8087,8088,8089,8090,8091,8092,8093,8094,8095,8096,8097,8099,8100,8101,8102,8103,8104,8105,8106,8107,8108,8109,8110,8112,8113,8115,8116,8118,8119,8120,8121,8122,8123,8124,8125,8126,8128,8129,8130,8131,8132,8133,8134,8135,8136,8138,8139,8140,8141,8142,8143,8144,8145,8146,8147,8148,8149,8150,8151,8153,8154,8155,8156,8157,8158,8159,8160,8161,8162,8164,8165,8166,8167,8168,8169,8170,8171,8173,8174,8175,8176,8177,8178,8180,8181,8182,8183,8184,8185,8186,8187,8188,8189,8190,8191,8192,8193,8196,8197,8198,8200,8201,8202,8203,8204,8205,8206,8207,8208,8209,8210,8211,8213,8214,8215,8216,8217,8218,8219,8220,8222,8223,8224,8225,8226,8227,8229,8230,8231,8232,8233,8234,8235,8236,8237,8238,8239,8240,8241,8242,8244,8245,8246,8247,8248,8249,8250,8252,8253,8254,8255,8256,8257,8258,8259,8261,8262,8263,8264,8265,8266,8267,8268,8269,8270,8271,8272,8274,8275,8276,8277,8279,8280,8281,8282,8284,8285,8286,8287,8288,8289,8290,8291,8292,8293,8294,8295,8296,8297,8298,8299,8300,8301,8302,8303,8304,8305,8306,8308,8309,8310,8311,8312,8313,8314,8315,8316,8317,8318,8319,8320,8321,8322,8323,8324,8326,8327,8328,8329,8330,8331,8332,8333,8334,8336,8337,8339,8340,8341,8344,8345,8346,8347,8348,8349,8350,8352,8353,8354,8355,8356,8357,8358,8360,8361,8362,8363,8364,8365,8366,8367,8368,8369,8370,8371,8372,8374,8375,8376,8377,8378,8379,8380,8381,8383,8384,8385,8386,8387,8390,8391,8392,8393,8394,8395,8396,8397,8398,8399,8400,8401,8402,8403,8404,8405,8406,8407,8408,8409,8410,8411,8412,8413,8415,8416,8417,8418,8419,8420,8421,8422,8423,8424,8426,8427,8428,8429,8430,8431,8432,8433,8434,8435,8436,8437,8438,8439,8440,8441,8442,8443,8444,8445,8446,8447,8449,8450,8451,8452,8453,8454,8455,8456,8457,8459,8460,8461,8462,8463,8464,8465,8466,8467,8469,8470,8471,8472,8473,8474,8475,8476,8477,8478,8479,8480,8482,8483,8484,8485,8486,8487,8488,8489,8491,8492,8493,8494,8495,8497,8498,8499,8500,8502,8503,8504,8505,8506,8507,8508,8509,8510,8511,8512,8515,8516,8517,8518,8519,8520,8521,8522,8523,8524,8525,8526,8527,8529,8530,8531,8532,8533,8534,8536,8537,8538,8539,8540,8541,8542,8543,8544,8545,8546,8547,8549,8550,8551,8552,8553,8554,8555,8556,8557,8559,8560,8561,8562,8563,8564,8565,8566,8568,8569,8570,8571,8572,8573,8574,8575,8577,8578,8579,8580,8581,8582,8583,8584,8585,8586,8588,8589,8590,8591,8592,8593,8594,8596,8597,8598,8599,8600,8601,8602,8603,8604,8605,8606,8607,8608,8609,8610,8612,8613,8615,8616,8617,8618,8620,8622,8623,8624,8625,8626,8627,8628,8630,8631,8632,8633,8635,8636,8637,8638,8639,8640,8641,8642,8643,8644,8645,8646,8647,8648,8649,8650,8651,8652,8653,8654,8655,8656,8658,8659,8660,8661,8662,8663,8664,8665,8666,8667,8668,8669,8670,8672,8673,8674,8675,8676,8677,8678,8679,8680,8682,8683,8684,8685,8686,8687,8688,8689,8690,8692,8693,8694,8695,8696,8697,8698,8699,8700,8701,8702,8703,8704,8705,8706,8707,8708,8709,8710,8711,8712,8713,8714,8715,8716,8717,8718,8719,8720,8721,8722,8723,8724,8725,8726,8727,8728,8729,8732,8733,8734,8735,8736,8737,8739,8740,8741,8742,8743,8744,8745,8746,8747,8749,8750,8751,8753,8754,8755,8756,8757,8758,8759,8760,8761,8762,8766,8767,8768,8769,8770,8771,8773,8774,8775,8776,8777,8778,8779,8780,8781,8782,8783,8784,8785,8786,8787,8788,8789,8790,8791,8792,8793,8794,8796,8797,8799,8800,8801,8802,8803,8804,8805,8806,8807,8809,8810,8811,8812,8813,8814,8815,8816,8817,8819,8820,8821,8822,8823,8824,8825,8826,8827,8828,8829,8830,8831,8832,8833,8834,8835,8836,8837,8838,8839,8840,8841,8842,8843,8844,8846,8847,8848,8850,8852,8853,8854,8855,8856,8857,8860,8861,8862,8863,8864,8866,8867,8869,8870,8871,8872,8873,8874,8875,8876,8877,8878,8879,8880,8882,8883,8884,8885,8886,8887,8888,8889,8890,8891,8892,8893,8894,8896,8897,8898,8899,8900,8901,8902,8903,8904,8905,8906,8907,8908,8909,8910,8911,8912,8914,8915,8916,8917,8918,8919,8920,8922,8923,8924,8925,8926,8927,8928,8930,8931,8932,8933,8934,8935,8936,8937,8938,8939,8940,8941,8942,8943,8944,8945,8946,8947,8948,8949,8950,8952,8953,8954,8955,8956,8957,8958,8959,8960,8961,8962,8963,8964,8965,8966,8967,8968,8969,8970,8971,8972,8973,8974,8975,8976,8977,8979,8980,8981,8982,8984,8985,8986,8987,8988,8989,8990,8993,8994,8995,8996,8997,8998,9000,9001,9002,9003,9005,9006,9007,9008,9009,9010,9011,9012,9013,9014,9015,9017,9018,9019,9020,9021,9022,9023,9024,9025,9026,9027,9028,9029,9030,9031,9032,9033,9034,9035,9036,9039,9040,9041,9042,9043,9044,9045,9046,9047,9048,9049,9050,9051,9053,9054,9055,9056,9057,9058,9059,9061,9062,9063,9064,9065,9066,9067,9068,9069,9071,9072,9073,9074,9075,9076,9077,9078,9079,9081,9082,9083,9084,9085,9086,9087,9088,9089,9090,9091,9092,9093,9094,9096,9097,9098,9099,9100,9101,9102,9103,9104,9106,9107,9108,9109,9110,9111,9112,9113,9114,9115,9116,9117,9118,9119,9120,9121,9122,9123,9124,9125,9126,9127,9128,9129,9130,9131,9132,9133,9135,9136,9138,9139,9140,9141,9142,9143,9144,9145,9146,9147,9148,9149,9150,9151,9152,9153,9154,9155,9156,9157,9159,9160,9161,9163,9164,9165,9166,9168,9169,9170,9171,9172,9173,9175,9176,9177,9178,9180,9181,9182,9183,9184,9185,9186,9187,9188,9190,9191,9192,9193,9194,9195,9196,9197,9198,9200,9201,9202,9203,9204,9205,9206,9207,9208,9209,9210,9211,9212,9213,9214,9215,9216,9217,9218,9219,9222,9224,9225,9226,9227,9228,9229,9231,9232,9233,9234,9235,9237,9238,9240,9241,9242,9243,9245,9246,9247,9248,9249,9250,9251,9252,9253,9254,9255,9256,9257,9258,9259,9260,9261,9262,9263,9265,9266,9267,9268,9269,9270,9271,9272,9274,9275,9276,9277,9278,9279,9280,9282,9283,9284,9285,9286,9287,9288,9289,9290,9291,9292,9293,9294,9295,9298,9299,9300,9301,9302,9303,9304,9305,9306,9307,9308,9309,9312,9313,9314,9315,9316,9317,9318,9319,9320,9321,9322,9323,9324,9326,9327,9328,9329,9330,9331,9332,9333,9334,9335,9336,9337,9338,9340,9341,9342,9343,9344,9345,9346,9347,9348,9349,9350,9351,9353,9354,9355,9356,9357,9359,9360,9361,9362,9363,9364,9365,9366,9368,9369,9370,9371,9372,9373,9374,9375,9376,9378,9379,9380,9381,9382,9383,9384,9385,9386,9388,9389,9390,9391,9392,9393,9394,9395,9397,9398,9399,9400,9401,9402,9403,9404,9406,9407,9408,9409,9410,9411,9412,9413,9415,9416,9417,9418,9419,9420,9421,9422,9423,9424,9426,9427,9428,9429,9430,9431,9432,9433,9434,9435,9437,9438,9441,9442,9443,9444,9445,9446,9447,9448,9449,9450,9451,9452,9453,9454,9456,9458,9460,9461,9462,9463,9464,9465,9466,9467,9468,9469,9470,9471,9472,9473,9474,9475,9476,9477,9478,9479,9480,9481,9482,9483,9484,9485,9486,9487,9489,9490,9491,9492,9493,9494,9495,9496,9497,9499,9500,9501,9502,9503,9504,9505,9506,9507,9509,9510,9511,9512,9513,9514,9515,9516,9517,9518,9520,9521,9522,9523,9524,9525,9526,9529,9530,9531,9532,9533,9534,9535,9536,9537,9538,9539,9540,9541,9543,9544,9545,9546,9547,9548,9549,9550,9551,9553,9554,9555,9556,9557,9558,9559,9560,9561,9562,9563,9564,9565,9566,9567,9568,9569,9570,9571,9572,9573,9574,9575,9576,9577,9578,9579,9580,9581,9582,9583,9584,9586,9587,9588,9589,9590,9591,9592,9593,9594,9595,9596,9597,9598,9599,9600,9602,9603,9604,9605,9606,9607,9608,9609,9610,9612,9613,9614,9615,9616,9617,9618,9619,9620,9622,9623,9624,9625,9626,9627,9628,9629,9630,9632,9635,9636,9637,9638,9639,9640,9641,9642,9643,9644,9645,9646,9649,9650,9651,9652,9653,9654,9655,9656,9657,9658,9659,9660,9661,9662,9664,9665,9667,9668,9669,9670,9671,9672,9673,9674,9675,9676,9678,9679,9680,9681,9682,9683,9684,9685,9686,9689,9690,9691,9692,9693,9694,9695,9696,9697,9698,9699,9700,9701,9702,9703,9705,9706,9707,9708,9709,9710,9711,9712,9713,9715,9716,9717,9718,9719,9720,9721,9722,9723,9725,9726,9727,9728,9729,9730,9731,9732,9733,9734,9735,9736,9737,9738,9740,9741,9742,9743,9744,9745,9746,9747,9748,9749,9750,9751,9752,9754,9755,9756,9758,9759,9760,9762,9764,9765,9766,9767,9768,9769,9770,9771,9772,9773,9774,9775,9776,9777,9778,9779,9780,9781,9782,9783,9784,9785,9786,9787,9788,9789,9790,9792,9793,9794,9795,9796,9797,9798,9799,9802,9803,9804,9805,9806,9807,9808,9810,9811,9812,9813,9814,9815,9816,9817,9819,9820,9821,9822,9823,9824,9825,9827,9828,9829,9830,9831,9832,9833,9834,9835,9836,9837,9838,9839,9840,9841,9842,9843,9844,9845,9846,9847,9848,9849,9851,9852,9853,9854,9855,9856,9857,9858,9859,9860,9861,9862,9863,9864,9866,9867,9868,9869,9870,9871,9872,9873,9874,9875,9876,9877,9878,9880,9881,9882,9883,9884,9886,9887,9888,9889,9890,9891,9892,9893,9894,9895,9896,9898,9899,9900,9901,9903,9904,9905,9906,9907,9908,9909,9910,9912,9913,9914,9915,9916,9917,9918,9919,9920,9921,9922,9923,9924,9925,9926,9927,9928,9929,9931,9932,9933,9934,9935,9936,9937,9938,9940,9941,9942,9943,9944,9945,9946,9947,9949,9950,9953,9954,9955,9956,9957,9958,9959,9960,9961,9963,9965,9966,9967,9968,9969,9970,9971,9972,9973,9974,9975,9976,9977,9978,9979,9980,9981,9982,9984,9985,9986,9987,9988,9989,9990,9991,9992,9994,9995,9996,9997,9998,9999],"errors":9020}},{"run_id":"graph-fidelity-source-residual-s102","spec":{"run_id":"graph-fidelity-source-residual-s102","stage":"evaluate","cohort":"fidelity","variant":"source-residual","recipe":"residual","pmax":0.0,"input_scale":1.0,"output_relu":true,"lr":0.001,"momentum":0.9,"shrinkage":2e-05,"seed":102,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"timeout_seconds":180,"gpu":"A100","precision":"fp32"},"history":[{"epoch":1,"stochastic_training_loss":4.544461250305176,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":0.7372415239999839,"epoch_training_seconds":0.7372415239999839,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":5,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":3.625660859999982,"epoch_training_seconds":0.7222186200000067,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":10,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":7.236593406999987,"epoch_training_seconds":0.7220236260000092,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":15,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":10.847027136999998,"epoch_training_seconds":0.7220554870000058,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":20,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":14.457806314000038,"epoch_training_seconds":0.7220470489999968,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":25,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":18.06841386000002,"epoch_training_seconds":0.7220971149999968,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":30,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":21.67901366800004,"epoch_training_seconds":0.7220184599999868,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":35,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":25.28942397899999,"epoch_training_seconds":0.7220421029999784,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":40,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":28.90018921899997,"epoch_training_seconds":0.7221400499999788,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":45,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":32.51123970599997,"epoch_training_seconds":0.7222943969999847,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":50,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":36.121778510999974,"epoch_training_seconds":0.7220015329999967,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":55,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":39.732564808999996,"epoch_training_seconds":0.7221027129999982,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":60,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":43.34345240600004,"epoch_training_seconds":0.7220668190000197,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":65,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":46.95433130600003,"epoch_training_seconds":0.7221598950000043,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":70,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":50.56499878400007,"epoch_training_seconds":0.7220444260000249,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":75,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":54.17570996699999,"epoch_training_seconds":0.7220826709999528,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":80,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":57.78661143499994,"epoch_training_seconds":0.7220081670000127,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":85,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":61.3973577239999,"epoch_training_seconds":0.7219774010000037,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":90,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":65.0077198869999,"epoch_training_seconds":0.7219330220000302,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":95,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":68.61926513899994,"epoch_training_seconds":0.7220310469999731,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":100,"stochastic_training_loss":1.931959867477417,"dense_train_probe":{"loss":1.743318359375,"accuracy":0.3635,"n":10000},"validation":{"loss":1.74424296875,"accuracy":0.3659,"n":10000},"training_seconds":72.23016014299992,"epoch_training_seconds":0.722458362999987,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.935595691204071,"validation_probe_prediction_counts":[1307,0,0,0,218,0,0,0,284,239]}],"best_epoch":100,"best_validation_loss":1.74424296875,"training_seconds":72.23016014299992,"total_run_seconds":73.46011743699998,"hardware":{"device":"cuda:0","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"4d0ac269167486811a0086108ca56313016afcebfc075d45e09455c228dee75b","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[0,0,0,0],"final_train":{"loss":1.74476890625,"accuracy":0.36294,"n":50000},"selected_train":{"loss":1.74476890625,"accuracy":0.36294,"n":50000},"final_test":{"loss":1.732096484375,"accuracy":0.3683,"n":10000,"wrong_indices":[0,1,2,5,8,11,14,15,17,18,21,22,23,26,29,30,31,32,34,35,36,37,38,39,40,41,43,44,45,46,47,50,51,52,53,54,55,57,59,60,63,64,66,68,70,72,74,75,76,77,79,80,81,82,83,86,87,88,89,90,91,92,93,94,96,97,98,100,102,106,107,111,112,114,119,120,122,123,124,127,129,130,131,132,133,135,137,138,140,141,142,143,144,145,147,149,151,152,153,154,155,156,158,161,162,164,165,167,168,171,172,173,174,175,176,178,180,182,186,187,189,190,191,195,196,197,199,200,201,202,203,204,205,207,208,211,213,216,217,218,219,220,221,222,223,224,225,228,229,230,231,233,234,236,237,239,240,241,243,244,245,247,249,251,253,254,255,256,258,259,261,262,263,265,267,270,272,276,278,279,280,282,283,285,286,288,289,290,291,293,298,300,301,302,303,306,307,309,310,312,313,314,316,317,318,319,321,323,326,328,329,330,331,332,333,334,335,337,339,340,341,342,343,345,346,347,348,349,350,351,352,353,354,356,357,358,361,362,363,364,365,366,367,368,369,370,371,375,377,378,381,382,383,384,385,386,387,388,390,392,393,395,396,397,400,402,403,404,405,406,408,409,410,411,412,413,415,416,418,419,421,423,427,430,433,437,438,439,441,442,443,444,445,446,448,449,450,451,452,453,455,456,457,460,461,462,463,464,467,468,469,472,473,476,477,478,479,480,482,483,489,491,492,493,494,498,499,500,502,503,504,505,506,507,508,509,510,511,512,513,514,515,516,517,518,522,523,524,526,528,529,531,534,536,537,539,540,543,547,548,549,550,551,552,554,557,559,566,568,569,570,573,574,576,577,578,579,582,583,584,585,587,588,590,591,594,595,600,602,604,605,607,609,610,612,613,614,615,617,618,619,623,624,625,626,627,628,629,632,633,635,636,637,638,640,643,645,646,647,648,649,650,651,652,653,654,657,658,659,661,663,665,666,667,669,672,674,675,676,677,679,680,682,683,684,686,687,688,689,690,691,692,694,695,696,699,700,702,703,705,707,710,711,715,716,720,724,725,726,727,728,729,730,731,732,734,735,737,738,739,740,741,743,744,745,746,747,749,751,753,754,755,756,760,764,766,767,768,769,771,772,775,777,778,779,780,782,783,785,786,790,791,792,795,796,797,798,799,801,807,808,809,810,811,812,814,815,816,817,818,819,820,822,823,824,825,826,828,829,830,831,832,834,835,836,837,840,841,842,846,847,848,849,850,852,853,855,856,857,858,859,860,861,863,865,866,867,868,869,870,873,875,880,881,883,885,886,887,888,889,890,891,892,894,897,898,900,903,905,907,909,911,912,917,918,919,920,921,922,923,924,925,926,927,929,930,933,934,935,937,938,939,940,941,942,943,944,945,946,947,948,949,950,951,952,955,956,957,958,959,960,963,964,965,967,970,973,974,975,976,977,978,979,980,982,984,985,986,987,988,989,990,991,992,994,995,996,1002,1003,1004,1006,1008,1011,1012,1014,1016,1017,1019,1020,1021,1022,1025,1027,1028,1030,1031,1032,1035,1036,1037,1038,1039,1040,1041,1042,1044,1046,1049,1050,1053,1054,1055,1056,1062,1064,1065,1066,1067,1068,1069,1070,1071,1072,1073,1075,1076,1079,1082,1083,1085,1087,1089,1091,1092,1094,1095,1096,1097,1098,1099,1100,1102,1104,1106,1107,1108,1109,1110,1112,1113,1114,1115,1117,1119,1122,1123,1125,1126,1127,1128,1129,1131,1132,1133,1134,1135,1136,1137,1138,1139,1141,1143,1144,1146,1150,1151,1153,1155,1156,1161,1162,1164,1166,1168,1169,1171,1172,1173,1174,1175,1177,1179,1180,1181,1182,1184,1186,1187,1189,1190,1192,1193,1194,1196,1198,1199,1200,1201,1204,1205,1206,1207,1208,1209,1210,1211,1212,1213,1214,1215,1216,1221,1224,1226,1227,1232,1233,1235,1236,1237,1238,1239,1240,1241,1242,1243,1244,1245,1247,1250,1251,1252,1254,1256,1257,1258,1260,1262,1263,1265,1266,1269,1272,1273,1276,1278,1280,1281,1283,1284,1285,1289,1290,1291,1292,1293,1295,1296,1298,1299,1302,1303,1305,1307,1310,1315,1316,1317,1318,1321,1326,1328,1329,1331,1332,1334,1335,1336,1337,1338,1339,1340,1341,1344,1345,1346,1347,1348,1349,1350,1351,1352,1354,1355,1356,1357,1358,1359,1360,1361,1362,1363,1365,1366,1367,1368,1369,1370,1372,1373,1374,1375,1376,1377,1378,1381,1383,1384,1386,1387,1388,1391,1392,1393,1395,1397,1400,1401,1402,1403,1404,1405,1406,1407,1409,1410,1411,1412,1413,1420,1421,1422,1424,1426,1429,1430,1431,1432,1434,1436,1441,1442,1444,1446,1447,1448,1450,1451,1456,1458,1459,1460,1462,1463,1465,1466,1467,1469,1471,1472,1473,1475,1476,1477,1478,1479,1480,1482,1483,1484,1485,1489,1490,1491,1493,1494,1495,1496,1497,1498,1500,1503,1505,1506,1507,1510,1513,1514,1515,1518,1519,1520,1521,1522,1525,1527,1528,1530,1531,1536,1537,1538,1539,1540,1543,1544,1546,1548,1549,1550,1551,1553,1555,1558,1563,1564,1566,1569,1574,1576,1577,1578,1579,1581,1582,1585,1586,1587,1588,1591,1592,1593,1595,1598,1600,1601,1602,1603,1604,1605,1606,1607,1608,1609,1611,1612,1615,1616,1617,1618,1620,1624,1626,1628,1629,1630,1632,1633,1634,1635,1637,1638,1639,1641,1642,1643,1644,1646,1653,1654,1656,1657,1658,1659,1660,1661,1662,1667,1670,1671,1672,1673,1674,1676,1677,1678,1681,1682,1683,1684,1685,1688,1689,1690,1691,1693,1696,1698,1699,1703,1704,1705,1707,1709,1710,1711,1715,1716,1717,1718,1721,1722,1725,1727,1728,1729,1730,1731,1733,1734,1736,1737,1738,1741,1742,1744,1746,1747,1749,1750,1751,1752,1753,1754,1755,1760,1761,1763,1765,1766,1769,1770,1771,1772,1773,1776,1779,1780,1783,1784,1785,1789,1790,1791,1792,1795,1797,1798,1799,1800,1801,1802,1803,1804,1805,1806,1809,1810,1811,1814,1817,1818,1819,1820,1822,1824,1828,1829,1830,1831,1832,1833,1834,1835,1836,1837,1838,1839,1840,1842,1844,1845,1846,1847,1848,1850,1852,1854,1856,1857,1858,1860,1861,1863,1865,1866,1867,1868,1871,1874,1875,1876,1878,1879,1880,1883,1884,1885,1886,1887,1888,1889,1890,1891,1895,1896,1897,1900,1901,1902,1903,1905,1908,1909,1910,1911,1913,1915,1916,1917,1919,1921,1922,1923,1925,1926,1927,1928,1930,1931,1932,1933,1934,1935,1936,1937,1939,1940,1941,1943,1945,1947,1948,1949,1950,1951,1952,1953,1954,1956,1957,1962,1965,1966,1967,1969,1970,1971,1974,1975,1976,1977,1981,1982,1983,1984,1986,1987,1988,1989,1990,1991,1993,1994,1996,1997,1999,2000,2001,2002,2003,2006,2008,2009,2010,2011,2013,2015,2016,2017,2018,2020,2021,2024,2025,2026,2027,2028,2029,2030,2031,2032,2033,2034,2035,2036,2037,2039,2040,2041,2043,2044,2045,2047,2048,2051,2053,2055,2057,2058,2059,2062,2063,2064,2066,2069,2070,2071,2072,2073,2075,2076,2077,2078,2079,2080,2082,2083,2085,2086,2091,2092,2093,2095,2097,2098,2099,2100,2101,2103,2104,2105,2108,2109,2110,2112,2113,2114,2115,2116,2118,2122,2123,2125,2126,2128,2129,2130,2131,2132,2133,2134,2135,2136,2137,2138,2139,2140,2141,2143,2144,2148,2150,2151,2153,2154,2156,2157,2158,2159,2160,2162,2164,2166,2167,2170,2171,2174,2175,2176,2180,2182,2184,2185,2186,2187,2188,2189,2191,2192,2193,2194,2195,2198,2199,2200,2201,2204,2207,2210,2214,2215,2220,2221,2222,2224,2228,2229,2230,2231,2234,2235,2237,2238,2239,2240,2241,2242,2243,2245,2247,2248,2252,2253,2254,2255,2258,2260,2261,2262,2266,2267,2268,2269,2270,2273,2275,2276,2277,2278,2279,2280,2281,2282,2283,2284,2285,2286,2287,2288,2290,2291,2293,2296,2299,2300,2301,2302,2303,2305,2308,2311,2312,2314,2315,2316,2317,2321,2322,2324,2325,2327,2331,2332,2334,2335,2337,2339,2343,2344,2346,2347,2348,2350,2351,2352,2353,2354,2355,2356,2357,2358,2359,2360,2364,2365,2366,2367,2369,2371,2372,2374,2377,2379,2380,2381,2383,2387,2388,2390,2391,2392,2394,2396,2397,2398,2399,2400,2404,2405,2406,2407,2408,2409,2411,2412,2413,2415,2416,2418,2421,2422,2424,2425,2427,2428,2429,2431,2432,2433,2434,2436,2437,2439,2441,2442,2444,2445,2446,2449,2450,2452,2453,2454,2458,2459,2460,2462,2463,2464,2465,2466,2468,2469,2471,2473,2474,2475,2476,2480,2481,2482,2483,2484,2486,2487,2488,2490,2491,2495,2496,2500,2501,2502,2503,2504,2505,2507,2508,2510,2511,2513,2515,2517,2518,2519,2521,2522,2523,2524,2525,2526,2529,2532,2533,2534,2535,2539,2540,2541,2542,2545,2546,2547,2548,2549,2551,2553,2554,2555,2556,2558,2559,2560,2562,2563,2564,2565,2566,2567,2569,2572,2573,2574,2575,2576,2577,2578,2580,2581,2583,2586,2587,2588,2590,2591,2594,2595,2596,2597,2598,2599,2601,2602,2604,2605,2606,2607,2609,2610,2611,2612,2616,2618,2620,2621,2622,2623,2624,2625,2626,2628,2629,2630,2632,2634,2635,2639,2642,2643,2644,2646,2647,2648,2649,2651,2652,2653,2654,2655,2661,2662,2663,2664,2665,2666,2668,2669,2670,2671,2672,2674,2676,2677,2679,2681,2682,2684,2686,2688,2689,2690,2693,2695,2697,2698,2699,2700,2702,2704,2705,2706,2710,2711,2712,2713,2716,2718,2719,2720,2721,2722,2723,2725,2726,2727,2728,2729,2730,2731,2732,2734,2736,2737,2738,2741,2743,2745,2746,2749,2750,2751,2752,2753,2754,2756,2757,2759,2762,2766,2767,2768,2770,2771,2772,2773,2775,2776,2780,2782,2784,2785,2786,2787,2788,2789,2790,2791,2795,2796,2797,2798,2799,2801,2802,2803,2805,2807,2808,2810,2813,2814,2815,2816,2820,2822,2823,2825,2826,2827,2829,2830,2831,2832,2833,2837,2838,2839,2840,2841,2843,2844,2846,2848,2850,2851,2853,2855,2860,2861,2863,2864,2865,2866,2867,2868,2871,2874,2876,2877,2878,2880,2881,2884,2885,2887,2888,2890,2891,2893,2896,2900,2902,2903,2904,2906,2907,2909,2910,2912,2913,2914,2915,2918,2919,2920,2921,2922,2924,2925,2927,2928,2930,2931,2933,2940,2943,2944,2945,2946,2947,2948,2950,2951,2952,2953,2955,2956,2957,2959,2961,2965,2967,2968,2969,2970,2971,2974,2976,2977,2978,2980,2981,2982,2984,2985,2986,2987,2989,2991,2992,2993,2994,2995,2997,3000,3003,3004,3007,3009,3010,3011,3014,3015,3018,3019,3021,3022,3026,3027,3028,3030,3031,3033,3035,3036,3037,3038,3039,3040,3045,3047,3048,3049,3050,3051,3053,3054,3055,3057,3058,3059,3060,3061,3063,3067,3070,3071,3073,3074,3078,3079,3080,3081,3082,3083,3084,3085,3088,3089,3092,3093,3094,3095,3097,3098,3099,3100,3101,3102,3103,3104,3105,3106,3107,3108,3109,3110,3111,3113,3114,3115,3116,3117,3118,3119,3120,3121,3122,3124,3125,3126,3127,3128,3129,3130,3131,3132,3134,3135,3136,3138,3141,3142,3143,3144,3145,3146,3148,3150,3151,3152,3156,3157,3159,3161,3162,3164,3166,3167,3171,3172,3173,3175,3176,3177,3180,3181,3182,3183,3184,3187,3189,3192,3193,3195,3196,3199,3201,3202,3203,3206,3207,3208,3209,3211,3212,3213,3214,3217,3218,3220,3221,3222,3223,3225,3227,3229,3230,3231,3236,3237,3238,3239,3240,3243,3244,3248,3250,3252,3253,3254,3255,3256,3257,3258,3259,3260,3261,3262,3263,3264,3267,3268,3269,3270,3272,3273,3274,3275,3276,3277,3280,3281,3283,3284,3285,3288,3290,3292,3293,3294,3295,3296,3299,3300,3301,3302,3303,3304,3305,3307,3308,3309,3311,3312,3314,3316,3318,3320,3321,3326,3327,3328,3329,3330,3331,3333,3334,3335,3336,3337,3339,3342,3344,3345,3349,3350,3351,3352,3353,3354,3355,3356,3360,3361,3362,3363,3365,3367,3372,3373,3375,3376,3378,3379,3380,3381,3382,3383,3384,3386,3390,3391,3393,3395,3396,3398,3399,3400,3402,3403,3407,3408,3409,3410,3414,3415,3416,3418,3419,3420,3421,3422,3423,3424,3425,3427,3428,3430,3432,3433,3434,3435,3436,3438,3441,3442,3443,3447,3448,3449,3450,3451,3452,3453,3454,3455,3456,3457,3461,3462,3464,3468,3469,3470,3471,3474,3475,3476,3480,3482,3484,3486,3487,3488,3489,3490,3493,3494,3498,3503,3505,3506,3508,3510,3511,3513,3514,3515,3518,3520,3522,3524,3525,3527,3528,3531,3532,3535,3537,3539,3543,3545,3546,3547,3548,3549,3550,3552,3554,3556,3557,3558,3560,3562,3564,3565,3566,3569,3570,3572,3573,3575,3577,3578,3579,3580,3582,3585,3586,3589,3590,3591,3593,3594,3595,3597,3598,3599,3600,3601,3602,3603,3604,3605,3606,3609,3611,3614,3616,3617,3619,3620,3622,3623,3625,3628,3630,3631,3632,3636,3637,3638,3639,3641,3642,3643,3645,3647,3648,3649,3651,3652,3654,3655,3656,3657,3658,3659,3661,3663,3664,3665,3667,3668,3669,3670,3671,3673,3675,3678,3679,3681,3682,3683,3686,3687,3688,3689,3690,3691,3692,3694,3696,3697,3699,3701,3702,3703,3712,3713,3714,3715,3717,3718,3719,3720,3721,3725,3729,3730,3731,3733,3736,3738,3739,3740,3741,3742,3743,3744,3745,3746,3747,3748,3749,3750,3751,3753,3754,3756,3757,3761,3762,3763,3765,3766,3767,3769,3772,3773,3775,3776,3777,3778,3779,3780,3784,3785,3786,3787,3788,3789,3795,3796,3797,3799,3800,3801,3802,3806,3808,3809,3810,3811,3812,3814,3815,3817,3821,3822,3823,3824,3825,3826,3827,3832,3834,3835,3836,3837,3838,3839,3843,3844,3846,3848,3851,3852,3853,3854,3855,3858,3860,3862,3863,3864,3866,3869,3876,3877,3878,3886,3890,3893,3894,3896,3897,3898,3899,3900,3901,3902,3904,3906,3907,3908,3909,3910,3912,3913,3914,3916,3917,3918,3919,3920,3921,3922,3923,3925,3926,3928,3929,3930,3931,3932,3933,3935,3936,3937,3939,3941,3943,3944,3945,3946,3947,3948,3952,3953,3955,3957,3958,3960,3961,3962,3963,3965,3968,3969,3972,3973,3974,3975,3976,3977,3978,3979,3983,3985,3986,3990,3991,3993,3994,3995,3997,4002,4003,4004,4005,4006,4007,4008,4010,4013,4014,4017,4018,4019,4021,4022,4025,4026,4027,4028,4031,4032,4035,4036,4037,4038,4039,4044,4045,4049,4050,4051,4052,4053,4054,4055,4056,4057,4059,4061,4063,4064,4066,4067,4069,4072,4073,4074,4075,4076,4077,4078,4080,4081,4083,4084,4085,4087,4089,4093,4094,4097,4098,4099,4100,4102,4103,4104,4105,4106,4107,4108,4109,4110,4113,4114,4115,4118,4119,4120,4125,4127,4128,4130,4131,4132,4133,4135,4138,4139,4142,4144,4147,4148,4149,4151,4152,4153,4154,4156,4160,4161,4162,4164,4166,4167,4168,4169,4170,4171,4173,4175,4176,4177,4178,4179,4180,4181,4185,4186,4187,4189,4190,4191,4193,4195,4196,4199,4200,4201,4202,4203,4204,4205,4206,4209,4211,4212,4214,4215,4216,4219,4220,4222,4224,4225,4226,4228,4232,4233,4234,4236,4238,4239,4242,4243,4244,4247,4248,4249,4250,4252,4254,4255,4256,4260,4261,4262,4263,4264,4265,4267,4270,4271,4273,4274,4275,4276,4277,4279,4281,4285,4288,4289,4292,4295,4296,4297,4300,4302,4303,4304,4306,4307,4308,4310,4311,4312,4315,4317,4318,4322,4323,4326,4328,4330,4331,4334,4335,4336,4337,4338,4339,4340,4341,4342,4345,4346,4347,4349,4350,4352,4354,4355,4356,4357,4359,4360,4364,4366,4367,4368,4369,4374,4378,4381,4384,4385,4386,4387,4388,4391,4393,4394,4395,4397,4400,4401,4402,4406,4409,4412,4413,4415,4416,4418,4420,4422,4423,4427,4428,4430,4433,4435,4437,4438,4439,4440,4441,4442,4443,4445,4446,4449,4450,4451,4453,4456,4459,4460,4461,4463,4464,4466,4467,4469,4471,4472,4474,4476,4477,4482,4484,4485,4487,4488,4491,4492,4493,4494,4497,4498,4499,4501,4503,4504,4506,4507,4509,4510,4512,4516,4517,4520,4521,4522,4523,4524,4525,4526,4528,4529,4530,4532,4533,4535,4536,4537,4538,4539,4540,4541,4546,4547,4548,4549,4551,4552,4557,4559,4561,4562,4563,4564,4565,4566,4568,4569,4571,4573,4574,4575,4577,4578,4579,4580,4581,4582,4583,4586,4587,4588,4589,4591,4593,4594,4595,4596,4597,4599,4600,4601,4602,4603,4605,4606,4607,4612,4613,4615,4618,4619,4620,4621,4622,4623,4624,4625,4627,4630,4632,4635,4636,4637,4638,4639,4640,4643,4645,4646,4647,4649,4651,4653,4654,4655,4656,4657,4658,4660,4664,4666,4668,4669,4670,4674,4676,4677,4678,4680,4684,4685,4686,4687,4688,4689,4690,4691,4693,4694,4696,4697,4698,4699,4702,4703,4704,4705,4708,4709,4710,4711,4712,4713,4714,4715,4716,4717,4719,4721,4722,4723,4725,4727,4728,4729,4730,4732,4733,4734,4735,4736,4740,4742,4745,4746,4747,4749,4751,4754,4755,4758,4759,4760,4762,4763,4764,4765,4766,4767,4770,4771,4773,4774,4775,4778,4779,4781,4782,4784,4785,4787,4790,4793,4794,4796,4798,4800,4801,4802,4805,4806,4807,4808,4809,4810,4811,4812,4814,4815,4816,4818,4821,4823,4824,4828,4830,4831,4832,4833,4836,4837,4838,4841,4844,4847,4848,4851,4853,4854,4855,4858,4859,4861,4863,4864,4865,4867,4868,4869,4870,4871,4872,4873,4874,4875,4876,4877,4878,4880,4881,4882,4883,4885,4886,4888,4889,4890,4892,4894,4896,4897,4898,4899,4900,4902,4903,4904,4905,4907,4908,4909,4910,4913,4914,4915,4917,4918,4920,4921,4924,4925,4926,4927,4928,4930,4931,4932,4933,4934,4936,4938,4939,4940,4941,4942,4943,4944,4949,4950,4951,4952,4953,4954,4955,4956,4961,4962,4964,4965,4966,4969,4970,4971,4972,4973,4977,4978,4979,4980,4981,4983,4984,4985,4990,4991,4993,4994,4995,4996,4997,5000,5001,5005,5007,5010,5012,5013,5014,5018,5019,5020,5021,5024,5025,5028,5030,5034,5036,5037,5038,5040,5044,5045,5046,5048,5052,5053,5054,5056,5057,5058,5062,5064,5066,5067,5068,5071,5072,5074,5077,5078,5081,5083,5085,5086,5088,5089,5090,5091,5092,5093,5094,5095,5097,5098,5099,5102,5105,5107,5110,5111,5112,5113,5114,5115,5116,5117,5119,5120,5121,5122,5125,5127,5128,5131,5132,5134,5135,5136,5140,5143,5145,5146,5148,5149,5150,5152,5153,5154,5156,5157,5158,5160,5161,5162,5166,5167,5168,5170,5171,5172,5174,5176,5177,5179,5180,5181,5183,5185,5186,5187,5189,5190,5192,5193,5194,5196,5197,5199,5201,5203,5205,5206,5207,5208,5210,5211,5212,5213,5214,5215,5216,5217,5218,5221,5222,5223,5224,5225,5227,5228,5229,5230,5232,5234,5235,5237,5238,5240,5245,5246,5248,5250,5252,5254,5258,5261,5263,5264,5265,5266,5267,5271,5272,5273,5275,5276,5277,5281,5282,5283,5285,5286,5287,5291,5292,5293,5295,5296,5297,5301,5302,5303,5304,5307,5308,5309,5310,5313,5314,5316,5317,5318,5323,5324,5325,5326,5327,5328,5329,5330,5331,5332,5334,5336,5338,5339,5340,5341,5346,5347,5350,5351,5354,5356,5357,5358,5359,5361,5363,5364,5365,5366,5367,5370,5371,5372,5374,5378,5381,5382,5383,5384,5385,5389,5390,5391,5392,5396,5397,5399,5400,5401,5402,5406,5407,5408,5410,5411,5412,5416,5417,5418,5420,5421,5422,5425,5427,5431,5432,5436,5437,5441,5442,5445,5446,5449,5451,5453,5454,5455,5457,5458,5460,5461,5465,5466,5467,5468,5469,5471,5472,5473,5475,5477,5479,5480,5481,5482,5484,5485,5486,5487,5488,5490,5492,5494,5495,5496,5497,5498,5499,5501,5502,5504,5506,5507,5508,5510,5511,5512,5514,5515,5516,5518,5520,5521,5524,5526,5528,5529,5532,5533,5534,5535,5536,5538,5539,5540,5541,5542,5544,5545,5549,5550,5551,5552,5553,5555,5557,5558,5560,5562,5563,5566,5568,5570,5571,5572,5573,5574,5576,5579,5581,5583,5585,5588,5590,5591,5594,5595,5596,5598,5599,5600,5604,5605,5606,5608,5609,5610,5614,5615,5616,5618,5619,5620,5623,5624,5625,5626,5628,5629,5630,5632,5633,5634,5635,5636,5637,5638,5640,5641,5642,5643,5646,5649,5651,5654,5655,5657,5658,5660,5661,5662,5663,5665,5666,5667,5668,5670,5674,5677,5679,5681,5682,5687,5688,5689,5690,5691,5692,5693,5694,5697,5699,5700,5702,5703,5706,5708,5709,5711,5712,5714,5715,5716,5717,5718,5722,5723,5724,5726,5727,5728,5732,5733,5734,5735,5736,5738,5739,5740,5742,5743,5745,5746,5747,5748,5751,5752,5755,5759,5760,5761,5762,5763,5764,5766,5767,5768,5769,5770,5772,5773,5776,5779,5780,5783,5785,5786,5788,5789,5793,5794,5795,5796,5798,5799,5801,5802,5804,5807,5808,5809,5810,5811,5814,5815,5819,5820,5821,5823,5824,5826,5829,5831,5833,5834,5835,5839,5840,5841,5843,5844,5845,5848,5849,5850,5851,5852,5853,5854,5858,5859,5860,5861,5862,5863,5866,5867,5872,5873,5874,5877,5878,5879,5880,5882,5883,5884,5885,5886,5887,5888,5889,5891,5892,5893,5895,5896,5898,5901,5902,5903,5904,5906,5907,5909,5910,5912,5913,5914,5915,5916,5917,5918,5920,5921,5922,5924,5925,5928,5931,5933,5934,5935,5936,5937,5938,5939,5943,5944,5945,5947,5948,5949,5953,5954,5955,5957,5958,5959,5963,5964,5966,5970,5972,5973,5978,5981,5982,5983,5984,5985,5988,5989,5991,5992,5994,5997,5998,5999,6002,6005,6006,6007,6008,6009,6010,6011,6012,6014,6017,6020,6023,6026,6027,6028,6029,6030,6031,6033,6034,6035,6036,6037,6038,6041,6042,6043,6044,6045,6046,6048,6050,6051,6052,6053,6054,6057,6058,6059,6060,6061,6063,6064,6065,6067,6068,6069,6071,6073,6074,6075,6077,6078,6079,6081,6083,6084,6085,6087,6088,6089,6091,6092,6093,6094,6095,6096,6098,6101,6103,6104,6105,6106,6107,6108,6109,6110,6111,6112,6113,6115,6116,6118,6119,6120,6121,6122,6123,6124,6125,6126,6128,6130,6132,6134,6135,6136,6139,6141,6142,6146,6147,6148,6149,6151,6155,6156,6157,6158,6159,6160,6162,6164,6165,6166,6167,6168,6170,6171,6172,6173,6174,6177,6179,6180,6182,6183,6184,6186,6187,6188,6192,6193,6194,6196,6197,6198,6202,6203,6204,6206,6207,6208,6213,6215,6216,6217,6218,6222,6223,6224,6225,6226,6227,6229,6231,6232,6233,6234,6236,6237,6239,6240,6242,6243,6244,6246,6252,6253,6254,6255,6257,6258,6260,6261,6263,6266,6267,6269,6270,6272,6274,6276,6277,6278,6279,6281,6282,6283,6285,6289,6290,6291,6292,6294,6298,6299,6301,6305,6306,6307,6308,6310,6311,6312,6314,6315,6316,6320,6321,6322,6324,6325,6326,6329,6330,6331,6333,6334,6335,6337,6338,6339,6340,6341,6345,6346,6349,6350,6352,6353,6354,6355,6356,6357,6360,6361,6363,6364,6365,6366,6368,6370,6371,6374,6375,6377,6379,6380,6381,6382,6384,6385,6386,6387,6388,6389,6390,6391,6392,6397,6399,6402,6405,6406,6407,6408,6412,6413,6414,6415,6418,6419,6421,6423,6425,6430,6431,6432,6434,6438,6439,6440,6441,6445,6446,6447,6449,6452,6453,6455,6456,6458,6459,6462,6463,6465,6466,6468,6469,6471,6472,6476,6479,6480,6481,6482,6483,6484,6486,6490,6491,6494,6497,6498,6499,6500,6501,6502,6503,6504,6505,6506,6509,6511,6513,6515,6517,6518,6519,6521,6522,6525,6527,6528,6530,6531,6533,6534,6535,6537,6538,6539,6540,6541,6542,6544,6545,6548,6549,6550,6551,6554,6556,6558,6561,6562,6563,6564,6566,6568,6569,6570,6571,6572,6573,6574,6575,6576,6577,6581,6584,6586,6589,6591,6593,6594,6596,6598,6599,6600,6601,6604,6605,6606,6607,6609,6611,6613,6614,6615,6616,6618,6619,6620,6622,6623,6624,6625,6628,6630,6634,6635,6636,6638,6639,6640,6644,6645,6646,6648,6650,6652,6653,6661,6662,6663,6664,6665,6666,6667,6668,6669,6670,6673,6674,6675,6676,6677,6678,6679,6680,6681,6683,6684,6685,6688,6690,6691,6693,6694,6697,6698,6702,6703,6704,6706,6707,6708,6712,6713,6714,6716,6717,6720,6721,6722,6724,6726,6727,6728,6729,6730,6731,6732,6733,6736,6739,6741,6743,6744,6745,6746,6748,6749,6751,6754,6756,6757,6758,6762,6763,6764,6765,6767,6768,6771,6773,6774,6775,6777,6782,6783,6785,6788,6789,6790,6791,6792,6794,6796,6797,6799,6800,6801,6803,6804,6805,6809,6810,6811,6813,6814,6815,6817,6819,6820,6821,6823,6824,6825,6827,6828,6829,6830,6831,6832,6836,6837,6840,6842,6844,6845,6846,6847,6848,6849,6852,6853,6855,6856,6857,6858,6860,6862,6863,6866,6868,6869,6871,6872,6873,6874,6875,6876,6878,6879,6880,6881,6882,6883,6884,6885,6886,6891,6893,6896,6899,6900,6901,6902,6906,6907,6908,6909,6912,6913,6917,6918,6920,6922,6926,6928,6929,6930,6932,6933,6934,6938,6939,6940,6942,6943,6944,6948,6949,6950,6952,6953,6954,6957,6960,6961,6963,6964,6965,6966,6969,6973,6975,6976,6977,6978,6981,6982,6985,6986,6987,6989,6991,6992,6993,6994,7000,7001,7002,7003,7005,7006,7007,7010,7012,7013,7014,7015,7017,7018,7019,7020,7021,7022,7023,7024,7026,7028,7029,7030,7032,7036,7038,7039,7040,7041,7042,7048,7050,7051,7053,7054,7055,7057,7058,7059,7063,7064,7065,7067,7068,7069,7073,7074,7075,7077,7078,7079,7082,7087,7088,7090,7091,7093,7097,7098,7100,7103,7104,7105,7108,7110,7111,7113,7115,7116,7117,7119,7120,7121,7122,7123,7124,7130,7131,7134,7135,7138,7140,7141,7142,7144,7145,7147,7149,7150,7151,7152,7154,7155,7156,7157,7158,7159,7160,7163,7165,7166,7167,7170,7171,7172,7173,7176,7178,7179,7180,7183,7184,7185,7187,7188,7189,7191,7192,7193,7195,7196,7197,7204,7205,7207,7209,7210,7211,7212,7213,7214,7215,7217,7219,7222,7223,7226,7228,7229,7230,7232,7233,7235,7237,7238,7239,7240,7241,7245,7247,7248,7249,7250,7252,7253,7257,7258,7260,7262,7264,7266,7267,7268,7269,7270,7271,7272,7274,7275,7276,7280,7281,7282,7284,7285,7286,7290,7291,7292,7294,7295,7296,7299,7300,7303,7304,7305,7306,7307,7308,7310,7311,7312,7314,7315,7319,7320,7321,7323,7324,7325,7326,7327,7328,7329,7331,7333,7334,7335,7337,7338,7340,7343,7344,7345,7346,7348,7349,7350,7351,7352,7353,7355,7356,7358,7359,7362,7364,7365,7372,7373,7374,7375,7381,7386,7387,7388,7389,7390,7392,7393,7394,7395,7396,7397,7398,7399,7400,7401,7403,7404,7405,7406,7407,7409,7411,7412,7414,7415,7416,7418,7419,7420,7422,7424,7427,7430,7431,7432,7433,7434,7435,7436,7437,7438,7439,7441,7442,7443,7445,7447,7448,7451,7453,7454,7457,7458,7460,7461,7463,7466,7467,7468,7469,7470,7472,7474,7475,7476,7477,7478,7479,7480,7482,7483,7484,7486,7490,7492,7493,7497,7498,7501,7503,7504,7507,7508,7509,7511,7512,7513,7517,7518,7519,7521,7522,7523,7527,7528,7529,7531,7532,7533,7538,7539,7540,7541,7542,7543,7544,7546,7547,7548,7549,7551,7554,7556,7559,7561,7563,7564,7565,7567,7568,7570,7572,7573,7575,7576,7577,7578,7581,7582,7583,7584,7585,7587,7590,7591,7595,7596,7598,7600,7602,7604,7605,7606,7608,7609,7610,7612,7613,7614,7618,7619,7620,7622,7626,7627,7628,7630,7631,7632,7635,7636,7637,7638,7639,7643,7644,7645,7647,7648,7649,7650,7654,7656,7658,7659,7661,7665,7667,7668,7670,7672,7673,7674,7675,7676,7677,7678,7679,7681,7683,7684,7685,7686,7687,7690,7692,7695,7698,7701,7705,7708,7709,7710,7711,7712,7714,7715,7716,7717,7719,7721,7722,7724,7725,7728,7729,7730,7732,7733,7734,7738,7739,7740,7742,7743,7744,7748,7749,7750,7752,7753,7754,7757,7758,7760,7761,7762,7763,7766,7768,7771,7772,7773,7777,7778,7779,7781,7783,7784,7785,7787,7789,7790,7792,7793,7794,7796,7797,7798,7800,7801,7802,7804,7806,7808,7809,7811,7812,7815,7816,7819,7821,7822,7824,7825,7826,7829,7831,7832,7839,7840,7841,7842,7843,7844,7847,7848,7849,7850,7851,7852,7856,7857,7858,7859,7860,7861,7865,7869,7870,7875,7876,7877,7880,7881,7886,7888,7890,7891,7893,7894,7896,7897,7899,7900,7902,7903,7904,7905,7906,7908,7909,7911,7912,7914,7915,7916,7917,7918,7920,7921,7922,7924,7925,7927,7928,7929,7930,7932,7934,7935,7936,7938,7939,7940,7944,7945,7946,7948,7949,7950,7954,7955,7956,7958,7959,7960,7965,7966,7968,7969,7970,7973,7974,7975,7977,7978,7980,7981,7983,7985,7986,7988,7990,7992,7993,7994,7995,7996,7997,7998,8003,8004,8005,8008,8010,8013,8014,8018,8019,8020,8022,8024,8025,8026,8030,8031,8032,8034,8035,8036,8038,8040,8041,8042,8043,8045,8047,8048,8049,8050,8052,8058,8059,8060,8061,8062,8063,8064,8068,8069,8070,8072,8073,8074,8078,8079,8080,8081,8082,8083,8086,8087,8088,8089,8090,8091,8094,8095,8096,8099,8100,8102,8103,8104,8106,8108,8110,8112,8113,8115,8116,8118,8119,8120,8122,8123,8124,8128,8129,8130,8132,8133,8134,8138,8139,8140,8142,8143,8144,8148,8149,8151,8153,8154,8156,8158,8159,8160,8161,8162,8164,8165,8166,8167,8168,8169,8170,8171,8173,8174,8175,8177,8180,8185,8186,8187,8188,8190,8191,8192,8196,8197,8198,8200,8201,8202,8203,8206,8208,8211,8214,8215,8218,8219,8224,8225,8226,8229,8231,8232,8233,8234,8237,8238,8239,8240,8244,8245,8246,8248,8252,8253,8254,8256,8257,8261,8262,8263,8265,8268,8270,8271,8272,8275,8277,8279,8281,8282,8284,8285,8286,8287,8289,8290,8291,8292,8293,8295,8296,8299,8302,8303,8304,8305,8306,8308,8310,8311,8313,8315,8316,8318,8320,8321,8323,8324,8326,8327,8328,8331,8333,8336,8337,8339,8340,8341,8344,8345,8346,8348,8349,8350,8352,8353,8354,8356,8360,8361,8362,8364,8365,8366,8367,8368,8370,8375,8376,8377,8379,8380,8381,8385,8386,8387,8390,8391,8393,8394,8396,8397,8398,8399,8401,8402,8403,8406,8407,8408,8409,8411,8412,8415,8417,8418,8419,8420,8421,8423,8424,8426,8427,8428,8429,8430,8432,8433,8435,8438,8439,8441,8443,8444,8445,8446,8447,8449,8450,8451,8453,8454,8455,8459,8460,8461,8463,8464,8465,8469,8470,8471,8473,8474,8475,8478,8480,8482,8483,8485,8487,8488,8489,8491,8492,8493,8494,8495,8497,8498,8499,8502,8507,8508,8509,8510,8512,8515,8516,8517,8518,8519,8520,8521,8525,8526,8527,8531,8532,8533,8536,8538,8539,8540,8541,8542,8543,8544,8545,8546,8549,8550,8551,8553,8554,8555,8559,8560,8561,8563,8564,8565,8568,8569,8570,8571,8572,8573,8575,8578,8579,8580,8581,8584,8586,8588,8591,8592,8594,8597,8598,8600,8601,8602,8603,8604,8605,8606,8607,8608,8612,8615,8617,8620,8622,8624,8625,8628,8630,8631,8632,8633,8636,8637,8638,8639,8641,8643,8644,8645,8646,8647,8648,8650,8651,8652,8653,8654,8655,8656,8658,8659,8660,8665,8666,8668,8672,8673,8674,8676,8677,8678,8682,8683,8684,8686,8687,8688,8692,8693,8694,8696,8697,8698,8701,8702,8703,8704,8706,8707,8708,8710,8711,8712,8713,8714,8715,8716,8718,8719,8720,8721,8724,8727,8729,8732,8733,8734,8736,8737,8739,8740,8741,8742,8744,8745,8746,8747,8749,8753,8758,8760,8761,8766,8767,8768,8769,8771,8774,8776,8777,8779,8780,8783,8785,8786,8788,8789,8791,8792,8793,8794,8799,8800,8801,8803,8804,8805,8809,8810,8811,8813,8814,8815,8819,8820,8821,8823,8824,8825,8828,8830,8831,8833,8834,8835,8837,8838,8840,8842,8844,8847,8848,8850,8852,8853,8854,8855,8856,8860,8862,8863,8864,8867,8869,8870,8871,8873,8874,8875,8876,8878,8880,8883,8884,8885,8887,8888,8889,8890,8891,8892,8896,8901,8902,8903,8904,8905,8907,8908,8909,8910,8911,8914,8915,8916,8918,8922,8923,8924,8926,8930,8931,8936,8937,8938,8939,8940,8943,8944,8946,8948,8950,8952,8956,8957,8959,8964,8966,8967,8968,8969,8970,8971,8972,8973,8974,8975,8976,8979,8980,8981,8982,8984,8986,8987,8988,8990,8995,8996,8997,9000,9001,9002,9003,9005,9006,9007,9009,9010,9011,9013,9014,9015,9017,9018,9019,9021,9022,9024,9025,9027,9029,9030,9031,9032,9035,9036,9039,9040,9041,9043,9044,9045,9046,9048,9049,9050,9051,9053,9056,9058,9059,9061,9062,9063,9065,9066,9067,9071,9072,9073,9075,9076,9077,9081,9082,9083,9085,9086,9087,9090,9091,9096,9097,9100,9101,9103,9106,9108,9109,9110,9111,9112,9113,9114,9115,9117,9118,9119,9120,9121,9122,9123,9124,9125,9127,9128,9129,9130,9131,9132,9133,9135,9138,9140,9141,9143,9145,9146,9147,9148,9149,9151,9154,9155,9156,9157,9158,9159,9160,9163,9164,9166,9168,9169,9171,9172,9175,9176,9177,9178,9180,9181,9182,9184,9185,9186,9190,9191,9192,9194,9195,9196,9200,9201,9202,9204,9207,9209,9210,9212,9214,9215,9217,9219,9222,9225,9226,9227,9228,9229,9231,9233,9234,9235,9238,9240,9241,9242,9246,9247,9248,9249,9251,9256,9257,9258,9259,9260,9261,9262,9265,9266,9268,9269,9270,9274,9275,9277,9278,9279,9282,9283,9285,9288,9289,9290,9291,9294,9295,9298,9300,9301,9302,9303,9304,9305,9306,9308,9309,9312,9313,9314,9315,9317,9318,9323,9324,9327,9328,9329,9331,9332,9334,9335,9336,9337,9338,9340,9341,9342,9343,9345,9346,9348,9349,9351,9355,9356,9359,9360,9361,9363,9364,9365,9366,9368,9369,9370,9372,9373,9374,9378,9379,9380,9382,9383,9384,9388,9389,9390,9391,9392,9393,9395,9398,9399,9400,9401,9403,9407,9409,9413,9415,9417,9419,9421,9422,9424,9426,9427,9428,9429,9430,9431,9434,9435,9437,9438,9441,9442,9443,9444,9445,9446,9447,9448,9451,9454,9456,9458,9460,9461,9463,9464,9465,9468,9469,9470,9474,9475,9476,9477,9478,9479,9480,9481,9482,9485,9486,9487,9489,9490,9491,9493,9494,9495,9499,9500,9501,9503,9504,9505,9509,9510,9511,9513,9514,9515,9518,9520,9521,9522,9523,9524,9529,9531,9532,9533,9534,9535,9536,9540,9543,9545,9546,9547,9548,9549,9552,9555,9556,9558,9559,9560,9561,9564,9566,9567,9568,9569,9570,9573,9576,9577,9578,9579,9581,9582,9583,9584,9586,9587,9588,9589,9590,9591,9593,9594,9595,9597,9598,9599,9600,9602,9603,9604,9606,9607,9608,9612,9613,9614,9616,9617,9618,9622,9623,9624,9626,9627,9628,9632,9635,9636,9637,9640,9641,9642,9643,9644,9645,9649,9650,9651,9652,9653,9654,9655,9656,9657,9658,9660,9661,9662,9664,9665,9669,9670,9671,9674,9675,9678,9679,9680,9682,9684,9685,9686,9689,9690,9693,9696,9697,9698,9699,9700,9702,9703,9705,9706,9707,9709,9710,9711,9715,9716,9717,9719,9720,9721,9725,9726,9727,9729,9730,9731,9733,9734,9735,9736,9737,9738,9740,9741,9742,9743,9744,9745,9746,9747,9749,9750,9751,9752,9754,9756,9758,9760,9762,9764,9765,9768,9770,9771,9772,9773,9774,9775,9776,9777,9778,9779,9780,9781,9782,9783,9786,9787,9788,9790,9792,9793,9794,9795,9796,9797,9798,9799,9802,9803,9804,9806,9808,9810,9811,9812,9814,9815,9816,9819,9820,9821,9823,9826,9828,9830,9831,9832,9833,9836,9837,9838,9839,9840,9841,9842,9844,9845,9846,9847,9848,9849,9851,9852,9853,9855,9858,9859,9860,9862,9864,9867,9868,9869,9870,9872,9874,9876,9877,9878,9880,9881,9882,9883,9884,9886,9888,9889,9893,9894,9895,9896,9898,9899,9903,9904,9905,9907,9908,9909,9912,9913,9914,9916,9919,9921,9923,9925,9929,9931,9933,9935,9937,9938,9940,9941,9942,9943,9944,9946,9949,9950,9953,9954,9955,9956,9957,9958,9961,9963,9965,9966,9968,9969,9970,9971,9975,9976,9978,9979,9980,9981,9982,9984,9985,9986,9988,9989,9990,9992,9994,9995,9996,9998,9999],"errors":6317},"selected_test":{"loss":1.732096484375,"accuracy":0.3683,"n":10000,"wrong_indices":[0,1,2,5,8,11,14,15,17,18,21,22,23,26,29,30,31,32,34,35,36,37,38,39,40,41,43,44,45,46,47,50,51,52,53,54,55,57,59,60,63,64,66,68,70,72,74,75,76,77,79,80,81,82,83,86,87,88,89,90,91,92,93,94,96,97,98,100,102,106,107,111,112,114,119,120,122,123,124,127,129,130,131,132,133,135,137,138,140,141,142,143,144,145,147,149,151,152,153,154,155,156,158,161,162,164,165,167,168,171,172,173,174,175,176,178,180,182,186,187,189,190,191,195,196,197,199,200,201,202,203,204,205,207,208,211,213,216,217,218,219,220,221,222,223,224,225,228,229,230,231,233,234,236,237,239,240,241,243,244,245,247,249,251,253,254,255,256,258,259,261,262,263,265,267,270,272,276,278,279,280,282,283,285,286,288,289,290,291,293,298,300,301,302,303,306,307,309,310,312,313,314,316,317,318,319,321,323,326,328,329,330,331,332,333,334,335,337,339,340,341,342,343,345,346,347,348,349,350,351,352,353,354,356,357,358,361,362,363,364,365,366,367,368,369,370,371,375,377,378,381,382,383,384,385,386,387,388,390,392,393,395,396,397,400,402,403,404,405,406,408,409,410,411,412,413,415,416,418,419,421,423,427,430,433,437,438,439,441,442,443,444,445,446,448,449,450,451,452,453,455,456,457,460,461,462,463,464,467,468,469,472,473,476,477,478,479,480,482,483,489,491,492,493,494,498,499,500,502,503,504,505,506,507,508,509,510,511,512,513,514,515,516,517,518,522,523,524,526,528,529,531,534,536,537,539,540,543,547,548,549,550,551,552,554,557,559,566,568,569,570,573,574,576,577,578,579,582,583,584,585,587,588,590,591,594,595,600,602,604,605,607,609,610,612,613,614,615,617,618,619,623,624,625,626,627,628,629,632,633,635,636,637,638,640,643,645,646,647,648,649,650,651,652,653,654,657,658,659,661,663,665,666,667,669,672,674,675,676,677,679,680,682,683,684,686,687,688,689,690,691,692,694,695,696,699,700,702,703,705,707,710,711,715,716,720,724,725,726,727,728,729,730,731,732,734,735,737,738,739,740,741,743,744,745,746,747,749,751,753,754,755,756,760,764,766,767,768,769,771,772,775,777,778,779,780,782,783,785,786,790,791,792,795,796,797,798,799,801,807,808,809,810,811,812,814,815,816,817,818,819,820,822,823,824,825,826,828,829,830,831,832,834,835,836,837,840,841,842,846,847,848,849,850,852,853,855,856,857,858,859,860,861,863,865,866,867,868,869,870,873,875,880,881,883,885,886,887,888,889,890,891,892,894,897,898,900,903,905,907,909,911,912,917,918,919,920,921,922,923,924,925,926,927,929,930,933,934,935,937,938,939,940,941,942,943,944,945,946,947,948,949,950,951,952,955,956,957,958,959,960,963,964,965,967,970,973,974,975,976,977,978,979,980,982,984,985,986,987,988,989,990,991,992,994,995,996,1002,1003,1004,1006,1008,1011,1012,1014,1016,1017,1019,1020,1021,1022,1025,1027,1028,1030,1031,1032,1035,1036,1037,1038,1039,1040,1041,1042,1044,1046,1049,1050,1053,1054,1055,1056,1062,1064,1065,1066,1067,1068,1069,1070,1071,1072,1073,1075,1076,1079,1082,1083,1085,1087,1089,1091,1092,1094,1095,1096,1097,1098,1099,1100,1102,1104,1106,1107,1108,1109,1110,1112,1113,1114,1115,1117,1119,1122,1123,1125,1126,1127,1128,1129,1131,1132,1133,1134,1135,1136,1137,1138,1139,1141,1143,1144,1146,1150,1151,1153,1155,1156,1161,1162,1164,1166,1168,1169,1171,1172,1173,1174,1175,1177,1179,1180,1181,1182,1184,1186,1187,1189,1190,1192,1193,1194,1196,1198,1199,1200,1201,1204,1205,1206,1207,1208,1209,1210,1211,1212,1213,1214,1215,1216,1221,1224,1226,1227,1232,1233,1235,1236,1237,1238,1239,1240,1241,1242,1243,1244,1245,1247,1250,1251,1252,1254,1256,1257,1258,1260,1262,1263,1265,1266,1269,1272,1273,1276,1278,1280,1281,1283,1284,1285,1289,1290,1291,1292,1293,1295,1296,1298,1299,1302,1303,1305,1307,1310,1315,1316,1317,1318,1321,1326,1328,1329,1331,1332,1334,1335,1336,1337,1338,1339,1340,1341,1344,1345,1346,1347,1348,1349,1350,1351,1352,1354,1355,1356,1357,1358,1359,1360,1361,1362,1363,1365,1366,1367,1368,1369,1370,1372,1373,1374,1375,1376,1377,1378,1381,1383,1384,1386,1387,1388,1391,1392,1393,1395,1397,1400,1401,1402,1403,1404,1405,1406,1407,1409,1410,1411,1412,1413,1420,1421,1422,1424,1426,1429,1430,1431,1432,1434,1436,1441,1442,1444,1446,1447,1448,1450,1451,1456,1458,1459,1460,1462,1463,1465,1466,1467,1469,1471,1472,1473,1475,1476,1477,1478,1479,1480,1482,1483,1484,1485,1489,1490,1491,1493,1494,1495,1496,1497,1498,1500,1503,1505,1506,1507,1510,1513,1514,1515,1518,1519,1520,1521,1522,1525,1527,1528,1530,1531,1536,1537,1538,1539,1540,1543,1544,1546,1548,1549,1550,1551,1553,1555,1558,1563,1564,1566,1569,1574,1576,1577,1578,1579,1581,1582,1585,1586,1587,1588,1591,1592,1593,1595,1598,1600,1601,1602,1603,1604,1605,1606,1607,1608,1609,1611,1612,1615,1616,1617,1618,1620,1624,1626,1628,1629,1630,1632,1633,1634,1635,1637,1638,1639,1641,1642,1643,1644,1646,1653,1654,1656,1657,1658,1659,1660,1661,1662,1667,1670,1671,1672,1673,1674,1676,1677,1678,1681,1682,1683,1684,1685,1688,1689,1690,1691,1693,1696,1698,1699,1703,1704,1705,1707,1709,1710,1711,1715,1716,1717,1718,1721,1722,1725,1727,1728,1729,1730,1731,1733,1734,1736,1737,1738,1741,1742,1744,1746,1747,1749,1750,1751,1752,1753,1754,1755,1760,1761,1763,1765,1766,1769,1770,1771,1772,1773,1776,1779,1780,1783,1784,1785,1789,1790,1791,1792,1795,1797,1798,1799,1800,1801,1802,1803,1804,1805,1806,1809,1810,1811,1814,1817,1818,1819,1820,1822,1824,1828,1829,1830,1831,1832,1833,1834,1835,1836,1837,1838,1839,1840,1842,1844,1845,1846,1847,1848,1850,1852,1854,1856,1857,1858,1860,1861,1863,1865,1866,1867,1868,1871,1874,1875,1876,1878,1879,1880,1883,1884,1885,1886,1887,1888,1889,1890,1891,1895,1896,1897,1900,1901,1902,1903,1905,1908,1909,1910,1911,1913,1915,1916,1917,1919,1921,1922,1923,1925,1926,1927,1928,1930,1931,1932,1933,1934,1935,1936,1937,1939,1940,1941,1943,1945,1947,1948,1949,1950,1951,1952,1953,1954,1956,1957,1962,1965,1966,1967,1969,1970,1971,1974,1975,1976,1977,1981,1982,1983,1984,1986,1987,1988,1989,1990,1991,1993,1994,1996,1997,1999,2000,2001,2002,2003,2006,2008,2009,2010,2011,2013,2015,2016,2017,2018,2020,2021,2024,2025,2026,2027,2028,2029,2030,2031,2032,2033,2034,2035,2036,2037,2039,2040,2041,2043,2044,2045,2047,2048,2051,2053,2055,2057,2058,2059,2062,2063,2064,2066,2069,2070,2071,2072,2073,2075,2076,2077,2078,2079,2080,2082,2083,2085,2086,2091,2092,2093,2095,2097,2098,2099,2100,2101,2103,2104,2105,2108,2109,2110,2112,2113,2114,2115,2116,2118,2122,2123,2125,2126,2128,2129,2130,2131,2132,2133,2134,2135,2136,2137,2138,2139,2140,2141,2143,2144,2148,2150,2151,2153,2154,2156,2157,2158,2159,2160,2162,2164,2166,2167,2170,2171,2174,2175,2176,2180,2182,2184,2185,2186,2187,2188,2189,2191,2192,2193,2194,2195,2198,2199,2200,2201,2204,2207,2210,2214,2215,2220,2221,2222,2224,2228,2229,2230,2231,2234,2235,2237,2238,2239,2240,2241,2242,2243,2245,2247,2248,2252,2253,2254,2255,2258,2260,2261,2262,2266,2267,2268,2269,2270,2273,2275,2276,2277,2278,2279,2280,2281,2282,2283,2284,2285,2286,2287,2288,2290,2291,2293,2296,2299,2300,2301,2302,2303,2305,2308,2311,2312,2314,2315,2316,2317,2321,2322,2324,2325,2327,2331,2332,2334,2335,2337,2339,2343,2344,2346,2347,2348,2350,2351,2352,2353,2354,2355,2356,2357,2358,2359,2360,2364,2365,2366,2367,2369,2371,2372,2374,2377,2379,2380,2381,2383,2387,2388,2390,2391,2392,2394,2396,2397,2398,2399,2400,2404,2405,2406,2407,2408,2409,2411,2412,2413,2415,2416,2418,2421,2422,2424,2425,2427,2428,2429,2431,2432,2433,2434,2436,2437,2439,2441,2442,2444,2445,2446,2449,2450,2452,2453,2454,2458,2459,2460,2462,2463,2464,2465,2466,2468,2469,2471,2473,2474,2475,2476,2480,2481,2482,2483,2484,2486,2487,2488,2490,2491,2495,2496,2500,2501,2502,2503,2504,2505,2507,2508,2510,2511,2513,2515,2517,2518,2519,2521,2522,2523,2524,2525,2526,2529,2532,2533,2534,2535,2539,2540,2541,2542,2545,2546,2547,2548,2549,2551,2553,2554,2555,2556,2558,2559,2560,2562,2563,2564,2565,2566,2567,2569,2572,2573,2574,2575,2576,2577,2578,2580,2581,2583,2586,2587,2588,2590,2591,2594,2595,2596,2597,2598,2599,2601,2602,2604,2605,2606,2607,2609,2610,2611,2612,2616,2618,2620,2621,2622,2623,2624,2625,2626,2628,2629,2630,2632,2634,2635,2639,2642,2643,2644,2646,2647,2648,2649,2651,2652,2653,2654,2655,2661,2662,2663,2664,2665,2666,2668,2669,2670,2671,2672,2674,2676,2677,2679,2681,2682,2684,2686,2688,2689,2690,2693,2695,2697,2698,2699,2700,2702,2704,2705,2706,2710,2711,2712,2713,2716,2718,2719,2720,2721,2722,2723,2725,2726,2727,2728,2729,2730,2731,2732,2734,2736,2737,2738,2741,2743,2745,2746,2749,2750,2751,2752,2753,2754,2756,2757,2759,2762,2766,2767,2768,2770,2771,2772,2773,2775,2776,2780,2782,2784,2785,2786,2787,2788,2789,2790,2791,2795,2796,2797,2798,2799,2801,2802,2803,2805,2807,2808,2810,2813,2814,2815,2816,2820,2822,2823,2825,2826,2827,2829,2830,2831,2832,2833,2837,2838,2839,2840,2841,2843,2844,2846,2848,2850,2851,2853,2855,2860,2861,2863,2864,2865,2866,2867,2868,2871,2874,2876,2877,2878,2880,2881,2884,2885,2887,2888,2890,2891,2893,2896,2900,2902,2903,2904,2906,2907,2909,2910,2912,2913,2914,2915,2918,2919,2920,2921,2922,2924,2925,2927,2928,2930,2931,2933,2940,2943,2944,2945,2946,2947,2948,2950,2951,2952,2953,2955,2956,2957,2959,2961,2965,2967,2968,2969,2970,2971,2974,2976,2977,2978,2980,2981,2982,2984,2985,2986,2987,2989,2991,2992,2993,2994,2995,2997,3000,3003,3004,3007,3009,3010,3011,3014,3015,3018,3019,3021,3022,3026,3027,3028,3030,3031,3033,3035,3036,3037,3038,3039,3040,3045,3047,3048,3049,3050,3051,3053,3054,3055,3057,3058,3059,3060,3061,3063,3067,3070,3071,3073,3074,3078,3079,3080,3081,3082,3083,3084,3085,3088,3089,3092,3093,3094,3095,3097,3098,3099,3100,3101,3102,3103,3104,3105,3106,3107,3108,3109,3110,3111,3113,3114,3115,3116,3117,3118,3119,3120,3121,3122,3124,3125,3126,3127,3128,3129,3130,3131,3132,3134,3135,3136,3138,3141,3142,3143,3144,3145,3146,3148,3150,3151,3152,3156,3157,3159,3161,3162,3164,3166,3167,3171,3172,3173,3175,3176,3177,3180,3181,3182,3183,3184,3187,3189,3192,3193,3195,3196,3199,3201,3202,3203,3206,3207,3208,3209,3211,3212,3213,3214,3217,3218,3220,3221,3222,3223,3225,3227,3229,3230,3231,3236,3237,3238,3239,3240,3243,3244,3248,3250,3252,3253,3254,3255,3256,3257,3258,3259,3260,3261,3262,3263,3264,3267,3268,3269,3270,3272,3273,3274,3275,3276,3277,3280,3281,3283,3284,3285,3288,3290,3292,3293,3294,3295,3296,3299,3300,3301,3302,3303,3304,3305,3307,3308,3309,3311,3312,3314,3316,3318,3320,3321,3326,3327,3328,3329,3330,3331,3333,3334,3335,3336,3337,3339,3342,3344,3345,3349,3350,3351,3352,3353,3354,3355,3356,3360,3361,3362,3363,3365,3367,3372,3373,3375,3376,3378,3379,3380,3381,3382,3383,3384,3386,3390,3391,3393,3395,3396,3398,3399,3400,3402,3403,3407,3408,3409,3410,3414,3415,3416,3418,3419,3420,3421,3422,3423,3424,3425,3427,3428,3430,3432,3433,3434,3435,3436,3438,3441,3442,3443,3447,3448,3449,3450,3451,3452,3453,3454,3455,3456,3457,3461,3462,3464,3468,3469,3470,3471,3474,3475,3476,3480,3482,3484,3486,3487,3488,3489,3490,3493,3494,3498,3503,3505,3506,3508,3510,3511,3513,3514,3515,3518,3520,3522,3524,3525,3527,3528,3531,3532,3535,3537,3539,3543,3545,3546,3547,3548,3549,3550,3552,3554,3556,3557,3558,3560,3562,3564,3565,3566,3569,3570,3572,3573,3575,3577,3578,3579,3580,3582,3585,3586,3589,3590,3591,3593,3594,3595,3597,3598,3599,3600,3601,3602,3603,3604,3605,3606,3609,3611,3614,3616,3617,3619,3620,3622,3623,3625,3628,3630,3631,3632,3636,3637,3638,3639,3641,3642,3643,3645,3647,3648,3649,3651,3652,3654,3655,3656,3657,3658,3659,3661,3663,3664,3665,3667,3668,3669,3670,3671,3673,3675,3678,3679,3681,3682,3683,3686,3687,3688,3689,3690,3691,3692,3694,3696,3697,3699,3701,3702,3703,3712,3713,3714,3715,3717,3718,3719,3720,3721,3725,3729,3730,3731,3733,3736,3738,3739,3740,3741,3742,3743,3744,3745,3746,3747,3748,3749,3750,3751,3753,3754,3756,3757,3761,3762,3763,3765,3766,3767,3769,3772,3773,3775,3776,3777,3778,3779,3780,3784,3785,3786,3787,3788,3789,3795,3796,3797,3799,3800,3801,3802,3806,3808,3809,3810,3811,3812,3814,3815,3817,3821,3822,3823,3824,3825,3826,3827,3832,3834,3835,3836,3837,3838,3839,3843,3844,3846,3848,3851,3852,3853,3854,3855,3858,3860,3862,3863,3864,3866,3869,3876,3877,3878,3886,3890,3893,3894,3896,3897,3898,3899,3900,3901,3902,3904,3906,3907,3908,3909,3910,3912,3913,3914,3916,3917,3918,3919,3920,3921,3922,3923,3925,3926,3928,3929,3930,3931,3932,3933,3935,3936,3937,3939,3941,3943,3944,3945,3946,3947,3948,3952,3953,3955,3957,3958,3960,3961,3962,3963,3965,3968,3969,3972,3973,3974,3975,3976,3977,3978,3979,3983,3985,3986,3990,3991,3993,3994,3995,3997,4002,4003,4004,4005,4006,4007,4008,4010,4013,4014,4017,4018,4019,4021,4022,4025,4026,4027,4028,4031,4032,4035,4036,4037,4038,4039,4044,4045,4049,4050,4051,4052,4053,4054,4055,4056,4057,4059,4061,4063,4064,4066,4067,4069,4072,4073,4074,4075,4076,4077,4078,4080,4081,4083,4084,4085,4087,4089,4093,4094,4097,4098,4099,4100,4102,4103,4104,4105,4106,4107,4108,4109,4110,4113,4114,4115,4118,4119,4120,4125,4127,4128,4130,4131,4132,4133,4135,4138,4139,4142,4144,4147,4148,4149,4151,4152,4153,4154,4156,4160,4161,4162,4164,4166,4167,4168,4169,4170,4171,4173,4175,4176,4177,4178,4179,4180,4181,4185,4186,4187,4189,4190,4191,4193,4195,4196,4199,4200,4201,4202,4203,4204,4205,4206,4209,4211,4212,4214,4215,4216,4219,4220,4222,4224,4225,4226,4228,4232,4233,4234,4236,4238,4239,4242,4243,4244,4247,4248,4249,4250,4252,4254,4255,4256,4260,4261,4262,4263,4264,4265,4267,4270,4271,4273,4274,4275,4276,4277,4279,4281,4285,4288,4289,4292,4295,4296,4297,4300,4302,4303,4304,4306,4307,4308,4310,4311,4312,4315,4317,4318,4322,4323,4326,4328,4330,4331,4334,4335,4336,4337,4338,4339,4340,4341,4342,4345,4346,4347,4349,4350,4352,4354,4355,4356,4357,4359,4360,4364,4366,4367,4368,4369,4374,4378,4381,4384,4385,4386,4387,4388,4391,4393,4394,4395,4397,4400,4401,4402,4406,4409,4412,4413,4415,4416,4418,4420,4422,4423,4427,4428,4430,4433,4435,4437,4438,4439,4440,4441,4442,4443,4445,4446,4449,4450,4451,4453,4456,4459,4460,4461,4463,4464,4466,4467,4469,4471,4472,4474,4476,4477,4482,4484,4485,4487,4488,4491,4492,4493,4494,4497,4498,4499,4501,4503,4504,4506,4507,4509,4510,4512,4516,4517,4520,4521,4522,4523,4524,4525,4526,4528,4529,4530,4532,4533,4535,4536,4537,4538,4539,4540,4541,4546,4547,4548,4549,4551,4552,4557,4559,4561,4562,4563,4564,4565,4566,4568,4569,4571,4573,4574,4575,4577,4578,4579,4580,4581,4582,4583,4586,4587,4588,4589,4591,4593,4594,4595,4596,4597,4599,4600,4601,4602,4603,4605,4606,4607,4612,4613,4615,4618,4619,4620,4621,4622,4623,4624,4625,4627,4630,4632,4635,4636,4637,4638,4639,4640,4643,4645,4646,4647,4649,4651,4653,4654,4655,4656,4657,4658,4660,4664,4666,4668,4669,4670,4674,4676,4677,4678,4680,4684,4685,4686,4687,4688,4689,4690,4691,4693,4694,4696,4697,4698,4699,4702,4703,4704,4705,4708,4709,4710,4711,4712,4713,4714,4715,4716,4717,4719,4721,4722,4723,4725,4727,4728,4729,4730,4732,4733,4734,4735,4736,4740,4742,4745,4746,4747,4749,4751,4754,4755,4758,4759,4760,4762,4763,4764,4765,4766,4767,4770,4771,4773,4774,4775,4778,4779,4781,4782,4784,4785,4787,4790,4793,4794,4796,4798,4800,4801,4802,4805,4806,4807,4808,4809,4810,4811,4812,4814,4815,4816,4818,4821,4823,4824,4828,4830,4831,4832,4833,4836,4837,4838,4841,4844,4847,4848,4851,4853,4854,4855,4858,4859,4861,4863,4864,4865,4867,4868,4869,4870,4871,4872,4873,4874,4875,4876,4877,4878,4880,4881,4882,4883,4885,4886,4888,4889,4890,4892,4894,4896,4897,4898,4899,4900,4902,4903,4904,4905,4907,4908,4909,4910,4913,4914,4915,4917,4918,4920,4921,4924,4925,4926,4927,4928,4930,4931,4932,4933,4934,4936,4938,4939,4940,4941,4942,4943,4944,4949,4950,4951,4952,4953,4954,4955,4956,4961,4962,4964,4965,4966,4969,4970,4971,4972,4973,4977,4978,4979,4980,4981,4983,4984,4985,4990,4991,4993,4994,4995,4996,4997,5000,5001,5005,5007,5010,5012,5013,5014,5018,5019,5020,5021,5024,5025,5028,5030,5034,5036,5037,5038,5040,5044,5045,5046,5048,5052,5053,5054,5056,5057,5058,5062,5064,5066,5067,5068,5071,5072,5074,5077,5078,5081,5083,5085,5086,5088,5089,5090,5091,5092,5093,5094,5095,5097,5098,5099,5102,5105,5107,5110,5111,5112,5113,5114,5115,5116,5117,5119,5120,5121,5122,5125,5127,5128,5131,5132,5134,5135,5136,5140,5143,5145,5146,5148,5149,5150,5152,5153,5154,5156,5157,5158,5160,5161,5162,5166,5167,5168,5170,5171,5172,5174,5176,5177,5179,5180,5181,5183,5185,5186,5187,5189,5190,5192,5193,5194,5196,5197,5199,5201,5203,5205,5206,5207,5208,5210,5211,5212,5213,5214,5215,5216,5217,5218,5221,5222,5223,5224,5225,5227,5228,5229,5230,5232,5234,5235,5237,5238,5240,5245,5246,5248,5250,5252,5254,5258,5261,5263,5264,5265,5266,5267,5271,5272,5273,5275,5276,5277,5281,5282,5283,5285,5286,5287,5291,5292,5293,5295,5296,5297,5301,5302,5303,5304,5307,5308,5309,5310,5313,5314,5316,5317,5318,5323,5324,5325,5326,5327,5328,5329,5330,5331,5332,5334,5336,5338,5339,5340,5341,5346,5347,5350,5351,5354,5356,5357,5358,5359,5361,5363,5364,5365,5366,5367,5370,5371,5372,5374,5378,5381,5382,5383,5384,5385,5389,5390,5391,5392,5396,5397,5399,5400,5401,5402,5406,5407,5408,5410,5411,5412,5416,5417,5418,5420,5421,5422,5425,5427,5431,5432,5436,5437,5441,5442,5445,5446,5449,5451,5453,5454,5455,5457,5458,5460,5461,5465,5466,5467,5468,5469,5471,5472,5473,5475,5477,5479,5480,5481,5482,5484,5485,5486,5487,5488,5490,5492,5494,5495,5496,5497,5498,5499,5501,5502,5504,5506,5507,5508,5510,5511,5512,5514,5515,5516,5518,5520,5521,5524,5526,5528,5529,5532,5533,5534,5535,5536,5538,5539,5540,5541,5542,5544,5545,5549,5550,5551,5552,5553,5555,5557,5558,5560,5562,5563,5566,5568,5570,5571,5572,5573,5574,5576,5579,5581,5583,5585,5588,5590,5591,5594,5595,5596,5598,5599,5600,5604,5605,5606,5608,5609,5610,5614,5615,5616,5618,5619,5620,5623,5624,5625,5626,5628,5629,5630,5632,5633,5634,5635,5636,5637,5638,5640,5641,5642,5643,5646,5649,5651,5654,5655,5657,5658,5660,5661,5662,5663,5665,5666,5667,5668,5670,5674,5677,5679,5681,5682,5687,5688,5689,5690,5691,5692,5693,5694,5697,5699,5700,5702,5703,5706,5708,5709,5711,5712,5714,5715,5716,5717,5718,5722,5723,5724,5726,5727,5728,5732,5733,5734,5735,5736,5738,5739,5740,5742,5743,5745,5746,5747,5748,5751,5752,5755,5759,5760,5761,5762,5763,5764,5766,5767,5768,5769,5770,5772,5773,5776,5779,5780,5783,5785,5786,5788,5789,5793,5794,5795,5796,5798,5799,5801,5802,5804,5807,5808,5809,5810,5811,5814,5815,5819,5820,5821,5823,5824,5826,5829,5831,5833,5834,5835,5839,5840,5841,5843,5844,5845,5848,5849,5850,5851,5852,5853,5854,5858,5859,5860,5861,5862,5863,5866,5867,5872,5873,5874,5877,5878,5879,5880,5882,5883,5884,5885,5886,5887,5888,5889,5891,5892,5893,5895,5896,5898,5901,5902,5903,5904,5906,5907,5909,5910,5912,5913,5914,5915,5916,5917,5918,5920,5921,5922,5924,5925,5928,5931,5933,5934,5935,5936,5937,5938,5939,5943,5944,5945,5947,5948,5949,5953,5954,5955,5957,5958,5959,5963,5964,5966,5970,5972,5973,5978,5981,5982,5983,5984,5985,5988,5989,5991,5992,5994,5997,5998,5999,6002,6005,6006,6007,6008,6009,6010,6011,6012,6014,6017,6020,6023,6026,6027,6028,6029,6030,6031,6033,6034,6035,6036,6037,6038,6041,6042,6043,6044,6045,6046,6048,6050,6051,6052,6053,6054,6057,6058,6059,6060,6061,6063,6064,6065,6067,6068,6069,6071,6073,6074,6075,6077,6078,6079,6081,6083,6084,6085,6087,6088,6089,6091,6092,6093,6094,6095,6096,6098,6101,6103,6104,6105,6106,6107,6108,6109,6110,6111,6112,6113,6115,6116,6118,6119,6120,6121,6122,6123,6124,6125,6126,6128,6130,6132,6134,6135,6136,6139,6141,6142,6146,6147,6148,6149,6151,6155,6156,6157,6158,6159,6160,6162,6164,6165,6166,6167,6168,6170,6171,6172,6173,6174,6177,6179,6180,6182,6183,6184,6186,6187,6188,6192,6193,6194,6196,6197,6198,6202,6203,6204,6206,6207,6208,6213,6215,6216,6217,6218,6222,6223,6224,6225,6226,6227,6229,6231,6232,6233,6234,6236,6237,6239,6240,6242,6243,6244,6246,6252,6253,6254,6255,6257,6258,6260,6261,6263,6266,6267,6269,6270,6272,6274,6276,6277,6278,6279,6281,6282,6283,6285,6289,6290,6291,6292,6294,6298,6299,6301,6305,6306,6307,6308,6310,6311,6312,6314,6315,6316,6320,6321,6322,6324,6325,6326,6329,6330,6331,6333,6334,6335,6337,6338,6339,6340,6341,6345,6346,6349,6350,6352,6353,6354,6355,6356,6357,6360,6361,6363,6364,6365,6366,6368,6370,6371,6374,6375,6377,6379,6380,6381,6382,6384,6385,6386,6387,6388,6389,6390,6391,6392,6397,6399,6402,6405,6406,6407,6408,6412,6413,6414,6415,6418,6419,6421,6423,6425,6430,6431,6432,6434,6438,6439,6440,6441,6445,6446,6447,6449,6452,6453,6455,6456,6458,6459,6462,6463,6465,6466,6468,6469,6471,6472,6476,6479,6480,6481,6482,6483,6484,6486,6490,6491,6494,6497,6498,6499,6500,6501,6502,6503,6504,6505,6506,6509,6511,6513,6515,6517,6518,6519,6521,6522,6525,6527,6528,6530,6531,6533,6534,6535,6537,6538,6539,6540,6541,6542,6544,6545,6548,6549,6550,6551,6554,6556,6558,6561,6562,6563,6564,6566,6568,6569,6570,6571,6572,6573,6574,6575,6576,6577,6581,6584,6586,6589,6591,6593,6594,6596,6598,6599,6600,6601,6604,6605,6606,6607,6609,6611,6613,6614,6615,6616,6618,6619,6620,6622,6623,6624,6625,6628,6630,6634,6635,6636,6638,6639,6640,6644,6645,6646,6648,6650,6652,6653,6661,6662,6663,6664,6665,6666,6667,6668,6669,6670,6673,6674,6675,6676,6677,6678,6679,6680,6681,6683,6684,6685,6688,6690,6691,6693,6694,6697,6698,6702,6703,6704,6706,6707,6708,6712,6713,6714,6716,6717,6720,6721,6722,6724,6726,6727,6728,6729,6730,6731,6732,6733,6736,6739,6741,6743,6744,6745,6746,6748,6749,6751,6754,6756,6757,6758,6762,6763,6764,6765,6767,6768,6771,6773,6774,6775,6777,6782,6783,6785,6788,6789,6790,6791,6792,6794,6796,6797,6799,6800,6801,6803,6804,6805,6809,6810,6811,6813,6814,6815,6817,6819,6820,6821,6823,6824,6825,6827,6828,6829,6830,6831,6832,6836,6837,6840,6842,6844,6845,6846,6847,6848,6849,6852,6853,6855,6856,6857,6858,6860,6862,6863,6866,6868,6869,6871,6872,6873,6874,6875,6876,6878,6879,6880,6881,6882,6883,6884,6885,6886,6891,6893,6896,6899,6900,6901,6902,6906,6907,6908,6909,6912,6913,6917,6918,6920,6922,6926,6928,6929,6930,6932,6933,6934,6938,6939,6940,6942,6943,6944,6948,6949,6950,6952,6953,6954,6957,6960,6961,6963,6964,6965,6966,6969,6973,6975,6976,6977,6978,6981,6982,6985,6986,6987,6989,6991,6992,6993,6994,7000,7001,7002,7003,7005,7006,7007,7010,7012,7013,7014,7015,7017,7018,7019,7020,7021,7022,7023,7024,7026,7028,7029,7030,7032,7036,7038,7039,7040,7041,7042,7048,7050,7051,7053,7054,7055,7057,7058,7059,7063,7064,7065,7067,7068,7069,7073,7074,7075,7077,7078,7079,7082,7087,7088,7090,7091,7093,7097,7098,7100,7103,7104,7105,7108,7110,7111,7113,7115,7116,7117,7119,7120,7121,7122,7123,7124,7130,7131,7134,7135,7138,7140,7141,7142,7144,7145,7147,7149,7150,7151,7152,7154,7155,7156,7157,7158,7159,7160,7163,7165,7166,7167,7170,7171,7172,7173,7176,7178,7179,7180,7183,7184,7185,7187,7188,7189,7191,7192,7193,7195,7196,7197,7204,7205,7207,7209,7210,7211,7212,7213,7214,7215,7217,7219,7222,7223,7226,7228,7229,7230,7232,7233,7235,7237,7238,7239,7240,7241,7245,7247,7248,7249,7250,7252,7253,7257,7258,7260,7262,7264,7266,7267,7268,7269,7270,7271,7272,7274,7275,7276,7280,7281,7282,7284,7285,7286,7290,7291,7292,7294,7295,7296,7299,7300,7303,7304,7305,7306,7307,7308,7310,7311,7312,7314,7315,7319,7320,7321,7323,7324,7325,7326,7327,7328,7329,7331,7333,7334,7335,7337,7338,7340,7343,7344,7345,7346,7348,7349,7350,7351,7352,7353,7355,7356,7358,7359,7362,7364,7365,7372,7373,7374,7375,7381,7386,7387,7388,7389,7390,7392,7393,7394,7395,7396,7397,7398,7399,7400,7401,7403,7404,7405,7406,7407,7409,7411,7412,7414,7415,7416,7418,7419,7420,7422,7424,7427,7430,7431,7432,7433,7434,7435,7436,7437,7438,7439,7441,7442,7443,7445,7447,7448,7451,7453,7454,7457,7458,7460,7461,7463,7466,7467,7468,7469,7470,7472,7474,7475,7476,7477,7478,7479,7480,7482,7483,7484,7486,7490,7492,7493,7497,7498,7501,7503,7504,7507,7508,7509,7511,7512,7513,7517,7518,7519,7521,7522,7523,7527,7528,7529,7531,7532,7533,7538,7539,7540,7541,7542,7543,7544,7546,7547,7548,7549,7551,7554,7556,7559,7561,7563,7564,7565,7567,7568,7570,7572,7573,7575,7576,7577,7578,7581,7582,7583,7584,7585,7587,7590,7591,7595,7596,7598,7600,7602,7604,7605,7606,7608,7609,7610,7612,7613,7614,7618,7619,7620,7622,7626,7627,7628,7630,7631,7632,7635,7636,7637,7638,7639,7643,7644,7645,7647,7648,7649,7650,7654,7656,7658,7659,7661,7665,7667,7668,7670,7672,7673,7674,7675,7676,7677,7678,7679,7681,7683,7684,7685,7686,7687,7690,7692,7695,7698,7701,7705,7708,7709,7710,7711,7712,7714,7715,7716,7717,7719,7721,7722,7724,7725,7728,7729,7730,7732,7733,7734,7738,7739,7740,7742,7743,7744,7748,7749,7750,7752,7753,7754,7757,7758,7760,7761,7762,7763,7766,7768,7771,7772,7773,7777,7778,7779,7781,7783,7784,7785,7787,7789,7790,7792,7793,7794,7796,7797,7798,7800,7801,7802,7804,7806,7808,7809,7811,7812,7815,7816,7819,7821,7822,7824,7825,7826,7829,7831,7832,7839,7840,7841,7842,7843,7844,7847,7848,7849,7850,7851,7852,7856,7857,7858,7859,7860,7861,7865,7869,7870,7875,7876,7877,7880,7881,7886,7888,7890,7891,7893,7894,7896,7897,7899,7900,7902,7903,7904,7905,7906,7908,7909,7911,7912,7914,7915,7916,7917,7918,7920,7921,7922,7924,7925,7927,7928,7929,7930,7932,7934,7935,7936,7938,7939,7940,7944,7945,7946,7948,7949,7950,7954,7955,7956,7958,7959,7960,7965,7966,7968,7969,7970,7973,7974,7975,7977,7978,7980,7981,7983,7985,7986,7988,7990,7992,7993,7994,7995,7996,7997,7998,8003,8004,8005,8008,8010,8013,8014,8018,8019,8020,8022,8024,8025,8026,8030,8031,8032,8034,8035,8036,8038,8040,8041,8042,8043,8045,8047,8048,8049,8050,8052,8058,8059,8060,8061,8062,8063,8064,8068,8069,8070,8072,8073,8074,8078,8079,8080,8081,8082,8083,8086,8087,8088,8089,8090,8091,8094,8095,8096,8099,8100,8102,8103,8104,8106,8108,8110,8112,8113,8115,8116,8118,8119,8120,8122,8123,8124,8128,8129,8130,8132,8133,8134,8138,8139,8140,8142,8143,8144,8148,8149,8151,8153,8154,8156,8158,8159,8160,8161,8162,8164,8165,8166,8167,8168,8169,8170,8171,8173,8174,8175,8177,8180,8185,8186,8187,8188,8190,8191,8192,8196,8197,8198,8200,8201,8202,8203,8206,8208,8211,8214,8215,8218,8219,8224,8225,8226,8229,8231,8232,8233,8234,8237,8238,8239,8240,8244,8245,8246,8248,8252,8253,8254,8256,8257,8261,8262,8263,8265,8268,8270,8271,8272,8275,8277,8279,8281,8282,8284,8285,8286,8287,8289,8290,8291,8292,8293,8295,8296,8299,8302,8303,8304,8305,8306,8308,8310,8311,8313,8315,8316,8318,8320,8321,8323,8324,8326,8327,8328,8331,8333,8336,8337,8339,8340,8341,8344,8345,8346,8348,8349,8350,8352,8353,8354,8356,8360,8361,8362,8364,8365,8366,8367,8368,8370,8375,8376,8377,8379,8380,8381,8385,8386,8387,8390,8391,8393,8394,8396,8397,8398,8399,8401,8402,8403,8406,8407,8408,8409,8411,8412,8415,8417,8418,8419,8420,8421,8423,8424,8426,8427,8428,8429,8430,8432,8433,8435,8438,8439,8441,8443,8444,8445,8446,8447,8449,8450,8451,8453,8454,8455,8459,8460,8461,8463,8464,8465,8469,8470,8471,8473,8474,8475,8478,8480,8482,8483,8485,8487,8488,8489,8491,8492,8493,8494,8495,8497,8498,8499,8502,8507,8508,8509,8510,8512,8515,8516,8517,8518,8519,8520,8521,8525,8526,8527,8531,8532,8533,8536,8538,8539,8540,8541,8542,8543,8544,8545,8546,8549,8550,8551,8553,8554,8555,8559,8560,8561,8563,8564,8565,8568,8569,8570,8571,8572,8573,8575,8578,8579,8580,8581,8584,8586,8588,8591,8592,8594,8597,8598,8600,8601,8602,8603,8604,8605,8606,8607,8608,8612,8615,8617,8620,8622,8624,8625,8628,8630,8631,8632,8633,8636,8637,8638,8639,8641,8643,8644,8645,8646,8647,8648,8650,8651,8652,8653,8654,8655,8656,8658,8659,8660,8665,8666,8668,8672,8673,8674,8676,8677,8678,8682,8683,8684,8686,8687,8688,8692,8693,8694,8696,8697,8698,8701,8702,8703,8704,8706,8707,8708,8710,8711,8712,8713,8714,8715,8716,8718,8719,8720,8721,8724,8727,8729,8732,8733,8734,8736,8737,8739,8740,8741,8742,8744,8745,8746,8747,8749,8753,8758,8760,8761,8766,8767,8768,8769,8771,8774,8776,8777,8779,8780,8783,8785,8786,8788,8789,8791,8792,8793,8794,8799,8800,8801,8803,8804,8805,8809,8810,8811,8813,8814,8815,8819,8820,8821,8823,8824,8825,8828,8830,8831,8833,8834,8835,8837,8838,8840,8842,8844,8847,8848,8850,8852,8853,8854,8855,8856,8860,8862,8863,8864,8867,8869,8870,8871,8873,8874,8875,8876,8878,8880,8883,8884,8885,8887,8888,8889,8890,8891,8892,8896,8901,8902,8903,8904,8905,8907,8908,8909,8910,8911,8914,8915,8916,8918,8922,8923,8924,8926,8930,8931,8936,8937,8938,8939,8940,8943,8944,8946,8948,8950,8952,8956,8957,8959,8964,8966,8967,8968,8969,8970,8971,8972,8973,8974,8975,8976,8979,8980,8981,8982,8984,8986,8987,8988,8990,8995,8996,8997,9000,9001,9002,9003,9005,9006,9007,9009,9010,9011,9013,9014,9015,9017,9018,9019,9021,9022,9024,9025,9027,9029,9030,9031,9032,9035,9036,9039,9040,9041,9043,9044,9045,9046,9048,9049,9050,9051,9053,9056,9058,9059,9061,9062,9063,9065,9066,9067,9071,9072,9073,9075,9076,9077,9081,9082,9083,9085,9086,9087,9090,9091,9096,9097,9100,9101,9103,9106,9108,9109,9110,9111,9112,9113,9114,9115,9117,9118,9119,9120,9121,9122,9123,9124,9125,9127,9128,9129,9130,9131,9132,9133,9135,9138,9140,9141,9143,9145,9146,9147,9148,9149,9151,9154,9155,9156,9157,9158,9159,9160,9163,9164,9166,9168,9169,9171,9172,9175,9176,9177,9178,9180,9181,9182,9184,9185,9186,9190,9191,9192,9194,9195,9196,9200,9201,9202,9204,9207,9209,9210,9212,9214,9215,9217,9219,9222,9225,9226,9227,9228,9229,9231,9233,9234,9235,9238,9240,9241,9242,9246,9247,9248,9249,9251,9256,9257,9258,9259,9260,9261,9262,9265,9266,9268,9269,9270,9274,9275,9277,9278,9279,9282,9283,9285,9288,9289,9290,9291,9294,9295,9298,9300,9301,9302,9303,9304,9305,9306,9308,9309,9312,9313,9314,9315,9317,9318,9323,9324,9327,9328,9329,9331,9332,9334,9335,9336,9337,9338,9340,9341,9342,9343,9345,9346,9348,9349,9351,9355,9356,9359,9360,9361,9363,9364,9365,9366,9368,9369,9370,9372,9373,9374,9378,9379,9380,9382,9383,9384,9388,9389,9390,9391,9392,9393,9395,9398,9399,9400,9401,9403,9407,9409,9413,9415,9417,9419,9421,9422,9424,9426,9427,9428,9429,9430,9431,9434,9435,9437,9438,9441,9442,9443,9444,9445,9446,9447,9448,9451,9454,9456,9458,9460,9461,9463,9464,9465,9468,9469,9470,9474,9475,9476,9477,9478,9479,9480,9481,9482,9485,9486,9487,9489,9490,9491,9493,9494,9495,9499,9500,9501,9503,9504,9505,9509,9510,9511,9513,9514,9515,9518,9520,9521,9522,9523,9524,9529,9531,9532,9533,9534,9535,9536,9540,9543,9545,9546,9547,9548,9549,9552,9555,9556,9558,9559,9560,9561,9564,9566,9567,9568,9569,9570,9573,9576,9577,9578,9579,9581,9582,9583,9584,9586,9587,9588,9589,9590,9591,9593,9594,9595,9597,9598,9599,9600,9602,9603,9604,9606,9607,9608,9612,9613,9614,9616,9617,9618,9622,9623,9624,9626,9627,9628,9632,9635,9636,9637,9640,9641,9642,9643,9644,9645,9649,9650,9651,9652,9653,9654,9655,9656,9657,9658,9660,9661,9662,9664,9665,9669,9670,9671,9674,9675,9678,9679,9680,9682,9684,9685,9686,9689,9690,9693,9696,9697,9698,9699,9700,9702,9703,9705,9706,9707,9709,9710,9711,9715,9716,9717,9719,9720,9721,9725,9726,9727,9729,9730,9731,9733,9734,9735,9736,9737,9738,9740,9741,9742,9743,9744,9745,9746,9747,9749,9750,9751,9752,9754,9756,9758,9760,9762,9764,9765,9768,9770,9771,9772,9773,9774,9775,9776,9777,9778,9779,9780,9781,9782,9783,9786,9787,9788,9790,9792,9793,9794,9795,9796,9797,9798,9799,9802,9803,9804,9806,9808,9810,9811,9812,9814,9815,9816,9819,9820,9821,9823,9826,9828,9830,9831,9832,9833,9836,9837,9838,9839,9840,9841,9842,9844,9845,9846,9847,9848,9849,9851,9852,9853,9855,9858,9859,9860,9862,9864,9867,9868,9869,9870,9872,9874,9876,9877,9878,9880,9881,9882,9883,9884,9886,9888,9889,9893,9894,9895,9896,9898,9899,9903,9904,9905,9907,9908,9909,9912,9913,9914,9916,9919,9921,9923,9925,9929,9931,9933,9935,9937,9938,9940,9941,9942,9943,9944,9946,9949,9950,9953,9954,9955,9956,9957,9958,9961,9963,9965,9966,9968,9969,9970,9971,9975,9976,9978,9979,9980,9981,9982,9984,9985,9986,9988,9989,9990,9992,9994,9995,9996,9998,9999],"errors":6317}},{"run_id":"graph-fidelity-source-residual-s103","spec":{"run_id":"graph-fidelity-source-residual-s103","stage":"evaluate","cohort":"fidelity","variant":"source-residual","recipe":"residual","pmax":0.0,"input_scale":1.0,"output_relu":true,"lr":0.001,"momentum":0.9,"shrinkage":2e-05,"seed":103,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"timeout_seconds":180,"gpu":"A100","precision":"fp32"},"history":[{"epoch":1,"stochastic_training_loss":4.435299396514893,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":0.7448473610000121,"epoch_training_seconds":0.7448473610000121,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":5,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":3.6303253430000098,"epoch_training_seconds":0.7213114609999991,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":10,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":7.237777601999994,"epoch_training_seconds":0.7214123669999992,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":15,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":10.846650691999997,"epoch_training_seconds":0.7214935130000129,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":20,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":14.45465844100002,"epoch_training_seconds":0.7214388940000163,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":25,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":18.063142580000005,"epoch_training_seconds":0.7213428819999876,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":30,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":21.672826223000015,"epoch_training_seconds":0.7217027519999988,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":35,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":25.29056320799998,"epoch_training_seconds":0.7241996079999922,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":40,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":28.898581066999924,"epoch_training_seconds":0.7214511849999781,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":45,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":32.51999141099992,"epoch_training_seconds":0.7214673940000011,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":50,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":36.1273685459999,"epoch_training_seconds":0.7212298209999801,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":55,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":39.73482587299998,"epoch_training_seconds":0.7214142060000199,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":60,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":43.342302277000044,"epoch_training_seconds":0.7214945860000057,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":65,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":46.95173511400009,"epoch_training_seconds":0.7221293580000179,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":70,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":50.56081048900012,"epoch_training_seconds":0.721800667000025,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":75,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":54.16928765900019,"epoch_training_seconds":0.7215404940000099,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":80,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":57.777043687000116,"epoch_training_seconds":0.7214508089999754,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":85,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":61.38460467200008,"epoch_training_seconds":0.7213890040000024,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":90,"stochastic_training_loss":1.6817184686660767,"dense_train_probe":{"loss":1.673444140625,"accuracy":0.3834,"n":10000},"validation":{"loss":1.68748203125,"accuracy":0.3847,"n":10000},"training_seconds":64.99353519200002,"epoch_training_seconds":0.7220253890000095,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.9671387076377869,"validation_probe_prediction_counts":[1387,0,228,0,0,0,205,0,0,228]},{"epoch":95,"stochastic_training_loss":1.6502306461334229,"dense_train_probe":{"loss":1.6525087890625,"accuracy":0.3862,"n":10000},"validation":{"loss":1.679220703125,"accuracy":0.3874,"n":10000},"training_seconds":68.60208561300004,"epoch_training_seconds":0.7215336099999945,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.967968761920929,"validation_probe_prediction_counts":[1411,0,236,0,0,0,195,0,0,206]},{"epoch":100,"stochastic_training_loss":1.63728928565979,"dense_train_probe":{"loss":1.6362998046875,"accuracy":0.3897,"n":10000},"validation":{"loss":1.6681251953125,"accuracy":0.391,"n":10000},"training_seconds":72.2122515320001,"epoch_training_seconds":0.722299119000013,"drop_probabilities":[0.0,0.0,0.0,0.0],"zero_logit_fraction":0.9681152701377869,"validation_probe_prediction_counts":[1418,0,221,0,0,0,198,0,0,211]}],"best_epoch":100,"best_validation_loss":1.6681251953125,"training_seconds":72.2122515320001,"total_run_seconds":73.50128555500001,"hardware":{"device":"cuda:0","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"316aa46c9e0a65fa375b579be0871a16f447d396fe64f85e2063ee6ef8c8dd5d","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[0,0,0,0],"final_train":{"loss":1.6316690625,"accuracy":0.39194,"n":50000},"selected_train":{"loss":1.6316690625,"accuracy":0.39194,"n":50000},"final_test":{"loss":1.6647134765625,"accuracy":0.3905,"n":10000,"wrong_indices":[0,2,4,5,6,8,14,15,17,18,19,23,24,26,27,29,30,31,32,33,34,36,37,39,40,41,42,44,45,46,48,49,51,52,53,56,57,59,60,61,63,64,65,67,68,70,74,75,76,79,80,83,84,85,86,87,89,90,93,94,95,96,97,102,103,107,109,110,111,112,114,115,116,117,120,121,122,124,127,128,129,132,133,134,135,137,139,141,142,143,144,145,146,149,152,153,154,155,158,159,160,162,163,165,166,167,168,169,170,171,173,175,176,177,178,179,180,181,182,184,187,189,190,191,195,196,198,200,202,203,204,205,207,210,211,213,216,218,219,220,223,224,226,227,228,229,230,231,232,233,234,238,239,240,241,242,243,245,247,248,250,251,253,254,255,257,259,260,261,262,263,265,266,267,268,270,272,275,276,277,279,282,283,287,288,289,290,295,299,300,301,302,304,307,308,309,310,313,314,317,319,321,323,325,328,329,330,332,333,334,335,337,338,340,342,343,344,345,347,348,349,350,351,352,354,355,356,357,358,360,364,367,369,370,373,374,375,376,377,378,379,381,382,383,385,388,391,393,395,397,398,399,401,402,403,405,406,408,409,410,411,412,413,415,416,419,420,425,427,428,429,430,431,432,433,435,436,437,438,442,447,449,450,451,453,455,458,460,464,465,466,468,469,470,473,474,475,476,478,480,482,483,484,486,489,491,493,494,495,497,500,502,504,505,506,507,509,510,511,515,518,519,520,522,523,524,526,527,528,529,531,532,533,535,537,538,540,541,542,543,544,548,550,551,553,554,555,556,557,563,565,569,570,571,572,573,574,576,577,578,579,580,582,583,584,585,588,589,590,591,595,596,601,603,604,605,606,610,614,615,617,618,619,621,622,626,628,631,636,637,638,640,641,645,647,648,649,651,652,654,655,657,658,660,663,664,666,667,668,669,670,672,674,675,676,677,679,682,683,684,685,686,687,689,691,692,693,694,695,696,697,698,699,700,702,703,705,707,708,709,710,711,712,714,716,717,718,719,720,722,725,726,727,730,734,735,736,739,740,745,746,747,748,749,751,752,753,754,755,756,757,760,761,762,765,766,767,768,770,771,772,774,776,777,778,779,780,781,782,783,784,785,787,789,790,791,792,793,795,797,798,800,801,802,803,805,806,807,808,809,810,811,812,815,818,819,822,824,825,826,827,829,831,832,835,836,838,839,840,841,842,843,844,846,847,848,849,850,852,853,855,856,857,859,864,865,866,869,872,876,877,878,879,880,881,883,887,889,890,894,895,897,898,899,900,901,902,907,908,909,910,911,912,914,915,916,917,918,920,923,925,927,929,930,931,933,934,935,936,938,941,944,946,947,948,949,950,951,953,955,956,957,958,959,960,961,963,964,965,967,968,969,970,971,976,977,978,979,982,983,984,987,988,991,994,998,1003,1004,1006,1007,1008,1010,1011,1012,1014,1015,1018,1019,1020,1021,1022,1023,1024,1025,1026,1027,1028,1029,1030,1032,1033,1037,1038,1039,1040,1041,1042,1043,1046,1051,1052,1054,1055,1057,1059,1060,1062,1066,1067,1068,1069,1070,1071,1072,1073,1074,1075,1077,1078,1080,1082,1083,1087,1089,1091,1092,1093,1095,1096,1097,1098,1100,1101,1102,1104,1107,1109,1110,1111,1112,1113,1114,1115,1116,1117,1118,1119,1120,1122,1124,1125,1126,1127,1128,1129,1131,1133,1134,1135,1136,1137,1139,1140,1141,1142,1143,1144,1145,1146,1147,1149,1150,1156,1157,1158,1159,1160,1163,1164,1166,1167,1168,1169,1170,1171,1172,1173,1175,1178,1179,1180,1182,1185,1186,1189,1190,1193,1194,1198,1200,1201,1202,1204,1205,1206,1208,1211,1213,1214,1215,1216,1219,1221,1222,1225,1226,1229,1230,1232,1233,1234,1235,1236,1238,1239,1240,1241,1242,1243,1244,1247,1248,1249,1252,1253,1254,1257,1258,1259,1260,1263,1264,1265,1267,1268,1270,1272,1274,1275,1276,1278,1279,1280,1281,1283,1284,1285,1286,1287,1289,1290,1291,1295,1298,1299,1300,1301,1302,1305,1306,1310,1312,1313,1314,1315,1316,1317,1318,1319,1320,1321,1323,1324,1325,1326,1328,1329,1330,1331,1334,1338,1339,1340,1342,1346,1347,1350,1351,1353,1354,1355,1357,1358,1359,1360,1361,1363,1364,1366,1367,1368,1369,1370,1371,1376,1378,1382,1383,1384,1386,1389,1391,1392,1393,1394,1397,1398,1401,1403,1405,1406,1413,1415,1419,1421,1422,1424,1425,1426,1427,1430,1433,1434,1437,1440,1441,1442,1443,1447,1448,1453,1460,1461,1463,1464,1465,1466,1467,1469,1470,1471,1472,1473,1474,1476,1477,1479,1480,1483,1484,1488,1489,1490,1493,1494,1495,1496,1497,1498,1499,1500,1502,1503,1505,1507,1509,1510,1511,1513,1515,1516,1519,1520,1521,1522,1523,1524,1525,1527,1528,1529,1530,1531,1539,1540,1541,1542,1543,1544,1547,1548,1549,1550,1552,1555,1556,1557,1560,1561,1562,1563,1564,1566,1567,1568,1569,1571,1572,1573,1575,1576,1580,1581,1582,1583,1584,1586,1588,1591,1592,1595,1598,1599,1600,1601,1603,1605,1606,1607,1608,1609,1611,1612,1613,1614,1615,1617,1618,1621,1624,1625,1628,1629,1630,1633,1634,1635,1636,1637,1639,1641,1643,1646,1649,1651,1652,1653,1657,1659,1660,1661,1663,1664,1665,1667,1669,1670,1671,1672,1673,1674,1675,1677,1679,1680,1681,1683,1684,1686,1687,1690,1691,1693,1694,1699,1701,1702,1703,1704,1705,1706,1707,1709,1710,1715,1716,1717,1718,1719,1720,1721,1724,1727,1728,1729,1730,1731,1734,1735,1736,1737,1738,1740,1741,1742,1746,1747,1750,1751,1752,1753,1754,1755,1756,1758,1759,1760,1761,1763,1765,1766,1767,1769,1770,1772,1773,1774,1776,1778,1779,1780,1782,1783,1784,1785,1786,1789,1790,1791,1792,1797,1798,1799,1803,1804,1805,1806,1809,1810,1813,1814,1815,1816,1820,1823,1827,1828,1829,1830,1832,1833,1834,1835,1836,1837,1838,1840,1844,1845,1846,1847,1848,1849,1850,1855,1856,1859,1860,1861,1862,1864,1865,1866,1867,1868,1872,1874,1875,1876,1877,1878,1879,1882,1883,1884,1885,1887,1889,1893,1896,1897,1899,1900,1901,1902,1903,1909,1910,1911,1912,1913,1914,1917,1919,1920,1922,1923,1924,1925,1926,1928,1929,1931,1933,1934,1935,1938,1939,1940,1941,1942,1945,1946,1948,1949,1950,1953,1954,1955,1956,1958,1960,1961,1962,1963,1966,1967,1968,1970,1973,1975,1976,1978,1980,1983,1985,1986,1987,1988,1989,1993,1994,1997,1999,2001,2003,2004,2005,2007,2008,2010,2011,2012,2013,2015,2016,2017,2018,2020,2021,2022,2024,2025,2027,2028,2029,2030,2031,2032,2034,2035,2036,2037,2038,2040,2041,2043,2044,2045,2046,2048,2050,2051,2052,2053,2056,2059,2063,2064,2065,2069,2070,2071,2072,2073,2074,2075,2076,2077,2078,2080,2083,2084,2086,2090,2091,2093,2094,2095,2098,2099,2100,2102,2103,2104,2105,2107,2109,2111,2113,2114,2115,2117,2118,2119,2120,2121,2123,2124,2125,2128,2129,2130,2132,2134,2135,2136,2137,2139,2141,2142,2143,2145,2146,2148,2149,2151,2152,2153,2154,2159,2162,2163,2164,2165,2166,2167,2168,2169,2171,2172,2173,2174,2175,2177,2179,2180,2182,2183,2186,2187,2192,2193,2195,2197,2201,2202,2203,2205,2206,2207,2208,2211,2213,2214,2218,2219,2220,2221,2222,2223,2224,2225,2228,2229,2230,2233,2234,2235,2237,2238,2239,2240,2241,2243,2245,2246,2247,2249,2251,2252,2255,2256,2258,2261,2262,2264,2265,2266,2268,2270,2271,2272,2273,2275,2276,2277,2278,2279,2280,2281,2282,2283,2284,2285,2287,2288,2289,2290,2291,2297,2298,2300,2301,2302,2303,2305,2306,2307,2308,2309,2312,2314,2315,2316,2317,2319,2322,2324,2325,2330,2332,2334,2335,2336,2338,2339,2340,2343,2344,2346,2347,2348,2349,2351,2355,2356,2357,2358,2359,2362,2363,2364,2365,2366,2368,2369,2371,2372,2373,2375,2377,2379,2381,2382,2386,2389,2392,2393,2394,2395,2398,2399,2400,2401,2402,2404,2405,2406,2407,2408,2409,2411,2413,2416,2418,2419,2421,2423,2424,2425,2427,2430,2431,2434,2436,2440,2441,2442,2444,2445,2447,2450,2451,2452,2453,2457,2460,2462,2463,2464,2467,2470,2473,2474,2476,2480,2482,2484,2487,2488,2489,2490,2498,2499,2501,2502,2504,2505,2507,2509,2510,2511,2512,2513,2514,2515,2518,2519,2520,2521,2522,2523,2524,2525,2526,2529,2530,2533,2534,2537,2539,2540,2541,2543,2545,2546,2547,2549,2550,2551,2552,2553,2554,2555,2556,2558,2559,2560,2561,2563,2564,2565,2566,2567,2569,2573,2574,2575,2576,2577,2578,2579,2581,2583,2584,2586,2587,2588,2590,2591,2594,2595,2597,2598,2599,2600,2604,2605,2606,2607,2608,2611,2612,2613,2614,2615,2616,2617,2618,2622,2623,2624,2626,2628,2629,2630,2632,2634,2636,2639,2640,2642,2644,2645,2646,2647,2648,2650,2653,2654,2655,2658,2659,2661,2663,2665,2666,2667,2668,2670,2671,2674,2675,2676,2678,2680,2681,2682,2683,2684,2686,2688,2689,2690,2691,2693,2695,2697,2698,2700,2701,2704,2705,2706,2708,2709,2710,2712,2715,2716,2719,2722,2723,2724,2725,2727,2730,2731,2734,2736,2739,2743,2744,2745,2746,2749,2753,2756,2757,2758,2767,2768,2770,2771,2772,2773,2774,2775,2776,2778,2783,2785,2786,2788,2789,2790,2793,2797,2798,2799,2800,2803,2804,2805,2806,2807,2808,2809,2810,2813,2814,2815,2816,2818,2819,2820,2822,2823,2825,2827,2828,2829,2832,2833,2834,2835,2836,2837,2839,2840,2841,2843,2844,2847,2849,2850,2851,2852,2853,2855,2856,2859,2862,2865,2867,2868,2869,2871,2872,2874,2877,2878,2879,2880,2881,2882,2884,2885,2886,2887,2888,2889,2890,2893,2895,2896,2897,2898,2900,2901,2902,2903,2905,2906,2907,2909,2911,2912,2913,2914,2915,2917,2919,2921,2922,2924,2925,2927,2928,2930,2931,2935,2936,2938,2939,2943,2945,2946,2948,2949,2950,2951,2952,2953,2955,2956,2957,2960,2961,2963,2965,2967,2968,2969,2970,2974,2975,2978,2982,2984,2985,2986,2987,2989,2990,2991,2992,2993,2995,2997,2998,3002,3003,3007,3009,3010,3011,3012,3014,3015,3017,3019,3022,3023,3024,3025,3026,3027,3028,3029,3030,3038,3039,3040,3042,3045,3046,3049,3050,3053,3054,3055,3059,3060,3061,3062,3064,3065,3066,3068,3069,3070,3072,3073,3074,3076,3078,3079,3080,3082,3083,3084,3085,3086,3091,3092,3093,3094,3095,3096,3097,3098,3099,3100,3101,3102,3103,3104,3107,3108,3109,3110,3111,3112,3113,3114,3115,3117,3119,3120,3122,3123,3124,3125,3126,3127,3129,3131,3132,3133,3136,3137,3138,3139,3143,3145,3146,3148,3150,3152,3153,3154,3155,3157,3158,3161,3162,3163,3166,3167,3169,3171,3172,3174,3175,3177,3183,3184,3186,3188,3189,3192,3193,3194,3196,3197,3198,3199,3202,3203,3204,3205,3206,3208,3211,3213,3214,3216,3217,3220,3221,3224,3225,3227,3228,3230,3231,3232,3233,3234,3235,3236,3237,3244,3245,3246,3247,3248,3249,3253,3255,3259,3261,3262,3263,3264,3268,3272,3275,3276,3277,3278,3279,3281,3282,3283,3284,3285,3288,3289,3290,3291,3292,3294,3295,3296,3298,3299,3300,3303,3308,3309,3311,3312,3313,3314,3316,3319,3320,3321,3323,3324,3326,3328,3329,3330,3332,3333,3334,3335,3336,3340,3341,3343,3345,3348,3349,3351,3352,3353,3354,3356,3357,3360,3361,3363,3364,3366,3370,3372,3373,3374,3376,3377,3378,3379,3380,3381,3386,3388,3389,3390,3393,3397,3399,3400,3405,3406,3407,3408,3409,3410,3414,3416,3418,3419,3420,3421,3423,3425,3429,3430,3431,3432,3433,3434,3437,3438,3440,3441,3443,3444,3448,3449,3451,3452,3453,3454,3455,3456,3457,3461,3462,3463,3464,3465,3466,3468,3469,3470,3471,3473,3475,3476,3480,3484,3486,3487,3490,3492,3493,3494,3495,3497,3498,3499,3500,3502,3503,3505,3506,3509,3515,3516,3517,3519,3520,3521,3523,3525,3527,3528,3530,3531,3532,3533,3534,3535,3537,3541,3542,3543,3544,3546,3548,3549,3551,3552,3555,3556,3558,3559,3561,3562,3563,3565,3567,3568,3569,3570,3571,3572,3573,3575,3576,3579,3580,3582,3583,3585,3586,3588,3589,3590,3591,3593,3594,3595,3596,3597,3598,3601,3604,3605,3606,3607,3609,3610,3612,3615,3616,3619,3620,3621,3623,3625,3626,3627,3629,3630,3631,3632,3633,3635,3636,3637,3638,3639,3641,3642,3643,3644,3645,3647,3648,3649,3651,3652,3653,3654,3656,3659,3662,3663,3667,3669,3670,3672,3673,3674,3676,3678,3679,3684,3685,3686,3689,3691,3692,3699,3700,3701,3702,3704,3705,3707,3708,3713,3715,3717,3718,3719,3720,3721,3722,3726,3727,3728,3730,3732,3733,3736,3737,3738,3739,3740,3741,3742,3743,3745,3746,3747,3750,3751,3752,3753,3754,3756,3757,3758,3761,3763,3765,3766,3767,3769,3770,3771,3776,3777,3778,3779,3780,3781,3782,3784,3786,3787,3788,3789,3792,3793,3794,3795,3797,3799,3806,3807,3808,3809,3810,3811,3812,3813,3814,3815,3816,3819,3824,3825,3826,3828,3829,3833,3834,3836,3837,3838,3841,3843,3845,3848,3851,3852,3853,3854,3855,3858,3860,3863,3865,3866,3868,3871,3873,3875,3877,3878,3880,3882,3887,3890,3892,3893,3894,3896,3897,3898,3900,3902,3905,3906,3907,3910,3915,3916,3917,3918,3919,3920,3922,3925,3928,3929,3930,3934,3936,3937,3938,3941,3943,3944,3947,3949,3951,3952,3953,3954,3955,3956,3957,3960,3962,3964,3965,3968,3969,3971,3973,3974,3975,3976,3977,3983,3985,3987,3988,3990,3993,3994,3995,3996,3997,3998,4000,4001,4002,4004,4005,4006,4007,4010,4011,4012,4013,4014,4017,4018,4020,4021,4024,4025,4026,4027,4028,4029,4031,4032,4035,4036,4039,4041,4042,4044,4046,4049,4050,4052,4053,4054,4056,4057,4058,4059,4060,4061,4064,4067,4068,4069,4071,4072,4073,4074,4075,4076,4077,4078,4083,4084,4085,4086,4087,4089,4092,4094,4096,4097,4099,4102,4104,4105,4106,4107,4108,4109,4110,4112,4116,4117,4118,4119,4120,4121,4123,4124,4126,4128,4130,4131,4136,4137,4138,4140,4141,4142,4144,4145,4146,4147,4148,4151,4152,4153,4156,4159,4162,4163,4164,4165,4168,4169,4170,4171,4172,4175,4176,4177,4178,4179,4181,4185,4190,4191,4192,4194,4195,4196,4197,4199,4200,4201,4202,4207,4212,4214,4215,4216,4217,4218,4219,4220,4221,4222,4223,4224,4225,4226,4228,4229,4230,4231,4232,4233,4234,4236,4238,4242,4244,4246,4248,4249,4251,4253,4254,4255,4256,4258,4261,4262,4263,4264,4265,4266,4267,4268,4269,4270,4271,4273,4276,4277,4288,4289,4290,4291,4292,4295,4297,4300,4302,4303,4304,4305,4306,4307,4308,4310,4311,4312,4313,4315,4317,4318,4322,4323,4324,4328,4330,4331,4332,4334,4335,4337,4338,4340,4349,4352,4355,4356,4357,4359,4360,4362,4364,4366,4368,4371,4372,4373,4374,4375,4376,4377,4378,4379,4380,4381,4382,4386,4389,4390,4391,4393,4396,4397,4398,4399,4400,4406,4409,4411,4414,4419,4420,4421,4422,4423,4428,4429,4430,4431,4433,4434,4435,4437,4438,4440,4443,4450,4452,4453,4455,4458,4459,4460,4461,4463,4465,4467,4468,4469,4471,4472,4474,4475,4477,4478,4481,4483,4485,4486,4487,4490,4491,4492,4493,4494,4496,4497,4498,4501,4507,4508,4509,4513,4514,4516,4518,4519,4520,4522,4523,4524,4525,4526,4528,4529,4530,4532,4533,4535,4537,4538,4539,4540,4541,4543,4544,4545,4548,4551,4552,4558,4561,4563,4564,4566,4567,4568,4569,4571,4572,4574,4575,4576,4577,4578,4580,4581,4583,4586,4588,4589,4590,4593,4595,4596,4597,4598,4600,4601,4602,4603,4605,4606,4608,4609,4612,4613,4615,4620,4621,4623,4624,4626,4629,4630,4634,4635,4637,4638,4639,4640,4643,4645,4646,4647,4651,4652,4653,4654,4655,4657,4658,4660,4661,4664,4667,4669,4670,4671,4674,4676,4677,4678,4685,4687,4688,4689,4690,4691,4693,4695,4696,4697,4703,4707,4708,4711,4712,4714,4715,4717,4719,4721,4722,4724,4726,4727,4728,4729,4730,4731,4732,4733,4736,4737,4738,4740,4742,4743,4744,4745,4746,4747,4748,4749,4750,4751,4753,4754,4755,4756,4758,4759,4760,4762,4763,4764,4766,4767,4768,4770,4771,4772,4773,4774,4777,4778,4781,4782,4783,4784,4785,4789,4791,4792,4793,4794,4796,4797,4800,4802,4803,4806,4807,4808,4809,4810,4811,4813,4815,4817,4818,4820,4821,4822,4823,4825,4826,4827,4828,4829,4830,4833,4836,4837,4839,4841,4842,4844,4845,4847,4849,4850,4852,4853,4854,4855,4858,4859,4860,4861,4863,4864,4865,4866,4867,4868,4869,4871,4872,4873,4877,4879,4881,4885,4886,4888,4890,4892,4893,4894,4895,4896,4900,4902,4903,4904,4906,4907,4909,4911,4912,4913,4915,4916,4917,4921,4922,4924,4925,4927,4928,4929,4930,4931,4932,4933,4936,4938,4940,4942,4946,4948,4949,4950,4951,4953,4955,4956,4960,4966,4970,4971,4972,4973,4974,4976,4977,4978,4979,4982,4983,4984,4986,4987,4990,4991,4993,4994,4996,4998,5000,5003,5004,5005,5011,5013,5014,5016,5019,5020,5021,5023,5025,5027,5028,5032,5036,5038,5039,5040,5041,5044,5046,5047,5048,5049,5052,5054,5055,5056,5058,5059,5061,5062,5063,5064,5065,5067,5068,5071,5072,5074,5075,5076,5077,5078,5081,5082,5083,5084,5090,5091,5092,5093,5094,5096,5097,5098,5101,5102,5103,5104,5107,5110,5111,5112,5113,5114,5118,5121,5122,5123,5126,5128,5129,5132,5134,5138,5140,5142,5143,5146,5148,5150,5151,5152,5154,5156,5158,5159,5160,5162,5163,5165,5166,5168,5169,5170,5172,5173,5174,5175,5176,5177,5178,5179,5180,5181,5183,5184,5185,5186,5187,5188,5190,5191,5193,5194,5195,5196,5197,5198,5200,5201,5202,5203,5204,5205,5206,5207,5208,5209,5210,5211,5212,5214,5215,5222,5223,5224,5225,5226,5227,5229,5231,5232,5234,5236,5237,5238,5239,5240,5245,5246,5248,5252,5254,5256,5258,5260,5261,5271,5273,5274,5275,5277,5278,5281,5283,5284,5285,5287,5288,5291,5293,5294,5295,5297,5298,5300,5302,5306,5309,5310,5312,5313,5314,5316,5317,5318,5319,5322,5323,5324,5325,5326,5327,5328,5329,5330,5331,5334,5335,5336,5339,5343,5345,5346,5347,5348,5349,5350,5351,5355,5356,5358,5359,5360,5361,5362,5363,5364,5365,5370,5371,5372,5374,5376,5379,5380,5382,5384,5387,5389,5393,5394,5395,5397,5399,5400,5402,5403,5406,5408,5409,5410,5412,5413,5416,5418,5419,5420,5422,5423,5425,5426,5431,5432,5433,5434,5437,5438,5439,5440,5442,5444,5445,5446,5448,5451,5453,5454,5457,5460,5461,5462,5464,5465,5466,5468,5471,5472,5473,5474,5476,5477,5478,5479,5480,5482,5485,5486,5488,5489,5490,5492,5493,5495,5496,5498,5499,5500,5504,5506,5508,5509,5510,5512,5514,5516,5517,5518,5520,5522,5524,5525,5528,5530,5532,5533,5534,5535,5538,5540,5542,5543,5544,5547,5548,5549,5550,5551,5552,5553,5555,5556,5559,5560,5561,5563,5564,5566,5569,5570,5571,5572,5573,5574,5576,5577,5578,5579,5583,5585,5586,5588,5589,5590,5594,5596,5597,5598,5600,5601,5604,5606,5607,5608,5610,5611,5614,5616,5617,5618,5620,5621,5623,5624,5625,5628,5630,5631,5632,5633,5635,5637,5638,5640,5642,5644,5646,5647,5648,5649,5650,5651,5654,5655,5656,5657,5658,5661,5662,5663,5664,5666,5668,5670,5674,5675,5676,5677,5678,5679,5680,5682,5687,5688,5689,5691,5696,5697,5698,5699,5700,5701,5703,5706,5708,5709,5710,5711,5713,5714,5720,5722,5724,5725,5726,5728,5729,5732,5734,5735,5738,5740,5741,5742,5744,5745,5746,5747,5749,5751,5752,5758,5759,5760,5762,5764,5765,5766,5769,5771,5773,5774,5775,5776,5777,5779,5780,5782,5783,5786,5789,5792,5794,5795,5796,5797,5798,5802,5803,5804,5807,5808,5809,5811,5814,5815,5816,5817,5821,5822,5824,5825,5831,5832,5833,5835,5836,5839,5841,5842,5843,5845,5846,5848,5850,5851,5852,5854,5855,5857,5858,5859,5860,5861,5862,5864,5866,5867,5872,5873,5874,5875,5876,5878,5880,5881,5882,5885,5887,5888,5889,5891,5892,5893,5896,5900,5902,5903,5904,5905,5906,5910,5911,5912,5913,5914,5915,5917,5922,5923,5925,5926,5927,5933,5935,5936,5937,5939,5940,5943,5945,5946,5947,5949,5950,5953,5955,5956,5957,5959,5960,5962,5964,5967,5969,5970,5972,5973,5975,5976,5978,5979,5981,5982,5984,5985,5986,5988,5991,5992,5995,5997,5998,5999,6001,6004,6005,6006,6007,6008,6009,6011,6012,6013,6017,6018,6019,6021,6023,6024,6025,6026,6028,6030,6034,6035,6037,6042,6043,6044,6045,6046,6048,6049,6050,6053,6054,6056,6058,6059,6060,6061,6063,6065,6066,6067,6069,6070,6073,6075,6076,6077,6079,6080,6083,6085,6086,6087,6089,6090,6091,6092,6095,6096,6098,6100,6101,6102,6103,6105,6107,6108,6110,6115,6116,6119,6120,6121,6125,6135,6136,6137,6138,6139,6141,6142,6143,6144,6145,6146,6147,6148,6149,6150,6151,6152,6153,6154,6155,6157,6158,6159,6160,6161,6162,6164,6165,6166,6168,6169,6170,6171,6172,6173,6174,6175,6176,6177,6178,6182,6184,6185,6186,6188,6189,6192,6194,6195,6196,6198,6199,6202,6204,6205,6206,6208,6209,6212,6213,6215,6216,6219,6220,6222,6223,6224,6226,6227,6231,6232,6233,6236,6238,6239,6242,6243,6244,6245,6248,6251,6253,6254,6255,6256,6257,6260,6262,6263,6265,6267,6268,6269,6270,6271,6272,6273,6275,6276,6277,6278,6282,6284,6285,6289,6290,6291,6292,6295,6296,6297,6299,6300,6304,6306,6307,6308,6310,6312,6313,6314,6316,6317,6320,6322,6323,6324,6326,6327,6329,6331,6332,6333,6335,6336,6338,6339,6341,6343,6346,6347,6348,6349,6353,6356,6358,6359,6360,6361,6362,6363,6364,6365,6366,6367,6368,6369,6370,6371,6372,6373,6374,6375,6377,6378,6379,6380,6381,6382,6385,6386,6389,6390,6392,6395,6396,6397,6403,6404,6405,6407,6408,6410,6413,6414,6415,6417,6419,6421,6427,6430,6432,6433,6434,6435,6438,6440,6441,6442,6445,6447,6448,6449,6450,6452,6453,6455,6456,6457,6458,6460,6464,6465,6467,6468,6471,6472,6474,6475,6476,6477,6481,6482,6483,6484,6485,6486,6488,6490,6491,6492,6493,6494,6495,6500,6501,6502,6503,6504,6505,6506,6511,6514,6515,6516,6517,6518,6522,6523,6525,6527,6529,6530,6533,6535,6536,6537,6539,6540,6542,6543,6544,6545,6547,6548,6551,6552,6553,6555,6556,6559,6560,6561,6563,6564,6569,6570,6572,6573,6575,6576,6577,6578,6579,6582,6585,6586,6587,6589,6593,6595,6598,6599,6600,6601,6603,6604,6606,6609,6611,6612,6617,6618,6619,6620,6622,6623,6624,6625,6626,6628,6629,6631,6634,6636,6637,6638,6640,6641,6644,6646,6647,6648,6649,6652,6653,6654,6657,6659,6660,6661,6662,6663,6664,6665,6666,6670,6673,6674,6676,6678,6679,6680,6681,6683,6684,6686,6687,6688,6689,6690,6694,6695,6696,6697,6699,6700,6702,6704,6705,6706,6708,6709,6712,6714,6715,6716,6720,6722,6723,6724,6725,6726,6727,6728,6729,6730,6731,6733,6734,6735,6736,6737,6738,6739,6741,6742,6743,6745,6746,6748,6751,6755,6756,6757,6758,6759,6761,6762,6763,6765,6767,6768,6769,6775,6776,6780,6783,6788,6789,6790,6791,6794,6799,6801,6802,6803,6805,6806,6809,6811,6812,6813,6815,6816,6819,6821,6822,6823,6825,6826,6829,6830,6832,6834,6837,6838,6839,6840,6845,6848,6850,6851,6852,6853,6854,6855,6856,6857,6858,6859,6860,6861,6862,6863,6864,6865,6866,6867,6868,6869,6871,6872,6873,6874,6875,6876,6879,6880,6882,6883,6884,6886,6889,6890,6891,6897,6898,6899,6901,6902,6904,6907,6908,6909,6911,6913,6915,6917,6918,6924,6928,6930,6931,6932,6934,6935,6938,6940,6941,6942,6944,6945,6948,6950,6951,6952,6954,6955,6957,6958,6960,6961,6963,6964,6965,6969,6972,6973,6974,6975,6976,6977,6981,6982,6983,6985,6986,6990,6991,6992,6995,6997,6999,7000,7003,7004,7005,7006,7009,7010,7011,7014,7016,7018,7019,7021,7023,7024,7026,7027,7028,7029,7030,7032,7033,7034,7035,7036,7040,7041,7045,7046,7047,7048,7053,7055,7056,7057,7059,7060,7063,7065,7066,7067,7069,7070,7073,7075,7076,7077,7079,7080,7082,7083,7085,7087,7088,7090,7091,7092,7094,7096,7097,7098,7099,7101,7102,7103,7104,7108,7109,7111,7114,7117,7119,7121,7123,7124,7125,7126,7127,7130,7131,7134,7137,7138,7140,7141,7142,7143,7144,7145,7146,7149,7150,7153,7155,7157,7160,7164,7165,7167,7169,7170,7171,7173,7176,7177,7178,7180,7181,7183,7185,7186,7187,7189,7191,7193,7194,7195,7197,7198,7200,7201,7204,7206,7207,7208,7211,7214,7215,7217,7218,7219,7220,7222,7223,7226,7228,7230,7232,7233,7234,7238,7240,7241,7244,7247,7248,7250,7251,7252,7253,7257,7259,7260,7262,7264,7265,7267,7268,7270,7272,7273,7274,7276,7277,7280,7282,7283,7284,7286,7287,7290,7292,7293,7294,7296,7297,7299,7300,7301,7302,7303,7304,7306,7307,7309,7311,7312,7313,7315,7316,7319,7320,7323,7324,7325,7326,7329,7332,7333,7334,7338,7339,7340,7341,7344,7350,7351,7352,7353,7355,7356,7361,7362,7365,7366,7369,7370,7371,7372,7373,7374,7375,7376,7378,7379,7383,7388,7390,7391,7392,7393,7394,7395,7396,7397,7398,7399,7401,7402,7403,7405,7407,7408,7411,7413,7414,7416,7417,7418,7419,7421,7422,7423,7424,7425,7428,7429,7430,7431,7432,7433,7434,7435,7436,7437,7439,7442,7444,7445,7447,7448,7450,7451,7453,7454,7455,7456,7458,7460,7463,7467,7468,7470,7473,7474,7475,7476,7477,7478,7479,7480,7481,7484,7488,7490,7493,7494,7498,7500,7501,7502,7504,7507,7509,7510,7511,7513,7514,7517,7519,7520,7521,7523,7524,7527,7529,7530,7531,7533,7534,7538,7541,7542,7543,7544,7545,7550,7551,7552,7553,7554,7556,7559,7560,7561,7563,7565,7567,7568,7569,7573,7574,7577,7578,7581,7582,7583,7584,7586,7589,7590,7591,7595,7597,7598,7600,7602,7603,7605,7606,7608,7610,7611,7612,7614,7615,7618,7620,7621,7622,7623,7626,7628,7629,7630,7632,7633,7636,7638,7639,7642,7643,7644,7645,7647,7648,7649,7650,7653,7654,7656,7657,7658,7659,7660,7661,7662,7663,7664,7665,7666,7669,7672,7673,7674,7675,7676,7677,7679,7686,7689,7690,7691,7692,7694,7695,7696,7698,7701,7704,7708,7711,7713,7714,7715,7717,7718,7719,7720,7722,7725,7726,7728,7730,7731,7732,7734,7735,7738,7740,7741,7742,7744,7745,7748,7750,7751,7752,7754,7755,7757,7759,7760,7763,7764,7765,7766,7767,7770,7771,7774,7775,7776,7777,7779,7783,7784,7788,7790,7793,7796,7797,7798,7800,7801,7802,7803,7804,7805,7806,7808,7809,7811,7812,7814,7818,7819,7821,7822,7823,7825,7826,7829,7831,7832,7833,7834,7836,7839,7841,7842,7844,7845,7847,7849,7850,7852,7853,7856,7858,7859,7861,7862,7865,7869,7870,7871,7872,7875,7877,7878,7879,7881,7883,7885,7888,7890,7893,7896,7899,7900,7901,7902,7903,7905,7908,7910,7911,7912,7915,7916,7918,7919,7920,7921,7923,7924,7926,7927,7928,7932,7934,7936,7937,7938,7940,7941,7944,7946,7947,7948,7950,7951,7954,7956,7957,7958,7960,7961,7963,7965,7966,7968,7969,7971,7972,7973,7974,7976,7978,7979,7980,7981,7982,7983,7984,7985,7988,7990,7993,7995,7996,7997,7998,7999,8000,8003,8004,8005,8008,8009,8010,8011,8012,8014,8015,8020,8022,8026,8027,8030,8032,8033,8034,8035,8037,8038,8039,8043,8045,8046,8048,8049,8050,8051,8052,8054,8058,8060,8061,8062,8064,8065,8068,8070,8071,8072,8074,8075,8078,8080,8081,8082,8086,8087,8088,8089,8090,8092,8095,8097,8099,8100,8105,8106,8107,8110,8113,8115,8118,8120,8121,8122,8124,8125,8128,8130,8131,8132,8134,8135,8138,8140,8141,8142,8144,8145,8147,8149,8151,8154,8155,8156,8157,8158,8159,8160,8162,8164,8166,8167,8170,8171,8173,8175,8176,8178,8180,8183,8185,8186,8187,8188,8189,8190,8192,8193,8201,8202,8203,8204,8205,8206,8209,8214,8215,8216,8217,8218,8219,8220,8222,8223,8224,8226,8229,8231,8232,8233,8234,8235,8236,8239,8241,8242,8244,8246,8247,8248,8249,8252,8254,8255,8257,8258,8261,8263,8264,8265,8266,8268,8269,8270,8271,8272,8275,8276,8277,8279,8280,8282,8284,8285,8286,8289,8290,8293,8294,8296,8297,8299,8300,8301,8302,8303,8304,8305,8306,8308,8309,8312,8313,8314,8316,8317,8321,8324,8325,8327,8328,8329,8330,8331,8337,8339,8340,8344,8346,8347,8348,8350,8352,8354,8355,8356,8357,8360,8362,8363,8364,8366,8367,8369,8370,8375,8376,8378,8379,8384,8386,8387,8390,8391,8392,8393,8395,8396,8397,8398,8400,8401,8402,8403,8405,8406,8407,8408,8410,8411,8412,8413,8415,8416,8417,8418,8419,8420,8421,8427,8428,8429,8430,8432,8434,8435,8437,8439,8440,8442,8443,8444,8445,8447,8449,8451,8452,8453,8455,8456,8459,8461,8462,8463,8465,8466,8469,8471,8472,8473,8475,8476,8480,8483,8484,8485,8486,8487,8488,8489,8491,8493,8494,8497,8500,8502,8505,8507,8508,8509,8510,8511,8512,8518,8519,8520,8522,8524,8525,8526,8527,8529,8530,8531,8533,8536,8538,8539,8540,8541,8543,8545,8547,8549,8551,8552,8553,8555,8556,8559,8561,8562,8563,8565,8566,8568,8570,8571,8573,8574,8575,8577,8578,8581,8582,8583,8585,8586,8589,8591,8597,8598,8600,8601,8603,8604,8606,8607,8608,8609,8610,8613,8616,8617,8618,8620,8624,8626,8627,8630,8631,8632,8633,8635,8636,8638,8641,8643,8645,8649,8650,8651,8652,8653,8654,8655,8656,8658,8659,8660,8661,8662,8664,8665,8666,8667,8669,8672,8674,8675,8676,8678,8679,8682,8684,8685,8686,8688,8689,8692,8694,8695,8696,8698,8699,8701,8702,8703,8706,8708,8709,8710,8711,8713,8715,8716,8718,8720,8722,8724,8725,8726,8727,8728,8729,8733,8734,8735,8736,8737,8740,8741,8742,8743,8745,8747,8749,8753,8754,8755,8756,8757,8758,8759,8761,8766,8767,8768,8770,8773,8774,8775,8776,8777,8778,8780,8783,8785,8786,8787,8788,8790,8791,8797,8799,8801,8802,8803,8805,8806,8809,8811,8812,8813,8815,8816,8819,8821,8822,8823,8825,8826,8829,8832,8833,8834,8835,8836,8837,8840,8842,8843,8847,8850,8853,8854,8855,8856,8857,8860,8861,8862,8863,8864,8866,8867,8871,8872,8873,8874,8875,8876,8877,8878,8879,8883,8885,8886,8887,8891,8892,8894,8898,8903,8904,8905,8909,8910,8911,8912,8914,8916,8917,8918,8919,8922,8924,8925,8926,8927,8930,8931,8932,8934,8938,8939,8940,8941,8942,8945,8946,8947,8948,8952,8954,8956,8957,8958,8959,8960,8961,8963,8964,8965,8970,8971,8972,8974,8975,8976,8979,8980,8981,8982,8984,8985,8986,8987,8988,8989,8993,8995,9000,9002,9003,9005,9007,9008,9009,9011,9012,9013,9015,9017,9019,9020,9022,9024,9025,9027,9030,9031,9033,9034,9035,9036,9039,9042,9044,9045,9047,9049,9051,9055,9056,9059,9061,9063,9064,9065,9067,9068,9071,9073,9074,9075,9077,9078,9081,9083,9084,9085,9087,9088,9090,9092,9096,9098,9099,9100,9101,9102,9103,9104,9106,9107,9108,9109,9110,9112,9113,9114,9115,9116,9117,9119,9120,9121,9124,9125,9126,9128,9132,9133,9136,9139,9140,9141,9143,9147,9150,9151,9152,9155,9156,9157,9159,9160,9161,9163,9164,9166,9169,9171,9172,9173,9175,9176,9177,9180,9182,9183,9184,9186,9187,9190,9192,9193,9194,9196,9197,9200,9202,9203,9204,9205,9208,9211,9212,9213,9217,9219,9222,9224,9227,9228,9229,9231,9232,9233,9234,9235,9237,9238,9241,9242,9243,9248,9249,9253,9257,9258,9260,9261,9262,9263,9265,9267,9268,9270,9271,9274,9275,9276,9277,9279,9280,9282,9283,9284,9285,9286,9288,9289,9290,9291,9294,9295,9298,9300,9301,9302,9305,9307,9308,9313,9314,9315,9316,9320,9321,9322,9323,9324,9326,9327,9328,9329,9330,9331,9332,9333,9335,9336,9337,9338,9340,9342,9344,9345,9347,9348,9349,9350,9353,9354,9356,9360,9363,9365,9368,9370,9371,9372,9374,9375,9378,9380,9381,9382,9384,9385,9388,9390,9391,9393,9394,9395,9398,9399,9400,9401,9402,9406,9407,9409,9410,9411,9412,9413,9415,9418,9419,9420,9422,9427,9428,9429,9430,9431,9433,9434,9435,9438,9443,9444,9445,9447,9448,9449,9450,9451,9452,9453,9458,9460,9462,9463,9464,9465,9468,9469,9471,9473,9474,9478,9479,9481,9482,9484,9485,9486,9489,9491,9492,9493,9495,9496,9499,9501,9502,9503,9505,9506,9509,9511,9512,9513,9515,9516,9518,9520,9522,9523,9524,9525,9526,9533,9534,9536,9537,9538,9540,9541,9543,9545,9546,9548,9549,9550,9551,9556,9557,9558,9559,9560,9561,9563,9564,9565,9566,9567,9570,9572,9573,9574,9575,9576,9579,9581,9582,9583,9584,9586,9588,9590,9591,9592,9593,9594,9596,9599,9600,9602,9604,9605,9606,9608,9609,9612,9614,9615,9616,9618,9619,9622,9624,9625,9626,9628,9629,9630,9636,9637,9639,9640,9641,9643,9644,9645,9646,9649,9650,9651,9652,9653,9654,9655,9656,9657,9660,9661,9662,9667,9669,9670,9671,9672,9673,9674,9675,9680,9681,9682,9683,9684,9685,9689,9690,9691,9694,9695,9697,9699,9702,9705,9707,9708,9709,9711,9712,9715,9717,9718,9719,9721,9722,9725,9727,9728,9729,9731,9732,9734,9735,9737,9738,9742,9743,9744,9745,9746,9747,9748,9749,9750,9754,9755,9758,9759,9760,9762,9764,9765,9766,9768,9770,9771,9772,9773,9774,9777,9779,9780,9781,9783,9786,9787,9788,9789,9790,9792,9795,9796,9797,9799,9802,9804,9805,9806,9807,9810,9812,9813,9814,9816,9817,9819,9821,9822,9823,9824,9827,9828,9830,9831,9834,9835,9836,9837,9838,9839,9840,9841,9844,9845,9846,9848,9851,9852,9853,9854,9857,9859,9860,9861,9863,9864,9866,9868,9869,9870,9871,9872,9873,9875,9876,9877,9878,9879,9881,9882,9883,9884,9887,9888,9889,9892,9894,9895,9896,9898,9899,9900,9903,9905,9906,9907,9909,9910,9912,9914,9915,9916,9917,9919,9920,9922,9923,9925,9926,9927,9928,9929,9931,9934,9935,9936,9941,9942,9943,9944,9946,9947,9950,9955,9956,9957,9958,9959,9960,9963,9965,9967,9968,9969,9970,9972,9974,9975,9977,9978,9979,9982,9984,9986,9987,9988,9990,9991,9994,9996,9997,9998],"errors":6095},"selected_test":{"loss":1.6647134765625,"accuracy":0.3905,"n":10000,"wrong_indices":[0,2,4,5,6,8,14,15,17,18,19,23,24,26,27,29,30,31,32,33,34,36,37,39,40,41,42,44,45,46,48,49,51,52,53,56,57,59,60,61,63,64,65,67,68,70,74,75,76,79,80,83,84,85,86,87,89,90,93,94,95,96,97,102,103,107,109,110,111,112,114,115,116,117,120,121,122,124,127,128,129,132,133,134,135,137,139,141,142,143,144,145,146,149,152,153,154,155,158,159,160,162,163,165,166,167,168,169,170,171,173,175,176,177,178,179,180,181,182,184,187,189,190,191,195,196,198,200,202,203,204,205,207,210,211,213,216,218,219,220,223,224,226,227,228,229,230,231,232,233,234,238,239,240,241,242,243,245,247,248,250,251,253,254,255,257,259,260,261,262,263,265,266,267,268,270,272,275,276,277,279,282,283,287,288,289,290,295,299,300,301,302,304,307,308,309,310,313,314,317,319,321,323,325,328,329,330,332,333,334,335,337,338,340,342,343,344,345,347,348,349,350,351,352,354,355,356,357,358,360,364,367,369,370,373,374,375,376,377,378,379,381,382,383,385,388,391,393,395,397,398,399,401,402,403,405,406,408,409,410,411,412,413,415,416,419,420,425,427,428,429,430,431,432,433,435,436,437,438,442,447,449,450,451,453,455,458,460,464,465,466,468,469,470,473,474,475,476,478,480,482,483,484,486,489,491,493,494,495,497,500,502,504,505,506,507,509,510,511,515,518,519,520,522,523,524,526,527,528,529,531,532,533,535,537,538,540,541,542,543,544,548,550,551,553,554,555,556,557,563,565,569,570,571,572,573,574,576,577,578,579,580,582,583,584,585,588,589,590,591,595,596,601,603,604,605,606,610,614,615,617,618,619,621,622,626,628,631,636,637,638,640,641,645,647,648,649,651,652,654,655,657,658,660,663,664,666,667,668,669,670,672,674,675,676,677,679,682,683,684,685,686,687,689,691,692,693,694,695,696,697,698,699,700,702,703,705,707,708,709,710,711,712,714,716,717,718,719,720,722,725,726,727,730,734,735,736,739,740,745,746,747,748,749,751,752,753,754,755,756,757,760,761,762,765,766,767,768,770,771,772,774,776,777,778,779,780,781,782,783,784,785,787,789,790,791,792,793,795,797,798,800,801,802,803,805,806,807,808,809,810,811,812,815,818,819,822,824,825,826,827,829,831,832,835,836,838,839,840,841,842,843,844,846,847,848,849,850,852,853,855,856,857,859,864,865,866,869,872,876,877,878,879,880,881,883,887,889,890,894,895,897,898,899,900,901,902,907,908,909,910,911,912,914,915,916,917,918,920,923,925,927,929,930,931,933,934,935,936,938,941,944,946,947,948,949,950,951,953,955,956,957,958,959,960,961,963,964,965,967,968,969,970,971,976,977,978,979,982,983,984,987,988,991,994,998,1003,1004,1006,1007,1008,1010,1011,1012,1014,1015,1018,1019,1020,1021,1022,1023,1024,1025,1026,1027,1028,1029,1030,1032,1033,1037,1038,1039,1040,1041,1042,1043,1046,1051,1052,1054,1055,1057,1059,1060,1062,1066,1067,1068,1069,1070,1071,1072,1073,1074,1075,1077,1078,1080,1082,1083,1087,1089,1091,1092,1093,1095,1096,1097,1098,1100,1101,1102,1104,1107,1109,1110,1111,1112,1113,1114,1115,1116,1117,1118,1119,1120,1122,1124,1125,1126,1127,1128,1129,1131,1133,1134,1135,1136,1137,1139,1140,1141,1142,1143,1144,1145,1146,1147,1149,1150,1156,1157,1158,1159,1160,1163,1164,1166,1167,1168,1169,1170,1171,1172,1173,1175,1178,1179,1180,1182,1185,1186,1189,1190,1193,1194,1198,1200,1201,1202,1204,1205,1206,1208,1211,1213,1214,1215,1216,1219,1221,1222,1225,1226,1229,1230,1232,1233,1234,1235,1236,1238,1239,1240,1241,1242,1243,1244,1247,1248,1249,1252,1253,1254,1257,1258,1259,1260,1263,1264,1265,1267,1268,1270,1272,1274,1275,1276,1278,1279,1280,1281,1283,1284,1285,1286,1287,1289,1290,1291,1295,1298,1299,1300,1301,1302,1305,1306,1310,1312,1313,1314,1315,1316,1317,1318,1319,1320,1321,1323,1324,1325,1326,1328,1329,1330,1331,1334,1338,1339,1340,1342,1346,1347,1350,1351,1353,1354,1355,1357,1358,1359,1360,1361,1363,1364,1366,1367,1368,1369,1370,1371,1376,1378,1382,1383,1384,1386,1389,1391,1392,1393,1394,1397,1398,1401,1403,1405,1406,1413,1415,1419,1421,1422,1424,1425,1426,1427,1430,1433,1434,1437,1440,1441,1442,1443,1447,1448,1453,1460,1461,1463,1464,1465,1466,1467,1469,1470,1471,1472,1473,1474,1476,1477,1479,1480,1483,1484,1488,1489,1490,1493,1494,1495,1496,1497,1498,1499,1500,1502,1503,1505,1507,1509,1510,1511,1513,1515,1516,1519,1520,1521,1522,1523,1524,1525,1527,1528,1529,1530,1531,1539,1540,1541,1542,1543,1544,1547,1548,1549,1550,1552,1555,1556,1557,1560,1561,1562,1563,1564,1566,1567,1568,1569,1571,1572,1573,1575,1576,1580,1581,1582,1583,1584,1586,1588,1591,1592,1595,1598,1599,1600,1601,1603,1605,1606,1607,1608,1609,1611,1612,1613,1614,1615,1617,1618,1621,1624,1625,1628,1629,1630,1633,1634,1635,1636,1637,1639,1641,1643,1646,1649,1651,1652,1653,1657,1659,1660,1661,1663,1664,1665,1667,1669,1670,1671,1672,1673,1674,1675,1677,1679,1680,1681,1683,1684,1686,1687,1690,1691,1693,1694,1699,1701,1702,1703,1704,1705,1706,1707,1709,1710,1715,1716,1717,1718,1719,1720,1721,1724,1727,1728,1729,1730,1731,1734,1735,1736,1737,1738,1740,1741,1742,1746,1747,1750,1751,1752,1753,1754,1755,1756,1758,1759,1760,1761,1763,1765,1766,1767,1769,1770,1772,1773,1774,1776,1778,1779,1780,1782,1783,1784,1785,1786,1789,1790,1791,1792,1797,1798,1799,1803,1804,1805,1806,1809,1810,1813,1814,1815,1816,1820,1823,1827,1828,1829,1830,1832,1833,1834,1835,1836,1837,1838,1840,1844,1845,1846,1847,1848,1849,1850,1855,1856,1859,1860,1861,1862,1864,1865,1866,1867,1868,1872,1874,1875,1876,1877,1878,1879,1882,1883,1884,1885,1887,1889,1893,1896,1897,1899,1900,1901,1902,1903,1909,1910,1911,1912,1913,1914,1917,1919,1920,1922,1923,1924,1925,1926,1928,1929,1931,1933,1934,1935,1938,1939,1940,1941,1942,1945,1946,1948,1949,1950,1953,1954,1955,1956,1958,1960,1961,1962,1963,1966,1967,1968,1970,1973,1975,1976,1978,1980,1983,1985,1986,1987,1988,1989,1993,1994,1997,1999,2001,2003,2004,2005,2007,2008,2010,2011,2012,2013,2015,2016,2017,2018,2020,2021,2022,2024,2025,2027,2028,2029,2030,2031,2032,2034,2035,2036,2037,2038,2040,2041,2043,2044,2045,2046,2048,2050,2051,2052,2053,2056,2059,2063,2064,2065,2069,2070,2071,2072,2073,2074,2075,2076,2077,2078,2080,2083,2084,2086,2090,2091,2093,2094,2095,2098,2099,2100,2102,2103,2104,2105,2107,2109,2111,2113,2114,2115,2117,2118,2119,2120,2121,2123,2124,2125,2128,2129,2130,2132,2134,2135,2136,2137,2139,2141,2142,2143,2145,2146,2148,2149,2151,2152,2153,2154,2159,2162,2163,2164,2165,2166,2167,2168,2169,2171,2172,2173,2174,2175,2177,2179,2180,2182,2183,2186,2187,2192,2193,2195,2197,2201,2202,2203,2205,2206,2207,2208,2211,2213,2214,2218,2219,2220,2221,2222,2223,2224,2225,2228,2229,2230,2233,2234,2235,2237,2238,2239,2240,2241,2243,2245,2246,2247,2249,2251,2252,2255,2256,2258,2261,2262,2264,2265,2266,2268,2270,2271,2272,2273,2275,2276,2277,2278,2279,2280,2281,2282,2283,2284,2285,2287,2288,2289,2290,2291,2297,2298,2300,2301,2302,2303,2305,2306,2307,2308,2309,2312,2314,2315,2316,2317,2319,2322,2324,2325,2330,2332,2334,2335,2336,2338,2339,2340,2343,2344,2346,2347,2348,2349,2351,2355,2356,2357,2358,2359,2362,2363,2364,2365,2366,2368,2369,2371,2372,2373,2375,2377,2379,2381,2382,2386,2389,2392,2393,2394,2395,2398,2399,2400,2401,2402,2404,2405,2406,2407,2408,2409,2411,2413,2416,2418,2419,2421,2423,2424,2425,2427,2430,2431,2434,2436,2440,2441,2442,2444,2445,2447,2450,2451,2452,2453,2457,2460,2462,2463,2464,2467,2470,2473,2474,2476,2480,2482,2484,2487,2488,2489,2490,2498,2499,2501,2502,2504,2505,2507,2509,2510,2511,2512,2513,2514,2515,2518,2519,2520,2521,2522,2523,2524,2525,2526,2529,2530,2533,2534,2537,2539,2540,2541,2543,2545,2546,2547,2549,2550,2551,2552,2553,2554,2555,2556,2558,2559,2560,2561,2563,2564,2565,2566,2567,2569,2573,2574,2575,2576,2577,2578,2579,2581,2583,2584,2586,2587,2588,2590,2591,2594,2595,2597,2598,2599,2600,2604,2605,2606,2607,2608,2611,2612,2613,2614,2615,2616,2617,2618,2622,2623,2624,2626,2628,2629,2630,2632,2634,2636,2639,2640,2642,2644,2645,2646,2647,2648,2650,2653,2654,2655,2658,2659,2661,2663,2665,2666,2667,2668,2670,2671,2674,2675,2676,2678,2680,2681,2682,2683,2684,2686,2688,2689,2690,2691,2693,2695,2697,2698,2700,2701,2704,2705,2706,2708,2709,2710,2712,2715,2716,2719,2722,2723,2724,2725,2727,2730,2731,2734,2736,2739,2743,2744,2745,2746,2749,2753,2756,2757,2758,2767,2768,2770,2771,2772,2773,2774,2775,2776,2778,2783,2785,2786,2788,2789,2790,2793,2797,2798,2799,2800,2803,2804,2805,2806,2807,2808,2809,2810,2813,2814,2815,2816,2818,2819,2820,2822,2823,2825,2827,2828,2829,2832,2833,2834,2835,2836,2837,2839,2840,2841,2843,2844,2847,2849,2850,2851,2852,2853,2855,2856,2859,2862,2865,2867,2868,2869,2871,2872,2874,2877,2878,2879,2880,2881,2882,2884,2885,2886,2887,2888,2889,2890,2893,2895,2896,2897,2898,2900,2901,2902,2903,2905,2906,2907,2909,2911,2912,2913,2914,2915,2917,2919,2921,2922,2924,2925,2927,2928,2930,2931,2935,2936,2938,2939,2943,2945,2946,2948,2949,2950,2951,2952,2953,2955,2956,2957,2960,2961,2963,2965,2967,2968,2969,2970,2974,2975,2978,2982,2984,2985,2986,2987,2989,2990,2991,2992,2993,2995,2997,2998,3002,3003,3007,3009,3010,3011,3012,3014,3015,3017,3019,3022,3023,3024,3025,3026,3027,3028,3029,3030,3038,3039,3040,3042,3045,3046,3049,3050,3053,3054,3055,3059,3060,3061,3062,3064,3065,3066,3068,3069,3070,3072,3073,3074,3076,3078,3079,3080,3082,3083,3084,3085,3086,3091,3092,3093,3094,3095,3096,3097,3098,3099,3100,3101,3102,3103,3104,3107,3108,3109,3110,3111,3112,3113,3114,3115,3117,3119,3120,3122,3123,3124,3125,3126,3127,3129,3131,3132,3133,3136,3137,3138,3139,3143,3145,3146,3148,3150,3152,3153,3154,3155,3157,3158,3161,3162,3163,3166,3167,3169,3171,3172,3174,3175,3177,3183,3184,3186,3188,3189,3192,3193,3194,3196,3197,3198,3199,3202,3203,3204,3205,3206,3208,3211,3213,3214,3216,3217,3220,3221,3224,3225,3227,3228,3230,3231,3232,3233,3234,3235,3236,3237,3244,3245,3246,3247,3248,3249,3253,3255,3259,3261,3262,3263,3264,3268,3272,3275,3276,3277,3278,3279,3281,3282,3283,3284,3285,3288,3289,3290,3291,3292,3294,3295,3296,3298,3299,3300,3303,3308,3309,3311,3312,3313,3314,3316,3319,3320,3321,3323,3324,3326,3328,3329,3330,3332,3333,3334,3335,3336,3340,3341,3343,3345,3348,3349,3351,3352,3353,3354,3356,3357,3360,3361,3363,3364,3366,3370,3372,3373,3374,3376,3377,3378,3379,3380,3381,3386,3388,3389,3390,3393,3397,3399,3400,3405,3406,3407,3408,3409,3410,3414,3416,3418,3419,3420,3421,3423,3425,3429,3430,3431,3432,3433,3434,3437,3438,3440,3441,3443,3444,3448,3449,3451,3452,3453,3454,3455,3456,3457,3461,3462,3463,3464,3465,3466,3468,3469,3470,3471,3473,3475,3476,3480,3484,3486,3487,3490,3492,3493,3494,3495,3497,3498,3499,3500,3502,3503,3505,3506,3509,3515,3516,3517,3519,3520,3521,3523,3525,3527,3528,3530,3531,3532,3533,3534,3535,3537,3541,3542,3543,3544,3546,3548,3549,3551,3552,3555,3556,3558,3559,3561,3562,3563,3565,3567,3568,3569,3570,3571,3572,3573,3575,3576,3579,3580,3582,3583,3585,3586,3588,3589,3590,3591,3593,3594,3595,3596,3597,3598,3601,3604,3605,3606,3607,3609,3610,3612,3615,3616,3619,3620,3621,3623,3625,3626,3627,3629,3630,3631,3632,3633,3635,3636,3637,3638,3639,3641,3642,3643,3644,3645,3647,3648,3649,3651,3652,3653,3654,3656,3659,3662,3663,3667,3669,3670,3672,3673,3674,3676,3678,3679,3684,3685,3686,3689,3691,3692,3699,3700,3701,3702,3704,3705,3707,3708,3713,3715,3717,3718,3719,3720,3721,3722,3726,3727,3728,3730,3732,3733,3736,3737,3738,3739,3740,3741,3742,3743,3745,3746,3747,3750,3751,3752,3753,3754,3756,3757,3758,3761,3763,3765,3766,3767,3769,3770,3771,3776,3777,3778,3779,3780,3781,3782,3784,3786,3787,3788,3789,3792,3793,3794,3795,3797,3799,3806,3807,3808,3809,3810,3811,3812,3813,3814,3815,3816,3819,3824,3825,3826,3828,3829,3833,3834,3836,3837,3838,3841,3843,3845,3848,3851,3852,3853,3854,3855,3858,3860,3863,3865,3866,3868,3871,3873,3875,3877,3878,3880,3882,3887,3890,3892,3893,3894,3896,3897,3898,3900,3902,3905,3906,3907,3910,3915,3916,3917,3918,3919,3920,3922,3925,3928,3929,3930,3934,3936,3937,3938,3941,3943,3944,3947,3949,3951,3952,3953,3954,3955,3956,3957,3960,3962,3964,3965,3968,3969,3971,3973,3974,3975,3976,3977,3983,3985,3987,3988,3990,3993,3994,3995,3996,3997,3998,4000,4001,4002,4004,4005,4006,4007,4010,4011,4012,4013,4014,4017,4018,4020,4021,4024,4025,4026,4027,4028,4029,4031,4032,4035,4036,4039,4041,4042,4044,4046,4049,4050,4052,4053,4054,4056,4057,4058,4059,4060,4061,4064,4067,4068,4069,4071,4072,4073,4074,4075,4076,4077,4078,4083,4084,4085,4086,4087,4089,4092,4094,4096,4097,4099,4102,4104,4105,4106,4107,4108,4109,4110,4112,4116,4117,4118,4119,4120,4121,4123,4124,4126,4128,4130,4131,4136,4137,4138,4140,4141,4142,4144,4145,4146,4147,4148,4151,4152,4153,4156,4159,4162,4163,4164,4165,4168,4169,4170,4171,4172,4175,4176,4177,4178,4179,4181,4185,4190,4191,4192,4194,4195,4196,4197,4199,4200,4201,4202,4207,4212,4214,4215,4216,4217,4218,4219,4220,4221,4222,4223,4224,4225,4226,4228,4229,4230,4231,4232,4233,4234,4236,4238,4242,4244,4246,4248,4249,4251,4253,4254,4255,4256,4258,4261,4262,4263,4264,4265,4266,4267,4268,4269,4270,4271,4273,4276,4277,4288,4289,4290,4291,4292,4295,4297,4300,4302,4303,4304,4305,4306,4307,4308,4310,4311,4312,4313,4315,4317,4318,4322,4323,4324,4328,4330,4331,4332,4334,4335,4337,4338,4340,4349,4352,4355,4356,4357,4359,4360,4362,4364,4366,4368,4371,4372,4373,4374,4375,4376,4377,4378,4379,4380,4381,4382,4386,4389,4390,4391,4393,4396,4397,4398,4399,4400,4406,4409,4411,4414,4419,4420,4421,4422,4423,4428,4429,4430,4431,4433,4434,4435,4437,4438,4440,4443,4450,4452,4453,4455,4458,4459,4460,4461,4463,4465,4467,4468,4469,4471,4472,4474,4475,4477,4478,4481,4483,4485,4486,4487,4490,4491,4492,4493,4494,4496,4497,4498,4501,4507,4508,4509,4513,4514,4516,4518,4519,4520,4522,4523,4524,4525,4526,4528,4529,4530,4532,4533,4535,4537,4538,4539,4540,4541,4543,4544,4545,4548,4551,4552,4558,4561,4563,4564,4566,4567,4568,4569,4571,4572,4574,4575,4576,4577,4578,4580,4581,4583,4586,4588,4589,4590,4593,4595,4596,4597,4598,4600,4601,4602,4603,4605,4606,4608,4609,4612,4613,4615,4620,4621,4623,4624,4626,4629,4630,4634,4635,4637,4638,4639,4640,4643,4645,4646,4647,4651,4652,4653,4654,4655,4657,4658,4660,4661,4664,4667,4669,4670,4671,4674,4676,4677,4678,4685,4687,4688,4689,4690,4691,4693,4695,4696,4697,4703,4707,4708,4711,4712,4714,4715,4717,4719,4721,4722,4724,4726,4727,4728,4729,4730,4731,4732,4733,4736,4737,4738,4740,4742,4743,4744,4745,4746,4747,4748,4749,4750,4751,4753,4754,4755,4756,4758,4759,4760,4762,4763,4764,4766,4767,4768,4770,4771,4772,4773,4774,4777,4778,4781,4782,4783,4784,4785,4789,4791,4792,4793,4794,4796,4797,4800,4802,4803,4806,4807,4808,4809,4810,4811,4813,4815,4817,4818,4820,4821,4822,4823,4825,4826,4827,4828,4829,4830,4833,4836,4837,4839,4841,4842,4844,4845,4847,4849,4850,4852,4853,4854,4855,4858,4859,4860,4861,4863,4864,4865,4866,4867,4868,4869,4871,4872,4873,4877,4879,4881,4885,4886,4888,4890,4892,4893,4894,4895,4896,4900,4902,4903,4904,4906,4907,4909,4911,4912,4913,4915,4916,4917,4921,4922,4924,4925,4927,4928,4929,4930,4931,4932,4933,4936,4938,4940,4942,4946,4948,4949,4950,4951,4953,4955,4956,4960,4966,4970,4971,4972,4973,4974,4976,4977,4978,4979,4982,4983,4984,4986,4987,4990,4991,4993,4994,4996,4998,5000,5003,5004,5005,5011,5013,5014,5016,5019,5020,5021,5023,5025,5027,5028,5032,5036,5038,5039,5040,5041,5044,5046,5047,5048,5049,5052,5054,5055,5056,5058,5059,5061,5062,5063,5064,5065,5067,5068,5071,5072,5074,5075,5076,5077,5078,5081,5082,5083,5084,5090,5091,5092,5093,5094,5096,5097,5098,5101,5102,5103,5104,5107,5110,5111,5112,5113,5114,5118,5121,5122,5123,5126,5128,5129,5132,5134,5138,5140,5142,5143,5146,5148,5150,5151,5152,5154,5156,5158,5159,5160,5162,5163,5165,5166,5168,5169,5170,5172,5173,5174,5175,5176,5177,5178,5179,5180,5181,5183,5184,5185,5186,5187,5188,5190,5191,5193,5194,5195,5196,5197,5198,5200,5201,5202,5203,5204,5205,5206,5207,5208,5209,5210,5211,5212,5214,5215,5222,5223,5224,5225,5226,5227,5229,5231,5232,5234,5236,5237,5238,5239,5240,5245,5246,5248,5252,5254,5256,5258,5260,5261,5271,5273,5274,5275,5277,5278,5281,5283,5284,5285,5287,5288,5291,5293,5294,5295,5297,5298,5300,5302,5306,5309,5310,5312,5313,5314,5316,5317,5318,5319,5322,5323,5324,5325,5326,5327,5328,5329,5330,5331,5334,5335,5336,5339,5343,5345,5346,5347,5348,5349,5350,5351,5355,5356,5358,5359,5360,5361,5362,5363,5364,5365,5370,5371,5372,5374,5376,5379,5380,5382,5384,5387,5389,5393,5394,5395,5397,5399,5400,5402,5403,5406,5408,5409,5410,5412,5413,5416,5418,5419,5420,5422,5423,5425,5426,5431,5432,5433,5434,5437,5438,5439,5440,5442,5444,5445,5446,5448,5451,5453,5454,5457,5460,5461,5462,5464,5465,5466,5468,5471,5472,5473,5474,5476,5477,5478,5479,5480,5482,5485,5486,5488,5489,5490,5492,5493,5495,5496,5498,5499,5500,5504,5506,5508,5509,5510,5512,5514,5516,5517,5518,5520,5522,5524,5525,5528,5530,5532,5533,5534,5535,5538,5540,5542,5543,5544,5547,5548,5549,5550,5551,5552,5553,5555,5556,5559,5560,5561,5563,5564,5566,5569,5570,5571,5572,5573,5574,5576,5577,5578,5579,5583,5585,5586,5588,5589,5590,5594,5596,5597,5598,5600,5601,5604,5606,5607,5608,5610,5611,5614,5616,5617,5618,5620,5621,5623,5624,5625,5628,5630,5631,5632,5633,5635,5637,5638,5640,5642,5644,5646,5647,5648,5649,5650,5651,5654,5655,5656,5657,5658,5661,5662,5663,5664,5666,5668,5670,5674,5675,5676,5677,5678,5679,5680,5682,5687,5688,5689,5691,5696,5697,5698,5699,5700,5701,5703,5706,5708,5709,5710,5711,5713,5714,5720,5722,5724,5725,5726,5728,5729,5732,5734,5735,5738,5740,5741,5742,5744,5745,5746,5747,5749,5751,5752,5758,5759,5760,5762,5764,5765,5766,5769,5771,5773,5774,5775,5776,5777,5779,5780,5782,5783,5786,5789,5792,5794,5795,5796,5797,5798,5802,5803,5804,5807,5808,5809,5811,5814,5815,5816,5817,5821,5822,5824,5825,5831,5832,5833,5835,5836,5839,5841,5842,5843,5845,5846,5848,5850,5851,5852,5854,5855,5857,5858,5859,5860,5861,5862,5864,5866,5867,5872,5873,5874,5875,5876,5878,5880,5881,5882,5885,5887,5888,5889,5891,5892,5893,5896,5900,5902,5903,5904,5905,5906,5910,5911,5912,5913,5914,5915,5917,5922,5923,5925,5926,5927,5933,5935,5936,5937,5939,5940,5943,5945,5946,5947,5949,5950,5953,5955,5956,5957,5959,5960,5962,5964,5967,5969,5970,5972,5973,5975,5976,5978,5979,5981,5982,5984,5985,5986,5988,5991,5992,5995,5997,5998,5999,6001,6004,6005,6006,6007,6008,6009,6011,6012,6013,6017,6018,6019,6021,6023,6024,6025,6026,6028,6030,6034,6035,6037,6042,6043,6044,6045,6046,6048,6049,6050,6053,6054,6056,6058,6059,6060,6061,6063,6065,6066,6067,6069,6070,6073,6075,6076,6077,6079,6080,6083,6085,6086,6087,6089,6090,6091,6092,6095,6096,6098,6100,6101,6102,6103,6105,6107,6108,6110,6115,6116,6119,6120,6121,6125,6135,6136,6137,6138,6139,6141,6142,6143,6144,6145,6146,6147,6148,6149,6150,6151,6152,6153,6154,6155,6157,6158,6159,6160,6161,6162,6164,6165,6166,6168,6169,6170,6171,6172,6173,6174,6175,6176,6177,6178,6182,6184,6185,6186,6188,6189,6192,6194,6195,6196,6198,6199,6202,6204,6205,6206,6208,6209,6212,6213,6215,6216,6219,6220,6222,6223,6224,6226,6227,6231,6232,6233,6236,6238,6239,6242,6243,6244,6245,6248,6251,6253,6254,6255,6256,6257,6260,6262,6263,6265,6267,6268,6269,6270,6271,6272,6273,6275,6276,6277,6278,6282,6284,6285,6289,6290,6291,6292,6295,6296,6297,6299,6300,6304,6306,6307,6308,6310,6312,6313,6314,6316,6317,6320,6322,6323,6324,6326,6327,6329,6331,6332,6333,6335,6336,6338,6339,6341,6343,6346,6347,6348,6349,6353,6356,6358,6359,6360,6361,6362,6363,6364,6365,6366,6367,6368,6369,6370,6371,6372,6373,6374,6375,6377,6378,6379,6380,6381,6382,6385,6386,6389,6390,6392,6395,6396,6397,6403,6404,6405,6407,6408,6410,6413,6414,6415,6417,6419,6421,6427,6430,6432,6433,6434,6435,6438,6440,6441,6442,6445,6447,6448,6449,6450,6452,6453,6455,6456,6457,6458,6460,6464,6465,6467,6468,6471,6472,6474,6475,6476,6477,6481,6482,6483,6484,6485,6486,6488,6490,6491,6492,6493,6494,6495,6500,6501,6502,6503,6504,6505,6506,6511,6514,6515,6516,6517,6518,6522,6523,6525,6527,6529,6530,6533,6535,6536,6537,6539,6540,6542,6543,6544,6545,6547,6548,6551,6552,6553,6555,6556,6559,6560,6561,6563,6564,6569,6570,6572,6573,6575,6576,6577,6578,6579,6582,6585,6586,6587,6589,6593,6595,6598,6599,6600,6601,6603,6604,6606,6609,6611,6612,6617,6618,6619,6620,6622,6623,6624,6625,6626,6628,6629,6631,6634,6636,6637,6638,6640,6641,6644,6646,6647,6648,6649,6652,6653,6654,6657,6659,6660,6661,6662,6663,6664,6665,6666,6670,6673,6674,6676,6678,6679,6680,6681,6683,6684,6686,6687,6688,6689,6690,6694,6695,6696,6697,6699,6700,6702,6704,6705,6706,6708,6709,6712,6714,6715,6716,6720,6722,6723,6724,6725,6726,6727,6728,6729,6730,6731,6733,6734,6735,6736,6737,6738,6739,6741,6742,6743,6745,6746,6748,6751,6755,6756,6757,6758,6759,6761,6762,6763,6765,6767,6768,6769,6775,6776,6780,6783,6788,6789,6790,6791,6794,6799,6801,6802,6803,6805,6806,6809,6811,6812,6813,6815,6816,6819,6821,6822,6823,6825,6826,6829,6830,6832,6834,6837,6838,6839,6840,6845,6848,6850,6851,6852,6853,6854,6855,6856,6857,6858,6859,6860,6861,6862,6863,6864,6865,6866,6867,6868,6869,6871,6872,6873,6874,6875,6876,6879,6880,6882,6883,6884,6886,6889,6890,6891,6897,6898,6899,6901,6902,6904,6907,6908,6909,6911,6913,6915,6917,6918,6924,6928,6930,6931,6932,6934,6935,6938,6940,6941,6942,6944,6945,6948,6950,6951,6952,6954,6955,6957,6958,6960,6961,6963,6964,6965,6969,6972,6973,6974,6975,6976,6977,6981,6982,6983,6985,6986,6990,6991,6992,6995,6997,6999,7000,7003,7004,7005,7006,7009,7010,7011,7014,7016,7018,7019,7021,7023,7024,7026,7027,7028,7029,7030,7032,7033,7034,7035,7036,7040,7041,7045,7046,7047,7048,7053,7055,7056,7057,7059,7060,7063,7065,7066,7067,7069,7070,7073,7075,7076,7077,7079,7080,7082,7083,7085,7087,7088,7090,7091,7092,7094,7096,7097,7098,7099,7101,7102,7103,7104,7108,7109,7111,7114,7117,7119,7121,7123,7124,7125,7126,7127,7130,7131,7134,7137,7138,7140,7141,7142,7143,7144,7145,7146,7149,7150,7153,7155,7157,7160,7164,7165,7167,7169,7170,7171,7173,7176,7177,7178,7180,7181,7183,7185,7186,7187,7189,7191,7193,7194,7195,7197,7198,7200,7201,7204,7206,7207,7208,7211,7214,7215,7217,7218,7219,7220,7222,7223,7226,7228,7230,7232,7233,7234,7238,7240,7241,7244,7247,7248,7250,7251,7252,7253,7257,7259,7260,7262,7264,7265,7267,7268,7270,7272,7273,7274,7276,7277,7280,7282,7283,7284,7286,7287,7290,7292,7293,7294,7296,7297,7299,7300,7301,7302,7303,7304,7306,7307,7309,7311,7312,7313,7315,7316,7319,7320,7323,7324,7325,7326,7329,7332,7333,7334,7338,7339,7340,7341,7344,7350,7351,7352,7353,7355,7356,7361,7362,7365,7366,7369,7370,7371,7372,7373,7374,7375,7376,7378,7379,7383,7388,7390,7391,7392,7393,7394,7395,7396,7397,7398,7399,7401,7402,7403,7405,7407,7408,7411,7413,7414,7416,7417,7418,7419,7421,7422,7423,7424,7425,7428,7429,7430,7431,7432,7433,7434,7435,7436,7437,7439,7442,7444,7445,7447,7448,7450,7451,7453,7454,7455,7456,7458,7460,7463,7467,7468,7470,7473,7474,7475,7476,7477,7478,7479,7480,7481,7484,7488,7490,7493,7494,7498,7500,7501,7502,7504,7507,7509,7510,7511,7513,7514,7517,7519,7520,7521,7523,7524,7527,7529,7530,7531,7533,7534,7538,7541,7542,7543,7544,7545,7550,7551,7552,7553,7554,7556,7559,7560,7561,7563,7565,7567,7568,7569,7573,7574,7577,7578,7581,7582,7583,7584,7586,7589,7590,7591,7595,7597,7598,7600,7602,7603,7605,7606,7608,7610,7611,7612,7614,7615,7618,7620,7621,7622,7623,7626,7628,7629,7630,7632,7633,7636,7638,7639,7642,7643,7644,7645,7647,7648,7649,7650,7653,7654,7656,7657,7658,7659,7660,7661,7662,7663,7664,7665,7666,7669,7672,7673,7674,7675,7676,7677,7679,7686,7689,7690,7691,7692,7694,7695,7696,7698,7701,7704,7708,7711,7713,7714,7715,7717,7718,7719,7720,7722,7725,7726,7728,7730,7731,7732,7734,7735,7738,7740,7741,7742,7744,7745,7748,7750,7751,7752,7754,7755,7757,7759,7760,7763,7764,7765,7766,7767,7770,7771,7774,7775,7776,7777,7779,7783,7784,7788,7790,7793,7796,7797,7798,7800,7801,7802,7803,7804,7805,7806,7808,7809,7811,7812,7814,7818,7819,7821,7822,7823,7825,7826,7829,7831,7832,7833,7834,7836,7839,7841,7842,7844,7845,7847,7849,7850,7852,7853,7856,7858,7859,7861,7862,7865,7869,7870,7871,7872,7875,7877,7878,7879,7881,7883,7885,7888,7890,7893,7896,7899,7900,7901,7902,7903,7905,7908,7910,7911,7912,7915,7916,7918,7919,7920,7921,7923,7924,7926,7927,7928,7932,7934,7936,7937,7938,7940,7941,7944,7946,7947,7948,7950,7951,7954,7956,7957,7958,7960,7961,7963,7965,7966,7968,7969,7971,7972,7973,7974,7976,7978,7979,7980,7981,7982,7983,7984,7985,7988,7990,7993,7995,7996,7997,7998,7999,8000,8003,8004,8005,8008,8009,8010,8011,8012,8014,8015,8020,8022,8026,8027,8030,8032,8033,8034,8035,8037,8038,8039,8043,8045,8046,8048,8049,8050,8051,8052,8054,8058,8060,8061,8062,8064,8065,8068,8070,8071,8072,8074,8075,8078,8080,8081,8082,8086,8087,8088,8089,8090,8092,8095,8097,8099,8100,8105,8106,8107,8110,8113,8115,8118,8120,8121,8122,8124,8125,8128,8130,8131,8132,8134,8135,8138,8140,8141,8142,8144,8145,8147,8149,8151,8154,8155,8156,8157,8158,8159,8160,8162,8164,8166,8167,8170,8171,8173,8175,8176,8178,8180,8183,8185,8186,8187,8188,8189,8190,8192,8193,8201,8202,8203,8204,8205,8206,8209,8214,8215,8216,8217,8218,8219,8220,8222,8223,8224,8226,8229,8231,8232,8233,8234,8235,8236,8239,8241,8242,8244,8246,8247,8248,8249,8252,8254,8255,8257,8258,8261,8263,8264,8265,8266,8268,8269,8270,8271,8272,8275,8276,8277,8279,8280,8282,8284,8285,8286,8289,8290,8293,8294,8296,8297,8299,8300,8301,8302,8303,8304,8305,8306,8308,8309,8312,8313,8314,8316,8317,8321,8324,8325,8327,8328,8329,8330,8331,8337,8339,8340,8344,8346,8347,8348,8350,8352,8354,8355,8356,8357,8360,8362,8363,8364,8366,8367,8369,8370,8375,8376,8378,8379,8384,8386,8387,8390,8391,8392,8393,8395,8396,8397,8398,8400,8401,8402,8403,8405,8406,8407,8408,8410,8411,8412,8413,8415,8416,8417,8418,8419,8420,8421,8427,8428,8429,8430,8432,8434,8435,8437,8439,8440,8442,8443,8444,8445,8447,8449,8451,8452,8453,8455,8456,8459,8461,8462,8463,8465,8466,8469,8471,8472,8473,8475,8476,8480,8483,8484,8485,8486,8487,8488,8489,8491,8493,8494,8497,8500,8502,8505,8507,8508,8509,8510,8511,8512,8518,8519,8520,8522,8524,8525,8526,8527,8529,8530,8531,8533,8536,8538,8539,8540,8541,8543,8545,8547,8549,8551,8552,8553,8555,8556,8559,8561,8562,8563,8565,8566,8568,8570,8571,8573,8574,8575,8577,8578,8581,8582,8583,8585,8586,8589,8591,8597,8598,8600,8601,8603,8604,8606,8607,8608,8609,8610,8613,8616,8617,8618,8620,8624,8626,8627,8630,8631,8632,8633,8635,8636,8638,8641,8643,8645,8649,8650,8651,8652,8653,8654,8655,8656,8658,8659,8660,8661,8662,8664,8665,8666,8667,8669,8672,8674,8675,8676,8678,8679,8682,8684,8685,8686,8688,8689,8692,8694,8695,8696,8698,8699,8701,8702,8703,8706,8708,8709,8710,8711,8713,8715,8716,8718,8720,8722,8724,8725,8726,8727,8728,8729,8733,8734,8735,8736,8737,8740,8741,8742,8743,8745,8747,8749,8753,8754,8755,8756,8757,8758,8759,8761,8766,8767,8768,8770,8773,8774,8775,8776,8777,8778,8780,8783,8785,8786,8787,8788,8790,8791,8797,8799,8801,8802,8803,8805,8806,8809,8811,8812,8813,8815,8816,8819,8821,8822,8823,8825,8826,8829,8832,8833,8834,8835,8836,8837,8840,8842,8843,8847,8850,8853,8854,8855,8856,8857,8860,8861,8862,8863,8864,8866,8867,8871,8872,8873,8874,8875,8876,8877,8878,8879,8883,8885,8886,8887,8891,8892,8894,8898,8903,8904,8905,8909,8910,8911,8912,8914,8916,8917,8918,8919,8922,8924,8925,8926,8927,8930,8931,8932,8934,8938,8939,8940,8941,8942,8945,8946,8947,8948,8952,8954,8956,8957,8958,8959,8960,8961,8963,8964,8965,8970,8971,8972,8974,8975,8976,8979,8980,8981,8982,8984,8985,8986,8987,8988,8989,8993,8995,9000,9002,9003,9005,9007,9008,9009,9011,9012,9013,9015,9017,9019,9020,9022,9024,9025,9027,9030,9031,9033,9034,9035,9036,9039,9042,9044,9045,9047,9049,9051,9055,9056,9059,9061,9063,9064,9065,9067,9068,9071,9073,9074,9075,9077,9078,9081,9083,9084,9085,9087,9088,9090,9092,9096,9098,9099,9100,9101,9102,9103,9104,9106,9107,9108,9109,9110,9112,9113,9114,9115,9116,9117,9119,9120,9121,9124,9125,9126,9128,9132,9133,9136,9139,9140,9141,9143,9147,9150,9151,9152,9155,9156,9157,9159,9160,9161,9163,9164,9166,9169,9171,9172,9173,9175,9176,9177,9180,9182,9183,9184,9186,9187,9190,9192,9193,9194,9196,9197,9200,9202,9203,9204,9205,9208,9211,9212,9213,9217,9219,9222,9224,9227,9228,9229,9231,9232,9233,9234,9235,9237,9238,9241,9242,9243,9248,9249,9253,9257,9258,9260,9261,9262,9263,9265,9267,9268,9270,9271,9274,9275,9276,9277,9279,9280,9282,9283,9284,9285,9286,9288,9289,9290,9291,9294,9295,9298,9300,9301,9302,9305,9307,9308,9313,9314,9315,9316,9320,9321,9322,9323,9324,9326,9327,9328,9329,9330,9331,9332,9333,9335,9336,9337,9338,9340,9342,9344,9345,9347,9348,9349,9350,9353,9354,9356,9360,9363,9365,9368,9370,9371,9372,9374,9375,9378,9380,9381,9382,9384,9385,9388,9390,9391,9393,9394,9395,9398,9399,9400,9401,9402,9406,9407,9409,9410,9411,9412,9413,9415,9418,9419,9420,9422,9427,9428,9429,9430,9431,9433,9434,9435,9438,9443,9444,9445,9447,9448,9449,9450,9451,9452,9453,9458,9460,9462,9463,9464,9465,9468,9469,9471,9473,9474,9478,9479,9481,9482,9484,9485,9486,9489,9491,9492,9493,9495,9496,9499,9501,9502,9503,9505,9506,9509,9511,9512,9513,9515,9516,9518,9520,9522,9523,9524,9525,9526,9533,9534,9536,9537,9538,9540,9541,9543,9545,9546,9548,9549,9550,9551,9556,9557,9558,9559,9560,9561,9563,9564,9565,9566,9567,9570,9572,9573,9574,9575,9576,9579,9581,9582,9583,9584,9586,9588,9590,9591,9592,9593,9594,9596,9599,9600,9602,9604,9605,9606,9608,9609,9612,9614,9615,9616,9618,9619,9622,9624,9625,9626,9628,9629,9630,9636,9637,9639,9640,9641,9643,9644,9645,9646,9649,9650,9651,9652,9653,9654,9655,9656,9657,9660,9661,9662,9667,9669,9670,9671,9672,9673,9674,9675,9680,9681,9682,9683,9684,9685,9689,9690,9691,9694,9695,9697,9699,9702,9705,9707,9708,9709,9711,9712,9715,9717,9718,9719,9721,9722,9725,9727,9728,9729,9731,9732,9734,9735,9737,9738,9742,9743,9744,9745,9746,9747,9748,9749,9750,9754,9755,9758,9759,9760,9762,9764,9765,9766,9768,9770,9771,9772,9773,9774,9777,9779,9780,9781,9783,9786,9787,9788,9789,9790,9792,9795,9796,9797,9799,9802,9804,9805,9806,9807,9810,9812,9813,9814,9816,9817,9819,9821,9822,9823,9824,9827,9828,9830,9831,9834,9835,9836,9837,9838,9839,9840,9841,9844,9845,9846,9848,9851,9852,9853,9854,9857,9859,9860,9861,9863,9864,9866,9868,9869,9870,9871,9872,9873,9875,9876,9877,9878,9879,9881,9882,9883,9884,9887,9888,9889,9892,9894,9895,9896,9898,9899,9900,9903,9905,9906,9907,9909,9910,9912,9914,9915,9916,9917,9919,9920,9922,9923,9925,9926,9927,9928,9929,9931,9934,9935,9936,9941,9942,9943,9944,9946,9947,9950,9955,9956,9957,9958,9959,9960,9963,9965,9967,9968,9969,9970,9972,9974,9975,9977,9978,9979,9982,9984,9986,9987,9988,9990,9991,9994,9996,9997,9998],"errors":6095}},{"run_id":"graph-fidelity-source-sd-s101","spec":{"run_id":"graph-fidelity-source-sd-s101","stage":"evaluate","cohort":"fidelity","variant":"source-sd","recipe":"sd_constant","pmax":0.4,"input_scale":1.0,"output_relu":true,"lr":0.001,"momentum":0.9,"shrinkage":2e-05,"seed":101,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"timeout_seconds":180,"gpu":"A100","precision":"fp32"},"history":[{"epoch":1,"stochastic_training_loss":8.921187400817871,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":0.6537692989999755,"epoch_training_seconds":0.6537692989999755,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":5,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":3.168609739999937,"epoch_training_seconds":0.627154747999981,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":10,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":6.335742484999997,"epoch_training_seconds":0.6341639550000195,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":15,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":9.489914953000039,"epoch_training_seconds":0.6268126909999978,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":20,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":12.645698641999985,"epoch_training_seconds":0.6278875839999785,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":25,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":15.800454118999966,"epoch_training_seconds":0.6291423629999997,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":30,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":18.956762478999963,"epoch_training_seconds":0.6285732810000013,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":35,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":22.11771436699999,"epoch_training_seconds":0.6352545579999855,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":40,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":25.280749309999976,"epoch_training_seconds":0.6375576599999988,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":45,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":28.40980317499998,"epoch_training_seconds":0.6308978540000112,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":50,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":31.56242364099998,"epoch_training_seconds":0.6318914340000106,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":55,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":34.715033225999974,"epoch_training_seconds":0.62497000999997,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":60,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":37.878716339999954,"epoch_training_seconds":0.6300290979999659,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":65,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":41.031837537999905,"epoch_training_seconds":0.6348526520000064,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":70,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":44.182380323999865,"epoch_training_seconds":0.6262237230000096,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":75,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":47.33254829699993,"epoch_training_seconds":0.632311188000017,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":80,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":50.48144303299992,"epoch_training_seconds":0.6341211399999906,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":85,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":53.63318112900001,"epoch_training_seconds":0.6371435840000004,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":90,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":56.784946908999956,"epoch_training_seconds":0.6298252849999812,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":95,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":59.943851592000016,"epoch_training_seconds":0.6343724950000365,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":100,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":63.09232125100013,"epoch_training_seconds":0.632453546000022,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]}],"best_epoch":1,"best_validation_loss":2.302585546875,"training_seconds":63.09232125100013,"total_run_seconds":64.70638588599999,"hardware":{"device":"cuda:0","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"e1efb33081a653eb2db13a44aa7d20f3f16925ea1dc8bc2e91ed2f639a3974ae","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[7719,15527,23589,31320],"final_train":{"loss":2.3025853125,"accuracy":0.09802,"n":50000},"selected_train":{"loss":2.3025853125,"accuracy":0.09802,"n":50000},"final_test":{"loss":2.302585546875,"accuracy":0.098,"n":10000,"wrong_indices":[0,1,2,4,5,6,7,8,9,11,12,14,15,16,17,18,19,20,21,22,23,24,26,27,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,56,57,58,59,60,61,62,63,64,65,66,67,68,70,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,127,128,129,130,131,132,133,134,135,137,138,139,140,141,142,143,144,145,146,147,149,150,151,152,153,154,155,156,158,159,160,161,162,163,164,165,166,167,168,169,170,171,172,173,174,175,176,177,178,179,180,181,182,184,185,186,187,189,190,191,193,195,196,197,198,199,200,201,202,203,204,205,206,207,208,209,210,211,212,213,214,216,217,218,219,220,221,222,223,224,225,226,227,228,229,230,231,232,233,234,235,236,237,238,239,240,241,242,243,244,245,247,248,249,250,251,252,253,254,255,256,257,258,259,260,261,262,263,264,265,266,267,268,270,272,273,274,275,276,277,278,279,280,281,282,283,284,285,286,287,288,289,290,291,292,293,295,298,299,300,301,302,303,304,306,307,308,309,310,313,314,315,316,317,318,319,320,321,322,323,325,326,328,329,330,331,332,333,334,335,336,337,338,339,340,341,342,343,344,345,347,348,349,350,351,352,353,354,355,356,357,358,359,360,361,362,363,364,366,367,368,369,370,371,373,374,375,376,377,378,379,381,382,383,384,385,386,387,388,389,390,391,392,393,394,395,396,397,398,399,400,401,402,403,404,405,406,408,409,410,411,412,413,414,415,416,417,418,419,420,421,422,423,425,426,427,428,429,430,431,432,433,434,435,436,437,438,439,442,444,445,446,447,448,449,450,451,452,453,454,455,456,457,458,460,461,462,463,464,465,466,467,468,469,470,471,472,473,474,475,476,477,478,479,480,481,482,483,484,486,487,488,489,491,492,493,494,495,496,497,499,500,501,502,503,504,505,506,507,508,509,510,511,512,513,514,515,516,517,518,519,520,521,522,523,524,526,527,528,529,530,531,532,533,534,535,536,537,538,539,540,541,542,543,544,547,548,549,550,551,553,554,555,556,557,558,559,560,562,563,565,566,568,569,570,571,572,573,574,575,576,577,578,579,580,582,583,584,585,587,588,589,590,591,593,594,595,596,598,599,600,601,602,603,604,605,606,607,609,610,612,613,614,615,616,617,618,619,621,622,623,624,625,626,627,628,629,630,631,632,633,634,635,636,637,638,639,640,641,643,645,646,647,648,649,650,651,652,653,654,655,657,658,659,660,662,663,664,665,666,667,668,669,670,671,672,673,674,675,676,677,678,679,680,681,682,683,684,685,686,687,688,689,690,691,692,693,694,695,696,697,698,699,700,702,703,705,706,707,708,709,710,711,712,714,715,716,718,719,720,722,724,725,726,727,728,729,730,731,732,733,734,735,736,737,738,739,740,741,743,744,745,746,747,748,749,751,752,753,754,755,756,757,758,759,760,761,762,764,765,766,767,768,769,770,771,772,773,774,775,776,777,778,779,780,781,782,783,784,785,786,787,788,789,790,791,792,793,795,796,797,798,799,800,801,802,803,805,806,807,808,809,810,811,812,813,814,815,816,817,818,819,820,822,823,824,825,826,827,828,829,830,831,832,833,834,835,836,837,838,839,840,841,842,843,844,846,847,848,849,850,852,853,855,856,857,858,859,860,861,862,863,864,865,866,867,868,869,870,872,873,874,875,876,877,878,879,880,881,882,883,885,886,887,888,889,890,891,892,893,894,897,898,899,900,901,902,903,905,906,907,908,909,910,911,912,913,914,915,916,917,918,919,920,921,922,923,924,925,926,927,928,929,930,931,933,934,935,936,937,938,939,940,941,942,943,944,945,946,947,948,949,950,951,952,953,954,955,956,957,958,959,960,961,962,963,964,965,966,967,968,969,970,971,973,974,975,976,977,978,979,980,982,983,984,985,986,987,988,989,990,991,992,994,995,996,998,999,1000,1002,1003,1004,1005,1006,1007,1008,1010,1011,1012,1013,1014,1015,1016,1017,1018,1019,1020,1021,1022,1023,1024,1025,1026,1027,1028,1029,1030,1031,1032,1033,1035,1036,1037,1038,1039,1040,1041,1042,1043,1044,1045,1046,1048,1049,1050,1051,1052,1053,1054,1055,1056,1057,1058,1059,1060,1062,1063,1064,1065,1066,1067,1068,1069,1070,1071,1072,1073,1074,1075,1076,1077,1078,1079,1080,1081,1082,1083,1085,1086,1087,1088,1089,1090,1091,1092,1093,1095,1096,1097,1098,1099,1100,1101,1102,1103,1104,1105,1106,1107,1108,1109,1110,1111,1112,1113,1114,1115,1116,1117,1118,1119,1120,1122,1123,1124,1125,1126,1127,1128,1129,1130,1131,1132,1133,1134,1135,1136,1137,1138,1139,1140,1141,1142,1143,1144,1145,1146,1147,1149,1150,1151,1152,1153,1155,1156,1157,1158,1159,1160,1161,1162,1163,1164,1165,1166,1167,1168,1169,1170,1171,1172,1173,1174,1175,1177,1178,1179,1180,1181,1182,1183,1184,1185,1186,1187,1189,1190,1192,1193,1194,1196,1198,1199,1200,1201,1202,1204,1205,1206,1207,1208,1209,1210,1211,1212,1213,1214,1215,1216,1217,1219,1221,1222,1224,1225,1226,1227,1228,1229,1230,1232,1233,1234,1235,1236,1237,1238,1239,1240,1241,1242,1243,1244,1245,1247,1248,1249,1250,1251,1252,1253,1254,1255,1256,1257,1258,1259,1260,1262,1263,1264,1265,1266,1267,1268,1269,1270,1272,1274,1275,1276,1277,1278,1279,1280,1281,1282,1283,1284,1285,1286,1287,1289,1290,1291,1292,1293,1295,1296,1298,1299,1300,1301,1302,1303,1304,1305,1306,1307,1308,1309,1310,1311,1312,1313,1314,1315,1316,1317,1318,1319,1320,1321,1322,1323,1324,1325,1326,1327,1328,1329,1330,1331,1332,1334,1335,1336,1337,1338,1339,1340,1341,1342,1343,1344,1345,1346,1347,1348,1349,1350,1351,1352,1353,1354,1355,1356,1357,1358,1359,1360,1361,1362,1363,1364,1365,1366,1367,1368,1369,1370,1371,1372,1373,1374,1375,1376,1377,1378,1380,1381,1382,1383,1384,1385,1386,1387,1388,1389,1391,1392,1393,1394,1395,1396,1397,1398,1400,1401,1402,1403,1405,1406,1407,1409,1410,1412,1413,1414,1415,1417,1418,1419,1420,1421,1422,1423,1424,1425,1426,1427,1428,1429,1430,1431,1432,1433,1434,1435,1436,1437,1439,1440,1441,1442,1443,1444,1446,1447,1448,1449,1450,1451,1452,1453,1455,1456,1458,1459,1460,1461,1462,1463,1464,1465,1466,1467,1469,1470,1471,1472,1473,1474,1475,1476,1477,1478,1479,1480,1481,1482,1483,1484,1485,1486,1488,1489,1490,1491,1492,1493,1494,1495,1496,1497,1498,1499,1500,1501,1502,1503,1505,1506,1507,1508,1509,1510,1511,1512,1513,1514,1515,1516,1518,1519,1520,1521,1522,1523,1524,1525,1527,1528,1529,1530,1531,1532,1536,1537,1538,1539,1540,1541,1542,1543,1544,1545,1546,1547,1548,1549,1550,1551,1552,1553,1554,1555,1556,1557,1559,1560,1561,1562,1563,1564,1566,1567,1568,1569,1571,1572,1573,1574,1575,1576,1577,1578,1579,1580,1581,1582,1583,1584,1585,1586,1587,1588,1591,1592,1593,1594,1595,1596,1597,1598,1599,1600,1601,1602,1603,1604,1605,1606,1607,1608,1609,1611,1612,1613,1614,1615,1616,1617,1618,1620,1622,1624,1625,1626,1627,1628,1629,1630,1631,1632,1633,1634,1635,1636,1637,1639,1640,1641,1642,1643,1644,1645,1646,1647,1648,1649,1651,1652,1653,1654,1655,1656,1657,1658,1659,1660,1661,1662,1663,1664,1665,1666,1667,1668,1669,1670,1671,1672,1673,1674,1675,1676,1677,1678,1679,1680,1681,1682,1683,1684,1685,1686,1687,1688,1689,1690,1691,1693,1694,1695,1696,1697,1698,1699,1701,1702,1703,1704,1705,1706,1707,1709,1710,1711,1714,1715,1716,1717,1718,1719,1720,1721,1722,1724,1725,1727,1728,1729,1730,1731,1732,1733,1734,1735,1736,1737,1738,1740,1741,1742,1743,1744,1745,1746,1747,1749,1750,1751,1752,1753,1754,1755,1756,1758,1759,1760,1761,1763,1765,1766,1767,1769,1770,1771,1772,1773,1774,1776,1778,1779,1780,1781,1782,1783,1784,1785,1786,1787,1788,1789,1790,1791,1792,1793,1795,1797,1798,1799,1800,1801,1802,1803,1804,1805,1806,1809,1810,1811,1812,1813,1814,1815,1816,1817,1818,1819,1820,1821,1822,1823,1824,1825,1827,1828,1829,1830,1831,1832,1833,1834,1835,1836,1837,1838,1839,1840,1842,1844,1845,1846,1847,1848,1849,1850,1851,1852,1853,1854,1855,1856,1857,1858,1859,1860,1861,1862,1863,1864,1865,1866,1867,1868,1869,1871,1872,1873,1874,1875,1876,1877,1878,1879,1880,1881,1882,1883,1884,1885,1886,1887,1888,1889,1890,1891,1893,1894,1895,1896,1897,1899,1900,1901,1902,1903,1904,1905,1906,1908,1909,1910,1911,1912,1913,1914,1915,1916,1917,1919,1920,1921,1922,1923,1924,1925,1926,1927,1928,1929,1930,1931,1932,1933,1934,1935,1936,1937,1938,1939,1940,1941,1942,1943,1945,1946,1947,1948,1949,1950,1951,1952,1953,1954,1955,1956,1957,1958,1960,1961,1962,1963,1964,1965,1966,1967,1968,1969,1970,1971,1973,1974,1975,1976,1977,1978,1979,1980,1981,1982,1983,1984,1985,1986,1988,1989,1990,1991,1992,1993,1994,1996,1997,1998,1999,2000,2001,2002,2003,2004,2005,2006,2007,2008,2009,2010,2011,2012,2013,2014,2015,2016,2017,2018,2019,2020,2021,2022,2024,2025,2026,2027,2028,2029,2030,2031,2032,2034,2035,2036,2037,2038,2039,2040,2041,2043,2044,2045,2046,2047,2048,2049,2050,2051,2052,2053,2054,2055,2056,2057,2058,2059,2062,2063,2064,2065,2066,2068,2069,2070,2071,2072,2073,2074,2075,2076,2077,2078,2079,2080,2082,2083,2084,2085,2086,2088,2089,2090,2091,2092,2093,2094,2095,2097,2098,2099,2100,2101,2102,2103,2104,2105,2107,2108,2109,2110,2111,2112,2113,2114,2115,2116,2117,2118,2119,2120,2121,2122,2123,2124,2125,2126,2128,2129,2130,2131,2132,2133,2134,2135,2136,2137,2138,2139,2140,2141,2142,2143,2144,2145,2146,2147,2148,2149,2150,2151,2152,2153,2154,2156,2157,2158,2159,2160,2161,2162,2163,2164,2165,2166,2167,2168,2169,2170,2171,2172,2173,2174,2175,2176,2177,2179,2180,2181,2182,2183,2184,2186,2187,2189,2191,2192,2193,2194,2195,2196,2197,2198,2199,2200,2201,2202,2203,2205,2206,2207,2208,2210,2211,2212,2213,2214,2215,2216,2218,2219,2220,2221,2222,2223,2224,2225,2227,2228,2229,2230,2231,2232,2233,2234,2235,2237,2238,2239,2240,2241,2242,2243,2244,2245,2246,2247,2248,2249,2250,2251,2252,2253,2254,2255,2256,2257,2258,2259,2260,2261,2262,2263,2264,2265,2266,2267,2268,2269,2270,2271,2272,2273,2274,2275,2276,2277,2278,2279,2280,2281,2282,2283,2284,2285,2286,2287,2288,2289,2290,2291,2292,2293,2296,2297,2298,2299,2300,2301,2302,2303,2305,2306,2307,2308,2309,2310,2311,2312,2313,2314,2315,2316,2317,2319,2320,2321,2322,2323,2324,2325,2327,2330,2331,2332,2334,2335,2336,2337,2338,2339,2340,2341,2342,2343,2344,2345,2346,2347,2348,2349,2350,2351,2352,2353,2354,2355,2356,2357,2358,2359,2360,2361,2362,2363,2364,2365,2366,2367,2368,2369,2371,2372,2373,2374,2375,2377,2379,2380,2381,2382,2383,2386,2387,2388,2389,2390,2391,2392,2393,2394,2395,2396,2397,2398,2399,2400,2401,2402,2404,2405,2406,2407,2408,2409,2411,2412,2413,2414,2415,2416,2418,2419,2420,2421,2422,2423,2424,2425,2426,2427,2428,2429,2430,2431,2432,2433,2434,2436,2437,2438,2439,2440,2441,2442,2443,2444,2445,2446,2447,2448,2450,2451,2452,2453,2454,2456,2457,2458,2459,2460,2462,2463,2464,2465,2466,2467,2468,2469,2470,2471,2472,2473,2474,2475,2476,2477,2478,2480,2481,2482,2483,2484,2486,2487,2488,2489,2490,2491,2493,2494,2495,2496,2497,2498,2499,2500,2501,2502,2503,2504,2505,2507,2508,2509,2510,2511,2512,2513,2514,2515,2516,2517,2518,2519,2520,2521,2522,2523,2524,2525,2526,2528,2529,2530,2532,2533,2534,2535,2537,2538,2539,2540,2541,2542,2543,2544,2545,2546,2547,2548,2549,2550,2551,2552,2553,2554,2555,2556,2558,2559,2560,2561,2562,2563,2564,2565,2566,2567,2569,2570,2572,2573,2574,2575,2576,2577,2578,2579,2580,2581,2582,2583,2584,2585,2586,2587,2588,2589,2590,2591,2594,2595,2596,2597,2598,2599,2600,2601,2602,2603,2604,2605,2606,2607,2608,2609,2610,2611,2612,2613,2614,2615,2616,2617,2618,2620,2621,2622,2623,2624,2625,2626,2628,2629,2630,2632,2633,2634,2635,2636,2637,2639,2640,2642,2643,2644,2645,2646,2647,2648,2650,2651,2652,2653,2654,2655,2658,2659,2661,2662,2663,2664,2665,2666,2667,2668,2669,2670,2671,2672,2673,2674,2675,2676,2677,2678,2679,2680,2681,2682,2683,2684,2685,2686,2688,2689,2690,2691,2692,2693,2694,2695,2696,2697,2698,2699,2700,2701,2702,2704,2705,2706,2708,2709,2710,2711,2712,2715,2716,2718,2719,2720,2721,2722,2723,2724,2725,2726,2727,2728,2729,2730,2731,2732,2734,2735,2736,2737,2738,2739,2740,2741,2742,2743,2744,2745,2746,2749,2750,2751,2752,2753,2754,2755,2756,2757,2758,2759,2760,2762,2766,2767,2768,2769,2770,2771,2772,2773,2774,2775,2776,2778,2780,2781,2782,2783,2784,2785,2786,2787,2788,2789,2790,2791,2792,2793,2795,2796,2797,2798,2799,2800,2801,2802,2803,2804,2805,2806,2807,2808,2809,2810,2812,2813,2814,2815,2816,2818,2819,2820,2822,2823,2825,2826,2827,2828,2829,2830,2831,2832,2833,2834,2835,2836,2837,2838,2839,2840,2841,2843,2844,2845,2846,2847,2848,2849,2850,2851,2852,2853,2854,2855,2856,2857,2858,2859,2860,2861,2862,2863,2864,2865,2866,2867,2868,2869,2870,2871,2872,2874,2875,2876,2877,2878,2879,2880,2881,2882,2883,2884,2885,2886,2887,2888,2889,2890,2891,2892,2893,2895,2896,2897,2898,2900,2901,2902,2903,2904,2905,2906,2907,2908,2909,2910,2911,2912,2913,2914,2915,2916,2917,2918,2919,2920,2921,2922,2923,2924,2925,2926,2927,2928,2929,2930,2931,2933,2934,2935,2936,2938,2939,2940,2941,2943,2945,2946,2947,2948,2949,2950,2951,2952,2953,2955,2956,2957,2958,2959,2960,2961,2963,2964,2965,2966,2967,2968,2969,2970,2971,2973,2974,2975,2976,2977,2978,2979,2980,2981,2982,2983,2984,2985,2986,2987,2989,2990,2991,2992,2993,2994,2995,2997,2998,3000,3001,3002,3003,3004,3005,3006,3007,3008,3009,3010,3011,3012,3014,3015,3017,3018,3019,3021,3022,3023,3024,3025,3026,3027,3028,3029,3030,3031,3033,3034,3035,3036,3037,3038,3039,3040,3041,3042,3045,3046,3047,3048,3049,3050,3051,3053,3054,3055,3056,3057,3058,3059,3060,3061,3062,3063,3064,3065,3066,3067,3068,3069,3070,3071,3072,3073,3074,3075,3076,3078,3079,3080,3081,3082,3083,3084,3085,3086,3088,3089,3091,3092,3093,3094,3095,3096,3097,3098,3099,3100,3101,3102,3103,3104,3105,3106,3107,3108,3109,3110,3111,3112,3113,3114,3115,3116,3117,3118,3119,3120,3121,3122,3123,3124,3125,3126,3127,3128,3129,3130,3131,3132,3133,3134,3135,3136,3137,3138,3139,3141,3142,3143,3144,3145,3146,3147,3148,3149,3150,3151,3152,3153,3154,3155,3156,3157,3158,3159,3160,3161,3162,3163,3164,3165,3166,3167,3168,3169,3171,3172,3173,3174,3175,3176,3177,3180,3181,3182,3183,3184,3186,3187,3188,3189,3190,3192,3193,3194,3195,3196,3197,3198,3199,3200,3201,3202,3203,3204,3205,3206,3207,3208,3209,3211,3212,3213,3214,3216,3217,3218,3220,3221,3222,3223,3224,3225,3227,3228,3229,3230,3231,3232,3233,3234,3235,3236,3237,3238,3239,3240,3241,3244,3245,3246,3247,3248,3249,3250,3252,3253,3254,3255,3256,3257,3258,3259,3260,3261,3262,3263,3264,3267,3268,3269,3270,3272,3273,3274,3275,3276,3277,3278,3279,3280,3281,3282,3283,3284,3285,3286,3287,3288,3289,3290,3291,3292,3293,3294,3295,3296,3298,3299,3300,3301,3302,3303,3304,3307,3308,3309,3311,3312,3313,3314,3316,3318,3319,3320,3321,3323,3324,3326,3327,3328,3329,3330,3331,3332,3333,3334,3335,3336,3337,3338,3339,3340,3341,3342,3343,3344,3345,3348,3349,3350,3351,3352,3353,3354,3355,3356,3357,3360,3361,3362,3363,3364,3365,3366,3367,3369,3370,3372,3373,3374,3375,3376,3377,3378,3379,3380,3381,3382,3383,3384,3385,3386,3387,3388,3389,3390,3391,3392,3393,3394,3395,3396,3397,3398,3399,3400,3402,3403,3404,3405,3406,3407,3408,3409,3410,3411,3414,3415,3416,3418,3419,3420,3421,3422,3423,3424,3425,3426,3427,3428,3429,3430,3431,3432,3433,3434,3435,3436,3437,3438,3440,3441,3442,3443,3444,3447,3448,3449,3451,3452,3453,3454,3455,3456,3457,3459,3460,3461,3462,3463,3464,3465,3466,3467,3468,3469,3470,3471,3472,3473,3474,3475,3476,3477,3478,3480,3482,3483,3484,3485,3486,3487,3488,3489,3490,3491,3492,3493,3494,3495,3497,3498,3499,3500,3501,3502,3503,3504,3505,3506,3507,3508,3509,3510,3511,3513,3514,3515,3516,3517,3518,3519,3520,3521,3522,3523,3524,3525,3526,3527,3528,3529,3530,3531,3532,3533,3534,3535,3537,3538,3539,3541,3542,3543,3544,3545,3546,3547,3548,3549,3550,3551,3552,3553,3554,3555,3556,3557,3558,3559,3560,3561,3562,3563,3564,3565,3566,3567,3568,3569,3570,3571,3572,3573,3575,3576,3577,3578,3579,3580,3582,3583,3585,3586,3587,3588,3589,3590,3591,3592,3593,3594,3595,3596,3597,3598,3599,3600,3601,3602,3603,3604,3605,3606,3607,3609,3610,3611,3612,3614,3615,3616,3617,3618,3619,3620,3621,3622,3623,3625,3626,3627,3628,3629,3630,3631,3632,3633,3635,3636,3637,3638,3639,3641,3642,3643,3644,3645,3647,3648,3649,3651,3652,3653,3654,3655,3656,3657,3658,3659,3661,3662,3663,3664,3665,3666,3667,3668,3669,3670,3671,3672,3673,3674,3675,3676,3678,3679,3681,3682,3683,3684,3685,3686,3687,3688,3689,3690,3691,3692,3693,3694,3696,3697,3699,3700,3701,3702,3703,3704,3705,3707,3708,3709,3711,3712,3713,3714,3715,3716,3717,3718,3719,3720,3721,3722,3723,3725,3726,3727,3728,3729,3730,3731,3732,3733,3736,3737,3738,3739,3740,3741,3742,3743,3744,3745,3746,3747,3748,3749,3750,3751,3752,3753,3754,3755,3756,3757,3758,3759,3760,3761,3762,3763,3765,3766,3767,3769,3770,3771,3772,3773,3775,3776,3777,3778,3779,3780,3781,3782,3783,3784,3785,3786,3787,3788,3789,3791,3792,3793,3794,3795,3796,3797,3798,3799,3800,3801,3802,3806,3807,3808,3809,3810,3811,3812,3813,3814,3815,3816,3817,3819,3820,3821,3822,3823,3824,3825,3826,3827,3828,3829,3831,3832,3833,3834,3835,3836,3837,3838,3839,3840,3841,3842,3843,3844,3845,3846,3848,3850,3851,3852,3853,3854,3855,3856,3857,3858,3859,3860,3861,3862,3863,3865,3866,3868,3869,3871,3872,3873,3874,3875,3876,3877,3878,3879,3880,3881,3882,3884,3885,3886,3887,3888,3889,3890,3891,3892,3893,3894,3896,3897,3898,3899,3900,3901,3902,3904,3905,3906,3907,3908,3909,3910,3912,3913,3914,3915,3916,3917,3918,3919,3920,3921,3922,3923,3924,3925,3926,3927,3928,3929,3930,3931,3932,3933,3934,3935,3936,3937,3938,3939,3941,3943,3944,3945,3946,3947,3948,3949,3950,3951,3952,3953,3954,3955,3956,3957,3958,3960,3961,3962,3963,3964,3965,3966,3967,3968,3969,3970,3971,3972,3973,3974,3975,3976,3977,3978,3979,3981,3983,3984,3985,3986,3987,3988,3990,3991,3992,3993,3994,3995,3996,3997,3998,3999,4000,4001,4002,4003,4004,4005,4006,4007,4008,4009,4010,4011,4012,4013,4014,4015,4016,4017,4018,4019,4020,4021,4022,4024,4025,4026,4027,4028,4029,4030,4031,4032,4035,4036,4037,4038,4039,4040,4041,4042,4044,4045,4046,4047,4049,4050,4051,4052,4053,4054,4055,4056,4057,4058,4059,4060,4061,4063,4064,4066,4067,4068,4069,4071,4072,4073,4074,4075,4076,4077,4078,4081,4083,4084,4085,4086,4087,4088,4089,4092,4093,4094,4095,4096,4097,4098,4099,4100,4101,4102,4103,4104,4105,4106,4107,4108,4109,4110,4111,4112,4113,4114,4115,4116,4117,4118,4119,4120,4121,4122,4123,4124,4125,4126,4127,4128,4129,4130,4131,4132,4133,4134,4135,4136,4137,4138,4139,4140,4141,4142,4143,4144,4145,4147,4148,4149,4151,4152,4153,4154,4156,4158,4159,4160,4161,4162,4163,4164,4165,4167,4168,4169,4170,4171,4172,4173,4174,4175,4176,4177,4178,4179,4180,4181,4182,4183,4184,4185,4187,4189,4190,4191,4192,4193,4194,4195,4196,4197,4198,4199,4200,4201,4202,4203,4204,4205,4206,4207,4209,4210,4211,4212,4213,4214,4215,4216,4217,4218,4219,4220,4221,4222,4223,4224,4225,4226,4228,4229,4230,4231,4232,4233,4234,4235,4236,4237,4238,4239,4240,4242,4243,4244,4245,4246,4247,4248,4249,4250,4251,4252,4253,4254,4255,4256,4257,4258,4259,4260,4261,4262,4263,4264,4265,4266,4267,4268,4269,4270,4271,4272,4273,4274,4275,4276,4277,4279,4280,4283,4284,4285,4287,4288,4289,4290,4291,4292,4293,4294,4295,4296,4297,4298,4299,4300,4301,4302,4303,4304,4305,4306,4307,4308,4309,4310,4311,4312,4313,4314,4315,4316,4317,4318,4319,4321,4322,4323,4324,4325,4326,4328,4330,4331,4332,4333,4334,4335,4336,4337,4338,4339,4340,4341,4342,4344,4345,4346,4347,4349,4350,4352,4354,4355,4356,4357,4358,4359,4360,4362,4363,4364,4366,4367,4368,4369,4371,4372,4373,4374,4375,4376,4377,4378,4379,4380,4381,4382,4383,4384,4385,4386,4387,4388,4389,4390,4391,4393,4394,4395,4396,4397,4398,4399,4400,4401,4402,4405,4406,4407,4408,4409,4410,4411,4412,4413,4414,4415,4416,4417,4418,4419,4420,4421,4422,4423,4424,4425,4426,4427,4428,4429,4430,4431,4433,4434,4435,4436,4437,4438,4439,4440,4441,4442,4443,4444,4445,4446,4449,4450,4451,4452,4453,4454,4455,4456,4458,4459,4460,4461,4463,4464,4465,4466,4467,4468,4469,4471,4472,4474,4475,4476,4478,4479,4480,4481,4482,4483,4484,4485,4486,4487,4488,4489,4490,4491,4492,4493,4494,4496,4497,4498,4499,4500,4501,4502,4503,4504,4505,4506,4507,4508,4509,4510,4511,4512,4513,4514,4516,4517,4518,4519,4520,4521,4522,4523,4524,4525,4526,4528,4529,4530,4532,4533,4534,4535,4536,4537,4538,4539,4540,4541,4543,4544,4545,4546,4547,4548,4549,4550,4551,4552,4553,4555,4556,4557,4558,4559,4560,4561,4562,4563,4564,4565,4566,4567,4568,4569,4570,4571,4572,4573,4574,4575,4576,4577,4578,4579,4580,4581,4582,4583,4584,4585,4586,4587,4588,4589,4590,4591,4592,4593,4594,4595,4596,4597,4598,4599,4600,4601,4602,4603,4605,4606,4607,4608,4609,4610,4612,4613,4615,4616,4618,4619,4620,4621,4622,4623,4624,4625,4626,4627,4629,4630,4632,4633,4634,4635,4636,4637,4638,4639,4640,4643,4644,4645,4646,4647,4648,4649,4651,4652,4653,4654,4655,4656,4657,4658,4659,4660,4661,4662,4663,4664,4665,4666,4667,4668,4669,4670,4671,4673,4674,4676,4677,4678,4679,4680,4681,4682,4683,4684,4685,4686,4687,4688,4689,4690,4691,4692,4693,4694,4695,4696,4697,4698,4699,4700,4701,4702,4703,4704,4705,4706,4707,4708,4709,4710,4711,4712,4713,4714,4715,4716,4717,4719,4721,4722,4723,4724,4725,4726,4727,4728,4729,4730,4731,4732,4733,4734,4735,4736,4737,4738,4740,4742,4743,4744,4745,4746,4747,4748,4749,4750,4751,4752,4753,4754,4755,4756,4758,4759,4760,4761,4762,4763,4764,4765,4766,4767,4768,4769,4770,4771,4772,4773,4774,4775,4777,4778,4779,4781,4782,4783,4784,4785,4786,4787,4789,4790,4791,4792,4793,4794,4795,4796,4797,4798,4799,4800,4801,4802,4803,4805,4806,4807,4808,4809,4810,4811,4812,4813,4814,4815,4816,4817,4818,4820,4821,4822,4823,4825,4826,4827,4828,4829,4830,4831,4832,4833,4835,4836,4837,4838,4839,4840,4841,4842,4843,4844,4845,4846,4847,4848,4849,4850,4851,4852,4853,4854,4855,4856,4858,4859,4860,4861,4863,4864,4865,4866,4867,4868,4869,4870,4871,4872,4873,4874,4875,4876,4877,4878,4879,4881,4882,4883,4884,4885,4886,4888,4889,4890,4892,4893,4894,4895,4896,4897,4898,4899,4900,4901,4902,4903,4904,4905,4906,4907,4908,4909,4910,4911,4912,4913,4914,4915,4916,4917,4918,4919,4920,4921,4922,4924,4925,4926,4927,4928,4929,4930,4931,4932,4933,4934,4936,4938,4939,4940,4941,4942,4943,4944,4945,4946,4947,4948,4949,4950,4951,4952,4953,4954,4955,4956,4960,4961,4962,4963,4964,4965,4966,4967,4968,4969,4970,4971,4972,4973,4974,4975,4976,4977,4978,4979,4980,4981,4982,4983,4984,4985,4986,4987,4988,4989,4990,4991,4993,4994,4995,4996,4997,4998,5000,5001,5002,5003,5004,5005,5007,5009,5010,5011,5012,5013,5014,5015,5016,5017,5018,5019,5020,5021,5022,5023,5024,5025,5026,5027,5028,5029,5030,5032,5034,5036,5037,5038,5039,5040,5041,5042,5044,5045,5046,5047,5048,5049,5050,5052,5053,5054,5055,5056,5057,5058,5059,5060,5061,5062,5063,5064,5065,5066,5067,5068,5070,5071,5072,5073,5074,5075,5076,5077,5078,5080,5081,5082,5083,5084,5085,5086,5088,5089,5090,5091,5092,5093,5094,5095,5096,5097,5098,5099,5100,5101,5102,5103,5104,5105,5106,5107,5110,5111,5112,5113,5114,5115,5116,5117,5118,5119,5120,5121,5122,5123,5125,5126,5127,5128,5129,5130,5131,5132,5134,5135,5136,5137,5138,5140,5142,5143,5144,5145,5146,5148,5149,5150,5151,5152,5153,5154,5156,5157,5158,5159,5160,5161,5162,5163,5164,5166,5167,5168,5169,5170,5171,5172,5173,5174,5175,5176,5177,5178,5179,5180,5181,5182,5183,5184,5185,5186,5187,5188,5189,5190,5191,5192,5193,5194,5195,5196,5197,5198,5199,5200,5201,5202,5203,5204,5205,5206,5207,5208,5209,5210,5211,5212,5213,5214,5215,5216,5217,5218,5219,5220,5221,5222,5223,5224,5225,5226,5227,5228,5229,5230,5231,5232,5233,5234,5235,5236,5237,5238,5239,5240,5242,5245,5246,5247,5248,5250,5252,5254,5256,5258,5260,5261,5262,5263,5264,5265,5266,5267,5268,5269,5271,5272,5273,5274,5275,5276,5277,5278,5279,5281,5282,5283,5284,5285,5286,5287,5288,5289,5291,5292,5293,5294,5295,5296,5297,5298,5299,5300,5302,5303,5304,5306,5308,5309,5310,5311,5312,5313,5314,5315,5316,5317,5318,5319,5322,5323,5324,5325,5326,5327,5328,5329,5330,5331,5332,5333,5334,5335,5336,5338,5339,5340,5341,5343,5344,5345,5346,5347,5348,5349,5350,5351,5352,5354,5355,5356,5357,5358,5359,5360,5361,5362,5363,5364,5365,5366,5367,5370,5371,5372,5373,5374,5375,5376,5377,5378,5379,5380,5381,5382,5383,5384,5385,5386,5387,5388,5389,5390,5391,5392,5393,5394,5395,5396,5397,5399,5400,5401,5402,5403,5404,5406,5407,5408,5409,5410,5411,5412,5413,5414,5416,5417,5418,5419,5420,5421,5422,5423,5424,5425,5426,5427,5429,5431,5432,5433,5434,5436,5437,5438,5439,5440,5441,5442,5444,5445,5446,5447,5448,5449,5451,5453,5454,5455,5456,5457,5458,5460,5461,5462,5464,5465,5466,5467,5468,5469,5471,5472,5473,5474,5475,5476,5477,5478,5479,5480,5481,5482,5484,5485,5486,5487,5488,5489,5490,5491,5492,5493,5494,5495,5496,5497,5498,5499,5500,5501,5502,5503,5504,5506,5507,5508,5509,5510,5511,5512,5514,5515,5516,5517,5518,5520,5521,5522,5523,5524,5525,5527,5528,5530,5532,5533,5534,5535,5536,5537,5538,5539,5540,5541,5542,5543,5544,5545,5546,5547,5548,5549,5550,5551,5552,5553,5555,5556,5557,5558,5559,5560,5561,5562,5563,5564,5565,5566,5568,5569,5570,5571,5572,5573,5574,5575,5576,5577,5578,5579,5580,5581,5582,5583,5585,5586,5587,5588,5589,5590,5591,5594,5595,5596,5597,5598,5599,5600,5601,5602,5604,5605,5606,5607,5608,5609,5610,5611,5612,5614,5615,5616,5617,5618,5619,5620,5621,5622,5623,5624,5625,5626,5627,5628,5629,5630,5631,5632,5633,5634,5635,5636,5637,5638,5639,5640,5641,5642,5643,5644,5645,5646,5647,5648,5649,5650,5651,5654,5655,5656,5657,5658,5660,5661,5662,5663,5664,5665,5666,5667,5668,5670,5671,5672,5674,5675,5676,5677,5678,5679,5680,5681,5682,5683,5687,5688,5689,5690,5691,5692,5693,5694,5696,5697,5698,5699,5700,5701,5702,5703,5704,5705,5706,5707,5708,5709,5710,5711,5712,5713,5714,5715,5716,5717,5719,5720,5722,5723,5724,5725,5726,5727,5728,5729,5730,5732,5733,5734,5735,5736,5738,5739,5740,5741,5742,5743,5744,5745,5746,5747,5748,5749,5751,5752,5753,5754,5755,5757,5758,5759,5760,5761,5762,5763,5764,5765,5766,5767,5768,5769,5770,5771,5772,5773,5774,5775,5776,5777,5779,5780,5781,5782,5783,5784,5785,5786,5787,5788,5789,5790,5792,5793,5794,5795,5796,5797,5798,5799,5800,5801,5802,5803,5804,5805,5807,5808,5809,5810,5811,5813,5814,5815,5816,5817,5819,5820,5821,5822,5823,5824,5825,5826,5829,5831,5832,5833,5834,5835,5836,5837,5839,5840,5841,5842,5843,5844,5845,5846,5848,5849,5850,5851,5852,5853,5854,5855,5856,5857,5858,5859,5860,5861,5862,5863,5864,5866,5867,5868,5869,5871,5872,5873,5874,5875,5876,5877,5878,5879,5880,5881,5882,5883,5884,5885,5886,5887,5888,5889,5891,5892,5893,5894,5895,5896,5897,5898,5900,5901,5902,5903,5904,5905,5906,5907,5908,5909,5910,5911,5912,5913,5914,5915,5916,5917,5919,5920,5921,5922,5923,5924,5925,5926,5927,5928,5931,5933,5934,5935,5936,5937,5938,5939,5940,5941,5943,5944,5945,5946,5947,5948,5949,5950,5951,5953,5954,5955,5956,5957,5958,5959,5960,5961,5962,5963,5964,5966,5967,5968,5969,5970,5971,5972,5973,5975,5976,5977,5978,5979,5981,5982,5983,5984,5985,5986,5988,5989,5991,5992,5994,5995,5996,5997,5998,5999,6000,6001,6002,6004,6005,6006,6007,6008,6009,6010,6011,6012,6013,6014,6017,6018,6019,6020,6021,6022,6023,6024,6025,6026,6027,6028,6029,6030,6031,6032,6033,6034,6035,6036,6037,6038,6039,6041,6042,6043,6044,6045,6046,6047,6048,6049,6050,6051,6052,6053,6054,6055,6056,6057,6058,6059,6060,6061,6063,6064,6065,6066,6067,6068,6069,6070,6071,6073,6074,6075,6076,6077,6078,6079,6080,6081,6083,6084,6085,6086,6087,6088,6089,6090,6091,6092,6093,6094,6095,6096,6098,6100,6101,6102,6103,6104,6105,6106,6107,6108,6109,6110,6111,6112,6113,6115,6116,6118,6119,6120,6121,6122,6123,6124,6125,6126,6128,6130,6132,6134,6135,6136,6137,6138,6139,6141,6142,6143,6144,6145,6146,6147,6148,6149,6150,6151,6152,6153,6154,6155,6156,6157,6158,6159,6160,6161,6162,6164,6165,6166,6167,6168,6169,6170,6171,6172,6173,6174,6175,6176,6177,6178,6179,6180,6182,6183,6184,6185,6186,6187,6188,6189,6190,6192,6193,6194,6195,6196,6197,6198,6199,6200,6202,6203,6204,6205,6206,6207,6208,6209,6210,6212,6213,6214,6215,6216,6217,6218,6219,6220,6221,6222,6223,6224,6225,6226,6227,6228,6229,6230,6231,6232,6233,6234,6235,6236,6237,6238,6239,6240,6242,6243,6244,6245,6246,6247,6248,6249,6251,6252,6253,6254,6255,6256,6257,6258,6260,6261,6262,6263,6265,6266,6267,6268,6269,6270,6271,6272,6273,6274,6275,6276,6277,6278,6279,6281,6282,6283,6284,6285,6289,6290,6291,6292,6294,6295,6296,6297,6298,6299,6300,6301,6302,6303,6304,6305,6306,6307,6308,6310,6311,6312,6313,6314,6315,6316,6317,6318,6320,6321,6322,6323,6324,6325,6326,6327,6329,6330,6331,6332,6333,6334,6335,6336,6337,6338,6339,6340,6341,6343,6345,6346,6347,6348,6349,6350,6352,6353,6354,6355,6356,6357,6358,6359,6360,6361,6362,6363,6364,6365,6366,6367,6368,6369,6370,6371,6372,6373,6374,6375,6376,6377,6378,6379,6380,6381,6382,6384,6385,6386,6387,6388,6389,6390,6391,6392,6393,6394,6395,6396,6397,6399,6401,6402,6403,6404,6405,6406,6407,6408,6409,6410,6411,6412,6413,6414,6415,6416,6417,6418,6419,6420,6421,6422,6423,6425,6427,6430,6431,6432,6433,6434,6435,6436,6438,6439,6440,6441,6442,6443,6445,6446,6447,6448,6449,6450,6451,6452,6453,6455,6456,6457,6458,6459,6460,6462,6463,6464,6465,6466,6467,6468,6469,6471,6472,6474,6475,6476,6477,6479,6480,6481,6482,6483,6484,6485,6486,6487,6488,6490,6491,6492,6493,6494,6495,6496,6497,6498,6499,6500,6501,6502,6503,6504,6505,6506,6507,6508,6509,6511,6512,6513,6514,6515,6516,6517,6518,6519,6520,6521,6522,6523,6524,6525,6527,6528,6529,6530,6531,6533,6534,6535,6536,6537,6538,6539,6540,6541,6542,6543,6544,6545,6547,6548,6549,6550,6551,6552,6553,6554,6555,6556,6558,6559,6560,6561,6562,6563,6564,6565,6566,6568,6569,6570,6571,6572,6573,6574,6575,6576,6577,6578,6579,6581,6582,6584,6585,6586,6587,6589,6591,6592,6593,6594,6595,6596,6598,6599,6600,6601,6603,6604,6605,6606,6607,6608,6609,6610,6611,6612,6613,6614,6615,6616,6617,6618,6619,6620,6622,6623,6624,6625,6626,6627,6628,6629,6630,6631,6632,6634,6635,6636,6637,6638,6639,6640,6641,6642,6644,6645,6646,6647,6648,6649,6650,6652,6653,6654,6655,6656,6657,6658,6659,6660,6661,6662,6663,6664,6665,6666,6667,6668,6669,6670,6671,6673,6674,6675,6676,6677,6678,6679,6680,6681,6682,6683,6684,6685,6686,6687,6688,6689,6690,6691,6692,6693,6694,6695,6696,6697,6698,6699,6700,6702,6703,6704,6705,6706,6707,6708,6709,6710,6712,6713,6714,6715,6716,6717,6718,6720,6721,6722,6723,6724,6725,6726,6727,6728,6729,6730,6731,6732,6733,6734,6735,6736,6737,6738,6739,6740,6741,6742,6743,6744,6745,6746,6747,6748,6749,6751,6754,6755,6756,6757,6758,6759,6761,6762,6763,6764,6765,6767,6768,6769,6771,6772,6773,6774,6775,6776,6777,6778,6780,6782,6783,6784,6785,6787,6788,6789,6790,6791,6792,6793,6794,6796,6797,6799,6800,6801,6802,6803,6804,6805,6806,6807,6809,6810,6811,6812,6813,6814,6815,6816,6817,6819,6820,6821,6822,6823,6824,6825,6826,6827,6828,6829,6830,6831,6832,6834,6836,6837,6838,6839,6840,6842,6844,6845,6846,6847,6848,6849,6850,6851,6852,6853,6854,6855,6856,6857,6858,6859,6860,6861,6862,6863,6864,6865,6866,6867,6868,6869,6870,6871,6872,6873,6874,6875,6876,6878,6879,6880,6881,6882,6883,6884,6885,6886,6887,6888,6889,6890,6891,6893,6895,6896,6897,6898,6899,6900,6901,6902,6903,6904,6905,6906,6907,6908,6909,6910,6911,6912,6913,6914,6915,6916,6917,6918,6919,6920,6922,6924,6926,6928,6929,6930,6931,6932,6933,6934,6935,6936,6938,6939,6940,6941,6942,6943,6944,6945,6946,6948,6949,6950,6951,6952,6953,6954,6955,6956,6957,6958,6960,6961,6963,6964,6965,6966,6967,6969,6972,6973,6974,6975,6976,6977,6980,6981,6982,6983,6984,6985,6986,6987,6988,6989,6990,6991,6992,6993,6994,6995,6996,6997,6998,6999,7000,7001,7002,7003,7004,7005,7006,7007,7008,7009,7010,7011,7012,7013,7014,7015,7016,7017,7018,7019,7020,7021,7022,7023,7024,7025,7026,7027,7028,7029,7030,7032,7033,7034,7035,7036,7038,7039,7040,7041,7042,7043,7044,7045,7046,7047,7048,7050,7051,7053,7054,7055,7056,7057,7058,7059,7060,7061,7063,7064,7065,7066,7067,7068,7069,7070,7071,7073,7074,7075,7076,7077,7078,7079,7080,7081,7082,7083,7085,7087,7088,7089,7090,7091,7092,7093,7094,7095,7096,7097,7098,7099,7100,7101,7102,7103,7104,7105,7106,7107,7108,7109,7110,7111,7113,7114,7115,7116,7117,7118,7119,7120,7121,7122,7123,7124,7125,7126,7127,7128,7130,7131,7132,7134,7135,7136,7137,7138,7140,7141,7142,7143,7144,7145,7146,7147,7148,7149,7150,7151,7152,7153,7154,7155,7156,7157,7158,7159,7160,7163,7164,7165,7166,7167,7169,7170,7171,7172,7173,7174,7176,7177,7178,7179,7180,7181,7182,7183,7184,7185,7186,7187,7188,7189,7191,7192,7193,7194,7195,7196,7197,7198,7199,7200,7201,7204,7205,7206,7207,7208,7209,7210,7211,7212,7213,7214,7215,7217,7218,7219,7220,7222,7223,7224,7226,7227,7228,7229,7230,7232,7233,7234,7235,7236,7237,7238,7239,7240,7241,7242,7243,7244,7245,7246,7247,7248,7249,7250,7251,7252,7253,7254,7256,7257,7258,7259,7260,7262,7264,7265,7266,7267,7268,7270,7271,7272,7273,7274,7275,7276,7277,7278,7280,7281,7282,7283,7284,7285,7286,7287,7288,7290,7291,7292,7293,7294,7295,7296,7297,7298,7299,7300,7301,7302,7303,7304,7305,7306,7307,7308,7309,7310,7311,7312,7313,7314,7315,7316,7318,7319,7320,7321,7322,7323,7324,7325,7326,7327,7328,7329,7331,7332,7333,7334,7335,7336,7338,7339,7340,7341,7343,7344,7345,7346,7347,7348,7349,7350,7351,7352,7353,7355,7356,7357,7358,7359,7360,7361,7362,7364,7365,7366,7369,7370,7371,7372,7373,7374,7375,7376,7377,7378,7379,7380,7382,7383,7384,7386,7387,7388,7389,7390,7391,7392,7393,7394,7395,7396,7397,7398,7399,7400,7401,7402,7403,7404,7405,7406,7407,7408,7409,7411,7412,7413,7414,7415,7416,7417,7418,7419,7420,7421,7422,7423,7424,7425,7426,7427,7428,7429,7430,7431,7432,7433,7434,7435,7436,7437,7438,7439,7441,7442,7443,7444,7445,7447,7448,7450,7451,7453,7454,7455,7456,7457,7458,7459,7460,7461,7462,7463,7464,7466,7467,7468,7469,7470,7471,7472,7473,7474,7475,7476,7477,7478,7479,7480,7481,7482,7483,7484,7486,7487,7488,7489,7490,7492,7493,7494,7495,7496,7497,7498,7499,7500,7501,7502,7503,7504,7507,7508,7509,7510,7511,7512,7513,7514,7515,7517,7518,7519,7520,7521,7522,7523,7524,7525,7527,7528,7529,7530,7531,7532,7533,7534,7535,7538,7539,7540,7541,7542,7543,7544,7545,7546,7547,7548,7549,7550,7551,7552,7553,7554,7556,7557,7559,7560,7561,7562,7563,7564,7565,7567,7568,7569,7570,7571,7572,7573,7574,7575,7576,7577,7578,7579,7580,7581,7582,7583,7584,7585,7586,7587,7588,7589,7590,7591,7592,7594,7595,7596,7597,7598,7600,7602,7603,7604,7605,7606,7608,7609,7610,7611,7612,7613,7614,7615,7616,7618,7619,7620,7621,7622,7623,7624,7626,7627,7628,7629,7630,7631,7632,7633,7634,7635,7636,7637,7638,7639,7640,7641,7642,7643,7644,7645,7647,7648,7649,7650,7651,7652,7653,7654,7656,7657,7658,7659,7660,7661,7662,7663,7664,7665,7666,7667,7668,7669,7670,7672,7673,7674,7675,7676,7677,7678,7679,7680,7681,7682,7683,7684,7685,7686,7687,7689,7690,7691,7692,7694,7695,7696,7697,7698,7700,7701,7704,7705,7707,7708,7709,7710,7711,7712,7713,7714,7715,7716,7717,7718,7719,7720,7721,7722,7724,7725,7726,7728,7729,7730,7731,7732,7733,7734,7735,7736,7738,7739,7740,7741,7742,7743,7744,7745,7746,7748,7749,7750,7751,7752,7753,7754,7755,7756,7757,7758,7759,7760,7761,7762,7763,7764,7765,7766,7767,7768,7769,7770,7771,7772,7773,7774,7775,7776,7777,7778,7779,7781,7783,7784,7785,7786,7787,7788,7789,7790,7792,7793,7794,7795,7796,7797,7798,7799,7800,7801,7802,7803,7804,7805,7806,7807,7808,7809,7811,7812,7813,7814,7815,7816,7818,7819,7821,7822,7823,7824,7825,7826,7827,7828,7829,7831,7832,7833,7834,7836,7837,7839,7840,7841,7842,7843,7844,7845,7847,7848,7849,7850,7851,7852,7853,7854,7856,7857,7858,7859,7860,7861,7862,7863,7864,7865,7867,7869,7870,7871,7872,7874,7875,7876,7877,7878,7879,7880,7881,7883,7884,7885,7886,7888,7890,7891,7892,7893,7894,7895,7896,7897,7899,7900,7901,7902,7903,7904,7905,7906,7908,7909,7910,7911,7912,7914,7915,7916,7917,7918,7919,7920,7921,7922,7923,7924,7925,7926,7927,7928,7929,7930,7931,7932,7934,7935,7936,7937,7938,7939,7940,7941,7942,7944,7945,7946,7947,7948,7949,7950,7951,7952,7954,7955,7956,7957,7958,7959,7960,7961,7962,7963,7964,7965,7966,7968,7969,7970,7971,7972,7973,7974,7975,7976,7977,7978,7979,7980,7981,7982,7983,7984,7985,7986,7988,7990,7991,7992,7993,7994,7995,7996,7997,7998,7999,8000,8001,8002,8003,8004,8005,8006,8008,8009,8010,8011,8012,8013,8014,8015,8017,8018,8019,8020,8022,8024,8025,8026,8027,8028,8030,8031,8032,8033,8034,8035,8036,8037,8038,8039,8040,8041,8042,8043,8044,8045,8046,8047,8048,8049,8050,8051,8052,8053,8054,8058,8059,8060,8061,8062,8063,8064,8065,8066,8068,8069,8070,8071,8072,8073,8074,8075,8076,8078,8079,8080,8081,8082,8083,8084,8086,8087,8088,8089,8090,8091,8092,8093,8094,8095,8096,8097,8099,8100,8101,8102,8103,8104,8105,8106,8107,8108,8109,8110,8112,8113,8115,8116,8118,8119,8120,8121,8122,8123,8124,8125,8126,8128,8129,8130,8131,8132,8133,8134,8135,8136,8138,8139,8140,8141,8142,8143,8144,8145,8146,8147,8148,8149,8150,8151,8153,8154,8155,8156,8157,8158,8159,8160,8161,8162,8164,8165,8166,8167,8168,8169,8170,8171,8173,8174,8175,8176,8177,8178,8180,8181,8182,8183,8184,8185,8186,8187,8188,8189,8190,8191,8192,8193,8196,8197,8198,8200,8201,8202,8203,8204,8205,8206,8207,8208,8209,8210,8211,8213,8214,8215,8216,8217,8218,8219,8220,8222,8223,8224,8225,8226,8227,8229,8230,8231,8232,8233,8234,8235,8236,8237,8238,8239,8240,8241,8242,8244,8245,8246,8247,8248,8249,8250,8252,8253,8254,8255,8256,8257,8258,8259,8261,8262,8263,8264,8265,8266,8267,8268,8269,8270,8271,8272,8274,8275,8276,8277,8279,8280,8281,8282,8284,8285,8286,8287,8288,8289,8290,8291,8292,8293,8294,8295,8296,8297,8298,8299,8300,8301,8302,8303,8304,8305,8306,8308,8309,8310,8311,8312,8313,8314,8315,8316,8317,8318,8319,8320,8321,8322,8323,8324,8326,8327,8328,8329,8330,8331,8332,8333,8334,8336,8337,8339,8340,8341,8344,8345,8346,8347,8348,8349,8350,8352,8353,8354,8355,8356,8357,8358,8360,8361,8362,8363,8364,8365,8366,8367,8368,8369,8370,8371,8372,8374,8375,8376,8377,8378,8379,8380,8381,8383,8384,8385,8386,8387,8390,8391,8392,8393,8394,8395,8396,8397,8398,8399,8400,8401,8402,8403,8404,8405,8406,8407,8408,8409,8410,8411,8412,8413,8415,8416,8417,8418,8419,8420,8421,8422,8423,8424,8426,8427,8428,8429,8430,8431,8432,8433,8434,8435,8436,8437,8438,8439,8440,8441,8442,8443,8444,8445,8446,8447,8449,8450,8451,8452,8453,8454,8455,8456,8457,8459,8460,8461,8462,8463,8464,8465,8466,8467,8469,8470,8471,8472,8473,8474,8475,8476,8477,8478,8479,8480,8482,8483,8484,8485,8486,8487,8488,8489,8491,8492,8493,8494,8495,8497,8498,8499,8500,8502,8503,8504,8505,8506,8507,8508,8509,8510,8511,8512,8515,8516,8517,8518,8519,8520,8521,8522,8523,8524,8525,8526,8527,8529,8530,8531,8532,8533,8534,8536,8537,8538,8539,8540,8541,8542,8543,8544,8545,8546,8547,8549,8550,8551,8552,8553,8554,8555,8556,8557,8559,8560,8561,8562,8563,8564,8565,8566,8568,8569,8570,8571,8572,8573,8574,8575,8577,8578,8579,8580,8581,8582,8583,8584,8585,8586,8588,8589,8590,8591,8592,8593,8594,8596,8597,8598,8599,8600,8601,8602,8603,8604,8605,8606,8607,8608,8609,8610,8612,8613,8615,8616,8617,8618,8620,8622,8623,8624,8625,8626,8627,8628,8630,8631,8632,8633,8635,8636,8637,8638,8639,8640,8641,8642,8643,8644,8645,8646,8647,8648,8649,8650,8651,8652,8653,8654,8655,8656,8658,8659,8660,8661,8662,8663,8664,8665,8666,8667,8668,8669,8670,8672,8673,8674,8675,8676,8677,8678,8679,8680,8682,8683,8684,8685,8686,8687,8688,8689,8690,8692,8693,8694,8695,8696,8697,8698,8699,8700,8701,8702,8703,8704,8705,8706,8707,8708,8709,8710,8711,8712,8713,8714,8715,8716,8717,8718,8719,8720,8721,8722,8723,8724,8725,8726,8727,8728,8729,8732,8733,8734,8735,8736,8737,8739,8740,8741,8742,8743,8744,8745,8746,8747,8749,8750,8751,8753,8754,8755,8756,8757,8758,8759,8760,8761,8762,8766,8767,8768,8769,8770,8771,8773,8774,8775,8776,8777,8778,8779,8780,8781,8782,8783,8784,8785,8786,8787,8788,8789,8790,8791,8792,8793,8794,8796,8797,8799,8800,8801,8802,8803,8804,8805,8806,8807,8809,8810,8811,8812,8813,8814,8815,8816,8817,8819,8820,8821,8822,8823,8824,8825,8826,8827,8828,8829,8830,8831,8832,8833,8834,8835,8836,8837,8838,8839,8840,8841,8842,8843,8844,8846,8847,8848,8850,8852,8853,8854,8855,8856,8857,8860,8861,8862,8863,8864,8866,8867,8869,8870,8871,8872,8873,8874,8875,8876,8877,8878,8879,8880,8882,8883,8884,8885,8886,8887,8888,8889,8890,8891,8892,8893,8894,8896,8897,8898,8899,8900,8901,8902,8903,8904,8905,8906,8907,8908,8909,8910,8911,8912,8914,8915,8916,8917,8918,8919,8920,8922,8923,8924,8925,8926,8927,8928,8930,8931,8932,8933,8934,8935,8936,8937,8938,8939,8940,8941,8942,8943,8944,8945,8946,8947,8948,8949,8950,8952,8953,8954,8955,8956,8957,8958,8959,8960,8961,8962,8963,8964,8965,8966,8967,8968,8969,8970,8971,8972,8973,8974,8975,8976,8977,8979,8980,8981,8982,8984,8985,8986,8987,8988,8989,8990,8993,8994,8995,8996,8997,8998,9000,9001,9002,9003,9005,9006,9007,9008,9009,9010,9011,9012,9013,9014,9015,9017,9018,9019,9020,9021,9022,9023,9024,9025,9026,9027,9028,9029,9030,9031,9032,9033,9034,9035,9036,9039,9040,9041,9042,9043,9044,9045,9046,9047,9048,9049,9050,9051,9053,9054,9055,9056,9057,9058,9059,9061,9062,9063,9064,9065,9066,9067,9068,9069,9071,9072,9073,9074,9075,9076,9077,9078,9079,9081,9082,9083,9084,9085,9086,9087,9088,9089,9090,9091,9092,9093,9094,9096,9097,9098,9099,9100,9101,9102,9103,9104,9106,9107,9108,9109,9110,9111,9112,9113,9114,9115,9116,9117,9118,9119,9120,9121,9122,9123,9124,9125,9126,9127,9128,9129,9130,9131,9132,9133,9135,9136,9138,9139,9140,9141,9142,9143,9144,9145,9146,9147,9148,9149,9150,9151,9152,9153,9154,9155,9156,9157,9159,9160,9161,9163,9164,9165,9166,9168,9169,9170,9171,9172,9173,9175,9176,9177,9178,9180,9181,9182,9183,9184,9185,9186,9187,9188,9190,9191,9192,9193,9194,9195,9196,9197,9198,9200,9201,9202,9203,9204,9205,9206,9207,9208,9209,9210,9211,9212,9213,9214,9215,9216,9217,9218,9219,9222,9224,9225,9226,9227,9228,9229,9231,9232,9233,9234,9235,9237,9238,9240,9241,9242,9243,9245,9246,9247,9248,9249,9250,9251,9252,9253,9254,9255,9256,9257,9258,9259,9260,9261,9262,9263,9265,9266,9267,9268,9269,9270,9271,9272,9274,9275,9276,9277,9278,9279,9280,9282,9283,9284,9285,9286,9287,9288,9289,9290,9291,9292,9293,9294,9295,9298,9299,9300,9301,9302,9303,9304,9305,9306,9307,9308,9309,9312,9313,9314,9315,9316,9317,9318,9319,9320,9321,9322,9323,9324,9326,9327,9328,9329,9330,9331,9332,9333,9334,9335,9336,9337,9338,9340,9341,9342,9343,9344,9345,9346,9347,9348,9349,9350,9351,9353,9354,9355,9356,9357,9359,9360,9361,9362,9363,9364,9365,9366,9368,9369,9370,9371,9372,9373,9374,9375,9376,9378,9379,9380,9381,9382,9383,9384,9385,9386,9388,9389,9390,9391,9392,9393,9394,9395,9397,9398,9399,9400,9401,9402,9403,9404,9406,9407,9408,9409,9410,9411,9412,9413,9415,9416,9417,9418,9419,9420,9421,9422,9423,9424,9426,9427,9428,9429,9430,9431,9432,9433,9434,9435,9437,9438,9441,9442,9443,9444,9445,9446,9447,9448,9449,9450,9451,9452,9453,9454,9456,9458,9460,9461,9462,9463,9464,9465,9466,9467,9468,9469,9470,9471,9472,9473,9474,9475,9476,9477,9478,9479,9480,9481,9482,9483,9484,9485,9486,9487,9489,9490,9491,9492,9493,9494,9495,9496,9497,9499,9500,9501,9502,9503,9504,9505,9506,9507,9509,9510,9511,9512,9513,9514,9515,9516,9517,9518,9520,9521,9522,9523,9524,9525,9526,9529,9530,9531,9532,9533,9534,9535,9536,9537,9538,9539,9540,9541,9543,9544,9545,9546,9547,9548,9549,9550,9551,9553,9554,9555,9556,9557,9558,9559,9560,9561,9562,9563,9564,9565,9566,9567,9568,9569,9570,9571,9572,9573,9574,9575,9576,9577,9578,9579,9580,9581,9582,9583,9584,9586,9587,9588,9589,9590,9591,9592,9593,9594,9595,9596,9597,9598,9599,9600,9602,9603,9604,9605,9606,9607,9608,9609,9610,9612,9613,9614,9615,9616,9617,9618,9619,9620,9622,9623,9624,9625,9626,9627,9628,9629,9630,9632,9635,9636,9637,9638,9639,9640,9641,9642,9643,9644,9645,9646,9649,9650,9651,9652,9653,9654,9655,9656,9657,9658,9659,9660,9661,9662,9664,9665,9667,9668,9669,9670,9671,9672,9673,9674,9675,9676,9678,9679,9680,9681,9682,9683,9684,9685,9686,9689,9690,9691,9692,9693,9694,9695,9696,9697,9698,9699,9700,9701,9702,9703,9705,9706,9707,9708,9709,9710,9711,9712,9713,9715,9716,9717,9718,9719,9720,9721,9722,9723,9725,9726,9727,9728,9729,9730,9731,9732,9733,9734,9735,9736,9737,9738,9740,9741,9742,9743,9744,9745,9746,9747,9748,9749,9750,9751,9752,9754,9755,9756,9758,9759,9760,9762,9764,9765,9766,9767,9768,9769,9770,9771,9772,9773,9774,9775,9776,9777,9778,9779,9780,9781,9782,9783,9784,9785,9786,9787,9788,9789,9790,9792,9793,9794,9795,9796,9797,9798,9799,9802,9803,9804,9805,9806,9807,9808,9810,9811,9812,9813,9814,9815,9816,9817,9819,9820,9821,9822,9823,9824,9825,9827,9828,9829,9830,9831,9832,9833,9834,9835,9836,9837,9838,9839,9840,9841,9842,9843,9844,9845,9846,9847,9848,9849,9851,9852,9853,9854,9855,9856,9857,9858,9859,9860,9861,9862,9863,9864,9866,9867,9868,9869,9870,9871,9872,9873,9874,9875,9876,9877,9878,9880,9881,9882,9883,9884,9886,9887,9888,9889,9890,9891,9892,9893,9894,9895,9896,9898,9899,9900,9901,9903,9904,9905,9906,9907,9908,9909,9910,9912,9913,9914,9915,9916,9917,9918,9919,9920,9921,9922,9923,9924,9925,9926,9927,9928,9929,9931,9932,9933,9934,9935,9936,9937,9938,9940,9941,9942,9943,9944,9945,9946,9947,9949,9950,9953,9954,9955,9956,9957,9958,9959,9960,9961,9963,9965,9966,9967,9968,9969,9970,9971,9972,9973,9974,9975,9976,9977,9978,9979,9980,9981,9982,9984,9985,9986,9987,9988,9989,9990,9991,9992,9994,9995,9996,9997,9998,9999],"errors":9020},"selected_test":{"loss":2.302585546875,"accuracy":0.098,"n":10000,"wrong_indices":[0,1,2,4,5,6,7,8,9,11,12,14,15,16,17,18,19,20,21,22,23,24,26,27,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,56,57,58,59,60,61,62,63,64,65,66,67,68,70,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,127,128,129,130,131,132,133,134,135,137,138,139,140,141,142,143,144,145,146,147,149,150,151,152,153,154,155,156,158,159,160,161,162,163,164,165,166,167,168,169,170,171,172,173,174,175,176,177,178,179,180,181,182,184,185,186,187,189,190,191,193,195,196,197,198,199,200,201,202,203,204,205,206,207,208,209,210,211,212,213,214,216,217,218,219,220,221,222,223,224,225,226,227,228,229,230,231,232,233,234,235,236,237,238,239,240,241,242,243,244,245,247,248,249,250,251,252,253,254,255,256,257,258,259,260,261,262,263,264,265,266,267,268,270,272,273,274,275,276,277,278,279,280,281,282,283,284,285,286,287,288,289,290,291,292,293,295,298,299,300,301,302,303,304,306,307,308,309,310,313,314,315,316,317,318,319,320,321,322,323,325,326,328,329,330,331,332,333,334,335,336,337,338,339,340,341,342,343,344,345,347,348,349,350,351,352,353,354,355,356,357,358,359,360,361,362,363,364,366,367,368,369,370,371,373,374,375,376,377,378,379,381,382,383,384,385,386,387,388,389,390,391,392,393,394,395,396,397,398,399,400,401,402,403,404,405,406,408,409,410,411,412,413,414,415,416,417,418,419,420,421,422,423,425,426,427,428,429,430,431,432,433,434,435,436,437,438,439,442,444,445,446,447,448,449,450,451,452,453,454,455,456,457,458,460,461,462,463,464,465,466,467,468,469,470,471,472,473,474,475,476,477,478,479,480,481,482,483,484,486,487,488,489,491,492,493,494,495,496,497,499,500,501,502,503,504,505,506,507,508,509,510,511,512,513,514,515,516,517,518,519,520,521,522,523,524,526,527,528,529,530,531,532,533,534,535,536,537,538,539,540,541,542,543,544,547,548,549,550,551,553,554,555,556,557,558,559,560,562,563,565,566,568,569,570,571,572,573,574,575,576,577,578,579,580,582,583,584,585,587,588,589,590,591,593,594,595,596,598,599,600,601,602,603,604,605,606,607,609,610,612,613,614,615,616,617,618,619,621,622,623,624,625,626,627,628,629,630,631,632,633,634,635,636,637,638,639,640,641,643,645,646,647,648,649,650,651,652,653,654,655,657,658,659,660,662,663,664,665,666,667,668,669,670,671,672,673,674,675,676,677,678,679,680,681,682,683,684,685,686,687,688,689,690,691,692,693,694,695,696,697,698,699,700,702,703,705,706,707,708,709,710,711,712,714,715,716,718,719,720,722,724,725,726,727,728,729,730,731,732,733,734,735,736,737,738,739,740,741,743,744,745,746,747,748,749,751,752,753,754,755,756,757,758,759,760,761,762,764,765,766,767,768,769,770,771,772,773,774,775,776,777,778,779,780,781,782,783,784,785,786,787,788,789,790,791,792,793,795,796,797,798,799,800,801,802,803,805,806,807,808,809,810,811,812,813,814,815,816,817,818,819,820,822,823,824,825,826,827,828,829,830,831,832,833,834,835,836,837,838,839,840,841,842,843,844,846,847,848,849,850,852,853,855,856,857,858,859,860,861,862,863,864,865,866,867,868,869,870,872,873,874,875,876,877,878,879,880,881,882,883,885,886,887,888,889,890,891,892,893,894,897,898,899,900,901,902,903,905,906,907,908,909,910,911,912,913,914,915,916,917,918,919,920,921,922,923,924,925,926,927,928,929,930,931,933,934,935,936,937,938,939,940,941,942,943,944,945,946,947,948,949,950,951,952,953,954,955,956,957,958,959,960,961,962,963,964,965,966,967,968,969,970,971,973,974,975,976,977,978,979,980,982,983,984,985,986,987,988,989,990,991,992,994,995,996,998,999,1000,1002,1003,1004,1005,1006,1007,1008,1010,1011,1012,1013,1014,1015,1016,1017,1018,1019,1020,1021,1022,1023,1024,1025,1026,1027,1028,1029,1030,1031,1032,1033,1035,1036,1037,1038,1039,1040,1041,1042,1043,1044,1045,1046,1048,1049,1050,1051,1052,1053,1054,1055,1056,1057,1058,1059,1060,1062,1063,1064,1065,1066,1067,1068,1069,1070,1071,1072,1073,1074,1075,1076,1077,1078,1079,1080,1081,1082,1083,1085,1086,1087,1088,1089,1090,1091,1092,1093,1095,1096,1097,1098,1099,1100,1101,1102,1103,1104,1105,1106,1107,1108,1109,1110,1111,1112,1113,1114,1115,1116,1117,1118,1119,1120,1122,1123,1124,1125,1126,1127,1128,1129,1130,1131,1132,1133,1134,1135,1136,1137,1138,1139,1140,1141,1142,1143,1144,1145,1146,1147,1149,1150,1151,1152,1153,1155,1156,1157,1158,1159,1160,1161,1162,1163,1164,1165,1166,1167,1168,1169,1170,1171,1172,1173,1174,1175,1177,1178,1179,1180,1181,1182,1183,1184,1185,1186,1187,1189,1190,1192,1193,1194,1196,1198,1199,1200,1201,1202,1204,1205,1206,1207,1208,1209,1210,1211,1212,1213,1214,1215,1216,1217,1219,1221,1222,1224,1225,1226,1227,1228,1229,1230,1232,1233,1234,1235,1236,1237,1238,1239,1240,1241,1242,1243,1244,1245,1247,1248,1249,1250,1251,1252,1253,1254,1255,1256,1257,1258,1259,1260,1262,1263,1264,1265,1266,1267,1268,1269,1270,1272,1274,1275,1276,1277,1278,1279,1280,1281,1282,1283,1284,1285,1286,1287,1289,1290,1291,1292,1293,1295,1296,1298,1299,1300,1301,1302,1303,1304,1305,1306,1307,1308,1309,1310,1311,1312,1313,1314,1315,1316,1317,1318,1319,1320,1321,1322,1323,1324,1325,1326,1327,1328,1329,1330,1331,1332,1334,1335,1336,1337,1338,1339,1340,1341,1342,1343,1344,1345,1346,1347,1348,1349,1350,1351,1352,1353,1354,1355,1356,1357,1358,1359,1360,1361,1362,1363,1364,1365,1366,1367,1368,1369,1370,1371,1372,1373,1374,1375,1376,1377,1378,1380,1381,1382,1383,1384,1385,1386,1387,1388,1389,1391,1392,1393,1394,1395,1396,1397,1398,1400,1401,1402,1403,1405,1406,1407,1409,1410,1412,1413,1414,1415,1417,1418,1419,1420,1421,1422,1423,1424,1425,1426,1427,1428,1429,1430,1431,1432,1433,1434,1435,1436,1437,1439,1440,1441,1442,1443,1444,1446,1447,1448,1449,1450,1451,1452,1453,1455,1456,1458,1459,1460,1461,1462,1463,1464,1465,1466,1467,1469,1470,1471,1472,1473,1474,1475,1476,1477,1478,1479,1480,1481,1482,1483,1484,1485,1486,1488,1489,1490,1491,1492,1493,1494,1495,1496,1497,1498,1499,1500,1501,1502,1503,1505,1506,1507,1508,1509,1510,1511,1512,1513,1514,1515,1516,1518,1519,1520,1521,1522,1523,1524,1525,1527,1528,1529,1530,1531,1532,1536,1537,1538,1539,1540,1541,1542,1543,1544,1545,1546,1547,1548,1549,1550,1551,1552,1553,1554,1555,1556,1557,1559,1560,1561,1562,1563,1564,1566,1567,1568,1569,1571,1572,1573,1574,1575,1576,1577,1578,1579,1580,1581,1582,1583,1584,1585,1586,1587,1588,1591,1592,1593,1594,1595,1596,1597,1598,1599,1600,1601,1602,1603,1604,1605,1606,1607,1608,1609,1611,1612,1613,1614,1615,1616,1617,1618,1620,1622,1624,1625,1626,1627,1628,1629,1630,1631,1632,1633,1634,1635,1636,1637,1639,1640,1641,1642,1643,1644,1645,1646,1647,1648,1649,1651,1652,1653,1654,1655,1656,1657,1658,1659,1660,1661,1662,1663,1664,1665,1666,1667,1668,1669,1670,1671,1672,1673,1674,1675,1676,1677,1678,1679,1680,1681,1682,1683,1684,1685,1686,1687,1688,1689,1690,1691,1693,1694,1695,1696,1697,1698,1699,1701,1702,1703,1704,1705,1706,1707,1709,1710,1711,1714,1715,1716,1717,1718,1719,1720,1721,1722,1724,1725,1727,1728,1729,1730,1731,1732,1733,1734,1735,1736,1737,1738,1740,1741,1742,1743,1744,1745,1746,1747,1749,1750,1751,1752,1753,1754,1755,1756,1758,1759,1760,1761,1763,1765,1766,1767,1769,1770,1771,1772,1773,1774,1776,1778,1779,1780,1781,1782,1783,1784,1785,1786,1787,1788,1789,1790,1791,1792,1793,1795,1797,1798,1799,1800,1801,1802,1803,1804,1805,1806,1809,1810,1811,1812,1813,1814,1815,1816,1817,1818,1819,1820,1821,1822,1823,1824,1825,1827,1828,1829,1830,1831,1832,1833,1834,1835,1836,1837,1838,1839,1840,1842,1844,1845,1846,1847,1848,1849,1850,1851,1852,1853,1854,1855,1856,1857,1858,1859,1860,1861,1862,1863,1864,1865,1866,1867,1868,1869,1871,1872,1873,1874,1875,1876,1877,1878,1879,1880,1881,1882,1883,1884,1885,1886,1887,1888,1889,1890,1891,1893,1894,1895,1896,1897,1899,1900,1901,1902,1903,1904,1905,1906,1908,1909,1910,1911,1912,1913,1914,1915,1916,1917,1919,1920,1921,1922,1923,1924,1925,1926,1927,1928,1929,1930,1931,1932,1933,1934,1935,1936,1937,1938,1939,1940,1941,1942,1943,1945,1946,1947,1948,1949,1950,1951,1952,1953,1954,1955,1956,1957,1958,1960,1961,1962,1963,1964,1965,1966,1967,1968,1969,1970,1971,1973,1974,1975,1976,1977,1978,1979,1980,1981,1982,1983,1984,1985,1986,1988,1989,1990,1991,1992,1993,1994,1996,1997,1998,1999,2000,2001,2002,2003,2004,2005,2006,2007,2008,2009,2010,2011,2012,2013,2014,2015,2016,2017,2018,2019,2020,2021,2022,2024,2025,2026,2027,2028,2029,2030,2031,2032,2034,2035,2036,2037,2038,2039,2040,2041,2043,2044,2045,2046,2047,2048,2049,2050,2051,2052,2053,2054,2055,2056,2057,2058,2059,2062,2063,2064,2065,2066,2068,2069,2070,2071,2072,2073,2074,2075,2076,2077,2078,2079,2080,2082,2083,2084,2085,2086,2088,2089,2090,2091,2092,2093,2094,2095,2097,2098,2099,2100,2101,2102,2103,2104,2105,2107,2108,2109,2110,2111,2112,2113,2114,2115,2116,2117,2118,2119,2120,2121,2122,2123,2124,2125,2126,2128,2129,2130,2131,2132,2133,2134,2135,2136,2137,2138,2139,2140,2141,2142,2143,2144,2145,2146,2147,2148,2149,2150,2151,2152,2153,2154,2156,2157,2158,2159,2160,2161,2162,2163,2164,2165,2166,2167,2168,2169,2170,2171,2172,2173,2174,2175,2176,2177,2179,2180,2181,2182,2183,2184,2186,2187,2189,2191,2192,2193,2194,2195,2196,2197,2198,2199,2200,2201,2202,2203,2205,2206,2207,2208,2210,2211,2212,2213,2214,2215,2216,2218,2219,2220,2221,2222,2223,2224,2225,2227,2228,2229,2230,2231,2232,2233,2234,2235,2237,2238,2239,2240,2241,2242,2243,2244,2245,2246,2247,2248,2249,2250,2251,2252,2253,2254,2255,2256,2257,2258,2259,2260,2261,2262,2263,2264,2265,2266,2267,2268,2269,2270,2271,2272,2273,2274,2275,2276,2277,2278,2279,2280,2281,2282,2283,2284,2285,2286,2287,2288,2289,2290,2291,2292,2293,2296,2297,2298,2299,2300,2301,2302,2303,2305,2306,2307,2308,2309,2310,2311,2312,2313,2314,2315,2316,2317,2319,2320,2321,2322,2323,2324,2325,2327,2330,2331,2332,2334,2335,2336,2337,2338,2339,2340,2341,2342,2343,2344,2345,2346,2347,2348,2349,2350,2351,2352,2353,2354,2355,2356,2357,2358,2359,2360,2361,2362,2363,2364,2365,2366,2367,2368,2369,2371,2372,2373,2374,2375,2377,2379,2380,2381,2382,2383,2386,2387,2388,2389,2390,2391,2392,2393,2394,2395,2396,2397,2398,2399,2400,2401,2402,2404,2405,2406,2407,2408,2409,2411,2412,2413,2414,2415,2416,2418,2419,2420,2421,2422,2423,2424,2425,2426,2427,2428,2429,2430,2431,2432,2433,2434,2436,2437,2438,2439,2440,2441,2442,2443,2444,2445,2446,2447,2448,2450,2451,2452,2453,2454,2456,2457,2458,2459,2460,2462,2463,2464,2465,2466,2467,2468,2469,2470,2471,2472,2473,2474,2475,2476,2477,2478,2480,2481,2482,2483,2484,2486,2487,2488,2489,2490,2491,2493,2494,2495,2496,2497,2498,2499,2500,2501,2502,2503,2504,2505,2507,2508,2509,2510,2511,2512,2513,2514,2515,2516,2517,2518,2519,2520,2521,2522,2523,2524,2525,2526,2528,2529,2530,2532,2533,2534,2535,2537,2538,2539,2540,2541,2542,2543,2544,2545,2546,2547,2548,2549,2550,2551,2552,2553,2554,2555,2556,2558,2559,2560,2561,2562,2563,2564,2565,2566,2567,2569,2570,2572,2573,2574,2575,2576,2577,2578,2579,2580,2581,2582,2583,2584,2585,2586,2587,2588,2589,2590,2591,2594,2595,2596,2597,2598,2599,2600,2601,2602,2603,2604,2605,2606,2607,2608,2609,2610,2611,2612,2613,2614,2615,2616,2617,2618,2620,2621,2622,2623,2624,2625,2626,2628,2629,2630,2632,2633,2634,2635,2636,2637,2639,2640,2642,2643,2644,2645,2646,2647,2648,2650,2651,2652,2653,2654,2655,2658,2659,2661,2662,2663,2664,2665,2666,2667,2668,2669,2670,2671,2672,2673,2674,2675,2676,2677,2678,2679,2680,2681,2682,2683,2684,2685,2686,2688,2689,2690,2691,2692,2693,2694,2695,2696,2697,2698,2699,2700,2701,2702,2704,2705,2706,2708,2709,2710,2711,2712,2715,2716,2718,2719,2720,2721,2722,2723,2724,2725,2726,2727,2728,2729,2730,2731,2732,2734,2735,2736,2737,2738,2739,2740,2741,2742,2743,2744,2745,2746,2749,2750,2751,2752,2753,2754,2755,2756,2757,2758,2759,2760,2762,2766,2767,2768,2769,2770,2771,2772,2773,2774,2775,2776,2778,2780,2781,2782,2783,2784,2785,2786,2787,2788,2789,2790,2791,2792,2793,2795,2796,2797,2798,2799,2800,2801,2802,2803,2804,2805,2806,2807,2808,2809,2810,2812,2813,2814,2815,2816,2818,2819,2820,2822,2823,2825,2826,2827,2828,2829,2830,2831,2832,2833,2834,2835,2836,2837,2838,2839,2840,2841,2843,2844,2845,2846,2847,2848,2849,2850,2851,2852,2853,2854,2855,2856,2857,2858,2859,2860,2861,2862,2863,2864,2865,2866,2867,2868,2869,2870,2871,2872,2874,2875,2876,2877,2878,2879,2880,2881,2882,2883,2884,2885,2886,2887,2888,2889,2890,2891,2892,2893,2895,2896,2897,2898,2900,2901,2902,2903,2904,2905,2906,2907,2908,2909,2910,2911,2912,2913,2914,2915,2916,2917,2918,2919,2920,2921,2922,2923,2924,2925,2926,2927,2928,2929,2930,2931,2933,2934,2935,2936,2938,2939,2940,2941,2943,2945,2946,2947,2948,2949,2950,2951,2952,2953,2955,2956,2957,2958,2959,2960,2961,2963,2964,2965,2966,2967,2968,2969,2970,2971,2973,2974,2975,2976,2977,2978,2979,2980,2981,2982,2983,2984,2985,2986,2987,2989,2990,2991,2992,2993,2994,2995,2997,2998,3000,3001,3002,3003,3004,3005,3006,3007,3008,3009,3010,3011,3012,3014,3015,3017,3018,3019,3021,3022,3023,3024,3025,3026,3027,3028,3029,3030,3031,3033,3034,3035,3036,3037,3038,3039,3040,3041,3042,3045,3046,3047,3048,3049,3050,3051,3053,3054,3055,3056,3057,3058,3059,3060,3061,3062,3063,3064,3065,3066,3067,3068,3069,3070,3071,3072,3073,3074,3075,3076,3078,3079,3080,3081,3082,3083,3084,3085,3086,3088,3089,3091,3092,3093,3094,3095,3096,3097,3098,3099,3100,3101,3102,3103,3104,3105,3106,3107,3108,3109,3110,3111,3112,3113,3114,3115,3116,3117,3118,3119,3120,3121,3122,3123,3124,3125,3126,3127,3128,3129,3130,3131,3132,3133,3134,3135,3136,3137,3138,3139,3141,3142,3143,3144,3145,3146,3147,3148,3149,3150,3151,3152,3153,3154,3155,3156,3157,3158,3159,3160,3161,3162,3163,3164,3165,3166,3167,3168,3169,3171,3172,3173,3174,3175,3176,3177,3180,3181,3182,3183,3184,3186,3187,3188,3189,3190,3192,3193,3194,3195,3196,3197,3198,3199,3200,3201,3202,3203,3204,3205,3206,3207,3208,3209,3211,3212,3213,3214,3216,3217,3218,3220,3221,3222,3223,3224,3225,3227,3228,3229,3230,3231,3232,3233,3234,3235,3236,3237,3238,3239,3240,3241,3244,3245,3246,3247,3248,3249,3250,3252,3253,3254,3255,3256,3257,3258,3259,3260,3261,3262,3263,3264,3267,3268,3269,3270,3272,3273,3274,3275,3276,3277,3278,3279,3280,3281,3282,3283,3284,3285,3286,3287,3288,3289,3290,3291,3292,3293,3294,3295,3296,3298,3299,3300,3301,3302,3303,3304,3307,3308,3309,3311,3312,3313,3314,3316,3318,3319,3320,3321,3323,3324,3326,3327,3328,3329,3330,3331,3332,3333,3334,3335,3336,3337,3338,3339,3340,3341,3342,3343,3344,3345,3348,3349,3350,3351,3352,3353,3354,3355,3356,3357,3360,3361,3362,3363,3364,3365,3366,3367,3369,3370,3372,3373,3374,3375,3376,3377,3378,3379,3380,3381,3382,3383,3384,3385,3386,3387,3388,3389,3390,3391,3392,3393,3394,3395,3396,3397,3398,3399,3400,3402,3403,3404,3405,3406,3407,3408,3409,3410,3411,3414,3415,3416,3418,3419,3420,3421,3422,3423,3424,3425,3426,3427,3428,3429,3430,3431,3432,3433,3434,3435,3436,3437,3438,3440,3441,3442,3443,3444,3447,3448,3449,3451,3452,3453,3454,3455,3456,3457,3459,3460,3461,3462,3463,3464,3465,3466,3467,3468,3469,3470,3471,3472,3473,3474,3475,3476,3477,3478,3480,3482,3483,3484,3485,3486,3487,3488,3489,3490,3491,3492,3493,3494,3495,3497,3498,3499,3500,3501,3502,3503,3504,3505,3506,3507,3508,3509,3510,3511,3513,3514,3515,3516,3517,3518,3519,3520,3521,3522,3523,3524,3525,3526,3527,3528,3529,3530,3531,3532,3533,3534,3535,3537,3538,3539,3541,3542,3543,3544,3545,3546,3547,3548,3549,3550,3551,3552,3553,3554,3555,3556,3557,3558,3559,3560,3561,3562,3563,3564,3565,3566,3567,3568,3569,3570,3571,3572,3573,3575,3576,3577,3578,3579,3580,3582,3583,3585,3586,3587,3588,3589,3590,3591,3592,3593,3594,3595,3596,3597,3598,3599,3600,3601,3602,3603,3604,3605,3606,3607,3609,3610,3611,3612,3614,3615,3616,3617,3618,3619,3620,3621,3622,3623,3625,3626,3627,3628,3629,3630,3631,3632,3633,3635,3636,3637,3638,3639,3641,3642,3643,3644,3645,3647,3648,3649,3651,3652,3653,3654,3655,3656,3657,3658,3659,3661,3662,3663,3664,3665,3666,3667,3668,3669,3670,3671,3672,3673,3674,3675,3676,3678,3679,3681,3682,3683,3684,3685,3686,3687,3688,3689,3690,3691,3692,3693,3694,3696,3697,3699,3700,3701,3702,3703,3704,3705,3707,3708,3709,3711,3712,3713,3714,3715,3716,3717,3718,3719,3720,3721,3722,3723,3725,3726,3727,3728,3729,3730,3731,3732,3733,3736,3737,3738,3739,3740,3741,3742,3743,3744,3745,3746,3747,3748,3749,3750,3751,3752,3753,3754,3755,3756,3757,3758,3759,3760,3761,3762,3763,3765,3766,3767,3769,3770,3771,3772,3773,3775,3776,3777,3778,3779,3780,3781,3782,3783,3784,3785,3786,3787,3788,3789,3791,3792,3793,3794,3795,3796,3797,3798,3799,3800,3801,3802,3806,3807,3808,3809,3810,3811,3812,3813,3814,3815,3816,3817,3819,3820,3821,3822,3823,3824,3825,3826,3827,3828,3829,3831,3832,3833,3834,3835,3836,3837,3838,3839,3840,3841,3842,3843,3844,3845,3846,3848,3850,3851,3852,3853,3854,3855,3856,3857,3858,3859,3860,3861,3862,3863,3865,3866,3868,3869,3871,3872,3873,3874,3875,3876,3877,3878,3879,3880,3881,3882,3884,3885,3886,3887,3888,3889,3890,3891,3892,3893,3894,3896,3897,3898,3899,3900,3901,3902,3904,3905,3906,3907,3908,3909,3910,3912,3913,3914,3915,3916,3917,3918,3919,3920,3921,3922,3923,3924,3925,3926,3927,3928,3929,3930,3931,3932,3933,3934,3935,3936,3937,3938,3939,3941,3943,3944,3945,3946,3947,3948,3949,3950,3951,3952,3953,3954,3955,3956,3957,3958,3960,3961,3962,3963,3964,3965,3966,3967,3968,3969,3970,3971,3972,3973,3974,3975,3976,3977,3978,3979,3981,3983,3984,3985,3986,3987,3988,3990,3991,3992,3993,3994,3995,3996,3997,3998,3999,4000,4001,4002,4003,4004,4005,4006,4007,4008,4009,4010,4011,4012,4013,4014,4015,4016,4017,4018,4019,4020,4021,4022,4024,4025,4026,4027,4028,4029,4030,4031,4032,4035,4036,4037,4038,4039,4040,4041,4042,4044,4045,4046,4047,4049,4050,4051,4052,4053,4054,4055,4056,4057,4058,4059,4060,4061,4063,4064,4066,4067,4068,4069,4071,4072,4073,4074,4075,4076,4077,4078,4081,4083,4084,4085,4086,4087,4088,4089,4092,4093,4094,4095,4096,4097,4098,4099,4100,4101,4102,4103,4104,4105,4106,4107,4108,4109,4110,4111,4112,4113,4114,4115,4116,4117,4118,4119,4120,4121,4122,4123,4124,4125,4126,4127,4128,4129,4130,4131,4132,4133,4134,4135,4136,4137,4138,4139,4140,4141,4142,4143,4144,4145,4147,4148,4149,4151,4152,4153,4154,4156,4158,4159,4160,4161,4162,4163,4164,4165,4167,4168,4169,4170,4171,4172,4173,4174,4175,4176,4177,4178,4179,4180,4181,4182,4183,4184,4185,4187,4189,4190,4191,4192,4193,4194,4195,4196,4197,4198,4199,4200,4201,4202,4203,4204,4205,4206,4207,4209,4210,4211,4212,4213,4214,4215,4216,4217,4218,4219,4220,4221,4222,4223,4224,4225,4226,4228,4229,4230,4231,4232,4233,4234,4235,4236,4237,4238,4239,4240,4242,4243,4244,4245,4246,4247,4248,4249,4250,4251,4252,4253,4254,4255,4256,4257,4258,4259,4260,4261,4262,4263,4264,4265,4266,4267,4268,4269,4270,4271,4272,4273,4274,4275,4276,4277,4279,4280,4283,4284,4285,4287,4288,4289,4290,4291,4292,4293,4294,4295,4296,4297,4298,4299,4300,4301,4302,4303,4304,4305,4306,4307,4308,4309,4310,4311,4312,4313,4314,4315,4316,4317,4318,4319,4321,4322,4323,4324,4325,4326,4328,4330,4331,4332,4333,4334,4335,4336,4337,4338,4339,4340,4341,4342,4344,4345,4346,4347,4349,4350,4352,4354,4355,4356,4357,4358,4359,4360,4362,4363,4364,4366,4367,4368,4369,4371,4372,4373,4374,4375,4376,4377,4378,4379,4380,4381,4382,4383,4384,4385,4386,4387,4388,4389,4390,4391,4393,4394,4395,4396,4397,4398,4399,4400,4401,4402,4405,4406,4407,4408,4409,4410,4411,4412,4413,4414,4415,4416,4417,4418,4419,4420,4421,4422,4423,4424,4425,4426,4427,4428,4429,4430,4431,4433,4434,4435,4436,4437,4438,4439,4440,4441,4442,4443,4444,4445,4446,4449,4450,4451,4452,4453,4454,4455,4456,4458,4459,4460,4461,4463,4464,4465,4466,4467,4468,4469,4471,4472,4474,4475,4476,4478,4479,4480,4481,4482,4483,4484,4485,4486,4487,4488,4489,4490,4491,4492,4493,4494,4496,4497,4498,4499,4500,4501,4502,4503,4504,4505,4506,4507,4508,4509,4510,4511,4512,4513,4514,4516,4517,4518,4519,4520,4521,4522,4523,4524,4525,4526,4528,4529,4530,4532,4533,4534,4535,4536,4537,4538,4539,4540,4541,4543,4544,4545,4546,4547,4548,4549,4550,4551,4552,4553,4555,4556,4557,4558,4559,4560,4561,4562,4563,4564,4565,4566,4567,4568,4569,4570,4571,4572,4573,4574,4575,4576,4577,4578,4579,4580,4581,4582,4583,4584,4585,4586,4587,4588,4589,4590,4591,4592,4593,4594,4595,4596,4597,4598,4599,4600,4601,4602,4603,4605,4606,4607,4608,4609,4610,4612,4613,4615,4616,4618,4619,4620,4621,4622,4623,4624,4625,4626,4627,4629,4630,4632,4633,4634,4635,4636,4637,4638,4639,4640,4643,4644,4645,4646,4647,4648,4649,4651,4652,4653,4654,4655,4656,4657,4658,4659,4660,4661,4662,4663,4664,4665,4666,4667,4668,4669,4670,4671,4673,4674,4676,4677,4678,4679,4680,4681,4682,4683,4684,4685,4686,4687,4688,4689,4690,4691,4692,4693,4694,4695,4696,4697,4698,4699,4700,4701,4702,4703,4704,4705,4706,4707,4708,4709,4710,4711,4712,4713,4714,4715,4716,4717,4719,4721,4722,4723,4724,4725,4726,4727,4728,4729,4730,4731,4732,4733,4734,4735,4736,4737,4738,4740,4742,4743,4744,4745,4746,4747,4748,4749,4750,4751,4752,4753,4754,4755,4756,4758,4759,4760,4761,4762,4763,4764,4765,4766,4767,4768,4769,4770,4771,4772,4773,4774,4775,4777,4778,4779,4781,4782,4783,4784,4785,4786,4787,4789,4790,4791,4792,4793,4794,4795,4796,4797,4798,4799,4800,4801,4802,4803,4805,4806,4807,4808,4809,4810,4811,4812,4813,4814,4815,4816,4817,4818,4820,4821,4822,4823,4825,4826,4827,4828,4829,4830,4831,4832,4833,4835,4836,4837,4838,4839,4840,4841,4842,4843,4844,4845,4846,4847,4848,4849,4850,4851,4852,4853,4854,4855,4856,4858,4859,4860,4861,4863,4864,4865,4866,4867,4868,4869,4870,4871,4872,4873,4874,4875,4876,4877,4878,4879,4881,4882,4883,4884,4885,4886,4888,4889,4890,4892,4893,4894,4895,4896,4897,4898,4899,4900,4901,4902,4903,4904,4905,4906,4907,4908,4909,4910,4911,4912,4913,4914,4915,4916,4917,4918,4919,4920,4921,4922,4924,4925,4926,4927,4928,4929,4930,4931,4932,4933,4934,4936,4938,4939,4940,4941,4942,4943,4944,4945,4946,4947,4948,4949,4950,4951,4952,4953,4954,4955,4956,4960,4961,4962,4963,4964,4965,4966,4967,4968,4969,4970,4971,4972,4973,4974,4975,4976,4977,4978,4979,4980,4981,4982,4983,4984,4985,4986,4987,4988,4989,4990,4991,4993,4994,4995,4996,4997,4998,5000,5001,5002,5003,5004,5005,5007,5009,5010,5011,5012,5013,5014,5015,5016,5017,5018,5019,5020,5021,5022,5023,5024,5025,5026,5027,5028,5029,5030,5032,5034,5036,5037,5038,5039,5040,5041,5042,5044,5045,5046,5047,5048,5049,5050,5052,5053,5054,5055,5056,5057,5058,5059,5060,5061,5062,5063,5064,5065,5066,5067,5068,5070,5071,5072,5073,5074,5075,5076,5077,5078,5080,5081,5082,5083,5084,5085,5086,5088,5089,5090,5091,5092,5093,5094,5095,5096,5097,5098,5099,5100,5101,5102,5103,5104,5105,5106,5107,5110,5111,5112,5113,5114,5115,5116,5117,5118,5119,5120,5121,5122,5123,5125,5126,5127,5128,5129,5130,5131,5132,5134,5135,5136,5137,5138,5140,5142,5143,5144,5145,5146,5148,5149,5150,5151,5152,5153,5154,5156,5157,5158,5159,5160,5161,5162,5163,5164,5166,5167,5168,5169,5170,5171,5172,5173,5174,5175,5176,5177,5178,5179,5180,5181,5182,5183,5184,5185,5186,5187,5188,5189,5190,5191,5192,5193,5194,5195,5196,5197,5198,5199,5200,5201,5202,5203,5204,5205,5206,5207,5208,5209,5210,5211,5212,5213,5214,5215,5216,5217,5218,5219,5220,5221,5222,5223,5224,5225,5226,5227,5228,5229,5230,5231,5232,5233,5234,5235,5236,5237,5238,5239,5240,5242,5245,5246,5247,5248,5250,5252,5254,5256,5258,5260,5261,5262,5263,5264,5265,5266,5267,5268,5269,5271,5272,5273,5274,5275,5276,5277,5278,5279,5281,5282,5283,5284,5285,5286,5287,5288,5289,5291,5292,5293,5294,5295,5296,5297,5298,5299,5300,5302,5303,5304,5306,5308,5309,5310,5311,5312,5313,5314,5315,5316,5317,5318,5319,5322,5323,5324,5325,5326,5327,5328,5329,5330,5331,5332,5333,5334,5335,5336,5338,5339,5340,5341,5343,5344,5345,5346,5347,5348,5349,5350,5351,5352,5354,5355,5356,5357,5358,5359,5360,5361,5362,5363,5364,5365,5366,5367,5370,5371,5372,5373,5374,5375,5376,5377,5378,5379,5380,5381,5382,5383,5384,5385,5386,5387,5388,5389,5390,5391,5392,5393,5394,5395,5396,5397,5399,5400,5401,5402,5403,5404,5406,5407,5408,5409,5410,5411,5412,5413,5414,5416,5417,5418,5419,5420,5421,5422,5423,5424,5425,5426,5427,5429,5431,5432,5433,5434,5436,5437,5438,5439,5440,5441,5442,5444,5445,5446,5447,5448,5449,5451,5453,5454,5455,5456,5457,5458,5460,5461,5462,5464,5465,5466,5467,5468,5469,5471,5472,5473,5474,5475,5476,5477,5478,5479,5480,5481,5482,5484,5485,5486,5487,5488,5489,5490,5491,5492,5493,5494,5495,5496,5497,5498,5499,5500,5501,5502,5503,5504,5506,5507,5508,5509,5510,5511,5512,5514,5515,5516,5517,5518,5520,5521,5522,5523,5524,5525,5527,5528,5530,5532,5533,5534,5535,5536,5537,5538,5539,5540,5541,5542,5543,5544,5545,5546,5547,5548,5549,5550,5551,5552,5553,5555,5556,5557,5558,5559,5560,5561,5562,5563,5564,5565,5566,5568,5569,5570,5571,5572,5573,5574,5575,5576,5577,5578,5579,5580,5581,5582,5583,5585,5586,5587,5588,5589,5590,5591,5594,5595,5596,5597,5598,5599,5600,5601,5602,5604,5605,5606,5607,5608,5609,5610,5611,5612,5614,5615,5616,5617,5618,5619,5620,5621,5622,5623,5624,5625,5626,5627,5628,5629,5630,5631,5632,5633,5634,5635,5636,5637,5638,5639,5640,5641,5642,5643,5644,5645,5646,5647,5648,5649,5650,5651,5654,5655,5656,5657,5658,5660,5661,5662,5663,5664,5665,5666,5667,5668,5670,5671,5672,5674,5675,5676,5677,5678,5679,5680,5681,5682,5683,5687,5688,5689,5690,5691,5692,5693,5694,5696,5697,5698,5699,5700,5701,5702,5703,5704,5705,5706,5707,5708,5709,5710,5711,5712,5713,5714,5715,5716,5717,5719,5720,5722,5723,5724,5725,5726,5727,5728,5729,5730,5732,5733,5734,5735,5736,5738,5739,5740,5741,5742,5743,5744,5745,5746,5747,5748,5749,5751,5752,5753,5754,5755,5757,5758,5759,5760,5761,5762,5763,5764,5765,5766,5767,5768,5769,5770,5771,5772,5773,5774,5775,5776,5777,5779,5780,5781,5782,5783,5784,5785,5786,5787,5788,5789,5790,5792,5793,5794,5795,5796,5797,5798,5799,5800,5801,5802,5803,5804,5805,5807,5808,5809,5810,5811,5813,5814,5815,5816,5817,5819,5820,5821,5822,5823,5824,5825,5826,5829,5831,5832,5833,5834,5835,5836,5837,5839,5840,5841,5842,5843,5844,5845,5846,5848,5849,5850,5851,5852,5853,5854,5855,5856,5857,5858,5859,5860,5861,5862,5863,5864,5866,5867,5868,5869,5871,5872,5873,5874,5875,5876,5877,5878,5879,5880,5881,5882,5883,5884,5885,5886,5887,5888,5889,5891,5892,5893,5894,5895,5896,5897,5898,5900,5901,5902,5903,5904,5905,5906,5907,5908,5909,5910,5911,5912,5913,5914,5915,5916,5917,5919,5920,5921,5922,5923,5924,5925,5926,5927,5928,5931,5933,5934,5935,5936,5937,5938,5939,5940,5941,5943,5944,5945,5946,5947,5948,5949,5950,5951,5953,5954,5955,5956,5957,5958,5959,5960,5961,5962,5963,5964,5966,5967,5968,5969,5970,5971,5972,5973,5975,5976,5977,5978,5979,5981,5982,5983,5984,5985,5986,5988,5989,5991,5992,5994,5995,5996,5997,5998,5999,6000,6001,6002,6004,6005,6006,6007,6008,6009,6010,6011,6012,6013,6014,6017,6018,6019,6020,6021,6022,6023,6024,6025,6026,6027,6028,6029,6030,6031,6032,6033,6034,6035,6036,6037,6038,6039,6041,6042,6043,6044,6045,6046,6047,6048,6049,6050,6051,6052,6053,6054,6055,6056,6057,6058,6059,6060,6061,6063,6064,6065,6066,6067,6068,6069,6070,6071,6073,6074,6075,6076,6077,6078,6079,6080,6081,6083,6084,6085,6086,6087,6088,6089,6090,6091,6092,6093,6094,6095,6096,6098,6100,6101,6102,6103,6104,6105,6106,6107,6108,6109,6110,6111,6112,6113,6115,6116,6118,6119,6120,6121,6122,6123,6124,6125,6126,6128,6130,6132,6134,6135,6136,6137,6138,6139,6141,6142,6143,6144,6145,6146,6147,6148,6149,6150,6151,6152,6153,6154,6155,6156,6157,6158,6159,6160,6161,6162,6164,6165,6166,6167,6168,6169,6170,6171,6172,6173,6174,6175,6176,6177,6178,6179,6180,6182,6183,6184,6185,6186,6187,6188,6189,6190,6192,6193,6194,6195,6196,6197,6198,6199,6200,6202,6203,6204,6205,6206,6207,6208,6209,6210,6212,6213,6214,6215,6216,6217,6218,6219,6220,6221,6222,6223,6224,6225,6226,6227,6228,6229,6230,6231,6232,6233,6234,6235,6236,6237,6238,6239,6240,6242,6243,6244,6245,6246,6247,6248,6249,6251,6252,6253,6254,6255,6256,6257,6258,6260,6261,6262,6263,6265,6266,6267,6268,6269,6270,6271,6272,6273,6274,6275,6276,6277,6278,6279,6281,6282,6283,6284,6285,6289,6290,6291,6292,6294,6295,6296,6297,6298,6299,6300,6301,6302,6303,6304,6305,6306,6307,6308,6310,6311,6312,6313,6314,6315,6316,6317,6318,6320,6321,6322,6323,6324,6325,6326,6327,6329,6330,6331,6332,6333,6334,6335,6336,6337,6338,6339,6340,6341,6343,6345,6346,6347,6348,6349,6350,6352,6353,6354,6355,6356,6357,6358,6359,6360,6361,6362,6363,6364,6365,6366,6367,6368,6369,6370,6371,6372,6373,6374,6375,6376,6377,6378,6379,6380,6381,6382,6384,6385,6386,6387,6388,6389,6390,6391,6392,6393,6394,6395,6396,6397,6399,6401,6402,6403,6404,6405,6406,6407,6408,6409,6410,6411,6412,6413,6414,6415,6416,6417,6418,6419,6420,6421,6422,6423,6425,6427,6430,6431,6432,6433,6434,6435,6436,6438,6439,6440,6441,6442,6443,6445,6446,6447,6448,6449,6450,6451,6452,6453,6455,6456,6457,6458,6459,6460,6462,6463,6464,6465,6466,6467,6468,6469,6471,6472,6474,6475,6476,6477,6479,6480,6481,6482,6483,6484,6485,6486,6487,6488,6490,6491,6492,6493,6494,6495,6496,6497,6498,6499,6500,6501,6502,6503,6504,6505,6506,6507,6508,6509,6511,6512,6513,6514,6515,6516,6517,6518,6519,6520,6521,6522,6523,6524,6525,6527,6528,6529,6530,6531,6533,6534,6535,6536,6537,6538,6539,6540,6541,6542,6543,6544,6545,6547,6548,6549,6550,6551,6552,6553,6554,6555,6556,6558,6559,6560,6561,6562,6563,6564,6565,6566,6568,6569,6570,6571,6572,6573,6574,6575,6576,6577,6578,6579,6581,6582,6584,6585,6586,6587,6589,6591,6592,6593,6594,6595,6596,6598,6599,6600,6601,6603,6604,6605,6606,6607,6608,6609,6610,6611,6612,6613,6614,6615,6616,6617,6618,6619,6620,6622,6623,6624,6625,6626,6627,6628,6629,6630,6631,6632,6634,6635,6636,6637,6638,6639,6640,6641,6642,6644,6645,6646,6647,6648,6649,6650,6652,6653,6654,6655,6656,6657,6658,6659,6660,6661,6662,6663,6664,6665,6666,6667,6668,6669,6670,6671,6673,6674,6675,6676,6677,6678,6679,6680,6681,6682,6683,6684,6685,6686,6687,6688,6689,6690,6691,6692,6693,6694,6695,6696,6697,6698,6699,6700,6702,6703,6704,6705,6706,6707,6708,6709,6710,6712,6713,6714,6715,6716,6717,6718,6720,6721,6722,6723,6724,6725,6726,6727,6728,6729,6730,6731,6732,6733,6734,6735,6736,6737,6738,6739,6740,6741,6742,6743,6744,6745,6746,6747,6748,6749,6751,6754,6755,6756,6757,6758,6759,6761,6762,6763,6764,6765,6767,6768,6769,6771,6772,6773,6774,6775,6776,6777,6778,6780,6782,6783,6784,6785,6787,6788,6789,6790,6791,6792,6793,6794,6796,6797,6799,6800,6801,6802,6803,6804,6805,6806,6807,6809,6810,6811,6812,6813,6814,6815,6816,6817,6819,6820,6821,6822,6823,6824,6825,6826,6827,6828,6829,6830,6831,6832,6834,6836,6837,6838,6839,6840,6842,6844,6845,6846,6847,6848,6849,6850,6851,6852,6853,6854,6855,6856,6857,6858,6859,6860,6861,6862,6863,6864,6865,6866,6867,6868,6869,6870,6871,6872,6873,6874,6875,6876,6878,6879,6880,6881,6882,6883,6884,6885,6886,6887,6888,6889,6890,6891,6893,6895,6896,6897,6898,6899,6900,6901,6902,6903,6904,6905,6906,6907,6908,6909,6910,6911,6912,6913,6914,6915,6916,6917,6918,6919,6920,6922,6924,6926,6928,6929,6930,6931,6932,6933,6934,6935,6936,6938,6939,6940,6941,6942,6943,6944,6945,6946,6948,6949,6950,6951,6952,6953,6954,6955,6956,6957,6958,6960,6961,6963,6964,6965,6966,6967,6969,6972,6973,6974,6975,6976,6977,6980,6981,6982,6983,6984,6985,6986,6987,6988,6989,6990,6991,6992,6993,6994,6995,6996,6997,6998,6999,7000,7001,7002,7003,7004,7005,7006,7007,7008,7009,7010,7011,7012,7013,7014,7015,7016,7017,7018,7019,7020,7021,7022,7023,7024,7025,7026,7027,7028,7029,7030,7032,7033,7034,7035,7036,7038,7039,7040,7041,7042,7043,7044,7045,7046,7047,7048,7050,7051,7053,7054,7055,7056,7057,7058,7059,7060,7061,7063,7064,7065,7066,7067,7068,7069,7070,7071,7073,7074,7075,7076,7077,7078,7079,7080,7081,7082,7083,7085,7087,7088,7089,7090,7091,7092,7093,7094,7095,7096,7097,7098,7099,7100,7101,7102,7103,7104,7105,7106,7107,7108,7109,7110,7111,7113,7114,7115,7116,7117,7118,7119,7120,7121,7122,7123,7124,7125,7126,7127,7128,7130,7131,7132,7134,7135,7136,7137,7138,7140,7141,7142,7143,7144,7145,7146,7147,7148,7149,7150,7151,7152,7153,7154,7155,7156,7157,7158,7159,7160,7163,7164,7165,7166,7167,7169,7170,7171,7172,7173,7174,7176,7177,7178,7179,7180,7181,7182,7183,7184,7185,7186,7187,7188,7189,7191,7192,7193,7194,7195,7196,7197,7198,7199,7200,7201,7204,7205,7206,7207,7208,7209,7210,7211,7212,7213,7214,7215,7217,7218,7219,7220,7222,7223,7224,7226,7227,7228,7229,7230,7232,7233,7234,7235,7236,7237,7238,7239,7240,7241,7242,7243,7244,7245,7246,7247,7248,7249,7250,7251,7252,7253,7254,7256,7257,7258,7259,7260,7262,7264,7265,7266,7267,7268,7270,7271,7272,7273,7274,7275,7276,7277,7278,7280,7281,7282,7283,7284,7285,7286,7287,7288,7290,7291,7292,7293,7294,7295,7296,7297,7298,7299,7300,7301,7302,7303,7304,7305,7306,7307,7308,7309,7310,7311,7312,7313,7314,7315,7316,7318,7319,7320,7321,7322,7323,7324,7325,7326,7327,7328,7329,7331,7332,7333,7334,7335,7336,7338,7339,7340,7341,7343,7344,7345,7346,7347,7348,7349,7350,7351,7352,7353,7355,7356,7357,7358,7359,7360,7361,7362,7364,7365,7366,7369,7370,7371,7372,7373,7374,7375,7376,7377,7378,7379,7380,7382,7383,7384,7386,7387,7388,7389,7390,7391,7392,7393,7394,7395,7396,7397,7398,7399,7400,7401,7402,7403,7404,7405,7406,7407,7408,7409,7411,7412,7413,7414,7415,7416,7417,7418,7419,7420,7421,7422,7423,7424,7425,7426,7427,7428,7429,7430,7431,7432,7433,7434,7435,7436,7437,7438,7439,7441,7442,7443,7444,7445,7447,7448,7450,7451,7453,7454,7455,7456,7457,7458,7459,7460,7461,7462,7463,7464,7466,7467,7468,7469,7470,7471,7472,7473,7474,7475,7476,7477,7478,7479,7480,7481,7482,7483,7484,7486,7487,7488,7489,7490,7492,7493,7494,7495,7496,7497,7498,7499,7500,7501,7502,7503,7504,7507,7508,7509,7510,7511,7512,7513,7514,7515,7517,7518,7519,7520,7521,7522,7523,7524,7525,7527,7528,7529,7530,7531,7532,7533,7534,7535,7538,7539,7540,7541,7542,7543,7544,7545,7546,7547,7548,7549,7550,7551,7552,7553,7554,7556,7557,7559,7560,7561,7562,7563,7564,7565,7567,7568,7569,7570,7571,7572,7573,7574,7575,7576,7577,7578,7579,7580,7581,7582,7583,7584,7585,7586,7587,7588,7589,7590,7591,7592,7594,7595,7596,7597,7598,7600,7602,7603,7604,7605,7606,7608,7609,7610,7611,7612,7613,7614,7615,7616,7618,7619,7620,7621,7622,7623,7624,7626,7627,7628,7629,7630,7631,7632,7633,7634,7635,7636,7637,7638,7639,7640,7641,7642,7643,7644,7645,7647,7648,7649,7650,7651,7652,7653,7654,7656,7657,7658,7659,7660,7661,7662,7663,7664,7665,7666,7667,7668,7669,7670,7672,7673,7674,7675,7676,7677,7678,7679,7680,7681,7682,7683,7684,7685,7686,7687,7689,7690,7691,7692,7694,7695,7696,7697,7698,7700,7701,7704,7705,7707,7708,7709,7710,7711,7712,7713,7714,7715,7716,7717,7718,7719,7720,7721,7722,7724,7725,7726,7728,7729,7730,7731,7732,7733,7734,7735,7736,7738,7739,7740,7741,7742,7743,7744,7745,7746,7748,7749,7750,7751,7752,7753,7754,7755,7756,7757,7758,7759,7760,7761,7762,7763,7764,7765,7766,7767,7768,7769,7770,7771,7772,7773,7774,7775,7776,7777,7778,7779,7781,7783,7784,7785,7786,7787,7788,7789,7790,7792,7793,7794,7795,7796,7797,7798,7799,7800,7801,7802,7803,7804,7805,7806,7807,7808,7809,7811,7812,7813,7814,7815,7816,7818,7819,7821,7822,7823,7824,7825,7826,7827,7828,7829,7831,7832,7833,7834,7836,7837,7839,7840,7841,7842,7843,7844,7845,7847,7848,7849,7850,7851,7852,7853,7854,7856,7857,7858,7859,7860,7861,7862,7863,7864,7865,7867,7869,7870,7871,7872,7874,7875,7876,7877,7878,7879,7880,7881,7883,7884,7885,7886,7888,7890,7891,7892,7893,7894,7895,7896,7897,7899,7900,7901,7902,7903,7904,7905,7906,7908,7909,7910,7911,7912,7914,7915,7916,7917,7918,7919,7920,7921,7922,7923,7924,7925,7926,7927,7928,7929,7930,7931,7932,7934,7935,7936,7937,7938,7939,7940,7941,7942,7944,7945,7946,7947,7948,7949,7950,7951,7952,7954,7955,7956,7957,7958,7959,7960,7961,7962,7963,7964,7965,7966,7968,7969,7970,7971,7972,7973,7974,7975,7976,7977,7978,7979,7980,7981,7982,7983,7984,7985,7986,7988,7990,7991,7992,7993,7994,7995,7996,7997,7998,7999,8000,8001,8002,8003,8004,8005,8006,8008,8009,8010,8011,8012,8013,8014,8015,8017,8018,8019,8020,8022,8024,8025,8026,8027,8028,8030,8031,8032,8033,8034,8035,8036,8037,8038,8039,8040,8041,8042,8043,8044,8045,8046,8047,8048,8049,8050,8051,8052,8053,8054,8058,8059,8060,8061,8062,8063,8064,8065,8066,8068,8069,8070,8071,8072,8073,8074,8075,8076,8078,8079,8080,8081,8082,8083,8084,8086,8087,8088,8089,8090,8091,8092,8093,8094,8095,8096,8097,8099,8100,8101,8102,8103,8104,8105,8106,8107,8108,8109,8110,8112,8113,8115,8116,8118,8119,8120,8121,8122,8123,8124,8125,8126,8128,8129,8130,8131,8132,8133,8134,8135,8136,8138,8139,8140,8141,8142,8143,8144,8145,8146,8147,8148,8149,8150,8151,8153,8154,8155,8156,8157,8158,8159,8160,8161,8162,8164,8165,8166,8167,8168,8169,8170,8171,8173,8174,8175,8176,8177,8178,8180,8181,8182,8183,8184,8185,8186,8187,8188,8189,8190,8191,8192,8193,8196,8197,8198,8200,8201,8202,8203,8204,8205,8206,8207,8208,8209,8210,8211,8213,8214,8215,8216,8217,8218,8219,8220,8222,8223,8224,8225,8226,8227,8229,8230,8231,8232,8233,8234,8235,8236,8237,8238,8239,8240,8241,8242,8244,8245,8246,8247,8248,8249,8250,8252,8253,8254,8255,8256,8257,8258,8259,8261,8262,8263,8264,8265,8266,8267,8268,8269,8270,8271,8272,8274,8275,8276,8277,8279,8280,8281,8282,8284,8285,8286,8287,8288,8289,8290,8291,8292,8293,8294,8295,8296,8297,8298,8299,8300,8301,8302,8303,8304,8305,8306,8308,8309,8310,8311,8312,8313,8314,8315,8316,8317,8318,8319,8320,8321,8322,8323,8324,8326,8327,8328,8329,8330,8331,8332,8333,8334,8336,8337,8339,8340,8341,8344,8345,8346,8347,8348,8349,8350,8352,8353,8354,8355,8356,8357,8358,8360,8361,8362,8363,8364,8365,8366,8367,8368,8369,8370,8371,8372,8374,8375,8376,8377,8378,8379,8380,8381,8383,8384,8385,8386,8387,8390,8391,8392,8393,8394,8395,8396,8397,8398,8399,8400,8401,8402,8403,8404,8405,8406,8407,8408,8409,8410,8411,8412,8413,8415,8416,8417,8418,8419,8420,8421,8422,8423,8424,8426,8427,8428,8429,8430,8431,8432,8433,8434,8435,8436,8437,8438,8439,8440,8441,8442,8443,8444,8445,8446,8447,8449,8450,8451,8452,8453,8454,8455,8456,8457,8459,8460,8461,8462,8463,8464,8465,8466,8467,8469,8470,8471,8472,8473,8474,8475,8476,8477,8478,8479,8480,8482,8483,8484,8485,8486,8487,8488,8489,8491,8492,8493,8494,8495,8497,8498,8499,8500,8502,8503,8504,8505,8506,8507,8508,8509,8510,8511,8512,8515,8516,8517,8518,8519,8520,8521,8522,8523,8524,8525,8526,8527,8529,8530,8531,8532,8533,8534,8536,8537,8538,8539,8540,8541,8542,8543,8544,8545,8546,8547,8549,8550,8551,8552,8553,8554,8555,8556,8557,8559,8560,8561,8562,8563,8564,8565,8566,8568,8569,8570,8571,8572,8573,8574,8575,8577,8578,8579,8580,8581,8582,8583,8584,8585,8586,8588,8589,8590,8591,8592,8593,8594,8596,8597,8598,8599,8600,8601,8602,8603,8604,8605,8606,8607,8608,8609,8610,8612,8613,8615,8616,8617,8618,8620,8622,8623,8624,8625,8626,8627,8628,8630,8631,8632,8633,8635,8636,8637,8638,8639,8640,8641,8642,8643,8644,8645,8646,8647,8648,8649,8650,8651,8652,8653,8654,8655,8656,8658,8659,8660,8661,8662,8663,8664,8665,8666,8667,8668,8669,8670,8672,8673,8674,8675,8676,8677,8678,8679,8680,8682,8683,8684,8685,8686,8687,8688,8689,8690,8692,8693,8694,8695,8696,8697,8698,8699,8700,8701,8702,8703,8704,8705,8706,8707,8708,8709,8710,8711,8712,8713,8714,8715,8716,8717,8718,8719,8720,8721,8722,8723,8724,8725,8726,8727,8728,8729,8732,8733,8734,8735,8736,8737,8739,8740,8741,8742,8743,8744,8745,8746,8747,8749,8750,8751,8753,8754,8755,8756,8757,8758,8759,8760,8761,8762,8766,8767,8768,8769,8770,8771,8773,8774,8775,8776,8777,8778,8779,8780,8781,8782,8783,8784,8785,8786,8787,8788,8789,8790,8791,8792,8793,8794,8796,8797,8799,8800,8801,8802,8803,8804,8805,8806,8807,8809,8810,8811,8812,8813,8814,8815,8816,8817,8819,8820,8821,8822,8823,8824,8825,8826,8827,8828,8829,8830,8831,8832,8833,8834,8835,8836,8837,8838,8839,8840,8841,8842,8843,8844,8846,8847,8848,8850,8852,8853,8854,8855,8856,8857,8860,8861,8862,8863,8864,8866,8867,8869,8870,8871,8872,8873,8874,8875,8876,8877,8878,8879,8880,8882,8883,8884,8885,8886,8887,8888,8889,8890,8891,8892,8893,8894,8896,8897,8898,8899,8900,8901,8902,8903,8904,8905,8906,8907,8908,8909,8910,8911,8912,8914,8915,8916,8917,8918,8919,8920,8922,8923,8924,8925,8926,8927,8928,8930,8931,8932,8933,8934,8935,8936,8937,8938,8939,8940,8941,8942,8943,8944,8945,8946,8947,8948,8949,8950,8952,8953,8954,8955,8956,8957,8958,8959,8960,8961,8962,8963,8964,8965,8966,8967,8968,8969,8970,8971,8972,8973,8974,8975,8976,8977,8979,8980,8981,8982,8984,8985,8986,8987,8988,8989,8990,8993,8994,8995,8996,8997,8998,9000,9001,9002,9003,9005,9006,9007,9008,9009,9010,9011,9012,9013,9014,9015,9017,9018,9019,9020,9021,9022,9023,9024,9025,9026,9027,9028,9029,9030,9031,9032,9033,9034,9035,9036,9039,9040,9041,9042,9043,9044,9045,9046,9047,9048,9049,9050,9051,9053,9054,9055,9056,9057,9058,9059,9061,9062,9063,9064,9065,9066,9067,9068,9069,9071,9072,9073,9074,9075,9076,9077,9078,9079,9081,9082,9083,9084,9085,9086,9087,9088,9089,9090,9091,9092,9093,9094,9096,9097,9098,9099,9100,9101,9102,9103,9104,9106,9107,9108,9109,9110,9111,9112,9113,9114,9115,9116,9117,9118,9119,9120,9121,9122,9123,9124,9125,9126,9127,9128,9129,9130,9131,9132,9133,9135,9136,9138,9139,9140,9141,9142,9143,9144,9145,9146,9147,9148,9149,9150,9151,9152,9153,9154,9155,9156,9157,9159,9160,9161,9163,9164,9165,9166,9168,9169,9170,9171,9172,9173,9175,9176,9177,9178,9180,9181,9182,9183,9184,9185,9186,9187,9188,9190,9191,9192,9193,9194,9195,9196,9197,9198,9200,9201,9202,9203,9204,9205,9206,9207,9208,9209,9210,9211,9212,9213,9214,9215,9216,9217,9218,9219,9222,9224,9225,9226,9227,9228,9229,9231,9232,9233,9234,9235,9237,9238,9240,9241,9242,9243,9245,9246,9247,9248,9249,9250,9251,9252,9253,9254,9255,9256,9257,9258,9259,9260,9261,9262,9263,9265,9266,9267,9268,9269,9270,9271,9272,9274,9275,9276,9277,9278,9279,9280,9282,9283,9284,9285,9286,9287,9288,9289,9290,9291,9292,9293,9294,9295,9298,9299,9300,9301,9302,9303,9304,9305,9306,9307,9308,9309,9312,9313,9314,9315,9316,9317,9318,9319,9320,9321,9322,9323,9324,9326,9327,9328,9329,9330,9331,9332,9333,9334,9335,9336,9337,9338,9340,9341,9342,9343,9344,9345,9346,9347,9348,9349,9350,9351,9353,9354,9355,9356,9357,9359,9360,9361,9362,9363,9364,9365,9366,9368,9369,9370,9371,9372,9373,9374,9375,9376,9378,9379,9380,9381,9382,9383,9384,9385,9386,9388,9389,9390,9391,9392,9393,9394,9395,9397,9398,9399,9400,9401,9402,9403,9404,9406,9407,9408,9409,9410,9411,9412,9413,9415,9416,9417,9418,9419,9420,9421,9422,9423,9424,9426,9427,9428,9429,9430,9431,9432,9433,9434,9435,9437,9438,9441,9442,9443,9444,9445,9446,9447,9448,9449,9450,9451,9452,9453,9454,9456,9458,9460,9461,9462,9463,9464,9465,9466,9467,9468,9469,9470,9471,9472,9473,9474,9475,9476,9477,9478,9479,9480,9481,9482,9483,9484,9485,9486,9487,9489,9490,9491,9492,9493,9494,9495,9496,9497,9499,9500,9501,9502,9503,9504,9505,9506,9507,9509,9510,9511,9512,9513,9514,9515,9516,9517,9518,9520,9521,9522,9523,9524,9525,9526,9529,9530,9531,9532,9533,9534,9535,9536,9537,9538,9539,9540,9541,9543,9544,9545,9546,9547,9548,9549,9550,9551,9553,9554,9555,9556,9557,9558,9559,9560,9561,9562,9563,9564,9565,9566,9567,9568,9569,9570,9571,9572,9573,9574,9575,9576,9577,9578,9579,9580,9581,9582,9583,9584,9586,9587,9588,9589,9590,9591,9592,9593,9594,9595,9596,9597,9598,9599,9600,9602,9603,9604,9605,9606,9607,9608,9609,9610,9612,9613,9614,9615,9616,9617,9618,9619,9620,9622,9623,9624,9625,9626,9627,9628,9629,9630,9632,9635,9636,9637,9638,9639,9640,9641,9642,9643,9644,9645,9646,9649,9650,9651,9652,9653,9654,9655,9656,9657,9658,9659,9660,9661,9662,9664,9665,9667,9668,9669,9670,9671,9672,9673,9674,9675,9676,9678,9679,9680,9681,9682,9683,9684,9685,9686,9689,9690,9691,9692,9693,9694,9695,9696,9697,9698,9699,9700,9701,9702,9703,9705,9706,9707,9708,9709,9710,9711,9712,9713,9715,9716,9717,9718,9719,9720,9721,9722,9723,9725,9726,9727,9728,9729,9730,9731,9732,9733,9734,9735,9736,9737,9738,9740,9741,9742,9743,9744,9745,9746,9747,9748,9749,9750,9751,9752,9754,9755,9756,9758,9759,9760,9762,9764,9765,9766,9767,9768,9769,9770,9771,9772,9773,9774,9775,9776,9777,9778,9779,9780,9781,9782,9783,9784,9785,9786,9787,9788,9789,9790,9792,9793,9794,9795,9796,9797,9798,9799,9802,9803,9804,9805,9806,9807,9808,9810,9811,9812,9813,9814,9815,9816,9817,9819,9820,9821,9822,9823,9824,9825,9827,9828,9829,9830,9831,9832,9833,9834,9835,9836,9837,9838,9839,9840,9841,9842,9843,9844,9845,9846,9847,9848,9849,9851,9852,9853,9854,9855,9856,9857,9858,9859,9860,9861,9862,9863,9864,9866,9867,9868,9869,9870,9871,9872,9873,9874,9875,9876,9877,9878,9880,9881,9882,9883,9884,9886,9887,9888,9889,9890,9891,9892,9893,9894,9895,9896,9898,9899,9900,9901,9903,9904,9905,9906,9907,9908,9909,9910,9912,9913,9914,9915,9916,9917,9918,9919,9920,9921,9922,9923,9924,9925,9926,9927,9928,9929,9931,9932,9933,9934,9935,9936,9937,9938,9940,9941,9942,9943,9944,9945,9946,9947,9949,9950,9953,9954,9955,9956,9957,9958,9959,9960,9961,9963,9965,9966,9967,9968,9969,9970,9971,9972,9973,9974,9975,9976,9977,9978,9979,9980,9981,9982,9984,9985,9986,9987,9988,9989,9990,9991,9992,9994,9995,9996,9997,9998,9999],"errors":9020}},{"run_id":"graph-fidelity-source-sd-s102","spec":{"run_id":"graph-fidelity-source-sd-s102","stage":"evaluate","cohort":"fidelity","variant":"source-sd","recipe":"sd_constant","pmax":0.4,"input_scale":1.0,"output_relu":true,"lr":0.001,"momentum":0.9,"shrinkage":2e-05,"seed":102,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"timeout_seconds":180,"gpu":"A100","precision":"fp32"},"history":[{"epoch":1,"stochastic_training_loss":456492.625,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":0.6350219480000021,"epoch_training_seconds":0.6350219480000021,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":5,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":3.1540754720000166,"epoch_training_seconds":0.6286879680000084,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":10,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":6.305727795000081,"epoch_training_seconds":0.6296953850000193,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":15,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":9.448965994000105,"epoch_training_seconds":0.6290593490000163,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":20,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":12.5960331900001,"epoch_training_seconds":0.6291515320000087,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":25,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":15.769952755000077,"epoch_training_seconds":0.626330055000011,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":30,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":18.899050642000077,"epoch_training_seconds":0.6262359680000031,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":35,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":22.03743038300007,"epoch_training_seconds":0.6331683470000087,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":40,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":25.174772971000067,"epoch_training_seconds":0.6275509280000051,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":45,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":28.307810326000066,"epoch_training_seconds":0.6276039910000009,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":50,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":31.43995324100007,"epoch_training_seconds":0.6261162790000014,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":55,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":34.58420603400012,"epoch_training_seconds":0.6258081880000077,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":60,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":37.727219241000086,"epoch_training_seconds":0.630084829999987,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":65,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":40.866800512000026,"epoch_training_seconds":0.6292993419999675,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":70,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":44.010707368000084,"epoch_training_seconds":0.6299940610000476,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":75,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":47.13436806000013,"epoch_training_seconds":0.6258977010000422,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":80,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":50.27257758000016,"epoch_training_seconds":0.6288040940000315,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":85,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":53.41162813400021,"epoch_training_seconds":0.6317667800000208,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":90,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":56.55507262600017,"epoch_training_seconds":0.6320577369999683,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":95,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":59.69316909900013,"epoch_training_seconds":0.6294048999999973,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":100,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":62.833476593000086,"epoch_training_seconds":0.6275810559999968,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]}],"best_epoch":1,"best_validation_loss":2.302585546875,"training_seconds":62.833476593000086,"total_run_seconds":64.002410696,"hardware":{"device":"cuda:0","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"4d0ac269167486811a0086108ca56313016afcebfc075d45e09455c228dee75b","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[7773,15460,23463,31533],"final_train":{"loss":2.3025853125,"accuracy":0.09802,"n":50000},"selected_train":{"loss":2.3025853125,"accuracy":0.09802,"n":50000},"final_test":{"loss":2.302585546875,"accuracy":0.098,"n":10000,"wrong_indices":[0,1,2,4,5,6,7,8,9,11,12,14,15,16,17,18,19,20,21,22,23,24,26,27,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,56,57,58,59,60,61,62,63,64,65,66,67,68,70,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,127,128,129,130,131,132,133,134,135,137,138,139,140,141,142,143,144,145,146,147,149,150,151,152,153,154,155,156,158,159,160,161,162,163,164,165,166,167,168,169,170,171,172,173,174,175,176,177,178,179,180,181,182,184,185,186,187,189,190,191,193,195,196,197,198,199,200,201,202,203,204,205,206,207,208,209,210,211,212,213,214,216,217,218,219,220,221,222,223,224,225,226,227,228,229,230,231,232,233,234,235,236,237,238,239,240,241,242,243,244,245,247,248,249,250,251,252,253,254,255,256,257,258,259,260,261,262,263,264,265,266,267,268,270,272,273,274,275,276,277,278,279,280,281,282,283,284,285,286,287,288,289,290,291,292,293,295,298,299,300,301,302,303,304,306,307,308,309,310,313,314,315,316,317,318,319,320,321,322,323,325,326,328,329,330,331,332,333,334,335,336,337,338,339,340,341,342,343,344,345,347,348,349,350,351,352,353,354,355,356,357,358,359,360,361,362,363,364,366,367,368,369,370,371,373,374,375,376,377,378,379,381,382,383,384,385,386,387,388,389,390,391,392,393,394,395,396,397,398,399,400,401,402,403,404,405,406,408,409,410,411,412,413,414,415,416,417,418,419,420,421,422,423,425,426,427,428,429,430,431,432,433,434,435,436,437,438,439,442,444,445,446,447,448,449,450,451,452,453,454,455,456,457,458,460,461,462,463,464,465,466,467,468,469,470,471,472,473,474,475,476,477,478,479,480,481,482,483,484,486,487,488,489,491,492,493,494,495,496,497,499,500,501,502,503,504,505,506,507,508,509,510,511,512,513,514,515,516,517,518,519,520,521,522,523,524,526,527,528,529,530,531,532,533,534,535,536,537,538,539,540,541,542,543,544,547,548,549,550,551,553,554,555,556,557,558,559,560,562,563,565,566,568,569,570,571,572,573,574,575,576,577,578,579,580,582,583,584,585,587,588,589,590,591,593,594,595,596,598,599,600,601,602,603,604,605,606,607,609,610,612,613,614,615,616,617,618,619,621,622,623,624,625,626,627,628,629,630,631,632,633,634,635,636,637,638,639,640,641,643,645,646,647,648,649,650,651,652,653,654,655,657,658,659,660,662,663,664,665,666,667,668,669,670,671,672,673,674,675,676,677,678,679,680,681,682,683,684,685,686,687,688,689,690,691,692,693,694,695,696,697,698,699,700,702,703,705,706,707,708,709,710,711,712,714,715,716,718,719,720,722,724,725,726,727,728,729,730,731,732,733,734,735,736,737,738,739,740,741,743,744,745,746,747,748,749,751,752,753,754,755,756,757,758,759,760,761,762,764,765,766,767,768,769,770,771,772,773,774,775,776,777,778,779,780,781,782,783,784,785,786,787,788,789,790,791,792,793,795,796,797,798,799,800,801,802,803,805,806,807,808,809,810,811,812,813,814,815,816,817,818,819,820,822,823,824,825,826,827,828,829,830,831,832,833,834,835,836,837,838,839,840,841,842,843,844,846,847,848,849,850,852,853,855,856,857,858,859,860,861,862,863,864,865,866,867,868,869,870,872,873,874,875,876,877,878,879,880,881,882,883,885,886,887,888,889,890,891,892,893,894,897,898,899,900,901,902,903,905,906,907,908,909,910,911,912,913,914,915,916,917,918,919,920,921,922,923,924,925,926,927,928,929,930,931,933,934,935,936,937,938,939,940,941,942,943,944,945,946,947,948,949,950,951,952,953,954,955,956,957,958,959,960,961,962,963,964,965,966,967,968,969,970,971,973,974,975,976,977,978,979,980,982,983,984,985,986,987,988,989,990,991,992,994,995,996,998,999,1000,1002,1003,1004,1005,1006,1007,1008,1010,1011,1012,1013,1014,1015,1016,1017,1018,1019,1020,1021,1022,1023,1024,1025,1026,1027,1028,1029,1030,1031,1032,1033,1035,1036,1037,1038,1039,1040,1041,1042,1043,1044,1045,1046,1048,1049,1050,1051,1052,1053,1054,1055,1056,1057,1058,1059,1060,1062,1063,1064,1065,1066,1067,1068,1069,1070,1071,1072,1073,1074,1075,1076,1077,1078,1079,1080,1081,1082,1083,1085,1086,1087,1088,1089,1090,1091,1092,1093,1095,1096,1097,1098,1099,1100,1101,1102,1103,1104,1105,1106,1107,1108,1109,1110,1111,1112,1113,1114,1115,1116,1117,1118,1119,1120,1122,1123,1124,1125,1126,1127,1128,1129,1130,1131,1132,1133,1134,1135,1136,1137,1138,1139,1140,1141,1142,1143,1144,1145,1146,1147,1149,1150,1151,1152,1153,1155,1156,1157,1158,1159,1160,1161,1162,1163,1164,1165,1166,1167,1168,1169,1170,1171,1172,1173,1174,1175,1177,1178,1179,1180,1181,1182,1183,1184,1185,1186,1187,1189,1190,1192,1193,1194,1196,1198,1199,1200,1201,1202,1204,1205,1206,1207,1208,1209,1210,1211,1212,1213,1214,1215,1216,1217,1219,1221,1222,1224,1225,1226,1227,1228,1229,1230,1232,1233,1234,1235,1236,1237,1238,1239,1240,1241,1242,1243,1244,1245,1247,1248,1249,1250,1251,1252,1253,1254,1255,1256,1257,1258,1259,1260,1262,1263,1264,1265,1266,1267,1268,1269,1270,1272,1274,1275,1276,1277,1278,1279,1280,1281,1282,1283,1284,1285,1286,1287,1289,1290,1291,1292,1293,1295,1296,1298,1299,1300,1301,1302,1303,1304,1305,1306,1307,1308,1309,1310,1311,1312,1313,1314,1315,1316,1317,1318,1319,1320,1321,1322,1323,1324,1325,1326,1327,1328,1329,1330,1331,1332,1334,1335,1336,1337,1338,1339,1340,1341,1342,1343,1344,1345,1346,1347,1348,1349,1350,1351,1352,1353,1354,1355,1356,1357,1358,1359,1360,1361,1362,1363,1364,1365,1366,1367,1368,1369,1370,1371,1372,1373,1374,1375,1376,1377,1378,1380,1381,1382,1383,1384,1385,1386,1387,1388,1389,1391,1392,1393,1394,1395,1396,1397,1398,1400,1401,1402,1403,1405,1406,1407,1409,1410,1412,1413,1414,1415,1417,1418,1419,1420,1421,1422,1423,1424,1425,1426,1427,1428,1429,1430,1431,1432,1433,1434,1435,1436,1437,1439,1440,1441,1442,1443,1444,1446,1447,1448,1449,1450,1451,1452,1453,1455,1456,1458,1459,1460,1461,1462,1463,1464,1465,1466,1467,1469,1470,1471,1472,1473,1474,1475,1476,1477,1478,1479,1480,1481,1482,1483,1484,1485,1486,1488,1489,1490,1491,1492,1493,1494,1495,1496,1497,1498,1499,1500,1501,1502,1503,1505,1506,1507,1508,1509,1510,1511,1512,1513,1514,1515,1516,1518,1519,1520,1521,1522,1523,1524,1525,1527,1528,1529,1530,1531,1532,1536,1537,1538,1539,1540,1541,1542,1543,1544,1545,1546,1547,1548,1549,1550,1551,1552,1553,1554,1555,1556,1557,1559,1560,1561,1562,1563,1564,1566,1567,1568,1569,1571,1572,1573,1574,1575,1576,1577,1578,1579,1580,1581,1582,1583,1584,1585,1586,1587,1588,1591,1592,1593,1594,1595,1596,1597,1598,1599,1600,1601,1602,1603,1604,1605,1606,1607,1608,1609,1611,1612,1613,1614,1615,1616,1617,1618,1620,1622,1624,1625,1626,1627,1628,1629,1630,1631,1632,1633,1634,1635,1636,1637,1639,1640,1641,1642,1643,1644,1645,1646,1647,1648,1649,1651,1652,1653,1654,1655,1656,1657,1658,1659,1660,1661,1662,1663,1664,1665,1666,1667,1668,1669,1670,1671,1672,1673,1674,1675,1676,1677,1678,1679,1680,1681,1682,1683,1684,1685,1686,1687,1688,1689,1690,1691,1693,1694,1695,1696,1697,1698,1699,1701,1702,1703,1704,1705,1706,1707,1709,1710,1711,1714,1715,1716,1717,1718,1719,1720,1721,1722,1724,1725,1727,1728,1729,1730,1731,1732,1733,1734,1735,1736,1737,1738,1740,1741,1742,1743,1744,1745,1746,1747,1749,1750,1751,1752,1753,1754,1755,1756,1758,1759,1760,1761,1763,1765,1766,1767,1769,1770,1771,1772,1773,1774,1776,1778,1779,1780,1781,1782,1783,1784,1785,1786,1787,1788,1789,1790,1791,1792,1793,1795,1797,1798,1799,1800,1801,1802,1803,1804,1805,1806,1809,1810,1811,1812,1813,1814,1815,1816,1817,1818,1819,1820,1821,1822,1823,1824,1825,1827,1828,1829,1830,1831,1832,1833,1834,1835,1836,1837,1838,1839,1840,1842,1844,1845,1846,1847,1848,1849,1850,1851,1852,1853,1854,1855,1856,1857,1858,1859,1860,1861,1862,1863,1864,1865,1866,1867,1868,1869,1871,1872,1873,1874,1875,1876,1877,1878,1879,1880,1881,1882,1883,1884,1885,1886,1887,1888,1889,1890,1891,1893,1894,1895,1896,1897,1899,1900,1901,1902,1903,1904,1905,1906,1908,1909,1910,1911,1912,1913,1914,1915,1916,1917,1919,1920,1921,1922,1923,1924,1925,1926,1927,1928,1929,1930,1931,1932,1933,1934,1935,1936,1937,1938,1939,1940,1941,1942,1943,1945,1946,1947,1948,1949,1950,1951,1952,1953,1954,1955,1956,1957,1958,1960,1961,1962,1963,1964,1965,1966,1967,1968,1969,1970,1971,1973,1974,1975,1976,1977,1978,1979,1980,1981,1982,1983,1984,1985,1986,1988,1989,1990,1991,1992,1993,1994,1996,1997,1998,1999,2000,2001,2002,2003,2004,2005,2006,2007,2008,2009,2010,2011,2012,2013,2014,2015,2016,2017,2018,2019,2020,2021,2022,2024,2025,2026,2027,2028,2029,2030,2031,2032,2034,2035,2036,2037,2038,2039,2040,2041,2043,2044,2045,2046,2047,2048,2049,2050,2051,2052,2053,2054,2055,2056,2057,2058,2059,2062,2063,2064,2065,2066,2068,2069,2070,2071,2072,2073,2074,2075,2076,2077,2078,2079,2080,2082,2083,2084,2085,2086,2088,2089,2090,2091,2092,2093,2094,2095,2097,2098,2099,2100,2101,2102,2103,2104,2105,2107,2108,2109,2110,2111,2112,2113,2114,2115,2116,2117,2118,2119,2120,2121,2122,2123,2124,2125,2126,2128,2129,2130,2131,2132,2133,2134,2135,2136,2137,2138,2139,2140,2141,2142,2143,2144,2145,2146,2147,2148,2149,2150,2151,2152,2153,2154,2156,2157,2158,2159,2160,2161,2162,2163,2164,2165,2166,2167,2168,2169,2170,2171,2172,2173,2174,2175,2176,2177,2179,2180,2181,2182,2183,2184,2186,2187,2189,2191,2192,2193,2194,2195,2196,2197,2198,2199,2200,2201,2202,2203,2205,2206,2207,2208,2210,2211,2212,2213,2214,2215,2216,2218,2219,2220,2221,2222,2223,2224,2225,2227,2228,2229,2230,2231,2232,2233,2234,2235,2237,2238,2239,2240,2241,2242,2243,2244,2245,2246,2247,2248,2249,2250,2251,2252,2253,2254,2255,2256,2257,2258,2259,2260,2261,2262,2263,2264,2265,2266,2267,2268,2269,2270,2271,2272,2273,2274,2275,2276,2277,2278,2279,2280,2281,2282,2283,2284,2285,2286,2287,2288,2289,2290,2291,2292,2293,2296,2297,2298,2299,2300,2301,2302,2303,2305,2306,2307,2308,2309,2310,2311,2312,2313,2314,2315,2316,2317,2319,2320,2321,2322,2323,2324,2325,2327,2330,2331,2332,2334,2335,2336,2337,2338,2339,2340,2341,2342,2343,2344,2345,2346,2347,2348,2349,2350,2351,2352,2353,2354,2355,2356,2357,2358,2359,2360,2361,2362,2363,2364,2365,2366,2367,2368,2369,2371,2372,2373,2374,2375,2377,2379,2380,2381,2382,2383,2386,2387,2388,2389,2390,2391,2392,2393,2394,2395,2396,2397,2398,2399,2400,2401,2402,2404,2405,2406,2407,2408,2409,2411,2412,2413,2414,2415,2416,2418,2419,2420,2421,2422,2423,2424,2425,2426,2427,2428,2429,2430,2431,2432,2433,2434,2436,2437,2438,2439,2440,2441,2442,2443,2444,2445,2446,2447,2448,2450,2451,2452,2453,2454,2456,2457,2458,2459,2460,2462,2463,2464,2465,2466,2467,2468,2469,2470,2471,2472,2473,2474,2475,2476,2477,2478,2480,2481,2482,2483,2484,2486,2487,2488,2489,2490,2491,2493,2494,2495,2496,2497,2498,2499,2500,2501,2502,2503,2504,2505,2507,2508,2509,2510,2511,2512,2513,2514,2515,2516,2517,2518,2519,2520,2521,2522,2523,2524,2525,2526,2528,2529,2530,2532,2533,2534,2535,2537,2538,2539,2540,2541,2542,2543,2544,2545,2546,2547,2548,2549,2550,2551,2552,2553,2554,2555,2556,2558,2559,2560,2561,2562,2563,2564,2565,2566,2567,2569,2570,2572,2573,2574,2575,2576,2577,2578,2579,2580,2581,2582,2583,2584,2585,2586,2587,2588,2589,2590,2591,2594,2595,2596,2597,2598,2599,2600,2601,2602,2603,2604,2605,2606,2607,2608,2609,2610,2611,2612,2613,2614,2615,2616,2617,2618,2620,2621,2622,2623,2624,2625,2626,2628,2629,2630,2632,2633,2634,2635,2636,2637,2639,2640,2642,2643,2644,2645,2646,2647,2648,2650,2651,2652,2653,2654,2655,2658,2659,2661,2662,2663,2664,2665,2666,2667,2668,2669,2670,2671,2672,2673,2674,2675,2676,2677,2678,2679,2680,2681,2682,2683,2684,2685,2686,2688,2689,2690,2691,2692,2693,2694,2695,2696,2697,2698,2699,2700,2701,2702,2704,2705,2706,2708,2709,2710,2711,2712,2715,2716,2718,2719,2720,2721,2722,2723,2724,2725,2726,2727,2728,2729,2730,2731,2732,2734,2735,2736,2737,2738,2739,2740,2741,2742,2743,2744,2745,2746,2749,2750,2751,2752,2753,2754,2755,2756,2757,2758,2759,2760,2762,2766,2767,2768,2769,2770,2771,2772,2773,2774,2775,2776,2778,2780,2781,2782,2783,2784,2785,2786,2787,2788,2789,2790,2791,2792,2793,2795,2796,2797,2798,2799,2800,2801,2802,2803,2804,2805,2806,2807,2808,2809,2810,2812,2813,2814,2815,2816,2818,2819,2820,2822,2823,2825,2826,2827,2828,2829,2830,2831,2832,2833,2834,2835,2836,2837,2838,2839,2840,2841,2843,2844,2845,2846,2847,2848,2849,2850,2851,2852,2853,2854,2855,2856,2857,2858,2859,2860,2861,2862,2863,2864,2865,2866,2867,2868,2869,2870,2871,2872,2874,2875,2876,2877,2878,2879,2880,2881,2882,2883,2884,2885,2886,2887,2888,2889,2890,2891,2892,2893,2895,2896,2897,2898,2900,2901,2902,2903,2904,2905,2906,2907,2908,2909,2910,2911,2912,2913,2914,2915,2916,2917,2918,2919,2920,2921,2922,2923,2924,2925,2926,2927,2928,2929,2930,2931,2933,2934,2935,2936,2938,2939,2940,2941,2943,2945,2946,2947,2948,2949,2950,2951,2952,2953,2955,2956,2957,2958,2959,2960,2961,2963,2964,2965,2966,2967,2968,2969,2970,2971,2973,2974,2975,2976,2977,2978,2979,2980,2981,2982,2983,2984,2985,2986,2987,2989,2990,2991,2992,2993,2994,2995,2997,2998,3000,3001,3002,3003,3004,3005,3006,3007,3008,3009,3010,3011,3012,3014,3015,3017,3018,3019,3021,3022,3023,3024,3025,3026,3027,3028,3029,3030,3031,3033,3034,3035,3036,3037,3038,3039,3040,3041,3042,3045,3046,3047,3048,3049,3050,3051,3053,3054,3055,3056,3057,3058,3059,3060,3061,3062,3063,3064,3065,3066,3067,3068,3069,3070,3071,3072,3073,3074,3075,3076,3078,3079,3080,3081,3082,3083,3084,3085,3086,3088,3089,3091,3092,3093,3094,3095,3096,3097,3098,3099,3100,3101,3102,3103,3104,3105,3106,3107,3108,3109,3110,3111,3112,3113,3114,3115,3116,3117,3118,3119,3120,3121,3122,3123,3124,3125,3126,3127,3128,3129,3130,3131,3132,3133,3134,3135,3136,3137,3138,3139,3141,3142,3143,3144,3145,3146,3147,3148,3149,3150,3151,3152,3153,3154,3155,3156,3157,3158,3159,3160,3161,3162,3163,3164,3165,3166,3167,3168,3169,3171,3172,3173,3174,3175,3176,3177,3180,3181,3182,3183,3184,3186,3187,3188,3189,3190,3192,3193,3194,3195,3196,3197,3198,3199,3200,3201,3202,3203,3204,3205,3206,3207,3208,3209,3211,3212,3213,3214,3216,3217,3218,3220,3221,3222,3223,3224,3225,3227,3228,3229,3230,3231,3232,3233,3234,3235,3236,3237,3238,3239,3240,3241,3244,3245,3246,3247,3248,3249,3250,3252,3253,3254,3255,3256,3257,3258,3259,3260,3261,3262,3263,3264,3267,3268,3269,3270,3272,3273,3274,3275,3276,3277,3278,3279,3280,3281,3282,3283,3284,3285,3286,3287,3288,3289,3290,3291,3292,3293,3294,3295,3296,3298,3299,3300,3301,3302,3303,3304,3307,3308,3309,3311,3312,3313,3314,3316,3318,3319,3320,3321,3323,3324,3326,3327,3328,3329,3330,3331,3332,3333,3334,3335,3336,3337,3338,3339,3340,3341,3342,3343,3344,3345,3348,3349,3350,3351,3352,3353,3354,3355,3356,3357,3360,3361,3362,3363,3364,3365,3366,3367,3369,3370,3372,3373,3374,3375,3376,3377,3378,3379,3380,3381,3382,3383,3384,3385,3386,3387,3388,3389,3390,3391,3392,3393,3394,3395,3396,3397,3398,3399,3400,3402,3403,3404,3405,3406,3407,3408,3409,3410,3411,3414,3415,3416,3418,3419,3420,3421,3422,3423,3424,3425,3426,3427,3428,3429,3430,3431,3432,3433,3434,3435,3436,3437,3438,3440,3441,3442,3443,3444,3447,3448,3449,3451,3452,3453,3454,3455,3456,3457,3459,3460,3461,3462,3463,3464,3465,3466,3467,3468,3469,3470,3471,3472,3473,3474,3475,3476,3477,3478,3480,3482,3483,3484,3485,3486,3487,3488,3489,3490,3491,3492,3493,3494,3495,3497,3498,3499,3500,3501,3502,3503,3504,3505,3506,3507,3508,3509,3510,3511,3513,3514,3515,3516,3517,3518,3519,3520,3521,3522,3523,3524,3525,3526,3527,3528,3529,3530,3531,3532,3533,3534,3535,3537,3538,3539,3541,3542,3543,3544,3545,3546,3547,3548,3549,3550,3551,3552,3553,3554,3555,3556,3557,3558,3559,3560,3561,3562,3563,3564,3565,3566,3567,3568,3569,3570,3571,3572,3573,3575,3576,3577,3578,3579,3580,3582,3583,3585,3586,3587,3588,3589,3590,3591,3592,3593,3594,3595,3596,3597,3598,3599,3600,3601,3602,3603,3604,3605,3606,3607,3609,3610,3611,3612,3614,3615,3616,3617,3618,3619,3620,3621,3622,3623,3625,3626,3627,3628,3629,3630,3631,3632,3633,3635,3636,3637,3638,3639,3641,3642,3643,3644,3645,3647,3648,3649,3651,3652,3653,3654,3655,3656,3657,3658,3659,3661,3662,3663,3664,3665,3666,3667,3668,3669,3670,3671,3672,3673,3674,3675,3676,3678,3679,3681,3682,3683,3684,3685,3686,3687,3688,3689,3690,3691,3692,3693,3694,3696,3697,3699,3700,3701,3702,3703,3704,3705,3707,3708,3709,3711,3712,3713,3714,3715,3716,3717,3718,3719,3720,3721,3722,3723,3725,3726,3727,3728,3729,3730,3731,3732,3733,3736,3737,3738,3739,3740,3741,3742,3743,3744,3745,3746,3747,3748,3749,3750,3751,3752,3753,3754,3755,3756,3757,3758,3759,3760,3761,3762,3763,3765,3766,3767,3769,3770,3771,3772,3773,3775,3776,3777,3778,3779,3780,3781,3782,3783,3784,3785,3786,3787,3788,3789,3791,3792,3793,3794,3795,3796,3797,3798,3799,3800,3801,3802,3806,3807,3808,3809,3810,3811,3812,3813,3814,3815,3816,3817,3819,3820,3821,3822,3823,3824,3825,3826,3827,3828,3829,3831,3832,3833,3834,3835,3836,3837,3838,3839,3840,3841,3842,3843,3844,3845,3846,3848,3850,3851,3852,3853,3854,3855,3856,3857,3858,3859,3860,3861,3862,3863,3865,3866,3868,3869,3871,3872,3873,3874,3875,3876,3877,3878,3879,3880,3881,3882,3884,3885,3886,3887,3888,3889,3890,3891,3892,3893,3894,3896,3897,3898,3899,3900,3901,3902,3904,3905,3906,3907,3908,3909,3910,3912,3913,3914,3915,3916,3917,3918,3919,3920,3921,3922,3923,3924,3925,3926,3927,3928,3929,3930,3931,3932,3933,3934,3935,3936,3937,3938,3939,3941,3943,3944,3945,3946,3947,3948,3949,3950,3951,3952,3953,3954,3955,3956,3957,3958,3960,3961,3962,3963,3964,3965,3966,3967,3968,3969,3970,3971,3972,3973,3974,3975,3976,3977,3978,3979,3981,3983,3984,3985,3986,3987,3988,3990,3991,3992,3993,3994,3995,3996,3997,3998,3999,4000,4001,4002,4003,4004,4005,4006,4007,4008,4009,4010,4011,4012,4013,4014,4015,4016,4017,4018,4019,4020,4021,4022,4024,4025,4026,4027,4028,4029,4030,4031,4032,4035,4036,4037,4038,4039,4040,4041,4042,4044,4045,4046,4047,4049,4050,4051,4052,4053,4054,4055,4056,4057,4058,4059,4060,4061,4063,4064,4066,4067,4068,4069,4071,4072,4073,4074,4075,4076,4077,4078,4081,4083,4084,4085,4086,4087,4088,4089,4092,4093,4094,4095,4096,4097,4098,4099,4100,4101,4102,4103,4104,4105,4106,4107,4108,4109,4110,4111,4112,4113,4114,4115,4116,4117,4118,4119,4120,4121,4122,4123,4124,4125,4126,4127,4128,4129,4130,4131,4132,4133,4134,4135,4136,4137,4138,4139,4140,4141,4142,4143,4144,4145,4147,4148,4149,4151,4152,4153,4154,4156,4158,4159,4160,4161,4162,4163,4164,4165,4167,4168,4169,4170,4171,4172,4173,4174,4175,4176,4177,4178,4179,4180,4181,4182,4183,4184,4185,4187,4189,4190,4191,4192,4193,4194,4195,4196,4197,4198,4199,4200,4201,4202,4203,4204,4205,4206,4207,4209,4210,4211,4212,4213,4214,4215,4216,4217,4218,4219,4220,4221,4222,4223,4224,4225,4226,4228,4229,4230,4231,4232,4233,4234,4235,4236,4237,4238,4239,4240,4242,4243,4244,4245,4246,4247,4248,4249,4250,4251,4252,4253,4254,4255,4256,4257,4258,4259,4260,4261,4262,4263,4264,4265,4266,4267,4268,4269,4270,4271,4272,4273,4274,4275,4276,4277,4279,4280,4283,4284,4285,4287,4288,4289,4290,4291,4292,4293,4294,4295,4296,4297,4298,4299,4300,4301,4302,4303,4304,4305,4306,4307,4308,4309,4310,4311,4312,4313,4314,4315,4316,4317,4318,4319,4321,4322,4323,4324,4325,4326,4328,4330,4331,4332,4333,4334,4335,4336,4337,4338,4339,4340,4341,4342,4344,4345,4346,4347,4349,4350,4352,4354,4355,4356,4357,4358,4359,4360,4362,4363,4364,4366,4367,4368,4369,4371,4372,4373,4374,4375,4376,4377,4378,4379,4380,4381,4382,4383,4384,4385,4386,4387,4388,4389,4390,4391,4393,4394,4395,4396,4397,4398,4399,4400,4401,4402,4405,4406,4407,4408,4409,4410,4411,4412,4413,4414,4415,4416,4417,4418,4419,4420,4421,4422,4423,4424,4425,4426,4427,4428,4429,4430,4431,4433,4434,4435,4436,4437,4438,4439,4440,4441,4442,4443,4444,4445,4446,4449,4450,4451,4452,4453,4454,4455,4456,4458,4459,4460,4461,4463,4464,4465,4466,4467,4468,4469,4471,4472,4474,4475,4476,4478,4479,4480,4481,4482,4483,4484,4485,4486,4487,4488,4489,4490,4491,4492,4493,4494,4496,4497,4498,4499,4500,4501,4502,4503,4504,4505,4506,4507,4508,4509,4510,4511,4512,4513,4514,4516,4517,4518,4519,4520,4521,4522,4523,4524,4525,4526,4528,4529,4530,4532,4533,4534,4535,4536,4537,4538,4539,4540,4541,4543,4544,4545,4546,4547,4548,4549,4550,4551,4552,4553,4555,4556,4557,4558,4559,4560,4561,4562,4563,4564,4565,4566,4567,4568,4569,4570,4571,4572,4573,4574,4575,4576,4577,4578,4579,4580,4581,4582,4583,4584,4585,4586,4587,4588,4589,4590,4591,4592,4593,4594,4595,4596,4597,4598,4599,4600,4601,4602,4603,4605,4606,4607,4608,4609,4610,4612,4613,4615,4616,4618,4619,4620,4621,4622,4623,4624,4625,4626,4627,4629,4630,4632,4633,4634,4635,4636,4637,4638,4639,4640,4643,4644,4645,4646,4647,4648,4649,4651,4652,4653,4654,4655,4656,4657,4658,4659,4660,4661,4662,4663,4664,4665,4666,4667,4668,4669,4670,4671,4673,4674,4676,4677,4678,4679,4680,4681,4682,4683,4684,4685,4686,4687,4688,4689,4690,4691,4692,4693,4694,4695,4696,4697,4698,4699,4700,4701,4702,4703,4704,4705,4706,4707,4708,4709,4710,4711,4712,4713,4714,4715,4716,4717,4719,4721,4722,4723,4724,4725,4726,4727,4728,4729,4730,4731,4732,4733,4734,4735,4736,4737,4738,4740,4742,4743,4744,4745,4746,4747,4748,4749,4750,4751,4752,4753,4754,4755,4756,4758,4759,4760,4761,4762,4763,4764,4765,4766,4767,4768,4769,4770,4771,4772,4773,4774,4775,4777,4778,4779,4781,4782,4783,4784,4785,4786,4787,4789,4790,4791,4792,4793,4794,4795,4796,4797,4798,4799,4800,4801,4802,4803,4805,4806,4807,4808,4809,4810,4811,4812,4813,4814,4815,4816,4817,4818,4820,4821,4822,4823,4825,4826,4827,4828,4829,4830,4831,4832,4833,4835,4836,4837,4838,4839,4840,4841,4842,4843,4844,4845,4846,4847,4848,4849,4850,4851,4852,4853,4854,4855,4856,4858,4859,4860,4861,4863,4864,4865,4866,4867,4868,4869,4870,4871,4872,4873,4874,4875,4876,4877,4878,4879,4881,4882,4883,4884,4885,4886,4888,4889,4890,4892,4893,4894,4895,4896,4897,4898,4899,4900,4901,4902,4903,4904,4905,4906,4907,4908,4909,4910,4911,4912,4913,4914,4915,4916,4917,4918,4919,4920,4921,4922,4924,4925,4926,4927,4928,4929,4930,4931,4932,4933,4934,4936,4938,4939,4940,4941,4942,4943,4944,4945,4946,4947,4948,4949,4950,4951,4952,4953,4954,4955,4956,4960,4961,4962,4963,4964,4965,4966,4967,4968,4969,4970,4971,4972,4973,4974,4975,4976,4977,4978,4979,4980,4981,4982,4983,4984,4985,4986,4987,4988,4989,4990,4991,4993,4994,4995,4996,4997,4998,5000,5001,5002,5003,5004,5005,5007,5009,5010,5011,5012,5013,5014,5015,5016,5017,5018,5019,5020,5021,5022,5023,5024,5025,5026,5027,5028,5029,5030,5032,5034,5036,5037,5038,5039,5040,5041,5042,5044,5045,5046,5047,5048,5049,5050,5052,5053,5054,5055,5056,5057,5058,5059,5060,5061,5062,5063,5064,5065,5066,5067,5068,5070,5071,5072,5073,5074,5075,5076,5077,5078,5080,5081,5082,5083,5084,5085,5086,5088,5089,5090,5091,5092,5093,5094,5095,5096,5097,5098,5099,5100,5101,5102,5103,5104,5105,5106,5107,5110,5111,5112,5113,5114,5115,5116,5117,5118,5119,5120,5121,5122,5123,5125,5126,5127,5128,5129,5130,5131,5132,5134,5135,5136,5137,5138,5140,5142,5143,5144,5145,5146,5148,5149,5150,5151,5152,5153,5154,5156,5157,5158,5159,5160,5161,5162,5163,5164,5166,5167,5168,5169,5170,5171,5172,5173,5174,5175,5176,5177,5178,5179,5180,5181,5182,5183,5184,5185,5186,5187,5188,5189,5190,5191,5192,5193,5194,5195,5196,5197,5198,5199,5200,5201,5202,5203,5204,5205,5206,5207,5208,5209,5210,5211,5212,5213,5214,5215,5216,5217,5218,5219,5220,5221,5222,5223,5224,5225,5226,5227,5228,5229,5230,5231,5232,5233,5234,5235,5236,5237,5238,5239,5240,5242,5245,5246,5247,5248,5250,5252,5254,5256,5258,5260,5261,5262,5263,5264,5265,5266,5267,5268,5269,5271,5272,5273,5274,5275,5276,5277,5278,5279,5281,5282,5283,5284,5285,5286,5287,5288,5289,5291,5292,5293,5294,5295,5296,5297,5298,5299,5300,5302,5303,5304,5306,5308,5309,5310,5311,5312,5313,5314,5315,5316,5317,5318,5319,5322,5323,5324,5325,5326,5327,5328,5329,5330,5331,5332,5333,5334,5335,5336,5338,5339,5340,5341,5343,5344,5345,5346,5347,5348,5349,5350,5351,5352,5354,5355,5356,5357,5358,5359,5360,5361,5362,5363,5364,5365,5366,5367,5370,5371,5372,5373,5374,5375,5376,5377,5378,5379,5380,5381,5382,5383,5384,5385,5386,5387,5388,5389,5390,5391,5392,5393,5394,5395,5396,5397,5399,5400,5401,5402,5403,5404,5406,5407,5408,5409,5410,5411,5412,5413,5414,5416,5417,5418,5419,5420,5421,5422,5423,5424,5425,5426,5427,5429,5431,5432,5433,5434,5436,5437,5438,5439,5440,5441,5442,5444,5445,5446,5447,5448,5449,5451,5453,5454,5455,5456,5457,5458,5460,5461,5462,5464,5465,5466,5467,5468,5469,5471,5472,5473,5474,5475,5476,5477,5478,5479,5480,5481,5482,5484,5485,5486,5487,5488,5489,5490,5491,5492,5493,5494,5495,5496,5497,5498,5499,5500,5501,5502,5503,5504,5506,5507,5508,5509,5510,5511,5512,5514,5515,5516,5517,5518,5520,5521,5522,5523,5524,5525,5527,5528,5530,5532,5533,5534,5535,5536,5537,5538,5539,5540,5541,5542,5543,5544,5545,5546,5547,5548,5549,5550,5551,5552,5553,5555,5556,5557,5558,5559,5560,5561,5562,5563,5564,5565,5566,5568,5569,5570,5571,5572,5573,5574,5575,5576,5577,5578,5579,5580,5581,5582,5583,5585,5586,5587,5588,5589,5590,5591,5594,5595,5596,5597,5598,5599,5600,5601,5602,5604,5605,5606,5607,5608,5609,5610,5611,5612,5614,5615,5616,5617,5618,5619,5620,5621,5622,5623,5624,5625,5626,5627,5628,5629,5630,5631,5632,5633,5634,5635,5636,5637,5638,5639,5640,5641,5642,5643,5644,5645,5646,5647,5648,5649,5650,5651,5654,5655,5656,5657,5658,5660,5661,5662,5663,5664,5665,5666,5667,5668,5670,5671,5672,5674,5675,5676,5677,5678,5679,5680,5681,5682,5683,5687,5688,5689,5690,5691,5692,5693,5694,5696,5697,5698,5699,5700,5701,5702,5703,5704,5705,5706,5707,5708,5709,5710,5711,5712,5713,5714,5715,5716,5717,5719,5720,5722,5723,5724,5725,5726,5727,5728,5729,5730,5732,5733,5734,5735,5736,5738,5739,5740,5741,5742,5743,5744,5745,5746,5747,5748,5749,5751,5752,5753,5754,5755,5757,5758,5759,5760,5761,5762,5763,5764,5765,5766,5767,5768,5769,5770,5771,5772,5773,5774,5775,5776,5777,5779,5780,5781,5782,5783,5784,5785,5786,5787,5788,5789,5790,5792,5793,5794,5795,5796,5797,5798,5799,5800,5801,5802,5803,5804,5805,5807,5808,5809,5810,5811,5813,5814,5815,5816,5817,5819,5820,5821,5822,5823,5824,5825,5826,5829,5831,5832,5833,5834,5835,5836,5837,5839,5840,5841,5842,5843,5844,5845,5846,5848,5849,5850,5851,5852,5853,5854,5855,5856,5857,5858,5859,5860,5861,5862,5863,5864,5866,5867,5868,5869,5871,5872,5873,5874,5875,5876,5877,5878,5879,5880,5881,5882,5883,5884,5885,5886,5887,5888,5889,5891,5892,5893,5894,5895,5896,5897,5898,5900,5901,5902,5903,5904,5905,5906,5907,5908,5909,5910,5911,5912,5913,5914,5915,5916,5917,5919,5920,5921,5922,5923,5924,5925,5926,5927,5928,5931,5933,5934,5935,5936,5937,5938,5939,5940,5941,5943,5944,5945,5946,5947,5948,5949,5950,5951,5953,5954,5955,5956,5957,5958,5959,5960,5961,5962,5963,5964,5966,5967,5968,5969,5970,5971,5972,5973,5975,5976,5977,5978,5979,5981,5982,5983,5984,5985,5986,5988,5989,5991,5992,5994,5995,5996,5997,5998,5999,6000,6001,6002,6004,6005,6006,6007,6008,6009,6010,6011,6012,6013,6014,6017,6018,6019,6020,6021,6022,6023,6024,6025,6026,6027,6028,6029,6030,6031,6032,6033,6034,6035,6036,6037,6038,6039,6041,6042,6043,6044,6045,6046,6047,6048,6049,6050,6051,6052,6053,6054,6055,6056,6057,6058,6059,6060,6061,6063,6064,6065,6066,6067,6068,6069,6070,6071,6073,6074,6075,6076,6077,6078,6079,6080,6081,6083,6084,6085,6086,6087,6088,6089,6090,6091,6092,6093,6094,6095,6096,6098,6100,6101,6102,6103,6104,6105,6106,6107,6108,6109,6110,6111,6112,6113,6115,6116,6118,6119,6120,6121,6122,6123,6124,6125,6126,6128,6130,6132,6134,6135,6136,6137,6138,6139,6141,6142,6143,6144,6145,6146,6147,6148,6149,6150,6151,6152,6153,6154,6155,6156,6157,6158,6159,6160,6161,6162,6164,6165,6166,6167,6168,6169,6170,6171,6172,6173,6174,6175,6176,6177,6178,6179,6180,6182,6183,6184,6185,6186,6187,6188,6189,6190,6192,6193,6194,6195,6196,6197,6198,6199,6200,6202,6203,6204,6205,6206,6207,6208,6209,6210,6212,6213,6214,6215,6216,6217,6218,6219,6220,6221,6222,6223,6224,6225,6226,6227,6228,6229,6230,6231,6232,6233,6234,6235,6236,6237,6238,6239,6240,6242,6243,6244,6245,6246,6247,6248,6249,6251,6252,6253,6254,6255,6256,6257,6258,6260,6261,6262,6263,6265,6266,6267,6268,6269,6270,6271,6272,6273,6274,6275,6276,6277,6278,6279,6281,6282,6283,6284,6285,6289,6290,6291,6292,6294,6295,6296,6297,6298,6299,6300,6301,6302,6303,6304,6305,6306,6307,6308,6310,6311,6312,6313,6314,6315,6316,6317,6318,6320,6321,6322,6323,6324,6325,6326,6327,6329,6330,6331,6332,6333,6334,6335,6336,6337,6338,6339,6340,6341,6343,6345,6346,6347,6348,6349,6350,6352,6353,6354,6355,6356,6357,6358,6359,6360,6361,6362,6363,6364,6365,6366,6367,6368,6369,6370,6371,6372,6373,6374,6375,6376,6377,6378,6379,6380,6381,6382,6384,6385,6386,6387,6388,6389,6390,6391,6392,6393,6394,6395,6396,6397,6399,6401,6402,6403,6404,6405,6406,6407,6408,6409,6410,6411,6412,6413,6414,6415,6416,6417,6418,6419,6420,6421,6422,6423,6425,6427,6430,6431,6432,6433,6434,6435,6436,6438,6439,6440,6441,6442,6443,6445,6446,6447,6448,6449,6450,6451,6452,6453,6455,6456,6457,6458,6459,6460,6462,6463,6464,6465,6466,6467,6468,6469,6471,6472,6474,6475,6476,6477,6479,6480,6481,6482,6483,6484,6485,6486,6487,6488,6490,6491,6492,6493,6494,6495,6496,6497,6498,6499,6500,6501,6502,6503,6504,6505,6506,6507,6508,6509,6511,6512,6513,6514,6515,6516,6517,6518,6519,6520,6521,6522,6523,6524,6525,6527,6528,6529,6530,6531,6533,6534,6535,6536,6537,6538,6539,6540,6541,6542,6543,6544,6545,6547,6548,6549,6550,6551,6552,6553,6554,6555,6556,6558,6559,6560,6561,6562,6563,6564,6565,6566,6568,6569,6570,6571,6572,6573,6574,6575,6576,6577,6578,6579,6581,6582,6584,6585,6586,6587,6589,6591,6592,6593,6594,6595,6596,6598,6599,6600,6601,6603,6604,6605,6606,6607,6608,6609,6610,6611,6612,6613,6614,6615,6616,6617,6618,6619,6620,6622,6623,6624,6625,6626,6627,6628,6629,6630,6631,6632,6634,6635,6636,6637,6638,6639,6640,6641,6642,6644,6645,6646,6647,6648,6649,6650,6652,6653,6654,6655,6656,6657,6658,6659,6660,6661,6662,6663,6664,6665,6666,6667,6668,6669,6670,6671,6673,6674,6675,6676,6677,6678,6679,6680,6681,6682,6683,6684,6685,6686,6687,6688,6689,6690,6691,6692,6693,6694,6695,6696,6697,6698,6699,6700,6702,6703,6704,6705,6706,6707,6708,6709,6710,6712,6713,6714,6715,6716,6717,6718,6720,6721,6722,6723,6724,6725,6726,6727,6728,6729,6730,6731,6732,6733,6734,6735,6736,6737,6738,6739,6740,6741,6742,6743,6744,6745,6746,6747,6748,6749,6751,6754,6755,6756,6757,6758,6759,6761,6762,6763,6764,6765,6767,6768,6769,6771,6772,6773,6774,6775,6776,6777,6778,6780,6782,6783,6784,6785,6787,6788,6789,6790,6791,6792,6793,6794,6796,6797,6799,6800,6801,6802,6803,6804,6805,6806,6807,6809,6810,6811,6812,6813,6814,6815,6816,6817,6819,6820,6821,6822,6823,6824,6825,6826,6827,6828,6829,6830,6831,6832,6834,6836,6837,6838,6839,6840,6842,6844,6845,6846,6847,6848,6849,6850,6851,6852,6853,6854,6855,6856,6857,6858,6859,6860,6861,6862,6863,6864,6865,6866,6867,6868,6869,6870,6871,6872,6873,6874,6875,6876,6878,6879,6880,6881,6882,6883,6884,6885,6886,6887,6888,6889,6890,6891,6893,6895,6896,6897,6898,6899,6900,6901,6902,6903,6904,6905,6906,6907,6908,6909,6910,6911,6912,6913,6914,6915,6916,6917,6918,6919,6920,6922,6924,6926,6928,6929,6930,6931,6932,6933,6934,6935,6936,6938,6939,6940,6941,6942,6943,6944,6945,6946,6948,6949,6950,6951,6952,6953,6954,6955,6956,6957,6958,6960,6961,6963,6964,6965,6966,6967,6969,6972,6973,6974,6975,6976,6977,6980,6981,6982,6983,6984,6985,6986,6987,6988,6989,6990,6991,6992,6993,6994,6995,6996,6997,6998,6999,7000,7001,7002,7003,7004,7005,7006,7007,7008,7009,7010,7011,7012,7013,7014,7015,7016,7017,7018,7019,7020,7021,7022,7023,7024,7025,7026,7027,7028,7029,7030,7032,7033,7034,7035,7036,7038,7039,7040,7041,7042,7043,7044,7045,7046,7047,7048,7050,7051,7053,7054,7055,7056,7057,7058,7059,7060,7061,7063,7064,7065,7066,7067,7068,7069,7070,7071,7073,7074,7075,7076,7077,7078,7079,7080,7081,7082,7083,7085,7087,7088,7089,7090,7091,7092,7093,7094,7095,7096,7097,7098,7099,7100,7101,7102,7103,7104,7105,7106,7107,7108,7109,7110,7111,7113,7114,7115,7116,7117,7118,7119,7120,7121,7122,7123,7124,7125,7126,7127,7128,7130,7131,7132,7134,7135,7136,7137,7138,7140,7141,7142,7143,7144,7145,7146,7147,7148,7149,7150,7151,7152,7153,7154,7155,7156,7157,7158,7159,7160,7163,7164,7165,7166,7167,7169,7170,7171,7172,7173,7174,7176,7177,7178,7179,7180,7181,7182,7183,7184,7185,7186,7187,7188,7189,7191,7192,7193,7194,7195,7196,7197,7198,7199,7200,7201,7204,7205,7206,7207,7208,7209,7210,7211,7212,7213,7214,7215,7217,7218,7219,7220,7222,7223,7224,7226,7227,7228,7229,7230,7232,7233,7234,7235,7236,7237,7238,7239,7240,7241,7242,7243,7244,7245,7246,7247,7248,7249,7250,7251,7252,7253,7254,7256,7257,7258,7259,7260,7262,7264,7265,7266,7267,7268,7270,7271,7272,7273,7274,7275,7276,7277,7278,7280,7281,7282,7283,7284,7285,7286,7287,7288,7290,7291,7292,7293,7294,7295,7296,7297,7298,7299,7300,7301,7302,7303,7304,7305,7306,7307,7308,7309,7310,7311,7312,7313,7314,7315,7316,7318,7319,7320,7321,7322,7323,7324,7325,7326,7327,7328,7329,7331,7332,7333,7334,7335,7336,7338,7339,7340,7341,7343,7344,7345,7346,7347,7348,7349,7350,7351,7352,7353,7355,7356,7357,7358,7359,7360,7361,7362,7364,7365,7366,7369,7370,7371,7372,7373,7374,7375,7376,7377,7378,7379,7380,7382,7383,7384,7386,7387,7388,7389,7390,7391,7392,7393,7394,7395,7396,7397,7398,7399,7400,7401,7402,7403,7404,7405,7406,7407,7408,7409,7411,7412,7413,7414,7415,7416,7417,7418,7419,7420,7421,7422,7423,7424,7425,7426,7427,7428,7429,7430,7431,7432,7433,7434,7435,7436,7437,7438,7439,7441,7442,7443,7444,7445,7447,7448,7450,7451,7453,7454,7455,7456,7457,7458,7459,7460,7461,7462,7463,7464,7466,7467,7468,7469,7470,7471,7472,7473,7474,7475,7476,7477,7478,7479,7480,7481,7482,7483,7484,7486,7487,7488,7489,7490,7492,7493,7494,7495,7496,7497,7498,7499,7500,7501,7502,7503,7504,7507,7508,7509,7510,7511,7512,7513,7514,7515,7517,7518,7519,7520,7521,7522,7523,7524,7525,7527,7528,7529,7530,7531,7532,7533,7534,7535,7538,7539,7540,7541,7542,7543,7544,7545,7546,7547,7548,7549,7550,7551,7552,7553,7554,7556,7557,7559,7560,7561,7562,7563,7564,7565,7567,7568,7569,7570,7571,7572,7573,7574,7575,7576,7577,7578,7579,7580,7581,7582,7583,7584,7585,7586,7587,7588,7589,7590,7591,7592,7594,7595,7596,7597,7598,7600,7602,7603,7604,7605,7606,7608,7609,7610,7611,7612,7613,7614,7615,7616,7618,7619,7620,7621,7622,7623,7624,7626,7627,7628,7629,7630,7631,7632,7633,7634,7635,7636,7637,7638,7639,7640,7641,7642,7643,7644,7645,7647,7648,7649,7650,7651,7652,7653,7654,7656,7657,7658,7659,7660,7661,7662,7663,7664,7665,7666,7667,7668,7669,7670,7672,7673,7674,7675,7676,7677,7678,7679,7680,7681,7682,7683,7684,7685,7686,7687,7689,7690,7691,7692,7694,7695,7696,7697,7698,7700,7701,7704,7705,7707,7708,7709,7710,7711,7712,7713,7714,7715,7716,7717,7718,7719,7720,7721,7722,7724,7725,7726,7728,7729,7730,7731,7732,7733,7734,7735,7736,7738,7739,7740,7741,7742,7743,7744,7745,7746,7748,7749,7750,7751,7752,7753,7754,7755,7756,7757,7758,7759,7760,7761,7762,7763,7764,7765,7766,7767,7768,7769,7770,7771,7772,7773,7774,7775,7776,7777,7778,7779,7781,7783,7784,7785,7786,7787,7788,7789,7790,7792,7793,7794,7795,7796,7797,7798,7799,7800,7801,7802,7803,7804,7805,7806,7807,7808,7809,7811,7812,7813,7814,7815,7816,7818,7819,7821,7822,7823,7824,7825,7826,7827,7828,7829,7831,7832,7833,7834,7836,7837,7839,7840,7841,7842,7843,7844,7845,7847,7848,7849,7850,7851,7852,7853,7854,7856,7857,7858,7859,7860,7861,7862,7863,7864,7865,7867,7869,7870,7871,7872,7874,7875,7876,7877,7878,7879,7880,7881,7883,7884,7885,7886,7888,7890,7891,7892,7893,7894,7895,7896,7897,7899,7900,7901,7902,7903,7904,7905,7906,7908,7909,7910,7911,7912,7914,7915,7916,7917,7918,7919,7920,7921,7922,7923,7924,7925,7926,7927,7928,7929,7930,7931,7932,7934,7935,7936,7937,7938,7939,7940,7941,7942,7944,7945,7946,7947,7948,7949,7950,7951,7952,7954,7955,7956,7957,7958,7959,7960,7961,7962,7963,7964,7965,7966,7968,7969,7970,7971,7972,7973,7974,7975,7976,7977,7978,7979,7980,7981,7982,7983,7984,7985,7986,7988,7990,7991,7992,7993,7994,7995,7996,7997,7998,7999,8000,8001,8002,8003,8004,8005,8006,8008,8009,8010,8011,8012,8013,8014,8015,8017,8018,8019,8020,8022,8024,8025,8026,8027,8028,8030,8031,8032,8033,8034,8035,8036,8037,8038,8039,8040,8041,8042,8043,8044,8045,8046,8047,8048,8049,8050,8051,8052,8053,8054,8058,8059,8060,8061,8062,8063,8064,8065,8066,8068,8069,8070,8071,8072,8073,8074,8075,8076,8078,8079,8080,8081,8082,8083,8084,8086,8087,8088,8089,8090,8091,8092,8093,8094,8095,8096,8097,8099,8100,8101,8102,8103,8104,8105,8106,8107,8108,8109,8110,8112,8113,8115,8116,8118,8119,8120,8121,8122,8123,8124,8125,8126,8128,8129,8130,8131,8132,8133,8134,8135,8136,8138,8139,8140,8141,8142,8143,8144,8145,8146,8147,8148,8149,8150,8151,8153,8154,8155,8156,8157,8158,8159,8160,8161,8162,8164,8165,8166,8167,8168,8169,8170,8171,8173,8174,8175,8176,8177,8178,8180,8181,8182,8183,8184,8185,8186,8187,8188,8189,8190,8191,8192,8193,8196,8197,8198,8200,8201,8202,8203,8204,8205,8206,8207,8208,8209,8210,8211,8213,8214,8215,8216,8217,8218,8219,8220,8222,8223,8224,8225,8226,8227,8229,8230,8231,8232,8233,8234,8235,8236,8237,8238,8239,8240,8241,8242,8244,8245,8246,8247,8248,8249,8250,8252,8253,8254,8255,8256,8257,8258,8259,8261,8262,8263,8264,8265,8266,8267,8268,8269,8270,8271,8272,8274,8275,8276,8277,8279,8280,8281,8282,8284,8285,8286,8287,8288,8289,8290,8291,8292,8293,8294,8295,8296,8297,8298,8299,8300,8301,8302,8303,8304,8305,8306,8308,8309,8310,8311,8312,8313,8314,8315,8316,8317,8318,8319,8320,8321,8322,8323,8324,8326,8327,8328,8329,8330,8331,8332,8333,8334,8336,8337,8339,8340,8341,8344,8345,8346,8347,8348,8349,8350,8352,8353,8354,8355,8356,8357,8358,8360,8361,8362,8363,8364,8365,8366,8367,8368,8369,8370,8371,8372,8374,8375,8376,8377,8378,8379,8380,8381,8383,8384,8385,8386,8387,8390,8391,8392,8393,8394,8395,8396,8397,8398,8399,8400,8401,8402,8403,8404,8405,8406,8407,8408,8409,8410,8411,8412,8413,8415,8416,8417,8418,8419,8420,8421,8422,8423,8424,8426,8427,8428,8429,8430,8431,8432,8433,8434,8435,8436,8437,8438,8439,8440,8441,8442,8443,8444,8445,8446,8447,8449,8450,8451,8452,8453,8454,8455,8456,8457,8459,8460,8461,8462,8463,8464,8465,8466,8467,8469,8470,8471,8472,8473,8474,8475,8476,8477,8478,8479,8480,8482,8483,8484,8485,8486,8487,8488,8489,8491,8492,8493,8494,8495,8497,8498,8499,8500,8502,8503,8504,8505,8506,8507,8508,8509,8510,8511,8512,8515,8516,8517,8518,8519,8520,8521,8522,8523,8524,8525,8526,8527,8529,8530,8531,8532,8533,8534,8536,8537,8538,8539,8540,8541,8542,8543,8544,8545,8546,8547,8549,8550,8551,8552,8553,8554,8555,8556,8557,8559,8560,8561,8562,8563,8564,8565,8566,8568,8569,8570,8571,8572,8573,8574,8575,8577,8578,8579,8580,8581,8582,8583,8584,8585,8586,8588,8589,8590,8591,8592,8593,8594,8596,8597,8598,8599,8600,8601,8602,8603,8604,8605,8606,8607,8608,8609,8610,8612,8613,8615,8616,8617,8618,8620,8622,8623,8624,8625,8626,8627,8628,8630,8631,8632,8633,8635,8636,8637,8638,8639,8640,8641,8642,8643,8644,8645,8646,8647,8648,8649,8650,8651,8652,8653,8654,8655,8656,8658,8659,8660,8661,8662,8663,8664,8665,8666,8667,8668,8669,8670,8672,8673,8674,8675,8676,8677,8678,8679,8680,8682,8683,8684,8685,8686,8687,8688,8689,8690,8692,8693,8694,8695,8696,8697,8698,8699,8700,8701,8702,8703,8704,8705,8706,8707,8708,8709,8710,8711,8712,8713,8714,8715,8716,8717,8718,8719,8720,8721,8722,8723,8724,8725,8726,8727,8728,8729,8732,8733,8734,8735,8736,8737,8739,8740,8741,8742,8743,8744,8745,8746,8747,8749,8750,8751,8753,8754,8755,8756,8757,8758,8759,8760,8761,8762,8766,8767,8768,8769,8770,8771,8773,8774,8775,8776,8777,8778,8779,8780,8781,8782,8783,8784,8785,8786,8787,8788,8789,8790,8791,8792,8793,8794,8796,8797,8799,8800,8801,8802,8803,8804,8805,8806,8807,8809,8810,8811,8812,8813,8814,8815,8816,8817,8819,8820,8821,8822,8823,8824,8825,8826,8827,8828,8829,8830,8831,8832,8833,8834,8835,8836,8837,8838,8839,8840,8841,8842,8843,8844,8846,8847,8848,8850,8852,8853,8854,8855,8856,8857,8860,8861,8862,8863,8864,8866,8867,8869,8870,8871,8872,8873,8874,8875,8876,8877,8878,8879,8880,8882,8883,8884,8885,8886,8887,8888,8889,8890,8891,8892,8893,8894,8896,8897,8898,8899,8900,8901,8902,8903,8904,8905,8906,8907,8908,8909,8910,8911,8912,8914,8915,8916,8917,8918,8919,8920,8922,8923,8924,8925,8926,8927,8928,8930,8931,8932,8933,8934,8935,8936,8937,8938,8939,8940,8941,8942,8943,8944,8945,8946,8947,8948,8949,8950,8952,8953,8954,8955,8956,8957,8958,8959,8960,8961,8962,8963,8964,8965,8966,8967,8968,8969,8970,8971,8972,8973,8974,8975,8976,8977,8979,8980,8981,8982,8984,8985,8986,8987,8988,8989,8990,8993,8994,8995,8996,8997,8998,9000,9001,9002,9003,9005,9006,9007,9008,9009,9010,9011,9012,9013,9014,9015,9017,9018,9019,9020,9021,9022,9023,9024,9025,9026,9027,9028,9029,9030,9031,9032,9033,9034,9035,9036,9039,9040,9041,9042,9043,9044,9045,9046,9047,9048,9049,9050,9051,9053,9054,9055,9056,9057,9058,9059,9061,9062,9063,9064,9065,9066,9067,9068,9069,9071,9072,9073,9074,9075,9076,9077,9078,9079,9081,9082,9083,9084,9085,9086,9087,9088,9089,9090,9091,9092,9093,9094,9096,9097,9098,9099,9100,9101,9102,9103,9104,9106,9107,9108,9109,9110,9111,9112,9113,9114,9115,9116,9117,9118,9119,9120,9121,9122,9123,9124,9125,9126,9127,9128,9129,9130,9131,9132,9133,9135,9136,9138,9139,9140,9141,9142,9143,9144,9145,9146,9147,9148,9149,9150,9151,9152,9153,9154,9155,9156,9157,9159,9160,9161,9163,9164,9165,9166,9168,9169,9170,9171,9172,9173,9175,9176,9177,9178,9180,9181,9182,9183,9184,9185,9186,9187,9188,9190,9191,9192,9193,9194,9195,9196,9197,9198,9200,9201,9202,9203,9204,9205,9206,9207,9208,9209,9210,9211,9212,9213,9214,9215,9216,9217,9218,9219,9222,9224,9225,9226,9227,9228,9229,9231,9232,9233,9234,9235,9237,9238,9240,9241,9242,9243,9245,9246,9247,9248,9249,9250,9251,9252,9253,9254,9255,9256,9257,9258,9259,9260,9261,9262,9263,9265,9266,9267,9268,9269,9270,9271,9272,9274,9275,9276,9277,9278,9279,9280,9282,9283,9284,9285,9286,9287,9288,9289,9290,9291,9292,9293,9294,9295,9298,9299,9300,9301,9302,9303,9304,9305,9306,9307,9308,9309,9312,9313,9314,9315,9316,9317,9318,9319,9320,9321,9322,9323,9324,9326,9327,9328,9329,9330,9331,9332,9333,9334,9335,9336,9337,9338,9340,9341,9342,9343,9344,9345,9346,9347,9348,9349,9350,9351,9353,9354,9355,9356,9357,9359,9360,9361,9362,9363,9364,9365,9366,9368,9369,9370,9371,9372,9373,9374,9375,9376,9378,9379,9380,9381,9382,9383,9384,9385,9386,9388,9389,9390,9391,9392,9393,9394,9395,9397,9398,9399,9400,9401,9402,9403,9404,9406,9407,9408,9409,9410,9411,9412,9413,9415,9416,9417,9418,9419,9420,9421,9422,9423,9424,9426,9427,9428,9429,9430,9431,9432,9433,9434,9435,9437,9438,9441,9442,9443,9444,9445,9446,9447,9448,9449,9450,9451,9452,9453,9454,9456,9458,9460,9461,9462,9463,9464,9465,9466,9467,9468,9469,9470,9471,9472,9473,9474,9475,9476,9477,9478,9479,9480,9481,9482,9483,9484,9485,9486,9487,9489,9490,9491,9492,9493,9494,9495,9496,9497,9499,9500,9501,9502,9503,9504,9505,9506,9507,9509,9510,9511,9512,9513,9514,9515,9516,9517,9518,9520,9521,9522,9523,9524,9525,9526,9529,9530,9531,9532,9533,9534,9535,9536,9537,9538,9539,9540,9541,9543,9544,9545,9546,9547,9548,9549,9550,9551,9553,9554,9555,9556,9557,9558,9559,9560,9561,9562,9563,9564,9565,9566,9567,9568,9569,9570,9571,9572,9573,9574,9575,9576,9577,9578,9579,9580,9581,9582,9583,9584,9586,9587,9588,9589,9590,9591,9592,9593,9594,9595,9596,9597,9598,9599,9600,9602,9603,9604,9605,9606,9607,9608,9609,9610,9612,9613,9614,9615,9616,9617,9618,9619,9620,9622,9623,9624,9625,9626,9627,9628,9629,9630,9632,9635,9636,9637,9638,9639,9640,9641,9642,9643,9644,9645,9646,9649,9650,9651,9652,9653,9654,9655,9656,9657,9658,9659,9660,9661,9662,9664,9665,9667,9668,9669,9670,9671,9672,9673,9674,9675,9676,9678,9679,9680,9681,9682,9683,9684,9685,9686,9689,9690,9691,9692,9693,9694,9695,9696,9697,9698,9699,9700,9701,9702,9703,9705,9706,9707,9708,9709,9710,9711,9712,9713,9715,9716,9717,9718,9719,9720,9721,9722,9723,9725,9726,9727,9728,9729,9730,9731,9732,9733,9734,9735,9736,9737,9738,9740,9741,9742,9743,9744,9745,9746,9747,9748,9749,9750,9751,9752,9754,9755,9756,9758,9759,9760,9762,9764,9765,9766,9767,9768,9769,9770,9771,9772,9773,9774,9775,9776,9777,9778,9779,9780,9781,9782,9783,9784,9785,9786,9787,9788,9789,9790,9792,9793,9794,9795,9796,9797,9798,9799,9802,9803,9804,9805,9806,9807,9808,9810,9811,9812,9813,9814,9815,9816,9817,9819,9820,9821,9822,9823,9824,9825,9827,9828,9829,9830,9831,9832,9833,9834,9835,9836,9837,9838,9839,9840,9841,9842,9843,9844,9845,9846,9847,9848,9849,9851,9852,9853,9854,9855,9856,9857,9858,9859,9860,9861,9862,9863,9864,9866,9867,9868,9869,9870,9871,9872,9873,9874,9875,9876,9877,9878,9880,9881,9882,9883,9884,9886,9887,9888,9889,9890,9891,9892,9893,9894,9895,9896,9898,9899,9900,9901,9903,9904,9905,9906,9907,9908,9909,9910,9912,9913,9914,9915,9916,9917,9918,9919,9920,9921,9922,9923,9924,9925,9926,9927,9928,9929,9931,9932,9933,9934,9935,9936,9937,9938,9940,9941,9942,9943,9944,9945,9946,9947,9949,9950,9953,9954,9955,9956,9957,9958,9959,9960,9961,9963,9965,9966,9967,9968,9969,9970,9971,9972,9973,9974,9975,9976,9977,9978,9979,9980,9981,9982,9984,9985,9986,9987,9988,9989,9990,9991,9992,9994,9995,9996,9997,9998,9999],"errors":9020},"selected_test":{"loss":2.302585546875,"accuracy":0.098,"n":10000,"wrong_indices":[0,1,2,4,5,6,7,8,9,11,12,14,15,16,17,18,19,20,21,22,23,24,26,27,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,56,57,58,59,60,61,62,63,64,65,66,67,68,70,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,127,128,129,130,131,132,133,134,135,137,138,139,140,141,142,143,144,145,146,147,149,150,151,152,153,154,155,156,158,159,160,161,162,163,164,165,166,167,168,169,170,171,172,173,174,175,176,177,178,179,180,181,182,184,185,186,187,189,190,191,193,195,196,197,198,199,200,201,202,203,204,205,206,207,208,209,210,211,212,213,214,216,217,218,219,220,221,222,223,224,225,226,227,228,229,230,231,232,233,234,235,236,237,238,239,240,241,242,243,244,245,247,248,249,250,251,252,253,254,255,256,257,258,259,260,261,262,263,264,265,266,267,268,270,272,273,274,275,276,277,278,279,280,281,282,283,284,285,286,287,288,289,290,291,292,293,295,298,299,300,301,302,303,304,306,307,308,309,310,313,314,315,316,317,318,319,320,321,322,323,325,326,328,329,330,331,332,333,334,335,336,337,338,339,340,341,342,343,344,345,347,348,349,350,351,352,353,354,355,356,357,358,359,360,361,362,363,364,366,367,368,369,370,371,373,374,375,376,377,378,379,381,382,383,384,385,386,387,388,389,390,391,392,393,394,395,396,397,398,399,400,401,402,403,404,405,406,408,409,410,411,412,413,414,415,416,417,418,419,420,421,422,423,425,426,427,428,429,430,431,432,433,434,435,436,437,438,439,442,444,445,446,447,448,449,450,451,452,453,454,455,456,457,458,460,461,462,463,464,465,466,467,468,469,470,471,472,473,474,475,476,477,478,479,480,481,482,483,484,486,487,488,489,491,492,493,494,495,496,497,499,500,501,502,503,504,505,506,507,508,509,510,511,512,513,514,515,516,517,518,519,520,521,522,523,524,526,527,528,529,530,531,532,533,534,535,536,537,538,539,540,541,542,543,544,547,548,549,550,551,553,554,555,556,557,558,559,560,562,563,565,566,568,569,570,571,572,573,574,575,576,577,578,579,580,582,583,584,585,587,588,589,590,591,593,594,595,596,598,599,600,601,602,603,604,605,606,607,609,610,612,613,614,615,616,617,618,619,621,622,623,624,625,626,627,628,629,630,631,632,633,634,635,636,637,638,639,640,641,643,645,646,647,648,649,650,651,652,653,654,655,657,658,659,660,662,663,664,665,666,667,668,669,670,671,672,673,674,675,676,677,678,679,680,681,682,683,684,685,686,687,688,689,690,691,692,693,694,695,696,697,698,699,700,702,703,705,706,707,708,709,710,711,712,714,715,716,718,719,720,722,724,725,726,727,728,729,730,731,732,733,734,735,736,737,738,739,740,741,743,744,745,746,747,748,749,751,752,753,754,755,756,757,758,759,760,761,762,764,765,766,767,768,769,770,771,772,773,774,775,776,777,778,779,780,781,782,783,784,785,786,787,788,789,790,791,792,793,795,796,797,798,799,800,801,802,803,805,806,807,808,809,810,811,812,813,814,815,816,817,818,819,820,822,823,824,825,826,827,828,829,830,831,832,833,834,835,836,837,838,839,840,841,842,843,844,846,847,848,849,850,852,853,855,856,857,858,859,860,861,862,863,864,865,866,867,868,869,870,872,873,874,875,876,877,878,879,880,881,882,883,885,886,887,888,889,890,891,892,893,894,897,898,899,900,901,902,903,905,906,907,908,909,910,911,912,913,914,915,916,917,918,919,920,921,922,923,924,925,926,927,928,929,930,931,933,934,935,936,937,938,939,940,941,942,943,944,945,946,947,948,949,950,951,952,953,954,955,956,957,958,959,960,961,962,963,964,965,966,967,968,969,970,971,973,974,975,976,977,978,979,980,982,983,984,985,986,987,988,989,990,991,992,994,995,996,998,999,1000,1002,1003,1004,1005,1006,1007,1008,1010,1011,1012,1013,1014,1015,1016,1017,1018,1019,1020,1021,1022,1023,1024,1025,1026,1027,1028,1029,1030,1031,1032,1033,1035,1036,1037,1038,1039,1040,1041,1042,1043,1044,1045,1046,1048,1049,1050,1051,1052,1053,1054,1055,1056,1057,1058,1059,1060,1062,1063,1064,1065,1066,1067,1068,1069,1070,1071,1072,1073,1074,1075,1076,1077,1078,1079,1080,1081,1082,1083,1085,1086,1087,1088,1089,1090,1091,1092,1093,1095,1096,1097,1098,1099,1100,1101,1102,1103,1104,1105,1106,1107,1108,1109,1110,1111,1112,1113,1114,1115,1116,1117,1118,1119,1120,1122,1123,1124,1125,1126,1127,1128,1129,1130,1131,1132,1133,1134,1135,1136,1137,1138,1139,1140,1141,1142,1143,1144,1145,1146,1147,1149,1150,1151,1152,1153,1155,1156,1157,1158,1159,1160,1161,1162,1163,1164,1165,1166,1167,1168,1169,1170,1171,1172,1173,1174,1175,1177,1178,1179,1180,1181,1182,1183,1184,1185,1186,1187,1189,1190,1192,1193,1194,1196,1198,1199,1200,1201,1202,1204,1205,1206,1207,1208,1209,1210,1211,1212,1213,1214,1215,1216,1217,1219,1221,1222,1224,1225,1226,1227,1228,1229,1230,1232,1233,1234,1235,1236,1237,1238,1239,1240,1241,1242,1243,1244,1245,1247,1248,1249,1250,1251,1252,1253,1254,1255,1256,1257,1258,1259,1260,1262,1263,1264,1265,1266,1267,1268,1269,1270,1272,1274,1275,1276,1277,1278,1279,1280,1281,1282,1283,1284,1285,1286,1287,1289,1290,1291,1292,1293,1295,1296,1298,1299,1300,1301,1302,1303,1304,1305,1306,1307,1308,1309,1310,1311,1312,1313,1314,1315,1316,1317,1318,1319,1320,1321,1322,1323,1324,1325,1326,1327,1328,1329,1330,1331,1332,1334,1335,1336,1337,1338,1339,1340,1341,1342,1343,1344,1345,1346,1347,1348,1349,1350,1351,1352,1353,1354,1355,1356,1357,1358,1359,1360,1361,1362,1363,1364,1365,1366,1367,1368,1369,1370,1371,1372,1373,1374,1375,1376,1377,1378,1380,1381,1382,1383,1384,1385,1386,1387,1388,1389,1391,1392,1393,1394,1395,1396,1397,1398,1400,1401,1402,1403,1405,1406,1407,1409,1410,1412,1413,1414,1415,1417,1418,1419,1420,1421,1422,1423,1424,1425,1426,1427,1428,1429,1430,1431,1432,1433,1434,1435,1436,1437,1439,1440,1441,1442,1443,1444,1446,1447,1448,1449,1450,1451,1452,1453,1455,1456,1458,1459,1460,1461,1462,1463,1464,1465,1466,1467,1469,1470,1471,1472,1473,1474,1475,1476,1477,1478,1479,1480,1481,1482,1483,1484,1485,1486,1488,1489,1490,1491,1492,1493,1494,1495,1496,1497,1498,1499,1500,1501,1502,1503,1505,1506,1507,1508,1509,1510,1511,1512,1513,1514,1515,1516,1518,1519,1520,1521,1522,1523,1524,1525,1527,1528,1529,1530,1531,1532,1536,1537,1538,1539,1540,1541,1542,1543,1544,1545,1546,1547,1548,1549,1550,1551,1552,1553,1554,1555,1556,1557,1559,1560,1561,1562,1563,1564,1566,1567,1568,1569,1571,1572,1573,1574,1575,1576,1577,1578,1579,1580,1581,1582,1583,1584,1585,1586,1587,1588,1591,1592,1593,1594,1595,1596,1597,1598,1599,1600,1601,1602,1603,1604,1605,1606,1607,1608,1609,1611,1612,1613,1614,1615,1616,1617,1618,1620,1622,1624,1625,1626,1627,1628,1629,1630,1631,1632,1633,1634,1635,1636,1637,1639,1640,1641,1642,1643,1644,1645,1646,1647,1648,1649,1651,1652,1653,1654,1655,1656,1657,1658,1659,1660,1661,1662,1663,1664,1665,1666,1667,1668,1669,1670,1671,1672,1673,1674,1675,1676,1677,1678,1679,1680,1681,1682,1683,1684,1685,1686,1687,1688,1689,1690,1691,1693,1694,1695,1696,1697,1698,1699,1701,1702,1703,1704,1705,1706,1707,1709,1710,1711,1714,1715,1716,1717,1718,1719,1720,1721,1722,1724,1725,1727,1728,1729,1730,1731,1732,1733,1734,1735,1736,1737,1738,1740,1741,1742,1743,1744,1745,1746,1747,1749,1750,1751,1752,1753,1754,1755,1756,1758,1759,1760,1761,1763,1765,1766,1767,1769,1770,1771,1772,1773,1774,1776,1778,1779,1780,1781,1782,1783,1784,1785,1786,1787,1788,1789,1790,1791,1792,1793,1795,1797,1798,1799,1800,1801,1802,1803,1804,1805,1806,1809,1810,1811,1812,1813,1814,1815,1816,1817,1818,1819,1820,1821,1822,1823,1824,1825,1827,1828,1829,1830,1831,1832,1833,1834,1835,1836,1837,1838,1839,1840,1842,1844,1845,1846,1847,1848,1849,1850,1851,1852,1853,1854,1855,1856,1857,1858,1859,1860,1861,1862,1863,1864,1865,1866,1867,1868,1869,1871,1872,1873,1874,1875,1876,1877,1878,1879,1880,1881,1882,1883,1884,1885,1886,1887,1888,1889,1890,1891,1893,1894,1895,1896,1897,1899,1900,1901,1902,1903,1904,1905,1906,1908,1909,1910,1911,1912,1913,1914,1915,1916,1917,1919,1920,1921,1922,1923,1924,1925,1926,1927,1928,1929,1930,1931,1932,1933,1934,1935,1936,1937,1938,1939,1940,1941,1942,1943,1945,1946,1947,1948,1949,1950,1951,1952,1953,1954,1955,1956,1957,1958,1960,1961,1962,1963,1964,1965,1966,1967,1968,1969,1970,1971,1973,1974,1975,1976,1977,1978,1979,1980,1981,1982,1983,1984,1985,1986,1988,1989,1990,1991,1992,1993,1994,1996,1997,1998,1999,2000,2001,2002,2003,2004,2005,2006,2007,2008,2009,2010,2011,2012,2013,2014,2015,2016,2017,2018,2019,2020,2021,2022,2024,2025,2026,2027,2028,2029,2030,2031,2032,2034,2035,2036,2037,2038,2039,2040,2041,2043,2044,2045,2046,2047,2048,2049,2050,2051,2052,2053,2054,2055,2056,2057,2058,2059,2062,2063,2064,2065,2066,2068,2069,2070,2071,2072,2073,2074,2075,2076,2077,2078,2079,2080,2082,2083,2084,2085,2086,2088,2089,2090,2091,2092,2093,2094,2095,2097,2098,2099,2100,2101,2102,2103,2104,2105,2107,2108,2109,2110,2111,2112,2113,2114,2115,2116,2117,2118,2119,2120,2121,2122,2123,2124,2125,2126,2128,2129,2130,2131,2132,2133,2134,2135,2136,2137,2138,2139,2140,2141,2142,2143,2144,2145,2146,2147,2148,2149,2150,2151,2152,2153,2154,2156,2157,2158,2159,2160,2161,2162,2163,2164,2165,2166,2167,2168,2169,2170,2171,2172,2173,2174,2175,2176,2177,2179,2180,2181,2182,2183,2184,2186,2187,2189,2191,2192,2193,2194,2195,2196,2197,2198,2199,2200,2201,2202,2203,2205,2206,2207,2208,2210,2211,2212,2213,2214,2215,2216,2218,2219,2220,2221,2222,2223,2224,2225,2227,2228,2229,2230,2231,2232,2233,2234,2235,2237,2238,2239,2240,2241,2242,2243,2244,2245,2246,2247,2248,2249,2250,2251,2252,2253,2254,2255,2256,2257,2258,2259,2260,2261,2262,2263,2264,2265,2266,2267,2268,2269,2270,2271,2272,2273,2274,2275,2276,2277,2278,2279,2280,2281,2282,2283,2284,2285,2286,2287,2288,2289,2290,2291,2292,2293,2296,2297,2298,2299,2300,2301,2302,2303,2305,2306,2307,2308,2309,2310,2311,2312,2313,2314,2315,2316,2317,2319,2320,2321,2322,2323,2324,2325,2327,2330,2331,2332,2334,2335,2336,2337,2338,2339,2340,2341,2342,2343,2344,2345,2346,2347,2348,2349,2350,2351,2352,2353,2354,2355,2356,2357,2358,2359,2360,2361,2362,2363,2364,2365,2366,2367,2368,2369,2371,2372,2373,2374,2375,2377,2379,2380,2381,2382,2383,2386,2387,2388,2389,2390,2391,2392,2393,2394,2395,2396,2397,2398,2399,2400,2401,2402,2404,2405,2406,2407,2408,2409,2411,2412,2413,2414,2415,2416,2418,2419,2420,2421,2422,2423,2424,2425,2426,2427,2428,2429,2430,2431,2432,2433,2434,2436,2437,2438,2439,2440,2441,2442,2443,2444,2445,2446,2447,2448,2450,2451,2452,2453,2454,2456,2457,2458,2459,2460,2462,2463,2464,2465,2466,2467,2468,2469,2470,2471,2472,2473,2474,2475,2476,2477,2478,2480,2481,2482,2483,2484,2486,2487,2488,2489,2490,2491,2493,2494,2495,2496,2497,2498,2499,2500,2501,2502,2503,2504,2505,2507,2508,2509,2510,2511,2512,2513,2514,2515,2516,2517,2518,2519,2520,2521,2522,2523,2524,2525,2526,2528,2529,2530,2532,2533,2534,2535,2537,2538,2539,2540,2541,2542,2543,2544,2545,2546,2547,2548,2549,2550,2551,2552,2553,2554,2555,2556,2558,2559,2560,2561,2562,2563,2564,2565,2566,2567,2569,2570,2572,2573,2574,2575,2576,2577,2578,2579,2580,2581,2582,2583,2584,2585,2586,2587,2588,2589,2590,2591,2594,2595,2596,2597,2598,2599,2600,2601,2602,2603,2604,2605,2606,2607,2608,2609,2610,2611,2612,2613,2614,2615,2616,2617,2618,2620,2621,2622,2623,2624,2625,2626,2628,2629,2630,2632,2633,2634,2635,2636,2637,2639,2640,2642,2643,2644,2645,2646,2647,2648,2650,2651,2652,2653,2654,2655,2658,2659,2661,2662,2663,2664,2665,2666,2667,2668,2669,2670,2671,2672,2673,2674,2675,2676,2677,2678,2679,2680,2681,2682,2683,2684,2685,2686,2688,2689,2690,2691,2692,2693,2694,2695,2696,2697,2698,2699,2700,2701,2702,2704,2705,2706,2708,2709,2710,2711,2712,2715,2716,2718,2719,2720,2721,2722,2723,2724,2725,2726,2727,2728,2729,2730,2731,2732,2734,2735,2736,2737,2738,2739,2740,2741,2742,2743,2744,2745,2746,2749,2750,2751,2752,2753,2754,2755,2756,2757,2758,2759,2760,2762,2766,2767,2768,2769,2770,2771,2772,2773,2774,2775,2776,2778,2780,2781,2782,2783,2784,2785,2786,2787,2788,2789,2790,2791,2792,2793,2795,2796,2797,2798,2799,2800,2801,2802,2803,2804,2805,2806,2807,2808,2809,2810,2812,2813,2814,2815,2816,2818,2819,2820,2822,2823,2825,2826,2827,2828,2829,2830,2831,2832,2833,2834,2835,2836,2837,2838,2839,2840,2841,2843,2844,2845,2846,2847,2848,2849,2850,2851,2852,2853,2854,2855,2856,2857,2858,2859,2860,2861,2862,2863,2864,2865,2866,2867,2868,2869,2870,2871,2872,2874,2875,2876,2877,2878,2879,2880,2881,2882,2883,2884,2885,2886,2887,2888,2889,2890,2891,2892,2893,2895,2896,2897,2898,2900,2901,2902,2903,2904,2905,2906,2907,2908,2909,2910,2911,2912,2913,2914,2915,2916,2917,2918,2919,2920,2921,2922,2923,2924,2925,2926,2927,2928,2929,2930,2931,2933,2934,2935,2936,2938,2939,2940,2941,2943,2945,2946,2947,2948,2949,2950,2951,2952,2953,2955,2956,2957,2958,2959,2960,2961,2963,2964,2965,2966,2967,2968,2969,2970,2971,2973,2974,2975,2976,2977,2978,2979,2980,2981,2982,2983,2984,2985,2986,2987,2989,2990,2991,2992,2993,2994,2995,2997,2998,3000,3001,3002,3003,3004,3005,3006,3007,3008,3009,3010,3011,3012,3014,3015,3017,3018,3019,3021,3022,3023,3024,3025,3026,3027,3028,3029,3030,3031,3033,3034,3035,3036,3037,3038,3039,3040,3041,3042,3045,3046,3047,3048,3049,3050,3051,3053,3054,3055,3056,3057,3058,3059,3060,3061,3062,3063,3064,3065,3066,3067,3068,3069,3070,3071,3072,3073,3074,3075,3076,3078,3079,3080,3081,3082,3083,3084,3085,3086,3088,3089,3091,3092,3093,3094,3095,3096,3097,3098,3099,3100,3101,3102,3103,3104,3105,3106,3107,3108,3109,3110,3111,3112,3113,3114,3115,3116,3117,3118,3119,3120,3121,3122,3123,3124,3125,3126,3127,3128,3129,3130,3131,3132,3133,3134,3135,3136,3137,3138,3139,3141,3142,3143,3144,3145,3146,3147,3148,3149,3150,3151,3152,3153,3154,3155,3156,3157,3158,3159,3160,3161,3162,3163,3164,3165,3166,3167,3168,3169,3171,3172,3173,3174,3175,3176,3177,3180,3181,3182,3183,3184,3186,3187,3188,3189,3190,3192,3193,3194,3195,3196,3197,3198,3199,3200,3201,3202,3203,3204,3205,3206,3207,3208,3209,3211,3212,3213,3214,3216,3217,3218,3220,3221,3222,3223,3224,3225,3227,3228,3229,3230,3231,3232,3233,3234,3235,3236,3237,3238,3239,3240,3241,3244,3245,3246,3247,3248,3249,3250,3252,3253,3254,3255,3256,3257,3258,3259,3260,3261,3262,3263,3264,3267,3268,3269,3270,3272,3273,3274,3275,3276,3277,3278,3279,3280,3281,3282,3283,3284,3285,3286,3287,3288,3289,3290,3291,3292,3293,3294,3295,3296,3298,3299,3300,3301,3302,3303,3304,3307,3308,3309,3311,3312,3313,3314,3316,3318,3319,3320,3321,3323,3324,3326,3327,3328,3329,3330,3331,3332,3333,3334,3335,3336,3337,3338,3339,3340,3341,3342,3343,3344,3345,3348,3349,3350,3351,3352,3353,3354,3355,3356,3357,3360,3361,3362,3363,3364,3365,3366,3367,3369,3370,3372,3373,3374,3375,3376,3377,3378,3379,3380,3381,3382,3383,3384,3385,3386,3387,3388,3389,3390,3391,3392,3393,3394,3395,3396,3397,3398,3399,3400,3402,3403,3404,3405,3406,3407,3408,3409,3410,3411,3414,3415,3416,3418,3419,3420,3421,3422,3423,3424,3425,3426,3427,3428,3429,3430,3431,3432,3433,3434,3435,3436,3437,3438,3440,3441,3442,3443,3444,3447,3448,3449,3451,3452,3453,3454,3455,3456,3457,3459,3460,3461,3462,3463,3464,3465,3466,3467,3468,3469,3470,3471,3472,3473,3474,3475,3476,3477,3478,3480,3482,3483,3484,3485,3486,3487,3488,3489,3490,3491,3492,3493,3494,3495,3497,3498,3499,3500,3501,3502,3503,3504,3505,3506,3507,3508,3509,3510,3511,3513,3514,3515,3516,3517,3518,3519,3520,3521,3522,3523,3524,3525,3526,3527,3528,3529,3530,3531,3532,3533,3534,3535,3537,3538,3539,3541,3542,3543,3544,3545,3546,3547,3548,3549,3550,3551,3552,3553,3554,3555,3556,3557,3558,3559,3560,3561,3562,3563,3564,3565,3566,3567,3568,3569,3570,3571,3572,3573,3575,3576,3577,3578,3579,3580,3582,3583,3585,3586,3587,3588,3589,3590,3591,3592,3593,3594,3595,3596,3597,3598,3599,3600,3601,3602,3603,3604,3605,3606,3607,3609,3610,3611,3612,3614,3615,3616,3617,3618,3619,3620,3621,3622,3623,3625,3626,3627,3628,3629,3630,3631,3632,3633,3635,3636,3637,3638,3639,3641,3642,3643,3644,3645,3647,3648,3649,3651,3652,3653,3654,3655,3656,3657,3658,3659,3661,3662,3663,3664,3665,3666,3667,3668,3669,3670,3671,3672,3673,3674,3675,3676,3678,3679,3681,3682,3683,3684,3685,3686,3687,3688,3689,3690,3691,3692,3693,3694,3696,3697,3699,3700,3701,3702,3703,3704,3705,3707,3708,3709,3711,3712,3713,3714,3715,3716,3717,3718,3719,3720,3721,3722,3723,3725,3726,3727,3728,3729,3730,3731,3732,3733,3736,3737,3738,3739,3740,3741,3742,3743,3744,3745,3746,3747,3748,3749,3750,3751,3752,3753,3754,3755,3756,3757,3758,3759,3760,3761,3762,3763,3765,3766,3767,3769,3770,3771,3772,3773,3775,3776,3777,3778,3779,3780,3781,3782,3783,3784,3785,3786,3787,3788,3789,3791,3792,3793,3794,3795,3796,3797,3798,3799,3800,3801,3802,3806,3807,3808,3809,3810,3811,3812,3813,3814,3815,3816,3817,3819,3820,3821,3822,3823,3824,3825,3826,3827,3828,3829,3831,3832,3833,3834,3835,3836,3837,3838,3839,3840,3841,3842,3843,3844,3845,3846,3848,3850,3851,3852,3853,3854,3855,3856,3857,3858,3859,3860,3861,3862,3863,3865,3866,3868,3869,3871,3872,3873,3874,3875,3876,3877,3878,3879,3880,3881,3882,3884,3885,3886,3887,3888,3889,3890,3891,3892,3893,3894,3896,3897,3898,3899,3900,3901,3902,3904,3905,3906,3907,3908,3909,3910,3912,3913,3914,3915,3916,3917,3918,3919,3920,3921,3922,3923,3924,3925,3926,3927,3928,3929,3930,3931,3932,3933,3934,3935,3936,3937,3938,3939,3941,3943,3944,3945,3946,3947,3948,3949,3950,3951,3952,3953,3954,3955,3956,3957,3958,3960,3961,3962,3963,3964,3965,3966,3967,3968,3969,3970,3971,3972,3973,3974,3975,3976,3977,3978,3979,3981,3983,3984,3985,3986,3987,3988,3990,3991,3992,3993,3994,3995,3996,3997,3998,3999,4000,4001,4002,4003,4004,4005,4006,4007,4008,4009,4010,4011,4012,4013,4014,4015,4016,4017,4018,4019,4020,4021,4022,4024,4025,4026,4027,4028,4029,4030,4031,4032,4035,4036,4037,4038,4039,4040,4041,4042,4044,4045,4046,4047,4049,4050,4051,4052,4053,4054,4055,4056,4057,4058,4059,4060,4061,4063,4064,4066,4067,4068,4069,4071,4072,4073,4074,4075,4076,4077,4078,4081,4083,4084,4085,4086,4087,4088,4089,4092,4093,4094,4095,4096,4097,4098,4099,4100,4101,4102,4103,4104,4105,4106,4107,4108,4109,4110,4111,4112,4113,4114,4115,4116,4117,4118,4119,4120,4121,4122,4123,4124,4125,4126,4127,4128,4129,4130,4131,4132,4133,4134,4135,4136,4137,4138,4139,4140,4141,4142,4143,4144,4145,4147,4148,4149,4151,4152,4153,4154,4156,4158,4159,4160,4161,4162,4163,4164,4165,4167,4168,4169,4170,4171,4172,4173,4174,4175,4176,4177,4178,4179,4180,4181,4182,4183,4184,4185,4187,4189,4190,4191,4192,4193,4194,4195,4196,4197,4198,4199,4200,4201,4202,4203,4204,4205,4206,4207,4209,4210,4211,4212,4213,4214,4215,4216,4217,4218,4219,4220,4221,4222,4223,4224,4225,4226,4228,4229,4230,4231,4232,4233,4234,4235,4236,4237,4238,4239,4240,4242,4243,4244,4245,4246,4247,4248,4249,4250,4251,4252,4253,4254,4255,4256,4257,4258,4259,4260,4261,4262,4263,4264,4265,4266,4267,4268,4269,4270,4271,4272,4273,4274,4275,4276,4277,4279,4280,4283,4284,4285,4287,4288,4289,4290,4291,4292,4293,4294,4295,4296,4297,4298,4299,4300,4301,4302,4303,4304,4305,4306,4307,4308,4309,4310,4311,4312,4313,4314,4315,4316,4317,4318,4319,4321,4322,4323,4324,4325,4326,4328,4330,4331,4332,4333,4334,4335,4336,4337,4338,4339,4340,4341,4342,4344,4345,4346,4347,4349,4350,4352,4354,4355,4356,4357,4358,4359,4360,4362,4363,4364,4366,4367,4368,4369,4371,4372,4373,4374,4375,4376,4377,4378,4379,4380,4381,4382,4383,4384,4385,4386,4387,4388,4389,4390,4391,4393,4394,4395,4396,4397,4398,4399,4400,4401,4402,4405,4406,4407,4408,4409,4410,4411,4412,4413,4414,4415,4416,4417,4418,4419,4420,4421,4422,4423,4424,4425,4426,4427,4428,4429,4430,4431,4433,4434,4435,4436,4437,4438,4439,4440,4441,4442,4443,4444,4445,4446,4449,4450,4451,4452,4453,4454,4455,4456,4458,4459,4460,4461,4463,4464,4465,4466,4467,4468,4469,4471,4472,4474,4475,4476,4478,4479,4480,4481,4482,4483,4484,4485,4486,4487,4488,4489,4490,4491,4492,4493,4494,4496,4497,4498,4499,4500,4501,4502,4503,4504,4505,4506,4507,4508,4509,4510,4511,4512,4513,4514,4516,4517,4518,4519,4520,4521,4522,4523,4524,4525,4526,4528,4529,4530,4532,4533,4534,4535,4536,4537,4538,4539,4540,4541,4543,4544,4545,4546,4547,4548,4549,4550,4551,4552,4553,4555,4556,4557,4558,4559,4560,4561,4562,4563,4564,4565,4566,4567,4568,4569,4570,4571,4572,4573,4574,4575,4576,4577,4578,4579,4580,4581,4582,4583,4584,4585,4586,4587,4588,4589,4590,4591,4592,4593,4594,4595,4596,4597,4598,4599,4600,4601,4602,4603,4605,4606,4607,4608,4609,4610,4612,4613,4615,4616,4618,4619,4620,4621,4622,4623,4624,4625,4626,4627,4629,4630,4632,4633,4634,4635,4636,4637,4638,4639,4640,4643,4644,4645,4646,4647,4648,4649,4651,4652,4653,4654,4655,4656,4657,4658,4659,4660,4661,4662,4663,4664,4665,4666,4667,4668,4669,4670,4671,4673,4674,4676,4677,4678,4679,4680,4681,4682,4683,4684,4685,4686,4687,4688,4689,4690,4691,4692,4693,4694,4695,4696,4697,4698,4699,4700,4701,4702,4703,4704,4705,4706,4707,4708,4709,4710,4711,4712,4713,4714,4715,4716,4717,4719,4721,4722,4723,4724,4725,4726,4727,4728,4729,4730,4731,4732,4733,4734,4735,4736,4737,4738,4740,4742,4743,4744,4745,4746,4747,4748,4749,4750,4751,4752,4753,4754,4755,4756,4758,4759,4760,4761,4762,4763,4764,4765,4766,4767,4768,4769,4770,4771,4772,4773,4774,4775,4777,4778,4779,4781,4782,4783,4784,4785,4786,4787,4789,4790,4791,4792,4793,4794,4795,4796,4797,4798,4799,4800,4801,4802,4803,4805,4806,4807,4808,4809,4810,4811,4812,4813,4814,4815,4816,4817,4818,4820,4821,4822,4823,4825,4826,4827,4828,4829,4830,4831,4832,4833,4835,4836,4837,4838,4839,4840,4841,4842,4843,4844,4845,4846,4847,4848,4849,4850,4851,4852,4853,4854,4855,4856,4858,4859,4860,4861,4863,4864,4865,4866,4867,4868,4869,4870,4871,4872,4873,4874,4875,4876,4877,4878,4879,4881,4882,4883,4884,4885,4886,4888,4889,4890,4892,4893,4894,4895,4896,4897,4898,4899,4900,4901,4902,4903,4904,4905,4906,4907,4908,4909,4910,4911,4912,4913,4914,4915,4916,4917,4918,4919,4920,4921,4922,4924,4925,4926,4927,4928,4929,4930,4931,4932,4933,4934,4936,4938,4939,4940,4941,4942,4943,4944,4945,4946,4947,4948,4949,4950,4951,4952,4953,4954,4955,4956,4960,4961,4962,4963,4964,4965,4966,4967,4968,4969,4970,4971,4972,4973,4974,4975,4976,4977,4978,4979,4980,4981,4982,4983,4984,4985,4986,4987,4988,4989,4990,4991,4993,4994,4995,4996,4997,4998,5000,5001,5002,5003,5004,5005,5007,5009,5010,5011,5012,5013,5014,5015,5016,5017,5018,5019,5020,5021,5022,5023,5024,5025,5026,5027,5028,5029,5030,5032,5034,5036,5037,5038,5039,5040,5041,5042,5044,5045,5046,5047,5048,5049,5050,5052,5053,5054,5055,5056,5057,5058,5059,5060,5061,5062,5063,5064,5065,5066,5067,5068,5070,5071,5072,5073,5074,5075,5076,5077,5078,5080,5081,5082,5083,5084,5085,5086,5088,5089,5090,5091,5092,5093,5094,5095,5096,5097,5098,5099,5100,5101,5102,5103,5104,5105,5106,5107,5110,5111,5112,5113,5114,5115,5116,5117,5118,5119,5120,5121,5122,5123,5125,5126,5127,5128,5129,5130,5131,5132,5134,5135,5136,5137,5138,5140,5142,5143,5144,5145,5146,5148,5149,5150,5151,5152,5153,5154,5156,5157,5158,5159,5160,5161,5162,5163,5164,5166,5167,5168,5169,5170,5171,5172,5173,5174,5175,5176,5177,5178,5179,5180,5181,5182,5183,5184,5185,5186,5187,5188,5189,5190,5191,5192,5193,5194,5195,5196,5197,5198,5199,5200,5201,5202,5203,5204,5205,5206,5207,5208,5209,5210,5211,5212,5213,5214,5215,5216,5217,5218,5219,5220,5221,5222,5223,5224,5225,5226,5227,5228,5229,5230,5231,5232,5233,5234,5235,5236,5237,5238,5239,5240,5242,5245,5246,5247,5248,5250,5252,5254,5256,5258,5260,5261,5262,5263,5264,5265,5266,5267,5268,5269,5271,5272,5273,5274,5275,5276,5277,5278,5279,5281,5282,5283,5284,5285,5286,5287,5288,5289,5291,5292,5293,5294,5295,5296,5297,5298,5299,5300,5302,5303,5304,5306,5308,5309,5310,5311,5312,5313,5314,5315,5316,5317,5318,5319,5322,5323,5324,5325,5326,5327,5328,5329,5330,5331,5332,5333,5334,5335,5336,5338,5339,5340,5341,5343,5344,5345,5346,5347,5348,5349,5350,5351,5352,5354,5355,5356,5357,5358,5359,5360,5361,5362,5363,5364,5365,5366,5367,5370,5371,5372,5373,5374,5375,5376,5377,5378,5379,5380,5381,5382,5383,5384,5385,5386,5387,5388,5389,5390,5391,5392,5393,5394,5395,5396,5397,5399,5400,5401,5402,5403,5404,5406,5407,5408,5409,5410,5411,5412,5413,5414,5416,5417,5418,5419,5420,5421,5422,5423,5424,5425,5426,5427,5429,5431,5432,5433,5434,5436,5437,5438,5439,5440,5441,5442,5444,5445,5446,5447,5448,5449,5451,5453,5454,5455,5456,5457,5458,5460,5461,5462,5464,5465,5466,5467,5468,5469,5471,5472,5473,5474,5475,5476,5477,5478,5479,5480,5481,5482,5484,5485,5486,5487,5488,5489,5490,5491,5492,5493,5494,5495,5496,5497,5498,5499,5500,5501,5502,5503,5504,5506,5507,5508,5509,5510,5511,5512,5514,5515,5516,5517,5518,5520,5521,5522,5523,5524,5525,5527,5528,5530,5532,5533,5534,5535,5536,5537,5538,5539,5540,5541,5542,5543,5544,5545,5546,5547,5548,5549,5550,5551,5552,5553,5555,5556,5557,5558,5559,5560,5561,5562,5563,5564,5565,5566,5568,5569,5570,5571,5572,5573,5574,5575,5576,5577,5578,5579,5580,5581,5582,5583,5585,5586,5587,5588,5589,5590,5591,5594,5595,5596,5597,5598,5599,5600,5601,5602,5604,5605,5606,5607,5608,5609,5610,5611,5612,5614,5615,5616,5617,5618,5619,5620,5621,5622,5623,5624,5625,5626,5627,5628,5629,5630,5631,5632,5633,5634,5635,5636,5637,5638,5639,5640,5641,5642,5643,5644,5645,5646,5647,5648,5649,5650,5651,5654,5655,5656,5657,5658,5660,5661,5662,5663,5664,5665,5666,5667,5668,5670,5671,5672,5674,5675,5676,5677,5678,5679,5680,5681,5682,5683,5687,5688,5689,5690,5691,5692,5693,5694,5696,5697,5698,5699,5700,5701,5702,5703,5704,5705,5706,5707,5708,5709,5710,5711,5712,5713,5714,5715,5716,5717,5719,5720,5722,5723,5724,5725,5726,5727,5728,5729,5730,5732,5733,5734,5735,5736,5738,5739,5740,5741,5742,5743,5744,5745,5746,5747,5748,5749,5751,5752,5753,5754,5755,5757,5758,5759,5760,5761,5762,5763,5764,5765,5766,5767,5768,5769,5770,5771,5772,5773,5774,5775,5776,5777,5779,5780,5781,5782,5783,5784,5785,5786,5787,5788,5789,5790,5792,5793,5794,5795,5796,5797,5798,5799,5800,5801,5802,5803,5804,5805,5807,5808,5809,5810,5811,5813,5814,5815,5816,5817,5819,5820,5821,5822,5823,5824,5825,5826,5829,5831,5832,5833,5834,5835,5836,5837,5839,5840,5841,5842,5843,5844,5845,5846,5848,5849,5850,5851,5852,5853,5854,5855,5856,5857,5858,5859,5860,5861,5862,5863,5864,5866,5867,5868,5869,5871,5872,5873,5874,5875,5876,5877,5878,5879,5880,5881,5882,5883,5884,5885,5886,5887,5888,5889,5891,5892,5893,5894,5895,5896,5897,5898,5900,5901,5902,5903,5904,5905,5906,5907,5908,5909,5910,5911,5912,5913,5914,5915,5916,5917,5919,5920,5921,5922,5923,5924,5925,5926,5927,5928,5931,5933,5934,5935,5936,5937,5938,5939,5940,5941,5943,5944,5945,5946,5947,5948,5949,5950,5951,5953,5954,5955,5956,5957,5958,5959,5960,5961,5962,5963,5964,5966,5967,5968,5969,5970,5971,5972,5973,5975,5976,5977,5978,5979,5981,5982,5983,5984,5985,5986,5988,5989,5991,5992,5994,5995,5996,5997,5998,5999,6000,6001,6002,6004,6005,6006,6007,6008,6009,6010,6011,6012,6013,6014,6017,6018,6019,6020,6021,6022,6023,6024,6025,6026,6027,6028,6029,6030,6031,6032,6033,6034,6035,6036,6037,6038,6039,6041,6042,6043,6044,6045,6046,6047,6048,6049,6050,6051,6052,6053,6054,6055,6056,6057,6058,6059,6060,6061,6063,6064,6065,6066,6067,6068,6069,6070,6071,6073,6074,6075,6076,6077,6078,6079,6080,6081,6083,6084,6085,6086,6087,6088,6089,6090,6091,6092,6093,6094,6095,6096,6098,6100,6101,6102,6103,6104,6105,6106,6107,6108,6109,6110,6111,6112,6113,6115,6116,6118,6119,6120,6121,6122,6123,6124,6125,6126,6128,6130,6132,6134,6135,6136,6137,6138,6139,6141,6142,6143,6144,6145,6146,6147,6148,6149,6150,6151,6152,6153,6154,6155,6156,6157,6158,6159,6160,6161,6162,6164,6165,6166,6167,6168,6169,6170,6171,6172,6173,6174,6175,6176,6177,6178,6179,6180,6182,6183,6184,6185,6186,6187,6188,6189,6190,6192,6193,6194,6195,6196,6197,6198,6199,6200,6202,6203,6204,6205,6206,6207,6208,6209,6210,6212,6213,6214,6215,6216,6217,6218,6219,6220,6221,6222,6223,6224,6225,6226,6227,6228,6229,6230,6231,6232,6233,6234,6235,6236,6237,6238,6239,6240,6242,6243,6244,6245,6246,6247,6248,6249,6251,6252,6253,6254,6255,6256,6257,6258,6260,6261,6262,6263,6265,6266,6267,6268,6269,6270,6271,6272,6273,6274,6275,6276,6277,6278,6279,6281,6282,6283,6284,6285,6289,6290,6291,6292,6294,6295,6296,6297,6298,6299,6300,6301,6302,6303,6304,6305,6306,6307,6308,6310,6311,6312,6313,6314,6315,6316,6317,6318,6320,6321,6322,6323,6324,6325,6326,6327,6329,6330,6331,6332,6333,6334,6335,6336,6337,6338,6339,6340,6341,6343,6345,6346,6347,6348,6349,6350,6352,6353,6354,6355,6356,6357,6358,6359,6360,6361,6362,6363,6364,6365,6366,6367,6368,6369,6370,6371,6372,6373,6374,6375,6376,6377,6378,6379,6380,6381,6382,6384,6385,6386,6387,6388,6389,6390,6391,6392,6393,6394,6395,6396,6397,6399,6401,6402,6403,6404,6405,6406,6407,6408,6409,6410,6411,6412,6413,6414,6415,6416,6417,6418,6419,6420,6421,6422,6423,6425,6427,6430,6431,6432,6433,6434,6435,6436,6438,6439,6440,6441,6442,6443,6445,6446,6447,6448,6449,6450,6451,6452,6453,6455,6456,6457,6458,6459,6460,6462,6463,6464,6465,6466,6467,6468,6469,6471,6472,6474,6475,6476,6477,6479,6480,6481,6482,6483,6484,6485,6486,6487,6488,6490,6491,6492,6493,6494,6495,6496,6497,6498,6499,6500,6501,6502,6503,6504,6505,6506,6507,6508,6509,6511,6512,6513,6514,6515,6516,6517,6518,6519,6520,6521,6522,6523,6524,6525,6527,6528,6529,6530,6531,6533,6534,6535,6536,6537,6538,6539,6540,6541,6542,6543,6544,6545,6547,6548,6549,6550,6551,6552,6553,6554,6555,6556,6558,6559,6560,6561,6562,6563,6564,6565,6566,6568,6569,6570,6571,6572,6573,6574,6575,6576,6577,6578,6579,6581,6582,6584,6585,6586,6587,6589,6591,6592,6593,6594,6595,6596,6598,6599,6600,6601,6603,6604,6605,6606,6607,6608,6609,6610,6611,6612,6613,6614,6615,6616,6617,6618,6619,6620,6622,6623,6624,6625,6626,6627,6628,6629,6630,6631,6632,6634,6635,6636,6637,6638,6639,6640,6641,6642,6644,6645,6646,6647,6648,6649,6650,6652,6653,6654,6655,6656,6657,6658,6659,6660,6661,6662,6663,6664,6665,6666,6667,6668,6669,6670,6671,6673,6674,6675,6676,6677,6678,6679,6680,6681,6682,6683,6684,6685,6686,6687,6688,6689,6690,6691,6692,6693,6694,6695,6696,6697,6698,6699,6700,6702,6703,6704,6705,6706,6707,6708,6709,6710,6712,6713,6714,6715,6716,6717,6718,6720,6721,6722,6723,6724,6725,6726,6727,6728,6729,6730,6731,6732,6733,6734,6735,6736,6737,6738,6739,6740,6741,6742,6743,6744,6745,6746,6747,6748,6749,6751,6754,6755,6756,6757,6758,6759,6761,6762,6763,6764,6765,6767,6768,6769,6771,6772,6773,6774,6775,6776,6777,6778,6780,6782,6783,6784,6785,6787,6788,6789,6790,6791,6792,6793,6794,6796,6797,6799,6800,6801,6802,6803,6804,6805,6806,6807,6809,6810,6811,6812,6813,6814,6815,6816,6817,6819,6820,6821,6822,6823,6824,6825,6826,6827,6828,6829,6830,6831,6832,6834,6836,6837,6838,6839,6840,6842,6844,6845,6846,6847,6848,6849,6850,6851,6852,6853,6854,6855,6856,6857,6858,6859,6860,6861,6862,6863,6864,6865,6866,6867,6868,6869,6870,6871,6872,6873,6874,6875,6876,6878,6879,6880,6881,6882,6883,6884,6885,6886,6887,6888,6889,6890,6891,6893,6895,6896,6897,6898,6899,6900,6901,6902,6903,6904,6905,6906,6907,6908,6909,6910,6911,6912,6913,6914,6915,6916,6917,6918,6919,6920,6922,6924,6926,6928,6929,6930,6931,6932,6933,6934,6935,6936,6938,6939,6940,6941,6942,6943,6944,6945,6946,6948,6949,6950,6951,6952,6953,6954,6955,6956,6957,6958,6960,6961,6963,6964,6965,6966,6967,6969,6972,6973,6974,6975,6976,6977,6980,6981,6982,6983,6984,6985,6986,6987,6988,6989,6990,6991,6992,6993,6994,6995,6996,6997,6998,6999,7000,7001,7002,7003,7004,7005,7006,7007,7008,7009,7010,7011,7012,7013,7014,7015,7016,7017,7018,7019,7020,7021,7022,7023,7024,7025,7026,7027,7028,7029,7030,7032,7033,7034,7035,7036,7038,7039,7040,7041,7042,7043,7044,7045,7046,7047,7048,7050,7051,7053,7054,7055,7056,7057,7058,7059,7060,7061,7063,7064,7065,7066,7067,7068,7069,7070,7071,7073,7074,7075,7076,7077,7078,7079,7080,7081,7082,7083,7085,7087,7088,7089,7090,7091,7092,7093,7094,7095,7096,7097,7098,7099,7100,7101,7102,7103,7104,7105,7106,7107,7108,7109,7110,7111,7113,7114,7115,7116,7117,7118,7119,7120,7121,7122,7123,7124,7125,7126,7127,7128,7130,7131,7132,7134,7135,7136,7137,7138,7140,7141,7142,7143,7144,7145,7146,7147,7148,7149,7150,7151,7152,7153,7154,7155,7156,7157,7158,7159,7160,7163,7164,7165,7166,7167,7169,7170,7171,7172,7173,7174,7176,7177,7178,7179,7180,7181,7182,7183,7184,7185,7186,7187,7188,7189,7191,7192,7193,7194,7195,7196,7197,7198,7199,7200,7201,7204,7205,7206,7207,7208,7209,7210,7211,7212,7213,7214,7215,7217,7218,7219,7220,7222,7223,7224,7226,7227,7228,7229,7230,7232,7233,7234,7235,7236,7237,7238,7239,7240,7241,7242,7243,7244,7245,7246,7247,7248,7249,7250,7251,7252,7253,7254,7256,7257,7258,7259,7260,7262,7264,7265,7266,7267,7268,7270,7271,7272,7273,7274,7275,7276,7277,7278,7280,7281,7282,7283,7284,7285,7286,7287,7288,7290,7291,7292,7293,7294,7295,7296,7297,7298,7299,7300,7301,7302,7303,7304,7305,7306,7307,7308,7309,7310,7311,7312,7313,7314,7315,7316,7318,7319,7320,7321,7322,7323,7324,7325,7326,7327,7328,7329,7331,7332,7333,7334,7335,7336,7338,7339,7340,7341,7343,7344,7345,7346,7347,7348,7349,7350,7351,7352,7353,7355,7356,7357,7358,7359,7360,7361,7362,7364,7365,7366,7369,7370,7371,7372,7373,7374,7375,7376,7377,7378,7379,7380,7382,7383,7384,7386,7387,7388,7389,7390,7391,7392,7393,7394,7395,7396,7397,7398,7399,7400,7401,7402,7403,7404,7405,7406,7407,7408,7409,7411,7412,7413,7414,7415,7416,7417,7418,7419,7420,7421,7422,7423,7424,7425,7426,7427,7428,7429,7430,7431,7432,7433,7434,7435,7436,7437,7438,7439,7441,7442,7443,7444,7445,7447,7448,7450,7451,7453,7454,7455,7456,7457,7458,7459,7460,7461,7462,7463,7464,7466,7467,7468,7469,7470,7471,7472,7473,7474,7475,7476,7477,7478,7479,7480,7481,7482,7483,7484,7486,7487,7488,7489,7490,7492,7493,7494,7495,7496,7497,7498,7499,7500,7501,7502,7503,7504,7507,7508,7509,7510,7511,7512,7513,7514,7515,7517,7518,7519,7520,7521,7522,7523,7524,7525,7527,7528,7529,7530,7531,7532,7533,7534,7535,7538,7539,7540,7541,7542,7543,7544,7545,7546,7547,7548,7549,7550,7551,7552,7553,7554,7556,7557,7559,7560,7561,7562,7563,7564,7565,7567,7568,7569,7570,7571,7572,7573,7574,7575,7576,7577,7578,7579,7580,7581,7582,7583,7584,7585,7586,7587,7588,7589,7590,7591,7592,7594,7595,7596,7597,7598,7600,7602,7603,7604,7605,7606,7608,7609,7610,7611,7612,7613,7614,7615,7616,7618,7619,7620,7621,7622,7623,7624,7626,7627,7628,7629,7630,7631,7632,7633,7634,7635,7636,7637,7638,7639,7640,7641,7642,7643,7644,7645,7647,7648,7649,7650,7651,7652,7653,7654,7656,7657,7658,7659,7660,7661,7662,7663,7664,7665,7666,7667,7668,7669,7670,7672,7673,7674,7675,7676,7677,7678,7679,7680,7681,7682,7683,7684,7685,7686,7687,7689,7690,7691,7692,7694,7695,7696,7697,7698,7700,7701,7704,7705,7707,7708,7709,7710,7711,7712,7713,7714,7715,7716,7717,7718,7719,7720,7721,7722,7724,7725,7726,7728,7729,7730,7731,7732,7733,7734,7735,7736,7738,7739,7740,7741,7742,7743,7744,7745,7746,7748,7749,7750,7751,7752,7753,7754,7755,7756,7757,7758,7759,7760,7761,7762,7763,7764,7765,7766,7767,7768,7769,7770,7771,7772,7773,7774,7775,7776,7777,7778,7779,7781,7783,7784,7785,7786,7787,7788,7789,7790,7792,7793,7794,7795,7796,7797,7798,7799,7800,7801,7802,7803,7804,7805,7806,7807,7808,7809,7811,7812,7813,7814,7815,7816,7818,7819,7821,7822,7823,7824,7825,7826,7827,7828,7829,7831,7832,7833,7834,7836,7837,7839,7840,7841,7842,7843,7844,7845,7847,7848,7849,7850,7851,7852,7853,7854,7856,7857,7858,7859,7860,7861,7862,7863,7864,7865,7867,7869,7870,7871,7872,7874,7875,7876,7877,7878,7879,7880,7881,7883,7884,7885,7886,7888,7890,7891,7892,7893,7894,7895,7896,7897,7899,7900,7901,7902,7903,7904,7905,7906,7908,7909,7910,7911,7912,7914,7915,7916,7917,7918,7919,7920,7921,7922,7923,7924,7925,7926,7927,7928,7929,7930,7931,7932,7934,7935,7936,7937,7938,7939,7940,7941,7942,7944,7945,7946,7947,7948,7949,7950,7951,7952,7954,7955,7956,7957,7958,7959,7960,7961,7962,7963,7964,7965,7966,7968,7969,7970,7971,7972,7973,7974,7975,7976,7977,7978,7979,7980,7981,7982,7983,7984,7985,7986,7988,7990,7991,7992,7993,7994,7995,7996,7997,7998,7999,8000,8001,8002,8003,8004,8005,8006,8008,8009,8010,8011,8012,8013,8014,8015,8017,8018,8019,8020,8022,8024,8025,8026,8027,8028,8030,8031,8032,8033,8034,8035,8036,8037,8038,8039,8040,8041,8042,8043,8044,8045,8046,8047,8048,8049,8050,8051,8052,8053,8054,8058,8059,8060,8061,8062,8063,8064,8065,8066,8068,8069,8070,8071,8072,8073,8074,8075,8076,8078,8079,8080,8081,8082,8083,8084,8086,8087,8088,8089,8090,8091,8092,8093,8094,8095,8096,8097,8099,8100,8101,8102,8103,8104,8105,8106,8107,8108,8109,8110,8112,8113,8115,8116,8118,8119,8120,8121,8122,8123,8124,8125,8126,8128,8129,8130,8131,8132,8133,8134,8135,8136,8138,8139,8140,8141,8142,8143,8144,8145,8146,8147,8148,8149,8150,8151,8153,8154,8155,8156,8157,8158,8159,8160,8161,8162,8164,8165,8166,8167,8168,8169,8170,8171,8173,8174,8175,8176,8177,8178,8180,8181,8182,8183,8184,8185,8186,8187,8188,8189,8190,8191,8192,8193,8196,8197,8198,8200,8201,8202,8203,8204,8205,8206,8207,8208,8209,8210,8211,8213,8214,8215,8216,8217,8218,8219,8220,8222,8223,8224,8225,8226,8227,8229,8230,8231,8232,8233,8234,8235,8236,8237,8238,8239,8240,8241,8242,8244,8245,8246,8247,8248,8249,8250,8252,8253,8254,8255,8256,8257,8258,8259,8261,8262,8263,8264,8265,8266,8267,8268,8269,8270,8271,8272,8274,8275,8276,8277,8279,8280,8281,8282,8284,8285,8286,8287,8288,8289,8290,8291,8292,8293,8294,8295,8296,8297,8298,8299,8300,8301,8302,8303,8304,8305,8306,8308,8309,8310,8311,8312,8313,8314,8315,8316,8317,8318,8319,8320,8321,8322,8323,8324,8326,8327,8328,8329,8330,8331,8332,8333,8334,8336,8337,8339,8340,8341,8344,8345,8346,8347,8348,8349,8350,8352,8353,8354,8355,8356,8357,8358,8360,8361,8362,8363,8364,8365,8366,8367,8368,8369,8370,8371,8372,8374,8375,8376,8377,8378,8379,8380,8381,8383,8384,8385,8386,8387,8390,8391,8392,8393,8394,8395,8396,8397,8398,8399,8400,8401,8402,8403,8404,8405,8406,8407,8408,8409,8410,8411,8412,8413,8415,8416,8417,8418,8419,8420,8421,8422,8423,8424,8426,8427,8428,8429,8430,8431,8432,8433,8434,8435,8436,8437,8438,8439,8440,8441,8442,8443,8444,8445,8446,8447,8449,8450,8451,8452,8453,8454,8455,8456,8457,8459,8460,8461,8462,8463,8464,8465,8466,8467,8469,8470,8471,8472,8473,8474,8475,8476,8477,8478,8479,8480,8482,8483,8484,8485,8486,8487,8488,8489,8491,8492,8493,8494,8495,8497,8498,8499,8500,8502,8503,8504,8505,8506,8507,8508,8509,8510,8511,8512,8515,8516,8517,8518,8519,8520,8521,8522,8523,8524,8525,8526,8527,8529,8530,8531,8532,8533,8534,8536,8537,8538,8539,8540,8541,8542,8543,8544,8545,8546,8547,8549,8550,8551,8552,8553,8554,8555,8556,8557,8559,8560,8561,8562,8563,8564,8565,8566,8568,8569,8570,8571,8572,8573,8574,8575,8577,8578,8579,8580,8581,8582,8583,8584,8585,8586,8588,8589,8590,8591,8592,8593,8594,8596,8597,8598,8599,8600,8601,8602,8603,8604,8605,8606,8607,8608,8609,8610,8612,8613,8615,8616,8617,8618,8620,8622,8623,8624,8625,8626,8627,8628,8630,8631,8632,8633,8635,8636,8637,8638,8639,8640,8641,8642,8643,8644,8645,8646,8647,8648,8649,8650,8651,8652,8653,8654,8655,8656,8658,8659,8660,8661,8662,8663,8664,8665,8666,8667,8668,8669,8670,8672,8673,8674,8675,8676,8677,8678,8679,8680,8682,8683,8684,8685,8686,8687,8688,8689,8690,8692,8693,8694,8695,8696,8697,8698,8699,8700,8701,8702,8703,8704,8705,8706,8707,8708,8709,8710,8711,8712,8713,8714,8715,8716,8717,8718,8719,8720,8721,8722,8723,8724,8725,8726,8727,8728,8729,8732,8733,8734,8735,8736,8737,8739,8740,8741,8742,8743,8744,8745,8746,8747,8749,8750,8751,8753,8754,8755,8756,8757,8758,8759,8760,8761,8762,8766,8767,8768,8769,8770,8771,8773,8774,8775,8776,8777,8778,8779,8780,8781,8782,8783,8784,8785,8786,8787,8788,8789,8790,8791,8792,8793,8794,8796,8797,8799,8800,8801,8802,8803,8804,8805,8806,8807,8809,8810,8811,8812,8813,8814,8815,8816,8817,8819,8820,8821,8822,8823,8824,8825,8826,8827,8828,8829,8830,8831,8832,8833,8834,8835,8836,8837,8838,8839,8840,8841,8842,8843,8844,8846,8847,8848,8850,8852,8853,8854,8855,8856,8857,8860,8861,8862,8863,8864,8866,8867,8869,8870,8871,8872,8873,8874,8875,8876,8877,8878,8879,8880,8882,8883,8884,8885,8886,8887,8888,8889,8890,8891,8892,8893,8894,8896,8897,8898,8899,8900,8901,8902,8903,8904,8905,8906,8907,8908,8909,8910,8911,8912,8914,8915,8916,8917,8918,8919,8920,8922,8923,8924,8925,8926,8927,8928,8930,8931,8932,8933,8934,8935,8936,8937,8938,8939,8940,8941,8942,8943,8944,8945,8946,8947,8948,8949,8950,8952,8953,8954,8955,8956,8957,8958,8959,8960,8961,8962,8963,8964,8965,8966,8967,8968,8969,8970,8971,8972,8973,8974,8975,8976,8977,8979,8980,8981,8982,8984,8985,8986,8987,8988,8989,8990,8993,8994,8995,8996,8997,8998,9000,9001,9002,9003,9005,9006,9007,9008,9009,9010,9011,9012,9013,9014,9015,9017,9018,9019,9020,9021,9022,9023,9024,9025,9026,9027,9028,9029,9030,9031,9032,9033,9034,9035,9036,9039,9040,9041,9042,9043,9044,9045,9046,9047,9048,9049,9050,9051,9053,9054,9055,9056,9057,9058,9059,9061,9062,9063,9064,9065,9066,9067,9068,9069,9071,9072,9073,9074,9075,9076,9077,9078,9079,9081,9082,9083,9084,9085,9086,9087,9088,9089,9090,9091,9092,9093,9094,9096,9097,9098,9099,9100,9101,9102,9103,9104,9106,9107,9108,9109,9110,9111,9112,9113,9114,9115,9116,9117,9118,9119,9120,9121,9122,9123,9124,9125,9126,9127,9128,9129,9130,9131,9132,9133,9135,9136,9138,9139,9140,9141,9142,9143,9144,9145,9146,9147,9148,9149,9150,9151,9152,9153,9154,9155,9156,9157,9159,9160,9161,9163,9164,9165,9166,9168,9169,9170,9171,9172,9173,9175,9176,9177,9178,9180,9181,9182,9183,9184,9185,9186,9187,9188,9190,9191,9192,9193,9194,9195,9196,9197,9198,9200,9201,9202,9203,9204,9205,9206,9207,9208,9209,9210,9211,9212,9213,9214,9215,9216,9217,9218,9219,9222,9224,9225,9226,9227,9228,9229,9231,9232,9233,9234,9235,9237,9238,9240,9241,9242,9243,9245,9246,9247,9248,9249,9250,9251,9252,9253,9254,9255,9256,9257,9258,9259,9260,9261,9262,9263,9265,9266,9267,9268,9269,9270,9271,9272,9274,9275,9276,9277,9278,9279,9280,9282,9283,9284,9285,9286,9287,9288,9289,9290,9291,9292,9293,9294,9295,9298,9299,9300,9301,9302,9303,9304,9305,9306,9307,9308,9309,9312,9313,9314,9315,9316,9317,9318,9319,9320,9321,9322,9323,9324,9326,9327,9328,9329,9330,9331,9332,9333,9334,9335,9336,9337,9338,9340,9341,9342,9343,9344,9345,9346,9347,9348,9349,9350,9351,9353,9354,9355,9356,9357,9359,9360,9361,9362,9363,9364,9365,9366,9368,9369,9370,9371,9372,9373,9374,9375,9376,9378,9379,9380,9381,9382,9383,9384,9385,9386,9388,9389,9390,9391,9392,9393,9394,9395,9397,9398,9399,9400,9401,9402,9403,9404,9406,9407,9408,9409,9410,9411,9412,9413,9415,9416,9417,9418,9419,9420,9421,9422,9423,9424,9426,9427,9428,9429,9430,9431,9432,9433,9434,9435,9437,9438,9441,9442,9443,9444,9445,9446,9447,9448,9449,9450,9451,9452,9453,9454,9456,9458,9460,9461,9462,9463,9464,9465,9466,9467,9468,9469,9470,9471,9472,9473,9474,9475,9476,9477,9478,9479,9480,9481,9482,9483,9484,9485,9486,9487,9489,9490,9491,9492,9493,9494,9495,9496,9497,9499,9500,9501,9502,9503,9504,9505,9506,9507,9509,9510,9511,9512,9513,9514,9515,9516,9517,9518,9520,9521,9522,9523,9524,9525,9526,9529,9530,9531,9532,9533,9534,9535,9536,9537,9538,9539,9540,9541,9543,9544,9545,9546,9547,9548,9549,9550,9551,9553,9554,9555,9556,9557,9558,9559,9560,9561,9562,9563,9564,9565,9566,9567,9568,9569,9570,9571,9572,9573,9574,9575,9576,9577,9578,9579,9580,9581,9582,9583,9584,9586,9587,9588,9589,9590,9591,9592,9593,9594,9595,9596,9597,9598,9599,9600,9602,9603,9604,9605,9606,9607,9608,9609,9610,9612,9613,9614,9615,9616,9617,9618,9619,9620,9622,9623,9624,9625,9626,9627,9628,9629,9630,9632,9635,9636,9637,9638,9639,9640,9641,9642,9643,9644,9645,9646,9649,9650,9651,9652,9653,9654,9655,9656,9657,9658,9659,9660,9661,9662,9664,9665,9667,9668,9669,9670,9671,9672,9673,9674,9675,9676,9678,9679,9680,9681,9682,9683,9684,9685,9686,9689,9690,9691,9692,9693,9694,9695,9696,9697,9698,9699,9700,9701,9702,9703,9705,9706,9707,9708,9709,9710,9711,9712,9713,9715,9716,9717,9718,9719,9720,9721,9722,9723,9725,9726,9727,9728,9729,9730,9731,9732,9733,9734,9735,9736,9737,9738,9740,9741,9742,9743,9744,9745,9746,9747,9748,9749,9750,9751,9752,9754,9755,9756,9758,9759,9760,9762,9764,9765,9766,9767,9768,9769,9770,9771,9772,9773,9774,9775,9776,9777,9778,9779,9780,9781,9782,9783,9784,9785,9786,9787,9788,9789,9790,9792,9793,9794,9795,9796,9797,9798,9799,9802,9803,9804,9805,9806,9807,9808,9810,9811,9812,9813,9814,9815,9816,9817,9819,9820,9821,9822,9823,9824,9825,9827,9828,9829,9830,9831,9832,9833,9834,9835,9836,9837,9838,9839,9840,9841,9842,9843,9844,9845,9846,9847,9848,9849,9851,9852,9853,9854,9855,9856,9857,9858,9859,9860,9861,9862,9863,9864,9866,9867,9868,9869,9870,9871,9872,9873,9874,9875,9876,9877,9878,9880,9881,9882,9883,9884,9886,9887,9888,9889,9890,9891,9892,9893,9894,9895,9896,9898,9899,9900,9901,9903,9904,9905,9906,9907,9908,9909,9910,9912,9913,9914,9915,9916,9917,9918,9919,9920,9921,9922,9923,9924,9925,9926,9927,9928,9929,9931,9932,9933,9934,9935,9936,9937,9938,9940,9941,9942,9943,9944,9945,9946,9947,9949,9950,9953,9954,9955,9956,9957,9958,9959,9960,9961,9963,9965,9966,9967,9968,9969,9970,9971,9972,9973,9974,9975,9976,9977,9978,9979,9980,9981,9982,9984,9985,9986,9987,9988,9989,9990,9991,9992,9994,9995,9996,9997,9998,9999],"errors":9020}},{"run_id":"graph-fidelity-source-sd-s103","spec":{"run_id":"graph-fidelity-source-sd-s103","stage":"evaluate","cohort":"fidelity","variant":"source-sd","recipe":"sd_constant","pmax":0.4,"input_scale":1.0,"output_relu":true,"lr":0.001,"momentum":0.9,"shrinkage":2e-05,"seed":103,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"timeout_seconds":180,"gpu":"A100","precision":"fp32"},"history":[{"epoch":1,"stochastic_training_loss":4.973321437835693,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":0.6459317750000082,"epoch_training_seconds":0.6459317750000082,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":5,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":3.1679955200000336,"epoch_training_seconds":0.6303554049999889,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":10,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":6.314472395000024,"epoch_training_seconds":0.6232434129999831,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":15,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":9.46880626700002,"epoch_training_seconds":0.6318047849999857,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":20,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":12.611694828999987,"epoch_training_seconds":0.6315470099999914,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":25,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":15.764244777999977,"epoch_training_seconds":0.629984936999989,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":30,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":18.924664413999977,"epoch_training_seconds":0.6261483849999934,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":35,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":22.074443966999922,"epoch_training_seconds":0.6313326730000028,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":40,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":25.24033914499995,"epoch_training_seconds":0.6312903000000176,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":45,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":28.395924295999947,"epoch_training_seconds":0.6340018199999804,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":50,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":31.545037745999934,"epoch_training_seconds":0.6207405259999916,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":55,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":34.69589231799998,"epoch_training_seconds":0.6301157890000013,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":60,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":37.85857097799985,"epoch_training_seconds":0.6279163209999865,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":65,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":41.00672727199989,"epoch_training_seconds":0.6233858040000086,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":70,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":44.15065695799993,"epoch_training_seconds":0.6261598589999835,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":75,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":47.30313879499991,"epoch_training_seconds":0.6286848839999948,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":80,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":50.45366978099983,"epoch_training_seconds":0.633152511999981,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":85,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":53.63108203299984,"epoch_training_seconds":0.6292893329999742,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":90,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":56.775034775999785,"epoch_training_seconds":0.6280234099999689,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":95,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":59.93697137999979,"epoch_training_seconds":0.6284333199999992,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]},{"epoch":100,"stochastic_training_loss":2.3025853633880615,"dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"n":10000},"validation":{"loss":2.302585546875,"accuracy":0.1022,"n":10000},"training_seconds":63.083562527999646,"epoch_training_seconds":0.6277073300000211,"drop_probabilities":[0.1,0.2,0.30000000000000004,0.4],"zero_logit_fraction":1.0,"validation_probe_prediction_counts":[2048,0,0,0,0,0,0,0,0,0]}],"best_epoch":1,"best_validation_loss":2.302585546875,"training_seconds":63.083562527999646,"total_run_seconds":64.678102279,"hardware":{"device":"cuda:0","gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"initial_parameters_sha256":"316aa46c9e0a65fa375b579be0871a16f447d396fe64f85e2063ee6ef8c8dd5d","parameter_count":11972510,"steps_per_epoch":781,"skipped_batch_counts":[7857,15464,23550,31175],"final_train":{"loss":2.3025853125,"accuracy":0.09802,"n":50000},"selected_train":{"loss":2.3025853125,"accuracy":0.09802,"n":50000},"final_test":{"loss":2.302585546875,"accuracy":0.098,"n":10000,"wrong_indices":[0,1,2,4,5,6,7,8,9,11,12,14,15,16,17,18,19,20,21,22,23,24,26,27,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,56,57,58,59,60,61,62,63,64,65,66,67,68,70,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,127,128,129,130,131,132,133,134,135,137,138,139,140,141,142,143,144,145,146,147,149,150,151,152,153,154,155,156,158,159,160,161,162,163,164,165,166,167,168,169,170,171,172,173,174,175,176,177,178,179,180,181,182,184,185,186,187,189,190,191,193,195,196,197,198,199,200,201,202,203,204,205,206,207,208,209,210,211,212,213,214,216,217,218,219,220,221,222,223,224,225,226,227,228,229,230,231,232,233,234,235,236,237,238,239,240,241,242,243,244,245,247,248,249,250,251,252,253,254,255,256,257,258,259,260,261,262,263,264,265,266,267,268,270,272,273,274,275,276,277,278,279,280,281,282,283,284,285,286,287,288,289,290,291,292,293,295,298,299,300,301,302,303,304,306,307,308,309,310,313,314,315,316,317,318,319,320,321,322,323,325,326,328,329,330,331,332,333,334,335,336,337,338,339,340,341,342,343,344,345,347,348,349,350,351,352,353,354,355,356,357,358,359,360,361,362,363,364,366,367,368,369,370,371,373,374,375,376,377,378,379,381,382,383,384,385,386,387,388,389,390,391,392,393,394,395,396,397,398,399,400,401,402,403,404,405,406,408,409,410,411,412,413,414,415,416,417,418,419,420,421,422,423,425,426,427,428,429,430,431,432,433,434,435,436,437,438,439,442,444,445,446,447,448,449,450,451,452,453,454,455,456,457,458,460,461,462,463,464,465,466,467,468,469,470,471,472,473,474,475,476,477,478,479,480,481,482,483,484,486,487,488,489,491,492,493,494,495,496,497,499,500,501,502,503,504,505,506,507,508,509,510,511,512,513,514,515,516,517,518,519,520,521,522,523,524,526,527,528,529,530,531,532,533,534,535,536,537,538,539,540,541,542,543,544,547,548,549,550,551,553,554,555,556,557,558,559,560,562,563,565,566,568,569,570,571,572,573,574,575,576,577,578,579,580,582,583,584,585,587,588,589,590,591,593,594,595,596,598,599,600,601,602,603,604,605,606,607,609,610,612,613,614,615,616,617,618,619,621,622,623,624,625,626,627,628,629,630,631,632,633,634,635,636,637,638,639,640,641,643,645,646,647,648,649,650,651,652,653,654,655,657,658,659,660,662,663,664,665,666,667,668,669,670,671,672,673,674,675,676,677,678,679,680,681,682,683,684,685,686,687,688,689,690,691,692,693,694,695,696,697,698,699,700,702,703,705,706,707,708,709,710,711,712,714,715,716,718,719,720,722,724,725,726,727,728,729,730,731,732,733,734,735,736,737,738,739,740,741,743,744,745,746,747,748,749,751,752,753,754,755,756,757,758,759,760,761,762,764,765,766,767,768,769,770,771,772,773,774,775,776,777,778,779,780,781,782,783,784,785,786,787,788,789,790,791,792,793,795,796,797,798,799,800,801,802,803,805,806,807,808,809,810,811,812,813,814,815,816,817,818,819,820,822,823,824,825,826,827,828,829,830,831,832,833,834,835,836,837,838,839,840,841,842,843,844,846,847,848,849,850,852,853,855,856,857,858,859,860,861,862,863,864,865,866,867,868,869,870,872,873,874,875,876,877,878,879,880,881,882,883,885,886,887,888,889,890,891,892,893,894,897,898,899,900,901,902,903,905,906,907,908,909,910,911,912,913,914,915,916,917,918,919,920,921,922,923,924,925,926,927,928,929,930,931,933,934,935,936,937,938,939,940,941,942,943,944,945,946,947,948,949,950,951,952,953,954,955,956,957,958,959,960,961,962,963,964,965,966,967,968,969,970,971,973,974,975,976,977,978,979,980,982,983,984,985,986,987,988,989,990,991,992,994,995,996,998,999,1000,1002,1003,1004,1005,1006,1007,1008,1010,1011,1012,1013,1014,1015,1016,1017,1018,1019,1020,1021,1022,1023,1024,1025,1026,1027,1028,1029,1030,1031,1032,1033,1035,1036,1037,1038,1039,1040,1041,1042,1043,1044,1045,1046,1048,1049,1050,1051,1052,1053,1054,1055,1056,1057,1058,1059,1060,1062,1063,1064,1065,1066,1067,1068,1069,1070,1071,1072,1073,1074,1075,1076,1077,1078,1079,1080,1081,1082,1083,1085,1086,1087,1088,1089,1090,1091,1092,1093,1095,1096,1097,1098,1099,1100,1101,1102,1103,1104,1105,1106,1107,1108,1109,1110,1111,1112,1113,1114,1115,1116,1117,1118,1119,1120,1122,1123,1124,1125,1126,1127,1128,1129,1130,1131,1132,1133,1134,1135,1136,1137,1138,1139,1140,1141,1142,1143,1144,1145,1146,1147,1149,1150,1151,1152,1153,1155,1156,1157,1158,1159,1160,1161,1162,1163,1164,1165,1166,1167,1168,1169,1170,1171,1172,1173,1174,1175,1177,1178,1179,1180,1181,1182,1183,1184,1185,1186,1187,1189,1190,1192,1193,1194,1196,1198,1199,1200,1201,1202,1204,1205,1206,1207,1208,1209,1210,1211,1212,1213,1214,1215,1216,1217,1219,1221,1222,1224,1225,1226,1227,1228,1229,1230,1232,1233,1234,1235,1236,1237,1238,1239,1240,1241,1242,1243,1244,1245,1247,1248,1249,1250,1251,1252,1253,1254,1255,1256,1257,1258,1259,1260,1262,1263,1264,1265,1266,1267,1268,1269,1270,1272,1274,1275,1276,1277,1278,1279,1280,1281,1282,1283,1284,1285,1286,1287,1289,1290,1291,1292,1293,1295,1296,1298,1299,1300,1301,1302,1303,1304,1305,1306,1307,1308,1309,1310,1311,1312,1313,1314,1315,1316,1317,1318,1319,1320,1321,1322,1323,1324,1325,1326,1327,1328,1329,1330,1331,1332,1334,1335,1336,1337,1338,1339,1340,1341,1342,1343,1344,1345,1346,1347,1348,1349,1350,1351,1352,1353,1354,1355,1356,1357,1358,1359,1360,1361,1362,1363,1364,1365,1366,1367,1368,1369,1370,1371,1372,1373,1374,1375,1376,1377,1378,1380,1381,1382,1383,1384,1385,1386,1387,1388,1389,1391,1392,1393,1394,1395,1396,1397,1398,1400,1401,1402,1403,1405,1406,1407,1409,1410,1412,1413,1414,1415,1417,1418,1419,1420,1421,1422,1423,1424,1425,1426,1427,1428,1429,1430,1431,1432,1433,1434,1435,1436,1437,1439,1440,1441,1442,1443,1444,1446,1447,1448,1449,1450,1451,1452,1453,1455,1456,1458,1459,1460,1461,1462,1463,1464,1465,1466,1467,1469,1470,1471,1472,1473,1474,1475,1476,1477,1478,1479,1480,1481,1482,1483,1484,1485,1486,1488,1489,1490,1491,1492,1493,1494,1495,1496,1497,1498,1499,1500,1501,1502,1503,1505,1506,1507,1508,1509,1510,1511,1512,1513,1514,1515,1516,1518,1519,1520,1521,1522,1523,1524,1525,1527,1528,1529,1530,1531,1532,1536,1537,1538,1539,1540,1541,1542,1543,1544,1545,1546,1547,1548,1549,1550,1551,1552,1553,1554,1555,1556,1557,1559,1560,1561,1562,1563,1564,1566,1567,1568,1569,1571,1572,1573,1574,1575,1576,1577,1578,1579,1580,1581,1582,1583,1584,1585,1586,1587,1588,1591,1592,1593,1594,1595,1596,1597,1598,1599,1600,1601,1602,1603,1604,1605,1606,1607,1608,1609,1611,1612,1613,1614,1615,1616,1617,1618,1620,1622,1624,1625,1626,1627,1628,1629,1630,1631,1632,1633,1634,1635,1636,1637,1639,1640,1641,1642,1643,1644,1645,1646,1647,1648,1649,1651,1652,1653,1654,1655,1656,1657,1658,1659,1660,1661,1662,1663,1664,1665,1666,1667,1668,1669,1670,1671,1672,1673,1674,1675,1676,1677,1678,1679,1680,1681,1682,1683,1684,1685,1686,1687,1688,1689,1690,1691,1693,1694,1695,1696,1697,1698,1699,1701,1702,1703,1704,1705,1706,1707,1709,1710,1711,1714,1715,1716,1717,1718,1719,1720,1721,1722,1724,1725,1727,1728,1729,1730,1731,1732,1733,1734,1735,1736,1737,1738,1740,1741,1742,1743,1744,1745,1746,1747,1749,1750,1751,1752,1753,1754,1755,1756,1758,1759,1760,1761,1763,1765,1766,1767,1769,1770,1771,1772,1773,1774,1776,1778,1779,1780,1781,1782,1783,1784,1785,1786,1787,1788,1789,1790,1791,1792,1793,1795,1797,1798,1799,1800,1801,1802,1803,1804,1805,1806,1809,1810,1811,1812,1813,1814,1815,1816,1817,1818,1819,1820,1821,1822,1823,1824,1825,1827,1828,1829,1830,1831,1832,1833,1834,1835,1836,1837,1838,1839,1840,1842,1844,1845,1846,1847,1848,1849,1850,1851,1852,1853,1854,1855,1856,1857,1858,1859,1860,1861,1862,1863,1864,1865,1866,1867,1868,1869,1871,1872,1873,1874,1875,1876,1877,1878,1879,1880,1881,1882,1883,1884,1885,1886,1887,1888,1889,1890,1891,1893,1894,1895,1896,1897,1899,1900,1901,1902,1903,1904,1905,1906,1908,1909,1910,1911,1912,1913,1914,1915,1916,1917,1919,1920,1921,1922,1923,1924,1925,1926,1927,1928,1929,1930,1931,1932,1933,1934,1935,1936,1937,1938,1939,1940,1941,1942,1943,1945,1946,1947,1948,1949,1950,1951,1952,1953,1954,1955,1956,1957,1958,1960,1961,1962,1963,1964,1965,1966,1967,1968,1969,1970,1971,1973,1974,1975,1976,1977,1978,1979,1980,1981,1982,1983,1984,1985,1986,1988,1989,1990,1991,1992,1993,1994,1996,1997,1998,1999,2000,2001,2002,2003,2004,2005,2006,2007,2008,2009,2010,2011,2012,2013,2014,2015,2016,2017,2018,2019,2020,2021,2022,2024,2025,2026,2027,2028,2029,2030,2031,2032,2034,2035,2036,2037,2038,2039,2040,2041,2043,2044,2045,2046,2047,2048,2049,2050,2051,2052,2053,2054,2055,2056,2057,2058,2059,2062,2063,2064,2065,2066,2068,2069,2070,2071,2072,2073,2074,2075,2076,2077,2078,2079,2080,2082,2083,2084,2085,2086,2088,2089,2090,2091,2092,2093,2094,2095,2097,2098,2099,2100,2101,2102,2103,2104,2105,2107,2108,2109,2110,2111,2112,2113,2114,2115,2116,2117,2118,2119,2120,2121,2122,2123,2124,2125,2126,2128,2129,2130,2131,2132,2133,2134,2135,2136,2137,2138,2139,2140,2141,2142,2143,2144,2145,2146,2147,2148,2149,2150,2151,2152,2153,2154,2156,2157,2158,2159,2160,2161,2162,2163,2164,2165,2166,2167,2168,2169,2170,2171,2172,2173,2174,2175,2176,2177,2179,2180,2181,2182,2183,2184,2186,2187,2189,2191,2192,2193,2194,2195,2196,2197,2198,2199,2200,2201,2202,2203,2205,2206,2207,2208,2210,2211,2212,2213,2214,2215,2216,2218,2219,2220,2221,2222,2223,2224,2225,2227,2228,2229,2230,2231,2232,2233,2234,2235,2237,2238,2239,2240,2241,2242,2243,2244,2245,2246,2247,2248,2249,2250,2251,2252,2253,2254,2255,2256,2257,2258,2259,2260,2261,2262,2263,2264,2265,2266,2267,2268,2269,2270,2271,2272,2273,2274,2275,2276,2277,2278,2279,2280,2281,2282,2283,2284,2285,2286,2287,2288,2289,2290,2291,2292,2293,2296,2297,2298,2299,2300,2301,2302,2303,2305,2306,2307,2308,2309,2310,2311,2312,2313,2314,2315,2316,2317,2319,2320,2321,2322,2323,2324,2325,2327,2330,2331,2332,2334,2335,2336,2337,2338,2339,2340,2341,2342,2343,2344,2345,2346,2347,2348,2349,2350,2351,2352,2353,2354,2355,2356,2357,2358,2359,2360,2361,2362,2363,2364,2365,2366,2367,2368,2369,2371,2372,2373,2374,2375,2377,2379,2380,2381,2382,2383,2386,2387,2388,2389,2390,2391,2392,2393,2394,2395,2396,2397,2398,2399,2400,2401,2402,2404,2405,2406,2407,2408,2409,2411,2412,2413,2414,2415,2416,2418,2419,2420,2421,2422,2423,2424,2425,2426,2427,2428,2429,2430,2431,2432,2433,2434,2436,2437,2438,2439,2440,2441,2442,2443,2444,2445,2446,2447,2448,2450,2451,2452,2453,2454,2456,2457,2458,2459,2460,2462,2463,2464,2465,2466,2467,2468,2469,2470,2471,2472,2473,2474,2475,2476,2477,2478,2480,2481,2482,2483,2484,2486,2487,2488,2489,2490,2491,2493,2494,2495,2496,2497,2498,2499,2500,2501,2502,2503,2504,2505,2507,2508,2509,2510,2511,2512,2513,2514,2515,2516,2517,2518,2519,2520,2521,2522,2523,2524,2525,2526,2528,2529,2530,2532,2533,2534,2535,2537,2538,2539,2540,2541,2542,2543,2544,2545,2546,2547,2548,2549,2550,2551,2552,2553,2554,2555,2556,2558,2559,2560,2561,2562,2563,2564,2565,2566,2567,2569,2570,2572,2573,2574,2575,2576,2577,2578,2579,2580,2581,2582,2583,2584,2585,2586,2587,2588,2589,2590,2591,2594,2595,2596,2597,2598,2599,2600,2601,2602,2603,2604,2605,2606,2607,2608,2609,2610,2611,2612,2613,2614,2615,2616,2617,2618,2620,2621,2622,2623,2624,2625,2626,2628,2629,2630,2632,2633,2634,2635,2636,2637,2639,2640,2642,2643,2644,2645,2646,2647,2648,2650,2651,2652,2653,2654,2655,2658,2659,2661,2662,2663,2664,2665,2666,2667,2668,2669,2670,2671,2672,2673,2674,2675,2676,2677,2678,2679,2680,2681,2682,2683,2684,2685,2686,2688,2689,2690,2691,2692,2693,2694,2695,2696,2697,2698,2699,2700,2701,2702,2704,2705,2706,2708,2709,2710,2711,2712,2715,2716,2718,2719,2720,2721,2722,2723,2724,2725,2726,2727,2728,2729,2730,2731,2732,2734,2735,2736,2737,2738,2739,2740,2741,2742,2743,2744,2745,2746,2749,2750,2751,2752,2753,2754,2755,2756,2757,2758,2759,2760,2762,2766,2767,2768,2769,2770,2771,2772,2773,2774,2775,2776,2778,2780,2781,2782,2783,2784,2785,2786,2787,2788,2789,2790,2791,2792,2793,2795,2796,2797,2798,2799,2800,2801,2802,2803,2804,2805,2806,2807,2808,2809,2810,2812,2813,2814,2815,2816,2818,2819,2820,2822,2823,2825,2826,2827,2828,2829,2830,2831,2832,2833,2834,2835,2836,2837,2838,2839,2840,2841,2843,2844,2845,2846,2847,2848,2849,2850,2851,2852,2853,2854,2855,2856,2857,2858,2859,2860,2861,2862,2863,2864,2865,2866,2867,2868,2869,2870,2871,2872,2874,2875,2876,2877,2878,2879,2880,2881,2882,2883,2884,2885,2886,2887,2888,2889,2890,2891,2892,2893,2895,2896,2897,2898,2900,2901,2902,2903,2904,2905,2906,2907,2908,2909,2910,2911,2912,2913,2914,2915,2916,2917,2918,2919,2920,2921,2922,2923,2924,2925,2926,2927,2928,2929,2930,2931,2933,2934,2935,2936,2938,2939,2940,2941,2943,2945,2946,2947,2948,2949,2950,2951,2952,2953,2955,2956,2957,2958,2959,2960,2961,2963,2964,2965,2966,2967,2968,2969,2970,2971,2973,2974,2975,2976,2977,2978,2979,2980,2981,2982,2983,2984,2985,2986,2987,2989,2990,2991,2992,2993,2994,2995,2997,2998,3000,3001,3002,3003,3004,3005,3006,3007,3008,3009,3010,3011,3012,3014,3015,3017,3018,3019,3021,3022,3023,3024,3025,3026,3027,3028,3029,3030,3031,3033,3034,3035,3036,3037,3038,3039,3040,3041,3042,3045,3046,3047,3048,3049,3050,3051,3053,3054,3055,3056,3057,3058,3059,3060,3061,3062,3063,3064,3065,3066,3067,3068,3069,3070,3071,3072,3073,3074,3075,3076,3078,3079,3080,3081,3082,3083,3084,3085,3086,3088,3089,3091,3092,3093,3094,3095,3096,3097,3098,3099,3100,3101,3102,3103,3104,3105,3106,3107,3108,3109,3110,3111,3112,3113,3114,3115,3116,3117,3118,3119,3120,3121,3122,3123,3124,3125,3126,3127,3128,3129,3130,3131,3132,3133,3134,3135,3136,3137,3138,3139,3141,3142,3143,3144,3145,3146,3147,3148,3149,3150,3151,3152,3153,3154,3155,3156,3157,3158,3159,3160,3161,3162,3163,3164,3165,3166,3167,3168,3169,3171,3172,3173,3174,3175,3176,3177,3180,3181,3182,3183,3184,3186,3187,3188,3189,3190,3192,3193,3194,3195,3196,3197,3198,3199,3200,3201,3202,3203,3204,3205,3206,3207,3208,3209,3211,3212,3213,3214,3216,3217,3218,3220,3221,3222,3223,3224,3225,3227,3228,3229,3230,3231,3232,3233,3234,3235,3236,3237,3238,3239,3240,3241,3244,3245,3246,3247,3248,3249,3250,3252,3253,3254,3255,3256,3257,3258,3259,3260,3261,3262,3263,3264,3267,3268,3269,3270,3272,3273,3274,3275,3276,3277,3278,3279,3280,3281,3282,3283,3284,3285,3286,3287,3288,3289,3290,3291,3292,3293,3294,3295,3296,3298,3299,3300,3301,3302,3303,3304,3307,3308,3309,3311,3312,3313,3314,3316,3318,3319,3320,3321,3323,3324,3326,3327,3328,3329,3330,3331,3332,3333,3334,3335,3336,3337,3338,3339,3340,3341,3342,3343,3344,3345,3348,3349,3350,3351,3352,3353,3354,3355,3356,3357,3360,3361,3362,3363,3364,3365,3366,3367,3369,3370,3372,3373,3374,3375,3376,3377,3378,3379,3380,3381,3382,3383,3384,3385,3386,3387,3388,3389,3390,3391,3392,3393,3394,3395,3396,3397,3398,3399,3400,3402,3403,3404,3405,3406,3407,3408,3409,3410,3411,3414,3415,3416,3418,3419,3420,3421,3422,3423,3424,3425,3426,3427,3428,3429,3430,3431,3432,3433,3434,3435,3436,3437,3438,3440,3441,3442,3443,3444,3447,3448,3449,3451,3452,3453,3454,3455,3456,3457,3459,3460,3461,3462,3463,3464,3465,3466,3467,3468,3469,3470,3471,3472,3473,3474,3475,3476,3477,3478,3480,3482,3483,3484,3485,3486,3487,3488,3489,3490,3491,3492,3493,3494,3495,3497,3498,3499,3500,3501,3502,3503,3504,3505,3506,3507,3508,3509,3510,3511,3513,3514,3515,3516,3517,3518,3519,3520,3521,3522,3523,3524,3525,3526,3527,3528,3529,3530,3531,3532,3533,3534,3535,3537,3538,3539,3541,3542,3543,3544,3545,3546,3547,3548,3549,3550,3551,3552,3553,3554,3555,3556,3557,3558,3559,3560,3561,3562,3563,3564,3565,3566,3567,3568,3569,3570,3571,3572,3573,3575,3576,3577,3578,3579,3580,3582,3583,3585,3586,3587,3588,3589,3590,3591,3592,3593,3594,3595,3596,3597,3598,3599,3600,3601,3602,3603,3604,3605,3606,3607,3609,3610,3611,3612,3614,3615,3616,3617,3618,3619,3620,3621,3622,3623,3625,3626,3627,3628,3629,3630,3631,3632,3633,3635,3636,3637,3638,3639,3641,3642,3643,3644,3645,3647,3648,3649,3651,3652,3653,3654,3655,3656,3657,3658,3659,3661,3662,3663,3664,3665,3666,3667,3668,3669,3670,3671,3672,3673,3674,3675,3676,3678,3679,3681,3682,3683,3684,3685,3686,3687,3688,3689,3690,3691,3692,3693,3694,3696,3697,3699,3700,3701,3702,3703,3704,3705,3707,3708,3709,3711,3712,3713,3714,3715,3716,3717,3718,3719,3720,3721,3722,3723,3725,3726,3727,3728,3729,3730,3731,3732,3733,3736,3737,3738,3739,3740,3741,3742,3743,3744,3745,3746,3747,3748,3749,3750,3751,3752,3753,3754,3755,3756,3757,3758,3759,3760,3761,3762,3763,3765,3766,3767,3769,3770,3771,3772,3773,3775,3776,3777,3778,3779,3780,3781,3782,3783,3784,3785,3786,3787,3788,3789,3791,3792,3793,3794,3795,3796,3797,3798,3799,3800,3801,3802,3806,3807,3808,3809,3810,3811,3812,3813,3814,3815,3816,3817,3819,3820,3821,3822,3823,3824,3825,3826,3827,3828,3829,3831,3832,3833,3834,3835,3836,3837,3838,3839,3840,3841,3842,3843,3844,3845,3846,3848,3850,3851,3852,3853,3854,3855,3856,3857,3858,3859,3860,3861,3862,3863,3865,3866,3868,3869,3871,3872,3873,3874,3875,3876,3877,3878,3879,3880,3881,3882,3884,3885,3886,3887,3888,3889,3890,3891,3892,3893,3894,3896,3897,3898,3899,3900,3901,3902,3904,3905,3906,3907,3908,3909,3910,3912,3913,3914,3915,3916,3917,3918,3919,3920,3921,3922,3923,3924,3925,3926,3927,3928,3929,3930,3931,3932,3933,3934,3935,3936,3937,3938,3939,3941,3943,3944,3945,3946,3947,3948,3949,3950,3951,3952,3953,3954,3955,3956,3957,3958,3960,3961,3962,3963,3964,3965,3966,3967,3968,3969,3970,3971,3972,3973,3974,3975,3976,3977,3978,3979,3981,3983,3984,3985,3986,3987,3988,3990,3991,3992,3993,3994,3995,3996,3997,3998,3999,4000,4001,4002,4003,4004,4005,4006,4007,4008,4009,4010,4011,4012,4013,4014,4015,4016,4017,4018,4019,4020,4021,4022,4024,4025,4026,4027,4028,4029,4030,4031,4032,4035,4036,4037,4038,4039,4040,4041,4042,4044,4045,4046,4047,4049,4050,4051,4052,4053,4054,4055,4056,4057,4058,4059,4060,4061,4063,4064,4066,4067,4068,4069,4071,4072,4073,4074,4075,4076,4077,4078,4081,4083,4084,4085,4086,4087,4088,4089,4092,4093,4094,4095,4096,4097,4098,4099,4100,4101,4102,4103,4104,4105,4106,4107,4108,4109,4110,4111,4112,4113,4114,4115,4116,4117,4118,4119,4120,4121,4122,4123,4124,4125,4126,4127,4128,4129,4130,4131,4132,4133,4134,4135,4136,4137,4138,4139,4140,4141,4142,4143,4144,4145,4147,4148,4149,4151,4152,4153,4154,4156,4158,4159,4160,4161,4162,4163,4164,4165,4167,4168,4169,4170,4171,4172,4173,4174,4175,4176,4177,4178,4179,4180,4181,4182,4183,4184,4185,4187,4189,4190,4191,4192,4193,4194,4195,4196,4197,4198,4199,4200,4201,4202,4203,4204,4205,4206,4207,4209,4210,4211,4212,4213,4214,4215,4216,4217,4218,4219,4220,4221,4222,4223,4224,4225,4226,4228,4229,4230,4231,4232,4233,4234,4235,4236,4237,4238,4239,4240,4242,4243,4244,4245,4246,4247,4248,4249,4250,4251,4252,4253,4254,4255,4256,4257,4258,4259,4260,4261,4262,4263,4264,4265,4266,4267,4268,4269,4270,4271,4272,4273,4274,4275,4276,4277,4279,4280,4283,4284,4285,4287,4288,4289,4290,4291,4292,4293,4294,4295,4296,4297,4298,4299,4300,4301,4302,4303,4304,4305,4306,4307,4308,4309,4310,4311,4312,4313,4314,4315,4316,4317,4318,4319,4321,4322,4323,4324,4325,4326,4328,4330,4331,4332,4333,4334,4335,4336,4337,4338,4339,4340,4341,4342,4344,4345,4346,4347,4349,4350,4352,4354,4355,4356,4357,4358,4359,4360,4362,4363,4364,4366,4367,4368,4369,4371,4372,4373,4374,4375,4376,4377,4378,4379,4380,4381,4382,4383,4384,4385,4386,4387,4388,4389,4390,4391,4393,4394,4395,4396,4397,4398,4399,4400,4401,4402,4405,4406,4407,4408,4409,4410,4411,4412,4413,4414,4415,4416,4417,4418,4419,4420,4421,4422,4423,4424,4425,4426,4427,4428,4429,4430,4431,4433,4434,4435,4436,4437,4438,4439,4440,4441,4442,4443,4444,4445,4446,4449,4450,4451,4452,4453,4454,4455,4456,4458,4459,4460,4461,4463,4464,4465,4466,4467,4468,4469,4471,4472,4474,4475,4476,4478,4479,4480,4481,4482,4483,4484,4485,4486,4487,4488,4489,4490,4491,4492,4493,4494,4496,4497,4498,4499,4500,4501,4502,4503,4504,4505,4506,4507,4508,4509,4510,4511,4512,4513,4514,4516,4517,4518,4519,4520,4521,4522,4523,4524,4525,4526,4528,4529,4530,4532,4533,4534,4535,4536,4537,4538,4539,4540,4541,4543,4544,4545,4546,4547,4548,4549,4550,4551,4552,4553,4555,4556,4557,4558,4559,4560,4561,4562,4563,4564,4565,4566,4567,4568,4569,4570,4571,4572,4573,4574,4575,4576,4577,4578,4579,4580,4581,4582,4583,4584,4585,4586,4587,4588,4589,4590,4591,4592,4593,4594,4595,4596,4597,4598,4599,4600,4601,4602,4603,4605,4606,4607,4608,4609,4610,4612,4613,4615,4616,4618,4619,4620,4621,4622,4623,4624,4625,4626,4627,4629,4630,4632,4633,4634,4635,4636,4637,4638,4639,4640,4643,4644,4645,4646,4647,4648,4649,4651,4652,4653,4654,4655,4656,4657,4658,4659,4660,4661,4662,4663,4664,4665,4666,4667,4668,4669,4670,4671,4673,4674,4676,4677,4678,4679,4680,4681,4682,4683,4684,4685,4686,4687,4688,4689,4690,4691,4692,4693,4694,4695,4696,4697,4698,4699,4700,4701,4702,4703,4704,4705,4706,4707,4708,4709,4710,4711,4712,4713,4714,4715,4716,4717,4719,4721,4722,4723,4724,4725,4726,4727,4728,4729,4730,4731,4732,4733,4734,4735,4736,4737,4738,4740,4742,4743,4744,4745,4746,4747,4748,4749,4750,4751,4752,4753,4754,4755,4756,4758,4759,4760,4761,4762,4763,4764,4765,4766,4767,4768,4769,4770,4771,4772,4773,4774,4775,4777,4778,4779,4781,4782,4783,4784,4785,4786,4787,4789,4790,4791,4792,4793,4794,4795,4796,4797,4798,4799,4800,4801,4802,4803,4805,4806,4807,4808,4809,4810,4811,4812,4813,4814,4815,4816,4817,4818,4820,4821,4822,4823,4825,4826,4827,4828,4829,4830,4831,4832,4833,4835,4836,4837,4838,4839,4840,4841,4842,4843,4844,4845,4846,4847,4848,4849,4850,4851,4852,4853,4854,4855,4856,4858,4859,4860,4861,4863,4864,4865,4866,4867,4868,4869,4870,4871,4872,4873,4874,4875,4876,4877,4878,4879,4881,4882,4883,4884,4885,4886,4888,4889,4890,4892,4893,4894,4895,4896,4897,4898,4899,4900,4901,4902,4903,4904,4905,4906,4907,4908,4909,4910,4911,4912,4913,4914,4915,4916,4917,4918,4919,4920,4921,4922,4924,4925,4926,4927,4928,4929,4930,4931,4932,4933,4934,4936,4938,4939,4940,4941,4942,4943,4944,4945,4946,4947,4948,4949,4950,4951,4952,4953,4954,4955,4956,4960,4961,4962,4963,4964,4965,4966,4967,4968,4969,4970,4971,4972,4973,4974,4975,4976,4977,4978,4979,4980,4981,4982,4983,4984,4985,4986,4987,4988,4989,4990,4991,4993,4994,4995,4996,4997,4998,5000,5001,5002,5003,5004,5005,5007,5009,5010,5011,5012,5013,5014,5015,5016,5017,5018,5019,5020,5021,5022,5023,5024,5025,5026,5027,5028,5029,5030,5032,5034,5036,5037,5038,5039,5040,5041,5042,5044,5045,5046,5047,5048,5049,5050,5052,5053,5054,5055,5056,5057,5058,5059,5060,5061,5062,5063,5064,5065,5066,5067,5068,5070,5071,5072,5073,5074,5075,5076,5077,5078,5080,5081,5082,5083,5084,5085,5086,5088,5089,5090,5091,5092,5093,5094,5095,5096,5097,5098,5099,5100,5101,5102,5103,5104,5105,5106,5107,5110,5111,5112,5113,5114,5115,5116,5117,5118,5119,5120,5121,5122,5123,5125,5126,5127,5128,5129,5130,5131,5132,5134,5135,5136,5137,5138,5140,5142,5143,5144,5145,5146,5148,5149,5150,5151,5152,5153,5154,5156,5157,5158,5159,5160,5161,5162,5163,5164,5166,5167,5168,5169,5170,5171,5172,5173,5174,5175,5176,5177,5178,5179,5180,5181,5182,5183,5184,5185,5186,5187,5188,5189,5190,5191,5192,5193,5194,5195,5196,5197,5198,5199,5200,5201,5202,5203,5204,5205,5206,5207,5208,5209,5210,5211,5212,5213,5214,5215,5216,5217,5218,5219,5220,5221,5222,5223,5224,5225,5226,5227,5228,5229,5230,5231,5232,5233,5234,5235,5236,5237,5238,5239,5240,5242,5245,5246,5247,5248,5250,5252,5254,5256,5258,5260,5261,5262,5263,5264,5265,5266,5267,5268,5269,5271,5272,5273,5274,5275,5276,5277,5278,5279,5281,5282,5283,5284,5285,5286,5287,5288,5289,5291,5292,5293,5294,5295,5296,5297,5298,5299,5300,5302,5303,5304,5306,5308,5309,5310,5311,5312,5313,5314,5315,5316,5317,5318,5319,5322,5323,5324,5325,5326,5327,5328,5329,5330,5331,5332,5333,5334,5335,5336,5338,5339,5340,5341,5343,5344,5345,5346,5347,5348,5349,5350,5351,5352,5354,5355,5356,5357,5358,5359,5360,5361,5362,5363,5364,5365,5366,5367,5370,5371,5372,5373,5374,5375,5376,5377,5378,5379,5380,5381,5382,5383,5384,5385,5386,5387,5388,5389,5390,5391,5392,5393,5394,5395,5396,5397,5399,5400,5401,5402,5403,5404,5406,5407,5408,5409,5410,5411,5412,5413,5414,5416,5417,5418,5419,5420,5421,5422,5423,5424,5425,5426,5427,5429,5431,5432,5433,5434,5436,5437,5438,5439,5440,5441,5442,5444,5445,5446,5447,5448,5449,5451,5453,5454,5455,5456,5457,5458,5460,5461,5462,5464,5465,5466,5467,5468,5469,5471,5472,5473,5474,5475,5476,5477,5478,5479,5480,5481,5482,5484,5485,5486,5487,5488,5489,5490,5491,5492,5493,5494,5495,5496,5497,5498,5499,5500,5501,5502,5503,5504,5506,5507,5508,5509,5510,5511,5512,5514,5515,5516,5517,5518,5520,5521,5522,5523,5524,5525,5527,5528,5530,5532,5533,5534,5535,5536,5537,5538,5539,5540,5541,5542,5543,5544,5545,5546,5547,5548,5549,5550,5551,5552,5553,5555,5556,5557,5558,5559,5560,5561,5562,5563,5564,5565,5566,5568,5569,5570,5571,5572,5573,5574,5575,5576,5577,5578,5579,5580,5581,5582,5583,5585,5586,5587,5588,5589,5590,5591,5594,5595,5596,5597,5598,5599,5600,5601,5602,5604,5605,5606,5607,5608,5609,5610,5611,5612,5614,5615,5616,5617,5618,5619,5620,5621,5622,5623,5624,5625,5626,5627,5628,5629,5630,5631,5632,5633,5634,5635,5636,5637,5638,5639,5640,5641,5642,5643,5644,5645,5646,5647,5648,5649,5650,5651,5654,5655,5656,5657,5658,5660,5661,5662,5663,5664,5665,5666,5667,5668,5670,5671,5672,5674,5675,5676,5677,5678,5679,5680,5681,5682,5683,5687,5688,5689,5690,5691,5692,5693,5694,5696,5697,5698,5699,5700,5701,5702,5703,5704,5705,5706,5707,5708,5709,5710,5711,5712,5713,5714,5715,5716,5717,5719,5720,5722,5723,5724,5725,5726,5727,5728,5729,5730,5732,5733,5734,5735,5736,5738,5739,5740,5741,5742,5743,5744,5745,5746,5747,5748,5749,5751,5752,5753,5754,5755,5757,5758,5759,5760,5761,5762,5763,5764,5765,5766,5767,5768,5769,5770,5771,5772,5773,5774,5775,5776,5777,5779,5780,5781,5782,5783,5784,5785,5786,5787,5788,5789,5790,5792,5793,5794,5795,5796,5797,5798,5799,5800,5801,5802,5803,5804,5805,5807,5808,5809,5810,5811,5813,5814,5815,5816,5817,5819,5820,5821,5822,5823,5824,5825,5826,5829,5831,5832,5833,5834,5835,5836,5837,5839,5840,5841,5842,5843,5844,5845,5846,5848,5849,5850,5851,5852,5853,5854,5855,5856,5857,5858,5859,5860,5861,5862,5863,5864,5866,5867,5868,5869,5871,5872,5873,5874,5875,5876,5877,5878,5879,5880,5881,5882,5883,5884,5885,5886,5887,5888,5889,5891,5892,5893,5894,5895,5896,5897,5898,5900,5901,5902,5903,5904,5905,5906,5907,5908,5909,5910,5911,5912,5913,5914,5915,5916,5917,5919,5920,5921,5922,5923,5924,5925,5926,5927,5928,5931,5933,5934,5935,5936,5937,5938,5939,5940,5941,5943,5944,5945,5946,5947,5948,5949,5950,5951,5953,5954,5955,5956,5957,5958,5959,5960,5961,5962,5963,5964,5966,5967,5968,5969,5970,5971,5972,5973,5975,5976,5977,5978,5979,5981,5982,5983,5984,5985,5986,5988,5989,5991,5992,5994,5995,5996,5997,5998,5999,6000,6001,6002,6004,6005,6006,6007,6008,6009,6010,6011,6012,6013,6014,6017,6018,6019,6020,6021,6022,6023,6024,6025,6026,6027,6028,6029,6030,6031,6032,6033,6034,6035,6036,6037,6038,6039,6041,6042,6043,6044,6045,6046,6047,6048,6049,6050,6051,6052,6053,6054,6055,6056,6057,6058,6059,6060,6061,6063,6064,6065,6066,6067,6068,6069,6070,6071,6073,6074,6075,6076,6077,6078,6079,6080,6081,6083,6084,6085,6086,6087,6088,6089,6090,6091,6092,6093,6094,6095,6096,6098,6100,6101,6102,6103,6104,6105,6106,6107,6108,6109,6110,6111,6112,6113,6115,6116,6118,6119,6120,6121,6122,6123,6124,6125,6126,6128,6130,6132,6134,6135,6136,6137,6138,6139,6141,6142,6143,6144,6145,6146,6147,6148,6149,6150,6151,6152,6153,6154,6155,6156,6157,6158,6159,6160,6161,6162,6164,6165,6166,6167,6168,6169,6170,6171,6172,6173,6174,6175,6176,6177,6178,6179,6180,6182,6183,6184,6185,6186,6187,6188,6189,6190,6192,6193,6194,6195,6196,6197,6198,6199,6200,6202,6203,6204,6205,6206,6207,6208,6209,6210,6212,6213,6214,6215,6216,6217,6218,6219,6220,6221,6222,6223,6224,6225,6226,6227,6228,6229,6230,6231,6232,6233,6234,6235,6236,6237,6238,6239,6240,6242,6243,6244,6245,6246,6247,6248,6249,6251,6252,6253,6254,6255,6256,6257,6258,6260,6261,6262,6263,6265,6266,6267,6268,6269,6270,6271,6272,6273,6274,6275,6276,6277,6278,6279,6281,6282,6283,6284,6285,6289,6290,6291,6292,6294,6295,6296,6297,6298,6299,6300,6301,6302,6303,6304,6305,6306,6307,6308,6310,6311,6312,6313,6314,6315,6316,6317,6318,6320,6321,6322,6323,6324,6325,6326,6327,6329,6330,6331,6332,6333,6334,6335,6336,6337,6338,6339,6340,6341,6343,6345,6346,6347,6348,6349,6350,6352,6353,6354,6355,6356,6357,6358,6359,6360,6361,6362,6363,6364,6365,6366,6367,6368,6369,6370,6371,6372,6373,6374,6375,6376,6377,6378,6379,6380,6381,6382,6384,6385,6386,6387,6388,6389,6390,6391,6392,6393,6394,6395,6396,6397,6399,6401,6402,6403,6404,6405,6406,6407,6408,6409,6410,6411,6412,6413,6414,6415,6416,6417,6418,6419,6420,6421,6422,6423,6425,6427,6430,6431,6432,6433,6434,6435,6436,6438,6439,6440,6441,6442,6443,6445,6446,6447,6448,6449,6450,6451,6452,6453,6455,6456,6457,6458,6459,6460,6462,6463,6464,6465,6466,6467,6468,6469,6471,6472,6474,6475,6476,6477,6479,6480,6481,6482,6483,6484,6485,6486,6487,6488,6490,6491,6492,6493,6494,6495,6496,6497,6498,6499,6500,6501,6502,6503,6504,6505,6506,6507,6508,6509,6511,6512,6513,6514,6515,6516,6517,6518,6519,6520,6521,6522,6523,6524,6525,6527,6528,6529,6530,6531,6533,6534,6535,6536,6537,6538,6539,6540,6541,6542,6543,6544,6545,6547,6548,6549,6550,6551,6552,6553,6554,6555,6556,6558,6559,6560,6561,6562,6563,6564,6565,6566,6568,6569,6570,6571,6572,6573,6574,6575,6576,6577,6578,6579,6581,6582,6584,6585,6586,6587,6589,6591,6592,6593,6594,6595,6596,6598,6599,6600,6601,6603,6604,6605,6606,6607,6608,6609,6610,6611,6612,6613,6614,6615,6616,6617,6618,6619,6620,6622,6623,6624,6625,6626,6627,6628,6629,6630,6631,6632,6634,6635,6636,6637,6638,6639,6640,6641,6642,6644,6645,6646,6647,6648,6649,6650,6652,6653,6654,6655,6656,6657,6658,6659,6660,6661,6662,6663,6664,6665,6666,6667,6668,6669,6670,6671,6673,6674,6675,6676,6677,6678,6679,6680,6681,6682,6683,6684,6685,6686,6687,6688,6689,6690,6691,6692,6693,6694,6695,6696,6697,6698,6699,6700,6702,6703,6704,6705,6706,6707,6708,6709,6710,6712,6713,6714,6715,6716,6717,6718,6720,6721,6722,6723,6724,6725,6726,6727,6728,6729,6730,6731,6732,6733,6734,6735,6736,6737,6738,6739,6740,6741,6742,6743,6744,6745,6746,6747,6748,6749,6751,6754,6755,6756,6757,6758,6759,6761,6762,6763,6764,6765,6767,6768,6769,6771,6772,6773,6774,6775,6776,6777,6778,6780,6782,6783,6784,6785,6787,6788,6789,6790,6791,6792,6793,6794,6796,6797,6799,6800,6801,6802,6803,6804,6805,6806,6807,6809,6810,6811,6812,6813,6814,6815,6816,6817,6819,6820,6821,6822,6823,6824,6825,6826,6827,6828,6829,6830,6831,6832,6834,6836,6837,6838,6839,6840,6842,6844,6845,6846,6847,6848,6849,6850,6851,6852,6853,6854,6855,6856,6857,6858,6859,6860,6861,6862,6863,6864,6865,6866,6867,6868,6869,6870,6871,6872,6873,6874,6875,6876,6878,6879,6880,6881,6882,6883,6884,6885,6886,6887,6888,6889,6890,6891,6893,6895,6896,6897,6898,6899,6900,6901,6902,6903,6904,6905,6906,6907,6908,6909,6910,6911,6912,6913,6914,6915,6916,6917,6918,6919,6920,6922,6924,6926,6928,6929,6930,6931,6932,6933,6934,6935,6936,6938,6939,6940,6941,6942,6943,6944,6945,6946,6948,6949,6950,6951,6952,6953,6954,6955,6956,6957,6958,6960,6961,6963,6964,6965,6966,6967,6969,6972,6973,6974,6975,6976,6977,6980,6981,6982,6983,6984,6985,6986,6987,6988,6989,6990,6991,6992,6993,6994,6995,6996,6997,6998,6999,7000,7001,7002,7003,7004,7005,7006,7007,7008,7009,7010,7011,7012,7013,7014,7015,7016,7017,7018,7019,7020,7021,7022,7023,7024,7025,7026,7027,7028,7029,7030,7032,7033,7034,7035,7036,7038,7039,7040,7041,7042,7043,7044,7045,7046,7047,7048,7050,7051,7053,7054,7055,7056,7057,7058,7059,7060,7061,7063,7064,7065,7066,7067,7068,7069,7070,7071,7073,7074,7075,7076,7077,7078,7079,7080,7081,7082,7083,7085,7087,7088,7089,7090,7091,7092,7093,7094,7095,7096,7097,7098,7099,7100,7101,7102,7103,7104,7105,7106,7107,7108,7109,7110,7111,7113,7114,7115,7116,7117,7118,7119,7120,7121,7122,7123,7124,7125,7126,7127,7128,7130,7131,7132,7134,7135,7136,7137,7138,7140,7141,7142,7143,7144,7145,7146,7147,7148,7149,7150,7151,7152,7153,7154,7155,7156,7157,7158,7159,7160,7163,7164,7165,7166,7167,7169,7170,7171,7172,7173,7174,7176,7177,7178,7179,7180,7181,7182,7183,7184,7185,7186,7187,7188,7189,7191,7192,7193,7194,7195,7196,7197,7198,7199,7200,7201,7204,7205,7206,7207,7208,7209,7210,7211,7212,7213,7214,7215,7217,7218,7219,7220,7222,7223,7224,7226,7227,7228,7229,7230,7232,7233,7234,7235,7236,7237,7238,7239,7240,7241,7242,7243,7244,7245,7246,7247,7248,7249,7250,7251,7252,7253,7254,7256,7257,7258,7259,7260,7262,7264,7265,7266,7267,7268,7270,7271,7272,7273,7274,7275,7276,7277,7278,7280,7281,7282,7283,7284,7285,7286,7287,7288,7290,7291,7292,7293,7294,7295,7296,7297,7298,7299,7300,7301,7302,7303,7304,7305,7306,7307,7308,7309,7310,7311,7312,7313,7314,7315,7316,7318,7319,7320,7321,7322,7323,7324,7325,7326,7327,7328,7329,7331,7332,7333,7334,7335,7336,7338,7339,7340,7341,7343,7344,7345,7346,7347,7348,7349,7350,7351,7352,7353,7355,7356,7357,7358,7359,7360,7361,7362,7364,7365,7366,7369,7370,7371,7372,7373,7374,7375,7376,7377,7378,7379,7380,7382,7383,7384,7386,7387,7388,7389,7390,7391,7392,7393,7394,7395,7396,7397,7398,7399,7400,7401,7402,7403,7404,7405,7406,7407,7408,7409,7411,7412,7413,7414,7415,7416,7417,7418,7419,7420,7421,7422,7423,7424,7425,7426,7427,7428,7429,7430,7431,7432,7433,7434,7435,7436,7437,7438,7439,7441,7442,7443,7444,7445,7447,7448,7450,7451,7453,7454,7455,7456,7457,7458,7459,7460,7461,7462,7463,7464,7466,7467,7468,7469,7470,7471,7472,7473,7474,7475,7476,7477,7478,7479,7480,7481,7482,7483,7484,7486,7487,7488,7489,7490,7492,7493,7494,7495,7496,7497,7498,7499,7500,7501,7502,7503,7504,7507,7508,7509,7510,7511,7512,7513,7514,7515,7517,7518,7519,7520,7521,7522,7523,7524,7525,7527,7528,7529,7530,7531,7532,7533,7534,7535,7538,7539,7540,7541,7542,7543,7544,7545,7546,7547,7548,7549,7550,7551,7552,7553,7554,7556,7557,7559,7560,7561,7562,7563,7564,7565,7567,7568,7569,7570,7571,7572,7573,7574,7575,7576,7577,7578,7579,7580,7581,7582,7583,7584,7585,7586,7587,7588,7589,7590,7591,7592,7594,7595,7596,7597,7598,7600,7602,7603,7604,7605,7606,7608,7609,7610,7611,7612,7613,7614,7615,7616,7618,7619,7620,7621,7622,7623,7624,7626,7627,7628,7629,7630,7631,7632,7633,7634,7635,7636,7637,7638,7639,7640,7641,7642,7643,7644,7645,7647,7648,7649,7650,7651,7652,7653,7654,7656,7657,7658,7659,7660,7661,7662,7663,7664,7665,7666,7667,7668,7669,7670,7672,7673,7674,7675,7676,7677,7678,7679,7680,7681,7682,7683,7684,7685,7686,7687,7689,7690,7691,7692,7694,7695,7696,7697,7698,7700,7701,7704,7705,7707,7708,7709,7710,7711,7712,7713,7714,7715,7716,7717,7718,7719,7720,7721,7722,7724,7725,7726,7728,7729,7730,7731,7732,7733,7734,7735,7736,7738,7739,7740,7741,7742,7743,7744,7745,7746,7748,7749,7750,7751,7752,7753,7754,7755,7756,7757,7758,7759,7760,7761,7762,7763,7764,7765,7766,7767,7768,7769,7770,7771,7772,7773,7774,7775,7776,7777,7778,7779,7781,7783,7784,7785,7786,7787,7788,7789,7790,7792,7793,7794,7795,7796,7797,7798,7799,7800,7801,7802,7803,7804,7805,7806,7807,7808,7809,7811,7812,7813,7814,7815,7816,7818,7819,7821,7822,7823,7824,7825,7826,7827,7828,7829,7831,7832,7833,7834,7836,7837,7839,7840,7841,7842,7843,7844,7845,7847,7848,7849,7850,7851,7852,7853,7854,7856,7857,7858,7859,7860,7861,7862,7863,7864,7865,7867,7869,7870,7871,7872,7874,7875,7876,7877,7878,7879,7880,7881,7883,7884,7885,7886,7888,7890,7891,7892,7893,7894,7895,7896,7897,7899,7900,7901,7902,7903,7904,7905,7906,7908,7909,7910,7911,7912,7914,7915,7916,7917,7918,7919,7920,7921,7922,7923,7924,7925,7926,7927,7928,7929,7930,7931,7932,7934,7935,7936,7937,7938,7939,7940,7941,7942,7944,7945,7946,7947,7948,7949,7950,7951,7952,7954,7955,7956,7957,7958,7959,7960,7961,7962,7963,7964,7965,7966,7968,7969,7970,7971,7972,7973,7974,7975,7976,7977,7978,7979,7980,7981,7982,7983,7984,7985,7986,7988,7990,7991,7992,7993,7994,7995,7996,7997,7998,7999,8000,8001,8002,8003,8004,8005,8006,8008,8009,8010,8011,8012,8013,8014,8015,8017,8018,8019,8020,8022,8024,8025,8026,8027,8028,8030,8031,8032,8033,8034,8035,8036,8037,8038,8039,8040,8041,8042,8043,8044,8045,8046,8047,8048,8049,8050,8051,8052,8053,8054,8058,8059,8060,8061,8062,8063,8064,8065,8066,8068,8069,8070,8071,8072,8073,8074,8075,8076,8078,8079,8080,8081,8082,8083,8084,8086,8087,8088,8089,8090,8091,8092,8093,8094,8095,8096,8097,8099,8100,8101,8102,8103,8104,8105,8106,8107,8108,8109,8110,8112,8113,8115,8116,8118,8119,8120,8121,8122,8123,8124,8125,8126,8128,8129,8130,8131,8132,8133,8134,8135,8136,8138,8139,8140,8141,8142,8143,8144,8145,8146,8147,8148,8149,8150,8151,8153,8154,8155,8156,8157,8158,8159,8160,8161,8162,8164,8165,8166,8167,8168,8169,8170,8171,8173,8174,8175,8176,8177,8178,8180,8181,8182,8183,8184,8185,8186,8187,8188,8189,8190,8191,8192,8193,8196,8197,8198,8200,8201,8202,8203,8204,8205,8206,8207,8208,8209,8210,8211,8213,8214,8215,8216,8217,8218,8219,8220,8222,8223,8224,8225,8226,8227,8229,8230,8231,8232,8233,8234,8235,8236,8237,8238,8239,8240,8241,8242,8244,8245,8246,8247,8248,8249,8250,8252,8253,8254,8255,8256,8257,8258,8259,8261,8262,8263,8264,8265,8266,8267,8268,8269,8270,8271,8272,8274,8275,8276,8277,8279,8280,8281,8282,8284,8285,8286,8287,8288,8289,8290,8291,8292,8293,8294,8295,8296,8297,8298,8299,8300,8301,8302,8303,8304,8305,8306,8308,8309,8310,8311,8312,8313,8314,8315,8316,8317,8318,8319,8320,8321,8322,8323,8324,8326,8327,8328,8329,8330,8331,8332,8333,8334,8336,8337,8339,8340,8341,8344,8345,8346,8347,8348,8349,8350,8352,8353,8354,8355,8356,8357,8358,8360,8361,8362,8363,8364,8365,8366,8367,8368,8369,8370,8371,8372,8374,8375,8376,8377,8378,8379,8380,8381,8383,8384,8385,8386,8387,8390,8391,8392,8393,8394,8395,8396,8397,8398,8399,8400,8401,8402,8403,8404,8405,8406,8407,8408,8409,8410,8411,8412,8413,8415,8416,8417,8418,8419,8420,8421,8422,8423,8424,8426,8427,8428,8429,8430,8431,8432,8433,8434,8435,8436,8437,8438,8439,8440,8441,8442,8443,8444,8445,8446,8447,8449,8450,8451,8452,8453,8454,8455,8456,8457,8459,8460,8461,8462,8463,8464,8465,8466,8467,8469,8470,8471,8472,8473,8474,8475,8476,8477,8478,8479,8480,8482,8483,8484,8485,8486,8487,8488,8489,8491,8492,8493,8494,8495,8497,8498,8499,8500,8502,8503,8504,8505,8506,8507,8508,8509,8510,8511,8512,8515,8516,8517,8518,8519,8520,8521,8522,8523,8524,8525,8526,8527,8529,8530,8531,8532,8533,8534,8536,8537,8538,8539,8540,8541,8542,8543,8544,8545,8546,8547,8549,8550,8551,8552,8553,8554,8555,8556,8557,8559,8560,8561,8562,8563,8564,8565,8566,8568,8569,8570,8571,8572,8573,8574,8575,8577,8578,8579,8580,8581,8582,8583,8584,8585,8586,8588,8589,8590,8591,8592,8593,8594,8596,8597,8598,8599,8600,8601,8602,8603,8604,8605,8606,8607,8608,8609,8610,8612,8613,8615,8616,8617,8618,8620,8622,8623,8624,8625,8626,8627,8628,8630,8631,8632,8633,8635,8636,8637,8638,8639,8640,8641,8642,8643,8644,8645,8646,8647,8648,8649,8650,8651,8652,8653,8654,8655,8656,8658,8659,8660,8661,8662,8663,8664,8665,8666,8667,8668,8669,8670,8672,8673,8674,8675,8676,8677,8678,8679,8680,8682,8683,8684,8685,8686,8687,8688,8689,8690,8692,8693,8694,8695,8696,8697,8698,8699,8700,8701,8702,8703,8704,8705,8706,8707,8708,8709,8710,8711,8712,8713,8714,8715,8716,8717,8718,8719,8720,8721,8722,8723,8724,8725,8726,8727,8728,8729,8732,8733,8734,8735,8736,8737,8739,8740,8741,8742,8743,8744,8745,8746,8747,8749,8750,8751,8753,8754,8755,8756,8757,8758,8759,8760,8761,8762,8766,8767,8768,8769,8770,8771,8773,8774,8775,8776,8777,8778,8779,8780,8781,8782,8783,8784,8785,8786,8787,8788,8789,8790,8791,8792,8793,8794,8796,8797,8799,8800,8801,8802,8803,8804,8805,8806,8807,8809,8810,8811,8812,8813,8814,8815,8816,8817,8819,8820,8821,8822,8823,8824,8825,8826,8827,8828,8829,8830,8831,8832,8833,8834,8835,8836,8837,8838,8839,8840,8841,8842,8843,8844,8846,8847,8848,8850,8852,8853,8854,8855,8856,8857,8860,8861,8862,8863,8864,8866,8867,8869,8870,8871,8872,8873,8874,8875,8876,8877,8878,8879,8880,8882,8883,8884,8885,8886,8887,8888,8889,8890,8891,8892,8893,8894,8896,8897,8898,8899,8900,8901,8902,8903,8904,8905,8906,8907,8908,8909,8910,8911,8912,8914,8915,8916,8917,8918,8919,8920,8922,8923,8924,8925,8926,8927,8928,8930,8931,8932,8933,8934,8935,8936,8937,8938,8939,8940,8941,8942,8943,8944,8945,8946,8947,8948,8949,8950,8952,8953,8954,8955,8956,8957,8958,8959,8960,8961,8962,8963,8964,8965,8966,8967,8968,8969,8970,8971,8972,8973,8974,8975,8976,8977,8979,8980,8981,8982,8984,8985,8986,8987,8988,8989,8990,8993,8994,8995,8996,8997,8998,9000,9001,9002,9003,9005,9006,9007,9008,9009,9010,9011,9012,9013,9014,9015,9017,9018,9019,9020,9021,9022,9023,9024,9025,9026,9027,9028,9029,9030,9031,9032,9033,9034,9035,9036,9039,9040,9041,9042,9043,9044,9045,9046,9047,9048,9049,9050,9051,9053,9054,9055,9056,9057,9058,9059,9061,9062,9063,9064,9065,9066,9067,9068,9069,9071,9072,9073,9074,9075,9076,9077,9078,9079,9081,9082,9083,9084,9085,9086,9087,9088,9089,9090,9091,9092,9093,9094,9096,9097,9098,9099,9100,9101,9102,9103,9104,9106,9107,9108,9109,9110,9111,9112,9113,9114,9115,9116,9117,9118,9119,9120,9121,9122,9123,9124,9125,9126,9127,9128,9129,9130,9131,9132,9133,9135,9136,9138,9139,9140,9141,9142,9143,9144,9145,9146,9147,9148,9149,9150,9151,9152,9153,9154,9155,9156,9157,9159,9160,9161,9163,9164,9165,9166,9168,9169,9170,9171,9172,9173,9175,9176,9177,9178,9180,9181,9182,9183,9184,9185,9186,9187,9188,9190,9191,9192,9193,9194,9195,9196,9197,9198,9200,9201,9202,9203,9204,9205,9206,9207,9208,9209,9210,9211,9212,9213,9214,9215,9216,9217,9218,9219,9222,9224,9225,9226,9227,9228,9229,9231,9232,9233,9234,9235,9237,9238,9240,9241,9242,9243,9245,9246,9247,9248,9249,9250,9251,9252,9253,9254,9255,9256,9257,9258,9259,9260,9261,9262,9263,9265,9266,9267,9268,9269,9270,9271,9272,9274,9275,9276,9277,9278,9279,9280,9282,9283,9284,9285,9286,9287,9288,9289,9290,9291,9292,9293,9294,9295,9298,9299,9300,9301,9302,9303,9304,9305,9306,9307,9308,9309,9312,9313,9314,9315,9316,9317,9318,9319,9320,9321,9322,9323,9324,9326,9327,9328,9329,9330,9331,9332,9333,9334,9335,9336,9337,9338,9340,9341,9342,9343,9344,9345,9346,9347,9348,9349,9350,9351,9353,9354,9355,9356,9357,9359,9360,9361,9362,9363,9364,9365,9366,9368,9369,9370,9371,9372,9373,9374,9375,9376,9378,9379,9380,9381,9382,9383,9384,9385,9386,9388,9389,9390,9391,9392,9393,9394,9395,9397,9398,9399,9400,9401,9402,9403,9404,9406,9407,9408,9409,9410,9411,9412,9413,9415,9416,9417,9418,9419,9420,9421,9422,9423,9424,9426,9427,9428,9429,9430,9431,9432,9433,9434,9435,9437,9438,9441,9442,9443,9444,9445,9446,9447,9448,9449,9450,9451,9452,9453,9454,9456,9458,9460,9461,9462,9463,9464,9465,9466,9467,9468,9469,9470,9471,9472,9473,9474,9475,9476,9477,9478,9479,9480,9481,9482,9483,9484,9485,9486,9487,9489,9490,9491,9492,9493,9494,9495,9496,9497,9499,9500,9501,9502,9503,9504,9505,9506,9507,9509,9510,9511,9512,9513,9514,9515,9516,9517,9518,9520,9521,9522,9523,9524,9525,9526,9529,9530,9531,9532,9533,9534,9535,9536,9537,9538,9539,9540,9541,9543,9544,9545,9546,9547,9548,9549,9550,9551,9553,9554,9555,9556,9557,9558,9559,9560,9561,9562,9563,9564,9565,9566,9567,9568,9569,9570,9571,9572,9573,9574,9575,9576,9577,9578,9579,9580,9581,9582,9583,9584,9586,9587,9588,9589,9590,9591,9592,9593,9594,9595,9596,9597,9598,9599,9600,9602,9603,9604,9605,9606,9607,9608,9609,9610,9612,9613,9614,9615,9616,9617,9618,9619,9620,9622,9623,9624,9625,9626,9627,9628,9629,9630,9632,9635,9636,9637,9638,9639,9640,9641,9642,9643,9644,9645,9646,9649,9650,9651,9652,9653,9654,9655,9656,9657,9658,9659,9660,9661,9662,9664,9665,9667,9668,9669,9670,9671,9672,9673,9674,9675,9676,9678,9679,9680,9681,9682,9683,9684,9685,9686,9689,9690,9691,9692,9693,9694,9695,9696,9697,9698,9699,9700,9701,9702,9703,9705,9706,9707,9708,9709,9710,9711,9712,9713,9715,9716,9717,9718,9719,9720,9721,9722,9723,9725,9726,9727,9728,9729,9730,9731,9732,9733,9734,9735,9736,9737,9738,9740,9741,9742,9743,9744,9745,9746,9747,9748,9749,9750,9751,9752,9754,9755,9756,9758,9759,9760,9762,9764,9765,9766,9767,9768,9769,9770,9771,9772,9773,9774,9775,9776,9777,9778,9779,9780,9781,9782,9783,9784,9785,9786,9787,9788,9789,9790,9792,9793,9794,9795,9796,9797,9798,9799,9802,9803,9804,9805,9806,9807,9808,9810,9811,9812,9813,9814,9815,9816,9817,9819,9820,9821,9822,9823,9824,9825,9827,9828,9829,9830,9831,9832,9833,9834,9835,9836,9837,9838,9839,9840,9841,9842,9843,9844,9845,9846,9847,9848,9849,9851,9852,9853,9854,9855,9856,9857,9858,9859,9860,9861,9862,9863,9864,9866,9867,9868,9869,9870,9871,9872,9873,9874,9875,9876,9877,9878,9880,9881,9882,9883,9884,9886,9887,9888,9889,9890,9891,9892,9893,9894,9895,9896,9898,9899,9900,9901,9903,9904,9905,9906,9907,9908,9909,9910,9912,9913,9914,9915,9916,9917,9918,9919,9920,9921,9922,9923,9924,9925,9926,9927,9928,9929,9931,9932,9933,9934,9935,9936,9937,9938,9940,9941,9942,9943,9944,9945,9946,9947,9949,9950,9953,9954,9955,9956,9957,9958,9959,9960,9961,9963,9965,9966,9967,9968,9969,9970,9971,9972,9973,9974,9975,9976,9977,9978,9979,9980,9981,9982,9984,9985,9986,9987,9988,9989,9990,9991,9992,9994,9995,9996,9997,9998,9999],"errors":9020},"selected_test":{"loss":2.302585546875,"accuracy":0.098,"n":10000,"wrong_indices":[0,1,2,4,5,6,7,8,9,11,12,14,15,16,17,18,19,20,21,22,23,24,26,27,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,56,57,58,59,60,61,62,63,64,65,66,67,68,70,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,127,128,129,130,131,132,133,134,135,137,138,139,140,141,142,143,144,145,146,147,149,150,151,152,153,154,155,156,158,159,160,161,162,163,164,165,166,167,168,169,170,171,172,173,174,175,176,177,178,179,180,181,182,184,185,186,187,189,190,191,193,195,196,197,198,199,200,201,202,203,204,205,206,207,208,209,210,211,212,213,214,216,217,218,219,220,221,222,223,224,225,226,227,228,229,230,231,232,233,234,235,236,237,238,239,240,241,242,243,244,245,247,248,249,250,251,252,253,254,255,256,257,258,259,260,261,262,263,264,265,266,267,268,270,272,273,274,275,276,277,278,279,280,281,282,283,284,285,286,287,288,289,290,291,292,293,295,298,299,300,301,302,303,304,306,307,308,309,310,313,314,315,316,317,318,319,320,321,322,323,325,326,328,329,330,331,332,333,334,335,336,337,338,339,340,341,342,343,344,345,347,348,349,350,351,352,353,354,355,356,357,358,359,360,361,362,363,364,366,367,368,369,370,371,373,374,375,376,377,378,379,381,382,383,384,385,386,387,388,389,390,391,392,393,394,395,396,397,398,399,400,401,402,403,404,405,406,408,409,410,411,412,413,414,415,416,417,418,419,420,421,422,423,425,426,427,428,429,430,431,432,433,434,435,436,437,438,439,442,444,445,446,447,448,449,450,451,452,453,454,455,456,457,458,460,461,462,463,464,465,466,467,468,469,470,471,472,473,474,475,476,477,478,479,480,481,482,483,484,486,487,488,489,491,492,493,494,495,496,497,499,500,501,502,503,504,505,506,507,508,509,510,511,512,513,514,515,516,517,518,519,520,521,522,523,524,526,527,528,529,530,531,532,533,534,535,536,537,538,539,540,541,542,543,544,547,548,549,550,551,553,554,555,556,557,558,559,560,562,563,565,566,568,569,570,571,572,573,574,575,576,577,578,579,580,582,583,584,585,587,588,589,590,591,593,594,595,596,598,599,600,601,602,603,604,605,606,607,609,610,612,613,614,615,616,617,618,619,621,622,623,624,625,626,627,628,629,630,631,632,633,634,635,636,637,638,639,640,641,643,645,646,647,648,649,650,651,652,653,654,655,657,658,659,660,662,663,664,665,666,667,668,669,670,671,672,673,674,675,676,677,678,679,680,681,682,683,684,685,686,687,688,689,690,691,692,693,694,695,696,697,698,699,700,702,703,705,706,707,708,709,710,711,712,714,715,716,718,719,720,722,724,725,726,727,728,729,730,731,732,733,734,735,736,737,738,739,740,741,743,744,745,746,747,748,749,751,752,753,754,755,756,757,758,759,760,761,762,764,765,766,767,768,769,770,771,772,773,774,775,776,777,778,779,780,781,782,783,784,785,786,787,788,789,790,791,792,793,795,796,797,798,799,800,801,802,803,805,806,807,808,809,810,811,812,813,814,815,816,817,818,819,820,822,823,824,825,826,827,828,829,830,831,832,833,834,835,836,837,838,839,840,841,842,843,844,846,847,848,849,850,852,853,855,856,857,858,859,860,861,862,863,864,865,866,867,868,869,870,872,873,874,875,876,877,878,879,880,881,882,883,885,886,887,888,889,890,891,892,893,894,897,898,899,900,901,902,903,905,906,907,908,909,910,911,912,913,914,915,916,917,918,919,920,921,922,923,924,925,926,927,928,929,930,931,933,934,935,936,937,938,939,940,941,942,943,944,945,946,947,948,949,950,951,952,953,954,955,956,957,958,959,960,961,962,963,964,965,966,967,968,969,970,971,973,974,975,976,977,978,979,980,982,983,984,985,986,987,988,989,990,991,992,994,995,996,998,999,1000,1002,1003,1004,1005,1006,1007,1008,1010,1011,1012,1013,1014,1015,1016,1017,1018,1019,1020,1021,1022,1023,1024,1025,1026,1027,1028,1029,1030,1031,1032,1033,1035,1036,1037,1038,1039,1040,1041,1042,1043,1044,1045,1046,1048,1049,1050,1051,1052,1053,1054,1055,1056,1057,1058,1059,1060,1062,1063,1064,1065,1066,1067,1068,1069,1070,1071,1072,1073,1074,1075,1076,1077,1078,1079,1080,1081,1082,1083,1085,1086,1087,1088,1089,1090,1091,1092,1093,1095,1096,1097,1098,1099,1100,1101,1102,1103,1104,1105,1106,1107,1108,1109,1110,1111,1112,1113,1114,1115,1116,1117,1118,1119,1120,1122,1123,1124,1125,1126,1127,1128,1129,1130,1131,1132,1133,1134,1135,1136,1137,1138,1139,1140,1141,1142,1143,1144,1145,1146,1147,1149,1150,1151,1152,1153,1155,1156,1157,1158,1159,1160,1161,1162,1163,1164,1165,1166,1167,1168,1169,1170,1171,1172,1173,1174,1175,1177,1178,1179,1180,1181,1182,1183,1184,1185,1186,1187,1189,1190,1192,1193,1194,1196,1198,1199,1200,1201,1202,1204,1205,1206,1207,1208,1209,1210,1211,1212,1213,1214,1215,1216,1217,1219,1221,1222,1224,1225,1226,1227,1228,1229,1230,1232,1233,1234,1235,1236,1237,1238,1239,1240,1241,1242,1243,1244,1245,1247,1248,1249,1250,1251,1252,1253,1254,1255,1256,1257,1258,1259,1260,1262,1263,1264,1265,1266,1267,1268,1269,1270,1272,1274,1275,1276,1277,1278,1279,1280,1281,1282,1283,1284,1285,1286,1287,1289,1290,1291,1292,1293,1295,1296,1298,1299,1300,1301,1302,1303,1304,1305,1306,1307,1308,1309,1310,1311,1312,1313,1314,1315,1316,1317,1318,1319,1320,1321,1322,1323,1324,1325,1326,1327,1328,1329,1330,1331,1332,1334,1335,1336,1337,1338,1339,1340,1341,1342,1343,1344,1345,1346,1347,1348,1349,1350,1351,1352,1353,1354,1355,1356,1357,1358,1359,1360,1361,1362,1363,1364,1365,1366,1367,1368,1369,1370,1371,1372,1373,1374,1375,1376,1377,1378,1380,1381,1382,1383,1384,1385,1386,1387,1388,1389,1391,1392,1393,1394,1395,1396,1397,1398,1400,1401,1402,1403,1405,1406,1407,1409,1410,1412,1413,1414,1415,1417,1418,1419,1420,1421,1422,1423,1424,1425,1426,1427,1428,1429,1430,1431,1432,1433,1434,1435,1436,1437,1439,1440,1441,1442,1443,1444,1446,1447,1448,1449,1450,1451,1452,1453,1455,1456,1458,1459,1460,1461,1462,1463,1464,1465,1466,1467,1469,1470,1471,1472,1473,1474,1475,1476,1477,1478,1479,1480,1481,1482,1483,1484,1485,1486,1488,1489,1490,1491,1492,1493,1494,1495,1496,1497,1498,1499,1500,1501,1502,1503,1505,1506,1507,1508,1509,1510,1511,1512,1513,1514,1515,1516,1518,1519,1520,1521,1522,1523,1524,1525,1527,1528,1529,1530,1531,1532,1536,1537,1538,1539,1540,1541,1542,1543,1544,1545,1546,1547,1548,1549,1550,1551,1552,1553,1554,1555,1556,1557,1559,1560,1561,1562,1563,1564,1566,1567,1568,1569,1571,1572,1573,1574,1575,1576,1577,1578,1579,1580,1581,1582,1583,1584,1585,1586,1587,1588,1591,1592,1593,1594,1595,1596,1597,1598,1599,1600,1601,1602,1603,1604,1605,1606,1607,1608,1609,1611,1612,1613,1614,1615,1616,1617,1618,1620,1622,1624,1625,1626,1627,1628,1629,1630,1631,1632,1633,1634,1635,1636,1637,1639,1640,1641,1642,1643,1644,1645,1646,1647,1648,1649,1651,1652,1653,1654,1655,1656,1657,1658,1659,1660,1661,1662,1663,1664,1665,1666,1667,1668,1669,1670,1671,1672,1673,1674,1675,1676,1677,1678,1679,1680,1681,1682,1683,1684,1685,1686,1687,1688,1689,1690,1691,1693,1694,1695,1696,1697,1698,1699,1701,1702,1703,1704,1705,1706,1707,1709,1710,1711,1714,1715,1716,1717,1718,1719,1720,1721,1722,1724,1725,1727,1728,1729,1730,1731,1732,1733,1734,1735,1736,1737,1738,1740,1741,1742,1743,1744,1745,1746,1747,1749,1750,1751,1752,1753,1754,1755,1756,1758,1759,1760,1761,1763,1765,1766,1767,1769,1770,1771,1772,1773,1774,1776,1778,1779,1780,1781,1782,1783,1784,1785,1786,1787,1788,1789,1790,1791,1792,1793,1795,1797,1798,1799,1800,1801,1802,1803,1804,1805,1806,1809,1810,1811,1812,1813,1814,1815,1816,1817,1818,1819,1820,1821,1822,1823,1824,1825,1827,1828,1829,1830,1831,1832,1833,1834,1835,1836,1837,1838,1839,1840,1842,1844,1845,1846,1847,1848,1849,1850,1851,1852,1853,1854,1855,1856,1857,1858,1859,1860,1861,1862,1863,1864,1865,1866,1867,1868,1869,1871,1872,1873,1874,1875,1876,1877,1878,1879,1880,1881,1882,1883,1884,1885,1886,1887,1888,1889,1890,1891,1893,1894,1895,1896,1897,1899,1900,1901,1902,1903,1904,1905,1906,1908,1909,1910,1911,1912,1913,1914,1915,1916,1917,1919,1920,1921,1922,1923,1924,1925,1926,1927,1928,1929,1930,1931,1932,1933,1934,1935,1936,1937,1938,1939,1940,1941,1942,1943,1945,1946,1947,1948,1949,1950,1951,1952,1953,1954,1955,1956,1957,1958,1960,1961,1962,1963,1964,1965,1966,1967,1968,1969,1970,1971,1973,1974,1975,1976,1977,1978,1979,1980,1981,1982,1983,1984,1985,1986,1988,1989,1990,1991,1992,1993,1994,1996,1997,1998,1999,2000,2001,2002,2003,2004,2005,2006,2007,2008,2009,2010,2011,2012,2013,2014,2015,2016,2017,2018,2019,2020,2021,2022,2024,2025,2026,2027,2028,2029,2030,2031,2032,2034,2035,2036,2037,2038,2039,2040,2041,2043,2044,2045,2046,2047,2048,2049,2050,2051,2052,2053,2054,2055,2056,2057,2058,2059,2062,2063,2064,2065,2066,2068,2069,2070,2071,2072,2073,2074,2075,2076,2077,2078,2079,2080,2082,2083,2084,2085,2086,2088,2089,2090,2091,2092,2093,2094,2095,2097,2098,2099,2100,2101,2102,2103,2104,2105,2107,2108,2109,2110,2111,2112,2113,2114,2115,2116,2117,2118,2119,2120,2121,2122,2123,2124,2125,2126,2128,2129,2130,2131,2132,2133,2134,2135,2136,2137,2138,2139,2140,2141,2142,2143,2144,2145,2146,2147,2148,2149,2150,2151,2152,2153,2154,2156,2157,2158,2159,2160,2161,2162,2163,2164,2165,2166,2167,2168,2169,2170,2171,2172,2173,2174,2175,2176,2177,2179,2180,2181,2182,2183,2184,2186,2187,2189,2191,2192,2193,2194,2195,2196,2197,2198,2199,2200,2201,2202,2203,2205,2206,2207,2208,2210,2211,2212,2213,2214,2215,2216,2218,2219,2220,2221,2222,2223,2224,2225,2227,2228,2229,2230,2231,2232,2233,2234,2235,2237,2238,2239,2240,2241,2242,2243,2244,2245,2246,2247,2248,2249,2250,2251,2252,2253,2254,2255,2256,2257,2258,2259,2260,2261,2262,2263,2264,2265,2266,2267,2268,2269,2270,2271,2272,2273,2274,2275,2276,2277,2278,2279,2280,2281,2282,2283,2284,2285,2286,2287,2288,2289,2290,2291,2292,2293,2296,2297,2298,2299,2300,2301,2302,2303,2305,2306,2307,2308,2309,2310,2311,2312,2313,2314,2315,2316,2317,2319,2320,2321,2322,2323,2324,2325,2327,2330,2331,2332,2334,2335,2336,2337,2338,2339,2340,2341,2342,2343,2344,2345,2346,2347,2348,2349,2350,2351,2352,2353,2354,2355,2356,2357,2358,2359,2360,2361,2362,2363,2364,2365,2366,2367,2368,2369,2371,2372,2373,2374,2375,2377,2379,2380,2381,2382,2383,2386,2387,2388,2389,2390,2391,2392,2393,2394,2395,2396,2397,2398,2399,2400,2401,2402,2404,2405,2406,2407,2408,2409,2411,2412,2413,2414,2415,2416,2418,2419,2420,2421,2422,2423,2424,2425,2426,2427,2428,2429,2430,2431,2432,2433,2434,2436,2437,2438,2439,2440,2441,2442,2443,2444,2445,2446,2447,2448,2450,2451,2452,2453,2454,2456,2457,2458,2459,2460,2462,2463,2464,2465,2466,2467,2468,2469,2470,2471,2472,2473,2474,2475,2476,2477,2478,2480,2481,2482,2483,2484,2486,2487,2488,2489,2490,2491,2493,2494,2495,2496,2497,2498,2499,2500,2501,2502,2503,2504,2505,2507,2508,2509,2510,2511,2512,2513,2514,2515,2516,2517,2518,2519,2520,2521,2522,2523,2524,2525,2526,2528,2529,2530,2532,2533,2534,2535,2537,2538,2539,2540,2541,2542,2543,2544,2545,2546,2547,2548,2549,2550,2551,2552,2553,2554,2555,2556,2558,2559,2560,2561,2562,2563,2564,2565,2566,2567,2569,2570,2572,2573,2574,2575,2576,2577,2578,2579,2580,2581,2582,2583,2584,2585,2586,2587,2588,2589,2590,2591,2594,2595,2596,2597,2598,2599,2600,2601,2602,2603,2604,2605,2606,2607,2608,2609,2610,2611,2612,2613,2614,2615,2616,2617,2618,2620,2621,2622,2623,2624,2625,2626,2628,2629,2630,2632,2633,2634,2635,2636,2637,2639,2640,2642,2643,2644,2645,2646,2647,2648,2650,2651,2652,2653,2654,2655,2658,2659,2661,2662,2663,2664,2665,2666,2667,2668,2669,2670,2671,2672,2673,2674,2675,2676,2677,2678,2679,2680,2681,2682,2683,2684,2685,2686,2688,2689,2690,2691,2692,2693,2694,2695,2696,2697,2698,2699,2700,2701,2702,2704,2705,2706,2708,2709,2710,2711,2712,2715,2716,2718,2719,2720,2721,2722,2723,2724,2725,2726,2727,2728,2729,2730,2731,2732,2734,2735,2736,2737,2738,2739,2740,2741,2742,2743,2744,2745,2746,2749,2750,2751,2752,2753,2754,2755,2756,2757,2758,2759,2760,2762,2766,2767,2768,2769,2770,2771,2772,2773,2774,2775,2776,2778,2780,2781,2782,2783,2784,2785,2786,2787,2788,2789,2790,2791,2792,2793,2795,2796,2797,2798,2799,2800,2801,2802,2803,2804,2805,2806,2807,2808,2809,2810,2812,2813,2814,2815,2816,2818,2819,2820,2822,2823,2825,2826,2827,2828,2829,2830,2831,2832,2833,2834,2835,2836,2837,2838,2839,2840,2841,2843,2844,2845,2846,2847,2848,2849,2850,2851,2852,2853,2854,2855,2856,2857,2858,2859,2860,2861,2862,2863,2864,2865,2866,2867,2868,2869,2870,2871,2872,2874,2875,2876,2877,2878,2879,2880,2881,2882,2883,2884,2885,2886,2887,2888,2889,2890,2891,2892,2893,2895,2896,2897,2898,2900,2901,2902,2903,2904,2905,2906,2907,2908,2909,2910,2911,2912,2913,2914,2915,2916,2917,2918,2919,2920,2921,2922,2923,2924,2925,2926,2927,2928,2929,2930,2931,2933,2934,2935,2936,2938,2939,2940,2941,2943,2945,2946,2947,2948,2949,2950,2951,2952,2953,2955,2956,2957,2958,2959,2960,2961,2963,2964,2965,2966,2967,2968,2969,2970,2971,2973,2974,2975,2976,2977,2978,2979,2980,2981,2982,2983,2984,2985,2986,2987,2989,2990,2991,2992,2993,2994,2995,2997,2998,3000,3001,3002,3003,3004,3005,3006,3007,3008,3009,3010,3011,3012,3014,3015,3017,3018,3019,3021,3022,3023,3024,3025,3026,3027,3028,3029,3030,3031,3033,3034,3035,3036,3037,3038,3039,3040,3041,3042,3045,3046,3047,3048,3049,3050,3051,3053,3054,3055,3056,3057,3058,3059,3060,3061,3062,3063,3064,3065,3066,3067,3068,3069,3070,3071,3072,3073,3074,3075,3076,3078,3079,3080,3081,3082,3083,3084,3085,3086,3088,3089,3091,3092,3093,3094,3095,3096,3097,3098,3099,3100,3101,3102,3103,3104,3105,3106,3107,3108,3109,3110,3111,3112,3113,3114,3115,3116,3117,3118,3119,3120,3121,3122,3123,3124,3125,3126,3127,3128,3129,3130,3131,3132,3133,3134,3135,3136,3137,3138,3139,3141,3142,3143,3144,3145,3146,3147,3148,3149,3150,3151,3152,3153,3154,3155,3156,3157,3158,3159,3160,3161,3162,3163,3164,3165,3166,3167,3168,3169,3171,3172,3173,3174,3175,3176,3177,3180,3181,3182,3183,3184,3186,3187,3188,3189,3190,3192,3193,3194,3195,3196,3197,3198,3199,3200,3201,3202,3203,3204,3205,3206,3207,3208,3209,3211,3212,3213,3214,3216,3217,3218,3220,3221,3222,3223,3224,3225,3227,3228,3229,3230,3231,3232,3233,3234,3235,3236,3237,3238,3239,3240,3241,3244,3245,3246,3247,3248,3249,3250,3252,3253,3254,3255,3256,3257,3258,3259,3260,3261,3262,3263,3264,3267,3268,3269,3270,3272,3273,3274,3275,3276,3277,3278,3279,3280,3281,3282,3283,3284,3285,3286,3287,3288,3289,3290,3291,3292,3293,3294,3295,3296,3298,3299,3300,3301,3302,3303,3304,3307,3308,3309,3311,3312,3313,3314,3316,3318,3319,3320,3321,3323,3324,3326,3327,3328,3329,3330,3331,3332,3333,3334,3335,3336,3337,3338,3339,3340,3341,3342,3343,3344,3345,3348,3349,3350,3351,3352,3353,3354,3355,3356,3357,3360,3361,3362,3363,3364,3365,3366,3367,3369,3370,3372,3373,3374,3375,3376,3377,3378,3379,3380,3381,3382,3383,3384,3385,3386,3387,3388,3389,3390,3391,3392,3393,3394,3395,3396,3397,3398,3399,3400,3402,3403,3404,3405,3406,3407,3408,3409,3410,3411,3414,3415,3416,3418,3419,3420,3421,3422,3423,3424,3425,3426,3427,3428,3429,3430,3431,3432,3433,3434,3435,3436,3437,3438,3440,3441,3442,3443,3444,3447,3448,3449,3451,3452,3453,3454,3455,3456,3457,3459,3460,3461,3462,3463,3464,3465,3466,3467,3468,3469,3470,3471,3472,3473,3474,3475,3476,3477,3478,3480,3482,3483,3484,3485,3486,3487,3488,3489,3490,3491,3492,3493,3494,3495,3497,3498,3499,3500,3501,3502,3503,3504,3505,3506,3507,3508,3509,3510,3511,3513,3514,3515,3516,3517,3518,3519,3520,3521,3522,3523,3524,3525,3526,3527,3528,3529,3530,3531,3532,3533,3534,3535,3537,3538,3539,3541,3542,3543,3544,3545,3546,3547,3548,3549,3550,3551,3552,3553,3554,3555,3556,3557,3558,3559,3560,3561,3562,3563,3564,3565,3566,3567,3568,3569,3570,3571,3572,3573,3575,3576,3577,3578,3579,3580,3582,3583,3585,3586,3587,3588,3589,3590,3591,3592,3593,3594,3595,3596,3597,3598,3599,3600,3601,3602,3603,3604,3605,3606,3607,3609,3610,3611,3612,3614,3615,3616,3617,3618,3619,3620,3621,3622,3623,3625,3626,3627,3628,3629,3630,3631,3632,3633,3635,3636,3637,3638,3639,3641,3642,3643,3644,3645,3647,3648,3649,3651,3652,3653,3654,3655,3656,3657,3658,3659,3661,3662,3663,3664,3665,3666,3667,3668,3669,3670,3671,3672,3673,3674,3675,3676,3678,3679,3681,3682,3683,3684,3685,3686,3687,3688,3689,3690,3691,3692,3693,3694,3696,3697,3699,3700,3701,3702,3703,3704,3705,3707,3708,3709,3711,3712,3713,3714,3715,3716,3717,3718,3719,3720,3721,3722,3723,3725,3726,3727,3728,3729,3730,3731,3732,3733,3736,3737,3738,3739,3740,3741,3742,3743,3744,3745,3746,3747,3748,3749,3750,3751,3752,3753,3754,3755,3756,3757,3758,3759,3760,3761,3762,3763,3765,3766,3767,3769,3770,3771,3772,3773,3775,3776,3777,3778,3779,3780,3781,3782,3783,3784,3785,3786,3787,3788,3789,3791,3792,3793,3794,3795,3796,3797,3798,3799,3800,3801,3802,3806,3807,3808,3809,3810,3811,3812,3813,3814,3815,3816,3817,3819,3820,3821,3822,3823,3824,3825,3826,3827,3828,3829,3831,3832,3833,3834,3835,3836,3837,3838,3839,3840,3841,3842,3843,3844,3845,3846,3848,3850,3851,3852,3853,3854,3855,3856,3857,3858,3859,3860,3861,3862,3863,3865,3866,3868,3869,3871,3872,3873,3874,3875,3876,3877,3878,3879,3880,3881,3882,3884,3885,3886,3887,3888,3889,3890,3891,3892,3893,3894,3896,3897,3898,3899,3900,3901,3902,3904,3905,3906,3907,3908,3909,3910,3912,3913,3914,3915,3916,3917,3918,3919,3920,3921,3922,3923,3924,3925,3926,3927,3928,3929,3930,3931,3932,3933,3934,3935,3936,3937,3938,3939,3941,3943,3944,3945,3946,3947,3948,3949,3950,3951,3952,3953,3954,3955,3956,3957,3958,3960,3961,3962,3963,3964,3965,3966,3967,3968,3969,3970,3971,3972,3973,3974,3975,3976,3977,3978,3979,3981,3983,3984,3985,3986,3987,3988,3990,3991,3992,3993,3994,3995,3996,3997,3998,3999,4000,4001,4002,4003,4004,4005,4006,4007,4008,4009,4010,4011,4012,4013,4014,4015,4016,4017,4018,4019,4020,4021,4022,4024,4025,4026,4027,4028,4029,4030,4031,4032,4035,4036,4037,4038,4039,4040,4041,4042,4044,4045,4046,4047,4049,4050,4051,4052,4053,4054,4055,4056,4057,4058,4059,4060,4061,4063,4064,4066,4067,4068,4069,4071,4072,4073,4074,4075,4076,4077,4078,4081,4083,4084,4085,4086,4087,4088,4089,4092,4093,4094,4095,4096,4097,4098,4099,4100,4101,4102,4103,4104,4105,4106,4107,4108,4109,4110,4111,4112,4113,4114,4115,4116,4117,4118,4119,4120,4121,4122,4123,4124,4125,4126,4127,4128,4129,4130,4131,4132,4133,4134,4135,4136,4137,4138,4139,4140,4141,4142,4143,4144,4145,4147,4148,4149,4151,4152,4153,4154,4156,4158,4159,4160,4161,4162,4163,4164,4165,4167,4168,4169,4170,4171,4172,4173,4174,4175,4176,4177,4178,4179,4180,4181,4182,4183,4184,4185,4187,4189,4190,4191,4192,4193,4194,4195,4196,4197,4198,4199,4200,4201,4202,4203,4204,4205,4206,4207,4209,4210,4211,4212,4213,4214,4215,4216,4217,4218,4219,4220,4221,4222,4223,4224,4225,4226,4228,4229,4230,4231,4232,4233,4234,4235,4236,4237,4238,4239,4240,4242,4243,4244,4245,4246,4247,4248,4249,4250,4251,4252,4253,4254,4255,4256,4257,4258,4259,4260,4261,4262,4263,4264,4265,4266,4267,4268,4269,4270,4271,4272,4273,4274,4275,4276,4277,4279,4280,4283,4284,4285,4287,4288,4289,4290,4291,4292,4293,4294,4295,4296,4297,4298,4299,4300,4301,4302,4303,4304,4305,4306,4307,4308,4309,4310,4311,4312,4313,4314,4315,4316,4317,4318,4319,4321,4322,4323,4324,4325,4326,4328,4330,4331,4332,4333,4334,4335,4336,4337,4338,4339,4340,4341,4342,4344,4345,4346,4347,4349,4350,4352,4354,4355,4356,4357,4358,4359,4360,4362,4363,4364,4366,4367,4368,4369,4371,4372,4373,4374,4375,4376,4377,4378,4379,4380,4381,4382,4383,4384,4385,4386,4387,4388,4389,4390,4391,4393,4394,4395,4396,4397,4398,4399,4400,4401,4402,4405,4406,4407,4408,4409,4410,4411,4412,4413,4414,4415,4416,4417,4418,4419,4420,4421,4422,4423,4424,4425,4426,4427,4428,4429,4430,4431,4433,4434,4435,4436,4437,4438,4439,4440,4441,4442,4443,4444,4445,4446,4449,4450,4451,4452,4453,4454,4455,4456,4458,4459,4460,4461,4463,4464,4465,4466,4467,4468,4469,4471,4472,4474,4475,4476,4478,4479,4480,4481,4482,4483,4484,4485,4486,4487,4488,4489,4490,4491,4492,4493,4494,4496,4497,4498,4499,4500,4501,4502,4503,4504,4505,4506,4507,4508,4509,4510,4511,4512,4513,4514,4516,4517,4518,4519,4520,4521,4522,4523,4524,4525,4526,4528,4529,4530,4532,4533,4534,4535,4536,4537,4538,4539,4540,4541,4543,4544,4545,4546,4547,4548,4549,4550,4551,4552,4553,4555,4556,4557,4558,4559,4560,4561,4562,4563,4564,4565,4566,4567,4568,4569,4570,4571,4572,4573,4574,4575,4576,4577,4578,4579,4580,4581,4582,4583,4584,4585,4586,4587,4588,4589,4590,4591,4592,4593,4594,4595,4596,4597,4598,4599,4600,4601,4602,4603,4605,4606,4607,4608,4609,4610,4612,4613,4615,4616,4618,4619,4620,4621,4622,4623,4624,4625,4626,4627,4629,4630,4632,4633,4634,4635,4636,4637,4638,4639,4640,4643,4644,4645,4646,4647,4648,4649,4651,4652,4653,4654,4655,4656,4657,4658,4659,4660,4661,4662,4663,4664,4665,4666,4667,4668,4669,4670,4671,4673,4674,4676,4677,4678,4679,4680,4681,4682,4683,4684,4685,4686,4687,4688,4689,4690,4691,4692,4693,4694,4695,4696,4697,4698,4699,4700,4701,4702,4703,4704,4705,4706,4707,4708,4709,4710,4711,4712,4713,4714,4715,4716,4717,4719,4721,4722,4723,4724,4725,4726,4727,4728,4729,4730,4731,4732,4733,4734,4735,4736,4737,4738,4740,4742,4743,4744,4745,4746,4747,4748,4749,4750,4751,4752,4753,4754,4755,4756,4758,4759,4760,4761,4762,4763,4764,4765,4766,4767,4768,4769,4770,4771,4772,4773,4774,4775,4777,4778,4779,4781,4782,4783,4784,4785,4786,4787,4789,4790,4791,4792,4793,4794,4795,4796,4797,4798,4799,4800,4801,4802,4803,4805,4806,4807,4808,4809,4810,4811,4812,4813,4814,4815,4816,4817,4818,4820,4821,4822,4823,4825,4826,4827,4828,4829,4830,4831,4832,4833,4835,4836,4837,4838,4839,4840,4841,4842,4843,4844,4845,4846,4847,4848,4849,4850,4851,4852,4853,4854,4855,4856,4858,4859,4860,4861,4863,4864,4865,4866,4867,4868,4869,4870,4871,4872,4873,4874,4875,4876,4877,4878,4879,4881,4882,4883,4884,4885,4886,4888,4889,4890,4892,4893,4894,4895,4896,4897,4898,4899,4900,4901,4902,4903,4904,4905,4906,4907,4908,4909,4910,4911,4912,4913,4914,4915,4916,4917,4918,4919,4920,4921,4922,4924,4925,4926,4927,4928,4929,4930,4931,4932,4933,4934,4936,4938,4939,4940,4941,4942,4943,4944,4945,4946,4947,4948,4949,4950,4951,4952,4953,4954,4955,4956,4960,4961,4962,4963,4964,4965,4966,4967,4968,4969,4970,4971,4972,4973,4974,4975,4976,4977,4978,4979,4980,4981,4982,4983,4984,4985,4986,4987,4988,4989,4990,4991,4993,4994,4995,4996,4997,4998,5000,5001,5002,5003,5004,5005,5007,5009,5010,5011,5012,5013,5014,5015,5016,5017,5018,5019,5020,5021,5022,5023,5024,5025,5026,5027,5028,5029,5030,5032,5034,5036,5037,5038,5039,5040,5041,5042,5044,5045,5046,5047,5048,5049,5050,5052,5053,5054,5055,5056,5057,5058,5059,5060,5061,5062,5063,5064,5065,5066,5067,5068,5070,5071,5072,5073,5074,5075,5076,5077,5078,5080,5081,5082,5083,5084,5085,5086,5088,5089,5090,5091,5092,5093,5094,5095,5096,5097,5098,5099,5100,5101,5102,5103,5104,5105,5106,5107,5110,5111,5112,5113,5114,5115,5116,5117,5118,5119,5120,5121,5122,5123,5125,5126,5127,5128,5129,5130,5131,5132,5134,5135,5136,5137,5138,5140,5142,5143,5144,5145,5146,5148,5149,5150,5151,5152,5153,5154,5156,5157,5158,5159,5160,5161,5162,5163,5164,5166,5167,5168,5169,5170,5171,5172,5173,5174,5175,5176,5177,5178,5179,5180,5181,5182,5183,5184,5185,5186,5187,5188,5189,5190,5191,5192,5193,5194,5195,5196,5197,5198,5199,5200,5201,5202,5203,5204,5205,5206,5207,5208,5209,5210,5211,5212,5213,5214,5215,5216,5217,5218,5219,5220,5221,5222,5223,5224,5225,5226,5227,5228,5229,5230,5231,5232,5233,5234,5235,5236,5237,5238,5239,5240,5242,5245,5246,5247,5248,5250,5252,5254,5256,5258,5260,5261,5262,5263,5264,5265,5266,5267,5268,5269,5271,5272,5273,5274,5275,5276,5277,5278,5279,5281,5282,5283,5284,5285,5286,5287,5288,5289,5291,5292,5293,5294,5295,5296,5297,5298,5299,5300,5302,5303,5304,5306,5308,5309,5310,5311,5312,5313,5314,5315,5316,5317,5318,5319,5322,5323,5324,5325,5326,5327,5328,5329,5330,5331,5332,5333,5334,5335,5336,5338,5339,5340,5341,5343,5344,5345,5346,5347,5348,5349,5350,5351,5352,5354,5355,5356,5357,5358,5359,5360,5361,5362,5363,5364,5365,5366,5367,5370,5371,5372,5373,5374,5375,5376,5377,5378,5379,5380,5381,5382,5383,5384,5385,5386,5387,5388,5389,5390,5391,5392,5393,5394,5395,5396,5397,5399,5400,5401,5402,5403,5404,5406,5407,5408,5409,5410,5411,5412,5413,5414,5416,5417,5418,5419,5420,5421,5422,5423,5424,5425,5426,5427,5429,5431,5432,5433,5434,5436,5437,5438,5439,5440,5441,5442,5444,5445,5446,5447,5448,5449,5451,5453,5454,5455,5456,5457,5458,5460,5461,5462,5464,5465,5466,5467,5468,5469,5471,5472,5473,5474,5475,5476,5477,5478,5479,5480,5481,5482,5484,5485,5486,5487,5488,5489,5490,5491,5492,5493,5494,5495,5496,5497,5498,5499,5500,5501,5502,5503,5504,5506,5507,5508,5509,5510,5511,5512,5514,5515,5516,5517,5518,5520,5521,5522,5523,5524,5525,5527,5528,5530,5532,5533,5534,5535,5536,5537,5538,5539,5540,5541,5542,5543,5544,5545,5546,5547,5548,5549,5550,5551,5552,5553,5555,5556,5557,5558,5559,5560,5561,5562,5563,5564,5565,5566,5568,5569,5570,5571,5572,5573,5574,5575,5576,5577,5578,5579,5580,5581,5582,5583,5585,5586,5587,5588,5589,5590,5591,5594,5595,5596,5597,5598,5599,5600,5601,5602,5604,5605,5606,5607,5608,5609,5610,5611,5612,5614,5615,5616,5617,5618,5619,5620,5621,5622,5623,5624,5625,5626,5627,5628,5629,5630,5631,5632,5633,5634,5635,5636,5637,5638,5639,5640,5641,5642,5643,5644,5645,5646,5647,5648,5649,5650,5651,5654,5655,5656,5657,5658,5660,5661,5662,5663,5664,5665,5666,5667,5668,5670,5671,5672,5674,5675,5676,5677,5678,5679,5680,5681,5682,5683,5687,5688,5689,5690,5691,5692,5693,5694,5696,5697,5698,5699,5700,5701,5702,5703,5704,5705,5706,5707,5708,5709,5710,5711,5712,5713,5714,5715,5716,5717,5719,5720,5722,5723,5724,5725,5726,5727,5728,5729,5730,5732,5733,5734,5735,5736,5738,5739,5740,5741,5742,5743,5744,5745,5746,5747,5748,5749,5751,5752,5753,5754,5755,5757,5758,5759,5760,5761,5762,5763,5764,5765,5766,5767,5768,5769,5770,5771,5772,5773,5774,5775,5776,5777,5779,5780,5781,5782,5783,5784,5785,5786,5787,5788,5789,5790,5792,5793,5794,5795,5796,5797,5798,5799,5800,5801,5802,5803,5804,5805,5807,5808,5809,5810,5811,5813,5814,5815,5816,5817,5819,5820,5821,5822,5823,5824,5825,5826,5829,5831,5832,5833,5834,5835,5836,5837,5839,5840,5841,5842,5843,5844,5845,5846,5848,5849,5850,5851,5852,5853,5854,5855,5856,5857,5858,5859,5860,5861,5862,5863,5864,5866,5867,5868,5869,5871,5872,5873,5874,5875,5876,5877,5878,5879,5880,5881,5882,5883,5884,5885,5886,5887,5888,5889,5891,5892,5893,5894,5895,5896,5897,5898,5900,5901,5902,5903,5904,5905,5906,5907,5908,5909,5910,5911,5912,5913,5914,5915,5916,5917,5919,5920,5921,5922,5923,5924,5925,5926,5927,5928,5931,5933,5934,5935,5936,5937,5938,5939,5940,5941,5943,5944,5945,5946,5947,5948,5949,5950,5951,5953,5954,5955,5956,5957,5958,5959,5960,5961,5962,5963,5964,5966,5967,5968,5969,5970,5971,5972,5973,5975,5976,5977,5978,5979,5981,5982,5983,5984,5985,5986,5988,5989,5991,5992,5994,5995,5996,5997,5998,5999,6000,6001,6002,6004,6005,6006,6007,6008,6009,6010,6011,6012,6013,6014,6017,6018,6019,6020,6021,6022,6023,6024,6025,6026,6027,6028,6029,6030,6031,6032,6033,6034,6035,6036,6037,6038,6039,6041,6042,6043,6044,6045,6046,6047,6048,6049,6050,6051,6052,6053,6054,6055,6056,6057,6058,6059,6060,6061,6063,6064,6065,6066,6067,6068,6069,6070,6071,6073,6074,6075,6076,6077,6078,6079,6080,6081,6083,6084,6085,6086,6087,6088,6089,6090,6091,6092,6093,6094,6095,6096,6098,6100,6101,6102,6103,6104,6105,6106,6107,6108,6109,6110,6111,6112,6113,6115,6116,6118,6119,6120,6121,6122,6123,6124,6125,6126,6128,6130,6132,6134,6135,6136,6137,6138,6139,6141,6142,6143,6144,6145,6146,6147,6148,6149,6150,6151,6152,6153,6154,6155,6156,6157,6158,6159,6160,6161,6162,6164,6165,6166,6167,6168,6169,6170,6171,6172,6173,6174,6175,6176,6177,6178,6179,6180,6182,6183,6184,6185,6186,6187,6188,6189,6190,6192,6193,6194,6195,6196,6197,6198,6199,6200,6202,6203,6204,6205,6206,6207,6208,6209,6210,6212,6213,6214,6215,6216,6217,6218,6219,6220,6221,6222,6223,6224,6225,6226,6227,6228,6229,6230,6231,6232,6233,6234,6235,6236,6237,6238,6239,6240,6242,6243,6244,6245,6246,6247,6248,6249,6251,6252,6253,6254,6255,6256,6257,6258,6260,6261,6262,6263,6265,6266,6267,6268,6269,6270,6271,6272,6273,6274,6275,6276,6277,6278,6279,6281,6282,6283,6284,6285,6289,6290,6291,6292,6294,6295,6296,6297,6298,6299,6300,6301,6302,6303,6304,6305,6306,6307,6308,6310,6311,6312,6313,6314,6315,6316,6317,6318,6320,6321,6322,6323,6324,6325,6326,6327,6329,6330,6331,6332,6333,6334,6335,6336,6337,6338,6339,6340,6341,6343,6345,6346,6347,6348,6349,6350,6352,6353,6354,6355,6356,6357,6358,6359,6360,6361,6362,6363,6364,6365,6366,6367,6368,6369,6370,6371,6372,6373,6374,6375,6376,6377,6378,6379,6380,6381,6382,6384,6385,6386,6387,6388,6389,6390,6391,6392,6393,6394,6395,6396,6397,6399,6401,6402,6403,6404,6405,6406,6407,6408,6409,6410,6411,6412,6413,6414,6415,6416,6417,6418,6419,6420,6421,6422,6423,6425,6427,6430,6431,6432,6433,6434,6435,6436,6438,6439,6440,6441,6442,6443,6445,6446,6447,6448,6449,6450,6451,6452,6453,6455,6456,6457,6458,6459,6460,6462,6463,6464,6465,6466,6467,6468,6469,6471,6472,6474,6475,6476,6477,6479,6480,6481,6482,6483,6484,6485,6486,6487,6488,6490,6491,6492,6493,6494,6495,6496,6497,6498,6499,6500,6501,6502,6503,6504,6505,6506,6507,6508,6509,6511,6512,6513,6514,6515,6516,6517,6518,6519,6520,6521,6522,6523,6524,6525,6527,6528,6529,6530,6531,6533,6534,6535,6536,6537,6538,6539,6540,6541,6542,6543,6544,6545,6547,6548,6549,6550,6551,6552,6553,6554,6555,6556,6558,6559,6560,6561,6562,6563,6564,6565,6566,6568,6569,6570,6571,6572,6573,6574,6575,6576,6577,6578,6579,6581,6582,6584,6585,6586,6587,6589,6591,6592,6593,6594,6595,6596,6598,6599,6600,6601,6603,6604,6605,6606,6607,6608,6609,6610,6611,6612,6613,6614,6615,6616,6617,6618,6619,6620,6622,6623,6624,6625,6626,6627,6628,6629,6630,6631,6632,6634,6635,6636,6637,6638,6639,6640,6641,6642,6644,6645,6646,6647,6648,6649,6650,6652,6653,6654,6655,6656,6657,6658,6659,6660,6661,6662,6663,6664,6665,6666,6667,6668,6669,6670,6671,6673,6674,6675,6676,6677,6678,6679,6680,6681,6682,6683,6684,6685,6686,6687,6688,6689,6690,6691,6692,6693,6694,6695,6696,6697,6698,6699,6700,6702,6703,6704,6705,6706,6707,6708,6709,6710,6712,6713,6714,6715,6716,6717,6718,6720,6721,6722,6723,6724,6725,6726,6727,6728,6729,6730,6731,6732,6733,6734,6735,6736,6737,6738,6739,6740,6741,6742,6743,6744,6745,6746,6747,6748,6749,6751,6754,6755,6756,6757,6758,6759,6761,6762,6763,6764,6765,6767,6768,6769,6771,6772,6773,6774,6775,6776,6777,6778,6780,6782,6783,6784,6785,6787,6788,6789,6790,6791,6792,6793,6794,6796,6797,6799,6800,6801,6802,6803,6804,6805,6806,6807,6809,6810,6811,6812,6813,6814,6815,6816,6817,6819,6820,6821,6822,6823,6824,6825,6826,6827,6828,6829,6830,6831,6832,6834,6836,6837,6838,6839,6840,6842,6844,6845,6846,6847,6848,6849,6850,6851,6852,6853,6854,6855,6856,6857,6858,6859,6860,6861,6862,6863,6864,6865,6866,6867,6868,6869,6870,6871,6872,6873,6874,6875,6876,6878,6879,6880,6881,6882,6883,6884,6885,6886,6887,6888,6889,6890,6891,6893,6895,6896,6897,6898,6899,6900,6901,6902,6903,6904,6905,6906,6907,6908,6909,6910,6911,6912,6913,6914,6915,6916,6917,6918,6919,6920,6922,6924,6926,6928,6929,6930,6931,6932,6933,6934,6935,6936,6938,6939,6940,6941,6942,6943,6944,6945,6946,6948,6949,6950,6951,6952,6953,6954,6955,6956,6957,6958,6960,6961,6963,6964,6965,6966,6967,6969,6972,6973,6974,6975,6976,6977,6980,6981,6982,6983,6984,6985,6986,6987,6988,6989,6990,6991,6992,6993,6994,6995,6996,6997,6998,6999,7000,7001,7002,7003,7004,7005,7006,7007,7008,7009,7010,7011,7012,7013,7014,7015,7016,7017,7018,7019,7020,7021,7022,7023,7024,7025,7026,7027,7028,7029,7030,7032,7033,7034,7035,7036,7038,7039,7040,7041,7042,7043,7044,7045,7046,7047,7048,7050,7051,7053,7054,7055,7056,7057,7058,7059,7060,7061,7063,7064,7065,7066,7067,7068,7069,7070,7071,7073,7074,7075,7076,7077,7078,7079,7080,7081,7082,7083,7085,7087,7088,7089,7090,7091,7092,7093,7094,7095,7096,7097,7098,7099,7100,7101,7102,7103,7104,7105,7106,7107,7108,7109,7110,7111,7113,7114,7115,7116,7117,7118,7119,7120,7121,7122,7123,7124,7125,7126,7127,7128,7130,7131,7132,7134,7135,7136,7137,7138,7140,7141,7142,7143,7144,7145,7146,7147,7148,7149,7150,7151,7152,7153,7154,7155,7156,7157,7158,7159,7160,7163,7164,7165,7166,7167,7169,7170,7171,7172,7173,7174,7176,7177,7178,7179,7180,7181,7182,7183,7184,7185,7186,7187,7188,7189,7191,7192,7193,7194,7195,7196,7197,7198,7199,7200,7201,7204,7205,7206,7207,7208,7209,7210,7211,7212,7213,7214,7215,7217,7218,7219,7220,7222,7223,7224,7226,7227,7228,7229,7230,7232,7233,7234,7235,7236,7237,7238,7239,7240,7241,7242,7243,7244,7245,7246,7247,7248,7249,7250,7251,7252,7253,7254,7256,7257,7258,7259,7260,7262,7264,7265,7266,7267,7268,7270,7271,7272,7273,7274,7275,7276,7277,7278,7280,7281,7282,7283,7284,7285,7286,7287,7288,7290,7291,7292,7293,7294,7295,7296,7297,7298,7299,7300,7301,7302,7303,7304,7305,7306,7307,7308,7309,7310,7311,7312,7313,7314,7315,7316,7318,7319,7320,7321,7322,7323,7324,7325,7326,7327,7328,7329,7331,7332,7333,7334,7335,7336,7338,7339,7340,7341,7343,7344,7345,7346,7347,7348,7349,7350,7351,7352,7353,7355,7356,7357,7358,7359,7360,7361,7362,7364,7365,7366,7369,7370,7371,7372,7373,7374,7375,7376,7377,7378,7379,7380,7382,7383,7384,7386,7387,7388,7389,7390,7391,7392,7393,7394,7395,7396,7397,7398,7399,7400,7401,7402,7403,7404,7405,7406,7407,7408,7409,7411,7412,7413,7414,7415,7416,7417,7418,7419,7420,7421,7422,7423,7424,7425,7426,7427,7428,7429,7430,7431,7432,7433,7434,7435,7436,7437,7438,7439,7441,7442,7443,7444,7445,7447,7448,7450,7451,7453,7454,7455,7456,7457,7458,7459,7460,7461,7462,7463,7464,7466,7467,7468,7469,7470,7471,7472,7473,7474,7475,7476,7477,7478,7479,7480,7481,7482,7483,7484,7486,7487,7488,7489,7490,7492,7493,7494,7495,7496,7497,7498,7499,7500,7501,7502,7503,7504,7507,7508,7509,7510,7511,7512,7513,7514,7515,7517,7518,7519,7520,7521,7522,7523,7524,7525,7527,7528,7529,7530,7531,7532,7533,7534,7535,7538,7539,7540,7541,7542,7543,7544,7545,7546,7547,7548,7549,7550,7551,7552,7553,7554,7556,7557,7559,7560,7561,7562,7563,7564,7565,7567,7568,7569,7570,7571,7572,7573,7574,7575,7576,7577,7578,7579,7580,7581,7582,7583,7584,7585,7586,7587,7588,7589,7590,7591,7592,7594,7595,7596,7597,7598,7600,7602,7603,7604,7605,7606,7608,7609,7610,7611,7612,7613,7614,7615,7616,7618,7619,7620,7621,7622,7623,7624,7626,7627,7628,7629,7630,7631,7632,7633,7634,7635,7636,7637,7638,7639,7640,7641,7642,7643,7644,7645,7647,7648,7649,7650,7651,7652,7653,7654,7656,7657,7658,7659,7660,7661,7662,7663,7664,7665,7666,7667,7668,7669,7670,7672,7673,7674,7675,7676,7677,7678,7679,7680,7681,7682,7683,7684,7685,7686,7687,7689,7690,7691,7692,7694,7695,7696,7697,7698,7700,7701,7704,7705,7707,7708,7709,7710,7711,7712,7713,7714,7715,7716,7717,7718,7719,7720,7721,7722,7724,7725,7726,7728,7729,7730,7731,7732,7733,7734,7735,7736,7738,7739,7740,7741,7742,7743,7744,7745,7746,7748,7749,7750,7751,7752,7753,7754,7755,7756,7757,7758,7759,7760,7761,7762,7763,7764,7765,7766,7767,7768,7769,7770,7771,7772,7773,7774,7775,7776,7777,7778,7779,7781,7783,7784,7785,7786,7787,7788,7789,7790,7792,7793,7794,7795,7796,7797,7798,7799,7800,7801,7802,7803,7804,7805,7806,7807,7808,7809,7811,7812,7813,7814,7815,7816,7818,7819,7821,7822,7823,7824,7825,7826,7827,7828,7829,7831,7832,7833,7834,7836,7837,7839,7840,7841,7842,7843,7844,7845,7847,7848,7849,7850,7851,7852,7853,7854,7856,7857,7858,7859,7860,7861,7862,7863,7864,7865,7867,7869,7870,7871,7872,7874,7875,7876,7877,7878,7879,7880,7881,7883,7884,7885,7886,7888,7890,7891,7892,7893,7894,7895,7896,7897,7899,7900,7901,7902,7903,7904,7905,7906,7908,7909,7910,7911,7912,7914,7915,7916,7917,7918,7919,7920,7921,7922,7923,7924,7925,7926,7927,7928,7929,7930,7931,7932,7934,7935,7936,7937,7938,7939,7940,7941,7942,7944,7945,7946,7947,7948,7949,7950,7951,7952,7954,7955,7956,7957,7958,7959,7960,7961,7962,7963,7964,7965,7966,7968,7969,7970,7971,7972,7973,7974,7975,7976,7977,7978,7979,7980,7981,7982,7983,7984,7985,7986,7988,7990,7991,7992,7993,7994,7995,7996,7997,7998,7999,8000,8001,8002,8003,8004,8005,8006,8008,8009,8010,8011,8012,8013,8014,8015,8017,8018,8019,8020,8022,8024,8025,8026,8027,8028,8030,8031,8032,8033,8034,8035,8036,8037,8038,8039,8040,8041,8042,8043,8044,8045,8046,8047,8048,8049,8050,8051,8052,8053,8054,8058,8059,8060,8061,8062,8063,8064,8065,8066,8068,8069,8070,8071,8072,8073,8074,8075,8076,8078,8079,8080,8081,8082,8083,8084,8086,8087,8088,8089,8090,8091,8092,8093,8094,8095,8096,8097,8099,8100,8101,8102,8103,8104,8105,8106,8107,8108,8109,8110,8112,8113,8115,8116,8118,8119,8120,8121,8122,8123,8124,8125,8126,8128,8129,8130,8131,8132,8133,8134,8135,8136,8138,8139,8140,8141,8142,8143,8144,8145,8146,8147,8148,8149,8150,8151,8153,8154,8155,8156,8157,8158,8159,8160,8161,8162,8164,8165,8166,8167,8168,8169,8170,8171,8173,8174,8175,8176,8177,8178,8180,8181,8182,8183,8184,8185,8186,8187,8188,8189,8190,8191,8192,8193,8196,8197,8198,8200,8201,8202,8203,8204,8205,8206,8207,8208,8209,8210,8211,8213,8214,8215,8216,8217,8218,8219,8220,8222,8223,8224,8225,8226,8227,8229,8230,8231,8232,8233,8234,8235,8236,8237,8238,8239,8240,8241,8242,8244,8245,8246,8247,8248,8249,8250,8252,8253,8254,8255,8256,8257,8258,8259,8261,8262,8263,8264,8265,8266,8267,8268,8269,8270,8271,8272,8274,8275,8276,8277,8279,8280,8281,8282,8284,8285,8286,8287,8288,8289,8290,8291,8292,8293,8294,8295,8296,8297,8298,8299,8300,8301,8302,8303,8304,8305,8306,8308,8309,8310,8311,8312,8313,8314,8315,8316,8317,8318,8319,8320,8321,8322,8323,8324,8326,8327,8328,8329,8330,8331,8332,8333,8334,8336,8337,8339,8340,8341,8344,8345,8346,8347,8348,8349,8350,8352,8353,8354,8355,8356,8357,8358,8360,8361,8362,8363,8364,8365,8366,8367,8368,8369,8370,8371,8372,8374,8375,8376,8377,8378,8379,8380,8381,8383,8384,8385,8386,8387,8390,8391,8392,8393,8394,8395,8396,8397,8398,8399,8400,8401,8402,8403,8404,8405,8406,8407,8408,8409,8410,8411,8412,8413,8415,8416,8417,8418,8419,8420,8421,8422,8423,8424,8426,8427,8428,8429,8430,8431,8432,8433,8434,8435,8436,8437,8438,8439,8440,8441,8442,8443,8444,8445,8446,8447,8449,8450,8451,8452,8453,8454,8455,8456,8457,8459,8460,8461,8462,8463,8464,8465,8466,8467,8469,8470,8471,8472,8473,8474,8475,8476,8477,8478,8479,8480,8482,8483,8484,8485,8486,8487,8488,8489,8491,8492,8493,8494,8495,8497,8498,8499,8500,8502,8503,8504,8505,8506,8507,8508,8509,8510,8511,8512,8515,8516,8517,8518,8519,8520,8521,8522,8523,8524,8525,8526,8527,8529,8530,8531,8532,8533,8534,8536,8537,8538,8539,8540,8541,8542,8543,8544,8545,8546,8547,8549,8550,8551,8552,8553,8554,8555,8556,8557,8559,8560,8561,8562,8563,8564,8565,8566,8568,8569,8570,8571,8572,8573,8574,8575,8577,8578,8579,8580,8581,8582,8583,8584,8585,8586,8588,8589,8590,8591,8592,8593,8594,8596,8597,8598,8599,8600,8601,8602,8603,8604,8605,8606,8607,8608,8609,8610,8612,8613,8615,8616,8617,8618,8620,8622,8623,8624,8625,8626,8627,8628,8630,8631,8632,8633,8635,8636,8637,8638,8639,8640,8641,8642,8643,8644,8645,8646,8647,8648,8649,8650,8651,8652,8653,8654,8655,8656,8658,8659,8660,8661,8662,8663,8664,8665,8666,8667,8668,8669,8670,8672,8673,8674,8675,8676,8677,8678,8679,8680,8682,8683,8684,8685,8686,8687,8688,8689,8690,8692,8693,8694,8695,8696,8697,8698,8699,8700,8701,8702,8703,8704,8705,8706,8707,8708,8709,8710,8711,8712,8713,8714,8715,8716,8717,8718,8719,8720,8721,8722,8723,8724,8725,8726,8727,8728,8729,8732,8733,8734,8735,8736,8737,8739,8740,8741,8742,8743,8744,8745,8746,8747,8749,8750,8751,8753,8754,8755,8756,8757,8758,8759,8760,8761,8762,8766,8767,8768,8769,8770,8771,8773,8774,8775,8776,8777,8778,8779,8780,8781,8782,8783,8784,8785,8786,8787,8788,8789,8790,8791,8792,8793,8794,8796,8797,8799,8800,8801,8802,8803,8804,8805,8806,8807,8809,8810,8811,8812,8813,8814,8815,8816,8817,8819,8820,8821,8822,8823,8824,8825,8826,8827,8828,8829,8830,8831,8832,8833,8834,8835,8836,8837,8838,8839,8840,8841,8842,8843,8844,8846,8847,8848,8850,8852,8853,8854,8855,8856,8857,8860,8861,8862,8863,8864,8866,8867,8869,8870,8871,8872,8873,8874,8875,8876,8877,8878,8879,8880,8882,8883,8884,8885,8886,8887,8888,8889,8890,8891,8892,8893,8894,8896,8897,8898,8899,8900,8901,8902,8903,8904,8905,8906,8907,8908,8909,8910,8911,8912,8914,8915,8916,8917,8918,8919,8920,8922,8923,8924,8925,8926,8927,8928,8930,8931,8932,8933,8934,8935,8936,8937,8938,8939,8940,8941,8942,8943,8944,8945,8946,8947,8948,8949,8950,8952,8953,8954,8955,8956,8957,8958,8959,8960,8961,8962,8963,8964,8965,8966,8967,8968,8969,8970,8971,8972,8973,8974,8975,8976,8977,8979,8980,8981,8982,8984,8985,8986,8987,8988,8989,8990,8993,8994,8995,8996,8997,8998,9000,9001,9002,9003,9005,9006,9007,9008,9009,9010,9011,9012,9013,9014,9015,9017,9018,9019,9020,9021,9022,9023,9024,9025,9026,9027,9028,9029,9030,9031,9032,9033,9034,9035,9036,9039,9040,9041,9042,9043,9044,9045,9046,9047,9048,9049,9050,9051,9053,9054,9055,9056,9057,9058,9059,9061,9062,9063,9064,9065,9066,9067,9068,9069,9071,9072,9073,9074,9075,9076,9077,9078,9079,9081,9082,9083,9084,9085,9086,9087,9088,9089,9090,9091,9092,9093,9094,9096,9097,9098,9099,9100,9101,9102,9103,9104,9106,9107,9108,9109,9110,9111,9112,9113,9114,9115,9116,9117,9118,9119,9120,9121,9122,9123,9124,9125,9126,9127,9128,9129,9130,9131,9132,9133,9135,9136,9138,9139,9140,9141,9142,9143,9144,9145,9146,9147,9148,9149,9150,9151,9152,9153,9154,9155,9156,9157,9159,9160,9161,9163,9164,9165,9166,9168,9169,9170,9171,9172,9173,9175,9176,9177,9178,9180,9181,9182,9183,9184,9185,9186,9187,9188,9190,9191,9192,9193,9194,9195,9196,9197,9198,9200,9201,9202,9203,9204,9205,9206,9207,9208,9209,9210,9211,9212,9213,9214,9215,9216,9217,9218,9219,9222,9224,9225,9226,9227,9228,9229,9231,9232,9233,9234,9235,9237,9238,9240,9241,9242,9243,9245,9246,9247,9248,9249,9250,9251,9252,9253,9254,9255,9256,9257,9258,9259,9260,9261,9262,9263,9265,9266,9267,9268,9269,9270,9271,9272,9274,9275,9276,9277,9278,9279,9280,9282,9283,9284,9285,9286,9287,9288,9289,9290,9291,9292,9293,9294,9295,9298,9299,9300,9301,9302,9303,9304,9305,9306,9307,9308,9309,9312,9313,9314,9315,9316,9317,9318,9319,9320,9321,9322,9323,9324,9326,9327,9328,9329,9330,9331,9332,9333,9334,9335,9336,9337,9338,9340,9341,9342,9343,9344,9345,9346,9347,9348,9349,9350,9351,9353,9354,9355,9356,9357,9359,9360,9361,9362,9363,9364,9365,9366,9368,9369,9370,9371,9372,9373,9374,9375,9376,9378,9379,9380,9381,9382,9383,9384,9385,9386,9388,9389,9390,9391,9392,9393,9394,9395,9397,9398,9399,9400,9401,9402,9403,9404,9406,9407,9408,9409,9410,9411,9412,9413,9415,9416,9417,9418,9419,9420,9421,9422,9423,9424,9426,9427,9428,9429,9430,9431,9432,9433,9434,9435,9437,9438,9441,9442,9443,9444,9445,9446,9447,9448,9449,9450,9451,9452,9453,9454,9456,9458,9460,9461,9462,9463,9464,9465,9466,9467,9468,9469,9470,9471,9472,9473,9474,9475,9476,9477,9478,9479,9480,9481,9482,9483,9484,9485,9486,9487,9489,9490,9491,9492,9493,9494,9495,9496,9497,9499,9500,9501,9502,9503,9504,9505,9506,9507,9509,9510,9511,9512,9513,9514,9515,9516,9517,9518,9520,9521,9522,9523,9524,9525,9526,9529,9530,9531,9532,9533,9534,9535,9536,9537,9538,9539,9540,9541,9543,9544,9545,9546,9547,9548,9549,9550,9551,9553,9554,9555,9556,9557,9558,9559,9560,9561,9562,9563,9564,9565,9566,9567,9568,9569,9570,9571,9572,9573,9574,9575,9576,9577,9578,9579,9580,9581,9582,9583,9584,9586,9587,9588,9589,9590,9591,9592,9593,9594,9595,9596,9597,9598,9599,9600,9602,9603,9604,9605,9606,9607,9608,9609,9610,9612,9613,9614,9615,9616,9617,9618,9619,9620,9622,9623,9624,9625,9626,9627,9628,9629,9630,9632,9635,9636,9637,9638,9639,9640,9641,9642,9643,9644,9645,9646,9649,9650,9651,9652,9653,9654,9655,9656,9657,9658,9659,9660,9661,9662,9664,9665,9667,9668,9669,9670,9671,9672,9673,9674,9675,9676,9678,9679,9680,9681,9682,9683,9684,9685,9686,9689,9690,9691,9692,9693,9694,9695,9696,9697,9698,9699,9700,9701,9702,9703,9705,9706,9707,9708,9709,9710,9711,9712,9713,9715,9716,9717,9718,9719,9720,9721,9722,9723,9725,9726,9727,9728,9729,9730,9731,9732,9733,9734,9735,9736,9737,9738,9740,9741,9742,9743,9744,9745,9746,9747,9748,9749,9750,9751,9752,9754,9755,9756,9758,9759,9760,9762,9764,9765,9766,9767,9768,9769,9770,9771,9772,9773,9774,9775,9776,9777,9778,9779,9780,9781,9782,9783,9784,9785,9786,9787,9788,9789,9790,9792,9793,9794,9795,9796,9797,9798,9799,9802,9803,9804,9805,9806,9807,9808,9810,9811,9812,9813,9814,9815,9816,9817,9819,9820,9821,9822,9823,9824,9825,9827,9828,9829,9830,9831,9832,9833,9834,9835,9836,9837,9838,9839,9840,9841,9842,9843,9844,9845,9846,9847,9848,9849,9851,9852,9853,9854,9855,9856,9857,9858,9859,9860,9861,9862,9863,9864,9866,9867,9868,9869,9870,9871,9872,9873,9874,9875,9876,9877,9878,9880,9881,9882,9883,9884,9886,9887,9888,9889,9890,9891,9892,9893,9894,9895,9896,9898,9899,9900,9901,9903,9904,9905,9906,9907,9908,9909,9910,9912,9913,9914,9915,9916,9917,9918,9919,9920,9921,9922,9923,9924,9925,9926,9927,9928,9929,9931,9932,9933,9934,9935,9936,9937,9938,9940,9941,9942,9943,9944,9945,9946,9947,9949,9950,9953,9954,9955,9956,9957,9958,9959,9960,9961,9963,9965,9966,9967,9968,9969,9970,9971,9972,9973,9974,9975,9976,9977,9978,9979,9980,9981,9982,9984,9985,9986,9987,9988,9989,9990,9991,9992,9994,9995,9996,9997,9998,9999],"errors":9020}}],"raw_files":[{"run_id":"pilot-source-plain","sha256":"40b6e6e3ce2969d04534b7ab4e6b72bff2f384207d5227166e9d441b2d4a8721"},{"run_id":"pilot-source-residual","sha256":"9957ed67a913c53fa6f6502ba2de6a5028e43b8cec1683fd711fc6531c6e8606"},{"run_id":"pilot-normalized-plain","sha256":"d16a83571b89f88ad5324d7e031fb52b3d98b717d5016f199dee924af5b48f1c"},{"run_id":"pilot-normalized-residual","sha256":"5c05a80f4b9b792b2ca6730ba3d5f625387db9836c7e9aba5bb467096b208b46"},{"run_id":"pilot-source-linear","sha256":"e11e2c09691fe444be112a1d3b3a7426d2792567be987ab365e8c3aa882b0839"},{"run_id":"pilot-normalized-sd","sha256":"672efaa4f1ccb8a22613ef8aa0e30369cc769eb4a7891c7949fe218b383a20be"},{"run_id":"graph-eval-plain-s101","sha256":"fc8928a6121cf8e7a2808d5025e9990eab8cefbf1e0fff92af40a3c46ccf4939"},{"run_id":"graph-eval-plain-s102","sha256":"7ef024e92795c7acdd9956a74e553f9393d662c2b0b8ba08014036d26f091c91"},{"run_id":"graph-eval-plain-s103","sha256":"c6460d176950a86cff04c698bf3a5e4a74d3e95bb2b8c442ac3309fecf501213"},{"run_id":"graph-eval-residual-s101","sha256":"fe619114848785e3c30051ef64298fcdebac62677cd911eb4f290c51155fac39"},{"run_id":"graph-eval-residual-s102","sha256":"62a0410e4d65211e47150addd59f001e8f930bf1a34115109867bcf8140f50ab"},{"run_id":"graph-eval-residual-s103","sha256":"29b4d0a2989b4dc0ae9baf103eebb0a61913599e1b60026bb14e28a756b66bb5"},{"run_id":"graph-eval-sd_constant-s101","sha256":"092c055f120d9044df072d756bf7ae5ca3b6d1e2eabcc8a1935074f2c8cea817"},{"run_id":"graph-eval-sd_constant-s102","sha256":"f53d6c00ad2bbbb9e436121fd2b7dd8c1041d0def849282feb495558d8475261"},{"run_id":"graph-eval-sd_constant-s103","sha256":"6f33d71a0b3df47c5095bf732b47172ef6b43b5332b6351e8bc9710f56eec666"},{"run_id":"graph-eval-sd_annealed-s101","sha256":"3469bd70bd03fc1b0a07868f7348c8a8f1921b9d5313bbfb9f37e15f7cd70c7a"},{"run_id":"graph-eval-sd_annealed-s102","sha256":"ff3505ee0fe5952a81a1abc57b103b76eb1e8a20f66f7c4b6d87bb9647d67eed"},{"run_id":"graph-eval-sd_annealed-s103","sha256":"cf48c318ae956e822dbe1a313819479ae687d3614c1994e6111c369e7983cb06"},{"run_id":"graph-eval-residual_unit_dropout-s101","sha256":"a2cff196860cf892cac8e1079cda0be32cc82778d390119e0f0ae4120ae27bcd"},{"run_id":"graph-eval-residual_unit_dropout-s102","sha256":"057cb0f41d53c773755dd796355f8d6109b37163dc7db038ecec4ce58491ac7f"},{"run_id":"graph-eval-residual_unit_dropout-s103","sha256":"bdf01e637e82c343ae9def157a544f2727fd41fc1347ac5acafd7ecd2c599f07"},{"run_id":"graph-fidelity-source-plain-s101","sha256":"558b07b345ba4dda09bcb719ca9984e038e99ed112e5ef6149844b74be4c4c1c"},{"run_id":"graph-fidelity-source-plain-s102","sha256":"82aee3798104d051104d96ab139a55b11693b480766f72702d7d2342a655bf08"},{"run_id":"graph-fidelity-source-plain-s103","sha256":"549108b4c498494928986ea3a567ebc61ea5d726f1cef3502f38e8773e31d2e6"},{"run_id":"graph-fidelity-source-residual-s101","sha256":"9840b14b64aab7af85bde0e1b13add5d31b922c4279a8efeb54dbdb80b493cb1"},{"run_id":"graph-fidelity-source-residual-s102","sha256":"ce4a0ab1ea1c931808cfe079a005fbf453f0578084d888a119c6432439f56614"},{"run_id":"graph-fidelity-source-residual-s103","sha256":"f5c6324f317eb3b86d4ecd9530d61b0c1c8e0bdc729e1093b137e312ae9e81fa"},{"run_id":"graph-fidelity-source-sd-s101","sha256":"2177272e90cce2499066ed3f2a07f1470ef30003e74f7ffde28c6bd6faebd07e"},{"run_id":"graph-fidelity-source-sd-s102","sha256":"43187e0a3d248e85962b41861aeb4967da3b7b9472e3095dd8ca8992575d62a6"},{"run_id":"graph-fidelity-source-sd-s103","sha256":"7325b9c703eb1e93a7f911d25ba5af19fb5e1ea37e3bbb01e7a38407968a5d38"}],"analysis":{"schema_version":2,"generated_utc":"2026-09-09T22:58:38.128334+00:00","mode":"final_enabled","test_results_included":true,"verification":{"passed":true,"complete":true,"final_manifest_present":true,"expected_runs":24,"missing_run_ids":[],"invalid_run_ids":[],"missing_tuning_run_ids":[],"invalid_record_ids":[],"expected_final_cohorts":{"main":{"runs":15,"seeds":[101,102,103]},"fidelity":{"runs":9,"seeds":[101,102,103]}},"failure_interpretation":"Reported scientific divergence or job failure in an exploratory pilot/tune is retained but does not invalidate otherwise verified final results. Invalid records, missing final runs and divergent/failed final runs do block completeness.","issues":[],"pairing":[{"cohort":"fidelity","seed":101,"run_ids":["graph-fidelity-source-plain-s101","graph-fidelity-source-residual-s101","graph-fidelity-source-sd-s101"],"n":3,"hashes":{"initial_parameters_sha256":{"matches":true,"run_hashes":{"graph-fidelity-source-plain-s101":"e1efb33081a653eb2db13a44aa7d20f3f16925ea1dc8bc2e91ed2f639a3974ae","graph-fidelity-source-residual-s101":"e1efb33081a653eb2db13a44aa7d20f3f16925ea1dc8bc2e91ed2f639a3974ae","graph-fidelity-source-sd-s101":"e1efb33081a653eb2db13a44aa7d20f3f16925ea1dc8bc2e91ed2f639a3974ae"}},"training_data_sha256":{"matches":true,"run_hashes":{"graph-fidelity-source-plain-s101":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","graph-fidelity-source-residual-s101":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","graph-fidelity-source-sd-s101":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d"}},"train_indices_sha256":{"matches":true,"run_hashes":{"graph-fidelity-source-plain-s101":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","graph-fidelity-source-residual-s101":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","graph-fidelity-source-sd-s101":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf"}},"val_indices_sha256":{"matches":true,"run_hashes":{"graph-fidelity-source-plain-s101":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","graph-fidelity-source-residual-s101":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","graph-fidelity-source-sd-s101":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98"}},"executed_epoch_order_sha256":{"matches":true,"run_hashes":{"graph-fidelity-source-plain-s101":"95de3b6ad9c32d8e212dfb753005644da2ec11a0822a569bc4955d1ef949a7c9","graph-fidelity-source-residual-s101":"95de3b6ad9c32d8e212dfb753005644da2ec11a0822a569bc4955d1ef949a7c9","graph-fidelity-source-sd-s101":"95de3b6ad9c32d8e212dfb753005644da2ec11a0822a569bc4955d1ef949a7c9"}}},"same_training_exposure":true,"passed":true,"interpretation":"Hashes verify exact initialization, training data, split indices, and the ordered stream of all executed epoch permutations. Equal batch size/drop-last then fixes minibatch membership/order; mask hashes intentionally differ between recipes."},{"cohort":"fidelity","seed":102,"run_ids":["graph-fidelity-source-plain-s102","graph-fidelity-source-residual-s102","graph-fidelity-source-sd-s102"],"n":3,"hashes":{"initial_parameters_sha256":{"matches":true,"run_hashes":{"graph-fidelity-source-plain-s102":"4d0ac269167486811a0086108ca56313016afcebfc075d45e09455c228dee75b","graph-fidelity-source-residual-s102":"4d0ac269167486811a0086108ca56313016afcebfc075d45e09455c228dee75b","graph-fidelity-source-sd-s102":"4d0ac269167486811a0086108ca56313016afcebfc075d45e09455c228dee75b"}},"training_data_sha256":{"matches":true,"run_hashes":{"graph-fidelity-source-plain-s102":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","graph-fidelity-source-residual-s102":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","graph-fidelity-source-sd-s102":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d"}},"train_indices_sha256":{"matches":true,"run_hashes":{"graph-fidelity-source-plain-s102":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","graph-fidelity-source-residual-s102":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","graph-fidelity-source-sd-s102":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf"}},"val_indices_sha256":{"matches":true,"run_hashes":{"graph-fidelity-source-plain-s102":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","graph-fidelity-source-residual-s102":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","graph-fidelity-source-sd-s102":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98"}},"executed_epoch_order_sha256":{"matches":true,"run_hashes":{"graph-fidelity-source-plain-s102":"e6025a334be66a35953ae9a58680d6697dd3473607a14ac350db1321c0a92bd9","graph-fidelity-source-residual-s102":"e6025a334be66a35953ae9a58680d6697dd3473607a14ac350db1321c0a92bd9","graph-fidelity-source-sd-s102":"e6025a334be66a35953ae9a58680d6697dd3473607a14ac350db1321c0a92bd9"}}},"same_training_exposure":true,"passed":true,"interpretation":"Hashes verify exact initialization, training data, split indices, and the ordered stream of all executed epoch permutations. Equal batch size/drop-last then fixes minibatch membership/order; mask hashes intentionally differ between recipes."},{"cohort":"fidelity","seed":103,"run_ids":["graph-fidelity-source-plain-s103","graph-fidelity-source-residual-s103","graph-fidelity-source-sd-s103"],"n":3,"hashes":{"initial_parameters_sha256":{"matches":true,"run_hashes":{"graph-fidelity-source-plain-s103":"316aa46c9e0a65fa375b579be0871a16f447d396fe64f85e2063ee6ef8c8dd5d","graph-fidelity-source-residual-s103":"316aa46c9e0a65fa375b579be0871a16f447d396fe64f85e2063ee6ef8c8dd5d","graph-fidelity-source-sd-s103":"316aa46c9e0a65fa375b579be0871a16f447d396fe64f85e2063ee6ef8c8dd5d"}},"training_data_sha256":{"matches":true,"run_hashes":{"graph-fidelity-source-plain-s103":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","graph-fidelity-source-residual-s103":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","graph-fidelity-source-sd-s103":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d"}},"train_indices_sha256":{"matches":true,"run_hashes":{"graph-fidelity-source-plain-s103":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","graph-fidelity-source-residual-s103":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","graph-fidelity-source-sd-s103":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf"}},"val_indices_sha256":{"matches":true,"run_hashes":{"graph-fidelity-source-plain-s103":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","graph-fidelity-source-residual-s103":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","graph-fidelity-source-sd-s103":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98"}},"executed_epoch_order_sha256":{"matches":true,"run_hashes":{"graph-fidelity-source-plain-s103":"2b1dca89b73a8be186981c47ab34da696096b300bc7be619f12a35965192253e","graph-fidelity-source-residual-s103":"2b1dca89b73a8be186981c47ab34da696096b300bc7be619f12a35965192253e","graph-fidelity-source-sd-s103":"2b1dca89b73a8be186981c47ab34da696096b300bc7be619f12a35965192253e"}}},"same_training_exposure":true,"passed":true,"interpretation":"Hashes verify exact initialization, training data, split indices, and the ordered stream of all executed epoch permutations. Equal batch size/drop-last then fixes minibatch membership/order; mask hashes intentionally differ between recipes."},{"cohort":"main","seed":101,"run_ids":["graph-eval-plain-s101","graph-eval-residual-s101","graph-eval-residual_unit_dropout-s101","graph-eval-sd_annealed-s101","graph-eval-sd_constant-s101"],"n":5,"hashes":{"initial_parameters_sha256":{"matches":true,"run_hashes":{"graph-eval-plain-s101":"e1efb33081a653eb2db13a44aa7d20f3f16925ea1dc8bc2e91ed2f639a3974ae","graph-eval-residual-s101":"e1efb33081a653eb2db13a44aa7d20f3f16925ea1dc8bc2e91ed2f639a3974ae","graph-eval-residual_unit_dropout-s101":"e1efb33081a653eb2db13a44aa7d20f3f16925ea1dc8bc2e91ed2f639a3974ae","graph-eval-sd_annealed-s101":"e1efb33081a653eb2db13a44aa7d20f3f16925ea1dc8bc2e91ed2f639a3974ae","graph-eval-sd_constant-s101":"e1efb33081a653eb2db13a44aa7d20f3f16925ea1dc8bc2e91ed2f639a3974ae"}},"training_data_sha256":{"matches":true,"run_hashes":{"graph-eval-plain-s101":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","graph-eval-residual-s101":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","graph-eval-residual_unit_dropout-s101":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","graph-eval-sd_annealed-s101":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","graph-eval-sd_constant-s101":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d"}},"train_indices_sha256":{"matches":true,"run_hashes":{"graph-eval-plain-s101":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","graph-eval-residual-s101":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","graph-eval-residual_unit_dropout-s101":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","graph-eval-sd_annealed-s101":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","graph-eval-sd_constant-s101":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf"}},"val_indices_sha256":{"matches":true,"run_hashes":{"graph-eval-plain-s101":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","graph-eval-residual-s101":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","graph-eval-residual_unit_dropout-s101":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","graph-eval-sd_annealed-s101":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","graph-eval-sd_constant-s101":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98"}},"executed_epoch_order_sha256":{"matches":true,"run_hashes":{"graph-eval-plain-s101":"95de3b6ad9c32d8e212dfb753005644da2ec11a0822a569bc4955d1ef949a7c9","graph-eval-residual-s101":"95de3b6ad9c32d8e212dfb753005644da2ec11a0822a569bc4955d1ef949a7c9","graph-eval-residual_unit_dropout-s101":"95de3b6ad9c32d8e212dfb753005644da2ec11a0822a569bc4955d1ef949a7c9","graph-eval-sd_annealed-s101":"95de3b6ad9c32d8e212dfb753005644da2ec11a0822a569bc4955d1ef949a7c9","graph-eval-sd_constant-s101":"95de3b6ad9c32d8e212dfb753005644da2ec11a0822a569bc4955d1ef949a7c9"}}},"same_training_exposure":true,"passed":true,"interpretation":"Hashes verify exact initialization, training data, split indices, and the ordered stream of all executed epoch permutations. Equal batch size/drop-last then fixes minibatch membership/order; mask hashes intentionally differ between recipes."},{"cohort":"main","seed":102,"run_ids":["graph-eval-plain-s102","graph-eval-residual-s102","graph-eval-residual_unit_dropout-s102","graph-eval-sd_annealed-s102","graph-eval-sd_constant-s102"],"n":5,"hashes":{"initial_parameters_sha256":{"matches":true,"run_hashes":{"graph-eval-plain-s102":"4d0ac269167486811a0086108ca56313016afcebfc075d45e09455c228dee75b","graph-eval-residual-s102":"4d0ac269167486811a0086108ca56313016afcebfc075d45e09455c228dee75b","graph-eval-residual_unit_dropout-s102":"4d0ac269167486811a0086108ca56313016afcebfc075d45e09455c228dee75b","graph-eval-sd_annealed-s102":"4d0ac269167486811a0086108ca56313016afcebfc075d45e09455c228dee75b","graph-eval-sd_constant-s102":"4d0ac269167486811a0086108ca56313016afcebfc075d45e09455c228dee75b"}},"training_data_sha256":{"matches":true,"run_hashes":{"graph-eval-plain-s102":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","graph-eval-residual-s102":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","graph-eval-residual_unit_dropout-s102":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","graph-eval-sd_annealed-s102":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","graph-eval-sd_constant-s102":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d"}},"train_indices_sha256":{"matches":true,"run_hashes":{"graph-eval-plain-s102":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","graph-eval-residual-s102":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","graph-eval-residual_unit_dropout-s102":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","graph-eval-sd_annealed-s102":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","graph-eval-sd_constant-s102":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf"}},"val_indices_sha256":{"matches":true,"run_hashes":{"graph-eval-plain-s102":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","graph-eval-residual-s102":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","graph-eval-residual_unit_dropout-s102":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","graph-eval-sd_annealed-s102":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","graph-eval-sd_constant-s102":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98"}},"executed_epoch_order_sha256":{"matches":true,"run_hashes":{"graph-eval-plain-s102":"e6025a334be66a35953ae9a58680d6697dd3473607a14ac350db1321c0a92bd9","graph-eval-residual-s102":"e6025a334be66a35953ae9a58680d6697dd3473607a14ac350db1321c0a92bd9","graph-eval-residual_unit_dropout-s102":"e6025a334be66a35953ae9a58680d6697dd3473607a14ac350db1321c0a92bd9","graph-eval-sd_annealed-s102":"e6025a334be66a35953ae9a58680d6697dd3473607a14ac350db1321c0a92bd9","graph-eval-sd_constant-s102":"e6025a334be66a35953ae9a58680d6697dd3473607a14ac350db1321c0a92bd9"}}},"same_training_exposure":true,"passed":true,"interpretation":"Hashes verify exact initialization, training data, split indices, and the ordered stream of all executed epoch permutations. Equal batch size/drop-last then fixes minibatch membership/order; mask hashes intentionally differ between recipes."},{"cohort":"main","seed":103,"run_ids":["graph-eval-plain-s103","graph-eval-residual-s103","graph-eval-residual_unit_dropout-s103","graph-eval-sd_annealed-s103","graph-eval-sd_constant-s103"],"n":5,"hashes":{"initial_parameters_sha256":{"matches":true,"run_hashes":{"graph-eval-plain-s103":"316aa46c9e0a65fa375b579be0871a16f447d396fe64f85e2063ee6ef8c8dd5d","graph-eval-residual-s103":"316aa46c9e0a65fa375b579be0871a16f447d396fe64f85e2063ee6ef8c8dd5d","graph-eval-residual_unit_dropout-s103":"316aa46c9e0a65fa375b579be0871a16f447d396fe64f85e2063ee6ef8c8dd5d","graph-eval-sd_annealed-s103":"316aa46c9e0a65fa375b579be0871a16f447d396fe64f85e2063ee6ef8c8dd5d","graph-eval-sd_constant-s103":"316aa46c9e0a65fa375b579be0871a16f447d396fe64f85e2063ee6ef8c8dd5d"}},"training_data_sha256":{"matches":true,"run_hashes":{"graph-eval-plain-s103":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","graph-eval-residual-s103":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","graph-eval-residual_unit_dropout-s103":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","graph-eval-sd_annealed-s103":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","graph-eval-sd_constant-s103":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d"}},"train_indices_sha256":{"matches":true,"run_hashes":{"graph-eval-plain-s103":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","graph-eval-residual-s103":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","graph-eval-residual_unit_dropout-s103":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","graph-eval-sd_annealed-s103":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","graph-eval-sd_constant-s103":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf"}},"val_indices_sha256":{"matches":true,"run_hashes":{"graph-eval-plain-s103":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","graph-eval-residual-s103":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","graph-eval-residual_unit_dropout-s103":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","graph-eval-sd_annealed-s103":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","graph-eval-sd_constant-s103":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98"}},"executed_epoch_order_sha256":{"matches":true,"run_hashes":{"graph-eval-plain-s103":"2b1dca89b73a8be186981c47ab34da696096b300bc7be619f12a35965192253e","graph-eval-residual-s103":"2b1dca89b73a8be186981c47ab34da696096b300bc7be619f12a35965192253e","graph-eval-residual_unit_dropout-s103":"2b1dca89b73a8be186981c47ab34da696096b300bc7be619f12a35965192253e","graph-eval-sd_annealed-s103":"2b1dca89b73a8be186981c47ab34da696096b300bc7be619f12a35965192253e","graph-eval-sd_constant-s103":"2b1dca89b73a8be186981c47ab34da696096b300bc7be619f12a35965192253e"}}},"same_training_exposure":true,"passed":true,"interpretation":"Hashes verify exact initialization, training data, split indices, and the ordered stream of all executed epoch permutations. Equal batch size/drop-last then fixes minibatch membership/order; mask hashes intentionally differ between recipes."}],"frozen_graph_source":{"available":true,"file":"graph-protocol-freeze.json","sha256":"b8bfa1d47233c8a49918539487003803bd671039d3ae41875862eaec41eb1760","passed":true,"executed_core_expected_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a"},"run_checks":[{"run_id":"graph-eval-plain-s101","passed":true},{"run_id":"graph-eval-plain-s102","passed":true},{"run_id":"graph-eval-plain-s103","passed":true},{"run_id":"graph-eval-residual-s101","passed":true},{"run_id":"graph-eval-residual-s102","passed":true},{"run_id":"graph-eval-residual-s103","passed":true},{"run_id":"graph-eval-residual_unit_dropout-s101","passed":true},{"run_id":"graph-eval-residual_unit_dropout-s102","passed":true},{"run_id":"graph-eval-residual_unit_dropout-s103","passed":true},{"run_id":"graph-eval-sd_annealed-s101","passed":true},{"run_id":"graph-eval-sd_annealed-s102","passed":true},{"run_id":"graph-eval-sd_annealed-s103","passed":true},{"run_id":"graph-eval-sd_constant-s101","passed":true},{"run_id":"graph-eval-sd_constant-s102","passed":true},{"run_id":"graph-eval-sd_constant-s103","passed":true},{"run_id":"graph-fidelity-source-plain-s101","passed":true},{"run_id":"graph-fidelity-source-plain-s102","passed":true},{"run_id":"graph-fidelity-source-plain-s103","passed":true},{"run_id":"graph-fidelity-source-residual-s101","passed":true},{"run_id":"graph-fidelity-source-residual-s102","passed":true},{"run_id":"graph-fidelity-source-residual-s103","passed":true},{"run_id":"graph-fidelity-source-sd-s101","passed":true},{"run_id":"graph-fidelity-source-sd-s102","passed":true},{"run_id":"graph-fidelity-source-sd-s103","passed":true},{"run_id":"graph-tune-plain-lr0.01","passed":true},{"run_id":"graph-tune-plain-lr0.03","passed":true},{"run_id":"graph-tune-plain-lr0.1","passed":true},{"run_id":"graph-tune-residual-lr0.01","passed":true},{"run_id":"graph-tune-residual-lr0.03","passed":true},{"run_id":"graph-tune-residual-lr0.1","passed":true},{"run_id":"graph-tune-residual_unit_dropout-lr0.01","passed":true},{"run_id":"graph-tune-residual_unit_dropout-lr0.03","passed":true},{"run_id":"graph-tune-residual_unit_dropout-lr0.1","passed":true},{"run_id":"graph-tune-sd_annealed-lr0.01","passed":true},{"run_id":"graph-tune-sd_annealed-lr0.03","passed":true},{"run_id":"graph-tune-sd_annealed-lr0.1","passed":true},{"run_id":"graph-tune-sd_constant-lr0.01","passed":true},{"run_id":"graph-tune-sd_constant-lr0.03","passed":true},{"run_id":"graph-tune-sd_constant-lr0.1","passed":true}],"tuning_manifest_hash_matches":true}},"counts":{"evaluate":24,"tune":15,"pilot":6},"source_files":[{"file":"graph-eval-plain-s101.json","run_id":"graph-eval-plain-s101","sha256":"fc8928a6121cf8e7a2808d5025e9990eab8cefbf1e0fff92af40a3c46ccf4939"},{"file":"graph-eval-plain-s102.json","run_id":"graph-eval-plain-s102","sha256":"7ef024e92795c7acdd9956a74e553f9393d662c2b0b8ba08014036d26f091c91"},{"file":"graph-eval-plain-s103.json","run_id":"graph-eval-plain-s103","sha256":"c6460d176950a86cff04c698bf3a5e4a74d3e95bb2b8c442ac3309fecf501213"},{"file":"graph-eval-residual-s101.json","run_id":"graph-eval-residual-s101","sha256":"fe619114848785e3c30051ef64298fcdebac62677cd911eb4f290c51155fac39"},{"file":"graph-eval-residual-s102.json","run_id":"graph-eval-residual-s102","sha256":"62a0410e4d65211e47150addd59f001e8f930bf1a34115109867bcf8140f50ab"},{"file":"graph-eval-residual-s103.json","run_id":"graph-eval-residual-s103","sha256":"29b4d0a2989b4dc0ae9baf103eebb0a61913599e1b60026bb14e28a756b66bb5"},{"file":"graph-eval-residual_unit_dropout-s101.json","run_id":"graph-eval-residual_unit_dropout-s101","sha256":"a2cff196860cf892cac8e1079cda0be32cc82778d390119e0f0ae4120ae27bcd"},{"file":"graph-eval-residual_unit_dropout-s102.json","run_id":"graph-eval-residual_unit_dropout-s102","sha256":"057cb0f41d53c773755dd796355f8d6109b37163dc7db038ecec4ce58491ac7f"},{"file":"graph-eval-residual_unit_dropout-s103.json","run_id":"graph-eval-residual_unit_dropout-s103","sha256":"bdf01e637e82c343ae9def157a544f2727fd41fc1347ac5acafd7ecd2c599f07"},{"file":"graph-eval-sd_annealed-s101.json","run_id":"graph-eval-sd_annealed-s101","sha256":"3469bd70bd03fc1b0a07868f7348c8a8f1921b9d5313bbfb9f37e15f7cd70c7a"},{"file":"graph-eval-sd_annealed-s102.json","run_id":"graph-eval-sd_annealed-s102","sha256":"ff3505ee0fe5952a81a1abc57b103b76eb1e8a20f66f7c4b6d87bb9647d67eed"},{"file":"graph-eval-sd_annealed-s103.json","run_id":"graph-eval-sd_annealed-s103","sha256":"cf48c318ae956e822dbe1a313819479ae687d3614c1994e6111c369e7983cb06"},{"file":"graph-eval-sd_constant-s101.json","run_id":"graph-eval-sd_constant-s101","sha256":"092c055f120d9044df072d756bf7ae5ca3b6d1e2eabcc8a1935074f2c8cea817"},{"file":"graph-eval-sd_constant-s102.json","run_id":"graph-eval-sd_constant-s102","sha256":"f53d6c00ad2bbbb9e436121fd2b7dd8c1041d0def849282feb495558d8475261"},{"file":"graph-eval-sd_constant-s103.json","run_id":"graph-eval-sd_constant-s103","sha256":"6f33d71a0b3df47c5095bf732b47172ef6b43b5332b6351e8bc9710f56eec666"},{"file":"graph-fidelity-source-plain-s101.json","run_id":"graph-fidelity-source-plain-s101","sha256":"558b07b345ba4dda09bcb719ca9984e038e99ed112e5ef6149844b74be4c4c1c"},{"file":"graph-fidelity-source-plain-s102.json","run_id":"graph-fidelity-source-plain-s102","sha256":"82aee3798104d051104d96ab139a55b11693b480766f72702d7d2342a655bf08"},{"file":"graph-fidelity-source-plain-s103.json","run_id":"graph-fidelity-source-plain-s103","sha256":"549108b4c498494928986ea3a567ebc61ea5d726f1cef3502f38e8773e31d2e6"},{"file":"graph-fidelity-source-residual-s101.json","run_id":"graph-fidelity-source-residual-s101","sha256":"9840b14b64aab7af85bde0e1b13add5d31b922c4279a8efeb54dbdb80b493cb1"},{"file":"graph-fidelity-source-residual-s102.json","run_id":"graph-fidelity-source-residual-s102","sha256":"ce4a0ab1ea1c931808cfe079a005fbf453f0578084d888a119c6432439f56614"},{"file":"graph-fidelity-source-residual-s103.json","run_id":"graph-fidelity-source-residual-s103","sha256":"f5c6324f317eb3b86d4ecd9530d61b0c1c8e0bdc729e1093b137e312ae9e81fa"},{"file":"graph-fidelity-source-sd-s101.json","run_id":"graph-fidelity-source-sd-s101","sha256":"2177272e90cce2499066ed3f2a07f1470ef30003e74f7ffde28c6bd6faebd07e"},{"file":"graph-fidelity-source-sd-s102.json","run_id":"graph-fidelity-source-sd-s102","sha256":"43187e0a3d248e85962b41861aeb4967da3b7b9472e3095dd8ca8992575d62a6"},{"file":"graph-fidelity-source-sd-s103.json","run_id":"graph-fidelity-source-sd-s103","sha256":"7325b9c703eb1e93a7f911d25ba5af19fb5e1ea37e3bbb01e7a38407968a5d38"},{"file":"graph-tune-plain-lr0.01.json","run_id":"graph-tune-plain-lr0.01","sha256":"ecf3007ad8be09e76410b7297a72613252a3bdd2886f8df9a6fbabee48021ac9"},{"file":"graph-tune-plain-lr0.03.json","run_id":"graph-tune-plain-lr0.03","sha256":"1012d4462d65724a956b4a0b3e53f9e5d7777143821001f27ac818bf78dd956f"},{"file":"graph-tune-plain-lr0.1.json","run_id":"graph-tune-plain-lr0.1","sha256":"2a129b27945225df4ca733508575a84a4f8f8428e6b4f74766ae0a451ba10631"},{"file":"graph-tune-residual-lr0.01.json","run_id":"graph-tune-residual-lr0.01","sha256":"cd391e00ae69c44280d46383d0c9bd3f1380608dc70fa5a8c3a53720014537c9"},{"file":"graph-tune-residual-lr0.03.json","run_id":"graph-tune-residual-lr0.03","sha256":"f23c57038f670da085a1bf09f10565b243ee2ce22640f08a76d5a8ee1658156c"},{"file":"graph-tune-residual-lr0.1.json","run_id":"graph-tune-residual-lr0.1","sha256":"a7ece97324dd241af5be58503af16e6314e0a84a9fa3f003e340bf2c3bdad00a"},{"file":"graph-tune-residual_unit_dropout-lr0.01.json","run_id":"graph-tune-residual_unit_dropout-lr0.01","sha256":"67b7ee7159296726fd53a3a0f640b872c436725917b2659f2b0240101ab1269a"},{"file":"graph-tune-residual_unit_dropout-lr0.03.json","run_id":"graph-tune-residual_unit_dropout-lr0.03","sha256":"d93a3786807b9e4a8abb0cb1303ca8a2e7c1bdd75e567a9840431cc8ce366b74"},{"file":"graph-tune-residual_unit_dropout-lr0.1.json","run_id":"graph-tune-residual_unit_dropout-lr0.1","sha256":"94201eae0e842139eb4def9487b8b53ef18ec1fc2e76c52175015126b9299c7a"},{"file":"graph-tune-sd_annealed-lr0.01.json","run_id":"graph-tune-sd_annealed-lr0.01","sha256":"bf2e6d6ec5f6fd10535bfd4d208da5825e7cdccb391e18fdbc05f64347f407cb"},{"file":"graph-tune-sd_annealed-lr0.03.json","run_id":"graph-tune-sd_annealed-lr0.03","sha256":"7089ae92f258ea8fc07561d2cfbf84ca8d42738b3c593283f41575df2601fa99"},{"file":"graph-tune-sd_annealed-lr0.1.json","run_id":"graph-tune-sd_annealed-lr0.1","sha256":"82b76bd24513ee2e42feee995c7e2081db2f4586e395827e10b83dcfc25ed36e"},{"file":"graph-tune-sd_constant-lr0.01.json","run_id":"graph-tune-sd_constant-lr0.01","sha256":"cc102e730f5b75bd105797e7c92a42219202c3438393a9bbee240d73873fa87c"},{"file":"graph-tune-sd_constant-lr0.03.json","run_id":"graph-tune-sd_constant-lr0.03","sha256":"471895473e68d3f057d9f4a768d616bef25ad43a48c8c24fd5622c34be254f9c"},{"file":"graph-tune-sd_constant-lr0.1.json","run_id":"graph-tune-sd_constant-lr0.1","sha256":"8685fb2df072339201bd69fed589a9bfcfd5bd613c6716538aeceaf62c02e19e"},{"file":"pilot-normalized-plain.json","run_id":"pilot-normalized-plain","sha256":"d16a83571b89f88ad5324d7e031fb52b3d98b717d5016f199dee924af5b48f1c"},{"file":"pilot-normalized-residual.json","run_id":"pilot-normalized-residual","sha256":"5c05a80f4b9b792b2ca6730ba3d5f625387db9836c7e9aba5bb467096b208b46"},{"file":"pilot-normalized-sd.json","run_id":"pilot-normalized-sd","sha256":"672efaa4f1ccb8a22613ef8aa0e30369cc769eb4a7891c7949fe218b383a20be"},{"file":"pilot-source-linear.json","run_id":"pilot-source-linear","sha256":"e11e2c09691fe444be112a1d3b3a7426d2792567be987ab365e8c3aa882b0839"},{"file":"pilot-source-plain.json","run_id":"pilot-source-plain","sha256":"40b6e6e3ce2969d04534b7ab4e6b72bff2f384207d5227166e9d441b2d4a8721"},{"file":"pilot-source-residual.json","run_id":"pilot-source-residual","sha256":"9957ed67a913c53fa6f6502ba2de6a5028e43b8cec1683fd711fc6531c6e8606"}],"manifests":[{"file":"pilot-manifest.json","sha256":"872c0021fd88541afc42c9d8b5e83e427e5e372dae5bbf379f89ac347f3fd3f3","runs":6},{"file":"graph-tune-manifest.json","sha256":"18372da13f6b1876ae5682020e0083d08c020b88088cb003f2336299a6e04ed1","runs":15},{"file":"final-manifest.json","sha256":"6991448261384c466b7fb1614f75daaeddb5378feedee69ef1d8a9e7279a2972","runs":24}],"failures":[{"run_id":"graph-tune-residual_unit_dropout-lr0.1","code":"training_diverged"},{"run_id":"graph-tune-sd_annealed-lr0.1","code":"training_diverged"},{"run_id":"graph-tune-sd_constant-lr0.1","code":"training_diverged"}],"scope":{"included_manifest_names":["pilot-manifest.json","graph-tune-manifest.json","final-manifest.json"],"excluded_result_filenames":["billing-latest.json","budget-ledger.json","collapse-diagnostic.json","dataset-manifest.json","graph-qualification-v1.json","opt-compile-214-v1.json","opt-compile-214-v2.json","opt-compile-214-v3.json","opt-confirm-b256-bf16-s1.json","opt-confirm-b256-bf16-s101.json","opt-confirm-b256-bf16-s102.json","opt-confirm-b256-bf16-s103.json","opt-confirm-b256-bf16-s104.json","opt-confirm-b256-bf16-s105.json","opt-confirm-normalized-dropout-step-s101.json","opt-confirm-normalized-dropout-step-s102.json","opt-confirm-normalized-dropout-step-s103.json","opt-confirm-raw-linear-dropout-step-s101.json","opt-confirm-raw-linear-dropout-step-s102.json","opt-confirm-raw-linear-dropout-step-s103.json","opt-diagnostic-seed104-linear.json","opt-diagnostic-seed104-relu.json","opt-kernels-214-v1.json","opt-kernels-214-v2.json","opt-recipe-b1024-linear-bf16-s1.json","opt-recipe-b256-linear-s1.json","opt-recipe-b256-lower-lr-s1.json","opt-recipe-b256-stronger-shrink-s1.json","opt-recipe-b512-linear-bf16-s1.json","opt-recipe-b512-lower-lr-s1.json","opt-speed-eager-tf32-b64-s1.json","opt-speed-fused-bf16-b128-s1.json","opt-speed-fused-bf16-b256-s1.json","opt-speed-fused-bf16-b512-s1.json","opt-speed-fused-bf16-b64-s1.json","opt-speed-fused-tf32-b256-s1.json","opt-speed-fused-tf32-b64-s1.json","opt-speed-graph-tf32-b64-s1.json","opt-stable-linear-dropout-s1.json","opt-stable-linear-dropout-step-s1.json","opt-stable-linear-step-fp32-s1.json","opt-stable-linear-step-s1.json","opt-stable-normalized-dropout-step-s1.json","opt-stable-relu-step-s1.json","optimization-analysis.json","tune-plain-lr0.01.json","tune-plain-lr0.03.json","tune-plain-lr0.1.json","tune-residual-lr0.01.json","tune-residual-lr0.03.json","tune-residual-lr0.1.json","tune-sd_annealed-lr0.01.json","tune-sd_annealed-lr0.03.json","tune-sd_constant-lr0.01.json","tune-sd_constant-lr0.03.json","tune-sd_constant-lr0.1.json"],"interpretation":"Only pilot-manifest.json, graph-tune-manifest.json and the explicit final manifest authorize result reads. Other filenames are listed without opening their contents; archived old tuning, optimization and qualification do not enter study selection or outcomes."},"selection":{"selection_file":{"file":"selection.json","sha256":"4ff7d753840ffca7aca6a747ab9d289ea49c9f8bd40acfaac50ecb952959d9a3"},"selected_learning_rates":{"plain":0.03,"residual":0.01,"sd_constant":0.01,"sd_annealed":0.01,"residual_unit_dropout":0.01},"candidates":[{"run_id":"graph-tune-plain-lr0.01","recipe":"plain","seed":1,"lr":0.01,"status":"ok","selected_epoch":5,"best_validation_loss":0.09332907104492187,"accuracy_at_best_validation_loss_pct":97.41},{"run_id":"graph-tune-plain-lr0.03","recipe":"plain","seed":1,"lr":0.03,"status":"ok","selected_epoch":5,"best_validation_loss":0.0866325439453125,"accuracy_at_best_validation_loss_pct":97.72999999999999},{"run_id":"graph-tune-plain-lr0.1","recipe":"plain","seed":1,"lr":0.1,"status":"ok","selected_epoch":5,"best_validation_loss":0.107379052734375,"accuracy_at_best_validation_loss_pct":97.58},{"run_id":"graph-tune-residual-lr0.01","recipe":"residual","seed":1,"lr":0.01,"status":"ok","selected_epoch":5,"best_validation_loss":0.07866966552734375,"accuracy_at_best_validation_loss_pct":97.82},{"run_id":"graph-tune-residual-lr0.03","recipe":"residual","seed":1,"lr":0.03,"status":"ok","selected_epoch":5,"best_validation_loss":0.09070323486328125,"accuracy_at_best_validation_loss_pct":97.58},{"run_id":"graph-tune-residual-lr0.1","recipe":"residual","seed":1,"lr":0.1,"status":"ok","selected_epoch":25,"best_validation_loss":0.1134759765625,"accuracy_at_best_validation_loss_pct":98.3},{"run_id":"graph-tune-residual_unit_dropout-lr0.01","recipe":"residual_unit_dropout","seed":1,"lr":0.01,"status":"ok","selected_epoch":15,"best_validation_loss":0.08553690795898437,"accuracy_at_best_validation_loss_pct":98.11},{"run_id":"graph-tune-residual_unit_dropout-lr0.03","recipe":"residual_unit_dropout","seed":1,"lr":0.03,"status":"ok","selected_epoch":5,"best_validation_loss":0.08573321533203125,"accuracy_at_best_validation_loss_pct":97.78},{"run_id":"graph-tune-residual_unit_dropout-lr0.1","recipe":"residual_unit_dropout","seed":1,"lr":0.1,"status":"diverged","selected_epoch":null,"best_validation_loss":null,"accuracy_at_best_validation_loss_pct":null},{"run_id":"graph-tune-sd_annealed-lr0.01","recipe":"sd_annealed","seed":1,"lr":0.01,"status":"ok","selected_epoch":15,"best_validation_loss":0.0804996337890625,"accuracy_at_best_validation_loss_pct":98.08},{"run_id":"graph-tune-sd_annealed-lr0.03","recipe":"sd_annealed","seed":1,"lr":0.03,"status":"ok","selected_epoch":20,"best_validation_loss":0.08432885131835938,"accuracy_at_best_validation_loss_pct":98.04},{"run_id":"graph-tune-sd_annealed-lr0.1","recipe":"sd_annealed","seed":1,"lr":0.1,"status":"diverged","selected_epoch":null,"best_validation_loss":null,"accuracy_at_best_validation_loss_pct":null},{"run_id":"graph-tune-sd_constant-lr0.01","recipe":"sd_constant","seed":1,"lr":0.01,"status":"ok","selected_epoch":10,"best_validation_loss":0.07920894775390624,"accuracy_at_best_validation_loss_pct":98.03},{"run_id":"graph-tune-sd_constant-lr0.03","recipe":"sd_constant","seed":1,"lr":0.03,"status":"ok","selected_epoch":5,"best_validation_loss":0.0805029052734375,"accuracy_at_best_validation_loss_pct":97.84},{"run_id":"graph-tune-sd_constant-lr0.1","recipe":"sd_constant","seed":1,"lr":0.1,"status":"diverged","selected_epoch":null,"best_validation_loss":null,"accuracy_at_best_validation_loss_pct":null}],"audits":[{"recipe":"plain","selected_lr":0.03,"ce_selection_verified":true,"lowest_validation_ce_run_ids":["graph-tune-plain-lr0.03"]},{"recipe":"residual","selected_lr":0.01,"ce_selection_verified":true,"lowest_validation_ce_run_ids":["graph-tune-residual-lr0.01"]},{"recipe":"residual_unit_dropout","selected_lr":0.01,"ce_selection_verified":true,"lowest_validation_ce_run_ids":["graph-tune-residual_unit_dropout-lr0.01"]},{"recipe":"sd_annealed","selected_lr":0.01,"ce_selection_verified":true,"lowest_validation_ce_run_ids":["graph-tune-sd_annealed-lr0.01"]},{"recipe":"sd_constant","selected_lr":0.01,"ce_selection_verified":true,"lowest_validation_ce_run_ids":["graph-tune-sd_constant-lr0.01"]}],"candidate_source_hashes_verified":true,"criterion":"Among completed nondiverged candidates, lowest validation CE over scheduled checkpoints, then lower LR for an exact tie; accuracy does not select LR."},"cohorts":{"main":{"groups":{"plain":{"label":"Plain MLP","run_ids":["graph-eval-plain-s101","graph-eval-plain-s102","graph-eval-plain-s103"],"valid_run_ids":["graph-eval-plain-s101","graph-eval-plain-s102","graph-eval-plain-s103"],"seeds":[101,102,103],"n":3,"selected_learning_rates":[0.03],"failure_count":0,"metrics":{"training_seconds":{"n":3,"mean":62.26581861033331,"sample_sd":0.34205655834904264,"values":[62.66078952299994,62.06725023199999,62.069416075999996]},"total_run_seconds":{"n":3,"mean":64.62865934566666,"sample_sd":0.35940982084587647,"values":[65.040802399,64.380409661,64.464765977]},"selected_epoch":{"n":3,"mean":8.333333333333334,"sample_sd":2.8867513459481287,"values":[5.0,10.0,10.0]},"selected_training_seconds":{"n":3,"mean":5.218785857333334,"sample_sd":1.7770303756556711,"values":[3.1668497759999985,6.242367563,6.247140233000003]},"epoch_to_validation_98":{"n":3,"mean":15.0,"sample_sd":5.0,"values":[15.0,10.0,20.0]},"training_seconds_to_validation_98":{"n":3,"mean":9.370181363333334,"sample_sd":3.100670486970631,"values":[9.425200231999998,6.242367563,12.442976295000003]},"final_stochastic_training_loss":{"n":3,"mean":1.3846096180714085e-06,"sample_sd":2.9032601999041216e-08,"values":[1.3511548786482308e-06,1.4032017361387261e-06,1.3994722394272685e-06]},"parameter_count":{"n":3,"mean":11972510.0,"sample_sd":0.0,"values":[11972510.0,11972510.0,11972510.0]},"training_examples_per_epoch":{"n":3,"mean":49984.0,"sample_sd":0.0,"values":[49984.0,49984.0,49984.0]},"steps_per_epoch":{"n":3,"mean":781.0,"sample_sd":0.0,"values":[781.0,781.0,781.0]},"epoch_preparation_seconds":{"n":3,"mean":0.25776682033333626,"sample_sd":0.021566244130854464,"values":[0.23657420100003446,0.2570380449999998,0.2796882149999744]},"graph_setup_seconds":{"n":3,"mean":0.5088037759999997,"sample_sd":0.027060848412514972,"values":[0.5377813729999996,0.4841900739999998,0.5044398809999997]}},"endpoints":{"selected":{"train":{"loss":{"n":3,"mean":0.016260492350260416,"sample_sd":0.013268666560775041,"values":[0.0309840185546875,0.00522846435546875,0.012568994140625]},"accuracy_pct":{"n":3,"mean":99.50933333333333,"sample_sd":0.41052324335333007,"values":[99.05199999999999,99.846,99.63]},"example_counts":[50000]},"validation":{"loss":{"n":3,"mean":0.09096935221354167,"sample_sd":0.007098887208903928,"values":[0.09530687255859376,0.082777001953125,0.09482418212890625]},"accuracy_pct":{"n":3,"mean":97.76666666666667,"sample_sd":0.35571524191877807,"values":[97.38,98.08,97.84]},"example_counts":[10000]},"test":{"loss":{"n":3,"mean":0.08529521484375,"sample_sd":0.009225420487819066,"values":[0.08981358642578124,0.074681591796875,0.09139046630859375]},"accuracy_pct":{"n":3,"mean":97.91333333333334,"sample_sd":0.33246553706111037,"values":[97.56,98.22,97.96000000000001]},"errors":{"n":3,"mean":208.66666666666666,"sample_sd":33.24655370611116,"values":[244.0,178.0,204.0]},"example_counts":[10000]},"dense_train_probe":{"loss":{"n":3,"mean":0.014864367675781249,"sample_sd":0.012174036494897615,"values":[0.028665936279296873,0.005651724243164062,0.010275442504882812]},"accuracy_pct":{"n":3,"mean":99.54666666666667,"sample_sd":0.4045161719058106,"values":[99.09,99.86,99.69]},"example_counts":[10000]},"generalization":{"validation_minus_train_loss":{"n":3,"mean":0.07470885986328125,"sample_sd":0.009297310243189775,"values":[0.06432285400390625,0.07754853759765624,0.08225518798828126]},"test_minus_train_loss":{"n":3,"mean":0.06903472249348958,"sample_sd":0.010002517502068327,"values":[0.058829567871093745,0.06945312744140625,0.07882147216796875]},"train_minus_validation_accuracy_pp":{"n":3,"mean":1.7426666666666628,"sample_sd":0.062364519827649276,"values":[1.6719999999999957,1.766000000000001,1.7899999999999916]},"train_minus_test_accuracy_pp":{"n":3,"mean":1.5959999999999974,"sample_sd":0.09271461589199614,"values":[1.4919999999999933,1.6260000000000052,1.6699999999999937]}}},"final":{"train":{"loss":{"n":3,"mean":1.371540129184723e-06,"sample_sd":2.926181096914555e-08,"values":[1.3377690315246583e-06,1.389368176460266e-06,1.3874831795692444e-06]},"accuracy_pct":{"n":3,"mean":100.0,"sample_sd":0.0,"values":[100.0,100.0,100.0]},"example_counts":[50000]},"validation":{"loss":{"n":3,"mean":0.12921027018229167,"sample_sd":0.006195588118883112,"values":[0.1359433837890625,0.12793756103515624,0.12374986572265625]},"accuracy_pct":{"n":3,"mean":98.38333333333333,"sample_sd":0.056862407030774866,"values":[98.32,98.4,98.42999999999999]},"example_counts":[10000]},"test":{"loss":{"n":3,"mean":0.11157829996744792,"sample_sd":0.006422388762742991,"values":[0.10615570068359376,0.118670654296875,0.109908544921875]},"accuracy_pct":{"n":3,"mean":98.57333333333334,"sample_sd":0.02516611478422706,"values":[98.55000000000001,98.57000000000001,98.6]},"errors":{"n":3,"mean":142.66666666666666,"sample_sd":2.516611478423583,"values":[145.0,143.0,140.0]},"example_counts":[10000]},"dense_train_probe":{"loss":{"n":3,"mean":1.5134857346614202e-06,"sample_sd":2.748894835267908e-08,"values":[1.508619450032711e-06,1.4887548983097076e-06,1.5430828556418418e-06]},"accuracy_pct":{"n":3,"mean":100.0,"sample_sd":0.0,"values":[100.0,100.0,100.0]},"example_counts":[10000]},"generalization":{"validation_minus_train_loss":{"n":3,"mean":0.12920889864216248,"sample_sd":0.006195615326161016,"values":[0.135942046020031,0.1279361716669798,0.12374847823947668]},"test_minus_train_loss":{"n":3,"mean":0.11157692842731873,"sample_sd":0.006422366734444103,"values":[0.10615436291456223,0.11866926492869853,0.10990715743869543]},"train_minus_validation_accuracy_pp":{"n":3,"mean":1.61666666666667,"sample_sd":0.056862407030773186,"values":[1.6800000000000037,1.6000000000000014,1.5700000000000047]},"train_minus_test_accuracy_pp":{"n":3,"mean":1.426666666666665,"sample_sd":0.02516611478423306,"values":[1.4499999999999957,1.429999999999998,1.4000000000000012]}}}},"timing_by_hardware":[{"hardware":{"cpu_threads":2,"cuda_runtime":"13.0","dtype":"float32","float32_matmul_precision":"high","gpu":"NVIDIA A100-SXM4-40GB","tf32":true,"torch":"2.14.0+cu130"},"source_sha256":{"model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41","train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d"},"run_ids":["graph-eval-plain-s101","graph-eval-plain-s102","graph-eval-plain-s103"],"seeds":[101,102,103],"metrics":{"training_seconds":{"n":3,"mean":62.26581861033331,"sample_sd":0.34205655834904264,"values":[62.66078952299994,62.06725023199999,62.069416075999996]},"total_run_seconds":{"n":3,"mean":64.62865934566666,"sample_sd":0.35940982084587647,"values":[65.040802399,64.380409661,64.464765977]},"selected_training_seconds":{"n":3,"mean":5.218785857333334,"sample_sd":1.7770303756556711,"values":[3.1668497759999985,6.242367563,6.247140233000003]},"training_seconds_to_validation_98":{"n":3,"mean":9.370181363333334,"sample_sd":3.100670486970631,"values":[9.425200231999998,6.242367563,12.442976295000003]},"epoch_preparation_seconds":{"n":3,"mean":0.25776682033333626,"sample_sd":0.021566244130854464,"values":[0.23657420100003446,0.2570380449999998,0.2796882149999744]},"graph_setup_seconds":{"n":3,"mean":0.5088037759999997,"sample_sd":0.027060848412514972,"values":[0.5377813729999996,0.4841900739999998,0.5044398809999997]}}}],"timing_interpretation":"Pooled runtime means are descriptive across assigned workers. Use timing_by_hardware and hardware-matched seed pairs for speed comparisons; hardware assignment was not randomized.","validation_98":{"reached":3,"not_reached":0,"interpretation":"First scheduled validation observation >=98%; means include achievers only, not unreached/censored runs."}},"residual":{"label":"Residual dense","run_ids":["graph-eval-residual-s101","graph-eval-residual-s102","graph-eval-residual-s103"],"valid_run_ids":["graph-eval-residual-s101","graph-eval-residual-s102","graph-eval-residual-s103"],"seeds":[101,102,103],"n":3,"selected_learning_rates":[0.01],"failure_count":0,"metrics":{"training_seconds":{"n":3,"mean":66.37749733133334,"sample_sd":0.28280928177025955,"values":[66.39346609800003,66.65198389999996,66.08704199600002]},"total_run_seconds":{"n":3,"mean":69.043039708,"sample_sd":0.5286591386923497,"values":[69.289195148,69.40373477499999,68.436189201]},"selected_epoch":{"n":3,"mean":10.0,"sample_sd":0.0,"values":[10.0,10.0,10.0]},"selected_training_seconds":{"n":3,"mean":6.687019798666667,"sample_sd":0.028515422298560664,"values":[6.697065197000002,6.709153070999998,6.654841128000001]},"epoch_to_validation_98":{"n":3,"mean":10.0,"sample_sd":0.0,"values":[10.0,10.0,10.0]},"training_seconds_to_validation_98":{"n":3,"mean":6.687019798666667,"sample_sd":0.028515422298560664,"values":[6.697065197000002,6.709153070999998,6.654841128000001]},"final_stochastic_training_loss":{"n":3,"mean":7.753032150503714e-06,"sample_sd":9.127947281229259e-08,"values":[7.716164873272646e-06,7.856979209464043e-06,7.685952368774451e-06]},"parameter_count":{"n":3,"mean":11972510.0,"sample_sd":0.0,"values":[11972510.0,11972510.0,11972510.0]},"training_examples_per_epoch":{"n":3,"mean":49984.0,"sample_sd":0.0,"values":[49984.0,49984.0,49984.0]},"steps_per_epoch":{"n":3,"mean":781.0,"sample_sd":0.0,"values":[781.0,781.0,781.0]},"epoch_preparation_seconds":{"n":3,"mean":0.3433047616667002,"sample_sd":0.09330850679411022,"values":[0.42535296200006467,0.36275831900002853,0.24180300400000743]},"graph_setup_seconds":{"n":3,"mean":0.5365181886666669,"sample_sd":0.025452332754717446,"values":[0.5471660720000004,0.5074710900000001,0.5549174040000002]}},"endpoints":{"selected":{"train":{"loss":{"n":3,"mean":0.0009733600362141927,"sample_sd":0.00033190401188562833,"values":[0.0006481150817871094,0.0013115446472167969,0.0009604203796386719]},"accuracy_pct":{"n":3,"mean":99.984,"sample_sd":0.00871779788708548,"values":[99.99,99.97399999999999,99.988]},"example_counts":[50000]},"validation":{"loss":{"n":3,"mean":0.08215002848307291,"sample_sd":0.003800087323493867,"values":[0.07871497802734374,0.086232080078125,0.08150302734375]},"accuracy_pct":{"n":3,"mean":98.18333333333334,"sample_sd":0.05507570547286769,"values":[98.24000000000001,98.13,98.18]},"example_counts":[10000]},"test":{"loss":{"n":3,"mean":0.0737675557454427,"sample_sd":0.00716163040458154,"values":[0.06685361328125,0.08115352172851563,0.0732955322265625]},"accuracy_pct":{"n":3,"mean":98.37333333333333,"sample_sd":0.06658328118479243,"values":[98.42999999999999,98.3,98.39]},"errors":{"n":3,"mean":162.66666666666666,"sample_sd":6.6583281184793925,"values":[157.0,170.0,161.0]},"example_counts":[10000]},"dense_train_probe":{"loss":{"n":3,"mean":0.0008418276786804199,"sample_sd":0.00023008598334052266,"values":[0.0005857361793518066,0.0010311304092407226,0.0009086164474487305]},"accuracy_pct":{"n":3,"mean":99.98666666666666,"sample_sd":0.005773502691891007,"values":[99.99,99.99,99.98]},"example_counts":[10000]},"generalization":{"validation_minus_train_loss":{"n":3,"mean":0.08117666844685872,"sample_sd":0.0034705521328808986,"values":[0.07806686294555663,0.0849205354309082,0.08054260696411134]},"test_minus_train_loss":{"n":3,"mean":0.07279419570922852,"sample_sd":0.006829821195914346,"values":[0.06620549819946289,0.07984197708129884,0.07233511184692383]},"train_minus_validation_accuracy_pp":{"n":3,"mean":1.8006666666666653,"sample_sd":0.04742713709822233,"values":[1.749999999999996,1.8440000000000012,1.8079999999999985]},"train_minus_test_accuracy_pp":{"n":3,"mean":1.6106666666666676,"sample_sd":0.05804595880277025,"values":[1.5600000000000058,1.6739999999999977,1.5979999999999994]}}},"final":{"train":{"loss":{"n":3,"mean":7.638381123542785e-06,"sample_sd":8.468503695588692e-08,"values":[7.610405683517456e-06,7.733514308929443e-06,7.571223378181458e-06]},"accuracy_pct":{"n":3,"mean":100.0,"sample_sd":0.0,"values":[100.0,100.0,100.0]},"example_counts":[50000]},"validation":{"loss":{"n":3,"mean":0.11458976236979167,"sample_sd":0.0014901811271410374,"values":[0.1132458740234375,0.1143310546875,0.1161923583984375]},"accuracy_pct":{"n":3,"mean":98.27,"sample_sd":0.026457513110643326,"values":[98.25,98.3,98.26]},"example_counts":[10000]},"test":{"loss":{"n":3,"mean":0.09722737426757813,"sample_sd":0.005616402520450987,"values":[0.09158612060546875,0.10281859130859375,0.09727741088867188]},"accuracy_pct":{"n":3,"mean":98.4,"sample_sd":0.0,"values":[98.4,98.4,98.4]},"errors":{"n":3,"mean":160.0,"sample_sd":0.0,"values":[160.0,160.0,160.0]},"example_counts":[10000]},"dense_train_probe":{"loss":{"n":3,"mean":7.830071200927098e-06,"sample_sd":2.3391554291971755e-07,"values":[7.73824155330658e-06,7.656004279851914e-06,8.095967769622803e-06]},"accuracy_pct":{"n":3,"mean":100.0,"sample_sd":0.0,"values":[100.0,100.0,100.0]},"example_counts":[10000]},"generalization":{"validation_minus_train_loss":{"n":3,"mean":0.11458212398866813,"sample_sd":0.0014902128845950082,"values":[0.11323826361775398,0.11432332117319108,0.11618478717505933]},"test_minus_train_loss":{"n":3,"mean":0.09721973588645459,"sample_sd":0.005616341417008555,"values":[0.09157851019978523,0.10281085779428482,0.0972698396652937]},"train_minus_validation_accuracy_pp":{"n":3,"mean":1.7299999999999982,"sample_sd":0.026457513110642993,"values":[1.749999999999996,1.7000000000000015,1.739999999999997]},"train_minus_test_accuracy_pp":{"n":3,"mean":1.6000000000000014,"sample_sd":0.0,"values":[1.6000000000000014,1.6000000000000014,1.6000000000000014]}}}},"timing_by_hardware":[{"hardware":{"cpu_threads":2,"cuda_runtime":"13.0","dtype":"float32","float32_matmul_precision":"high","gpu":"NVIDIA A100-SXM4-40GB","tf32":true,"torch":"2.14.0+cu130"},"source_sha256":{"model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41","train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d"},"run_ids":["graph-eval-residual-s101","graph-eval-residual-s102","graph-eval-residual-s103"],"seeds":[101,102,103],"metrics":{"training_seconds":{"n":3,"mean":66.37749733133334,"sample_sd":0.28280928177025955,"values":[66.39346609800003,66.65198389999996,66.08704199600002]},"total_run_seconds":{"n":3,"mean":69.043039708,"sample_sd":0.5286591386923497,"values":[69.289195148,69.40373477499999,68.436189201]},"selected_training_seconds":{"n":3,"mean":6.687019798666667,"sample_sd":0.028515422298560664,"values":[6.697065197000002,6.709153070999998,6.654841128000001]},"training_seconds_to_validation_98":{"n":3,"mean":6.687019798666667,"sample_sd":0.028515422298560664,"values":[6.697065197000002,6.709153070999998,6.654841128000001]},"epoch_preparation_seconds":{"n":3,"mean":0.3433047616667002,"sample_sd":0.09330850679411022,"values":[0.42535296200006467,0.36275831900002853,0.24180300400000743]},"graph_setup_seconds":{"n":3,"mean":0.5365181886666669,"sample_sd":0.025452332754717446,"values":[0.5471660720000004,0.5074710900000001,0.5549174040000002]}}}],"timing_interpretation":"Pooled runtime means are descriptive across assigned workers. Use timing_by_hardware and hardware-matched seed pairs for speed comparisons; hardware assignment was not randomized.","validation_98":{"reached":3,"not_reached":0,"interpretation":"First scheduled validation observation >=98%; means include achievers only, not unreached/censored runs."}},"residual_unit_dropout":{"label":"Residual + unit dropout","run_ids":["graph-eval-residual_unit_dropout-s101","graph-eval-residual_unit_dropout-s102","graph-eval-residual_unit_dropout-s103"],"valid_run_ids":["graph-eval-residual_unit_dropout-s101","graph-eval-residual_unit_dropout-s102","graph-eval-residual_unit_dropout-s103"],"seeds":[101,102,103],"n":3,"selected_learning_rates":[0.01],"failure_count":0,"metrics":{"training_seconds":{"n":3,"mean":69.02957614333327,"sample_sd":0.051622011571611025,"values":[69.06684382699984,68.9706536939999,69.05123090900008]},"total_run_seconds":{"n":3,"mean":70.386591424,"sample_sd":0.07434945900992976,"values":[70.44327690200001,70.302410441,70.41408692899998]},"selected_epoch":{"n":3,"mean":13.333333333333334,"sample_sd":2.8867513459481287,"values":[15.0,15.0,10.0]},"selected_training_seconds":{"n":3,"mean":9.233558799000008,"sample_sd":2.0017016081532213,"values":[10.387162182999987,10.391320092999962,6.922194121000075]},"epoch_to_validation_98":{"n":3,"mean":13.333333333333334,"sample_sd":2.8867513459481287,"values":[15.0,15.0,10.0]},"training_seconds_to_validation_98":{"n":3,"mean":9.233558799000008,"sample_sd":2.0017016081532213,"values":[10.387162182999987,10.391320092999962,6.922194121000075]},"final_stochastic_training_loss":{"n":3,"mean":0.0009174636652460322,"sample_sd":0.0007917303422284899,"values":[0.00178746716119349,0.00023923903063405305,0.0007256848039105535]},"parameter_count":{"n":3,"mean":11972510.0,"sample_sd":0.0,"values":[11972510.0,11972510.0,11972510.0]},"training_examples_per_epoch":{"n":3,"mean":49984.0,"sample_sd":0.0,"values":[49984.0,49984.0,49984.0]},"steps_per_epoch":{"n":3,"mean":781.0,"sample_sd":0.0,"values":[781.0,781.0,781.0]},"epoch_preparation_seconds":{"n":3,"mean":0.1873968333333759,"sample_sd":0.01348770091035124,"values":[0.17526344500004143,0.2019195160000038,0.1850075390000825]},"graph_setup_seconds":{"n":3,"mean":0.03309078700000138,"sample_sd":0.000868603562839731,"values":[0.03377378700000122,0.03338537299998734,0.03211320100001558]}},"endpoints":{"selected":{"train":{"loss":{"n":3,"mean":0.0046695198567708335,"sample_sd":0.0021009796528306626,"values":[0.00284011474609375,0.0042043408203125,0.00696410400390625]},"accuracy_pct":{"n":3,"mean":99.86133333333333,"sample_sd":0.08471914384206593,"values":[99.928,99.89,99.766]},"example_counts":[50000]},"validation":{"loss":{"n":3,"mean":0.07852590332031249,"sample_sd":0.0013233898368047513,"values":[0.07943436889648438,0.07700753784179687,0.07913580322265625]},"accuracy_pct":{"n":3,"mean":98.13333333333334,"sample_sd":0.11015141094572851,"values":[98.14,98.24000000000001,98.02]},"example_counts":[10000]},"test":{"loss":{"n":3,"mean":0.07140107625325522,"sample_sd":0.004196811216999174,"values":[0.070423388671875,0.07600043334960938,0.06777940673828126]},"accuracy_pct":{"n":3,"mean":98.33,"sample_sd":0.1417744687875756,"values":[98.49,98.28,98.22]},"errors":{"n":3,"mean":167.0,"sample_sd":14.177446878757825,"values":[151.0,172.0,178.0]},"example_counts":[10000]},"dense_train_probe":{"loss":{"n":3,"mean":0.004084326489766439,"sample_sd":0.002198518018921571,"values":[0.0023075422286987306,0.0034024448394775393,0.006542992401123047]},"accuracy_pct":{"n":3,"mean":99.87666666666667,"sample_sd":0.07767453465153673,"values":[99.94,99.9,99.79]},"example_counts":[10000]},"generalization":{"validation_minus_train_loss":{"n":3,"mean":0.07385638346354166,"sample_sd":0.0023919969256135563,"values":[0.07659425415039063,0.07280319702148437,0.07217169921875]},"test_minus_train_loss":{"n":3,"mean":0.06673155639648438,"sample_sd":0.005539720497673935,"values":[0.06758327392578126,0.07179609252929688,0.06081530273437501]},"train_minus_validation_accuracy_pp":{"n":3,"mean":1.7279999999999962,"sample_sd":0.0707389567353078,"values":[1.7879999999999896,1.649999999999996,1.746000000000003]},"train_minus_test_accuracy_pp":{"n":3,"mean":1.5313333333333328,"sample_sd":0.08693292433441936,"values":[1.4379999999999948,1.6100000000000003,1.546000000000003]}}},"final":{"train":{"loss":{"n":3,"mean":0.0015150119283795357,"sample_sd":0.002500268112416067,"values":[0.00013944978713989259,4.563659131526947e-06,0.004401022338867188]},"accuracy_pct":{"n":3,"mean":99.96666666666667,"sample_sd":0.05430776494510271,"values":[99.996,100.0,99.90400000000001]},"example_counts":[50000]},"validation":{"loss":{"n":3,"mean":0.12392521565755209,"sample_sd":0.01197909697171614,"values":[0.1133442626953125,0.12150003662109375,0.13693134765625]},"accuracy_pct":{"n":3,"mean":98.30666666666667,"sample_sd":0.17009801096230945,"values":[98.3,98.48,98.14]},"example_counts":[10000]},"test":{"loss":{"n":3,"mean":0.10307365519205729,"sample_sd":0.005544739893050781,"values":[0.09737022094726562,0.10340599365234375,0.1084447509765625]},"accuracy_pct":{"n":3,"mean":98.50666666666666,"sample_sd":0.11503622617824413,"values":[98.50999999999999,98.61999999999999,98.39]},"errors":{"n":3,"mean":149.33333333333334,"sample_sd":11.50362261782493,"values":[149.0,138.0,161.0]},"example_counts":[10000]},"dense_train_probe":{"loss":{"n":3,"mean":0.0007806729437162479,"sample_sd":0.0013027151775776727,"values":[5.356653928756714e-05,3.8077834993600845e-06,0.0022846445083618164]},"accuracy_pct":{"n":3,"mean":99.98,"sample_sd":0.03464101615137886,"values":[100.0,100.0,99.94]},"example_counts":[10000]},"generalization":{"validation_minus_train_loss":{"n":3,"mean":0.12241020372917255,"sample_sd":0.009695174405444977,"values":[0.11320481290817261,0.12149547296196223,0.13253032531738282]},"test_minus_train_loss":{"n":3,"mean":0.10155864326367775,"sample_sd":0.00376178077454071,"values":[0.09723077116012573,0.10340142999321222,0.10404372863769532]},"train_minus_validation_accuracy_pp":{"n":3,"mean":1.6599999999999986,"sample_sd":0.12592060990957724,"values":[1.6959999999999975,1.5199999999999991,1.763999999999999]},"train_minus_test_accuracy_pp":{"n":3,"mean":1.460000000000002,"sample_sd":0.07068238818828855,"values":[1.4859999999999984,1.3800000000000034,1.5140000000000042]}}}},"timing_by_hardware":[{"hardware":{"cpu_threads":2,"cuda_runtime":"13.0","dtype":"float32","float32_matmul_precision":"high","gpu":"NVIDIA A100-SXM4-40GB","tf32":true,"torch":"2.14.0+cu130"},"source_sha256":{"model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41","train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d"},"run_ids":["graph-eval-residual_unit_dropout-s101","graph-eval-residual_unit_dropout-s102","graph-eval-residual_unit_dropout-s103"],"seeds":[101,102,103],"metrics":{"training_seconds":{"n":3,"mean":69.02957614333327,"sample_sd":0.051622011571611025,"values":[69.06684382699984,68.9706536939999,69.05123090900008]},"total_run_seconds":{"n":3,"mean":70.386591424,"sample_sd":0.07434945900992976,"values":[70.44327690200001,70.302410441,70.41408692899998]},"selected_training_seconds":{"n":3,"mean":9.233558799000008,"sample_sd":2.0017016081532213,"values":[10.387162182999987,10.391320092999962,6.922194121000075]},"training_seconds_to_validation_98":{"n":3,"mean":9.233558799000008,"sample_sd":2.0017016081532213,"values":[10.387162182999987,10.391320092999962,6.922194121000075]},"epoch_preparation_seconds":{"n":3,"mean":0.1873968333333759,"sample_sd":0.01348770091035124,"values":[0.17526344500004143,0.2019195160000038,0.1850075390000825]},"graph_setup_seconds":{"n":3,"mean":0.03309078700000138,"sample_sd":0.000868603562839731,"values":[0.03377378700000122,0.03338537299998734,0.03211320100001558]}}}],"timing_interpretation":"Pooled runtime means are descriptive across assigned workers. Use timing_by_hardware and hardware-matched seed pairs for speed comparisons; hardware assignment was not randomized.","validation_98":{"reached":3,"not_reached":0,"interpretation":"First scheduled validation observation >=98%; means include achievers only, not unreached/censored runs."}},"sd_annealed":{"label":"Residual + decreasing SD","run_ids":["graph-eval-sd_annealed-s101","graph-eval-sd_annealed-s102","graph-eval-sd_annealed-s103"],"valid_run_ids":["graph-eval-sd_annealed-s101","graph-eval-sd_annealed-s102","graph-eval-sd_annealed-s103"],"seeds":[101,102,103],"n":3,"selected_learning_rates":[0.01],"failure_count":0,"metrics":{"training_seconds":{"n":3,"mean":56.87169800733332,"sample_sd":0.1763041638161115,"values":[57.05315608299995,56.70104473499994,56.86089320400008]},"total_run_seconds":{"n":3,"mean":58.554229245666676,"sample_sd":0.5362984341713765,"values":[59.033537945000006,57.97499664500002,58.654153147]},"selected_epoch":{"n":3,"mean":10.0,"sample_sd":5.0,"values":[15.0,5.0,10.0]},"selected_training_seconds":{"n":3,"mean":4.885670766333338,"sample_sd":2.5054348249561222,"values":[7.405219249000012,2.394592239000005,4.8572008109999985]},"epoch_to_validation_98":{"n":3,"mean":18.333333333333332,"sample_sd":2.8867513459481287,"values":[15.0,20.0,20.0]},"training_seconds_to_validation_98":{"n":3,"mean":9.040611827000015,"sample_sd":1.416357022401664,"values":[7.405219249000012,9.844686377000002,9.871929855000033]},"final_stochastic_training_loss":{"n":3,"mean":4.7183789888549654e-06,"sample_sd":6.498805729258499e-06,"values":[9.261892159884155e-07,1.006537672765262e-06,1.2222410077811219e-05]},"parameter_count":{"n":3,"mean":11972510.0,"sample_sd":0.0,"values":[11972510.0,11972510.0,11972510.0]},"training_examples_per_epoch":{"n":3,"mean":49984.0,"sample_sd":0.0,"values":[49984.0,49984.0,49984.0]},"steps_per_epoch":{"n":3,"mean":781.0,"sample_sd":0.0,"values":[781.0,781.0,781.0]},"epoch_preparation_seconds":{"n":3,"mean":0.2607876659999893,"sample_sd":0.06386670233279275,"values":[0.29897472499999367,0.1870565390000678,0.29633173399990653]},"graph_setup_seconds":{"n":3,"mean":0.1319846006666694,"sample_sd":0.024742931514731056,"values":[0.1592274239999938,0.1109077150000104,0.125818663000004]}},"endpoints":{"selected":{"train":{"loss":{"n":3,"mean":0.020214609781901042,"sample_sd":0.017174949909820242,"values":[0.0073738916015625,0.03972373779296875,0.013546199951171876]},"accuracy_pct":{"n":3,"mean":99.40333333333334,"sample_sd":0.49551723817979665,"values":[99.78,98.842,99.588]},"example_counts":[50000]},"validation":{"loss":{"n":3,"mean":0.07871205444335938,"sample_sd":0.004359903644409535,"values":[0.0818095947265625,0.080600244140625,0.07372632446289062]},"accuracy_pct":{"n":3,"mean":97.87333333333333,"sample_sd":0.2635020556529584,"values":[98.09,97.58,97.95]},"example_counts":[10000]},"test":{"loss":{"n":3,"mean":0.0725057393391927,"sample_sd":0.0034646897055538007,"values":[0.0753540283203125,0.073514599609375,0.06864859008789062]},"accuracy_pct":{"n":3,"mean":97.99666666666667,"sample_sd":0.28919428302325056,"values":[98.22,97.67,98.1]},"errors":{"n":3,"mean":200.33333333333334,"sample_sd":28.919428302325297,"values":[178.0,233.0,190.0]},"example_counts":[10000]},"dense_train_probe":{"loss":{"n":3,"mean":0.020383703613281248,"sample_sd":0.017452186267630985,"values":[0.00715621337890625,0.0401638427734375,0.0138310546875]},"accuracy_pct":{"n":3,"mean":99.36999999999999,"sample_sd":0.4838388161361183,"values":[99.72999999999999,98.82,99.56]},"example_counts":[10000]},"generalization":{"validation_minus_train_loss":{"n":3,"mean":0.058497444661458335,"sample_sd":0.016842757514551294,"values":[0.074435703125,0.04087650634765625,0.06018012451171875]},"test_minus_train_loss":{"n":3,"mean":0.05229112955729166,"sample_sd":0.017267136969430937,"values":[0.06798013671875,0.03379086181640625,0.05510239013671875]},"train_minus_validation_accuracy_pp":{"n":3,"mean":1.529999999999998,"sample_sd":0.23354656923192177,"values":[1.6900000000000026,1.2619999999999965,1.637999999999995]},"train_minus_test_accuracy_pp":{"n":3,"mean":1.4066666666666672,"sample_sd":0.20639121428330076,"values":[1.5600000000000058,1.1719999999999953,1.4880000000000004]}}},"final":{"train":{"loss":{"n":3,"mean":4.508770803610484e-06,"sample_sd":6.152419047114718e-06,"values":[9.178103506565094e-07,9.956718981266022e-07,1.161283016204834e-05]},"accuracy_pct":{"n":3,"mean":100.0,"sample_sd":0.0,"values":[100.0,100.0,100.0]},"example_counts":[50000]},"validation":{"loss":{"n":3,"mean":0.13198736572265624,"sample_sd":0.01586826248346425,"values":[0.134895361328125,0.1462005126953125,0.11486622314453125]},"accuracy_pct":{"n":3,"mean":98.32666666666667,"sample_sd":0.03214550253664342,"values":[98.35000000000001,98.34,98.29]},"example_counts":[10000]},"test":{"loss":{"n":3,"mean":0.11697754109700521,"sample_sd":0.015887284759775844,"values":[0.12641207275390626,0.125885546875,0.09863500366210938]},"accuracy_pct":{"n":3,"mean":98.51,"sample_sd":0.045825756949560134,"values":[98.47,98.56,98.5]},"errors":{"n":3,"mean":149.0,"sample_sd":4.58257569495584,"values":[153.0,144.0,150.0]},"example_counts":[10000]},"dense_train_probe":{"loss":{"n":3,"mean":4.832514158139626e-06,"sample_sd":6.3991405347624086e-06,"values":[9.382639080286026e-07,1.3413389213383198e-06,1.2217939645051956e-05]},"accuracy_pct":{"n":3,"mean":100.0,"sample_sd":0.0,"values":[100.0,100.0,100.0]},"example_counts":[10000]},"generalization":{"validation_minus_train_loss":{"n":3,"mean":0.13198285695185263,"sample_sd":0.01587399749268684,"values":[0.13489444351777433,0.14619951702341438,0.11485461031436921]},"test_minus_train_loss":{"n":3,"mean":0.1169730323262016,"sample_sd":0.015893436856155702,"values":[0.1264111549435556,0.12588455120310188,0.09862339083194734]},"train_minus_validation_accuracy_pp":{"n":3,"mean":1.6733333333333305,"sample_sd":0.03214550253664598,"values":[1.649999999999996,1.6599999999999948,1.7100000000000004]},"train_minus_test_accuracy_pp":{"n":3,"mean":1.4899999999999987,"sample_sd":0.04582575694955941,"values":[1.529999999999998,1.4399999999999968,1.5000000000000013]}}}},"timing_by_hardware":[{"hardware":{"cpu_threads":2,"cuda_runtime":"13.0","dtype":"float32","float32_matmul_precision":"high","gpu":"NVIDIA A100-SXM4-40GB","tf32":true,"torch":"2.14.0+cu130"},"source_sha256":{"model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41","train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d"},"run_ids":["graph-eval-sd_annealed-s101","graph-eval-sd_annealed-s102","graph-eval-sd_annealed-s103"],"seeds":[101,102,103],"metrics":{"training_seconds":{"n":3,"mean":56.87169800733332,"sample_sd":0.1763041638161115,"values":[57.05315608299995,56.70104473499994,56.86089320400008]},"total_run_seconds":{"n":3,"mean":58.554229245666676,"sample_sd":0.5362984341713765,"values":[59.033537945000006,57.97499664500002,58.654153147]},"selected_training_seconds":{"n":3,"mean":4.885670766333338,"sample_sd":2.5054348249561222,"values":[7.405219249000012,2.394592239000005,4.8572008109999985]},"training_seconds_to_validation_98":{"n":3,"mean":9.040611827000015,"sample_sd":1.416357022401664,"values":[7.405219249000012,9.844686377000002,9.871929855000033]},"epoch_preparation_seconds":{"n":3,"mean":0.2607876659999893,"sample_sd":0.06386670233279275,"values":[0.29897472499999367,0.1870565390000678,0.29633173399990653]},"graph_setup_seconds":{"n":3,"mean":0.1319846006666694,"sample_sd":0.024742931514731056,"values":[0.1592274239999938,0.1109077150000104,0.125818663000004]}}}],"timing_interpretation":"Pooled runtime means are descriptive across assigned workers. Use timing_by_hardware and hardware-matched seed pairs for speed comparisons; hardware assignment was not randomized.","validation_98":{"reached":3,"not_reached":0,"interpretation":"First scheduled validation observation >=98%; means include achievers only, not unreached/censored runs."}},"sd_constant":{"label":"Residual + constant SD","run_ids":["graph-eval-sd_constant-s101","graph-eval-sd_constant-s102","graph-eval-sd_constant-s103"],"valid_run_ids":["graph-eval-sd_constant-s101","graph-eval-sd_constant-s102","graph-eval-sd_constant-s103"],"seeds":[101,102,103],"n":3,"selected_learning_rates":[0.01],"failure_count":0,"metrics":{"training_seconds":{"n":3,"mean":56.84002282766671,"sample_sd":0.1806258139478525,"values":[56.78209531600007,56.69546716900007,57.04250599799998]},"total_run_seconds":{"n":3,"mean":58.24707554533333,"sample_sd":0.3127144911006294,"values":[58.152022927999994,57.99291641699999,58.59628729100001]},"selected_epoch":{"n":3,"mean":6.666666666666667,"sample_sd":2.8867513459481287,"values":[5.0,5.0,10.0]},"selected_training_seconds":{"n":3,"mean":3.8175436383333383,"sample_sd":1.6659018856602987,"values":[2.846230949999992,2.865269929000007,5.7411300360000155]},"epoch_to_validation_98":{"n":3,"mean":15.0,"sample_sd":0.0,"values":[15.0,15.0,15.0]},"training_seconds_to_validation_98":{"n":3,"mean":8.566413545333347,"sample_sd":0.021374018046510034,"values":[8.56321889500002,8.546816665999998,8.589205075000024]},"final_stochastic_training_loss":{"n":3,"mean":0.0006572036072611809,"sample_sd":4.711385000850784e-05,"values":[0.0006054788245819509,0.0006684671971015632,0.0006976648001000285]},"parameter_count":{"n":3,"mean":11972510.0,"sample_sd":0.0,"values":[11972510.0,11972510.0,11972510.0]},"training_examples_per_epoch":{"n":3,"mean":49984.0,"sample_sd":0.0,"values":[49984.0,49984.0,49984.0]},"steps_per_epoch":{"n":3,"mean":781.0,"sample_sd":0.0,"values":[781.0,781.0,781.0]},"epoch_preparation_seconds":{"n":3,"mean":0.19508095066669284,"sample_sd":0.00048813185159525443,"values":[0.1956165539999688,0.1949651999999844,0.19466109800012532]},"graph_setup_seconds":{"n":3,"mean":0.16626555166666415,"sample_sd":0.06114224140147729,"values":[0.14420809399999257,0.11921265600000197,0.23537590499999794]}},"endpoints":{"selected":{"train":{"loss":{"n":3,"mean":0.023654397786458333,"sample_sd":0.010264233192051624,"values":[0.02965966796875,0.029500888671875,0.01180263671875]},"accuracy_pct":{"n":3,"mean":99.23733333333334,"sample_sd":0.3136898680756712,"values":[99.028,99.086,99.598]},"example_counts":[50000]},"validation":{"loss":{"n":3,"mean":0.08557972819010416,"sample_sd":0.00219345360714284,"values":[0.08439702758789062,0.08423145141601562,0.08811070556640625]},"accuracy_pct":{"n":3,"mean":97.67,"sample_sd":0.2523885892824794,"values":[97.63,97.44,97.94]},"example_counts":[10000]},"test":{"loss":{"n":3,"mean":0.07901785074869792,"sample_sd":0.00562109144024319,"values":[0.0757639404296875,0.07578109130859376,0.0855085205078125]},"accuracy_pct":{"n":3,"mean":97.80333333333334,"sample_sd":0.17897858344878093,"values":[97.76,97.65,98.0]},"errors":{"n":3,"mean":219.66666666666666,"sample_sd":17.897858344878397,"values":[224.0,235.0,200.0]},"example_counts":[10000]},"dense_train_probe":{"loss":{"n":3,"mean":0.024755657704671225,"sample_sd":0.010432254846262522,"values":[0.030873800659179686,0.03068314208984375,0.012710030364990235]},"accuracy_pct":{"n":3,"mean":99.22666666666667,"sample_sd":0.2983845393671326,"values":[99.03,99.08,99.57000000000001]},"example_counts":[10000]},"generalization":{"validation_minus_train_loss":{"n":3,"mean":0.06192533040364583,"sample_sd":0.012455817332113896,"values":[0.05473735961914063,0.05473056274414062,0.07630806884765626]},"test_minus_train_loss":{"n":3,"mean":0.05536345296223959,"sample_sd":0.015885254619749583,"values":[0.0461042724609375,0.046280202636718754,0.07370588378906251]},"train_minus_validation_accuracy_pp":{"n":3,"mean":1.5673333333333317,"sample_sd":0.1467696608067563,"values":[1.3980000000000103,1.645999999999992,1.6579999999999928]},"train_minus_test_accuracy_pp":{"n":3,"mean":1.4339999999999982,"sample_sd":0.16500909065866487,"values":[1.2680000000000025,1.4359999999999928,1.5979999999999994]}}},"final":{"train":{"loss":{"n":3,"mean":2.142309012512366e-06,"sample_sd":1.4164387996668406e-06,"values":[2.671930193901062e-06,5.373771861195564e-07,3.2176196575164796e-06]},"accuracy_pct":{"n":3,"mean":100.0,"sample_sd":0.0,"values":[100.0,100.0,100.0]},"example_counts":[50000]},"validation":{"loss":{"n":3,"mean":0.14494252115885417,"sample_sd":0.019141988981301834,"values":[0.129225,0.1662599365234375,0.139342626953125]},"accuracy_pct":{"n":3,"mean":98.42333333333333,"sample_sd":0.0513160143944734,"values":[98.48,98.41,98.38]},"example_counts":[10000]},"test":{"loss":{"n":3,"mean":0.13363821207682292,"sample_sd":0.022471827331612078,"values":[0.1167528076171875,0.159143896484375,0.12501793212890625]},"accuracy_pct":{"n":3,"mean":98.44333333333333,"sample_sd":0.03055050463304061,"values":[98.47,98.41,98.45]},"errors":{"n":3,"mean":155.66666666666666,"sample_sd":3.0550504633038935,"values":[153.0,159.0,155.0]},"example_counts":[10000]},"dense_train_probe":{"loss":{"n":3,"mean":2.8674060478806494e-06,"sample_sd":1.8970846101958034e-06,"values":[2.94302012771368e-06,9.336449205875397e-07,4.725553095340729e-06]},"accuracy_pct":{"n":3,"mean":100.0,"sample_sd":0.0,"values":[100.0,100.0,100.0]},"example_counts":[10000]},"generalization":{"validation_minus_train_loss":{"n":3,"mean":0.14494037884984165,"sample_sd":0.019143257380156854,"values":[0.1292223280698061,0.1662593991462514,0.13933940933346747]},"test_minus_train_loss":{"n":3,"mean":0.1336360697678104,"sample_sd":0.02247314336846084,"values":[0.11675013568699359,0.15914335910718888,0.12501471450924873]},"train_minus_validation_accuracy_pp":{"n":3,"mean":1.5766666666666669,"sample_sd":0.05131601439446932,"values":[1.5199999999999991,1.5900000000000025,1.6199999999999992]},"train_minus_test_accuracy_pp":{"n":3,"mean":1.5566666666666655,"sample_sd":0.030550504633041625,"values":[1.529999999999998,1.5900000000000025,1.5499999999999958]}}}},"timing_by_hardware":[{"hardware":{"cpu_threads":2,"cuda_runtime":"13.0","dtype":"float32","float32_matmul_precision":"high","gpu":"NVIDIA A100-SXM4-40GB","tf32":true,"torch":"2.14.0+cu130"},"source_sha256":{"model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41","train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d"},"run_ids":["graph-eval-sd_constant-s101","graph-eval-sd_constant-s102","graph-eval-sd_constant-s103"],"seeds":[101,102,103],"metrics":{"training_seconds":{"n":3,"mean":56.84002282766671,"sample_sd":0.1806258139478525,"values":[56.78209531600007,56.69546716900007,57.04250599799998]},"total_run_seconds":{"n":3,"mean":58.24707554533333,"sample_sd":0.3127144911006294,"values":[58.152022927999994,57.99291641699999,58.59628729100001]},"selected_training_seconds":{"n":3,"mean":3.8175436383333383,"sample_sd":1.6659018856602987,"values":[2.846230949999992,2.865269929000007,5.7411300360000155]},"training_seconds_to_validation_98":{"n":3,"mean":8.566413545333347,"sample_sd":0.021374018046510034,"values":[8.56321889500002,8.546816665999998,8.589205075000024]},"epoch_preparation_seconds":{"n":3,"mean":0.19508095066669284,"sample_sd":0.00048813185159525443,"values":[0.1956165539999688,0.1949651999999844,0.19466109800012532]},"graph_setup_seconds":{"n":3,"mean":0.16626555166666415,"sample_sd":0.06114224140147729,"values":[0.14420809399999257,0.11921265600000197,0.23537590499999794]}}}],"timing_interpretation":"Pooled runtime means are descriptive across assigned workers. Use timing_by_hardware and hardware-matched seed pairs for speed comparisons; hardware assignment was not randomized.","validation_98":{"reached":3,"not_reached":0,"interpretation":"First scheduled validation observation >=98%; means include achievers only, not unreached/censored runs."}}}},"fidelity":{"groups":{"source-plain":{"label":"Plain MLP","run_ids":["graph-fidelity-source-plain-s101","graph-fidelity-source-plain-s102","graph-fidelity-source-plain-s103"],"valid_run_ids":["graph-fidelity-source-plain-s101","graph-fidelity-source-plain-s102","graph-fidelity-source-plain-s103"],"seeds":[101,102,103],"n":3,"selected_learning_rates":[0.001],"failure_count":0,"metrics":{"training_seconds":{"n":3,"mean":68.14202772833332,"sample_sd":0.10272901686981128,"values":[68.18079109299993,68.02555690100002,68.21973519100001]},"total_run_seconds":{"n":3,"mean":70.13904469566667,"sample_sd":0.48927253285718125,"values":[70.683689947,69.73668832800001,69.996755812]},"selected_epoch":{"n":3,"mean":68.33333333333333,"sample_sd":16.072751268321593,"values":[75.0,50.0,80.0]},"selected_training_seconds":{"n":3,"mean":46.58551457033335,"sample_sd":11.02133767423667,"values":[51.15088855100001,34.01507250700001,54.59058265300004]},"epoch_to_validation_98":{"n":1,"mean":15.0,"sample_sd":null,"values":[15.0]},"training_seconds_to_validation_98":{"n":1,"mean":10.243587533999943,"sample_sd":null,"values":[10.243587533999943]},"final_stochastic_training_loss":{"n":3,"mean":0.1660388623131439,"sample_sd":0.14378629457362285,"values":[0.001167256967164576,0.26543089747428894,0.2315184324979782]},"parameter_count":{"n":3,"mean":11972510.0,"sample_sd":0.0,"values":[11972510.0,11972510.0,11972510.0]},"training_examples_per_epoch":{"n":3,"mean":49984.0,"sample_sd":0.0,"values":[49984.0,49984.0,49984.0]},"steps_per_epoch":{"n":3,"mean":781.0,"sample_sd":0.0,"values":[781.0,781.0,781.0]},"epoch_preparation_seconds":{"n":3,"mean":0.27505648433332414,"sample_sd":0.09263464154200104,"values":[0.36385658099996476,0.1790126180000584,0.2823002539999493]},"graph_setup_seconds":{"n":3,"mean":0.034216131333323574,"sample_sd":0.0068376999565330455,"values":[0.03615571999998224,0.039874506999979076,0.026618167000009407]}},"endpoints":{"selected":{"train":{"loss":{"n":3,"mean":0.16511604476928712,"sample_sd":0.1428514342041166,"values":[0.0011725679016113281,0.26284958984375,0.2313259765625]},"accuracy_pct":{"n":3,"mean":92.88533333333334,"sample_sd":6.198236630956688,"values":[100.0,88.654,90.00200000000001]},"example_counts":[50000]},"validation":{"loss":{"n":3,"mean":0.22185826212565105,"sample_sd":0.1346787703075265,"values":[0.06670652465820312,0.3086169921875,0.29025126953125]},"accuracy_pct":{"n":3,"mean":91.51333333333334,"sample_sd":5.733631775178216,"values":[98.1,87.64,88.8]},"example_counts":[10000]},"test":{"loss":{"n":3,"mean":0.22311907348632815,"sample_sd":0.1449572635490953,"values":[0.05650311889648438,0.320281689453125,0.292572412109375]},"accuracy_pct":{"n":3,"mean":91.33666666666667,"sample_sd":6.1222735428379345,"values":[98.34,87.0,88.67]},"errors":{"n":3,"mean":866.3333333333334,"sample_sd":612.2273542837933,"values":[166.0,1300.0,1133.0]},"example_counts":[10000]},"dense_train_probe":{"loss":{"n":3,"mean":0.16668826192220051,"sample_sd":0.14513901334254417,"values":[0.0011584625244140626,0.2721522216796875,0.2267541015625]},"accuracy_pct":{"n":3,"mean":92.81666666666666,"sample_sd":6.2968907671432035,"values":[100.0,88.25,90.2]},"example_counts":[10000]},"generalization":{"validation_minus_train_loss":{"n":3,"mean":0.05674221735636393,"sample_sd":0.010062481437796799,"values":[0.0655339567565918,0.045767402343749986,0.058925292968750015]},"test_minus_train_loss":{"n":3,"mean":0.05800302871704102,"sample_sd":0.0029989819176912476,"values":[0.05533055099487305,0.05743209960937501,0.061246435546875005]},"train_minus_validation_accuracy_pp":{"n":3,"mean":1.3720000000000028,"sample_sd":0.466823307044538,"values":[1.9000000000000017,1.0140000000000038,1.202000000000003]},"train_minus_test_accuracy_pp":{"n":3,"mean":1.5486666666666649,"sample_sd":0.18766281819618072,"values":[1.6599999999999948,1.654,1.3319999999999999]}}},"final":{"train":{"loss":{"n":3,"mean":0.1654930438741048,"sample_sd":0.14327963896777432,"values":[0.001150615997314453,0.2641787890625,0.2311497265625]},"accuracy_pct":{"n":3,"mean":92.882,"sample_sd":6.202090937740271,"values":[100.0,88.64,90.006]},"example_counts":[50000]},"validation":{"loss":{"n":3,"mean":0.22625680745442708,"sample_sd":0.13696204942925472,"values":[0.06887960205078125,0.3184699951171875,0.2914208251953125]},"accuracy_pct":{"n":3,"mean":91.45333333333333,"sample_sd":5.823919069950521,"values":[98.14,87.49,88.73]},"example_counts":[10000]},"test":{"loss":{"n":3,"mean":0.2275680643717448,"sample_sd":0.1455861393331276,"values":[0.06090704956054688,0.32996171875,0.2918354248046875]},"accuracy_pct":{"n":3,"mean":91.25666666666667,"sample_sd":6.145000678058002,"values":[98.28,86.87,88.62]},"errors":{"n":3,"mean":874.3333333333334,"sample_sd":614.5000678058004,"values":[172.0,1313.0,1138.0]},"example_counts":[10000]},"dense_train_probe":{"loss":{"n":3,"mean":0.1670042330423991,"sample_sd":0.14552143963750608,"values":[0.0011736854553222656,0.273406982421875,0.22643203125]},"accuracy_pct":{"n":3,"mean":92.81666666666666,"sample_sd":6.298446898508658,"values":[100.0,88.24,90.21000000000001]},"example_counts":[10000]},"generalization":{"validation_minus_train_loss":{"n":3,"mean":0.06076376358032227,"sample_sd":0.006732423180904243,"values":[0.0677289860534668,0.05429120605468751,0.06027109863281249]},"test_minus_train_loss":{"n":3,"mean":0.06207502049763999,"sample_sd":0.003244584122977067,"values":[0.059756433563232424,0.06578292968750005,0.0606856982421875]},"train_minus_validation_accuracy_pp":{"n":3,"mean":1.4286666666666632,"sample_sd":0.37882097794780656,"values":[1.859999999999995,1.1499999999999955,1.2759999999999994]},"train_minus_test_accuracy_pp":{"n":3,"mean":1.6253333333333304,"sample_sd":0.2087710069270462,"values":[1.7199999999999993,1.7699999999999938,1.3859999999999983]}}}},"timing_by_hardware":[{"hardware":{"cpu_threads":2,"cuda_runtime":"13.0","dtype":"float32","float32_matmul_precision":"high","gpu":"NVIDIA A100-SXM4-40GB","tf32":true,"torch":"2.14.0+cu130"},"source_sha256":{"model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41","train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d"},"run_ids":["graph-fidelity-source-plain-s101","graph-fidelity-source-plain-s102","graph-fidelity-source-plain-s103"],"seeds":[101,102,103],"metrics":{"training_seconds":{"n":3,"mean":68.14202772833332,"sample_sd":0.10272901686981128,"values":[68.18079109299993,68.02555690100002,68.21973519100001]},"total_run_seconds":{"n":3,"mean":70.13904469566667,"sample_sd":0.48927253285718125,"values":[70.683689947,69.73668832800001,69.996755812]},"selected_training_seconds":{"n":3,"mean":46.58551457033335,"sample_sd":11.02133767423667,"values":[51.15088855100001,34.01507250700001,54.59058265300004]},"training_seconds_to_validation_98":{"n":1,"mean":10.243587533999943,"sample_sd":null,"values":[10.243587533999943]},"epoch_preparation_seconds":{"n":3,"mean":0.27505648433332414,"sample_sd":0.09263464154200104,"values":[0.36385658099996476,0.1790126180000584,0.2823002539999493]},"graph_setup_seconds":{"n":3,"mean":0.034216131333323574,"sample_sd":0.0068376999565330455,"values":[0.03615571999998224,0.039874506999979076,0.026618167000009407]}}}],"timing_interpretation":"Pooled runtime means are descriptive across assigned workers. Use timing_by_hardware and hardware-matched seed pairs for speed comparisons; hardware assignment was not randomized.","validation_98":{"reached":1,"not_reached":2,"interpretation":"First scheduled validation observation >=98%; means include achievers only, not unreached/censored runs."}},"source-residual":{"label":"Residual dense","run_ids":["graph-fidelity-source-residual-s101","graph-fidelity-source-residual-s102","graph-fidelity-source-residual-s103"],"valid_run_ids":["graph-fidelity-source-residual-s101","graph-fidelity-source-residual-s102","graph-fidelity-source-residual-s103"],"seeds":[101,102,103],"n":3,"selected_learning_rates":[0.001],"failure_count":0,"metrics":{"training_seconds":{"n":3,"mean":72.18410912933325,"sample_sd":0.06487431585315122,"values":[72.10991571299974,72.23016014299992,72.2122515320001]},"total_run_seconds":{"n":3,"mean":73.39410031133332,"sample_sd":0.15140343140738766,"values":[73.22089794199997,73.46011743699998,73.50128555500001]},"selected_epoch":{"n":3,"mean":67.0,"sample_sd":57.15767664977295,"values":[1.0,100.0,100.0]},"selected_training_seconds":{"n":3,"mean":48.39664204133334,"sample_sd":41.265355934638855,"values":[0.7475144489999934,72.23016014299992,72.2122515320001]},"epoch_to_validation_98":{"n":0,"mean":null,"sample_sd":null,"values":[]},"training_seconds_to_validation_98":{"n":0,"mean":null,"sample_sd":null,"values":[]},"final_stochastic_training_loss":{"n":3,"mean":1.9572781721750896,"sample_sd":0.33336988492473146,"values":[2.3025853633880615,1.931959867477417,1.63728928565979]},"parameter_count":{"n":3,"mean":11972510.0,"sample_sd":0.0,"values":[11972510.0,11972510.0,11972510.0]},"training_examples_per_epoch":{"n":3,"mean":49984.0,"sample_sd":0.0,"values":[49984.0,49984.0,49984.0]},"steps_per_epoch":{"n":3,"mean":781.0,"sample_sd":0.0,"values":[781.0,781.0,781.0]},"epoch_preparation_seconds":{"n":3,"mean":0.20120581199993617,"sample_sd":0.014850366320367134,"values":[0.2122572899998545,0.20703489600001035,0.1843252499999437]},"graph_setup_seconds":{"n":3,"mean":0.018654004000003017,"sample_sd":0.009232525759805448,"values":[0.029277242000006254,0.01411675099998888,0.01256801900001392]}},"endpoints":{"selected":{"train":{"loss":{"n":3,"mean":1.8930077604166669,"sample_sd":0.35918410605426343,"values":[2.3025853125,1.74476890625,1.6316690625]},"accuracy_pct":{"n":3,"mean":28.43,"sample_sd":16.197354351868704,"values":[9.802,36.294,39.194]},"example_counts":[50000]},"validation":{"loss":{"n":3,"mean":1.9049845703125001,"sample_sd":0.34642947519063805,"values":[2.302585546875,1.74424296875,1.6681251953125]},"accuracy_pct":{"n":3,"mean":28.63666666666667,"sample_sd":15.998600980502431,"values":[10.22,36.59,39.1]},"example_counts":[10000]},"test":{"loss":{"n":3,"mean":1.8997985026041666,"sample_sd":0.35044709973088745,"values":[2.302585546875,1.732096484375,1.6647134765625]},"accuracy_pct":{"n":3,"mean":28.560000000000002,"sample_sd":16.284511045775982,"values":[9.8,36.83,39.050000000000004]},"errors":{"n":3,"mean":7144.0,"sample_sd":1628.4511045775982,"values":[9020.0,6317.0,6095.0]},"example_counts":[10000]},"dense_train_probe":{"loss":{"n":3,"mean":1.8940679036458332,"sample_sd":0.3578103427571441,"values":[2.302585546875,1.743318359375,1.6362998046875]},"accuracy_pct":{"n":3,"mean":28.38,"sample_sd":16.126726264186416,"values":[9.82,36.35,38.97]},"example_counts":[10000]},"generalization":{"validation_minus_train_loss":{"n":3,"mean":0.011976809895833274,"sample_sd":0.02120134788296115,"values":[2.3437499985234922e-07,-0.0005259374999999622,0.03645613281249993]},"test_minus_train_loss":{"n":3,"mean":0.0067907421874999025,"sample_sd":0.023602765077375798,"values":[2.3437499985234922e-07,-0.012672421875000062,0.033044414062499916]},"train_minus_validation_accuracy_pp":{"n":3,"mean":-0.2066666666666675,"sample_sd":0.26743472723887873,"values":[-0.4180000000000003,-0.2960000000000018,0.09399999999999964]},"train_minus_test_accuracy_pp":{"n":3,"mean":-0.13000000000000142,"sample_sd":0.35870321994651944,"values":[0.0019999999999992246,-0.5360000000000031,0.14399999999999968]}}},"final":{"train":{"loss":{"n":3,"mean":1.8930077604166669,"sample_sd":0.35918410605426343,"values":[2.3025853125,1.74476890625,1.6316690625]},"accuracy_pct":{"n":3,"mean":28.43,"sample_sd":16.197354351868704,"values":[9.802,36.294,39.194]},"example_counts":[50000]},"validation":{"loss":{"n":3,"mean":1.9049845703125001,"sample_sd":0.34642947519063805,"values":[2.302585546875,1.74424296875,1.6681251953125]},"accuracy_pct":{"n":3,"mean":28.63666666666667,"sample_sd":15.998600980502431,"values":[10.22,36.59,39.1]},"example_counts":[10000]},"test":{"loss":{"n":3,"mean":1.8997985026041666,"sample_sd":0.35044709973088745,"values":[2.302585546875,1.732096484375,1.6647134765625]},"accuracy_pct":{"n":3,"mean":28.560000000000002,"sample_sd":16.284511045775982,"values":[9.8,36.83,39.050000000000004]},"errors":{"n":3,"mean":7144.0,"sample_sd":1628.4511045775982,"values":[9020.0,6317.0,6095.0]},"example_counts":[10000]},"dense_train_probe":{"loss":{"n":3,"mean":1.8940679036458332,"sample_sd":0.3578103427571441,"values":[2.302585546875,1.743318359375,1.6362998046875]},"accuracy_pct":{"n":3,"mean":28.38,"sample_sd":16.126726264186416,"values":[9.82,36.35,38.97]},"example_counts":[10000]},"generalization":{"validation_minus_train_loss":{"n":3,"mean":0.011976809895833274,"sample_sd":0.02120134788296115,"values":[2.3437499985234922e-07,-0.0005259374999999622,0.03645613281249993]},"test_minus_train_loss":{"n":3,"mean":0.0067907421874999025,"sample_sd":0.023602765077375798,"values":[2.3437499985234922e-07,-0.012672421875000062,0.033044414062499916]},"train_minus_validation_accuracy_pp":{"n":3,"mean":-0.2066666666666675,"sample_sd":0.26743472723887873,"values":[-0.4180000000000003,-0.2960000000000018,0.09399999999999964]},"train_minus_test_accuracy_pp":{"n":3,"mean":-0.13000000000000142,"sample_sd":0.35870321994651944,"values":[0.0019999999999992246,-0.5360000000000031,0.14399999999999968]}}}},"timing_by_hardware":[{"hardware":{"cpu_threads":2,"cuda_runtime":"13.0","dtype":"float32","float32_matmul_precision":"high","gpu":"NVIDIA A100-SXM4-40GB","tf32":true,"torch":"2.14.0+cu130"},"source_sha256":{"model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41","train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d"},"run_ids":["graph-fidelity-source-residual-s101","graph-fidelity-source-residual-s102","graph-fidelity-source-residual-s103"],"seeds":[101,102,103],"metrics":{"training_seconds":{"n":3,"mean":72.18410912933325,"sample_sd":0.06487431585315122,"values":[72.10991571299974,72.23016014299992,72.2122515320001]},"total_run_seconds":{"n":3,"mean":73.39410031133332,"sample_sd":0.15140343140738766,"values":[73.22089794199997,73.46011743699998,73.50128555500001]},"selected_training_seconds":{"n":3,"mean":48.39664204133334,"sample_sd":41.265355934638855,"values":[0.7475144489999934,72.23016014299992,72.2122515320001]},"training_seconds_to_validation_98":{"n":0,"mean":null,"sample_sd":null,"values":[]},"epoch_preparation_seconds":{"n":3,"mean":0.20120581199993617,"sample_sd":0.014850366320367134,"values":[0.2122572899998545,0.20703489600001035,0.1843252499999437]},"graph_setup_seconds":{"n":3,"mean":0.018654004000003017,"sample_sd":0.009232525759805448,"values":[0.029277242000006254,0.01411675099998888,0.01256801900001392]}}}],"timing_interpretation":"Pooled runtime means are descriptive across assigned workers. Use timing_by_hardware and hardware-matched seed pairs for speed comparisons; hardware assignment was not randomized.","validation_98":{"reached":0,"not_reached":3,"interpretation":"First scheduled validation observation >=98%; means include achievers only, not unreached/censored runs."}},"source-sd":{"label":"Residual + constant SD","run_ids":["graph-fidelity-source-sd-s101","graph-fidelity-source-sd-s102","graph-fidelity-source-sd-s103"],"valid_run_ids":["graph-fidelity-source-sd-s101","graph-fidelity-source-sd-s102","graph-fidelity-source-sd-s103"],"seeds":[101,102,103],"n":3,"selected_learning_rates":[0.001],"failure_count":0,"metrics":{"training_seconds":{"n":3,"mean":63.003120123999956,"sample_sd":0.14698086445087746,"values":[63.09232125100013,62.833476593000086,63.083562527999646]},"total_run_seconds":{"n":3,"mean":64.46229962033333,"sample_sd":0.39852648299653126,"values":[64.70638588599999,64.002410696,64.678102279]},"selected_epoch":{"n":3,"mean":1.0,"sample_sd":0.0,"values":[1.0,1.0,1.0]},"selected_training_seconds":{"n":3,"mean":0.6449076739999953,"sample_sd":0.009415539258200845,"values":[0.6537692989999755,0.6350219480000021,0.6459317750000082]},"epoch_to_validation_98":{"n":0,"mean":null,"sample_sd":null,"values":[]},"training_seconds_to_validation_98":{"n":0,"mean":null,"sample_sd":null,"values":[]},"final_stochastic_training_loss":{"n":3,"mean":2.3025853633880615,"sample_sd":0.0,"values":[2.3025853633880615,2.3025853633880615,2.3025853633880615]},"parameter_count":{"n":3,"mean":11972510.0,"sample_sd":0.0,"values":[11972510.0,11972510.0,11972510.0]},"training_examples_per_epoch":{"n":3,"mean":49984.0,"sample_sd":0.0,"values":[49984.0,49984.0,49984.0]},"steps_per_epoch":{"n":3,"mean":781.0,"sample_sd":0.0,"values":[781.0,781.0,781.0]},"epoch_preparation_seconds":{"n":3,"mean":0.24807345266666894,"sample_sd":0.0655604937913082,"values":[0.30181906400014213,0.17502992800018546,0.26737136599967926]},"graph_setup_seconds":{"n":3,"mean":0.12240884900000992,"sample_sd":0.024745341324428672,"values":[0.15062496699999883,0.11220206300001223,0.1043995170000187]}},"endpoints":{"selected":{"train":{"loss":{"n":3,"mean":2.3025853125,"sample_sd":0.0,"values":[2.3025853125,2.3025853125,2.3025853125]},"accuracy_pct":{"n":3,"mean":9.802,"sample_sd":0.0,"values":[9.802,9.802,9.802]},"example_counts":[50000]},"validation":{"loss":{"n":3,"mean":2.302585546875,"sample_sd":0.0,"values":[2.302585546875,2.302585546875,2.302585546875]},"accuracy_pct":{"n":3,"mean":10.22,"sample_sd":0.0,"values":[10.22,10.22,10.22]},"example_counts":[10000]},"test":{"loss":{"n":3,"mean":2.302585546875,"sample_sd":0.0,"values":[2.302585546875,2.302585546875,2.302585546875]},"accuracy_pct":{"n":3,"mean":9.8,"sample_sd":0.0,"values":[9.8,9.8,9.8]},"errors":{"n":3,"mean":9020.0,"sample_sd":0.0,"values":[9020.0,9020.0,9020.0]},"example_counts":[10000]},"dense_train_probe":{"loss":{"n":3,"mean":2.302585546875,"sample_sd":0.0,"values":[2.302585546875,2.302585546875,2.302585546875]},"accuracy_pct":{"n":3,"mean":9.82,"sample_sd":0.0,"values":[9.82,9.82,9.82]},"example_counts":[10000]},"generalization":{"validation_minus_train_loss":{"n":3,"mean":2.3437499985234922e-07,"sample_sd":0.0,"values":[2.3437499985234922e-07,2.3437499985234922e-07,2.3437499985234922e-07]},"test_minus_train_loss":{"n":3,"mean":2.3437499985234922e-07,"sample_sd":0.0,"values":[2.3437499985234922e-07,2.3437499985234922e-07,2.3437499985234922e-07]},"train_minus_validation_accuracy_pp":{"n":3,"mean":-0.4180000000000003,"sample_sd":0.0,"values":[-0.4180000000000003,-0.4180000000000003,-0.4180000000000003]},"train_minus_test_accuracy_pp":{"n":3,"mean":0.0019999999999992246,"sample_sd":0.0,"values":[0.0019999999999992246,0.0019999999999992246,0.0019999999999992246]}}},"final":{"train":{"loss":{"n":3,"mean":2.3025853125,"sample_sd":0.0,"values":[2.3025853125,2.3025853125,2.3025853125]},"accuracy_pct":{"n":3,"mean":9.802,"sample_sd":0.0,"values":[9.802,9.802,9.802]},"example_counts":[50000]},"validation":{"loss":{"n":3,"mean":2.302585546875,"sample_sd":0.0,"values":[2.302585546875,2.302585546875,2.302585546875]},"accuracy_pct":{"n":3,"mean":10.22,"sample_sd":0.0,"values":[10.22,10.22,10.22]},"example_counts":[10000]},"test":{"loss":{"n":3,"mean":2.302585546875,"sample_sd":0.0,"values":[2.302585546875,2.302585546875,2.302585546875]},"accuracy_pct":{"n":3,"mean":9.8,"sample_sd":0.0,"values":[9.8,9.8,9.8]},"errors":{"n":3,"mean":9020.0,"sample_sd":0.0,"values":[9020.0,9020.0,9020.0]},"example_counts":[10000]},"dense_train_probe":{"loss":{"n":3,"mean":2.302585546875,"sample_sd":0.0,"values":[2.302585546875,2.302585546875,2.302585546875]},"accuracy_pct":{"n":3,"mean":9.82,"sample_sd":0.0,"values":[9.82,9.82,9.82]},"example_counts":[10000]},"generalization":{"validation_minus_train_loss":{"n":3,"mean":2.3437499985234922e-07,"sample_sd":0.0,"values":[2.3437499985234922e-07,2.3437499985234922e-07,2.3437499985234922e-07]},"test_minus_train_loss":{"n":3,"mean":2.3437499985234922e-07,"sample_sd":0.0,"values":[2.3437499985234922e-07,2.3437499985234922e-07,2.3437499985234922e-07]},"train_minus_validation_accuracy_pp":{"n":3,"mean":-0.4180000000000003,"sample_sd":0.0,"values":[-0.4180000000000003,-0.4180000000000003,-0.4180000000000003]},"train_minus_test_accuracy_pp":{"n":3,"mean":0.0019999999999992246,"sample_sd":0.0,"values":[0.0019999999999992246,0.0019999999999992246,0.0019999999999992246]}}}},"timing_by_hardware":[{"hardware":{"cpu_threads":2,"cuda_runtime":"13.0","dtype":"float32","float32_matmul_precision":"high","gpu":"NVIDIA A100-SXM4-40GB","tf32":true,"torch":"2.14.0+cu130"},"source_sha256":{"model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41","train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d"},"run_ids":["graph-fidelity-source-sd-s101","graph-fidelity-source-sd-s102","graph-fidelity-source-sd-s103"],"seeds":[101,102,103],"metrics":{"training_seconds":{"n":3,"mean":63.003120123999956,"sample_sd":0.14698086445087746,"values":[63.09232125100013,62.833476593000086,63.083562527999646]},"total_run_seconds":{"n":3,"mean":64.46229962033333,"sample_sd":0.39852648299653126,"values":[64.70638588599999,64.002410696,64.678102279]},"selected_training_seconds":{"n":3,"mean":0.6449076739999953,"sample_sd":0.009415539258200845,"values":[0.6537692989999755,0.6350219480000021,0.6459317750000082]},"training_seconds_to_validation_98":{"n":0,"mean":null,"sample_sd":null,"values":[]},"epoch_preparation_seconds":{"n":3,"mean":0.24807345266666894,"sample_sd":0.0655604937913082,"values":[0.30181906400014213,0.17502992800018546,0.26737136599967926]},"graph_setup_seconds":{"n":3,"mean":0.12240884900000992,"sample_sd":0.024745341324428672,"values":[0.15062496699999883,0.11220206300001223,0.1043995170000187]}}}],"timing_interpretation":"Pooled runtime means are descriptive across assigned workers. Use timing_by_hardware and hardware-matched seed pairs for speed comparisons; hardware assignment was not randomized.","validation_98":{"reached":0,"not_reached":3,"interpretation":"First scheduled validation observation >=98%; means include achievers only, not unreached/censored runs."}}}}},"paired_comparisons":[{"cohort":"fidelity","treatment":"source-plain","control":"source-residual","endpoint":"selected","seeds":[101,102,103],"run_pairs":[{"seed":101,"treatment":"graph-fidelity-source-plain-s101","control":"graph-fidelity-source-residual-s101"},{"seed":102,"treatment":"graph-fidelity-source-plain-s102","control":"graph-fidelity-source-residual-s102"},{"seed":103,"treatment":"graph-fidelity-source-plain-s103","control":"graph-fidelity-source-residual-s103"}],"test_accuracy_delta_pp":{"n":3,"mean":62.77666666666667,"sample_sd":22.313395827021342,"values":[88.54,50.17,49.620000000000005],"df":2,"t_critical":4.302653,"ci95_low":7.347115134008739,"ci95_high":118.20621819932461},"test_error_count_delta":{"n":3,"mean":-6277.666666666667,"sample_sd":2231.339582702134,"values":[-8854.0,-5017.0,-4962.0],"df":2,"t_critical":4.302653,"ci95_low":-11820.621819932461,"ci95_high":-734.7115134008736},"test_loss_delta":{"n":3,"mean":-1.6766794291178386,"sample_sd":0.49351629411395925,"values":[-2.2460824279785156,-1.411814794921875,-1.3721410644531251],"df":2,"t_critical":4.302653,"ci95_low":-2.9026419436925552,"ci95_high":-0.450716914543122},"error_disagreements":[{"seed":101,"test_n":10000,"treatment_wrong_control_correct":10,"treatment_correct_control_wrong":8864,"both_wrong":156},{"seed":102,"test_n":10000,"treatment_wrong_control_correct":24,"treatment_correct_control_wrong":5041,"both_wrong":1276},{"seed":103,"test_n":10000,"treatment_wrong_control_correct":1002,"treatment_correct_control_wrong":5964,"both_wrong":131}],"timing_pairing":{"matched_seeds":[101,102,103],"excluded_pairs":[]},"training_seconds_delta":{"n":3,"mean":-4.042081400999933,"sample_sd":0.14427279429732817,"values":[-3.9291246199998113,-4.204603241999905,-3.9925163410000835],"df":2,"t_critical":4.302653,"ci95_low":-4.400474912604296,"ci95_high":-3.683687889395571,"paired_seeds":[101,102,103]},"selected_training_seconds_delta":{"n":3,"mean":-1.8111274709999823,"sample_sd":46.376587357339076,"values":[50.403374102000015,-38.21508763599991,-17.621668879000055],"df":2,"t_critical":4.302653,"ci95_low":-117.01696430375237,"ci95_high":113.39470936175242,"paired_seeds":[101,102,103]},"epoch_to_validation_98_delta":{"n":0,"mean":null,"sample_sd":null,"values":[],"df":null,"t_critical":null,"ci95_low":null,"ci95_high":null,"paired_seeds":[]},"training_seconds_to_validation_98_delta":{"n":0,"mean":null,"sample_sd":null,"values":[],"df":null,"t_critical":null,"ci95_low":null,"ci95_high":null,"paired_seeds":[]},"training_speedup_ratio":{"n":3,"mean":1.0593205198840274,"sample_sd":0.0022013378847196407,"values":[1.0576280292001952,1.0618091704580825,1.0585243599938043],"df":2,"t_critical":4.302653,"ci95_low":1.0538520930848176,"ci95_high":1.0647889466832372},"timing_by_hardware":[{"hardware":{"cpu_threads":2,"cuda_runtime":"13.0","dtype":"float32","float32_matmul_precision":"high","gpu":"NVIDIA A100-SXM4-40GB","tf32":true,"torch":"2.14.0+cu130"},"source_sha256":{"model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41","train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d"},"seeds":[101,102,103],"training_seconds_delta":{"n":3,"mean":-4.042081400999933,"sample_sd":0.14427279429732817,"values":[-3.9291246199998113,-4.204603241999905,-3.9925163410000835],"df":2,"t_critical":4.302653,"ci95_low":-4.400474912604296,"ci95_high":-3.683687889395571},"training_speedup_ratio":{"n":3,"mean":1.0593205198840274,"sample_sd":0.0022013378847196407,"values":[1.0576280292001952,1.0618091704580825,1.0585243599938043],"df":2,"t_critical":4.302653,"ci95_low":1.0538520930848176,"ci95_high":1.0647889466832372}}],"interpretation":"Treatment minus residual dense: positive accuracy delta is better; negative error/loss/time delta is better. Quality pairs need not share assigned GPU variant. All time/speed comparisons exclude pairs with different or unknown reported GPU/runtime/source; hardware-specific strata are retained. Speedup is control training seconds / treatment training seconds, above one faster. A pooled matched-pair mean remains descriptive when its pairs use different A100 variants. Threshold-time comparisons include only pairs where both reached 98%; not an unconditional time-to-target estimate."},{"cohort":"fidelity","treatment":"source-plain","control":"source-residual","endpoint":"final","seeds":[101,102,103],"run_pairs":[{"seed":101,"treatment":"graph-fidelity-source-plain-s101","control":"graph-fidelity-source-residual-s101"},{"seed":102,"treatment":"graph-fidelity-source-plain-s102","control":"graph-fidelity-source-residual-s102"},{"seed":103,"treatment":"graph-fidelity-source-plain-s103","control":"graph-fidelity-source-residual-s103"}],"test_accuracy_delta_pp":{"n":3,"mean":62.696666666666665,"sample_sd":22.330258246006327,"values":[88.48,50.03999999999999,49.57],"df":2,"t_critical":4.302653,"ci95_low":7.225226560465764,"ci95_high":118.16810677286756},"test_error_count_delta":{"n":3,"mean":-6269.666666666667,"sample_sd":2233.0258246006324,"values":[-8848.0,-5004.0,-4957.0],"df":2,"t_critical":4.302653,"ci95_low":-11816.810677286756,"ci95_high":-722.522656046578},"test_loss_delta":{"n":3,"mean":-1.6722304382324218,"sample_sd":0.49337339593942026,"values":[-2.241678497314453,-1.402134765625,-1.3728780517578125],"df":2,"t_critical":4.302653,"ci95_low":-2.8978379740405296,"ci95_high":-0.446622902424314},"error_disagreements":[{"seed":101,"test_n":10000,"treatment_wrong_control_correct":9,"treatment_correct_control_wrong":8857,"both_wrong":163},{"seed":102,"test_n":10000,"treatment_wrong_control_correct":28,"treatment_correct_control_wrong":5032,"both_wrong":1285},{"seed":103,"test_n":10000,"treatment_wrong_control_correct":998,"treatment_correct_control_wrong":5955,"both_wrong":140}],"timing_pairing":{"matched_seeds":[101,102,103],"excluded_pairs":[]},"training_seconds_delta":{"n":3,"mean":-4.042081400999933,"sample_sd":0.14427279429732817,"values":[-3.9291246199998113,-4.204603241999905,-3.9925163410000835],"df":2,"t_critical":4.302653,"ci95_low":-4.400474912604296,"ci95_high":-3.683687889395571,"paired_seeds":[101,102,103]},"selected_training_seconds_delta":{"n":3,"mean":-1.8111274709999823,"sample_sd":46.376587357339076,"values":[50.403374102000015,-38.21508763599991,-17.621668879000055],"df":2,"t_critical":4.302653,"ci95_low":-117.01696430375237,"ci95_high":113.39470936175242,"paired_seeds":[101,102,103]},"epoch_to_validation_98_delta":{"n":0,"mean":null,"sample_sd":null,"values":[],"df":null,"t_critical":null,"ci95_low":null,"ci95_high":null,"paired_seeds":[]},"training_seconds_to_validation_98_delta":{"n":0,"mean":null,"sample_sd":null,"values":[],"df":null,"t_critical":null,"ci95_low":null,"ci95_high":null,"paired_seeds":[]},"training_speedup_ratio":{"n":3,"mean":1.0593205198840274,"sample_sd":0.0022013378847196407,"values":[1.0576280292001952,1.0618091704580825,1.0585243599938043],"df":2,"t_critical":4.302653,"ci95_low":1.0538520930848176,"ci95_high":1.0647889466832372},"timing_by_hardware":[{"hardware":{"cpu_threads":2,"cuda_runtime":"13.0","dtype":"float32","float32_matmul_precision":"high","gpu":"NVIDIA A100-SXM4-40GB","tf32":true,"torch":"2.14.0+cu130"},"source_sha256":{"model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41","train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d"},"seeds":[101,102,103],"training_seconds_delta":{"n":3,"mean":-4.042081400999933,"sample_sd":0.14427279429732817,"values":[-3.9291246199998113,-4.204603241999905,-3.9925163410000835],"df":2,"t_critical":4.302653,"ci95_low":-4.400474912604296,"ci95_high":-3.683687889395571},"training_speedup_ratio":{"n":3,"mean":1.0593205198840274,"sample_sd":0.0022013378847196407,"values":[1.0576280292001952,1.0618091704580825,1.0585243599938043],"df":2,"t_critical":4.302653,"ci95_low":1.0538520930848176,"ci95_high":1.0647889466832372}}],"interpretation":"Treatment minus residual dense: positive accuracy delta is better; negative error/loss/time delta is better. Quality pairs need not share assigned GPU variant. All time/speed comparisons exclude pairs with different or unknown reported GPU/runtime/source; hardware-specific strata are retained. Speedup is control training seconds / treatment training seconds, above one faster. A pooled matched-pair mean remains descriptive when its pairs use different A100 variants. Threshold-time comparisons include only pairs where both reached 98%; not an unconditional time-to-target estimate."},{"cohort":"fidelity","treatment":"source-sd","control":"source-residual","endpoint":"selected","seeds":[101,102,103],"run_pairs":[{"seed":101,"treatment":"graph-fidelity-source-sd-s101","control":"graph-fidelity-source-residual-s101"},{"seed":102,"treatment":"graph-fidelity-source-sd-s102","control":"graph-fidelity-source-residual-s102"},{"seed":103,"treatment":"graph-fidelity-source-sd-s103","control":"graph-fidelity-source-residual-s103"}],"test_accuracy_delta_pp":{"n":3,"mean":-18.759999999999998,"sample_sd":16.284511045775982,"values":[0.0,-27.029999999999998,-29.25],"df":2,"t_critical":4.302653,"ci95_low":-59.21297054708649,"ci95_high":21.692970547086496},"test_error_count_delta":{"n":3,"mean":1876.0,"sample_sd":1628.4511045775982,"values":[0.0,2703.0,2925.0],"df":2,"t_critical":4.302653,"ci95_low":-2169.2970547086497,"ci95_high":5921.29705470865},"test_loss_delta":{"n":3,"mean":0.4027870442708334,"sample_sd":0.35044709973088745,"values":[0.0,0.5704890625000001,0.6378720703125],"df":2,"t_critical":4.302653,"ci95_low":-0.467771866824181,"ci95_high":1.2733459553658477},"error_disagreements":[{"seed":101,"test_n":10000,"treatment_wrong_control_correct":0,"treatment_correct_control_wrong":0,"both_wrong":9020},{"seed":102,"test_n":10000,"treatment_wrong_control_correct":2751,"treatment_correct_control_wrong":48,"both_wrong":6269},{"seed":103,"test_n":10000,"treatment_wrong_control_correct":2934,"treatment_correct_control_wrong":9,"both_wrong":6086}],"timing_pairing":{"matched_seeds":[101,102,103],"excluded_pairs":[]},"training_seconds_delta":{"n":3,"mean":-9.180989005333297,"sample_sd":0.1948809938520765,"values":[-9.017594461999607,-9.396683549999835,-9.12868900400045],"df":2,"t_critical":4.302653,"ci95_low":-9.665100261871753,"ci95_high":-8.69687774879484,"paired_seeds":[101,102,103]},"selected_training_seconds_delta":{"n":3,"mean":-47.75173436733334,"sample_sd":41.27303187076504,"values":[-0.09374515000001793,-71.59513819499992,-71.56631975700009],"df":2,"t_critical":4.302653,"ci95_low":-150.27963575557305,"ci95_high":54.776167020906385,"paired_seeds":[101,102,103]},"epoch_to_validation_98_delta":{"n":0,"mean":null,"sample_sd":null,"values":[],"df":null,"t_critical":null,"ci95_low":null,"ci95_high":null,"paired_seeds":[]},"training_seconds_to_validation_98_delta":{"n":0,"mean":null,"sample_sd":null,"values":[],"df":null,"t_critical":null,"ci95_low":null,"ci95_high":null,"paired_seeds":[]},"training_speedup_ratio":{"n":3,"mean":1.1457279527575182,"sample_sd":0.0034268369455594154,"values":[1.1429269724619089,1.1495489993473744,1.1447078864632714],"df":2,"t_critical":4.302653,"ci95_low":1.137215217334348,"ci95_high":1.1542406881806884},"timing_by_hardware":[{"hardware":{"cpu_threads":2,"cuda_runtime":"13.0","dtype":"float32","float32_matmul_precision":"high","gpu":"NVIDIA A100-SXM4-40GB","tf32":true,"torch":"2.14.0+cu130"},"source_sha256":{"model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41","train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d"},"seeds":[101,102,103],"training_seconds_delta":{"n":3,"mean":-9.180989005333297,"sample_sd":0.1948809938520765,"values":[-9.017594461999607,-9.396683549999835,-9.12868900400045],"df":2,"t_critical":4.302653,"ci95_low":-9.665100261871753,"ci95_high":-8.69687774879484},"training_speedup_ratio":{"n":3,"mean":1.1457279527575182,"sample_sd":0.0034268369455594154,"values":[1.1429269724619089,1.1495489993473744,1.1447078864632714],"df":2,"t_critical":4.302653,"ci95_low":1.137215217334348,"ci95_high":1.1542406881806884}}],"interpretation":"Treatment minus residual dense: positive accuracy delta is better; negative error/loss/time delta is better. Quality pairs need not share assigned GPU variant. All time/speed comparisons exclude pairs with different or unknown reported GPU/runtime/source; hardware-specific strata are retained. Speedup is control training seconds / treatment training seconds, above one faster. A pooled matched-pair mean remains descriptive when its pairs use different A100 variants. Threshold-time comparisons include only pairs where both reached 98%; not an unconditional time-to-target estimate."},{"cohort":"fidelity","treatment":"source-sd","control":"source-residual","endpoint":"final","seeds":[101,102,103],"run_pairs":[{"seed":101,"treatment":"graph-fidelity-source-sd-s101","control":"graph-fidelity-source-residual-s101"},{"seed":102,"treatment":"graph-fidelity-source-sd-s102","control":"graph-fidelity-source-residual-s102"},{"seed":103,"treatment":"graph-fidelity-source-sd-s103","control":"graph-fidelity-source-residual-s103"}],"test_accuracy_delta_pp":{"n":3,"mean":-18.759999999999998,"sample_sd":16.284511045775982,"values":[0.0,-27.029999999999998,-29.25],"df":2,"t_critical":4.302653,"ci95_low":-59.21297054708649,"ci95_high":21.692970547086496},"test_error_count_delta":{"n":3,"mean":1876.0,"sample_sd":1628.4511045775982,"values":[0.0,2703.0,2925.0],"df":2,"t_critical":4.302653,"ci95_low":-2169.2970547086497,"ci95_high":5921.29705470865},"test_loss_delta":{"n":3,"mean":0.4027870442708334,"sample_sd":0.35044709973088745,"values":[0.0,0.5704890625000001,0.6378720703125],"df":2,"t_critical":4.302653,"ci95_low":-0.467771866824181,"ci95_high":1.2733459553658477},"error_disagreements":[{"seed":101,"test_n":10000,"treatment_wrong_control_correct":0,"treatment_correct_control_wrong":0,"both_wrong":9020},{"seed":102,"test_n":10000,"treatment_wrong_control_correct":2751,"treatment_correct_control_wrong":48,"both_wrong":6269},{"seed":103,"test_n":10000,"treatment_wrong_control_correct":2934,"treatment_correct_control_wrong":9,"both_wrong":6086}],"timing_pairing":{"matched_seeds":[101,102,103],"excluded_pairs":[]},"training_seconds_delta":{"n":3,"mean":-9.180989005333297,"sample_sd":0.1948809938520765,"values":[-9.017594461999607,-9.396683549999835,-9.12868900400045],"df":2,"t_critical":4.302653,"ci95_low":-9.665100261871753,"ci95_high":-8.69687774879484,"paired_seeds":[101,102,103]},"selected_training_seconds_delta":{"n":3,"mean":-47.75173436733334,"sample_sd":41.27303187076504,"values":[-0.09374515000001793,-71.59513819499992,-71.56631975700009],"df":2,"t_critical":4.302653,"ci95_low":-150.27963575557305,"ci95_high":54.776167020906385,"paired_seeds":[101,102,103]},"epoch_to_validation_98_delta":{"n":0,"mean":null,"sample_sd":null,"values":[],"df":null,"t_critical":null,"ci95_low":null,"ci95_high":null,"paired_seeds":[]},"training_seconds_to_validation_98_delta":{"n":0,"mean":null,"sample_sd":null,"values":[],"df":null,"t_critical":null,"ci95_low":null,"ci95_high":null,"paired_seeds":[]},"training_speedup_ratio":{"n":3,"mean":1.1457279527575182,"sample_sd":0.0034268369455594154,"values":[1.1429269724619089,1.1495489993473744,1.1447078864632714],"df":2,"t_critical":4.302653,"ci95_low":1.137215217334348,"ci95_high":1.1542406881806884},"timing_by_hardware":[{"hardware":{"cpu_threads":2,"cuda_runtime":"13.0","dtype":"float32","float32_matmul_precision":"high","gpu":"NVIDIA A100-SXM4-40GB","tf32":true,"torch":"2.14.0+cu130"},"source_sha256":{"model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41","train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d"},"seeds":[101,102,103],"training_seconds_delta":{"n":3,"mean":-9.180989005333297,"sample_sd":0.1948809938520765,"values":[-9.017594461999607,-9.396683549999835,-9.12868900400045],"df":2,"t_critical":4.302653,"ci95_low":-9.665100261871753,"ci95_high":-8.69687774879484},"training_speedup_ratio":{"n":3,"mean":1.1457279527575182,"sample_sd":0.0034268369455594154,"values":[1.1429269724619089,1.1495489993473744,1.1447078864632714],"df":2,"t_critical":4.302653,"ci95_low":1.137215217334348,"ci95_high":1.1542406881806884}}],"interpretation":"Treatment minus residual dense: positive accuracy delta is better; negative error/loss/time delta is better. Quality pairs need not share assigned GPU variant. All time/speed comparisons exclude pairs with different or unknown reported GPU/runtime/source; hardware-specific strata are retained. Speedup is control training seconds / treatment training seconds, above one faster. A pooled matched-pair mean remains descriptive when its pairs use different A100 variants. Threshold-time comparisons include only pairs where both reached 98%; not an unconditional time-to-target estimate."},{"cohort":"main","treatment":"plain","control":"residual","endpoint":"selected","seeds":[101,102,103],"run_pairs":[{"seed":101,"treatment":"graph-eval-plain-s101","control":"graph-eval-residual-s101"},{"seed":102,"treatment":"graph-eval-plain-s102","control":"graph-eval-residual-s102"},{"seed":103,"treatment":"graph-eval-plain-s103","control":"graph-eval-residual-s103"}],"test_accuracy_delta_pp":{"n":3,"mean":-0.45999999999999747,"sample_sd":0.3958535082577851,"values":[-0.869999999999993,-0.08000000000000229,-0.42999999999999705],"df":2,"t_critical":4.302653,"ci95_low":-1.4433546899565466,"ci95_high":0.5233546899565518},"test_error_count_delta":{"n":3,"mean":46.0,"sample_sd":39.585350825778974,"values":[87.0,8.0,43.0],"df":2,"t_critical":4.302653,"ci95_low":-52.335468995656086,"ci95_high":144.33546899565607},"test_loss_delta":{"n":3,"mean":0.011527659098307289,"sample_sd":0.015776756802498373,"values":[0.022959973144531243,-0.006471929931640627,0.01809493408203125],"df":2,"t_critical":4.302653,"ci95_low":-0.027663979905527547,"ci95_high":0.050719298102142124},"error_disagreements":[{"seed":101,"test_n":10000,"treatment_wrong_control_correct":134,"treatment_correct_control_wrong":47,"both_wrong":110},{"seed":102,"test_n":10000,"treatment_wrong_control_correct":63,"treatment_correct_control_wrong":55,"both_wrong":115},{"seed":103,"test_n":10000,"treatment_wrong_control_correct":81,"treatment_correct_control_wrong":38,"both_wrong":123}],"timing_pairing":{"matched_seeds":[101,102,103],"excluded_pairs":[]},"training_seconds_delta":{"n":3,"mean":-4.11167872100003,"sample_sd":0.4337450512280344,"values":[-3.7326765750000916,-4.58473366799997,-4.017625920000029],"df":2,"t_critical":4.302653,"ci95_low":-5.189161227717571,"ci95_high":-3.0341962142824883,"paired_seeds":[101,102,103]},"selected_training_seconds_delta":{"n":3,"mean":-1.468233941333333,"sample_sd":1.785972694287235,"values":[-3.530215421000004,-0.4667855079999974,-0.40770089499999784],"df":2,"t_critical":4.302653,"ci95_low":-5.9048363420325245,"ci95_high":2.968368459365859,"paired_seeds":[101,102,103]},"epoch_to_validation_98_delta":{"n":3,"mean":5.0,"sample_sd":5.0,"values":[5.0,0.0,10.0],"df":2,"t_critical":4.302653,"ci95_low":-7.4206893388977555,"ci95_high":17.420689338897756,"paired_seeds":[101,102,103]},"training_seconds_to_validation_98_delta":{"n":3,"mean":2.683161564666667,"sample_sd":3.127702850721433,"values":[2.7281350349999958,-0.4667855079999974,5.788135167000002],"df":2,"t_critical":4.302653,"ci95_low":-5.086483525972497,"ci95_high":10.452806655305832,"paired_seeds":[101,102,103]},"training_speedup_ratio":{"n":3,"mean":1.0660549057316846,"sample_sd":0.007240586965217587,"values":[1.059569574584278,1.0738671948710918,1.064727947739684],"df":2,"t_critical":4.302653,"ci95_low":1.0480682894664366,"ci95_high":1.0840415219969326},"timing_by_hardware":[{"hardware":{"cpu_threads":2,"cuda_runtime":"13.0","dtype":"float32","float32_matmul_precision":"high","gpu":"NVIDIA A100-SXM4-40GB","tf32":true,"torch":"2.14.0+cu130"},"source_sha256":{"model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41","train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d"},"seeds":[101,102,103],"training_seconds_delta":{"n":3,"mean":-4.11167872100003,"sample_sd":0.4337450512280344,"values":[-3.7326765750000916,-4.58473366799997,-4.017625920000029],"df":2,"t_critical":4.302653,"ci95_low":-5.189161227717571,"ci95_high":-3.0341962142824883},"training_speedup_ratio":{"n":3,"mean":1.0660549057316846,"sample_sd":0.007240586965217587,"values":[1.059569574584278,1.0738671948710918,1.064727947739684],"df":2,"t_critical":4.302653,"ci95_low":1.0480682894664366,"ci95_high":1.0840415219969326}}],"interpretation":"Treatment minus residual dense: positive accuracy delta is better; negative error/loss/time delta is better. Quality pairs need not share assigned GPU variant. All time/speed comparisons exclude pairs with different or unknown reported GPU/runtime/source; hardware-specific strata are retained. Speedup is control training seconds / treatment training seconds, above one faster. A pooled matched-pair mean remains descriptive when its pairs use different A100 variants. Threshold-time comparisons include only pairs where both reached 98%; not an unconditional time-to-target estimate."},{"cohort":"main","treatment":"plain","control":"residual","endpoint":"final","seeds":[101,102,103],"run_pairs":[{"seed":101,"treatment":"graph-eval-plain-s101","control":"graph-eval-residual-s101"},{"seed":102,"treatment":"graph-eval-plain-s102","control":"graph-eval-residual-s102"},{"seed":103,"treatment":"graph-eval-plain-s103","control":"graph-eval-residual-s103"}],"test_accuracy_delta_pp":{"n":3,"mean":0.17333333333333645,"sample_sd":0.02516611478423306,"values":[0.15000000000000568,0.17000000000000348,0.20000000000000018],"df":2,"t_critical":4.302653,"ci95_low":0.11081723461293629,"ci95_high":0.2358494320537366},"test_error_count_delta":{"n":3,"mean":-17.333333333333332,"sample_sd":2.516611478423583,"values":[-15.0,-17.0,-20.0],"df":2,"t_critical":4.302653,"ci95_low":-23.584943205374035,"ci95_high":-11.08172346129263},"test_loss_delta":{"n":3,"mean":0.014350925699869793,"sample_sd":0.0016215588599439727,"values":[0.014569580078125005,0.01585206298828125,0.012631134033203123],"df":2,"t_critical":4.302653,"ci95_low":0.010322749931049532,"ci95_high":0.018379101468690054},"error_disagreements":[{"seed":101,"test_n":10000,"treatment_wrong_control_correct":28,"treatment_correct_control_wrong":43,"both_wrong":117},{"seed":102,"test_n":10000,"treatment_wrong_control_correct":32,"treatment_correct_control_wrong":49,"both_wrong":111},{"seed":103,"test_n":10000,"treatment_wrong_control_correct":22,"treatment_correct_control_wrong":42,"both_wrong":118}],"timing_pairing":{"matched_seeds":[101,102,103],"excluded_pairs":[]},"training_seconds_delta":{"n":3,"mean":-4.11167872100003,"sample_sd":0.4337450512280344,"values":[-3.7326765750000916,-4.58473366799997,-4.017625920000029],"df":2,"t_critical":4.302653,"ci95_low":-5.189161227717571,"ci95_high":-3.0341962142824883,"paired_seeds":[101,102,103]},"selected_training_seconds_delta":{"n":3,"mean":-1.468233941333333,"sample_sd":1.785972694287235,"values":[-3.530215421000004,-0.4667855079999974,-0.40770089499999784],"df":2,"t_critical":4.302653,"ci95_low":-5.9048363420325245,"ci95_high":2.968368459365859,"paired_seeds":[101,102,103]},"epoch_to_validation_98_delta":{"n":3,"mean":5.0,"sample_sd":5.0,"values":[5.0,0.0,10.0],"df":2,"t_critical":4.302653,"ci95_low":-7.4206893388977555,"ci95_high":17.420689338897756,"paired_seeds":[101,102,103]},"training_seconds_to_validation_98_delta":{"n":3,"mean":2.683161564666667,"sample_sd":3.127702850721433,"values":[2.7281350349999958,-0.4667855079999974,5.788135167000002],"df":2,"t_critical":4.302653,"ci95_low":-5.086483525972497,"ci95_high":10.452806655305832,"paired_seeds":[101,102,103]},"training_speedup_ratio":{"n":3,"mean":1.0660549057316846,"sample_sd":0.007240586965217587,"values":[1.059569574584278,1.0738671948710918,1.064727947739684],"df":2,"t_critical":4.302653,"ci95_low":1.0480682894664366,"ci95_high":1.0840415219969326},"timing_by_hardware":[{"hardware":{"cpu_threads":2,"cuda_runtime":"13.0","dtype":"float32","float32_matmul_precision":"high","gpu":"NVIDIA A100-SXM4-40GB","tf32":true,"torch":"2.14.0+cu130"},"source_sha256":{"model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41","train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d"},"seeds":[101,102,103],"training_seconds_delta":{"n":3,"mean":-4.11167872100003,"sample_sd":0.4337450512280344,"values":[-3.7326765750000916,-4.58473366799997,-4.017625920000029],"df":2,"t_critical":4.302653,"ci95_low":-5.189161227717571,"ci95_high":-3.0341962142824883},"training_speedup_ratio":{"n":3,"mean":1.0660549057316846,"sample_sd":0.007240586965217587,"values":[1.059569574584278,1.0738671948710918,1.064727947739684],"df":2,"t_critical":4.302653,"ci95_low":1.0480682894664366,"ci95_high":1.0840415219969326}}],"interpretation":"Treatment minus residual dense: positive accuracy delta is better; negative error/loss/time delta is better. Quality pairs need not share assigned GPU variant. All time/speed comparisons exclude pairs with different or unknown reported GPU/runtime/source; hardware-specific strata are retained. Speedup is control training seconds / treatment training seconds, above one faster. A pooled matched-pair mean remains descriptive when its pairs use different A100 variants. Threshold-time comparisons include only pairs where both reached 98%; not an unconditional time-to-target estimate."},{"cohort":"main","treatment":"residual_unit_dropout","control":"residual","endpoint":"selected","seeds":[101,102,103],"run_pairs":[{"seed":101,"treatment":"graph-eval-residual_unit_dropout-s101","control":"graph-eval-residual-s101"},{"seed":102,"treatment":"graph-eval-residual_unit_dropout-s102","control":"graph-eval-residual-s102"},{"seed":103,"treatment":"graph-eval-residual_unit_dropout-s103","control":"graph-eval-residual-s103"}],"test_accuracy_delta_pp":{"n":3,"mean":-0.04333333333333226,"sample_sd":0.11676186592091739,"values":[0.060000000000004494,-0.019999999999997797,-0.17000000000000348],"df":2,"t_critical":4.302653,"ci95_low":-0.33338590598008183,"ci95_high":0.2467192393134173},"test_error_count_delta":{"n":3,"mean":4.333333333333333,"sample_sd":11.67618659209133,"values":[-6.0,2.0,17.0],"df":2,"t_critical":4.302653,"ci95_low":-24.671923931340608,"ci95_high":33.33859059800727},"test_loss_delta":{"n":3,"mean":-0.002366479492187499,"sample_sd":0.005144151097215388,"values":[0.003569775390625002,-0.005153088378906254,-0.0055161254882812455],"df":2,"t_critical":4.302653,"ci95_low":-0.015145260030359972,"ci95_high":0.010412301045984975},"error_disagreements":[{"seed":101,"test_n":10000,"treatment_wrong_control_correct":40,"treatment_correct_control_wrong":46,"both_wrong":111},{"seed":102,"test_n":10000,"treatment_wrong_control_correct":52,"treatment_correct_control_wrong":50,"both_wrong":120},{"seed":103,"test_n":10000,"treatment_wrong_control_correct":61,"treatment_correct_control_wrong":44,"both_wrong":117}],"timing_pairing":{"matched_seeds":[101,102,103],"excluded_pairs":[]},"training_seconds_delta":{"n":3,"mean":2.6520788119999374,"sample_sd":0.32328619851100376,"values":[2.67337772899981,2.3186697939999448,2.964188913000058],"df":2,"t_critical":4.302653,"ci95_low":1.8489913241482558,"ci95_high":3.4551662998516193,"paired_seeds":[101,102,103]},"selected_training_seconds_delta":{"n":3,"mean":2.546539000333341,"sample_sd":1.973836964670608,"values":[3.6900969859999844,3.6821670219999643,0.267352993000074],"df":2,"t_critical":4.302653,"ci95_low":-2.3567441484279636,"ci95_high":7.449822149094645,"paired_seeds":[101,102,103]},"epoch_to_validation_98_delta":{"n":3,"mean":3.3333333333333335,"sample_sd":2.8867513459481287,"values":[5.0,5.0,0.0],"df":2,"t_critical":4.302653,"ci95_low":-3.837755,"ci95_high":10.504421666666667,"paired_seeds":[101,102,103]},"training_seconds_to_validation_98_delta":{"n":3,"mean":2.546539000333341,"sample_sd":1.973836964670608,"values":[3.6900969859999844,3.6821670219999643,0.267352993000074],"df":2,"t_critical":4.302653,"ci95_low":-2.3567441484279636,"ci95_high":7.449822149094645,"paired_seeds":[101,102,103]},"training_speedup_ratio":{"n":3,"mean":0.9615824325314584,"sample_sd":0.004661338606125392,"values":[0.9612928927851959,0.9663817918228365,0.9570726129863427],"df":2,"t_critical":4.302653,"ci95_low":0.9500030247854395,"ci95_high":0.9731618402774772},"timing_by_hardware":[{"hardware":{"cpu_threads":2,"cuda_runtime":"13.0","dtype":"float32","float32_matmul_precision":"high","gpu":"NVIDIA A100-SXM4-40GB","tf32":true,"torch":"2.14.0+cu130"},"source_sha256":{"model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41","train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d"},"seeds":[101,102,103],"training_seconds_delta":{"n":3,"mean":2.6520788119999374,"sample_sd":0.32328619851100376,"values":[2.67337772899981,2.3186697939999448,2.964188913000058],"df":2,"t_critical":4.302653,"ci95_low":1.8489913241482558,"ci95_high":3.4551662998516193},"training_speedup_ratio":{"n":3,"mean":0.9615824325314584,"sample_sd":0.004661338606125392,"values":[0.9612928927851959,0.9663817918228365,0.9570726129863427],"df":2,"t_critical":4.302653,"ci95_low":0.9500030247854395,"ci95_high":0.9731618402774772}}],"interpretation":"Treatment minus residual dense: positive accuracy delta is better; negative error/loss/time delta is better. Quality pairs need not share assigned GPU variant. All time/speed comparisons exclude pairs with different or unknown reported GPU/runtime/source; hardware-specific strata are retained. Speedup is control training seconds / treatment training seconds, above one faster. A pooled matched-pair mean remains descriptive when its pairs use different A100 variants. Threshold-time comparisons include only pairs where both reached 98%; not an unconditional time-to-target estimate."},{"cohort":"main","treatment":"residual_unit_dropout","control":"residual","endpoint":"final","seeds":[101,102,103],"run_pairs":[{"seed":101,"treatment":"graph-eval-residual_unit_dropout-s101","control":"graph-eval-residual-s101"},{"seed":102,"treatment":"graph-eval-residual_unit_dropout-s102","control":"graph-eval-residual-s102"},{"seed":103,"treatment":"graph-eval-residual_unit_dropout-s103","control":"graph-eval-residual-s103"}],"test_accuracy_delta_pp":{"n":3,"mean":0.10666666666666602,"sample_sd":0.11503622617824774,"values":[0.10999999999999899,0.21999999999999797,-0.009999999999998899],"df":2,"t_critical":4.302653,"ci95_low":-0.1790991789491725,"ci95_high":0.39243251228250453},"test_error_count_delta":{"n":3,"mean":-10.666666666666666,"sample_sd":11.50362261782493,"values":[-11.0,-22.0,1.0],"df":2,"t_critical":4.302653,"ci95_low":-39.243251228250905,"ci95_high":17.909917894917577},"test_loss_delta":{"n":3,"mean":0.005846280924479165,"sample_sd":0.005290242951521212,"values":[0.005784100341796869,0.0005874023437500014,0.011167340087890623],"df":2,"t_critical":4.302653,"ci95_low":-0.007295411921148538,"ci95_high":0.01898797377010687},"error_disagreements":[{"seed":101,"test_n":10000,"treatment_wrong_control_correct":37,"treatment_correct_control_wrong":48,"both_wrong":112},{"seed":102,"test_n":10000,"treatment_wrong_control_correct":29,"treatment_correct_control_wrong":51,"both_wrong":109},{"seed":103,"test_n":10000,"treatment_wrong_control_correct":52,"treatment_correct_control_wrong":51,"both_wrong":109}],"timing_pairing":{"matched_seeds":[101,102,103],"excluded_pairs":[]},"training_seconds_delta":{"n":3,"mean":2.6520788119999374,"sample_sd":0.32328619851100376,"values":[2.67337772899981,2.3186697939999448,2.964188913000058],"df":2,"t_critical":4.302653,"ci95_low":1.8489913241482558,"ci95_high":3.4551662998516193,"paired_seeds":[101,102,103]},"selected_training_seconds_delta":{"n":3,"mean":2.546539000333341,"sample_sd":1.973836964670608,"values":[3.6900969859999844,3.6821670219999643,0.267352993000074],"df":2,"t_critical":4.302653,"ci95_low":-2.3567441484279636,"ci95_high":7.449822149094645,"paired_seeds":[101,102,103]},"epoch_to_validation_98_delta":{"n":3,"mean":3.3333333333333335,"sample_sd":2.8867513459481287,"values":[5.0,5.0,0.0],"df":2,"t_critical":4.302653,"ci95_low":-3.837755,"ci95_high":10.504421666666667,"paired_seeds":[101,102,103]},"training_seconds_to_validation_98_delta":{"n":3,"mean":2.546539000333341,"sample_sd":1.973836964670608,"values":[3.6900969859999844,3.6821670219999643,0.267352993000074],"df":2,"t_critical":4.302653,"ci95_low":-2.3567441484279636,"ci95_high":7.449822149094645,"paired_seeds":[101,102,103]},"training_speedup_ratio":{"n":3,"mean":0.9615824325314584,"sample_sd":0.004661338606125392,"values":[0.9612928927851959,0.9663817918228365,0.9570726129863427],"df":2,"t_critical":4.302653,"ci95_low":0.9500030247854395,"ci95_high":0.9731618402774772},"timing_by_hardware":[{"hardware":{"cpu_threads":2,"cuda_runtime":"13.0","dtype":"float32","float32_matmul_precision":"high","gpu":"NVIDIA A100-SXM4-40GB","tf32":true,"torch":"2.14.0+cu130"},"source_sha256":{"model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41","train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d"},"seeds":[101,102,103],"training_seconds_delta":{"n":3,"mean":2.6520788119999374,"sample_sd":0.32328619851100376,"values":[2.67337772899981,2.3186697939999448,2.964188913000058],"df":2,"t_critical":4.302653,"ci95_low":1.8489913241482558,"ci95_high":3.4551662998516193},"training_speedup_ratio":{"n":3,"mean":0.9615824325314584,"sample_sd":0.004661338606125392,"values":[0.9612928927851959,0.9663817918228365,0.9570726129863427],"df":2,"t_critical":4.302653,"ci95_low":0.9500030247854395,"ci95_high":0.9731618402774772}}],"interpretation":"Treatment minus residual dense: positive accuracy delta is better; negative error/loss/time delta is better. Quality pairs need not share assigned GPU variant. All time/speed comparisons exclude pairs with different or unknown reported GPU/runtime/source; hardware-specific strata are retained. Speedup is control training seconds / treatment training seconds, above one faster. A pooled matched-pair mean remains descriptive when its pairs use different A100 variants. Threshold-time comparisons include only pairs where both reached 98%; not an unconditional time-to-target estimate."},{"cohort":"main","treatment":"sd_annealed","control":"residual","endpoint":"selected","seeds":[101,102,103],"run_pairs":[{"seed":101,"treatment":"graph-eval-sd_annealed-s101","control":"graph-eval-residual-s101"},{"seed":102,"treatment":"graph-eval-sd_annealed-s102","control":"graph-eval-residual-s102"},{"seed":103,"treatment":"graph-eval-sd_annealed-s103","control":"graph-eval-residual-s103"}],"test_accuracy_delta_pp":{"n":3,"mean":-0.3766666666666659,"sample_sd":0.22300971578236825,"values":[-0.20999999999999908,-0.6299999999999972,-0.29000000000000137],"df":2,"t_critical":4.302653,"ci95_low":-0.9306535465244019,"ci95_high":0.1773202131910701},"test_error_count_delta":{"n":3,"mean":37.666666666666664,"sample_sd":22.300971578236975,"values":[21.0,63.0,29.0],"df":2,"t_critical":4.302653,"ci95_low":-17.732021319107304,"ci95_high":93.06535465244063},"test_loss_delta":{"n":3,"mean":-0.0012618164062500048,"sample_sd":0.008585677500626707,"values":[0.0085004150390625,-0.007638922119140634,-0.004646942138671881],"df":2,"t_critical":4.302653,"ci95_low":-0.0225898230060997,"ci95_high":0.02006619019359969},"error_disagreements":[{"seed":101,"test_n":10000,"treatment_wrong_control_correct":64,"treatment_correct_control_wrong":43,"both_wrong":114},{"seed":102,"test_n":10000,"treatment_wrong_control_correct":108,"treatment_correct_control_wrong":45,"both_wrong":125},{"seed":103,"test_n":10000,"treatment_wrong_control_correct":67,"treatment_correct_control_wrong":38,"both_wrong":123}],"timing_pairing":{"matched_seeds":[101,102,103],"excluded_pairs":[]},"training_seconds_delta":{"n":3,"mean":-9.505799324000018,"sample_sd":0.38970540763935224,"values":[-9.340310015000085,-9.950939165000023,-9.226148791999947],"df":2,"t_critical":4.302653,"ci95_low":-10.473881284395398,"ci95_high":-8.537717363604637,"paired_seeds":[101,102,103]},"selected_training_seconds_delta":{"n":3,"mean":-1.8013490323333283,"sample_sd":2.5113594958539602,"values":[0.70815405200001,-4.314560831999993,-1.7976403170000026],"df":2,"t_critical":4.302653,"ci95_low":-8.039912255591913,"ci95_high":4.437214190925257,"paired_seeds":[101,102,103]},"epoch_to_validation_98_delta":{"n":3,"mean":8.333333333333334,"sample_sd":2.8867513459481287,"values":[5.0,10.0,10.0],"df":2,"t_critical":4.302653,"ci95_low":1.1622450000000004,"ci95_high":15.504421666666667,"paired_seeds":[101,102,103]},"training_seconds_to_validation_98_delta":{"n":3,"mean":2.353592028333349,"sample_sd":1.4255744183112953,"values":[0.70815405200001,3.1355333060000046,3.217088727000032],"df":2,"t_critical":4.302653,"ci95_low":-1.187731367531546,"ci95_high":5.894915424198244,"paired_seeds":[101,102,103]},"training_speedup_ratio":{"n":3,"mean":1.1671563335576638,"sample_sd":0.007260884411640913,"values":[1.1637124158637597,1.175498338901992,1.16225824590724],"df":2,"t_critical":4.302653,"ci95_low":1.1491192956371363,"ci95_high":1.1851933714781913},"timing_by_hardware":[{"hardware":{"cpu_threads":2,"cuda_runtime":"13.0","dtype":"float32","float32_matmul_precision":"high","gpu":"NVIDIA A100-SXM4-40GB","tf32":true,"torch":"2.14.0+cu130"},"source_sha256":{"model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41","train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d"},"seeds":[101,102,103],"training_seconds_delta":{"n":3,"mean":-9.505799324000018,"sample_sd":0.38970540763935224,"values":[-9.340310015000085,-9.950939165000023,-9.226148791999947],"df":2,"t_critical":4.302653,"ci95_low":-10.473881284395398,"ci95_high":-8.537717363604637},"training_speedup_ratio":{"n":3,"mean":1.1671563335576638,"sample_sd":0.007260884411640913,"values":[1.1637124158637597,1.175498338901992,1.16225824590724],"df":2,"t_critical":4.302653,"ci95_low":1.1491192956371363,"ci95_high":1.1851933714781913}}],"interpretation":"Treatment minus residual dense: positive accuracy delta is better; negative error/loss/time delta is better. Quality pairs need not share assigned GPU variant. All time/speed comparisons exclude pairs with different or unknown reported GPU/runtime/source; hardware-specific strata are retained. Speedup is control training seconds / treatment training seconds, above one faster. A pooled matched-pair mean remains descriptive when its pairs use different A100 variants. Threshold-time comparisons include only pairs where both reached 98%; not an unconditional time-to-target estimate."},{"cohort":"main","treatment":"sd_annealed","control":"residual","endpoint":"final","seeds":[101,102,103],"run_pairs":[{"seed":101,"treatment":"graph-eval-sd_annealed-s101","control":"graph-eval-residual-s101"},{"seed":102,"treatment":"graph-eval-sd_annealed-s102","control":"graph-eval-residual-s102"},{"seed":103,"treatment":"graph-eval-sd_annealed-s103","control":"graph-eval-residual-s103"}],"test_accuracy_delta_pp":{"n":3,"mean":0.11000000000000269,"sample_sd":0.04582575694955941,"values":[0.07000000000000339,0.16000000000000458,0.10000000000000009],"df":2,"t_critical":4.302653,"ci95_low":-0.0038374981580597683,"ci95_high":0.22383749815806514},"test_error_count_delta":{"n":3,"mean":-11.0,"sample_sd":4.58257569495584,"values":[-7.0,-16.0,-10.0],"df":2,"t_critical":4.302653,"ci95_low":-22.383749815805995,"ci95_high":0.3837498158059951},"test_loss_delta":{"n":3,"mean":0.019750166829427086,"sample_sd":0.0169789159093816,"values":[0.034825952148437506,0.023066955566406255,0.0013575927734374993],"df":2,"t_critical":4.302653,"ci95_low":-0.022427801134912422,"ci95_high":0.06192813479376659},"error_disagreements":[{"seed":101,"test_n":10000,"treatment_wrong_control_correct":32,"treatment_correct_control_wrong":39,"both_wrong":121},{"seed":102,"test_n":10000,"treatment_wrong_control_correct":19,"treatment_correct_control_wrong":35,"both_wrong":125},{"seed":103,"test_n":10000,"treatment_wrong_control_correct":27,"treatment_correct_control_wrong":37,"both_wrong":123}],"timing_pairing":{"matched_seeds":[101,102,103],"excluded_pairs":[]},"training_seconds_delta":{"n":3,"mean":-9.505799324000018,"sample_sd":0.38970540763935224,"values":[-9.340310015000085,-9.950939165000023,-9.226148791999947],"df":2,"t_critical":4.302653,"ci95_low":-10.473881284395398,"ci95_high":-8.537717363604637,"paired_seeds":[101,102,103]},"selected_training_seconds_delta":{"n":3,"mean":-1.8013490323333283,"sample_sd":2.5113594958539602,"values":[0.70815405200001,-4.314560831999993,-1.7976403170000026],"df":2,"t_critical":4.302653,"ci95_low":-8.039912255591913,"ci95_high":4.437214190925257,"paired_seeds":[101,102,103]},"epoch_to_validation_98_delta":{"n":3,"mean":8.333333333333334,"sample_sd":2.8867513459481287,"values":[5.0,10.0,10.0],"df":2,"t_critical":4.302653,"ci95_low":1.1622450000000004,"ci95_high":15.504421666666667,"paired_seeds":[101,102,103]},"training_seconds_to_validation_98_delta":{"n":3,"mean":2.353592028333349,"sample_sd":1.4255744183112953,"values":[0.70815405200001,3.1355333060000046,3.217088727000032],"df":2,"t_critical":4.302653,"ci95_low":-1.187731367531546,"ci95_high":5.894915424198244,"paired_seeds":[101,102,103]},"training_speedup_ratio":{"n":3,"mean":1.1671563335576638,"sample_sd":0.007260884411640913,"values":[1.1637124158637597,1.175498338901992,1.16225824590724],"df":2,"t_critical":4.302653,"ci95_low":1.1491192956371363,"ci95_high":1.1851933714781913},"timing_by_hardware":[{"hardware":{"cpu_threads":2,"cuda_runtime":"13.0","dtype":"float32","float32_matmul_precision":"high","gpu":"NVIDIA A100-SXM4-40GB","tf32":true,"torch":"2.14.0+cu130"},"source_sha256":{"model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41","train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d"},"seeds":[101,102,103],"training_seconds_delta":{"n":3,"mean":-9.505799324000018,"sample_sd":0.38970540763935224,"values":[-9.340310015000085,-9.950939165000023,-9.226148791999947],"df":2,"t_critical":4.302653,"ci95_low":-10.473881284395398,"ci95_high":-8.537717363604637},"training_speedup_ratio":{"n":3,"mean":1.1671563335576638,"sample_sd":0.007260884411640913,"values":[1.1637124158637597,1.175498338901992,1.16225824590724],"df":2,"t_critical":4.302653,"ci95_low":1.1491192956371363,"ci95_high":1.1851933714781913}}],"interpretation":"Treatment minus residual dense: positive accuracy delta is better; negative error/loss/time delta is better. Quality pairs need not share assigned GPU variant. All time/speed comparisons exclude pairs with different or unknown reported GPU/runtime/source; hardware-specific strata are retained. Speedup is control training seconds / treatment training seconds, above one faster. A pooled matched-pair mean remains descriptive when its pairs use different A100 variants. Threshold-time comparisons include only pairs where both reached 98%; not an unconditional time-to-target estimate."},{"cohort":"main","treatment":"sd_constant","control":"residual","endpoint":"selected","seeds":[101,102,103],"run_pairs":[{"seed":101,"treatment":"graph-eval-sd_constant-s101","control":"graph-eval-residual-s101"},{"seed":102,"treatment":"graph-eval-sd_constant-s102","control":"graph-eval-residual-s102"},{"seed":103,"treatment":"graph-eval-sd_constant-s103","control":"graph-eval-residual-s103"}],"test_accuracy_delta_pp":{"n":3,"mean":-0.5699999999999964,"sample_sd":0.15620499351812867,"values":[-0.6699999999999928,-0.649999999999995,-0.39000000000000146],"df":2,"t_critical":4.302653,"ci95_low":-0.9580347395346391,"ci95_high":-0.1819652604653536},"test_error_count_delta":{"n":3,"mean":57.0,"sample_sd":15.620499351813308,"values":[67.0,65.0,39.0],"df":2,"t_critical":4.302653,"ci95_low":18.19652604653463,"ci95_high":95.80347395346537},"test_loss_delta":{"n":3,"mean":0.005250295003255208,"sample_sd":0.009346583022779346,"values":[0.008910327148437494,-0.0053724304199218725,0.012212988281250003],"df":2,"t_critical":4.302653,"ci95_low":-0.01796790581797643,"ci95_high":0.028468495824486843},"error_disagreements":[{"seed":101,"test_n":10000,"treatment_wrong_control_correct":104,"treatment_correct_control_wrong":37,"both_wrong":120},{"seed":102,"test_n":10000,"treatment_wrong_control_correct":107,"treatment_correct_control_wrong":42,"both_wrong":128},{"seed":103,"test_n":10000,"treatment_wrong_control_correct":83,"treatment_correct_control_wrong":44,"both_wrong":117}],"timing_pairing":{"matched_seeds":[101,102,103],"excluded_pairs":[]},"training_seconds_delta":{"n":3,"mean":-9.537474503666635,"sample_sd":0.46045923739716005,"values":[-9.611370781999966,-9.956516730999894,-9.044535998000043],"df":2,"t_critical":4.302653,"ci95_low":-10.681318731853814,"ci95_high":-8.393630275479456,"paired_seeds":[101,102,103]},"selected_training_seconds_delta":{"n":3,"mean":-2.869476160333329,"sample_sd":1.6937457989172624,"values":[-3.8508342470000105,-3.8438831419999904,-0.9137110919999856],"df":2,"t_critical":4.302653,"ci95_low":-7.076974237816229,"ci95_high":1.3380219171495713,"paired_seeds":[101,102,103]},"epoch_to_validation_98_delta":{"n":3,"mean":5.0,"sample_sd":0.0,"values":[5.0,5.0,5.0],"df":2,"t_critical":4.302653,"ci95_low":5.0,"ci95_high":5.0,"paired_seeds":[101,102,103]},"training_seconds_to_validation_98_delta":{"n":3,"mean":1.8793937466666801,"sample_sd":0.049691183179249705,"values":[1.8661536980000175,1.8376635950000004,1.9343639470000227],"df":2,"t_critical":4.302653,"ci95_low":1.7559539968363356,"ci95_high":2.0028334964970247,"paired_seeds":[101,102,103]},"training_speedup_ratio":{"n":3,"mean":1.1678131478649536,"sample_sd":0.008620598282218117,"values":[1.1692676314340178,1.1756139816490287,1.1585578305118145],"df":2,"t_critical":4.302653,"ci95_low":1.1463983932291801,"ci95_high":1.189227902500727},"timing_by_hardware":[{"hardware":{"cpu_threads":2,"cuda_runtime":"13.0","dtype":"float32","float32_matmul_precision":"high","gpu":"NVIDIA A100-SXM4-40GB","tf32":true,"torch":"2.14.0+cu130"},"source_sha256":{"model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41","train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d"},"seeds":[101,102,103],"training_seconds_delta":{"n":3,"mean":-9.537474503666635,"sample_sd":0.46045923739716005,"values":[-9.611370781999966,-9.956516730999894,-9.044535998000043],"df":2,"t_critical":4.302653,"ci95_low":-10.681318731853814,"ci95_high":-8.393630275479456},"training_speedup_ratio":{"n":3,"mean":1.1678131478649536,"sample_sd":0.008620598282218117,"values":[1.1692676314340178,1.1756139816490287,1.1585578305118145],"df":2,"t_critical":4.302653,"ci95_low":1.1463983932291801,"ci95_high":1.189227902500727}}],"interpretation":"Treatment minus residual dense: positive accuracy delta is better; negative error/loss/time delta is better. Quality pairs need not share assigned GPU variant. All time/speed comparisons exclude pairs with different or unknown reported GPU/runtime/source; hardware-specific strata are retained. Speedup is control training seconds / treatment training seconds, above one faster. A pooled matched-pair mean remains descriptive when its pairs use different A100 variants. Threshold-time comparisons include only pairs where both reached 98%; not an unconditional time-to-target estimate."},{"cohort":"main","treatment":"sd_constant","control":"residual","endpoint":"final","seeds":[101,102,103],"run_pairs":[{"seed":101,"treatment":"graph-eval-sd_constant-s101","control":"graph-eval-residual-s101"},{"seed":102,"treatment":"graph-eval-sd_constant-s102","control":"graph-eval-residual-s102"},{"seed":103,"treatment":"graph-eval-sd_constant-s103","control":"graph-eval-residual-s103"}],"test_accuracy_delta_pp":{"n":3,"mean":0.043333333333335965,"sample_sd":0.030550504633041625,"values":[0.07000000000000339,0.009999999999998899,0.050000000000005596],"df":2,"t_critical":4.302653,"ci95_low":-0.03255833210537736,"ci95_high":0.11922499877204928},"test_error_count_delta":{"n":3,"mean":-4.333333333333333,"sample_sd":3.0550504633038935,"values":[-7.0,-1.0,-5.0],"df":2,"t_critical":4.302653,"ci95_low":-11.922499877203997,"ci95_high":3.2558332105373307},"test_loss_delta":{"n":3,"mean":0.036410837809244784,"sample_sd":0.017294382426921287,"values":[0.025166687011718744,0.05632530517578124,0.027740521240234364],"df":2,"t_critical":4.302653,"ci95_low":-0.0065507924773316045,"ci95_high":0.07937246809582117},"error_disagreements":[{"seed":101,"test_n":10000,"treatment_wrong_control_correct":27,"treatment_correct_control_wrong":34,"both_wrong":126},{"seed":102,"test_n":10000,"treatment_wrong_control_correct":27,"treatment_correct_control_wrong":28,"both_wrong":132},{"seed":103,"test_n":10000,"treatment_wrong_control_correct":29,"treatment_correct_control_wrong":34,"both_wrong":126}],"timing_pairing":{"matched_seeds":[101,102,103],"excluded_pairs":[]},"training_seconds_delta":{"n":3,"mean":-9.537474503666635,"sample_sd":0.46045923739716005,"values":[-9.611370781999966,-9.956516730999894,-9.044535998000043],"df":2,"t_critical":4.302653,"ci95_low":-10.681318731853814,"ci95_high":-8.393630275479456,"paired_seeds":[101,102,103]},"selected_training_seconds_delta":{"n":3,"mean":-2.869476160333329,"sample_sd":1.6937457989172624,"values":[-3.8508342470000105,-3.8438831419999904,-0.9137110919999856],"df":2,"t_critical":4.302653,"ci95_low":-7.076974237816229,"ci95_high":1.3380219171495713,"paired_seeds":[101,102,103]},"epoch_to_validation_98_delta":{"n":3,"mean":5.0,"sample_sd":0.0,"values":[5.0,5.0,5.0],"df":2,"t_critical":4.302653,"ci95_low":5.0,"ci95_high":5.0,"paired_seeds":[101,102,103]},"training_seconds_to_validation_98_delta":{"n":3,"mean":1.8793937466666801,"sample_sd":0.049691183179249705,"values":[1.8661536980000175,1.8376635950000004,1.9343639470000227],"df":2,"t_critical":4.302653,"ci95_low":1.7559539968363356,"ci95_high":2.0028334964970247,"paired_seeds":[101,102,103]},"training_speedup_ratio":{"n":3,"mean":1.1678131478649536,"sample_sd":0.008620598282218117,"values":[1.1692676314340178,1.1756139816490287,1.1585578305118145],"df":2,"t_critical":4.302653,"ci95_low":1.1463983932291801,"ci95_high":1.189227902500727},"timing_by_hardware":[{"hardware":{"cpu_threads":2,"cuda_runtime":"13.0","dtype":"float32","float32_matmul_precision":"high","gpu":"NVIDIA A100-SXM4-40GB","tf32":true,"torch":"2.14.0+cu130"},"source_sha256":{"model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41","train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d"},"seeds":[101,102,103],"training_seconds_delta":{"n":3,"mean":-9.537474503666635,"sample_sd":0.46045923739716005,"values":[-9.611370781999966,-9.956516730999894,-9.044535998000043],"df":2,"t_critical":4.302653,"ci95_low":-10.681318731853814,"ci95_high":-8.393630275479456},"training_speedup_ratio":{"n":3,"mean":1.1678131478649536,"sample_sd":0.008620598282218117,"values":[1.1692676314340178,1.1756139816490287,1.1585578305118145],"df":2,"t_critical":4.302653,"ci95_low":1.1463983932291801,"ci95_high":1.189227902500727}}],"interpretation":"Treatment minus residual dense: positive accuracy delta is better; negative error/loss/time delta is better. Quality pairs need not share assigned GPU variant. All time/speed comparisons exclude pairs with different or unknown reported GPU/runtime/source; hardware-specific strata are retained. Speedup is control training seconds / treatment training seconds, above one faster. A pooled matched-pair mean remains descriptive when its pairs use different A100 variants. Threshold-time comparisons include only pairs where both reached 98%; not an unconditional time-to-target estimate."}],"runs":[{"run_id":"graph-eval-plain-s101","spec":{"run_id":"graph-eval-plain-s101","stage":"evaluate","cohort":"main","recipe":"plain","seed":101,"lr":0.03,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.0,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"e1efb33081a653eb2db13a44aa7d20f3f16925ea1dc8bc2e91ed2f639a3974ae","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"95de3b6ad9c32d8e212dfb753005644da2ec11a0822a569bc4955d1ef949a7c9"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":62.66078952299994,"total_run_seconds":65.040802399,"selected_epoch":5,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":15,"training_seconds_to_validation_98":9.425200231999998,"selected_training_seconds":3.1668497759999985,"selected_validation":{"loss":0.09530687255859376,"accuracy":0.9738,"accuracy_pct":97.38,"n":10000},"final_validation":{"loss":0.1359433837890625,"accuracy":0.9832,"accuracy_pct":98.32,"n":10000},"selected_dense_train_probe":{"loss":0.028665936279296873,"accuracy":0.9909,"accuracy_pct":99.09,"n":10000},"final_dense_train_probe":{"loss":1.508619450032711e-06,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_stochastic_training_loss":1.3511548786482308e-06,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":0.23657420100003446,"graph_setup_seconds":0.5377813729999996,"executed_epoch_masks_sha256":"c6b9d31d522f8bfcf99fed3eab8ee51ea530b24ebe6c1fdc846962552021ca03","selected_train":{"loss":0.0309840185546875,"accuracy":0.99052,"accuracy_pct":99.05199999999999,"n":50000},"selected_test":{"loss":0.08981358642578124,"accuracy":0.9756,"accuracy_pct":97.56,"n":10000,"errors":244,"wrong_indices_verified":true},"selected_generalization":{"validation_minus_train_loss":0.06432285400390625,"test_minus_train_loss":0.058829567871093745,"train_minus_validation_accuracy_pp":1.6719999999999957,"train_minus_test_accuracy_pp":1.4919999999999933},"final_train":{"loss":1.3377690315246583e-06,"accuracy":1.0,"accuracy_pct":100.0,"n":50000},"final_test":{"loss":0.10615570068359376,"accuracy":0.9855,"accuracy_pct":98.55000000000001,"n":10000,"errors":145,"wrong_indices_verified":true},"final_generalization":{"validation_minus_train_loss":0.135942046020031,"test_minus_train_loss":0.10615436291456223,"train_minus_validation_accuracy_pp":1.6800000000000037,"train_minus_test_accuracy_pp":1.4499999999999957}},{"run_id":"graph-eval-plain-s102","spec":{"run_id":"graph-eval-plain-s102","stage":"evaluate","cohort":"main","recipe":"plain","seed":102,"lr":0.03,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.0,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"4d0ac269167486811a0086108ca56313016afcebfc075d45e09455c228dee75b","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"e6025a334be66a35953ae9a58680d6697dd3473607a14ac350db1321c0a92bd9"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":62.06725023199999,"total_run_seconds":64.380409661,"selected_epoch":10,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":10,"training_seconds_to_validation_98":6.242367563,"selected_training_seconds":6.242367563,"selected_validation":{"loss":0.082777001953125,"accuracy":0.9808,"accuracy_pct":98.08,"n":10000},"final_validation":{"loss":0.12793756103515624,"accuracy":0.984,"accuracy_pct":98.4,"n":10000},"selected_dense_train_probe":{"loss":0.005651724243164062,"accuracy":0.9986,"accuracy_pct":99.86,"n":10000},"final_dense_train_probe":{"loss":1.4887548983097076e-06,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_stochastic_training_loss":1.4032017361387261e-06,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":0.2570380449999998,"graph_setup_seconds":0.4841900739999998,"executed_epoch_masks_sha256":"c6b9d31d522f8bfcf99fed3eab8ee51ea530b24ebe6c1fdc846962552021ca03","selected_train":{"loss":0.00522846435546875,"accuracy":0.99846,"accuracy_pct":99.846,"n":50000},"selected_test":{"loss":0.074681591796875,"accuracy":0.9822,"accuracy_pct":98.22,"n":10000,"errors":178,"wrong_indices_verified":true},"selected_generalization":{"validation_minus_train_loss":0.07754853759765624,"test_minus_train_loss":0.06945312744140625,"train_minus_validation_accuracy_pp":1.766000000000001,"train_minus_test_accuracy_pp":1.6260000000000052},"final_train":{"loss":1.389368176460266e-06,"accuracy":1.0,"accuracy_pct":100.0,"n":50000},"final_test":{"loss":0.118670654296875,"accuracy":0.9857,"accuracy_pct":98.57000000000001,"n":10000,"errors":143,"wrong_indices_verified":true},"final_generalization":{"validation_minus_train_loss":0.1279361716669798,"test_minus_train_loss":0.11866926492869853,"train_minus_validation_accuracy_pp":1.6000000000000014,"train_minus_test_accuracy_pp":1.429999999999998}},{"run_id":"graph-eval-plain-s103","spec":{"run_id":"graph-eval-plain-s103","stage":"evaluate","cohort":"main","recipe":"plain","seed":103,"lr":0.03,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.0,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"316aa46c9e0a65fa375b579be0871a16f447d396fe64f85e2063ee6ef8c8dd5d","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"2b1dca89b73a8be186981c47ab34da696096b300bc7be619f12a35965192253e"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":62.069416075999996,"total_run_seconds":64.464765977,"selected_epoch":10,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":20,"training_seconds_to_validation_98":12.442976295000003,"selected_training_seconds":6.247140233000003,"selected_validation":{"loss":0.09482418212890625,"accuracy":0.9784,"accuracy_pct":97.84,"n":10000},"final_validation":{"loss":0.12374986572265625,"accuracy":0.9843,"accuracy_pct":98.42999999999999,"n":10000},"selected_dense_train_probe":{"loss":0.010275442504882812,"accuracy":0.9969,"accuracy_pct":99.69,"n":10000},"final_dense_train_probe":{"loss":1.5430828556418418e-06,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_stochastic_training_loss":1.3994722394272685e-06,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":0.2796882149999744,"graph_setup_seconds":0.5044398809999997,"executed_epoch_masks_sha256":"c6b9d31d522f8bfcf99fed3eab8ee51ea530b24ebe6c1fdc846962552021ca03","selected_train":{"loss":0.012568994140625,"accuracy":0.9963,"accuracy_pct":99.63,"n":50000},"selected_test":{"loss":0.09139046630859375,"accuracy":0.9796,"accuracy_pct":97.96000000000001,"n":10000,"errors":204,"wrong_indices_verified":true},"selected_generalization":{"validation_minus_train_loss":0.08225518798828126,"test_minus_train_loss":0.07882147216796875,"train_minus_validation_accuracy_pp":1.7899999999999916,"train_minus_test_accuracy_pp":1.6699999999999937},"final_train":{"loss":1.3874831795692444e-06,"accuracy":1.0,"accuracy_pct":100.0,"n":50000},"final_test":{"loss":0.109908544921875,"accuracy":0.986,"accuracy_pct":98.6,"n":10000,"errors":140,"wrong_indices_verified":true},"final_generalization":{"validation_minus_train_loss":0.12374847823947668,"test_minus_train_loss":0.10990715743869543,"train_minus_validation_accuracy_pp":1.5700000000000047,"train_minus_test_accuracy_pp":1.4000000000000012}},{"run_id":"graph-eval-residual-s101","spec":{"run_id":"graph-eval-residual-s101","stage":"evaluate","cohort":"main","recipe":"residual","seed":101,"lr":0.01,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.0,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"e1efb33081a653eb2db13a44aa7d20f3f16925ea1dc8bc2e91ed2f639a3974ae","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"95de3b6ad9c32d8e212dfb753005644da2ec11a0822a569bc4955d1ef949a7c9"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":66.39346609800003,"total_run_seconds":69.289195148,"selected_epoch":10,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":10,"training_seconds_to_validation_98":6.697065197000002,"selected_training_seconds":6.697065197000002,"selected_validation":{"loss":0.07871497802734374,"accuracy":0.9824,"accuracy_pct":98.24000000000001,"n":10000},"final_validation":{"loss":0.1132458740234375,"accuracy":0.9825,"accuracy_pct":98.25,"n":10000},"selected_dense_train_probe":{"loss":0.0005857361793518066,"accuracy":0.9999,"accuracy_pct":99.99,"n":10000},"final_dense_train_probe":{"loss":7.73824155330658e-06,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_stochastic_training_loss":7.716164873272646e-06,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":0.42535296200006467,"graph_setup_seconds":0.5471660720000004,"executed_epoch_masks_sha256":"c6b9d31d522f8bfcf99fed3eab8ee51ea530b24ebe6c1fdc846962552021ca03","selected_train":{"loss":0.0006481150817871094,"accuracy":0.9999,"accuracy_pct":99.99,"n":50000},"selected_test":{"loss":0.06685361328125,"accuracy":0.9843,"accuracy_pct":98.42999999999999,"n":10000,"errors":157,"wrong_indices_verified":true},"selected_generalization":{"validation_minus_train_loss":0.07806686294555663,"test_minus_train_loss":0.06620549819946289,"train_minus_validation_accuracy_pp":1.749999999999996,"train_minus_test_accuracy_pp":1.5600000000000058},"final_train":{"loss":7.610405683517456e-06,"accuracy":1.0,"accuracy_pct":100.0,"n":50000},"final_test":{"loss":0.09158612060546875,"accuracy":0.984,"accuracy_pct":98.4,"n":10000,"errors":160,"wrong_indices_verified":true},"final_generalization":{"validation_minus_train_loss":0.11323826361775398,"test_minus_train_loss":0.09157851019978523,"train_minus_validation_accuracy_pp":1.749999999999996,"train_minus_test_accuracy_pp":1.6000000000000014}},{"run_id":"graph-eval-residual-s102","spec":{"run_id":"graph-eval-residual-s102","stage":"evaluate","cohort":"main","recipe":"residual","seed":102,"lr":0.01,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.0,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"4d0ac269167486811a0086108ca56313016afcebfc075d45e09455c228dee75b","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"e6025a334be66a35953ae9a58680d6697dd3473607a14ac350db1321c0a92bd9"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":66.65198389999996,"total_run_seconds":69.40373477499999,"selected_epoch":10,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":10,"training_seconds_to_validation_98":6.709153070999998,"selected_training_seconds":6.709153070999998,"selected_validation":{"loss":0.086232080078125,"accuracy":0.9813,"accuracy_pct":98.13,"n":10000},"final_validation":{"loss":0.1143310546875,"accuracy":0.983,"accuracy_pct":98.3,"n":10000},"selected_dense_train_probe":{"loss":0.0010311304092407226,"accuracy":0.9999,"accuracy_pct":99.99,"n":10000},"final_dense_train_probe":{"loss":7.656004279851914e-06,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_stochastic_training_loss":7.856979209464043e-06,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":0.36275831900002853,"graph_setup_seconds":0.5074710900000001,"executed_epoch_masks_sha256":"c6b9d31d522f8bfcf99fed3eab8ee51ea530b24ebe6c1fdc846962552021ca03","selected_train":{"loss":0.0013115446472167969,"accuracy":0.99974,"accuracy_pct":99.97399999999999,"n":50000},"selected_test":{"loss":0.08115352172851563,"accuracy":0.983,"accuracy_pct":98.3,"n":10000,"errors":170,"wrong_indices_verified":true},"selected_generalization":{"validation_minus_train_loss":0.0849205354309082,"test_minus_train_loss":0.07984197708129884,"train_minus_validation_accuracy_pp":1.8440000000000012,"train_minus_test_accuracy_pp":1.6739999999999977},"final_train":{"loss":7.733514308929443e-06,"accuracy":1.0,"accuracy_pct":100.0,"n":50000},"final_test":{"loss":0.10281859130859375,"accuracy":0.984,"accuracy_pct":98.4,"n":10000,"errors":160,"wrong_indices_verified":true},"final_generalization":{"validation_minus_train_loss":0.11432332117319108,"test_minus_train_loss":0.10281085779428482,"train_minus_validation_accuracy_pp":1.7000000000000015,"train_minus_test_accuracy_pp":1.6000000000000014}},{"run_id":"graph-eval-residual-s103","spec":{"run_id":"graph-eval-residual-s103","stage":"evaluate","cohort":"main","recipe":"residual","seed":103,"lr":0.01,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.0,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"316aa46c9e0a65fa375b579be0871a16f447d396fe64f85e2063ee6ef8c8dd5d","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"2b1dca89b73a8be186981c47ab34da696096b300bc7be619f12a35965192253e"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":66.08704199600002,"total_run_seconds":68.436189201,"selected_epoch":10,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":10,"training_seconds_to_validation_98":6.654841128000001,"selected_training_seconds":6.654841128000001,"selected_validation":{"loss":0.08150302734375,"accuracy":0.9818,"accuracy_pct":98.18,"n":10000},"final_validation":{"loss":0.1161923583984375,"accuracy":0.9826,"accuracy_pct":98.26,"n":10000},"selected_dense_train_probe":{"loss":0.0009086164474487305,"accuracy":0.9998,"accuracy_pct":99.98,"n":10000},"final_dense_train_probe":{"loss":8.095967769622803e-06,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_stochastic_training_loss":7.685952368774451e-06,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":0.24180300400000743,"graph_setup_seconds":0.5549174040000002,"executed_epoch_masks_sha256":"c6b9d31d522f8bfcf99fed3eab8ee51ea530b24ebe6c1fdc846962552021ca03","selected_train":{"loss":0.0009604203796386719,"accuracy":0.99988,"accuracy_pct":99.988,"n":50000},"selected_test":{"loss":0.0732955322265625,"accuracy":0.9839,"accuracy_pct":98.39,"n":10000,"errors":161,"wrong_indices_verified":true},"selected_generalization":{"validation_minus_train_loss":0.08054260696411134,"test_minus_train_loss":0.07233511184692383,"train_minus_validation_accuracy_pp":1.8079999999999985,"train_minus_test_accuracy_pp":1.5979999999999994},"final_train":{"loss":7.571223378181458e-06,"accuracy":1.0,"accuracy_pct":100.0,"n":50000},"final_test":{"loss":0.09727741088867188,"accuracy":0.984,"accuracy_pct":98.4,"n":10000,"errors":160,"wrong_indices_verified":true},"final_generalization":{"validation_minus_train_loss":0.11618478717505933,"test_minus_train_loss":0.0972698396652937,"train_minus_validation_accuracy_pp":1.739999999999997,"train_minus_test_accuracy_pp":1.6000000000000014}},{"run_id":"graph-eval-residual_unit_dropout-s101","spec":{"run_id":"graph-eval-residual_unit_dropout-s101","stage":"evaluate","cohort":"main","recipe":"residual_unit_dropout","seed":101,"lr":0.01,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.2,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"e1efb33081a653eb2db13a44aa7d20f3f16925ea1dc8bc2e91ed2f639a3974ae","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"95de3b6ad9c32d8e212dfb753005644da2ec11a0822a569bc4955d1ef949a7c9"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":69.06684382699984,"total_run_seconds":70.44327690200001,"selected_epoch":15,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":15,"training_seconds_to_validation_98":10.387162182999987,"selected_training_seconds":10.387162182999987,"selected_validation":{"loss":0.07943436889648438,"accuracy":0.9814,"accuracy_pct":98.14,"n":10000},"final_validation":{"loss":0.1133442626953125,"accuracy":0.983,"accuracy_pct":98.3,"n":10000},"selected_dense_train_probe":{"loss":0.0023075422286987306,"accuracy":0.9994,"accuracy_pct":99.94,"n":10000},"final_dense_train_probe":{"loss":5.356653928756714e-05,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_stochastic_training_loss":0.00178746716119349,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":0.17526344500004143,"graph_setup_seconds":0.03377378700000122,"executed_epoch_masks_sha256":"c6b9d31d522f8bfcf99fed3eab8ee51ea530b24ebe6c1fdc846962552021ca03","selected_train":{"loss":0.00284011474609375,"accuracy":0.99928,"accuracy_pct":99.928,"n":50000},"selected_test":{"loss":0.070423388671875,"accuracy":0.9849,"accuracy_pct":98.49,"n":10000,"errors":151,"wrong_indices_verified":true},"selected_generalization":{"validation_minus_train_loss":0.07659425415039063,"test_minus_train_loss":0.06758327392578126,"train_minus_validation_accuracy_pp":1.7879999999999896,"train_minus_test_accuracy_pp":1.4379999999999948},"final_train":{"loss":0.00013944978713989259,"accuracy":0.99996,"accuracy_pct":99.996,"n":50000},"final_test":{"loss":0.09737022094726562,"accuracy":0.9851,"accuracy_pct":98.50999999999999,"n":10000,"errors":149,"wrong_indices_verified":true},"final_generalization":{"validation_minus_train_loss":0.11320481290817261,"test_minus_train_loss":0.09723077116012573,"train_minus_validation_accuracy_pp":1.6959999999999975,"train_minus_test_accuracy_pp":1.4859999999999984}},{"run_id":"graph-eval-residual_unit_dropout-s102","spec":{"run_id":"graph-eval-residual_unit_dropout-s102","stage":"evaluate","cohort":"main","recipe":"residual_unit_dropout","seed":102,"lr":0.01,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.2,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"4d0ac269167486811a0086108ca56313016afcebfc075d45e09455c228dee75b","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"e6025a334be66a35953ae9a58680d6697dd3473607a14ac350db1321c0a92bd9"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":68.9706536939999,"total_run_seconds":70.302410441,"selected_epoch":15,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":15,"training_seconds_to_validation_98":10.391320092999962,"selected_training_seconds":10.391320092999962,"selected_validation":{"loss":0.07700753784179687,"accuracy":0.9824,"accuracy_pct":98.24000000000001,"n":10000},"final_validation":{"loss":0.12150003662109375,"accuracy":0.9848,"accuracy_pct":98.48,"n":10000},"selected_dense_train_probe":{"loss":0.0034024448394775393,"accuracy":0.999,"accuracy_pct":99.9,"n":10000},"final_dense_train_probe":{"loss":3.8077834993600845e-06,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_stochastic_training_loss":0.00023923903063405305,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":0.2019195160000038,"graph_setup_seconds":0.03338537299998734,"executed_epoch_masks_sha256":"c6b9d31d522f8bfcf99fed3eab8ee51ea530b24ebe6c1fdc846962552021ca03","selected_train":{"loss":0.0042043408203125,"accuracy":0.9989,"accuracy_pct":99.89,"n":50000},"selected_test":{"loss":0.07600043334960938,"accuracy":0.9828,"accuracy_pct":98.28,"n":10000,"errors":172,"wrong_indices_verified":true},"selected_generalization":{"validation_minus_train_loss":0.07280319702148437,"test_minus_train_loss":0.07179609252929688,"train_minus_validation_accuracy_pp":1.649999999999996,"train_minus_test_accuracy_pp":1.6100000000000003},"final_train":{"loss":4.563659131526947e-06,"accuracy":1.0,"accuracy_pct":100.0,"n":50000},"final_test":{"loss":0.10340599365234375,"accuracy":0.9862,"accuracy_pct":98.61999999999999,"n":10000,"errors":138,"wrong_indices_verified":true},"final_generalization":{"validation_minus_train_loss":0.12149547296196223,"test_minus_train_loss":0.10340142999321222,"train_minus_validation_accuracy_pp":1.5199999999999991,"train_minus_test_accuracy_pp":1.3800000000000034}},{"run_id":"graph-eval-residual_unit_dropout-s103","spec":{"run_id":"graph-eval-residual_unit_dropout-s103","stage":"evaluate","cohort":"main","recipe":"residual_unit_dropout","seed":103,"lr":0.01,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.2,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"316aa46c9e0a65fa375b579be0871a16f447d396fe64f85e2063ee6ef8c8dd5d","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"2b1dca89b73a8be186981c47ab34da696096b300bc7be619f12a35965192253e"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":69.05123090900008,"total_run_seconds":70.41408692899998,"selected_epoch":10,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":10,"training_seconds_to_validation_98":6.922194121000075,"selected_training_seconds":6.922194121000075,"selected_validation":{"loss":0.07913580322265625,"accuracy":0.9802,"accuracy_pct":98.02,"n":10000},"final_validation":{"loss":0.13693134765625,"accuracy":0.9814,"accuracy_pct":98.14,"n":10000},"selected_dense_train_probe":{"loss":0.006542992401123047,"accuracy":0.9979,"accuracy_pct":99.79,"n":10000},"final_dense_train_probe":{"loss":0.0022846445083618164,"accuracy":0.9994,"accuracy_pct":99.94,"n":10000},"final_stochastic_training_loss":0.0007256848039105535,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":0.1850075390000825,"graph_setup_seconds":0.03211320100001558,"executed_epoch_masks_sha256":"c6b9d31d522f8bfcf99fed3eab8ee51ea530b24ebe6c1fdc846962552021ca03","selected_train":{"loss":0.00696410400390625,"accuracy":0.99766,"accuracy_pct":99.766,"n":50000},"selected_test":{"loss":0.06777940673828126,"accuracy":0.9822,"accuracy_pct":98.22,"n":10000,"errors":178,"wrong_indices_verified":true},"selected_generalization":{"validation_minus_train_loss":0.07217169921875,"test_minus_train_loss":0.06081530273437501,"train_minus_validation_accuracy_pp":1.746000000000003,"train_minus_test_accuracy_pp":1.546000000000003},"final_train":{"loss":0.004401022338867188,"accuracy":0.99904,"accuracy_pct":99.90400000000001,"n":50000},"final_test":{"loss":0.1084447509765625,"accuracy":0.9839,"accuracy_pct":98.39,"n":10000,"errors":161,"wrong_indices_verified":true},"final_generalization":{"validation_minus_train_loss":0.13253032531738282,"test_minus_train_loss":0.10404372863769532,"train_minus_validation_accuracy_pp":1.763999999999999,"train_minus_test_accuracy_pp":1.5140000000000042}},{"run_id":"graph-eval-sd_annealed-s101","spec":{"run_id":"graph-eval-sd_annealed-s101","stage":"evaluate","cohort":"main","recipe":"sd_annealed","seed":101,"lr":0.01,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.8,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"e1efb33081a653eb2db13a44aa7d20f3f16925ea1dc8bc2e91ed2f639a3974ae","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"95de3b6ad9c32d8e212dfb753005644da2ec11a0822a569bc4955d1ef949a7c9"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":57.05315608299995,"total_run_seconds":59.033537945000006,"selected_epoch":15,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":15,"training_seconds_to_validation_98":7.405219249000012,"selected_training_seconds":7.405219249000012,"selected_validation":{"loss":0.0818095947265625,"accuracy":0.9809,"accuracy_pct":98.09,"n":10000},"final_validation":{"loss":0.134895361328125,"accuracy":0.9835,"accuracy_pct":98.35000000000001,"n":10000},"selected_dense_train_probe":{"loss":0.00715621337890625,"accuracy":0.9973,"accuracy_pct":99.72999999999999,"n":10000},"final_dense_train_probe":{"loss":9.382639080286026e-07,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_stochastic_training_loss":9.261892159884155e-07,"skipped_batch_counts":[7686,15519,23418,31322],"epoch_preparation_seconds":0.29897472499999367,"graph_setup_seconds":0.1592274239999938,"executed_epoch_masks_sha256":"7f080c9dd9f622e6792827835a0d7cffa5d21024e2c0c040c33046bec63b2718","selected_train":{"loss":0.0073738916015625,"accuracy":0.9978,"accuracy_pct":99.78,"n":50000},"selected_test":{"loss":0.0753540283203125,"accuracy":0.9822,"accuracy_pct":98.22,"n":10000,"errors":178,"wrong_indices_verified":true},"selected_generalization":{"validation_minus_train_loss":0.074435703125,"test_minus_train_loss":0.06798013671875,"train_minus_validation_accuracy_pp":1.6900000000000026,"train_minus_test_accuracy_pp":1.5600000000000058},"final_train":{"loss":9.178103506565094e-07,"accuracy":1.0,"accuracy_pct":100.0,"n":50000},"final_test":{"loss":0.12641207275390626,"accuracy":0.9847,"accuracy_pct":98.47,"n":10000,"errors":153,"wrong_indices_verified":true},"final_generalization":{"validation_minus_train_loss":0.13489444351777433,"test_minus_train_loss":0.1264111549435556,"train_minus_validation_accuracy_pp":1.649999999999996,"train_minus_test_accuracy_pp":1.529999999999998}},{"run_id":"graph-eval-sd_annealed-s102","spec":{"run_id":"graph-eval-sd_annealed-s102","stage":"evaluate","cohort":"main","recipe":"sd_annealed","seed":102,"lr":0.01,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.8,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"4d0ac269167486811a0086108ca56313016afcebfc075d45e09455c228dee75b","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"e6025a334be66a35953ae9a58680d6697dd3473607a14ac350db1321c0a92bd9"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":56.70104473499994,"total_run_seconds":57.97499664500002,"selected_epoch":5,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":20,"training_seconds_to_validation_98":9.844686377000002,"selected_training_seconds":2.394592239000005,"selected_validation":{"loss":0.080600244140625,"accuracy":0.9758,"accuracy_pct":97.58,"n":10000},"final_validation":{"loss":0.1462005126953125,"accuracy":0.9834,"accuracy_pct":98.34,"n":10000},"selected_dense_train_probe":{"loss":0.0401638427734375,"accuracy":0.9882,"accuracy_pct":98.82,"n":10000},"final_dense_train_probe":{"loss":1.3413389213383198e-06,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_stochastic_training_loss":1.006537672765262e-06,"skipped_batch_counts":[7895,15464,23344,31254],"epoch_preparation_seconds":0.1870565390000678,"graph_setup_seconds":0.1109077150000104,"executed_epoch_masks_sha256":"5cc83739e5c7a5dec2a1a5572ab525be6f8e5b546b350f7746877116d00f848a","selected_train":{"loss":0.03972373779296875,"accuracy":0.98842,"accuracy_pct":98.842,"n":50000},"selected_test":{"loss":0.073514599609375,"accuracy":0.9767,"accuracy_pct":97.67,"n":10000,"errors":233,"wrong_indices_verified":true},"selected_generalization":{"validation_minus_train_loss":0.04087650634765625,"test_minus_train_loss":0.03379086181640625,"train_minus_validation_accuracy_pp":1.2619999999999965,"train_minus_test_accuracy_pp":1.1719999999999953},"final_train":{"loss":9.956718981266022e-07,"accuracy":1.0,"accuracy_pct":100.0,"n":50000},"final_test":{"loss":0.125885546875,"accuracy":0.9856,"accuracy_pct":98.56,"n":10000,"errors":144,"wrong_indices_verified":true},"final_generalization":{"validation_minus_train_loss":0.14619951702341438,"test_minus_train_loss":0.12588455120310188,"train_minus_validation_accuracy_pp":1.6599999999999948,"train_minus_test_accuracy_pp":1.4399999999999968}},{"run_id":"graph-eval-sd_annealed-s103","spec":{"run_id":"graph-eval-sd_annealed-s103","stage":"evaluate","cohort":"main","recipe":"sd_annealed","seed":103,"lr":0.01,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.8,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"316aa46c9e0a65fa375b579be0871a16f447d396fe64f85e2063ee6ef8c8dd5d","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"2b1dca89b73a8be186981c47ab34da696096b300bc7be619f12a35965192253e"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":56.86089320400008,"total_run_seconds":58.654153147,"selected_epoch":10,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":20,"training_seconds_to_validation_98":9.871929855000033,"selected_training_seconds":4.8572008109999985,"selected_validation":{"loss":0.07372632446289062,"accuracy":0.9795,"accuracy_pct":97.95,"n":10000},"final_validation":{"loss":0.11486622314453125,"accuracy":0.9829,"accuracy_pct":98.29,"n":10000},"selected_dense_train_probe":{"loss":0.0138310546875,"accuracy":0.9956,"accuracy_pct":99.56,"n":10000},"final_dense_train_probe":{"loss":1.2217939645051956e-05,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_stochastic_training_loss":1.2222410077811219e-05,"skipped_batch_counts":[7810,15508,23505,31406],"epoch_preparation_seconds":0.29633173399990653,"graph_setup_seconds":0.125818663000004,"executed_epoch_masks_sha256":"2de62d03bda035af20852fab73e694563101ffffd22d66c4fce3a855e2421ca8","selected_train":{"loss":0.013546199951171876,"accuracy":0.99588,"accuracy_pct":99.588,"n":50000},"selected_test":{"loss":0.06864859008789062,"accuracy":0.981,"accuracy_pct":98.1,"n":10000,"errors":190,"wrong_indices_verified":true},"selected_generalization":{"validation_minus_train_loss":0.06018012451171875,"test_minus_train_loss":0.05510239013671875,"train_minus_validation_accuracy_pp":1.637999999999995,"train_minus_test_accuracy_pp":1.4880000000000004},"final_train":{"loss":1.161283016204834e-05,"accuracy":1.0,"accuracy_pct":100.0,"n":50000},"final_test":{"loss":0.09863500366210938,"accuracy":0.985,"accuracy_pct":98.5,"n":10000,"errors":150,"wrong_indices_verified":true},"final_generalization":{"validation_minus_train_loss":0.11485461031436921,"test_minus_train_loss":0.09862339083194734,"train_minus_validation_accuracy_pp":1.7100000000000004,"train_minus_test_accuracy_pp":1.5000000000000013}},{"run_id":"graph-eval-sd_constant-s101","spec":{"run_id":"graph-eval-sd_constant-s101","stage":"evaluate","cohort":"main","recipe":"sd_constant","seed":101,"lr":0.01,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.4,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"e1efb33081a653eb2db13a44aa7d20f3f16925ea1dc8bc2e91ed2f639a3974ae","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"95de3b6ad9c32d8e212dfb753005644da2ec11a0822a569bc4955d1ef949a7c9"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":56.78209531600007,"total_run_seconds":58.152022927999994,"selected_epoch":5,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":15,"training_seconds_to_validation_98":8.56321889500002,"selected_training_seconds":2.846230949999992,"selected_validation":{"loss":0.08439702758789062,"accuracy":0.9763,"accuracy_pct":97.63,"n":10000},"final_validation":{"loss":0.129225,"accuracy":0.9848,"accuracy_pct":98.48,"n":10000},"selected_dense_train_probe":{"loss":0.030873800659179686,"accuracy":0.9903,"accuracy_pct":99.03,"n":10000},"final_dense_train_probe":{"loss":2.94302012771368e-06,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_stochastic_training_loss":0.0006054788245819509,"skipped_batch_counts":[7719,15527,23589,31320],"epoch_preparation_seconds":0.1956165539999688,"graph_setup_seconds":0.14420809399999257,"executed_epoch_masks_sha256":"6f6f74a7d2fae89dc21498f67de8163fc7dc26050fdfaec7741ac7f69389fb22","selected_train":{"loss":0.02965966796875,"accuracy":0.99028,"accuracy_pct":99.028,"n":50000},"selected_test":{"loss":0.0757639404296875,"accuracy":0.9776,"accuracy_pct":97.76,"n":10000,"errors":224,"wrong_indices_verified":true},"selected_generalization":{"validation_minus_train_loss":0.05473735961914063,"test_minus_train_loss":0.0461042724609375,"train_minus_validation_accuracy_pp":1.3980000000000103,"train_minus_test_accuracy_pp":1.2680000000000025},"final_train":{"loss":2.671930193901062e-06,"accuracy":1.0,"accuracy_pct":100.0,"n":50000},"final_test":{"loss":0.1167528076171875,"accuracy":0.9847,"accuracy_pct":98.47,"n":10000,"errors":153,"wrong_indices_verified":true},"final_generalization":{"validation_minus_train_loss":0.1292223280698061,"test_minus_train_loss":0.11675013568699359,"train_minus_validation_accuracy_pp":1.5199999999999991,"train_minus_test_accuracy_pp":1.529999999999998}},{"run_id":"graph-eval-sd_constant-s102","spec":{"run_id":"graph-eval-sd_constant-s102","stage":"evaluate","cohort":"main","recipe":"sd_constant","seed":102,"lr":0.01,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.4,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"4d0ac269167486811a0086108ca56313016afcebfc075d45e09455c228dee75b","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"e6025a334be66a35953ae9a58680d6697dd3473607a14ac350db1321c0a92bd9"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":56.69546716900007,"total_run_seconds":57.99291641699999,"selected_epoch":5,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":15,"training_seconds_to_validation_98":8.546816665999998,"selected_training_seconds":2.865269929000007,"selected_validation":{"loss":0.08423145141601562,"accuracy":0.9744,"accuracy_pct":97.44,"n":10000},"final_validation":{"loss":0.1662599365234375,"accuracy":0.9841,"accuracy_pct":98.41,"n":10000},"selected_dense_train_probe":{"loss":0.03068314208984375,"accuracy":0.9908,"accuracy_pct":99.08,"n":10000},"final_dense_train_probe":{"loss":9.336449205875397e-07,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_stochastic_training_loss":0.0006684671971015632,"skipped_batch_counts":[7773,15460,23463,31533],"epoch_preparation_seconds":0.1949651999999844,"graph_setup_seconds":0.11921265600000197,"executed_epoch_masks_sha256":"110c09d9a0eeb4048cb45deae9679a9c176daffccfc5e4ec9048c3a63b37a75f","selected_train":{"loss":0.029500888671875,"accuracy":0.99086,"accuracy_pct":99.086,"n":50000},"selected_test":{"loss":0.07578109130859376,"accuracy":0.9765,"accuracy_pct":97.65,"n":10000,"errors":235,"wrong_indices_verified":true},"selected_generalization":{"validation_minus_train_loss":0.05473056274414062,"test_minus_train_loss":0.046280202636718754,"train_minus_validation_accuracy_pp":1.645999999999992,"train_minus_test_accuracy_pp":1.4359999999999928},"final_train":{"loss":5.373771861195564e-07,"accuracy":1.0,"accuracy_pct":100.0,"n":50000},"final_test":{"loss":0.159143896484375,"accuracy":0.9841,"accuracy_pct":98.41,"n":10000,"errors":159,"wrong_indices_verified":true},"final_generalization":{"validation_minus_train_loss":0.1662593991462514,"test_minus_train_loss":0.15914335910718888,"train_minus_validation_accuracy_pp":1.5900000000000025,"train_minus_test_accuracy_pp":1.5900000000000025}},{"run_id":"graph-eval-sd_constant-s103","spec":{"run_id":"graph-eval-sd_constant-s103","stage":"evaluate","cohort":"main","recipe":"sd_constant","seed":103,"lr":0.01,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.4,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"316aa46c9e0a65fa375b579be0871a16f447d396fe64f85e2063ee6ef8c8dd5d","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"2b1dca89b73a8be186981c47ab34da696096b300bc7be619f12a35965192253e"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":57.04250599799998,"total_run_seconds":58.59628729100001,"selected_epoch":10,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":15,"training_seconds_to_validation_98":8.589205075000024,"selected_training_seconds":5.7411300360000155,"selected_validation":{"loss":0.08811070556640625,"accuracy":0.9794,"accuracy_pct":97.94,"n":10000},"final_validation":{"loss":0.139342626953125,"accuracy":0.9838,"accuracy_pct":98.38,"n":10000},"selected_dense_train_probe":{"loss":0.012710030364990235,"accuracy":0.9957,"accuracy_pct":99.57000000000001,"n":10000},"final_dense_train_probe":{"loss":4.725553095340729e-06,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_stochastic_training_loss":0.0006976648001000285,"skipped_batch_counts":[7857,15464,23550,31175],"epoch_preparation_seconds":0.19466109800012532,"graph_setup_seconds":0.23537590499999794,"executed_epoch_masks_sha256":"0e6eed5c0ba1bd9ffbeec35989c7757838c2f84735863944493b0cfa786550e8","selected_train":{"loss":0.01180263671875,"accuracy":0.99598,"accuracy_pct":99.598,"n":50000},"selected_test":{"loss":0.0855085205078125,"accuracy":0.98,"accuracy_pct":98.0,"n":10000,"errors":200,"wrong_indices_verified":true},"selected_generalization":{"validation_minus_train_loss":0.07630806884765626,"test_minus_train_loss":0.07370588378906251,"train_minus_validation_accuracy_pp":1.6579999999999928,"train_minus_test_accuracy_pp":1.5979999999999994},"final_train":{"loss":3.2176196575164796e-06,"accuracy":1.0,"accuracy_pct":100.0,"n":50000},"final_test":{"loss":0.12501793212890625,"accuracy":0.9845,"accuracy_pct":98.45,"n":10000,"errors":155,"wrong_indices_verified":true},"final_generalization":{"validation_minus_train_loss":0.13933940933346747,"test_minus_train_loss":0.12501471450924873,"train_minus_validation_accuracy_pp":1.6199999999999992,"train_minus_test_accuracy_pp":1.5499999999999958}},{"run_id":"graph-fidelity-source-plain-s101","spec":{"run_id":"graph-fidelity-source-plain-s101","stage":"evaluate","cohort":"fidelity","variant":"source-plain","recipe":"plain","seed":101,"lr":0.001,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"momentum":0.9,"pmax":0.0,"input_scale":1.0,"output_relu":true,"shrinkage":2e-05,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"e1efb33081a653eb2db13a44aa7d20f3f16925ea1dc8bc2e91ed2f639a3974ae","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"95de3b6ad9c32d8e212dfb753005644da2ec11a0822a569bc4955d1ef949a7c9"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":68.18079109299993,"total_run_seconds":70.683689947,"selected_epoch":75,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":15,"training_seconds_to_validation_98":10.243587533999943,"selected_training_seconds":51.15088855100001,"selected_validation":{"loss":0.06670652465820312,"accuracy":0.981,"accuracy_pct":98.1,"n":10000},"final_validation":{"loss":0.06887960205078125,"accuracy":0.9814,"accuracy_pct":98.14,"n":10000},"selected_dense_train_probe":{"loss":0.0011584625244140626,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_dense_train_probe":{"loss":0.0011736854553222656,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_stochastic_training_loss":0.001167256967164576,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":0.36385658099996476,"graph_setup_seconds":0.03615571999998224,"executed_epoch_masks_sha256":"c6b9d31d522f8bfcf99fed3eab8ee51ea530b24ebe6c1fdc846962552021ca03","selected_train":{"loss":0.0011725679016113281,"accuracy":1.0,"accuracy_pct":100.0,"n":50000},"selected_test":{"loss":0.05650311889648438,"accuracy":0.9834,"accuracy_pct":98.34,"n":10000,"errors":166,"wrong_indices_verified":true},"selected_generalization":{"validation_minus_train_loss":0.0655339567565918,"test_minus_train_loss":0.05533055099487305,"train_minus_validation_accuracy_pp":1.9000000000000017,"train_minus_test_accuracy_pp":1.6599999999999948},"final_train":{"loss":0.001150615997314453,"accuracy":1.0,"accuracy_pct":100.0,"n":50000},"final_test":{"loss":0.06090704956054688,"accuracy":0.9828,"accuracy_pct":98.28,"n":10000,"errors":172,"wrong_indices_verified":true},"final_generalization":{"validation_minus_train_loss":0.0677289860534668,"test_minus_train_loss":0.059756433563232424,"train_minus_validation_accuracy_pp":1.859999999999995,"train_minus_test_accuracy_pp":1.7199999999999993}},{"run_id":"graph-fidelity-source-plain-s102","spec":{"run_id":"graph-fidelity-source-plain-s102","stage":"evaluate","cohort":"fidelity","variant":"source-plain","recipe":"plain","seed":102,"lr":0.001,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"momentum":0.9,"pmax":0.0,"input_scale":1.0,"output_relu":true,"shrinkage":2e-05,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"4d0ac269167486811a0086108ca56313016afcebfc075d45e09455c228dee75b","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"e6025a334be66a35953ae9a58680d6697dd3473607a14ac350db1321c0a92bd9"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":68.02555690100002,"total_run_seconds":69.73668832800001,"selected_epoch":50,"last_epoch":100,"validation_98_reached":false,"epoch_to_validation_98":null,"training_seconds_to_validation_98":null,"selected_training_seconds":34.01507250700001,"selected_validation":{"loss":0.3086169921875,"accuracy":0.8764,"accuracy_pct":87.64,"n":10000},"final_validation":{"loss":0.3184699951171875,"accuracy":0.8749,"accuracy_pct":87.49,"n":10000},"selected_dense_train_probe":{"loss":0.2721522216796875,"accuracy":0.8825,"accuracy_pct":88.25,"n":10000},"final_dense_train_probe":{"loss":0.273406982421875,"accuracy":0.8824,"accuracy_pct":88.24,"n":10000},"final_stochastic_training_loss":0.26543089747428894,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":0.1790126180000584,"graph_setup_seconds":0.039874506999979076,"executed_epoch_masks_sha256":"c6b9d31d522f8bfcf99fed3eab8ee51ea530b24ebe6c1fdc846962552021ca03","selected_train":{"loss":0.26284958984375,"accuracy":0.88654,"accuracy_pct":88.654,"n":50000},"selected_test":{"loss":0.320281689453125,"accuracy":0.87,"accuracy_pct":87.0,"n":10000,"errors":1300,"wrong_indices_verified":true},"selected_generalization":{"validation_minus_train_loss":0.045767402343749986,"test_minus_train_loss":0.05743209960937501,"train_minus_validation_accuracy_pp":1.0140000000000038,"train_minus_test_accuracy_pp":1.654},"final_train":{"loss":0.2641787890625,"accuracy":0.8864,"accuracy_pct":88.64,"n":50000},"final_test":{"loss":0.32996171875,"accuracy":0.8687,"accuracy_pct":86.87,"n":10000,"errors":1313,"wrong_indices_verified":true},"final_generalization":{"validation_minus_train_loss":0.05429120605468751,"test_minus_train_loss":0.06578292968750005,"train_minus_validation_accuracy_pp":1.1499999999999955,"train_minus_test_accuracy_pp":1.7699999999999938}},{"run_id":"graph-fidelity-source-plain-s103","spec":{"run_id":"graph-fidelity-source-plain-s103","stage":"evaluate","cohort":"fidelity","variant":"source-plain","recipe":"plain","seed":103,"lr":0.001,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"momentum":0.9,"pmax":0.0,"input_scale":1.0,"output_relu":true,"shrinkage":2e-05,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"316aa46c9e0a65fa375b579be0871a16f447d396fe64f85e2063ee6ef8c8dd5d","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"2b1dca89b73a8be186981c47ab34da696096b300bc7be619f12a35965192253e"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":68.21973519100001,"total_run_seconds":69.996755812,"selected_epoch":80,"last_epoch":100,"validation_98_reached":false,"epoch_to_validation_98":null,"training_seconds_to_validation_98":null,"selected_training_seconds":54.59058265300004,"selected_validation":{"loss":0.29025126953125,"accuracy":0.888,"accuracy_pct":88.8,"n":10000},"final_validation":{"loss":0.2914208251953125,"accuracy":0.8873,"accuracy_pct":88.73,"n":10000},"selected_dense_train_probe":{"loss":0.2267541015625,"accuracy":0.902,"accuracy_pct":90.2,"n":10000},"final_dense_train_probe":{"loss":0.22643203125,"accuracy":0.9021,"accuracy_pct":90.21000000000001,"n":10000},"final_stochastic_training_loss":0.2315184324979782,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":0.2823002539999493,"graph_setup_seconds":0.026618167000009407,"executed_epoch_masks_sha256":"c6b9d31d522f8bfcf99fed3eab8ee51ea530b24ebe6c1fdc846962552021ca03","selected_train":{"loss":0.2313259765625,"accuracy":0.90002,"accuracy_pct":90.00200000000001,"n":50000},"selected_test":{"loss":0.292572412109375,"accuracy":0.8867,"accuracy_pct":88.67,"n":10000,"errors":1133,"wrong_indices_verified":true},"selected_generalization":{"validation_minus_train_loss":0.058925292968750015,"test_minus_train_loss":0.061246435546875005,"train_minus_validation_accuracy_pp":1.202000000000003,"train_minus_test_accuracy_pp":1.3319999999999999},"final_train":{"loss":0.2311497265625,"accuracy":0.90006,"accuracy_pct":90.006,"n":50000},"final_test":{"loss":0.2918354248046875,"accuracy":0.8862,"accuracy_pct":88.62,"n":10000,"errors":1138,"wrong_indices_verified":true},"final_generalization":{"validation_minus_train_loss":0.06027109863281249,"test_minus_train_loss":0.0606856982421875,"train_minus_validation_accuracy_pp":1.2759999999999994,"train_minus_test_accuracy_pp":1.3859999999999983}},{"run_id":"graph-fidelity-source-residual-s101","spec":{"run_id":"graph-fidelity-source-residual-s101","stage":"evaluate","cohort":"fidelity","variant":"source-residual","recipe":"residual","seed":101,"lr":0.001,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"momentum":0.9,"pmax":0.0,"input_scale":1.0,"output_relu":true,"shrinkage":2e-05,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"e1efb33081a653eb2db13a44aa7d20f3f16925ea1dc8bc2e91ed2f639a3974ae","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"95de3b6ad9c32d8e212dfb753005644da2ec11a0822a569bc4955d1ef949a7c9"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":72.10991571299974,"total_run_seconds":73.22089794199997,"selected_epoch":1,"last_epoch":100,"validation_98_reached":false,"epoch_to_validation_98":null,"training_seconds_to_validation_98":null,"selected_training_seconds":0.7475144489999934,"selected_validation":{"loss":2.302585546875,"accuracy":0.1022,"accuracy_pct":10.22,"n":10000},"final_validation":{"loss":2.302585546875,"accuracy":0.1022,"accuracy_pct":10.22,"n":10000},"selected_dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"accuracy_pct":9.82,"n":10000},"final_dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"accuracy_pct":9.82,"n":10000},"final_stochastic_training_loss":2.3025853633880615,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":0.2122572899998545,"graph_setup_seconds":0.029277242000006254,"executed_epoch_masks_sha256":"c6b9d31d522f8bfcf99fed3eab8ee51ea530b24ebe6c1fdc846962552021ca03","selected_train":{"loss":2.3025853125,"accuracy":0.09802,"accuracy_pct":9.802,"n":50000},"selected_test":{"loss":2.302585546875,"accuracy":0.098,"accuracy_pct":9.8,"n":10000,"errors":9020,"wrong_indices_verified":true},"selected_generalization":{"validation_minus_train_loss":2.3437499985234922e-07,"test_minus_train_loss":2.3437499985234922e-07,"train_minus_validation_accuracy_pp":-0.4180000000000003,"train_minus_test_accuracy_pp":0.0019999999999992246},"final_train":{"loss":2.3025853125,"accuracy":0.09802,"accuracy_pct":9.802,"n":50000},"final_test":{"loss":2.302585546875,"accuracy":0.098,"accuracy_pct":9.8,"n":10000,"errors":9020,"wrong_indices_verified":true},"final_generalization":{"validation_minus_train_loss":2.3437499985234922e-07,"test_minus_train_loss":2.3437499985234922e-07,"train_minus_validation_accuracy_pp":-0.4180000000000003,"train_minus_test_accuracy_pp":0.0019999999999992246}},{"run_id":"graph-fidelity-source-residual-s102","spec":{"run_id":"graph-fidelity-source-residual-s102","stage":"evaluate","cohort":"fidelity","variant":"source-residual","recipe":"residual","seed":102,"lr":0.001,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"momentum":0.9,"pmax":0.0,"input_scale":1.0,"output_relu":true,"shrinkage":2e-05,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"4d0ac269167486811a0086108ca56313016afcebfc075d45e09455c228dee75b","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"e6025a334be66a35953ae9a58680d6697dd3473607a14ac350db1321c0a92bd9"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":72.23016014299992,"total_run_seconds":73.46011743699998,"selected_epoch":100,"last_epoch":100,"validation_98_reached":false,"epoch_to_validation_98":null,"training_seconds_to_validation_98":null,"selected_training_seconds":72.23016014299992,"selected_validation":{"loss":1.74424296875,"accuracy":0.3659,"accuracy_pct":36.59,"n":10000},"final_validation":{"loss":1.74424296875,"accuracy":0.3659,"accuracy_pct":36.59,"n":10000},"selected_dense_train_probe":{"loss":1.743318359375,"accuracy":0.3635,"accuracy_pct":36.35,"n":10000},"final_dense_train_probe":{"loss":1.743318359375,"accuracy":0.3635,"accuracy_pct":36.35,"n":10000},"final_stochastic_training_loss":1.931959867477417,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":0.20703489600001035,"graph_setup_seconds":0.01411675099998888,"executed_epoch_masks_sha256":"c6b9d31d522f8bfcf99fed3eab8ee51ea530b24ebe6c1fdc846962552021ca03","selected_train":{"loss":1.74476890625,"accuracy":0.36294,"accuracy_pct":36.294,"n":50000},"selected_test":{"loss":1.732096484375,"accuracy":0.3683,"accuracy_pct":36.83,"n":10000,"errors":6317,"wrong_indices_verified":true},"selected_generalization":{"validation_minus_train_loss":-0.0005259374999999622,"test_minus_train_loss":-0.012672421875000062,"train_minus_validation_accuracy_pp":-0.2960000000000018,"train_minus_test_accuracy_pp":-0.5360000000000031},"final_train":{"loss":1.74476890625,"accuracy":0.36294,"accuracy_pct":36.294,"n":50000},"final_test":{"loss":1.732096484375,"accuracy":0.3683,"accuracy_pct":36.83,"n":10000,"errors":6317,"wrong_indices_verified":true},"final_generalization":{"validation_minus_train_loss":-0.0005259374999999622,"test_minus_train_loss":-0.012672421875000062,"train_minus_validation_accuracy_pp":-0.2960000000000018,"train_minus_test_accuracy_pp":-0.5360000000000031}},{"run_id":"graph-fidelity-source-residual-s103","spec":{"run_id":"graph-fidelity-source-residual-s103","stage":"evaluate","cohort":"fidelity","variant":"source-residual","recipe":"residual","seed":103,"lr":0.001,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"momentum":0.9,"pmax":0.0,"input_scale":1.0,"output_relu":true,"shrinkage":2e-05,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"316aa46c9e0a65fa375b579be0871a16f447d396fe64f85e2063ee6ef8c8dd5d","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"2b1dca89b73a8be186981c47ab34da696096b300bc7be619f12a35965192253e"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":72.2122515320001,"total_run_seconds":73.50128555500001,"selected_epoch":100,"last_epoch":100,"validation_98_reached":false,"epoch_to_validation_98":null,"training_seconds_to_validation_98":null,"selected_training_seconds":72.2122515320001,"selected_validation":{"loss":1.6681251953125,"accuracy":0.391,"accuracy_pct":39.1,"n":10000},"final_validation":{"loss":1.6681251953125,"accuracy":0.391,"accuracy_pct":39.1,"n":10000},"selected_dense_train_probe":{"loss":1.6362998046875,"accuracy":0.3897,"accuracy_pct":38.97,"n":10000},"final_dense_train_probe":{"loss":1.6362998046875,"accuracy":0.3897,"accuracy_pct":38.97,"n":10000},"final_stochastic_training_loss":1.63728928565979,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":0.1843252499999437,"graph_setup_seconds":0.01256801900001392,"executed_epoch_masks_sha256":"c6b9d31d522f8bfcf99fed3eab8ee51ea530b24ebe6c1fdc846962552021ca03","selected_train":{"loss":1.6316690625,"accuracy":0.39194,"accuracy_pct":39.194,"n":50000},"selected_test":{"loss":1.6647134765625,"accuracy":0.3905,"accuracy_pct":39.050000000000004,"n":10000,"errors":6095,"wrong_indices_verified":true},"selected_generalization":{"validation_minus_train_loss":0.03645613281249993,"test_minus_train_loss":0.033044414062499916,"train_minus_validation_accuracy_pp":0.09399999999999964,"train_minus_test_accuracy_pp":0.14399999999999968},"final_train":{"loss":1.6316690625,"accuracy":0.39194,"accuracy_pct":39.194,"n":50000},"final_test":{"loss":1.6647134765625,"accuracy":0.3905,"accuracy_pct":39.050000000000004,"n":10000,"errors":6095,"wrong_indices_verified":true},"final_generalization":{"validation_minus_train_loss":0.03645613281249993,"test_minus_train_loss":0.033044414062499916,"train_minus_validation_accuracy_pp":0.09399999999999964,"train_minus_test_accuracy_pp":0.14399999999999968}},{"run_id":"graph-fidelity-source-sd-s101","spec":{"run_id":"graph-fidelity-source-sd-s101","stage":"evaluate","cohort":"fidelity","variant":"source-sd","recipe":"sd_constant","seed":101,"lr":0.001,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"momentum":0.9,"pmax":0.4,"input_scale":1.0,"output_relu":true,"shrinkage":2e-05,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"e1efb33081a653eb2db13a44aa7d20f3f16925ea1dc8bc2e91ed2f639a3974ae","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"95de3b6ad9c32d8e212dfb753005644da2ec11a0822a569bc4955d1ef949a7c9"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":63.09232125100013,"total_run_seconds":64.70638588599999,"selected_epoch":1,"last_epoch":100,"validation_98_reached":false,"epoch_to_validation_98":null,"training_seconds_to_validation_98":null,"selected_training_seconds":0.6537692989999755,"selected_validation":{"loss":2.302585546875,"accuracy":0.1022,"accuracy_pct":10.22,"n":10000},"final_validation":{"loss":2.302585546875,"accuracy":0.1022,"accuracy_pct":10.22,"n":10000},"selected_dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"accuracy_pct":9.82,"n":10000},"final_dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"accuracy_pct":9.82,"n":10000},"final_stochastic_training_loss":2.3025853633880615,"skipped_batch_counts":[7719,15527,23589,31320],"epoch_preparation_seconds":0.30181906400014213,"graph_setup_seconds":0.15062496699999883,"executed_epoch_masks_sha256":"6f6f74a7d2fae89dc21498f67de8163fc7dc26050fdfaec7741ac7f69389fb22","selected_train":{"loss":2.3025853125,"accuracy":0.09802,"accuracy_pct":9.802,"n":50000},"selected_test":{"loss":2.302585546875,"accuracy":0.098,"accuracy_pct":9.8,"n":10000,"errors":9020,"wrong_indices_verified":true},"selected_generalization":{"validation_minus_train_loss":2.3437499985234922e-07,"test_minus_train_loss":2.3437499985234922e-07,"train_minus_validation_accuracy_pp":-0.4180000000000003,"train_minus_test_accuracy_pp":0.0019999999999992246},"final_train":{"loss":2.3025853125,"accuracy":0.09802,"accuracy_pct":9.802,"n":50000},"final_test":{"loss":2.302585546875,"accuracy":0.098,"accuracy_pct":9.8,"n":10000,"errors":9020,"wrong_indices_verified":true},"final_generalization":{"validation_minus_train_loss":2.3437499985234922e-07,"test_minus_train_loss":2.3437499985234922e-07,"train_minus_validation_accuracy_pp":-0.4180000000000003,"train_minus_test_accuracy_pp":0.0019999999999992246}},{"run_id":"graph-fidelity-source-sd-s102","spec":{"run_id":"graph-fidelity-source-sd-s102","stage":"evaluate","cohort":"fidelity","variant":"source-sd","recipe":"sd_constant","seed":102,"lr":0.001,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"momentum":0.9,"pmax":0.4,"input_scale":1.0,"output_relu":true,"shrinkage":2e-05,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"4d0ac269167486811a0086108ca56313016afcebfc075d45e09455c228dee75b","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"e6025a334be66a35953ae9a58680d6697dd3473607a14ac350db1321c0a92bd9"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":62.833476593000086,"total_run_seconds":64.002410696,"selected_epoch":1,"last_epoch":100,"validation_98_reached":false,"epoch_to_validation_98":null,"training_seconds_to_validation_98":null,"selected_training_seconds":0.6350219480000021,"selected_validation":{"loss":2.302585546875,"accuracy":0.1022,"accuracy_pct":10.22,"n":10000},"final_validation":{"loss":2.302585546875,"accuracy":0.1022,"accuracy_pct":10.22,"n":10000},"selected_dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"accuracy_pct":9.82,"n":10000},"final_dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"accuracy_pct":9.82,"n":10000},"final_stochastic_training_loss":2.3025853633880615,"skipped_batch_counts":[7773,15460,23463,31533],"epoch_preparation_seconds":0.17502992800018546,"graph_setup_seconds":0.11220206300001223,"executed_epoch_masks_sha256":"110c09d9a0eeb4048cb45deae9679a9c176daffccfc5e4ec9048c3a63b37a75f","selected_train":{"loss":2.3025853125,"accuracy":0.09802,"accuracy_pct":9.802,"n":50000},"selected_test":{"loss":2.302585546875,"accuracy":0.098,"accuracy_pct":9.8,"n":10000,"errors":9020,"wrong_indices_verified":true},"selected_generalization":{"validation_minus_train_loss":2.3437499985234922e-07,"test_minus_train_loss":2.3437499985234922e-07,"train_minus_validation_accuracy_pp":-0.4180000000000003,"train_minus_test_accuracy_pp":0.0019999999999992246},"final_train":{"loss":2.3025853125,"accuracy":0.09802,"accuracy_pct":9.802,"n":50000},"final_test":{"loss":2.302585546875,"accuracy":0.098,"accuracy_pct":9.8,"n":10000,"errors":9020,"wrong_indices_verified":true},"final_generalization":{"validation_minus_train_loss":2.3437499985234922e-07,"test_minus_train_loss":2.3437499985234922e-07,"train_minus_validation_accuracy_pp":-0.4180000000000003,"train_minus_test_accuracy_pp":0.0019999999999992246}},{"run_id":"graph-fidelity-source-sd-s103","spec":{"run_id":"graph-fidelity-source-sd-s103","stage":"evaluate","cohort":"fidelity","variant":"source-sd","recipe":"sd_constant","seed":103,"lr":0.001,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"momentum":0.9,"pmax":0.4,"input_scale":1.0,"output_relu":true,"shrinkage":2e-05,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"316aa46c9e0a65fa375b579be0871a16f447d396fe64f85e2063ee6ef8c8dd5d","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"2b1dca89b73a8be186981c47ab34da696096b300bc7be619f12a35965192253e"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":63.083562527999646,"total_run_seconds":64.678102279,"selected_epoch":1,"last_epoch":100,"validation_98_reached":false,"epoch_to_validation_98":null,"training_seconds_to_validation_98":null,"selected_training_seconds":0.6459317750000082,"selected_validation":{"loss":2.302585546875,"accuracy":0.1022,"accuracy_pct":10.22,"n":10000},"final_validation":{"loss":2.302585546875,"accuracy":0.1022,"accuracy_pct":10.22,"n":10000},"selected_dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"accuracy_pct":9.82,"n":10000},"final_dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"accuracy_pct":9.82,"n":10000},"final_stochastic_training_loss":2.3025853633880615,"skipped_batch_counts":[7857,15464,23550,31175],"epoch_preparation_seconds":0.26737136599967926,"graph_setup_seconds":0.1043995170000187,"executed_epoch_masks_sha256":"0e6eed5c0ba1bd9ffbeec35989c7757838c2f84735863944493b0cfa786550e8","selected_train":{"loss":2.3025853125,"accuracy":0.09802,"accuracy_pct":9.802,"n":50000},"selected_test":{"loss":2.302585546875,"accuracy":0.098,"accuracy_pct":9.8,"n":10000,"errors":9020,"wrong_indices_verified":true},"selected_generalization":{"validation_minus_train_loss":2.3437499985234922e-07,"test_minus_train_loss":2.3437499985234922e-07,"train_minus_validation_accuracy_pp":-0.4180000000000003,"train_minus_test_accuracy_pp":0.0019999999999992246},"final_train":{"loss":2.3025853125,"accuracy":0.09802,"accuracy_pct":9.802,"n":50000},"final_test":{"loss":2.302585546875,"accuracy":0.098,"accuracy_pct":9.8,"n":10000,"errors":9020,"wrong_indices_verified":true},"final_generalization":{"validation_minus_train_loss":2.3437499985234922e-07,"test_minus_train_loss":2.3437499985234922e-07,"train_minus_validation_accuracy_pp":-0.4180000000000003,"train_minus_test_accuracy_pp":0.0019999999999992246}},{"run_id":"graph-tune-plain-lr0.01","spec":{"run_id":"graph-tune-plain-lr0.01","stage":"tune","cohort":"main","recipe":"plain","seed":1,"lr":0.01,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.0,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"df8ef46c69011718b66e38f100c668736a2aeb36fd131152f01cd2416b04dacc","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"fab202edeb9e22c84d22944633784196b06e4227d236b258f3c08d546534dd49"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":62.29433589499999,"total_run_seconds":65.02259042,"selected_epoch":5,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":15,"training_seconds_to_validation_98":9.392179764000005,"selected_training_seconds":3.1808096819999996,"selected_validation":{"loss":0.09332907104492187,"accuracy":0.9741,"accuracy_pct":97.41,"n":10000},"final_validation":{"loss":0.1246977783203125,"accuracy":0.9835,"accuracy_pct":98.35000000000001,"n":10000},"selected_dense_train_probe":{"loss":0.028364566040039063,"accuracy":0.9911,"accuracy_pct":99.11,"n":10000},"final_dense_train_probe":{"loss":3.6996021866798403e-06,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_stochastic_training_loss":3.7485961001948453e-06,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":0.261849561999977,"graph_setup_seconds":0.7871541769999997,"executed_epoch_masks_sha256":"c6b9d31d522f8bfcf99fed3eab8ee51ea530b24ebe6c1fdc846962552021ca03"},{"run_id":"graph-tune-plain-lr0.03","spec":{"run_id":"graph-tune-plain-lr0.03","stage":"tune","cohort":"main","recipe":"plain","seed":1,"lr":0.03,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.0,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"df8ef46c69011718b66e38f100c668736a2aeb36fd131152f01cd2416b04dacc","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"fab202edeb9e22c84d22944633784196b06e4227d236b258f3c08d546534dd49"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":62.44905222300001,"total_run_seconds":64.577277017,"selected_epoch":5,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":15,"training_seconds_to_validation_98":9.433111193000004,"selected_training_seconds":3.175778513000001,"selected_validation":{"loss":0.0866325439453125,"accuracy":0.9773,"accuracy_pct":97.72999999999999,"n":10000},"final_validation":{"loss":0.1191703857421875,"accuracy":0.9851,"accuracy_pct":98.50999999999999,"n":10000},"selected_dense_train_probe":{"loss":0.022877609252929688,"accuracy":0.9934,"accuracy_pct":99.33999999999999,"n":10000},"final_dense_train_probe":{"loss":1.7089612782001494e-06,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_stochastic_training_loss":1.4876281966280658e-06,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":0.2503572460000374,"graph_setup_seconds":0.5629237059999994,"executed_epoch_masks_sha256":"c6b9d31d522f8bfcf99fed3eab8ee51ea530b24ebe6c1fdc846962552021ca03"},{"run_id":"graph-tune-plain-lr0.1","spec":{"run_id":"graph-tune-plain-lr0.1","stage":"tune","cohort":"main","recipe":"plain","seed":1,"lr":0.1,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.0,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"df8ef46c69011718b66e38f100c668736a2aeb36fd131152f01cd2416b04dacc","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"fab202edeb9e22c84d22944633784196b06e4227d236b258f3c08d546534dd49"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":62.49598755699997,"total_run_seconds":65.046725167,"selected_epoch":5,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":25,"training_seconds_to_validation_98":15.651224404000002,"selected_training_seconds":3.1589968470000027,"selected_validation":{"loss":0.107379052734375,"accuracy":0.9758,"accuracy_pct":97.58,"n":10000},"final_validation":{"loss":0.18096153564453124,"accuracy":0.9833,"accuracy_pct":98.33,"n":10000},"selected_dense_train_probe":{"loss":0.03987270812988281,"accuracy":0.9897,"accuracy_pct":98.97,"n":10000},"final_dense_train_probe":{"loss":6.464324425905943e-07,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_stochastic_training_loss":5.977497608000704e-07,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":0.2759507979999771,"graph_setup_seconds":0.6493891840000003,"executed_epoch_masks_sha256":"c6b9d31d522f8bfcf99fed3eab8ee51ea530b24ebe6c1fdc846962552021ca03"},{"run_id":"graph-tune-residual-lr0.01","spec":{"run_id":"graph-tune-residual-lr0.01","stage":"tune","cohort":"main","recipe":"residual","seed":1,"lr":0.01,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.0,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"df8ef46c69011718b66e38f100c668736a2aeb36fd131152f01cd2416b04dacc","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"fab202edeb9e22c84d22944633784196b06e4227d236b258f3c08d546534dd49"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":66.57511272699998,"total_run_seconds":69.91069564,"selected_epoch":5,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":15,"training_seconds_to_validation_98":10.067984201999996,"selected_training_seconds":3.4108077629999993,"selected_validation":{"loss":0.07866966552734375,"accuracy":0.9782,"accuracy_pct":97.82,"n":10000},"final_validation":{"loss":0.1091989501953125,"accuracy":0.9835,"accuracy_pct":98.35000000000001,"n":10000},"selected_dense_train_probe":{"loss":0.013530099487304688,"accuracy":0.9959,"accuracy_pct":99.59,"n":10000},"final_dense_train_probe":{"loss":6.543875485658645e-06,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_stochastic_training_loss":6.678104455204448e-06,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":0.2965698670000272,"graph_setup_seconds":1.202539194999999,"executed_epoch_masks_sha256":"c6b9d31d522f8bfcf99fed3eab8ee51ea530b24ebe6c1fdc846962552021ca03"},{"run_id":"graph-tune-residual-lr0.03","spec":{"run_id":"graph-tune-residual-lr0.03","stage":"tune","cohort":"main","recipe":"residual","seed":1,"lr":0.03,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.0,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"df8ef46c69011718b66e38f100c668736a2aeb36fd131152f01cd2416b04dacc","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"fab202edeb9e22c84d22944633784196b06e4227d236b258f3c08d546534dd49"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":66.21389787,"total_run_seconds":68.412653544,"selected_epoch":5,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":15,"training_seconds_to_validation_98":9.980786589000006,"selected_training_seconds":3.3643246760000025,"selected_validation":{"loss":0.09070323486328125,"accuracy":0.9758,"accuracy_pct":97.58,"n":10000},"final_validation":{"loss":0.11745986328125,"accuracy":0.9843,"accuracy_pct":98.42999999999999,"n":10000},"selected_dense_train_probe":{"loss":0.021345994567871094,"accuracy":0.9927,"accuracy_pct":99.27,"n":10000},"final_dense_train_probe":{"loss":1.6538279131054879e-06,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_stochastic_training_loss":1.6567361171837547e-06,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":0.2402177739999969,"graph_setup_seconds":0.5990511009999997,"executed_epoch_masks_sha256":"c6b9d31d522f8bfcf99fed3eab8ee51ea530b24ebe6c1fdc846962552021ca03"},{"run_id":"graph-tune-residual-lr0.1","spec":{"run_id":"graph-tune-residual-lr0.1","stage":"tune","cohort":"main","recipe":"residual","seed":1,"lr":0.1,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.0,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"df8ef46c69011718b66e38f100c668736a2aeb36fd131152f01cd2416b04dacc","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"fab202edeb9e22c84d22944633784196b06e4227d236b258f3c08d546534dd49"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":66.80894096299998,"total_run_seconds":69.651439081,"selected_epoch":25,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":20,"training_seconds_to_validation_98":13.443952725000008,"selected_training_seconds":16.78872227400001,"selected_validation":{"loss":0.1134759765625,"accuracy":0.983,"accuracy_pct":98.3,"n":10000},"final_validation":{"loss":0.1703010498046875,"accuracy":0.9833,"accuracy_pct":98.33,"n":10000},"selected_dense_train_probe":{"loss":0.001001873207092285,"accuracy":0.9997,"accuracy_pct":99.97,"n":10000},"final_dense_train_probe":{"loss":1.041648630052805e-06,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_stochastic_training_loss":1.0799677738759783e-06,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":0.25207176500000994,"graph_setup_seconds":0.8301666370000005,"executed_epoch_masks_sha256":"c6b9d31d522f8bfcf99fed3eab8ee51ea530b24ebe6c1fdc846962552021ca03"},{"run_id":"graph-tune-residual_unit_dropout-lr0.01","spec":{"run_id":"graph-tune-residual_unit_dropout-lr0.01","stage":"tune","cohort":"main","recipe":"residual_unit_dropout","seed":1,"lr":0.01,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.2,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"df8ef46c69011718b66e38f100c668736a2aeb36fd131152f01cd2416b04dacc","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"fab202edeb9e22c84d22944633784196b06e4227d236b258f3c08d546534dd49"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":69.32138422300012,"total_run_seconds":70.46976567700001,"selected_epoch":15,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":15,"training_seconds_to_validation_98":10.37775624999999,"selected_training_seconds":10.37775624999999,"selected_validation":{"loss":0.08553690795898437,"accuracy":0.9811,"accuracy_pct":98.11,"n":10000},"final_validation":{"loss":0.11723377685546875,"accuracy":0.9848,"accuracy_pct":98.48,"n":10000},"selected_dense_train_probe":{"loss":0.003738294219970703,"accuracy":0.9988,"accuracy_pct":99.88,"n":10000},"final_dense_train_probe":{"loss":8.364264667034149e-06,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_stochastic_training_loss":0.0008994282106868923,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":0.2064930399999838,"graph_setup_seconds":0.03886618200000669,"executed_epoch_masks_sha256":"c6b9d31d522f8bfcf99fed3eab8ee51ea530b24ebe6c1fdc846962552021ca03"},{"run_id":"graph-tune-residual_unit_dropout-lr0.03","spec":{"run_id":"graph-tune-residual_unit_dropout-lr0.03","stage":"tune","cohort":"main","recipe":"residual_unit_dropout","seed":1,"lr":0.03,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.2,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"df8ef46c69011718b66e38f100c668736a2aeb36fd131152f01cd2416b04dacc","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"fab202edeb9e22c84d22944633784196b06e4227d236b258f3c08d546534dd49"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":68.78616798400003,"total_run_seconds":69.859518135,"selected_epoch":5,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":10,"training_seconds_to_validation_98":6.8953456250000045,"selected_training_seconds":3.441549151000004,"selected_validation":{"loss":0.08573321533203125,"accuracy":0.9778,"accuracy_pct":97.78,"n":10000},"final_validation":{"loss":0.113064453125,"accuracy":0.9853,"accuracy_pct":98.53,"n":10000},"selected_dense_train_probe":{"loss":0.028522616577148437,"accuracy":0.9911,"accuracy_pct":99.11,"n":10000},"final_dense_train_probe":{"loss":1.1156310141086579e-05,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_stochastic_training_loss":0.0007007353124208748,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":0.23361811899994223,"graph_setup_seconds":0.04351318099999446,"executed_epoch_masks_sha256":"c6b9d31d522f8bfcf99fed3eab8ee51ea530b24ebe6c1fdc846962552021ca03"},{"run_id":"graph-tune-residual_unit_dropout-lr0.1","spec":{"run_id":"graph-tune-residual_unit_dropout-lr0.1","stage":"tune","cohort":"main","recipe":"residual_unit_dropout","seed":1,"lr":0.1,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.2,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"diverged","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"failure":{"run_id":"graph-tune-residual_unit_dropout-lr0.1","code":"training_diverged"},"training_seconds":14.584848239999957,"total_run_seconds":15.347493007000026,"stopped_epoch":21,"last_observed_validation":{"loss":0.13242564697265624,"accuracy":0.9768,"accuracy_pct":97.68,"n":10000},"last_observed_validation_epoch":20},{"run_id":"graph-tune-sd_annealed-lr0.01","spec":{"run_id":"graph-tune-sd_annealed-lr0.01","stage":"tune","cohort":"main","recipe":"sd_annealed","seed":1,"lr":0.01,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.8,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"df8ef46c69011718b66e38f100c668736a2aeb36fd131152f01cd2416b04dacc","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"fab202edeb9e22c84d22944633784196b06e4227d236b258f3c08d546534dd49"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":56.9732660169999,"total_run_seconds":58.18269024,"selected_epoch":15,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":15,"training_seconds_to_validation_98":7.350981123000011,"selected_training_seconds":7.350981123000011,"selected_validation":{"loss":0.0804996337890625,"accuracy":0.9808,"accuracy_pct":98.08,"n":10000},"final_validation":{"loss":0.1468416259765625,"accuracy":0.9842,"accuracy_pct":98.42,"n":10000},"selected_dense_train_probe":{"loss":0.0025086868286132813,"accuracy":0.9996,"accuracy_pct":99.96000000000001,"n":10000},"final_dense_train_probe":{"loss":5.786147899925709e-07,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_stochastic_training_loss":4.790002208210353e-07,"skipped_batch_counts":[7724,15618,23489,31289],"epoch_preparation_seconds":0.17954253999992886,"graph_setup_seconds":0.13608256099999494,"executed_epoch_masks_sha256":"c0510bb720822c2bd175c4158d19a16b96f71150cbe5051598bfcdd1066655be"},{"run_id":"graph-tune-sd_annealed-lr0.03","spec":{"run_id":"graph-tune-sd_annealed-lr0.03","stage":"tune","cohort":"main","recipe":"sd_annealed","seed":1,"lr":0.03,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.8,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"df8ef46c69011718b66e38f100c668736a2aeb36fd131152f01cd2416b04dacc","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"fab202edeb9e22c84d22944633784196b06e4227d236b258f3c08d546534dd49"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":56.900448669999975,"total_run_seconds":58.201331315999994,"selected_epoch":20,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":20,"training_seconds_to_validation_98":9.849377229999973,"selected_training_seconds":9.849377229999973,"selected_validation":{"loss":0.08432885131835938,"accuracy":0.9804,"accuracy_pct":98.04,"n":10000},"final_validation":{"loss":0.140843994140625,"accuracy":0.9837,"accuracy_pct":98.37,"n":10000},"selected_dense_train_probe":{"loss":0.006464675140380859,"accuracy":0.9984,"accuracy_pct":99.83999999999999,"n":10000},"final_dense_train_probe":{"loss":1.7558110877871514e-06,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_stochastic_training_loss":2.2599697331315838e-06,"skipped_batch_counts":[7724,15618,23489,31289],"epoch_preparation_seconds":0.1921668179999756,"graph_setup_seconds":0.1366386509999984,"executed_epoch_masks_sha256":"c0510bb720822c2bd175c4158d19a16b96f71150cbe5051598bfcdd1066655be"},{"run_id":"graph-tune-sd_annealed-lr0.1","spec":{"run_id":"graph-tune-sd_annealed-lr0.1","stage":"tune","cohort":"main","recipe":"sd_annealed","seed":1,"lr":0.1,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.8,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"diverged","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"failure":{"run_id":"graph-tune-sd_annealed-lr0.1","code":"training_diverged"},"training_seconds":0.4840846510000034,"total_run_seconds":0.9968032539999996,"stopped_epoch":1},{"run_id":"graph-tune-sd_constant-lr0.01","spec":{"run_id":"graph-tune-sd_constant-lr0.01","stage":"tune","cohort":"main","recipe":"sd_constant","seed":1,"lr":0.01,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.4,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"df8ef46c69011718b66e38f100c668736a2aeb36fd131152f01cd2416b04dacc","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"fab202edeb9e22c84d22944633784196b06e4227d236b258f3c08d546534dd49"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":56.89867518499997,"total_run_seconds":58.09528317999998,"selected_epoch":10,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":10,"training_seconds_to_validation_98":5.792859810999985,"selected_training_seconds":5.792859810999985,"selected_validation":{"loss":0.07920894775390624,"accuracy":0.9803,"accuracy_pct":98.03,"n":10000},"final_validation":{"loss":0.136387158203125,"accuracy":0.9848,"accuracy_pct":98.48,"n":10000},"selected_dense_train_probe":{"loss":0.005487228393554687,"accuracy":0.9988,"accuracy_pct":99.88,"n":10000},"final_dense_train_probe":{"loss":1.6330283135175706e-06,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_stochastic_training_loss":0.0005573111702688038,"skipped_batch_counts":[7965,15771,23438,31455],"epoch_preparation_seconds":0.15829238099998122,"graph_setup_seconds":0.1520455759999919,"executed_epoch_masks_sha256":"601aaa2f5c9703fb1d9ffa61d6d359abd4783f923a8cdf5e137798352a10214c"},{"run_id":"graph-tune-sd_constant-lr0.03","spec":{"run_id":"graph-tune-sd_constant-lr0.03","stage":"tune","cohort":"main","recipe":"sd_constant","seed":1,"lr":0.03,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.4,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"hashes":{"initial_parameters_sha256":"df8ef46c69011718b66e38f100c668736a2aeb36fd131152f01cd2416b04dacc","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98","executed_epoch_order_sha256":"fab202edeb9e22c84d22944633784196b06e4227d236b258f3c08d546534dd49"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":56.932940494999954,"total_run_seconds":58.06917192,"selected_epoch":5,"last_epoch":100,"validation_98_reached":true,"epoch_to_validation_98":10,"training_seconds_to_validation_98":5.732786909000026,"selected_training_seconds":2.8653040749999974,"selected_validation":{"loss":0.0805029052734375,"accuracy":0.9784,"accuracy_pct":97.84,"n":10000},"final_validation":{"loss":0.11031953125,"accuracy":0.9826,"accuracy_pct":98.26,"n":10000},"selected_dense_train_probe":{"loss":0.023065573120117186,"accuracy":0.9929,"accuracy_pct":99.29,"n":10000},"final_dense_train_probe":{"loss":0.00012933090925216676,"accuracy":1.0,"accuracy_pct":100.0,"n":10000},"final_stochastic_training_loss":0.002192367799580097,"skipped_batch_counts":[7965,15771,23438,31455],"epoch_preparation_seconds":0.21145045899987736,"graph_setup_seconds":0.1060424409999996,"executed_epoch_masks_sha256":"601aaa2f5c9703fb1d9ffa61d6d359abd4783f923a8cdf5e137798352a10214c"},{"run_id":"graph-tune-sd_constant-lr0.1","spec":{"run_id":"graph-tune-sd_constant-lr0.1","stage":"tune","cohort":"main","recipe":"sd_constant","seed":1,"lr":0.1,"epochs":100,"batch_size":64,"eval_every":5,"train_size":50000,"pmax":0.4,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0,"precision":"fp32"},"status":"diverged","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.14.0+cu130","cuda_runtime":"13.0","tf32":true,"float32_matmul_precision":"high","dtype":"float32","cpu_threads":2},"source_sha256":{"train_optimized.py":"3a2553956753bc6d617e9550ea33f6c1efc6ea046169c161c57db7e3e3da8d8d","model_data.py":"d0a5c40f24bcbe7d97d73803604e21b503953771db306d2e05f188ad2e51a3dd","optimization/stochastic_graph.py":"7844db46e84f39809feb7dbf3684e95a199b01773b6a3dc800127fb84c274a1a","optimization/test_stochastic_graph.py":"fed8f7d61ce10d4f3c2ab0942bc5a245b0e2b8e4b50d253ee65ab5d45b813d11","train.py":"bc1d430a2e104963feed5b55510fb0344f9f84f00ce2e56b9feaf442e067cb41"},"failure":{"run_id":"graph-tune-sd_constant-lr0.1","code":"training_diverged"},"training_seconds":6.836087495000015,"total_run_seconds":7.652775009999999,"stopped_epoch":12,"last_observed_validation":{"loss":0.120637158203125,"accuracy":0.9749,"accuracy_pct":97.49,"n":10000},"last_observed_validation_epoch":10},{"run_id":"pilot-normalized-plain","spec":{"run_id":"pilot-normalized-plain","stage":"pilot","recipe":"plain","seed":1,"lr":0.03,"epochs":5,"batch_size":64,"eval_every":1,"train_size":50000,"pmax":0.0,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.8.0+cu128","tf32":true,"dtype":"float32","cpu_threads":2},"source_sha256":{},"hashes":{"initial_parameters_sha256":"df8ef46c69011718b66e38f100c668736a2aeb36fd131152f01cd2416b04dacc","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":6.3803317949999965,"total_run_seconds":9.243859507,"selected_epoch":5,"last_epoch":5,"validation_98_reached":false,"epoch_to_validation_98":null,"training_seconds_to_validation_98":null,"selected_training_seconds":6.3803317949999965,"selected_validation":{"loss":0.0866325439453125,"accuracy":0.9773,"accuracy_pct":97.72999999999999,"n":10000},"final_validation":{"loss":0.0866325439453125,"accuracy":0.9773,"accuracy_pct":97.72999999999999,"n":10000},"selected_dense_train_probe":{"loss":0.022877607727050782,"accuracy":0.9934,"accuracy_pct":99.33999999999999,"n":10000},"final_dense_train_probe":{"loss":0.022877607727050782,"accuracy":0.9934,"accuracy_pct":99.33999999999999,"n":10000},"final_stochastic_training_loss":0.04113011062145233,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":null,"graph_setup_seconds":null,"executed_epoch_masks_sha256":null},{"run_id":"pilot-normalized-residual","spec":{"run_id":"pilot-normalized-residual","stage":"pilot","recipe":"residual","seed":1,"lr":0.03,"epochs":5,"batch_size":64,"eval_every":1,"train_size":50000,"pmax":0.0,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.8.0+cu128","tf32":true,"dtype":"float32","cpu_threads":2},"source_sha256":{},"hashes":{"initial_parameters_sha256":"df8ef46c69011718b66e38f100c668736a2aeb36fd131152f01cd2416b04dacc","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":12.568252603000003,"total_run_seconds":16.866292398,"selected_epoch":3,"last_epoch":5,"validation_98_reached":false,"epoch_to_validation_98":null,"training_seconds_to_validation_98":null,"selected_training_seconds":8.028379462000002,"selected_validation":{"loss":0.07315656127929687,"accuracy":0.9785,"accuracy_pct":97.85000000000001,"n":10000},"final_validation":{"loss":0.09070322875976562,"accuracy":0.9758,"accuracy_pct":97.58,"n":10000},"selected_dense_train_probe":{"loss":0.025550897216796875,"accuracy":0.9934,"accuracy_pct":99.33999999999999,"n":10000},"final_dense_train_probe":{"loss":0.021345994567871094,"accuracy":0.9927,"accuracy_pct":99.27,"n":10000},"final_stochastic_training_loss":0.03323053568601608,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":null,"graph_setup_seconds":null,"executed_epoch_masks_sha256":null},{"run_id":"pilot-normalized-sd","spec":{"run_id":"pilot-normalized-sd","stage":"pilot","recipe":"sd_annealed","seed":1,"lr":0.03,"epochs":5,"batch_size":64,"eval_every":1,"train_size":50000,"pmax":0.8,"input_scale":0.00392156862745098,"output_relu":false,"shrinkage":0.0},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.8.0+cu128","tf32":true,"dtype":"float32","cpu_threads":2},"source_sha256":{},"hashes":{"initial_parameters_sha256":"df8ef46c69011718b66e38f100c668736a2aeb36fd131152f01cd2416b04dacc","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":7.649306611999999,"total_run_seconds":10.414212812999999,"selected_epoch":5,"last_epoch":5,"validation_98_reached":false,"epoch_to_validation_98":null,"training_seconds_to_validation_98":null,"selected_training_seconds":7.649306611999999,"selected_validation":{"loss":0.0906310302734375,"accuracy":0.9758,"accuracy_pct":97.58,"n":10000},"final_validation":{"loss":0.0906310302734375,"accuracy":0.9758,"accuracy_pct":97.58,"n":10000},"selected_dense_train_probe":{"loss":0.0312780517578125,"accuracy":0.9896,"accuracy_pct":98.96000000000001,"n":10000},"final_dense_train_probe":{"loss":0.0312780517578125,"accuracy":0.9896,"accuracy_pct":98.96000000000001,"n":10000},"final_stochastic_training_loss":0.04879908263683319,"skipped_batch_counts":[404,781,1200,1584],"epoch_preparation_seconds":null,"graph_setup_seconds":null,"executed_epoch_masks_sha256":null},{"run_id":"pilot-source-linear","spec":{"run_id":"pilot-source-linear","stage":"pilot","recipe":"plain","seed":1,"lr":0.001,"epochs":5,"batch_size":64,"eval_every":1,"train_size":50000,"pmax":0.0,"input_scale":1.0,"output_relu":false,"shrinkage":2e-05},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.8.0+cu128","tf32":true,"dtype":"float32","cpu_threads":2},"source_sha256":{},"hashes":{"initial_parameters_sha256":"df8ef46c69011718b66e38f100c668736a2aeb36fd131152f01cd2416b04dacc","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":9.913843123000001,"total_run_seconds":14.348990537999999,"selected_epoch":5,"last_epoch":5,"validation_98_reached":false,"epoch_to_validation_98":null,"training_seconds_to_validation_98":null,"selected_training_seconds":9.913843123000001,"selected_validation":{"loss":0.07600885009765625,"accuracy":0.9782,"accuracy_pct":97.82,"n":10000},"final_validation":{"loss":0.07600885009765625,"accuracy":0.9782,"accuracy_pct":97.82,"n":10000},"selected_dense_train_probe":{"loss":0.008843421936035156,"accuracy":0.9986,"accuracy_pct":99.86,"n":10000},"final_dense_train_probe":{"loss":0.008843421936035156,"accuracy":0.9986,"accuracy_pct":99.86,"n":10000},"final_stochastic_training_loss":0.017660746350884438,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":null,"graph_setup_seconds":null,"executed_epoch_masks_sha256":null},{"run_id":"pilot-source-plain","spec":{"run_id":"pilot-source-plain","stage":"pilot","recipe":"plain","seed":1,"lr":0.001,"epochs":5,"batch_size":64,"eval_every":1,"train_size":50000,"pmax":0.0,"input_scale":1.0,"output_relu":true,"shrinkage":2e-05},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.8.0+cu128","tf32":true,"dtype":"float32","cpu_threads":2},"source_sha256":{},"hashes":{"initial_parameters_sha256":"df8ef46c69011718b66e38f100c668736a2aeb36fd131152f01cd2416b04dacc","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":6.652748309999999,"total_run_seconds":9.562714048,"selected_epoch":5,"last_epoch":5,"validation_98_reached":false,"epoch_to_validation_98":null,"training_seconds_to_validation_98":null,"selected_training_seconds":6.652748309999999,"selected_validation":{"loss":0.07544132080078125,"accuracy":0.9788,"accuracy_pct":97.88,"n":10000},"final_validation":{"loss":0.07544132080078125,"accuracy":0.9788,"accuracy_pct":97.88,"n":10000},"selected_dense_train_probe":{"loss":0.009754230499267578,"accuracy":0.9984,"accuracy_pct":99.83999999999999,"n":10000},"final_dense_train_probe":{"loss":0.009754230499267578,"accuracy":0.9984,"accuracy_pct":99.83999999999999,"n":10000},"final_stochastic_training_loss":0.017597535625100136,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":null,"graph_setup_seconds":null,"executed_epoch_masks_sha256":null},{"run_id":"pilot-source-residual","spec":{"run_id":"pilot-source-residual","stage":"pilot","recipe":"residual","seed":1,"lr":0.001,"epochs":5,"batch_size":64,"eval_every":1,"train_size":50000,"pmax":0.0,"input_scale":1.0,"output_relu":true,"shrinkage":2e-05},"status":"ok","hardware":{"gpu":"NVIDIA A100-SXM4-40GB","torch":"2.8.0+cu128","tf32":true,"dtype":"float32","cpu_threads":2},"source_sha256":{},"hashes":{"initial_parameters_sha256":"df8ef46c69011718b66e38f100c668736a2aeb36fd131152f01cd2416b04dacc","training_data_sha256":"db25eee67973dd887c79eb5b31e7466c2b0717df28dcdd5ca60c87116de2b25d","train_indices_sha256":"1083febc455815d0a5d7e9a387b9744d8b456a344b7088c7a9ca1235dade5fdf","val_indices_sha256":"90bec5b643d05f06c9863616b685340f4bdb8a5647dbd51ecf30523f138d9b98"},"parameter_count":11972510,"steps_per_epoch":781,"training_examples_per_epoch":49984,"training_seconds":13.431386436,"total_run_seconds":18.363070248,"selected_epoch":1,"last_epoch":5,"validation_98_reached":false,"epoch_to_validation_98":null,"training_seconds_to_validation_98":null,"selected_training_seconds":3.472561788,"selected_validation":{"loss":2.302585546875,"accuracy":0.1022,"accuracy_pct":10.22,"n":10000},"final_validation":{"loss":2.302585546875,"accuracy":0.1022,"accuracy_pct":10.22,"n":10000},"selected_dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"accuracy_pct":9.82,"n":10000},"final_dense_train_probe":{"loss":2.302585546875,"accuracy":0.0982,"accuracy_pct":9.82,"n":10000},"final_stochastic_training_loss":2.3025851249694824,"skipped_batch_counts":[0,0,0,0],"epoch_preparation_seconds":null,"graph_setup_seconds":null,"executed_epoch_masks_sha256":null}],"interpretation":["Validation-selected checkpoint is primary; last fixed-epoch checkpoint is secondary. This resumed study selects LRs/checkpoints using validation only. Its official test set was previously inspected during separate baseline optimization, so the overall investigation is exploratory rather than globally test-naive.","Main and fidelity cohorts are separate; plain versus residual also changes architecture.","Means and sample SD concern seeds. Paired 95% t intervals are conditional on one fixed data split, the same test examples, and validation-selected LRs; no multiple-comparison correction.","Repeated seeds reuse the same test examples; they are not independent dataset replications. Confirmation seeds 101\u2013103 were also used in the preceding baseline optimization, so they are not globally untouched initializations. CI including zero is not proof of equivalence. The resumed final manifest uses three seeds per arm, with df=2 for complete paired intervals.","Training seconds include gather, graph execution, optimizer/loop diagnostics; exclude loading/evaluation/checkpointing, graph setup and per-epoch mask/order/scaling preparation. Separate graph/preparation timings and total run time are retained. None is billed runtime or energy.","Assigned A100 variants differ. Per-arm pooled runtimes are descriptive; speed effects require the same reported hardware/runtime and source within a seed pair, with separate hardware strata. Matching model names still does not control clock, worker contention or thermal state.","First observed validation accuracy >=98% is discretized by evaluation cadence. Unreached runs remain censored; achiever-only means may be selection-biased.","Initialization, data/split, and executed epoch-order hashes verify paired inputs for the resumed runs; equal batch size and drop-last determine minibatch order. Mask streams are independent and intentionally recipe-specific. Older pilot runs predate the order digest.","Outputs omit checkpoints, wrong-index arrays, host identifiers and arbitrary exception messages; scientific GPU/runtime identifiers and paired disagreement counts are retained."]}}