2020-11-14 00:51:38 [INFO] ------------Environment Information------------- platform: Linux-3.10.0-1062.18.1.el7.x86_64-x86_64-with-centos-7.7.1908-Core Python: 3.7.7 (default, Mar 26 2020, 15:48:22) [GCC 7.3.0] Paddle compiled with cuda: True NVCC: Cuda compilation tools, release 10.2, V10.2.89 cudnn: 7.6 GPUs used: 4 CUDA_VISIBLE_DEVICES: 4,5,6,7 GPU: ['GPU 0: Tesla V100-SXM2-16GB', 'GPU 1: Tesla V100-SXM2-16GB', 'GPU 2: Tesla V100-SXM2-16GB', 'GPU 3: Tesla V100-SXM2-16GB', 'GPU 4: Tesla V100-SXM2-16GB', 'GPU 5: Tesla V100-SXM2-16GB', 'GPU 6: Tesla V100-SXM2-16GB', 'GPU 7: Tesla V100-SXM2-16GB'] GCC: gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-39) PaddlePaddle: 0.0.0 OpenCV: 4.2.0 ------------------------------------------------ 2020-11-14 00:51:38 [INFO] ---------------Config Information--------------- batch_size: 4 iters: 40000 learning_rate: decay: end_lr: 1.0e-05 power: 0.9 type: poly value: 0.01 loss: coef: - 1 - 0.4 types: - ignore_index: 255 type: CrossEntropyLoss model: align_corners: false backbone: output_stride: 8 pretrained: https://bj.bcebos.com/paddleseg/dygraph/resnet50_vd_ssld_v2.tar.gz type: ResNet50_vd enable_auxiliary_loss: true gc_channels: 512 pretrained: null ratio: 0.25 type: GCNet optimizer: momentum: 0.9 type: sgd weight_decay: 4.0e-05 train_dataset: dataset_root: data/VOCdevkit/ mode: trainaug transforms: - max_scale_factor: 2.0 min_scale_factor: 0.5 scale_step_size: 0.25 type: ResizeStepScaling - crop_size: - 512 - 512 type: RandomPaddingCrop - type: RandomHorizontalFlip - brightness_range: 0.4 contrast_range: 0.4 saturation_range: 0.4 type: RandomDistort - type: Normalize type: PascalVOC val_dataset: dataset_root: data/VOCdevkit/ mode: val transforms: - target_size: - 512 - 512 type: Padding - type: Normalize type: PascalVOC ------------------------------------------------ 2020-11-14 00:51:42 [INFO] Loading pretrained model from https://bj.bcebos.com/paddleseg/dygraph/resnet50_vd_ssld_v2.tar.gz 2020-11-14 00:51:43 [INFO] There are 275/275 variables loaded into ResNet_vd. 2020-11-14 00:51:58 [INFO] [TRAIN] epoch=1, iter=10/40000, loss=2.5360, lr=0.009998, batch_cost=0.8059, reader_cost=0.1406 | ETA 08:57:08 2020-11-14 00:52:03 [INFO] [TRAIN] epoch=1, iter=20/40000, loss=1.2171, lr=0.009996, batch_cost=0.4254, reader_cost=0.0005 | ETA 04:43:26 2020-11-14 00:52:07 [INFO] [TRAIN] epoch=1, iter=30/40000, loss=1.4472, lr=0.009993, batch_cost=0.4534, reader_cost=0.0003 | ETA 05:02:03 2020-11-14 00:52:11 [INFO] [TRAIN] epoch=1, iter=40/40000, loss=1.3663, lr=0.009991, batch_cost=0.4320, reader_cost=0.0002 | ETA 04:47:41 2020-11-14 00:52:16 [INFO] [TRAIN] epoch=1, iter=50/40000, loss=1.3243, lr=0.009989, batch_cost=0.4294, reader_cost=0.0003 | ETA 04:45:54 2020-11-14 00:52:20 [INFO] [TRAIN] epoch=1, iter=60/40000, loss=1.6599, lr=0.009987, batch_cost=0.4338, reader_cost=0.0002 | ETA 04:48:45 2020-11-14 00:52:24 [INFO] [TRAIN] epoch=1, iter=70/40000, loss=1.4958, lr=0.009984, batch_cost=0.4301, reader_cost=0.0002 | ETA 04:46:13 2020-11-14 00:52:29 [INFO] [TRAIN] epoch=1, iter=80/40000, loss=1.3628, lr=0.009982, batch_cost=0.4359, reader_cost=0.0002 | ETA 04:49:59 2020-11-14 00:52:33 [INFO] [TRAIN] epoch=1, iter=90/40000, loss=1.4743, lr=0.009980, batch_cost=0.4357, reader_cost=0.0003 | ETA 04:49:49 2020-11-14 00:52:37 [INFO] [TRAIN] epoch=1, iter=100/40000, loss=1.0022, lr=0.009978, batch_cost=0.4298, reader_cost=0.0002 | ETA 04:45:50 2020-11-14 00:52:42 [INFO] [TRAIN] epoch=1, iter=110/40000, loss=1.2785, lr=0.009975, batch_cost=0.4335, reader_cost=0.0002 | ETA 04:48:11 2020-11-14 00:52:46 [INFO] [TRAIN] epoch=1, iter=120/40000, loss=1.3215, lr=0.009973, batch_cost=0.4351, reader_cost=0.0002 | ETA 04:49:11 2020-11-14 00:52:50 [INFO] [TRAIN] epoch=1, iter=130/40000, loss=0.9122, lr=0.009971, batch_cost=0.4362, reader_cost=0.0003 | ETA 04:49:50 2020-11-14 00:52:55 [INFO] [TRAIN] epoch=1, iter=140/40000, loss=1.0306, lr=0.009969, batch_cost=0.4320, reader_cost=0.0002 | ETA 04:46:57 2020-11-14 00:52:59 [INFO] [TRAIN] epoch=1, iter=150/40000, loss=1.0405, lr=0.009967, batch_cost=0.4339, reader_cost=0.0003 | ETA 04:48:09 2020-11-14 00:53:03 [INFO] [TRAIN] epoch=1, iter=160/40000, loss=0.9080, lr=0.009964, batch_cost=0.4326, reader_cost=0.0003 | ETA 04:47:13 2020-11-14 00:53:08 [INFO] [TRAIN] epoch=1, iter=170/40000, loss=1.0911, lr=0.009962, batch_cost=0.4360, reader_cost=0.0003 | ETA 04:49:27 2020-11-14 00:53:12 [INFO] [TRAIN] epoch=1, iter=180/40000, loss=1.0261, lr=0.009960, batch_cost=0.4352, reader_cost=0.0003 | ETA 04:48:50 2020-11-14 00:53:16 [INFO] [TRAIN] epoch=1, iter=190/40000, loss=1.1271, lr=0.009958, batch_cost=0.4332, reader_cost=0.0003 | ETA 04:47:23 2020-11-14 00:53:21 [INFO] [TRAIN] epoch=1, iter=200/40000, loss=1.0085, lr=0.009955, batch_cost=0.4744, reader_cost=0.0003 | ETA 05:14:40 2020-11-14 00:53:26 [INFO] [TRAIN] epoch=1, iter=210/40000, loss=1.2298, lr=0.009953, batch_cost=0.4577, reader_cost=0.0003 | ETA 05:03:33 2020-11-14 00:53:30 [INFO] [TRAIN] epoch=1, iter=220/40000, loss=1.1267, lr=0.009951, batch_cost=0.4425, reader_cost=0.0003 | ETA 04:53:20 2020-11-14 00:53:35 [INFO] [TRAIN] epoch=1, iter=230/40000, loss=0.9469, lr=0.009949, batch_cost=0.4694, reader_cost=0.0022 | ETA 05:11:09 2020-11-14 00:53:39 [INFO] [TRAIN] epoch=1, iter=240/40000, loss=1.1296, lr=0.009946, batch_cost=0.4367, reader_cost=0.0002 | ETA 04:49:23 2020-11-14 00:53:44 [INFO] [TRAIN] epoch=1, iter=250/40000, loss=0.9662, lr=0.009944, batch_cost=0.4381, reader_cost=0.0002 | ETA 04:50:14 2020-11-14 00:53:48 [INFO] [TRAIN] epoch=1, iter=260/40000, loss=0.8858, lr=0.009942, batch_cost=0.4590, reader_cost=0.0002 | ETA 05:04:00 2020-11-14 00:53:53 [INFO] [TRAIN] epoch=1, iter=270/40000, loss=0.9166, lr=0.009940, batch_cost=0.4713, reader_cost=0.0002 | ETA 05:12:06 2020-11-14 00:53:57 [INFO] [TRAIN] epoch=1, iter=280/40000, loss=0.9509, lr=0.009937, batch_cost=0.4519, reader_cost=0.0002 | ETA 04:59:09 2020-11-14 00:54:02 [INFO] [TRAIN] epoch=1, iter=290/40000, loss=1.1353, lr=0.009935, batch_cost=0.4363, reader_cost=0.0002 | ETA 04:48:46 2020-11-14 00:54:06 [INFO] [TRAIN] epoch=1, iter=300/40000, loss=0.9795, lr=0.009933, batch_cost=0.4491, reader_cost=0.0002 | ETA 04:57:09 2020-11-14 00:54:11 [INFO] [TRAIN] epoch=1, iter=310/40000, loss=0.8267, lr=0.009931, batch_cost=0.4293, reader_cost=0.0002 | ETA 04:43:58 2020-11-14 00:54:15 [INFO] [TRAIN] epoch=1, iter=320/40000, loss=0.8780, lr=0.009928, batch_cost=0.4339, reader_cost=0.0002 | ETA 04:46:56 2020-11-14 00:54:19 [INFO] [TRAIN] epoch=1, iter=330/40000, loss=0.9023, lr=0.009926, batch_cost=0.4330, reader_cost=0.0002 | ETA 04:46:18 2020-11-14 00:54:24 [INFO] [TRAIN] epoch=1, iter=340/40000, loss=0.9387, lr=0.009924, batch_cost=0.4352, reader_cost=0.0002 | ETA 04:47:39 2020-11-14 00:54:28 [INFO] [TRAIN] epoch=1, iter=350/40000, loss=0.8007, lr=0.009922, batch_cost=0.4431, reader_cost=0.0002 | ETA 04:52:49 2020-11-14 00:54:32 [INFO] [TRAIN] epoch=1, iter=360/40000, loss=1.0791, lr=0.009919, batch_cost=0.4345, reader_cost=0.0002 | ETA 04:47:02 2020-11-14 00:54:37 [INFO] [TRAIN] epoch=1, iter=370/40000, loss=0.7362, lr=0.009917, batch_cost=0.4554, reader_cost=0.0042 | ETA 05:00:46 2020-11-14 00:54:41 [INFO] [TRAIN] epoch=1, iter=380/40000, loss=0.7467, lr=0.009915, batch_cost=0.4388, reader_cost=0.0002 | ETA 04:49:45 2020-11-14 00:54:46 [INFO] [TRAIN] epoch=1, iter=390/40000, loss=0.8959, lr=0.009913, batch_cost=0.4483, reader_cost=0.0002 | ETA 04:55:55 2020-11-14 00:54:50 [INFO] [TRAIN] epoch=1, iter=400/40000, loss=0.8141, lr=0.009910, batch_cost=0.4334, reader_cost=0.0002 | ETA 04:46:04 2020-11-14 00:54:54 [INFO] [TRAIN] epoch=1, iter=410/40000, loss=0.8492, lr=0.009908, batch_cost=0.4313, reader_cost=0.0002 | ETA 04:44:36 2020-11-14 00:54:59 [INFO] [TRAIN] epoch=1, iter=420/40000, loss=1.0662, lr=0.009906, batch_cost=0.4350, reader_cost=0.0002 | ETA 04:46:58 2020-11-14 00:55:03 [INFO] [TRAIN] epoch=1, iter=430/40000, loss=1.1098, lr=0.009904, batch_cost=0.4383, reader_cost=0.0002 | ETA 04:49:02 2020-11-14 00:55:08 [INFO] [TRAIN] epoch=1, iter=440/40000, loss=0.9261, lr=0.009901, batch_cost=0.4643, reader_cost=0.0002 | ETA 05:06:07 2020-11-14 00:55:12 [INFO] [TRAIN] epoch=1, iter=450/40000, loss=0.9417, lr=0.009899, batch_cost=0.4312, reader_cost=0.0002 | ETA 04:44:15 2020-11-14 00:55:16 [INFO] [TRAIN] epoch=1, iter=460/40000, loss=0.7955, lr=0.009897, batch_cost=0.4340, reader_cost=0.0002 | ETA 04:46:00 2020-11-14 00:55:21 [INFO] [TRAIN] epoch=1, iter=470/40000, loss=0.7488, lr=0.009895, batch_cost=0.4366, reader_cost=0.0002 | ETA 04:47:37 2020-11-14 00:55:25 [INFO] [TRAIN] epoch=1, iter=480/40000, loss=0.8713, lr=0.009892, batch_cost=0.4390, reader_cost=0.0002 | ETA 04:49:07 2020-11-14 00:55:30 [INFO] [TRAIN] epoch=1, iter=490/40000, loss=0.7599, lr=0.009890, batch_cost=0.4330, reader_cost=0.0002 | ETA 04:45:07 2020-11-14 00:55:34 [INFO] [TRAIN] epoch=1, iter=500/40000, loss=0.8254, lr=0.009888, batch_cost=0.4851, reader_cost=0.0002 | ETA 05:19:20 2020-11-14 00:55:39 [INFO] [TRAIN] epoch=1, iter=510/40000, loss=1.0476, lr=0.009886, batch_cost=0.4745, reader_cost=0.0002 | ETA 05:12:18 2020-11-14 00:55:44 [INFO] [TRAIN] epoch=1, iter=520/40000, loss=0.8682, lr=0.009883, batch_cost=0.4439, reader_cost=0.0002 | ETA 04:52:05 2020-11-14 00:55:48 [INFO] [TRAIN] epoch=1, iter=530/40000, loss=0.7421, lr=0.009881, batch_cost=0.4315, reader_cost=0.0002 | ETA 04:43:51 2020-11-14 00:55:52 [INFO] [TRAIN] epoch=1, iter=540/40000, loss=0.8270, lr=0.009879, batch_cost=0.4307, reader_cost=0.0002 | ETA 04:43:17 2020-11-14 00:55:57 [INFO] [TRAIN] epoch=1, iter=550/40000, loss=0.7427, lr=0.009877, batch_cost=0.4353, reader_cost=0.0002 | ETA 04:46:11 2020-11-14 00:56:01 [INFO] [TRAIN] epoch=1, iter=560/40000, loss=0.9094, lr=0.009874, batch_cost=0.4307, reader_cost=0.0002 | ETA 04:43:06 2020-11-14 00:56:05 [INFO] [TRAIN] epoch=1, iter=570/40000, loss=0.8391, lr=0.009872, batch_cost=0.4340, reader_cost=0.0002 | ETA 04:45:12 2020-11-14 00:56:10 [INFO] [TRAIN] epoch=1, iter=580/40000, loss=0.9418, lr=0.009870, batch_cost=0.4415, reader_cost=0.0002 | ETA 04:50:04 2020-11-14 00:56:14 [INFO] [TRAIN] epoch=1, iter=590/40000, loss=0.8617, lr=0.009868, batch_cost=0.4765, reader_cost=0.0002 | ETA 05:12:57 2020-11-14 00:56:19 [INFO] [TRAIN] epoch=1, iter=600/40000, loss=0.9245, lr=0.009865, batch_cost=0.4958, reader_cost=0.0002 | ETA 05:25:35 2020-11-14 00:56:24 [INFO] [TRAIN] epoch=1, iter=610/40000, loss=0.9629, lr=0.009863, batch_cost=0.4529, reader_cost=0.0002 | ETA 04:57:18 2020-11-14 00:56:29 [INFO] [TRAIN] epoch=1, iter=620/40000, loss=0.9268, lr=0.009861, batch_cost=0.4597, reader_cost=0.0002 | ETA 05:01:44 2020-11-14 00:56:33 [INFO] [TRAIN] epoch=1, iter=630/40000, loss=0.6718, lr=0.009859, batch_cost=0.4971, reader_cost=0.0002 | ETA 05:26:12 2020-11-14 00:56:38 [INFO] [TRAIN] epoch=1, iter=640/40000, loss=0.9494, lr=0.009856, batch_cost=0.5003, reader_cost=0.0002 | ETA 05:28:11 2020-11-14 00:56:43 [INFO] [TRAIN] epoch=1, iter=650/40000, loss=1.1855, lr=0.009854, batch_cost=0.4435, reader_cost=0.0002 | ETA 04:50:52 2020-11-14 00:56:47 [INFO] [TRAIN] epoch=1, iter=660/40000, loss=0.8058, lr=0.009852, batch_cost=0.4392, reader_cost=0.0002 | ETA 04:47:58 2020-11-14 00:56:53 [INFO] [TRAIN] epoch=2, iter=670/40000, loss=0.7971, lr=0.009849, batch_cost=0.5906, reader_cost=0.0847 | ETA 06:27:09 2020-11-14 00:56:58 [INFO] [TRAIN] epoch=2, iter=680/40000, loss=0.7637, lr=0.009847, batch_cost=0.4560, reader_cost=0.0007 | ETA 04:58:50 2020-11-14 00:57:02 [INFO] [TRAIN] epoch=2, iter=690/40000, loss=0.7020, lr=0.009845, batch_cost=0.4383, reader_cost=0.0003 | ETA 04:47:08 2020-11-14 00:57:07 [INFO] [TRAIN] epoch=2, iter=700/40000, loss=0.7631, lr=0.009843, batch_cost=0.4340, reader_cost=0.0002 | ETA 04:44:15 2020-11-14 00:57:11 [INFO] [TRAIN] epoch=2, iter=710/40000, loss=0.6784, lr=0.009840, batch_cost=0.4391, reader_cost=0.0002 | ETA 04:47:33 2020-11-14 00:57:15 [INFO] [TRAIN] epoch=2, iter=720/40000, loss=0.9904, lr=0.009838, batch_cost=0.4302, reader_cost=0.0002 | ETA 04:41:38 2020-11-14 00:57:20 [INFO] [TRAIN] epoch=2, iter=730/40000, loss=0.8014, lr=0.009836, batch_cost=0.4311, reader_cost=0.0002 | ETA 04:42:10 2020-11-14 00:57:24 [INFO] [TRAIN] epoch=2, iter=740/40000, loss=0.7862, lr=0.009834, batch_cost=0.4411, reader_cost=0.0002 | ETA 04:48:36 2020-11-14 00:57:28 [INFO] [TRAIN] epoch=2, iter=750/40000, loss=1.0208, lr=0.009831, batch_cost=0.4304, reader_cost=0.0002 | ETA 04:41:33 2020-11-14 00:57:33 [INFO] [TRAIN] epoch=2, iter=760/40000, loss=0.9195, lr=0.009829, batch_cost=0.4409, reader_cost=0.0002 | ETA 04:48:22 2020-11-14 00:57:37 [INFO] [TRAIN] epoch=2, iter=770/40000, loss=0.6201, lr=0.009827, batch_cost=0.4352, reader_cost=0.0002 | ETA 04:44:31 2020-11-14 00:57:41 [INFO] [TRAIN] epoch=2, iter=780/40000, loss=1.0823, lr=0.009825, batch_cost=0.4414, reader_cost=0.0002 | ETA 04:48:31 2020-11-14 00:57:46 [INFO] [TRAIN] epoch=2, iter=790/40000, loss=0.8309, lr=0.009822, batch_cost=0.4507, reader_cost=0.0002 | ETA 04:54:31 2020-11-14 00:57:51 [INFO] [TRAIN] epoch=2, iter=800/40000, loss=0.9575, lr=0.009820, batch_cost=0.4700, reader_cost=0.0002 | ETA 05:07:03 2020-11-14 00:57:55 [INFO] [TRAIN] epoch=2, iter=810/40000, loss=0.6657, lr=0.009818, batch_cost=0.4374, reader_cost=0.0002 | ETA 04:45:40 2020-11-14 00:57:59 [INFO] [TRAIN] epoch=2, iter=820/40000, loss=0.5696, lr=0.009816, batch_cost=0.4451, reader_cost=0.0002 | ETA 04:50:38 2020-11-14 00:58:04 [INFO] [TRAIN] epoch=2, iter=830/40000, loss=0.7853, lr=0.009813, batch_cost=0.4736, reader_cost=0.0022 | ETA 05:09:10 2020-11-14 00:58:09 [INFO] [TRAIN] epoch=2, iter=840/40000, loss=1.1141, lr=0.009811, batch_cost=0.4475, reader_cost=0.0015 | ETA 04:52:02 2020-11-14 00:58:13 [INFO] [TRAIN] epoch=2, iter=850/40000, loss=0.5937, lr=0.009809, batch_cost=0.4402, reader_cost=0.0002 | ETA 04:47:14 2020-11-14 00:58:17 [INFO] [TRAIN] epoch=2, iter=860/40000, loss=0.6736, lr=0.009807, batch_cost=0.4339, reader_cost=0.0002 | ETA 04:43:01 2020-11-14 00:58:22 [INFO] [TRAIN] epoch=2, iter=870/40000, loss=0.9709, lr=0.009804, batch_cost=0.4336, reader_cost=0.0002 | ETA 04:42:48 2020-11-14 00:58:26 [INFO] [TRAIN] epoch=2, iter=880/40000, loss=0.8921, lr=0.009802, batch_cost=0.4328, reader_cost=0.0002 | ETA 04:42:12 2020-11-14 00:58:30 [INFO] [TRAIN] epoch=2, iter=890/40000, loss=0.6986, lr=0.009800, batch_cost=0.4325, reader_cost=0.0002 | ETA 04:41:56 2020-11-14 00:58:35 [INFO] [TRAIN] epoch=2, iter=900/40000, loss=0.6327, lr=0.009798, batch_cost=0.4315, reader_cost=0.0003 | ETA 04:41:11 2020-11-14 00:58:39 [INFO] [TRAIN] epoch=2, iter=910/40000, loss=1.0311, lr=0.009795, batch_cost=0.4363, reader_cost=0.0002 | ETA 04:44:15 2020-11-14 00:58:43 [INFO] [TRAIN] epoch=2, iter=920/40000, loss=0.8713, lr=0.009793, batch_cost=0.4358, reader_cost=0.0003 | ETA 04:43:50 2020-11-14 00:58:48 [INFO] [TRAIN] epoch=2, iter=930/40000, loss=0.9319, lr=0.009791, batch_cost=0.4343, reader_cost=0.0002 | ETA 04:42:46 2020-11-14 00:58:52 [INFO] [TRAIN] epoch=2, iter=940/40000, loss=0.7876, lr=0.009789, batch_cost=0.4334, reader_cost=0.0002 | ETA 04:42:07 2020-11-14 00:58:57 [INFO] [TRAIN] epoch=2, iter=950/40000, loss=0.7388, lr=0.009786, batch_cost=0.4444, reader_cost=0.0002 | ETA 04:49:12 2020-11-14 00:59:01 [INFO] [TRAIN] epoch=2, iter=960/40000, loss=0.8498, lr=0.009784, batch_cost=0.4337, reader_cost=0.0002 | ETA 04:42:11 2020-11-14 00:59:05 [INFO] [TRAIN] epoch=2, iter=970/40000, loss=0.8111, lr=0.009782, batch_cost=0.4345, reader_cost=0.0002 | ETA 04:42:37 2020-11-14 00:59:10 [INFO] [TRAIN] epoch=2, iter=980/40000, loss=0.7420, lr=0.009780, batch_cost=0.4404, reader_cost=0.0002 | ETA 04:46:24 2020-11-14 00:59:14 [INFO] [TRAIN] epoch=2, iter=990/40000, loss=0.7602, lr=0.009777, batch_cost=0.4315, reader_cost=0.0002 | ETA 04:40:33 2020-11-14 00:59:18 [INFO] [TRAIN] epoch=2, iter=1000/40000, loss=0.7795, lr=0.009775, batch_cost=0.4363, reader_cost=0.0003 | ETA 04:43:35 2020-11-14 00:59:23 [INFO] [TRAIN] epoch=2, iter=1010/40000, loss=0.5501, lr=0.009773, batch_cost=0.4355, reader_cost=0.0002 | ETA 04:42:58 2020-11-14 00:59:27 [INFO] [TRAIN] epoch=2, iter=1020/40000, loss=0.8470, lr=0.009771, batch_cost=0.4447, reader_cost=0.0002 | ETA 04:48:54 2020-11-14 00:59:32 [INFO] [TRAIN] epoch=2, iter=1030/40000, loss=0.6548, lr=0.009768, batch_cost=0.4496, reader_cost=0.0002 | ETA 04:51:59 2020-11-14 00:59:36 [INFO] [TRAIN] epoch=2, iter=1040/40000, loss=0.8226, lr=0.009766, batch_cost=0.4398, reader_cost=0.0002 | ETA 04:45:35 2020-11-14 00:59:40 [INFO] [TRAIN] epoch=2, iter=1050/40000, loss=0.7351, lr=0.009764, batch_cost=0.4371, reader_cost=0.0002 | ETA 04:43:46 2020-11-14 00:59:45 [INFO] [TRAIN] epoch=2, iter=1060/40000, loss=0.7030, lr=0.009762, batch_cost=0.4308, reader_cost=0.0002 | ETA 04:39:34 2020-11-14 00:59:49 [INFO] [TRAIN] epoch=2, iter=1070/40000, loss=0.8266, lr=0.009759, batch_cost=0.4321, reader_cost=0.0001 | ETA 04:40:22 2020-11-14 00:59:53 [INFO] [TRAIN] epoch=2, iter=1080/40000, loss=0.6215, lr=0.009757, batch_cost=0.4355, reader_cost=0.0002 | ETA 04:42:30 2020-11-14 00:59:58 [INFO] [TRAIN] epoch=2, iter=1090/40000, loss=0.5642, lr=0.009755, batch_cost=0.4374, reader_cost=0.0003 | ETA 04:43:39 2020-11-14 01:00:02 [INFO] [TRAIN] epoch=2, iter=1100/40000, loss=0.8130, lr=0.009753, batch_cost=0.4410, reader_cost=0.0002 | ETA 04:45:56 2020-11-14 01:00:07 [INFO] [TRAIN] epoch=2, iter=1110/40000, loss=0.8429, lr=0.009750, batch_cost=0.4403, reader_cost=0.0003 | ETA 04:45:24 2020-11-14 01:00:11 [INFO] [TRAIN] epoch=2, iter=1120/40000, loss=0.9025, lr=0.009748, batch_cost=0.4403, reader_cost=0.0002 | ETA 04:45:16 2020-11-14 01:00:15 [INFO] [TRAIN] epoch=2, iter=1130/40000, loss=0.6453, lr=0.009746, batch_cost=0.4435, reader_cost=0.0002 | ETA 04:47:19 2020-11-14 01:00:20 [INFO] [TRAIN] epoch=2, iter=1140/40000, loss=0.7080, lr=0.009744, batch_cost=0.4420, reader_cost=0.0002 | ETA 04:46:17 2020-11-14 01:00:24 [INFO] [TRAIN] epoch=2, iter=1150/40000, loss=0.6629, lr=0.009741, batch_cost=0.4379, reader_cost=0.0002 | ETA 04:43:31 2020-11-14 01:00:29 [INFO] [TRAIN] epoch=2, iter=1160/40000, loss=0.6950, lr=0.009739, batch_cost=0.4369, reader_cost=0.0002 | ETA 04:42:48 2020-11-14 01:00:33 [INFO] [TRAIN] epoch=2, iter=1170/40000, loss=0.7492, lr=0.009737, batch_cost=0.4344, reader_cost=0.0002 | ETA 04:41:07 2020-11-14 01:00:37 [INFO] [TRAIN] epoch=2, iter=1180/40000, loss=0.6923, lr=0.009735, batch_cost=0.4364, reader_cost=0.0002 | ETA 04:42:19 2020-11-14 01:00:42 [INFO] [TRAIN] epoch=2, iter=1190/40000, loss=1.0089, lr=0.009732, batch_cost=0.4399, reader_cost=0.0002 | ETA 04:44:32 2020-11-14 01:00:46 [INFO] [TRAIN] epoch=2, iter=1200/40000, loss=0.5627, lr=0.009730, batch_cost=0.4388, reader_cost=0.0002 | ETA 04:43:47 2020-11-14 01:00:50 [INFO] [TRAIN] epoch=2, iter=1210/40000, loss=0.7959, lr=0.009728, batch_cost=0.4355, reader_cost=0.0002 | ETA 04:41:33 2020-11-14 01:00:55 [INFO] [TRAIN] epoch=2, iter=1220/40000, loss=0.7423, lr=0.009726, batch_cost=0.4367, reader_cost=0.0002 | ETA 04:42:14 2020-11-14 01:00:59 [INFO] [TRAIN] epoch=2, iter=1230/40000, loss=0.8153, lr=0.009723, batch_cost=0.4663, reader_cost=0.0002 | ETA 05:01:18 2020-11-14 01:01:04 [INFO] [TRAIN] epoch=2, iter=1240/40000, loss=0.6832, lr=0.009721, batch_cost=0.4538, reader_cost=0.0002 | ETA 04:53:10 2020-11-14 01:01:09 [INFO] [TRAIN] epoch=2, iter=1250/40000, loss=0.5541, lr=0.009719, batch_cost=0.4635, reader_cost=0.0002 | ETA 04:59:21 2020-11-14 01:01:13 [INFO] [TRAIN] epoch=2, iter=1260/40000, loss=0.9409, lr=0.009717, batch_cost=0.4529, reader_cost=0.0002 | ETA 04:52:24 2020-11-14 01:01:18 [INFO] [TRAIN] epoch=2, iter=1270/40000, loss=0.6720, lr=0.009714, batch_cost=0.4621, reader_cost=0.0002 | ETA 04:58:15 2020-11-14 01:01:22 [INFO] [TRAIN] epoch=2, iter=1280/40000, loss=0.6344, lr=0.009712, batch_cost=0.4565, reader_cost=0.0002 | ETA 04:54:37 2020-11-14 01:01:27 [INFO] [TRAIN] epoch=2, iter=1290/40000, loss=0.5965, lr=0.009710, batch_cost=0.4608, reader_cost=0.0002 | ETA 04:57:17 2020-11-14 01:01:31 [INFO] [TRAIN] epoch=2, iter=1300/40000, loss=1.0530, lr=0.009708, batch_cost=0.4338, reader_cost=0.0002 | ETA 04:39:49 2020-11-14 01:01:36 [INFO] [TRAIN] epoch=2, iter=1310/40000, loss=0.9369, lr=0.009705, batch_cost=0.4561, reader_cost=0.0002 | ETA 04:54:05 2020-11-14 01:01:40 [INFO] [TRAIN] epoch=2, iter=1320/40000, loss=0.9575, lr=0.009703, batch_cost=0.4330, reader_cost=0.0002 | ETA 04:39:08 2020-11-14 01:01:46 [INFO] [TRAIN] epoch=3, iter=1330/40000, loss=0.6447, lr=0.009701, batch_cost=0.6161, reader_cost=0.1535 | ETA 06:37:04 2020-11-14 01:01:51 [INFO] [TRAIN] epoch=3, iter=1340/40000, loss=0.7714, lr=0.009699, batch_cost=0.4879, reader_cost=0.0007 | ETA 05:14:22 2020-11-14 01:01:56 [INFO] [TRAIN] epoch=3, iter=1350/40000, loss=0.5934, lr=0.009696, batch_cost=0.4889, reader_cost=0.0002 | ETA 05:14:57 2020-11-14 01:02:01 [INFO] [TRAIN] epoch=3, iter=1360/40000, loss=0.7317, lr=0.009694, batch_cost=0.4913, reader_cost=0.0011 | ETA 05:16:22 2020-11-14 01:02:06 [INFO] [TRAIN] epoch=3, iter=1370/40000, loss=1.2093, lr=0.009692, batch_cost=0.4793, reader_cost=0.0015 | ETA 05:08:34 2020-11-14 01:02:10 [INFO] [TRAIN] epoch=3, iter=1380/40000, loss=0.6816, lr=0.009689, batch_cost=0.4411, reader_cost=0.0002 | ETA 04:43:56 2020-11-14 01:02:15 [INFO] [TRAIN] epoch=3, iter=1390/40000, loss=0.9444, lr=0.009687, batch_cost=0.4428, reader_cost=0.0002 | ETA 04:44:54 2020-11-14 01:02:19 [INFO] [TRAIN] epoch=3, iter=1400/40000, loss=0.8610, lr=0.009685, batch_cost=0.4427, reader_cost=0.0002 | ETA 04:44:48 2020-11-14 01:02:24 [INFO] [TRAIN] epoch=3, iter=1410/40000, loss=0.5602, lr=0.009683, batch_cost=0.4384, reader_cost=0.0002 | ETA 04:41:59 2020-11-14 01:02:28 [INFO] [TRAIN] epoch=3, iter=1420/40000, loss=0.6802, lr=0.009680, batch_cost=0.4359, reader_cost=0.0002 | ETA 04:40:17 2020-11-14 01:02:32 [INFO] [TRAIN] epoch=3, iter=1430/40000, loss=0.5592, lr=0.009678, batch_cost=0.4372, reader_cost=0.0002 | ETA 04:41:02 2020-11-14 01:02:37 [INFO] [TRAIN] epoch=3, iter=1440/40000, loss=0.8699, lr=0.009676, batch_cost=0.4406, reader_cost=0.0002 | ETA 04:43:09 2020-11-14 01:02:41 [INFO] [TRAIN] epoch=3, iter=1450/40000, loss=0.8422, lr=0.009674, batch_cost=0.4650, reader_cost=0.0002 | ETA 04:58:44 2020-11-14 01:02:46 [INFO] [TRAIN] epoch=3, iter=1460/40000, loss=0.5411, lr=0.009671, batch_cost=0.4509, reader_cost=0.0079 | ETA 04:49:36 2020-11-14 01:02:50 [INFO] [TRAIN] epoch=3, iter=1470/40000, loss=0.7627, lr=0.009669, batch_cost=0.4297, reader_cost=0.0002 | ETA 04:35:55 2020-11-14 01:02:55 [INFO] [TRAIN] epoch=3, iter=1480/40000, loss=0.4716, lr=0.009667, batch_cost=0.4720, reader_cost=0.0002 | ETA 05:03:01 2020-11-14 01:02:59 [INFO] [TRAIN] epoch=3, iter=1490/40000, loss=0.6643, lr=0.009665, batch_cost=0.4616, reader_cost=0.0009 | ETA 04:56:16 2020-11-14 01:03:04 [INFO] [TRAIN] epoch=3, iter=1500/40000, loss=0.5958, lr=0.009662, batch_cost=0.4692, reader_cost=0.0020 | ETA 05:01:02 2020-11-14 01:03:09 [INFO] [TRAIN] epoch=3, iter=1510/40000, loss=0.4801, lr=0.009660, batch_cost=0.4511, reader_cost=0.0002 | ETA 04:49:23 2020-11-14 01:03:13 [INFO] [TRAIN] epoch=3, iter=1520/40000, loss=0.5924, lr=0.009658, batch_cost=0.4387, reader_cost=0.0002 | ETA 04:41:22 2020-11-14 01:03:18 [INFO] [TRAIN] epoch=3, iter=1530/40000, loss=0.7331, lr=0.009656, batch_cost=0.4541, reader_cost=0.0003 | ETA 04:51:10 2020-11-14 01:03:22 [INFO] [TRAIN] epoch=3, iter=1540/40000, loss=0.6675, lr=0.009653, batch_cost=0.4769, reader_cost=0.0002 | ETA 05:05:43 2020-11-14 01:03:27 [INFO] [TRAIN] epoch=3, iter=1550/40000, loss=0.4480, lr=0.009651, batch_cost=0.4597, reader_cost=0.0005 | ETA 04:54:35 2020-11-14 01:03:32 [INFO] [TRAIN] epoch=3, iter=1560/40000, loss=0.5706, lr=0.009649, batch_cost=0.4652, reader_cost=0.0002 | ETA 04:58:04 2020-11-14 01:03:36 [INFO] [TRAIN] epoch=3, iter=1570/40000, loss=0.7421, lr=0.009647, batch_cost=0.4388, reader_cost=0.0002 | ETA 04:41:03 2020-11-14 01:03:41 [INFO] [TRAIN] epoch=3, iter=1580/40000, loss=0.5674, lr=0.009644, batch_cost=0.4635, reader_cost=0.0002 | ETA 04:56:49 2020-11-14 01:03:45 [INFO] [TRAIN] epoch=3, iter=1590/40000, loss=0.9012, lr=0.009642, batch_cost=0.4571, reader_cost=0.0002 | ETA 04:52:38 2020-11-14 01:03:50 [INFO] [TRAIN] epoch=3, iter=1600/40000, loss=0.5849, lr=0.009640, batch_cost=0.4563, reader_cost=0.0003 | ETA 04:52:00 2020-11-14 01:03:54 [INFO] [TRAIN] epoch=3, iter=1610/40000, loss=0.8201, lr=0.009638, batch_cost=0.4540, reader_cost=0.0002 | ETA 04:50:27 2020-11-14 01:03:59 [INFO] [TRAIN] epoch=3, iter=1620/40000, loss=0.6544, lr=0.009635, batch_cost=0.4667, reader_cost=0.0002 | ETA 04:58:30 2020-11-14 01:04:03 [INFO] [TRAIN] epoch=3, iter=1630/40000, loss=0.6622, lr=0.009633, batch_cost=0.4352, reader_cost=0.0002 | ETA 04:38:19 2020-11-14 01:04:08 [INFO] [TRAIN] epoch=3, iter=1640/40000, loss=0.9110, lr=0.009631, batch_cost=0.4383, reader_cost=0.0002 | ETA 04:40:13 2020-11-14 01:04:12 [INFO] [TRAIN] epoch=3, iter=1650/40000, loss=0.5760, lr=0.009629, batch_cost=0.4379, reader_cost=0.0003 | ETA 04:39:52 2020-11-14 01:04:17 [INFO] [TRAIN] epoch=3, iter=1660/40000, loss=0.6575, lr=0.009626, batch_cost=0.4940, reader_cost=0.0002 | ETA 05:15:40 2020-11-14 01:04:22 [INFO] [TRAIN] epoch=3, iter=1670/40000, loss=0.4252, lr=0.009624, batch_cost=0.4527, reader_cost=0.0002 | ETA 04:49:10 2020-11-14 01:04:26 [INFO] [TRAIN] epoch=3, iter=1680/40000, loss=0.5811, lr=0.009622, batch_cost=0.4280, reader_cost=0.0002 | ETA 04:33:22 2020-11-14 01:04:30 [INFO] [TRAIN] epoch=3, iter=1690/40000, loss=0.7013, lr=0.009620, batch_cost=0.4248, reader_cost=0.0002 | ETA 04:31:12 2020-11-14 01:04:34 [INFO] [TRAIN] epoch=3, iter=1700/40000, loss=0.6626, lr=0.009617, batch_cost=0.4264, reader_cost=0.0002 | ETA 04:32:09 2020-11-14 01:04:39 [INFO] [TRAIN] epoch=3, iter=1710/40000, loss=0.4804, lr=0.009615, batch_cost=0.4269, reader_cost=0.0002 | ETA 04:32:24 2020-11-14 01:04:43 [INFO] [TRAIN] epoch=3, iter=1720/40000, loss=0.6722, lr=0.009613, batch_cost=0.4264, reader_cost=0.0002 | ETA 04:32:03 2020-11-14 01:04:47 [INFO] [TRAIN] epoch=3, iter=1730/40000, loss=0.4980, lr=0.009611, batch_cost=0.4259, reader_cost=0.0002 | ETA 04:31:40 2020-11-14 01:04:51 [INFO] [TRAIN] epoch=3, iter=1740/40000, loss=0.7932, lr=0.009608, batch_cost=0.4274, reader_cost=0.0002 | ETA 04:32:32 2020-11-14 01:04:56 [INFO] [TRAIN] epoch=3, iter=1750/40000, loss=1.0808, lr=0.009606, batch_cost=0.4265, reader_cost=0.0002 | ETA 04:31:51 2020-11-14 01:05:00 [INFO] [TRAIN] epoch=3, iter=1760/40000, loss=0.7827, lr=0.009604, batch_cost=0.4273, reader_cost=0.0002 | ETA 04:32:20 2020-11-14 01:05:04 [INFO] [TRAIN] epoch=3, iter=1770/40000, loss=0.6387, lr=0.009601, batch_cost=0.4268, reader_cost=0.0002 | ETA 04:31:55 2020-11-14 01:05:08 [INFO] [TRAIN] epoch=3, iter=1780/40000, loss=0.4725, lr=0.009599, batch_cost=0.4254, reader_cost=0.0002 | ETA 04:30:59 2020-11-14 01:05:13 [INFO] [TRAIN] epoch=3, iter=1790/40000, loss=0.6214, lr=0.009597, batch_cost=0.4250, reader_cost=0.0002 | ETA 04:30:38 2020-11-14 01:05:17 [INFO] [TRAIN] epoch=3, iter=1800/40000, loss=0.8050, lr=0.009595, batch_cost=0.4253, reader_cost=0.0002 | ETA 04:30:47 2020-11-14 01:05:21 [INFO] [TRAIN] epoch=3, iter=1810/40000, loss=0.5996, lr=0.009592, batch_cost=0.4252, reader_cost=0.0002 | ETA 04:30:37 2020-11-14 01:05:26 [INFO] [TRAIN] epoch=3, iter=1820/40000, loss=0.4353, lr=0.009590, batch_cost=0.4270, reader_cost=0.0002 | ETA 04:31:42 2020-11-14 01:05:30 [INFO] [TRAIN] epoch=3, iter=1830/40000, loss=0.6215, lr=0.009588, batch_cost=0.4280, reader_cost=0.0002 | ETA 04:32:18 2020-11-14 01:05:34 [INFO] [TRAIN] epoch=3, iter=1840/40000, loss=0.6155, lr=0.009586, batch_cost=0.4431, reader_cost=0.0002 | ETA 04:41:48 2020-11-14 01:05:39 [INFO] [TRAIN] epoch=3, iter=1850/40000, loss=0.7360, lr=0.009583, batch_cost=0.4470, reader_cost=0.0002 | ETA 04:44:12 2020-11-14 01:05:43 [INFO] [TRAIN] epoch=3, iter=1860/40000, loss=0.6006, lr=0.009581, batch_cost=0.4670, reader_cost=0.0002 | ETA 04:56:49 2020-11-14 01:05:48 [INFO] [TRAIN] epoch=3, iter=1870/40000, loss=0.5059, lr=0.009579, batch_cost=0.4532, reader_cost=0.0002 | ETA 04:47:59 2020-11-14 01:05:53 [INFO] [TRAIN] epoch=3, iter=1880/40000, loss=0.6077, lr=0.009577, batch_cost=0.4631, reader_cost=0.0002 | ETA 04:54:13 2020-11-14 01:05:57 [INFO] [TRAIN] epoch=3, iter=1890/40000, loss=0.8204, lr=0.009574, batch_cost=0.4563, reader_cost=0.0002 | ETA 04:49:48 2020-11-14 01:06:02 [INFO] [TRAIN] epoch=3, iter=1900/40000, loss=0.8218, lr=0.009572, batch_cost=0.4540, reader_cost=0.0002 | ETA 04:48:17 2020-11-14 01:06:06 [INFO] [TRAIN] epoch=3, iter=1910/40000, loss=0.5951, lr=0.009570, batch_cost=0.4419, reader_cost=0.0002 | ETA 04:40:30 2020-11-14 01:06:10 [INFO] [TRAIN] epoch=3, iter=1920/40000, loss=0.5464, lr=0.009568, batch_cost=0.4403, reader_cost=0.0002 | ETA 04:39:25 2020-11-14 01:06:15 [INFO] [TRAIN] epoch=3, iter=1930/40000, loss=0.6908, lr=0.009565, batch_cost=0.4341, reader_cost=0.0002 | ETA 04:35:26 2020-11-14 01:06:19 [INFO] [TRAIN] epoch=3, iter=1940/40000, loss=0.7094, lr=0.009563, batch_cost=0.4259, reader_cost=0.0002 | ETA 04:30:09 2020-11-14 01:06:23 [INFO] [TRAIN] epoch=3, iter=1950/40000, loss=0.5053, lr=0.009561, batch_cost=0.4261, reader_cost=0.0002 | ETA 04:30:11 2020-11-14 01:06:28 [INFO] [TRAIN] epoch=3, iter=1960/40000, loss=0.5001, lr=0.009559, batch_cost=0.4691, reader_cost=0.0002 | ETA 04:57:23 2020-11-14 01:06:33 [INFO] [TRAIN] epoch=3, iter=1970/40000, loss=0.5551, lr=0.009556, batch_cost=0.5246, reader_cost=0.0002 | ETA 05:32:31 2020-11-14 01:06:38 [INFO] [TRAIN] epoch=3, iter=1980/40000, loss=0.6366, lr=0.009554, batch_cost=0.4580, reader_cost=0.0002 | ETA 04:50:11 2020-11-14 01:06:44 [INFO] [TRAIN] epoch=4, iter=1990/40000, loss=0.4903, lr=0.009552, batch_cost=0.6224, reader_cost=0.0848 | ETA 06:34:18 2020-11-14 01:06:49 [INFO] [TRAIN] epoch=4, iter=2000/40000, loss=0.6187, lr=0.009550, batch_cost=0.5103, reader_cost=0.0006 | ETA 05:23:13 2020-11-14 01:06:49 [INFO] Start evaluating (total_samples=1449, total_iters=363)... 2020-11-14 01:07:12 [INFO] [EVAL] #Images=1449 mIoU=0.6308 Acc=0.9122 Kappa=0.8074 2020-11-14 01:07:12 [INFO] [EVAL] Class IoU: [0.9114 0.8331 0.3108 0.8213 0.4799 0.5585 0.8419 0.7608 0.847 0.3133 0.6781 0.1595 0.7802 0.7543 0.5216 0.7848 0.4701 0.5717 0.4239 0.7746 0.651 ] 2020-11-14 01:07:12 [INFO] [EVAL] Class Acc: [0.9528 0.914 0.3202 0.9209 0.4945 0.9224 0.9725 0.835 0.9419 0.4707 0.7467 0.7361 0.8361 0.821 0.9565 0.859 0.5562 0.9209 0.6108 0.8849 0.7582] 2020-11-14 01:07:21 [INFO] [EVAL] The model with the best validation mIoU (0.6308) was saved at iter 2000. 2020-11-14 01:07:26 [INFO] [TRAIN] epoch=4, iter=2010/40000, loss=0.6810, lr=0.009547, batch_cost=0.4494, reader_cost=0.0005 | ETA 04:44:30 2020-11-14 01:07:30 [INFO] [TRAIN] epoch=4, iter=2020/40000, loss=0.5456, lr=0.009545, batch_cost=0.4466, reader_cost=0.0005 | ETA 04:42:41 2020-11-14 01:07:35 [INFO] [TRAIN] epoch=4, iter=2030/40000, loss=0.5912, lr=0.009543, batch_cost=0.4543, reader_cost=0.0005 | ETA 04:47:28 2020-11-14 01:07:39 [INFO] [TRAIN] epoch=4, iter=2040/40000, loss=0.7379, lr=0.009540, batch_cost=0.4860, reader_cost=0.0005 | ETA 05:07:28 2020-11-14 01:07:44 [INFO] [TRAIN] epoch=4, iter=2050/40000, loss=0.5854, lr=0.009538, batch_cost=0.4677, reader_cost=0.0002 | ETA 04:55:48 2020-11-14 01:07:49 [INFO] [TRAIN] epoch=4, iter=2060/40000, loss=0.4660, lr=0.009536, batch_cost=0.4584, reader_cost=0.0002 | ETA 04:49:52 2020-11-14 01:07:54 [INFO] [TRAIN] epoch=4, iter=2070/40000, loss=0.5046, lr=0.009534, batch_cost=0.5252, reader_cost=0.0002 | ETA 05:32:00 2020-11-14 01:07:59 [INFO] [TRAIN] epoch=4, iter=2080/40000, loss=0.5188, lr=0.009531, batch_cost=0.5027, reader_cost=0.0002 | ETA 05:17:42 2020-11-14 01:08:04 [INFO] [TRAIN] epoch=4, iter=2090/40000, loss=0.6184, lr=0.009529, batch_cost=0.4704, reader_cost=0.0021 | ETA 04:57:14 2020-11-14 01:08:08 [INFO] [TRAIN] epoch=4, iter=2100/40000, loss=0.5943, lr=0.009527, batch_cost=0.4348, reader_cost=0.0002 | ETA 04:34:39 2020-11-14 01:08:12 [INFO] [TRAIN] epoch=4, iter=2110/40000, loss=1.2569, lr=0.009525, batch_cost=0.4402, reader_cost=0.0002 | ETA 04:38:00 2020-11-14 01:08:17 [INFO] [TRAIN] epoch=4, iter=2120/40000, loss=0.7057, lr=0.009522, batch_cost=0.4399, reader_cost=0.0005 | ETA 04:37:43 2020-11-14 01:08:21 [INFO] [TRAIN] epoch=4, iter=2130/40000, loss=0.6242, lr=0.009520, batch_cost=0.4288, reader_cost=0.0002 | ETA 04:30:37 2020-11-14 01:08:25 [INFO] [TRAIN] epoch=4, iter=2140/40000, loss=0.4763, lr=0.009518, batch_cost=0.4255, reader_cost=0.0002 | ETA 04:28:29 2020-11-14 01:08:30 [INFO] [TRAIN] epoch=4, iter=2150/40000, loss=0.5168, lr=0.009516, batch_cost=0.4271, reader_cost=0.0002 | ETA 04:29:25 2020-11-14 01:08:34 [INFO] [TRAIN] epoch=4, iter=2160/40000, loss=1.2227, lr=0.009513, batch_cost=0.4262, reader_cost=0.0002 | ETA 04:28:48 2020-11-14 01:08:38 [INFO] [TRAIN] epoch=4, iter=2170/40000, loss=0.6055, lr=0.009511, batch_cost=0.4271, reader_cost=0.0002 | ETA 04:29:17 2020-11-14 01:08:42 [INFO] [TRAIN] epoch=4, iter=2180/40000, loss=0.7814, lr=0.009509, batch_cost=0.4266, reader_cost=0.0002 | ETA 04:28:55 2020-11-14 01:08:47 [INFO] [TRAIN] epoch=4, iter=2190/40000, loss=0.6112, lr=0.009507, batch_cost=0.4264, reader_cost=0.0002 | ETA 04:28:40 2020-11-14 01:08:51 [INFO] [TRAIN] epoch=4, iter=2200/40000, loss=0.6875, lr=0.009504, batch_cost=0.4278, reader_cost=0.0002 | ETA 04:29:31 2020-11-14 01:08:55 [INFO] [TRAIN] epoch=4, iter=2210/40000, loss=0.6844, lr=0.009502, batch_cost=0.4257, reader_cost=0.0002 | ETA 04:28:06 2020-11-14 01:09:00 [INFO] [TRAIN] epoch=4, iter=2220/40000, loss=0.8142, lr=0.009500, batch_cost=0.4255, reader_cost=0.0002 | ETA 04:27:55 2020-11-14 01:09:04 [INFO] [TRAIN] epoch=4, iter=2230/40000, loss=0.6965, lr=0.009498, batch_cost=0.4262, reader_cost=0.0002 | ETA 04:28:19 2020-11-14 01:09:08 [INFO] [TRAIN] epoch=4, iter=2240/40000, loss=0.7241, lr=0.009495, batch_cost=0.4268, reader_cost=0.0002 | ETA 04:28:36 2020-11-14 01:09:12 [INFO] [TRAIN] epoch=4, iter=2250/40000, loss=0.4799, lr=0.009493, batch_cost=0.4267, reader_cost=0.0002 | ETA 04:28:28 2020-11-14 01:09:17 [INFO] [TRAIN] epoch=4, iter=2260/40000, loss=0.5741, lr=0.009491, batch_cost=0.4280, reader_cost=0.0002 | ETA 04:29:11 2020-11-14 01:09:21 [INFO] [TRAIN] epoch=4, iter=2270/40000, loss=0.4762, lr=0.009489, batch_cost=0.4269, reader_cost=0.0002 | ETA 04:28:27 2020-11-14 01:09:25 [INFO] [TRAIN] epoch=4, iter=2280/40000, loss=0.7171, lr=0.009486, batch_cost=0.4460, reader_cost=0.0002 | ETA 04:40:22 2020-11-14 01:09:30 [INFO] [TRAIN] epoch=4, iter=2290/40000, loss=0.8579, lr=0.009484, batch_cost=0.4523, reader_cost=0.0002 | ETA 04:44:15 2020-11-14 01:09:34 [INFO] [TRAIN] epoch=4, iter=2300/40000, loss=0.7239, lr=0.009482, batch_cost=0.4257, reader_cost=0.0002 | ETA 04:27:27 2020-11-14 01:09:38 [INFO] [TRAIN] epoch=4, iter=2310/40000, loss=0.5486, lr=0.009479, batch_cost=0.4264, reader_cost=0.0002 | ETA 04:27:49 2020-11-14 01:09:43 [INFO] [TRAIN] epoch=4, iter=2320/40000, loss=0.7171, lr=0.009477, batch_cost=0.4262, reader_cost=0.0002 | ETA 04:27:40 2020-11-14 01:09:47 [INFO] [TRAIN] epoch=4, iter=2330/40000, loss=0.7260, lr=0.009475, batch_cost=0.4262, reader_cost=0.0002 | ETA 04:27:35 2020-11-14 01:09:51 [INFO] [TRAIN] epoch=4, iter=2340/40000, loss=0.4840, lr=0.009473, batch_cost=0.4268, reader_cost=0.0002 | ETA 04:27:53 2020-11-14 01:09:55 [INFO] [TRAIN] epoch=4, iter=2350/40000, loss=0.5376, lr=0.009470, batch_cost=0.4267, reader_cost=0.0002 | ETA 04:27:44 2020-11-14 01:10:00 [INFO] [TRAIN] epoch=4, iter=2360/40000, loss=0.6000, lr=0.009468, batch_cost=0.4260, reader_cost=0.0002 | ETA 04:27:14 2020-11-14 01:10:04 [INFO] [TRAIN] epoch=4, iter=2370/40000, loss=0.3344, lr=0.009466, batch_cost=0.4264, reader_cost=0.0002 | ETA 04:27:25 2020-11-14 01:10:08 [INFO] [TRAIN] epoch=4, iter=2380/40000, loss=0.6116, lr=0.009464, batch_cost=0.4280, reader_cost=0.0002 | ETA 04:28:21 2020-11-14 01:10:12 [INFO] [TRAIN] epoch=4, iter=2390/40000, loss=0.6480, lr=0.009461, batch_cost=0.4256, reader_cost=0.0002 | ETA 04:26:44 2020-11-14 01:10:17 [INFO] [TRAIN] epoch=4, iter=2400/40000, loss=0.8250, lr=0.009459, batch_cost=0.4264, reader_cost=0.0002 | ETA 04:27:11 2020-11-14 01:10:21 [INFO] [TRAIN] epoch=4, iter=2410/40000, loss=0.6868, lr=0.009457, batch_cost=0.4262, reader_cost=0.0002 | ETA 04:27:00 2020-11-14 01:10:25 [INFO] [TRAIN] epoch=4, iter=2420/40000, loss=0.7588, lr=0.009455, batch_cost=0.4266, reader_cost=0.0002 | ETA 04:27:09 2020-11-14 01:10:30 [INFO] [TRAIN] epoch=4, iter=2430/40000, loss=0.5711, lr=0.009452, batch_cost=0.4260, reader_cost=0.0002 | ETA 04:26:43 2020-11-14 01:10:34 [INFO] [TRAIN] epoch=4, iter=2440/40000, loss=0.5615, lr=0.009450, batch_cost=0.4261, reader_cost=0.0002 | ETA 04:26:45 2020-11-14 01:10:38 [INFO] [TRAIN] epoch=4, iter=2450/40000, loss=0.8308, lr=0.009448, batch_cost=0.4253, reader_cost=0.0002 | ETA 04:26:11 2020-11-14 01:10:43 [INFO] [TRAIN] epoch=4, iter=2460/40000, loss=0.5048, lr=0.009446, batch_cost=0.4488, reader_cost=0.0002 | ETA 04:40:48 2020-11-14 01:10:47 [INFO] [TRAIN] epoch=4, iter=2470/40000, loss=0.5722, lr=0.009443, batch_cost=0.4475, reader_cost=0.0002 | ETA 04:39:53 2020-11-14 01:10:52 [INFO] [TRAIN] epoch=4, iter=2480/40000, loss=0.6833, lr=0.009441, batch_cost=0.4563, reader_cost=0.0002 | ETA 04:45:21 2020-11-14 01:10:56 [INFO] [TRAIN] epoch=4, iter=2490/40000, loss=0.7938, lr=0.009439, batch_cost=0.4372, reader_cost=0.0002 | ETA 04:33:21 2020-11-14 01:11:00 [INFO] [TRAIN] epoch=4, iter=2500/40000, loss=0.5890, lr=0.009436, batch_cost=0.4292, reader_cost=0.0001 | ETA 04:28:15 2020-11-14 01:11:05 [INFO] [TRAIN] epoch=4, iter=2510/40000, loss=0.6193, lr=0.009434, batch_cost=0.4324, reader_cost=0.0002 | ETA 04:30:09 2020-11-14 01:11:09 [INFO] [TRAIN] epoch=4, iter=2520/40000, loss=0.4158, lr=0.009432, batch_cost=0.4415, reader_cost=0.0002 | ETA 04:35:47 2020-11-14 01:11:13 [INFO] [TRAIN] epoch=4, iter=2530/40000, loss=0.3639, lr=0.009430, batch_cost=0.4307, reader_cost=0.0002 | ETA 04:28:59 2020-11-14 01:11:18 [INFO] [TRAIN] epoch=4, iter=2540/40000, loss=0.8090, lr=0.009427, batch_cost=0.4335, reader_cost=0.0002 | ETA 04:30:38 2020-11-14 01:11:22 [INFO] [TRAIN] epoch=4, iter=2550/40000, loss=0.4816, lr=0.009425, batch_cost=0.4538, reader_cost=0.0002 | ETA 04:43:14 2020-11-14 01:11:27 [INFO] [TRAIN] epoch=4, iter=2560/40000, loss=0.4516, lr=0.009423, batch_cost=0.4399, reader_cost=0.0002 | ETA 04:34:31 2020-11-14 01:11:32 [INFO] [TRAIN] epoch=4, iter=2570/40000, loss=0.7409, lr=0.009421, batch_cost=0.4971, reader_cost=0.0002 | ETA 05:10:04 2020-11-14 01:11:36 [INFO] [TRAIN] epoch=4, iter=2580/40000, loss=0.5312, lr=0.009418, batch_cost=0.4724, reader_cost=0.0002 | ETA 04:54:38 2020-11-14 01:11:41 [INFO] [TRAIN] epoch=4, iter=2590/40000, loss=0.5863, lr=0.009416, batch_cost=0.4598, reader_cost=0.0002 | ETA 04:46:41 2020-11-14 01:11:46 [INFO] [TRAIN] epoch=4, iter=2600/40000, loss=0.5891, lr=0.009414, batch_cost=0.4666, reader_cost=0.0002 | ETA 04:50:51 2020-11-14 01:11:50 [INFO] [TRAIN] epoch=4, iter=2610/40000, loss=0.5894, lr=0.009412, batch_cost=0.4483, reader_cost=0.0002 | ETA 04:39:22 2020-11-14 01:11:54 [INFO] [TRAIN] epoch=4, iter=2620/40000, loss=0.5855, lr=0.009409, batch_cost=0.4450, reader_cost=0.0002 | ETA 04:37:12 2020-11-14 01:11:59 [INFO] [TRAIN] epoch=4, iter=2630/40000, loss=0.6198, lr=0.009407, batch_cost=0.4396, reader_cost=0.0002 | ETA 04:33:48 2020-11-14 01:12:03 [INFO] [TRAIN] epoch=4, iter=2640/40000, loss=0.4983, lr=0.009405, batch_cost=0.4334, reader_cost=0.0004 | ETA 04:29:52 2020-11-14 01:12:09 [INFO] [TRAIN] epoch=5, iter=2650/40000, loss=0.4734, lr=0.009403, batch_cost=0.5678, reader_cost=0.0892 | ETA 05:53:25 2020-11-14 01:12:13 [INFO] [TRAIN] epoch=5, iter=2660/40000, loss=0.6831, lr=0.009400, batch_cost=0.4388, reader_cost=0.0005 | ETA 04:33:04 2020-11-14 01:12:18 [INFO] [TRAIN] epoch=5, iter=2670/40000, loss=0.6487, lr=0.009398, batch_cost=0.4418, reader_cost=0.0002 | ETA 04:34:51 2020-11-14 01:12:22 [INFO] [TRAIN] epoch=5, iter=2680/40000, loss=0.5044, lr=0.009396, batch_cost=0.4365, reader_cost=0.0002 | ETA 04:31:31 2020-11-14 01:12:26 [INFO] [TRAIN] epoch=5, iter=2690/40000, loss=0.5994, lr=0.009393, batch_cost=0.4361, reader_cost=0.0002 | ETA 04:31:10 2020-11-14 01:12:31 [INFO] [TRAIN] epoch=5, iter=2700/40000, loss=0.4645, lr=0.009391, batch_cost=0.4349, reader_cost=0.0002 | ETA 04:30:21 2020-11-14 01:12:35 [INFO] [TRAIN] epoch=5, iter=2710/40000, loss=0.6613, lr=0.009389, batch_cost=0.4373, reader_cost=0.0002 | ETA 04:31:47 2020-11-14 01:12:40 [INFO] [TRAIN] epoch=5, iter=2720/40000, loss=0.6808, lr=0.009387, batch_cost=0.4492, reader_cost=0.0002 | ETA 04:39:05 2020-11-14 01:12:44 [INFO] [TRAIN] epoch=5, iter=2730/40000, loss=0.4977, lr=0.009384, batch_cost=0.4374, reader_cost=0.0002 | ETA 04:31:42 2020-11-14 01:12:48 [INFO] [TRAIN] epoch=5, iter=2740/40000, loss=0.5123, lr=0.009382, batch_cost=0.4371, reader_cost=0.0002 | ETA 04:31:25 2020-11-14 01:12:53 [INFO] [TRAIN] epoch=5, iter=2750/40000, loss=0.8073, lr=0.009380, batch_cost=0.4386, reader_cost=0.0002 | ETA 04:32:17 2020-11-14 01:12:57 [INFO] [TRAIN] epoch=5, iter=2760/40000, loss=0.6555, lr=0.009378, batch_cost=0.4316, reader_cost=0.0002 | ETA 04:27:52 2020-11-14 01:13:01 [INFO] [TRAIN] epoch=5, iter=2770/40000, loss=0.5102, lr=0.009375, batch_cost=0.4340, reader_cost=0.0002 | ETA 04:29:18 2020-11-14 01:13:06 [INFO] [TRAIN] epoch=5, iter=2780/40000, loss=0.6481, lr=0.009373, batch_cost=0.4397, reader_cost=0.0002 | ETA 04:32:46 2020-11-14 01:13:10 [INFO] [TRAIN] epoch=5, iter=2790/40000, loss=0.5548, lr=0.009371, batch_cost=0.4365, reader_cost=0.0002 | ETA 04:30:43 2020-11-14 01:13:15 [INFO] [TRAIN] epoch=5, iter=2800/40000, loss=0.5549, lr=0.009369, batch_cost=0.4401, reader_cost=0.0002 | ETA 04:32:52 2020-11-14 01:13:19 [INFO] [TRAIN] epoch=5, iter=2810/40000, loss=0.6623, lr=0.009366, batch_cost=0.4435, reader_cost=0.0002 | ETA 04:34:54 2020-11-14 01:13:23 [INFO] [TRAIN] epoch=5, iter=2820/40000, loss=0.6535, lr=0.009364, batch_cost=0.4409, reader_cost=0.0002 | ETA 04:33:11 2020-11-14 01:13:28 [INFO] [TRAIN] epoch=5, iter=2830/40000, loss=0.4995, lr=0.009362, batch_cost=0.4419, reader_cost=0.0002 | ETA 04:33:43 2020-11-14 01:13:32 [INFO] [TRAIN] epoch=5, iter=2840/40000, loss=0.7256, lr=0.009360, batch_cost=0.4391, reader_cost=0.0002 | ETA 04:31:55 2020-11-14 01:13:37 [INFO] [TRAIN] epoch=5, iter=2850/40000, loss=0.5476, lr=0.009357, batch_cost=0.4377, reader_cost=0.0002 | ETA 04:31:02 2020-11-14 01:13:41 [INFO] [TRAIN] epoch=5, iter=2860/40000, loss=0.7868, lr=0.009355, batch_cost=0.4542, reader_cost=0.0012 | ETA 04:41:07 2020-11-14 01:13:46 [INFO] [TRAIN] epoch=5, iter=2870/40000, loss=0.5396, lr=0.009353, batch_cost=0.4569, reader_cost=0.0022 | ETA 04:42:43 2020-11-14 01:13:50 [INFO] [TRAIN] epoch=5, iter=2880/40000, loss=0.7615, lr=0.009350, batch_cost=0.4608, reader_cost=0.0005 | ETA 04:45:04 2020-11-14 01:13:55 [INFO] [TRAIN] epoch=5, iter=2890/40000, loss=0.5659, lr=0.009348, batch_cost=0.4769, reader_cost=0.0002 | ETA 04:54:56 2020-11-14 01:14:00 [INFO] [TRAIN] epoch=5, iter=2900/40000, loss=0.5312, lr=0.009346, batch_cost=0.4733, reader_cost=0.0002 | ETA 04:52:38 2020-11-14 01:14:04 [INFO] [TRAIN] epoch=5, iter=2910/40000, loss=0.4477, lr=0.009344, batch_cost=0.4635, reader_cost=0.0002 | ETA 04:46:31 2020-11-14 01:14:09 [INFO] [TRAIN] epoch=5, iter=2920/40000, loss=0.7441, lr=0.009341, batch_cost=0.4462, reader_cost=0.0015 | ETA 04:35:45 2020-11-14 01:14:13 [INFO] [TRAIN] epoch=5, iter=2930/40000, loss=0.4294, lr=0.009339, batch_cost=0.4440, reader_cost=0.0002 | ETA 04:34:19 2020-11-14 01:14:18 [INFO] [TRAIN] epoch=5, iter=2940/40000, loss=0.6316, lr=0.009337, batch_cost=0.4406, reader_cost=0.0002 | ETA 04:32:08 2020-11-14 01:14:22 [INFO] [TRAIN] epoch=5, iter=2950/40000, loss=0.5158, lr=0.009335, batch_cost=0.4476, reader_cost=0.0002 | ETA 04:36:24 2020-11-14 01:14:27 [INFO] [TRAIN] epoch=5, iter=2960/40000, loss=0.5478, lr=0.009332, batch_cost=0.4476, reader_cost=0.0002 | ETA 04:36:18 2020-11-14 01:14:31 [INFO] [TRAIN] epoch=5, iter=2970/40000, loss=0.3756, lr=0.009330, batch_cost=0.4480, reader_cost=0.0002 | ETA 04:36:29 2020-11-14 01:14:36 [INFO] [TRAIN] epoch=5, iter=2980/40000, loss=0.5771, lr=0.009328, batch_cost=0.4489, reader_cost=0.0002 | ETA 04:36:57 2020-11-14 01:14:41 [INFO] [TRAIN] epoch=5, iter=2990/40000, loss=0.5941, lr=0.009326, batch_cost=0.4853, reader_cost=0.0002 | ETA 04:59:19 2020-11-14 01:14:49 [INFO] [TRAIN] epoch=5, iter=3000/40000, loss=0.6590, lr=0.009323, batch_cost=0.8386, reader_cost=0.0002 | ETA 08:37:07 2020-11-14 01:14:55 [INFO] [TRAIN] epoch=5, iter=3010/40000, loss=0.6686, lr=0.009321, batch_cost=0.5655, reader_cost=0.0002 | ETA 05:48:38 2020-11-14 01:14:59 [INFO] [TRAIN] epoch=5, iter=3020/40000, loss=0.9387, lr=0.009319, batch_cost=0.4488, reader_cost=0.0002 | ETA 04:36:38 2020-11-14 01:15:04 [INFO] [TRAIN] epoch=5, iter=3030/40000, loss=0.5687, lr=0.009317, batch_cost=0.4430, reader_cost=0.0002 | ETA 04:32:57 2020-11-14 01:15:08 [INFO] [TRAIN] epoch=5, iter=3040/40000, loss=0.8300, lr=0.009314, batch_cost=0.4614, reader_cost=0.0002 | ETA 04:44:12 2020-11-14 01:15:13 [INFO] [TRAIN] epoch=5, iter=3050/40000, loss=0.6886, lr=0.009312, batch_cost=0.4975, reader_cost=0.0002 | ETA 05:06:23 2020-11-14 01:15:18 [INFO] [TRAIN] epoch=5, iter=3060/40000, loss=0.4574, lr=0.009310, batch_cost=0.4511, reader_cost=0.0002 | ETA 04:37:45 2020-11-14 01:15:22 [INFO] [TRAIN] epoch=5, iter=3070/40000, loss=0.7384, lr=0.009307, batch_cost=0.4386, reader_cost=0.0002 | ETA 04:29:57 2020-11-14 01:15:26 [INFO] [TRAIN] epoch=5, iter=3080/40000, loss=0.7060, lr=0.009305, batch_cost=0.4392, reader_cost=0.0003 | ETA 04:30:15 2020-11-14 01:15:31 [INFO] [TRAIN] epoch=5, iter=3090/40000, loss=0.5698, lr=0.009303, batch_cost=0.4362, reader_cost=0.0002 | ETA 04:28:18 2020-11-14 01:15:35 [INFO] [TRAIN] epoch=5, iter=3100/40000, loss=0.8303, lr=0.009301, batch_cost=0.4349, reader_cost=0.0002 | ETA 04:27:27 2020-11-14 01:15:39 [INFO] [TRAIN] epoch=5, iter=3110/40000, loss=0.6884, lr=0.009298, batch_cost=0.4311, reader_cost=0.0002 | ETA 04:25:04 2020-11-14 01:15:44 [INFO] [TRAIN] epoch=5, iter=3120/40000, loss=0.8050, lr=0.009296, batch_cost=0.4428, reader_cost=0.0002 | ETA 04:32:09 2020-11-14 01:15:49 [INFO] [TRAIN] epoch=5, iter=3130/40000, loss=0.4773, lr=0.009294, batch_cost=0.4790, reader_cost=0.0002 | ETA 04:54:20 2020-11-14 01:15:54 [INFO] [TRAIN] epoch=5, iter=3140/40000, loss=0.4845, lr=0.009292, batch_cost=0.4872, reader_cost=0.0015 | ETA 04:59:19 2020-11-14 01:15:58 [INFO] [TRAIN] epoch=5, iter=3150/40000, loss=0.7688, lr=0.009289, batch_cost=0.4760, reader_cost=0.0036 | ETA 04:52:22 2020-11-14 01:16:03 [INFO] [TRAIN] epoch=5, iter=3160/40000, loss=0.5486, lr=0.009287, batch_cost=0.4832, reader_cost=0.0015 | ETA 04:56:39 2020-11-14 01:16:08 [INFO] [TRAIN] epoch=5, iter=3170/40000, loss=0.5468, lr=0.009285, batch_cost=0.4949, reader_cost=0.0005 | ETA 05:03:46 2020-11-14 01:16:13 [INFO] [TRAIN] epoch=5, iter=3180/40000, loss=0.6279, lr=0.009283, batch_cost=0.4449, reader_cost=0.0002 | ETA 04:33:01 2020-11-14 01:16:17 [INFO] [TRAIN] epoch=5, iter=3190/40000, loss=0.5415, lr=0.009280, batch_cost=0.4254, reader_cost=0.0002 | ETA 04:20:59 2020-11-14 01:16:21 [INFO] [TRAIN] epoch=5, iter=3200/40000, loss=0.5711, lr=0.009278, batch_cost=0.4256, reader_cost=0.0002 | ETA 04:21:03 2020-11-14 01:16:26 [INFO] [TRAIN] epoch=5, iter=3210/40000, loss=0.4104, lr=0.009276, batch_cost=0.4761, reader_cost=0.0016 | ETA 04:51:57 2020-11-14 01:16:30 [INFO] [TRAIN] epoch=5, iter=3220/40000, loss=0.5506, lr=0.009273, batch_cost=0.4402, reader_cost=0.0003 | ETA 04:29:49 2020-11-14 01:16:35 [INFO] [TRAIN] epoch=5, iter=3230/40000, loss=0.3869, lr=0.009271, batch_cost=0.4373, reader_cost=0.0002 | ETA 04:28:00 2020-11-14 01:16:39 [INFO] [TRAIN] epoch=5, iter=3240/40000, loss=0.5562, lr=0.009269, batch_cost=0.4300, reader_cost=0.0002 | ETA 04:23:25 2020-11-14 01:16:43 [INFO] [TRAIN] epoch=5, iter=3250/40000, loss=0.4540, lr=0.009267, batch_cost=0.4317, reader_cost=0.0002 | ETA 04:24:23 2020-11-14 01:16:48 [INFO] [TRAIN] epoch=5, iter=3260/40000, loss=0.6068, lr=0.009264, batch_cost=0.4292, reader_cost=0.0002 | ETA 04:22:49 2020-11-14 01:16:52 [INFO] [TRAIN] epoch=5, iter=3270/40000, loss=0.5500, lr=0.009262, batch_cost=0.4726, reader_cost=0.0005 | ETA 04:49:20 2020-11-14 01:16:57 [INFO] [TRAIN] epoch=5, iter=3280/40000, loss=0.4499, lr=0.009260, batch_cost=0.4475, reader_cost=0.0003 | ETA 04:33:51 2020-11-14 01:17:01 [INFO] [TRAIN] epoch=5, iter=3290/40000, loss=0.4994, lr=0.009258, batch_cost=0.4416, reader_cost=0.0002 | ETA 04:30:10 2020-11-14 01:17:06 [INFO] [TRAIN] epoch=5, iter=3300/40000, loss=0.5548, lr=0.009255, batch_cost=0.4517, reader_cost=0.0002 | ETA 04:36:15 2020-11-14 01:17:11 [INFO] [TRAIN] epoch=6, iter=3310/40000, loss=0.3675, lr=0.009253, batch_cost=0.5500, reader_cost=0.0988 | ETA 05:36:21 2020-11-14 01:17:16 [INFO] [TRAIN] epoch=6, iter=3320/40000, loss=0.5410, lr=0.009251, batch_cost=0.4349, reader_cost=0.0005 | ETA 04:25:50 2020-11-14 01:17:20 [INFO] [TRAIN] epoch=6, iter=3330/40000, loss=0.5583, lr=0.009249, batch_cost=0.4354, reader_cost=0.0002 | ETA 04:26:06 2020-11-14 01:17:24 [INFO] [TRAIN] epoch=6, iter=3340/40000, loss=0.4324, lr=0.009246, batch_cost=0.4375, reader_cost=0.0002 | ETA 04:27:19 2020-11-14 01:17:29 [INFO] [TRAIN] epoch=6, iter=3350/40000, loss=0.4707, lr=0.009244, batch_cost=0.4322, reader_cost=0.0002 | ETA 04:23:59 2020-11-14 01:17:33 [INFO] [TRAIN] epoch=6, iter=3360/40000, loss=0.7616, lr=0.009242, batch_cost=0.4336, reader_cost=0.0002 | ETA 04:24:47 2020-11-14 01:17:37 [INFO] [TRAIN] epoch=6, iter=3370/40000, loss=0.4069, lr=0.009239, batch_cost=0.4450, reader_cost=0.0002 | ETA 04:31:42 2020-11-14 01:17:42 [INFO] [TRAIN] epoch=6, iter=3380/40000, loss=0.5858, lr=0.009237, batch_cost=0.4875, reader_cost=0.0002 | ETA 04:57:32 2020-11-14 01:17:47 [INFO] [TRAIN] epoch=6, iter=3390/40000, loss=0.4043, lr=0.009235, batch_cost=0.4877, reader_cost=0.0002 | ETA 04:57:35 2020-11-14 01:17:52 [INFO] [TRAIN] epoch=6, iter=3400/40000, loss=0.5704, lr=0.009233, batch_cost=0.4674, reader_cost=0.0002 | ETA 04:45:07 2020-11-14 01:17:57 [INFO] [TRAIN] epoch=6, iter=3410/40000, loss=0.4783, lr=0.009230, batch_cost=0.4872, reader_cost=0.0002 | ETA 04:57:06 2020-11-14 01:18:01 [INFO] [TRAIN] epoch=6, iter=3420/40000, loss=0.8015, lr=0.009228, batch_cost=0.4730, reader_cost=0.0002 | ETA 04:48:23 2020-11-14 01:18:06 [INFO] [TRAIN] epoch=6, iter=3430/40000, loss=0.4155, lr=0.009226, batch_cost=0.4875, reader_cost=0.0002 | ETA 04:57:07 2020-11-14 01:18:11 [INFO] [TRAIN] epoch=6, iter=3440/40000, loss=0.6837, lr=0.009224, batch_cost=0.4552, reader_cost=0.0002 | ETA 04:37:23 2020-11-14 01:18:15 [INFO] [TRAIN] epoch=6, iter=3450/40000, loss=0.4732, lr=0.009221, batch_cost=0.4622, reader_cost=0.0002 | ETA 04:41:34 2020-11-14 01:18:20 [INFO] [TRAIN] epoch=6, iter=3460/40000, loss=0.5510, lr=0.009219, batch_cost=0.4610, reader_cost=0.0002 | ETA 04:40:46 2020-11-14 01:18:25 [INFO] [TRAIN] epoch=6, iter=3470/40000, loss=0.4974, lr=0.009217, batch_cost=0.4726, reader_cost=0.0002 | ETA 04:47:42 2020-11-14 01:18:29 [INFO] [TRAIN] epoch=6, iter=3480/40000, loss=0.4127, lr=0.009214, batch_cost=0.4592, reader_cost=0.0002 | ETA 04:39:28 2020-11-14 01:18:34 [INFO] [TRAIN] epoch=6, iter=3490/40000, loss=0.4162, lr=0.009212, batch_cost=0.4781, reader_cost=0.0002 | ETA 04:50:54 2020-11-14 01:18:39 [INFO] [TRAIN] epoch=6, iter=3500/40000, loss=0.8230, lr=0.009210, batch_cost=0.4797, reader_cost=0.0003 | ETA 04:51:48 2020-11-14 01:18:44 [INFO] [TRAIN] epoch=6, iter=3510/40000, loss=0.5231, lr=0.009208, batch_cost=0.4777, reader_cost=0.0002 | ETA 04:50:30 2020-11-14 01:18:49 [INFO] [TRAIN] epoch=6, iter=3520/40000, loss=0.3434, lr=0.009205, batch_cost=0.4913, reader_cost=0.0050 | ETA 04:58:43 2020-11-14 01:18:54 [INFO] [TRAIN] epoch=6, iter=3530/40000, loss=0.3920, lr=0.009203, batch_cost=0.4968, reader_cost=0.0067 | ETA 05:01:59 2020-11-14 01:18:58 [INFO] [TRAIN] epoch=6, iter=3540/40000, loss=0.6876, lr=0.009201, batch_cost=0.4500, reader_cost=0.0002 | ETA 04:33:27 2020-11-14 01:19:03 [INFO] [TRAIN] epoch=6, iter=3550/40000, loss=0.4361, lr=0.009199, batch_cost=0.4705, reader_cost=0.0003 | ETA 04:45:48 2020-11-14 01:19:08 [INFO] [TRAIN] epoch=6, iter=3560/40000, loss=0.5735, lr=0.009196, batch_cost=0.4753, reader_cost=0.0092 | ETA 04:48:38 2020-11-14 01:19:12 [INFO] [TRAIN] epoch=6, iter=3570/40000, loss=0.5414, lr=0.009194, batch_cost=0.4744, reader_cost=0.0081 | ETA 04:48:03 2020-11-14 01:19:17 [INFO] [TRAIN] epoch=6, iter=3580/40000, loss=0.5073, lr=0.009192, batch_cost=0.4656, reader_cost=0.0002 | ETA 04:42:36 2020-11-14 01:19:22 [INFO] [TRAIN] epoch=6, iter=3590/40000, loss=0.4242, lr=0.009190, batch_cost=0.4730, reader_cost=0.0002 | ETA 04:47:01 2020-11-14 01:19:27 [INFO] [TRAIN] epoch=6, iter=3600/40000, loss=0.7843, lr=0.009187, batch_cost=0.5077, reader_cost=0.0002 | ETA 05:08:01 2020-11-14 01:19:31 [INFO] [TRAIN] epoch=6, iter=3610/40000, loss=0.7208, lr=0.009185, batch_cost=0.4659, reader_cost=0.0002 | ETA 04:42:35 2020-11-14 01:19:36 [INFO] [TRAIN] epoch=6, iter=3620/40000, loss=0.5098, lr=0.009183, batch_cost=0.4583, reader_cost=0.0002 | ETA 04:37:52 2020-11-14 01:19:41 [INFO] [TRAIN] epoch=6, iter=3630/40000, loss=0.6209, lr=0.009180, batch_cost=0.4526, reader_cost=0.0002 | ETA 04:34:20 2020-11-14 01:19:45 [INFO] [TRAIN] epoch=6, iter=3640/40000, loss=0.4150, lr=0.009178, batch_cost=0.4871, reader_cost=0.0002 | ETA 04:55:11 2020-11-14 01:19:50 [INFO] [TRAIN] epoch=6, iter=3650/40000, loss=0.4091, lr=0.009176, batch_cost=0.4445, reader_cost=0.0002 | ETA 04:29:15 2020-11-14 01:19:54 [INFO] [TRAIN] epoch=6, iter=3660/40000, loss=0.6616, lr=0.009174, batch_cost=0.4394, reader_cost=0.0002 | ETA 04:26:07 2020-11-14 01:19:59 [INFO] [TRAIN] epoch=6, iter=3670/40000, loss=0.4877, lr=0.009171, batch_cost=0.4363, reader_cost=0.0002 | ETA 04:24:09 2020-11-14 01:20:03 [INFO] [TRAIN] epoch=6, iter=3680/40000, loss=0.5563, lr=0.009169, batch_cost=0.4334, reader_cost=0.0002 | ETA 04:22:20 2020-11-14 01:20:08 [INFO] [TRAIN] epoch=6, iter=3690/40000, loss=0.5134, lr=0.009167, batch_cost=0.4515, reader_cost=0.0002 | ETA 04:33:12 2020-11-14 01:20:12 [INFO] [TRAIN] epoch=6, iter=3700/40000, loss=0.4432, lr=0.009165, batch_cost=0.4531, reader_cost=0.0003 | ETA 04:34:06 2020-11-14 01:20:17 [INFO] [TRAIN] epoch=6, iter=3710/40000, loss=0.3959, lr=0.009162, batch_cost=0.4678, reader_cost=0.0002 | ETA 04:42:54 2020-11-14 01:20:21 [INFO] [TRAIN] epoch=6, iter=3720/40000, loss=0.5101, lr=0.009160, batch_cost=0.4714, reader_cost=0.0002 | ETA 04:45:02 2020-11-14 01:20:27 [INFO] [TRAIN] epoch=6, iter=3730/40000, loss=0.4728, lr=0.009158, batch_cost=0.5099, reader_cost=0.0019 | ETA 05:08:13 2020-11-14 01:20:31 [INFO] [TRAIN] epoch=6, iter=3740/40000, loss=0.5805, lr=0.009155, batch_cost=0.4635, reader_cost=0.0002 | ETA 04:40:08 2020-11-14 01:20:36 [INFO] [TRAIN] epoch=6, iter=3750/40000, loss=0.5789, lr=0.009153, batch_cost=0.4789, reader_cost=0.0002 | ETA 04:49:18 2020-11-14 01:20:41 [INFO] [TRAIN] epoch=6, iter=3760/40000, loss=0.6670, lr=0.009151, batch_cost=0.4604, reader_cost=0.0002 | ETA 04:38:03 2020-11-14 01:20:45 [INFO] [TRAIN] epoch=6, iter=3770/40000, loss=0.7443, lr=0.009149, batch_cost=0.4680, reader_cost=0.0002 | ETA 04:42:36 2020-11-14 01:20:51 [INFO] [TRAIN] epoch=6, iter=3780/40000, loss=0.4380, lr=0.009146, batch_cost=0.5364, reader_cost=0.0002 | ETA 05:23:48 2020-11-14 01:20:56 [INFO] [TRAIN] epoch=6, iter=3790/40000, loss=0.7136, lr=0.009144, batch_cost=0.5636, reader_cost=0.0015 | ETA 05:40:07 2020-11-14 01:21:02 [INFO] [TRAIN] epoch=6, iter=3800/40000, loss=0.3996, lr=0.009142, batch_cost=0.5478, reader_cost=0.0002 | ETA 05:30:29 2020-11-14 01:21:07 [INFO] [TRAIN] epoch=6, iter=3810/40000, loss=0.4862, lr=0.009140, batch_cost=0.5290, reader_cost=0.0002 | ETA 05:19:05 2020-11-14 01:21:12 [INFO] [TRAIN] epoch=6, iter=3820/40000, loss=0.5747, lr=0.009137, batch_cost=0.4745, reader_cost=0.0002 | ETA 04:46:07 2020-11-14 01:21:17 [INFO] [TRAIN] epoch=6, iter=3830/40000, loss=0.6549, lr=0.009135, batch_cost=0.4734, reader_cost=0.0002 | ETA 04:45:21 2020-11-14 01:21:22 [INFO] [TRAIN] epoch=6, iter=3840/40000, loss=0.4450, lr=0.009133, batch_cost=0.4998, reader_cost=0.0002 | ETA 05:01:13 2020-11-14 01:21:26 [INFO] [TRAIN] epoch=6, iter=3850/40000, loss=0.4941, lr=0.009131, batch_cost=0.4511, reader_cost=0.0002 | ETA 04:31:46 2020-11-14 01:21:31 [INFO] [TRAIN] epoch=6, iter=3860/40000, loss=0.4543, lr=0.009128, batch_cost=0.4841, reader_cost=0.0002 | ETA 04:51:36 2020-11-14 01:21:35 [INFO] [TRAIN] epoch=6, iter=3870/40000, loss=0.4428, lr=0.009126, batch_cost=0.4639, reader_cost=0.0002 | ETA 04:39:19 2020-11-14 01:21:40 [INFO] [TRAIN] epoch=6, iter=3880/40000, loss=0.5947, lr=0.009124, batch_cost=0.4855, reader_cost=0.0015 | ETA 04:52:17 2020-11-14 01:21:45 [INFO] [TRAIN] epoch=6, iter=3890/40000, loss=0.3572, lr=0.009121, batch_cost=0.4935, reader_cost=0.0002 | ETA 04:56:58 2020-11-14 01:21:50 [INFO] [TRAIN] epoch=6, iter=3900/40000, loss=0.6046, lr=0.009119, batch_cost=0.4606, reader_cost=0.0002 | ETA 04:37:07 2020-11-14 01:21:54 [INFO] [TRAIN] epoch=6, iter=3910/40000, loss=0.4753, lr=0.009117, batch_cost=0.4405, reader_cost=0.0002 | ETA 04:24:58 2020-11-14 01:21:59 [INFO] [TRAIN] epoch=6, iter=3920/40000, loss=0.5022, lr=0.009115, batch_cost=0.4377, reader_cost=0.0002 | ETA 04:23:10 2020-11-14 01:22:03 [INFO] [TRAIN] epoch=6, iter=3930/40000, loss=0.6029, lr=0.009112, batch_cost=0.4341, reader_cost=0.0002 | ETA 04:20:59 2020-11-14 01:22:07 [INFO] [TRAIN] epoch=6, iter=3940/40000, loss=0.5631, lr=0.009110, batch_cost=0.4427, reader_cost=0.0002 | ETA 04:26:04 2020-11-14 01:22:12 [INFO] [TRAIN] epoch=6, iter=3950/40000, loss=0.5271, lr=0.009108, batch_cost=0.4471, reader_cost=0.0002 | ETA 04:28:38 2020-11-14 01:22:16 [INFO] [TRAIN] epoch=6, iter=3960/40000, loss=0.4604, lr=0.009106, batch_cost=0.4436, reader_cost=0.0002 | ETA 04:26:27 2020-11-14 01:22:22 [INFO] [TRAIN] epoch=7, iter=3970/40000, loss=0.6606, lr=0.009103, batch_cost=0.5527, reader_cost=0.0873 | ETA 05:31:52 2020-11-14 01:22:26 [INFO] [TRAIN] epoch=7, iter=3980/40000, loss=0.6550, lr=0.009101, batch_cost=0.4532, reader_cost=0.0004 | ETA 04:32:04 2020-11-14 01:22:31 [INFO] [TRAIN] epoch=7, iter=3990/40000, loss=0.5759, lr=0.009099, batch_cost=0.4654, reader_cost=0.0002 | ETA 04:39:19 2020-11-14 01:22:35 [INFO] [TRAIN] epoch=7, iter=4000/40000, loss=0.4975, lr=0.009096, batch_cost=0.4412, reader_cost=0.0002 | ETA 04:24:43 2020-11-14 01:22:36 [INFO] Start evaluating (total_samples=1449, total_iters=363)... 2020-11-14 01:22:56 [INFO] [EVAL] #Images=1449 mIoU=0.6877 Acc=0.9262 Kappa=0.8388 2020-11-14 01:22:56 [INFO] [EVAL] Class IoU: [0.9229 0.8584 0.3869 0.8517 0.6439 0.6327 0.8429 0.8499 0.8549 0.2978 0.7738 0.5376 0.7804 0.7918 0.7728 0.8102 0.4949 0.6721 0.3674 0.6504 0.6488] 2020-11-14 01:22:56 [INFO] [EVAL] Class Acc: [0.9612 0.9121 0.4245 0.9297 0.6837 0.6798 0.9474 0.954 0.9171 0.5952 0.8449 0.6851 0.8636 0.8526 0.8197 0.8984 0.8202 0.886 0.8234 0.6725 0.8165] 2020-11-14 01:23:05 [INFO] [EVAL] The model with the best validation mIoU (0.6877) was saved at iter 4000. 2020-11-14 01:23:10 [INFO] [TRAIN] epoch=7, iter=4010/40000, loss=0.4250, lr=0.009094, batch_cost=0.4285, reader_cost=0.0004 | ETA 04:17:01 2020-11-14 01:23:14 [INFO] [TRAIN] epoch=7, iter=4020/40000, loss=0.5211, lr=0.009092, batch_cost=0.4299, reader_cost=0.0002 | ETA 04:17:46 2020-11-14 01:23:18 [INFO] [TRAIN] epoch=7, iter=4030/40000, loss=0.6821, lr=0.009090, batch_cost=0.4320, reader_cost=0.0002 | ETA 04:18:57 2020-11-14 01:23:23 [INFO] [TRAIN] epoch=7, iter=4040/40000, loss=0.5745, lr=0.009087, batch_cost=0.4339, reader_cost=0.0002 | ETA 04:20:02 2020-11-14 01:23:27 [INFO] [TRAIN] epoch=7, iter=4050/40000, loss=0.6315, lr=0.009085, batch_cost=0.4321, reader_cost=0.0002 | ETA 04:18:53 2020-11-14 01:23:31 [INFO] [TRAIN] epoch=7, iter=4060/40000, loss=0.4626, lr=0.009083, batch_cost=0.4351, reader_cost=0.0002 | ETA 04:20:36 2020-11-14 01:23:36 [INFO] [TRAIN] epoch=7, iter=4070/40000, loss=0.3658, lr=0.009081, batch_cost=0.4346, reader_cost=0.0002 | ETA 04:20:16 2020-11-14 01:23:40 [INFO] [TRAIN] epoch=7, iter=4080/40000, loss=0.4538, lr=0.009078, batch_cost=0.4416, reader_cost=0.0002 | ETA 04:24:22 2020-11-14 01:23:44 [INFO] [TRAIN] epoch=7, iter=4090/40000, loss=0.3862, lr=0.009076, batch_cost=0.4318, reader_cost=0.0002 | ETA 04:18:27 2020-11-14 01:23:49 [INFO] [TRAIN] epoch=7, iter=4100/40000, loss=0.3168, lr=0.009074, batch_cost=0.4302, reader_cost=0.0002 | ETA 04:17:25 2020-11-14 01:23:53 [INFO] [TRAIN] epoch=7, iter=4110/40000, loss=0.6235, lr=0.009071, batch_cost=0.4364, reader_cost=0.0002 | ETA 04:21:03 2020-11-14 01:23:57 [INFO] [TRAIN] epoch=7, iter=4120/40000, loss=0.3619, lr=0.009069, batch_cost=0.4318, reader_cost=0.0002 | ETA 04:18:13 2020-11-14 01:24:02 [INFO] [TRAIN] epoch=7, iter=4130/40000, loss=0.4931, lr=0.009067, batch_cost=0.4367, reader_cost=0.0002 | ETA 04:21:06 2020-11-14 01:24:06 [INFO] [TRAIN] epoch=7, iter=4140/40000, loss=0.3625, lr=0.009065, batch_cost=0.4302, reader_cost=0.0002 | ETA 04:17:07 2020-11-14 01:24:11 [INFO] [TRAIN] epoch=7, iter=4150/40000, loss=0.5438, lr=0.009062, batch_cost=0.4594, reader_cost=0.0002 | ETA 04:34:31 2020-11-14 01:24:15 [INFO] [TRAIN] epoch=7, iter=4160/40000, loss=0.5339, lr=0.009060, batch_cost=0.4361, reader_cost=0.0002 | ETA 04:20:28 2020-11-14 01:24:19 [INFO] [TRAIN] epoch=7, iter=4170/40000, loss=0.6214, lr=0.009058, batch_cost=0.4346, reader_cost=0.0002 | ETA 04:19:30 2020-11-14 01:24:24 [INFO] [TRAIN] epoch=7, iter=4180/40000, loss=0.4600, lr=0.009056, batch_cost=0.4402, reader_cost=0.0002 | ETA 04:22:48 2020-11-14 01:24:28 [INFO] [TRAIN] epoch=7, iter=4190/40000, loss=0.4564, lr=0.009053, batch_cost=0.4582, reader_cost=0.0003 | ETA 04:33:27 2020-11-14 01:24:33 [INFO] [TRAIN] epoch=7, iter=4200/40000, loss=0.6899, lr=0.009051, batch_cost=0.4647, reader_cost=0.0004 | ETA 04:37:17 2020-11-14 01:24:37 [INFO] [TRAIN] epoch=7, iter=4210/40000, loss=0.6667, lr=0.009049, batch_cost=0.4365, reader_cost=0.0002 | ETA 04:20:22 2020-11-14 01:24:42 [INFO] [TRAIN] epoch=7, iter=4220/40000, loss=0.5420, lr=0.009046, batch_cost=0.4599, reader_cost=0.0020 | ETA 04:34:14 2020-11-14 01:24:47 [INFO] [TRAIN] epoch=7, iter=4230/40000, loss=0.6213, lr=0.009044, batch_cost=0.4790, reader_cost=0.0020 | ETA 04:45:34 2020-11-14 01:24:51 [INFO] [TRAIN] epoch=7, iter=4240/40000, loss=0.4476, lr=0.009042, batch_cost=0.4307, reader_cost=0.0008 | ETA 04:16:43 2020-11-14 01:24:55 [INFO] [TRAIN] epoch=7, iter=4250/40000, loss=0.4701, lr=0.009040, batch_cost=0.4329, reader_cost=0.0002 | ETA 04:17:56 2020-11-14 01:25:00 [INFO] [TRAIN] epoch=7, iter=4260/40000, loss=0.5705, lr=0.009037, batch_cost=0.4332, reader_cost=0.0002 | ETA 04:18:02 2020-11-14 01:25:04 [INFO] [TRAIN] epoch=7, iter=4270/40000, loss=0.4065, lr=0.009035, batch_cost=0.4424, reader_cost=0.0002 | ETA 04:23:27 2020-11-14 01:25:09 [INFO] [TRAIN] epoch=7, iter=4280/40000, loss=0.5001, lr=0.009033, batch_cost=0.4727, reader_cost=0.0002 | ETA 04:41:24 2020-11-14 01:25:13 [INFO] [TRAIN] epoch=7, iter=4290/40000, loss=0.5668, lr=0.009031, batch_cost=0.4395, reader_cost=0.0002 | ETA 04:21:33 2020-11-14 01:25:18 [INFO] [TRAIN] epoch=7, iter=4300/40000, loss=0.6326, lr=0.009028, batch_cost=0.4346, reader_cost=0.0002 | ETA 04:18:34 2020-11-14 01:25:22 [INFO] [TRAIN] epoch=7, iter=4310/40000, loss=0.5273, lr=0.009026, batch_cost=0.4376, reader_cost=0.0002 | ETA 04:20:18 2020-11-14 01:25:26 [INFO] [TRAIN] epoch=7, iter=4320/40000, loss=0.5116, lr=0.009024, batch_cost=0.4357, reader_cost=0.0002 | ETA 04:19:06 2020-11-14 01:25:31 [INFO] [TRAIN] epoch=7, iter=4330/40000, loss=0.4415, lr=0.009021, batch_cost=0.4514, reader_cost=0.0002 | ETA 04:28:20 2020-11-14 01:25:35 [INFO] [TRAIN] epoch=7, iter=4340/40000, loss=0.5005, lr=0.009019, batch_cost=0.4369, reader_cost=0.0002 | ETA 04:19:38 2020-11-14 01:25:40 [INFO] [TRAIN] epoch=7, iter=4350/40000, loss=0.4669, lr=0.009017, batch_cost=0.4556, reader_cost=0.0002 | ETA 04:30:42 2020-11-14 01:25:44 [INFO] [TRAIN] epoch=7, iter=4360/40000, loss=0.4196, lr=0.009015, batch_cost=0.4340, reader_cost=0.0002 | ETA 04:17:48 2020-11-14 01:25:49 [INFO] [TRAIN] epoch=7, iter=4370/40000, loss=0.4857, lr=0.009012, batch_cost=0.4447, reader_cost=0.0002 | ETA 04:24:04 2020-11-14 01:25:53 [INFO] [TRAIN] epoch=7, iter=4380/40000, loss=0.4941, lr=0.009010, batch_cost=0.4446, reader_cost=0.0002 | ETA 04:23:58 2020-11-14 01:25:57 [INFO] [TRAIN] epoch=7, iter=4390/40000, loss=0.5768, lr=0.009008, batch_cost=0.4341, reader_cost=0.0002 | ETA 04:17:38 2020-11-14 01:26:02 [INFO] [TRAIN] epoch=7, iter=4400/40000, loss=0.5944, lr=0.009006, batch_cost=0.4306, reader_cost=0.0002 | ETA 04:15:28 2020-11-14 01:26:06 [INFO] [TRAIN] epoch=7, iter=4410/40000, loss=0.5135, lr=0.009003, batch_cost=0.4594, reader_cost=0.0002 | ETA 04:32:30 2020-11-14 01:26:11 [INFO] [TRAIN] epoch=7, iter=4420/40000, loss=0.4527, lr=0.009001, batch_cost=0.4547, reader_cost=0.0002 | ETA 04:29:39 2020-11-14 01:26:15 [INFO] [TRAIN] epoch=7, iter=4430/40000, loss=0.4339, lr=0.008999, batch_cost=0.4647, reader_cost=0.0002 | ETA 04:35:28 2020-11-14 01:26:20 [INFO] [TRAIN] epoch=7, iter=4440/40000, loss=0.3994, lr=0.008996, batch_cost=0.4531, reader_cost=0.0002 | ETA 04:28:32 2020-11-14 01:26:24 [INFO] [TRAIN] epoch=7, iter=4450/40000, loss=0.3959, lr=0.008994, batch_cost=0.4388, reader_cost=0.0002 | ETA 04:19:59 2020-11-14 01:26:29 [INFO] [TRAIN] epoch=7, iter=4460/40000, loss=0.4157, lr=0.008992, batch_cost=0.4389, reader_cost=0.0002 | ETA 04:19:57 2020-11-14 01:26:33 [INFO] [TRAIN] epoch=7, iter=4470/40000, loss=0.4044, lr=0.008990, batch_cost=0.4366, reader_cost=0.0002 | ETA 04:18:32 2020-11-14 01:26:38 [INFO] [TRAIN] epoch=7, iter=4480/40000, loss=0.5522, lr=0.008987, batch_cost=0.4618, reader_cost=0.0002 | ETA 04:33:22 2020-11-14 01:26:42 [INFO] [TRAIN] epoch=7, iter=4490/40000, loss=0.5758, lr=0.008985, batch_cost=0.4603, reader_cost=0.0002 | ETA 04:32:25 2020-11-14 01:26:47 [INFO] [TRAIN] epoch=7, iter=4500/40000, loss=0.4221, lr=0.008983, batch_cost=0.4454, reader_cost=0.0002 | ETA 04:23:32 2020-11-14 01:26:51 [INFO] [TRAIN] epoch=7, iter=4510/40000, loss=0.4254, lr=0.008981, batch_cost=0.4490, reader_cost=0.0002 | ETA 04:25:34 2020-11-14 01:26:56 [INFO] [TRAIN] epoch=7, iter=4520/40000, loss=0.4839, lr=0.008978, batch_cost=0.4386, reader_cost=0.0002 | ETA 04:19:22 2020-11-14 01:27:00 [INFO] [TRAIN] epoch=7, iter=4530/40000, loss=0.5954, lr=0.008976, batch_cost=0.4398, reader_cost=0.0002 | ETA 04:20:00 2020-11-14 01:27:05 [INFO] [TRAIN] epoch=7, iter=4540/40000, loss=0.6482, lr=0.008974, batch_cost=0.4433, reader_cost=0.0002 | ETA 04:21:57 2020-11-14 01:27:09 [INFO] [TRAIN] epoch=7, iter=4550/40000, loss=0.3772, lr=0.008971, batch_cost=0.4392, reader_cost=0.0002 | ETA 04:19:28 2020-11-14 01:27:13 [INFO] [TRAIN] epoch=7, iter=4560/40000, loss=0.4343, lr=0.008969, batch_cost=0.4424, reader_cost=0.0002 | ETA 04:21:19 2020-11-14 01:27:18 [INFO] [TRAIN] epoch=7, iter=4570/40000, loss=0.6566, lr=0.008967, batch_cost=0.4399, reader_cost=0.0002 | ETA 04:19:46 2020-11-14 01:27:22 [INFO] [TRAIN] epoch=7, iter=4580/40000, loss=0.8770, lr=0.008965, batch_cost=0.4415, reader_cost=0.0002 | ETA 04:20:37 2020-11-14 01:27:27 [INFO] [TRAIN] epoch=7, iter=4590/40000, loss=0.6793, lr=0.008962, batch_cost=0.4365, reader_cost=0.0002 | ETA 04:17:36 2020-11-14 01:27:31 [INFO] [TRAIN] epoch=7, iter=4600/40000, loss=0.4976, lr=0.008960, batch_cost=0.4391, reader_cost=0.0002 | ETA 04:19:04 2020-11-14 01:27:36 [INFO] [TRAIN] epoch=7, iter=4610/40000, loss=0.7320, lr=0.008958, batch_cost=0.4553, reader_cost=0.0002 | ETA 04:28:32 2020-11-14 01:27:40 [INFO] [TRAIN] epoch=7, iter=4620/40000, loss=0.4124, lr=0.008955, batch_cost=0.4377, reader_cost=0.0005 | ETA 04:18:06 2020-11-14 01:27:45 [INFO] [TRAIN] epoch=8, iter=4630/40000, loss=0.4999, lr=0.008953, batch_cost=0.5584, reader_cost=0.0781 | ETA 05:29:10 2020-11-14 01:27:50 [INFO] [TRAIN] epoch=8, iter=4640/40000, loss=0.5257, lr=0.008951, batch_cost=0.4628, reader_cost=0.0006 | ETA 04:32:43 2020-11-14 01:27:54 [INFO] [TRAIN] epoch=8, iter=4650/40000, loss=0.4177, lr=0.008949, batch_cost=0.4385, reader_cost=0.0002 | ETA 04:18:21 2020-11-14 01:27:59 [INFO] [TRAIN] epoch=8, iter=4660/40000, loss=0.3969, lr=0.008946, batch_cost=0.4427, reader_cost=0.0002 | ETA 04:20:43 2020-11-14 01:28:03 [INFO] [TRAIN] epoch=8, iter=4670/40000, loss=0.7968, lr=0.008944, batch_cost=0.4547, reader_cost=0.0004 | ETA 04:27:45 2020-11-14 01:28:08 [INFO] [TRAIN] epoch=8, iter=4680/40000, loss=0.5515, lr=0.008942, batch_cost=0.4314, reader_cost=0.0001 | ETA 04:13:56 2020-11-14 01:28:12 [INFO] [TRAIN] epoch=8, iter=4690/40000, loss=0.4313, lr=0.008940, batch_cost=0.4388, reader_cost=0.0026 | ETA 04:18:12 2020-11-14 01:28:16 [INFO] [TRAIN] epoch=8, iter=4700/40000, loss=0.5129, lr=0.008937, batch_cost=0.4325, reader_cost=0.0002 | ETA 04:14:27 2020-11-14 01:28:21 [INFO] [TRAIN] epoch=8, iter=4710/40000, loss=0.8300, lr=0.008935, batch_cost=0.4601, reader_cost=0.0002 | ETA 04:30:38 2020-11-14 01:28:26 [INFO] [TRAIN] epoch=8, iter=4720/40000, loss=0.4386, lr=0.008933, batch_cost=0.4528, reader_cost=0.0002 | ETA 04:26:13 2020-11-14 01:28:30 [INFO] [TRAIN] epoch=8, iter=4730/40000, loss=0.5531, lr=0.008930, batch_cost=0.4491, reader_cost=0.0002 | ETA 04:23:58 2020-11-14 01:28:34 [INFO] [TRAIN] epoch=8, iter=4740/40000, loss=0.5653, lr=0.008928, batch_cost=0.4340, reader_cost=0.0002 | ETA 04:15:04 2020-11-14 01:28:39 [INFO] [TRAIN] epoch=8, iter=4750/40000, loss=0.4310, lr=0.008926, batch_cost=0.4450, reader_cost=0.0002 | ETA 04:21:25 2020-11-14 01:28:43 [INFO] [TRAIN] epoch=8, iter=4760/40000, loss=0.4993, lr=0.008924, batch_cost=0.4514, reader_cost=0.0002 | ETA 04:25:08 2020-11-14 01:28:48 [INFO] [TRAIN] epoch=8, iter=4770/40000, loss=0.4615, lr=0.008921, batch_cost=0.4430, reader_cost=0.0002 | ETA 04:20:05 2020-11-14 01:28:52 [INFO] [TRAIN] epoch=8, iter=4780/40000, loss=0.4386, lr=0.008919, batch_cost=0.4572, reader_cost=0.0002 | ETA 04:28:23 2020-11-14 01:28:57 [INFO] [TRAIN] epoch=8, iter=4790/40000, loss=0.3809, lr=0.008917, batch_cost=0.4595, reader_cost=0.0002 | ETA 04:29:38 2020-11-14 01:29:02 [INFO] [TRAIN] epoch=8, iter=4800/40000, loss=0.4208, lr=0.008915, batch_cost=0.4492, reader_cost=0.0002 | ETA 04:23:30 2020-11-14 01:29:06 [INFO] [TRAIN] epoch=8, iter=4810/40000, loss=0.5786, lr=0.008912, batch_cost=0.4577, reader_cost=0.0002 | ETA 04:28:25 2020-11-14 01:29:10 [INFO] [TRAIN] epoch=8, iter=4820/40000, loss=0.4007, lr=0.008910, batch_cost=0.4386, reader_cost=0.0002 | ETA 04:17:08 2020-11-14 01:29:15 [INFO] [TRAIN] epoch=8, iter=4830/40000, loss=0.4552, lr=0.008908, batch_cost=0.4342, reader_cost=0.0002 | ETA 04:14:30 2020-11-14 01:29:19 [INFO] [TRAIN] epoch=8, iter=4840/40000, loss=0.8997, lr=0.008905, batch_cost=0.4349, reader_cost=0.0002 | ETA 04:14:52 2020-11-14 01:29:24 [INFO] [TRAIN] epoch=8, iter=4850/40000, loss=0.4841, lr=0.008903, batch_cost=0.4371, reader_cost=0.0002 | ETA 04:16:04 2020-11-14 01:29:28 [INFO] [TRAIN] epoch=8, iter=4860/40000, loss=0.5565, lr=0.008901, batch_cost=0.4390, reader_cost=0.0002 | ETA 04:17:06 2020-11-14 01:29:32 [INFO] [TRAIN] epoch=8, iter=4870/40000, loss=0.5798, lr=0.008899, batch_cost=0.4393, reader_cost=0.0002 | ETA 04:17:13 2020-11-14 01:29:37 [INFO] [TRAIN] epoch=8, iter=4880/40000, loss=0.4244, lr=0.008896, batch_cost=0.4377, reader_cost=0.0002 | ETA 04:16:10 2020-11-14 01:29:41 [INFO] [TRAIN] epoch=8, iter=4890/40000, loss=0.6715, lr=0.008894, batch_cost=0.4416, reader_cost=0.0002 | ETA 04:18:26 2020-11-14 01:29:45 [INFO] [TRAIN] epoch=8, iter=4900/40000, loss=0.6788, lr=0.008892, batch_cost=0.4320, reader_cost=0.0002 | ETA 04:12:42 2020-11-14 01:29:50 [INFO] [TRAIN] epoch=8, iter=4910/40000, loss=0.4678, lr=0.008889, batch_cost=0.4384, reader_cost=0.0002 | ETA 04:16:23 2020-11-14 01:29:54 [INFO] [TRAIN] epoch=8, iter=4920/40000, loss=0.6973, lr=0.008887, batch_cost=0.4365, reader_cost=0.0002 | ETA 04:15:13 2020-11-14 01:29:59 [INFO] [TRAIN] epoch=8, iter=4930/40000, loss=0.7914, lr=0.008885, batch_cost=0.4552, reader_cost=0.0002 | ETA 04:26:02 2020-11-14 01:30:03 [INFO] [TRAIN] epoch=8, iter=4940/40000, loss=0.5059, lr=0.008883, batch_cost=0.4427, reader_cost=0.0002 | ETA 04:18:42 2020-11-14 01:30:08 [INFO] [TRAIN] epoch=8, iter=4950/40000, loss=0.4337, lr=0.008880, batch_cost=0.4395, reader_cost=0.0002 | ETA 04:16:45 2020-11-14 01:30:12 [INFO] [TRAIN] epoch=8, iter=4960/40000, loss=0.4295, lr=0.008878, batch_cost=0.4458, reader_cost=0.0002 | ETA 04:20:20 2020-11-14 01:30:17 [INFO] [TRAIN] epoch=8, iter=4970/40000, loss=0.5526, lr=0.008876, batch_cost=0.4687, reader_cost=0.0002 | ETA 04:33:36 2020-11-14 01:30:22 [INFO] [TRAIN] epoch=8, iter=4980/40000, loss=0.4112, lr=0.008874, batch_cost=0.4818, reader_cost=0.0002 | ETA 04:41:11 2020-11-14 01:30:26 [INFO] [TRAIN] epoch=8, iter=4990/40000, loss=0.4012, lr=0.008871, batch_cost=0.4365, reader_cost=0.0002 | ETA 04:14:40 2020-11-14 01:30:30 [INFO] [TRAIN] epoch=8, iter=5000/40000, loss=0.6385, lr=0.008869, batch_cost=0.4343, reader_cost=0.0002 | ETA 04:13:21 2020-11-14 01:30:35 [INFO] [TRAIN] epoch=8, iter=5010/40000, loss=0.5574, lr=0.008867, batch_cost=0.4333, reader_cost=0.0002 | ETA 04:12:39 2020-11-14 01:30:39 [INFO] [TRAIN] epoch=8, iter=5020/40000, loss=0.5203, lr=0.008864, batch_cost=0.4373, reader_cost=0.0002 | ETA 04:14:55 2020-11-14 01:30:43 [INFO] [TRAIN] epoch=8, iter=5030/40000, loss=0.3896, lr=0.008862, batch_cost=0.4387, reader_cost=0.0002 | ETA 04:15:40 2020-11-14 01:30:48 [INFO] [TRAIN] epoch=8, iter=5040/40000, loss=0.6346, lr=0.008860, batch_cost=0.4392, reader_cost=0.0002 | ETA 04:15:55 2020-11-14 01:30:52 [INFO] [TRAIN] epoch=8, iter=5050/40000, loss=0.4394, lr=0.008858, batch_cost=0.4394, reader_cost=0.0002 | ETA 04:15:58 2020-11-14 01:30:57 [INFO] [TRAIN] epoch=8, iter=5060/40000, loss=0.6623, lr=0.008855, batch_cost=0.4727, reader_cost=0.0002 | ETA 04:35:15 2020-11-14 01:31:01 [INFO] [TRAIN] epoch=8, iter=5070/40000, loss=0.5719, lr=0.008853, batch_cost=0.4372, reader_cost=0.0002 | ETA 04:14:31 2020-11-14 01:31:06 [INFO] [TRAIN] epoch=8, iter=5080/40000, loss=0.5910, lr=0.008851, batch_cost=0.4382, reader_cost=0.0002 | ETA 04:15:02 2020-11-14 01:31:10 [INFO] [TRAIN] epoch=8, iter=5090/40000, loss=0.3966, lr=0.008848, batch_cost=0.4332, reader_cost=0.0002 | ETA 04:12:01 2020-11-14 01:31:14 [INFO] [TRAIN] epoch=8, iter=5100/40000, loss=0.4798, lr=0.008846, batch_cost=0.4369, reader_cost=0.0002 | ETA 04:14:08 2020-11-14 01:31:19 [INFO] [TRAIN] epoch=8, iter=5110/40000, loss=0.5499, lr=0.008844, batch_cost=0.4800, reader_cost=0.0002 | ETA 04:39:06 2020-11-14 01:31:24 [INFO] [TRAIN] epoch=8, iter=5120/40000, loss=0.4726, lr=0.008842, batch_cost=0.4661, reader_cost=0.0002 | ETA 04:30:58 2020-11-14 01:31:29 [INFO] [TRAIN] epoch=8, iter=5130/40000, loss=0.3652, lr=0.008839, batch_cost=0.4751, reader_cost=0.0002 | ETA 04:36:07 2020-11-14 01:31:33 [INFO] [TRAIN] epoch=8, iter=5140/40000, loss=0.3942, lr=0.008837, batch_cost=0.4631, reader_cost=0.0002 | ETA 04:29:02 2020-11-14 01:31:38 [INFO] [TRAIN] epoch=8, iter=5150/40000, loss=0.4233, lr=0.008835, batch_cost=0.4645, reader_cost=0.0002 | ETA 04:29:47 2020-11-14 01:31:42 [INFO] [TRAIN] epoch=8, iter=5160/40000, loss=0.5295, lr=0.008833, batch_cost=0.4530, reader_cost=0.0002 | ETA 04:23:02 2020-11-14 01:31:47 [INFO] [TRAIN] epoch=8, iter=5170/40000, loss=0.5149, lr=0.008830, batch_cost=0.4979, reader_cost=0.0002 | ETA 04:49:01 2020-11-14 01:31:52 [INFO] [TRAIN] epoch=8, iter=5180/40000, loss=0.4784, lr=0.008828, batch_cost=0.4557, reader_cost=0.0002 | ETA 04:24:27 2020-11-14 01:31:57 [INFO] [TRAIN] epoch=8, iter=5190/40000, loss=0.5868, lr=0.008826, batch_cost=0.4669, reader_cost=0.0002 | ETA 04:30:54 2020-11-14 01:32:01 [INFO] [TRAIN] epoch=8, iter=5200/40000, loss=0.5283, lr=0.008823, batch_cost=0.4736, reader_cost=0.0002 | ETA 04:34:41 2020-11-14 01:32:06 [INFO] [TRAIN] epoch=8, iter=5210/40000, loss=0.6882, lr=0.008821, batch_cost=0.4655, reader_cost=0.0002 | ETA 04:29:55 2020-11-14 01:32:10 [INFO] [TRAIN] epoch=8, iter=5220/40000, loss=0.6365, lr=0.008819, batch_cost=0.4347, reader_cost=0.0002 | ETA 04:11:57 2020-11-14 01:32:15 [INFO] [TRAIN] epoch=8, iter=5230/40000, loss=0.6360, lr=0.008817, batch_cost=0.4375, reader_cost=0.0002 | ETA 04:13:31 2020-11-14 01:32:19 [INFO] [TRAIN] epoch=8, iter=5240/40000, loss=0.7852, lr=0.008814, batch_cost=0.4357, reader_cost=0.0002 | ETA 04:12:24 2020-11-14 01:32:23 [INFO] [TRAIN] epoch=8, iter=5250/40000, loss=0.5412, lr=0.008812, batch_cost=0.4402, reader_cost=0.0002 | ETA 04:14:55 2020-11-14 01:32:28 [INFO] [TRAIN] epoch=8, iter=5260/40000, loss=0.6888, lr=0.008810, batch_cost=0.4392, reader_cost=0.0002 | ETA 04:14:16 2020-11-14 01:32:32 [INFO] [TRAIN] epoch=8, iter=5270/40000, loss=0.4752, lr=0.008807, batch_cost=0.4324, reader_cost=0.0002 | ETA 04:10:15 2020-11-14 01:32:37 [INFO] [TRAIN] epoch=8, iter=5280/40000, loss=0.5710, lr=0.008805, batch_cost=0.4399, reader_cost=0.0002 | ETA 04:14:32 2020-11-14 01:32:42 [INFO] [TRAIN] epoch=9, iter=5290/40000, loss=0.5793, lr=0.008803, batch_cost=0.5510, reader_cost=0.0912 | ETA 05:18:45 2020-11-14 01:32:47 [INFO] [TRAIN] epoch=9, iter=5300/40000, loss=0.4661, lr=0.008801, batch_cost=0.4575, reader_cost=0.0005 | ETA 04:24:35 2020-11-14 01:32:51 [INFO] [TRAIN] epoch=9, iter=5310/40000, loss=0.4494, lr=0.008798, batch_cost=0.4548, reader_cost=0.0002 | ETA 04:22:56 2020-11-14 01:32:56 [INFO] [TRAIN] epoch=9, iter=5320/40000, loss=0.4425, lr=0.008796, batch_cost=0.4606, reader_cost=0.0002 | ETA 04:26:15 2020-11-14 01:33:00 [INFO] [TRAIN] epoch=9, iter=5330/40000, loss=0.6407, lr=0.008794, batch_cost=0.4492, reader_cost=0.0002 | ETA 04:19:32 2020-11-14 01:33:05 [INFO] [TRAIN] epoch=9, iter=5340/40000, loss=0.3853, lr=0.008791, batch_cost=0.4309, reader_cost=0.0002 | ETA 04:08:53 2020-11-14 01:33:09 [INFO] [TRAIN] epoch=9, iter=5350/40000, loss=0.6007, lr=0.008789, batch_cost=0.4393, reader_cost=0.0002 | ETA 04:13:40 2020-11-14 01:33:13 [INFO] [TRAIN] epoch=9, iter=5360/40000, loss=0.3761, lr=0.008787, batch_cost=0.4496, reader_cost=0.0002 | ETA 04:19:33 2020-11-14 01:33:18 [INFO] [TRAIN] epoch=9, iter=5370/40000, loss=0.3716, lr=0.008785, batch_cost=0.4568, reader_cost=0.0002 | ETA 04:23:37 2020-11-14 01:33:22 [INFO] [TRAIN] epoch=9, iter=5380/40000, loss=0.6874, lr=0.008782, batch_cost=0.4452, reader_cost=0.0002 | ETA 04:16:53 2020-11-14 01:33:27 [INFO] [TRAIN] epoch=9, iter=5390/40000, loss=0.5624, lr=0.008780, batch_cost=0.4324, reader_cost=0.0002 | ETA 04:09:26 2020-11-14 01:33:31 [INFO] [TRAIN] epoch=9, iter=5400/40000, loss=0.4566, lr=0.008778, batch_cost=0.4338, reader_cost=0.0002 | ETA 04:10:09 2020-11-14 01:33:35 [INFO] [TRAIN] epoch=9, iter=5410/40000, loss=0.4124, lr=0.008776, batch_cost=0.4360, reader_cost=0.0002 | ETA 04:11:21 2020-11-14 01:33:40 [INFO] [TRAIN] epoch=9, iter=5420/40000, loss=0.5087, lr=0.008773, batch_cost=0.4576, reader_cost=0.0002 | ETA 04:23:44 2020-11-14 01:33:45 [INFO] [TRAIN] epoch=9, iter=5430/40000, loss=0.6670, lr=0.008771, batch_cost=0.4612, reader_cost=0.0002 | ETA 04:25:42 2020-11-14 01:33:49 [INFO] [TRAIN] epoch=9, iter=5440/40000, loss=0.6743, lr=0.008769, batch_cost=0.4501, reader_cost=0.0001 | ETA 04:19:16 2020-11-14 01:33:54 [INFO] [TRAIN] epoch=9, iter=5450/40000, loss=0.4859, lr=0.008766, batch_cost=0.4575, reader_cost=0.0002 | ETA 04:23:27 2020-11-14 01:33:58 [INFO] [TRAIN] epoch=9, iter=5460/40000, loss=0.4505, lr=0.008764, batch_cost=0.4369, reader_cost=0.0002 | ETA 04:11:30 2020-11-14 01:34:02 [INFO] [TRAIN] epoch=9, iter=5470/40000, loss=0.6163, lr=0.008762, batch_cost=0.4318, reader_cost=0.0002 | ETA 04:08:31 2020-11-14 01:34:07 [INFO] [TRAIN] epoch=9, iter=5480/40000, loss=0.3682, lr=0.008760, batch_cost=0.4436, reader_cost=0.0002 | ETA 04:15:13 2020-11-14 01:34:12 [INFO] [TRAIN] epoch=9, iter=5490/40000, loss=0.5340, lr=0.008757, batch_cost=0.4692, reader_cost=0.0002 | ETA 04:29:52 2020-11-14 01:34:16 [INFO] [TRAIN] epoch=9, iter=5500/40000, loss=0.5779, lr=0.008755, batch_cost=0.4432, reader_cost=0.0002 | ETA 04:14:49 2020-11-14 01:34:21 [INFO] [TRAIN] epoch=9, iter=5510/40000, loss=0.4822, lr=0.008753, batch_cost=0.4533, reader_cost=0.0002 | ETA 04:20:34 2020-11-14 01:34:25 [INFO] [TRAIN] epoch=9, iter=5520/40000, loss=0.5584, lr=0.008750, batch_cost=0.4495, reader_cost=0.0002 | ETA 04:18:19 2020-11-14 01:34:30 [INFO] [TRAIN] epoch=9, iter=5530/40000, loss=0.3816, lr=0.008748, batch_cost=0.4469, reader_cost=0.0002 | ETA 04:16:43 2020-11-14 01:34:34 [INFO] [TRAIN] epoch=9, iter=5540/40000, loss=0.6889, lr=0.008746, batch_cost=0.4466, reader_cost=0.0002 | ETA 04:16:28 2020-11-14 01:34:38 [INFO] [TRAIN] epoch=9, iter=5550/40000, loss=0.7708, lr=0.008744, batch_cost=0.4388, reader_cost=0.0002 | ETA 04:11:58 2020-11-14 01:34:43 [INFO] [TRAIN] epoch=9, iter=5560/40000, loss=0.5375, lr=0.008741, batch_cost=0.4417, reader_cost=0.0002 | ETA 04:13:32 2020-11-14 01:34:47 [INFO] [TRAIN] epoch=9, iter=5570/40000, loss=0.5481, lr=0.008739, batch_cost=0.4357, reader_cost=0.0002 | ETA 04:10:01 2020-11-14 01:34:52 [INFO] [TRAIN] epoch=9, iter=5580/40000, loss=0.5896, lr=0.008737, batch_cost=0.4535, reader_cost=0.0002 | ETA 04:20:10 2020-11-14 01:34:56 [INFO] [TRAIN] epoch=9, iter=5590/40000, loss=0.4386, lr=0.008734, batch_cost=0.4608, reader_cost=0.0002 | ETA 04:24:16 2020-11-14 01:35:01 [INFO] [TRAIN] epoch=9, iter=5600/40000, loss=0.6909, lr=0.008732, batch_cost=0.4560, reader_cost=0.0002 | ETA 04:21:27 2020-11-14 01:35:05 [INFO] [TRAIN] epoch=9, iter=5610/40000, loss=0.4819, lr=0.008730, batch_cost=0.4536, reader_cost=0.0002 | ETA 04:19:58 2020-11-14 01:35:10 [INFO] [TRAIN] epoch=9, iter=5620/40000, loss=0.5712, lr=0.008728, batch_cost=0.4682, reader_cost=0.0002 | ETA 04:28:16 2020-11-14 01:35:14 [INFO] [TRAIN] epoch=9, iter=5630/40000, loss=0.6257, lr=0.008725, batch_cost=0.4383, reader_cost=0.0002 | ETA 04:11:04 2020-11-14 01:35:19 [INFO] [TRAIN] epoch=9, iter=5640/40000, loss=0.6341, lr=0.008723, batch_cost=0.4498, reader_cost=0.0002 | ETA 04:17:34 2020-11-14 01:35:23 [INFO] [TRAIN] epoch=9, iter=5650/40000, loss=0.7070, lr=0.008721, batch_cost=0.4543, reader_cost=0.0002 | ETA 04:20:05 2020-11-14 01:35:28 [INFO] [TRAIN] epoch=9, iter=5660/40000, loss=0.2502, lr=0.008718, batch_cost=0.4543, reader_cost=0.0002 | ETA 04:19:59 2020-11-14 01:35:33 [INFO] [TRAIN] epoch=9, iter=5670/40000, loss=0.4974, lr=0.008716, batch_cost=0.4553, reader_cost=0.0002 | ETA 04:20:31 2020-11-14 01:35:37 [INFO] [TRAIN] epoch=9, iter=5680/40000, loss=0.3868, lr=0.008714, batch_cost=0.4466, reader_cost=0.0002 | ETA 04:15:27 2020-11-14 01:35:42 [INFO] [TRAIN] epoch=9, iter=5690/40000, loss=0.4748, lr=0.008712, batch_cost=0.4546, reader_cost=0.0002 | ETA 04:19:58 2020-11-14 01:35:46 [INFO] [TRAIN] epoch=9, iter=5700/40000, loss=0.6600, lr=0.008709, batch_cost=0.4890, reader_cost=0.0002 | ETA 04:39:32 2020-11-14 01:35:51 [INFO] [TRAIN] epoch=9, iter=5710/40000, loss=0.4225, lr=0.008707, batch_cost=0.4552, reader_cost=0.0002 | ETA 04:20:08 2020-11-14 01:35:56 [INFO] [TRAIN] epoch=9, iter=5720/40000, loss=0.7732, lr=0.008705, batch_cost=0.4591, reader_cost=0.0002 | ETA 04:22:18 2020-11-14 01:36:00 [INFO] [TRAIN] epoch=9, iter=5730/40000, loss=0.6730, lr=0.008703, batch_cost=0.4541, reader_cost=0.0002 | ETA 04:19:23 2020-11-14 01:36:05 [INFO] [TRAIN] epoch=9, iter=5740/40000, loss=0.6059, lr=0.008700, batch_cost=0.4984, reader_cost=0.0002 | ETA 04:44:36 2020-11-14 01:36:10 [INFO] [TRAIN] epoch=9, iter=5750/40000, loss=0.4659, lr=0.008698, batch_cost=0.4690, reader_cost=0.0002 | ETA 04:27:43 2020-11-14 01:36:14 [INFO] [TRAIN] epoch=9, iter=5760/40000, loss=0.3789, lr=0.008696, batch_cost=0.4355, reader_cost=0.0002 | ETA 04:08:30 2020-11-14 01:36:19 [INFO] [TRAIN] epoch=9, iter=5770/40000, loss=0.5631, lr=0.008693, batch_cost=0.4407, reader_cost=0.0002 | ETA 04:11:23 2020-11-14 01:36:23 [INFO] [TRAIN] epoch=9, iter=5780/40000, loss=0.6576, lr=0.008691, batch_cost=0.4479, reader_cost=0.0002 | ETA 04:15:28 2020-11-14 01:36:27 [INFO] [TRAIN] epoch=9, iter=5790/40000, loss=0.4516, lr=0.008689, batch_cost=0.4358, reader_cost=0.0002 | ETA 04:08:27 2020-11-14 01:36:32 [INFO] [TRAIN] epoch=9, iter=5800/40000, loss=0.5173, lr=0.008687, batch_cost=0.4351, reader_cost=0.0002 | ETA 04:07:59 2020-11-14 01:36:36 [INFO] [TRAIN] epoch=9, iter=5810/40000, loss=0.4487, lr=0.008684, batch_cost=0.4563, reader_cost=0.0002 | ETA 04:19:59 2020-11-14 01:36:41 [INFO] [TRAIN] epoch=9, iter=5820/40000, loss=0.4156, lr=0.008682, batch_cost=0.4307, reader_cost=0.0002 | ETA 04:05:21 2020-11-14 01:36:45 [INFO] [TRAIN] epoch=9, iter=5830/40000, loss=0.4297, lr=0.008680, batch_cost=0.4297, reader_cost=0.0002 | ETA 04:04:44 2020-11-14 01:36:49 [INFO] [TRAIN] epoch=9, iter=5840/40000, loss=0.4511, lr=0.008677, batch_cost=0.4317, reader_cost=0.0002 | ETA 04:05:48 2020-11-14 01:36:54 [INFO] [TRAIN] epoch=9, iter=5850/40000, loss=0.4960, lr=0.008675, batch_cost=0.4302, reader_cost=0.0002 | ETA 04:04:51 2020-11-14 01:36:58 [INFO] [TRAIN] epoch=9, iter=5860/40000, loss=0.5389, lr=0.008673, batch_cost=0.4302, reader_cost=0.0002 | ETA 04:04:48 2020-11-14 01:37:02 [INFO] [TRAIN] epoch=9, iter=5870/40000, loss=0.4247, lr=0.008671, batch_cost=0.4300, reader_cost=0.0002 | ETA 04:04:36 2020-11-14 01:37:07 [INFO] [TRAIN] epoch=9, iter=5880/40000, loss=0.3296, lr=0.008668, batch_cost=0.4310, reader_cost=0.0002 | ETA 04:05:06 2020-11-14 01:37:11 [INFO] [TRAIN] epoch=9, iter=5890/40000, loss=0.4400, lr=0.008666, batch_cost=0.4433, reader_cost=0.0002 | ETA 04:12:01 2020-11-14 01:37:16 [INFO] [TRAIN] epoch=9, iter=5900/40000, loss=0.5895, lr=0.008664, batch_cost=0.4730, reader_cost=0.0002 | ETA 04:28:47 2020-11-14 01:37:20 [INFO] [TRAIN] epoch=9, iter=5910/40000, loss=0.7947, lr=0.008661, batch_cost=0.4480, reader_cost=0.0002 | ETA 04:14:30 2020-11-14 01:37:25 [INFO] [TRAIN] epoch=9, iter=5920/40000, loss=0.4933, lr=0.008659, batch_cost=0.4369, reader_cost=0.0002 | ETA 04:08:07 2020-11-14 01:37:29 [INFO] [TRAIN] epoch=9, iter=5930/40000, loss=0.6371, lr=0.008657, batch_cost=0.4489, reader_cost=0.0002 | ETA 04:14:53 2020-11-14 01:37:33 [INFO] [TRAIN] epoch=9, iter=5940/40000, loss=0.4441, lr=0.008655, batch_cost=0.4381, reader_cost=0.0002 | ETA 04:08:42 2020-11-14 01:37:39 [INFO] [TRAIN] epoch=10, iter=5950/40000, loss=0.5521, lr=0.008652, batch_cost=0.5493, reader_cost=0.0880 | ETA 05:11:42 2020-11-14 01:37:44 [INFO] [TRAIN] epoch=10, iter=5960/40000, loss=0.5320, lr=0.008650, batch_cost=0.4803, reader_cost=0.0005 | ETA 04:32:29 2020-11-14 01:37:48 [INFO] [TRAIN] epoch=10, iter=5970/40000, loss=0.5407, lr=0.008648, batch_cost=0.4605, reader_cost=0.0002 | ETA 04:21:10 2020-11-14 01:37:53 [INFO] [TRAIN] epoch=10, iter=5980/40000, loss=0.3428, lr=0.008645, batch_cost=0.4691, reader_cost=0.0002 | ETA 04:26:00 2020-11-14 01:37:58 [INFO] [TRAIN] epoch=10, iter=5990/40000, loss=0.7296, lr=0.008643, batch_cost=0.5124, reader_cost=0.0002 | ETA 04:50:27 2020-11-14 01:38:03 [INFO] [TRAIN] epoch=10, iter=6000/40000, loss=0.4084, lr=0.008641, batch_cost=0.4743, reader_cost=0.0002 | ETA 04:28:45 2020-11-14 01:38:03 [INFO] Start evaluating (total_samples=1449, total_iters=363)... 2020-11-14 01:38:25 [INFO] [EVAL] #Images=1449 mIoU=0.6966 Acc=0.9302 Kappa=0.8457 2020-11-14 01:38:25 [INFO] [EVAL] Class IoU: [0.9266 0.8733 0.3685 0.845 0.6532 0.708 0.8954 0.816 0.8388 0.2809 0.7805 0.4345 0.7933 0.7637 0.7277 0.8212 0.5265 0.7936 0.4944 0.8187 0.4698] 2020-11-14 01:38:25 [INFO] [EVAL] Class Acc: [0.9577 0.8999 0.4163 0.9418 0.7243 0.8521 0.9797 0.9051 0.8793 0.6683 0.9133 0.9559 0.8813 0.9448 0.8178 0.9127 0.8796 0.9072 0.6641 0.9029 0.5005] 2020-11-14 01:38:36 [INFO] [EVAL] The model with the best validation mIoU (0.6966) was saved at iter 6000. 2020-11-14 01:38:41 [INFO] [TRAIN] epoch=10, iter=6010/40000, loss=0.5218, lr=0.008639, batch_cost=0.4757, reader_cost=0.0005 | ETA 04:29:29 2020-11-14 01:38:46 [INFO] [TRAIN] epoch=10, iter=6020/40000, loss=0.3430, lr=0.008636, batch_cost=0.5005, reader_cost=0.0003 | ETA 04:43:27 2020-11-14 01:38:51 [INFO] [TRAIN] epoch=10, iter=6030/40000, loss=0.5679, lr=0.008634, batch_cost=0.5128, reader_cost=0.0002 | ETA 04:50:18 2020-11-14 01:38:56 [INFO] [TRAIN] epoch=10, iter=6040/40000, loss=0.5166, lr=0.008632, batch_cost=0.5239, reader_cost=0.0062 | ETA 04:56:31 2020-11-14 01:39:01 [INFO] [TRAIN] epoch=10, iter=6050/40000, loss=0.3228, lr=0.008629, batch_cost=0.4442, reader_cost=0.0002 | ETA 04:11:21 2020-11-14 01:39:05 [INFO] [TRAIN] epoch=10, iter=6060/40000, loss=0.4750, lr=0.008627, batch_cost=0.4328, reader_cost=0.0002 | ETA 04:04:48 2020-11-14 01:39:10 [INFO] [TRAIN] epoch=10, iter=6070/40000, loss=0.2817, lr=0.008625, batch_cost=0.4565, reader_cost=0.0002 | ETA 04:18:09 2020-11-14 01:39:15 [INFO] [TRAIN] epoch=10, iter=6080/40000, loss=0.4258, lr=0.008623, batch_cost=0.4978, reader_cost=0.0002 | ETA 04:41:25 2020-11-14 01:39:19 [INFO] [TRAIN] epoch=10, iter=6090/40000, loss=0.4774, lr=0.008620, batch_cost=0.4431, reader_cost=0.0005 | ETA 04:10:24 2020-11-14 01:39:23 [INFO] [TRAIN] epoch=10, iter=6100/40000, loss=0.4261, lr=0.008618, batch_cost=0.4289, reader_cost=0.0002 | ETA 04:02:20 2020-11-14 01:39:28 [INFO] [TRAIN] epoch=10, iter=6110/40000, loss=0.4998, lr=0.008616, batch_cost=0.4287, reader_cost=0.0001 | ETA 04:02:07 2020-11-14 01:39:32 [INFO] [TRAIN] epoch=10, iter=6120/40000, loss=0.4982, lr=0.008613, batch_cost=0.4594, reader_cost=0.0002 | ETA 04:19:24 2020-11-14 01:39:37 [INFO] [TRAIN] epoch=10, iter=6130/40000, loss=0.4165, lr=0.008611, batch_cost=0.4403, reader_cost=0.0002 | ETA 04:08:31 2020-11-14 01:39:41 [INFO] [TRAIN] epoch=10, iter=6140/40000, loss=0.3544, lr=0.008609, batch_cost=0.4750, reader_cost=0.0002 | ETA 04:28:02 2020-11-14 01:39:46 [INFO] [TRAIN] epoch=10, iter=6150/40000, loss=0.3062, lr=0.008607, batch_cost=0.4723, reader_cost=0.0002 | ETA 04:26:28 2020-11-14 01:39:51 [INFO] [TRAIN] epoch=10, iter=6160/40000, loss=0.5563, lr=0.008604, batch_cost=0.4916, reader_cost=0.0002 | ETA 04:37:14 2020-11-14 01:39:56 [INFO] [TRAIN] epoch=10, iter=6170/40000, loss=0.5978, lr=0.008602, batch_cost=0.4778, reader_cost=0.0002 | ETA 04:29:25 2020-11-14 01:40:00 [INFO] [TRAIN] epoch=10, iter=6180/40000, loss=0.4605, lr=0.008600, batch_cost=0.4324, reader_cost=0.0002 | ETA 04:03:44 2020-11-14 01:40:04 [INFO] [TRAIN] epoch=10, iter=6190/40000, loss=0.6620, lr=0.008597, batch_cost=0.4335, reader_cost=0.0002 | ETA 04:04:15 2020-11-14 01:40:09 [INFO] [TRAIN] epoch=10, iter=6200/40000, loss=0.4173, lr=0.008595, batch_cost=0.4351, reader_cost=0.0002 | ETA 04:05:07 2020-11-14 01:40:13 [INFO] [TRAIN] epoch=10, iter=6210/40000, loss=0.6456, lr=0.008593, batch_cost=0.4679, reader_cost=0.0002 | ETA 04:23:30 2020-11-14 01:40:18 [INFO] [TRAIN] epoch=10, iter=6220/40000, loss=0.3676, lr=0.008591, batch_cost=0.4533, reader_cost=0.0002 | ETA 04:15:11 2020-11-14 01:40:23 [INFO] [TRAIN] epoch=10, iter=6230/40000, loss=0.3608, lr=0.008588, batch_cost=0.4583, reader_cost=0.0002 | ETA 04:17:55 2020-11-14 01:40:27 [INFO] [TRAIN] epoch=10, iter=6240/40000, loss=0.5515, lr=0.008586, batch_cost=0.4358, reader_cost=0.0002 | ETA 04:05:12 2020-11-14 01:40:31 [INFO] [TRAIN] epoch=10, iter=6250/40000, loss=0.5571, lr=0.008584, batch_cost=0.4473, reader_cost=0.0002 | ETA 04:11:36 2020-11-14 01:40:36 [INFO] [TRAIN] epoch=10, iter=6260/40000, loss=0.5685, lr=0.008581, batch_cost=0.4880, reader_cost=0.0002 | ETA 04:34:24 2020-11-14 01:40:41 [INFO] [TRAIN] epoch=10, iter=6270/40000, loss=0.5274, lr=0.008579, batch_cost=0.4405, reader_cost=0.0002 | ETA 04:07:38 2020-11-14 01:40:45 [INFO] [TRAIN] epoch=10, iter=6280/40000, loss=0.5093, lr=0.008577, batch_cost=0.4586, reader_cost=0.0002 | ETA 04:17:42 2020-11-14 01:40:50 [INFO] [TRAIN] epoch=10, iter=6290/40000, loss=0.3237, lr=0.008575, batch_cost=0.4510, reader_cost=0.0002 | ETA 04:13:22 2020-11-14 01:40:54 [INFO] [TRAIN] epoch=10, iter=6300/40000, loss=0.5618, lr=0.008572, batch_cost=0.4552, reader_cost=0.0002 | ETA 04:15:38 2020-11-14 01:40:59 [INFO] [TRAIN] epoch=10, iter=6310/40000, loss=0.3772, lr=0.008570, batch_cost=0.4346, reader_cost=0.0002 | ETA 04:04:03 2020-11-14 01:41:03 [INFO] [TRAIN] epoch=10, iter=6320/40000, loss=0.5878, lr=0.008568, batch_cost=0.4424, reader_cost=0.0002 | ETA 04:08:21 2020-11-14 01:41:08 [INFO] [TRAIN] epoch=10, iter=6330/40000, loss=0.4288, lr=0.008565, batch_cost=0.4510, reader_cost=0.0002 | ETA 04:13:03 2020-11-14 01:41:12 [INFO] [TRAIN] epoch=10, iter=6340/40000, loss=0.4394, lr=0.008563, batch_cost=0.4574, reader_cost=0.0002 | ETA 04:16:36 2020-11-14 01:41:17 [INFO] [TRAIN] epoch=10, iter=6350/40000, loss=0.5816, lr=0.008561, batch_cost=0.5033, reader_cost=0.0002 | ETA 04:42:15 2020-11-14 01:41:22 [INFO] [TRAIN] epoch=10, iter=6360/40000, loss=0.4516, lr=0.008559, batch_cost=0.4773, reader_cost=0.0002 | ETA 04:27:37 2020-11-14 01:41:27 [INFO] [TRAIN] epoch=10, iter=6370/40000, loss=0.4567, lr=0.008556, batch_cost=0.4653, reader_cost=0.0002 | ETA 04:20:49 2020-11-14 01:41:32 [INFO] [TRAIN] epoch=10, iter=6380/40000, loss=0.3957, lr=0.008554, batch_cost=0.4977, reader_cost=0.0002 | ETA 04:38:52 2020-11-14 01:41:37 [INFO] [TRAIN] epoch=10, iter=6390/40000, loss=0.6262, lr=0.008552, batch_cost=0.5576, reader_cost=0.0002 | ETA 05:12:21 2020-11-14 01:41:42 [INFO] [TRAIN] epoch=10, iter=6400/40000, loss=0.6013, lr=0.008549, batch_cost=0.4881, reader_cost=0.0015 | ETA 04:33:21 2020-11-14 01:41:47 [INFO] [TRAIN] epoch=10, iter=6410/40000, loss=0.5972, lr=0.008547, batch_cost=0.4848, reader_cost=0.0002 | ETA 04:31:24 2020-11-14 01:41:51 [INFO] [TRAIN] epoch=10, iter=6420/40000, loss=0.4281, lr=0.008545, batch_cost=0.4580, reader_cost=0.0002 | ETA 04:16:21 2020-11-14 01:41:56 [INFO] [TRAIN] epoch=10, iter=6430/40000, loss=0.5271, lr=0.008543, batch_cost=0.4953, reader_cost=0.0002 | ETA 04:37:07 2020-11-14 01:42:01 [INFO] [TRAIN] epoch=10, iter=6440/40000, loss=0.5413, lr=0.008540, batch_cost=0.4770, reader_cost=0.0002 | ETA 04:26:48 2020-11-14 01:42:06 [INFO] [TRAIN] epoch=10, iter=6450/40000, loss=0.6782, lr=0.008538, batch_cost=0.4677, reader_cost=0.0002 | ETA 04:21:31 2020-11-14 01:42:11 [INFO] [TRAIN] epoch=10, iter=6460/40000, loss=0.3733, lr=0.008536, batch_cost=0.4646, reader_cost=0.0002 | ETA 04:19:44 2020-11-14 01:42:15 [INFO] [TRAIN] epoch=10, iter=6470/40000, loss=0.3732, lr=0.008533, batch_cost=0.4914, reader_cost=0.0002 | ETA 04:34:36 2020-11-14 01:42:20 [INFO] [TRAIN] epoch=10, iter=6480/40000, loss=0.3724, lr=0.008531, batch_cost=0.4506, reader_cost=0.0002 | ETA 04:11:42 2020-11-14 01:42:25 [INFO] [TRAIN] epoch=10, iter=6490/40000, loss=0.3216, lr=0.008529, batch_cost=0.4725, reader_cost=0.0002 | ETA 04:23:54 2020-11-14 01:42:29 [INFO] [TRAIN] epoch=10, iter=6500/40000, loss=0.4212, lr=0.008527, batch_cost=0.4781, reader_cost=0.0002 | ETA 04:26:55 2020-11-14 01:42:34 [INFO] [TRAIN] epoch=10, iter=6510/40000, loss=0.3348, lr=0.008524, batch_cost=0.4780, reader_cost=0.0003 | ETA 04:26:49 2020-11-14 01:42:39 [INFO] [TRAIN] epoch=10, iter=6520/40000, loss=0.5145, lr=0.008522, batch_cost=0.4731, reader_cost=0.0002 | ETA 04:23:59 2020-11-14 01:42:43 [INFO] [TRAIN] epoch=10, iter=6530/40000, loss=0.3811, lr=0.008520, batch_cost=0.4511, reader_cost=0.0002 | ETA 04:11:38 2020-11-14 01:42:48 [INFO] [TRAIN] epoch=10, iter=6540/40000, loss=0.3985, lr=0.008517, batch_cost=0.4577, reader_cost=0.0002 | ETA 04:15:14 2020-11-14 01:42:53 [INFO] [TRAIN] epoch=10, iter=6550/40000, loss=0.3768, lr=0.008515, batch_cost=0.4623, reader_cost=0.0002 | ETA 04:17:43 2020-11-14 01:42:58 [INFO] [TRAIN] epoch=10, iter=6560/40000, loss=0.4197, lr=0.008513, batch_cost=0.5001, reader_cost=0.0015 | ETA 04:38:42 2020-11-14 01:43:03 [INFO] [TRAIN] epoch=10, iter=6570/40000, loss=0.7967, lr=0.008511, batch_cost=0.5104, reader_cost=0.0012 | ETA 04:44:22 2020-11-14 01:43:07 [INFO] [TRAIN] epoch=10, iter=6580/40000, loss=0.3649, lr=0.008508, batch_cost=0.4516, reader_cost=0.0002 | ETA 04:11:32 2020-11-14 01:43:12 [INFO] [TRAIN] epoch=10, iter=6590/40000, loss=0.3915, lr=0.008506, batch_cost=0.4445, reader_cost=0.0002 | ETA 04:07:30 2020-11-14 01:43:16 [INFO] [TRAIN] epoch=10, iter=6600/40000, loss=0.4733, lr=0.008504, batch_cost=0.4539, reader_cost=0.0002 | ETA 04:12:40 2020-11-14 01:43:21 [INFO] [TRAIN] epoch=10, iter=6610/40000, loss=0.5983, lr=0.008501, batch_cost=0.4528, reader_cost=0.0002 | ETA 04:11:58 2020-11-14 01:43:26 [INFO] [TRAIN] epoch=11, iter=6620/40000, loss=0.4973, lr=0.008499, batch_cost=0.5629, reader_cost=0.1224 | ETA 05:13:10 2020-11-14 01:43:31 [INFO] [TRAIN] epoch=11, iter=6630/40000, loss=0.5577, lr=0.008497, batch_cost=0.4312, reader_cost=0.0005 | ETA 03:59:50 2020-11-14 01:43:35 [INFO] [TRAIN] epoch=11, iter=6640/40000, loss=0.4389, lr=0.008495, batch_cost=0.4556, reader_cost=0.0002 | ETA 04:13:18 2020-11-14 01:43:40 [INFO] [TRAIN] epoch=11, iter=6650/40000, loss=0.4160, lr=0.008492, batch_cost=0.5154, reader_cost=0.0002 | ETA 04:46:29 2020-11-14 01:43:45 [INFO] [TRAIN] epoch=11, iter=6660/40000, loss=0.4040, lr=0.008490, batch_cost=0.4522, reader_cost=0.0002 | ETA 04:11:15 2020-11-14 01:43:50 [INFO] [TRAIN] epoch=11, iter=6670/40000, loss=0.4357, lr=0.008488, batch_cost=0.4576, reader_cost=0.0002 | ETA 04:14:12 2020-11-14 01:43:54 [INFO] [TRAIN] epoch=11, iter=6680/40000, loss=0.3430, lr=0.008485, batch_cost=0.4695, reader_cost=0.0002 | ETA 04:20:44 2020-11-14 01:43:59 [INFO] [TRAIN] epoch=11, iter=6690/40000, loss=0.4674, lr=0.008483, batch_cost=0.4799, reader_cost=0.0002 | ETA 04:26:27 2020-11-14 01:44:04 [INFO] [TRAIN] epoch=11, iter=6700/40000, loss=0.5578, lr=0.008481, batch_cost=0.4732, reader_cost=0.0002 | ETA 04:22:38 2020-11-14 01:44:08 [INFO] [TRAIN] epoch=11, iter=6710/40000, loss=0.5178, lr=0.008478, batch_cost=0.4603, reader_cost=0.0002 | ETA 04:15:22 2020-11-14 01:44:13 [INFO] [TRAIN] epoch=11, iter=6720/40000, loss=0.3973, lr=0.008476, batch_cost=0.4702, reader_cost=0.0002 | ETA 04:20:49 2020-11-14 01:44:18 [INFO] [TRAIN] epoch=11, iter=6730/40000, loss=0.6528, lr=0.008474, batch_cost=0.4864, reader_cost=0.0002 | ETA 04:29:43 2020-11-14 01:44:22 [INFO] [TRAIN] epoch=11, iter=6740/40000, loss=0.4960, lr=0.008472, batch_cost=0.4396, reader_cost=0.0002 | ETA 04:03:41 2020-11-14 01:44:27 [INFO] [TRAIN] epoch=11, iter=6750/40000, loss=0.4002, lr=0.008469, batch_cost=0.4360, reader_cost=0.0002 | ETA 04:01:38 2020-11-14 01:44:31 [INFO] [TRAIN] epoch=11, iter=6760/40000, loss=0.6991, lr=0.008467, batch_cost=0.4329, reader_cost=0.0002 | ETA 03:59:49 2020-11-14 01:44:35 [INFO] [TRAIN] epoch=11, iter=6770/40000, loss=0.3640, lr=0.008465, batch_cost=0.4267, reader_cost=0.0002 | ETA 03:56:17 2020-11-14 01:44:40 [INFO] [TRAIN] epoch=11, iter=6780/40000, loss=0.4750, lr=0.008462, batch_cost=0.4384, reader_cost=0.0002 | ETA 04:02:43 2020-11-14 01:44:44 [INFO] [TRAIN] epoch=11, iter=6790/40000, loss=0.4653, lr=0.008460, batch_cost=0.4621, reader_cost=0.0002 | ETA 04:15:46 2020-11-14 01:44:49 [INFO] [TRAIN] epoch=11, iter=6800/40000, loss=0.4640, lr=0.008458, batch_cost=0.4319, reader_cost=0.0002 | ETA 03:58:59 2020-11-14 01:44:53 [INFO] [TRAIN] epoch=11, iter=6810/40000, loss=0.5943, lr=0.008456, batch_cost=0.4352, reader_cost=0.0002 | ETA 04:00:42 2020-11-14 01:44:57 [INFO] [TRAIN] epoch=11, iter=6820/40000, loss=0.4533, lr=0.008453, batch_cost=0.4337, reader_cost=0.0002 | ETA 03:59:48 2020-11-14 01:45:02 [INFO] [TRAIN] epoch=11, iter=6830/40000, loss=0.5206, lr=0.008451, batch_cost=0.4464, reader_cost=0.0002 | ETA 04:06:48 2020-11-14 01:45:06 [INFO] [TRAIN] epoch=11, iter=6840/40000, loss=0.4055, lr=0.008449, batch_cost=0.4331, reader_cost=0.0002 | ETA 03:59:20 2020-11-14 01:45:10 [INFO] [TRAIN] epoch=11, iter=6850/40000, loss=0.3266, lr=0.008446, batch_cost=0.4331, reader_cost=0.0001 | ETA 03:59:17 2020-11-14 01:45:15 [INFO] [TRAIN] epoch=11, iter=6860/40000, loss=0.4795, lr=0.008444, batch_cost=0.4354, reader_cost=0.0002 | ETA 04:00:29 2020-11-14 01:45:19 [INFO] [TRAIN] epoch=11, iter=6870/40000, loss=0.5373, lr=0.008442, batch_cost=0.4399, reader_cost=0.0002 | ETA 04:02:54 2020-11-14 01:45:24 [INFO] [TRAIN] epoch=11, iter=6880/40000, loss=0.4047, lr=0.008440, batch_cost=0.4407, reader_cost=0.0002 | ETA 04:03:16 2020-11-14 01:45:28 [INFO] [TRAIN] epoch=11, iter=6890/40000, loss=0.3507, lr=0.008437, batch_cost=0.4399, reader_cost=0.0002 | ETA 04:02:46 2020-11-14 01:45:33 [INFO] [TRAIN] epoch=11, iter=6900/40000, loss=0.3655, lr=0.008435, batch_cost=0.4492, reader_cost=0.0002 | ETA 04:07:48 2020-11-14 01:45:37 [INFO] [TRAIN] epoch=11, iter=6910/40000, loss=0.3137, lr=0.008433, batch_cost=0.4494, reader_cost=0.0002 | ETA 04:07:51 2020-11-14 01:45:41 [INFO] [TRAIN] epoch=11, iter=6920/40000, loss=0.3565, lr=0.008430, batch_cost=0.4392, reader_cost=0.0002 | ETA 04:02:09 2020-11-14 01:45:46 [INFO] [TRAIN] epoch=11, iter=6930/40000, loss=0.6377, lr=0.008428, batch_cost=0.4471, reader_cost=0.0002 | ETA 04:06:25 2020-11-14 01:45:50 [INFO] [TRAIN] epoch=11, iter=6940/40000, loss=0.5722, lr=0.008426, batch_cost=0.4403, reader_cost=0.0002 | ETA 04:02:37 2020-11-14 01:45:55 [INFO] [TRAIN] epoch=11, iter=6950/40000, loss=0.5637, lr=0.008424, batch_cost=0.4338, reader_cost=0.0002 | ETA 03:58:57 2020-11-14 01:45:59 [INFO] [TRAIN] epoch=11, iter=6960/40000, loss=0.4555, lr=0.008421, batch_cost=0.4405, reader_cost=0.0002 | ETA 04:02:34 2020-11-14 01:46:03 [INFO] [TRAIN] epoch=11, iter=6970/40000, loss=0.3037, lr=0.008419, batch_cost=0.4361, reader_cost=0.0002 | ETA 04:00:03 2020-11-14 01:46:08 [INFO] [TRAIN] epoch=11, iter=6980/40000, loss=0.6329, lr=0.008417, batch_cost=0.4624, reader_cost=0.0002 | ETA 04:14:28 2020-11-14 01:46:13 [INFO] [TRAIN] epoch=11, iter=6990/40000, loss=0.3956, lr=0.008414, batch_cost=0.4470, reader_cost=0.0002 | ETA 04:05:56 2020-11-14 01:46:17 [INFO] [TRAIN] epoch=11, iter=7000/40000, loss=0.4539, lr=0.008412, batch_cost=0.4412, reader_cost=0.0002 | ETA 04:02:41 2020-11-14 01:46:21 [INFO] [TRAIN] epoch=11, iter=7010/40000, loss=0.4276, lr=0.008410, batch_cost=0.4528, reader_cost=0.0002 | ETA 04:08:56 2020-11-14 01:46:26 [INFO] [TRAIN] epoch=11, iter=7020/40000, loss=0.4587, lr=0.008407, batch_cost=0.4659, reader_cost=0.0002 | ETA 04:16:05 2020-11-14 01:46:31 [INFO] [TRAIN] epoch=11, iter=7030/40000, loss=0.6217, lr=0.008405, batch_cost=0.5062, reader_cost=0.0002 | ETA 04:38:10 2020-11-14 01:46:36 [INFO] [TRAIN] epoch=11, iter=7040/40000, loss=0.6712, lr=0.008403, batch_cost=0.4931, reader_cost=0.0002 | ETA 04:30:52 2020-11-14 01:46:41 [INFO] [TRAIN] epoch=11, iter=7050/40000, loss=0.4231, lr=0.008401, batch_cost=0.5048, reader_cost=0.0002 | ETA 04:37:13 2020-11-14 01:46:46 [INFO] [TRAIN] epoch=11, iter=7060/40000, loss=0.4547, lr=0.008398, batch_cost=0.4943, reader_cost=0.0002 | ETA 04:31:21 2020-11-14 01:46:51 [INFO] [TRAIN] epoch=11, iter=7070/40000, loss=0.6843, lr=0.008396, batch_cost=0.4852, reader_cost=0.0002 | ETA 04:26:18 2020-11-14 01:46:56 [INFO] [TRAIN] epoch=11, iter=7080/40000, loss=0.4671, lr=0.008394, batch_cost=0.4645, reader_cost=0.0002 | ETA 04:14:51 2020-11-14 01:47:00 [INFO] [TRAIN] epoch=11, iter=7090/40000, loss=0.5336, lr=0.008391, batch_cost=0.4427, reader_cost=0.0002 | ETA 04:02:49 2020-11-14 01:47:04 [INFO] [TRAIN] epoch=11, iter=7100/40000, loss=0.4756, lr=0.008389, batch_cost=0.4429, reader_cost=0.0002 | ETA 04:02:52 2020-11-14 01:47:09 [INFO] [TRAIN] epoch=11, iter=7110/40000, loss=0.4073, lr=0.008387, batch_cost=0.4347, reader_cost=0.0002 | ETA 03:58:18 2020-11-14 01:47:13 [INFO] [TRAIN] epoch=11, iter=7120/40000, loss=0.4211, lr=0.008385, batch_cost=0.4389, reader_cost=0.0002 | ETA 04:00:29 2020-11-14 01:47:18 [INFO] [TRAIN] epoch=11, iter=7130/40000, loss=0.3043, lr=0.008382, batch_cost=0.4373, reader_cost=0.0002 | ETA 03:59:35 2020-11-14 01:47:22 [INFO] [TRAIN] epoch=11, iter=7140/40000, loss=0.3794, lr=0.008380, batch_cost=0.4353, reader_cost=0.0002 | ETA 03:58:24 2020-11-14 01:47:26 [INFO] [TRAIN] epoch=11, iter=7150/40000, loss=0.5044, lr=0.008378, batch_cost=0.4391, reader_cost=0.0002 | ETA 04:00:24 2020-11-14 01:47:31 [INFO] [TRAIN] epoch=11, iter=7160/40000, loss=0.4295, lr=0.008375, batch_cost=0.4392, reader_cost=0.0002 | ETA 04:00:24 2020-11-14 01:47:35 [INFO] [TRAIN] epoch=11, iter=7170/40000, loss=0.3092, lr=0.008373, batch_cost=0.4352, reader_cost=0.0002 | ETA 03:58:06 2020-11-14 01:47:39 [INFO] [TRAIN] epoch=11, iter=7180/40000, loss=0.5849, lr=0.008371, batch_cost=0.4403, reader_cost=0.0002 | ETA 04:00:51 2020-11-14 01:47:44 [INFO] [TRAIN] epoch=11, iter=7190/40000, loss=0.4864, lr=0.008369, batch_cost=0.4445, reader_cost=0.0002 | ETA 04:03:05 2020-11-14 01:47:48 [INFO] [TRAIN] epoch=11, iter=7200/40000, loss=0.3803, lr=0.008366, batch_cost=0.4403, reader_cost=0.0002 | ETA 04:00:42 2020-11-14 01:47:53 [INFO] [TRAIN] epoch=11, iter=7210/40000, loss=0.4430, lr=0.008364, batch_cost=0.4392, reader_cost=0.0002 | ETA 04:00:01 2020-11-14 01:47:57 [INFO] [TRAIN] epoch=11, iter=7220/40000, loss=0.5373, lr=0.008362, batch_cost=0.4354, reader_cost=0.0002 | ETA 03:57:53 2020-11-14 01:48:01 [INFO] [TRAIN] epoch=11, iter=7230/40000, loss=0.4161, lr=0.008359, batch_cost=0.4336, reader_cost=0.0002 | ETA 03:56:50 2020-11-14 01:48:06 [INFO] [TRAIN] epoch=11, iter=7240/40000, loss=0.4664, lr=0.008357, batch_cost=0.4333, reader_cost=0.0002 | ETA 03:56:36 2020-11-14 01:48:10 [INFO] [TRAIN] epoch=11, iter=7250/40000, loss=0.3508, lr=0.008355, batch_cost=0.4378, reader_cost=0.0002 | ETA 03:58:58 2020-11-14 01:48:14 [INFO] [TRAIN] epoch=11, iter=7260/40000, loss=0.6738, lr=0.008352, batch_cost=0.4388, reader_cost=0.0002 | ETA 03:59:27 2020-11-14 01:48:19 [INFO] [TRAIN] epoch=11, iter=7270/40000, loss=0.5044, lr=0.008350, batch_cost=0.4360, reader_cost=0.0002 | ETA 03:57:51 2020-11-14 01:48:25 [INFO] [TRAIN] epoch=12, iter=7280/40000, loss=0.6248, lr=0.008348, batch_cost=0.5711, reader_cost=0.0916 | ETA 05:11:26 2020-11-14 01:48:29 [INFO] [TRAIN] epoch=12, iter=7290/40000, loss=0.6607, lr=0.008346, batch_cost=0.4585, reader_cost=0.0005 | ETA 04:09:56 2020-11-14 01:48:34 [INFO] [TRAIN] epoch=12, iter=7300/40000, loss=0.3238, lr=0.008343, batch_cost=0.4931, reader_cost=0.0002 | ETA 04:28:44 2020-11-14 01:48:39 [INFO] [TRAIN] epoch=12, iter=7310/40000, loss=0.4105, lr=0.008341, batch_cost=0.4744, reader_cost=0.0002 | ETA 04:18:28 2020-11-14 01:48:44 [INFO] [TRAIN] epoch=12, iter=7320/40000, loss=0.5378, lr=0.008339, batch_cost=0.4830, reader_cost=0.0002 | ETA 04:23:04 2020-11-14 01:48:49 [INFO] [TRAIN] epoch=12, iter=7330/40000, loss=0.4380, lr=0.008336, batch_cost=0.5147, reader_cost=0.0002 | ETA 04:40:14 2020-11-14 01:48:53 [INFO] [TRAIN] epoch=12, iter=7340/40000, loss=0.4601, lr=0.008334, batch_cost=0.4684, reader_cost=0.0002 | ETA 04:14:57 2020-11-14 01:48:58 [INFO] [TRAIN] epoch=12, iter=7350/40000, loss=0.4616, lr=0.008332, batch_cost=0.4671, reader_cost=0.0002 | ETA 04:14:10 2020-11-14 01:49:03 [INFO] [TRAIN] epoch=12, iter=7360/40000, loss=0.6176, lr=0.008330, batch_cost=0.4898, reader_cost=0.0002 | ETA 04:26:27 2020-11-14 01:49:08 [INFO] [TRAIN] epoch=12, iter=7370/40000, loss=0.4450, lr=0.008327, batch_cost=0.4896, reader_cost=0.0002 | ETA 04:26:17 2020-11-14 01:49:13 [INFO] [TRAIN] epoch=12, iter=7380/40000, loss=0.4711, lr=0.008325, batch_cost=0.5149, reader_cost=0.0002 | ETA 04:39:56 2020-11-14 01:49:18 [INFO] [TRAIN] epoch=12, iter=7390/40000, loss=0.4125, lr=0.008323, batch_cost=0.4889, reader_cost=0.0002 | ETA 04:25:42 2020-11-14 01:49:23 [INFO] [TRAIN] epoch=12, iter=7400/40000, loss=0.4109, lr=0.008320, batch_cost=0.4939, reader_cost=0.0002 | ETA 04:28:19 2020-11-14 01:49:27 [INFO] [TRAIN] epoch=12, iter=7410/40000, loss=0.3273, lr=0.008318, batch_cost=0.4454, reader_cost=0.0002 | ETA 04:01:56 2020-11-14 01:49:32 [INFO] [TRAIN] epoch=12, iter=7420/40000, loss=0.4374, lr=0.008316, batch_cost=0.4691, reader_cost=0.0002 | ETA 04:14:42 2020-11-14 01:49:37 [INFO] [TRAIN] epoch=12, iter=7430/40000, loss=0.4546, lr=0.008313, batch_cost=0.4714, reader_cost=0.0002 | ETA 04:15:51 2020-11-14 01:49:41 [INFO] [TRAIN] epoch=12, iter=7440/40000, loss=0.5169, lr=0.008311, batch_cost=0.4548, reader_cost=0.0002 | ETA 04:06:49 2020-11-14 01:49:46 [INFO] [TRAIN] epoch=12, iter=7450/40000, loss=0.4549, lr=0.008309, batch_cost=0.4549, reader_cost=0.0002 | ETA 04:06:46 2020-11-14 01:49:51 [INFO] [TRAIN] epoch=12, iter=7460/40000, loss=0.3169, lr=0.008307, batch_cost=0.4656, reader_cost=0.0002 | ETA 04:12:31 2020-11-14 01:49:55 [INFO] [TRAIN] epoch=12, iter=7470/40000, loss=0.3650, lr=0.008304, batch_cost=0.4722, reader_cost=0.0002 | ETA 04:16:00 2020-11-14 01:50:00 [INFO] [TRAIN] epoch=12, iter=7480/40000, loss=0.5222, lr=0.008302, batch_cost=0.4403, reader_cost=0.0002 | ETA 03:58:37 2020-11-14 01:50:04 [INFO] [TRAIN] epoch=12, iter=7490/40000, loss=0.4153, lr=0.008300, batch_cost=0.4395, reader_cost=0.0002 | ETA 03:58:06 2020-11-14 01:50:08 [INFO] [TRAIN] epoch=12, iter=7500/40000, loss=0.4452, lr=0.008297, batch_cost=0.4382, reader_cost=0.0002 | ETA 03:57:21 2020-11-14 01:50:13 [INFO] [TRAIN] epoch=12, iter=7510/40000, loss=0.2818, lr=0.008295, batch_cost=0.4416, reader_cost=0.0002 | ETA 03:59:07 2020-11-14 01:50:17 [INFO] [TRAIN] epoch=12, iter=7520/40000, loss=0.4342, lr=0.008293, batch_cost=0.4358, reader_cost=0.0002 | ETA 03:55:55 2020-11-14 01:50:22 [INFO] [TRAIN] epoch=12, iter=7530/40000, loss=0.3242, lr=0.008291, batch_cost=0.4414, reader_cost=0.0002 | ETA 03:58:52 2020-11-14 01:50:26 [INFO] [TRAIN] epoch=12, iter=7540/40000, loss=0.5566, lr=0.008288, batch_cost=0.4417, reader_cost=0.0012 | ETA 03:58:57 2020-11-14 01:50:30 [INFO] [TRAIN] epoch=12, iter=7550/40000, loss=0.4641, lr=0.008286, batch_cost=0.4337, reader_cost=0.0002 | ETA 03:54:32 2020-11-14 01:50:35 [INFO] [TRAIN] epoch=12, iter=7560/40000, loss=0.2722, lr=0.008284, batch_cost=0.4381, reader_cost=0.0002 | ETA 03:56:52 2020-11-14 01:50:39 [INFO] [TRAIN] epoch=12, iter=7570/40000, loss=0.4030, lr=0.008281, batch_cost=0.4310, reader_cost=0.0002 | ETA 03:52:56 2020-11-14 01:50:43 [INFO] [TRAIN] epoch=12, iter=7580/40000, loss=0.3722, lr=0.008279, batch_cost=0.4365, reader_cost=0.0008 | ETA 03:55:51 2020-11-14 01:50:48 [INFO] [TRAIN] epoch=12, iter=7590/40000, loss=0.4007, lr=0.008277, batch_cost=0.4291, reader_cost=0.0002 | ETA 03:51:48 2020-11-14 01:50:52 [INFO] [TRAIN] epoch=12, iter=7600/40000, loss=0.2904, lr=0.008274, batch_cost=0.4318, reader_cost=0.0002 | ETA 03:53:10 2020-11-14 01:50:57 [INFO] [TRAIN] epoch=12, iter=7610/40000, loss=0.3708, lr=0.008272, batch_cost=0.4774, reader_cost=0.0002 | ETA 04:17:41 2020-11-14 01:51:02 [INFO] [TRAIN] epoch=12, iter=7620/40000, loss=0.5015, lr=0.008270, batch_cost=0.5173, reader_cost=0.0011 | ETA 04:39:09 2020-11-14 01:51:07 [INFO] [TRAIN] epoch=12, iter=7630/40000, loss=0.4282, lr=0.008268, batch_cost=0.4648, reader_cost=0.0002 | ETA 04:10:47 2020-11-14 01:51:11 [INFO] [TRAIN] epoch=12, iter=7640/40000, loss=0.5521, lr=0.008265, batch_cost=0.4330, reader_cost=0.0002 | ETA 03:53:33 2020-11-14 01:51:15 [INFO] [TRAIN] epoch=12, iter=7650/40000, loss=0.4020, lr=0.008263, batch_cost=0.4355, reader_cost=0.0002 | ETA 03:54:47 2020-11-14 01:51:20 [INFO] [TRAIN] epoch=12, iter=7660/40000, loss=0.2792, lr=0.008261, batch_cost=0.4451, reader_cost=0.0009 | ETA 03:59:53 2020-11-14 01:51:24 [INFO] [TRAIN] epoch=12, iter=7670/40000, loss=0.5279, lr=0.008258, batch_cost=0.4344, reader_cost=0.0002 | ETA 03:54:05 2020-11-14 01:51:29 [INFO] [TRAIN] epoch=12, iter=7680/40000, loss=0.4328, lr=0.008256, batch_cost=0.4410, reader_cost=0.0002 | ETA 03:57:32 2020-11-14 01:51:33 [INFO] [TRAIN] epoch=12, iter=7690/40000, loss=0.4916, lr=0.008254, batch_cost=0.4387, reader_cost=0.0002 | ETA 03:56:14 2020-11-14 01:51:38 [INFO] [TRAIN] epoch=12, iter=7700/40000, loss=0.3671, lr=0.008251, batch_cost=0.4796, reader_cost=0.0002 | ETA 04:18:10 2020-11-14 01:51:42 [INFO] [TRAIN] epoch=12, iter=7710/40000, loss=0.5133, lr=0.008249, batch_cost=0.4585, reader_cost=0.0002 | ETA 04:06:45 2020-11-14 01:51:47 [INFO] [TRAIN] epoch=12, iter=7720/40000, loss=0.5767, lr=0.008247, batch_cost=0.4456, reader_cost=0.0002 | ETA 03:59:44 2020-11-14 01:51:51 [INFO] [TRAIN] epoch=12, iter=7730/40000, loss=0.5207, lr=0.008245, batch_cost=0.4555, reader_cost=0.0002 | ETA 04:04:59 2020-11-14 01:51:56 [INFO] [TRAIN] epoch=12, iter=7740/40000, loss=0.4536, lr=0.008242, batch_cost=0.4687, reader_cost=0.0002 | ETA 04:12:00 2020-11-14 01:52:01 [INFO] [TRAIN] epoch=12, iter=7750/40000, loss=0.4544, lr=0.008240, batch_cost=0.4743, reader_cost=0.0002 | ETA 04:14:57 2020-11-14 01:52:05 [INFO] [TRAIN] epoch=12, iter=7760/40000, loss=0.2869, lr=0.008238, batch_cost=0.4478, reader_cost=0.0002 | ETA 04:00:35 2020-11-14 01:52:10 [INFO] [TRAIN] epoch=12, iter=7770/40000, loss=0.3435, lr=0.008235, batch_cost=0.4929, reader_cost=0.0002 | ETA 04:24:44 2020-11-14 01:52:15 [INFO] [TRAIN] epoch=12, iter=7780/40000, loss=0.4845, lr=0.008233, batch_cost=0.4893, reader_cost=0.0002 | ETA 04:22:44 2020-11-14 01:52:20 [INFO] [TRAIN] epoch=12, iter=7790/40000, loss=0.4584, lr=0.008231, batch_cost=0.4752, reader_cost=0.0002 | ETA 04:15:04 2020-11-14 01:52:25 [INFO] [TRAIN] epoch=12, iter=7800/40000, loss=0.4852, lr=0.008229, batch_cost=0.4906, reader_cost=0.0002 | ETA 04:23:18 2020-11-14 01:52:29 [INFO] [TRAIN] epoch=12, iter=7810/40000, loss=0.3867, lr=0.008226, batch_cost=0.4549, reader_cost=0.0002 | ETA 04:04:04 2020-11-14 01:52:34 [INFO] [TRAIN] epoch=12, iter=7820/40000, loss=0.4960, lr=0.008224, batch_cost=0.4443, reader_cost=0.0002 | ETA 03:58:18 2020-11-14 01:52:38 [INFO] [TRAIN] epoch=12, iter=7830/40000, loss=0.3236, lr=0.008222, batch_cost=0.4447, reader_cost=0.0002 | ETA 03:58:26 2020-11-14 01:52:43 [INFO] [TRAIN] epoch=12, iter=7840/40000, loss=0.4340, lr=0.008219, batch_cost=0.4792, reader_cost=0.0002 | ETA 04:16:49 2020-11-14 01:52:48 [INFO] [TRAIN] epoch=12, iter=7850/40000, loss=0.5281, lr=0.008217, batch_cost=0.5268, reader_cost=0.0002 | ETA 04:42:16 2020-11-14 01:52:53 [INFO] [TRAIN] epoch=12, iter=7860/40000, loss=0.5843, lr=0.008215, batch_cost=0.4449, reader_cost=0.0002 | ETA 03:58:19 2020-11-14 01:52:57 [INFO] [TRAIN] epoch=12, iter=7870/40000, loss=0.3670, lr=0.008212, batch_cost=0.4543, reader_cost=0.0002 | ETA 04:03:17 2020-11-14 01:53:02 [INFO] [TRAIN] epoch=12, iter=7880/40000, loss=0.5380, lr=0.008210, batch_cost=0.5004, reader_cost=0.0002 | ETA 04:27:51 2020-11-14 01:53:08 [INFO] [TRAIN] epoch=12, iter=7890/40000, loss=0.4516, lr=0.008208, batch_cost=0.5371, reader_cost=0.0056 | ETA 04:47:25 2020-11-14 01:53:12 [INFO] [TRAIN] epoch=12, iter=7900/40000, loss=0.5091, lr=0.008206, batch_cost=0.4740, reader_cost=0.0083 | ETA 04:13:35 2020-11-14 01:53:17 [INFO] [TRAIN] epoch=12, iter=7910/40000, loss=0.4736, lr=0.008203, batch_cost=0.4821, reader_cost=0.0002 | ETA 04:17:51 2020-11-14 01:53:22 [INFO] [TRAIN] epoch=12, iter=7920/40000, loss=0.3212, lr=0.008201, batch_cost=0.5044, reader_cost=0.0002 | ETA 04:29:40 2020-11-14 01:53:27 [INFO] [TRAIN] epoch=12, iter=7930/40000, loss=0.5629, lr=0.008199, batch_cost=0.4766, reader_cost=0.0002 | ETA 04:14:45 2020-11-14 01:53:33 [INFO] [TRAIN] epoch=13, iter=7940/40000, loss=0.5233, lr=0.008196, batch_cost=0.5900, reader_cost=0.0843 | ETA 05:15:16 2020-11-14 01:53:37 [INFO] [TRAIN] epoch=13, iter=7950/40000, loss=0.4773, lr=0.008194, batch_cost=0.4452, reader_cost=0.0005 | ETA 03:57:48 2020-11-14 01:53:42 [INFO] [TRAIN] epoch=13, iter=7960/40000, loss=0.3726, lr=0.008192, batch_cost=0.4464, reader_cost=0.0002 | ETA 03:58:22 2020-11-14 01:53:46 [INFO] [TRAIN] epoch=13, iter=7970/40000, loss=0.3790, lr=0.008189, batch_cost=0.4474, reader_cost=0.0002 | ETA 03:58:49 2020-11-14 01:53:51 [INFO] [TRAIN] epoch=13, iter=7980/40000, loss=0.4796, lr=0.008187, batch_cost=0.4767, reader_cost=0.0002 | ETA 04:14:22 2020-11-14 01:53:56 [INFO] [TRAIN] epoch=13, iter=7990/40000, loss=0.5487, lr=0.008185, batch_cost=0.4771, reader_cost=0.0002 | ETA 04:14:31 2020-11-14 01:54:01 [INFO] [TRAIN] epoch=13, iter=8000/40000, loss=0.4300, lr=0.008183, batch_cost=0.4758, reader_cost=0.0002 | ETA 04:13:45 2020-11-14 01:54:01 [INFO] Start evaluating (total_samples=1449, total_iters=363)... 2020-11-14 01:54:24 [INFO] [EVAL] #Images=1449 mIoU=0.7401 Acc=0.9402 Kappa=0.8686 2020-11-14 01:54:24 [INFO] [EVAL] Class IoU: [0.9342 0.8705 0.3922 0.8506 0.6683 0.6251 0.9408 0.8391 0.8982 0.3583 0.8419 0.5504 0.8592 0.8618 0.8138 0.8316 0.5658 0.8251 0.4814 0.8587 0.6752] 2020-11-14 01:54:24 [INFO] [EVAL] Class Acc: [0.9642 0.8948 0.4037 0.8778 0.7632 0.9447 0.9713 0.882 0.9435 0.5356 0.9298 0.9407 0.9276 0.9346 0.8733 0.9216 0.7104 0.8702 0.7787 0.9037 0.7474] 2020-11-14 01:54:34 [INFO] [EVAL] The model with the best validation mIoU (0.7401) was saved at iter 8000. 2020-11-14 01:54:38 [INFO] [TRAIN] epoch=13, iter=8010/40000, loss=0.3107, lr=0.008180, batch_cost=0.4376, reader_cost=0.0005 | ETA 03:53:17 2020-11-14 01:54:43 [INFO] [TRAIN] epoch=13, iter=8020/40000, loss=0.6518, lr=0.008178, batch_cost=0.4441, reader_cost=0.0006 | ETA 03:56:41 2020-11-14 01:54:47 [INFO] [TRAIN] epoch=13, iter=8030/40000, loss=0.3215, lr=0.008176, batch_cost=0.4355, reader_cost=0.0005 | ETA 03:52:03 2020-11-14 01:54:51 [INFO] [TRAIN] epoch=13, iter=8040/40000, loss=0.3325, lr=0.008173, batch_cost=0.4489, reader_cost=0.0002 | ETA 03:59:05 2020-11-14 01:54:56 [INFO] [TRAIN] epoch=13, iter=8050/40000, loss=0.5069, lr=0.008171, batch_cost=0.4392, reader_cost=0.0002 | ETA 03:53:53 2020-11-14 01:55:00 [INFO] [TRAIN] epoch=13, iter=8060/40000, loss=0.4110, lr=0.008169, batch_cost=0.4403, reader_cost=0.0002 | ETA 03:54:22 2020-11-14 01:55:05 [INFO] [TRAIN] epoch=13, iter=8070/40000, loss=0.4410, lr=0.008166, batch_cost=0.4375, reader_cost=0.0002 | ETA 03:52:48 2020-11-14 01:55:09 [INFO] [TRAIN] epoch=13, iter=8080/40000, loss=0.3954, lr=0.008164, batch_cost=0.4534, reader_cost=0.0002 | ETA 04:01:13 2020-11-14 01:55:14 [INFO] [TRAIN] epoch=13, iter=8090/40000, loss=0.3789, lr=0.008162, batch_cost=0.4649, reader_cost=0.0002 | ETA 04:07:14 2020-11-14 01:55:18 [INFO] [TRAIN] epoch=13, iter=8100/40000, loss=0.3733, lr=0.008160, batch_cost=0.4488, reader_cost=0.0002 | ETA 03:58:36 2020-11-14 01:55:23 [INFO] [TRAIN] epoch=13, iter=8110/40000, loss=0.3856, lr=0.008157, batch_cost=0.4404, reader_cost=0.0002 | ETA 03:54:03 2020-11-14 01:55:27 [INFO] [TRAIN] epoch=13, iter=8120/40000, loss=0.5131, lr=0.008155, batch_cost=0.4335, reader_cost=0.0002 | ETA 03:50:21 2020-11-14 01:55:31 [INFO] [TRAIN] epoch=13, iter=8130/40000, loss=0.4525, lr=0.008153, batch_cost=0.4399, reader_cost=0.0002 | ETA 03:53:40 2020-11-14 01:55:36 [INFO] [TRAIN] epoch=13, iter=8140/40000, loss=0.4082, lr=0.008150, batch_cost=0.4361, reader_cost=0.0002 | ETA 03:51:33 2020-11-14 01:55:40 [INFO] [TRAIN] epoch=13, iter=8150/40000, loss=0.5927, lr=0.008148, batch_cost=0.4657, reader_cost=0.0002 | ETA 04:07:11 2020-11-14 01:55:45 [INFO] [TRAIN] epoch=13, iter=8160/40000, loss=0.4849, lr=0.008146, batch_cost=0.4507, reader_cost=0.0002 | ETA 03:59:09 2020-11-14 01:55:50 [INFO] [TRAIN] epoch=13, iter=8170/40000, loss=0.4656, lr=0.008143, batch_cost=0.4603, reader_cost=0.0002 | ETA 04:04:12 2020-11-14 01:55:54 [INFO] [TRAIN] epoch=13, iter=8180/40000, loss=0.4273, lr=0.008141, batch_cost=0.4554, reader_cost=0.0002 | ETA 04:01:29 2020-11-14 01:55:59 [INFO] [TRAIN] epoch=13, iter=8190/40000, loss=0.5637, lr=0.008139, batch_cost=0.4451, reader_cost=0.0002 | ETA 03:55:58 2020-11-14 01:56:03 [INFO] [TRAIN] epoch=13, iter=8200/40000, loss=0.4784, lr=0.008137, batch_cost=0.4321, reader_cost=0.0002 | ETA 03:49:00 2020-11-14 01:56:07 [INFO] [TRAIN] epoch=13, iter=8210/40000, loss=0.3819, lr=0.008134, batch_cost=0.4281, reader_cost=0.0002 | ETA 03:46:50 2020-11-14 01:56:12 [INFO] [TRAIN] epoch=13, iter=8220/40000, loss=0.3408, lr=0.008132, batch_cost=0.4330, reader_cost=0.0002 | ETA 03:49:22 2020-11-14 01:56:16 [INFO] [TRAIN] epoch=13, iter=8230/40000, loss=0.3782, lr=0.008130, batch_cost=0.4393, reader_cost=0.0002 | ETA 03:52:35 2020-11-14 01:56:20 [INFO] [TRAIN] epoch=13, iter=8240/40000, loss=0.4772, lr=0.008127, batch_cost=0.4400, reader_cost=0.0002 | ETA 03:52:55 2020-11-14 01:56:25 [INFO] [TRAIN] epoch=13, iter=8250/40000, loss=0.4591, lr=0.008125, batch_cost=0.4277, reader_cost=0.0001 | ETA 03:46:18 2020-11-14 01:56:29 [INFO] [TRAIN] epoch=13, iter=8260/40000, loss=0.3392, lr=0.008123, batch_cost=0.4311, reader_cost=0.0001 | ETA 03:48:03 2020-11-14 01:56:33 [INFO] [TRAIN] epoch=13, iter=8270/40000, loss=0.4835, lr=0.008120, batch_cost=0.4289, reader_cost=0.0001 | ETA 03:46:49 2020-11-14 01:56:37 [INFO] [TRAIN] epoch=13, iter=8280/40000, loss=0.4379, lr=0.008118, batch_cost=0.4290, reader_cost=0.0002 | ETA 03:46:47 2020-11-14 01:56:42 [INFO] [TRAIN] epoch=13, iter=8290/40000, loss=0.4458, lr=0.008116, batch_cost=0.4334, reader_cost=0.0002 | ETA 03:49:02 2020-11-14 01:56:46 [INFO] [TRAIN] epoch=13, iter=8300/40000, loss=0.3583, lr=0.008114, batch_cost=0.4368, reader_cost=0.0002 | ETA 03:50:47 2020-11-14 01:56:51 [INFO] [TRAIN] epoch=13, iter=8310/40000, loss=0.5210, lr=0.008111, batch_cost=0.4329, reader_cost=0.0002 | ETA 03:48:38 2020-11-14 01:56:55 [INFO] [TRAIN] epoch=13, iter=8320/40000, loss=0.4205, lr=0.008109, batch_cost=0.4302, reader_cost=0.0002 | ETA 03:47:09 2020-11-14 01:56:59 [INFO] [TRAIN] epoch=13, iter=8330/40000, loss=0.5165, lr=0.008107, batch_cost=0.4346, reader_cost=0.0002 | ETA 03:49:24 2020-11-14 01:57:04 [INFO] [TRAIN] epoch=13, iter=8340/40000, loss=0.6541, lr=0.008104, batch_cost=0.4327, reader_cost=0.0002 | ETA 03:48:19 2020-11-14 01:57:08 [INFO] [TRAIN] epoch=13, iter=8350/40000, loss=0.3571, lr=0.008102, batch_cost=0.4404, reader_cost=0.0002 | ETA 03:52:18 2020-11-14 01:57:12 [INFO] [TRAIN] epoch=13, iter=8360/40000, loss=0.4720, lr=0.008100, batch_cost=0.4340, reader_cost=0.0002 | ETA 03:48:50 2020-11-14 01:57:17 [INFO] [TRAIN] epoch=13, iter=8370/40000, loss=0.4811, lr=0.008097, batch_cost=0.4518, reader_cost=0.0080 | ETA 03:58:10 2020-11-14 01:57:21 [INFO] [TRAIN] epoch=13, iter=8380/40000, loss=0.4559, lr=0.008095, batch_cost=0.4647, reader_cost=0.0132 | ETA 04:04:53 2020-11-14 01:57:26 [INFO] [TRAIN] epoch=13, iter=8390/40000, loss=0.7131, lr=0.008093, batch_cost=0.4963, reader_cost=0.0109 | ETA 04:21:27 2020-11-14 01:57:31 [INFO] [TRAIN] epoch=13, iter=8400/40000, loss=0.5453, lr=0.008091, batch_cost=0.4634, reader_cost=0.0118 | ETA 04:04:01 2020-11-14 01:57:36 [INFO] [TRAIN] epoch=13, iter=8410/40000, loss=0.7395, lr=0.008088, batch_cost=0.4558, reader_cost=0.0118 | ETA 03:59:58 2020-11-14 01:57:40 [INFO] [TRAIN] epoch=13, iter=8420/40000, loss=0.3654, lr=0.008086, batch_cost=0.4562, reader_cost=0.0114 | ETA 04:00:06 2020-11-14 01:57:45 [INFO] [TRAIN] epoch=13, iter=8430/40000, loss=0.3327, lr=0.008084, batch_cost=0.4853, reader_cost=0.0088 | ETA 04:15:21 2020-11-14 01:57:50 [INFO] [TRAIN] epoch=13, iter=8440/40000, loss=0.4471, lr=0.008081, batch_cost=0.4626, reader_cost=0.0035 | ETA 04:03:20 2020-11-14 01:57:54 [INFO] [TRAIN] epoch=13, iter=8450/40000, loss=0.3725, lr=0.008079, batch_cost=0.4771, reader_cost=0.0054 | ETA 04:10:52 2020-11-14 01:57:59 [INFO] [TRAIN] epoch=13, iter=8460/40000, loss=0.4636, lr=0.008077, batch_cost=0.4519, reader_cost=0.0002 | ETA 03:57:31 2020-11-14 01:58:04 [INFO] [TRAIN] epoch=13, iter=8470/40000, loss=0.3955, lr=0.008074, batch_cost=0.5000, reader_cost=0.0016 | ETA 04:22:45 2020-11-14 01:58:09 [INFO] [TRAIN] epoch=13, iter=8480/40000, loss=0.3367, lr=0.008072, batch_cost=0.4588, reader_cost=0.0013 | ETA 04:01:00 2020-11-14 01:58:13 [INFO] [TRAIN] epoch=13, iter=8490/40000, loss=0.4262, lr=0.008070, batch_cost=0.4747, reader_cost=0.0002 | ETA 04:09:18 2020-11-14 01:58:18 [INFO] [TRAIN] epoch=13, iter=8500/40000, loss=0.5084, lr=0.008068, batch_cost=0.4943, reader_cost=0.0002 | ETA 04:19:30 2020-11-14 01:58:23 [INFO] [TRAIN] epoch=13, iter=8510/40000, loss=0.5577, lr=0.008065, batch_cost=0.4547, reader_cost=0.0002 | ETA 03:58:37 2020-11-14 01:58:27 [INFO] [TRAIN] epoch=13, iter=8520/40000, loss=0.2737, lr=0.008063, batch_cost=0.4589, reader_cost=0.0002 | ETA 04:00:45 2020-11-14 01:58:32 [INFO] [TRAIN] epoch=13, iter=8530/40000, loss=0.5420, lr=0.008061, batch_cost=0.4698, reader_cost=0.0002 | ETA 04:06:24 2020-11-14 01:58:37 [INFO] [TRAIN] epoch=13, iter=8540/40000, loss=0.3891, lr=0.008058, batch_cost=0.5008, reader_cost=0.0002 | ETA 04:22:33 2020-11-14 01:58:42 [INFO] [TRAIN] epoch=13, iter=8550/40000, loss=0.3636, lr=0.008056, batch_cost=0.4910, reader_cost=0.0002 | ETA 04:17:21 2020-11-14 01:58:47 [INFO] [TRAIN] epoch=13, iter=8560/40000, loss=0.6607, lr=0.008054, batch_cost=0.4655, reader_cost=0.0002 | ETA 04:03:54 2020-11-14 01:58:51 [INFO] [TRAIN] epoch=13, iter=8570/40000, loss=0.4116, lr=0.008051, batch_cost=0.4367, reader_cost=0.0002 | ETA 03:48:46 2020-11-14 01:58:55 [INFO] [TRAIN] epoch=13, iter=8580/40000, loss=0.3427, lr=0.008049, batch_cost=0.4374, reader_cost=0.0002 | ETA 03:49:01 2020-11-14 01:59:00 [INFO] [TRAIN] epoch=13, iter=8590/40000, loss=0.3814, lr=0.008047, batch_cost=0.4307, reader_cost=0.0004 | ETA 03:45:28 2020-11-14 01:59:06 [INFO] [TRAIN] epoch=14, iter=8600/40000, loss=0.4483, lr=0.008045, batch_cost=0.6504, reader_cost=0.0901 | ETA 05:40:21 2020-11-14 01:59:11 [INFO] [TRAIN] epoch=14, iter=8610/40000, loss=0.3988, lr=0.008042, batch_cost=0.4894, reader_cost=0.0005 | ETA 04:16:02 2020-11-14 01:59:16 [INFO] [TRAIN] epoch=14, iter=8620/40000, loss=0.4348, lr=0.008040, batch_cost=0.4702, reader_cost=0.0002 | ETA 04:05:54 2020-11-14 01:59:21 [INFO] [TRAIN] epoch=14, iter=8630/40000, loss=0.3284, lr=0.008038, batch_cost=0.4823, reader_cost=0.0002 | ETA 04:12:09 2020-11-14 01:59:25 [INFO] [TRAIN] epoch=14, iter=8640/40000, loss=0.3614, lr=0.008035, batch_cost=0.4511, reader_cost=0.0002 | ETA 03:55:47 2020-11-14 01:59:30 [INFO] [TRAIN] epoch=14, iter=8650/40000, loss=0.3595, lr=0.008033, batch_cost=0.4412, reader_cost=0.0002 | ETA 03:50:30 2020-11-14 01:59:34 [INFO] [TRAIN] epoch=14, iter=8660/40000, loss=0.2873, lr=0.008031, batch_cost=0.4400, reader_cost=0.0002 | ETA 03:49:49 2020-11-14 01:59:39 [INFO] [TRAIN] epoch=14, iter=8670/40000, loss=0.3443, lr=0.008028, batch_cost=0.4772, reader_cost=0.0002 | ETA 04:09:10 2020-11-14 01:59:43 [INFO] [TRAIN] epoch=14, iter=8680/40000, loss=0.6189, lr=0.008026, batch_cost=0.4555, reader_cost=0.0066 | ETA 03:57:47 2020-11-14 01:59:48 [INFO] [TRAIN] epoch=14, iter=8690/40000, loss=0.4285, lr=0.008024, batch_cost=0.4430, reader_cost=0.0002 | ETA 03:51:09 2020-11-14 01:59:52 [INFO] [TRAIN] epoch=14, iter=8700/40000, loss=0.3786, lr=0.008022, batch_cost=0.4435, reader_cost=0.0002 | ETA 03:51:20 2020-11-14 01:59:57 [INFO] [TRAIN] epoch=14, iter=8710/40000, loss=0.4096, lr=0.008019, batch_cost=0.4562, reader_cost=0.0011 | ETA 03:57:55 2020-11-14 02:00:01 [INFO] [TRAIN] epoch=14, iter=8720/40000, loss=0.4216, lr=0.008017, batch_cost=0.4494, reader_cost=0.0023 | ETA 03:54:18 2020-11-14 02:00:06 [INFO] [TRAIN] epoch=14, iter=8730/40000, loss=0.3831, lr=0.008015, batch_cost=0.4435, reader_cost=0.0002 | ETA 03:51:09 2020-11-14 02:00:10 [INFO] [TRAIN] epoch=14, iter=8740/40000, loss=0.3252, lr=0.008012, batch_cost=0.4429, reader_cost=0.0002 | ETA 03:50:46 2020-11-14 02:00:14 [INFO] [TRAIN] epoch=14, iter=8750/40000, loss=0.4935, lr=0.008010, batch_cost=0.4436, reader_cost=0.0002 | ETA 03:51:02 2020-11-14 02:00:19 [INFO] [TRAIN] epoch=14, iter=8760/40000, loss=0.2769, lr=0.008008, batch_cost=0.4501, reader_cost=0.0002 | ETA 03:54:22 2020-11-14 02:00:26 [INFO] [TRAIN] epoch=14, iter=8770/40000, loss=0.4641, lr=0.008005, batch_cost=0.6752, reader_cost=0.0002 | ETA 05:51:25 2020-11-14 02:00:30 [INFO] [TRAIN] epoch=14, iter=8780/40000, loss=0.3893, lr=0.008003, batch_cost=0.4423, reader_cost=0.0002 | ETA 03:50:08 2020-11-14 02:00:35 [INFO] [TRAIN] epoch=14, iter=8790/40000, loss=0.4520, lr=0.008001, batch_cost=0.4432, reader_cost=0.0002 | ETA 03:50:32 2020-11-14 02:00:39 [INFO] [TRAIN] epoch=14, iter=8800/40000, loss=0.4782, lr=0.007998, batch_cost=0.4419, reader_cost=0.0002 | ETA 03:49:46 2020-11-14 02:00:43 [INFO] [TRAIN] epoch=14, iter=8810/40000, loss=0.4220, lr=0.007996, batch_cost=0.4421, reader_cost=0.0002 | ETA 03:49:49 2020-11-14 02:00:49 [INFO] [TRAIN] epoch=14, iter=8820/40000, loss=0.4218, lr=0.007994, batch_cost=0.5570, reader_cost=0.0002 | ETA 04:49:25 2020-11-14 02:00:53 [INFO] [TRAIN] epoch=14, iter=8830/40000, loss=0.3770, lr=0.007992, batch_cost=0.4465, reader_cost=0.0002 | ETA 03:51:58 2020-11-14 02:00:58 [INFO] [TRAIN] epoch=14, iter=8840/40000, loss=0.2864, lr=0.007989, batch_cost=0.4565, reader_cost=0.0002 | ETA 03:57:05 2020-11-14 02:01:03 [INFO] [TRAIN] epoch=14, iter=8850/40000, loss=0.4949, lr=0.007987, batch_cost=0.4557, reader_cost=0.0002 | ETA 03:56:35 2020-11-14 02:01:08 [INFO] [TRAIN] epoch=14, iter=8860/40000, loss=0.3365, lr=0.007985, batch_cost=0.5430, reader_cost=0.0002 | ETA 04:41:47 2020-11-14 02:01:13 [INFO] [TRAIN] epoch=14, iter=8870/40000, loss=0.5347, lr=0.007982, batch_cost=0.4940, reader_cost=0.0002 | ETA 04:16:17 2020-11-14 02:01:18 [INFO] [TRAIN] epoch=14, iter=8880/40000, loss=0.4133, lr=0.007980, batch_cost=0.4573, reader_cost=0.0002 | ETA 03:57:10 2020-11-14 02:01:22 [INFO] [TRAIN] epoch=14, iter=8890/40000, loss=0.5303, lr=0.007978, batch_cost=0.4610, reader_cost=0.0002 | ETA 03:59:02 2020-11-14 02:01:27 [INFO] [TRAIN] epoch=14, iter=8900/40000, loss=0.4191, lr=0.007975, batch_cost=0.4651, reader_cost=0.0002 | ETA 04:01:04 2020-11-14 02:01:32 [INFO] [TRAIN] epoch=14, iter=8910/40000, loss=0.4853, lr=0.007973, batch_cost=0.4915, reader_cost=0.0002 | ETA 04:14:39 2020-11-14 02:01:37 [INFO] [TRAIN] epoch=14, iter=8920/40000, loss=0.5178, lr=0.007971, batch_cost=0.4807, reader_cost=0.0002 | ETA 04:09:00 2020-11-14 02:01:42 [INFO] [TRAIN] epoch=14, iter=8930/40000, loss=0.7330, lr=0.007968, batch_cost=0.5011, reader_cost=0.0002 | ETA 04:19:28 2020-11-14 02:01:46 [INFO] [TRAIN] epoch=14, iter=8940/40000, loss=0.4601, lr=0.007966, batch_cost=0.4584, reader_cost=0.0002 | ETA 03:57:17 2020-11-14 02:01:51 [INFO] [TRAIN] epoch=14, iter=8950/40000, loss=0.3749, lr=0.007964, batch_cost=0.4761, reader_cost=0.0002 | ETA 04:06:23 2020-11-14 02:01:55 [INFO] [TRAIN] epoch=14, iter=8960/40000, loss=0.4822, lr=0.007962, batch_cost=0.4541, reader_cost=0.0002 | ETA 03:54:54 2020-11-14 02:02:00 [INFO] [TRAIN] epoch=14, iter=8970/40000, loss=0.4521, lr=0.007959, batch_cost=0.4429, reader_cost=0.0002 | ETA 03:49:04 2020-11-14 02:02:05 [INFO] [TRAIN] epoch=14, iter=8980/40000, loss=0.4776, lr=0.007957, batch_cost=0.4652, reader_cost=0.0002 | ETA 04:00:29 2020-11-14 02:02:09 [INFO] [TRAIN] epoch=14, iter=8990/40000, loss=0.4047, lr=0.007955, batch_cost=0.4487, reader_cost=0.0002 | ETA 03:51:54 2020-11-14 02:02:13 [INFO] [TRAIN] epoch=14, iter=9000/40000, loss=0.3204, lr=0.007952, batch_cost=0.4376, reader_cost=0.0002 | ETA 03:46:05 2020-11-14 02:02:18 [INFO] [TRAIN] epoch=14, iter=9010/40000, loss=0.3473, lr=0.007950, batch_cost=0.4360, reader_cost=0.0002 | ETA 03:45:12 2020-11-14 02:02:22 [INFO] [TRAIN] epoch=14, iter=9020/40000, loss=0.3603, lr=0.007948, batch_cost=0.4609, reader_cost=0.0002 | ETA 03:57:59 2020-11-14 02:02:27 [INFO] [TRAIN] epoch=14, iter=9030/40000, loss=0.3784, lr=0.007945, batch_cost=0.4656, reader_cost=0.0002 | ETA 04:00:20 2020-11-14 02:02:32 [INFO] [TRAIN] epoch=14, iter=9040/40000, loss=0.5282, lr=0.007943, batch_cost=0.4816, reader_cost=0.0010 | ETA 04:08:29 2020-11-14 02:02:37 [INFO] [TRAIN] epoch=14, iter=9050/40000, loss=0.3769, lr=0.007941, batch_cost=0.4714, reader_cost=0.0002 | ETA 04:03:10 2020-11-14 02:02:43 [INFO] [TRAIN] epoch=14, iter=9060/40000, loss=0.4314, lr=0.007939, batch_cost=0.6110, reader_cost=0.0005 | ETA 05:15:02 2020-11-14 02:02:48 [INFO] [TRAIN] epoch=14, iter=9070/40000, loss=0.3596, lr=0.007936, batch_cost=0.5780, reader_cost=0.0003 | ETA 04:57:57 2020-11-14 02:02:53 [INFO] [TRAIN] epoch=14, iter=9080/40000, loss=0.3727, lr=0.007934, batch_cost=0.4453, reader_cost=0.0002 | ETA 03:49:27 2020-11-14 02:02:57 [INFO] [TRAIN] epoch=14, iter=9090/40000, loss=0.4652, lr=0.007932, batch_cost=0.4573, reader_cost=0.0002 | ETA 03:55:33 2020-11-14 02:03:02 [INFO] [TRAIN] epoch=14, iter=9100/40000, loss=0.4054, lr=0.007929, batch_cost=0.4765, reader_cost=0.0017 | ETA 04:05:24 2020-11-14 02:03:07 [INFO] [TRAIN] epoch=14, iter=9110/40000, loss=0.3675, lr=0.007927, batch_cost=0.4519, reader_cost=0.0003 | ETA 03:52:40 2020-11-14 02:03:12 [INFO] [TRAIN] epoch=14, iter=9120/40000, loss=0.5013, lr=0.007925, batch_cost=0.4821, reader_cost=0.0003 | ETA 04:08:07 2020-11-14 02:03:16 [INFO] [TRAIN] epoch=14, iter=9130/40000, loss=0.3350, lr=0.007922, batch_cost=0.4836, reader_cost=0.0005 | ETA 04:08:49 2020-11-14 02:03:21 [INFO] [TRAIN] epoch=14, iter=9140/40000, loss=0.4502, lr=0.007920, batch_cost=0.4567, reader_cost=0.0002 | ETA 03:54:54 2020-11-14 02:03:26 [INFO] [TRAIN] epoch=14, iter=9150/40000, loss=0.4352, lr=0.007918, batch_cost=0.4614, reader_cost=0.0003 | ETA 03:57:15 2020-11-14 02:03:30 [INFO] [TRAIN] epoch=14, iter=9160/40000, loss=0.3492, lr=0.007915, batch_cost=0.4475, reader_cost=0.0002 | ETA 03:50:01 2020-11-14 02:03:35 [INFO] [TRAIN] epoch=14, iter=9170/40000, loss=0.3710, lr=0.007913, batch_cost=0.5045, reader_cost=0.0002 | ETA 04:19:13 2020-11-14 02:03:40 [INFO] [TRAIN] epoch=14, iter=9180/40000, loss=0.3320, lr=0.007911, batch_cost=0.4872, reader_cost=0.0003 | ETA 04:10:15 2020-11-14 02:03:44 [INFO] [TRAIN] epoch=14, iter=9190/40000, loss=0.4062, lr=0.007909, batch_cost=0.4384, reader_cost=0.0003 | ETA 03:45:06 2020-11-14 02:03:49 [INFO] [TRAIN] epoch=14, iter=9200/40000, loss=0.5069, lr=0.007906, batch_cost=0.4394, reader_cost=0.0002 | ETA 03:45:33 2020-11-14 02:03:53 [INFO] [TRAIN] epoch=14, iter=9210/40000, loss=0.3214, lr=0.007904, batch_cost=0.4487, reader_cost=0.0002 | ETA 03:50:14 2020-11-14 02:03:58 [INFO] [TRAIN] epoch=14, iter=9220/40000, loss=0.4066, lr=0.007902, batch_cost=0.4340, reader_cost=0.0002 | ETA 03:42:37 2020-11-14 02:04:02 [INFO] [TRAIN] epoch=14, iter=9230/40000, loss=0.4344, lr=0.007899, batch_cost=0.4401, reader_cost=0.0002 | ETA 03:45:41 2020-11-14 02:04:06 [INFO] [TRAIN] epoch=14, iter=9240/40000, loss=0.3435, lr=0.007897, batch_cost=0.4365, reader_cost=0.0002 | ETA 03:43:46 2020-11-14 02:04:11 [INFO] [TRAIN] epoch=14, iter=9250/40000, loss=0.5010, lr=0.007895, batch_cost=0.4304, reader_cost=0.0002 | ETA 03:40:33 2020-11-14 02:04:16 [INFO] [TRAIN] epoch=15, iter=9260/40000, loss=0.6205, lr=0.007892, batch_cost=0.5486, reader_cost=0.0842 | ETA 04:41:03 2020-11-14 02:04:20 [INFO] [TRAIN] epoch=15, iter=9270/40000, loss=0.2926, lr=0.007890, batch_cost=0.4283, reader_cost=0.0005 | ETA 03:39:22 2020-11-14 02:04:25 [INFO] [TRAIN] epoch=15, iter=9280/40000, loss=0.4172, lr=0.007888, batch_cost=0.4260, reader_cost=0.0002 | ETA 03:38:05 2020-11-14 02:04:29 [INFO] [TRAIN] epoch=15, iter=9290/40000, loss=0.2779, lr=0.007885, batch_cost=0.4280, reader_cost=0.0002 | ETA 03:39:02 2020-11-14 02:04:33 [INFO] [TRAIN] epoch=15, iter=9300/40000, loss=0.5547, lr=0.007883, batch_cost=0.4473, reader_cost=0.0002 | ETA 03:48:50 2020-11-14 02:04:38 [INFO] [TRAIN] epoch=15, iter=9310/40000, loss=0.3598, lr=0.007881, batch_cost=0.4453, reader_cost=0.0004 | ETA 03:47:44 2020-11-14 02:04:42 [INFO] [TRAIN] epoch=15, iter=9320/40000, loss=0.3474, lr=0.007879, batch_cost=0.4348, reader_cost=0.0002 | ETA 03:42:19 2020-11-14 02:04:47 [INFO] [TRAIN] epoch=15, iter=9330/40000, loss=0.4207, lr=0.007876, batch_cost=0.4341, reader_cost=0.0002 | ETA 03:41:54 2020-11-14 02:04:51 [INFO] [TRAIN] epoch=15, iter=9340/40000, loss=0.3928, lr=0.007874, batch_cost=0.4362, reader_cost=0.0002 | ETA 03:42:54 2020-11-14 02:04:56 [INFO] [TRAIN] epoch=15, iter=9350/40000, loss=0.3713, lr=0.007872, batch_cost=0.5496, reader_cost=0.0002 | ETA 04:40:43 2020-11-14 02:05:04 [INFO] [TRAIN] epoch=15, iter=9360/40000, loss=0.2731, lr=0.007869, batch_cost=0.7779, reader_cost=0.0002 | ETA 06:37:13 2020-11-14 02:05:09 [INFO] [TRAIN] epoch=15, iter=9370/40000, loss=0.3703, lr=0.007867, batch_cost=0.4420, reader_cost=0.0002 | ETA 03:45:37 2020-11-14 02:05:13 [INFO] [TRAIN] epoch=15, iter=9380/40000, loss=0.3207, lr=0.007865, batch_cost=0.4419, reader_cost=0.0002 | ETA 03:45:31 2020-11-14 02:05:17 [INFO] [TRAIN] epoch=15, iter=9390/40000, loss=0.3652, lr=0.007862, batch_cost=0.4426, reader_cost=0.0002 | ETA 03:45:46 2020-11-14 02:05:22 [INFO] [TRAIN] epoch=15, iter=9400/40000, loss=0.4092, lr=0.007860, batch_cost=0.4422, reader_cost=0.0002 | ETA 03:45:30 2020-11-14 02:05:26 [INFO] [TRAIN] epoch=15, iter=9410/40000, loss=0.4584, lr=0.007858, batch_cost=0.4401, reader_cost=0.0002 | ETA 03:44:23 2020-11-14 02:05:31 [INFO] [TRAIN] epoch=15, iter=9420/40000, loss=0.4161, lr=0.007855, batch_cost=0.4366, reader_cost=0.0002 | ETA 03:42:32 2020-11-14 02:05:35 [INFO] [TRAIN] epoch=15, iter=9430/40000, loss=0.4611, lr=0.007853, batch_cost=0.4668, reader_cost=0.0002 | ETA 03:57:49 2020-11-14 02:05:40 [INFO] [TRAIN] epoch=15, iter=9440/40000, loss=0.3124, lr=0.007851, batch_cost=0.4624, reader_cost=0.0002 | ETA 03:55:32 2020-11-14 02:05:45 [INFO] [TRAIN] epoch=15, iter=9450/40000, loss=0.3639, lr=0.007849, batch_cost=0.4534, reader_cost=0.0002 | ETA 03:50:49 2020-11-14 02:05:49 [INFO] [TRAIN] epoch=15, iter=9460/40000, loss=0.4084, lr=0.007846, batch_cost=0.4412, reader_cost=0.0002 | ETA 03:44:33 2020-11-14 02:05:54 [INFO] [TRAIN] epoch=15, iter=9470/40000, loss=0.4379, lr=0.007844, batch_cost=0.4612, reader_cost=0.0002 | ETA 03:54:39 2020-11-14 02:05:58 [INFO] [TRAIN] epoch=15, iter=9480/40000, loss=0.2734, lr=0.007842, batch_cost=0.4733, reader_cost=0.0002 | ETA 04:00:45 2020-11-14 02:06:03 [INFO] [TRAIN] epoch=15, iter=9490/40000, loss=0.2349, lr=0.007839, batch_cost=0.4383, reader_cost=0.0002 | ETA 03:42:52 2020-11-14 02:06:07 [INFO] [TRAIN] epoch=15, iter=9500/40000, loss=0.4577, lr=0.007837, batch_cost=0.4385, reader_cost=0.0002 | ETA 03:42:54 2020-11-14 02:06:11 [INFO] [TRAIN] epoch=15, iter=9510/40000, loss=0.4035, lr=0.007835, batch_cost=0.4336, reader_cost=0.0002 | ETA 03:40:19 2020-11-14 02:06:16 [INFO] [TRAIN] epoch=15, iter=9520/40000, loss=0.4872, lr=0.007832, batch_cost=0.4344, reader_cost=0.0002 | ETA 03:40:40 2020-11-14 02:06:20 [INFO] [TRAIN] epoch=15, iter=9530/40000, loss=0.3191, lr=0.007830, batch_cost=0.4413, reader_cost=0.0002 | ETA 03:44:06 2020-11-14 02:06:24 [INFO] [TRAIN] epoch=15, iter=9540/40000, loss=0.2935, lr=0.007828, batch_cost=0.4367, reader_cost=0.0002 | ETA 03:41:41 2020-11-14 02:06:29 [INFO] [TRAIN] epoch=15, iter=9550/40000, loss=0.4472, lr=0.007825, batch_cost=0.4357, reader_cost=0.0002 | ETA 03:41:08 2020-11-14 02:06:33 [INFO] [TRAIN] epoch=15, iter=9560/40000, loss=0.4702, lr=0.007823, batch_cost=0.4368, reader_cost=0.0002 | ETA 03:41:36 2020-11-14 02:06:38 [INFO] [TRAIN] epoch=15, iter=9570/40000, loss=0.3621, lr=0.007821, batch_cost=0.4397, reader_cost=0.0002 | ETA 03:43:00 2020-11-14 02:06:42 [INFO] [TRAIN] epoch=15, iter=9580/40000, loss=0.5999, lr=0.007819, batch_cost=0.4382, reader_cost=0.0002 | ETA 03:42:09 2020-11-14 02:06:46 [INFO] [TRAIN] epoch=15, iter=9590/40000, loss=0.5027, lr=0.007816, batch_cost=0.4348, reader_cost=0.0002 | ETA 03:40:22 2020-11-14 02:06:51 [INFO] [TRAIN] epoch=15, iter=9600/40000, loss=0.6963, lr=0.007814, batch_cost=0.4380, reader_cost=0.0002 | ETA 03:41:54 2020-11-14 02:06:55 [INFO] [TRAIN] epoch=15, iter=9610/40000, loss=0.3550, lr=0.007812, batch_cost=0.4314, reader_cost=0.0002 | ETA 03:38:31 2020-11-14 02:06:59 [INFO] [TRAIN] epoch=15, iter=9620/40000, loss=0.4421, lr=0.007809, batch_cost=0.4337, reader_cost=0.0002 | ETA 03:39:35 2020-11-14 02:07:04 [INFO] [TRAIN] epoch=15, iter=9630/40000, loss=0.5274, lr=0.007807, batch_cost=0.4316, reader_cost=0.0002 | ETA 03:38:27 2020-11-14 02:07:08 [INFO] [TRAIN] epoch=15, iter=9640/40000, loss=0.3560, lr=0.007805, batch_cost=0.4365, reader_cost=0.0002 | ETA 03:40:52 2020-11-14 02:07:13 [INFO] [TRAIN] epoch=15, iter=9650/40000, loss=0.4960, lr=0.007802, batch_cost=0.4469, reader_cost=0.0002 | ETA 03:46:03 2020-11-14 02:07:17 [INFO] [TRAIN] epoch=15, iter=9660/40000, loss=0.2932, lr=0.007800, batch_cost=0.4602, reader_cost=0.0002 | ETA 03:52:42 2020-11-14 02:07:22 [INFO] [TRAIN] epoch=15, iter=9670/40000, loss=0.3234, lr=0.007798, batch_cost=0.4539, reader_cost=0.0002 | ETA 03:49:26 2020-11-14 02:07:26 [INFO] [TRAIN] epoch=15, iter=9680/40000, loss=0.5635, lr=0.007795, batch_cost=0.4494, reader_cost=0.0002 | ETA 03:47:05 2020-11-14 02:07:31 [INFO] [TRAIN] epoch=15, iter=9690/40000, loss=0.4379, lr=0.007793, batch_cost=0.4909, reader_cost=0.0002 | ETA 04:07:59 2020-11-14 02:07:36 [INFO] [TRAIN] epoch=15, iter=9700/40000, loss=0.3739, lr=0.007791, batch_cost=0.4618, reader_cost=0.0002 | ETA 03:53:12 2020-11-14 02:07:40 [INFO] [TRAIN] epoch=15, iter=9710/40000, loss=0.5170, lr=0.007788, batch_cost=0.4636, reader_cost=0.0002 | ETA 03:54:01 2020-11-14 02:07:45 [INFO] [TRAIN] epoch=15, iter=9720/40000, loss=0.4978, lr=0.007786, batch_cost=0.4402, reader_cost=0.0002 | ETA 03:42:09 2020-11-14 02:07:49 [INFO] [TRAIN] epoch=15, iter=9730/40000, loss=0.4914, lr=0.007784, batch_cost=0.4391, reader_cost=0.0001 | ETA 03:41:30 2020-11-14 02:07:54 [INFO] [TRAIN] epoch=15, iter=9740/40000, loss=0.3842, lr=0.007782, batch_cost=0.4386, reader_cost=0.0002 | ETA 03:41:11 2020-11-14 02:07:58 [INFO] [TRAIN] epoch=15, iter=9750/40000, loss=0.5350, lr=0.007779, batch_cost=0.4350, reader_cost=0.0002 | ETA 03:39:19 2020-11-14 02:08:03 [INFO] [TRAIN] epoch=15, iter=9760/40000, loss=0.4136, lr=0.007777, batch_cost=0.4645, reader_cost=0.0002 | ETA 03:54:06 2020-11-14 02:08:07 [INFO] [TRAIN] epoch=15, iter=9770/40000, loss=0.3099, lr=0.007775, batch_cost=0.4447, reader_cost=0.0002 | ETA 03:44:04 2020-11-14 02:08:11 [INFO] [TRAIN] epoch=15, iter=9780/40000, loss=0.4585, lr=0.007772, batch_cost=0.4441, reader_cost=0.0002 | ETA 03:43:40 2020-11-14 02:08:16 [INFO] [TRAIN] epoch=15, iter=9790/40000, loss=0.3025, lr=0.007770, batch_cost=0.4430, reader_cost=0.0002 | ETA 03:43:03 2020-11-14 02:08:20 [INFO] [TRAIN] epoch=15, iter=9800/40000, loss=0.3241, lr=0.007768, batch_cost=0.4563, reader_cost=0.0002 | ETA 03:49:41 2020-11-14 02:08:25 [INFO] [TRAIN] epoch=15, iter=9810/40000, loss=0.4997, lr=0.007765, batch_cost=0.4430, reader_cost=0.0002 | ETA 03:42:55 2020-11-14 02:08:29 [INFO] [TRAIN] epoch=15, iter=9820/40000, loss=0.3654, lr=0.007763, batch_cost=0.4443, reader_cost=0.0002 | ETA 03:43:27 2020-11-14 02:08:34 [INFO] [TRAIN] epoch=15, iter=9830/40000, loss=0.4118, lr=0.007761, batch_cost=0.4401, reader_cost=0.0002 | ETA 03:41:17 2020-11-14 02:08:38 [INFO] [TRAIN] epoch=15, iter=9840/40000, loss=0.3544, lr=0.007758, batch_cost=0.4462, reader_cost=0.0002 | ETA 03:44:16 2020-11-14 02:08:43 [INFO] [TRAIN] epoch=15, iter=9850/40000, loss=0.3469, lr=0.007756, batch_cost=0.4675, reader_cost=0.0002 | ETA 03:54:55 2020-11-14 02:08:47 [INFO] [TRAIN] epoch=15, iter=9860/40000, loss=0.6032, lr=0.007754, batch_cost=0.4356, reader_cost=0.0002 | ETA 03:38:48 2020-11-14 02:08:52 [INFO] [TRAIN] epoch=15, iter=9870/40000, loss=0.4815, lr=0.007751, batch_cost=0.4481, reader_cost=0.0002 | ETA 03:45:00 2020-11-14 02:08:57 [INFO] [TRAIN] epoch=15, iter=9880/40000, loss=0.4502, lr=0.007749, batch_cost=0.4972, reader_cost=0.0002 | ETA 04:09:36 2020-11-14 02:09:02 [INFO] [TRAIN] epoch=15, iter=9890/40000, loss=0.4029, lr=0.007747, batch_cost=0.4984, reader_cost=0.0002 | ETA 04:10:07 2020-11-14 02:09:07 [INFO] [TRAIN] epoch=15, iter=9900/40000, loss=0.3809, lr=0.007745, batch_cost=0.5057, reader_cost=0.0002 | ETA 04:13:41 2020-11-14 02:09:12 [INFO] [TRAIN] epoch=15, iter=9910/40000, loss=0.5236, lr=0.007742, batch_cost=0.4927, reader_cost=0.0002 | ETA 04:07:04 2020-11-14 02:09:17 [INFO] [TRAIN] epoch=16, iter=9920/40000, loss=0.3871, lr=0.007740, batch_cost=0.5699, reader_cost=0.1006 | ETA 04:45:41 2020-11-14 02:09:22 [INFO] [TRAIN] epoch=16, iter=9930/40000, loss=0.4074, lr=0.007738, batch_cost=0.4812, reader_cost=0.0006 | ETA 04:01:10 2020-11-14 02:09:27 [INFO] [TRAIN] epoch=16, iter=9940/40000, loss=0.4152, lr=0.007735, batch_cost=0.4465, reader_cost=0.0003 | ETA 03:43:41 2020-11-14 02:09:31 [INFO] [TRAIN] epoch=16, iter=9950/40000, loss=0.4142, lr=0.007733, batch_cost=0.4723, reader_cost=0.0002 | ETA 03:56:32 2020-11-14 02:09:36 [INFO] [TRAIN] epoch=16, iter=9960/40000, loss=0.3573, lr=0.007731, batch_cost=0.4866, reader_cost=0.0002 | ETA 04:03:36 2020-11-14 02:09:41 [INFO] [TRAIN] epoch=16, iter=9970/40000, loss=0.4673, lr=0.007728, batch_cost=0.4729, reader_cost=0.0002 | ETA 03:56:40 2020-11-14 02:09:45 [INFO] [TRAIN] epoch=16, iter=9980/40000, loss=0.5266, lr=0.007726, batch_cost=0.4475, reader_cost=0.0002 | ETA 03:43:52 2020-11-14 02:09:50 [INFO] [TRAIN] epoch=16, iter=9990/40000, loss=0.4683, lr=0.007724, batch_cost=0.4489, reader_cost=0.0002 | ETA 03:44:31 2020-11-14 02:09:55 [INFO] [TRAIN] epoch=16, iter=10000/40000, loss=0.9703, lr=0.007721, batch_cost=0.5129, reader_cost=0.0002 | ETA 04:16:25 2020-11-14 02:09:55 [INFO] Start evaluating (total_samples=1449, total_iters=363)... 2020-11-14 02:10:16 [INFO] [EVAL] #Images=1449 mIoU=0.7513 Acc=0.9427 Kappa=0.8722 2020-11-14 02:10:16 [INFO] [EVAL] Class IoU: [0.9364 0.9038 0.4231 0.8536 0.6384 0.8037 0.9276 0.8625 0.8839 0.3877 0.8693 0.5906 0.824 0.8409 0.8269 0.8413 0.5844 0.8274 0.4095 0.8631 0.6791] 2020-11-14 02:10:16 [INFO] [EVAL] Class Acc: [0.9595 0.9494 0.4381 0.9554 0.684 0.8855 0.9748 0.9714 0.9667 0.6453 0.9002 0.8368 0.8937 0.8829 0.9401 0.9411 0.8904 0.9588 0.7573 0.9031 0.8552] 2020-11-14 02:10:25 [INFO] [EVAL] The model with the best validation mIoU (0.7513) was saved at iter 10000. 2020-11-14 02:10:30 [INFO] [TRAIN] epoch=16, iter=10010/40000, loss=0.3965, lr=0.007719, batch_cost=0.4987, reader_cost=0.0035 | ETA 04:09:15 2020-11-14 02:10:35 [INFO] [TRAIN] epoch=16, iter=10020/40000, loss=0.3553, lr=0.007717, batch_cost=0.4913, reader_cost=0.0005 | ETA 04:05:30 2020-11-14 02:10:40 [INFO] [TRAIN] epoch=16, iter=10030/40000, loss=0.3668, lr=0.007714, batch_cost=0.4844, reader_cost=0.0005 | ETA 04:01:58 2020-11-14 02:10:45 [INFO] [TRAIN] epoch=16, iter=10040/40000, loss=0.3698, lr=0.007712, batch_cost=0.4542, reader_cost=0.0005 | ETA 03:46:47 2020-11-14 02:10:50 [INFO] [TRAIN] epoch=16, iter=10050/40000, loss=0.3226, lr=0.007710, batch_cost=0.4932, reader_cost=0.0002 | ETA 04:06:12 2020-11-14 02:10:54 [INFO] [TRAIN] epoch=16, iter=10060/40000, loss=0.3744, lr=0.007708, batch_cost=0.4742, reader_cost=0.0005 | ETA 03:56:37 2020-11-14 02:10:59 [INFO] [TRAIN] epoch=16, iter=10070/40000, loss=0.3476, lr=0.007705, batch_cost=0.4695, reader_cost=0.0002 | ETA 03:54:12 2020-11-14 02:11:04 [INFO] [TRAIN] epoch=16, iter=10080/40000, loss=0.3714, lr=0.007703, batch_cost=0.4773, reader_cost=0.0002 | ETA 03:58:01 2020-11-14 02:11:09 [INFO] [TRAIN] epoch=16, iter=10090/40000, loss=0.3448, lr=0.007701, batch_cost=0.4787, reader_cost=0.0002 | ETA 03:58:37 2020-11-14 02:11:13 [INFO] [TRAIN] epoch=16, iter=10100/40000, loss=0.4000, lr=0.007698, batch_cost=0.4614, reader_cost=0.0002 | ETA 03:49:55 2020-11-14 02:11:18 [INFO] [TRAIN] epoch=16, iter=10110/40000, loss=0.4243, lr=0.007696, batch_cost=0.4588, reader_cost=0.0002 | ETA 03:48:34 2020-11-14 02:11:22 [INFO] [TRAIN] epoch=16, iter=10120/40000, loss=0.4067, lr=0.007694, batch_cost=0.4341, reader_cost=0.0002 | ETA 03:36:09 2020-11-14 02:11:26 [INFO] [TRAIN] epoch=16, iter=10130/40000, loss=0.3045, lr=0.007691, batch_cost=0.4415, reader_cost=0.0002 | ETA 03:39:46 2020-11-14 02:11:31 [INFO] [TRAIN] epoch=16, iter=10140/40000, loss=0.4582, lr=0.007689, batch_cost=0.4340, reader_cost=0.0002 | ETA 03:36:00 2020-11-14 02:11:35 [INFO] [TRAIN] epoch=16, iter=10150/40000, loss=0.4538, lr=0.007687, batch_cost=0.4364, reader_cost=0.0002 | ETA 03:37:06 2020-11-14 02:11:40 [INFO] [TRAIN] epoch=16, iter=10160/40000, loss=0.2639, lr=0.007684, batch_cost=0.4355, reader_cost=0.0002 | ETA 03:36:34 2020-11-14 02:11:44 [INFO] [TRAIN] epoch=16, iter=10170/40000, loss=0.4328, lr=0.007682, batch_cost=0.4343, reader_cost=0.0002 | ETA 03:35:54 2020-11-14 02:11:48 [INFO] [TRAIN] epoch=16, iter=10180/40000, loss=0.3675, lr=0.007680, batch_cost=0.4338, reader_cost=0.0002 | ETA 03:35:35 2020-11-14 02:11:53 [INFO] [TRAIN] epoch=16, iter=10190/40000, loss=0.3882, lr=0.007677, batch_cost=0.4384, reader_cost=0.0002 | ETA 03:37:47 2020-11-14 02:11:57 [INFO] [TRAIN] epoch=16, iter=10200/40000, loss=0.4011, lr=0.007675, batch_cost=0.4344, reader_cost=0.0002 | ETA 03:35:44 2020-11-14 02:12:01 [INFO] [TRAIN] epoch=16, iter=10210/40000, loss=0.4403, lr=0.007673, batch_cost=0.4464, reader_cost=0.0002 | ETA 03:41:37 2020-11-14 02:12:06 [INFO] [TRAIN] epoch=16, iter=10220/40000, loss=0.3660, lr=0.007670, batch_cost=0.4557, reader_cost=0.0002 | ETA 03:46:10 2020-11-14 02:12:11 [INFO] [TRAIN] epoch=16, iter=10230/40000, loss=0.3476, lr=0.007668, batch_cost=0.4684, reader_cost=0.0002 | ETA 03:52:25 2020-11-14 02:12:15 [INFO] [TRAIN] epoch=16, iter=10240/40000, loss=0.2755, lr=0.007666, batch_cost=0.4609, reader_cost=0.0002 | ETA 03:48:37 2020-11-14 02:12:20 [INFO] [TRAIN] epoch=16, iter=10250/40000, loss=0.3554, lr=0.007664, batch_cost=0.4623, reader_cost=0.0002 | ETA 03:49:12 2020-11-14 02:12:25 [INFO] [TRAIN] epoch=16, iter=10260/40000, loss=0.3145, lr=0.007661, batch_cost=0.4794, reader_cost=0.0002 | ETA 03:57:36 2020-11-14 02:12:29 [INFO] [TRAIN] epoch=16, iter=10270/40000, loss=0.3479, lr=0.007659, batch_cost=0.4495, reader_cost=0.0002 | ETA 03:42:44 2020-11-14 02:12:34 [INFO] [TRAIN] epoch=16, iter=10280/40000, loss=0.3170, lr=0.007657, batch_cost=0.4720, reader_cost=0.0002 | ETA 03:53:47 2020-11-14 02:12:39 [INFO] [TRAIN] epoch=16, iter=10290/40000, loss=0.3108, lr=0.007654, batch_cost=0.4797, reader_cost=0.0002 | ETA 03:57:30 2020-11-14 02:12:44 [INFO] [TRAIN] epoch=16, iter=10300/40000, loss=0.2776, lr=0.007652, batch_cost=0.4818, reader_cost=0.0002 | ETA 03:58:29 2020-11-14 02:12:48 [INFO] [TRAIN] epoch=16, iter=10310/40000, loss=0.2576, lr=0.007650, batch_cost=0.4772, reader_cost=0.0002 | ETA 03:56:07 2020-11-14 02:12:53 [INFO] [TRAIN] epoch=16, iter=10320/40000, loss=0.2932, lr=0.007647, batch_cost=0.4965, reader_cost=0.0003 | ETA 04:05:35 2020-11-14 02:12:58 [INFO] [TRAIN] epoch=16, iter=10330/40000, loss=0.3225, lr=0.007645, batch_cost=0.4863, reader_cost=0.0004 | ETA 04:00:27 2020-11-14 02:13:03 [INFO] [TRAIN] epoch=16, iter=10340/40000, loss=0.2367, lr=0.007643, batch_cost=0.5014, reader_cost=0.0002 | ETA 04:07:50 2020-11-14 02:13:08 [INFO] [TRAIN] epoch=16, iter=10350/40000, loss=0.4828, lr=0.007640, batch_cost=0.5016, reader_cost=0.0003 | ETA 04:07:51 2020-11-14 02:13:13 [INFO] [TRAIN] epoch=16, iter=10360/40000, loss=0.3714, lr=0.007638, batch_cost=0.4792, reader_cost=0.0002 | ETA 03:56:44 2020-11-14 02:13:18 [INFO] [TRAIN] epoch=16, iter=10370/40000, loss=0.3672, lr=0.007636, batch_cost=0.4997, reader_cost=0.0002 | ETA 04:06:47 2020-11-14 02:13:23 [INFO] [TRAIN] epoch=16, iter=10380/40000, loss=0.6220, lr=0.007633, batch_cost=0.4913, reader_cost=0.0002 | ETA 04:02:33 2020-11-14 02:13:28 [INFO] [TRAIN] epoch=16, iter=10390/40000, loss=0.4192, lr=0.007631, batch_cost=0.4880, reader_cost=0.0002 | ETA 04:00:48 2020-11-14 02:13:33 [INFO] [TRAIN] epoch=16, iter=10400/40000, loss=0.2750, lr=0.007629, batch_cost=0.4831, reader_cost=0.0002 | ETA 03:58:19 2020-11-14 02:13:37 [INFO] [TRAIN] epoch=16, iter=10410/40000, loss=0.4463, lr=0.007626, batch_cost=0.4616, reader_cost=0.0003 | ETA 03:47:39 2020-11-14 02:13:42 [INFO] [TRAIN] epoch=16, iter=10420/40000, loss=0.3753, lr=0.007624, batch_cost=0.4557, reader_cost=0.0003 | ETA 03:44:39 2020-11-14 02:13:46 [INFO] [TRAIN] epoch=16, iter=10430/40000, loss=0.2959, lr=0.007622, batch_cost=0.4617, reader_cost=0.0003 | ETA 03:47:31 2020-11-14 02:13:51 [INFO] [TRAIN] epoch=16, iter=10440/40000, loss=0.2773, lr=0.007620, batch_cost=0.4899, reader_cost=0.0003 | ETA 04:01:21 2020-11-14 02:13:56 [INFO] [TRAIN] epoch=16, iter=10450/40000, loss=0.4499, lr=0.007617, batch_cost=0.4735, reader_cost=0.0002 | ETA 03:53:12 2020-11-14 02:14:00 [INFO] [TRAIN] epoch=16, iter=10460/40000, loss=0.2797, lr=0.007615, batch_cost=0.4499, reader_cost=0.0002 | ETA 03:41:30 2020-11-14 02:14:05 [INFO] [TRAIN] epoch=16, iter=10470/40000, loss=0.3482, lr=0.007613, batch_cost=0.4477, reader_cost=0.0004 | ETA 03:40:20 2020-11-14 02:14:10 [INFO] [TRAIN] epoch=16, iter=10480/40000, loss=0.3640, lr=0.007610, batch_cost=0.4580, reader_cost=0.0075 | ETA 03:45:20 2020-11-14 02:14:14 [INFO] [TRAIN] epoch=16, iter=10490/40000, loss=0.4706, lr=0.007608, batch_cost=0.4494, reader_cost=0.0045 | ETA 03:41:02 2020-11-14 02:14:18 [INFO] [TRAIN] epoch=16, iter=10500/40000, loss=0.3949, lr=0.007606, batch_cost=0.4320, reader_cost=0.0002 | ETA 03:32:23 2020-11-14 02:14:23 [INFO] [TRAIN] epoch=16, iter=10510/40000, loss=0.3215, lr=0.007603, batch_cost=0.4352, reader_cost=0.0002 | ETA 03:33:52 2020-11-14 02:14:27 [INFO] [TRAIN] epoch=16, iter=10520/40000, loss=0.3912, lr=0.007601, batch_cost=0.4385, reader_cost=0.0002 | ETA 03:35:27 2020-11-14 02:14:32 [INFO] [TRAIN] epoch=16, iter=10530/40000, loss=0.4050, lr=0.007599, batch_cost=0.4847, reader_cost=0.0002 | ETA 03:58:04 2020-11-14 02:14:37 [INFO] [TRAIN] epoch=16, iter=10540/40000, loss=0.3473, lr=0.007596, batch_cost=0.4807, reader_cost=0.0002 | ETA 03:56:00 2020-11-14 02:14:41 [INFO] [TRAIN] epoch=16, iter=10550/40000, loss=0.3695, lr=0.007594, batch_cost=0.4449, reader_cost=0.0002 | ETA 03:38:22 2020-11-14 02:14:46 [INFO] [TRAIN] epoch=16, iter=10560/40000, loss=0.4749, lr=0.007592, batch_cost=0.4578, reader_cost=0.0002 | ETA 03:44:36 2020-11-14 02:14:50 [INFO] [TRAIN] epoch=16, iter=10570/40000, loss=0.3925, lr=0.007589, batch_cost=0.4660, reader_cost=0.0004 | ETA 03:48:33 2020-11-14 02:14:56 [INFO] [TRAIN] epoch=17, iter=10580/40000, loss=0.5022, lr=0.007587, batch_cost=0.5382, reader_cost=0.0871 | ETA 04:23:54 2020-11-14 02:15:00 [INFO] [TRAIN] epoch=17, iter=10590/40000, loss=0.3451, lr=0.007585, batch_cost=0.4450, reader_cost=0.0005 | ETA 03:38:08 2020-11-14 02:15:05 [INFO] [TRAIN] epoch=17, iter=10600/40000, loss=0.3314, lr=0.007582, batch_cost=0.4408, reader_cost=0.0002 | ETA 03:36:00 2020-11-14 02:15:09 [INFO] [TRAIN] epoch=17, iter=10610/40000, loss=0.3623, lr=0.007580, batch_cost=0.4745, reader_cost=0.0002 | ETA 03:52:26 2020-11-14 02:15:14 [INFO] [TRAIN] epoch=17, iter=10620/40000, loss=0.3780, lr=0.007578, batch_cost=0.4684, reader_cost=0.0002 | ETA 03:49:20 2020-11-14 02:15:19 [INFO] [TRAIN] epoch=17, iter=10630/40000, loss=0.3546, lr=0.007576, batch_cost=0.4526, reader_cost=0.0002 | ETA 03:41:32 2020-11-14 02:15:23 [INFO] [TRAIN] epoch=17, iter=10640/40000, loss=0.4255, lr=0.007573, batch_cost=0.4524, reader_cost=0.0002 | ETA 03:41:23 2020-11-14 02:15:28 [INFO] [TRAIN] epoch=17, iter=10650/40000, loss=0.2657, lr=0.007571, batch_cost=0.4476, reader_cost=0.0002 | ETA 03:38:57 2020-11-14 02:15:32 [INFO] [TRAIN] epoch=17, iter=10660/40000, loss=0.3345, lr=0.007569, batch_cost=0.4532, reader_cost=0.0002 | ETA 03:41:35 2020-11-14 02:15:37 [INFO] [TRAIN] epoch=17, iter=10670/40000, loss=0.2516, lr=0.007566, batch_cost=0.4556, reader_cost=0.0002 | ETA 03:42:43 2020-11-14 02:15:41 [INFO] [TRAIN] epoch=17, iter=10680/40000, loss=0.3012, lr=0.007564, batch_cost=0.4573, reader_cost=0.0002 | ETA 03:43:27 2020-11-14 02:15:46 [INFO] [TRAIN] epoch=17, iter=10690/40000, loss=0.2811, lr=0.007562, batch_cost=0.4503, reader_cost=0.0002 | ETA 03:39:57 2020-11-14 02:15:50 [INFO] [TRAIN] epoch=17, iter=10700/40000, loss=0.2217, lr=0.007559, batch_cost=0.4389, reader_cost=0.0002 | ETA 03:34:20 2020-11-14 02:15:55 [INFO] [TRAIN] epoch=17, iter=10710/40000, loss=0.3153, lr=0.007557, batch_cost=0.4564, reader_cost=0.0002 | ETA 03:42:48 2020-11-14 02:15:59 [INFO] [TRAIN] epoch=17, iter=10720/40000, loss=0.3489, lr=0.007555, batch_cost=0.4547, reader_cost=0.0002 | ETA 03:41:52 2020-11-14 02:16:04 [INFO] [TRAIN] epoch=17, iter=10730/40000, loss=0.3410, lr=0.007552, batch_cost=0.4372, reader_cost=0.0002 | ETA 03:33:18 2020-11-14 02:16:08 [INFO] [TRAIN] epoch=17, iter=10740/40000, loss=0.3758, lr=0.007550, batch_cost=0.4549, reader_cost=0.0002 | ETA 03:41:50 2020-11-14 02:16:13 [INFO] [TRAIN] epoch=17, iter=10750/40000, loss=0.3228, lr=0.007548, batch_cost=0.4408, reader_cost=0.0002 | ETA 03:34:53 2020-11-14 02:16:17 [INFO] [TRAIN] epoch=17, iter=10760/40000, loss=0.2923, lr=0.007545, batch_cost=0.4388, reader_cost=0.0002 | ETA 03:33:49 2020-11-14 02:16:21 [INFO] [TRAIN] epoch=17, iter=10770/40000, loss=0.3591, lr=0.007543, batch_cost=0.4417, reader_cost=0.0002 | ETA 03:35:11 2020-11-14 02:16:26 [INFO] [TRAIN] epoch=17, iter=10780/40000, loss=0.4333, lr=0.007541, batch_cost=0.4434, reader_cost=0.0002 | ETA 03:35:54 2020-11-14 02:16:30 [INFO] [TRAIN] epoch=17, iter=10790/40000, loss=0.3423, lr=0.007538, batch_cost=0.4346, reader_cost=0.0002 | ETA 03:31:35 2020-11-14 02:16:35 [INFO] [TRAIN] epoch=17, iter=10800/40000, loss=0.3471, lr=0.007536, batch_cost=0.4629, reader_cost=0.0002 | ETA 03:45:17 2020-11-14 02:16:39 [INFO] [TRAIN] epoch=17, iter=10810/40000, loss=0.3631, lr=0.007534, batch_cost=0.4407, reader_cost=0.0002 | ETA 03:34:24 2020-11-14 02:16:44 [INFO] [TRAIN] epoch=17, iter=10820/40000, loss=0.3756, lr=0.007531, batch_cost=0.4765, reader_cost=0.0002 | ETA 03:51:44 2020-11-14 02:16:49 [INFO] [TRAIN] epoch=17, iter=10830/40000, loss=0.3004, lr=0.007529, batch_cost=0.4671, reader_cost=0.0002 | ETA 03:47:04 2020-11-14 02:16:53 [INFO] [TRAIN] epoch=17, iter=10840/40000, loss=0.3861, lr=0.007527, batch_cost=0.4405, reader_cost=0.0002 | ETA 03:34:03 2020-11-14 02:16:58 [INFO] [TRAIN] epoch=17, iter=10850/40000, loss=0.2587, lr=0.007524, batch_cost=0.4422, reader_cost=0.0002 | ETA 03:34:49 2020-11-14 02:17:02 [INFO] [TRAIN] epoch=17, iter=10860/40000, loss=0.3941, lr=0.007522, batch_cost=0.4438, reader_cost=0.0002 | ETA 03:35:31 2020-11-14 02:17:06 [INFO] [TRAIN] epoch=17, iter=10870/40000, loss=0.4337, lr=0.007520, batch_cost=0.4446, reader_cost=0.0002 | ETA 03:35:51 2020-11-14 02:17:11 [INFO] [TRAIN] epoch=17, iter=10880/40000, loss=0.2488, lr=0.007518, batch_cost=0.4499, reader_cost=0.0002 | ETA 03:38:19 2020-11-14 02:17:15 [INFO] [TRAIN] epoch=17, iter=10890/40000, loss=0.3965, lr=0.007515, batch_cost=0.4368, reader_cost=0.0002 | ETA 03:31:56 2020-11-14 02:17:20 [INFO] [TRAIN] epoch=17, iter=10900/40000, loss=0.3167, lr=0.007513, batch_cost=0.4392, reader_cost=0.0002 | ETA 03:33:00 2020-11-14 02:17:24 [INFO] [TRAIN] epoch=17, iter=10910/40000, loss=0.3273, lr=0.007511, batch_cost=0.4509, reader_cost=0.0002 | ETA 03:38:37 2020-11-14 02:17:29 [INFO] [TRAIN] epoch=17, iter=10920/40000, loss=0.3589, lr=0.007508, batch_cost=0.4408, reader_cost=0.0002 | ETA 03:33:38 2020-11-14 02:17:33 [INFO] [TRAIN] epoch=17, iter=10930/40000, loss=0.3449, lr=0.007506, batch_cost=0.4426, reader_cost=0.0002 | ETA 03:34:25 2020-11-14 02:17:37 [INFO] [TRAIN] epoch=17, iter=10940/40000, loss=0.3611, lr=0.007504, batch_cost=0.4392, reader_cost=0.0002 | ETA 03:32:41 2020-11-14 02:17:42 [INFO] [TRAIN] epoch=17, iter=10950/40000, loss=0.3578, lr=0.007501, batch_cost=0.4443, reader_cost=0.0002 | ETA 03:35:07 2020-11-14 02:17:46 [INFO] [TRAIN] epoch=17, iter=10960/40000, loss=0.4242, lr=0.007499, batch_cost=0.4410, reader_cost=0.0002 | ETA 03:33:27 2020-11-14 02:17:51 [INFO] [TRAIN] epoch=17, iter=10970/40000, loss=0.4415, lr=0.007497, batch_cost=0.4383, reader_cost=0.0002 | ETA 03:32:04 2020-11-14 02:17:55 [INFO] [TRAIN] epoch=17, iter=10980/40000, loss=0.3784, lr=0.007494, batch_cost=0.4454, reader_cost=0.0002 | ETA 03:35:26 2020-11-14 02:18:00 [INFO] [TRAIN] epoch=17, iter=10990/40000, loss=0.2834, lr=0.007492, batch_cost=0.4483, reader_cost=0.0002 | ETA 03:36:46 2020-11-14 02:18:04 [INFO] [TRAIN] epoch=17, iter=11000/40000, loss=0.3304, lr=0.007490, batch_cost=0.4402, reader_cost=0.0002 | ETA 03:32:46 2020-11-14 02:18:08 [INFO] [TRAIN] epoch=17, iter=11010/40000, loss=0.5546, lr=0.007487, batch_cost=0.4424, reader_cost=0.0002 | ETA 03:33:45 2020-11-14 02:18:13 [INFO] [TRAIN] epoch=17, iter=11020/40000, loss=0.3258, lr=0.007485, batch_cost=0.4441, reader_cost=0.0002 | ETA 03:34:29 2020-11-14 02:18:17 [INFO] [TRAIN] epoch=17, iter=11030/40000, loss=0.4627, lr=0.007483, batch_cost=0.4389, reader_cost=0.0002 | ETA 03:31:55 2020-11-14 02:18:22 [INFO] [TRAIN] epoch=17, iter=11040/40000, loss=0.4379, lr=0.007480, batch_cost=0.4481, reader_cost=0.0002 | ETA 03:36:15 2020-11-14 02:18:26 [INFO] [TRAIN] epoch=17, iter=11050/40000, loss=0.4076, lr=0.007478, batch_cost=0.4388, reader_cost=0.0002 | ETA 03:31:43 2020-11-14 02:18:31 [INFO] [TRAIN] epoch=17, iter=11060/40000, loss=0.3320, lr=0.007476, batch_cost=0.4586, reader_cost=0.0002 | ETA 03:41:11 2020-11-14 02:18:35 [INFO] [TRAIN] epoch=17, iter=11070/40000, loss=0.2563, lr=0.007473, batch_cost=0.4449, reader_cost=0.0002 | ETA 03:34:30 2020-11-14 02:18:40 [INFO] [TRAIN] epoch=17, iter=11080/40000, loss=0.4371, lr=0.007471, batch_cost=0.4516, reader_cost=0.0002 | ETA 03:37:40 2020-11-14 02:18:44 [INFO] [TRAIN] epoch=17, iter=11090/40000, loss=0.5203, lr=0.007469, batch_cost=0.4455, reader_cost=0.0002 | ETA 03:34:40 2020-11-14 02:18:49 [INFO] [TRAIN] epoch=17, iter=11100/40000, loss=0.3909, lr=0.007466, batch_cost=0.4522, reader_cost=0.0002 | ETA 03:37:48 2020-11-14 02:18:53 [INFO] [TRAIN] epoch=17, iter=11110/40000, loss=0.3013, lr=0.007464, batch_cost=0.4583, reader_cost=0.0002 | ETA 03:40:39 2020-11-14 02:18:58 [INFO] [TRAIN] epoch=17, iter=11120/40000, loss=0.3994, lr=0.007462, batch_cost=0.4517, reader_cost=0.0002 | ETA 03:37:24 2020-11-14 02:19:02 [INFO] [TRAIN] epoch=17, iter=11130/40000, loss=0.3360, lr=0.007460, batch_cost=0.4400, reader_cost=0.0002 | ETA 03:31:41 2020-11-14 02:19:07 [INFO] [TRAIN] epoch=17, iter=11140/40000, loss=0.3008, lr=0.007457, batch_cost=0.4364, reader_cost=0.0002 | ETA 03:29:54 2020-11-14 02:19:11 [INFO] [TRAIN] epoch=17, iter=11150/40000, loss=0.3435, lr=0.007455, batch_cost=0.4389, reader_cost=0.0002 | ETA 03:31:01 2020-11-14 02:19:15 [INFO] [TRAIN] epoch=17, iter=11160/40000, loss=0.2997, lr=0.007453, batch_cost=0.4421, reader_cost=0.0002 | ETA 03:32:30 2020-11-14 02:19:20 [INFO] [TRAIN] epoch=17, iter=11170/40000, loss=0.4702, lr=0.007450, batch_cost=0.4581, reader_cost=0.0002 | ETA 03:40:05 2020-11-14 02:19:25 [INFO] [TRAIN] epoch=17, iter=11180/40000, loss=0.3703, lr=0.007448, batch_cost=0.4706, reader_cost=0.0002 | ETA 03:46:02 2020-11-14 02:19:29 [INFO] [TRAIN] epoch=17, iter=11190/40000, loss=0.3905, lr=0.007446, batch_cost=0.4799, reader_cost=0.0002 | ETA 03:50:24 2020-11-14 02:19:34 [INFO] [TRAIN] epoch=17, iter=11200/40000, loss=0.4569, lr=0.007443, batch_cost=0.4541, reader_cost=0.0002 | ETA 03:37:59 2020-11-14 02:19:38 [INFO] [TRAIN] epoch=17, iter=11210/40000, loss=0.5771, lr=0.007441, batch_cost=0.4470, reader_cost=0.0002 | ETA 03:34:29 2020-11-14 02:19:43 [INFO] [TRAIN] epoch=17, iter=11220/40000, loss=0.3030, lr=0.007439, batch_cost=0.4409, reader_cost=0.0002 | ETA 03:31:28 2020-11-14 02:19:47 [INFO] [TRAIN] epoch=17, iter=11230/40000, loss=0.5095, lr=0.007436, batch_cost=0.4346, reader_cost=0.0002 | ETA 03:28:22 2020-11-14 02:19:53 [INFO] [TRAIN] epoch=18, iter=11240/40000, loss=0.5156, lr=0.007434, batch_cost=0.5705, reader_cost=0.0899 | ETA 04:33:28 2020-11-14 02:19:57 [INFO] [TRAIN] epoch=18, iter=11250/40000, loss=0.3211, lr=0.007432, batch_cost=0.4412, reader_cost=0.0005 | ETA 03:31:23 2020-11-14 02:20:02 [INFO] [TRAIN] epoch=18, iter=11260/40000, loss=0.3438, lr=0.007429, batch_cost=0.4400, reader_cost=0.0002 | ETA 03:30:44 2020-11-14 02:20:06 [INFO] [TRAIN] epoch=18, iter=11270/40000, loss=0.3376, lr=0.007427, batch_cost=0.4758, reader_cost=0.0002 | ETA 03:47:49 2020-11-14 02:20:11 [INFO] [TRAIN] epoch=18, iter=11280/40000, loss=0.3271, lr=0.007425, batch_cost=0.4583, reader_cost=0.0002 | ETA 03:39:23 2020-11-14 02:20:15 [INFO] [TRAIN] epoch=18, iter=11290/40000, loss=0.4003, lr=0.007422, batch_cost=0.4411, reader_cost=0.0002 | ETA 03:31:02 2020-11-14 02:20:20 [INFO] [TRAIN] epoch=18, iter=11300/40000, loss=0.4085, lr=0.007420, batch_cost=0.4531, reader_cost=0.0002 | ETA 03:36:42 2020-11-14 02:20:25 [INFO] [TRAIN] epoch=18, iter=11310/40000, loss=0.3166, lr=0.007418, batch_cost=0.4831, reader_cost=0.0002 | ETA 03:50:59 2020-11-14 02:20:29 [INFO] [TRAIN] epoch=18, iter=11320/40000, loss=0.4276, lr=0.007415, batch_cost=0.4690, reader_cost=0.0002 | ETA 03:44:11 2020-11-14 02:20:34 [INFO] [TRAIN] epoch=18, iter=11330/40000, loss=0.3556, lr=0.007413, batch_cost=0.4356, reader_cost=0.0002 | ETA 03:28:07 2020-11-14 02:20:38 [INFO] [TRAIN] epoch=18, iter=11340/40000, loss=0.3502, lr=0.007411, batch_cost=0.4392, reader_cost=0.0002 | ETA 03:29:46 2020-11-14 02:20:43 [INFO] [TRAIN] epoch=18, iter=11350/40000, loss=0.2597, lr=0.007408, batch_cost=0.4544, reader_cost=0.0002 | ETA 03:36:59 2020-11-14 02:20:48 [INFO] [TRAIN] epoch=18, iter=11360/40000, loss=0.5063, lr=0.007406, batch_cost=0.4742, reader_cost=0.0002 | ETA 03:46:21 2020-11-14 02:20:52 [INFO] [TRAIN] epoch=18, iter=11370/40000, loss=0.3640, lr=0.007404, batch_cost=0.4478, reader_cost=0.0002 | ETA 03:33:41 2020-11-14 02:20:56 [INFO] [TRAIN] epoch=18, iter=11380/40000, loss=0.3884, lr=0.007401, batch_cost=0.4444, reader_cost=0.0002 | ETA 03:31:58 2020-11-14 02:21:01 [INFO] [TRAIN] epoch=18, iter=11390/40000, loss=0.3700, lr=0.007399, batch_cost=0.4477, reader_cost=0.0002 | ETA 03:33:28 2020-11-14 02:21:06 [INFO] [TRAIN] epoch=18, iter=11400/40000, loss=0.3293, lr=0.007397, batch_cost=0.4793, reader_cost=0.0002 | ETA 03:48:28 2020-11-14 02:21:10 [INFO] [TRAIN] epoch=18, iter=11410/40000, loss=0.3593, lr=0.007394, batch_cost=0.4658, reader_cost=0.0002 | ETA 03:41:55 2020-11-14 02:21:15 [INFO] [TRAIN] epoch=18, iter=11420/40000, loss=0.3072, lr=0.007392, batch_cost=0.4423, reader_cost=0.0002 | ETA 03:30:40 2020-11-14 02:21:20 [INFO] [TRAIN] epoch=18, iter=11430/40000, loss=0.4140, lr=0.007390, batch_cost=0.4957, reader_cost=0.0003 | ETA 03:56:03 2020-11-14 02:21:25 [INFO] [TRAIN] epoch=18, iter=11440/40000, loss=0.4134, lr=0.007387, batch_cost=0.5079, reader_cost=0.0002 | ETA 04:01:46 2020-11-14 02:21:30 [INFO] [TRAIN] epoch=18, iter=11450/40000, loss=0.4641, lr=0.007385, batch_cost=0.4960, reader_cost=0.0002 | ETA 03:56:01 2020-11-14 02:21:35 [INFO] [TRAIN] epoch=18, iter=11460/40000, loss=0.4255, lr=0.007383, batch_cost=0.4903, reader_cost=0.0002 | ETA 03:53:11 2020-11-14 02:21:40 [INFO] [TRAIN] epoch=18, iter=11470/40000, loss=0.3389, lr=0.007380, batch_cost=0.4976, reader_cost=0.0002 | ETA 03:56:35 2020-11-14 02:21:44 [INFO] [TRAIN] epoch=18, iter=11480/40000, loss=0.3303, lr=0.007378, batch_cost=0.4556, reader_cost=0.0002 | ETA 03:36:33 2020-11-14 02:21:49 [INFO] [TRAIN] epoch=18, iter=11490/40000, loss=0.3666, lr=0.007376, batch_cost=0.4516, reader_cost=0.0002 | ETA 03:34:34 2020-11-14 02:21:53 [INFO] [TRAIN] epoch=18, iter=11500/40000, loss=0.3379, lr=0.007374, batch_cost=0.4608, reader_cost=0.0002 | ETA 03:38:53 2020-11-14 02:21:58 [INFO] [TRAIN] epoch=18, iter=11510/40000, loss=0.3484, lr=0.007371, batch_cost=0.4854, reader_cost=0.0002 | ETA 03:50:29 2020-11-14 02:22:03 [INFO] [TRAIN] epoch=18, iter=11520/40000, loss=0.4137, lr=0.007369, batch_cost=0.4870, reader_cost=0.0002 | ETA 03:51:08 2020-11-14 02:22:08 [INFO] [TRAIN] epoch=18, iter=11530/40000, loss=0.4158, lr=0.007367, batch_cost=0.5088, reader_cost=0.0002 | ETA 04:01:24 2020-11-14 02:22:13 [INFO] [TRAIN] epoch=18, iter=11540/40000, loss=0.3146, lr=0.007364, batch_cost=0.4723, reader_cost=0.0002 | ETA 03:44:00 2020-11-14 02:22:17 [INFO] [TRAIN] epoch=18, iter=11550/40000, loss=0.3769, lr=0.007362, batch_cost=0.4445, reader_cost=0.0002 | ETA 03:30:46 2020-11-14 02:22:22 [INFO] [TRAIN] epoch=18, iter=11560/40000, loss=0.3446, lr=0.007360, batch_cost=0.4504, reader_cost=0.0002 | ETA 03:33:30 2020-11-14 02:22:26 [INFO] [TRAIN] epoch=18, iter=11570/40000, loss=0.4294, lr=0.007357, batch_cost=0.4403, reader_cost=0.0002 | ETA 03:28:37 2020-11-14 02:22:31 [INFO] [TRAIN] epoch=18, iter=11580/40000, loss=0.4289, lr=0.007355, batch_cost=0.4391, reader_cost=0.0002 | ETA 03:28:00 2020-11-14 02:22:35 [INFO] [TRAIN] epoch=18, iter=11590/40000, loss=0.6549, lr=0.007353, batch_cost=0.4377, reader_cost=0.0002 | ETA 03:27:15 2020-11-14 02:22:40 [INFO] [TRAIN] epoch=18, iter=11600/40000, loss=0.4517, lr=0.007350, batch_cost=0.4773, reader_cost=0.0002 | ETA 03:45:56 2020-11-14 02:22:45 [INFO] [TRAIN] epoch=18, iter=11610/40000, loss=0.4547, lr=0.007348, batch_cost=0.5057, reader_cost=0.0002 | ETA 03:59:17 2020-11-14 02:22:50 [INFO] [TRAIN] epoch=18, iter=11620/40000, loss=0.3649, lr=0.007346, batch_cost=0.4837, reader_cost=0.0002 | ETA 03:48:48 2020-11-14 02:22:55 [INFO] [TRAIN] epoch=18, iter=11630/40000, loss=0.4245, lr=0.007343, batch_cost=0.5036, reader_cost=0.0002 | ETA 03:58:06 2020-11-14 02:22:59 [INFO] [TRAIN] epoch=18, iter=11640/40000, loss=0.3887, lr=0.007341, batch_cost=0.4659, reader_cost=0.0002 | ETA 03:40:11 2020-11-14 02:23:04 [INFO] [TRAIN] epoch=18, iter=11650/40000, loss=0.4434, lr=0.007339, batch_cost=0.4652, reader_cost=0.0002 | ETA 03:39:49 2020-11-14 02:23:09 [INFO] [TRAIN] epoch=18, iter=11660/40000, loss=0.4606, lr=0.007336, batch_cost=0.4629, reader_cost=0.0002 | ETA 03:38:38 2020-11-14 02:23:13 [INFO] [TRAIN] epoch=18, iter=11670/40000, loss=0.4385, lr=0.007334, batch_cost=0.4684, reader_cost=0.0002 | ETA 03:41:09 2020-11-14 02:23:18 [INFO] [TRAIN] epoch=18, iter=11680/40000, loss=0.3101, lr=0.007332, batch_cost=0.4529, reader_cost=0.0003 | ETA 03:33:46 2020-11-14 02:23:22 [INFO] [TRAIN] epoch=18, iter=11690/40000, loss=0.2916, lr=0.007329, batch_cost=0.4509, reader_cost=0.0002 | ETA 03:32:44 2020-11-14 02:23:27 [INFO] [TRAIN] epoch=18, iter=11700/40000, loss=0.3417, lr=0.007327, batch_cost=0.4456, reader_cost=0.0002 | ETA 03:30:09 2020-11-14 02:23:32 [INFO] [TRAIN] epoch=18, iter=11710/40000, loss=0.3599, lr=0.007325, batch_cost=0.4724, reader_cost=0.0002 | ETA 03:42:43 2020-11-14 02:23:36 [INFO] [TRAIN] epoch=18, iter=11720/40000, loss=0.3234, lr=0.007322, batch_cost=0.4663, reader_cost=0.0002 | ETA 03:39:46 2020-11-14 02:23:41 [INFO] [TRAIN] epoch=18, iter=11730/40000, loss=0.3501, lr=0.007320, batch_cost=0.4636, reader_cost=0.0002 | ETA 03:38:25 2020-11-14 02:23:46 [INFO] [TRAIN] epoch=18, iter=11740/40000, loss=0.5366, lr=0.007318, batch_cost=0.4672, reader_cost=0.0014 | ETA 03:40:03 2020-11-14 02:23:50 [INFO] [TRAIN] epoch=18, iter=11750/40000, loss=0.3959, lr=0.007315, batch_cost=0.4655, reader_cost=0.0002 | ETA 03:39:09 2020-11-14 02:23:55 [INFO] [TRAIN] epoch=18, iter=11760/40000, loss=0.3663, lr=0.007313, batch_cost=0.4645, reader_cost=0.0033 | ETA 03:38:37 2020-11-14 02:24:00 [INFO] [TRAIN] epoch=18, iter=11770/40000, loss=0.3403, lr=0.007311, batch_cost=0.4698, reader_cost=0.0021 | ETA 03:41:03 2020-11-14 02:24:04 [INFO] [TRAIN] epoch=18, iter=11780/40000, loss=0.3346, lr=0.007308, batch_cost=0.4547, reader_cost=0.0002 | ETA 03:33:50 2020-11-14 02:24:09 [INFO] [TRAIN] epoch=18, iter=11790/40000, loss=0.3083, lr=0.007306, batch_cost=0.4666, reader_cost=0.0002 | ETA 03:39:23 2020-11-14 02:24:13 [INFO] [TRAIN] epoch=18, iter=11800/40000, loss=0.3863, lr=0.007304, batch_cost=0.4537, reader_cost=0.0002 | ETA 03:33:15 2020-11-14 02:24:18 [INFO] [TRAIN] epoch=18, iter=11810/40000, loss=0.2964, lr=0.007301, batch_cost=0.4654, reader_cost=0.0002 | ETA 03:38:40 2020-11-14 02:24:23 [INFO] [TRAIN] epoch=18, iter=11820/40000, loss=0.2802, lr=0.007299, batch_cost=0.4725, reader_cost=0.0003 | ETA 03:41:55 2020-11-14 02:24:28 [INFO] [TRAIN] epoch=18, iter=11830/40000, loss=0.4341, lr=0.007297, batch_cost=0.4958, reader_cost=0.0002 | ETA 03:52:47 2020-11-14 02:24:32 [INFO] [TRAIN] epoch=18, iter=11840/40000, loss=0.3262, lr=0.007294, batch_cost=0.4516, reader_cost=0.0002 | ETA 03:31:55 2020-11-14 02:24:37 [INFO] [TRAIN] epoch=18, iter=11850/40000, loss=0.4150, lr=0.007292, batch_cost=0.4533, reader_cost=0.0002 | ETA 03:32:40 2020-11-14 02:24:41 [INFO] [TRAIN] epoch=18, iter=11860/40000, loss=0.3591, lr=0.007290, batch_cost=0.4553, reader_cost=0.0002 | ETA 03:33:30 2020-11-14 02:24:46 [INFO] [TRAIN] epoch=18, iter=11870/40000, loss=0.3443, lr=0.007287, batch_cost=0.4352, reader_cost=0.0002 | ETA 03:24:01 2020-11-14 02:24:50 [INFO] [TRAIN] epoch=18, iter=11880/40000, loss=0.4187, lr=0.007285, batch_cost=0.4307, reader_cost=0.0001 | ETA 03:21:51 2020-11-14 02:24:54 [INFO] [TRAIN] epoch=18, iter=11890/40000, loss=0.3614, lr=0.007283, batch_cost=0.4335, reader_cost=0.0001 | ETA 03:23:05 2020-11-14 02:25:00 [INFO] [TRAIN] epoch=19, iter=11900/40000, loss=0.3866, lr=0.007280, batch_cost=0.5695, reader_cost=0.1010 | ETA 04:26:43 2020-11-14 02:25:05 [INFO] [TRAIN] epoch=19, iter=11910/40000, loss=0.3945, lr=0.007278, batch_cost=0.4556, reader_cost=0.0005 | ETA 03:33:18 2020-11-14 02:25:09 [INFO] [TRAIN] epoch=19, iter=11920/40000, loss=0.3440, lr=0.007276, batch_cost=0.4689, reader_cost=0.0002 | ETA 03:39:26 2020-11-14 02:25:14 [INFO] [TRAIN] epoch=19, iter=11930/40000, loss=0.1985, lr=0.007273, batch_cost=0.4445, reader_cost=0.0002 | ETA 03:27:55 2020-11-14 02:25:18 [INFO] [TRAIN] epoch=19, iter=11940/40000, loss=0.4058, lr=0.007271, batch_cost=0.4458, reader_cost=0.0003 | ETA 03:28:28 2020-11-14 02:25:23 [INFO] [TRAIN] epoch=19, iter=11950/40000, loss=0.6900, lr=0.007269, batch_cost=0.4654, reader_cost=0.0003 | ETA 03:37:33 2020-11-14 02:25:27 [INFO] [TRAIN] epoch=19, iter=11960/40000, loss=0.3464, lr=0.007266, batch_cost=0.4426, reader_cost=0.0002 | ETA 03:26:49 2020-11-14 02:25:32 [INFO] [TRAIN] epoch=19, iter=11970/40000, loss=0.6081, lr=0.007264, batch_cost=0.4830, reader_cost=0.0002 | ETA 03:45:39 2020-11-14 02:25:37 [INFO] [TRAIN] epoch=19, iter=11980/40000, loss=0.3915, lr=0.007262, batch_cost=0.4545, reader_cost=0.0002 | ETA 03:32:15 2020-11-14 02:25:41 [INFO] [TRAIN] epoch=19, iter=11990/40000, loss=0.3316, lr=0.007259, batch_cost=0.4359, reader_cost=0.0002 | ETA 03:23:29 2020-11-14 02:25:45 [INFO] [TRAIN] epoch=19, iter=12000/40000, loss=0.3952, lr=0.007257, batch_cost=0.4383, reader_cost=0.0002 | ETA 03:24:31 2020-11-14 02:25:45 [INFO] Start evaluating (total_samples=1449, total_iters=363)... 2020-11-14 02:26:10 [INFO] [EVAL] #Images=1449 mIoU=0.7494 Acc=0.9394 Kappa=0.8689 2020-11-14 02:26:10 [INFO] [EVAL] Class IoU: [0.9364 0.8788 0.4346 0.8717 0.6409 0.7897 0.9276 0.87 0.8188 0.3543 0.8182 0.5941 0.7346 0.8463 0.8714 0.8474 0.6064 0.7845 0.5049 0.8816 0.7256] 2020-11-14 02:26:10 [INFO] [EVAL] Class Acc: [0.972 0.9151 0.4525 0.9592 0.6903 0.883 0.9721 0.9367 0.9495 0.5136 0.8744 0.9231 0.7518 0.913 0.935 0.9356 0.7556 0.9458 0.5701 0.9547 0.8808] 2020-11-14 02:26:16 [INFO] [EVAL] The model with the best validation mIoU (0.7513) was saved at iter 10000. 2020-11-14 02:26:20 [INFO] [TRAIN] epoch=19, iter=12010/40000, loss=0.3128, lr=0.007255, batch_cost=0.4301, reader_cost=0.0004 | ETA 03:20:38 2020-11-14 02:26:24 [INFO] [TRAIN] epoch=19, iter=12020/40000, loss=0.2574, lr=0.007252, batch_cost=0.4331, reader_cost=0.0005 | ETA 03:21:56 2020-11-14 02:26:29 [INFO] [TRAIN] epoch=19, iter=12030/40000, loss=0.5917, lr=0.007250, batch_cost=0.4304, reader_cost=0.0002 | ETA 03:20:37 2020-11-14 02:26:33 [INFO] [TRAIN] epoch=19, iter=12040/40000, loss=0.3370, lr=0.007248, batch_cost=0.4428, reader_cost=0.0005 | ETA 03:26:19 2020-11-14 02:26:38 [INFO] [TRAIN] epoch=19, iter=12050/40000, loss=0.3288, lr=0.007246, batch_cost=0.4422, reader_cost=0.0002 | ETA 03:25:59 2020-11-14 02:26:42 [INFO] [TRAIN] epoch=19, iter=12060/40000, loss=0.3324, lr=0.007243, batch_cost=0.4498, reader_cost=0.0002 | ETA 03:29:28 2020-11-14 02:26:46 [INFO] [TRAIN] epoch=19, iter=12070/40000, loss=0.4585, lr=0.007241, batch_cost=0.4292, reader_cost=0.0002 | ETA 03:19:47 2020-11-14 02:26:51 [INFO] [TRAIN] epoch=19, iter=12080/40000, loss=0.4237, lr=0.007239, batch_cost=0.4314, reader_cost=0.0002 | ETA 03:20:43 2020-11-14 02:26:55 [INFO] [TRAIN] epoch=19, iter=12090/40000, loss=0.3583, lr=0.007236, batch_cost=0.4738, reader_cost=0.0002 | ETA 03:40:23 2020-11-14 02:27:00 [INFO] [TRAIN] epoch=19, iter=12100/40000, loss=0.3988, lr=0.007234, batch_cost=0.4598, reader_cost=0.0002 | ETA 03:33:47 2020-11-14 02:27:05 [INFO] [TRAIN] epoch=19, iter=12110/40000, loss=0.3712, lr=0.007232, batch_cost=0.4949, reader_cost=0.0002 | ETA 03:50:02 2020-11-14 02:27:09 [INFO] [TRAIN] epoch=19, iter=12120/40000, loss=0.4088, lr=0.007229, batch_cost=0.4464, reader_cost=0.0002 | ETA 03:27:24 2020-11-14 02:27:14 [INFO] [TRAIN] epoch=19, iter=12130/40000, loss=0.2917, lr=0.007227, batch_cost=0.4490, reader_cost=0.0002 | ETA 03:28:34 2020-11-14 02:27:18 [INFO] [TRAIN] epoch=19, iter=12140/40000, loss=0.5152, lr=0.007225, batch_cost=0.4499, reader_cost=0.0002 | ETA 03:28:53 2020-11-14 02:27:23 [INFO] [TRAIN] epoch=19, iter=12150/40000, loss=0.3362, lr=0.007222, batch_cost=0.4382, reader_cost=0.0002 | ETA 03:23:23 2020-11-14 02:27:27 [INFO] [TRAIN] epoch=19, iter=12160/40000, loss=0.4110, lr=0.007220, batch_cost=0.4355, reader_cost=0.0002 | ETA 03:22:05 2020-11-14 02:27:31 [INFO] [TRAIN] epoch=19, iter=12170/40000, loss=0.2551, lr=0.007218, batch_cost=0.4251, reader_cost=0.0002 | ETA 03:17:09 2020-11-14 02:27:36 [INFO] [TRAIN] epoch=19, iter=12180/40000, loss=0.4141, lr=0.007215, batch_cost=0.4267, reader_cost=0.0020 | ETA 03:17:50 2020-11-14 02:27:40 [INFO] [TRAIN] epoch=19, iter=12190/40000, loss=0.4807, lr=0.007213, batch_cost=0.4252, reader_cost=0.0002 | ETA 03:17:05 2020-11-14 02:27:44 [INFO] [TRAIN] epoch=19, iter=12200/40000, loss=0.3582, lr=0.007211, batch_cost=0.4268, reader_cost=0.0002 | ETA 03:17:44 2020-11-14 02:27:48 [INFO] [TRAIN] epoch=19, iter=12210/40000, loss=0.3698, lr=0.007208, batch_cost=0.4253, reader_cost=0.0002 | ETA 03:16:58 2020-11-14 02:27:53 [INFO] [TRAIN] epoch=19, iter=12220/40000, loss=0.3099, lr=0.007206, batch_cost=0.4253, reader_cost=0.0002 | ETA 03:16:55 2020-11-14 02:27:57 [INFO] [TRAIN] epoch=19, iter=12230/40000, loss=0.4284, lr=0.007204, batch_cost=0.4264, reader_cost=0.0002 | ETA 03:17:22 2020-11-14 02:28:01 [INFO] [TRAIN] epoch=19, iter=12240/40000, loss=0.4679, lr=0.007201, batch_cost=0.4260, reader_cost=0.0002 | ETA 03:17:04 2020-11-14 02:28:05 [INFO] [TRAIN] epoch=19, iter=12250/40000, loss=0.4293, lr=0.007199, batch_cost=0.4270, reader_cost=0.0002 | ETA 03:17:29 2020-11-14 02:28:10 [INFO] [TRAIN] epoch=19, iter=12260/40000, loss=0.3892, lr=0.007197, batch_cost=0.4271, reader_cost=0.0002 | ETA 03:17:27 2020-11-14 02:28:14 [INFO] [TRAIN] epoch=19, iter=12270/40000, loss=0.6529, lr=0.007194, batch_cost=0.4263, reader_cost=0.0002 | ETA 03:17:02 2020-11-14 02:28:19 [INFO] [TRAIN] epoch=19, iter=12280/40000, loss=0.2914, lr=0.007192, batch_cost=0.4589, reader_cost=0.0002 | ETA 03:32:00 2020-11-14 02:28:23 [INFO] [TRAIN] epoch=19, iter=12290/40000, loss=0.4542, lr=0.007190, batch_cost=0.4310, reader_cost=0.0002 | ETA 03:19:03 2020-11-14 02:28:27 [INFO] [TRAIN] epoch=19, iter=12300/40000, loss=0.2939, lr=0.007187, batch_cost=0.4266, reader_cost=0.0002 | ETA 03:16:57 2020-11-14 02:28:31 [INFO] [TRAIN] epoch=19, iter=12310/40000, loss=0.3393, lr=0.007185, batch_cost=0.4271, reader_cost=0.0002 | ETA 03:17:07 2020-11-14 02:28:36 [INFO] [TRAIN] epoch=19, iter=12320/40000, loss=0.4512, lr=0.007183, batch_cost=0.4268, reader_cost=0.0002 | ETA 03:16:54 2020-11-14 02:28:40 [INFO] [TRAIN] epoch=19, iter=12330/40000, loss=0.4872, lr=0.007180, batch_cost=0.4275, reader_cost=0.0002 | ETA 03:17:08 2020-11-14 02:28:44 [INFO] [TRAIN] epoch=19, iter=12340/40000, loss=0.3096, lr=0.007178, batch_cost=0.4267, reader_cost=0.0002 | ETA 03:16:42 2020-11-14 02:28:48 [INFO] [TRAIN] epoch=19, iter=12350/40000, loss=0.3782, lr=0.007176, batch_cost=0.4271, reader_cost=0.0002 | ETA 03:16:48 2020-11-14 02:28:53 [INFO] [TRAIN] epoch=19, iter=12360/40000, loss=0.3318, lr=0.007173, batch_cost=0.4310, reader_cost=0.0002 | ETA 03:18:33 2020-11-14 02:28:57 [INFO] [TRAIN] epoch=19, iter=12370/40000, loss=0.3244, lr=0.007171, batch_cost=0.4435, reader_cost=0.0002 | ETA 03:24:14 2020-11-14 02:29:02 [INFO] [TRAIN] epoch=19, iter=12380/40000, loss=0.3560, lr=0.007169, batch_cost=0.4411, reader_cost=0.0002 | ETA 03:23:02 2020-11-14 02:29:06 [INFO] [TRAIN] epoch=19, iter=12390/40000, loss=0.2769, lr=0.007166, batch_cost=0.4408, reader_cost=0.0002 | ETA 03:22:50 2020-11-14 02:29:11 [INFO] [TRAIN] epoch=19, iter=12400/40000, loss=0.3643, lr=0.007164, batch_cost=0.4518, reader_cost=0.0002 | ETA 03:27:50 2020-11-14 02:29:15 [INFO] [TRAIN] epoch=19, iter=12410/40000, loss=0.4280, lr=0.007162, batch_cost=0.4357, reader_cost=0.0002 | ETA 03:20:19 2020-11-14 02:29:19 [INFO] [TRAIN] epoch=19, iter=12420/40000, loss=0.4421, lr=0.007159, batch_cost=0.4348, reader_cost=0.0002 | ETA 03:19:52 2020-11-14 02:29:24 [INFO] [TRAIN] epoch=19, iter=12430/40000, loss=0.3845, lr=0.007157, batch_cost=0.4382, reader_cost=0.0002 | ETA 03:21:19 2020-11-14 02:29:28 [INFO] [TRAIN] epoch=19, iter=12440/40000, loss=0.2915, lr=0.007155, batch_cost=0.4352, reader_cost=0.0002 | ETA 03:19:54 2020-11-14 02:29:32 [INFO] [TRAIN] epoch=19, iter=12450/40000, loss=0.3737, lr=0.007152, batch_cost=0.4357, reader_cost=0.0002 | ETA 03:20:02 2020-11-14 02:29:37 [INFO] [TRAIN] epoch=19, iter=12460/40000, loss=0.3172, lr=0.007150, batch_cost=0.4399, reader_cost=0.0002 | ETA 03:21:55 2020-11-14 02:29:41 [INFO] [TRAIN] epoch=19, iter=12470/40000, loss=0.3752, lr=0.007148, batch_cost=0.4555, reader_cost=0.0002 | ETA 03:28:59 2020-11-14 02:29:46 [INFO] [TRAIN] epoch=19, iter=12480/40000, loss=0.3520, lr=0.007145, batch_cost=0.4631, reader_cost=0.0002 | ETA 03:32:25 2020-11-14 02:29:51 [INFO] [TRAIN] epoch=19, iter=12490/40000, loss=0.3622, lr=0.007143, batch_cost=0.4688, reader_cost=0.0002 | ETA 03:34:55 2020-11-14 02:29:55 [INFO] [TRAIN] epoch=19, iter=12500/40000, loss=0.3585, lr=0.007141, batch_cost=0.4638, reader_cost=0.0002 | ETA 03:32:33 2020-11-14 02:30:00 [INFO] [TRAIN] epoch=19, iter=12510/40000, loss=0.3557, lr=0.007138, batch_cost=0.4814, reader_cost=0.0002 | ETA 03:40:33 2020-11-14 02:30:05 [INFO] [TRAIN] epoch=19, iter=12520/40000, loss=0.3893, lr=0.007136, batch_cost=0.4637, reader_cost=0.0002 | ETA 03:32:23 2020-11-14 02:30:10 [INFO] [TRAIN] epoch=19, iter=12530/40000, loss=0.3997, lr=0.007134, batch_cost=0.4858, reader_cost=0.0002 | ETA 03:42:24 2020-11-14 02:30:14 [INFO] [TRAIN] epoch=19, iter=12540/40000, loss=0.3168, lr=0.007131, batch_cost=0.4745, reader_cost=0.0002 | ETA 03:37:08 2020-11-14 02:30:19 [INFO] [TRAIN] epoch=19, iter=12550/40000, loss=0.3637, lr=0.007129, batch_cost=0.4423, reader_cost=0.0002 | ETA 03:22:20 2020-11-14 02:30:24 [INFO] [TRAIN] epoch=20, iter=12560/40000, loss=0.3473, lr=0.007127, batch_cost=0.5531, reader_cost=0.0981 | ETA 04:12:56 2020-11-14 02:30:29 [INFO] [TRAIN] epoch=20, iter=12570/40000, loss=0.4022, lr=0.007124, batch_cost=0.4328, reader_cost=0.0002 | ETA 03:17:52 2020-11-14 02:30:33 [INFO] [TRAIN] epoch=20, iter=12580/40000, loss=0.4915, lr=0.007122, batch_cost=0.4417, reader_cost=0.0002 | ETA 03:21:51 2020-11-14 02:30:38 [INFO] [TRAIN] epoch=20, iter=12590/40000, loss=0.3957, lr=0.007120, batch_cost=0.4538, reader_cost=0.0002 | ETA 03:27:18 2020-11-14 02:30:42 [INFO] [TRAIN] epoch=20, iter=12600/40000, loss=0.3311, lr=0.007117, batch_cost=0.4418, reader_cost=0.0002 | ETA 03:21:45 2020-11-14 02:30:46 [INFO] [TRAIN] epoch=20, iter=12610/40000, loss=0.3739, lr=0.007115, batch_cost=0.4389, reader_cost=0.0002 | ETA 03:20:21 2020-11-14 02:30:51 [INFO] [TRAIN] epoch=20, iter=12620/40000, loss=0.3041, lr=0.007113, batch_cost=0.4391, reader_cost=0.0002 | ETA 03:20:23 2020-11-14 02:30:55 [INFO] [TRAIN] epoch=20, iter=12630/40000, loss=0.2831, lr=0.007110, batch_cost=0.4366, reader_cost=0.0002 | ETA 03:19:09 2020-11-14 02:31:00 [INFO] [TRAIN] epoch=20, iter=12640/40000, loss=0.3468, lr=0.007108, batch_cost=0.4700, reader_cost=0.0002 | ETA 03:34:20 2020-11-14 02:31:05 [INFO] [TRAIN] epoch=20, iter=12650/40000, loss=0.3213, lr=0.007106, batch_cost=0.4978, reader_cost=0.0002 | ETA 03:46:54 2020-11-14 02:31:10 [INFO] [TRAIN] epoch=20, iter=12660/40000, loss=0.3001, lr=0.007103, batch_cost=0.5091, reader_cost=0.0002 | ETA 03:51:58 2020-11-14 02:31:15 [INFO] [TRAIN] epoch=20, iter=12670/40000, loss=0.3248, lr=0.007101, batch_cost=0.4889, reader_cost=0.0002 | ETA 03:42:41 2020-11-14 02:31:20 [INFO] [TRAIN] epoch=20, iter=12680/40000, loss=0.3898, lr=0.007099, batch_cost=0.4990, reader_cost=0.0002 | ETA 03:47:12 2020-11-14 02:31:25 [INFO] [TRAIN] epoch=20, iter=12690/40000, loss=0.4329, lr=0.007096, batch_cost=0.4735, reader_cost=0.0002 | ETA 03:35:31 2020-11-14 02:31:29 [INFO] [TRAIN] epoch=20, iter=12700/40000, loss=0.4339, lr=0.007094, batch_cost=0.4939, reader_cost=0.0002 | ETA 03:44:43 2020-11-14 02:31:34 [INFO] [TRAIN] epoch=20, iter=12710/40000, loss=0.3416, lr=0.007092, batch_cost=0.4727, reader_cost=0.0002 | ETA 03:34:59 2020-11-14 02:31:39 [INFO] [TRAIN] epoch=20, iter=12720/40000, loss=0.3795, lr=0.007089, batch_cost=0.4842, reader_cost=0.0007 | ETA 03:40:09 2020-11-14 02:31:43 [INFO] [TRAIN] epoch=20, iter=12730/40000, loss=0.2459, lr=0.007087, batch_cost=0.4364, reader_cost=0.0002 | ETA 03:18:21 2020-11-14 02:31:48 [INFO] [TRAIN] epoch=20, iter=12740/40000, loss=0.3333, lr=0.007085, batch_cost=0.4472, reader_cost=0.0002 | ETA 03:23:11 2020-11-14 02:31:52 [INFO] [TRAIN] epoch=20, iter=12750/40000, loss=0.4862, lr=0.007082, batch_cost=0.4447, reader_cost=0.0002 | ETA 03:21:58 2020-11-14 02:31:57 [INFO] [TRAIN] epoch=20, iter=12760/40000, loss=0.3091, lr=0.007080, batch_cost=0.4426, reader_cost=0.0002 | ETA 03:20:56 2020-11-14 02:32:01 [INFO] [TRAIN] epoch=20, iter=12770/40000, loss=0.3542, lr=0.007078, batch_cost=0.4419, reader_cost=0.0002 | ETA 03:20:33 2020-11-14 02:32:06 [INFO] [TRAIN] epoch=20, iter=12780/40000, loss=0.3164, lr=0.007075, batch_cost=0.4425, reader_cost=0.0002 | ETA 03:20:43 2020-11-14 02:32:10 [INFO] [TRAIN] epoch=20, iter=12790/40000, loss=0.3060, lr=0.007073, batch_cost=0.4433, reader_cost=0.0002 | ETA 03:21:01 2020-11-14 02:32:14 [INFO] [TRAIN] epoch=20, iter=12800/40000, loss=0.3975, lr=0.007071, batch_cost=0.4429, reader_cost=0.0002 | ETA 03:20:46 2020-11-14 02:32:19 [INFO] [TRAIN] epoch=20, iter=12810/40000, loss=0.3670, lr=0.007068, batch_cost=0.4431, reader_cost=0.0002 | ETA 03:20:46 2020-11-14 02:32:23 [INFO] [TRAIN] epoch=20, iter=12820/40000, loss=0.2868, lr=0.007066, batch_cost=0.4413, reader_cost=0.0002 | ETA 03:19:55 2020-11-14 02:32:28 [INFO] [TRAIN] epoch=20, iter=12830/40000, loss=0.3417, lr=0.007064, batch_cost=0.4409, reader_cost=0.0002 | ETA 03:19:38 2020-11-14 02:32:32 [INFO] [TRAIN] epoch=20, iter=12840/40000, loss=0.2786, lr=0.007061, batch_cost=0.4412, reader_cost=0.0002 | ETA 03:19:42 2020-11-14 02:32:37 [INFO] [TRAIN] epoch=20, iter=12850/40000, loss=0.2703, lr=0.007059, batch_cost=0.4409, reader_cost=0.0002 | ETA 03:19:30 2020-11-14 02:32:41 [INFO] [TRAIN] epoch=20, iter=12860/40000, loss=0.5906, lr=0.007057, batch_cost=0.4409, reader_cost=0.0002 | ETA 03:19:25 2020-11-14 02:32:45 [INFO] [TRAIN] epoch=20, iter=12870/40000, loss=0.5236, lr=0.007054, batch_cost=0.4416, reader_cost=0.0002 | ETA 03:19:41 2020-11-14 02:32:50 [INFO] [TRAIN] epoch=20, iter=12880/40000, loss=0.2953, lr=0.007052, batch_cost=0.4410, reader_cost=0.0002 | ETA 03:19:19 2020-11-14 02:32:54 [INFO] [TRAIN] epoch=20, iter=12890/40000, loss=0.2718, lr=0.007050, batch_cost=0.4394, reader_cost=0.0002 | ETA 03:18:32 2020-11-14 02:32:59 [INFO] [TRAIN] epoch=20, iter=12900/40000, loss=0.5022, lr=0.007047, batch_cost=0.4402, reader_cost=0.0002 | ETA 03:18:49 2020-11-14 02:33:03 [INFO] [TRAIN] epoch=20, iter=12910/40000, loss=0.3065, lr=0.007045, batch_cost=0.4424, reader_cost=0.0002 | ETA 03:19:45 2020-11-14 02:33:07 [INFO] [TRAIN] epoch=20, iter=12920/40000, loss=0.3558, lr=0.007042, batch_cost=0.4413, reader_cost=0.0002 | ETA 03:19:10 2020-11-14 02:33:12 [INFO] [TRAIN] epoch=20, iter=12930/40000, loss=0.3521, lr=0.007040, batch_cost=0.4410, reader_cost=0.0002 | ETA 03:18:56 2020-11-14 02:33:16 [INFO] [TRAIN] epoch=20, iter=12940/40000, loss=0.2907, lr=0.007038, batch_cost=0.4403, reader_cost=0.0002 | ETA 03:18:33 2020-11-14 02:33:21 [INFO] [TRAIN] epoch=20, iter=12950/40000, loss=0.4558, lr=0.007035, batch_cost=0.4421, reader_cost=0.0002 | ETA 03:19:17 2020-11-14 02:33:25 [INFO] [TRAIN] epoch=20, iter=12960/40000, loss=0.4079, lr=0.007033, batch_cost=0.4318, reader_cost=0.0002 | ETA 03:14:35 2020-11-14 02:33:29 [INFO] [TRAIN] epoch=20, iter=12970/40000, loss=0.4275, lr=0.007031, batch_cost=0.4487, reader_cost=0.0002 | ETA 03:22:08 2020-11-14 02:33:34 [INFO] [TRAIN] epoch=20, iter=12980/40000, loss=0.2888, lr=0.007028, batch_cost=0.4821, reader_cost=0.0002 | ETA 03:37:05 2020-11-14 02:33:39 [INFO] [TRAIN] epoch=20, iter=12990/40000, loss=0.4091, lr=0.007026, batch_cost=0.4338, reader_cost=0.0002 | ETA 03:15:16 2020-11-14 02:33:43 [INFO] [TRAIN] epoch=20, iter=13000/40000, loss=0.4904, lr=0.007024, batch_cost=0.4373, reader_cost=0.0002 | ETA 03:16:47 2020-11-14 02:33:48 [INFO] [TRAIN] epoch=20, iter=13010/40000, loss=0.3993, lr=0.007021, batch_cost=0.4588, reader_cost=0.0002 | ETA 03:26:23 2020-11-14 02:33:52 [INFO] [TRAIN] epoch=20, iter=13020/40000, loss=0.3696, lr=0.007019, batch_cost=0.4512, reader_cost=0.0002 | ETA 03:22:53 2020-11-14 02:33:57 [INFO] [TRAIN] epoch=20, iter=13030/40000, loss=0.2777, lr=0.007017, batch_cost=0.4718, reader_cost=0.0002 | ETA 03:32:04 2020-11-14 02:34:02 [INFO] [TRAIN] epoch=20, iter=13040/40000, loss=0.3928, lr=0.007014, batch_cost=0.4725, reader_cost=0.0002 | ETA 03:32:19 2020-11-14 02:34:06 [INFO] [TRAIN] epoch=20, iter=13050/40000, loss=0.2836, lr=0.007012, batch_cost=0.4593, reader_cost=0.0002 | ETA 03:26:16 2020-11-14 02:34:11 [INFO] [TRAIN] epoch=20, iter=13060/40000, loss=0.3330, lr=0.007010, batch_cost=0.4676, reader_cost=0.0002 | ETA 03:29:56 2020-11-14 02:34:17 [INFO] [TRAIN] epoch=20, iter=13070/40000, loss=0.2829, lr=0.007007, batch_cost=0.6599, reader_cost=0.0002 | ETA 04:56:10 2020-11-14 02:34:25 [INFO] [TRAIN] epoch=20, iter=13080/40000, loss=0.3925, lr=0.007005, batch_cost=0.7940, reader_cost=0.0002 | ETA 05:56:14 2020-11-14 02:34:33 [INFO] [TRAIN] epoch=20, iter=13090/40000, loss=0.4643, lr=0.007003, batch_cost=0.7740, reader_cost=0.0002 | ETA 05:47:09 2020-11-14 02:34:38 [INFO] [TRAIN] epoch=20, iter=13100/40000, loss=0.3352, lr=0.007000, batch_cost=0.4512, reader_cost=0.0002 | ETA 03:22:18 2020-11-14 02:34:42 [INFO] [TRAIN] epoch=20, iter=13110/40000, loss=0.2623, lr=0.006998, batch_cost=0.4355, reader_cost=0.0002 | ETA 03:15:11 2020-11-14 02:34:46 [INFO] [TRAIN] epoch=20, iter=13120/40000, loss=0.3013, lr=0.006996, batch_cost=0.4360, reader_cost=0.0002 | ETA 03:15:19 2020-11-14 02:34:51 [INFO] [TRAIN] epoch=20, iter=13130/40000, loss=0.2041, lr=0.006993, batch_cost=0.4389, reader_cost=0.0002 | ETA 03:16:34 2020-11-14 02:34:55 [INFO] [TRAIN] epoch=20, iter=13140/40000, loss=0.3556, lr=0.006991, batch_cost=0.4343, reader_cost=0.0002 | ETA 03:14:25 2020-11-14 02:34:59 [INFO] [TRAIN] epoch=20, iter=13150/40000, loss=0.3742, lr=0.006989, batch_cost=0.4361, reader_cost=0.0002 | ETA 03:15:09 2020-11-14 02:35:04 [INFO] [TRAIN] epoch=20, iter=13160/40000, loss=0.3046, lr=0.006986, batch_cost=0.4381, reader_cost=0.0002 | ETA 03:15:57 2020-11-14 02:35:08 [INFO] [TRAIN] epoch=20, iter=13170/40000, loss=0.2749, lr=0.006984, batch_cost=0.4364, reader_cost=0.0002 | ETA 03:15:08 2020-11-14 02:35:12 [INFO] [TRAIN] epoch=20, iter=13180/40000, loss=0.2974, lr=0.006982, batch_cost=0.4304, reader_cost=0.0002 | ETA 03:12:24 2020-11-14 02:35:17 [INFO] [TRAIN] epoch=20, iter=13190/40000, loss=0.4010, lr=0.006979, batch_cost=0.4506, reader_cost=0.0002 | ETA 03:21:20 2020-11-14 02:35:21 [INFO] [TRAIN] epoch=20, iter=13200/40000, loss=0.3877, lr=0.006977, batch_cost=0.4367, reader_cost=0.0002 | ETA 03:15:02 2020-11-14 02:35:26 [INFO] [TRAIN] epoch=20, iter=13210/40000, loss=0.3540, lr=0.006975, batch_cost=0.4376, reader_cost=0.0002 | ETA 03:15:21 2020-11-14 02:35:30 [INFO] [TRAIN] epoch=20, iter=13220/40000, loss=0.3956, lr=0.006972, batch_cost=0.4340, reader_cost=0.0002 | ETA 03:13:42 2020-11-14 02:35:36 [INFO] [TRAIN] epoch=21, iter=13230/40000, loss=0.3483, lr=0.006970, batch_cost=0.5732, reader_cost=0.1208 | ETA 04:15:44 2020-11-14 02:35:40 [INFO] [TRAIN] epoch=21, iter=13240/40000, loss=0.2881, lr=0.006968, batch_cost=0.4497, reader_cost=0.0005 | ETA 03:20:33 2020-11-14 02:35:45 [INFO] [TRAIN] epoch=21, iter=13250/40000, loss=0.2764, lr=0.006965, batch_cost=0.5158, reader_cost=0.0041 | ETA 03:49:57 2020-11-14 02:35:51 [INFO] [TRAIN] epoch=21, iter=13260/40000, loss=0.2844, lr=0.006963, batch_cost=0.5288, reader_cost=0.0002 | ETA 03:55:40 2020-11-14 02:35:56 [INFO] [TRAIN] epoch=21, iter=13270/40000, loss=0.3092, lr=0.006961, batch_cost=0.4956, reader_cost=0.0002 | ETA 03:40:46 2020-11-14 02:36:01 [INFO] [TRAIN] epoch=21, iter=13280/40000, loss=0.2601, lr=0.006958, batch_cost=0.5287, reader_cost=0.0002 | ETA 03:55:27 2020-11-14 02:36:06 [INFO] [TRAIN] epoch=21, iter=13290/40000, loss=0.3130, lr=0.006956, batch_cost=0.4755, reader_cost=0.0002 | ETA 03:31:40 2020-11-14 02:36:10 [INFO] [TRAIN] epoch=21, iter=13300/40000, loss=0.3165, lr=0.006954, batch_cost=0.4371, reader_cost=0.0002 | ETA 03:14:30 2020-11-14 02:36:14 [INFO] [TRAIN] epoch=21, iter=13310/40000, loss=0.3371, lr=0.006951, batch_cost=0.4355, reader_cost=0.0002 | ETA 03:13:44 2020-11-14 02:36:19 [INFO] [TRAIN] epoch=21, iter=13320/40000, loss=0.3912, lr=0.006949, batch_cost=0.4344, reader_cost=0.0002 | ETA 03:13:09 2020-11-14 02:36:24 [INFO] [TRAIN] epoch=21, iter=13330/40000, loss=0.3185, lr=0.006947, batch_cost=0.4721, reader_cost=0.0047 | ETA 03:29:50 2020-11-14 02:36:29 [INFO] [TRAIN] epoch=21, iter=13340/40000, loss=0.4180, lr=0.006944, batch_cost=0.5313, reader_cost=0.0107 | ETA 03:56:04 2020-11-14 02:36:34 [INFO] [TRAIN] epoch=21, iter=13350/40000, loss=0.3865, lr=0.006942, batch_cost=0.5179, reader_cost=0.0100 | ETA 03:50:01 2020-11-14 02:36:39 [INFO] [TRAIN] epoch=21, iter=13360/40000, loss=0.4066, lr=0.006940, batch_cost=0.4913, reader_cost=0.0069 | ETA 03:38:08 2020-11-14 02:36:44 [INFO] [TRAIN] epoch=21, iter=13370/40000, loss=0.2671, lr=0.006937, batch_cost=0.4695, reader_cost=0.0002 | ETA 03:28:23 2020-11-14 02:36:49 [INFO] [TRAIN] epoch=21, iter=13380/40000, loss=0.3669, lr=0.006935, batch_cost=0.4995, reader_cost=0.0002 | ETA 03:41:37 2020-11-14 02:36:53 [INFO] [TRAIN] epoch=21, iter=13390/40000, loss=0.2505, lr=0.006933, batch_cost=0.4481, reader_cost=0.0002 | ETA 03:18:43 2020-11-14 02:36:58 [INFO] [TRAIN] epoch=21, iter=13400/40000, loss=0.3679, lr=0.006930, batch_cost=0.4436, reader_cost=0.0002 | ETA 03:16:41 2020-11-14 02:37:02 [INFO] [TRAIN] epoch=21, iter=13410/40000, loss=0.3432, lr=0.006928, batch_cost=0.4571, reader_cost=0.0002 | ETA 03:22:34 2020-11-14 02:37:07 [INFO] [TRAIN] epoch=21, iter=13420/40000, loss=0.3558, lr=0.006926, batch_cost=0.4737, reader_cost=0.0002 | ETA 03:29:52 2020-11-14 02:37:11 [INFO] [TRAIN] epoch=21, iter=13430/40000, loss=0.2833, lr=0.006923, batch_cost=0.4467, reader_cost=0.0002 | ETA 03:17:48 2020-11-14 02:37:16 [INFO] [TRAIN] epoch=21, iter=13440/40000, loss=0.3136, lr=0.006921, batch_cost=0.4742, reader_cost=0.0002 | ETA 03:29:55 2020-11-14 02:37:21 [INFO] [TRAIN] epoch=21, iter=13450/40000, loss=0.2719, lr=0.006919, batch_cost=0.4927, reader_cost=0.0002 | ETA 03:38:02 2020-11-14 02:37:26 [INFO] [TRAIN] epoch=21, iter=13460/40000, loss=0.2469, lr=0.006916, batch_cost=0.4802, reader_cost=0.0002 | ETA 03:32:23 2020-11-14 02:37:30 [INFO] [TRAIN] epoch=21, iter=13470/40000, loss=0.2940, lr=0.006914, batch_cost=0.4544, reader_cost=0.0002 | ETA 03:20:55 2020-11-14 02:37:35 [INFO] [TRAIN] epoch=21, iter=13480/40000, loss=0.2690, lr=0.006911, batch_cost=0.5055, reader_cost=0.0002 | ETA 03:43:25 2020-11-14 02:37:40 [INFO] [TRAIN] epoch=21, iter=13490/40000, loss=0.3222, lr=0.006909, batch_cost=0.4556, reader_cost=0.0002 | ETA 03:21:19 2020-11-14 02:37:44 [INFO] [TRAIN] epoch=21, iter=13500/40000, loss=0.2647, lr=0.006907, batch_cost=0.4396, reader_cost=0.0002 | ETA 03:14:09 2020-11-14 02:37:49 [INFO] [TRAIN] epoch=21, iter=13510/40000, loss=0.3386, lr=0.006904, batch_cost=0.4436, reader_cost=0.0002 | ETA 03:15:51 2020-11-14 02:37:53 [INFO] [TRAIN] epoch=21, iter=13520/40000, loss=0.4505, lr=0.006902, batch_cost=0.4372, reader_cost=0.0002 | ETA 03:12:55 2020-11-14 02:37:58 [INFO] [TRAIN] epoch=21, iter=13530/40000, loss=0.2441, lr=0.006900, batch_cost=0.4369, reader_cost=0.0002 | ETA 03:12:44 2020-11-14 02:38:02 [INFO] [TRAIN] epoch=21, iter=13540/40000, loss=0.4177, lr=0.006897, batch_cost=0.4506, reader_cost=0.0005 | ETA 03:18:43 2020-11-14 02:38:07 [INFO] [TRAIN] epoch=21, iter=13550/40000, loss=0.2580, lr=0.006895, batch_cost=0.4930, reader_cost=0.0012 | ETA 03:37:20 2020-11-14 02:38:12 [INFO] [TRAIN] epoch=21, iter=13560/40000, loss=0.3034, lr=0.006893, batch_cost=0.4638, reader_cost=0.0002 | ETA 03:24:23 2020-11-14 02:38:16 [INFO] [TRAIN] epoch=21, iter=13570/40000, loss=0.2950, lr=0.006890, batch_cost=0.4599, reader_cost=0.0002 | ETA 03:22:33 2020-11-14 02:38:21 [INFO] [TRAIN] epoch=21, iter=13580/40000, loss=0.2906, lr=0.006888, batch_cost=0.4422, reader_cost=0.0002 | ETA 03:14:43 2020-11-14 02:38:25 [INFO] [TRAIN] epoch=21, iter=13590/40000, loss=0.2610, lr=0.006886, batch_cost=0.4532, reader_cost=0.0002 | ETA 03:19:29 2020-11-14 02:38:30 [INFO] [TRAIN] epoch=21, iter=13600/40000, loss=0.4534, lr=0.006883, batch_cost=0.4432, reader_cost=0.0022 | ETA 03:15:00 2020-11-14 02:38:34 [INFO] [TRAIN] epoch=21, iter=13610/40000, loss=0.3715, lr=0.006881, batch_cost=0.4687, reader_cost=0.0003 | ETA 03:26:08 2020-11-14 02:38:39 [INFO] [TRAIN] epoch=21, iter=13620/40000, loss=0.2538, lr=0.006879, batch_cost=0.4420, reader_cost=0.0002 | ETA 03:14:20 2020-11-14 02:38:43 [INFO] [TRAIN] epoch=21, iter=13630/40000, loss=0.3668, lr=0.006876, batch_cost=0.4458, reader_cost=0.0002 | ETA 03:15:54 2020-11-14 02:38:48 [INFO] [TRAIN] epoch=21, iter=13640/40000, loss=0.2572, lr=0.006874, batch_cost=0.4518, reader_cost=0.0002 | ETA 03:18:30 2020-11-14 02:38:52 [INFO] [TRAIN] epoch=21, iter=13650/40000, loss=0.3638, lr=0.006872, batch_cost=0.4414, reader_cost=0.0002 | ETA 03:13:49 2020-11-14 02:38:57 [INFO] [TRAIN] epoch=21, iter=13660/40000, loss=0.3245, lr=0.006869, batch_cost=0.4481, reader_cost=0.0059 | ETA 03:16:41 2020-11-14 02:39:01 [INFO] [TRAIN] epoch=21, iter=13670/40000, loss=0.3384, lr=0.006867, batch_cost=0.4729, reader_cost=0.0011 | ETA 03:27:30 2020-11-14 02:39:06 [INFO] [TRAIN] epoch=21, iter=13680/40000, loss=0.5173, lr=0.006865, batch_cost=0.5077, reader_cost=0.0002 | ETA 03:42:41 2020-11-14 02:39:11 [INFO] [TRAIN] epoch=21, iter=13690/40000, loss=0.2546, lr=0.006862, batch_cost=0.4415, reader_cost=0.0002 | ETA 03:13:36 2020-11-14 02:39:15 [INFO] [TRAIN] epoch=21, iter=13700/40000, loss=0.3033, lr=0.006860, batch_cost=0.4456, reader_cost=0.0002 | ETA 03:15:19 2020-11-14 02:39:20 [INFO] [TRAIN] epoch=21, iter=13710/40000, loss=0.2206, lr=0.006858, batch_cost=0.4422, reader_cost=0.0002 | ETA 03:13:45 2020-11-14 02:39:24 [INFO] [TRAIN] epoch=21, iter=13720/40000, loss=0.3175, lr=0.006855, batch_cost=0.4410, reader_cost=0.0002 | ETA 03:13:08 2020-11-14 02:39:29 [INFO] [TRAIN] epoch=21, iter=13730/40000, loss=0.4279, lr=0.006853, batch_cost=0.4382, reader_cost=0.0002 | ETA 03:11:51 2020-11-14 02:39:33 [INFO] [TRAIN] epoch=21, iter=13740/40000, loss=0.4317, lr=0.006851, batch_cost=0.4476, reader_cost=0.0002 | ETA 03:15:54 2020-11-14 02:39:38 [INFO] [TRAIN] epoch=21, iter=13750/40000, loss=0.3767, lr=0.006848, batch_cost=0.4597, reader_cost=0.0002 | ETA 03:21:07 2020-11-14 02:39:42 [INFO] [TRAIN] epoch=21, iter=13760/40000, loss=0.3600, lr=0.006846, batch_cost=0.4756, reader_cost=0.0002 | ETA 03:27:59 2020-11-14 02:39:47 [INFO] [TRAIN] epoch=21, iter=13770/40000, loss=0.3900, lr=0.006844, batch_cost=0.4943, reader_cost=0.0005 | ETA 03:36:06 2020-11-14 02:39:52 [INFO] [TRAIN] epoch=21, iter=13780/40000, loss=0.3705, lr=0.006841, batch_cost=0.4755, reader_cost=0.0006 | ETA 03:27:47 2020-11-14 02:39:57 [INFO] [TRAIN] epoch=21, iter=13790/40000, loss=0.3868, lr=0.006839, batch_cost=0.4416, reader_cost=0.0002 | ETA 03:12:55 2020-11-14 02:40:01 [INFO] [TRAIN] epoch=21, iter=13800/40000, loss=0.6379, lr=0.006836, batch_cost=0.4486, reader_cost=0.0002 | ETA 03:15:54 2020-11-14 02:40:05 [INFO] [TRAIN] epoch=21, iter=13810/40000, loss=0.3202, lr=0.006834, batch_cost=0.4349, reader_cost=0.0002 | ETA 03:09:48 2020-11-14 02:40:10 [INFO] [TRAIN] epoch=21, iter=13820/40000, loss=0.2599, lr=0.006832, batch_cost=0.4372, reader_cost=0.0002 | ETA 03:10:46 2020-11-14 02:40:14 [INFO] [TRAIN] epoch=21, iter=13830/40000, loss=0.3690, lr=0.006829, batch_cost=0.4584, reader_cost=0.0002 | ETA 03:19:55 2020-11-14 02:40:19 [INFO] [TRAIN] epoch=21, iter=13840/40000, loss=0.2953, lr=0.006827, batch_cost=0.4901, reader_cost=0.0002 | ETA 03:33:40 2020-11-14 02:40:24 [INFO] [TRAIN] epoch=21, iter=13850/40000, loss=0.5610, lr=0.006825, batch_cost=0.4504, reader_cost=0.0002 | ETA 03:16:17 2020-11-14 02:40:28 [INFO] [TRAIN] epoch=21, iter=13860/40000, loss=0.6125, lr=0.006822, batch_cost=0.4285, reader_cost=0.0002 | ETA 03:06:40 2020-11-14 02:40:32 [INFO] [TRAIN] epoch=21, iter=13870/40000, loss=0.3988, lr=0.006820, batch_cost=0.4300, reader_cost=0.0002 | ETA 03:07:15 2020-11-14 02:40:37 [INFO] [TRAIN] epoch=21, iter=13880/40000, loss=0.4683, lr=0.006818, batch_cost=0.4278, reader_cost=0.0002 | ETA 03:06:14 2020-11-14 02:40:42 [INFO] [TRAIN] epoch=22, iter=13890/40000, loss=0.4035, lr=0.006815, batch_cost=0.5317, reader_cost=0.1013 | ETA 03:51:23 2020-11-14 02:40:46 [INFO] [TRAIN] epoch=22, iter=13900/40000, loss=0.3233, lr=0.006813, batch_cost=0.4270, reader_cost=0.0005 | ETA 03:05:44 2020-11-14 02:40:50 [INFO] [TRAIN] epoch=22, iter=13910/40000, loss=0.3354, lr=0.006811, batch_cost=0.4266, reader_cost=0.0002 | ETA 03:05:29 2020-11-14 02:40:55 [INFO] [TRAIN] epoch=22, iter=13920/40000, loss=0.2980, lr=0.006808, batch_cost=0.4278, reader_cost=0.0002 | ETA 03:05:56 2020-11-14 02:40:59 [INFO] [TRAIN] epoch=22, iter=13930/40000, loss=0.4093, lr=0.006806, batch_cost=0.4270, reader_cost=0.0002 | ETA 03:05:30 2020-11-14 02:41:03 [INFO] [TRAIN] epoch=22, iter=13940/40000, loss=0.5009, lr=0.006804, batch_cost=0.4279, reader_cost=0.0002 | ETA 03:05:49 2020-11-14 02:41:08 [INFO] [TRAIN] epoch=22, iter=13950/40000, loss=0.3682, lr=0.006801, batch_cost=0.4279, reader_cost=0.0002 | ETA 03:05:46 2020-11-14 02:41:12 [INFO] [TRAIN] epoch=22, iter=13960/40000, loss=0.3128, lr=0.006799, batch_cost=0.4569, reader_cost=0.0002 | ETA 03:18:18 2020-11-14 02:41:17 [INFO] [TRAIN] epoch=22, iter=13970/40000, loss=0.4604, lr=0.006797, batch_cost=0.4527, reader_cost=0.0002 | ETA 03:16:23 2020-11-14 02:41:21 [INFO] [TRAIN] epoch=22, iter=13980/40000, loss=0.3036, lr=0.006794, batch_cost=0.4464, reader_cost=0.0002 | ETA 03:13:35 2020-11-14 02:41:26 [INFO] [TRAIN] epoch=22, iter=13990/40000, loss=0.3496, lr=0.006792, batch_cost=0.4395, reader_cost=0.0002 | ETA 03:10:30 2020-11-14 02:41:30 [INFO] [TRAIN] epoch=22, iter=14000/40000, loss=0.3532, lr=0.006790, batch_cost=0.4435, reader_cost=0.0002 | ETA 03:12:11 2020-11-14 02:41:30 [INFO] Start evaluating (total_samples=1449, total_iters=363)... 2020-11-14 02:41:51 [INFO] [EVAL] #Images=1449 mIoU=0.7611 Acc=0.9446 Kappa=0.8790 2020-11-14 02:41:51 [INFO] [EVAL] Class IoU: [0.9386 0.8911 0.3471 0.8723 0.631 0.7773 0.9471 0.8865 0.9094 0.437 0.8712 0.5811 0.8594 0.8745 0.8143 0.8453 0.6234 0.8008 0.4347 0.9014 0.7401] 2020-11-14 02:41:51 [INFO] [EVAL] Class Acc: [0.9692 0.924 0.3508 0.9092 0.6566 0.8726 0.9705 0.9593 0.9414 0.5896 0.9273 0.9529 0.9083 0.908 0.8458 0.9094 0.8461 0.8943 0.7936 0.952 0.9354] 2020-11-14 02:41:59 [INFO] [EVAL] The model with the best validation mIoU (0.7611) was saved at iter 14000. 2020-11-14 02:42:04 [INFO] [TRAIN] epoch=22, iter=14010/40000, loss=0.2820, lr=0.006787, batch_cost=0.4339, reader_cost=0.0004 | ETA 03:07:57 2020-11-14 02:42:08 [INFO] [TRAIN] epoch=22, iter=14020/40000, loss=0.3405, lr=0.006785, batch_cost=0.4505, reader_cost=0.0005 | ETA 03:15:04 2020-11-14 02:42:13 [INFO] [TRAIN] epoch=22, iter=14030/40000, loss=0.3338, lr=0.006783, batch_cost=0.4567, reader_cost=0.0005 | ETA 03:17:41 2020-11-14 02:42:17 [INFO] [TRAIN] epoch=22, iter=14040/40000, loss=0.4212, lr=0.006780, batch_cost=0.4618, reader_cost=0.0005 | ETA 03:19:47 2020-11-14 02:42:22 [INFO] [TRAIN] epoch=22, iter=14050/40000, loss=0.4272, lr=0.006778, batch_cost=0.4407, reader_cost=0.0002 | ETA 03:10:36 2020-11-14 02:42:26 [INFO] [TRAIN] epoch=22, iter=14060/40000, loss=0.4455, lr=0.006775, batch_cost=0.4660, reader_cost=0.0002 | ETA 03:21:28 2020-11-14 02:42:31 [INFO] [TRAIN] epoch=22, iter=14070/40000, loss=0.3163, lr=0.006773, batch_cost=0.4560, reader_cost=0.0002 | ETA 03:17:03 2020-11-14 02:42:36 [INFO] [TRAIN] epoch=22, iter=14080/40000, loss=0.2896, lr=0.006771, batch_cost=0.4600, reader_cost=0.0002 | ETA 03:18:43 2020-11-14 02:42:40 [INFO] [TRAIN] epoch=22, iter=14090/40000, loss=0.4304, lr=0.006768, batch_cost=0.4507, reader_cost=0.0002 | ETA 03:14:37 2020-11-14 02:42:45 [INFO] [TRAIN] epoch=22, iter=14100/40000, loss=0.4523, lr=0.006766, batch_cost=0.4612, reader_cost=0.0002 | ETA 03:19:05 2020-11-14 02:42:49 [INFO] [TRAIN] epoch=22, iter=14110/40000, loss=0.2943, lr=0.006764, batch_cost=0.4439, reader_cost=0.0002 | ETA 03:11:33 2020-11-14 02:42:54 [INFO] [TRAIN] epoch=22, iter=14120/40000, loss=0.2711, lr=0.006761, batch_cost=0.4693, reader_cost=0.0002 | ETA 03:22:24 2020-11-14 02:42:58 [INFO] [TRAIN] epoch=22, iter=14130/40000, loss=0.3136, lr=0.006759, batch_cost=0.4339, reader_cost=0.0002 | ETA 03:07:04 2020-11-14 02:43:03 [INFO] [TRAIN] epoch=22, iter=14140/40000, loss=0.3706, lr=0.006757, batch_cost=0.4562, reader_cost=0.0003 | ETA 03:16:36 2020-11-14 02:43:07 [INFO] [TRAIN] epoch=22, iter=14150/40000, loss=0.3539, lr=0.006754, batch_cost=0.4358, reader_cost=0.0002 | ETA 03:07:45 2020-11-14 02:43:11 [INFO] [TRAIN] epoch=22, iter=14160/40000, loss=0.3002, lr=0.006752, batch_cost=0.4358, reader_cost=0.0002 | ETA 03:07:40 2020-11-14 02:43:16 [INFO] [TRAIN] epoch=22, iter=14170/40000, loss=0.3514, lr=0.006750, batch_cost=0.4629, reader_cost=0.0022 | ETA 03:19:15 2020-11-14 02:43:21 [INFO] [TRAIN] epoch=22, iter=14180/40000, loss=0.3607, lr=0.006747, batch_cost=0.5398, reader_cost=0.0016 | ETA 03:52:16 2020-11-14 02:43:26 [INFO] [TRAIN] epoch=22, iter=14190/40000, loss=0.3429, lr=0.006745, batch_cost=0.4761, reader_cost=0.0015 | ETA 03:24:47 2020-11-14 02:43:31 [INFO] [TRAIN] epoch=22, iter=14200/40000, loss=0.4975, lr=0.006743, batch_cost=0.4373, reader_cost=0.0002 | ETA 03:08:02 2020-11-14 02:43:35 [INFO] [TRAIN] epoch=22, iter=14210/40000, loss=0.1979, lr=0.006740, batch_cost=0.4595, reader_cost=0.0002 | ETA 03:17:30 2020-11-14 02:43:40 [INFO] [TRAIN] epoch=22, iter=14220/40000, loss=0.3506, lr=0.006738, batch_cost=0.4623, reader_cost=0.0002 | ETA 03:18:38 2020-11-14 02:43:44 [INFO] [TRAIN] epoch=22, iter=14230/40000, loss=0.3489, lr=0.006736, batch_cost=0.4614, reader_cost=0.0003 | ETA 03:18:10 2020-11-14 02:43:49 [INFO] [TRAIN] epoch=22, iter=14240/40000, loss=0.2318, lr=0.006733, batch_cost=0.4430, reader_cost=0.0002 | ETA 03:10:10 2020-11-14 02:43:53 [INFO] [TRAIN] epoch=22, iter=14250/40000, loss=0.2402, lr=0.006731, batch_cost=0.4490, reader_cost=0.0011 | ETA 03:12:41 2020-11-14 02:43:58 [INFO] [TRAIN] epoch=22, iter=14260/40000, loss=0.4065, lr=0.006729, batch_cost=0.4507, reader_cost=0.0002 | ETA 03:13:21 2020-11-14 02:44:02 [INFO] [TRAIN] epoch=22, iter=14270/40000, loss=0.2473, lr=0.006726, batch_cost=0.4560, reader_cost=0.0012 | ETA 03:15:33 2020-11-14 02:44:07 [INFO] [TRAIN] epoch=22, iter=14280/40000, loss=0.2914, lr=0.006724, batch_cost=0.4746, reader_cost=0.0002 | ETA 03:23:27 2020-11-14 02:44:12 [INFO] [TRAIN] epoch=22, iter=14290/40000, loss=0.2806, lr=0.006721, batch_cost=0.4428, reader_cost=0.0002 | ETA 03:09:43 2020-11-14 02:44:16 [INFO] [TRAIN] epoch=22, iter=14300/40000, loss=0.3312, lr=0.006719, batch_cost=0.4427, reader_cost=0.0011 | ETA 03:09:36 2020-11-14 02:44:21 [INFO] [TRAIN] epoch=22, iter=14310/40000, loss=0.2791, lr=0.006717, batch_cost=0.4654, reader_cost=0.0002 | ETA 03:19:14 2020-11-14 02:44:28 [INFO] [TRAIN] epoch=22, iter=14320/40000, loss=0.3963, lr=0.006714, batch_cost=0.7475, reader_cost=0.0029 | ETA 05:19:56 2020-11-14 02:44:33 [INFO] [TRAIN] epoch=22, iter=14330/40000, loss=0.4190, lr=0.006712, batch_cost=0.4429, reader_cost=0.0002 | ETA 03:09:30 2020-11-14 02:44:37 [INFO] [TRAIN] epoch=22, iter=14340/40000, loss=0.3181, lr=0.006710, batch_cost=0.4610, reader_cost=0.0002 | ETA 03:17:08 2020-11-14 02:44:42 [INFO] [TRAIN] epoch=22, iter=14350/40000, loss=0.3471, lr=0.006707, batch_cost=0.4641, reader_cost=0.0002 | ETA 03:18:23 2020-11-14 02:44:46 [INFO] [TRAIN] epoch=22, iter=14360/40000, loss=0.2983, lr=0.006705, batch_cost=0.4552, reader_cost=0.0002 | ETA 03:14:31 2020-11-14 02:44:51 [INFO] [TRAIN] epoch=22, iter=14370/40000, loss=0.2272, lr=0.006703, batch_cost=0.4558, reader_cost=0.0002 | ETA 03:14:42 2020-11-14 02:44:55 [INFO] [TRAIN] epoch=22, iter=14380/40000, loss=0.3049, lr=0.006700, batch_cost=0.4549, reader_cost=0.0002 | ETA 03:14:14 2020-11-14 02:45:00 [INFO] [TRAIN] epoch=22, iter=14390/40000, loss=0.2970, lr=0.006698, batch_cost=0.4601, reader_cost=0.0002 | ETA 03:16:23 2020-11-14 02:45:05 [INFO] [TRAIN] epoch=22, iter=14400/40000, loss=0.3290, lr=0.006696, batch_cost=0.4545, reader_cost=0.0002 | ETA 03:13:55 2020-11-14 02:45:09 [INFO] [TRAIN] epoch=22, iter=14410/40000, loss=0.4146, lr=0.006693, batch_cost=0.4552, reader_cost=0.0002 | ETA 03:14:09 2020-11-14 02:45:14 [INFO] [TRAIN] epoch=22, iter=14420/40000, loss=0.3414, lr=0.006691, batch_cost=0.4601, reader_cost=0.0002 | ETA 03:16:08 2020-11-14 02:45:18 [INFO] [TRAIN] epoch=22, iter=14430/40000, loss=0.4449, lr=0.006689, batch_cost=0.4553, reader_cost=0.0021 | ETA 03:14:02 2020-11-14 02:45:23 [INFO] [TRAIN] epoch=22, iter=14440/40000, loss=0.4699, lr=0.006686, batch_cost=0.4786, reader_cost=0.0002 | ETA 03:23:53 2020-11-14 02:45:28 [INFO] [TRAIN] epoch=22, iter=14450/40000, loss=0.2875, lr=0.006684, batch_cost=0.5167, reader_cost=0.0012 | ETA 03:40:02 2020-11-14 02:45:33 [INFO] [TRAIN] epoch=22, iter=14460/40000, loss=0.4017, lr=0.006682, batch_cost=0.4647, reader_cost=0.0023 | ETA 03:17:47 2020-11-14 02:45:37 [INFO] [TRAIN] epoch=22, iter=14470/40000, loss=0.2619, lr=0.006679, batch_cost=0.4526, reader_cost=0.0002 | ETA 03:12:35 2020-11-14 02:45:42 [INFO] [TRAIN] epoch=22, iter=14480/40000, loss=0.3478, lr=0.006677, batch_cost=0.4352, reader_cost=0.0002 | ETA 03:05:05 2020-11-14 02:45:46 [INFO] [TRAIN] epoch=22, iter=14490/40000, loss=0.3548, lr=0.006674, batch_cost=0.4405, reader_cost=0.0002 | ETA 03:07:16 2020-11-14 02:45:51 [INFO] [TRAIN] epoch=22, iter=14500/40000, loss=0.4221, lr=0.006672, batch_cost=0.4333, reader_cost=0.0002 | ETA 03:04:07 2020-11-14 02:45:55 [INFO] [TRAIN] epoch=22, iter=14510/40000, loss=0.4475, lr=0.006670, batch_cost=0.4442, reader_cost=0.0003 | ETA 03:08:43 2020-11-14 02:45:59 [INFO] [TRAIN] epoch=22, iter=14520/40000, loss=0.2570, lr=0.006667, batch_cost=0.4358, reader_cost=0.0002 | ETA 03:05:05 2020-11-14 02:46:04 [INFO] [TRAIN] epoch=22, iter=14530/40000, loss=0.3070, lr=0.006665, batch_cost=0.4389, reader_cost=0.0003 | ETA 03:06:19 2020-11-14 02:46:08 [INFO] [TRAIN] epoch=22, iter=14540/40000, loss=0.3407, lr=0.006663, batch_cost=0.4343, reader_cost=0.0003 | ETA 03:04:16 2020-11-14 02:46:14 [INFO] [TRAIN] epoch=23, iter=14550/40000, loss=0.2153, lr=0.006660, batch_cost=0.5763, reader_cost=0.0988 | ETA 04:04:27 2020-11-14 02:46:18 [INFO] [TRAIN] epoch=23, iter=14560/40000, loss=0.4004, lr=0.006658, batch_cost=0.4372, reader_cost=0.0005 | ETA 03:05:23 2020-11-14 02:46:23 [INFO] [TRAIN] epoch=23, iter=14570/40000, loss=0.2836, lr=0.006656, batch_cost=0.4650, reader_cost=0.0002 | ETA 03:17:04 2020-11-14 02:46:27 [INFO] [TRAIN] epoch=23, iter=14580/40000, loss=0.2996, lr=0.006653, batch_cost=0.4509, reader_cost=0.0002 | ETA 03:11:02 2020-11-14 02:46:32 [INFO] [TRAIN] epoch=23, iter=14590/40000, loss=0.3077, lr=0.006651, batch_cost=0.4693, reader_cost=0.0036 | ETA 03:18:44 2020-11-14 02:46:37 [INFO] [TRAIN] epoch=23, iter=14600/40000, loss=0.3561, lr=0.006649, batch_cost=0.4661, reader_cost=0.0002 | ETA 03:17:19 2020-11-14 02:46:41 [INFO] [TRAIN] epoch=23, iter=14610/40000, loss=0.2846, lr=0.006646, batch_cost=0.4644, reader_cost=0.0022 | ETA 03:16:30 2020-11-14 02:46:46 [INFO] [TRAIN] epoch=23, iter=14620/40000, loss=0.2793, lr=0.006644, batch_cost=0.4885, reader_cost=0.0011 | ETA 03:26:39 2020-11-14 02:46:51 [INFO] [TRAIN] epoch=23, iter=14630/40000, loss=0.3136, lr=0.006642, batch_cost=0.4532, reader_cost=0.0003 | ETA 03:11:36 2020-11-14 02:46:55 [INFO] [TRAIN] epoch=23, iter=14640/40000, loss=0.2846, lr=0.006639, batch_cost=0.4650, reader_cost=0.0014 | ETA 03:16:33 2020-11-14 02:47:00 [INFO] [TRAIN] epoch=23, iter=14650/40000, loss=0.5546, lr=0.006637, batch_cost=0.4311, reader_cost=0.0002 | ETA 03:02:07 2020-11-14 02:47:04 [INFO] [TRAIN] epoch=23, iter=14660/40000, loss=0.4218, lr=0.006634, batch_cost=0.4381, reader_cost=0.0002 | ETA 03:05:02 2020-11-14 02:47:09 [INFO] [TRAIN] epoch=23, iter=14670/40000, loss=0.3802, lr=0.006632, batch_cost=0.4387, reader_cost=0.0002 | ETA 03:05:12 2020-11-14 02:47:13 [INFO] [TRAIN] epoch=23, iter=14680/40000, loss=0.3601, lr=0.006630, batch_cost=0.4461, reader_cost=0.0005 | ETA 03:08:14 2020-11-14 02:47:17 [INFO] [TRAIN] epoch=23, iter=14690/40000, loss=0.4349, lr=0.006627, batch_cost=0.4372, reader_cost=0.0002 | ETA 03:04:25 2020-11-14 02:47:22 [INFO] [TRAIN] epoch=23, iter=14700/40000, loss=0.2783, lr=0.006625, batch_cost=0.4340, reader_cost=0.0002 | ETA 03:02:59 2020-11-14 02:47:26 [INFO] [TRAIN] epoch=23, iter=14710/40000, loss=0.2618, lr=0.006623, batch_cost=0.4317, reader_cost=0.0002 | ETA 03:01:57 2020-11-14 02:47:30 [INFO] [TRAIN] epoch=23, iter=14720/40000, loss=0.3640, lr=0.006620, batch_cost=0.4349, reader_cost=0.0002 | ETA 03:03:14 2020-11-14 02:47:35 [INFO] [TRAIN] epoch=23, iter=14730/40000, loss=0.4195, lr=0.006618, batch_cost=0.4339, reader_cost=0.0002 | ETA 03:02:44 2020-11-14 02:47:39 [INFO] [TRAIN] epoch=23, iter=14740/40000, loss=0.3745, lr=0.006616, batch_cost=0.4306, reader_cost=0.0002 | ETA 03:01:16 2020-11-14 02:47:43 [INFO] [TRAIN] epoch=23, iter=14750/40000, loss=0.3003, lr=0.006613, batch_cost=0.4310, reader_cost=0.0002 | ETA 03:01:23 2020-11-14 02:47:48 [INFO] [TRAIN] epoch=23, iter=14760/40000, loss=0.4073, lr=0.006611, batch_cost=0.4303, reader_cost=0.0002 | ETA 03:01:00 2020-11-14 02:47:52 [INFO] [TRAIN] epoch=23, iter=14770/40000, loss=0.4401, lr=0.006609, batch_cost=0.4331, reader_cost=0.0002 | ETA 03:02:07 2020-11-14 02:47:56 [INFO] [TRAIN] epoch=23, iter=14780/40000, loss=0.3994, lr=0.006606, batch_cost=0.4379, reader_cost=0.0003 | ETA 03:04:04 2020-11-14 02:48:01 [INFO] [TRAIN] epoch=23, iter=14790/40000, loss=0.3782, lr=0.006604, batch_cost=0.4448, reader_cost=0.0002 | ETA 03:06:54 2020-11-14 02:48:05 [INFO] [TRAIN] epoch=23, iter=14800/40000, loss=0.3835, lr=0.006602, batch_cost=0.4506, reader_cost=0.0003 | ETA 03:09:14 2020-11-14 02:48:10 [INFO] [TRAIN] epoch=23, iter=14810/40000, loss=0.3932, lr=0.006599, batch_cost=0.4438, reader_cost=0.0002 | ETA 03:06:20 2020-11-14 02:48:14 [INFO] [TRAIN] epoch=23, iter=14820/40000, loss=0.3234, lr=0.006597, batch_cost=0.4385, reader_cost=0.0002 | ETA 03:04:02 2020-11-14 02:48:19 [INFO] [TRAIN] epoch=23, iter=14830/40000, loss=0.3297, lr=0.006594, batch_cost=0.4421, reader_cost=0.0002 | ETA 03:05:26 2020-11-14 02:48:23 [INFO] [TRAIN] epoch=23, iter=14840/40000, loss=0.4243, lr=0.006592, batch_cost=0.4413, reader_cost=0.0002 | ETA 03:05:02 2020-11-14 02:48:27 [INFO] [TRAIN] epoch=23, iter=14850/40000, loss=0.4268, lr=0.006590, batch_cost=0.4400, reader_cost=0.0002 | ETA 03:04:25 2020-11-14 02:48:32 [INFO] [TRAIN] epoch=23, iter=14860/40000, loss=0.3853, lr=0.006587, batch_cost=0.4375, reader_cost=0.0002 | ETA 03:03:18 2020-11-14 02:48:36 [INFO] [TRAIN] epoch=23, iter=14870/40000, loss=0.3206, lr=0.006585, batch_cost=0.4404, reader_cost=0.0002 | ETA 03:04:27 2020-11-14 02:48:41 [INFO] [TRAIN] epoch=23, iter=14880/40000, loss=0.3096, lr=0.006583, batch_cost=0.4430, reader_cost=0.0002 | ETA 03:05:27 2020-11-14 02:48:45 [INFO] [TRAIN] epoch=23, iter=14890/40000, loss=0.3389, lr=0.006580, batch_cost=0.4402, reader_cost=0.0002 | ETA 03:04:12 2020-11-14 02:48:49 [INFO] [TRAIN] epoch=23, iter=14900/40000, loss=0.2891, lr=0.006578, batch_cost=0.4356, reader_cost=0.0002 | ETA 03:02:13 2020-11-14 02:48:54 [INFO] [TRAIN] epoch=23, iter=14910/40000, loss=0.2611, lr=0.006576, batch_cost=0.4390, reader_cost=0.0002 | ETA 03:03:33 2020-11-14 02:48:58 [INFO] [TRAIN] epoch=23, iter=14920/40000, loss=0.3122, lr=0.006573, batch_cost=0.4350, reader_cost=0.0002 | ETA 03:01:50 2020-11-14 02:49:03 [INFO] [TRAIN] epoch=23, iter=14930/40000, loss=0.2524, lr=0.006571, batch_cost=0.4570, reader_cost=0.0002 | ETA 03:10:57 2020-11-14 02:49:07 [INFO] [TRAIN] epoch=23, iter=14940/40000, loss=0.3957, lr=0.006569, batch_cost=0.4499, reader_cost=0.0002 | ETA 03:07:53 2020-11-14 02:49:12 [INFO] [TRAIN] epoch=23, iter=14950/40000, loss=0.3427, lr=0.006566, batch_cost=0.4616, reader_cost=0.0015 | ETA 03:12:42 2020-11-14 02:49:16 [INFO] [TRAIN] epoch=23, iter=14960/40000, loss=0.2848, lr=0.006564, batch_cost=0.4316, reader_cost=0.0002 | ETA 03:00:08 2020-11-14 02:49:20 [INFO] [TRAIN] epoch=23, iter=14970/40000, loss=0.3866, lr=0.006562, batch_cost=0.4371, reader_cost=0.0002 | ETA 03:02:19 2020-11-14 02:49:25 [INFO] [TRAIN] epoch=23, iter=14980/40000, loss=0.3400, lr=0.006559, batch_cost=0.4326, reader_cost=0.0002 | ETA 03:00:23 2020-11-14 02:49:29 [INFO] [TRAIN] epoch=23, iter=14990/40000, loss=0.2424, lr=0.006557, batch_cost=0.4324, reader_cost=0.0002 | ETA 03:00:14 2020-11-14 02:49:33 [INFO] [TRAIN] epoch=23, iter=15000/40000, loss=0.2864, lr=0.006554, batch_cost=0.4307, reader_cost=0.0002 | ETA 02:59:26 2020-11-14 02:49:38 [INFO] [TRAIN] epoch=23, iter=15010/40000, loss=0.4295, lr=0.006552, batch_cost=0.4390, reader_cost=0.0003 | ETA 03:02:50 2020-11-14 02:49:42 [INFO] [TRAIN] epoch=23, iter=15020/40000, loss=0.2457, lr=0.006550, batch_cost=0.4371, reader_cost=0.0002 | ETA 03:01:57 2020-11-14 02:49:47 [INFO] [TRAIN] epoch=23, iter=15030/40000, loss=0.2660, lr=0.006547, batch_cost=0.4335, reader_cost=0.0002 | ETA 03:00:25 2020-11-14 02:49:51 [INFO] [TRAIN] epoch=23, iter=15040/40000, loss=0.3584, lr=0.006545, batch_cost=0.4310, reader_cost=0.0002 | ETA 02:59:18 2020-11-14 02:49:55 [INFO] [TRAIN] epoch=23, iter=15050/40000, loss=0.3386, lr=0.006543, batch_cost=0.4310, reader_cost=0.0002 | ETA 02:59:12 2020-11-14 02:49:59 [INFO] [TRAIN] epoch=23, iter=15060/40000, loss=0.3523, lr=0.006540, batch_cost=0.4315, reader_cost=0.0002 | ETA 02:59:21 2020-11-14 02:50:04 [INFO] [TRAIN] epoch=23, iter=15070/40000, loss=0.2654, lr=0.006538, batch_cost=0.4318, reader_cost=0.0002 | ETA 02:59:25 2020-11-14 02:50:08 [INFO] [TRAIN] epoch=23, iter=15080/40000, loss=0.3480, lr=0.006536, batch_cost=0.4329, reader_cost=0.0002 | ETA 02:59:48 2020-11-14 02:50:12 [INFO] [TRAIN] epoch=23, iter=15090/40000, loss=0.2802, lr=0.006533, batch_cost=0.4343, reader_cost=0.0002 | ETA 03:00:17 2020-11-14 02:50:17 [INFO] [TRAIN] epoch=23, iter=15100/40000, loss=0.3018, lr=0.006531, batch_cost=0.4338, reader_cost=0.0002 | ETA 03:00:01 2020-11-14 02:50:21 [INFO] [TRAIN] epoch=23, iter=15110/40000, loss=0.2604, lr=0.006529, batch_cost=0.4314, reader_cost=0.0002 | ETA 02:58:58 2020-11-14 02:50:25 [INFO] [TRAIN] epoch=23, iter=15120/40000, loss=0.3142, lr=0.006526, batch_cost=0.4360, reader_cost=0.0002 | ETA 03:00:47 2020-11-14 02:50:30 [INFO] [TRAIN] epoch=23, iter=15130/40000, loss=0.5423, lr=0.006524, batch_cost=0.4355, reader_cost=0.0002 | ETA 03:00:30 2020-11-14 02:50:34 [INFO] [TRAIN] epoch=23, iter=15140/40000, loss=0.2889, lr=0.006521, batch_cost=0.4330, reader_cost=0.0002 | ETA 02:59:24 2020-11-14 02:50:39 [INFO] [TRAIN] epoch=23, iter=15150/40000, loss=0.3596, lr=0.006519, batch_cost=0.4330, reader_cost=0.0002 | ETA 02:59:21 2020-11-14 02:50:43 [INFO] [TRAIN] epoch=23, iter=15160/40000, loss=0.2697, lr=0.006517, batch_cost=0.4330, reader_cost=0.0002 | ETA 02:59:16 2020-11-14 02:50:47 [INFO] [TRAIN] epoch=23, iter=15170/40000, loss=0.5032, lr=0.006514, batch_cost=0.4301, reader_cost=0.0002 | ETA 02:57:58 2020-11-14 02:50:51 [INFO] [TRAIN] epoch=23, iter=15180/40000, loss=0.3739, lr=0.006512, batch_cost=0.4300, reader_cost=0.0002 | ETA 02:57:51 2020-11-14 02:50:56 [INFO] [TRAIN] epoch=23, iter=15190/40000, loss=0.3971, lr=0.006510, batch_cost=0.4317, reader_cost=0.0002 | ETA 02:58:29 2020-11-14 02:51:00 [INFO] [TRAIN] epoch=23, iter=15200/40000, loss=0.4129, lr=0.006507, batch_cost=0.4279, reader_cost=0.0002 | ETA 02:56:50 2020-11-14 02:51:06 [INFO] [TRAIN] epoch=24, iter=15210/40000, loss=0.3515, lr=0.006505, batch_cost=0.5713, reader_cost=0.1090 | ETA 03:56:02 2020-11-14 02:51:10 [INFO] [TRAIN] epoch=24, iter=15220/40000, loss=0.2595, lr=0.006503, batch_cost=0.4638, reader_cost=0.0005 | ETA 03:11:31 2020-11-14 02:51:15 [INFO] [TRAIN] epoch=24, iter=15230/40000, loss=0.3084, lr=0.006500, batch_cost=0.4358, reader_cost=0.0002 | ETA 02:59:54 2020-11-14 02:51:19 [INFO] [TRAIN] epoch=24, iter=15240/40000, loss=0.2557, lr=0.006498, batch_cost=0.4370, reader_cost=0.0002 | ETA 03:00:21 2020-11-14 02:51:24 [INFO] [TRAIN] epoch=24, iter=15250/40000, loss=0.2527, lr=0.006496, batch_cost=0.4410, reader_cost=0.0002 | ETA 03:01:54 2020-11-14 02:51:28 [INFO] [TRAIN] epoch=24, iter=15260/40000, loss=0.2977, lr=0.006493, batch_cost=0.4394, reader_cost=0.0002 | ETA 03:01:11 2020-11-14 02:51:32 [INFO] [TRAIN] epoch=24, iter=15270/40000, loss=0.3236, lr=0.006491, batch_cost=0.4385, reader_cost=0.0002 | ETA 03:00:43 2020-11-14 02:51:37 [INFO] [TRAIN] epoch=24, iter=15280/40000, loss=0.2951, lr=0.006488, batch_cost=0.4444, reader_cost=0.0002 | ETA 03:03:06 2020-11-14 02:51:42 [INFO] [TRAIN] epoch=24, iter=15290/40000, loss=0.3388, lr=0.006486, batch_cost=0.5077, reader_cost=0.0002 | ETA 03:29:04 2020-11-14 02:51:46 [INFO] [TRAIN] epoch=24, iter=15300/40000, loss=0.3699, lr=0.006484, batch_cost=0.4600, reader_cost=0.0002 | ETA 03:09:21 2020-11-14 02:51:51 [INFO] [TRAIN] epoch=24, iter=15310/40000, loss=0.3011, lr=0.006481, batch_cost=0.4869, reader_cost=0.0064 | ETA 03:20:22 2020-11-14 02:51:56 [INFO] [TRAIN] epoch=24, iter=15320/40000, loss=0.3405, lr=0.006479, batch_cost=0.5000, reader_cost=0.0040 | ETA 03:25:40 2020-11-14 02:52:01 [INFO] [TRAIN] epoch=24, iter=15330/40000, loss=0.3562, lr=0.006477, batch_cost=0.4604, reader_cost=0.0003 | ETA 03:09:17 2020-11-14 02:52:05 [INFO] [TRAIN] epoch=24, iter=15340/40000, loss=0.2708, lr=0.006474, batch_cost=0.4410, reader_cost=0.0003 | ETA 03:01:14 2020-11-14 02:52:10 [INFO] [TRAIN] epoch=24, iter=15350/40000, loss=0.2676, lr=0.006472, batch_cost=0.4603, reader_cost=0.0003 | ETA 03:09:06 2020-11-14 02:52:14 [INFO] [TRAIN] epoch=24, iter=15360/40000, loss=0.3569, lr=0.006470, batch_cost=0.4439, reader_cost=0.0002 | ETA 03:02:16 2020-11-14 02:52:19 [INFO] [TRAIN] epoch=24, iter=15370/40000, loss=0.2680, lr=0.006467, batch_cost=0.4727, reader_cost=0.0002 | ETA 03:14:01 2020-11-14 02:52:23 [INFO] [TRAIN] epoch=24, iter=15380/40000, loss=0.2927, lr=0.006465, batch_cost=0.4407, reader_cost=0.0002 | ETA 03:00:49 2020-11-14 02:52:28 [INFO] [TRAIN] epoch=24, iter=15390/40000, loss=0.2632, lr=0.006462, batch_cost=0.4648, reader_cost=0.0002 | ETA 03:10:38 2020-11-14 02:52:33 [INFO] [TRAIN] epoch=24, iter=15400/40000, loss=0.3236, lr=0.006460, batch_cost=0.4943, reader_cost=0.0005 | ETA 03:22:40 2020-11-14 02:52:38 [INFO] [TRAIN] epoch=24, iter=15410/40000, loss=0.2864, lr=0.006458, batch_cost=0.4570, reader_cost=0.0002 | ETA 03:07:17 2020-11-14 02:52:42 [INFO] [TRAIN] epoch=24, iter=15420/40000, loss=0.2649, lr=0.006455, batch_cost=0.4574, reader_cost=0.0002 | ETA 03:07:23 2020-11-14 02:52:47 [INFO] [TRAIN] epoch=24, iter=15430/40000, loss=0.5110, lr=0.006453, batch_cost=0.4684, reader_cost=0.0072 | ETA 03:11:48 2020-11-14 02:52:52 [INFO] [TRAIN] epoch=24, iter=15440/40000, loss=0.2698, lr=0.006451, batch_cost=0.4738, reader_cost=0.0003 | ETA 03:13:56 2020-11-14 02:52:56 [INFO] [TRAIN] epoch=24, iter=15450/40000, loss=0.3924, lr=0.006448, batch_cost=0.4535, reader_cost=0.0003 | ETA 03:05:33 2020-11-14 02:53:01 [INFO] [TRAIN] epoch=24, iter=15460/40000, loss=0.3689, lr=0.006446, batch_cost=0.4669, reader_cost=0.0015 | ETA 03:10:56 2020-11-14 02:53:05 [INFO] [TRAIN] epoch=24, iter=15470/40000, loss=0.3017, lr=0.006444, batch_cost=0.4349, reader_cost=0.0002 | ETA 02:57:47 2020-11-14 02:53:10 [INFO] [TRAIN] epoch=24, iter=15480/40000, loss=0.2739, lr=0.006441, batch_cost=0.4268, reader_cost=0.0002 | ETA 02:54:24 2020-11-14 02:53:14 [INFO] [TRAIN] epoch=24, iter=15490/40000, loss=0.2078, lr=0.006439, batch_cost=0.4302, reader_cost=0.0002 | ETA 02:55:43 2020-11-14 02:53:18 [INFO] [TRAIN] epoch=24, iter=15500/40000, loss=0.2755, lr=0.006437, batch_cost=0.4327, reader_cost=0.0002 | ETA 02:56:40 2020-11-14 02:53:22 [INFO] [TRAIN] epoch=24, iter=15510/40000, loss=0.3617, lr=0.006434, batch_cost=0.4343, reader_cost=0.0002 | ETA 02:57:15 2020-11-14 02:53:27 [INFO] [TRAIN] epoch=24, iter=15520/40000, loss=0.3719, lr=0.006432, batch_cost=0.4333, reader_cost=0.0002 | ETA 02:56:47 2020-11-14 02:53:31 [INFO] [TRAIN] epoch=24, iter=15530/40000, loss=0.2898, lr=0.006429, batch_cost=0.4336, reader_cost=0.0001 | ETA 02:56:51 2020-11-14 02:53:35 [INFO] [TRAIN] epoch=24, iter=15540/40000, loss=0.3204, lr=0.006427, batch_cost=0.4336, reader_cost=0.0001 | ETA 02:56:44 2020-11-14 02:53:40 [INFO] [TRAIN] epoch=24, iter=15550/40000, loss=0.3586, lr=0.006425, batch_cost=0.4400, reader_cost=0.0002 | ETA 02:59:18 2020-11-14 02:53:44 [INFO] [TRAIN] epoch=24, iter=15560/40000, loss=0.2592, lr=0.006422, batch_cost=0.4542, reader_cost=0.0016 | ETA 03:05:00 2020-11-14 02:53:49 [INFO] [TRAIN] epoch=24, iter=15570/40000, loss=0.2650, lr=0.006420, batch_cost=0.4437, reader_cost=0.0002 | ETA 03:00:40 2020-11-14 02:53:53 [INFO] [TRAIN] epoch=24, iter=15580/40000, loss=0.3369, lr=0.006418, batch_cost=0.4518, reader_cost=0.0010 | ETA 03:03:52 2020-11-14 02:53:58 [INFO] [TRAIN] epoch=24, iter=15590/40000, loss=0.2774, lr=0.006415, batch_cost=0.4437, reader_cost=0.0018 | ETA 03:00:31 2020-11-14 02:54:02 [INFO] [TRAIN] epoch=24, iter=15600/40000, loss=0.3582, lr=0.006413, batch_cost=0.4324, reader_cost=0.0002 | ETA 02:55:50 2020-11-14 02:54:06 [INFO] [TRAIN] epoch=24, iter=15610/40000, loss=0.3165, lr=0.006411, batch_cost=0.4316, reader_cost=0.0002 | ETA 02:55:26 2020-11-14 02:54:11 [INFO] [TRAIN] epoch=24, iter=15620/40000, loss=0.3020, lr=0.006408, batch_cost=0.4314, reader_cost=0.0002 | ETA 02:55:16 2020-11-14 02:54:15 [INFO] [TRAIN] epoch=24, iter=15630/40000, loss=0.3794, lr=0.006406, batch_cost=0.4334, reader_cost=0.0002 | ETA 02:56:01 2020-11-14 02:54:19 [INFO] [TRAIN] epoch=24, iter=15640/40000, loss=0.3687, lr=0.006403, batch_cost=0.4323, reader_cost=0.0002 | ETA 02:55:30 2020-11-14 02:54:24 [INFO] [TRAIN] epoch=24, iter=15650/40000, loss=0.3642, lr=0.006401, batch_cost=0.4319, reader_cost=0.0002 | ETA 02:55:16 2020-11-14 02:54:28 [INFO] [TRAIN] epoch=24, iter=15660/40000, loss=0.2984, lr=0.006399, batch_cost=0.4336, reader_cost=0.0001 | ETA 02:55:53 2020-11-14 02:54:35 [INFO] [TRAIN] epoch=24, iter=15670/40000, loss=0.2820, lr=0.006396, batch_cost=0.6708, reader_cost=0.0002 | ETA 04:32:01 2020-11-14 02:54:43 [INFO] [TRAIN] epoch=24, iter=15680/40000, loss=0.2632, lr=0.006394, batch_cost=0.8355, reader_cost=0.0014 | ETA 05:38:39 2020-11-14 02:54:49 [INFO] [TRAIN] epoch=24, iter=15690/40000, loss=0.3379, lr=0.006392, batch_cost=0.5509, reader_cost=0.0003 | ETA 03:43:12 2020-11-14 02:54:53 [INFO] [TRAIN] epoch=24, iter=15700/40000, loss=0.3172, lr=0.006389, batch_cost=0.4339, reader_cost=0.0003 | ETA 02:55:43 2020-11-14 02:54:57 [INFO] [TRAIN] epoch=24, iter=15710/40000, loss=0.3201, lr=0.006387, batch_cost=0.4406, reader_cost=0.0002 | ETA 02:58:23 2020-11-14 02:55:02 [INFO] [TRAIN] epoch=24, iter=15720/40000, loss=0.2918, lr=0.006385, batch_cost=0.4349, reader_cost=0.0002 | ETA 02:55:58 2020-11-14 02:55:06 [INFO] [TRAIN] epoch=24, iter=15730/40000, loss=0.2998, lr=0.006382, batch_cost=0.4336, reader_cost=0.0002 | ETA 02:55:22 2020-11-14 02:55:10 [INFO] [TRAIN] epoch=24, iter=15740/40000, loss=0.2543, lr=0.006380, batch_cost=0.4336, reader_cost=0.0002 | ETA 02:55:19 2020-11-14 02:55:15 [INFO] [TRAIN] epoch=24, iter=15750/40000, loss=0.3237, lr=0.006377, batch_cost=0.4337, reader_cost=0.0002 | ETA 02:55:17 2020-11-14 02:55:19 [INFO] [TRAIN] epoch=24, iter=15760/40000, loss=0.3598, lr=0.006375, batch_cost=0.4405, reader_cost=0.0002 | ETA 02:57:58 2020-11-14 02:55:24 [INFO] [TRAIN] epoch=24, iter=15770/40000, loss=0.2784, lr=0.006373, batch_cost=0.4340, reader_cost=0.0002 | ETA 02:55:15 2020-11-14 02:55:28 [INFO] [TRAIN] epoch=24, iter=15780/40000, loss=0.2947, lr=0.006370, batch_cost=0.4334, reader_cost=0.0002 | ETA 02:54:55 2020-11-14 02:55:32 [INFO] [TRAIN] epoch=24, iter=15790/40000, loss=0.3569, lr=0.006368, batch_cost=0.4365, reader_cost=0.0002 | ETA 02:56:08 2020-11-14 02:55:37 [INFO] [TRAIN] epoch=24, iter=15800/40000, loss=0.3213, lr=0.006366, batch_cost=0.4467, reader_cost=0.0002 | ETA 03:00:10 2020-11-14 02:55:41 [INFO] [TRAIN] epoch=24, iter=15810/40000, loss=0.3570, lr=0.006363, batch_cost=0.4517, reader_cost=0.0002 | ETA 03:02:07 2020-11-14 02:55:46 [INFO] [TRAIN] epoch=24, iter=15820/40000, loss=0.3605, lr=0.006361, batch_cost=0.4497, reader_cost=0.0002 | ETA 03:01:13 2020-11-14 02:55:50 [INFO] [TRAIN] epoch=24, iter=15830/40000, loss=0.3375, lr=0.006359, batch_cost=0.4402, reader_cost=0.0002 | ETA 02:57:19 2020-11-14 02:55:54 [INFO] [TRAIN] epoch=24, iter=15840/40000, loss=0.2901, lr=0.006356, batch_cost=0.4302, reader_cost=0.0002 | ETA 02:53:14 2020-11-14 02:55:59 [INFO] [TRAIN] epoch=24, iter=15850/40000, loss=0.3323, lr=0.006354, batch_cost=0.4310, reader_cost=0.0001 | ETA 02:53:27 2020-11-14 02:56:03 [INFO] [TRAIN] epoch=24, iter=15860/40000, loss=0.3046, lr=0.006351, batch_cost=0.4289, reader_cost=0.0002 | ETA 02:52:33 2020-11-14 02:56:08 [INFO] [TRAIN] epoch=25, iter=15870/40000, loss=0.2770, lr=0.006349, batch_cost=0.5295, reader_cost=0.0804 | ETA 03:32:57 2020-11-14 02:56:13 [INFO] [TRAIN] epoch=25, iter=15880/40000, loss=0.3808, lr=0.006347, batch_cost=0.4297, reader_cost=0.0004 | ETA 02:52:44 2020-11-14 02:56:17 [INFO] [TRAIN] epoch=25, iter=15890/40000, loss=0.2301, lr=0.006344, batch_cost=0.4336, reader_cost=0.0002 | ETA 02:54:15 2020-11-14 02:56:21 [INFO] [TRAIN] epoch=25, iter=15900/40000, loss=0.3641, lr=0.006342, batch_cost=0.4330, reader_cost=0.0002 | ETA 02:53:55 2020-11-14 02:56:26 [INFO] [TRAIN] epoch=25, iter=15910/40000, loss=0.2600, lr=0.006340, batch_cost=0.4327, reader_cost=0.0002 | ETA 02:53:44 2020-11-14 02:56:30 [INFO] [TRAIN] epoch=25, iter=15920/40000, loss=0.4526, lr=0.006337, batch_cost=0.4361, reader_cost=0.0002 | ETA 02:55:00 2020-11-14 02:56:34 [INFO] [TRAIN] epoch=25, iter=15930/40000, loss=0.3312, lr=0.006335, batch_cost=0.4367, reader_cost=0.0002 | ETA 02:55:10 2020-11-14 02:56:39 [INFO] [TRAIN] epoch=25, iter=15940/40000, loss=0.3060, lr=0.006333, batch_cost=0.4352, reader_cost=0.0002 | ETA 02:54:31 2020-11-14 02:56:43 [INFO] [TRAIN] epoch=25, iter=15950/40000, loss=0.2772, lr=0.006330, batch_cost=0.4697, reader_cost=0.0002 | ETA 03:08:15 2020-11-14 02:56:48 [INFO] [TRAIN] epoch=25, iter=15960/40000, loss=0.3226, lr=0.006328, batch_cost=0.4812, reader_cost=0.0011 | ETA 03:12:47 2020-11-14 02:56:53 [INFO] [TRAIN] epoch=25, iter=15970/40000, loss=0.4023, lr=0.006325, batch_cost=0.4334, reader_cost=0.0002 | ETA 02:53:33 2020-11-14 02:56:57 [INFO] [TRAIN] epoch=25, iter=15980/40000, loss=0.2947, lr=0.006323, batch_cost=0.4456, reader_cost=0.0002 | ETA 02:58:24 2020-11-14 02:57:02 [INFO] [TRAIN] epoch=25, iter=15990/40000, loss=0.3144, lr=0.006321, batch_cost=0.4656, reader_cost=0.0002 | ETA 03:06:18 2020-11-14 02:57:06 [INFO] [TRAIN] epoch=25, iter=16000/40000, loss=0.2557, lr=0.006318, batch_cost=0.4677, reader_cost=0.0002 | ETA 03:07:03 2020-11-14 02:57:06 [INFO] Start evaluating (total_samples=1449, total_iters=363)... 2020-11-14 02:57:25 [INFO] [EVAL] #Images=1449 mIoU=0.7787 Acc=0.9501 Kappa=0.8904 2020-11-14 02:57:25 [INFO] [EVAL] Class IoU: [0.9445 0.8376 0.4226 0.8779 0.7007 0.8259 0.9356 0.8739 0.9317 0.3756 0.8562 0.583 0.8915 0.8484 0.865 0.8546 0.641 0.8928 0.5543 0.8894 0.7501] 2020-11-14 02:57:25 [INFO] [EVAL] Class Acc: [0.9699 0.856 0.44 0.9206 0.7658 0.9075 0.9776 0.935 0.9617 0.572 0.9727 0.8842 0.9473 0.8822 0.9321 0.9087 0.8164 0.9397 0.8385 0.9347 0.9171] 2020-11-14 02:57:33 [INFO] [EVAL] The model with the best validation mIoU (0.7787) was saved at iter 16000. 2020-11-14 02:57:37 [INFO] [TRAIN] epoch=25, iter=16010/40000, loss=0.2829, lr=0.006316, batch_cost=0.4337, reader_cost=0.0005 | ETA 02:53:24 2020-11-14 02:57:42 [INFO] [TRAIN] epoch=25, iter=16020/40000, loss=0.2756, lr=0.006314, batch_cost=0.4321, reader_cost=0.0003 | ETA 02:52:42 2020-11-14 02:57:46 [INFO] [TRAIN] epoch=25, iter=16030/40000, loss=0.2323, lr=0.006311, batch_cost=0.4334, reader_cost=0.0005 | ETA 02:53:09 2020-11-14 02:57:51 [INFO] [TRAIN] epoch=25, iter=16040/40000, loss=0.2180, lr=0.006309, batch_cost=0.4373, reader_cost=0.0003 | ETA 02:54:36 2020-11-14 02:57:55 [INFO] [TRAIN] epoch=25, iter=16050/40000, loss=0.2659, lr=0.006307, batch_cost=0.4382, reader_cost=0.0002 | ETA 02:54:56 2020-11-14 02:57:59 [INFO] [TRAIN] epoch=25, iter=16060/40000, loss=0.3270, lr=0.006304, batch_cost=0.4391, reader_cost=0.0002 | ETA 02:55:12 2020-11-14 02:58:04 [INFO] [TRAIN] epoch=25, iter=16070/40000, loss=0.3251, lr=0.006302, batch_cost=0.4681, reader_cost=0.0002 | ETA 03:06:42 2020-11-14 02:58:09 [INFO] [TRAIN] epoch=25, iter=16080/40000, loss=0.2985, lr=0.006299, batch_cost=0.4623, reader_cost=0.0002 | ETA 03:04:18 2020-11-14 02:58:13 [INFO] [TRAIN] epoch=25, iter=16090/40000, loss=0.2961, lr=0.006297, batch_cost=0.4688, reader_cost=0.0002 | ETA 03:06:49 2020-11-14 02:58:18 [INFO] [TRAIN] epoch=25, iter=16100/40000, loss=0.3043, lr=0.006295, batch_cost=0.4414, reader_cost=0.0002 | ETA 02:55:48 2020-11-14 02:58:22 [INFO] [TRAIN] epoch=25, iter=16110/40000, loss=0.4137, lr=0.006292, batch_cost=0.4767, reader_cost=0.0002 | ETA 03:09:47 2020-11-14 02:58:27 [INFO] [TRAIN] epoch=25, iter=16120/40000, loss=0.3217, lr=0.006290, batch_cost=0.4746, reader_cost=0.0002 | ETA 03:08:53 2020-11-14 02:58:32 [INFO] [TRAIN] epoch=25, iter=16130/40000, loss=0.3399, lr=0.006288, batch_cost=0.4652, reader_cost=0.0002 | ETA 03:05:03 2020-11-14 02:58:36 [INFO] [TRAIN] epoch=25, iter=16140/40000, loss=0.2639, lr=0.006285, batch_cost=0.4399, reader_cost=0.0002 | ETA 02:54:56 2020-11-14 02:58:41 [INFO] [TRAIN] epoch=25, iter=16150/40000, loss=0.2003, lr=0.006283, batch_cost=0.4447, reader_cost=0.0002 | ETA 02:56:45 2020-11-14 02:58:45 [INFO] [TRAIN] epoch=25, iter=16160/40000, loss=0.3154, lr=0.006281, batch_cost=0.4342, reader_cost=0.0002 | ETA 02:52:31 2020-11-14 02:58:50 [INFO] [TRAIN] epoch=25, iter=16170/40000, loss=0.3545, lr=0.006278, batch_cost=0.4563, reader_cost=0.0002 | ETA 03:01:14 2020-11-14 02:58:54 [INFO] [TRAIN] epoch=25, iter=16180/40000, loss=0.3789, lr=0.006276, batch_cost=0.4414, reader_cost=0.0010 | ETA 02:55:14 2020-11-14 02:58:58 [INFO] [TRAIN] epoch=25, iter=16190/40000, loss=0.2780, lr=0.006273, batch_cost=0.4316, reader_cost=0.0002 | ETA 02:51:16 2020-11-14 02:59:03 [INFO] [TRAIN] epoch=25, iter=16200/40000, loss=0.3699, lr=0.006271, batch_cost=0.4429, reader_cost=0.0002 | ETA 02:55:41 2020-11-14 02:59:07 [INFO] [TRAIN] epoch=25, iter=16210/40000, loss=0.2839, lr=0.006269, batch_cost=0.4335, reader_cost=0.0002 | ETA 02:51:53 2020-11-14 02:59:12 [INFO] [TRAIN] epoch=25, iter=16220/40000, loss=0.4116, lr=0.006266, batch_cost=0.4399, reader_cost=0.0002 | ETA 02:54:21 2020-11-14 02:59:16 [INFO] [TRAIN] epoch=25, iter=16230/40000, loss=0.5095, lr=0.006264, batch_cost=0.4381, reader_cost=0.0002 | ETA 02:53:34 2020-11-14 02:59:20 [INFO] [TRAIN] epoch=25, iter=16240/40000, loss=0.2907, lr=0.006262, batch_cost=0.4407, reader_cost=0.0002 | ETA 02:54:31 2020-11-14 02:59:25 [INFO] [TRAIN] epoch=25, iter=16250/40000, loss=0.3518, lr=0.006259, batch_cost=0.4405, reader_cost=0.0002 | ETA 02:54:22 2020-11-14 02:59:29 [INFO] [TRAIN] epoch=25, iter=16260/40000, loss=0.3828, lr=0.006257, batch_cost=0.4359, reader_cost=0.0002 | ETA 02:52:27 2020-11-14 02:59:33 [INFO] [TRAIN] epoch=25, iter=16270/40000, loss=0.2658, lr=0.006254, batch_cost=0.4385, reader_cost=0.0002 | ETA 02:53:25 2020-11-14 02:59:38 [INFO] [TRAIN] epoch=25, iter=16280/40000, loss=0.3299, lr=0.006252, batch_cost=0.4373, reader_cost=0.0002 | ETA 02:52:52 2020-11-14 02:59:42 [INFO] [TRAIN] epoch=25, iter=16290/40000, loss=0.2675, lr=0.006250, batch_cost=0.4405, reader_cost=0.0002 | ETA 02:54:04 2020-11-14 02:59:47 [INFO] [TRAIN] epoch=25, iter=16300/40000, loss=0.4266, lr=0.006247, batch_cost=0.4373, reader_cost=0.0002 | ETA 02:52:44 2020-11-14 02:59:51 [INFO] [TRAIN] epoch=25, iter=16310/40000, loss=0.3282, lr=0.006245, batch_cost=0.4357, reader_cost=0.0002 | ETA 02:52:02 2020-11-14 02:59:56 [INFO] [TRAIN] epoch=25, iter=16320/40000, loss=0.2957, lr=0.006243, batch_cost=0.4690, reader_cost=0.0002 | ETA 03:05:06 2020-11-14 03:00:00 [INFO] [TRAIN] epoch=25, iter=16330/40000, loss=0.3751, lr=0.006240, batch_cost=0.4644, reader_cost=0.0002 | ETA 03:03:11 2020-11-14 03:00:05 [INFO] [TRAIN] epoch=25, iter=16340/40000, loss=0.3339, lr=0.006238, batch_cost=0.4650, reader_cost=0.0002 | ETA 03:03:22 2020-11-14 03:00:10 [INFO] [TRAIN] epoch=25, iter=16350/40000, loss=0.3376, lr=0.006236, batch_cost=0.4651, reader_cost=0.0002 | ETA 03:03:20 2020-11-14 03:00:14 [INFO] [TRAIN] epoch=25, iter=16360/40000, loss=0.2929, lr=0.006233, batch_cost=0.4653, reader_cost=0.0002 | ETA 03:03:19 2020-11-14 03:00:19 [INFO] [TRAIN] epoch=25, iter=16370/40000, loss=0.2714, lr=0.006231, batch_cost=0.4550, reader_cost=0.0002 | ETA 02:59:12 2020-11-14 03:00:23 [INFO] [TRAIN] epoch=25, iter=16380/40000, loss=0.2608, lr=0.006228, batch_cost=0.4491, reader_cost=0.0002 | ETA 02:56:47 2020-11-14 03:00:28 [INFO] [TRAIN] epoch=25, iter=16390/40000, loss=0.2732, lr=0.006226, batch_cost=0.4469, reader_cost=0.0002 | ETA 02:55:50 2020-11-14 03:00:32 [INFO] [TRAIN] epoch=25, iter=16400/40000, loss=0.2759, lr=0.006224, batch_cost=0.4573, reader_cost=0.0002 | ETA 02:59:53 2020-11-14 03:00:37 [INFO] [TRAIN] epoch=25, iter=16410/40000, loss=0.2831, lr=0.006221, batch_cost=0.4488, reader_cost=0.0002 | ETA 02:56:28 2020-11-14 03:00:41 [INFO] [TRAIN] epoch=25, iter=16420/40000, loss=0.3996, lr=0.006219, batch_cost=0.4461, reader_cost=0.0002 | ETA 02:55:19 2020-11-14 03:00:46 [INFO] [TRAIN] epoch=25, iter=16430/40000, loss=0.2820, lr=0.006217, batch_cost=0.4355, reader_cost=0.0002 | ETA 02:51:05 2020-11-14 03:00:50 [INFO] [TRAIN] epoch=25, iter=16440/40000, loss=0.3128, lr=0.006214, batch_cost=0.4720, reader_cost=0.0002 | ETA 03:05:19 2020-11-14 03:00:55 [INFO] [TRAIN] epoch=25, iter=16450/40000, loss=0.2614, lr=0.006212, batch_cost=0.4689, reader_cost=0.0029 | ETA 03:04:03 2020-11-14 03:01:00 [INFO] [TRAIN] epoch=25, iter=16460/40000, loss=0.3553, lr=0.006209, batch_cost=0.4757, reader_cost=0.0004 | ETA 03:06:37 2020-11-14 03:01:05 [INFO] [TRAIN] epoch=25, iter=16470/40000, loss=0.3309, lr=0.006207, batch_cost=0.4719, reader_cost=0.0010 | ETA 03:05:03 2020-11-14 03:01:09 [INFO] [TRAIN] epoch=25, iter=16480/40000, loss=0.3653, lr=0.006205, batch_cost=0.4624, reader_cost=0.0002 | ETA 03:01:14 2020-11-14 03:01:14 [INFO] [TRAIN] epoch=25, iter=16490/40000, loss=0.3385, lr=0.006202, batch_cost=0.4708, reader_cost=0.0002 | ETA 03:04:29 2020-11-14 03:01:19 [INFO] [TRAIN] epoch=25, iter=16500/40000, loss=0.2711, lr=0.006200, batch_cost=0.4910, reader_cost=0.0002 | ETA 03:12:17 2020-11-14 03:01:23 [INFO] [TRAIN] epoch=25, iter=16510/40000, loss=0.3259, lr=0.006198, batch_cost=0.4303, reader_cost=0.0002 | ETA 02:48:27 2020-11-14 03:01:27 [INFO] [TRAIN] epoch=25, iter=16520/40000, loss=0.2934, lr=0.006195, batch_cost=0.4296, reader_cost=0.0005 | ETA 02:48:06 2020-11-14 03:01:33 [INFO] [TRAIN] epoch=26, iter=16530/40000, loss=0.3847, lr=0.006193, batch_cost=0.5634, reader_cost=0.0931 | ETA 03:40:22 2020-11-14 03:01:38 [INFO] [TRAIN] epoch=26, iter=16540/40000, loss=0.2746, lr=0.006190, batch_cost=0.4529, reader_cost=0.0014 | ETA 02:57:04 2020-11-14 03:01:42 [INFO] [TRAIN] epoch=26, iter=16550/40000, loss=0.2977, lr=0.006188, batch_cost=0.4403, reader_cost=0.0003 | ETA 02:52:04 2020-11-14 03:01:46 [INFO] [TRAIN] epoch=26, iter=16560/40000, loss=0.2965, lr=0.006186, batch_cost=0.4411, reader_cost=0.0003 | ETA 02:52:19 2020-11-14 03:01:51 [INFO] [TRAIN] epoch=26, iter=16570/40000, loss=0.3030, lr=0.006183, batch_cost=0.4315, reader_cost=0.0002 | ETA 02:48:29 2020-11-14 03:01:55 [INFO] [TRAIN] epoch=26, iter=16580/40000, loss=0.2601, lr=0.006181, batch_cost=0.4311, reader_cost=0.0002 | ETA 02:48:16 2020-11-14 03:01:59 [INFO] [TRAIN] epoch=26, iter=16590/40000, loss=0.3354, lr=0.006179, batch_cost=0.4436, reader_cost=0.0002 | ETA 02:53:04 2020-11-14 03:02:04 [INFO] [TRAIN] epoch=26, iter=16600/40000, loss=0.2502, lr=0.006176, batch_cost=0.4395, reader_cost=0.0002 | ETA 02:51:23 2020-11-14 03:02:08 [INFO] [TRAIN] epoch=26, iter=16610/40000, loss=0.3951, lr=0.006174, batch_cost=0.4398, reader_cost=0.0002 | ETA 02:51:26 2020-11-14 03:02:13 [INFO] [TRAIN] epoch=26, iter=16620/40000, loss=0.2712, lr=0.006172, batch_cost=0.4413, reader_cost=0.0002 | ETA 02:51:57 2020-11-14 03:02:17 [INFO] [TRAIN] epoch=26, iter=16630/40000, loss=0.2098, lr=0.006169, batch_cost=0.4429, reader_cost=0.0002 | ETA 02:52:30 2020-11-14 03:02:22 [INFO] [TRAIN] epoch=26, iter=16640/40000, loss=0.2696, lr=0.006167, batch_cost=0.4492, reader_cost=0.0002 | ETA 02:54:54 2020-11-14 03:02:26 [INFO] [TRAIN] epoch=26, iter=16650/40000, loss=0.3209, lr=0.006164, batch_cost=0.4418, reader_cost=0.0002 | ETA 02:51:56 2020-11-14 03:02:30 [INFO] [TRAIN] epoch=26, iter=16660/40000, loss=0.3470, lr=0.006162, batch_cost=0.4413, reader_cost=0.0002 | ETA 02:51:38 2020-11-14 03:02:35 [INFO] [TRAIN] epoch=26, iter=16670/40000, loss=0.2988, lr=0.006160, batch_cost=0.4498, reader_cost=0.0002 | ETA 02:54:53 2020-11-14 03:02:39 [INFO] [TRAIN] epoch=26, iter=16680/40000, loss=0.3400, lr=0.006157, batch_cost=0.4482, reader_cost=0.0002 | ETA 02:54:11 2020-11-14 03:02:44 [INFO] [TRAIN] epoch=26, iter=16690/40000, loss=0.2479, lr=0.006155, batch_cost=0.4682, reader_cost=0.0002 | ETA 03:01:52 2020-11-14 03:02:48 [INFO] [TRAIN] epoch=26, iter=16700/40000, loss=0.2857, lr=0.006153, batch_cost=0.4335, reader_cost=0.0002 | ETA 02:48:20 2020-11-14 03:02:53 [INFO] [TRAIN] epoch=26, iter=16710/40000, loss=0.2906, lr=0.006150, batch_cost=0.4339, reader_cost=0.0002 | ETA 02:48:25 2020-11-14 03:02:57 [INFO] [TRAIN] epoch=26, iter=16720/40000, loss=0.2049, lr=0.006148, batch_cost=0.4436, reader_cost=0.0005 | ETA 02:52:08 2020-11-14 03:03:02 [INFO] [TRAIN] epoch=26, iter=16730/40000, loss=0.3974, lr=0.006145, batch_cost=0.4991, reader_cost=0.0003 | ETA 03:13:33 2020-11-14 03:03:07 [INFO] [TRAIN] epoch=26, iter=16740/40000, loss=0.3500, lr=0.006143, batch_cost=0.4758, reader_cost=0.0002 | ETA 03:04:26 2020-11-14 03:03:12 [INFO] [TRAIN] epoch=26, iter=16750/40000, loss=0.2788, lr=0.006141, batch_cost=0.4801, reader_cost=0.0002 | ETA 03:06:02 2020-11-14 03:03:17 [INFO] [TRAIN] epoch=26, iter=16760/40000, loss=0.2246, lr=0.006138, batch_cost=0.4844, reader_cost=0.0003 | ETA 03:07:38 2020-11-14 03:03:22 [INFO] [TRAIN] epoch=26, iter=16770/40000, loss=0.2683, lr=0.006136, batch_cost=0.4981, reader_cost=0.0002 | ETA 03:12:51 2020-11-14 03:03:26 [INFO] [TRAIN] epoch=26, iter=16780/40000, loss=0.3580, lr=0.006134, batch_cost=0.4588, reader_cost=0.0002 | ETA 02:57:34 2020-11-14 03:03:31 [INFO] [TRAIN] epoch=26, iter=16790/40000, loss=0.2085, lr=0.006131, batch_cost=0.4893, reader_cost=0.0011 | ETA 03:09:15 2020-11-14 03:03:36 [INFO] [TRAIN] epoch=26, iter=16800/40000, loss=0.2343, lr=0.006129, batch_cost=0.5066, reader_cost=0.0015 | ETA 03:15:53 2020-11-14 03:03:41 [INFO] [TRAIN] epoch=26, iter=16810/40000, loss=0.2947, lr=0.006126, batch_cost=0.5198, reader_cost=0.0003 | ETA 03:20:53 2020-11-14 03:03:46 [INFO] [TRAIN] epoch=26, iter=16820/40000, loss=0.3577, lr=0.006124, batch_cost=0.4698, reader_cost=0.0002 | ETA 03:01:29 2020-11-14 03:03:51 [INFO] [TRAIN] epoch=26, iter=16830/40000, loss=0.3141, lr=0.006122, batch_cost=0.4476, reader_cost=0.0003 | ETA 02:52:50 2020-11-14 03:03:55 [INFO] [TRAIN] epoch=26, iter=16840/40000, loss=0.3234, lr=0.006119, batch_cost=0.4529, reader_cost=0.0002 | ETA 02:54:49 2020-11-14 03:04:00 [INFO] [TRAIN] epoch=26, iter=16850/40000, loss=0.3560, lr=0.006117, batch_cost=0.4898, reader_cost=0.0002 | ETA 03:08:58 2020-11-14 03:04:05 [INFO] [TRAIN] epoch=26, iter=16860/40000, loss=0.2913, lr=0.006115, batch_cost=0.5052, reader_cost=0.0002 | ETA 03:14:49 2020-11-14 03:04:10 [INFO] [TRAIN] epoch=26, iter=16870/40000, loss=0.5051, lr=0.006112, batch_cost=0.4660, reader_cost=0.0002 | ETA 02:59:37 2020-11-14 03:04:15 [INFO] [TRAIN] epoch=26, iter=16880/40000, loss=0.2638, lr=0.006110, batch_cost=0.4893, reader_cost=0.0002 | ETA 03:08:31 2020-11-14 03:04:19 [INFO] [TRAIN] epoch=26, iter=16890/40000, loss=0.3849, lr=0.006107, batch_cost=0.4598, reader_cost=0.0002 | ETA 02:57:06 2020-11-14 03:04:24 [INFO] [TRAIN] epoch=26, iter=16900/40000, loss=0.3114, lr=0.006105, batch_cost=0.4765, reader_cost=0.0002 | ETA 03:03:26 2020-11-14 03:04:29 [INFO] [TRAIN] epoch=26, iter=16910/40000, loss=0.2523, lr=0.006103, batch_cost=0.4777, reader_cost=0.0002 | ETA 03:03:50 2020-11-14 03:04:34 [INFO] [TRAIN] epoch=26, iter=16920/40000, loss=0.2857, lr=0.006100, batch_cost=0.5080, reader_cost=0.0002 | ETA 03:15:25 2020-11-14 03:04:39 [INFO] [TRAIN] epoch=26, iter=16930/40000, loss=0.3256, lr=0.006098, batch_cost=0.5409, reader_cost=0.0002 | ETA 03:27:59 2020-11-14 03:04:44 [INFO] [TRAIN] epoch=26, iter=16940/40000, loss=0.3504, lr=0.006096, batch_cost=0.5152, reader_cost=0.0002 | ETA 03:18:00 2020-11-14 03:04:49 [INFO] [TRAIN] epoch=26, iter=16950/40000, loss=0.2893, lr=0.006093, batch_cost=0.4496, reader_cost=0.0002 | ETA 02:52:42 2020-11-14 03:04:53 [INFO] [TRAIN] epoch=26, iter=16960/40000, loss=0.3604, lr=0.006091, batch_cost=0.4426, reader_cost=0.0002 | ETA 02:49:57 2020-11-14 03:04:58 [INFO] [TRAIN] epoch=26, iter=16970/40000, loss=0.3161, lr=0.006088, batch_cost=0.4450, reader_cost=0.0002 | ETA 02:50:49 2020-11-14 03:05:03 [INFO] [TRAIN] epoch=26, iter=16980/40000, loss=0.3795, lr=0.006086, batch_cost=0.4874, reader_cost=0.0002 | ETA 03:06:59 2020-11-14 03:05:08 [INFO] [TRAIN] epoch=26, iter=16990/40000, loss=0.2438, lr=0.006084, batch_cost=0.5043, reader_cost=0.0005 | ETA 03:13:23 2020-11-14 03:05:12 [INFO] [TRAIN] epoch=26, iter=17000/40000, loss=0.2400, lr=0.006081, batch_cost=0.4438, reader_cost=0.0003 | ETA 02:50:07 2020-11-14 03:05:16 [INFO] [TRAIN] epoch=26, iter=17010/40000, loss=0.3032, lr=0.006079, batch_cost=0.4388, reader_cost=0.0002 | ETA 02:48:08 2020-11-14 03:05:21 [INFO] [TRAIN] epoch=26, iter=17020/40000, loss=0.3031, lr=0.006077, batch_cost=0.4390, reader_cost=0.0002 | ETA 02:48:08 2020-11-14 03:05:25 [INFO] [TRAIN] epoch=26, iter=17030/40000, loss=0.3183, lr=0.006074, batch_cost=0.4382, reader_cost=0.0003 | ETA 02:47:46 2020-11-14 03:05:30 [INFO] [TRAIN] epoch=26, iter=17040/40000, loss=0.2950, lr=0.006072, batch_cost=0.4354, reader_cost=0.0002 | ETA 02:46:36 2020-11-14 03:05:34 [INFO] [TRAIN] epoch=26, iter=17050/40000, loss=0.2690, lr=0.006069, batch_cost=0.4357, reader_cost=0.0002 | ETA 02:46:39 2020-11-14 03:05:38 [INFO] [TRAIN] epoch=26, iter=17060/40000, loss=0.3282, lr=0.006067, batch_cost=0.4340, reader_cost=0.0002 | ETA 02:45:56 2020-11-14 03:05:43 [INFO] [TRAIN] epoch=26, iter=17070/40000, loss=0.3035, lr=0.006065, batch_cost=0.4462, reader_cost=0.0002 | ETA 02:50:30 2020-11-14 03:05:47 [INFO] [TRAIN] epoch=26, iter=17080/40000, loss=0.4696, lr=0.006062, batch_cost=0.4334, reader_cost=0.0002 | ETA 02:45:34 2020-11-14 03:05:51 [INFO] [TRAIN] epoch=26, iter=17090/40000, loss=0.3084, lr=0.006060, batch_cost=0.4393, reader_cost=0.0002 | ETA 02:47:43 2020-11-14 03:05:56 [INFO] [TRAIN] epoch=26, iter=17100/40000, loss=0.2574, lr=0.006058, batch_cost=0.4407, reader_cost=0.0002 | ETA 02:48:12 2020-11-14 03:06:00 [INFO] [TRAIN] epoch=26, iter=17110/40000, loss=0.2491, lr=0.006055, batch_cost=0.4383, reader_cost=0.0002 | ETA 02:47:13 2020-11-14 03:06:05 [INFO] [TRAIN] epoch=26, iter=17120/40000, loss=0.2163, lr=0.006053, batch_cost=0.4392, reader_cost=0.0002 | ETA 02:47:29 2020-11-14 03:06:09 [INFO] [TRAIN] epoch=26, iter=17130/40000, loss=0.4651, lr=0.006050, batch_cost=0.4346, reader_cost=0.0002 | ETA 02:45:39 2020-11-14 03:06:13 [INFO] [TRAIN] epoch=26, iter=17140/40000, loss=0.3517, lr=0.006048, batch_cost=0.4482, reader_cost=0.0003 | ETA 02:50:46 2020-11-14 03:06:18 [INFO] [TRAIN] epoch=26, iter=17150/40000, loss=0.3249, lr=0.006046, batch_cost=0.4427, reader_cost=0.0002 | ETA 02:48:35 2020-11-14 03:06:23 [INFO] [TRAIN] epoch=26, iter=17160/40000, loss=0.2590, lr=0.006043, batch_cost=0.4609, reader_cost=0.0002 | ETA 02:55:27 2020-11-14 03:06:27 [INFO] [TRAIN] epoch=26, iter=17170/40000, loss=0.2939, lr=0.006041, batch_cost=0.4429, reader_cost=0.0002 | ETA 02:48:31 2020-11-14 03:06:31 [INFO] [TRAIN] epoch=26, iter=17180/40000, loss=0.2633, lr=0.006039, batch_cost=0.4394, reader_cost=0.0002 | ETA 02:47:07 2020-11-14 03:06:37 [INFO] [TRAIN] epoch=27, iter=17190/40000, loss=0.2928, lr=0.006036, batch_cost=0.5585, reader_cost=0.1066 | ETA 03:32:20 2020-11-14 03:06:42 [INFO] [TRAIN] epoch=27, iter=17200/40000, loss=0.2412, lr=0.006034, batch_cost=0.4616, reader_cost=0.0005 | ETA 02:55:23 2020-11-14 03:06:46 [INFO] [TRAIN] epoch=27, iter=17210/40000, loss=0.3104, lr=0.006031, batch_cost=0.4325, reader_cost=0.0002 | ETA 02:44:16 2020-11-14 03:06:51 [INFO] [TRAIN] epoch=27, iter=17220/40000, loss=0.3061, lr=0.006029, batch_cost=0.4768, reader_cost=0.0002 | ETA 03:01:00 2020-11-14 03:06:55 [INFO] [TRAIN] epoch=27, iter=17230/40000, loss=0.3188, lr=0.006027, batch_cost=0.4323, reader_cost=0.0002 | ETA 02:44:03 2020-11-14 03:06:59 [INFO] [TRAIN] epoch=27, iter=17240/40000, loss=0.2847, lr=0.006024, batch_cost=0.4394, reader_cost=0.0002 | ETA 02:46:40 2020-11-14 03:07:04 [INFO] [TRAIN] epoch=27, iter=17250/40000, loss=0.3738, lr=0.006022, batch_cost=0.4333, reader_cost=0.0002 | ETA 02:44:17 2020-11-14 03:07:08 [INFO] [TRAIN] epoch=27, iter=17260/40000, loss=0.2580, lr=0.006020, batch_cost=0.4340, reader_cost=0.0002 | ETA 02:44:30 2020-11-14 03:07:12 [INFO] [TRAIN] epoch=27, iter=17270/40000, loss=0.2646, lr=0.006017, batch_cost=0.4318, reader_cost=0.0002 | ETA 02:43:35 2020-11-14 03:07:17 [INFO] [TRAIN] epoch=27, iter=17280/40000, loss=0.2613, lr=0.006015, batch_cost=0.4336, reader_cost=0.0002 | ETA 02:44:10 2020-11-14 03:07:21 [INFO] [TRAIN] epoch=27, iter=17290/40000, loss=0.2922, lr=0.006012, batch_cost=0.4341, reader_cost=0.0002 | ETA 02:44:17 2020-11-14 03:07:25 [INFO] [TRAIN] epoch=27, iter=17300/40000, loss=0.2849, lr=0.006010, batch_cost=0.4345, reader_cost=0.0008 | ETA 02:44:23 2020-11-14 03:07:30 [INFO] [TRAIN] epoch=27, iter=17310/40000, loss=0.4054, lr=0.006008, batch_cost=0.4285, reader_cost=0.0002 | ETA 02:42:02 2020-11-14 03:07:34 [INFO] [TRAIN] epoch=27, iter=17320/40000, loss=0.3013, lr=0.006005, batch_cost=0.4280, reader_cost=0.0002 | ETA 02:41:48 2020-11-14 03:07:38 [INFO] [TRAIN] epoch=27, iter=17330/40000, loss=0.2846, lr=0.006003, batch_cost=0.4291, reader_cost=0.0002 | ETA 02:42:07 2020-11-14 03:07:43 [INFO] [TRAIN] epoch=27, iter=17340/40000, loss=0.1999, lr=0.006000, batch_cost=0.4288, reader_cost=0.0002 | ETA 02:41:56 2020-11-14 03:07:47 [INFO] [TRAIN] epoch=27, iter=17350/40000, loss=0.2988, lr=0.005998, batch_cost=0.4354, reader_cost=0.0002 | ETA 02:44:21 2020-11-14 03:07:51 [INFO] [TRAIN] epoch=27, iter=17360/40000, loss=0.3127, lr=0.005996, batch_cost=0.4277, reader_cost=0.0002 | ETA 02:41:22 2020-11-14 03:07:56 [INFO] [TRAIN] epoch=27, iter=17370/40000, loss=0.2164, lr=0.005993, batch_cost=0.4352, reader_cost=0.0002 | ETA 02:44:08 2020-11-14 03:08:00 [INFO] [TRAIN] epoch=27, iter=17380/40000, loss=0.2897, lr=0.005991, batch_cost=0.4364, reader_cost=0.0002 | ETA 02:44:32 2020-11-14 03:08:04 [INFO] [TRAIN] epoch=27, iter=17390/40000, loss=0.1730, lr=0.005989, batch_cost=0.4472, reader_cost=0.0002 | ETA 02:48:31 2020-11-14 03:08:09 [INFO] [TRAIN] epoch=27, iter=17400/40000, loss=0.2980, lr=0.005986, batch_cost=0.4337, reader_cost=0.0002 | ETA 02:43:21 2020-11-14 03:08:13 [INFO] [TRAIN] epoch=27, iter=17410/40000, loss=0.2214, lr=0.005984, batch_cost=0.4514, reader_cost=0.0002 | ETA 02:49:56 2020-11-14 03:08:18 [INFO] [TRAIN] epoch=27, iter=17420/40000, loss=0.2517, lr=0.005981, batch_cost=0.4331, reader_cost=0.0002 | ETA 02:43:00 2020-11-14 03:08:22 [INFO] [TRAIN] epoch=27, iter=17430/40000, loss=0.2833, lr=0.005979, batch_cost=0.4355, reader_cost=0.0002 | ETA 02:43:49 2020-11-14 03:08:26 [INFO] [TRAIN] epoch=27, iter=17440/40000, loss=0.2776, lr=0.005977, batch_cost=0.4343, reader_cost=0.0002 | ETA 02:43:18 2020-11-14 03:08:31 [INFO] [TRAIN] epoch=27, iter=17450/40000, loss=0.3377, lr=0.005974, batch_cost=0.4321, reader_cost=0.0002 | ETA 02:42:24 2020-11-14 03:08:35 [INFO] [TRAIN] epoch=27, iter=17460/40000, loss=0.2373, lr=0.005972, batch_cost=0.4305, reader_cost=0.0002 | ETA 02:41:43 2020-11-14 03:08:40 [INFO] [TRAIN] epoch=27, iter=17470/40000, loss=0.2639, lr=0.005970, batch_cost=0.4859, reader_cost=0.0002 | ETA 03:02:28 2020-11-14 03:08:45 [INFO] [TRAIN] epoch=27, iter=17480/40000, loss=0.2434, lr=0.005967, batch_cost=0.5211, reader_cost=0.0002 | ETA 03:15:35 2020-11-14 03:08:50 [INFO] [TRAIN] epoch=27, iter=17490/40000, loss=0.3363, lr=0.005965, batch_cost=0.5032, reader_cost=0.0002 | ETA 03:08:47 2020-11-14 03:08:55 [INFO] [TRAIN] epoch=27, iter=17500/40000, loss=0.3282, lr=0.005962, batch_cost=0.4884, reader_cost=0.0002 | ETA 03:03:08 2020-11-14 03:08:59 [INFO] [TRAIN] epoch=27, iter=17510/40000, loss=0.2118, lr=0.005960, batch_cost=0.4581, reader_cost=0.0002 | ETA 02:51:43 2020-11-14 03:09:04 [INFO] [TRAIN] epoch=27, iter=17520/40000, loss=0.2662, lr=0.005958, batch_cost=0.4765, reader_cost=0.0002 | ETA 02:58:31 2020-11-14 03:09:09 [INFO] [TRAIN] epoch=27, iter=17530/40000, loss=0.3130, lr=0.005955, batch_cost=0.5074, reader_cost=0.0011 | ETA 03:10:01 2020-11-14 03:09:14 [INFO] [TRAIN] epoch=27, iter=17540/40000, loss=0.2670, lr=0.005953, batch_cost=0.5084, reader_cost=0.0016 | ETA 03:10:17 2020-11-14 03:09:19 [INFO] [TRAIN] epoch=27, iter=17550/40000, loss=0.3884, lr=0.005951, batch_cost=0.4844, reader_cost=0.0002 | ETA 03:01:13 2020-11-14 03:09:24 [INFO] [TRAIN] epoch=27, iter=17560/40000, loss=0.3405, lr=0.005948, batch_cost=0.4831, reader_cost=0.0002 | ETA 03:00:41 2020-11-14 03:09:29 [INFO] [TRAIN] epoch=27, iter=17570/40000, loss=0.4513, lr=0.005946, batch_cost=0.5405, reader_cost=0.0015 | ETA 03:22:03 2020-11-14 03:09:34 [INFO] [TRAIN] epoch=27, iter=17580/40000, loss=0.3184, lr=0.005943, batch_cost=0.4741, reader_cost=0.0003 | ETA 02:57:08 2020-11-14 03:09:39 [INFO] [TRAIN] epoch=27, iter=17590/40000, loss=0.3272, lr=0.005941, batch_cost=0.4915, reader_cost=0.0012 | ETA 03:03:34 2020-11-14 03:09:44 [INFO] [TRAIN] epoch=27, iter=17600/40000, loss=0.2803, lr=0.005939, batch_cost=0.5302, reader_cost=0.0003 | ETA 03:17:57 2020-11-14 03:09:50 [INFO] [TRAIN] epoch=27, iter=17610/40000, loss=0.2744, lr=0.005936, batch_cost=0.5099, reader_cost=0.0002 | ETA 03:10:15 2020-11-14 03:09:54 [INFO] [TRAIN] epoch=27, iter=17620/40000, loss=0.3021, lr=0.005934, batch_cost=0.4847, reader_cost=0.0002 | ETA 03:00:48 2020-11-14 03:09:59 [INFO] [TRAIN] epoch=27, iter=17630/40000, loss=0.2023, lr=0.005931, batch_cost=0.4492, reader_cost=0.0012 | ETA 02:47:29 2020-11-14 03:10:03 [INFO] [TRAIN] epoch=27, iter=17640/40000, loss=0.2409, lr=0.005929, batch_cost=0.4561, reader_cost=0.0003 | ETA 02:49:57 2020-11-14 03:10:08 [INFO] [TRAIN] epoch=27, iter=17650/40000, loss=0.3886, lr=0.005927, batch_cost=0.4595, reader_cost=0.0002 | ETA 02:51:10 2020-11-14 03:10:12 [INFO] [TRAIN] epoch=27, iter=17660/40000, loss=0.2835, lr=0.005924, batch_cost=0.4449, reader_cost=0.0002 | ETA 02:45:39 2020-11-14 03:10:17 [INFO] [TRAIN] epoch=27, iter=17670/40000, loss=0.2310, lr=0.005922, batch_cost=0.4435, reader_cost=0.0002 | ETA 02:45:02 2020-11-14 03:10:21 [INFO] [TRAIN] epoch=27, iter=17680/40000, loss=0.2769, lr=0.005920, batch_cost=0.4428, reader_cost=0.0002 | ETA 02:44:44 2020-11-14 03:10:26 [INFO] [TRAIN] epoch=27, iter=17690/40000, loss=0.3260, lr=0.005917, batch_cost=0.4567, reader_cost=0.0002 | ETA 02:49:49 2020-11-14 03:10:31 [INFO] [TRAIN] epoch=27, iter=17700/40000, loss=0.4749, lr=0.005915, batch_cost=0.4721, reader_cost=0.0002 | ETA 02:55:27 2020-11-14 03:10:36 [INFO] [TRAIN] epoch=27, iter=17710/40000, loss=0.3382, lr=0.005912, batch_cost=0.5051, reader_cost=0.0003 | ETA 03:07:39 2020-11-14 03:10:41 [INFO] [TRAIN] epoch=27, iter=17720/40000, loss=0.2720, lr=0.005910, batch_cost=0.4906, reader_cost=0.0058 | ETA 03:02:11 2020-11-14 03:10:45 [INFO] [TRAIN] epoch=27, iter=17730/40000, loss=0.2313, lr=0.005908, batch_cost=0.4355, reader_cost=0.0002 | ETA 02:41:38 2020-11-14 03:10:50 [INFO] [TRAIN] epoch=27, iter=17740/40000, loss=0.2653, lr=0.005905, batch_cost=0.4596, reader_cost=0.0002 | ETA 02:50:30 2020-11-14 03:10:54 [INFO] [TRAIN] epoch=27, iter=17750/40000, loss=0.3369, lr=0.005903, batch_cost=0.4527, reader_cost=0.0011 | ETA 02:47:51 2020-11-14 03:10:59 [INFO] [TRAIN] epoch=27, iter=17760/40000, loss=0.2441, lr=0.005900, batch_cost=0.4540, reader_cost=0.0059 | ETA 02:48:15 2020-11-14 03:11:03 [INFO] [TRAIN] epoch=27, iter=17770/40000, loss=0.3111, lr=0.005898, batch_cost=0.4811, reader_cost=0.0003 | ETA 02:58:14 2020-11-14 03:11:08 [INFO] [TRAIN] epoch=27, iter=17780/40000, loss=0.2881, lr=0.005896, batch_cost=0.4395, reader_cost=0.0002 | ETA 02:42:45 2020-11-14 03:11:13 [INFO] [TRAIN] epoch=27, iter=17790/40000, loss=0.2393, lr=0.005893, batch_cost=0.4763, reader_cost=0.0002 | ETA 02:56:18 2020-11-14 03:11:17 [INFO] [TRAIN] epoch=27, iter=17800/40000, loss=0.3027, lr=0.005891, batch_cost=0.4487, reader_cost=0.0015 | ETA 02:46:01 2020-11-14 03:11:21 [INFO] [TRAIN] epoch=27, iter=17810/40000, loss=0.2584, lr=0.005889, batch_cost=0.4382, reader_cost=0.0002 | ETA 02:42:04 2020-11-14 03:11:26 [INFO] [TRAIN] epoch=27, iter=17820/40000, loss=0.3700, lr=0.005886, batch_cost=0.4884, reader_cost=0.0002 | ETA 03:00:32 2020-11-14 03:11:31 [INFO] [TRAIN] epoch=27, iter=17830/40000, loss=0.2745, lr=0.005884, batch_cost=0.4619, reader_cost=0.0002 | ETA 02:50:41 2020-11-14 03:11:35 [INFO] [TRAIN] epoch=27, iter=17840/40000, loss=0.2956, lr=0.005881, batch_cost=0.4498, reader_cost=0.0002 | ETA 02:46:08 2020-11-14 03:11:41 [INFO] [TRAIN] epoch=28, iter=17850/40000, loss=0.2408, lr=0.005879, batch_cost=0.5798, reader_cost=0.0885 | ETA 03:34:02 2020-11-14 03:11:47 [INFO] [TRAIN] epoch=28, iter=17860/40000, loss=0.2877, lr=0.005877, batch_cost=0.5374, reader_cost=0.0005 | ETA 03:18:16 2020-11-14 03:11:51 [INFO] [TRAIN] epoch=28, iter=17870/40000, loss=0.3528, lr=0.005874, batch_cost=0.4567, reader_cost=0.0002 | ETA 02:48:26 2020-11-14 03:11:56 [INFO] [TRAIN] epoch=28, iter=17880/40000, loss=0.2901, lr=0.005872, batch_cost=0.4612, reader_cost=0.0002 | ETA 02:50:01 2020-11-14 03:12:01 [INFO] [TRAIN] epoch=28, iter=17890/40000, loss=0.2564, lr=0.005869, batch_cost=0.5370, reader_cost=0.0002 | ETA 03:17:53 2020-11-14 03:12:06 [INFO] [TRAIN] epoch=28, iter=17900/40000, loss=0.3171, lr=0.005867, batch_cost=0.4884, reader_cost=0.0002 | ETA 02:59:54 2020-11-14 03:12:11 [INFO] [TRAIN] epoch=28, iter=17910/40000, loss=0.2451, lr=0.005865, batch_cost=0.5199, reader_cost=0.0002 | ETA 03:11:23 2020-11-14 03:12:16 [INFO] [TRAIN] epoch=28, iter=17920/40000, loss=0.2534, lr=0.005862, batch_cost=0.5108, reader_cost=0.0002 | ETA 03:07:59 2020-11-14 03:12:22 [INFO] [TRAIN] epoch=28, iter=17930/40000, loss=0.2772, lr=0.005860, batch_cost=0.5460, reader_cost=0.0002 | ETA 03:20:51 2020-11-14 03:12:27 [INFO] [TRAIN] epoch=28, iter=17940/40000, loss=0.3149, lr=0.005858, batch_cost=0.5002, reader_cost=0.0002 | ETA 03:03:53 2020-11-14 03:12:31 [INFO] [TRAIN] epoch=28, iter=17950/40000, loss=0.2788, lr=0.005855, batch_cost=0.4336, reader_cost=0.0002 | ETA 02:39:21 2020-11-14 03:12:36 [INFO] [TRAIN] epoch=28, iter=17960/40000, loss=0.2210, lr=0.005853, batch_cost=0.4481, reader_cost=0.0002 | ETA 02:44:35 2020-11-14 03:12:40 [INFO] [TRAIN] epoch=28, iter=17970/40000, loss=0.3343, lr=0.005850, batch_cost=0.4435, reader_cost=0.0002 | ETA 02:42:49 2020-11-14 03:12:44 [INFO] [TRAIN] epoch=28, iter=17980/40000, loss=0.3829, lr=0.005848, batch_cost=0.4382, reader_cost=0.0002 | ETA 02:40:50 2020-11-14 03:12:49 [INFO] [TRAIN] epoch=28, iter=17990/40000, loss=0.2817, lr=0.005846, batch_cost=0.4512, reader_cost=0.0002 | ETA 02:45:30 2020-11-14 03:12:53 [INFO] [TRAIN] epoch=28, iter=18000/40000, loss=0.2828, lr=0.005843, batch_cost=0.4399, reader_cost=0.0002 | ETA 02:41:18 2020-11-14 03:12:53 [INFO] Start evaluating (total_samples=1449, total_iters=363)... 2020-11-14 03:13:15 [INFO] [EVAL] #Images=1449 mIoU=0.7881 Acc=0.9522 Kappa=0.8939 2020-11-14 03:13:15 [INFO] [EVAL] Class IoU: [0.9457 0.9163 0.4209 0.8903 0.669 0.8199 0.9572 0.8722 0.9282 0.476 0.8579 0.5805 0.8974 0.8912 0.8628 0.8537 0.6288 0.8571 0.5792 0.88 0.7666] 2020-11-14 03:13:15 [INFO] [EVAL] Class Acc: [0.9661 0.9401 0.4365 0.9468 0.8441 0.9023 0.977 0.9308 0.9662 0.6656 0.9097 0.9458 0.9382 0.9503 0.9287 0.9506 0.8378 0.9683 0.7729 0.9648 0.9491] 2020-11-14 03:13:23 [INFO] [EVAL] The model with the best validation mIoU (0.7881) was saved at iter 18000. 2020-11-14 03:13:28 [INFO] [TRAIN] epoch=28, iter=18010/40000, loss=0.2491, lr=0.005841, batch_cost=0.4624, reader_cost=0.0056 | ETA 02:49:28 2020-11-14 03:13:33 [INFO] [TRAIN] epoch=28, iter=18020/40000, loss=0.2107, lr=0.005838, batch_cost=0.4581, reader_cost=0.0036 | ETA 02:47:48 2020-11-14 03:13:37 [INFO] [TRAIN] epoch=28, iter=18030/40000, loss=0.3691, lr=0.005836, batch_cost=0.4358, reader_cost=0.0005 | ETA 02:39:35 2020-11-14 03:13:42 [INFO] [TRAIN] epoch=28, iter=18040/40000, loss=0.2553, lr=0.005834, batch_cost=0.4711, reader_cost=0.0002 | ETA 02:52:25 2020-11-14 03:13:46 [INFO] [TRAIN] epoch=28, iter=18050/40000, loss=0.2565, lr=0.005831, batch_cost=0.4344, reader_cost=0.0002 | ETA 02:38:55 2020-11-14 03:13:50 [INFO] [TRAIN] epoch=28, iter=18060/40000, loss=0.2541, lr=0.005829, batch_cost=0.4397, reader_cost=0.0002 | ETA 02:40:47 2020-11-14 03:13:55 [INFO] [TRAIN] epoch=28, iter=18070/40000, loss=0.2818, lr=0.005827, batch_cost=0.4391, reader_cost=0.0002 | ETA 02:40:30 2020-11-14 03:13:59 [INFO] [TRAIN] epoch=28, iter=18080/40000, loss=0.2582, lr=0.005824, batch_cost=0.4406, reader_cost=0.0002 | ETA 02:40:57 2020-11-14 03:14:04 [INFO] [TRAIN] epoch=28, iter=18090/40000, loss=0.2617, lr=0.005822, batch_cost=0.4420, reader_cost=0.0002 | ETA 02:41:23 2020-11-14 03:14:08 [INFO] [TRAIN] epoch=28, iter=18100/40000, loss=0.3750, lr=0.005819, batch_cost=0.4419, reader_cost=0.0001 | ETA 02:41:16 2020-11-14 03:14:12 [INFO] [TRAIN] epoch=28, iter=18110/40000, loss=0.4208, lr=0.005817, batch_cost=0.4394, reader_cost=0.0002 | ETA 02:40:17 2020-11-14 03:14:17 [INFO] [TRAIN] epoch=28, iter=18120/40000, loss=0.3229, lr=0.005815, batch_cost=0.4752, reader_cost=0.0002 | ETA 02:53:16 2020-11-14 03:14:22 [INFO] [TRAIN] epoch=28, iter=18130/40000, loss=0.3741, lr=0.005812, batch_cost=0.5300, reader_cost=0.0002 | ETA 03:13:11 2020-11-14 03:14:27 [INFO] [TRAIN] epoch=28, iter=18140/40000, loss=0.2956, lr=0.005810, batch_cost=0.4684, reader_cost=0.0002 | ETA 02:50:39 2020-11-14 03:14:31 [INFO] [TRAIN] epoch=28, iter=18150/40000, loss=0.3586, lr=0.005807, batch_cost=0.4373, reader_cost=0.0002 | ETA 02:39:15 2020-11-14 03:14:36 [INFO] [TRAIN] epoch=28, iter=18160/40000, loss=0.3940, lr=0.005805, batch_cost=0.4696, reader_cost=0.0002 | ETA 02:50:57 2020-11-14 03:14:41 [INFO] [TRAIN] epoch=28, iter=18170/40000, loss=0.2859, lr=0.005803, batch_cost=0.4463, reader_cost=0.0002 | ETA 02:42:22 2020-11-14 03:14:45 [INFO] [TRAIN] epoch=28, iter=18180/40000, loss=0.2523, lr=0.005800, batch_cost=0.4708, reader_cost=0.0002 | ETA 02:51:12 2020-11-14 03:14:50 [INFO] [TRAIN] epoch=28, iter=18190/40000, loss=0.3825, lr=0.005798, batch_cost=0.4611, reader_cost=0.0002 | ETA 02:47:37 2020-11-14 03:14:54 [INFO] [TRAIN] epoch=28, iter=18200/40000, loss=0.2580, lr=0.005795, batch_cost=0.4471, reader_cost=0.0002 | ETA 02:42:25 2020-11-14 03:15:00 [INFO] [TRAIN] epoch=28, iter=18210/40000, loss=0.2917, lr=0.005793, batch_cost=0.5161, reader_cost=0.0002 | ETA 03:07:26 2020-11-14 03:15:05 [INFO] [TRAIN] epoch=28, iter=18220/40000, loss=0.4366, lr=0.005791, batch_cost=0.4974, reader_cost=0.0002 | ETA 03:00:33 2020-11-14 03:15:12 [INFO] [TRAIN] epoch=28, iter=18230/40000, loss=0.2951, lr=0.005788, batch_cost=0.7089, reader_cost=0.0003 | ETA 04:17:12 2020-11-14 03:15:18 [INFO] [TRAIN] epoch=28, iter=18240/40000, loss=0.3032, lr=0.005786, batch_cost=0.5973, reader_cost=0.0016 | ETA 03:36:36 2020-11-14 03:15:22 [INFO] [TRAIN] epoch=28, iter=18250/40000, loss=0.3705, lr=0.005784, batch_cost=0.4718, reader_cost=0.0002 | ETA 02:51:01 2020-11-14 03:15:27 [INFO] [TRAIN] epoch=28, iter=18260/40000, loss=0.3665, lr=0.005781, batch_cost=0.4813, reader_cost=0.0002 | ETA 02:54:23 2020-11-14 03:15:32 [INFO] [TRAIN] epoch=28, iter=18270/40000, loss=0.3560, lr=0.005779, batch_cost=0.4802, reader_cost=0.0002 | ETA 02:53:54 2020-11-14 03:15:37 [INFO] [TRAIN] epoch=28, iter=18280/40000, loss=0.2773, lr=0.005776, batch_cost=0.5200, reader_cost=0.0002 | ETA 03:08:13 2020-11-14 03:15:42 [INFO] [TRAIN] epoch=28, iter=18290/40000, loss=0.3587, lr=0.005774, batch_cost=0.4467, reader_cost=0.0002 | ETA 02:41:38 2020-11-14 03:15:46 [INFO] [TRAIN] epoch=28, iter=18300/40000, loss=0.2565, lr=0.005772, batch_cost=0.4766, reader_cost=0.0002 | ETA 02:52:22 2020-11-14 03:15:51 [INFO] [TRAIN] epoch=28, iter=18310/40000, loss=0.2942, lr=0.005769, batch_cost=0.4352, reader_cost=0.0002 | ETA 02:37:18 2020-11-14 03:15:55 [INFO] [TRAIN] epoch=28, iter=18320/40000, loss=0.2809, lr=0.005767, batch_cost=0.4429, reader_cost=0.0002 | ETA 02:40:03 2020-11-14 03:16:00 [INFO] [TRAIN] epoch=28, iter=18330/40000, loss=0.3023, lr=0.005764, batch_cost=0.4362, reader_cost=0.0002 | ETA 02:37:31 2020-11-14 03:16:04 [INFO] [TRAIN] epoch=28, iter=18340/40000, loss=0.2798, lr=0.005762, batch_cost=0.4560, reader_cost=0.0002 | ETA 02:44:36 2020-11-14 03:16:09 [INFO] [TRAIN] epoch=28, iter=18350/40000, loss=0.2241, lr=0.005760, batch_cost=0.4490, reader_cost=0.0002 | ETA 02:42:00 2020-11-14 03:16:13 [INFO] [TRAIN] epoch=28, iter=18360/40000, loss=0.2323, lr=0.005757, batch_cost=0.4492, reader_cost=0.0002 | ETA 02:42:00 2020-11-14 03:16:18 [INFO] [TRAIN] epoch=28, iter=18370/40000, loss=0.2533, lr=0.005755, batch_cost=0.4435, reader_cost=0.0002 | ETA 02:39:51 2020-11-14 03:16:22 [INFO] [TRAIN] epoch=28, iter=18380/40000, loss=0.2359, lr=0.005752, batch_cost=0.4490, reader_cost=0.0002 | ETA 02:41:46 2020-11-14 03:16:27 [INFO] [TRAIN] epoch=28, iter=18390/40000, loss=0.2744, lr=0.005750, batch_cost=0.4678, reader_cost=0.0002 | ETA 02:48:30 2020-11-14 03:16:31 [INFO] [TRAIN] epoch=28, iter=18400/40000, loss=0.3237, lr=0.005748, batch_cost=0.4389, reader_cost=0.0003 | ETA 02:38:00 2020-11-14 03:16:35 [INFO] [TRAIN] epoch=28, iter=18410/40000, loss=0.3923, lr=0.005745, batch_cost=0.4259, reader_cost=0.0002 | ETA 02:33:15 2020-11-14 03:16:40 [INFO] [TRAIN] epoch=28, iter=18420/40000, loss=0.2653, lr=0.005743, batch_cost=0.4259, reader_cost=0.0002 | ETA 02:33:09 2020-11-14 03:16:44 [INFO] [TRAIN] epoch=28, iter=18430/40000, loss=0.2723, lr=0.005741, batch_cost=0.4259, reader_cost=0.0002 | ETA 02:33:06 2020-11-14 03:16:48 [INFO] [TRAIN] epoch=28, iter=18440/40000, loss=0.3221, lr=0.005738, batch_cost=0.4250, reader_cost=0.0002 | ETA 02:32:43 2020-11-14 03:16:52 [INFO] [TRAIN] epoch=28, iter=18450/40000, loss=0.2854, lr=0.005736, batch_cost=0.4250, reader_cost=0.0002 | ETA 02:32:39 2020-11-14 03:16:57 [INFO] [TRAIN] epoch=28, iter=18460/40000, loss=0.3069, lr=0.005733, batch_cost=0.4270, reader_cost=0.0002 | ETA 02:33:16 2020-11-14 03:17:01 [INFO] [TRAIN] epoch=28, iter=18470/40000, loss=0.3383, lr=0.005731, batch_cost=0.4540, reader_cost=0.0002 | ETA 02:42:55 2020-11-14 03:17:06 [INFO] [TRAIN] epoch=28, iter=18480/40000, loss=0.3159, lr=0.005729, batch_cost=0.4755, reader_cost=0.0002 | ETA 02:50:33 2020-11-14 03:17:10 [INFO] [TRAIN] epoch=28, iter=18490/40000, loss=0.3597, lr=0.005726, batch_cost=0.4446, reader_cost=0.0002 | ETA 02:39:23 2020-11-14 03:17:15 [INFO] [TRAIN] epoch=28, iter=18500/40000, loss=0.3295, lr=0.005724, batch_cost=0.4317, reader_cost=0.0002 | ETA 02:34:42 2020-11-14 03:17:20 [INFO] [TRAIN] epoch=29, iter=18510/40000, loss=0.2246, lr=0.005721, batch_cost=0.5736, reader_cost=0.0821 | ETA 03:25:27 2020-11-14 03:17:25 [INFO] [TRAIN] epoch=29, iter=18520/40000, loss=0.3197, lr=0.005719, batch_cost=0.4769, reader_cost=0.0005 | ETA 02:50:43 2020-11-14 03:17:30 [INFO] [TRAIN] epoch=29, iter=18530/40000, loss=0.2618, lr=0.005717, batch_cost=0.4915, reader_cost=0.0002 | ETA 02:55:52 2020-11-14 03:17:35 [INFO] [TRAIN] epoch=29, iter=18540/40000, loss=0.3190, lr=0.005714, batch_cost=0.4690, reader_cost=0.0002 | ETA 02:47:43 2020-11-14 03:17:39 [INFO] [TRAIN] epoch=29, iter=18550/40000, loss=0.2340, lr=0.005712, batch_cost=0.4477, reader_cost=0.0002 | ETA 02:40:03 2020-11-14 03:17:44 [INFO] [TRAIN] epoch=29, iter=18560/40000, loss=0.2148, lr=0.005709, batch_cost=0.4440, reader_cost=0.0002 | ETA 02:38:39 2020-11-14 03:17:48 [INFO] [TRAIN] epoch=29, iter=18570/40000, loss=0.2387, lr=0.005707, batch_cost=0.4549, reader_cost=0.0002 | ETA 02:42:27 2020-11-14 03:17:53 [INFO] [TRAIN] epoch=29, iter=18580/40000, loss=0.3309, lr=0.005705, batch_cost=0.4507, reader_cost=0.0002 | ETA 02:40:53 2020-11-14 03:17:58 [INFO] [TRAIN] epoch=29, iter=18590/40000, loss=0.3033, lr=0.005702, batch_cost=0.4784, reader_cost=0.0002 | ETA 02:50:43 2020-11-14 03:18:02 [INFO] [TRAIN] epoch=29, iter=18600/40000, loss=0.2308, lr=0.005700, batch_cost=0.4824, reader_cost=0.0002 | ETA 02:52:03 2020-11-14 03:18:07 [INFO] [TRAIN] epoch=29, iter=18610/40000, loss=0.2759, lr=0.005697, batch_cost=0.4332, reader_cost=0.0002 | ETA 02:34:25 2020-11-14 03:18:11 [INFO] [TRAIN] epoch=29, iter=18620/40000, loss=0.2946, lr=0.005695, batch_cost=0.4301, reader_cost=0.0002 | ETA 02:33:15 2020-11-14 03:18:15 [INFO] [TRAIN] epoch=29, iter=18630/40000, loss=0.3589, lr=0.005693, batch_cost=0.4381, reader_cost=0.0002 | ETA 02:36:01 2020-11-14 03:18:20 [INFO] [TRAIN] epoch=29, iter=18640/40000, loss=0.3577, lr=0.005690, batch_cost=0.4327, reader_cost=0.0002 | ETA 02:34:03 2020-11-14 03:18:24 [INFO] [TRAIN] epoch=29, iter=18650/40000, loss=0.2788, lr=0.005688, batch_cost=0.4384, reader_cost=0.0002 | ETA 02:35:59 2020-11-14 03:18:29 [INFO] [TRAIN] epoch=29, iter=18660/40000, loss=0.2856, lr=0.005686, batch_cost=0.4416, reader_cost=0.0002 | ETA 02:37:02 2020-11-14 03:18:33 [INFO] [TRAIN] epoch=29, iter=18670/40000, loss=0.2871, lr=0.005683, batch_cost=0.4477, reader_cost=0.0002 | ETA 02:39:10 2020-11-14 03:18:37 [INFO] [TRAIN] epoch=29, iter=18680/40000, loss=0.2508, lr=0.005681, batch_cost=0.4445, reader_cost=0.0002 | ETA 02:37:57 2020-11-14 03:18:42 [INFO] [TRAIN] epoch=29, iter=18690/40000, loss=0.2646, lr=0.005678, batch_cost=0.4450, reader_cost=0.0002 | ETA 02:38:02 2020-11-14 03:18:46 [INFO] [TRAIN] epoch=29, iter=18700/40000, loss=0.2126, lr=0.005676, batch_cost=0.4446, reader_cost=0.0002 | ETA 02:37:50 2020-11-14 03:18:51 [INFO] [TRAIN] epoch=29, iter=18710/40000, loss=0.2966, lr=0.005674, batch_cost=0.4437, reader_cost=0.0002 | ETA 02:37:26 2020-11-14 03:18:55 [INFO] [TRAIN] epoch=29, iter=18720/40000, loss=0.2824, lr=0.005671, batch_cost=0.4445, reader_cost=0.0002 | ETA 02:37:38 2020-11-14 03:19:00 [INFO] [TRAIN] epoch=29, iter=18730/40000, loss=0.2025, lr=0.005669, batch_cost=0.4411, reader_cost=0.0002 | ETA 02:36:21 2020-11-14 03:19:04 [INFO] [TRAIN] epoch=29, iter=18740/40000, loss=0.2286, lr=0.005666, batch_cost=0.4415, reader_cost=0.0002 | ETA 02:36:26 2020-11-14 03:19:08 [INFO] [TRAIN] epoch=29, iter=18750/40000, loss=0.2416, lr=0.005664, batch_cost=0.4420, reader_cost=0.0001 | ETA 02:36:31 2020-11-14 03:19:13 [INFO] [TRAIN] epoch=29, iter=18760/40000, loss=0.2320, lr=0.005662, batch_cost=0.4431, reader_cost=0.0002 | ETA 02:36:51 2020-11-14 03:19:17 [INFO] [TRAIN] epoch=29, iter=18770/40000, loss=0.3200, lr=0.005659, batch_cost=0.4422, reader_cost=0.0002 | ETA 02:36:26 2020-11-14 03:19:22 [INFO] [TRAIN] epoch=29, iter=18780/40000, loss=0.2618, lr=0.005657, batch_cost=0.4424, reader_cost=0.0002 | ETA 02:36:27 2020-11-14 03:19:26 [INFO] [TRAIN] epoch=29, iter=18790/40000, loss=0.2491, lr=0.005654, batch_cost=0.4463, reader_cost=0.0002 | ETA 02:37:45 2020-11-14 03:19:31 [INFO] [TRAIN] epoch=29, iter=18800/40000, loss=0.2292, lr=0.005652, batch_cost=0.4505, reader_cost=0.0002 | ETA 02:39:11 2020-11-14 03:19:35 [INFO] [TRAIN] epoch=29, iter=18810/40000, loss=0.3529, lr=0.005650, batch_cost=0.4408, reader_cost=0.0002 | ETA 02:35:40 2020-11-14 03:19:40 [INFO] [TRAIN] epoch=29, iter=18820/40000, loss=0.3715, lr=0.005647, batch_cost=0.4379, reader_cost=0.0002 | ETA 02:34:34 2020-11-14 03:19:44 [INFO] [TRAIN] epoch=29, iter=18830/40000, loss=0.2823, lr=0.005645, batch_cost=0.4594, reader_cost=0.0002 | ETA 02:42:06 2020-11-14 03:19:49 [INFO] [TRAIN] epoch=29, iter=18840/40000, loss=0.2503, lr=0.005642, batch_cost=0.4400, reader_cost=0.0002 | ETA 02:35:10 2020-11-14 03:19:53 [INFO] [TRAIN] epoch=29, iter=18850/40000, loss=0.2943, lr=0.005640, batch_cost=0.4368, reader_cost=0.0002 | ETA 02:33:58 2020-11-14 03:19:57 [INFO] [TRAIN] epoch=29, iter=18860/40000, loss=0.2359, lr=0.005638, batch_cost=0.4376, reader_cost=0.0002 | ETA 02:34:11 2020-11-14 03:20:02 [INFO] [TRAIN] epoch=29, iter=18870/40000, loss=0.2559, lr=0.005635, batch_cost=0.4371, reader_cost=0.0002 | ETA 02:33:55 2020-11-14 03:20:06 [INFO] [TRAIN] epoch=29, iter=18880/40000, loss=0.3401, lr=0.005633, batch_cost=0.4514, reader_cost=0.0002 | ETA 02:38:54 2020-11-14 03:20:11 [INFO] [TRAIN] epoch=29, iter=18890/40000, loss=0.2601, lr=0.005630, batch_cost=0.4807, reader_cost=0.0002 | ETA 02:49:07 2020-11-14 03:20:15 [INFO] [TRAIN] epoch=29, iter=18900/40000, loss=0.3576, lr=0.005628, batch_cost=0.4402, reader_cost=0.0002 | ETA 02:34:47 2020-11-14 03:20:20 [INFO] [TRAIN] epoch=29, iter=18910/40000, loss=0.2754, lr=0.005626, batch_cost=0.4356, reader_cost=0.0002 | ETA 02:33:07 2020-11-14 03:20:24 [INFO] [TRAIN] epoch=29, iter=18920/40000, loss=0.3036, lr=0.005623, batch_cost=0.4698, reader_cost=0.0002 | ETA 02:45:03 2020-11-14 03:20:30 [INFO] [TRAIN] epoch=29, iter=18930/40000, loss=0.2798, lr=0.005621, batch_cost=0.5117, reader_cost=0.0002 | ETA 02:59:40 2020-11-14 03:20:34 [INFO] [TRAIN] epoch=29, iter=18940/40000, loss=0.2914, lr=0.005618, batch_cost=0.4380, reader_cost=0.0002 | ETA 02:33:45 2020-11-14 03:20:38 [INFO] [TRAIN] epoch=29, iter=18950/40000, loss=0.3498, lr=0.005616, batch_cost=0.4486, reader_cost=0.0002 | ETA 02:37:22 2020-11-14 03:20:43 [INFO] [TRAIN] epoch=29, iter=18960/40000, loss=0.2903, lr=0.005614, batch_cost=0.4495, reader_cost=0.0002 | ETA 02:37:38 2020-11-14 03:20:47 [INFO] [TRAIN] epoch=29, iter=18970/40000, loss=0.2476, lr=0.005611, batch_cost=0.4412, reader_cost=0.0002 | ETA 02:34:37 2020-11-14 03:20:52 [INFO] [TRAIN] epoch=29, iter=18980/40000, loss=0.2630, lr=0.005609, batch_cost=0.4443, reader_cost=0.0002 | ETA 02:35:39 2020-11-14 03:20:57 [INFO] [TRAIN] epoch=29, iter=18990/40000, loss=0.2336, lr=0.005606, batch_cost=0.4921, reader_cost=0.0002 | ETA 02:52:18 2020-11-14 03:21:01 [INFO] [TRAIN] epoch=29, iter=19000/40000, loss=0.2941, lr=0.005604, batch_cost=0.4426, reader_cost=0.0002 | ETA 02:34:53 2020-11-14 03:21:06 [INFO] [TRAIN] epoch=29, iter=19010/40000, loss=0.2005, lr=0.005602, batch_cost=0.4612, reader_cost=0.0002 | ETA 02:41:20 2020-11-14 03:21:10 [INFO] [TRAIN] epoch=29, iter=19020/40000, loss=0.2466, lr=0.005599, batch_cost=0.4350, reader_cost=0.0002 | ETA 02:32:06 2020-11-14 03:21:14 [INFO] [TRAIN] epoch=29, iter=19030/40000, loss=0.2665, lr=0.005597, batch_cost=0.4382, reader_cost=0.0002 | ETA 02:33:09 2020-11-14 03:21:19 [INFO] [TRAIN] epoch=29, iter=19040/40000, loss=0.2693, lr=0.005594, batch_cost=0.4368, reader_cost=0.0002 | ETA 02:32:35 2020-11-14 03:21:23 [INFO] [TRAIN] epoch=29, iter=19050/40000, loss=0.2258, lr=0.005592, batch_cost=0.4403, reader_cost=0.0002 | ETA 02:33:45 2020-11-14 03:21:28 [INFO] [TRAIN] epoch=29, iter=19060/40000, loss=0.2905, lr=0.005590, batch_cost=0.4565, reader_cost=0.0002 | ETA 02:39:18 2020-11-14 03:21:32 [INFO] [TRAIN] epoch=29, iter=19070/40000, loss=0.2352, lr=0.005587, batch_cost=0.4412, reader_cost=0.0002 | ETA 02:33:54 2020-11-14 03:21:37 [INFO] [TRAIN] epoch=29, iter=19080/40000, loss=0.3735, lr=0.005585, batch_cost=0.4312, reader_cost=0.0002 | ETA 02:30:21 2020-11-14 03:21:41 [INFO] [TRAIN] epoch=29, iter=19090/40000, loss=0.3918, lr=0.005582, batch_cost=0.4444, reader_cost=0.0002 | ETA 02:34:52 2020-11-14 03:21:45 [INFO] [TRAIN] epoch=29, iter=19100/40000, loss=0.2524, lr=0.005580, batch_cost=0.4541, reader_cost=0.0002 | ETA 02:38:11 2020-11-14 03:21:50 [INFO] [TRAIN] epoch=29, iter=19110/40000, loss=0.4437, lr=0.005578, batch_cost=0.4513, reader_cost=0.0002 | ETA 02:37:06 2020-11-14 03:21:55 [INFO] [TRAIN] epoch=29, iter=19120/40000, loss=0.4328, lr=0.005575, batch_cost=0.4675, reader_cost=0.0002 | ETA 02:42:41 2020-11-14 03:21:59 [INFO] [TRAIN] epoch=29, iter=19130/40000, loss=0.3747, lr=0.005573, batch_cost=0.4592, reader_cost=0.0002 | ETA 02:39:44 2020-11-14 03:22:04 [INFO] [TRAIN] epoch=29, iter=19140/40000, loss=0.3400, lr=0.005570, batch_cost=0.4447, reader_cost=0.0002 | ETA 02:34:36 2020-11-14 03:22:08 [INFO] [TRAIN] epoch=29, iter=19150/40000, loss=0.3567, lr=0.005568, batch_cost=0.4571, reader_cost=0.0002 | ETA 02:38:49 2020-11-14 03:22:13 [INFO] [TRAIN] epoch=29, iter=19160/40000, loss=0.3174, lr=0.005566, batch_cost=0.4832, reader_cost=0.0002 | ETA 02:47:50 2020-11-14 03:22:19 [INFO] [TRAIN] epoch=30, iter=19170/40000, loss=0.2966, lr=0.005563, batch_cost=0.5570, reader_cost=0.0910 | ETA 03:13:21 2020-11-14 03:22:24 [INFO] [TRAIN] epoch=30, iter=19180/40000, loss=0.4190, lr=0.005561, batch_cost=0.4993, reader_cost=0.0005 | ETA 02:53:14 2020-11-14 03:22:28 [INFO] [TRAIN] epoch=30, iter=19190/40000, loss=0.3006, lr=0.005558, batch_cost=0.4707, reader_cost=0.0002 | ETA 02:43:14 2020-11-14 03:22:33 [INFO] [TRAIN] epoch=30, iter=19200/40000, loss=0.2083, lr=0.005556, batch_cost=0.4770, reader_cost=0.0002 | ETA 02:45:21 2020-11-14 03:22:38 [INFO] [TRAIN] epoch=30, iter=19210/40000, loss=0.1809, lr=0.005554, batch_cost=0.5261, reader_cost=0.0002 | ETA 03:02:16 2020-11-14 03:22:43 [INFO] [TRAIN] epoch=30, iter=19220/40000, loss=0.3143, lr=0.005551, batch_cost=0.4804, reader_cost=0.0002 | ETA 02:46:21 2020-11-14 03:22:48 [INFO] [TRAIN] epoch=30, iter=19230/40000, loss=0.2152, lr=0.005549, batch_cost=0.5058, reader_cost=0.0002 | ETA 02:55:05 2020-11-14 03:22:53 [INFO] [TRAIN] epoch=30, iter=19240/40000, loss=0.2811, lr=0.005546, batch_cost=0.4762, reader_cost=0.0002 | ETA 02:44:45 2020-11-14 03:22:58 [INFO] [TRAIN] epoch=30, iter=19250/40000, loss=0.3327, lr=0.005544, batch_cost=0.5010, reader_cost=0.0002 | ETA 02:53:15 2020-11-14 03:23:04 [INFO] [TRAIN] epoch=30, iter=19260/40000, loss=0.3476, lr=0.005542, batch_cost=0.6047, reader_cost=0.0002 | ETA 03:29:01 2020-11-14 03:23:12 [INFO] [TRAIN] epoch=30, iter=19270/40000, loss=0.3397, lr=0.005539, batch_cost=0.7850, reader_cost=0.0002 | ETA 04:31:12 2020-11-14 03:23:17 [INFO] [TRAIN] epoch=30, iter=19280/40000, loss=0.2571, lr=0.005537, batch_cost=0.5140, reader_cost=0.0002 | ETA 02:57:29 2020-11-14 03:23:22 [INFO] [TRAIN] epoch=30, iter=19290/40000, loss=0.2234, lr=0.005534, batch_cost=0.4457, reader_cost=0.0002 | ETA 02:33:50 2020-11-14 03:23:26 [INFO] [TRAIN] epoch=30, iter=19300/40000, loss=0.4042, lr=0.005532, batch_cost=0.4751, reader_cost=0.0002 | ETA 02:43:55 2020-11-14 03:23:31 [INFO] [TRAIN] epoch=30, iter=19310/40000, loss=0.3235, lr=0.005530, batch_cost=0.4751, reader_cost=0.0002 | ETA 02:43:50 2020-11-14 03:23:36 [INFO] [TRAIN] epoch=30, iter=19320/40000, loss=0.2794, lr=0.005527, batch_cost=0.4707, reader_cost=0.0002 | ETA 02:42:13 2020-11-14 03:23:41 [INFO] [TRAIN] epoch=30, iter=19330/40000, loss=0.2895, lr=0.005525, batch_cost=0.5235, reader_cost=0.0002 | ETA 03:00:20 2020-11-14 03:23:46 [INFO] [TRAIN] epoch=30, iter=19340/40000, loss=0.2134, lr=0.005522, batch_cost=0.4645, reader_cost=0.0002 | ETA 02:39:56 2020-11-14 03:23:50 [INFO] [TRAIN] epoch=30, iter=19350/40000, loss=0.2941, lr=0.005520, batch_cost=0.4557, reader_cost=0.0002 | ETA 02:36:50 2020-11-14 03:23:55 [INFO] [TRAIN] epoch=30, iter=19360/40000, loss=0.2536, lr=0.005518, batch_cost=0.4808, reader_cost=0.0002 | ETA 02:45:24 2020-11-14 03:24:00 [INFO] [TRAIN] epoch=30, iter=19370/40000, loss=0.2609, lr=0.005515, batch_cost=0.4956, reader_cost=0.0002 | ETA 02:50:24 2020-11-14 03:24:05 [INFO] [TRAIN] epoch=30, iter=19380/40000, loss=0.3820, lr=0.005513, batch_cost=0.4667, reader_cost=0.0002 | ETA 02:40:22 2020-11-14 03:24:09 [INFO] [TRAIN] epoch=30, iter=19390/40000, loss=0.2479, lr=0.005510, batch_cost=0.4695, reader_cost=0.0011 | ETA 02:41:16 2020-11-14 03:24:14 [INFO] [TRAIN] epoch=30, iter=19400/40000, loss=0.3553, lr=0.005508, batch_cost=0.4614, reader_cost=0.0008 | ETA 02:38:25 2020-11-14 03:24:18 [INFO] [TRAIN] epoch=30, iter=19410/40000, loss=0.2847, lr=0.005506, batch_cost=0.4440, reader_cost=0.0002 | ETA 02:32:21 2020-11-14 03:24:23 [INFO] [TRAIN] epoch=30, iter=19420/40000, loss=0.3054, lr=0.005503, batch_cost=0.4442, reader_cost=0.0002 | ETA 02:32:22 2020-11-14 03:24:28 [INFO] [TRAIN] epoch=30, iter=19430/40000, loss=0.3151, lr=0.005501, batch_cost=0.4671, reader_cost=0.0002 | ETA 02:40:08 2020-11-14 03:24:32 [INFO] [TRAIN] epoch=30, iter=19440/40000, loss=0.3627, lr=0.005498, batch_cost=0.4657, reader_cost=0.0003 | ETA 02:39:34 2020-11-14 03:24:37 [INFO] [TRAIN] epoch=30, iter=19450/40000, loss=0.2001, lr=0.005496, batch_cost=0.4817, reader_cost=0.0015 | ETA 02:44:59 2020-11-14 03:24:42 [INFO] [TRAIN] epoch=30, iter=19460/40000, loss=0.2916, lr=0.005494, batch_cost=0.4580, reader_cost=0.0002 | ETA 02:36:47 2020-11-14 03:24:46 [INFO] [TRAIN] epoch=30, iter=19470/40000, loss=0.2452, lr=0.005491, batch_cost=0.4598, reader_cost=0.0002 | ETA 02:37:20 2020-11-14 03:24:51 [INFO] [TRAIN] epoch=30, iter=19480/40000, loss=0.2373, lr=0.005489, batch_cost=0.4535, reader_cost=0.0010 | ETA 02:35:06 2020-11-14 03:24:55 [INFO] [TRAIN] epoch=30, iter=19490/40000, loss=0.3836, lr=0.005486, batch_cost=0.4422, reader_cost=0.0001 | ETA 02:31:09 2020-11-14 03:25:00 [INFO] [TRAIN] epoch=30, iter=19500/40000, loss=0.2574, lr=0.005484, batch_cost=0.4468, reader_cost=0.0002 | ETA 02:32:39 2020-11-14 03:25:05 [INFO] [TRAIN] epoch=30, iter=19510/40000, loss=0.3782, lr=0.005482, batch_cost=0.4940, reader_cost=0.0002 | ETA 02:48:42 2020-11-14 03:25:10 [INFO] [TRAIN] epoch=30, iter=19520/40000, loss=0.2306, lr=0.005479, batch_cost=0.5323, reader_cost=0.0002 | ETA 03:01:42 2020-11-14 03:25:15 [INFO] [TRAIN] epoch=30, iter=19530/40000, loss=0.2151, lr=0.005477, batch_cost=0.5122, reader_cost=0.0002 | ETA 02:54:45 2020-11-14 03:25:20 [INFO] [TRAIN] epoch=30, iter=19540/40000, loss=0.2943, lr=0.005474, batch_cost=0.4777, reader_cost=0.0002 | ETA 02:42:53 2020-11-14 03:25:24 [INFO] [TRAIN] epoch=30, iter=19550/40000, loss=0.4018, lr=0.005472, batch_cost=0.4630, reader_cost=0.0002 | ETA 02:37:49 2020-11-14 03:25:30 [INFO] [TRAIN] epoch=30, iter=19560/40000, loss=0.3057, lr=0.005470, batch_cost=0.5579, reader_cost=0.0002 | ETA 03:10:02 2020-11-14 03:25:35 [INFO] [TRAIN] epoch=30, iter=19570/40000, loss=0.3279, lr=0.005467, batch_cost=0.4960, reader_cost=0.0002 | ETA 02:48:53 2020-11-14 03:25:40 [INFO] [TRAIN] epoch=30, iter=19580/40000, loss=0.2914, lr=0.005465, batch_cost=0.4586, reader_cost=0.0006 | ETA 02:36:04 2020-11-14 03:25:44 [INFO] [TRAIN] epoch=30, iter=19590/40000, loss=0.2461, lr=0.005462, batch_cost=0.4396, reader_cost=0.0002 | ETA 02:29:32 2020-11-14 03:25:49 [INFO] [TRAIN] epoch=30, iter=19600/40000, loss=0.2655, lr=0.005460, batch_cost=0.4636, reader_cost=0.0002 | ETA 02:37:37 2020-11-14 03:25:54 [INFO] [TRAIN] epoch=30, iter=19610/40000, loss=0.4047, lr=0.005458, batch_cost=0.4972, reader_cost=0.0002 | ETA 02:48:57 2020-11-14 03:25:58 [INFO] [TRAIN] epoch=30, iter=19620/40000, loss=0.3222, lr=0.005455, batch_cost=0.4640, reader_cost=0.0002 | ETA 02:37:35 2020-11-14 03:26:03 [INFO] [TRAIN] epoch=30, iter=19630/40000, loss=0.2975, lr=0.005453, batch_cost=0.4580, reader_cost=0.0002 | ETA 02:35:30 2020-11-14 03:26:07 [INFO] [TRAIN] epoch=30, iter=19640/40000, loss=0.2471, lr=0.005450, batch_cost=0.4390, reader_cost=0.0002 | ETA 02:28:57 2020-11-14 03:26:12 [INFO] [TRAIN] epoch=30, iter=19650/40000, loss=0.2411, lr=0.005448, batch_cost=0.4907, reader_cost=0.0002 | ETA 02:46:26 2020-11-14 03:26:17 [INFO] [TRAIN] epoch=30, iter=19660/40000, loss=0.2638, lr=0.005446, batch_cost=0.5256, reader_cost=0.0002 | ETA 02:58:10 2020-11-14 03:26:22 [INFO] [TRAIN] epoch=30, iter=19670/40000, loss=0.2719, lr=0.005443, batch_cost=0.4992, reader_cost=0.0002 | ETA 02:49:09 2020-11-14 03:26:28 [INFO] [TRAIN] epoch=30, iter=19680/40000, loss=0.2815, lr=0.005441, batch_cost=0.5466, reader_cost=0.0002 | ETA 03:05:06 2020-11-14 03:26:33 [INFO] [TRAIN] epoch=30, iter=19690/40000, loss=0.3186, lr=0.005438, batch_cost=0.5178, reader_cost=0.0002 | ETA 02:55:16 2020-11-14 03:26:38 [INFO] [TRAIN] epoch=30, iter=19700/40000, loss=0.3869, lr=0.005436, batch_cost=0.5196, reader_cost=0.0002 | ETA 02:55:47 2020-11-14 03:26:43 [INFO] [TRAIN] epoch=30, iter=19710/40000, loss=0.3072, lr=0.005434, batch_cost=0.4688, reader_cost=0.0002 | ETA 02:38:31 2020-11-14 03:26:47 [INFO] [TRAIN] epoch=30, iter=19720/40000, loss=0.3477, lr=0.005431, batch_cost=0.4474, reader_cost=0.0002 | ETA 02:31:12 2020-11-14 03:26:52 [INFO] [TRAIN] epoch=30, iter=19730/40000, loss=0.2704, lr=0.005429, batch_cost=0.4959, reader_cost=0.0002 | ETA 02:47:32 2020-11-14 03:26:57 [INFO] [TRAIN] epoch=30, iter=19740/40000, loss=0.3513, lr=0.005426, batch_cost=0.5060, reader_cost=0.0002 | ETA 02:50:52 2020-11-14 03:27:02 [INFO] [TRAIN] epoch=30, iter=19750/40000, loss=0.3414, lr=0.005424, batch_cost=0.4766, reader_cost=0.0002 | ETA 02:40:50 2020-11-14 03:27:07 [INFO] [TRAIN] epoch=30, iter=19760/40000, loss=0.2483, lr=0.005422, batch_cost=0.4550, reader_cost=0.0002 | ETA 02:33:30 2020-11-14 03:27:11 [INFO] [TRAIN] epoch=30, iter=19770/40000, loss=0.4495, lr=0.005419, batch_cost=0.4856, reader_cost=0.0002 | ETA 02:43:42 2020-11-14 03:27:16 [INFO] [TRAIN] epoch=30, iter=19780/40000, loss=0.3212, lr=0.005417, batch_cost=0.5003, reader_cost=0.0002 | ETA 02:48:36 2020-11-14 03:27:22 [INFO] [TRAIN] epoch=30, iter=19790/40000, loss=0.2824, lr=0.005414, batch_cost=0.5059, reader_cost=0.0002 | ETA 02:50:23 2020-11-14 03:27:27 [INFO] [TRAIN] epoch=30, iter=19800/40000, loss=0.3145, lr=0.005412, batch_cost=0.5060, reader_cost=0.0002 | ETA 02:50:20 2020-11-14 03:27:32 [INFO] [TRAIN] epoch=30, iter=19810/40000, loss=0.2562, lr=0.005409, batch_cost=0.5312, reader_cost=0.0002 | ETA 02:58:44 2020-11-14 03:27:37 [INFO] [TRAIN] epoch=30, iter=19820/40000, loss=0.3128, lr=0.005407, batch_cost=0.4763, reader_cost=0.0002 | ETA 02:40:11 2020-11-14 03:27:41 [INFO] [TRAIN] epoch=30, iter=19830/40000, loss=0.3349, lr=0.005405, batch_cost=0.4547, reader_cost=0.0002 | ETA 02:32:50 2020-11-14 03:27:50 [INFO] [TRAIN] epoch=31, iter=19840/40000, loss=0.2831, lr=0.005402, batch_cost=0.8489, reader_cost=0.0786 | ETA 04:45:13 2020-11-14 03:27:55 [INFO] [TRAIN] epoch=31, iter=19850/40000, loss=0.2743, lr=0.005400, batch_cost=0.5079, reader_cost=0.0005 | ETA 02:50:33 2020-11-14 03:28:00 [INFO] [TRAIN] epoch=31, iter=19860/40000, loss=0.2551, lr=0.005397, batch_cost=0.4862, reader_cost=0.0002 | ETA 02:43:11 2020-11-14 03:28:05 [INFO] [TRAIN] epoch=31, iter=19870/40000, loss=0.2617, lr=0.005395, batch_cost=0.4880, reader_cost=0.0002 | ETA 02:43:42 2020-11-14 03:28:10 [INFO] [TRAIN] epoch=31, iter=19880/40000, loss=0.3838, lr=0.005393, batch_cost=0.5145, reader_cost=0.0002 | ETA 02:52:32 2020-11-14 03:28:15 [INFO] [TRAIN] epoch=31, iter=19890/40000, loss=0.3118, lr=0.005390, batch_cost=0.5244, reader_cost=0.0002 | ETA 02:55:45 2020-11-14 03:28:20 [INFO] [TRAIN] epoch=31, iter=19900/40000, loss=0.2153, lr=0.005388, batch_cost=0.4712, reader_cost=0.0002 | ETA 02:37:52 2020-11-14 03:28:24 [INFO] [TRAIN] epoch=31, iter=19910/40000, loss=0.3044, lr=0.005385, batch_cost=0.4711, reader_cost=0.0002 | ETA 02:37:45 2020-11-14 03:28:29 [INFO] [TRAIN] epoch=31, iter=19920/40000, loss=0.2404, lr=0.005383, batch_cost=0.4839, reader_cost=0.0002 | ETA 02:41:56 2020-11-14 03:28:34 [INFO] [TRAIN] epoch=31, iter=19930/40000, loss=0.3863, lr=0.005381, batch_cost=0.4617, reader_cost=0.0002 | ETA 02:34:25 2020-11-14 03:28:39 [INFO] [TRAIN] epoch=31, iter=19940/40000, loss=0.2690, lr=0.005378, batch_cost=0.5013, reader_cost=0.0002 | ETA 02:47:36 2020-11-14 03:28:44 [INFO] [TRAIN] epoch=31, iter=19950/40000, loss=0.2897, lr=0.005376, batch_cost=0.4730, reader_cost=0.0002 | ETA 02:38:03 2020-11-14 03:28:48 [INFO] [TRAIN] epoch=31, iter=19960/40000, loss=0.1969, lr=0.005373, batch_cost=0.4814, reader_cost=0.0002 | ETA 02:40:47 2020-11-14 03:28:53 [INFO] [TRAIN] epoch=31, iter=19970/40000, loss=0.3348, lr=0.005371, batch_cost=0.4372, reader_cost=0.0002 | ETA 02:25:56 2020-11-14 03:28:57 [INFO] [TRAIN] epoch=31, iter=19980/40000, loss=0.2152, lr=0.005369, batch_cost=0.4466, reader_cost=0.0002 | ETA 02:29:00 2020-11-14 03:29:02 [INFO] [TRAIN] epoch=31, iter=19990/40000, loss=0.3029, lr=0.005366, batch_cost=0.4590, reader_cost=0.0002 | ETA 02:33:03 2020-11-14 03:29:06 [INFO] [TRAIN] epoch=31, iter=20000/40000, loss=0.2810, lr=0.005364, batch_cost=0.4390, reader_cost=0.0002 | ETA 02:26:19 2020-11-14 03:29:06 [INFO] Start evaluating (total_samples=1449, total_iters=363)... 2020-11-14 03:29:26 [INFO] [EVAL] #Images=1449 mIoU=0.7890 Acc=0.9521 Kappa=0.8954 2020-11-14 03:29:26 [INFO] [EVAL] Class IoU: [0.9468 0.8832 0.3988 0.8515 0.7315 0.8185 0.9498 0.8538 0.926 0.4595 0.9043 0.6245 0.8736 0.9026 0.8201 0.8623 0.6907 0.8513 0.5639 0.9042 0.7522] 2020-11-14 03:29:26 [INFO] [EVAL] Class Acc: [0.9736 0.9195 0.4419 0.899 0.8469 0.8839 0.977 0.9064 0.9442 0.611 0.969 0.8701 0.9283 0.9577 0.8852 0.9202 0.8154 0.9434 0.7456 0.957 0.9017] 2020-11-14 03:29:35 [INFO] [EVAL] The model with the best validation mIoU (0.7890) was saved at iter 20000. 2020-11-14 03:29:39 [INFO] [TRAIN] epoch=31, iter=20010/40000, loss=0.3173, lr=0.005361, batch_cost=0.4340, reader_cost=0.0006 | ETA 02:24:36 2020-11-14 03:29:43 [INFO] [TRAIN] epoch=31, iter=20020/40000, loss=0.2727, lr=0.005359, batch_cost=0.4255, reader_cost=0.0005 | ETA 02:21:41 2020-11-14 03:29:48 [INFO] [TRAIN] epoch=31, iter=20030/40000, loss=0.3157, lr=0.005357, batch_cost=0.4243, reader_cost=0.0005 | ETA 02:21:13 2020-11-14 03:29:52 [INFO] [TRAIN] epoch=31, iter=20040/40000, loss=0.2454, lr=0.005354, batch_cost=0.4648, reader_cost=0.0002 | ETA 02:34:37 2020-11-14 03:29:57 [INFO] [TRAIN] epoch=31, iter=20050/40000, loss=0.3004, lr=0.005352, batch_cost=0.4483, reader_cost=0.0002 | ETA 02:29:04 2020-11-14 03:30:01 [INFO] [TRAIN] epoch=31, iter=20060/40000, loss=0.2665, lr=0.005349, batch_cost=0.4416, reader_cost=0.0002 | ETA 02:26:45 2020-11-14 03:30:06 [INFO] [TRAIN] epoch=31, iter=20070/40000, loss=0.2229, lr=0.005347, batch_cost=0.4467, reader_cost=0.0002 | ETA 02:28:22 2020-11-14 03:30:10 [INFO] [TRAIN] epoch=31, iter=20080/40000, loss=0.2578, lr=0.005344, batch_cost=0.4497, reader_cost=0.0012 | ETA 02:29:17 2020-11-14 03:30:14 [INFO] [TRAIN] epoch=31, iter=20090/40000, loss=0.2732, lr=0.005342, batch_cost=0.4271, reader_cost=0.0002 | ETA 02:21:42 2020-11-14 03:30:19 [INFO] [TRAIN] epoch=31, iter=20100/40000, loss=0.3735, lr=0.005340, batch_cost=0.4255, reader_cost=0.0002 | ETA 02:21:07 2020-11-14 03:30:23 [INFO] [TRAIN] epoch=31, iter=20110/40000, loss=0.2924, lr=0.005337, batch_cost=0.4238, reader_cost=0.0002 | ETA 02:20:28 2020-11-14 03:30:27 [INFO] [TRAIN] epoch=31, iter=20120/40000, loss=0.2538, lr=0.005335, batch_cost=0.4241, reader_cost=0.0001 | ETA 02:20:31 2020-11-14 03:30:31 [INFO] [TRAIN] epoch=31, iter=20130/40000, loss=0.3990, lr=0.005332, batch_cost=0.4241, reader_cost=0.0002 | ETA 02:20:26 2020-11-14 03:30:36 [INFO] [TRAIN] epoch=31, iter=20140/40000, loss=0.3321, lr=0.005330, batch_cost=0.4251, reader_cost=0.0002 | ETA 02:20:41 2020-11-14 03:30:40 [INFO] [TRAIN] epoch=31, iter=20150/40000, loss=0.2799, lr=0.005328, batch_cost=0.4261, reader_cost=0.0002 | ETA 02:20:57 2020-11-14 03:30:44 [INFO] [TRAIN] epoch=31, iter=20160/40000, loss=0.2612, lr=0.005325, batch_cost=0.4259, reader_cost=0.0002 | ETA 02:20:50 2020-11-14 03:30:49 [INFO] [TRAIN] epoch=31, iter=20170/40000, loss=0.2510, lr=0.005323, batch_cost=0.4330, reader_cost=0.0002 | ETA 02:23:05 2020-11-14 03:30:53 [INFO] [TRAIN] epoch=31, iter=20180/40000, loss=0.3474, lr=0.005320, batch_cost=0.4443, reader_cost=0.0002 | ETA 02:26:45 2020-11-14 03:30:57 [INFO] [TRAIN] epoch=31, iter=20190/40000, loss=0.3048, lr=0.005318, batch_cost=0.4335, reader_cost=0.0002 | ETA 02:23:06 2020-11-14 03:31:02 [INFO] [TRAIN] epoch=31, iter=20200/40000, loss=0.2995, lr=0.005316, batch_cost=0.4782, reader_cost=0.0002 | ETA 02:37:49 2020-11-14 03:31:07 [INFO] [TRAIN] epoch=31, iter=20210/40000, loss=0.2993, lr=0.005313, batch_cost=0.4732, reader_cost=0.0002 | ETA 02:36:05 2020-11-14 03:31:11 [INFO] [TRAIN] epoch=31, iter=20220/40000, loss=0.2299, lr=0.005311, batch_cost=0.4387, reader_cost=0.0002 | ETA 02:24:37 2020-11-14 03:31:16 [INFO] [TRAIN] epoch=31, iter=20230/40000, loss=0.2874, lr=0.005308, batch_cost=0.4396, reader_cost=0.0002 | ETA 02:24:51 2020-11-14 03:31:20 [INFO] [TRAIN] epoch=31, iter=20240/40000, loss=0.2060, lr=0.005306, batch_cost=0.4408, reader_cost=0.0002 | ETA 02:25:10 2020-11-14 03:31:24 [INFO] [TRAIN] epoch=31, iter=20250/40000, loss=0.2463, lr=0.005303, batch_cost=0.4289, reader_cost=0.0002 | ETA 02:21:10 2020-11-14 03:31:29 [INFO] [TRAIN] epoch=31, iter=20260/40000, loss=0.2700, lr=0.005301, batch_cost=0.4336, reader_cost=0.0002 | ETA 02:22:39 2020-11-14 03:31:33 [INFO] [TRAIN] epoch=31, iter=20270/40000, loss=0.2650, lr=0.005299, batch_cost=0.4565, reader_cost=0.0002 | ETA 02:30:06 2020-11-14 03:31:38 [INFO] [TRAIN] epoch=31, iter=20280/40000, loss=0.2731, lr=0.005296, batch_cost=0.4681, reader_cost=0.0002 | ETA 02:33:51 2020-11-14 03:31:42 [INFO] [TRAIN] epoch=31, iter=20290/40000, loss=0.2719, lr=0.005294, batch_cost=0.4470, reader_cost=0.0002 | ETA 02:26:51 2020-11-14 03:31:47 [INFO] [TRAIN] epoch=31, iter=20300/40000, loss=0.2906, lr=0.005291, batch_cost=0.4675, reader_cost=0.0002 | ETA 02:33:30 2020-11-14 03:31:52 [INFO] [TRAIN] epoch=31, iter=20310/40000, loss=0.3398, lr=0.005289, batch_cost=0.4823, reader_cost=0.0002 | ETA 02:38:16 2020-11-14 03:31:56 [INFO] [TRAIN] epoch=31, iter=20320/40000, loss=0.3282, lr=0.005287, batch_cost=0.4435, reader_cost=0.0002 | ETA 02:25:28 2020-11-14 03:32:01 [INFO] [TRAIN] epoch=31, iter=20330/40000, loss=0.2199, lr=0.005284, batch_cost=0.4817, reader_cost=0.0002 | ETA 02:37:54 2020-11-14 03:32:06 [INFO] [TRAIN] epoch=31, iter=20340/40000, loss=0.3095, lr=0.005282, batch_cost=0.5014, reader_cost=0.0002 | ETA 02:44:18 2020-11-14 03:32:11 [INFO] [TRAIN] epoch=31, iter=20350/40000, loss=0.3065, lr=0.005279, batch_cost=0.5196, reader_cost=0.0002 | ETA 02:50:10 2020-11-14 03:32:16 [INFO] [TRAIN] epoch=31, iter=20360/40000, loss=0.3265, lr=0.005277, batch_cost=0.4856, reader_cost=0.0002 | ETA 02:38:57 2020-11-14 03:32:21 [INFO] [TRAIN] epoch=31, iter=20370/40000, loss=0.2123, lr=0.005275, batch_cost=0.4860, reader_cost=0.0002 | ETA 02:38:59 2020-11-14 03:32:26 [INFO] [TRAIN] epoch=31, iter=20380/40000, loss=0.2624, lr=0.005272, batch_cost=0.4517, reader_cost=0.0002 | ETA 02:27:42 2020-11-14 03:32:30 [INFO] [TRAIN] epoch=31, iter=20390/40000, loss=0.2884, lr=0.005270, batch_cost=0.4350, reader_cost=0.0002 | ETA 02:22:10 2020-11-14 03:32:35 [INFO] [TRAIN] epoch=31, iter=20400/40000, loss=0.2775, lr=0.005267, batch_cost=0.4672, reader_cost=0.0002 | ETA 02:32:36 2020-11-14 03:32:39 [INFO] [TRAIN] epoch=31, iter=20410/40000, loss=0.2467, lr=0.005265, batch_cost=0.4528, reader_cost=0.0002 | ETA 02:27:49 2020-11-14 03:32:44 [INFO] [TRAIN] epoch=31, iter=20420/40000, loss=0.4641, lr=0.005262, batch_cost=0.4564, reader_cost=0.0002 | ETA 02:28:55 2020-11-14 03:32:48 [INFO] [TRAIN] epoch=31, iter=20430/40000, loss=0.3635, lr=0.005260, batch_cost=0.4545, reader_cost=0.0002 | ETA 02:28:15 2020-11-14 03:32:53 [INFO] [TRAIN] epoch=31, iter=20440/40000, loss=0.3556, lr=0.005258, batch_cost=0.4688, reader_cost=0.0003 | ETA 02:32:49 2020-11-14 03:32:58 [INFO] [TRAIN] epoch=31, iter=20450/40000, loss=0.1905, lr=0.005255, batch_cost=0.4588, reader_cost=0.0002 | ETA 02:29:30 2020-11-14 03:33:02 [INFO] [TRAIN] epoch=31, iter=20460/40000, loss=0.3442, lr=0.005253, batch_cost=0.4543, reader_cost=0.0002 | ETA 02:27:57 2020-11-14 03:33:07 [INFO] [TRAIN] epoch=31, iter=20470/40000, loss=0.2483, lr=0.005250, batch_cost=0.4423, reader_cost=0.0002 | ETA 02:23:58 2020-11-14 03:33:11 [INFO] [TRAIN] epoch=31, iter=20480/40000, loss=0.2814, lr=0.005248, batch_cost=0.4778, reader_cost=0.0004 | ETA 02:35:26 2020-11-14 03:33:16 [INFO] [TRAIN] epoch=31, iter=20490/40000, loss=0.2241, lr=0.005246, batch_cost=0.4890, reader_cost=0.0017 | ETA 02:39:00 2020-11-14 03:33:22 [INFO] [TRAIN] epoch=32, iter=20500/40000, loss=0.2276, lr=0.005243, batch_cost=0.6162, reader_cost=0.1250 | ETA 03:20:15 2020-11-14 03:33:27 [INFO] [TRAIN] epoch=32, iter=20510/40000, loss=0.1774, lr=0.005241, batch_cost=0.4475, reader_cost=0.0005 | ETA 02:25:21 2020-11-14 03:33:31 [INFO] [TRAIN] epoch=32, iter=20520/40000, loss=0.3151, lr=0.005238, batch_cost=0.4506, reader_cost=0.0002 | ETA 02:26:18 2020-11-14 03:33:36 [INFO] [TRAIN] epoch=32, iter=20530/40000, loss=0.2774, lr=0.005236, batch_cost=0.4830, reader_cost=0.0002 | ETA 02:36:43 2020-11-14 03:33:41 [INFO] [TRAIN] epoch=32, iter=20540/40000, loss=0.2898, lr=0.005233, batch_cost=0.4585, reader_cost=0.0002 | ETA 02:28:43 2020-11-14 03:33:45 [INFO] [TRAIN] epoch=32, iter=20550/40000, loss=0.2810, lr=0.005231, batch_cost=0.4730, reader_cost=0.0002 | ETA 02:33:19 2020-11-14 03:33:50 [INFO] [TRAIN] epoch=32, iter=20560/40000, loss=0.1884, lr=0.005229, batch_cost=0.4654, reader_cost=0.0002 | ETA 02:30:46 2020-11-14 03:33:55 [INFO] [TRAIN] epoch=32, iter=20570/40000, loss=0.3083, lr=0.005226, batch_cost=0.4376, reader_cost=0.0015 | ETA 02:21:41 2020-11-14 03:33:59 [INFO] [TRAIN] epoch=32, iter=20580/40000, loss=0.2301, lr=0.005224, batch_cost=0.4380, reader_cost=0.0014 | ETA 02:21:46 2020-11-14 03:34:03 [INFO] [TRAIN] epoch=32, iter=20590/40000, loss=0.2504, lr=0.005221, batch_cost=0.4388, reader_cost=0.0002 | ETA 02:21:57 2020-11-14 03:34:08 [INFO] [TRAIN] epoch=32, iter=20600/40000, loss=0.2531, lr=0.005219, batch_cost=0.4720, reader_cost=0.0002 | ETA 02:32:37 2020-11-14 03:34:13 [INFO] [TRAIN] epoch=32, iter=20610/40000, loss=0.2689, lr=0.005217, batch_cost=0.4685, reader_cost=0.0002 | ETA 02:31:23 2020-11-14 03:34:17 [INFO] [TRAIN] epoch=32, iter=20620/40000, loss=0.2315, lr=0.005214, batch_cost=0.4360, reader_cost=0.0002 | ETA 02:20:48 2020-11-14 03:34:22 [INFO] [TRAIN] epoch=32, iter=20630/40000, loss=0.2781, lr=0.005212, batch_cost=0.4473, reader_cost=0.0002 | ETA 02:24:24 2020-11-14 03:34:26 [INFO] [TRAIN] epoch=32, iter=20640/40000, loss=0.2405, lr=0.005209, batch_cost=0.4798, reader_cost=0.0002 | ETA 02:34:49 2020-11-14 03:34:31 [INFO] [TRAIN] epoch=32, iter=20650/40000, loss=0.2737, lr=0.005207, batch_cost=0.4852, reader_cost=0.0002 | ETA 02:36:28 2020-11-14 03:34:36 [INFO] [TRAIN] epoch=32, iter=20660/40000, loss=0.3293, lr=0.005204, batch_cost=0.4409, reader_cost=0.0002 | ETA 02:22:07 2020-11-14 03:34:40 [INFO] [TRAIN] epoch=32, iter=20670/40000, loss=0.2395, lr=0.005202, batch_cost=0.4460, reader_cost=0.0002 | ETA 02:23:40 2020-11-14 03:34:45 [INFO] [TRAIN] epoch=32, iter=20680/40000, loss=0.2828, lr=0.005200, batch_cost=0.4599, reader_cost=0.0002 | ETA 02:28:05 2020-11-14 03:34:49 [INFO] [TRAIN] epoch=32, iter=20690/40000, loss=0.3763, lr=0.005197, batch_cost=0.4739, reader_cost=0.0002 | ETA 02:32:30 2020-11-14 03:34:54 [INFO] [TRAIN] epoch=32, iter=20700/40000, loss=0.2644, lr=0.005195, batch_cost=0.4471, reader_cost=0.0002 | ETA 02:23:49 2020-11-14 03:34:58 [INFO] [TRAIN] epoch=32, iter=20710/40000, loss=0.2715, lr=0.005192, batch_cost=0.4353, reader_cost=0.0002 | ETA 02:19:57 2020-11-14 03:35:03 [INFO] [TRAIN] epoch=32, iter=20720/40000, loss=0.2645, lr=0.005190, batch_cost=0.4326, reader_cost=0.0002 | ETA 02:18:59 2020-11-14 03:35:07 [INFO] [TRAIN] epoch=32, iter=20730/40000, loss=0.2806, lr=0.005188, batch_cost=0.4379, reader_cost=0.0002 | ETA 02:20:38 2020-11-14 03:35:11 [INFO] [TRAIN] epoch=32, iter=20740/40000, loss=0.3316, lr=0.005185, batch_cost=0.4346, reader_cost=0.0002 | ETA 02:19:31 2020-11-14 03:35:16 [INFO] [TRAIN] epoch=32, iter=20750/40000, loss=0.3092, lr=0.005183, batch_cost=0.4376, reader_cost=0.0002 | ETA 02:20:23 2020-11-14 03:35:20 [INFO] [TRAIN] epoch=32, iter=20760/40000, loss=0.2169, lr=0.005180, batch_cost=0.4678, reader_cost=0.0002 | ETA 02:30:00 2020-11-14 03:35:25 [INFO] [TRAIN] epoch=32, iter=20770/40000, loss=0.3169, lr=0.005178, batch_cost=0.4595, reader_cost=0.0002 | ETA 02:27:16 2020-11-14 03:35:30 [INFO] [TRAIN] epoch=32, iter=20780/40000, loss=0.2193, lr=0.005175, batch_cost=0.4988, reader_cost=0.0002 | ETA 02:39:47 2020-11-14 03:35:35 [INFO] [TRAIN] epoch=32, iter=20790/40000, loss=0.2909, lr=0.005173, batch_cost=0.4710, reader_cost=0.0002 | ETA 02:30:48 2020-11-14 03:35:39 [INFO] [TRAIN] epoch=32, iter=20800/40000, loss=0.3388, lr=0.005171, batch_cost=0.4586, reader_cost=0.0002 | ETA 02:26:45 2020-11-14 03:35:44 [INFO] [TRAIN] epoch=32, iter=20810/40000, loss=0.3163, lr=0.005168, batch_cost=0.4592, reader_cost=0.0002 | ETA 02:26:52 2020-11-14 03:35:48 [INFO] [TRAIN] epoch=32, iter=20820/40000, loss=0.2397, lr=0.005166, batch_cost=0.4500, reader_cost=0.0002 | ETA 02:23:50 2020-11-14 03:35:53 [INFO] [TRAIN] epoch=32, iter=20830/40000, loss=0.2406, lr=0.005163, batch_cost=0.4403, reader_cost=0.0002 | ETA 02:20:41 2020-11-14 03:35:57 [INFO] [TRAIN] epoch=32, iter=20840/40000, loss=0.2835, lr=0.005161, batch_cost=0.4425, reader_cost=0.0002 | ETA 02:21:19 2020-11-14 03:36:02 [INFO] [TRAIN] epoch=32, iter=20850/40000, loss=0.2265, lr=0.005159, batch_cost=0.4571, reader_cost=0.0002 | ETA 02:25:53 2020-11-14 03:36:06 [INFO] [TRAIN] epoch=32, iter=20860/40000, loss=0.2610, lr=0.005156, batch_cost=0.4466, reader_cost=0.0002 | ETA 02:22:27 2020-11-14 03:36:10 [INFO] [TRAIN] epoch=32, iter=20870/40000, loss=0.2659, lr=0.005154, batch_cost=0.4318, reader_cost=0.0002 | ETA 02:17:40 2020-11-14 03:36:15 [INFO] [TRAIN] epoch=32, iter=20880/40000, loss=0.2226, lr=0.005151, batch_cost=0.4278, reader_cost=0.0002 | ETA 02:16:20 2020-11-14 03:36:19 [INFO] [TRAIN] epoch=32, iter=20890/40000, loss=0.3430, lr=0.005149, batch_cost=0.4273, reader_cost=0.0002 | ETA 02:16:04 2020-11-14 03:36:23 [INFO] [TRAIN] epoch=32, iter=20900/40000, loss=0.2462, lr=0.005146, batch_cost=0.4277, reader_cost=0.0002 | ETA 02:16:08 2020-11-14 03:36:28 [INFO] [TRAIN] epoch=32, iter=20910/40000, loss=0.2448, lr=0.005144, batch_cost=0.4322, reader_cost=0.0002 | ETA 02:17:31 2020-11-14 03:36:32 [INFO] [TRAIN] epoch=32, iter=20920/40000, loss=0.2590, lr=0.005142, batch_cost=0.4537, reader_cost=0.0002 | ETA 02:24:17 2020-11-14 03:36:36 [INFO] [TRAIN] epoch=32, iter=20930/40000, loss=0.2393, lr=0.005139, batch_cost=0.4332, reader_cost=0.0002 | ETA 02:17:40 2020-11-14 03:36:41 [INFO] [TRAIN] epoch=32, iter=20940/40000, loss=0.2928, lr=0.005137, batch_cost=0.4529, reader_cost=0.0002 | ETA 02:23:51 2020-11-14 03:36:46 [INFO] [TRAIN] epoch=32, iter=20950/40000, loss=0.3252, lr=0.005134, batch_cost=0.4622, reader_cost=0.0002 | ETA 02:26:45 2020-11-14 03:36:50 [INFO] [TRAIN] epoch=32, iter=20960/40000, loss=0.2408, lr=0.005132, batch_cost=0.4667, reader_cost=0.0002 | ETA 02:28:05 2020-11-14 03:36:55 [INFO] [TRAIN] epoch=32, iter=20970/40000, loss=0.2798, lr=0.005129, batch_cost=0.4338, reader_cost=0.0002 | ETA 02:17:35 2020-11-14 03:36:59 [INFO] [TRAIN] epoch=32, iter=20980/40000, loss=0.3289, lr=0.005127, batch_cost=0.4337, reader_cost=0.0002 | ETA 02:17:29 2020-11-14 03:37:03 [INFO] [TRAIN] epoch=32, iter=20990/40000, loss=0.2069, lr=0.005125, batch_cost=0.4350, reader_cost=0.0002 | ETA 02:17:49 2020-11-14 03:37:08 [INFO] [TRAIN] epoch=32, iter=21000/40000, loss=0.2374, lr=0.005122, batch_cost=0.4379, reader_cost=0.0002 | ETA 02:18:40 2020-11-14 03:37:12 [INFO] [TRAIN] epoch=32, iter=21010/40000, loss=0.2260, lr=0.005120, batch_cost=0.4592, reader_cost=0.0002 | ETA 02:25:20 2020-11-14 03:37:17 [INFO] [TRAIN] epoch=32, iter=21020/40000, loss=0.2898, lr=0.005117, batch_cost=0.4478, reader_cost=0.0002 | ETA 02:21:39 2020-11-14 03:37:21 [INFO] [TRAIN] epoch=32, iter=21030/40000, loss=0.2229, lr=0.005115, batch_cost=0.4351, reader_cost=0.0002 | ETA 02:17:34 2020-11-14 03:37:25 [INFO] [TRAIN] epoch=32, iter=21040/40000, loss=0.2510, lr=0.005113, batch_cost=0.4325, reader_cost=0.0002 | ETA 02:16:39 2020-11-14 03:37:30 [INFO] [TRAIN] epoch=32, iter=21050/40000, loss=0.3455, lr=0.005110, batch_cost=0.4312, reader_cost=0.0002 | ETA 02:16:11 2020-11-14 03:37:34 [INFO] [TRAIN] epoch=32, iter=21060/40000, loss=0.2649, lr=0.005108, batch_cost=0.4342, reader_cost=0.0002 | ETA 02:17:03 2020-11-14 03:37:38 [INFO] [TRAIN] epoch=32, iter=21070/40000, loss=0.3789, lr=0.005105, batch_cost=0.4324, reader_cost=0.0002 | ETA 02:16:25 2020-11-14 03:37:43 [INFO] [TRAIN] epoch=32, iter=21080/40000, loss=0.3086, lr=0.005103, batch_cost=0.4557, reader_cost=0.0002 | ETA 02:23:41 2020-11-14 03:37:48 [INFO] [TRAIN] epoch=32, iter=21090/40000, loss=0.2165, lr=0.005100, batch_cost=0.4594, reader_cost=0.0002 | ETA 02:24:48 2020-11-14 03:37:52 [INFO] [TRAIN] epoch=32, iter=21100/40000, loss=0.2885, lr=0.005098, batch_cost=0.4401, reader_cost=0.0002 | ETA 02:18:37 2020-11-14 03:37:56 [INFO] [TRAIN] epoch=32, iter=21110/40000, loss=0.4205, lr=0.005096, batch_cost=0.4317, reader_cost=0.0002 | ETA 02:15:54 2020-11-14 03:38:01 [INFO] [TRAIN] epoch=32, iter=21120/40000, loss=0.5470, lr=0.005093, batch_cost=0.4374, reader_cost=0.0002 | ETA 02:17:38 2020-11-14 03:38:05 [INFO] [TRAIN] epoch=32, iter=21130/40000, loss=0.2847, lr=0.005091, batch_cost=0.4488, reader_cost=0.0002 | ETA 02:21:09 2020-11-14 03:38:10 [INFO] [TRAIN] epoch=32, iter=21140/40000, loss=0.3353, lr=0.005088, batch_cost=0.4530, reader_cost=0.0002 | ETA 02:22:23 2020-11-14 03:38:14 [INFO] [TRAIN] epoch=32, iter=21150/40000, loss=0.2275, lr=0.005086, batch_cost=0.4328, reader_cost=0.0002 | ETA 02:15:58 2020-11-14 03:38:20 [INFO] [TRAIN] epoch=33, iter=21160/40000, loss=0.3712, lr=0.005083, batch_cost=0.5727, reader_cost=0.0892 | ETA 02:59:49 2020-11-14 03:38:25 [INFO] [TRAIN] epoch=33, iter=21170/40000, loss=0.3694, lr=0.005081, batch_cost=0.4904, reader_cost=0.0005 | ETA 02:33:53 2020-11-14 03:38:30 [INFO] [TRAIN] epoch=33, iter=21180/40000, loss=0.2148, lr=0.005079, batch_cost=0.5079, reader_cost=0.0002 | ETA 02:39:17 2020-11-14 03:38:34 [INFO] [TRAIN] epoch=33, iter=21190/40000, loss=0.2037, lr=0.005076, batch_cost=0.4698, reader_cost=0.0002 | ETA 02:27:17 2020-11-14 03:38:39 [INFO] [TRAIN] epoch=33, iter=21200/40000, loss=0.3186, lr=0.005074, batch_cost=0.4657, reader_cost=0.0002 | ETA 02:25:55 2020-11-14 03:38:44 [INFO] [TRAIN] epoch=33, iter=21210/40000, loss=0.3072, lr=0.005071, batch_cost=0.4653, reader_cost=0.0002 | ETA 02:25:43 2020-11-14 03:38:48 [INFO] [TRAIN] epoch=33, iter=21220/40000, loss=0.3073, lr=0.005069, batch_cost=0.4697, reader_cost=0.0002 | ETA 02:27:01 2020-11-14 03:38:53 [INFO] [TRAIN] epoch=33, iter=21230/40000, loss=0.2193, lr=0.005067, batch_cost=0.4374, reader_cost=0.0002 | ETA 02:16:49 2020-11-14 03:38:57 [INFO] [TRAIN] epoch=33, iter=21240/40000, loss=0.2442, lr=0.005064, batch_cost=0.4365, reader_cost=0.0002 | ETA 02:16:28 2020-11-14 03:39:02 [INFO] [TRAIN] epoch=33, iter=21250/40000, loss=0.2796, lr=0.005062, batch_cost=0.4388, reader_cost=0.0002 | ETA 02:17:07 2020-11-14 03:39:06 [INFO] [TRAIN] epoch=33, iter=21260/40000, loss=0.2804, lr=0.005059, batch_cost=0.4369, reader_cost=0.0002 | ETA 02:16:27 2020-11-14 03:39:10 [INFO] [TRAIN] epoch=33, iter=21270/40000, loss=0.3075, lr=0.005057, batch_cost=0.4412, reader_cost=0.0002 | ETA 02:17:44 2020-11-14 03:39:15 [INFO] [TRAIN] epoch=33, iter=21280/40000, loss=0.4468, lr=0.005054, batch_cost=0.4365, reader_cost=0.0002 | ETA 02:16:12 2020-11-14 03:39:19 [INFO] [TRAIN] epoch=33, iter=21290/40000, loss=0.3825, lr=0.005052, batch_cost=0.4337, reader_cost=0.0002 | ETA 02:15:13 2020-11-14 03:39:23 [INFO] [TRAIN] epoch=33, iter=21300/40000, loss=0.3038, lr=0.005050, batch_cost=0.4403, reader_cost=0.0002 | ETA 02:17:13 2020-11-14 03:39:28 [INFO] [TRAIN] epoch=33, iter=21310/40000, loss=0.2771, lr=0.005047, batch_cost=0.4629, reader_cost=0.0002 | ETA 02:24:11 2020-11-14 03:39:33 [INFO] [TRAIN] epoch=33, iter=21320/40000, loss=0.2520, lr=0.005045, batch_cost=0.4630, reader_cost=0.0002 | ETA 02:24:09 2020-11-14 03:39:37 [INFO] [TRAIN] epoch=33, iter=21330/40000, loss=0.3229, lr=0.005042, batch_cost=0.4572, reader_cost=0.0002 | ETA 02:22:16 2020-11-14 03:39:42 [INFO] [TRAIN] epoch=33, iter=21340/40000, loss=0.3213, lr=0.005040, batch_cost=0.4350, reader_cost=0.0002 | ETA 02:15:17 2020-11-14 03:39:46 [INFO] [TRAIN] epoch=33, iter=21350/40000, loss=0.2317, lr=0.005037, batch_cost=0.4380, reader_cost=0.0002 | ETA 02:16:09 2020-11-14 03:39:50 [INFO] [TRAIN] epoch=33, iter=21360/40000, loss=0.3679, lr=0.005035, batch_cost=0.4383, reader_cost=0.0002 | ETA 02:16:10 2020-11-14 03:39:55 [INFO] [TRAIN] epoch=33, iter=21370/40000, loss=0.2551, lr=0.005033, batch_cost=0.4526, reader_cost=0.0002 | ETA 02:20:31 2020-11-14 03:39:59 [INFO] [TRAIN] epoch=33, iter=21380/40000, loss=0.3363, lr=0.005030, batch_cost=0.4422, reader_cost=0.0002 | ETA 02:17:14 2020-11-14 03:40:04 [INFO] [TRAIN] epoch=33, iter=21390/40000, loss=0.2582, lr=0.005028, batch_cost=0.4414, reader_cost=0.0002 | ETA 02:16:54 2020-11-14 03:40:09 [INFO] [TRAIN] epoch=33, iter=21400/40000, loss=0.2530, lr=0.005025, batch_cost=0.5161, reader_cost=0.0002 | ETA 02:39:59 2020-11-14 03:40:13 [INFO] [TRAIN] epoch=33, iter=21410/40000, loss=0.2924, lr=0.005023, batch_cost=0.4325, reader_cost=0.0002 | ETA 02:14:00 2020-11-14 03:40:18 [INFO] [TRAIN] epoch=33, iter=21420/40000, loss=0.2549, lr=0.005020, batch_cost=0.4393, reader_cost=0.0002 | ETA 02:16:02 2020-11-14 03:40:22 [INFO] [TRAIN] epoch=33, iter=21430/40000, loss=0.3109, lr=0.005018, batch_cost=0.4379, reader_cost=0.0002 | ETA 02:15:30 2020-11-14 03:40:26 [INFO] [TRAIN] epoch=33, iter=21440/40000, loss=0.2470, lr=0.005016, batch_cost=0.4405, reader_cost=0.0002 | ETA 02:16:14 2020-11-14 03:40:31 [INFO] [TRAIN] epoch=33, iter=21450/40000, loss=0.3418, lr=0.005013, batch_cost=0.4376, reader_cost=0.0002 | ETA 02:15:17 2020-11-14 03:40:35 [INFO] [TRAIN] epoch=33, iter=21460/40000, loss=0.3237, lr=0.005011, batch_cost=0.4278, reader_cost=0.0002 | ETA 02:12:12 2020-11-14 03:40:39 [INFO] [TRAIN] epoch=33, iter=21470/40000, loss=0.3617, lr=0.005008, batch_cost=0.4363, reader_cost=0.0002 | ETA 02:14:44 2020-11-14 03:40:44 [INFO] [TRAIN] epoch=33, iter=21480/40000, loss=0.2289, lr=0.005006, batch_cost=0.4493, reader_cost=0.0002 | ETA 02:18:41 2020-11-14 03:40:48 [INFO] [TRAIN] epoch=33, iter=21490/40000, loss=0.2130, lr=0.005003, batch_cost=0.4410, reader_cost=0.0002 | ETA 02:16:02 2020-11-14 03:40:53 [INFO] [TRAIN] epoch=33, iter=21500/40000, loss=0.2459, lr=0.005001, batch_cost=0.4397, reader_cost=0.0002 | ETA 02:15:34 2020-11-14 03:40:57 [INFO] [TRAIN] epoch=33, iter=21510/40000, loss=0.2345, lr=0.004999, batch_cost=0.4485, reader_cost=0.0002 | ETA 02:18:13 2020-11-14 03:41:02 [INFO] [TRAIN] epoch=33, iter=21520/40000, loss=0.2470, lr=0.004996, batch_cost=0.4395, reader_cost=0.0002 | ETA 02:15:22 2020-11-14 03:41:06 [INFO] [TRAIN] epoch=33, iter=21530/40000, loss=0.3222, lr=0.004994, batch_cost=0.4367, reader_cost=0.0002 | ETA 02:14:26 2020-11-14 03:41:10 [INFO] [TRAIN] epoch=33, iter=21540/40000, loss=0.2481, lr=0.004991, batch_cost=0.4338, reader_cost=0.0002 | ETA 02:13:28 2020-11-14 03:41:15 [INFO] [TRAIN] epoch=33, iter=21550/40000, loss=0.2507, lr=0.004989, batch_cost=0.4536, reader_cost=0.0002 | ETA 02:19:28 2020-11-14 03:41:19 [INFO] [TRAIN] epoch=33, iter=21560/40000, loss=0.2024, lr=0.004986, batch_cost=0.4375, reader_cost=0.0002 | ETA 02:14:27 2020-11-14 03:41:24 [INFO] [TRAIN] epoch=33, iter=21570/40000, loss=0.3298, lr=0.004984, batch_cost=0.4408, reader_cost=0.0002 | ETA 02:15:23 2020-11-14 03:41:28 [INFO] [TRAIN] epoch=33, iter=21580/40000, loss=0.2429, lr=0.004982, batch_cost=0.4398, reader_cost=0.0002 | ETA 02:15:01 2020-11-14 03:41:32 [INFO] [TRAIN] epoch=33, iter=21590/40000, loss=0.2877, lr=0.004979, batch_cost=0.4403, reader_cost=0.0002 | ETA 02:15:06 2020-11-14 03:41:37 [INFO] [TRAIN] epoch=33, iter=21600/40000, loss=0.2405, lr=0.004977, batch_cost=0.4393, reader_cost=0.0002 | ETA 02:14:42 2020-11-14 03:41:41 [INFO] [TRAIN] epoch=33, iter=21610/40000, loss=0.2433, lr=0.004974, batch_cost=0.4325, reader_cost=0.0002 | ETA 02:12:33 2020-11-14 03:41:46 [INFO] [TRAIN] epoch=33, iter=21620/40000, loss=0.2492, lr=0.004972, batch_cost=0.4292, reader_cost=0.0002 | ETA 02:11:29 2020-11-14 03:41:50 [INFO] [TRAIN] epoch=33, iter=21630/40000, loss=0.3450, lr=0.004969, batch_cost=0.4284, reader_cost=0.0002 | ETA 02:11:09 2020-11-14 03:41:54 [INFO] [TRAIN] epoch=33, iter=21640/40000, loss=0.2234, lr=0.004967, batch_cost=0.4302, reader_cost=0.0002 | ETA 02:11:39 2020-11-14 03:41:58 [INFO] [TRAIN] epoch=33, iter=21650/40000, loss=0.2134, lr=0.004965, batch_cost=0.4294, reader_cost=0.0002 | ETA 02:11:19 2020-11-14 03:42:03 [INFO] [TRAIN] epoch=33, iter=21660/40000, loss=0.3937, lr=0.004962, batch_cost=0.4496, reader_cost=0.0002 | ETA 02:17:26 2020-11-14 03:42:08 [INFO] [TRAIN] epoch=33, iter=21670/40000, loss=0.2511, lr=0.004960, batch_cost=0.4898, reader_cost=0.0002 | ETA 02:29:38 2020-11-14 03:42:13 [INFO] [TRAIN] epoch=33, iter=21680/40000, loss=0.2762, lr=0.004957, batch_cost=0.4868, reader_cost=0.0003 | ETA 02:28:37 2020-11-14 03:42:17 [INFO] [TRAIN] epoch=33, iter=21690/40000, loss=0.2897, lr=0.004955, batch_cost=0.4431, reader_cost=0.0003 | ETA 02:15:12 2020-11-14 03:42:22 [INFO] [TRAIN] epoch=33, iter=21700/40000, loss=0.2645, lr=0.004952, batch_cost=0.5020, reader_cost=0.0010 | ETA 02:33:05 2020-11-14 03:42:27 [INFO] [TRAIN] epoch=33, iter=21710/40000, loss=0.2535, lr=0.004950, batch_cost=0.4587, reader_cost=0.0015 | ETA 02:19:50 2020-11-14 03:42:31 [INFO] [TRAIN] epoch=33, iter=21720/40000, loss=0.2326, lr=0.004948, batch_cost=0.4428, reader_cost=0.0003 | ETA 02:14:53 2020-11-14 03:42:36 [INFO] [TRAIN] epoch=33, iter=21730/40000, loss=0.2003, lr=0.004945, batch_cost=0.4403, reader_cost=0.0003 | ETA 02:14:04 2020-11-14 03:42:40 [INFO] [TRAIN] epoch=33, iter=21740/40000, loss=0.3598, lr=0.004943, batch_cost=0.4537, reader_cost=0.0002 | ETA 02:18:05 2020-11-14 03:42:45 [INFO] [TRAIN] epoch=33, iter=21750/40000, loss=0.3002, lr=0.004940, batch_cost=0.4554, reader_cost=0.0002 | ETA 02:18:30 2020-11-14 03:42:50 [INFO] [TRAIN] epoch=33, iter=21760/40000, loss=0.3337, lr=0.004938, batch_cost=0.4920, reader_cost=0.0011 | ETA 02:29:33 2020-11-14 03:42:54 [INFO] [TRAIN] epoch=33, iter=21770/40000, loss=0.3171, lr=0.004935, batch_cost=0.4792, reader_cost=0.0002 | ETA 02:25:36 2020-11-14 03:42:59 [INFO] [TRAIN] epoch=33, iter=21780/40000, loss=0.2490, lr=0.004933, batch_cost=0.4650, reader_cost=0.0023 | ETA 02:21:11 2020-11-14 03:43:04 [INFO] [TRAIN] epoch=33, iter=21790/40000, loss=0.2539, lr=0.004931, batch_cost=0.4597, reader_cost=0.0002 | ETA 02:19:32 2020-11-14 03:43:08 [INFO] [TRAIN] epoch=33, iter=21800/40000, loss=0.2952, lr=0.004928, batch_cost=0.4669, reader_cost=0.0012 | ETA 02:21:37 2020-11-14 03:43:13 [INFO] [TRAIN] epoch=33, iter=21810/40000, loss=0.2488, lr=0.004926, batch_cost=0.4429, reader_cost=0.0053 | ETA 02:14:16 2020-11-14 03:43:18 [INFO] [TRAIN] epoch=34, iter=21820/40000, loss=0.3170, lr=0.004923, batch_cost=0.5670, reader_cost=0.0836 | ETA 02:51:48 2020-11-14 03:43:23 [INFO] [TRAIN] epoch=34, iter=21830/40000, loss=0.2767, lr=0.004921, batch_cost=0.4413, reader_cost=0.0006 | ETA 02:13:38 2020-11-14 03:43:27 [INFO] [TRAIN] epoch=34, iter=21840/40000, loss=0.2278, lr=0.004918, batch_cost=0.4529, reader_cost=0.0003 | ETA 02:17:04 2020-11-14 03:43:32 [INFO] [TRAIN] epoch=34, iter=21850/40000, loss=0.2341, lr=0.004916, batch_cost=0.4874, reader_cost=0.0029 | ETA 02:27:26 2020-11-14 03:43:37 [INFO] [TRAIN] epoch=34, iter=21860/40000, loss=0.2710, lr=0.004914, batch_cost=0.4674, reader_cost=0.0005 | ETA 02:21:19 2020-11-14 03:43:41 [INFO] [TRAIN] epoch=34, iter=21870/40000, loss=0.2428, lr=0.004911, batch_cost=0.4382, reader_cost=0.0002 | ETA 02:12:25 2020-11-14 03:43:46 [INFO] [TRAIN] epoch=34, iter=21880/40000, loss=0.3892, lr=0.004909, batch_cost=0.4477, reader_cost=0.0002 | ETA 02:15:12 2020-11-14 03:43:50 [INFO] [TRAIN] epoch=34, iter=21890/40000, loss=0.2824, lr=0.004906, batch_cost=0.4519, reader_cost=0.0002 | ETA 02:16:23 2020-11-14 03:43:55 [INFO] [TRAIN] epoch=34, iter=21900/40000, loss=0.2629, lr=0.004904, batch_cost=0.4469, reader_cost=0.0002 | ETA 02:14:49 2020-11-14 03:43:59 [INFO] [TRAIN] epoch=34, iter=21910/40000, loss=0.2372, lr=0.004901, batch_cost=0.4423, reader_cost=0.0002 | ETA 02:13:20 2020-11-14 03:44:04 [INFO] [TRAIN] epoch=34, iter=21920/40000, loss=0.2777, lr=0.004899, batch_cost=0.4403, reader_cost=0.0002 | ETA 02:12:40 2020-11-14 03:44:08 [INFO] [TRAIN] epoch=34, iter=21930/40000, loss=0.3001, lr=0.004896, batch_cost=0.4725, reader_cost=0.0002 | ETA 02:22:17 2020-11-14 03:44:13 [INFO] [TRAIN] epoch=34, iter=21940/40000, loss=0.2812, lr=0.004894, batch_cost=0.4493, reader_cost=0.0002 | ETA 02:15:15 2020-11-14 03:44:17 [INFO] [TRAIN] epoch=34, iter=21950/40000, loss=0.2512, lr=0.004892, batch_cost=0.4389, reader_cost=0.0002 | ETA 02:12:02 2020-11-14 03:44:22 [INFO] [TRAIN] epoch=34, iter=21960/40000, loss=0.2315, lr=0.004889, batch_cost=0.4471, reader_cost=0.0003 | ETA 02:14:25 2020-11-14 03:44:26 [INFO] [TRAIN] epoch=34, iter=21970/40000, loss=0.2505, lr=0.004887, batch_cost=0.4414, reader_cost=0.0002 | ETA 02:12:39 2020-11-14 03:44:31 [INFO] [TRAIN] epoch=34, iter=21980/40000, loss=0.2969, lr=0.004884, batch_cost=0.4469, reader_cost=0.0002 | ETA 02:14:12 2020-11-14 03:44:35 [INFO] [TRAIN] epoch=34, iter=21990/40000, loss=0.2664, lr=0.004882, batch_cost=0.4588, reader_cost=0.0002 | ETA 02:17:43 2020-11-14 03:44:40 [INFO] [TRAIN] epoch=34, iter=22000/40000, loss=0.3293, lr=0.004879, batch_cost=0.4398, reader_cost=0.0002 | ETA 02:11:55 2020-11-14 03:44:40 [INFO] Start evaluating (total_samples=1449, total_iters=363)... 2020-11-14 03:45:07 [INFO] [EVAL] #Images=1449 mIoU=0.7933 Acc=0.9540 Kappa=0.8989 2020-11-14 03:45:07 [INFO] [EVAL] Class IoU: [0.948 0.9186 0.4432 0.8866 0.7121 0.8076 0.9488 0.8791 0.9426 0.4517 0.8736 0.6055 0.9132 0.8849 0.8834 0.8672 0.617 0.8421 0.5685 0.9146 0.7506] 2020-11-14 03:45:07 [INFO] [EVAL] Class Acc: [0.9716 0.9581 0.4631 0.9378 0.7935 0.8758 0.9662 0.9545 0.9644 0.626 0.905 0.9073 0.9649 0.9377 0.9184 0.9372 0.8725 0.9459 0.7479 0.9444 0.925 ] 2020-11-14 03:45:14 [INFO] [EVAL] The model with the best validation mIoU (0.7933) was saved at iter 22000. 2020-11-14 03:45:19 [INFO] [TRAIN] epoch=34, iter=22010/40000, loss=0.2326, lr=0.004877, batch_cost=0.4921, reader_cost=0.0004 | ETA 02:27:32 2020-11-14 03:45:24 [INFO] [TRAIN] epoch=34, iter=22020/40000, loss=0.1963, lr=0.004875, batch_cost=0.5147, reader_cost=0.0002 | ETA 02:34:14 2020-11-14 03:45:29 [INFO] [TRAIN] epoch=34, iter=22030/40000, loss=0.3832, lr=0.004872, batch_cost=0.4847, reader_cost=0.0002 | ETA 02:25:09 2020-11-14 03:45:34 [INFO] [TRAIN] epoch=34, iter=22040/40000, loss=0.1979, lr=0.004870, batch_cost=0.4915, reader_cost=0.0005 | ETA 02:27:06 2020-11-14 03:45:39 [INFO] [TRAIN] epoch=34, iter=22050/40000, loss=0.1729, lr=0.004867, batch_cost=0.5053, reader_cost=0.0013 | ETA 02:31:10 2020-11-14 03:45:44 [INFO] [TRAIN] epoch=34, iter=22060/40000, loss=0.2663, lr=0.004865, batch_cost=0.5030, reader_cost=0.0002 | ETA 02:30:23 2020-11-14 03:45:49 [INFO] [TRAIN] epoch=34, iter=22070/40000, loss=0.2613, lr=0.004862, batch_cost=0.4872, reader_cost=0.0002 | ETA 02:25:36 2020-11-14 03:45:54 [INFO] [TRAIN] epoch=34, iter=22080/40000, loss=0.2298, lr=0.004860, batch_cost=0.4807, reader_cost=0.0012 | ETA 02:23:34 2020-11-14 03:45:59 [INFO] [TRAIN] epoch=34, iter=22090/40000, loss=0.3019, lr=0.004858, batch_cost=0.4808, reader_cost=0.0015 | ETA 02:23:31 2020-11-14 03:46:04 [INFO] [TRAIN] epoch=34, iter=22100/40000, loss=0.2428, lr=0.004855, batch_cost=0.5061, reader_cost=0.0002 | ETA 02:30:58 2020-11-14 03:46:09 [INFO] [TRAIN] epoch=34, iter=22110/40000, loss=0.3137, lr=0.004853, batch_cost=0.5137, reader_cost=0.0011 | ETA 02:33:09 2020-11-14 03:46:14 [INFO] [TRAIN] epoch=34, iter=22120/40000, loss=0.2802, lr=0.004850, batch_cost=0.4863, reader_cost=0.0002 | ETA 02:24:54 2020-11-14 03:46:19 [INFO] [TRAIN] epoch=34, iter=22130/40000, loss=0.3640, lr=0.004848, batch_cost=0.4871, reader_cost=0.0036 | ETA 02:25:04 2020-11-14 03:46:23 [INFO] [TRAIN] epoch=34, iter=22140/40000, loss=0.2396, lr=0.004845, batch_cost=0.4652, reader_cost=0.0003 | ETA 02:18:27 2020-11-14 03:46:28 [INFO] [TRAIN] epoch=34, iter=22150/40000, loss=0.2390, lr=0.004843, batch_cost=0.4601, reader_cost=0.0022 | ETA 02:16:52 2020-11-14 03:46:33 [INFO] [TRAIN] epoch=34, iter=22160/40000, loss=0.2841, lr=0.004840, batch_cost=0.4825, reader_cost=0.0018 | ETA 02:23:28 2020-11-14 03:46:38 [INFO] [TRAIN] epoch=34, iter=22170/40000, loss=0.1782, lr=0.004838, batch_cost=0.4900, reader_cost=0.0005 | ETA 02:25:36 2020-11-14 03:46:42 [INFO] [TRAIN] epoch=34, iter=22180/40000, loss=0.2543, lr=0.004836, batch_cost=0.4612, reader_cost=0.0002 | ETA 02:16:58 2020-11-14 03:46:47 [INFO] [TRAIN] epoch=34, iter=22190/40000, loss=0.3143, lr=0.004833, batch_cost=0.4371, reader_cost=0.0003 | ETA 02:09:43 2020-11-14 03:46:51 [INFO] [TRAIN] epoch=34, iter=22200/40000, loss=0.1811, lr=0.004831, batch_cost=0.4337, reader_cost=0.0002 | ETA 02:08:40 2020-11-14 03:46:55 [INFO] [TRAIN] epoch=34, iter=22210/40000, loss=0.3062, lr=0.004828, batch_cost=0.4458, reader_cost=0.0002 | ETA 02:12:11 2020-11-14 03:47:00 [INFO] [TRAIN] epoch=34, iter=22220/40000, loss=0.3505, lr=0.004826, batch_cost=0.4528, reader_cost=0.0002 | ETA 02:14:10 2020-11-14 03:47:05 [INFO] [TRAIN] epoch=34, iter=22230/40000, loss=0.2857, lr=0.004823, batch_cost=0.4719, reader_cost=0.0002 | ETA 02:19:46 2020-11-14 03:47:09 [INFO] [TRAIN] epoch=34, iter=22240/40000, loss=0.2538, lr=0.004821, batch_cost=0.4604, reader_cost=0.0002 | ETA 02:16:16 2020-11-14 03:47:14 [INFO] [TRAIN] epoch=34, iter=22250/40000, loss=0.2750, lr=0.004819, batch_cost=0.4460, reader_cost=0.0048 | ETA 02:11:57 2020-11-14 03:47:18 [INFO] [TRAIN] epoch=34, iter=22260/40000, loss=0.2808, lr=0.004816, batch_cost=0.4640, reader_cost=0.0003 | ETA 02:17:12 2020-11-14 03:47:23 [INFO] [TRAIN] epoch=34, iter=22270/40000, loss=0.3429, lr=0.004814, batch_cost=0.4380, reader_cost=0.0002 | ETA 02:09:25 2020-11-14 03:47:27 [INFO] [TRAIN] epoch=34, iter=22280/40000, loss=0.2100, lr=0.004811, batch_cost=0.4305, reader_cost=0.0002 | ETA 02:07:09 2020-11-14 03:47:31 [INFO] [TRAIN] epoch=34, iter=22290/40000, loss=0.3072, lr=0.004809, batch_cost=0.4299, reader_cost=0.0001 | ETA 02:06:54 2020-11-14 03:47:36 [INFO] [TRAIN] epoch=34, iter=22300/40000, loss=0.2363, lr=0.004806, batch_cost=0.4305, reader_cost=0.0002 | ETA 02:06:59 2020-11-14 03:47:40 [INFO] [TRAIN] epoch=34, iter=22310/40000, loss=0.2796, lr=0.004804, batch_cost=0.4275, reader_cost=0.0002 | ETA 02:06:03 2020-11-14 03:47:44 [INFO] [TRAIN] epoch=34, iter=22320/40000, loss=0.2747, lr=0.004801, batch_cost=0.4266, reader_cost=0.0002 | ETA 02:05:42 2020-11-14 03:47:48 [INFO] [TRAIN] epoch=34, iter=22330/40000, loss=0.3095, lr=0.004799, batch_cost=0.4271, reader_cost=0.0002 | ETA 02:05:46 2020-11-14 03:47:53 [INFO] [TRAIN] epoch=34, iter=22340/40000, loss=0.3484, lr=0.004797, batch_cost=0.4269, reader_cost=0.0002 | ETA 02:05:39 2020-11-14 03:47:57 [INFO] [TRAIN] epoch=34, iter=22350/40000, loss=0.2989, lr=0.004794, batch_cost=0.4346, reader_cost=0.0002 | ETA 02:07:50 2020-11-14 03:48:02 [INFO] [TRAIN] epoch=34, iter=22360/40000, loss=0.2297, lr=0.004792, batch_cost=0.4657, reader_cost=0.0002 | ETA 02:16:54 2020-11-14 03:48:07 [INFO] [TRAIN] epoch=34, iter=22370/40000, loss=0.3272, lr=0.004789, batch_cost=0.4993, reader_cost=0.0002 | ETA 02:26:43 2020-11-14 03:48:11 [INFO] [TRAIN] epoch=34, iter=22380/40000, loss=0.2639, lr=0.004787, batch_cost=0.4477, reader_cost=0.0002 | ETA 02:11:27 2020-11-14 03:48:16 [INFO] [TRAIN] epoch=34, iter=22390/40000, loss=0.2675, lr=0.004784, batch_cost=0.4656, reader_cost=0.0002 | ETA 02:16:39 2020-11-14 03:48:20 [INFO] [TRAIN] epoch=34, iter=22400/40000, loss=0.2622, lr=0.004782, batch_cost=0.4353, reader_cost=0.0002 | ETA 02:07:40 2020-11-14 03:48:25 [INFO] [TRAIN] epoch=34, iter=22410/40000, loss=0.3394, lr=0.004780, batch_cost=0.4401, reader_cost=0.0002 | ETA 02:09:00 2020-11-14 03:48:29 [INFO] [TRAIN] epoch=34, iter=22420/40000, loss=0.2480, lr=0.004777, batch_cost=0.4455, reader_cost=0.0002 | ETA 02:10:32 2020-11-14 03:48:34 [INFO] [TRAIN] epoch=34, iter=22430/40000, loss=0.2824, lr=0.004775, batch_cost=0.4563, reader_cost=0.0003 | ETA 02:13:36 2020-11-14 03:48:39 [INFO] [TRAIN] epoch=34, iter=22440/40000, loss=0.2460, lr=0.004772, batch_cost=0.5021, reader_cost=0.0004 | ETA 02:26:57 2020-11-14 03:48:43 [INFO] [TRAIN] epoch=34, iter=22450/40000, loss=0.2738, lr=0.004770, batch_cost=0.4593, reader_cost=0.0002 | ETA 02:14:20 2020-11-14 03:48:48 [INFO] [TRAIN] epoch=34, iter=22460/40000, loss=0.2275, lr=0.004767, batch_cost=0.4507, reader_cost=0.0002 | ETA 02:11:45 2020-11-14 03:48:52 [INFO] [TRAIN] epoch=34, iter=22470/40000, loss=0.2894, lr=0.004765, batch_cost=0.4416, reader_cost=0.0005 | ETA 02:09:01 2020-11-14 03:49:00 [INFO] [TRAIN] epoch=35, iter=22480/40000, loss=0.2989, lr=0.004762, batch_cost=0.7692, reader_cost=0.1229 | ETA 03:44:36 2020-11-14 03:49:04 [INFO] [TRAIN] epoch=35, iter=22490/40000, loss=0.2715, lr=0.004760, batch_cost=0.4400, reader_cost=0.0004 | ETA 02:08:24 2020-11-14 03:49:09 [INFO] [TRAIN] epoch=35, iter=22500/40000, loss=0.2427, lr=0.004758, batch_cost=0.4967, reader_cost=0.0003 | ETA 02:24:51 2020-11-14 03:49:14 [INFO] [TRAIN] epoch=35, iter=22510/40000, loss=0.2615, lr=0.004755, batch_cost=0.4790, reader_cost=0.0074 | ETA 02:19:38 2020-11-14 03:49:19 [INFO] [TRAIN] epoch=35, iter=22520/40000, loss=0.2669, lr=0.004753, batch_cost=0.4537, reader_cost=0.0069 | ETA 02:12:09 2020-11-14 03:49:23 [INFO] [TRAIN] epoch=35, iter=22530/40000, loss=0.3272, lr=0.004750, batch_cost=0.4643, reader_cost=0.0002 | ETA 02:15:11 2020-11-14 03:49:28 [INFO] [TRAIN] epoch=35, iter=22540/40000, loss=0.3409, lr=0.004748, batch_cost=0.4486, reader_cost=0.0002 | ETA 02:10:33 2020-11-14 03:49:32 [INFO] [TRAIN] epoch=35, iter=22550/40000, loss=0.1765, lr=0.004745, batch_cost=0.4597, reader_cost=0.0002 | ETA 02:13:42 2020-11-14 03:49:37 [INFO] [TRAIN] epoch=35, iter=22560/40000, loss=0.3019, lr=0.004743, batch_cost=0.4665, reader_cost=0.0002 | ETA 02:15:35 2020-11-14 03:49:42 [INFO] [TRAIN] epoch=35, iter=22570/40000, loss=0.3008, lr=0.004740, batch_cost=0.4659, reader_cost=0.0002 | ETA 02:15:20 2020-11-14 03:49:46 [INFO] [TRAIN] epoch=35, iter=22580/40000, loss=0.2457, lr=0.004738, batch_cost=0.4586, reader_cost=0.0002 | ETA 02:13:08 2020-11-14 03:49:51 [INFO] [TRAIN] epoch=35, iter=22590/40000, loss=0.2352, lr=0.004736, batch_cost=0.4950, reader_cost=0.0002 | ETA 02:23:37 2020-11-14 03:49:56 [INFO] [TRAIN] epoch=35, iter=22600/40000, loss=0.3274, lr=0.004733, batch_cost=0.4673, reader_cost=0.0002 | ETA 02:15:31 2020-11-14 03:50:00 [INFO] [TRAIN] epoch=35, iter=22610/40000, loss=0.2886, lr=0.004731, batch_cost=0.4447, reader_cost=0.0002 | ETA 02:08:53 2020-11-14 03:50:05 [INFO] [TRAIN] epoch=35, iter=22620/40000, loss=0.1787, lr=0.004728, batch_cost=0.4454, reader_cost=0.0002 | ETA 02:09:01 2020-11-14 03:50:09 [INFO] [TRAIN] epoch=35, iter=22630/40000, loss=0.2319, lr=0.004726, batch_cost=0.4425, reader_cost=0.0002 | ETA 02:08:06 2020-11-14 03:50:14 [INFO] [TRAIN] epoch=35, iter=22640/40000, loss=0.2333, lr=0.004723, batch_cost=0.4426, reader_cost=0.0002 | ETA 02:08:04 2020-11-14 03:50:19 [INFO] [TRAIN] epoch=35, iter=22650/40000, loss=0.2368, lr=0.004721, batch_cost=0.5146, reader_cost=0.0002 | ETA 02:28:47 2020-11-14 03:50:24 [INFO] [TRAIN] epoch=35, iter=22660/40000, loss=0.1670, lr=0.004718, batch_cost=0.5201, reader_cost=0.0002 | ETA 02:30:18 2020-11-14 03:50:29 [INFO] [TRAIN] epoch=35, iter=22670/40000, loss=0.4740, lr=0.004716, batch_cost=0.4829, reader_cost=0.0002 | ETA 02:19:29 2020-11-14 03:50:34 [INFO] [TRAIN] epoch=35, iter=22680/40000, loss=0.1983, lr=0.004714, batch_cost=0.5087, reader_cost=0.0002 | ETA 02:26:50 2020-11-14 03:50:39 [INFO] [TRAIN] epoch=35, iter=22690/40000, loss=0.2204, lr=0.004711, batch_cost=0.4958, reader_cost=0.0002 | ETA 02:23:02 2020-11-14 03:50:44 [INFO] [TRAIN] epoch=35, iter=22700/40000, loss=0.2533, lr=0.004709, batch_cost=0.5129, reader_cost=0.0002 | ETA 02:27:52 2020-11-14 03:50:49 [INFO] [TRAIN] epoch=35, iter=22710/40000, loss=0.2468, lr=0.004706, batch_cost=0.4945, reader_cost=0.0002 | ETA 02:22:30 2020-11-14 03:50:54 [INFO] [TRAIN] epoch=35, iter=22720/40000, loss=0.2529, lr=0.004704, batch_cost=0.5557, reader_cost=0.0002 | ETA 02:40:02 2020-11-14 03:51:00 [INFO] [TRAIN] epoch=35, iter=22730/40000, loss=0.2767, lr=0.004701, batch_cost=0.5401, reader_cost=0.0002 | ETA 02:35:27 2020-11-14 03:51:05 [INFO] [TRAIN] epoch=35, iter=22740/40000, loss=0.2507, lr=0.004699, batch_cost=0.5333, reader_cost=0.0002 | ETA 02:33:24 2020-11-14 03:51:11 [INFO] [TRAIN] epoch=35, iter=22750/40000, loss=0.1971, lr=0.004696, batch_cost=0.5770, reader_cost=0.0010 | ETA 02:45:52 2020-11-14 03:51:16 [INFO] [TRAIN] epoch=35, iter=22760/40000, loss=0.2111, lr=0.004694, batch_cost=0.4885, reader_cost=0.0002 | ETA 02:20:21 2020-11-14 03:51:21 [INFO] [TRAIN] epoch=35, iter=22770/40000, loss=0.2734, lr=0.004692, batch_cost=0.4921, reader_cost=0.0002 | ETA 02:21:18 2020-11-14 03:51:25 [INFO] [TRAIN] epoch=35, iter=22780/40000, loss=0.2324, lr=0.004689, batch_cost=0.4648, reader_cost=0.0002 | ETA 02:13:23 2020-11-14 03:51:30 [INFO] [TRAIN] epoch=35, iter=22790/40000, loss=0.2693, lr=0.004687, batch_cost=0.4798, reader_cost=0.0002 | ETA 02:17:37 2020-11-14 03:51:35 [INFO] [TRAIN] epoch=35, iter=22800/40000, loss=0.2378, lr=0.004684, batch_cost=0.4397, reader_cost=0.0002 | ETA 02:06:03 2020-11-14 03:51:39 [INFO] [TRAIN] epoch=35, iter=22810/40000, loss=0.3128, lr=0.004682, batch_cost=0.4309, reader_cost=0.0002 | ETA 02:03:26 2020-11-14 03:51:43 [INFO] [TRAIN] epoch=35, iter=22820/40000, loss=0.2273, lr=0.004679, batch_cost=0.4349, reader_cost=0.0002 | ETA 02:04:31 2020-11-14 03:51:48 [INFO] [TRAIN] epoch=35, iter=22830/40000, loss=0.1548, lr=0.004677, batch_cost=0.4316, reader_cost=0.0002 | ETA 02:03:31 2020-11-14 03:51:52 [INFO] [TRAIN] epoch=35, iter=22840/40000, loss=0.2619, lr=0.004674, batch_cost=0.4333, reader_cost=0.0002 | ETA 02:03:55 2020-11-14 03:51:56 [INFO] [TRAIN] epoch=35, iter=22850/40000, loss=0.2918, lr=0.004672, batch_cost=0.4311, reader_cost=0.0002 | ETA 02:03:13 2020-11-14 03:52:01 [INFO] [TRAIN] epoch=35, iter=22860/40000, loss=0.1856, lr=0.004670, batch_cost=0.4357, reader_cost=0.0002 | ETA 02:04:28 2020-11-14 03:52:05 [INFO] [TRAIN] epoch=35, iter=22870/40000, loss=0.3236, lr=0.004667, batch_cost=0.4329, reader_cost=0.0002 | ETA 02:03:34 2020-11-14 03:52:09 [INFO] [TRAIN] epoch=35, iter=22880/40000, loss=0.2797, lr=0.004665, batch_cost=0.4370, reader_cost=0.0002 | ETA 02:04:41 2020-11-14 03:52:14 [INFO] [TRAIN] epoch=35, iter=22890/40000, loss=0.2352, lr=0.004662, batch_cost=0.4325, reader_cost=0.0002 | ETA 02:03:19 2020-11-14 03:52:18 [INFO] [TRAIN] epoch=35, iter=22900/40000, loss=0.3446, lr=0.004660, batch_cost=0.4333, reader_cost=0.0002 | ETA 02:03:29 2020-11-14 03:52:22 [INFO] [TRAIN] epoch=35, iter=22910/40000, loss=0.2890, lr=0.004657, batch_cost=0.4353, reader_cost=0.0002 | ETA 02:03:58 2020-11-14 03:52:27 [INFO] [TRAIN] epoch=35, iter=22920/40000, loss=0.2838, lr=0.004655, batch_cost=0.4353, reader_cost=0.0002 | ETA 02:03:55 2020-11-14 03:52:31 [INFO] [TRAIN] epoch=35, iter=22930/40000, loss=0.2445, lr=0.004652, batch_cost=0.4299, reader_cost=0.0002 | ETA 02:02:18 2020-11-14 03:52:35 [INFO] [TRAIN] epoch=35, iter=22940/40000, loss=0.2240, lr=0.004650, batch_cost=0.4517, reader_cost=0.0002 | ETA 02:08:25 2020-11-14 03:52:40 [INFO] [TRAIN] epoch=35, iter=22950/40000, loss=0.2670, lr=0.004648, batch_cost=0.4499, reader_cost=0.0002 | ETA 02:07:49 2020-11-14 03:52:45 [INFO] [TRAIN] epoch=35, iter=22960/40000, loss=0.2538, lr=0.004645, batch_cost=0.4685, reader_cost=0.0002 | ETA 02:13:02 2020-11-14 03:52:49 [INFO] [TRAIN] epoch=35, iter=22970/40000, loss=0.2580, lr=0.004643, batch_cost=0.4451, reader_cost=0.0002 | ETA 02:06:20 2020-11-14 03:52:53 [INFO] [TRAIN] epoch=35, iter=22980/40000, loss=0.2579, lr=0.004640, batch_cost=0.4371, reader_cost=0.0002 | ETA 02:03:58 2020-11-14 03:52:58 [INFO] [TRAIN] epoch=35, iter=22990/40000, loss=0.2854, lr=0.004638, batch_cost=0.4347, reader_cost=0.0002 | ETA 02:03:13 2020-11-14 03:53:02 [INFO] [TRAIN] epoch=35, iter=23000/40000, loss=0.2166, lr=0.004635, batch_cost=0.4372, reader_cost=0.0002 | ETA 02:03:53 2020-11-14 03:53:06 [INFO] [TRAIN] epoch=35, iter=23010/40000, loss=0.2344, lr=0.004633, batch_cost=0.4335, reader_cost=0.0002 | ETA 02:02:45 2020-11-14 03:53:11 [INFO] [TRAIN] epoch=35, iter=23020/40000, loss=0.3102, lr=0.004630, batch_cost=0.4288, reader_cost=0.0002 | ETA 02:01:20 2020-11-14 03:53:15 [INFO] [TRAIN] epoch=35, iter=23030/40000, loss=0.2326, lr=0.004628, batch_cost=0.4272, reader_cost=0.0002 | ETA 02:00:48 2020-11-14 03:53:19 [INFO] [TRAIN] epoch=35, iter=23040/40000, loss=0.2312, lr=0.004625, batch_cost=0.4278, reader_cost=0.0002 | ETA 02:00:55 2020-11-14 03:53:24 [INFO] [TRAIN] epoch=35, iter=23050/40000, loss=0.2948, lr=0.004623, batch_cost=0.4282, reader_cost=0.0002 | ETA 02:00:58 2020-11-14 03:53:28 [INFO] [TRAIN] epoch=35, iter=23060/40000, loss=0.2011, lr=0.004621, batch_cost=0.4302, reader_cost=0.0002 | ETA 02:01:28 2020-11-14 03:53:32 [INFO] [TRAIN] epoch=35, iter=23070/40000, loss=0.2347, lr=0.004618, batch_cost=0.4439, reader_cost=0.0002 | ETA 02:05:15 2020-11-14 03:53:37 [INFO] [TRAIN] epoch=35, iter=23080/40000, loss=0.2813, lr=0.004616, batch_cost=0.4402, reader_cost=0.0002 | ETA 02:04:07 2020-11-14 03:53:41 [INFO] [TRAIN] epoch=35, iter=23090/40000, loss=0.2115, lr=0.004613, batch_cost=0.4502, reader_cost=0.0011 | ETA 02:06:52 2020-11-14 03:53:46 [INFO] [TRAIN] epoch=35, iter=23100/40000, loss=0.2695, lr=0.004611, batch_cost=0.4404, reader_cost=0.0002 | ETA 02:04:03 2020-11-14 03:53:50 [INFO] [TRAIN] epoch=35, iter=23110/40000, loss=0.2507, lr=0.004608, batch_cost=0.4291, reader_cost=0.0002 | ETA 02:00:46 2020-11-14 03:53:54 [INFO] [TRAIN] epoch=35, iter=23120/40000, loss=0.2080, lr=0.004606, batch_cost=0.4287, reader_cost=0.0002 | ETA 02:00:36 2020-11-14 03:53:58 [INFO] [TRAIN] epoch=35, iter=23130/40000, loss=0.3249, lr=0.004603, batch_cost=0.4281, reader_cost=0.0002 | ETA 02:00:21 2020-11-14 03:54:04 [INFO] [TRAIN] epoch=36, iter=23140/40000, loss=0.2461, lr=0.004601, batch_cost=0.5640, reader_cost=0.1001 | ETA 02:38:28 2020-11-14 03:54:09 [INFO] [TRAIN] epoch=36, iter=23150/40000, loss=0.3067, lr=0.004599, batch_cost=0.4886, reader_cost=0.0005 | ETA 02:17:12 2020-11-14 03:54:14 [INFO] [TRAIN] epoch=36, iter=23160/40000, loss=0.2172, lr=0.004596, batch_cost=0.4573, reader_cost=0.0002 | ETA 02:08:20 2020-11-14 03:54:18 [INFO] [TRAIN] epoch=36, iter=23170/40000, loss=0.2676, lr=0.004594, batch_cost=0.4469, reader_cost=0.0002 | ETA 02:05:21 2020-11-14 03:54:22 [INFO] [TRAIN] epoch=36, iter=23180/40000, loss=0.2312, lr=0.004591, batch_cost=0.4411, reader_cost=0.0002 | ETA 02:03:38 2020-11-14 03:54:27 [INFO] [TRAIN] epoch=36, iter=23190/40000, loss=0.2386, lr=0.004589, batch_cost=0.4435, reader_cost=0.0002 | ETA 02:04:14 2020-11-14 03:54:31 [INFO] [TRAIN] epoch=36, iter=23200/40000, loss=0.2885, lr=0.004586, batch_cost=0.4558, reader_cost=0.0002 | ETA 02:07:37 2020-11-14 03:54:36 [INFO] [TRAIN] epoch=36, iter=23210/40000, loss=0.2316, lr=0.004584, batch_cost=0.4929, reader_cost=0.0002 | ETA 02:17:55 2020-11-14 03:54:41 [INFO] [TRAIN] epoch=36, iter=23220/40000, loss=0.2607, lr=0.004581, batch_cost=0.4524, reader_cost=0.0002 | ETA 02:06:31 2020-11-14 03:54:45 [INFO] [TRAIN] epoch=36, iter=23230/40000, loss=0.3074, lr=0.004579, batch_cost=0.4362, reader_cost=0.0002 | ETA 02:01:54 2020-11-14 03:54:50 [INFO] [TRAIN] epoch=36, iter=23240/40000, loss=0.2258, lr=0.004576, batch_cost=0.4373, reader_cost=0.0002 | ETA 02:02:08 2020-11-14 03:54:54 [INFO] [TRAIN] epoch=36, iter=23250/40000, loss=0.4165, lr=0.004574, batch_cost=0.4323, reader_cost=0.0002 | ETA 02:00:41 2020-11-14 03:54:58 [INFO] [TRAIN] epoch=36, iter=23260/40000, loss=0.2403, lr=0.004572, batch_cost=0.4363, reader_cost=0.0002 | ETA 02:01:44 2020-11-14 03:55:03 [INFO] [TRAIN] epoch=36, iter=23270/40000, loss=0.1969, lr=0.004569, batch_cost=0.4364, reader_cost=0.0002 | ETA 02:01:40 2020-11-14 03:55:07 [INFO] [TRAIN] epoch=36, iter=23280/40000, loss=0.2281, lr=0.004567, batch_cost=0.4384, reader_cost=0.0002 | ETA 02:02:10 2020-11-14 03:55:12 [INFO] [TRAIN] epoch=36, iter=23290/40000, loss=0.2260, lr=0.004564, batch_cost=0.4409, reader_cost=0.0002 | ETA 02:02:48 2020-11-14 03:55:16 [INFO] [TRAIN] epoch=36, iter=23300/40000, loss=0.2251, lr=0.004562, batch_cost=0.4383, reader_cost=0.0002 | ETA 02:01:59 2020-11-14 03:55:20 [INFO] [TRAIN] epoch=36, iter=23310/40000, loss=0.3279, lr=0.004559, batch_cost=0.4396, reader_cost=0.0002 | ETA 02:02:16 2020-11-14 03:55:25 [INFO] [TRAIN] epoch=36, iter=23320/40000, loss=0.2191, lr=0.004557, batch_cost=0.4360, reader_cost=0.0002 | ETA 02:01:13 2020-11-14 03:55:29 [INFO] [TRAIN] epoch=36, iter=23330/40000, loss=0.2634, lr=0.004554, batch_cost=0.4745, reader_cost=0.0002 | ETA 02:11:49 2020-11-14 03:55:34 [INFO] [TRAIN] epoch=36, iter=23340/40000, loss=0.2447, lr=0.004552, batch_cost=0.4999, reader_cost=0.0002 | ETA 02:18:48 2020-11-14 03:55:39 [INFO] [TRAIN] epoch=36, iter=23350/40000, loss=0.2621, lr=0.004549, batch_cost=0.4981, reader_cost=0.0002 | ETA 02:18:13 2020-11-14 03:55:45 [INFO] [TRAIN] epoch=36, iter=23360/40000, loss=0.2442, lr=0.004547, batch_cost=0.5310, reader_cost=0.0002 | ETA 02:27:15 2020-11-14 03:55:49 [INFO] [TRAIN] epoch=36, iter=23370/40000, loss=0.2152, lr=0.004545, batch_cost=0.4522, reader_cost=0.0002 | ETA 02:05:19 2020-11-14 03:55:54 [INFO] [TRAIN] epoch=36, iter=23380/40000, loss=0.1931, lr=0.004542, batch_cost=0.4567, reader_cost=0.0002 | ETA 02:06:30 2020-11-14 03:55:58 [INFO] [TRAIN] epoch=36, iter=23390/40000, loss=0.2901, lr=0.004540, batch_cost=0.4452, reader_cost=0.0002 | ETA 02:03:15 2020-11-14 03:56:03 [INFO] [TRAIN] epoch=36, iter=23400/40000, loss=0.2365, lr=0.004537, batch_cost=0.4557, reader_cost=0.0002 | ETA 02:06:04 2020-11-14 03:56:07 [INFO] [TRAIN] epoch=36, iter=23410/40000, loss=0.2461, lr=0.004535, batch_cost=0.4359, reader_cost=0.0002 | ETA 02:00:32 2020-11-14 03:56:11 [INFO] [TRAIN] epoch=36, iter=23420/40000, loss=0.2069, lr=0.004532, batch_cost=0.4325, reader_cost=0.0002 | ETA 01:59:31 2020-11-14 03:56:16 [INFO] [TRAIN] epoch=36, iter=23430/40000, loss=0.2355, lr=0.004530, batch_cost=0.4335, reader_cost=0.0002 | ETA 01:59:43 2020-11-14 03:56:20 [INFO] [TRAIN] epoch=36, iter=23440/40000, loss=0.2501, lr=0.004527, batch_cost=0.4327, reader_cost=0.0002 | ETA 01:59:26 2020-11-14 03:56:24 [INFO] [TRAIN] epoch=36, iter=23450/40000, loss=0.2302, lr=0.004525, batch_cost=0.4362, reader_cost=0.0002 | ETA 02:00:19 2020-11-14 03:56:29 [INFO] [TRAIN] epoch=36, iter=23460/40000, loss=0.2307, lr=0.004522, batch_cost=0.4364, reader_cost=0.0002 | ETA 02:00:17 2020-11-14 03:56:33 [INFO] [TRAIN] epoch=36, iter=23470/40000, loss=0.2535, lr=0.004520, batch_cost=0.4342, reader_cost=0.0002 | ETA 01:59:37 2020-11-14 03:56:38 [INFO] [TRAIN] epoch=36, iter=23480/40000, loss=0.1811, lr=0.004518, batch_cost=0.4327, reader_cost=0.0002 | ETA 01:59:07 2020-11-14 03:56:42 [INFO] [TRAIN] epoch=36, iter=23490/40000, loss=0.2511, lr=0.004515, batch_cost=0.4328, reader_cost=0.0002 | ETA 01:59:06 2020-11-14 03:56:46 [INFO] [TRAIN] epoch=36, iter=23500/40000, loss=0.1928, lr=0.004513, batch_cost=0.4345, reader_cost=0.0002 | ETA 01:59:28 2020-11-14 03:56:51 [INFO] [TRAIN] epoch=36, iter=23510/40000, loss=0.2353, lr=0.004510, batch_cost=0.4378, reader_cost=0.0002 | ETA 02:00:20 2020-11-14 03:56:55 [INFO] [TRAIN] epoch=36, iter=23520/40000, loss=0.1890, lr=0.004508, batch_cost=0.4367, reader_cost=0.0002 | ETA 01:59:56 2020-11-14 03:56:59 [INFO] [TRAIN] epoch=36, iter=23530/40000, loss=0.2734, lr=0.004505, batch_cost=0.4372, reader_cost=0.0002 | ETA 02:00:01 2020-11-14 03:57:04 [INFO] [TRAIN] epoch=36, iter=23540/40000, loss=0.2403, lr=0.004503, batch_cost=0.4321, reader_cost=0.0002 | ETA 01:58:31 2020-11-14 03:57:08 [INFO] [TRAIN] epoch=36, iter=23550/40000, loss=0.3244, lr=0.004500, batch_cost=0.4317, reader_cost=0.0002 | ETA 01:58:20 2020-11-14 03:57:12 [INFO] [TRAIN] epoch=36, iter=23560/40000, loss=0.2228, lr=0.004498, batch_cost=0.4344, reader_cost=0.0002 | ETA 01:59:01 2020-11-14 03:57:17 [INFO] [TRAIN] epoch=36, iter=23570/40000, loss=0.3578, lr=0.004495, batch_cost=0.4360, reader_cost=0.0002 | ETA 01:59:23 2020-11-14 03:57:21 [INFO] [TRAIN] epoch=36, iter=23580/40000, loss=0.2115, lr=0.004493, batch_cost=0.4366, reader_cost=0.0002 | ETA 01:59:28 2020-11-14 03:57:25 [INFO] [TRAIN] epoch=36, iter=23590/40000, loss=0.2081, lr=0.004491, batch_cost=0.4354, reader_cost=0.0002 | ETA 01:59:04 2020-11-14 03:57:30 [INFO] [TRAIN] epoch=36, iter=23600/40000, loss=0.2065, lr=0.004488, batch_cost=0.4447, reader_cost=0.0002 | ETA 02:01:33 2020-11-14 03:57:34 [INFO] [TRAIN] epoch=36, iter=23610/40000, loss=0.2374, lr=0.004486, batch_cost=0.4449, reader_cost=0.0002 | ETA 02:01:31 2020-11-14 03:57:39 [INFO] [TRAIN] epoch=36, iter=23620/40000, loss=0.2608, lr=0.004483, batch_cost=0.4439, reader_cost=0.0002 | ETA 02:01:11 2020-11-14 03:57:43 [INFO] [TRAIN] epoch=36, iter=23630/40000, loss=0.1644, lr=0.004481, batch_cost=0.4430, reader_cost=0.0002 | ETA 02:00:51 2020-11-14 03:57:48 [INFO] [TRAIN] epoch=36, iter=23640/40000, loss=0.2147, lr=0.004478, batch_cost=0.4437, reader_cost=0.0002 | ETA 02:00:58 2020-11-14 03:57:52 [INFO] [TRAIN] epoch=36, iter=23650/40000, loss=0.1855, lr=0.004476, batch_cost=0.4433, reader_cost=0.0002 | ETA 02:00:47 2020-11-14 03:57:56 [INFO] [TRAIN] epoch=36, iter=23660/40000, loss=0.2268, lr=0.004473, batch_cost=0.4436, reader_cost=0.0002 | ETA 02:00:47 2020-11-14 03:58:01 [INFO] [TRAIN] epoch=36, iter=23670/40000, loss=0.1924, lr=0.004471, batch_cost=0.4432, reader_cost=0.0002 | ETA 02:00:36 2020-11-14 03:58:05 [INFO] [TRAIN] epoch=36, iter=23680/40000, loss=0.2384, lr=0.004468, batch_cost=0.4420, reader_cost=0.0002 | ETA 02:00:13 2020-11-14 03:58:10 [INFO] [TRAIN] epoch=36, iter=23690/40000, loss=0.2690, lr=0.004466, batch_cost=0.4431, reader_cost=0.0002 | ETA 02:00:26 2020-11-14 03:58:14 [INFO] [TRAIN] epoch=36, iter=23700/40000, loss=0.2772, lr=0.004464, batch_cost=0.4422, reader_cost=0.0002 | ETA 02:00:07 2020-11-14 03:58:19 [INFO] [TRAIN] epoch=36, iter=23710/40000, loss=0.2712, lr=0.004461, batch_cost=0.4454, reader_cost=0.0002 | ETA 02:00:55 2020-11-14 03:58:23 [INFO] [TRAIN] epoch=36, iter=23720/40000, loss=0.2217, lr=0.004459, batch_cost=0.4423, reader_cost=0.0002 | ETA 02:00:00 2020-11-14 03:58:27 [INFO] [TRAIN] epoch=36, iter=23730/40000, loss=0.2441, lr=0.004456, batch_cost=0.4423, reader_cost=0.0002 | ETA 01:59:56 2020-11-14 03:58:32 [INFO] [TRAIN] epoch=36, iter=23740/40000, loss=0.2990, lr=0.004454, batch_cost=0.4427, reader_cost=0.0002 | ETA 01:59:57 2020-11-14 03:58:36 [INFO] [TRAIN] epoch=36, iter=23750/40000, loss=0.2184, lr=0.004451, batch_cost=0.4354, reader_cost=0.0002 | ETA 01:57:55 2020-11-14 03:58:41 [INFO] [TRAIN] epoch=36, iter=23760/40000, loss=0.2696, lr=0.004449, batch_cost=0.4314, reader_cost=0.0002 | ETA 01:56:45 2020-11-14 03:58:45 [INFO] [TRAIN] epoch=36, iter=23770/40000, loss=0.2725, lr=0.004446, batch_cost=0.4347, reader_cost=0.0002 | ETA 01:57:35 2020-11-14 03:58:49 [INFO] [TRAIN] epoch=36, iter=23780/40000, loss=0.2537, lr=0.004444, batch_cost=0.4320, reader_cost=0.0002 | ETA 01:56:47 2020-11-14 03:58:54 [INFO] [TRAIN] epoch=36, iter=23790/40000, loss=0.2623, lr=0.004441, batch_cost=0.4297, reader_cost=0.0002 | ETA 01:56:04 2020-11-14 03:58:59 [INFO] [TRAIN] epoch=37, iter=23800/40000, loss=0.2954, lr=0.004439, batch_cost=0.5250, reader_cost=0.0817 | ETA 02:21:45 2020-11-14 03:59:03 [INFO] [TRAIN] epoch=37, iter=23810/40000, loss=0.2315, lr=0.004436, batch_cost=0.4483, reader_cost=0.0005 | ETA 02:00:57 2020-11-14 03:59:08 [INFO] [TRAIN] epoch=37, iter=23820/40000, loss=0.2533, lr=0.004434, batch_cost=0.4717, reader_cost=0.0003 | ETA 02:07:11 2020-11-14 03:59:13 [INFO] [TRAIN] epoch=37, iter=23830/40000, loss=0.1810, lr=0.004432, batch_cost=0.4830, reader_cost=0.0002 | ETA 02:10:10 2020-11-14 03:59:17 [INFO] [TRAIN] epoch=37, iter=23840/40000, loss=0.2421, lr=0.004429, batch_cost=0.4568, reader_cost=0.0002 | ETA 02:03:01 2020-11-14 03:59:22 [INFO] [TRAIN] epoch=37, iter=23850/40000, loss=0.2330, lr=0.004427, batch_cost=0.4706, reader_cost=0.0002 | ETA 02:06:39 2020-11-14 03:59:27 [INFO] [TRAIN] epoch=37, iter=23860/40000, loss=0.2133, lr=0.004424, batch_cost=0.4730, reader_cost=0.0002 | ETA 02:07:14 2020-11-14 03:59:32 [INFO] [TRAIN] epoch=37, iter=23870/40000, loss=0.2195, lr=0.004422, batch_cost=0.4757, reader_cost=0.0002 | ETA 02:07:53 2020-11-14 03:59:36 [INFO] [TRAIN] epoch=37, iter=23880/40000, loss=0.2232, lr=0.004419, batch_cost=0.4422, reader_cost=0.0002 | ETA 01:58:48 2020-11-14 03:59:41 [INFO] [TRAIN] epoch=37, iter=23890/40000, loss=0.2938, lr=0.004417, batch_cost=0.4653, reader_cost=0.0002 | ETA 02:04:56 2020-11-14 03:59:45 [INFO] [TRAIN] epoch=37, iter=23900/40000, loss=0.3734, lr=0.004414, batch_cost=0.4464, reader_cost=0.0002 | ETA 01:59:46 2020-11-14 03:59:50 [INFO] [TRAIN] epoch=37, iter=23910/40000, loss=0.3005, lr=0.004412, batch_cost=0.4662, reader_cost=0.0002 | ETA 02:05:01 2020-11-14 03:59:54 [INFO] [TRAIN] epoch=37, iter=23920/40000, loss=0.2112, lr=0.004409, batch_cost=0.4705, reader_cost=0.0002 | ETA 02:06:06 2020-11-14 03:59:59 [INFO] [TRAIN] epoch=37, iter=23930/40000, loss=0.2661, lr=0.004407, batch_cost=0.4797, reader_cost=0.0002 | ETA 02:08:29 2020-11-14 04:00:04 [INFO] [TRAIN] epoch=37, iter=23940/40000, loss=0.2409, lr=0.004404, batch_cost=0.4793, reader_cost=0.0002 | ETA 02:08:17 2020-11-14 04:00:09 [INFO] [TRAIN] epoch=37, iter=23950/40000, loss=0.3062, lr=0.004402, batch_cost=0.4661, reader_cost=0.0002 | ETA 02:04:41 2020-11-14 04:00:13 [INFO] [TRAIN] epoch=37, iter=23960/40000, loss=0.3060, lr=0.004400, batch_cost=0.4526, reader_cost=0.0002 | ETA 02:01:00 2020-11-14 04:00:18 [INFO] [TRAIN] epoch=37, iter=23970/40000, loss=0.2097, lr=0.004397, batch_cost=0.4528, reader_cost=0.0002 | ETA 02:00:57 2020-11-14 04:00:22 [INFO] [TRAIN] epoch=37, iter=23980/40000, loss=0.2965, lr=0.004395, batch_cost=0.4377, reader_cost=0.0002 | ETA 01:56:51 2020-11-14 04:00:27 [INFO] [TRAIN] epoch=37, iter=23990/40000, loss=0.2448, lr=0.004392, batch_cost=0.4433, reader_cost=0.0002 | ETA 01:58:17 2020-11-14 04:00:31 [INFO] [TRAIN] epoch=37, iter=24000/40000, loss=0.3060, lr=0.004390, batch_cost=0.4465, reader_cost=0.0002 | ETA 01:59:04 2020-11-14 04:00:31 [INFO] Start evaluating (total_samples=1449, total_iters=363)... 2020-11-14 04:00:55 [INFO] [EVAL] #Images=1449 mIoU=0.7918 Acc=0.9528 Kappa=0.8962 2020-11-14 04:00:55 [INFO] [EVAL] Class IoU: [0.9448 0.9178 0.4123 0.9008 0.7112 0.8173 0.9487 0.8932 0.9314 0.4924 0.8883 0.6109 0.8948 0.9095 0.8513 0.8656 0.5925 0.8392 0.594 0.8995 0.7129] 2020-11-14 04:00:55 [INFO] [EVAL] Class Acc: [0.97 0.9417 0.4223 0.9527 0.7724 0.8924 0.9649 0.9536 0.9612 0.6613 0.9194 0.9194 0.9414 0.9427 0.876 0.9435 0.8656 0.9221 0.8528 0.9318 0.8735] 2020-11-14 04:01:00 [INFO] [EVAL] The model with the best validation mIoU (0.7933) was saved at iter 22000. 2020-11-14 04:01:04 [INFO] [TRAIN] epoch=37, iter=24010/40000, loss=0.2752, lr=0.004387, batch_cost=0.4317, reader_cost=0.0004 | ETA 01:55:03 2020-11-14 04:01:08 [INFO] [TRAIN] epoch=37, iter=24020/40000, loss=0.2045, lr=0.004385, batch_cost=0.4388, reader_cost=0.0005 | ETA 01:56:52 2020-11-14 04:01:13 [INFO] [TRAIN] epoch=37, iter=24030/40000, loss=0.1558, lr=0.004382, batch_cost=0.4378, reader_cost=0.0005 | ETA 01:56:31 2020-11-14 04:01:18 [INFO] [TRAIN] epoch=37, iter=24040/40000, loss=0.2887, lr=0.004380, batch_cost=0.4751, reader_cost=0.0005 | ETA 02:06:21 2020-11-14 04:01:22 [INFO] [TRAIN] epoch=37, iter=24050/40000, loss=0.2675, lr=0.004377, batch_cost=0.4526, reader_cost=0.0002 | ETA 02:00:18 2020-11-14 04:01:27 [INFO] [TRAIN] epoch=37, iter=24060/40000, loss=0.2540, lr=0.004375, batch_cost=0.4730, reader_cost=0.0002 | ETA 02:05:39 2020-11-14 04:01:31 [INFO] [TRAIN] epoch=37, iter=24070/40000, loss=0.2070, lr=0.004372, batch_cost=0.4309, reader_cost=0.0002 | ETA 01:54:24 2020-11-14 04:01:36 [INFO] [TRAIN] epoch=37, iter=24080/40000, loss=0.1559, lr=0.004370, batch_cost=0.4544, reader_cost=0.0002 | ETA 02:00:34 2020-11-14 04:01:40 [INFO] [TRAIN] epoch=37, iter=24090/40000, loss=0.2163, lr=0.004368, batch_cost=0.4396, reader_cost=0.0002 | ETA 01:56:34 2020-11-14 04:01:45 [INFO] [TRAIN] epoch=37, iter=24100/40000, loss=0.3010, lr=0.004365, batch_cost=0.4638, reader_cost=0.0002 | ETA 02:02:54 2020-11-14 04:01:49 [INFO] [TRAIN] epoch=37, iter=24110/40000, loss=0.2433, lr=0.004363, batch_cost=0.4358, reader_cost=0.0002 | ETA 01:55:25 2020-11-14 04:01:54 [INFO] [TRAIN] epoch=37, iter=24120/40000, loss=0.2262, lr=0.004360, batch_cost=0.4476, reader_cost=0.0002 | ETA 01:58:27 2020-11-14 04:01:58 [INFO] [TRAIN] epoch=37, iter=24130/40000, loss=0.3400, lr=0.004358, batch_cost=0.4445, reader_cost=0.0002 | ETA 01:57:34 2020-11-14 04:02:03 [INFO] [TRAIN] epoch=37, iter=24140/40000, loss=0.2987, lr=0.004355, batch_cost=0.4648, reader_cost=0.0002 | ETA 02:02:51 2020-11-14 04:02:08 [INFO] [TRAIN] epoch=37, iter=24150/40000, loss=0.2964, lr=0.004353, batch_cost=0.4886, reader_cost=0.0002 | ETA 02:09:04 2020-11-14 04:02:12 [INFO] [TRAIN] epoch=37, iter=24160/40000, loss=0.2378, lr=0.004350, batch_cost=0.4550, reader_cost=0.0002 | ETA 02:00:07 2020-11-14 04:02:17 [INFO] [TRAIN] epoch=37, iter=24170/40000, loss=0.1909, lr=0.004348, batch_cost=0.4614, reader_cost=0.0002 | ETA 02:01:43 2020-11-14 04:02:21 [INFO] [TRAIN] epoch=37, iter=24180/40000, loss=0.1897, lr=0.004345, batch_cost=0.4736, reader_cost=0.0002 | ETA 02:04:51 2020-11-14 04:02:27 [INFO] [TRAIN] epoch=37, iter=24190/40000, loss=0.2611, lr=0.004343, batch_cost=0.5065, reader_cost=0.0002 | ETA 02:13:28 2020-11-14 04:02:31 [INFO] [TRAIN] epoch=37, iter=24200/40000, loss=0.2092, lr=0.004340, batch_cost=0.4522, reader_cost=0.0002 | ETA 01:59:04 2020-11-14 04:02:36 [INFO] [TRAIN] epoch=37, iter=24210/40000, loss=0.2982, lr=0.004338, batch_cost=0.4716, reader_cost=0.0002 | ETA 02:04:07 2020-11-14 04:02:40 [INFO] [TRAIN] epoch=37, iter=24220/40000, loss=0.2161, lr=0.004335, batch_cost=0.4547, reader_cost=0.0002 | ETA 01:59:34 2020-11-14 04:02:45 [INFO] [TRAIN] epoch=37, iter=24230/40000, loss=0.2876, lr=0.004333, batch_cost=0.4985, reader_cost=0.0002 | ETA 02:11:01 2020-11-14 04:02:50 [INFO] [TRAIN] epoch=37, iter=24240/40000, loss=0.2539, lr=0.004331, batch_cost=0.4950, reader_cost=0.0002 | ETA 02:10:00 2020-11-14 04:02:55 [INFO] [TRAIN] epoch=37, iter=24250/40000, loss=0.2236, lr=0.004328, batch_cost=0.4872, reader_cost=0.0002 | ETA 02:07:53 2020-11-14 04:03:00 [INFO] [TRAIN] epoch=37, iter=24260/40000, loss=0.3157, lr=0.004326, batch_cost=0.4610, reader_cost=0.0002 | ETA 02:00:56 2020-11-14 04:03:04 [INFO] [TRAIN] epoch=37, iter=24270/40000, loss=0.2344, lr=0.004323, batch_cost=0.4520, reader_cost=0.0002 | ETA 01:58:29 2020-11-14 04:03:09 [INFO] [TRAIN] epoch=37, iter=24280/40000, loss=0.3877, lr=0.004321, batch_cost=0.4518, reader_cost=0.0002 | ETA 01:58:21 2020-11-14 04:03:13 [INFO] [TRAIN] epoch=37, iter=24290/40000, loss=0.2538, lr=0.004318, batch_cost=0.4690, reader_cost=0.0002 | ETA 02:02:48 2020-11-14 04:03:18 [INFO] [TRAIN] epoch=37, iter=24300/40000, loss=0.2457, lr=0.004316, batch_cost=0.4900, reader_cost=0.0002 | ETA 02:08:13 2020-11-14 04:03:23 [INFO] [TRAIN] epoch=37, iter=24310/40000, loss=0.2583, lr=0.004313, batch_cost=0.4932, reader_cost=0.0002 | ETA 02:08:57 2020-11-14 04:03:29 [INFO] [TRAIN] epoch=37, iter=24320/40000, loss=0.2253, lr=0.004311, batch_cost=0.5200, reader_cost=0.0002 | ETA 02:15:53 2020-11-14 04:03:33 [INFO] [TRAIN] epoch=37, iter=24330/40000, loss=0.2331, lr=0.004308, batch_cost=0.4669, reader_cost=0.0002 | ETA 02:01:56 2020-11-14 04:03:38 [INFO] [TRAIN] epoch=37, iter=24340/40000, loss=0.2047, lr=0.004306, batch_cost=0.5208, reader_cost=0.0002 | ETA 02:15:55 2020-11-14 04:03:43 [INFO] [TRAIN] epoch=37, iter=24350/40000, loss=0.2474, lr=0.004303, batch_cost=0.5071, reader_cost=0.0002 | ETA 02:12:15 2020-11-14 04:03:48 [INFO] [TRAIN] epoch=37, iter=24360/40000, loss=0.2225, lr=0.004301, batch_cost=0.4687, reader_cost=0.0002 | ETA 02:02:10 2020-11-14 04:03:53 [INFO] [TRAIN] epoch=37, iter=24370/40000, loss=0.2526, lr=0.004298, batch_cost=0.4714, reader_cost=0.0002 | ETA 02:02:48 2020-11-14 04:03:58 [INFO] [TRAIN] epoch=37, iter=24380/40000, loss=0.2037, lr=0.004296, batch_cost=0.4876, reader_cost=0.0002 | ETA 02:06:55 2020-11-14 04:04:03 [INFO] [TRAIN] epoch=37, iter=24390/40000, loss=0.2198, lr=0.004294, batch_cost=0.4839, reader_cost=0.0002 | ETA 02:05:53 2020-11-14 04:04:07 [INFO] [TRAIN] epoch=37, iter=24400/40000, loss=0.2860, lr=0.004291, batch_cost=0.4813, reader_cost=0.0002 | ETA 02:05:08 2020-11-14 04:04:12 [INFO] [TRAIN] epoch=37, iter=24410/40000, loss=0.3430, lr=0.004289, batch_cost=0.4341, reader_cost=0.0002 | ETA 01:52:47 2020-11-14 04:04:16 [INFO] [TRAIN] epoch=37, iter=24420/40000, loss=0.2499, lr=0.004286, batch_cost=0.4622, reader_cost=0.0003 | ETA 02:00:01 2020-11-14 04:04:21 [INFO] [TRAIN] epoch=37, iter=24430/40000, loss=0.2095, lr=0.004284, batch_cost=0.5126, reader_cost=0.0002 | ETA 02:13:01 2020-11-14 04:04:26 [INFO] [TRAIN] epoch=37, iter=24440/40000, loss=0.2203, lr=0.004281, batch_cost=0.4617, reader_cost=0.0002 | ETA 01:59:43 2020-11-14 04:04:31 [INFO] [TRAIN] epoch=37, iter=24450/40000, loss=0.2165, lr=0.004279, batch_cost=0.4580, reader_cost=0.0004 | ETA 01:58:42 2020-11-14 04:04:36 [INFO] [TRAIN] epoch=38, iter=24460/40000, loss=0.2780, lr=0.004276, batch_cost=0.5672, reader_cost=0.1208 | ETA 02:26:53 2020-11-14 04:04:41 [INFO] [TRAIN] epoch=38, iter=24470/40000, loss=0.2111, lr=0.004274, batch_cost=0.4264, reader_cost=0.0004 | ETA 01:50:21 2020-11-14 04:04:45 [INFO] [TRAIN] epoch=38, iter=24480/40000, loss=0.2035, lr=0.004271, batch_cost=0.4256, reader_cost=0.0001 | ETA 01:50:04 2020-11-14 04:04:49 [INFO] [TRAIN] epoch=38, iter=24490/40000, loss=0.2091, lr=0.004269, batch_cost=0.4251, reader_cost=0.0002 | ETA 01:49:53 2020-11-14 04:04:54 [INFO] [TRAIN] epoch=38, iter=24500/40000, loss=0.2115, lr=0.004266, batch_cost=0.4427, reader_cost=0.0002 | ETA 01:54:21 2020-11-14 04:04:58 [INFO] [TRAIN] epoch=38, iter=24510/40000, loss=0.2292, lr=0.004264, batch_cost=0.4561, reader_cost=0.0002 | ETA 01:57:45 2020-11-14 04:05:03 [INFO] [TRAIN] epoch=38, iter=24520/40000, loss=0.2319, lr=0.004261, batch_cost=0.4530, reader_cost=0.0002 | ETA 01:56:52 2020-11-14 04:05:07 [INFO] [TRAIN] epoch=38, iter=24530/40000, loss=0.2215, lr=0.004259, batch_cost=0.4708, reader_cost=0.0002 | ETA 02:01:23 2020-11-14 04:05:12 [INFO] [TRAIN] epoch=38, iter=24540/40000, loss=0.2715, lr=0.004256, batch_cost=0.4384, reader_cost=0.0002 | ETA 01:52:58 2020-11-14 04:05:16 [INFO] [TRAIN] epoch=38, iter=24550/40000, loss=0.2295, lr=0.004254, batch_cost=0.4272, reader_cost=0.0002 | ETA 01:50:00 2020-11-14 04:05:20 [INFO] [TRAIN] epoch=38, iter=24560/40000, loss=0.2041, lr=0.004251, batch_cost=0.4278, reader_cost=0.0002 | ETA 01:50:05 2020-11-14 04:05:25 [INFO] [TRAIN] epoch=38, iter=24570/40000, loss=0.2422, lr=0.004249, batch_cost=0.4495, reader_cost=0.0002 | ETA 01:55:36 2020-11-14 04:05:30 [INFO] [TRAIN] epoch=38, iter=24580/40000, loss=0.2829, lr=0.004247, batch_cost=0.4847, reader_cost=0.0002 | ETA 02:04:34 2020-11-14 04:05:34 [INFO] [TRAIN] epoch=38, iter=24590/40000, loss=0.2417, lr=0.004244, batch_cost=0.4657, reader_cost=0.0011 | ETA 01:59:36 2020-11-14 04:05:39 [INFO] [TRAIN] epoch=38, iter=24600/40000, loss=0.2183, lr=0.004242, batch_cost=0.4722, reader_cost=0.0055 | ETA 02:01:12 2020-11-14 04:05:44 [INFO] [TRAIN] epoch=38, iter=24610/40000, loss=0.2543, lr=0.004239, batch_cost=0.4575, reader_cost=0.0014 | ETA 01:57:21 2020-11-14 04:05:48 [INFO] [TRAIN] epoch=38, iter=24620/40000, loss=0.2184, lr=0.004237, batch_cost=0.4590, reader_cost=0.0002 | ETA 01:57:39 2020-11-14 04:05:53 [INFO] [TRAIN] epoch=38, iter=24630/40000, loss=0.2023, lr=0.004234, batch_cost=0.4572, reader_cost=0.0002 | ETA 01:57:06 2020-11-14 04:05:57 [INFO] [TRAIN] epoch=38, iter=24640/40000, loss=0.2324, lr=0.004232, batch_cost=0.4704, reader_cost=0.0002 | ETA 02:00:25 2020-11-14 04:06:02 [INFO] [TRAIN] epoch=38, iter=24650/40000, loss=0.2383, lr=0.004229, batch_cost=0.4523, reader_cost=0.0002 | ETA 01:55:43 2020-11-14 04:06:07 [INFO] [TRAIN] epoch=38, iter=24660/40000, loss=0.2765, lr=0.004227, batch_cost=0.4642, reader_cost=0.0002 | ETA 01:58:40 2020-11-14 04:06:11 [INFO] [TRAIN] epoch=38, iter=24670/40000, loss=0.3060, lr=0.004224, batch_cost=0.4586, reader_cost=0.0002 | ETA 01:57:09 2020-11-14 04:06:16 [INFO] [TRAIN] epoch=38, iter=24680/40000, loss=0.3876, lr=0.004222, batch_cost=0.4674, reader_cost=0.0002 | ETA 01:59:21 2020-11-14 04:06:20 [INFO] [TRAIN] epoch=38, iter=24690/40000, loss=0.2092, lr=0.004219, batch_cost=0.4506, reader_cost=0.0002 | ETA 01:54:58 2020-11-14 04:06:25 [INFO] [TRAIN] epoch=38, iter=24700/40000, loss=0.2764, lr=0.004217, batch_cost=0.4745, reader_cost=0.0002 | ETA 02:00:59 2020-11-14 04:06:30 [INFO] [TRAIN] epoch=38, iter=24710/40000, loss=0.1997, lr=0.004214, batch_cost=0.4515, reader_cost=0.0002 | ETA 01:55:03 2020-11-14 04:06:34 [INFO] [TRAIN] epoch=38, iter=24720/40000, loss=0.3167, lr=0.004212, batch_cost=0.4618, reader_cost=0.0002 | ETA 01:57:36 2020-11-14 04:06:39 [INFO] [TRAIN] epoch=38, iter=24730/40000, loss=0.2518, lr=0.004209, batch_cost=0.4437, reader_cost=0.0002 | ETA 01:52:55 2020-11-14 04:06:43 [INFO] [TRAIN] epoch=38, iter=24740/40000, loss=0.1685, lr=0.004207, batch_cost=0.4375, reader_cost=0.0002 | ETA 01:51:15 2020-11-14 04:06:47 [INFO] [TRAIN] epoch=38, iter=24750/40000, loss=0.3035, lr=0.004204, batch_cost=0.4376, reader_cost=0.0002 | ETA 01:51:12 2020-11-14 04:06:52 [INFO] [TRAIN] epoch=38, iter=24760/40000, loss=0.4402, lr=0.004202, batch_cost=0.4381, reader_cost=0.0002 | ETA 01:51:16 2020-11-14 04:06:56 [INFO] [TRAIN] epoch=38, iter=24770/40000, loss=0.2800, lr=0.004200, batch_cost=0.4377, reader_cost=0.0002 | ETA 01:51:06 2020-11-14 04:07:01 [INFO] [TRAIN] epoch=38, iter=24780/40000, loss=0.3273, lr=0.004197, batch_cost=0.4356, reader_cost=0.0002 | ETA 01:50:30 2020-11-14 04:07:06 [INFO] [TRAIN] epoch=38, iter=24790/40000, loss=0.1964, lr=0.004195, batch_cost=0.5056, reader_cost=0.0002 | ETA 02:08:10 2020-11-14 04:07:11 [INFO] [TRAIN] epoch=38, iter=24800/40000, loss=0.2145, lr=0.004192, batch_cost=0.4938, reader_cost=0.0002 | ETA 02:05:05 2020-11-14 04:07:15 [INFO] [TRAIN] epoch=38, iter=24810/40000, loss=0.3027, lr=0.004190, batch_cost=0.4759, reader_cost=0.0002 | ETA 02:00:28 2020-11-14 04:07:20 [INFO] [TRAIN] epoch=38, iter=24820/40000, loss=0.3123, lr=0.004187, batch_cost=0.4340, reader_cost=0.0002 | ETA 01:49:47 2020-11-14 04:07:24 [INFO] [TRAIN] epoch=38, iter=24830/40000, loss=0.1777, lr=0.004185, batch_cost=0.4497, reader_cost=0.0002 | ETA 01:53:42 2020-11-14 04:07:29 [INFO] [TRAIN] epoch=38, iter=24840/40000, loss=0.2406, lr=0.004182, batch_cost=0.4428, reader_cost=0.0002 | ETA 01:51:52 2020-11-14 04:07:33 [INFO] [TRAIN] epoch=38, iter=24850/40000, loss=0.1755, lr=0.004180, batch_cost=0.4410, reader_cost=0.0002 | ETA 01:51:21 2020-11-14 04:07:37 [INFO] [TRAIN] epoch=38, iter=24860/40000, loss=0.2984, lr=0.004177, batch_cost=0.4367, reader_cost=0.0002 | ETA 01:50:12 2020-11-14 04:07:42 [INFO] [TRAIN] epoch=38, iter=24870/40000, loss=0.2777, lr=0.004175, batch_cost=0.4338, reader_cost=0.0002 | ETA 01:49:23 2020-11-14 04:07:46 [INFO] [TRAIN] epoch=38, iter=24880/40000, loss=0.1969, lr=0.004172, batch_cost=0.4288, reader_cost=0.0002 | ETA 01:48:02 2020-11-14 04:07:50 [INFO] [TRAIN] epoch=38, iter=24890/40000, loss=0.2567, lr=0.004170, batch_cost=0.4287, reader_cost=0.0002 | ETA 01:47:57 2020-11-14 04:07:55 [INFO] [TRAIN] epoch=38, iter=24900/40000, loss=0.2353, lr=0.004167, batch_cost=0.4289, reader_cost=0.0002 | ETA 01:47:56 2020-11-14 04:07:59 [INFO] [TRAIN] epoch=38, iter=24910/40000, loss=0.2828, lr=0.004165, batch_cost=0.4297, reader_cost=0.0002 | ETA 01:48:03 2020-11-14 04:08:03 [INFO] [TRAIN] epoch=38, iter=24920/40000, loss=0.2292, lr=0.004162, batch_cost=0.4294, reader_cost=0.0002 | ETA 01:47:54 2020-11-14 04:08:07 [INFO] [TRAIN] epoch=38, iter=24930/40000, loss=0.2068, lr=0.004160, batch_cost=0.4284, reader_cost=0.0002 | ETA 01:47:35 2020-11-14 04:08:12 [INFO] [TRAIN] epoch=38, iter=24940/40000, loss=0.2207, lr=0.004157, batch_cost=0.4454, reader_cost=0.0002 | ETA 01:51:47 2020-11-14 04:08:16 [INFO] [TRAIN] epoch=38, iter=24950/40000, loss=0.1957, lr=0.004155, batch_cost=0.4506, reader_cost=0.0002 | ETA 01:53:01 2020-11-14 04:08:21 [INFO] [TRAIN] epoch=38, iter=24960/40000, loss=0.2121, lr=0.004152, batch_cost=0.4612, reader_cost=0.0002 | ETA 01:55:36 2020-11-14 04:08:25 [INFO] [TRAIN] epoch=38, iter=24970/40000, loss=0.1696, lr=0.004150, batch_cost=0.4386, reader_cost=0.0002 | ETA 01:49:51 2020-11-14 04:08:30 [INFO] [TRAIN] epoch=38, iter=24980/40000, loss=0.3000, lr=0.004148, batch_cost=0.4535, reader_cost=0.0002 | ETA 01:53:31 2020-11-14 04:08:34 [INFO] [TRAIN] epoch=38, iter=24990/40000, loss=0.1891, lr=0.004145, batch_cost=0.4314, reader_cost=0.0002 | ETA 01:47:54 2020-11-14 04:08:39 [INFO] [TRAIN] epoch=38, iter=25000/40000, loss=0.2012, lr=0.004143, batch_cost=0.4393, reader_cost=0.0002 | ETA 01:49:48 2020-11-14 04:08:43 [INFO] [TRAIN] epoch=38, iter=25010/40000, loss=0.2353, lr=0.004140, batch_cost=0.4420, reader_cost=0.0002 | ETA 01:50:25 2020-11-14 04:08:47 [INFO] [TRAIN] epoch=38, iter=25020/40000, loss=0.2296, lr=0.004138, batch_cost=0.4307, reader_cost=0.0002 | ETA 01:47:31 2020-11-14 04:08:52 [INFO] [TRAIN] epoch=38, iter=25030/40000, loss=0.2169, lr=0.004135, batch_cost=0.4361, reader_cost=0.0002 | ETA 01:48:48 2020-11-14 04:08:56 [INFO] [TRAIN] epoch=38, iter=25040/40000, loss=0.2311, lr=0.004133, batch_cost=0.4312, reader_cost=0.0002 | ETA 01:47:30 2020-11-14 04:09:00 [INFO] [TRAIN] epoch=38, iter=25050/40000, loss=0.1846, lr=0.004130, batch_cost=0.4359, reader_cost=0.0002 | ETA 01:48:37 2020-11-14 04:09:05 [INFO] [TRAIN] epoch=38, iter=25060/40000, loss=0.1769, lr=0.004128, batch_cost=0.4353, reader_cost=0.0002 | ETA 01:48:24 2020-11-14 04:09:09 [INFO] [TRAIN] epoch=38, iter=25070/40000, loss=0.3068, lr=0.004125, batch_cost=0.4421, reader_cost=0.0002 | ETA 01:50:01 2020-11-14 04:09:14 [INFO] [TRAIN] epoch=38, iter=25080/40000, loss=0.2215, lr=0.004123, batch_cost=0.4351, reader_cost=0.0002 | ETA 01:48:11 2020-11-14 04:09:18 [INFO] [TRAIN] epoch=38, iter=25090/40000, loss=0.2050, lr=0.004120, batch_cost=0.4336, reader_cost=0.0002 | ETA 01:47:45 2020-11-14 04:09:22 [INFO] [TRAIN] epoch=38, iter=25100/40000, loss=0.2521, lr=0.004118, batch_cost=0.4331, reader_cost=0.0002 | ETA 01:47:33 2020-11-14 04:09:27 [INFO] [TRAIN] epoch=38, iter=25110/40000, loss=0.1788, lr=0.004115, batch_cost=0.4347, reader_cost=0.0002 | ETA 01:47:52 2020-11-14 04:09:32 [INFO] [TRAIN] epoch=39, iter=25120/40000, loss=0.3072, lr=0.004113, batch_cost=0.5689, reader_cost=0.1093 | ETA 02:21:04 2020-11-14 04:09:37 [INFO] [TRAIN] epoch=39, iter=25130/40000, loss=0.2580, lr=0.004110, batch_cost=0.4358, reader_cost=0.0005 | ETA 01:48:00 2020-11-14 04:09:41 [INFO] [TRAIN] epoch=39, iter=25140/40000, loss=0.2322, lr=0.004108, batch_cost=0.4559, reader_cost=0.0002 | ETA 01:52:55 2020-11-14 04:09:46 [INFO] [TRAIN] epoch=39, iter=25150/40000, loss=0.2360, lr=0.004105, batch_cost=0.4339, reader_cost=0.0002 | ETA 01:47:24 2020-11-14 04:09:50 [INFO] [TRAIN] epoch=39, iter=25160/40000, loss=0.1951, lr=0.004103, batch_cost=0.4423, reader_cost=0.0002 | ETA 01:49:24 2020-11-14 04:09:54 [INFO] [TRAIN] epoch=39, iter=25170/40000, loss=0.2048, lr=0.004100, batch_cost=0.4339, reader_cost=0.0002 | ETA 01:47:14 2020-11-14 04:09:59 [INFO] [TRAIN] epoch=39, iter=25180/40000, loss=0.1700, lr=0.004098, batch_cost=0.4401, reader_cost=0.0002 | ETA 01:48:41 2020-11-14 04:10:03 [INFO] [TRAIN] epoch=39, iter=25190/40000, loss=0.2767, lr=0.004095, batch_cost=0.4351, reader_cost=0.0002 | ETA 01:47:23 2020-11-14 04:10:08 [INFO] [TRAIN] epoch=39, iter=25200/40000, loss=0.2430, lr=0.004093, batch_cost=0.4526, reader_cost=0.0002 | ETA 01:51:38 2020-11-14 04:10:12 [INFO] [TRAIN] epoch=39, iter=25210/40000, loss=0.2220, lr=0.004090, batch_cost=0.4383, reader_cost=0.0002 | ETA 01:48:02 2020-11-14 04:10:16 [INFO] [TRAIN] epoch=39, iter=25220/40000, loss=0.1796, lr=0.004088, batch_cost=0.4323, reader_cost=0.0002 | ETA 01:46:29 2020-11-14 04:10:21 [INFO] [TRAIN] epoch=39, iter=25230/40000, loss=0.2197, lr=0.004085, batch_cost=0.4352, reader_cost=0.0002 | ETA 01:47:07 2020-11-14 04:10:25 [INFO] [TRAIN] epoch=39, iter=25240/40000, loss=0.3289, lr=0.004083, batch_cost=0.4510, reader_cost=0.0002 | ETA 01:50:57 2020-11-14 04:10:30 [INFO] [TRAIN] epoch=39, iter=25250/40000, loss=0.3061, lr=0.004081, batch_cost=0.4551, reader_cost=0.0002 | ETA 01:51:53 2020-11-14 04:10:34 [INFO] [TRAIN] epoch=39, iter=25260/40000, loss=0.2265, lr=0.004078, batch_cost=0.4500, reader_cost=0.0002 | ETA 01:50:33 2020-11-14 04:10:38 [INFO] [TRAIN] epoch=39, iter=25270/40000, loss=0.2597, lr=0.004076, batch_cost=0.4302, reader_cost=0.0002 | ETA 01:45:36 2020-11-14 04:10:43 [INFO] [TRAIN] epoch=39, iter=25280/40000, loss=0.2884, lr=0.004073, batch_cost=0.4438, reader_cost=0.0002 | ETA 01:48:52 2020-11-14 04:10:48 [INFO] [TRAIN] epoch=39, iter=25290/40000, loss=0.2318, lr=0.004071, batch_cost=0.4729, reader_cost=0.0002 | ETA 01:55:56 2020-11-14 04:10:52 [INFO] [TRAIN] epoch=39, iter=25300/40000, loss=0.2985, lr=0.004068, batch_cost=0.4633, reader_cost=0.0002 | ETA 01:53:29 2020-11-14 04:10:57 [INFO] [TRAIN] epoch=39, iter=25310/40000, loss=0.1968, lr=0.004066, batch_cost=0.4754, reader_cost=0.0012 | ETA 01:56:23 2020-11-14 04:11:02 [INFO] [TRAIN] epoch=39, iter=25320/40000, loss=0.2053, lr=0.004063, batch_cost=0.4501, reader_cost=0.0002 | ETA 01:50:07 2020-11-14 04:11:06 [INFO] [TRAIN] epoch=39, iter=25330/40000, loss=0.2545, lr=0.004061, batch_cost=0.4585, reader_cost=0.0010 | ETA 01:52:06 2020-11-14 04:11:11 [INFO] [TRAIN] epoch=39, iter=25340/40000, loss=0.2173, lr=0.004058, batch_cost=0.4711, reader_cost=0.0002 | ETA 01:55:06 2020-11-14 04:11:15 [INFO] [TRAIN] epoch=39, iter=25350/40000, loss=0.2699, lr=0.004056, batch_cost=0.4567, reader_cost=0.0002 | ETA 01:51:30 2020-11-14 04:11:20 [INFO] [TRAIN] epoch=39, iter=25360/40000, loss=0.2635, lr=0.004053, batch_cost=0.4422, reader_cost=0.0002 | ETA 01:47:53 2020-11-14 04:11:24 [INFO] [TRAIN] epoch=39, iter=25370/40000, loss=0.2630, lr=0.004051, batch_cost=0.4565, reader_cost=0.0013 | ETA 01:51:19 2020-11-14 04:11:29 [INFO] [TRAIN] epoch=39, iter=25380/40000, loss=0.3107, lr=0.004048, batch_cost=0.4703, reader_cost=0.0002 | ETA 01:54:36 2020-11-14 04:11:34 [INFO] [TRAIN] epoch=39, iter=25390/40000, loss=0.2718, lr=0.004046, batch_cost=0.4662, reader_cost=0.0013 | ETA 01:53:31 2020-11-14 04:11:38 [INFO] [TRAIN] epoch=39, iter=25400/40000, loss=0.2040, lr=0.004043, batch_cost=0.4562, reader_cost=0.0002 | ETA 01:51:00 2020-11-14 04:11:43 [INFO] [TRAIN] epoch=39, iter=25410/40000, loss=0.3124, lr=0.004041, batch_cost=0.4345, reader_cost=0.0002 | ETA 01:45:39 2020-11-14 04:11:47 [INFO] [TRAIN] epoch=39, iter=25420/40000, loss=0.2271, lr=0.004038, batch_cost=0.4368, reader_cost=0.0002 | ETA 01:46:09 2020-11-14 04:11:51 [INFO] [TRAIN] epoch=39, iter=25430/40000, loss=0.2807, lr=0.004036, batch_cost=0.4378, reader_cost=0.0002 | ETA 01:46:19 2020-11-14 04:11:56 [INFO] [TRAIN] epoch=39, iter=25440/40000, loss=0.2297, lr=0.004033, batch_cost=0.4428, reader_cost=0.0002 | ETA 01:47:27 2020-11-14 04:12:00 [INFO] [TRAIN] epoch=39, iter=25450/40000, loss=0.2606, lr=0.004031, batch_cost=0.4566, reader_cost=0.0002 | ETA 01:50:43 2020-11-14 04:12:05 [INFO] [TRAIN] epoch=39, iter=25460/40000, loss=0.2408, lr=0.004028, batch_cost=0.4608, reader_cost=0.0002 | ETA 01:51:39 2020-11-14 04:12:10 [INFO] [TRAIN] epoch=39, iter=25470/40000, loss=0.2421, lr=0.004026, batch_cost=0.4663, reader_cost=0.0002 | ETA 01:52:54 2020-11-14 04:12:14 [INFO] [TRAIN] epoch=39, iter=25480/40000, loss=0.2150, lr=0.004023, batch_cost=0.4389, reader_cost=0.0002 | ETA 01:46:12 2020-11-14 04:12:18 [INFO] [TRAIN] epoch=39, iter=25490/40000, loss=0.2408, lr=0.004021, batch_cost=0.4361, reader_cost=0.0002 | ETA 01:45:28 2020-11-14 04:12:23 [INFO] [TRAIN] epoch=39, iter=25500/40000, loss=0.3328, lr=0.004018, batch_cost=0.4622, reader_cost=0.0002 | ETA 01:51:42 2020-11-14 04:12:28 [INFO] [TRAIN] epoch=39, iter=25510/40000, loss=0.2124, lr=0.004016, batch_cost=0.4772, reader_cost=0.0003 | ETA 01:55:13 2020-11-14 04:12:33 [INFO] [TRAIN] epoch=39, iter=25520/40000, loss=0.2953, lr=0.004013, batch_cost=0.4747, reader_cost=0.0003 | ETA 01:54:33 2020-11-14 04:12:37 [INFO] [TRAIN] epoch=39, iter=25530/40000, loss=0.1937, lr=0.004011, batch_cost=0.4817, reader_cost=0.0003 | ETA 01:56:09 2020-11-14 04:12:42 [INFO] [TRAIN] epoch=39, iter=25540/40000, loss=0.2074, lr=0.004008, batch_cost=0.4437, reader_cost=0.0002 | ETA 01:46:56 2020-11-14 04:12:46 [INFO] [TRAIN] epoch=39, iter=25550/40000, loss=0.2340, lr=0.004006, batch_cost=0.4521, reader_cost=0.0003 | ETA 01:48:52 2020-11-14 04:12:51 [INFO] [TRAIN] epoch=39, iter=25560/40000, loss=0.2513, lr=0.004003, batch_cost=0.4538, reader_cost=0.0003 | ETA 01:49:13 2020-11-14 04:12:55 [INFO] [TRAIN] epoch=39, iter=25570/40000, loss=0.2771, lr=0.004001, batch_cost=0.4367, reader_cost=0.0002 | ETA 01:45:02 2020-11-14 04:13:00 [INFO] [TRAIN] epoch=39, iter=25580/40000, loss=0.1654, lr=0.003998, batch_cost=0.4611, reader_cost=0.0002 | ETA 01:50:49 2020-11-14 04:13:04 [INFO] [TRAIN] epoch=39, iter=25590/40000, loss=0.2320, lr=0.003996, batch_cost=0.4338, reader_cost=0.0002 | ETA 01:44:11 2020-11-14 04:13:09 [INFO] [TRAIN] epoch=39, iter=25600/40000, loss=0.2550, lr=0.003994, batch_cost=0.4328, reader_cost=0.0002 | ETA 01:43:52 2020-11-14 04:13:13 [INFO] [TRAIN] epoch=39, iter=25610/40000, loss=0.2039, lr=0.003991, batch_cost=0.4474, reader_cost=0.0002 | ETA 01:47:18 2020-11-14 04:13:18 [INFO] [TRAIN] epoch=39, iter=25620/40000, loss=0.2419, lr=0.003989, batch_cost=0.4636, reader_cost=0.0002 | ETA 01:51:05 2020-11-14 04:13:22 [INFO] [TRAIN] epoch=39, iter=25630/40000, loss=0.3308, lr=0.003986, batch_cost=0.4279, reader_cost=0.0002 | ETA 01:42:29 2020-11-14 04:13:26 [INFO] [TRAIN] epoch=39, iter=25640/40000, loss=0.2351, lr=0.003984, batch_cost=0.4269, reader_cost=0.0002 | ETA 01:42:10 2020-11-14 04:13:31 [INFO] [TRAIN] epoch=39, iter=25650/40000, loss=0.2882, lr=0.003981, batch_cost=0.4274, reader_cost=0.0002 | ETA 01:42:12 2020-11-14 04:13:35 [INFO] [TRAIN] epoch=39, iter=25660/40000, loss=0.1556, lr=0.003979, batch_cost=0.4258, reader_cost=0.0002 | ETA 01:41:46 2020-11-14 04:13:39 [INFO] [TRAIN] epoch=39, iter=25670/40000, loss=0.1835, lr=0.003976, batch_cost=0.4270, reader_cost=0.0002 | ETA 01:41:59 2020-11-14 04:13:44 [INFO] [TRAIN] epoch=39, iter=25680/40000, loss=0.2918, lr=0.003974, batch_cost=0.4550, reader_cost=0.0003 | ETA 01:48:35 2020-11-14 04:13:48 [INFO] [TRAIN] epoch=39, iter=25690/40000, loss=0.2054, lr=0.003971, batch_cost=0.4354, reader_cost=0.0002 | ETA 01:43:51 2020-11-14 04:13:52 [INFO] [TRAIN] epoch=39, iter=25700/40000, loss=0.2048, lr=0.003969, batch_cost=0.4377, reader_cost=0.0002 | ETA 01:44:19 2020-11-14 04:13:57 [INFO] [TRAIN] epoch=39, iter=25710/40000, loss=0.1970, lr=0.003966, batch_cost=0.4301, reader_cost=0.0002 | ETA 01:42:25 2020-11-14 04:14:01 [INFO] [TRAIN] epoch=39, iter=25720/40000, loss=0.3122, lr=0.003964, batch_cost=0.4790, reader_cost=0.0002 | ETA 01:54:00 2020-11-14 04:14:07 [INFO] [TRAIN] epoch=39, iter=25730/40000, loss=0.2196, lr=0.003961, batch_cost=0.5185, reader_cost=0.0010 | ETA 02:03:19 2020-11-14 04:14:12 [INFO] [TRAIN] epoch=39, iter=25740/40000, loss=0.1817, lr=0.003959, batch_cost=0.5013, reader_cost=0.0002 | ETA 01:59:09 2020-11-14 04:14:19 [INFO] [TRAIN] epoch=39, iter=25750/40000, loss=0.2272, lr=0.003956, batch_cost=0.7069, reader_cost=0.0002 | ETA 02:47:53 2020-11-14 04:14:26 [INFO] [TRAIN] epoch=39, iter=25760/40000, loss=0.2903, lr=0.003954, batch_cost=0.6907, reader_cost=0.0015 | ETA 02:43:56 2020-11-14 04:14:30 [INFO] [TRAIN] epoch=39, iter=25770/40000, loss=0.2847, lr=0.003951, batch_cost=0.4420, reader_cost=0.0002 | ETA 01:44:49 2020-11-14 04:14:36 [INFO] [TRAIN] epoch=40, iter=25780/40000, loss=0.2946, lr=0.003949, batch_cost=0.5883, reader_cost=0.1326 | ETA 02:19:25 2020-11-14 04:14:40 [INFO] [TRAIN] epoch=40, iter=25790/40000, loss=0.3065, lr=0.003946, batch_cost=0.4383, reader_cost=0.0014 | ETA 01:43:48 2020-11-14 04:14:45 [INFO] [TRAIN] epoch=40, iter=25800/40000, loss=0.2478, lr=0.003944, batch_cost=0.4333, reader_cost=0.0002 | ETA 01:42:32 2020-11-14 04:14:49 [INFO] [TRAIN] epoch=40, iter=25810/40000, loss=0.1947, lr=0.003941, batch_cost=0.4793, reader_cost=0.0002 | ETA 01:53:21 2020-11-14 04:14:54 [INFO] [TRAIN] epoch=40, iter=25820/40000, loss=0.2888, lr=0.003939, batch_cost=0.5032, reader_cost=0.0002 | ETA 01:58:56 2020-11-14 04:14:59 [INFO] [TRAIN] epoch=40, iter=25830/40000, loss=0.2187, lr=0.003936, batch_cost=0.4465, reader_cost=0.0002 | ETA 01:45:26 2020-11-14 04:15:03 [INFO] [TRAIN] epoch=40, iter=25840/40000, loss=0.3085, lr=0.003934, batch_cost=0.4396, reader_cost=0.0002 | ETA 01:43:44 2020-11-14 04:15:08 [INFO] [TRAIN] epoch=40, iter=25850/40000, loss=0.2219, lr=0.003931, batch_cost=0.4446, reader_cost=0.0002 | ETA 01:44:50 2020-11-14 04:15:12 [INFO] [TRAIN] epoch=40, iter=25860/40000, loss=0.2042, lr=0.003929, batch_cost=0.4390, reader_cost=0.0002 | ETA 01:43:27 2020-11-14 04:15:16 [INFO] [TRAIN] epoch=40, iter=25870/40000, loss=0.2079, lr=0.003926, batch_cost=0.4338, reader_cost=0.0002 | ETA 01:42:09 2020-11-14 04:15:21 [INFO] [TRAIN] epoch=40, iter=25880/40000, loss=0.1827, lr=0.003924, batch_cost=0.4402, reader_cost=0.0002 | ETA 01:43:35 2020-11-14 04:15:26 [INFO] [TRAIN] epoch=40, iter=25890/40000, loss=0.2514, lr=0.003921, batch_cost=0.4643, reader_cost=0.0002 | ETA 01:49:11 2020-11-14 04:15:30 [INFO] [TRAIN] epoch=40, iter=25900/40000, loss=0.2298, lr=0.003919, batch_cost=0.4508, reader_cost=0.0003 | ETA 01:45:56 2020-11-14 04:15:35 [INFO] [TRAIN] epoch=40, iter=25910/40000, loss=0.2896, lr=0.003916, batch_cost=0.4620, reader_cost=0.0002 | ETA 01:48:29 2020-11-14 04:15:39 [INFO] [TRAIN] epoch=40, iter=25920/40000, loss=0.2278, lr=0.003914, batch_cost=0.4630, reader_cost=0.0003 | ETA 01:48:38 2020-11-14 04:15:44 [INFO] [TRAIN] epoch=40, iter=25930/40000, loss=0.2431, lr=0.003911, batch_cost=0.4900, reader_cost=0.0002 | ETA 01:54:54 2020-11-14 04:15:49 [INFO] [TRAIN] epoch=40, iter=25940/40000, loss=0.1935, lr=0.003909, batch_cost=0.5221, reader_cost=0.0003 | ETA 02:02:20 2020-11-14 04:15:54 [INFO] [TRAIN] epoch=40, iter=25950/40000, loss=0.2906, lr=0.003906, batch_cost=0.4637, reader_cost=0.0016 | ETA 01:48:34 2020-11-14 04:15:58 [INFO] [TRAIN] epoch=40, iter=25960/40000, loss=0.2712, lr=0.003904, batch_cost=0.4399, reader_cost=0.0002 | ETA 01:42:56 2020-11-14 04:16:03 [INFO] [TRAIN] epoch=40, iter=25970/40000, loss=0.2447, lr=0.003901, batch_cost=0.4583, reader_cost=0.0002 | ETA 01:47:09 2020-11-14 04:16:08 [INFO] [TRAIN] epoch=40, iter=25980/40000, loss=0.1843, lr=0.003899, batch_cost=0.4579, reader_cost=0.0002 | ETA 01:47:00 2020-11-14 04:16:12 [INFO] [TRAIN] epoch=40, iter=25990/40000, loss=0.2286, lr=0.003896, batch_cost=0.4452, reader_cost=0.0002 | ETA 01:43:57 2020-11-14 04:16:17 [INFO] [TRAIN] epoch=40, iter=26000/40000, loss=0.2163, lr=0.003894, batch_cost=0.4710, reader_cost=0.0002 | ETA 01:49:53 2020-11-14 04:16:17 [INFO] Start evaluating (total_samples=1449, total_iters=363)... 2020-11-14 04:16:36 [INFO] [EVAL] #Images=1449 mIoU=0.7957 Acc=0.9544 Kappa=0.8987 2020-11-14 04:16:36 [INFO] [EVAL] Class IoU: [0.9473 0.9209 0.4243 0.8875 0.7317 0.8192 0.9541 0.9059 0.9411 0.4547 0.8816 0.5792 0.9098 0.9041 0.8987 0.8724 0.6487 0.8552 0.5019 0.919 0.7523] 2020-11-14 04:16:36 [INFO] [EVAL] Class Acc: [0.9672 0.9501 0.4396 0.9426 0.8176 0.9254 0.9809 0.9653 0.9658 0.6322 0.9412 0.9401 0.9561 0.9443 0.9453 0.9347 0.8268 0.928 0.8843 0.9602 0.9295] 2020-11-14 04:16:46 [INFO] [EVAL] The model with the best validation mIoU (0.7957) was saved at iter 26000. 2020-11-14 04:16:50 [INFO] [TRAIN] epoch=40, iter=26010/40000, loss=0.3229, lr=0.003891, batch_cost=0.4363, reader_cost=0.0014 | ETA 01:41:44 2020-11-14 04:16:55 [INFO] [TRAIN] epoch=40, iter=26020/40000, loss=0.2389, lr=0.003889, batch_cost=0.4311, reader_cost=0.0039 | ETA 01:40:26 2020-11-14 04:16:59 [INFO] [TRAIN] epoch=40, iter=26030/40000, loss=0.2835, lr=0.003886, batch_cost=0.4286, reader_cost=0.0002 | ETA 01:39:46 2020-11-14 04:17:03 [INFO] [TRAIN] epoch=40, iter=26040/40000, loss=0.2891, lr=0.003884, batch_cost=0.4309, reader_cost=0.0002 | ETA 01:40:14 2020-11-14 04:17:08 [INFO] [TRAIN] epoch=40, iter=26050/40000, loss=0.2606, lr=0.003881, batch_cost=0.4377, reader_cost=0.0005 | ETA 01:41:46 2020-11-14 04:17:12 [INFO] [TRAIN] epoch=40, iter=26060/40000, loss=0.1968, lr=0.003879, batch_cost=0.4445, reader_cost=0.0002 | ETA 01:43:15 2020-11-14 04:17:16 [INFO] [TRAIN] epoch=40, iter=26070/40000, loss=0.1807, lr=0.003876, batch_cost=0.4382, reader_cost=0.0002 | ETA 01:41:43 2020-11-14 04:17:21 [INFO] [TRAIN] epoch=40, iter=26080/40000, loss=0.1731, lr=0.003874, batch_cost=0.4322, reader_cost=0.0002 | ETA 01:40:16 2020-11-14 04:17:25 [INFO] [TRAIN] epoch=40, iter=26090/40000, loss=0.2560, lr=0.003871, batch_cost=0.4280, reader_cost=0.0012 | ETA 01:39:13 2020-11-14 04:17:29 [INFO] [TRAIN] epoch=40, iter=26100/40000, loss=0.1953, lr=0.003869, batch_cost=0.4366, reader_cost=0.0002 | ETA 01:41:08 2020-11-14 04:17:34 [INFO] [TRAIN] epoch=40, iter=26110/40000, loss=0.1763, lr=0.003866, batch_cost=0.4429, reader_cost=0.0003 | ETA 01:42:31 2020-11-14 04:17:38 [INFO] [TRAIN] epoch=40, iter=26120/40000, loss=0.2884, lr=0.003864, batch_cost=0.4336, reader_cost=0.0002 | ETA 01:40:18 2020-11-14 04:17:43 [INFO] [TRAIN] epoch=40, iter=26130/40000, loss=0.1876, lr=0.003861, batch_cost=0.4438, reader_cost=0.0002 | ETA 01:42:35 2020-11-14 04:17:47 [INFO] [TRAIN] epoch=40, iter=26140/40000, loss=0.2433, lr=0.003859, batch_cost=0.4387, reader_cost=0.0002 | ETA 01:41:19 2020-11-14 04:17:51 [INFO] [TRAIN] epoch=40, iter=26150/40000, loss=0.2506, lr=0.003856, batch_cost=0.4494, reader_cost=0.0002 | ETA 01:43:44 2020-11-14 04:17:56 [INFO] [TRAIN] epoch=40, iter=26160/40000, loss=0.2367, lr=0.003854, batch_cost=0.4364, reader_cost=0.0002 | ETA 01:40:39 2020-11-14 04:18:00 [INFO] [TRAIN] epoch=40, iter=26170/40000, loss=0.2124, lr=0.003851, batch_cost=0.4553, reader_cost=0.0003 | ETA 01:44:56 2020-11-14 04:18:05 [INFO] [TRAIN] epoch=40, iter=26180/40000, loss=0.2827, lr=0.003849, batch_cost=0.4634, reader_cost=0.0009 | ETA 01:46:43 2020-11-14 04:18:10 [INFO] [TRAIN] epoch=40, iter=26190/40000, loss=0.2482, lr=0.003846, batch_cost=0.4732, reader_cost=0.0002 | ETA 01:48:54 2020-11-14 04:18:15 [INFO] [TRAIN] epoch=40, iter=26200/40000, loss=0.2413, lr=0.003844, batch_cost=0.4873, reader_cost=0.0002 | ETA 01:52:04 2020-11-14 04:18:19 [INFO] [TRAIN] epoch=40, iter=26210/40000, loss=0.2021, lr=0.003841, batch_cost=0.4486, reader_cost=0.0002 | ETA 01:43:06 2020-11-14 04:18:24 [INFO] [TRAIN] epoch=40, iter=26220/40000, loss=0.1809, lr=0.003839, batch_cost=0.4417, reader_cost=0.0055 | ETA 01:41:26 2020-11-14 04:18:28 [INFO] [TRAIN] epoch=40, iter=26230/40000, loss=0.2685, lr=0.003836, batch_cost=0.4458, reader_cost=0.0012 | ETA 01:42:19 2020-11-14 04:18:32 [INFO] [TRAIN] epoch=40, iter=26240/40000, loss=0.2261, lr=0.003834, batch_cost=0.4339, reader_cost=0.0002 | ETA 01:39:29 2020-11-14 04:18:37 [INFO] [TRAIN] epoch=40, iter=26250/40000, loss=0.1853, lr=0.003831, batch_cost=0.4416, reader_cost=0.0002 | ETA 01:41:12 2020-11-14 04:18:41 [INFO] [TRAIN] epoch=40, iter=26260/40000, loss=0.2244, lr=0.003829, batch_cost=0.4346, reader_cost=0.0002 | ETA 01:39:31 2020-11-14 04:18:45 [INFO] [TRAIN] epoch=40, iter=26270/40000, loss=0.2619, lr=0.003826, batch_cost=0.4317, reader_cost=0.0002 | ETA 01:38:47 2020-11-14 04:18:50 [INFO] [TRAIN] epoch=40, iter=26280/40000, loss=0.2479, lr=0.003824, batch_cost=0.4326, reader_cost=0.0002 | ETA 01:38:55 2020-11-14 04:18:54 [INFO] [TRAIN] epoch=40, iter=26290/40000, loss=0.2328, lr=0.003821, batch_cost=0.4355, reader_cost=0.0002 | ETA 01:39:31 2020-11-14 04:18:59 [INFO] [TRAIN] epoch=40, iter=26300/40000, loss=0.2106, lr=0.003819, batch_cost=0.4609, reader_cost=0.0002 | ETA 01:45:14 2020-11-14 04:19:03 [INFO] [TRAIN] epoch=40, iter=26310/40000, loss=0.2448, lr=0.003816, batch_cost=0.4318, reader_cost=0.0002 | ETA 01:38:31 2020-11-14 04:19:07 [INFO] [TRAIN] epoch=40, iter=26320/40000, loss=0.2474, lr=0.003814, batch_cost=0.4344, reader_cost=0.0002 | ETA 01:39:02 2020-11-14 04:19:12 [INFO] [TRAIN] epoch=40, iter=26330/40000, loss=0.3168, lr=0.003811, batch_cost=0.4316, reader_cost=0.0002 | ETA 01:38:20 2020-11-14 04:19:16 [INFO] [TRAIN] epoch=40, iter=26340/40000, loss=0.1915, lr=0.003809, batch_cost=0.4370, reader_cost=0.0002 | ETA 01:39:29 2020-11-14 04:19:20 [INFO] [TRAIN] epoch=40, iter=26350/40000, loss=0.2588, lr=0.003806, batch_cost=0.4376, reader_cost=0.0002 | ETA 01:39:32 2020-11-14 04:19:25 [INFO] [TRAIN] epoch=40, iter=26360/40000, loss=0.1912, lr=0.003804, batch_cost=0.4360, reader_cost=0.0002 | ETA 01:39:06 2020-11-14 04:19:29 [INFO] [TRAIN] epoch=40, iter=26370/40000, loss=0.3210, lr=0.003801, batch_cost=0.4306, reader_cost=0.0002 | ETA 01:37:48 2020-11-14 04:19:33 [INFO] [TRAIN] epoch=40, iter=26380/40000, loss=0.2891, lr=0.003799, batch_cost=0.4361, reader_cost=0.0003 | ETA 01:38:59 2020-11-14 04:19:38 [INFO] [TRAIN] epoch=40, iter=26390/40000, loss=0.2091, lr=0.003796, batch_cost=0.4327, reader_cost=0.0002 | ETA 01:38:08 2020-11-14 04:19:42 [INFO] [TRAIN] epoch=40, iter=26400/40000, loss=0.1838, lr=0.003794, batch_cost=0.4333, reader_cost=0.0002 | ETA 01:38:13 2020-11-14 04:19:46 [INFO] [TRAIN] epoch=40, iter=26410/40000, loss=0.2792, lr=0.003791, batch_cost=0.4299, reader_cost=0.0002 | ETA 01:37:22 2020-11-14 04:19:51 [INFO] [TRAIN] epoch=40, iter=26420/40000, loss=0.2364, lr=0.003789, batch_cost=0.4342, reader_cost=0.0002 | ETA 01:38:16 2020-11-14 04:19:55 [INFO] [TRAIN] epoch=40, iter=26430/40000, loss=0.2327, lr=0.003786, batch_cost=0.4381, reader_cost=0.0038 | ETA 01:39:04 2020-11-14 04:20:00 [INFO] [TRAIN] epoch=40, iter=26440/40000, loss=0.1633, lr=0.003784, batch_cost=0.4509, reader_cost=0.0084 | ETA 01:41:53 2020-11-14 04:20:06 [INFO] [TRAIN] epoch=41, iter=26450/40000, loss=0.1598, lr=0.003781, batch_cost=0.5905, reader_cost=0.0960 | ETA 02:13:21 2020-11-14 04:20:10 [INFO] [TRAIN] epoch=41, iter=26460/40000, loss=0.2869, lr=0.003779, batch_cost=0.4517, reader_cost=0.0005 | ETA 01:41:55 2020-11-14 04:20:15 [INFO] [TRAIN] epoch=41, iter=26470/40000, loss=0.1822, lr=0.003776, batch_cost=0.4536, reader_cost=0.0002 | ETA 01:42:17 2020-11-14 04:20:19 [INFO] [TRAIN] epoch=41, iter=26480/40000, loss=0.2730, lr=0.003774, batch_cost=0.4385, reader_cost=0.0027 | ETA 01:38:48 2020-11-14 04:20:23 [INFO] [TRAIN] epoch=41, iter=26490/40000, loss=0.3098, lr=0.003771, batch_cost=0.4416, reader_cost=0.0002 | ETA 01:39:25 2020-11-14 04:20:28 [INFO] [TRAIN] epoch=41, iter=26500/40000, loss=0.2251, lr=0.003769, batch_cost=0.4480, reader_cost=0.0047 | ETA 01:40:47 2020-11-14 04:20:32 [INFO] [TRAIN] epoch=41, iter=26510/40000, loss=0.2548, lr=0.003766, batch_cost=0.4517, reader_cost=0.0065 | ETA 01:41:32 2020-11-14 04:20:37 [INFO] [TRAIN] epoch=41, iter=26520/40000, loss=0.2138, lr=0.003764, batch_cost=0.4468, reader_cost=0.0090 | ETA 01:40:22 2020-11-14 04:20:41 [INFO] [TRAIN] epoch=41, iter=26530/40000, loss=0.2593, lr=0.003761, batch_cost=0.4549, reader_cost=0.0061 | ETA 01:42:06 2020-11-14 04:20:46 [INFO] [TRAIN] epoch=41, iter=26540/40000, loss=0.2173, lr=0.003759, batch_cost=0.4504, reader_cost=0.0120 | ETA 01:41:01 2020-11-14 04:20:50 [INFO] [TRAIN] epoch=41, iter=26550/40000, loss=0.2228, lr=0.003756, batch_cost=0.4476, reader_cost=0.0069 | ETA 01:40:20 2020-11-14 04:20:55 [INFO] [TRAIN] epoch=41, iter=26560/40000, loss=0.2574, lr=0.003754, batch_cost=0.4436, reader_cost=0.0107 | ETA 01:39:22 2020-11-14 04:20:59 [INFO] [TRAIN] epoch=41, iter=26570/40000, loss=0.2713, lr=0.003751, batch_cost=0.4486, reader_cost=0.0120 | ETA 01:40:24 2020-11-14 04:21:04 [INFO] [TRAIN] epoch=41, iter=26580/40000, loss=0.2633, lr=0.003749, batch_cost=0.4460, reader_cost=0.0066 | ETA 01:39:45 2020-11-14 04:21:08 [INFO] [TRAIN] epoch=41, iter=26590/40000, loss=0.2085, lr=0.003746, batch_cost=0.4425, reader_cost=0.0032 | ETA 01:38:54 2020-11-14 04:21:13 [INFO] [TRAIN] epoch=41, iter=26600/40000, loss=0.2587, lr=0.003744, batch_cost=0.4616, reader_cost=0.0005 | ETA 01:43:05 2020-11-14 04:21:18 [INFO] [TRAIN] epoch=41, iter=26610/40000, loss=0.2227, lr=0.003741, batch_cost=0.4745, reader_cost=0.0003 | ETA 01:45:53 2020-11-14 04:21:22 [INFO] [TRAIN] epoch=41, iter=26620/40000, loss=0.2170, lr=0.003739, batch_cost=0.4634, reader_cost=0.0003 | ETA 01:43:20 2020-11-14 04:21:27 [INFO] [TRAIN] epoch=41, iter=26630/40000, loss=0.1958, lr=0.003736, batch_cost=0.4452, reader_cost=0.0002 | ETA 01:39:11 2020-11-14 04:21:31 [INFO] [TRAIN] epoch=41, iter=26640/40000, loss=0.2608, lr=0.003734, batch_cost=0.4619, reader_cost=0.0002 | ETA 01:42:51 2020-11-14 04:21:36 [INFO] [TRAIN] epoch=41, iter=26650/40000, loss=0.2666, lr=0.003731, batch_cost=0.4373, reader_cost=0.0002 | ETA 01:37:18 2020-11-14 04:21:40 [INFO] [TRAIN] epoch=41, iter=26660/40000, loss=0.1742, lr=0.003729, batch_cost=0.4393, reader_cost=0.0002 | ETA 01:37:40 2020-11-14 04:21:45 [INFO] [TRAIN] epoch=41, iter=26670/40000, loss=0.2836, lr=0.003726, batch_cost=0.4390, reader_cost=0.0002 | ETA 01:37:31 2020-11-14 04:21:49 [INFO] [TRAIN] epoch=41, iter=26680/40000, loss=0.1926, lr=0.003724, batch_cost=0.4528, reader_cost=0.0002 | ETA 01:40:30 2020-11-14 04:21:54 [INFO] [TRAIN] epoch=41, iter=26690/40000, loss=0.2633, lr=0.003721, batch_cost=0.4684, reader_cost=0.0003 | ETA 01:43:54 2020-11-14 04:21:59 [INFO] [TRAIN] epoch=41, iter=26700/40000, loss=0.2486, lr=0.003719, batch_cost=0.5131, reader_cost=0.0013 | ETA 01:53:44 2020-11-14 04:22:04 [INFO] [TRAIN] epoch=41, iter=26710/40000, loss=0.1843, lr=0.003716, batch_cost=0.4968, reader_cost=0.0015 | ETA 01:50:01 2020-11-14 04:22:09 [INFO] [TRAIN] epoch=41, iter=26720/40000, loss=0.2154, lr=0.003714, batch_cost=0.4836, reader_cost=0.0001 | ETA 01:47:02 2020-11-14 04:22:13 [INFO] [TRAIN] epoch=41, iter=26730/40000, loss=0.2117, lr=0.003711, batch_cost=0.4544, reader_cost=0.0027 | ETA 01:40:29 2020-11-14 04:22:18 [INFO] [TRAIN] epoch=41, iter=26740/40000, loss=0.2555, lr=0.003709, batch_cost=0.4463, reader_cost=0.0030 | ETA 01:38:38 2020-11-14 04:22:22 [INFO] [TRAIN] epoch=41, iter=26750/40000, loss=0.3361, lr=0.003706, batch_cost=0.4646, reader_cost=0.0029 | ETA 01:42:35 2020-11-14 04:22:27 [INFO] [TRAIN] epoch=41, iter=26760/40000, loss=0.2894, lr=0.003704, batch_cost=0.4705, reader_cost=0.0002 | ETA 01:43:49 2020-11-14 04:22:32 [INFO] [TRAIN] epoch=41, iter=26770/40000, loss=0.1670, lr=0.003701, batch_cost=0.4854, reader_cost=0.0002 | ETA 01:47:01 2020-11-14 04:22:37 [INFO] [TRAIN] epoch=41, iter=26780/40000, loss=0.3311, lr=0.003698, batch_cost=0.4568, reader_cost=0.0002 | ETA 01:40:38 2020-11-14 04:22:41 [INFO] [TRAIN] epoch=41, iter=26790/40000, loss=0.2547, lr=0.003696, batch_cost=0.4530, reader_cost=0.0026 | ETA 01:39:43 2020-11-14 04:22:46 [INFO] [TRAIN] epoch=41, iter=26800/40000, loss=0.2181, lr=0.003693, batch_cost=0.4410, reader_cost=0.0002 | ETA 01:37:00 2020-11-14 04:22:50 [INFO] [TRAIN] epoch=41, iter=26810/40000, loss=0.3293, lr=0.003691, batch_cost=0.4404, reader_cost=0.0002 | ETA 01:36:49 2020-11-14 04:22:54 [INFO] [TRAIN] epoch=41, iter=26820/40000, loss=0.3124, lr=0.003688, batch_cost=0.4384, reader_cost=0.0002 | ETA 01:36:17 2020-11-14 04:22:59 [INFO] [TRAIN] epoch=41, iter=26830/40000, loss=0.1855, lr=0.003686, batch_cost=0.4417, reader_cost=0.0002 | ETA 01:36:56 2020-11-14 04:23:03 [INFO] [TRAIN] epoch=41, iter=26840/40000, loss=0.2327, lr=0.003683, batch_cost=0.4407, reader_cost=0.0002 | ETA 01:36:39 2020-11-14 04:23:08 [INFO] [TRAIN] epoch=41, iter=26850/40000, loss=0.3000, lr=0.003681, batch_cost=0.4374, reader_cost=0.0002 | ETA 01:35:52 2020-11-14 04:23:12 [INFO] [TRAIN] epoch=41, iter=26860/40000, loss=0.2202, lr=0.003678, batch_cost=0.4870, reader_cost=0.0003 | ETA 01:46:38 2020-11-14 04:23:17 [INFO] [TRAIN] epoch=41, iter=26870/40000, loss=0.2360, lr=0.003676, batch_cost=0.4767, reader_cost=0.0003 | ETA 01:44:18 2020-11-14 04:23:22 [INFO] [TRAIN] epoch=41, iter=26880/40000, loss=0.2568, lr=0.003673, batch_cost=0.4854, reader_cost=0.0003 | ETA 01:46:08 2020-11-14 04:23:27 [INFO] [TRAIN] epoch=41, iter=26890/40000, loss=0.2992, lr=0.003671, batch_cost=0.4535, reader_cost=0.0003 | ETA 01:39:05 2020-11-14 04:23:31 [INFO] [TRAIN] epoch=41, iter=26900/40000, loss=0.2004, lr=0.003668, batch_cost=0.4585, reader_cost=0.0003 | ETA 01:40:06 2020-11-14 04:23:36 [INFO] [TRAIN] epoch=41, iter=26910/40000, loss=0.2409, lr=0.003666, batch_cost=0.4451, reader_cost=0.0002 | ETA 01:37:06 2020-11-14 04:23:40 [INFO] [TRAIN] epoch=41, iter=26920/40000, loss=0.2405, lr=0.003663, batch_cost=0.4607, reader_cost=0.0002 | ETA 01:40:26 2020-11-14 04:23:45 [INFO] [TRAIN] epoch=41, iter=26930/40000, loss=0.2776, lr=0.003661, batch_cost=0.4621, reader_cost=0.0002 | ETA 01:40:39 2020-11-14 04:23:49 [INFO] [TRAIN] epoch=41, iter=26940/40000, loss=0.1991, lr=0.003658, batch_cost=0.4453, reader_cost=0.0002 | ETA 01:36:55 2020-11-14 04:23:54 [INFO] [TRAIN] epoch=41, iter=26950/40000, loss=0.2184, lr=0.003656, batch_cost=0.4791, reader_cost=0.0002 | ETA 01:44:12 2020-11-14 04:23:59 [INFO] [TRAIN] epoch=41, iter=26960/40000, loss=0.2047, lr=0.003653, batch_cost=0.5144, reader_cost=0.0002 | ETA 01:51:47 2020-11-14 04:24:04 [INFO] [TRAIN] epoch=41, iter=26970/40000, loss=0.2435, lr=0.003651, batch_cost=0.5081, reader_cost=0.0003 | ETA 01:50:20 2020-11-14 04:24:09 [INFO] [TRAIN] epoch=41, iter=26980/40000, loss=0.1883, lr=0.003648, batch_cost=0.4757, reader_cost=0.0002 | ETA 01:43:13 2020-11-14 04:24:14 [INFO] [TRAIN] epoch=41, iter=26990/40000, loss=0.1987, lr=0.003646, batch_cost=0.4819, reader_cost=0.0002 | ETA 01:44:29 2020-11-14 04:24:19 [INFO] [TRAIN] epoch=41, iter=27000/40000, loss=0.1351, lr=0.003643, batch_cost=0.4975, reader_cost=0.0002 | ETA 01:47:47 2020-11-14 04:24:24 [INFO] [TRAIN] epoch=41, iter=27010/40000, loss=0.2955, lr=0.003641, batch_cost=0.4705, reader_cost=0.0002 | ETA 01:41:51 2020-11-14 04:24:28 [INFO] [TRAIN] epoch=41, iter=27020/40000, loss=0.1939, lr=0.003638, batch_cost=0.4570, reader_cost=0.0002 | ETA 01:38:51 2020-11-14 04:24:33 [INFO] [TRAIN] epoch=41, iter=27030/40000, loss=0.2363, lr=0.003636, batch_cost=0.4924, reader_cost=0.0027 | ETA 01:46:26 2020-11-14 04:24:38 [INFO] [TRAIN] epoch=41, iter=27040/40000, loss=0.4446, lr=0.003633, batch_cost=0.4641, reader_cost=0.0002 | ETA 01:40:14 2020-11-14 04:24:42 [INFO] [TRAIN] epoch=41, iter=27050/40000, loss=0.2398, lr=0.003631, batch_cost=0.4707, reader_cost=0.0002 | ETA 01:41:35 2020-11-14 04:24:47 [INFO] [TRAIN] epoch=41, iter=27060/40000, loss=0.1955, lr=0.003628, batch_cost=0.4650, reader_cost=0.0003 | ETA 01:40:17 2020-11-14 04:24:52 [INFO] [TRAIN] epoch=41, iter=27070/40000, loss=0.1908, lr=0.003626, batch_cost=0.4640, reader_cost=0.0002 | ETA 01:39:58 2020-11-14 04:24:56 [INFO] [TRAIN] epoch=41, iter=27080/40000, loss=0.2071, lr=0.003623, batch_cost=0.4645, reader_cost=0.0002 | ETA 01:40:01 2020-11-14 04:25:01 [INFO] [TRAIN] epoch=41, iter=27090/40000, loss=0.2853, lr=0.003621, batch_cost=0.4501, reader_cost=0.0002 | ETA 01:36:50 2020-11-14 04:25:05 [INFO] [TRAIN] epoch=41, iter=27100/40000, loss=0.3203, lr=0.003618, batch_cost=0.4410, reader_cost=0.0002 | ETA 01:34:49 2020-11-14 04:25:11 [INFO] [TRAIN] epoch=42, iter=27110/40000, loss=0.2604, lr=0.003616, batch_cost=0.5856, reader_cost=0.1134 | ETA 02:05:48 2020-11-14 04:25:16 [INFO] [TRAIN] epoch=42, iter=27120/40000, loss=0.2241, lr=0.003613, batch_cost=0.4546, reader_cost=0.0005 | ETA 01:37:35 2020-11-14 04:25:21 [INFO] [TRAIN] epoch=42, iter=27130/40000, loss=0.2003, lr=0.003610, batch_cost=0.4924, reader_cost=0.0007 | ETA 01:45:37 2020-11-14 04:25:26 [INFO] [TRAIN] epoch=42, iter=27140/40000, loss=0.2596, lr=0.003608, batch_cost=0.4935, reader_cost=0.0020 | ETA 01:45:46 2020-11-14 04:25:31 [INFO] [TRAIN] epoch=42, iter=27150/40000, loss=0.2641, lr=0.003605, batch_cost=0.5811, reader_cost=0.0002 | ETA 02:04:27 2020-11-14 04:25:36 [INFO] [TRAIN] epoch=42, iter=27160/40000, loss=0.2619, lr=0.003603, batch_cost=0.4723, reader_cost=0.0009 | ETA 01:41:04 2020-11-14 04:25:41 [INFO] [TRAIN] epoch=42, iter=27170/40000, loss=0.2828, lr=0.003600, batch_cost=0.5171, reader_cost=0.0002 | ETA 01:50:34 2020-11-14 04:25:46 [INFO] [TRAIN] epoch=42, iter=27180/40000, loss=0.1896, lr=0.003598, batch_cost=0.5026, reader_cost=0.0002 | ETA 01:47:23 2020-11-14 04:25:51 [INFO] [TRAIN] epoch=42, iter=27190/40000, loss=0.2344, lr=0.003595, batch_cost=0.4772, reader_cost=0.0002 | ETA 01:41:52 2020-11-14 04:25:56 [INFO] [TRAIN] epoch=42, iter=27200/40000, loss=0.2177, lr=0.003593, batch_cost=0.4626, reader_cost=0.0003 | ETA 01:38:40 2020-11-14 04:26:00 [INFO] [TRAIN] epoch=42, iter=27210/40000, loss=0.3272, lr=0.003590, batch_cost=0.4838, reader_cost=0.0002 | ETA 01:43:07 2020-11-14 04:26:05 [INFO] [TRAIN] epoch=42, iter=27220/40000, loss=0.3168, lr=0.003588, batch_cost=0.4749, reader_cost=0.0002 | ETA 01:41:08 2020-11-14 04:26:10 [INFO] [TRAIN] epoch=42, iter=27230/40000, loss=0.1779, lr=0.003585, batch_cost=0.4687, reader_cost=0.0002 | ETA 01:39:45 2020-11-14 04:26:15 [INFO] [TRAIN] epoch=42, iter=27240/40000, loss=0.2376, lr=0.003583, batch_cost=0.4612, reader_cost=0.0002 | ETA 01:38:05 2020-11-14 04:26:19 [INFO] [TRAIN] epoch=42, iter=27250/40000, loss=0.2609, lr=0.003580, batch_cost=0.4725, reader_cost=0.0002 | ETA 01:40:24 2020-11-14 04:26:24 [INFO] [TRAIN] epoch=42, iter=27260/40000, loss=0.2023, lr=0.003578, batch_cost=0.4567, reader_cost=0.0002 | ETA 01:36:58 2020-11-14 04:26:29 [INFO] [TRAIN] epoch=42, iter=27270/40000, loss=0.2002, lr=0.003575, batch_cost=0.4711, reader_cost=0.0002 | ETA 01:39:56 2020-11-14 04:26:33 [INFO] [TRAIN] epoch=42, iter=27280/40000, loss=0.2272, lr=0.003573, batch_cost=0.4555, reader_cost=0.0002 | ETA 01:36:33 2020-11-14 04:26:38 [INFO] [TRAIN] epoch=42, iter=27290/40000, loss=0.2634, lr=0.003570, batch_cost=0.4705, reader_cost=0.0002 | ETA 01:39:39 2020-11-14 04:26:42 [INFO] [TRAIN] epoch=42, iter=27300/40000, loss=0.1868, lr=0.003568, batch_cost=0.4503, reader_cost=0.0003 | ETA 01:35:19 2020-11-14 04:26:47 [INFO] [TRAIN] epoch=42, iter=27310/40000, loss=0.2156, lr=0.003565, batch_cost=0.4459, reader_cost=0.0003 | ETA 01:34:18 2020-11-14 04:26:51 [INFO] [TRAIN] epoch=42, iter=27320/40000, loss=0.1735, lr=0.003563, batch_cost=0.4572, reader_cost=0.0002 | ETA 01:36:36 2020-11-14 04:26:56 [INFO] [TRAIN] epoch=42, iter=27330/40000, loss=0.2642, lr=0.003560, batch_cost=0.4396, reader_cost=0.0002 | ETA 01:32:49 2020-11-14 04:27:00 [INFO] [TRAIN] epoch=42, iter=27340/40000, loss=0.2010, lr=0.003558, batch_cost=0.4494, reader_cost=0.0002 | ETA 01:34:49 2020-11-14 04:27:05 [INFO] [TRAIN] epoch=42, iter=27350/40000, loss=0.2302, lr=0.003555, batch_cost=0.4691, reader_cost=0.0002 | ETA 01:38:53 2020-11-14 04:27:09 [INFO] [TRAIN] epoch=42, iter=27360/40000, loss=0.2853, lr=0.003553, batch_cost=0.4524, reader_cost=0.0002 | ETA 01:35:17 2020-11-14 04:27:14 [INFO] [TRAIN] epoch=42, iter=27370/40000, loss=0.2254, lr=0.003550, batch_cost=0.4364, reader_cost=0.0002 | ETA 01:31:51 2020-11-14 04:27:18 [INFO] [TRAIN] epoch=42, iter=27380/40000, loss=0.2217, lr=0.003547, batch_cost=0.4354, reader_cost=0.0002 | ETA 01:31:34 2020-11-14 04:27:23 [INFO] [TRAIN] epoch=42, iter=27390/40000, loss=0.1781, lr=0.003545, batch_cost=0.4348, reader_cost=0.0002 | ETA 01:31:23 2020-11-14 04:27:27 [INFO] [TRAIN] epoch=42, iter=27400/40000, loss=0.2051, lr=0.003542, batch_cost=0.4347, reader_cost=0.0002 | ETA 01:31:17 2020-11-14 04:27:31 [INFO] [TRAIN] epoch=42, iter=27410/40000, loss=0.3209, lr=0.003540, batch_cost=0.4436, reader_cost=0.0003 | ETA 01:33:05 2020-11-14 04:27:36 [INFO] [TRAIN] epoch=42, iter=27420/40000, loss=0.3072, lr=0.003537, batch_cost=0.4346, reader_cost=0.0003 | ETA 01:31:06 2020-11-14 04:27:40 [INFO] [TRAIN] epoch=42, iter=27430/40000, loss=0.2064, lr=0.003535, batch_cost=0.4339, reader_cost=0.0003 | ETA 01:30:53 2020-11-14 04:27:44 [INFO] [TRAIN] epoch=42, iter=27440/40000, loss=0.2745, lr=0.003532, batch_cost=0.4297, reader_cost=0.0002 | ETA 01:29:57 2020-11-14 04:27:49 [INFO] [TRAIN] epoch=42, iter=27450/40000, loss=0.3260, lr=0.003530, batch_cost=0.4317, reader_cost=0.0002 | ETA 01:30:17 2020-11-14 04:27:53 [INFO] [TRAIN] epoch=42, iter=27460/40000, loss=0.2005, lr=0.003527, batch_cost=0.4481, reader_cost=0.0002 | ETA 01:33:38 2020-11-14 04:27:58 [INFO] [TRAIN] epoch=42, iter=27470/40000, loss=0.2339, lr=0.003525, batch_cost=0.4529, reader_cost=0.0003 | ETA 01:34:35 2020-11-14 04:28:02 [INFO] [TRAIN] epoch=42, iter=27480/40000, loss=0.2546, lr=0.003522, batch_cost=0.4683, reader_cost=0.0003 | ETA 01:37:42 2020-11-14 04:28:07 [INFO] [TRAIN] epoch=42, iter=27490/40000, loss=0.2215, lr=0.003520, batch_cost=0.4644, reader_cost=0.0002 | ETA 01:36:49 2020-11-14 04:28:12 [INFO] [TRAIN] epoch=42, iter=27500/40000, loss=0.2812, lr=0.003517, batch_cost=0.4837, reader_cost=0.0002 | ETA 01:40:46 2020-11-14 04:28:17 [INFO] [TRAIN] epoch=42, iter=27510/40000, loss=0.1902, lr=0.003515, batch_cost=0.4904, reader_cost=0.0023 | ETA 01:42:04 2020-11-14 04:28:22 [INFO] [TRAIN] epoch=42, iter=27520/40000, loss=0.2513, lr=0.003512, batch_cost=0.4992, reader_cost=0.0056 | ETA 01:43:50 2020-11-14 04:28:27 [INFO] [TRAIN] epoch=42, iter=27530/40000, loss=0.2011, lr=0.003510, batch_cost=0.4946, reader_cost=0.0063 | ETA 01:42:47 2020-11-14 04:28:31 [INFO] [TRAIN] epoch=42, iter=27540/40000, loss=0.2431, lr=0.003507, batch_cost=0.4420, reader_cost=0.0002 | ETA 01:31:47 2020-11-14 04:28:36 [INFO] [TRAIN] epoch=42, iter=27550/40000, loss=0.2986, lr=0.003505, batch_cost=0.4745, reader_cost=0.0002 | ETA 01:38:27 2020-11-14 04:28:40 [INFO] [TRAIN] epoch=42, iter=27560/40000, loss=0.2065, lr=0.003502, batch_cost=0.4612, reader_cost=0.0004 | ETA 01:35:37 2020-11-14 04:28:45 [INFO] [TRAIN] epoch=42, iter=27570/40000, loss=0.2119, lr=0.003500, batch_cost=0.4435, reader_cost=0.0003 | ETA 01:31:52 2020-11-14 04:28:49 [INFO] [TRAIN] epoch=42, iter=27580/40000, loss=0.2139, lr=0.003497, batch_cost=0.4417, reader_cost=0.0002 | ETA 01:31:25 2020-11-14 04:28:54 [INFO] [TRAIN] epoch=42, iter=27590/40000, loss=0.2102, lr=0.003494, batch_cost=0.4405, reader_cost=0.0002 | ETA 01:31:06 2020-11-14 04:28:58 [INFO] [TRAIN] epoch=42, iter=27600/40000, loss=0.2128, lr=0.003492, batch_cost=0.4331, reader_cost=0.0002 | ETA 01:29:30 2020-11-14 04:29:02 [INFO] [TRAIN] epoch=42, iter=27610/40000, loss=0.2025, lr=0.003489, batch_cost=0.4434, reader_cost=0.0002 | ETA 01:31:33 2020-11-14 04:29:07 [INFO] [TRAIN] epoch=42, iter=27620/40000, loss=0.1771, lr=0.003487, batch_cost=0.4298, reader_cost=0.0002 | ETA 01:28:40 2020-11-14 04:29:11 [INFO] [TRAIN] epoch=42, iter=27630/40000, loss=0.2594, lr=0.003484, batch_cost=0.4285, reader_cost=0.0002 | ETA 01:28:20 2020-11-14 04:29:15 [INFO] [TRAIN] epoch=42, iter=27640/40000, loss=0.2357, lr=0.003482, batch_cost=0.4305, reader_cost=0.0002 | ETA 01:28:41 2020-11-14 04:29:20 [INFO] [TRAIN] epoch=42, iter=27650/40000, loss=0.2591, lr=0.003479, batch_cost=0.4290, reader_cost=0.0002 | ETA 01:28:17 2020-11-14 04:29:24 [INFO] [TRAIN] epoch=42, iter=27660/40000, loss=0.2189, lr=0.003477, batch_cost=0.4297, reader_cost=0.0002 | ETA 01:28:21 2020-11-14 04:29:28 [INFO] [TRAIN] epoch=42, iter=27670/40000, loss=0.1676, lr=0.003474, batch_cost=0.4297, reader_cost=0.0002 | ETA 01:28:18 2020-11-14 04:29:32 [INFO] [TRAIN] epoch=42, iter=27680/40000, loss=0.2061, lr=0.003472, batch_cost=0.4296, reader_cost=0.0002 | ETA 01:28:12 2020-11-14 04:29:37 [INFO] [TRAIN] epoch=42, iter=27690/40000, loss=0.2543, lr=0.003469, batch_cost=0.4309, reader_cost=0.0002 | ETA 01:28:24 2020-11-14 04:29:41 [INFO] [TRAIN] epoch=42, iter=27700/40000, loss=0.2415, lr=0.003467, batch_cost=0.4290, reader_cost=0.0002 | ETA 01:27:57 2020-11-14 04:29:45 [INFO] [TRAIN] epoch=42, iter=27710/40000, loss=0.2297, lr=0.003464, batch_cost=0.4299, reader_cost=0.0002 | ETA 01:28:03 2020-11-14 04:29:50 [INFO] [TRAIN] epoch=42, iter=27720/40000, loss=0.2104, lr=0.003462, batch_cost=0.4303, reader_cost=0.0002 | ETA 01:28:04 2020-11-14 04:29:54 [INFO] [TRAIN] epoch=42, iter=27730/40000, loss=0.2259, lr=0.003459, batch_cost=0.4291, reader_cost=0.0002 | ETA 01:27:44 2020-11-14 04:29:58 [INFO] [TRAIN] epoch=42, iter=27740/40000, loss=0.2697, lr=0.003457, batch_cost=0.4291, reader_cost=0.0002 | ETA 01:27:40 2020-11-14 04:30:03 [INFO] [TRAIN] epoch=42, iter=27750/40000, loss=0.2052, lr=0.003454, batch_cost=0.4298, reader_cost=0.0002 | ETA 01:27:45 2020-11-14 04:30:07 [INFO] [TRAIN] epoch=42, iter=27760/40000, loss=0.2204, lr=0.003451, batch_cost=0.4316, reader_cost=0.0002 | ETA 01:28:02 2020-11-14 04:30:12 [INFO] [TRAIN] epoch=43, iter=27770/40000, loss=0.2108, lr=0.003449, batch_cost=0.5549, reader_cost=0.1064 | ETA 01:53:06 2020-11-14 04:30:17 [INFO] [TRAIN] epoch=43, iter=27780/40000, loss=0.2709, lr=0.003446, batch_cost=0.4328, reader_cost=0.0005 | ETA 01:28:09 2020-11-14 04:30:21 [INFO] [TRAIN] epoch=43, iter=27790/40000, loss=0.2586, lr=0.003444, batch_cost=0.4327, reader_cost=0.0002 | ETA 01:28:03 2020-11-14 04:30:26 [INFO] [TRAIN] epoch=43, iter=27800/40000, loss=0.2401, lr=0.003441, batch_cost=0.4895, reader_cost=0.0011 | ETA 01:39:31 2020-11-14 04:30:30 [INFO] [TRAIN] epoch=43, iter=27810/40000, loss=0.2575, lr=0.003439, batch_cost=0.4475, reader_cost=0.0014 | ETA 01:30:54 2020-11-14 04:30:35 [INFO] [TRAIN] epoch=43, iter=27820/40000, loss=0.2570, lr=0.003436, batch_cost=0.4587, reader_cost=0.0002 | ETA 01:33:06 2020-11-14 04:30:40 [INFO] [TRAIN] epoch=43, iter=27830/40000, loss=0.2508, lr=0.003434, batch_cost=0.4818, reader_cost=0.0011 | ETA 01:37:43 2020-11-14 04:30:45 [INFO] [TRAIN] epoch=43, iter=27840/40000, loss=0.2191, lr=0.003431, batch_cost=0.5255, reader_cost=0.0006 | ETA 01:46:29 2020-11-14 04:30:50 [INFO] [TRAIN] epoch=43, iter=27850/40000, loss=0.2278, lr=0.003429, batch_cost=0.4938, reader_cost=0.0002 | ETA 01:39:59 2020-11-14 04:30:55 [INFO] [TRAIN] epoch=43, iter=27860/40000, loss=0.2187, lr=0.003426, batch_cost=0.5072, reader_cost=0.0006 | ETA 01:42:37 2020-11-14 04:31:00 [INFO] [TRAIN] epoch=43, iter=27870/40000, loss=0.1568, lr=0.003424, batch_cost=0.4493, reader_cost=0.0002 | ETA 01:30:49 2020-11-14 04:31:04 [INFO] [TRAIN] epoch=43, iter=27880/40000, loss=0.3901, lr=0.003421, batch_cost=0.4706, reader_cost=0.0003 | ETA 01:35:04 2020-11-14 04:31:09 [INFO] [TRAIN] epoch=43, iter=27890/40000, loss=0.2077, lr=0.003419, batch_cost=0.4922, reader_cost=0.0003 | ETA 01:39:20 2020-11-14 04:31:14 [INFO] [TRAIN] epoch=43, iter=27900/40000, loss=0.1886, lr=0.003416, batch_cost=0.4548, reader_cost=0.0002 | ETA 01:31:43 2020-11-14 04:31:18 [INFO] [TRAIN] epoch=43, iter=27910/40000, loss=0.1922, lr=0.003414, batch_cost=0.4516, reader_cost=0.0002 | ETA 01:30:59 2020-11-14 04:31:23 [INFO] [TRAIN] epoch=43, iter=27920/40000, loss=0.2852, lr=0.003411, batch_cost=0.4447, reader_cost=0.0002 | ETA 01:29:31 2020-11-14 04:31:27 [INFO] [TRAIN] epoch=43, iter=27930/40000, loss=0.2534, lr=0.003408, batch_cost=0.4457, reader_cost=0.0002 | ETA 01:29:39 2020-11-14 04:31:32 [INFO] [TRAIN] epoch=43, iter=27940/40000, loss=0.2049, lr=0.003406, batch_cost=0.4578, reader_cost=0.0002 | ETA 01:32:01 2020-11-14 04:31:36 [INFO] [TRAIN] epoch=43, iter=27950/40000, loss=0.2623, lr=0.003403, batch_cost=0.4417, reader_cost=0.0002 | ETA 01:28:42 2020-11-14 04:31:41 [INFO] [TRAIN] epoch=43, iter=27960/40000, loss=0.2455, lr=0.003401, batch_cost=0.4692, reader_cost=0.0002 | ETA 01:34:09 2020-11-14 04:31:46 [INFO] [TRAIN] epoch=43, iter=27970/40000, loss=0.2337, lr=0.003398, batch_cost=0.4960, reader_cost=0.0002 | ETA 01:39:27 2020-11-14 04:31:50 [INFO] [TRAIN] epoch=43, iter=27980/40000, loss=0.2211, lr=0.003396, batch_cost=0.4554, reader_cost=0.0002 | ETA 01:31:13 2020-11-14 04:31:55 [INFO] [TRAIN] epoch=43, iter=27990/40000, loss=0.1737, lr=0.003393, batch_cost=0.4829, reader_cost=0.0002 | ETA 01:36:39 2020-11-14 04:32:00 [INFO] [TRAIN] epoch=43, iter=28000/40000, loss=0.2535, lr=0.003391, batch_cost=0.4871, reader_cost=0.0002 | ETA 01:37:24 2020-11-14 04:32:00 [INFO] Start evaluating (total_samples=1449, total_iters=363)... 2020-11-14 04:32:24 [INFO] [EVAL] #Images=1449 mIoU=0.7953 Acc=0.9546 Kappa=0.8991 2020-11-14 04:32:24 [INFO] [EVAL] Class IoU: [0.9477 0.9234 0.432 0.8871 0.7127 0.8258 0.9553 0.9079 0.9379 0.4645 0.8859 0.5546 0.9005 0.9107 0.8681 0.8684 0.6314 0.8443 0.5586 0.908 0.777 ] 2020-11-14 04:32:24 [INFO] [EVAL] Class Acc: [0.967 0.9509 0.4479 0.9337 0.8007 0.8989 0.9742 0.9555 0.9577 0.7305 0.9394 0.9397 0.9474 0.9502 0.9352 0.9552 0.8647 0.9227 0.796 0.963 0.9349] 2020-11-14 04:32:29 [INFO] [EVAL] The model with the best validation mIoU (0.7957) was saved at iter 26000. 2020-11-14 04:32:33 [INFO] [TRAIN] epoch=43, iter=28010/40000, loss=0.2664, lr=0.003388, batch_cost=0.4345, reader_cost=0.0004 | ETA 01:26:49 2020-11-14 04:32:37 [INFO] [TRAIN] epoch=43, iter=28020/40000, loss=0.1522, lr=0.003386, batch_cost=0.4364, reader_cost=0.0005 | ETA 01:27:08 2020-11-14 04:32:42 [INFO] [TRAIN] epoch=43, iter=28030/40000, loss=0.2780, lr=0.003383, batch_cost=0.4385, reader_cost=0.0004 | ETA 01:27:28 2020-11-14 04:32:46 [INFO] [TRAIN] epoch=43, iter=28040/40000, loss=0.1655, lr=0.003381, batch_cost=0.4394, reader_cost=0.0002 | ETA 01:27:35 2020-11-14 04:32:50 [INFO] [TRAIN] epoch=43, iter=28050/40000, loss=0.1946, lr=0.003378, batch_cost=0.4398, reader_cost=0.0002 | ETA 01:27:35 2020-11-14 04:32:55 [INFO] [TRAIN] epoch=43, iter=28060/40000, loss=0.2430, lr=0.003375, batch_cost=0.4386, reader_cost=0.0002 | ETA 01:27:16 2020-11-14 04:32:59 [INFO] [TRAIN] epoch=43, iter=28070/40000, loss=0.2143, lr=0.003373, batch_cost=0.4357, reader_cost=0.0005 | ETA 01:26:37 2020-11-14 04:33:04 [INFO] [TRAIN] epoch=43, iter=28080/40000, loss=0.2166, lr=0.003370, batch_cost=0.4342, reader_cost=0.0002 | ETA 01:26:15 2020-11-14 04:33:08 [INFO] [TRAIN] epoch=43, iter=28090/40000, loss=0.2139, lr=0.003368, batch_cost=0.4442, reader_cost=0.0002 | ETA 01:28:10 2020-11-14 04:33:12 [INFO] [TRAIN] epoch=43, iter=28100/40000, loss=0.1807, lr=0.003365, batch_cost=0.4333, reader_cost=0.0002 | ETA 01:25:55 2020-11-14 04:33:17 [INFO] [TRAIN] epoch=43, iter=28110/40000, loss=0.2318, lr=0.003363, batch_cost=0.4339, reader_cost=0.0002 | ETA 01:25:58 2020-11-14 04:33:21 [INFO] [TRAIN] epoch=43, iter=28120/40000, loss=0.1994, lr=0.003360, batch_cost=0.4345, reader_cost=0.0002 | ETA 01:26:02 2020-11-14 04:33:25 [INFO] [TRAIN] epoch=43, iter=28130/40000, loss=0.2071, lr=0.003358, batch_cost=0.4303, reader_cost=0.0002 | ETA 01:25:07 2020-11-14 04:33:30 [INFO] [TRAIN] epoch=43, iter=28140/40000, loss=0.2526, lr=0.003355, batch_cost=0.4286, reader_cost=0.0002 | ETA 01:24:43 2020-11-14 04:33:34 [INFO] [TRAIN] epoch=43, iter=28150/40000, loss=0.2473, lr=0.003353, batch_cost=0.4318, reader_cost=0.0001 | ETA 01:25:16 2020-11-14 04:33:38 [INFO] [TRAIN] epoch=43, iter=28160/40000, loss=0.2228, lr=0.003350, batch_cost=0.4315, reader_cost=0.0002 | ETA 01:25:09 2020-11-14 04:33:43 [INFO] [TRAIN] epoch=43, iter=28170/40000, loss=0.1990, lr=0.003348, batch_cost=0.4419, reader_cost=0.0002 | ETA 01:27:07 2020-11-14 04:33:47 [INFO] [TRAIN] epoch=43, iter=28180/40000, loss=0.2869, lr=0.003345, batch_cost=0.4418, reader_cost=0.0002 | ETA 01:27:02 2020-11-14 04:33:51 [INFO] [TRAIN] epoch=43, iter=28190/40000, loss=0.2332, lr=0.003342, batch_cost=0.4415, reader_cost=0.0002 | ETA 01:26:54 2020-11-14 04:33:56 [INFO] [TRAIN] epoch=43, iter=28200/40000, loss=0.2300, lr=0.003340, batch_cost=0.4423, reader_cost=0.0002 | ETA 01:26:59 2020-11-14 04:34:00 [INFO] [TRAIN] epoch=43, iter=28210/40000, loss=0.1851, lr=0.003337, batch_cost=0.4411, reader_cost=0.0002 | ETA 01:26:40 2020-11-14 04:34:05 [INFO] [TRAIN] epoch=43, iter=28220/40000, loss=0.2162, lr=0.003335, batch_cost=0.4424, reader_cost=0.0002 | ETA 01:26:51 2020-11-14 04:34:09 [INFO] [TRAIN] epoch=43, iter=28230/40000, loss=0.2012, lr=0.003332, batch_cost=0.4419, reader_cost=0.0002 | ETA 01:26:41 2020-11-14 04:34:14 [INFO] [TRAIN] epoch=43, iter=28240/40000, loss=0.2513, lr=0.003330, batch_cost=0.4427, reader_cost=0.0002 | ETA 01:26:46 2020-11-14 04:34:18 [INFO] [TRAIN] epoch=43, iter=28250/40000, loss=0.1597, lr=0.003327, batch_cost=0.4414, reader_cost=0.0002 | ETA 01:26:25 2020-11-14 04:34:22 [INFO] [TRAIN] epoch=43, iter=28260/40000, loss=0.2880, lr=0.003325, batch_cost=0.4423, reader_cost=0.0002 | ETA 01:26:32 2020-11-14 04:34:27 [INFO] [TRAIN] epoch=43, iter=28270/40000, loss=0.2637, lr=0.003322, batch_cost=0.4428, reader_cost=0.0002 | ETA 01:26:34 2020-11-14 04:34:31 [INFO] [TRAIN] epoch=43, iter=28280/40000, loss=0.2560, lr=0.003320, batch_cost=0.4431, reader_cost=0.0002 | ETA 01:26:32 2020-11-14 04:34:36 [INFO] [TRAIN] epoch=43, iter=28290/40000, loss=0.3092, lr=0.003317, batch_cost=0.4428, reader_cost=0.0002 | ETA 01:26:25 2020-11-14 04:34:40 [INFO] [TRAIN] epoch=43, iter=28300/40000, loss=0.2120, lr=0.003315, batch_cost=0.4432, reader_cost=0.0002 | ETA 01:26:25 2020-11-14 04:34:45 [INFO] [TRAIN] epoch=43, iter=28310/40000, loss=0.1793, lr=0.003312, batch_cost=0.4444, reader_cost=0.0002 | ETA 01:26:35 2020-11-14 04:34:52 [INFO] [TRAIN] epoch=43, iter=28320/40000, loss=0.2069, lr=0.003309, batch_cost=0.7414, reader_cost=0.0002 | ETA 02:24:19 2020-11-14 04:35:00 [INFO] [TRAIN] epoch=43, iter=28330/40000, loss=0.1770, lr=0.003307, batch_cost=0.7674, reader_cost=0.0002 | ETA 02:29:15 2020-11-14 04:35:07 [INFO] [TRAIN] epoch=43, iter=28340/40000, loss=0.2203, lr=0.003304, batch_cost=0.7471, reader_cost=0.0002 | ETA 02:25:11 2020-11-14 04:35:15 [INFO] [TRAIN] epoch=43, iter=28350/40000, loss=0.2367, lr=0.003302, batch_cost=0.7624, reader_cost=0.0002 | ETA 02:28:01 2020-11-14 04:35:22 [INFO] [TRAIN] epoch=43, iter=28360/40000, loss=0.2400, lr=0.003299, batch_cost=0.7659, reader_cost=0.0002 | ETA 02:28:34 2020-11-14 04:35:28 [INFO] [TRAIN] epoch=43, iter=28370/40000, loss=0.2645, lr=0.003297, batch_cost=0.5120, reader_cost=0.0002 | ETA 01:39:15 2020-11-14 04:35:33 [INFO] [TRAIN] epoch=43, iter=28380/40000, loss=0.1547, lr=0.003294, batch_cost=0.5712, reader_cost=0.0002 | ETA 01:50:37 2020-11-14 04:35:40 [INFO] [TRAIN] epoch=43, iter=28390/40000, loss=0.3314, lr=0.003292, batch_cost=0.7026, reader_cost=0.0002 | ETA 02:15:56 2020-11-14 04:35:45 [INFO] [TRAIN] epoch=43, iter=28400/40000, loss=0.2196, lr=0.003289, batch_cost=0.4888, reader_cost=0.0002 | ETA 01:34:29 2020-11-14 04:35:50 [INFO] [TRAIN] epoch=43, iter=28410/40000, loss=0.2270, lr=0.003287, batch_cost=0.4700, reader_cost=0.0002 | ETA 01:30:47 2020-11-14 04:35:54 [INFO] [TRAIN] epoch=43, iter=28420/40000, loss=0.1954, lr=0.003284, batch_cost=0.4371, reader_cost=0.0004 | ETA 01:24:22 2020-11-14 04:36:00 [INFO] [TRAIN] epoch=44, iter=28430/40000, loss=0.2686, lr=0.003281, batch_cost=0.5745, reader_cost=0.0946 | ETA 01:50:46 2020-11-14 04:36:04 [INFO] [TRAIN] epoch=44, iter=28440/40000, loss=0.2153, lr=0.003279, batch_cost=0.4385, reader_cost=0.0005 | ETA 01:24:29 2020-11-14 04:36:09 [INFO] [TRAIN] epoch=44, iter=28450/40000, loss=0.1691, lr=0.003276, batch_cost=0.4351, reader_cost=0.0002 | ETA 01:23:45 2020-11-14 04:36:13 [INFO] [TRAIN] epoch=44, iter=28460/40000, loss=0.2245, lr=0.003274, batch_cost=0.4520, reader_cost=0.0002 | ETA 01:26:55 2020-11-14 04:36:18 [INFO] [TRAIN] epoch=44, iter=28470/40000, loss=0.1838, lr=0.003271, batch_cost=0.4576, reader_cost=0.0002 | ETA 01:27:56 2020-11-14 04:36:22 [INFO] [TRAIN] epoch=44, iter=28480/40000, loss=0.3644, lr=0.003269, batch_cost=0.4372, reader_cost=0.0002 | ETA 01:23:56 2020-11-14 04:36:27 [INFO] [TRAIN] epoch=44, iter=28490/40000, loss=0.1596, lr=0.003266, batch_cost=0.4367, reader_cost=0.0002 | ETA 01:23:46 2020-11-14 04:36:31 [INFO] [TRAIN] epoch=44, iter=28500/40000, loss=0.1997, lr=0.003264, batch_cost=0.4342, reader_cost=0.0002 | ETA 01:23:13 2020-11-14 04:36:35 [INFO] [TRAIN] epoch=44, iter=28510/40000, loss=0.1972, lr=0.003261, batch_cost=0.4382, reader_cost=0.0002 | ETA 01:23:54 2020-11-14 04:36:40 [INFO] [TRAIN] epoch=44, iter=28520/40000, loss=0.2254, lr=0.003259, batch_cost=0.4319, reader_cost=0.0002 | ETA 01:22:38 2020-11-14 04:36:44 [INFO] [TRAIN] epoch=44, iter=28530/40000, loss=0.2752, lr=0.003256, batch_cost=0.4324, reader_cost=0.0002 | ETA 01:22:39 2020-11-14 04:36:48 [INFO] [TRAIN] epoch=44, iter=28540/40000, loss=0.3030, lr=0.003253, batch_cost=0.4303, reader_cost=0.0002 | ETA 01:22:11 2020-11-14 04:36:53 [INFO] [TRAIN] epoch=44, iter=28550/40000, loss=0.3045, lr=0.003251, batch_cost=0.4344, reader_cost=0.0002 | ETA 01:22:54 2020-11-14 04:36:57 [INFO] [TRAIN] epoch=44, iter=28560/40000, loss=0.2718, lr=0.003248, batch_cost=0.4314, reader_cost=0.0002 | ETA 01:22:15 2020-11-14 04:37:01 [INFO] [TRAIN] epoch=44, iter=28570/40000, loss=0.2019, lr=0.003246, batch_cost=0.4309, reader_cost=0.0002 | ETA 01:22:05 2020-11-14 04:37:05 [INFO] [TRAIN] epoch=44, iter=28580/40000, loss=0.2841, lr=0.003243, batch_cost=0.4297, reader_cost=0.0002 | ETA 01:21:47 2020-11-14 04:37:10 [INFO] [TRAIN] epoch=44, iter=28590/40000, loss=0.2187, lr=0.003241, batch_cost=0.4313, reader_cost=0.0002 | ETA 01:22:00 2020-11-14 04:37:14 [INFO] [TRAIN] epoch=44, iter=28600/40000, loss=0.2492, lr=0.003238, batch_cost=0.4392, reader_cost=0.0002 | ETA 01:23:26 2020-11-14 04:37:19 [INFO] [TRAIN] epoch=44, iter=28610/40000, loss=0.2338, lr=0.003236, batch_cost=0.4424, reader_cost=0.0002 | ETA 01:23:59 2020-11-14 04:37:23 [INFO] [TRAIN] epoch=44, iter=28620/40000, loss=0.2082, lr=0.003233, batch_cost=0.4505, reader_cost=0.0002 | ETA 01:25:27 2020-11-14 04:37:28 [INFO] [TRAIN] epoch=44, iter=28630/40000, loss=0.2775, lr=0.003231, batch_cost=0.4636, reader_cost=0.0010 | ETA 01:27:51 2020-11-14 04:37:32 [INFO] [TRAIN] epoch=44, iter=28640/40000, loss=0.2243, lr=0.003228, batch_cost=0.4531, reader_cost=0.0002 | ETA 01:25:47 2020-11-14 04:37:37 [INFO] [TRAIN] epoch=44, iter=28650/40000, loss=0.2220, lr=0.003225, batch_cost=0.4327, reader_cost=0.0002 | ETA 01:21:51 2020-11-14 04:37:41 [INFO] [TRAIN] epoch=44, iter=28660/40000, loss=0.2703, lr=0.003223, batch_cost=0.4449, reader_cost=0.0002 | ETA 01:24:05 2020-11-14 04:37:46 [INFO] [TRAIN] epoch=44, iter=28670/40000, loss=0.1768, lr=0.003220, batch_cost=0.4640, reader_cost=0.0002 | ETA 01:27:37 2020-11-14 04:37:50 [INFO] [TRAIN] epoch=44, iter=28680/40000, loss=0.2131, lr=0.003218, batch_cost=0.4502, reader_cost=0.0002 | ETA 01:24:56 2020-11-14 04:37:55 [INFO] [TRAIN] epoch=44, iter=28690/40000, loss=0.2519, lr=0.003215, batch_cost=0.4632, reader_cost=0.0002 | ETA 01:27:19 2020-11-14 04:37:59 [INFO] [TRAIN] epoch=44, iter=28700/40000, loss=0.1981, lr=0.003213, batch_cost=0.4549, reader_cost=0.0002 | ETA 01:25:40 2020-11-14 04:38:05 [INFO] [TRAIN] epoch=44, iter=28710/40000, loss=0.1923, lr=0.003210, batch_cost=0.5147, reader_cost=0.0043 | ETA 01:36:51 2020-11-14 04:38:09 [INFO] [TRAIN] epoch=44, iter=28720/40000, loss=0.2262, lr=0.003208, batch_cost=0.4666, reader_cost=0.0011 | ETA 01:27:43 2020-11-14 04:38:14 [INFO] [TRAIN] epoch=44, iter=28730/40000, loss=0.2073, lr=0.003205, batch_cost=0.4627, reader_cost=0.0002 | ETA 01:26:54 2020-11-14 04:38:18 [INFO] [TRAIN] epoch=44, iter=28740/40000, loss=0.2227, lr=0.003202, batch_cost=0.4548, reader_cost=0.0002 | ETA 01:25:21 2020-11-14 04:38:23 [INFO] [TRAIN] epoch=44, iter=28750/40000, loss=0.2615, lr=0.003200, batch_cost=0.4689, reader_cost=0.0002 | ETA 01:27:54 2020-11-14 04:38:28 [INFO] [TRAIN] epoch=44, iter=28760/40000, loss=0.1793, lr=0.003197, batch_cost=0.4664, reader_cost=0.0002 | ETA 01:27:22 2020-11-14 04:38:32 [INFO] [TRAIN] epoch=44, iter=28770/40000, loss=0.2845, lr=0.003195, batch_cost=0.4542, reader_cost=0.0002 | ETA 01:25:00 2020-11-14 04:38:37 [INFO] [TRAIN] epoch=44, iter=28780/40000, loss=0.1923, lr=0.003192, batch_cost=0.4377, reader_cost=0.0002 | ETA 01:21:51 2020-11-14 04:38:41 [INFO] [TRAIN] epoch=44, iter=28790/40000, loss=0.2031, lr=0.003190, batch_cost=0.4432, reader_cost=0.0002 | ETA 01:22:48 2020-11-14 04:38:45 [INFO] [TRAIN] epoch=44, iter=28800/40000, loss=0.2459, lr=0.003187, batch_cost=0.4347, reader_cost=0.0002 | ETA 01:21:08 2020-11-14 04:38:50 [INFO] [TRAIN] epoch=44, iter=28810/40000, loss=0.2347, lr=0.003185, batch_cost=0.4331, reader_cost=0.0002 | ETA 01:20:46 2020-11-14 04:38:54 [INFO] [TRAIN] epoch=44, iter=28820/40000, loss=0.2086, lr=0.003182, batch_cost=0.4335, reader_cost=0.0002 | ETA 01:20:46 2020-11-14 04:38:58 [INFO] [TRAIN] epoch=44, iter=28830/40000, loss=0.1979, lr=0.003180, batch_cost=0.4357, reader_cost=0.0002 | ETA 01:21:06 2020-11-14 04:39:03 [INFO] [TRAIN] epoch=44, iter=28840/40000, loss=0.1777, lr=0.003177, batch_cost=0.4302, reader_cost=0.0002 | ETA 01:20:01 2020-11-14 04:39:07 [INFO] [TRAIN] epoch=44, iter=28850/40000, loss=0.3331, lr=0.003174, batch_cost=0.4319, reader_cost=0.0002 | ETA 01:20:15 2020-11-14 04:39:11 [INFO] [TRAIN] epoch=44, iter=28860/40000, loss=0.2620, lr=0.003172, batch_cost=0.4313, reader_cost=0.0002 | ETA 01:20:04 2020-11-14 04:39:16 [INFO] [TRAIN] epoch=44, iter=28870/40000, loss=0.2032, lr=0.003169, batch_cost=0.4334, reader_cost=0.0002 | ETA 01:20:23 2020-11-14 04:39:20 [INFO] [TRAIN] epoch=44, iter=28880/40000, loss=0.1890, lr=0.003167, batch_cost=0.4351, reader_cost=0.0002 | ETA 01:20:38 2020-11-14 04:39:24 [INFO] [TRAIN] epoch=44, iter=28890/40000, loss=0.2159, lr=0.003164, batch_cost=0.4342, reader_cost=0.0002 | ETA 01:20:23 2020-11-14 04:39:29 [INFO] [TRAIN] epoch=44, iter=28900/40000, loss=0.1776, lr=0.003162, batch_cost=0.4466, reader_cost=0.0002 | ETA 01:22:37 2020-11-14 04:39:33 [INFO] [TRAIN] epoch=44, iter=28910/40000, loss=0.2688, lr=0.003159, batch_cost=0.4424, reader_cost=0.0002 | ETA 01:21:46 2020-11-14 04:39:38 [INFO] [TRAIN] epoch=44, iter=28920/40000, loss=0.2236, lr=0.003157, batch_cost=0.4451, reader_cost=0.0002 | ETA 01:22:11 2020-11-14 04:39:42 [INFO] [TRAIN] epoch=44, iter=28930/40000, loss=0.1895, lr=0.003154, batch_cost=0.4708, reader_cost=0.0002 | ETA 01:26:51 2020-11-14 04:39:47 [INFO] [TRAIN] epoch=44, iter=28940/40000, loss=0.2503, lr=0.003151, batch_cost=0.4789, reader_cost=0.0002 | ETA 01:28:16 2020-11-14 04:39:52 [INFO] [TRAIN] epoch=44, iter=28950/40000, loss=0.2330, lr=0.003149, batch_cost=0.4547, reader_cost=0.0002 | ETA 01:23:44 2020-11-14 04:39:56 [INFO] [TRAIN] epoch=44, iter=28960/40000, loss=0.1753, lr=0.003146, batch_cost=0.4652, reader_cost=0.0002 | ETA 01:25:36 2020-11-14 04:40:02 [INFO] [TRAIN] epoch=44, iter=28970/40000, loss=0.2075, lr=0.003144, batch_cost=0.5056, reader_cost=0.0002 | ETA 01:32:56 2020-11-14 04:40:06 [INFO] [TRAIN] epoch=44, iter=28980/40000, loss=0.2397, lr=0.003141, batch_cost=0.4735, reader_cost=0.0002 | ETA 01:26:57 2020-11-14 04:40:11 [INFO] [TRAIN] epoch=44, iter=28990/40000, loss=0.1958, lr=0.003139, batch_cost=0.4625, reader_cost=0.0002 | ETA 01:24:52 2020-11-14 04:40:16 [INFO] [TRAIN] epoch=44, iter=29000/40000, loss=0.1764, lr=0.003136, batch_cost=0.4765, reader_cost=0.0002 | ETA 01:27:21 2020-11-14 04:40:20 [INFO] [TRAIN] epoch=44, iter=29010/40000, loss=0.2167, lr=0.003134, batch_cost=0.4548, reader_cost=0.0002 | ETA 01:23:17 2020-11-14 04:40:25 [INFO] [TRAIN] epoch=44, iter=29020/40000, loss=0.2683, lr=0.003131, batch_cost=0.4771, reader_cost=0.0002 | ETA 01:27:18 2020-11-14 04:40:29 [INFO] [TRAIN] epoch=44, iter=29030/40000, loss=0.2331, lr=0.003128, batch_cost=0.4385, reader_cost=0.0002 | ETA 01:20:10 2020-11-14 04:40:34 [INFO] [TRAIN] epoch=44, iter=29040/40000, loss=0.2078, lr=0.003126, batch_cost=0.4372, reader_cost=0.0002 | ETA 01:19:51 2020-11-14 04:40:38 [INFO] [TRAIN] epoch=44, iter=29050/40000, loss=0.2527, lr=0.003123, batch_cost=0.4381, reader_cost=0.0002 | ETA 01:19:56 2020-11-14 04:40:43 [INFO] [TRAIN] epoch=44, iter=29060/40000, loss=0.2188, lr=0.003121, batch_cost=0.4845, reader_cost=0.0002 | ETA 01:28:20 2020-11-14 04:40:48 [INFO] [TRAIN] epoch=44, iter=29070/40000, loss=0.2221, lr=0.003118, batch_cost=0.4912, reader_cost=0.0002 | ETA 01:29:28 2020-11-14 04:40:53 [INFO] [TRAIN] epoch=44, iter=29080/40000, loss=0.1994, lr=0.003116, batch_cost=0.4989, reader_cost=0.0002 | ETA 01:30:47 2020-11-14 04:40:59 [INFO] [TRAIN] epoch=45, iter=29090/40000, loss=0.2273, lr=0.003113, batch_cost=0.6285, reader_cost=0.0892 | ETA 01:54:16 2020-11-14 04:41:04 [INFO] [TRAIN] epoch=45, iter=29100/40000, loss=0.1560, lr=0.003110, batch_cost=0.4693, reader_cost=0.0047 | ETA 01:25:15 2020-11-14 04:41:08 [INFO] [TRAIN] epoch=45, iter=29110/40000, loss=0.2409, lr=0.003108, batch_cost=0.4598, reader_cost=0.0109 | ETA 01:23:27 2020-11-14 04:41:13 [INFO] [TRAIN] epoch=45, iter=29120/40000, loss=0.2399, lr=0.003105, batch_cost=0.4700, reader_cost=0.0074 | ETA 01:25:13 2020-11-14 04:41:18 [INFO] [TRAIN] epoch=45, iter=29130/40000, loss=0.1903, lr=0.003103, batch_cost=0.4925, reader_cost=0.0003 | ETA 01:29:13 2020-11-14 04:41:23 [INFO] [TRAIN] epoch=45, iter=29140/40000, loss=0.2886, lr=0.003100, batch_cost=0.4908, reader_cost=0.0002 | ETA 01:28:50 2020-11-14 04:41:28 [INFO] [TRAIN] epoch=45, iter=29150/40000, loss=0.3153, lr=0.003098, batch_cost=0.5395, reader_cost=0.0002 | ETA 01:37:33 2020-11-14 04:41:34 [INFO] [TRAIN] epoch=45, iter=29160/40000, loss=0.1962, lr=0.003095, batch_cost=0.5133, reader_cost=0.0002 | ETA 01:32:44 2020-11-14 04:41:39 [INFO] [TRAIN] epoch=45, iter=29170/40000, loss=0.1684, lr=0.003093, batch_cost=0.5583, reader_cost=0.0002 | ETA 01:40:46 2020-11-14 04:41:44 [INFO] [TRAIN] epoch=45, iter=29180/40000, loss=0.2233, lr=0.003090, batch_cost=0.5295, reader_cost=0.0003 | ETA 01:35:29 2020-11-14 04:41:50 [INFO] [TRAIN] epoch=45, iter=29190/40000, loss=0.2207, lr=0.003087, batch_cost=0.5268, reader_cost=0.0002 | ETA 01:34:54 2020-11-14 04:41:55 [INFO] [TRAIN] epoch=45, iter=29200/40000, loss=0.2412, lr=0.003085, batch_cost=0.5026, reader_cost=0.0002 | ETA 01:30:28 2020-11-14 04:42:00 [INFO] [TRAIN] epoch=45, iter=29210/40000, loss=0.2071, lr=0.003082, batch_cost=0.4884, reader_cost=0.0039 | ETA 01:27:49 2020-11-14 04:42:04 [INFO] [TRAIN] epoch=45, iter=29220/40000, loss=0.2407, lr=0.003080, batch_cost=0.4624, reader_cost=0.0041 | ETA 01:23:04 2020-11-14 04:42:09 [INFO] [TRAIN] epoch=45, iter=29230/40000, loss=0.1851, lr=0.003077, batch_cost=0.4745, reader_cost=0.0002 | ETA 01:25:10 2020-11-14 04:42:14 [INFO] [TRAIN] epoch=45, iter=29240/40000, loss=0.2124, lr=0.003075, batch_cost=0.4714, reader_cost=0.0002 | ETA 01:24:32 2020-11-14 04:42:18 [INFO] [TRAIN] epoch=45, iter=29250/40000, loss=0.2249, lr=0.003072, batch_cost=0.4647, reader_cost=0.0002 | ETA 01:23:15 2020-11-14 04:42:23 [INFO] [TRAIN] epoch=45, iter=29260/40000, loss=0.2009, lr=0.003070, batch_cost=0.4563, reader_cost=0.0002 | ETA 01:21:40 2020-11-14 04:42:28 [INFO] [TRAIN] epoch=45, iter=29270/40000, loss=0.1938, lr=0.003067, batch_cost=0.4939, reader_cost=0.0002 | ETA 01:28:20 2020-11-14 04:42:33 [INFO] [TRAIN] epoch=45, iter=29280/40000, loss=0.2070, lr=0.003064, batch_cost=0.4983, reader_cost=0.0002 | ETA 01:29:01 2020-11-14 04:42:38 [INFO] [TRAIN] epoch=45, iter=29290/40000, loss=0.1813, lr=0.003062, batch_cost=0.5680, reader_cost=0.0002 | ETA 01:41:22 2020-11-14 04:42:44 [INFO] [TRAIN] epoch=45, iter=29300/40000, loss=0.2427, lr=0.003059, batch_cost=0.5094, reader_cost=0.0002 | ETA 01:30:51 2020-11-14 04:42:49 [INFO] [TRAIN] epoch=45, iter=29310/40000, loss=0.1708, lr=0.003057, batch_cost=0.5238, reader_cost=0.0002 | ETA 01:33:19 2020-11-14 04:42:54 [INFO] [TRAIN] epoch=45, iter=29320/40000, loss=0.1612, lr=0.003054, batch_cost=0.5422, reader_cost=0.0002 | ETA 01:36:30 2020-11-14 04:42:59 [INFO] [TRAIN] epoch=45, iter=29330/40000, loss=0.2477, lr=0.003052, batch_cost=0.4635, reader_cost=0.0002 | ETA 01:22:25 2020-11-14 04:43:03 [INFO] [TRAIN] epoch=45, iter=29340/40000, loss=0.2313, lr=0.003049, batch_cost=0.4542, reader_cost=0.0002 | ETA 01:20:42 2020-11-14 04:43:08 [INFO] [TRAIN] epoch=45, iter=29350/40000, loss=0.2465, lr=0.003046, batch_cost=0.4493, reader_cost=0.0002 | ETA 01:19:44 2020-11-14 04:43:12 [INFO] [TRAIN] epoch=45, iter=29360/40000, loss=0.2032, lr=0.003044, batch_cost=0.4453, reader_cost=0.0002 | ETA 01:18:58 2020-11-14 04:43:17 [INFO] [TRAIN] epoch=45, iter=29370/40000, loss=0.2118, lr=0.003041, batch_cost=0.4395, reader_cost=0.0002 | ETA 01:17:51 2020-11-14 04:43:21 [INFO] [TRAIN] epoch=45, iter=29380/40000, loss=0.2774, lr=0.003039, batch_cost=0.4463, reader_cost=0.0002 | ETA 01:18:59 2020-11-14 04:43:26 [INFO] [TRAIN] epoch=45, iter=29390/40000, loss=0.1982, lr=0.003036, batch_cost=0.4513, reader_cost=0.0002 | ETA 01:19:48 2020-11-14 04:43:30 [INFO] [TRAIN] epoch=45, iter=29400/40000, loss=0.2041, lr=0.003034, batch_cost=0.4719, reader_cost=0.0002 | ETA 01:23:21 2020-11-14 04:43:35 [INFO] [TRAIN] epoch=45, iter=29410/40000, loss=0.2017, lr=0.003031, batch_cost=0.4476, reader_cost=0.0002 | ETA 01:19:00 2020-11-14 04:43:40 [INFO] [TRAIN] epoch=45, iter=29420/40000, loss=0.2460, lr=0.003028, batch_cost=0.4840, reader_cost=0.0002 | ETA 01:25:20 2020-11-14 04:43:45 [INFO] [TRAIN] epoch=45, iter=29430/40000, loss=0.2394, lr=0.003026, batch_cost=0.4767, reader_cost=0.0002 | ETA 01:23:58 2020-11-14 04:43:49 [INFO] [TRAIN] epoch=45, iter=29440/40000, loss=0.2236, lr=0.003023, batch_cost=0.4427, reader_cost=0.0017 | ETA 01:17:54 2020-11-14 04:43:54 [INFO] [TRAIN] epoch=45, iter=29450/40000, loss=0.2341, lr=0.003021, batch_cost=0.4762, reader_cost=0.0002 | ETA 01:23:43 2020-11-14 04:43:58 [INFO] [TRAIN] epoch=45, iter=29460/40000, loss=0.3906, lr=0.003018, batch_cost=0.4348, reader_cost=0.0002 | ETA 01:16:22 2020-11-14 04:44:03 [INFO] [TRAIN] epoch=45, iter=29470/40000, loss=0.2413, lr=0.003016, batch_cost=0.4455, reader_cost=0.0002 | ETA 01:18:10 2020-11-14 04:44:07 [INFO] [TRAIN] epoch=45, iter=29480/40000, loss=0.2576, lr=0.003013, batch_cost=0.4351, reader_cost=0.0002 | ETA 01:16:17 2020-11-14 04:44:12 [INFO] [TRAIN] epoch=45, iter=29490/40000, loss=0.2312, lr=0.003010, batch_cost=0.4944, reader_cost=0.0002 | ETA 01:26:36 2020-11-14 04:44:17 [INFO] [TRAIN] epoch=45, iter=29500/40000, loss=0.1998, lr=0.003008, batch_cost=0.4817, reader_cost=0.0002 | ETA 01:24:18 2020-11-14 04:44:21 [INFO] [TRAIN] epoch=45, iter=29510/40000, loss=0.1955, lr=0.003005, batch_cost=0.4525, reader_cost=0.0002 | ETA 01:19:07 2020-11-14 04:44:26 [INFO] [TRAIN] epoch=45, iter=29520/40000, loss=0.2781, lr=0.003003, batch_cost=0.4588, reader_cost=0.0002 | ETA 01:20:07 2020-11-14 04:44:30 [INFO] [TRAIN] epoch=45, iter=29530/40000, loss=0.2249, lr=0.003000, batch_cost=0.4386, reader_cost=0.0002 | ETA 01:16:32 2020-11-14 04:44:35 [INFO] [TRAIN] epoch=45, iter=29540/40000, loss=0.2514, lr=0.002998, batch_cost=0.4649, reader_cost=0.0002 | ETA 01:21:02 2020-11-14 04:44:39 [INFO] [TRAIN] epoch=45, iter=29550/40000, loss=0.2559, lr=0.002995, batch_cost=0.4528, reader_cost=0.0002 | ETA 01:18:51 2020-11-14 04:44:44 [INFO] [TRAIN] epoch=45, iter=29560/40000, loss=0.1865, lr=0.002992, batch_cost=0.4781, reader_cost=0.0002 | ETA 01:23:10 2020-11-14 04:44:49 [INFO] [TRAIN] epoch=45, iter=29570/40000, loss=0.1521, lr=0.002990, batch_cost=0.5088, reader_cost=0.0001 | ETA 01:28:27 2020-11-14 04:44:54 [INFO] [TRAIN] epoch=45, iter=29580/40000, loss=0.1872, lr=0.002987, batch_cost=0.4513, reader_cost=0.0002 | ETA 01:18:22 2020-11-14 04:44:58 [INFO] [TRAIN] epoch=45, iter=29590/40000, loss=0.1772, lr=0.002985, batch_cost=0.4302, reader_cost=0.0001 | ETA 01:14:38 2020-11-14 04:45:02 [INFO] [TRAIN] epoch=45, iter=29600/40000, loss=0.2167, lr=0.002982, batch_cost=0.4455, reader_cost=0.0002 | ETA 01:17:12 2020-11-14 04:45:07 [INFO] [TRAIN] epoch=45, iter=29610/40000, loss=0.1794, lr=0.002980, batch_cost=0.4606, reader_cost=0.0002 | ETA 01:19:45 2020-11-14 04:45:12 [INFO] [TRAIN] epoch=45, iter=29620/40000, loss=0.1857, lr=0.002977, batch_cost=0.4441, reader_cost=0.0002 | ETA 01:16:49 2020-11-14 04:45:16 [INFO] [TRAIN] epoch=45, iter=29630/40000, loss=0.1816, lr=0.002974, batch_cost=0.4450, reader_cost=0.0002 | ETA 01:16:55 2020-11-14 04:45:21 [INFO] [TRAIN] epoch=45, iter=29640/40000, loss=0.2093, lr=0.002972, batch_cost=0.4588, reader_cost=0.0002 | ETA 01:19:13 2020-11-14 04:45:25 [INFO] [TRAIN] epoch=45, iter=29650/40000, loss=0.2513, lr=0.002969, batch_cost=0.4480, reader_cost=0.0002 | ETA 01:17:17 2020-11-14 04:45:30 [INFO] [TRAIN] epoch=45, iter=29660/40000, loss=0.1586, lr=0.002967, batch_cost=0.4535, reader_cost=0.0002 | ETA 01:18:08 2020-11-14 04:45:34 [INFO] [TRAIN] epoch=45, iter=29670/40000, loss=0.1765, lr=0.002964, batch_cost=0.4655, reader_cost=0.0002 | ETA 01:20:08 2020-11-14 04:45:39 [INFO] [TRAIN] epoch=45, iter=29680/40000, loss=0.1838, lr=0.002962, batch_cost=0.4737, reader_cost=0.0002 | ETA 01:21:28 2020-11-14 04:45:44 [INFO] [TRAIN] epoch=45, iter=29690/40000, loss=0.2340, lr=0.002959, batch_cost=0.4887, reader_cost=0.0002 | ETA 01:23:58 2020-11-14 04:45:49 [INFO] [TRAIN] epoch=45, iter=29700/40000, loss=0.2768, lr=0.002956, batch_cost=0.4645, reader_cost=0.0002 | ETA 01:19:44 2020-11-14 04:45:53 [INFO] [TRAIN] epoch=45, iter=29710/40000, loss=0.1827, lr=0.002954, batch_cost=0.4658, reader_cost=0.0002 | ETA 01:19:53 2020-11-14 04:45:58 [INFO] [TRAIN] epoch=45, iter=29720/40000, loss=0.2180, lr=0.002951, batch_cost=0.4448, reader_cost=0.0002 | ETA 01:16:12 2020-11-14 04:46:02 [INFO] [TRAIN] epoch=45, iter=29730/40000, loss=0.1783, lr=0.002949, batch_cost=0.4514, reader_cost=0.0002 | ETA 01:17:16 2020-11-14 04:46:07 [INFO] [TRAIN] epoch=45, iter=29740/40000, loss=0.2681, lr=0.002946, batch_cost=0.4700, reader_cost=0.0002 | ETA 01:20:22 2020-11-14 04:46:12 [INFO] [TRAIN] epoch=46, iter=29750/40000, loss=0.1684, lr=0.002944, batch_cost=0.5666, reader_cost=0.0854 | ETA 01:36:47 2020-11-14 04:46:17 [INFO] [TRAIN] epoch=46, iter=29760/40000, loss=0.2242, lr=0.002941, batch_cost=0.4662, reader_cost=0.0005 | ETA 01:19:33 2020-11-14 04:46:22 [INFO] [TRAIN] epoch=46, iter=29770/40000, loss=0.2054, lr=0.002938, batch_cost=0.4374, reader_cost=0.0002 | ETA 01:14:34 2020-11-14 04:46:26 [INFO] [TRAIN] epoch=46, iter=29780/40000, loss=0.1787, lr=0.002936, batch_cost=0.4393, reader_cost=0.0002 | ETA 01:14:49 2020-11-14 04:46:31 [INFO] [TRAIN] epoch=46, iter=29790/40000, loss=0.2103, lr=0.002933, batch_cost=0.4642, reader_cost=0.0002 | ETA 01:18:59 2020-11-14 04:46:35 [INFO] [TRAIN] epoch=46, iter=29800/40000, loss=0.1986, lr=0.002931, batch_cost=0.4698, reader_cost=0.0002 | ETA 01:19:52 2020-11-14 04:46:40 [INFO] [TRAIN] epoch=46, iter=29810/40000, loss=0.2260, lr=0.002928, batch_cost=0.4370, reader_cost=0.0002 | ETA 01:14:12 2020-11-14 04:46:44 [INFO] [TRAIN] epoch=46, iter=29820/40000, loss=0.1705, lr=0.002926, batch_cost=0.4439, reader_cost=0.0002 | ETA 01:15:18 2020-11-14 04:46:49 [INFO] [TRAIN] epoch=46, iter=29830/40000, loss=0.2062, lr=0.002923, batch_cost=0.4776, reader_cost=0.0002 | ETA 01:20:57 2020-11-14 04:46:53 [INFO] [TRAIN] epoch=46, iter=29840/40000, loss=0.2530, lr=0.002920, batch_cost=0.4353, reader_cost=0.0002 | ETA 01:13:43 2020-11-14 04:46:58 [INFO] [TRAIN] epoch=46, iter=29850/40000, loss=0.1956, lr=0.002918, batch_cost=0.4360, reader_cost=0.0002 | ETA 01:13:45 2020-11-14 04:47:02 [INFO] [TRAIN] epoch=46, iter=29860/40000, loss=0.1789, lr=0.002915, batch_cost=0.4365, reader_cost=0.0002 | ETA 01:13:46 2020-11-14 04:47:07 [INFO] [TRAIN] epoch=46, iter=29870/40000, loss=0.2919, lr=0.002913, batch_cost=0.4981, reader_cost=0.0002 | ETA 01:24:05 2020-11-14 04:47:12 [INFO] [TRAIN] epoch=46, iter=29880/40000, loss=0.2469, lr=0.002910, batch_cost=0.4978, reader_cost=0.0002 | ETA 01:23:57 2020-11-14 04:47:17 [INFO] [TRAIN] epoch=46, iter=29890/40000, loss=0.2365, lr=0.002908, batch_cost=0.4813, reader_cost=0.0002 | ETA 01:21:06 2020-11-14 04:47:21 [INFO] [TRAIN] epoch=46, iter=29900/40000, loss=0.2135, lr=0.002905, batch_cost=0.4789, reader_cost=0.0002 | ETA 01:20:36 2020-11-14 04:47:26 [INFO] [TRAIN] epoch=46, iter=29910/40000, loss=0.2102, lr=0.002902, batch_cost=0.4460, reader_cost=0.0002 | ETA 01:15:00 2020-11-14 04:47:30 [INFO] [TRAIN] epoch=46, iter=29920/40000, loss=0.2010, lr=0.002900, batch_cost=0.4340, reader_cost=0.0002 | ETA 01:12:54 2020-11-14 04:47:35 [INFO] [TRAIN] epoch=46, iter=29930/40000, loss=0.2157, lr=0.002897, batch_cost=0.4350, reader_cost=0.0002 | ETA 01:13:00 2020-11-14 04:47:39 [INFO] [TRAIN] epoch=46, iter=29940/40000, loss=0.1826, lr=0.002895, batch_cost=0.4369, reader_cost=0.0011 | ETA 01:13:15 2020-11-14 04:47:43 [INFO] [TRAIN] epoch=46, iter=29950/40000, loss=0.1824, lr=0.002892, batch_cost=0.4341, reader_cost=0.0002 | ETA 01:12:42 2020-11-14 04:47:48 [INFO] [TRAIN] epoch=46, iter=29960/40000, loss=0.2112, lr=0.002889, batch_cost=0.4327, reader_cost=0.0002 | ETA 01:12:24 2020-11-14 04:47:52 [INFO] [TRAIN] epoch=46, iter=29970/40000, loss=0.2085, lr=0.002887, batch_cost=0.4305, reader_cost=0.0002 | ETA 01:11:58 2020-11-14 04:47:56 [INFO] [TRAIN] epoch=46, iter=29980/40000, loss=0.1946, lr=0.002884, batch_cost=0.4260, reader_cost=0.0002 | ETA 01:11:08 2020-11-14 04:48:01 [INFO] [TRAIN] epoch=46, iter=29990/40000, loss=0.1675, lr=0.002882, batch_cost=0.4267, reader_cost=0.0002 | ETA 01:11:11 2020-11-14 04:48:05 [INFO] [TRAIN] epoch=46, iter=30000/40000, loss=0.2132, lr=0.002879, batch_cost=0.4267, reader_cost=0.0002 | ETA 01:11:07 2020-11-14 04:48:05 [INFO] Start evaluating (total_samples=1449, total_iters=363)... 2020-11-14 04:48:26 [INFO] [EVAL] #Images=1449 mIoU=0.7995 Acc=0.9556 Kappa=0.9019 2020-11-14 04:48:26 [INFO] [EVAL] Class IoU: [0.9495 0.9295 0.437 0.89 0.7257 0.8184 0.9525 0.913 0.9441 0.4507 0.8919 0.5669 0.9046 0.9178 0.897 0.8763 0.6653 0.8506 0.5468 0.922 0.7407] 2020-11-14 04:48:26 [INFO] [EVAL] Class Acc: [0.9702 0.9605 0.4498 0.9432 0.813 0.8852 0.9754 0.973 0.9717 0.6221 0.9323 0.9351 0.9425 0.9569 0.941 0.9423 0.8283 0.9437 0.8377 0.9638 0.8767] 2020-11-14 04:48:34 [INFO] [EVAL] The model with the best validation mIoU (0.7995) was saved at iter 30000. 2020-11-14 04:48:39 [INFO] [TRAIN] epoch=46, iter=30010/40000, loss=0.2142, lr=0.002877, batch_cost=0.4902, reader_cost=0.0016 | ETA 01:21:37 2020-11-14 04:48:44 [INFO] [TRAIN] epoch=46, iter=30020/40000, loss=0.1741, lr=0.002874, batch_cost=0.4845, reader_cost=0.0002 | ETA 01:20:35 2020-11-14 04:48:49 [INFO] [TRAIN] epoch=46, iter=30030/40000, loss=0.1804, lr=0.002871, batch_cost=0.4774, reader_cost=0.0005 | ETA 01:19:19 2020-11-14 04:48:54 [INFO] [TRAIN] epoch=46, iter=30040/40000, loss=0.2288, lr=0.002869, batch_cost=0.5033, reader_cost=0.0005 | ETA 01:23:32 2020-11-14 04:48:59 [INFO] [TRAIN] epoch=46, iter=30050/40000, loss=0.2261, lr=0.002866, batch_cost=0.5111, reader_cost=0.0002 | ETA 01:24:45 2020-11-14 04:49:04 [INFO] [TRAIN] epoch=46, iter=30060/40000, loss=0.2281, lr=0.002864, batch_cost=0.5294, reader_cost=0.0015 | ETA 01:27:42 2020-11-14 04:49:09 [INFO] [TRAIN] epoch=46, iter=30070/40000, loss=0.2653, lr=0.002861, batch_cost=0.5267, reader_cost=0.0003 | ETA 01:27:10 2020-11-14 04:49:14 [INFO] [TRAIN] epoch=46, iter=30080/40000, loss=0.2345, lr=0.002858, batch_cost=0.4823, reader_cost=0.0002 | ETA 01:19:44 2020-11-14 04:49:19 [INFO] [TRAIN] epoch=46, iter=30090/40000, loss=0.2980, lr=0.002856, batch_cost=0.4957, reader_cost=0.0002 | ETA 01:21:52 2020-11-14 04:49:23 [INFO] [TRAIN] epoch=46, iter=30100/40000, loss=0.2056, lr=0.002853, batch_cost=0.4403, reader_cost=0.0002 | ETA 01:12:38 2020-11-14 04:49:28 [INFO] [TRAIN] epoch=46, iter=30110/40000, loss=0.2068, lr=0.002851, batch_cost=0.4352, reader_cost=0.0002 | ETA 01:11:44 2020-11-14 04:49:32 [INFO] [TRAIN] epoch=46, iter=30120/40000, loss=0.2663, lr=0.002848, batch_cost=0.4432, reader_cost=0.0002 | ETA 01:12:59 2020-11-14 04:49:37 [INFO] [TRAIN] epoch=46, iter=30130/40000, loss=0.1908, lr=0.002846, batch_cost=0.4347, reader_cost=0.0002 | ETA 01:11:30 2020-11-14 04:49:41 [INFO] [TRAIN] epoch=46, iter=30140/40000, loss=0.2393, lr=0.002843, batch_cost=0.4368, reader_cost=0.0002 | ETA 01:11:47 2020-11-14 04:49:45 [INFO] [TRAIN] epoch=46, iter=30150/40000, loss=0.2630, lr=0.002840, batch_cost=0.4388, reader_cost=0.0002 | ETA 01:12:02 2020-11-14 04:49:50 [INFO] [TRAIN] epoch=46, iter=30160/40000, loss=0.2070, lr=0.002838, batch_cost=0.4361, reader_cost=0.0002 | ETA 01:11:31 2020-11-14 04:49:54 [INFO] [TRAIN] epoch=46, iter=30170/40000, loss=0.2295, lr=0.002835, batch_cost=0.4436, reader_cost=0.0002 | ETA 01:12:40 2020-11-14 04:49:59 [INFO] [TRAIN] epoch=46, iter=30180/40000, loss=0.2997, lr=0.002833, batch_cost=0.4591, reader_cost=0.0002 | ETA 01:15:07 2020-11-14 04:50:03 [INFO] [TRAIN] epoch=46, iter=30190/40000, loss=0.1702, lr=0.002830, batch_cost=0.4360, reader_cost=0.0003 | ETA 01:11:16 2020-11-14 04:50:08 [INFO] [TRAIN] epoch=46, iter=30200/40000, loss=0.1999, lr=0.002827, batch_cost=0.4390, reader_cost=0.0002 | ETA 01:11:41 2020-11-14 04:50:12 [INFO] [TRAIN] epoch=46, iter=30210/40000, loss=0.2606, lr=0.002825, batch_cost=0.4414, reader_cost=0.0002 | ETA 01:12:01 2020-11-14 04:50:16 [INFO] [TRAIN] epoch=46, iter=30220/40000, loss=0.2035, lr=0.002822, batch_cost=0.4347, reader_cost=0.0002 | ETA 01:10:50 2020-11-14 04:50:21 [INFO] [TRAIN] epoch=46, iter=30230/40000, loss=0.2063, lr=0.002820, batch_cost=0.4435, reader_cost=0.0002 | ETA 01:12:12 2020-11-14 04:50:25 [INFO] [TRAIN] epoch=46, iter=30240/40000, loss=0.1767, lr=0.002817, batch_cost=0.4598, reader_cost=0.0002 | ETA 01:14:47 2020-11-14 04:50:30 [INFO] [TRAIN] epoch=46, iter=30250/40000, loss=0.2411, lr=0.002815, batch_cost=0.4316, reader_cost=0.0002 | ETA 01:10:08 2020-11-14 04:50:34 [INFO] [TRAIN] epoch=46, iter=30260/40000, loss=0.1748, lr=0.002812, batch_cost=0.4310, reader_cost=0.0002 | ETA 01:09:58 2020-11-14 04:50:38 [INFO] [TRAIN] epoch=46, iter=30270/40000, loss=0.1757, lr=0.002809, batch_cost=0.4312, reader_cost=0.0001 | ETA 01:09:55 2020-11-14 04:50:43 [INFO] [TRAIN] epoch=46, iter=30280/40000, loss=0.2067, lr=0.002807, batch_cost=0.4308, reader_cost=0.0001 | ETA 01:09:47 2020-11-14 04:50:47 [INFO] [TRAIN] epoch=46, iter=30290/40000, loss=0.2526, lr=0.002804, batch_cost=0.4323, reader_cost=0.0002 | ETA 01:09:57 2020-11-14 04:50:51 [INFO] [TRAIN] epoch=46, iter=30300/40000, loss=0.1875, lr=0.002802, batch_cost=0.4345, reader_cost=0.0002 | ETA 01:10:14 2020-11-14 04:50:56 [INFO] [TRAIN] epoch=46, iter=30310/40000, loss=0.2332, lr=0.002799, batch_cost=0.4346, reader_cost=0.0002 | ETA 01:10:11 2020-11-14 04:51:00 [INFO] [TRAIN] epoch=46, iter=30320/40000, loss=0.1953, lr=0.002796, batch_cost=0.4360, reader_cost=0.0002 | ETA 01:10:20 2020-11-14 04:51:04 [INFO] [TRAIN] epoch=46, iter=30330/40000, loss=0.1621, lr=0.002794, batch_cost=0.4497, reader_cost=0.0003 | ETA 01:12:29 2020-11-14 04:51:09 [INFO] [TRAIN] epoch=46, iter=30340/40000, loss=0.2021, lr=0.002791, batch_cost=0.4516, reader_cost=0.0002 | ETA 01:12:42 2020-11-14 04:51:14 [INFO] [TRAIN] epoch=46, iter=30350/40000, loss=0.1890, lr=0.002789, batch_cost=0.4668, reader_cost=0.0002 | ETA 01:15:04 2020-11-14 04:51:18 [INFO] [TRAIN] epoch=46, iter=30360/40000, loss=0.2587, lr=0.002786, batch_cost=0.4545, reader_cost=0.0002 | ETA 01:13:01 2020-11-14 04:51:24 [INFO] [TRAIN] epoch=46, iter=30370/40000, loss=0.2792, lr=0.002783, batch_cost=0.5415, reader_cost=0.0002 | ETA 01:26:54 2020-11-14 04:51:29 [INFO] [TRAIN] epoch=46, iter=30380/40000, loss=0.2058, lr=0.002781, batch_cost=0.4912, reader_cost=0.0010 | ETA 01:18:45 2020-11-14 04:51:34 [INFO] [TRAIN] epoch=46, iter=30390/40000, loss=0.2377, lr=0.002778, batch_cost=0.5054, reader_cost=0.0002 | ETA 01:20:57 2020-11-14 04:51:38 [INFO] [TRAIN] epoch=46, iter=30400/40000, loss=0.2525, lr=0.002776, batch_cost=0.4722, reader_cost=0.0014 | ETA 01:15:33 2020-11-14 04:51:44 [INFO] [TRAIN] epoch=47, iter=30410/40000, loss=0.1578, lr=0.002773, batch_cost=0.5582, reader_cost=0.1117 | ETA 01:29:13 2020-11-14 04:51:48 [INFO] [TRAIN] epoch=47, iter=30420/40000, loss=0.2046, lr=0.002770, batch_cost=0.4310, reader_cost=0.0005 | ETA 01:08:48 2020-11-14 04:51:53 [INFO] [TRAIN] epoch=47, iter=30430/40000, loss=0.1864, lr=0.002768, batch_cost=0.4362, reader_cost=0.0002 | ETA 01:09:34 2020-11-14 04:51:57 [INFO] [TRAIN] epoch=47, iter=30440/40000, loss=0.1783, lr=0.002765, batch_cost=0.4324, reader_cost=0.0002 | ETA 01:08:53 2020-11-14 04:52:01 [INFO] [TRAIN] epoch=47, iter=30450/40000, loss=0.2050, lr=0.002763, batch_cost=0.4328, reader_cost=0.0002 | ETA 01:08:53 2020-11-14 04:52:06 [INFO] [TRAIN] epoch=47, iter=30460/40000, loss=0.2161, lr=0.002760, batch_cost=0.4355, reader_cost=0.0002 | ETA 01:09:14 2020-11-14 04:52:10 [INFO] [TRAIN] epoch=47, iter=30470/40000, loss=0.2339, lr=0.002757, batch_cost=0.4492, reader_cost=0.0002 | ETA 01:11:20 2020-11-14 04:52:15 [INFO] [TRAIN] epoch=47, iter=30480/40000, loss=0.2047, lr=0.002755, batch_cost=0.4573, reader_cost=0.0002 | ETA 01:12:33 2020-11-14 04:52:19 [INFO] [TRAIN] epoch=47, iter=30490/40000, loss=0.2833, lr=0.002752, batch_cost=0.4296, reader_cost=0.0002 | ETA 01:08:05 2020-11-14 04:52:23 [INFO] [TRAIN] epoch=47, iter=30500/40000, loss=0.2460, lr=0.002750, batch_cost=0.4312, reader_cost=0.0002 | ETA 01:08:16 2020-11-14 04:52:28 [INFO] [TRAIN] epoch=47, iter=30510/40000, loss=0.2242, lr=0.002747, batch_cost=0.4326, reader_cost=0.0002 | ETA 01:08:25 2020-11-14 04:52:32 [INFO] [TRAIN] epoch=47, iter=30520/40000, loss=0.2585, lr=0.002745, batch_cost=0.4557, reader_cost=0.0002 | ETA 01:12:00 2020-11-14 04:52:37 [INFO] [TRAIN] epoch=47, iter=30530/40000, loss=0.2121, lr=0.002742, batch_cost=0.4576, reader_cost=0.0002 | ETA 01:12:13 2020-11-14 04:52:41 [INFO] [TRAIN] epoch=47, iter=30540/40000, loss=0.1595, lr=0.002739, batch_cost=0.4387, reader_cost=0.0002 | ETA 01:09:09 2020-11-14 04:52:45 [INFO] [TRAIN] epoch=47, iter=30550/40000, loss=0.1952, lr=0.002737, batch_cost=0.4394, reader_cost=0.0002 | ETA 01:09:12 2020-11-14 04:52:50 [INFO] [TRAIN] epoch=47, iter=30560/40000, loss=0.1893, lr=0.002734, batch_cost=0.4390, reader_cost=0.0002 | ETA 01:09:03 2020-11-14 04:52:54 [INFO] [TRAIN] epoch=47, iter=30570/40000, loss=0.1563, lr=0.002732, batch_cost=0.4378, reader_cost=0.0002 | ETA 01:08:48 2020-11-14 04:52:59 [INFO] [TRAIN] epoch=47, iter=30580/40000, loss=0.2153, lr=0.002729, batch_cost=0.4554, reader_cost=0.0002 | ETA 01:11:29 2020-11-14 04:53:04 [INFO] [TRAIN] epoch=47, iter=30590/40000, loss=0.1850, lr=0.002726, batch_cost=0.4735, reader_cost=0.0002 | ETA 01:14:16 2020-11-14 04:53:08 [INFO] [TRAIN] epoch=47, iter=30600/40000, loss=0.2035, lr=0.002724, batch_cost=0.4434, reader_cost=0.0002 | ETA 01:09:28 2020-11-14 04:53:12 [INFO] [TRAIN] epoch=47, iter=30610/40000, loss=0.2196, lr=0.002721, batch_cost=0.4516, reader_cost=0.0002 | ETA 01:10:40 2020-11-14 04:53:17 [INFO] [TRAIN] epoch=47, iter=30620/40000, loss=0.2394, lr=0.002719, batch_cost=0.4538, reader_cost=0.0002 | ETA 01:10:57 2020-11-14 04:53:22 [INFO] [TRAIN] epoch=47, iter=30630/40000, loss=0.1939, lr=0.002716, batch_cost=0.4505, reader_cost=0.0002 | ETA 01:10:21 2020-11-14 04:53:26 [INFO] [TRAIN] epoch=47, iter=30640/40000, loss=0.1779, lr=0.002713, batch_cost=0.4571, reader_cost=0.0002 | ETA 01:11:18 2020-11-14 04:53:31 [INFO] [TRAIN] epoch=47, iter=30650/40000, loss=0.2100, lr=0.002711, batch_cost=0.4454, reader_cost=0.0002 | ETA 01:09:24 2020-11-14 04:53:35 [INFO] [TRAIN] epoch=47, iter=30660/40000, loss=0.2341, lr=0.002708, batch_cost=0.4370, reader_cost=0.0002 | ETA 01:08:01 2020-11-14 04:53:39 [INFO] [TRAIN] epoch=47, iter=30670/40000, loss=0.1833, lr=0.002706, batch_cost=0.4330, reader_cost=0.0002 | ETA 01:07:20 2020-11-14 04:53:44 [INFO] [TRAIN] epoch=47, iter=30680/40000, loss=0.2521, lr=0.002703, batch_cost=0.4388, reader_cost=0.0002 | ETA 01:08:09 2020-11-14 04:53:48 [INFO] [TRAIN] epoch=47, iter=30690/40000, loss=0.1541, lr=0.002700, batch_cost=0.4355, reader_cost=0.0002 | ETA 01:07:34 2020-11-14 04:53:52 [INFO] [TRAIN] epoch=47, iter=30700/40000, loss=0.2597, lr=0.002698, batch_cost=0.4359, reader_cost=0.0002 | ETA 01:07:33 2020-11-14 04:53:57 [INFO] [TRAIN] epoch=47, iter=30710/40000, loss=0.2114, lr=0.002695, batch_cost=0.4330, reader_cost=0.0002 | ETA 01:07:02 2020-11-14 04:54:01 [INFO] [TRAIN] epoch=47, iter=30720/40000, loss=0.2165, lr=0.002693, batch_cost=0.4323, reader_cost=0.0002 | ETA 01:06:51 2020-11-14 04:54:05 [INFO] [TRAIN] epoch=47, iter=30730/40000, loss=0.2551, lr=0.002690, batch_cost=0.4337, reader_cost=0.0002 | ETA 01:07:00 2020-11-14 04:54:10 [INFO] [TRAIN] epoch=47, iter=30740/40000, loss=0.2798, lr=0.002687, batch_cost=0.4312, reader_cost=0.0002 | ETA 01:06:32 2020-11-14 04:54:14 [INFO] [TRAIN] epoch=47, iter=30750/40000, loss=0.2330, lr=0.002685, batch_cost=0.4340, reader_cost=0.0002 | ETA 01:06:54 2020-11-14 04:54:18 [INFO] [TRAIN] epoch=47, iter=30760/40000, loss=0.2052, lr=0.002682, batch_cost=0.4330, reader_cost=0.0002 | ETA 01:06:41 2020-11-14 04:54:23 [INFO] [TRAIN] epoch=47, iter=30770/40000, loss=0.2465, lr=0.002680, batch_cost=0.4431, reader_cost=0.0002 | ETA 01:08:09 2020-11-14 04:54:27 [INFO] [TRAIN] epoch=47, iter=30780/40000, loss=0.2096, lr=0.002677, batch_cost=0.4523, reader_cost=0.0002 | ETA 01:09:30 2020-11-14 04:54:32 [INFO] [TRAIN] epoch=47, iter=30790/40000, loss=0.1596, lr=0.002674, batch_cost=0.4326, reader_cost=0.0002 | ETA 01:06:24 2020-11-14 04:54:36 [INFO] [TRAIN] epoch=47, iter=30800/40000, loss=0.1949, lr=0.002672, batch_cost=0.4355, reader_cost=0.0002 | ETA 01:06:46 2020-11-14 04:54:40 [INFO] [TRAIN] epoch=47, iter=30810/40000, loss=0.2387, lr=0.002669, batch_cost=0.4301, reader_cost=0.0002 | ETA 01:05:52 2020-11-14 04:54:45 [INFO] [TRAIN] epoch=47, iter=30820/40000, loss=0.1854, lr=0.002667, batch_cost=0.4280, reader_cost=0.0002 | ETA 01:05:29 2020-11-14 04:54:49 [INFO] [TRAIN] epoch=47, iter=30830/40000, loss=0.1621, lr=0.002664, batch_cost=0.4283, reader_cost=0.0002 | ETA 01:05:27 2020-11-14 04:54:53 [INFO] [TRAIN] epoch=47, iter=30840/40000, loss=0.2738, lr=0.002661, batch_cost=0.4379, reader_cost=0.0002 | ETA 01:06:50 2020-11-14 04:54:58 [INFO] [TRAIN] epoch=47, iter=30850/40000, loss=0.2419, lr=0.002659, batch_cost=0.4659, reader_cost=0.0002 | ETA 01:11:03 2020-11-14 04:55:03 [INFO] [TRAIN] epoch=47, iter=30860/40000, loss=0.2020, lr=0.002656, batch_cost=0.4694, reader_cost=0.0002 | ETA 01:11:30 2020-11-14 04:55:07 [INFO] [TRAIN] epoch=47, iter=30870/40000, loss=0.1792, lr=0.002653, batch_cost=0.4796, reader_cost=0.0002 | ETA 01:12:59 2020-11-14 04:55:12 [INFO] [TRAIN] epoch=47, iter=30880/40000, loss=0.2499, lr=0.002651, batch_cost=0.5100, reader_cost=0.0002 | ETA 01:17:31 2020-11-14 04:55:18 [INFO] [TRAIN] epoch=47, iter=30890/40000, loss=0.1786, lr=0.002648, batch_cost=0.5257, reader_cost=0.0002 | ETA 01:19:49 2020-11-14 04:55:22 [INFO] [TRAIN] epoch=47, iter=30900/40000, loss=0.2100, lr=0.002646, batch_cost=0.4469, reader_cost=0.0002 | ETA 01:07:46 2020-11-14 04:55:27 [INFO] [TRAIN] epoch=47, iter=30910/40000, loss=0.2269, lr=0.002643, batch_cost=0.4474, reader_cost=0.0002 | ETA 01:07:47 2020-11-14 04:55:31 [INFO] [TRAIN] epoch=47, iter=30920/40000, loss=0.1789, lr=0.002640, batch_cost=0.4427, reader_cost=0.0002 | ETA 01:06:59 2020-11-14 04:55:35 [INFO] [TRAIN] epoch=47, iter=30930/40000, loss=0.1972, lr=0.002638, batch_cost=0.4392, reader_cost=0.0002 | ETA 01:06:23 2020-11-14 04:55:40 [INFO] [TRAIN] epoch=47, iter=30940/40000, loss=0.1689, lr=0.002635, batch_cost=0.4701, reader_cost=0.0002 | ETA 01:10:59 2020-11-14 04:55:45 [INFO] [TRAIN] epoch=47, iter=30950/40000, loss=0.2271, lr=0.002633, batch_cost=0.4712, reader_cost=0.0002 | ETA 01:11:04 2020-11-14 04:55:49 [INFO] [TRAIN] epoch=47, iter=30960/40000, loss=0.2585, lr=0.002630, batch_cost=0.4390, reader_cost=0.0002 | ETA 01:06:08 2020-11-14 04:55:54 [INFO] [TRAIN] epoch=47, iter=30970/40000, loss=0.1494, lr=0.002627, batch_cost=0.4372, reader_cost=0.0002 | ETA 01:05:47 2020-11-14 04:55:58 [INFO] [TRAIN] epoch=47, iter=30980/40000, loss=0.2188, lr=0.002625, batch_cost=0.4368, reader_cost=0.0002 | ETA 01:05:39 2020-11-14 04:56:02 [INFO] [TRAIN] epoch=47, iter=30990/40000, loss=0.1761, lr=0.002622, batch_cost=0.4386, reader_cost=0.0002 | ETA 01:05:51 2020-11-14 04:56:07 [INFO] [TRAIN] epoch=47, iter=31000/40000, loss=0.1909, lr=0.002620, batch_cost=0.4605, reader_cost=0.0002 | ETA 01:09:04 2020-11-14 04:56:12 [INFO] [TRAIN] epoch=47, iter=31010/40000, loss=0.2019, lr=0.002617, batch_cost=0.4618, reader_cost=0.0002 | ETA 01:09:11 2020-11-14 04:56:16 [INFO] [TRAIN] epoch=47, iter=31020/40000, loss=0.1765, lr=0.002614, batch_cost=0.4545, reader_cost=0.0002 | ETA 01:08:01 2020-11-14 04:56:21 [INFO] [TRAIN] epoch=47, iter=31030/40000, loss=0.2138, lr=0.002612, batch_cost=0.4319, reader_cost=0.0001 | ETA 01:04:34 2020-11-14 04:56:25 [INFO] [TRAIN] epoch=47, iter=31040/40000, loss=0.1639, lr=0.002609, batch_cost=0.4536, reader_cost=0.0002 | ETA 01:07:44 2020-11-14 04:56:30 [INFO] [TRAIN] epoch=47, iter=31050/40000, loss=0.2022, lr=0.002607, batch_cost=0.4565, reader_cost=0.0002 | ETA 01:08:05 2020-11-14 04:56:34 [INFO] [TRAIN] epoch=47, iter=31060/40000, loss=0.1874, lr=0.002604, batch_cost=0.4389, reader_cost=0.0002 | ETA 01:05:23 2020-11-14 04:56:40 [INFO] [TRAIN] epoch=48, iter=31070/40000, loss=0.2086, lr=0.002601, batch_cost=0.5680, reader_cost=0.0906 | ETA 01:24:32 2020-11-14 04:56:45 [INFO] [TRAIN] epoch=48, iter=31080/40000, loss=0.1900, lr=0.002599, batch_cost=0.4965, reader_cost=0.0005 | ETA 01:13:48 2020-11-14 04:56:50 [INFO] [TRAIN] epoch=48, iter=31090/40000, loss=0.2134, lr=0.002596, batch_cost=0.5213, reader_cost=0.0002 | ETA 01:17:24 2020-11-14 04:56:55 [INFO] [TRAIN] epoch=48, iter=31100/40000, loss=0.2329, lr=0.002593, batch_cost=0.5204, reader_cost=0.0002 | ETA 01:17:11 2020-11-14 04:57:00 [INFO] [TRAIN] epoch=48, iter=31110/40000, loss=0.1972, lr=0.002591, batch_cost=0.4520, reader_cost=0.0002 | ETA 01:06:58 2020-11-14 04:57:04 [INFO] [TRAIN] epoch=48, iter=31120/40000, loss=0.2600, lr=0.002588, batch_cost=0.4573, reader_cost=0.0002 | ETA 01:07:40 2020-11-14 04:57:09 [INFO] [TRAIN] epoch=48, iter=31130/40000, loss=0.2401, lr=0.002586, batch_cost=0.4709, reader_cost=0.0002 | ETA 01:09:36 2020-11-14 04:57:14 [INFO] [TRAIN] epoch=48, iter=31140/40000, loss=0.1932, lr=0.002583, batch_cost=0.5105, reader_cost=0.0002 | ETA 01:15:22 2020-11-14 04:57:19 [INFO] [TRAIN] epoch=48, iter=31150/40000, loss=0.2806, lr=0.002580, batch_cost=0.5080, reader_cost=0.0002 | ETA 01:14:55 2020-11-14 04:57:24 [INFO] [TRAIN] epoch=48, iter=31160/40000, loss=0.2210, lr=0.002578, batch_cost=0.4945, reader_cost=0.0002 | ETA 01:12:51 2020-11-14 04:57:29 [INFO] [TRAIN] epoch=48, iter=31170/40000, loss=0.2021, lr=0.002575, batch_cost=0.4742, reader_cost=0.0002 | ETA 01:09:47 2020-11-14 04:57:33 [INFO] [TRAIN] epoch=48, iter=31180/40000, loss=0.1963, lr=0.002573, batch_cost=0.4597, reader_cost=0.0002 | ETA 01:07:34 2020-11-14 04:57:38 [INFO] [TRAIN] epoch=48, iter=31190/40000, loss=0.1664, lr=0.002570, batch_cost=0.4425, reader_cost=0.0002 | ETA 01:04:58 2020-11-14 04:57:42 [INFO] [TRAIN] epoch=48, iter=31200/40000, loss=0.2091, lr=0.002567, batch_cost=0.4666, reader_cost=0.0002 | ETA 01:08:25 2020-11-14 04:57:47 [INFO] [TRAIN] epoch=48, iter=31210/40000, loss=0.2027, lr=0.002565, batch_cost=0.4816, reader_cost=0.0002 | ETA 01:10:32 2020-11-14 04:57:52 [INFO] [TRAIN] epoch=48, iter=31220/40000, loss=0.2698, lr=0.002562, batch_cost=0.4526, reader_cost=0.0002 | ETA 01:06:13 2020-11-14 04:57:56 [INFO] [TRAIN] epoch=48, iter=31230/40000, loss=0.1494, lr=0.002560, batch_cost=0.4609, reader_cost=0.0002 | ETA 01:07:21 2020-11-14 04:58:01 [INFO] [TRAIN] epoch=48, iter=31240/40000, loss=0.2311, lr=0.002557, batch_cost=0.4865, reader_cost=0.0002 | ETA 01:11:01 2020-11-14 04:58:06 [INFO] [TRAIN] epoch=48, iter=31250/40000, loss=0.2357, lr=0.002554, batch_cost=0.4628, reader_cost=0.0002 | ETA 01:07:29 2020-11-14 04:58:11 [INFO] [TRAIN] epoch=48, iter=31260/40000, loss=0.1700, lr=0.002552, batch_cost=0.4700, reader_cost=0.0002 | ETA 01:08:27 2020-11-14 04:58:16 [INFO] [TRAIN] epoch=48, iter=31270/40000, loss=0.2172, lr=0.002549, batch_cost=0.4929, reader_cost=0.0002 | ETA 01:11:42 2020-11-14 04:58:21 [INFO] [TRAIN] epoch=48, iter=31280/40000, loss=0.1802, lr=0.002546, batch_cost=0.5119, reader_cost=0.0002 | ETA 01:14:23 2020-11-14 04:58:26 [INFO] [TRAIN] epoch=48, iter=31290/40000, loss=0.2797, lr=0.002544, batch_cost=0.5040, reader_cost=0.0002 | ETA 01:13:09 2020-11-14 04:58:30 [INFO] [TRAIN] epoch=48, iter=31300/40000, loss=0.1679, lr=0.002541, batch_cost=0.4386, reader_cost=0.0002 | ETA 01:03:36 2020-11-14 04:58:34 [INFO] [TRAIN] epoch=48, iter=31310/40000, loss=0.2067, lr=0.002539, batch_cost=0.4378, reader_cost=0.0002 | ETA 01:03:24 2020-11-14 04:58:39 [INFO] [TRAIN] epoch=48, iter=31320/40000, loss=0.1895, lr=0.002536, batch_cost=0.4486, reader_cost=0.0002 | ETA 01:04:53 2020-11-14 04:58:44 [INFO] [TRAIN] epoch=48, iter=31330/40000, loss=0.1979, lr=0.002533, batch_cost=0.4606, reader_cost=0.0002 | ETA 01:06:33 2020-11-14 04:58:48 [INFO] [TRAIN] epoch=48, iter=31340/40000, loss=0.2173, lr=0.002531, batch_cost=0.4842, reader_cost=0.0002 | ETA 01:09:53 2020-11-14 04:58:53 [INFO] [TRAIN] epoch=48, iter=31350/40000, loss=0.1622, lr=0.002528, batch_cost=0.4758, reader_cost=0.0015 | ETA 01:08:35 2020-11-14 04:58:58 [INFO] [TRAIN] epoch=48, iter=31360/40000, loss=0.1601, lr=0.002525, batch_cost=0.4913, reader_cost=0.0002 | ETA 01:10:44 2020-11-14 04:59:03 [INFO] [TRAIN] epoch=48, iter=31370/40000, loss=0.2236, lr=0.002523, batch_cost=0.5245, reader_cost=0.0002 | ETA 01:15:26 2020-11-14 04:59:08 [INFO] [TRAIN] epoch=48, iter=31380/40000, loss=0.1676, lr=0.002520, batch_cost=0.4762, reader_cost=0.0002 | ETA 01:08:24 2020-11-14 04:59:13 [INFO] [TRAIN] epoch=48, iter=31390/40000, loss=0.1966, lr=0.002518, batch_cost=0.4790, reader_cost=0.0002 | ETA 01:08:44 2020-11-14 04:59:17 [INFO] [TRAIN] epoch=48, iter=31400/40000, loss=0.2151, lr=0.002515, batch_cost=0.4546, reader_cost=0.0002 | ETA 01:05:09 2020-11-14 04:59:22 [INFO] [TRAIN] epoch=48, iter=31410/40000, loss=0.2061, lr=0.002512, batch_cost=0.4632, reader_cost=0.0002 | ETA 01:06:18 2020-11-14 04:59:27 [INFO] [TRAIN] epoch=48, iter=31420/40000, loss=0.2119, lr=0.002510, batch_cost=0.4598, reader_cost=0.0002 | ETA 01:05:45 2020-11-14 04:59:31 [INFO] [TRAIN] epoch=48, iter=31430/40000, loss=0.1912, lr=0.002507, batch_cost=0.4473, reader_cost=0.0002 | ETA 01:03:53 2020-11-14 04:59:35 [INFO] [TRAIN] epoch=48, iter=31440/40000, loss=0.3292, lr=0.002505, batch_cost=0.4368, reader_cost=0.0002 | ETA 01:02:19 2020-11-14 04:59:40 [INFO] [TRAIN] epoch=48, iter=31450/40000, loss=0.2180, lr=0.002502, batch_cost=0.4470, reader_cost=0.0002 | ETA 01:03:41 2020-11-14 04:59:45 [INFO] [TRAIN] epoch=48, iter=31460/40000, loss=0.1606, lr=0.002499, batch_cost=0.4837, reader_cost=0.0002 | ETA 01:08:51 2020-11-14 04:59:49 [INFO] [TRAIN] epoch=48, iter=31470/40000, loss=0.1795, lr=0.002497, batch_cost=0.4690, reader_cost=0.0004 | ETA 01:06:40 2020-11-14 04:59:54 [INFO] [TRAIN] epoch=48, iter=31480/40000, loss=0.2001, lr=0.002494, batch_cost=0.4406, reader_cost=0.0002 | ETA 01:02:33 2020-11-14 04:59:58 [INFO] [TRAIN] epoch=48, iter=31490/40000, loss=0.1588, lr=0.002491, batch_cost=0.4472, reader_cost=0.0002 | ETA 01:03:25 2020-11-14 05:00:04 [INFO] [TRAIN] epoch=48, iter=31500/40000, loss=0.1907, lr=0.002489, batch_cost=0.5261, reader_cost=0.0002 | ETA 01:14:31 2020-11-14 05:00:09 [INFO] [TRAIN] epoch=48, iter=31510/40000, loss=0.2314, lr=0.002486, batch_cost=0.4969, reader_cost=0.0002 | ETA 01:10:18 2020-11-14 05:00:13 [INFO] [TRAIN] epoch=48, iter=31520/40000, loss=0.3106, lr=0.002484, batch_cost=0.4394, reader_cost=0.0002 | ETA 01:02:06 2020-11-14 05:00:17 [INFO] [TRAIN] epoch=48, iter=31530/40000, loss=0.2076, lr=0.002481, batch_cost=0.4399, reader_cost=0.0002 | ETA 01:02:05 2020-11-14 05:00:22 [INFO] [TRAIN] epoch=48, iter=31540/40000, loss=0.2080, lr=0.002478, batch_cost=0.4417, reader_cost=0.0002 | ETA 01:02:16 2020-11-14 05:00:26 [INFO] [TRAIN] epoch=48, iter=31550/40000, loss=0.1750, lr=0.002476, batch_cost=0.4410, reader_cost=0.0002 | ETA 01:02:06 2020-11-14 05:00:31 [INFO] [TRAIN] epoch=48, iter=31560/40000, loss=0.1800, lr=0.002473, batch_cost=0.4429, reader_cost=0.0002 | ETA 01:02:17 2020-11-14 05:00:35 [INFO] [TRAIN] epoch=48, iter=31570/40000, loss=0.2220, lr=0.002470, batch_cost=0.4413, reader_cost=0.0002 | ETA 01:02:00 2020-11-14 05:00:39 [INFO] [TRAIN] epoch=48, iter=31580/40000, loss=0.3019, lr=0.002468, batch_cost=0.4412, reader_cost=0.0002 | ETA 01:01:55 2020-11-14 05:00:44 [INFO] [TRAIN] epoch=48, iter=31590/40000, loss=0.2352, lr=0.002465, batch_cost=0.4434, reader_cost=0.0002 | ETA 01:02:09 2020-11-14 05:00:48 [INFO] [TRAIN] epoch=48, iter=31600/40000, loss=0.2584, lr=0.002463, batch_cost=0.4567, reader_cost=0.0002 | ETA 01:03:56 2020-11-14 05:00:53 [INFO] [TRAIN] epoch=48, iter=31610/40000, loss=0.1920, lr=0.002460, batch_cost=0.4610, reader_cost=0.0002 | ETA 01:04:27 2020-11-14 05:00:58 [INFO] [TRAIN] epoch=48, iter=31620/40000, loss=0.1808, lr=0.002457, batch_cost=0.4590, reader_cost=0.0002 | ETA 01:04:06 2020-11-14 05:01:02 [INFO] [TRAIN] epoch=48, iter=31630/40000, loss=0.2365, lr=0.002455, batch_cost=0.4677, reader_cost=0.0002 | ETA 01:05:14 2020-11-14 05:01:07 [INFO] [TRAIN] epoch=48, iter=31640/40000, loss=0.1951, lr=0.002452, batch_cost=0.4402, reader_cost=0.0002 | ETA 01:01:19 2020-11-14 05:01:12 [INFO] [TRAIN] epoch=48, iter=31650/40000, loss=0.1982, lr=0.002449, batch_cost=0.4866, reader_cost=0.0002 | ETA 01:07:43 2020-11-14 05:01:16 [INFO] [TRAIN] epoch=48, iter=31660/40000, loss=0.1924, lr=0.002447, batch_cost=0.4596, reader_cost=0.0002 | ETA 01:03:52 2020-11-14 05:01:21 [INFO] [TRAIN] epoch=48, iter=31670/40000, loss=0.2900, lr=0.002444, batch_cost=0.4726, reader_cost=0.0002 | ETA 01:05:36 2020-11-14 05:01:26 [INFO] [TRAIN] epoch=48, iter=31680/40000, loss=0.2590, lr=0.002441, batch_cost=0.4671, reader_cost=0.0002 | ETA 01:04:45 2020-11-14 05:01:30 [INFO] [TRAIN] epoch=48, iter=31690/40000, loss=0.2167, lr=0.002439, batch_cost=0.4771, reader_cost=0.0002 | ETA 01:06:04 2020-11-14 05:01:35 [INFO] [TRAIN] epoch=48, iter=31700/40000, loss=0.1749, lr=0.002436, batch_cost=0.4445, reader_cost=0.0002 | ETA 01:01:29 2020-11-14 05:01:39 [INFO] [TRAIN] epoch=48, iter=31710/40000, loss=0.2569, lr=0.002434, batch_cost=0.4428, reader_cost=0.0002 | ETA 01:01:10 2020-11-14 05:01:44 [INFO] [TRAIN] epoch=48, iter=31720/40000, loss=0.2175, lr=0.002431, batch_cost=0.4401, reader_cost=0.0002 | ETA 01:00:44 2020-11-14 05:01:49 [INFO] [TRAIN] epoch=49, iter=31730/40000, loss=0.1957, lr=0.002428, batch_cost=0.5810, reader_cost=0.0953 | ETA 01:20:05 2020-11-14 05:01:54 [INFO] [TRAIN] epoch=49, iter=31740/40000, loss=0.1974, lr=0.002426, batch_cost=0.4400, reader_cost=0.0005 | ETA 01:00:34 2020-11-14 05:01:58 [INFO] [TRAIN] epoch=49, iter=31750/40000, loss=0.2072, lr=0.002423, batch_cost=0.4336, reader_cost=0.0002 | ETA 00:59:37 2020-11-14 05:02:02 [INFO] [TRAIN] epoch=49, iter=31760/40000, loss=0.2082, lr=0.002420, batch_cost=0.4312, reader_cost=0.0002 | ETA 00:59:13 2020-11-14 05:02:07 [INFO] [TRAIN] epoch=49, iter=31770/40000, loss=0.2765, lr=0.002418, batch_cost=0.4315, reader_cost=0.0002 | ETA 00:59:11 2020-11-14 05:02:11 [INFO] [TRAIN] epoch=49, iter=31780/40000, loss=0.2768, lr=0.002415, batch_cost=0.4541, reader_cost=0.0002 | ETA 01:02:12 2020-11-14 05:02:16 [INFO] [TRAIN] epoch=49, iter=31790/40000, loss=0.1991, lr=0.002413, batch_cost=0.4394, reader_cost=0.0002 | ETA 01:00:07 2020-11-14 05:02:20 [INFO] [TRAIN] epoch=49, iter=31800/40000, loss=0.2343, lr=0.002410, batch_cost=0.4368, reader_cost=0.0002 | ETA 00:59:41 2020-11-14 05:02:24 [INFO] [TRAIN] epoch=49, iter=31810/40000, loss=0.1807, lr=0.002407, batch_cost=0.4375, reader_cost=0.0002 | ETA 00:59:42 2020-11-14 05:02:29 [INFO] [TRAIN] epoch=49, iter=31820/40000, loss=0.1908, lr=0.002405, batch_cost=0.4335, reader_cost=0.0002 | ETA 00:59:06 2020-11-14 05:02:33 [INFO] [TRAIN] epoch=49, iter=31830/40000, loss=0.1867, lr=0.002402, batch_cost=0.4360, reader_cost=0.0002 | ETA 00:59:22 2020-11-14 05:02:38 [INFO] [TRAIN] epoch=49, iter=31840/40000, loss=0.1928, lr=0.002399, batch_cost=0.4821, reader_cost=0.0002 | ETA 01:05:33 2020-11-14 05:02:43 [INFO] [TRAIN] epoch=49, iter=31850/40000, loss=0.1919, lr=0.002397, batch_cost=0.5056, reader_cost=0.0002 | ETA 01:08:40 2020-11-14 05:02:48 [INFO] [TRAIN] epoch=49, iter=31860/40000, loss=0.2386, lr=0.002394, batch_cost=0.4785, reader_cost=0.0002 | ETA 01:04:54 2020-11-14 05:02:52 [INFO] [TRAIN] epoch=49, iter=31870/40000, loss=0.2070, lr=0.002391, batch_cost=0.4628, reader_cost=0.0002 | ETA 01:02:42 2020-11-14 05:02:57 [INFO] [TRAIN] epoch=49, iter=31880/40000, loss=0.2230, lr=0.002389, batch_cost=0.4708, reader_cost=0.0002 | ETA 01:03:42 2020-11-14 05:03:02 [INFO] [TRAIN] epoch=49, iter=31890/40000, loss=0.2353, lr=0.002386, batch_cost=0.4533, reader_cost=0.0002 | ETA 01:01:16 2020-11-14 05:03:06 [INFO] [TRAIN] epoch=49, iter=31900/40000, loss=0.2273, lr=0.002384, batch_cost=0.4579, reader_cost=0.0002 | ETA 01:01:49 2020-11-14 05:03:11 [INFO] [TRAIN] epoch=49, iter=31910/40000, loss=0.1599, lr=0.002381, batch_cost=0.4803, reader_cost=0.0002 | ETA 01:04:45 2020-11-14 05:03:16 [INFO] [TRAIN] epoch=49, iter=31920/40000, loss=0.2297, lr=0.002378, batch_cost=0.4881, reader_cost=0.0002 | ETA 01:05:43 2020-11-14 05:03:21 [INFO] [TRAIN] epoch=49, iter=31930/40000, loss=0.1925, lr=0.002376, batch_cost=0.4790, reader_cost=0.0002 | ETA 01:04:25 2020-11-14 05:03:25 [INFO] [TRAIN] epoch=49, iter=31940/40000, loss=0.3605, lr=0.002373, batch_cost=0.4369, reader_cost=0.0002 | ETA 00:58:41 2020-11-14 05:03:30 [INFO] [TRAIN] epoch=49, iter=31950/40000, loss=0.1905, lr=0.002370, batch_cost=0.4883, reader_cost=0.0002 | ETA 01:05:30 2020-11-14 05:03:35 [INFO] [TRAIN] epoch=49, iter=31960/40000, loss=0.1496, lr=0.002368, batch_cost=0.4662, reader_cost=0.0002 | ETA 01:02:27 2020-11-14 05:03:40 [INFO] [TRAIN] epoch=49, iter=31970/40000, loss=0.1889, lr=0.002365, batch_cost=0.5279, reader_cost=0.0002 | ETA 01:10:39 2020-11-14 05:03:45 [INFO] [TRAIN] epoch=49, iter=31980/40000, loss=0.2123, lr=0.002362, batch_cost=0.4860, reader_cost=0.0002 | ETA 01:04:57 2020-11-14 05:03:50 [INFO] [TRAIN] epoch=49, iter=31990/40000, loss=0.2274, lr=0.002360, batch_cost=0.4810, reader_cost=0.0002 | ETA 01:04:12 2020-11-14 05:03:54 [INFO] [TRAIN] epoch=49, iter=32000/40000, loss=0.2309, lr=0.002357, batch_cost=0.4615, reader_cost=0.0002 | ETA 01:01:31 2020-11-14 05:03:54 [INFO] Start evaluating (total_samples=1449, total_iters=363)... 2020-11-14 05:04:17 [INFO] [EVAL] #Images=1449 mIoU=0.7982 Acc=0.9553 Kappa=0.9010 2020-11-14 05:04:17 [INFO] [EVAL] Class IoU: [0.9493 0.9179 0.438 0.889 0.7186 0.8226 0.9532 0.9053 0.9427 0.4538 0.8785 0.5909 0.9094 0.9087 0.8956 0.8703 0.6468 0.849 0.5651 0.9085 0.7492] 2020-11-14 05:04:17 [INFO] [EVAL] Class Acc: [0.9692 0.947 0.4548 0.9345 0.8175 0.9134 0.9789 0.9621 0.9698 0.6213 0.9396 0.9173 0.9484 0.9487 0.9376 0.9517 0.8238 0.9378 0.8103 0.9633 0.9327] 2020-11-14 05:04:22 [INFO] [EVAL] The model with the best validation mIoU (0.7995) was saved at iter 30000. 2020-11-14 05:04:27 [INFO] [TRAIN] epoch=49, iter=32010/40000, loss=0.1983, lr=0.002355, batch_cost=0.4996, reader_cost=0.0006 | ETA 01:06:32 2020-11-14 05:04:32 [INFO] [TRAIN] epoch=49, iter=32020/40000, loss=0.1990, lr=0.002352, batch_cost=0.4520, reader_cost=0.0004 | ETA 01:00:07 2020-11-14 05:04:37 [INFO] [TRAIN] epoch=49, iter=32030/40000, loss=0.2158, lr=0.002349, batch_cost=0.5223, reader_cost=0.0004 | ETA 01:09:22 2020-11-14 05:04:42 [INFO] [TRAIN] epoch=49, iter=32040/40000, loss=0.1902, lr=0.002347, batch_cost=0.5232, reader_cost=0.0002 | ETA 01:09:24 2020-11-14 05:04:47 [INFO] [TRAIN] epoch=49, iter=32050/40000, loss=0.2173, lr=0.002344, batch_cost=0.4567, reader_cost=0.0004 | ETA 01:00:30 2020-11-14 05:04:52 [INFO] [TRAIN] epoch=49, iter=32060/40000, loss=0.2433, lr=0.002341, batch_cost=0.5191, reader_cost=0.0006 | ETA 01:08:41 2020-11-14 05:04:57 [INFO] [TRAIN] epoch=49, iter=32070/40000, loss=0.1945, lr=0.002339, batch_cost=0.5064, reader_cost=0.0002 | ETA 01:06:55 2020-11-14 05:05:02 [INFO] [TRAIN] epoch=49, iter=32080/40000, loss=0.1793, lr=0.002336, batch_cost=0.4681, reader_cost=0.0003 | ETA 01:01:47 2020-11-14 05:05:06 [INFO] [TRAIN] epoch=49, iter=32090/40000, loss=0.2310, lr=0.002333, batch_cost=0.4836, reader_cost=0.0002 | ETA 01:03:45 2020-11-14 05:05:11 [INFO] [TRAIN] epoch=49, iter=32100/40000, loss=0.2633, lr=0.002331, batch_cost=0.4541, reader_cost=0.0005 | ETA 00:59:47 2020-11-14 05:05:15 [INFO] [TRAIN] epoch=49, iter=32110/40000, loss=0.2212, lr=0.002328, batch_cost=0.4601, reader_cost=0.0002 | ETA 01:00:30 2020-11-14 05:05:20 [INFO] [TRAIN] epoch=49, iter=32120/40000, loss=0.2233, lr=0.002325, batch_cost=0.4310, reader_cost=0.0002 | ETA 00:56:36 2020-11-14 05:05:24 [INFO] [TRAIN] epoch=49, iter=32130/40000, loss=0.1952, lr=0.002323, batch_cost=0.4398, reader_cost=0.0002 | ETA 00:57:41 2020-11-14 05:05:29 [INFO] [TRAIN] epoch=49, iter=32140/40000, loss=0.1847, lr=0.002320, batch_cost=0.4404, reader_cost=0.0002 | ETA 00:57:41 2020-11-14 05:05:33 [INFO] [TRAIN] epoch=49, iter=32150/40000, loss=0.1894, lr=0.002318, batch_cost=0.4401, reader_cost=0.0002 | ETA 00:57:35 2020-11-14 05:05:37 [INFO] [TRAIN] epoch=49, iter=32160/40000, loss=0.2760, lr=0.002315, batch_cost=0.4446, reader_cost=0.0002 | ETA 00:58:05 2020-11-14 05:05:42 [INFO] [TRAIN] epoch=49, iter=32170/40000, loss=0.1853, lr=0.002312, batch_cost=0.4801, reader_cost=0.0002 | ETA 01:02:39 2020-11-14 05:05:47 [INFO] [TRAIN] epoch=49, iter=32180/40000, loss=0.2062, lr=0.002310, batch_cost=0.4469, reader_cost=0.0002 | ETA 00:58:14 2020-11-14 05:05:51 [INFO] [TRAIN] epoch=49, iter=32190/40000, loss=0.2274, lr=0.002307, batch_cost=0.4467, reader_cost=0.0003 | ETA 00:58:09 2020-11-14 05:05:56 [INFO] [TRAIN] epoch=49, iter=32200/40000, loss=0.2296, lr=0.002304, batch_cost=0.4630, reader_cost=0.0002 | ETA 01:00:11 2020-11-14 05:06:01 [INFO] [TRAIN] epoch=49, iter=32210/40000, loss=0.2129, lr=0.002302, batch_cost=0.4838, reader_cost=0.0002 | ETA 01:02:48 2020-11-14 05:06:05 [INFO] [TRAIN] epoch=49, iter=32220/40000, loss=0.1808, lr=0.002299, batch_cost=0.4580, reader_cost=0.0003 | ETA 00:59:23 2020-11-14 05:06:10 [INFO] [TRAIN] epoch=49, iter=32230/40000, loss=0.1977, lr=0.002296, batch_cost=0.4448, reader_cost=0.0002 | ETA 00:57:35 2020-11-14 05:06:14 [INFO] [TRAIN] epoch=49, iter=32240/40000, loss=0.2664, lr=0.002294, batch_cost=0.4487, reader_cost=0.0002 | ETA 00:58:02 2020-11-14 05:06:19 [INFO] [TRAIN] epoch=49, iter=32250/40000, loss=0.2372, lr=0.002291, batch_cost=0.4452, reader_cost=0.0002 | ETA 00:57:30 2020-11-14 05:06:23 [INFO] [TRAIN] epoch=49, iter=32260/40000, loss=0.1759, lr=0.002288, batch_cost=0.4661, reader_cost=0.0002 | ETA 01:00:07 2020-11-14 05:06:28 [INFO] [TRAIN] epoch=49, iter=32270/40000, loss=0.1454, lr=0.002286, batch_cost=0.4649, reader_cost=0.0003 | ETA 00:59:54 2020-11-14 05:06:33 [INFO] [TRAIN] epoch=49, iter=32280/40000, loss=0.1394, lr=0.002283, batch_cost=0.4613, reader_cost=0.0002 | ETA 00:59:21 2020-11-14 05:06:38 [INFO] [TRAIN] epoch=49, iter=32290/40000, loss=0.2066, lr=0.002280, batch_cost=0.5148, reader_cost=0.0002 | ETA 01:06:09 2020-11-14 05:06:43 [INFO] [TRAIN] epoch=49, iter=32300/40000, loss=0.2086, lr=0.002278, batch_cost=0.4999, reader_cost=0.0002 | ETA 01:04:09 2020-11-14 05:06:47 [INFO] [TRAIN] epoch=49, iter=32310/40000, loss=0.1892, lr=0.002275, batch_cost=0.4524, reader_cost=0.0002 | ETA 00:57:59 2020-11-14 05:06:52 [INFO] [TRAIN] epoch=49, iter=32320/40000, loss=0.1984, lr=0.002272, batch_cost=0.4462, reader_cost=0.0002 | ETA 00:57:06 2020-11-14 05:06:56 [INFO] [TRAIN] epoch=49, iter=32330/40000, loss=0.1466, lr=0.002270, batch_cost=0.4725, reader_cost=0.0002 | ETA 01:00:24 2020-11-14 05:07:01 [INFO] [TRAIN] epoch=49, iter=32340/40000, loss=0.2598, lr=0.002267, batch_cost=0.4950, reader_cost=0.0002 | ETA 01:03:12 2020-11-14 05:07:06 [INFO] [TRAIN] epoch=49, iter=32350/40000, loss=0.1640, lr=0.002265, batch_cost=0.4531, reader_cost=0.0002 | ETA 00:57:46 2020-11-14 05:07:11 [INFO] [TRAIN] epoch=49, iter=32360/40000, loss=0.2456, lr=0.002262, batch_cost=0.4687, reader_cost=0.0002 | ETA 00:59:40 2020-11-14 05:07:16 [INFO] [TRAIN] epoch=49, iter=32370/40000, loss=0.1790, lr=0.002259, batch_cost=0.4922, reader_cost=0.0002 | ETA 01:02:35 2020-11-14 05:07:20 [INFO] [TRAIN] epoch=49, iter=32380/40000, loss=0.2656, lr=0.002257, batch_cost=0.4778, reader_cost=0.0002 | ETA 01:00:40 2020-11-14 05:07:26 [INFO] [TRAIN] epoch=50, iter=32390/40000, loss=0.1458, lr=0.002254, batch_cost=0.5725, reader_cost=0.1042 | ETA 01:12:36 2020-11-14 05:07:31 [INFO] [TRAIN] epoch=50, iter=32400/40000, loss=0.1586, lr=0.002251, batch_cost=0.5223, reader_cost=0.0006 | ETA 01:06:09 2020-11-14 05:07:36 [INFO] [TRAIN] epoch=50, iter=32410/40000, loss=0.2776, lr=0.002249, batch_cost=0.4585, reader_cost=0.0002 | ETA 00:58:00 2020-11-14 05:07:40 [INFO] [TRAIN] epoch=50, iter=32420/40000, loss=0.2179, lr=0.002246, batch_cost=0.4334, reader_cost=0.0010 | ETA 00:54:45 2020-11-14 05:07:45 [INFO] [TRAIN] epoch=50, iter=32430/40000, loss=0.2341, lr=0.002243, batch_cost=0.4334, reader_cost=0.0001 | ETA 00:54:41 2020-11-14 05:07:49 [INFO] [TRAIN] epoch=50, iter=32440/40000, loss=0.3033, lr=0.002241, batch_cost=0.4306, reader_cost=0.0001 | ETA 00:54:15 2020-11-14 05:07:53 [INFO] [TRAIN] epoch=50, iter=32450/40000, loss=0.2544, lr=0.002238, batch_cost=0.4626, reader_cost=0.0002 | ETA 00:58:12 2020-11-14 05:07:59 [INFO] [TRAIN] epoch=50, iter=32460/40000, loss=0.1726, lr=0.002235, batch_cost=0.5436, reader_cost=0.0002 | ETA 01:08:18 2020-11-14 05:08:04 [INFO] [TRAIN] epoch=50, iter=32470/40000, loss=0.1478, lr=0.002233, batch_cost=0.5117, reader_cost=0.0003 | ETA 01:04:13 2020-11-14 05:08:09 [INFO] [TRAIN] epoch=50, iter=32480/40000, loss=0.1648, lr=0.002230, batch_cost=0.4590, reader_cost=0.0002 | ETA 00:57:31 2020-11-14 05:08:13 [INFO] [TRAIN] epoch=50, iter=32490/40000, loss=0.2574, lr=0.002227, batch_cost=0.4756, reader_cost=0.0019 | ETA 00:59:32 2020-11-14 05:08:18 [INFO] [TRAIN] epoch=50, iter=32500/40000, loss=0.1571, lr=0.002225, batch_cost=0.4913, reader_cost=0.0021 | ETA 01:01:24 2020-11-14 05:08:24 [INFO] [TRAIN] epoch=50, iter=32510/40000, loss=0.2294, lr=0.002222, batch_cost=0.5792, reader_cost=0.0043 | ETA 01:12:18 2020-11-14 05:08:29 [INFO] [TRAIN] epoch=50, iter=32520/40000, loss=0.2142, lr=0.002219, batch_cost=0.4711, reader_cost=0.0002 | ETA 00:58:43 2020-11-14 05:08:33 [INFO] [TRAIN] epoch=50, iter=32530/40000, loss=0.1759, lr=0.002217, batch_cost=0.4532, reader_cost=0.0004 | ETA 00:56:25 2020-11-14 05:08:38 [INFO] [TRAIN] epoch=50, iter=32540/40000, loss=0.1926, lr=0.002214, batch_cost=0.4513, reader_cost=0.0020 | ETA 00:56:06 2020-11-14 05:08:43 [INFO] [TRAIN] epoch=50, iter=32550/40000, loss=0.2616, lr=0.002211, batch_cost=0.4724, reader_cost=0.0055 | ETA 00:58:39 2020-11-14 05:08:47 [INFO] [TRAIN] epoch=50, iter=32560/40000, loss=0.2318, lr=0.002209, batch_cost=0.4876, reader_cost=0.0014 | ETA 01:00:27 2020-11-14 05:08:53 [INFO] [TRAIN] epoch=50, iter=32570/40000, loss=0.2521, lr=0.002206, batch_cost=0.5517, reader_cost=0.0034 | ETA 01:08:19 2020-11-14 05:08:58 [INFO] [TRAIN] epoch=50, iter=32580/40000, loss=0.1953, lr=0.002203, batch_cost=0.5214, reader_cost=0.0009 | ETA 01:04:28 2020-11-14 05:09:04 [INFO] [TRAIN] epoch=50, iter=32590/40000, loss=0.1918, lr=0.002201, batch_cost=0.5356, reader_cost=0.0023 | ETA 01:06:08 2020-11-14 05:09:09 [INFO] [TRAIN] epoch=50, iter=32600/40000, loss=0.2668, lr=0.002198, batch_cost=0.5076, reader_cost=0.0003 | ETA 01:02:36 2020-11-14 05:09:13 [INFO] [TRAIN] epoch=50, iter=32610/40000, loss=0.2206, lr=0.002195, batch_cost=0.4709, reader_cost=0.0002 | ETA 00:57:59 2020-11-14 05:09:18 [INFO] [TRAIN] epoch=50, iter=32620/40000, loss=0.1814, lr=0.002193, batch_cost=0.4671, reader_cost=0.0003 | ETA 00:57:26 2020-11-14 05:09:23 [INFO] [TRAIN] epoch=50, iter=32630/40000, loss=0.2088, lr=0.002190, batch_cost=0.4645, reader_cost=0.0002 | ETA 00:57:03 2020-11-14 05:09:27 [INFO] [TRAIN] epoch=50, iter=32640/40000, loss=0.1809, lr=0.002187, batch_cost=0.4484, reader_cost=0.0002 | ETA 00:55:00 2020-11-14 05:09:32 [INFO] [TRAIN] epoch=50, iter=32650/40000, loss=0.1868, lr=0.002185, batch_cost=0.4540, reader_cost=0.0002 | ETA 00:55:36 2020-11-14 05:09:36 [INFO] [TRAIN] epoch=50, iter=32660/40000, loss=0.1917, lr=0.002182, batch_cost=0.4466, reader_cost=0.0002 | ETA 00:54:37 2020-11-14 05:09:41 [INFO] [TRAIN] epoch=50, iter=32670/40000, loss=0.1754, lr=0.002179, batch_cost=0.4777, reader_cost=0.0003 | ETA 00:58:21 2020-11-14 05:09:46 [INFO] [TRAIN] epoch=50, iter=32680/40000, loss=0.1683, lr=0.002177, batch_cost=0.4657, reader_cost=0.0002 | ETA 00:56:49 2020-11-14 05:09:50 [INFO] [TRAIN] epoch=50, iter=32690/40000, loss=0.2350, lr=0.002174, batch_cost=0.4599, reader_cost=0.0002 | ETA 00:56:01 2020-11-14 05:09:55 [INFO] [TRAIN] epoch=50, iter=32700/40000, loss=0.2066, lr=0.002172, batch_cost=0.4549, reader_cost=0.0002 | ETA 00:55:20 2020-11-14 05:09:59 [INFO] [TRAIN] epoch=50, iter=32710/40000, loss=0.1720, lr=0.002169, batch_cost=0.4521, reader_cost=0.0002 | ETA 00:54:55 2020-11-14 05:10:05 [INFO] [TRAIN] epoch=50, iter=32720/40000, loss=0.1550, lr=0.002166, batch_cost=0.5719, reader_cost=0.0002 | ETA 01:09:23 2020-11-14 05:10:10 [INFO] [TRAIN] epoch=50, iter=32730/40000, loss=0.2082, lr=0.002164, batch_cost=0.4619, reader_cost=0.0002 | ETA 00:55:57 2020-11-14 05:10:14 [INFO] [TRAIN] epoch=50, iter=32740/40000, loss=0.2403, lr=0.002161, batch_cost=0.4460, reader_cost=0.0002 | ETA 00:53:57 2020-11-14 05:10:18 [INFO] [TRAIN] epoch=50, iter=32750/40000, loss=0.1805, lr=0.002158, batch_cost=0.4464, reader_cost=0.0002 | ETA 00:53:56 2020-11-14 05:10:23 [INFO] [TRAIN] epoch=50, iter=32760/40000, loss=0.2328, lr=0.002156, batch_cost=0.4751, reader_cost=0.0002 | ETA 00:57:19 2020-11-14 05:10:28 [INFO] [TRAIN] epoch=50, iter=32770/40000, loss=0.2377, lr=0.002153, batch_cost=0.4495, reader_cost=0.0002 | ETA 00:54:09 2020-11-14 05:10:32 [INFO] [TRAIN] epoch=50, iter=32780/40000, loss=0.2287, lr=0.002150, batch_cost=0.4647, reader_cost=0.0002 | ETA 00:55:55 2020-11-14 05:10:37 [INFO] [TRAIN] epoch=50, iter=32790/40000, loss=0.1910, lr=0.002148, batch_cost=0.5051, reader_cost=0.0002 | ETA 01:00:42 2020-11-14 05:10:42 [INFO] [TRAIN] epoch=50, iter=32800/40000, loss=0.2474, lr=0.002145, batch_cost=0.4887, reader_cost=0.0002 | ETA 00:58:38 2020-11-14 05:10:47 [INFO] [TRAIN] epoch=50, iter=32810/40000, loss=0.2078, lr=0.002142, batch_cost=0.4622, reader_cost=0.0002 | ETA 00:55:22 2020-11-14 05:10:52 [INFO] [TRAIN] epoch=50, iter=32820/40000, loss=0.2546, lr=0.002140, batch_cost=0.4813, reader_cost=0.0002 | ETA 00:57:36 2020-11-14 05:10:57 [INFO] [TRAIN] epoch=50, iter=32830/40000, loss=0.1924, lr=0.002137, batch_cost=0.4899, reader_cost=0.0002 | ETA 00:58:32 2020-11-14 05:11:01 [INFO] [TRAIN] epoch=50, iter=32840/40000, loss=0.2603, lr=0.002134, batch_cost=0.4661, reader_cost=0.0002 | ETA 00:55:37 2020-11-14 05:11:06 [INFO] [TRAIN] epoch=50, iter=32850/40000, loss=0.2032, lr=0.002131, batch_cost=0.4700, reader_cost=0.0002 | ETA 00:56:00 2020-11-14 05:11:11 [INFO] [TRAIN] epoch=50, iter=32860/40000, loss=0.2252, lr=0.002129, batch_cost=0.5117, reader_cost=0.0002 | ETA 01:00:53 2020-11-14 05:11:16 [INFO] [TRAIN] epoch=50, iter=32870/40000, loss=0.1961, lr=0.002126, batch_cost=0.4677, reader_cost=0.0011 | ETA 00:55:34 2020-11-14 05:11:20 [INFO] [TRAIN] epoch=50, iter=32880/40000, loss=0.2227, lr=0.002123, batch_cost=0.4620, reader_cost=0.0011 | ETA 00:54:49 2020-11-14 05:11:25 [INFO] [TRAIN] epoch=50, iter=32890/40000, loss=0.2092, lr=0.002121, batch_cost=0.4738, reader_cost=0.0100 | ETA 00:56:08 2020-11-14 05:11:30 [INFO] [TRAIN] epoch=50, iter=32900/40000, loss=0.1781, lr=0.002118, batch_cost=0.4547, reader_cost=0.0018 | ETA 00:53:48 2020-11-14 05:11:34 [INFO] [TRAIN] epoch=50, iter=32910/40000, loss=0.2281, lr=0.002115, batch_cost=0.4605, reader_cost=0.0002 | ETA 00:54:25 2020-11-14 05:11:39 [INFO] [TRAIN] epoch=50, iter=32920/40000, loss=0.2141, lr=0.002113, batch_cost=0.4473, reader_cost=0.0002 | ETA 00:52:46 2020-11-14 05:11:43 [INFO] [TRAIN] epoch=50, iter=32930/40000, loss=0.1874, lr=0.002110, batch_cost=0.4561, reader_cost=0.0002 | ETA 00:53:44 2020-11-14 05:11:48 [INFO] [TRAIN] epoch=50, iter=32940/40000, loss=0.1910, lr=0.002107, batch_cost=0.4687, reader_cost=0.0002 | ETA 00:55:09 2020-11-14 05:11:53 [INFO] [TRAIN] epoch=50, iter=32950/40000, loss=0.2996, lr=0.002105, batch_cost=0.4593, reader_cost=0.0002 | ETA 00:53:58 2020-11-14 05:11:57 [INFO] [TRAIN] epoch=50, iter=32960/40000, loss=0.2282, lr=0.002102, batch_cost=0.4695, reader_cost=0.0002 | ETA 00:55:05 2020-11-14 05:12:02 [INFO] [TRAIN] epoch=50, iter=32970/40000, loss=0.1786, lr=0.002099, batch_cost=0.4734, reader_cost=0.0002 | ETA 00:55:28 2020-11-14 05:12:07 [INFO] [TRAIN] epoch=50, iter=32980/40000, loss=0.1657, lr=0.002097, batch_cost=0.4658, reader_cost=0.0005 | ETA 00:54:29 2020-11-14 05:12:11 [INFO] [TRAIN] epoch=50, iter=32990/40000, loss=0.1928, lr=0.002094, batch_cost=0.4622, reader_cost=0.0002 | ETA 00:53:59 2020-11-14 05:12:16 [INFO] [TRAIN] epoch=50, iter=33000/40000, loss=0.2990, lr=0.002091, batch_cost=0.4730, reader_cost=0.0003 | ETA 00:55:11 2020-11-14 05:12:21 [INFO] [TRAIN] epoch=50, iter=33010/40000, loss=0.2001, lr=0.002089, batch_cost=0.4564, reader_cost=0.0002 | ETA 00:53:10 2020-11-14 05:12:25 [INFO] [TRAIN] epoch=50, iter=33020/40000, loss=0.2454, lr=0.002086, batch_cost=0.4638, reader_cost=0.0002 | ETA 00:53:57 2020-11-14 05:12:30 [INFO] [TRAIN] epoch=50, iter=33030/40000, loss=0.1812, lr=0.002083, batch_cost=0.5005, reader_cost=0.0002 | ETA 00:58:08 2020-11-14 05:12:35 [INFO] [TRAIN] epoch=50, iter=33040/40000, loss=0.2321, lr=0.002081, batch_cost=0.4674, reader_cost=0.0002 | ETA 00:54:13 2020-11-14 05:12:39 [INFO] [TRAIN] epoch=50, iter=33050/40000, loss=0.2013, lr=0.002078, batch_cost=0.4497, reader_cost=0.0003 | ETA 00:52:05 2020-11-14 05:12:46 [INFO] [TRAIN] epoch=51, iter=33060/40000, loss=0.1204, lr=0.002075, batch_cost=0.6338, reader_cost=0.1228 | ETA 01:13:18 2020-11-14 05:12:51 [INFO] [TRAIN] epoch=51, iter=33070/40000, loss=0.1735, lr=0.002073, batch_cost=0.4935, reader_cost=0.0005 | ETA 00:56:59 2020-11-14 05:12:56 [INFO] [TRAIN] epoch=51, iter=33080/40000, loss=0.2638, lr=0.002070, batch_cost=0.4813, reader_cost=0.0010 | ETA 00:55:30 2020-11-14 05:13:00 [INFO] [TRAIN] epoch=51, iter=33090/40000, loss=0.1807, lr=0.002067, batch_cost=0.4748, reader_cost=0.0003 | ETA 00:54:40 2020-11-14 05:13:05 [INFO] [TRAIN] epoch=51, iter=33100/40000, loss=0.1990, lr=0.002065, batch_cost=0.4701, reader_cost=0.0002 | ETA 00:54:03 2020-11-14 05:13:09 [INFO] [TRAIN] epoch=51, iter=33110/40000, loss=0.2365, lr=0.002062, batch_cost=0.4360, reader_cost=0.0002 | ETA 00:50:03 2020-11-14 05:13:14 [INFO] [TRAIN] epoch=51, iter=33120/40000, loss=0.1950, lr=0.002059, batch_cost=0.4404, reader_cost=0.0002 | ETA 00:50:29 2020-11-14 05:13:18 [INFO] [TRAIN] epoch=51, iter=33130/40000, loss=0.2092, lr=0.002057, batch_cost=0.4412, reader_cost=0.0002 | ETA 00:50:31 2020-11-14 05:13:23 [INFO] [TRAIN] epoch=51, iter=33140/40000, loss=0.1923, lr=0.002054, batch_cost=0.4327, reader_cost=0.0002 | ETA 00:49:28 2020-11-14 05:13:27 [INFO] [TRAIN] epoch=51, iter=33150/40000, loss=0.1832, lr=0.002051, batch_cost=0.4300, reader_cost=0.0001 | ETA 00:49:05 2020-11-14 05:13:31 [INFO] [TRAIN] epoch=51, iter=33160/40000, loss=0.1963, lr=0.002049, batch_cost=0.4373, reader_cost=0.0002 | ETA 00:49:51 2020-11-14 05:13:36 [INFO] [TRAIN] epoch=51, iter=33170/40000, loss=0.2210, lr=0.002046, batch_cost=0.4516, reader_cost=0.0002 | ETA 00:51:24 2020-11-14 05:13:40 [INFO] [TRAIN] epoch=51, iter=33180/40000, loss=0.2035, lr=0.002043, batch_cost=0.4345, reader_cost=0.0002 | ETA 00:49:23 2020-11-14 05:13:44 [INFO] [TRAIN] epoch=51, iter=33190/40000, loss=0.2492, lr=0.002040, batch_cost=0.4352, reader_cost=0.0002 | ETA 00:49:23 2020-11-14 05:13:49 [INFO] [TRAIN] epoch=51, iter=33200/40000, loss=0.2268, lr=0.002038, batch_cost=0.4472, reader_cost=0.0003 | ETA 00:50:41 2020-11-14 05:13:53 [INFO] [TRAIN] epoch=51, iter=33210/40000, loss=0.2103, lr=0.002035, batch_cost=0.4418, reader_cost=0.0002 | ETA 00:50:00 2020-11-14 05:13:58 [INFO] [TRAIN] epoch=51, iter=33220/40000, loss=0.1972, lr=0.002032, batch_cost=0.4509, reader_cost=0.0002 | ETA 00:50:56 2020-11-14 05:14:02 [INFO] [TRAIN] epoch=51, iter=33230/40000, loss=0.1742, lr=0.002030, batch_cost=0.4392, reader_cost=0.0002 | ETA 00:49:33 2020-11-14 05:14:07 [INFO] [TRAIN] epoch=51, iter=33240/40000, loss=0.2380, lr=0.002027, batch_cost=0.4422, reader_cost=0.0002 | ETA 00:49:49 2020-11-14 05:14:11 [INFO] [TRAIN] epoch=51, iter=33250/40000, loss=0.2037, lr=0.002024, batch_cost=0.4481, reader_cost=0.0002 | ETA 00:50:24 2020-11-14 05:14:15 [INFO] [TRAIN] epoch=51, iter=33260/40000, loss=0.1993, lr=0.002022, batch_cost=0.4359, reader_cost=0.0002 | ETA 00:48:57 2020-11-14 05:14:20 [INFO] [TRAIN] epoch=51, iter=33270/40000, loss=0.1929, lr=0.002019, batch_cost=0.4455, reader_cost=0.0002 | ETA 00:49:58 2020-11-14 05:14:25 [INFO] [TRAIN] epoch=51, iter=33280/40000, loss=0.2575, lr=0.002016, batch_cost=0.4697, reader_cost=0.0002 | ETA 00:52:36 2020-11-14 05:14:29 [INFO] [TRAIN] epoch=51, iter=33290/40000, loss=0.2331, lr=0.002014, batch_cost=0.4441, reader_cost=0.0002 | ETA 00:49:40 2020-11-14 05:14:33 [INFO] [TRAIN] epoch=51, iter=33300/40000, loss=0.2077, lr=0.002011, batch_cost=0.4351, reader_cost=0.0002 | ETA 00:48:35 2020-11-14 05:14:38 [INFO] [TRAIN] epoch=51, iter=33310/40000, loss=0.2590, lr=0.002008, batch_cost=0.4597, reader_cost=0.0002 | ETA 00:51:15 2020-11-14 05:14:43 [INFO] [TRAIN] epoch=51, iter=33320/40000, loss=0.2447, lr=0.002006, batch_cost=0.4912, reader_cost=0.0002 | ETA 00:54:41 2020-11-14 05:14:48 [INFO] [TRAIN] epoch=51, iter=33330/40000, loss=0.1828, lr=0.002003, batch_cost=0.4625, reader_cost=0.0002 | ETA 00:51:24 2020-11-14 05:14:52 [INFO] [TRAIN] epoch=51, iter=33340/40000, loss=0.1678, lr=0.002000, batch_cost=0.4420, reader_cost=0.0002 | ETA 00:49:03 2020-11-14 05:14:57 [INFO] [TRAIN] epoch=51, iter=33350/40000, loss=0.2462, lr=0.001998, batch_cost=0.4901, reader_cost=0.0002 | ETA 00:54:19 2020-11-14 05:15:02 [INFO] [TRAIN] epoch=51, iter=33360/40000, loss=0.2476, lr=0.001995, batch_cost=0.4668, reader_cost=0.0002 | ETA 00:51:39 2020-11-14 05:15:07 [INFO] [TRAIN] epoch=51, iter=33370/40000, loss=0.1824, lr=0.001992, batch_cost=0.5121, reader_cost=0.0002 | ETA 00:56:35 2020-11-14 05:15:11 [INFO] [TRAIN] epoch=51, iter=33380/40000, loss=0.1264, lr=0.001989, batch_cost=0.4585, reader_cost=0.0002 | ETA 00:50:35 2020-11-14 05:15:16 [INFO] [TRAIN] epoch=51, iter=33390/40000, loss=0.2033, lr=0.001987, batch_cost=0.4381, reader_cost=0.0002 | ETA 00:48:16 2020-11-14 05:15:20 [INFO] [TRAIN] epoch=51, iter=33400/40000, loss=0.1686, lr=0.001984, batch_cost=0.4673, reader_cost=0.0002 | ETA 00:51:23 2020-11-14 05:15:25 [INFO] [TRAIN] epoch=51, iter=33410/40000, loss=0.2421, lr=0.001981, batch_cost=0.4449, reader_cost=0.0002 | ETA 00:48:51 2020-11-14 05:15:29 [INFO] [TRAIN] epoch=51, iter=33420/40000, loss=0.1804, lr=0.001979, batch_cost=0.4467, reader_cost=0.0002 | ETA 00:48:59 2020-11-14 05:15:34 [INFO] [TRAIN] epoch=51, iter=33430/40000, loss=0.1675, lr=0.001976, batch_cost=0.5107, reader_cost=0.0002 | ETA 00:55:55 2020-11-14 05:15:39 [INFO] [TRAIN] epoch=51, iter=33440/40000, loss=0.2183, lr=0.001973, batch_cost=0.5172, reader_cost=0.0002 | ETA 00:56:32 2020-11-14 05:15:45 [INFO] [TRAIN] epoch=51, iter=33450/40000, loss=0.2141, lr=0.001971, batch_cost=0.5157, reader_cost=0.0002 | ETA 00:56:18 2020-11-14 05:15:49 [INFO] [TRAIN] epoch=51, iter=33460/40000, loss=0.2263, lr=0.001968, batch_cost=0.4777, reader_cost=0.0002 | ETA 00:52:03 2020-11-14 05:15:54 [INFO] [TRAIN] epoch=51, iter=33470/40000, loss=0.1521, lr=0.001965, batch_cost=0.4858, reader_cost=0.0002 | ETA 00:52:52 2020-11-14 05:15:59 [INFO] [TRAIN] epoch=51, iter=33480/40000, loss=0.2390, lr=0.001963, batch_cost=0.4837, reader_cost=0.0002 | ETA 00:52:33 2020-11-14 05:16:04 [INFO] [TRAIN] epoch=51, iter=33490/40000, loss=0.1779, lr=0.001960, batch_cost=0.4651, reader_cost=0.0002 | ETA 00:50:27 2020-11-14 05:16:09 [INFO] [TRAIN] epoch=51, iter=33500/40000, loss=0.2311, lr=0.001957, batch_cost=0.5049, reader_cost=0.0002 | ETA 00:54:41 2020-11-14 05:16:14 [INFO] [TRAIN] epoch=51, iter=33510/40000, loss=0.1976, lr=0.001954, batch_cost=0.4867, reader_cost=0.0002 | ETA 00:52:38 2020-11-14 05:16:18 [INFO] [TRAIN] epoch=51, iter=33520/40000, loss=0.2278, lr=0.001952, batch_cost=0.4800, reader_cost=0.0002 | ETA 00:51:50 2020-11-14 05:16:23 [INFO] [TRAIN] epoch=51, iter=33530/40000, loss=0.2166, lr=0.001949, batch_cost=0.4514, reader_cost=0.0002 | ETA 00:48:40 2020-11-14 05:16:27 [INFO] [TRAIN] epoch=51, iter=33540/40000, loss=0.1714, lr=0.001946, batch_cost=0.4412, reader_cost=0.0002 | ETA 00:47:29 2020-11-14 05:16:32 [INFO] [TRAIN] epoch=51, iter=33550/40000, loss=0.1715, lr=0.001944, batch_cost=0.4402, reader_cost=0.0002 | ETA 00:47:19 2020-11-14 05:16:36 [INFO] [TRAIN] epoch=51, iter=33560/40000, loss=0.1379, lr=0.001941, batch_cost=0.4502, reader_cost=0.0002 | ETA 00:48:19 2020-11-14 05:16:41 [INFO] [TRAIN] epoch=51, iter=33570/40000, loss=0.2717, lr=0.001938, batch_cost=0.4503, reader_cost=0.0002 | ETA 00:48:15 2020-11-14 05:16:45 [INFO] [TRAIN] epoch=51, iter=33580/40000, loss=0.1908, lr=0.001936, batch_cost=0.4404, reader_cost=0.0002 | ETA 00:47:07 2020-11-14 05:16:50 [INFO] [TRAIN] epoch=51, iter=33590/40000, loss=0.1463, lr=0.001933, batch_cost=0.4445, reader_cost=0.0002 | ETA 00:47:28 2020-11-14 05:16:54 [INFO] [TRAIN] epoch=51, iter=33600/40000, loss=0.1787, lr=0.001930, batch_cost=0.4675, reader_cost=0.0002 | ETA 00:49:52 2020-11-14 05:16:59 [INFO] [TRAIN] epoch=51, iter=33610/40000, loss=0.1736, lr=0.001927, batch_cost=0.4421, reader_cost=0.0002 | ETA 00:47:04 2020-11-14 05:17:04 [INFO] [TRAIN] epoch=51, iter=33620/40000, loss=0.2486, lr=0.001925, batch_cost=0.4732, reader_cost=0.0002 | ETA 00:50:18 2020-11-14 05:17:08 [INFO] [TRAIN] epoch=51, iter=33630/40000, loss=0.1812, lr=0.001922, batch_cost=0.4431, reader_cost=0.0002 | ETA 00:47:02 2020-11-14 05:17:12 [INFO] [TRAIN] epoch=51, iter=33640/40000, loss=0.1979, lr=0.001919, batch_cost=0.4521, reader_cost=0.0002 | ETA 00:47:55 2020-11-14 05:17:17 [INFO] [TRAIN] epoch=51, iter=33650/40000, loss=0.2108, lr=0.001917, batch_cost=0.4407, reader_cost=0.0002 | ETA 00:46:38 2020-11-14 05:17:21 [INFO] [TRAIN] epoch=51, iter=33660/40000, loss=0.1772, lr=0.001914, batch_cost=0.4529, reader_cost=0.0002 | ETA 00:47:51 2020-11-14 05:17:26 [INFO] [TRAIN] epoch=51, iter=33670/40000, loss=0.1810, lr=0.001911, batch_cost=0.4922, reader_cost=0.0002 | ETA 00:51:55 2020-11-14 05:17:31 [INFO] [TRAIN] epoch=51, iter=33680/40000, loss=0.1747, lr=0.001909, batch_cost=0.4699, reader_cost=0.0002 | ETA 00:49:29 2020-11-14 05:17:36 [INFO] [TRAIN] epoch=51, iter=33690/40000, loss=0.2035, lr=0.001906, batch_cost=0.4876, reader_cost=0.0002 | ETA 00:51:16 2020-11-14 05:17:41 [INFO] [TRAIN] epoch=51, iter=33700/40000, loss=0.1810, lr=0.001903, batch_cost=0.4731, reader_cost=0.0002 | ETA 00:49:40 2020-11-14 05:17:45 [INFO] [TRAIN] epoch=51, iter=33710/40000, loss=0.1943, lr=0.001900, batch_cost=0.4297, reader_cost=0.0002 | ETA 00:45:02 2020-11-14 05:17:51 [INFO] [TRAIN] epoch=52, iter=33720/40000, loss=0.1524, lr=0.001898, batch_cost=0.5947, reader_cost=0.1064 | ETA 01:02:14 2020-11-14 05:17:56 [INFO] [TRAIN] epoch=52, iter=33730/40000, loss=0.1870, lr=0.001895, batch_cost=0.4939, reader_cost=0.0005 | ETA 00:51:36 2020-11-14 05:18:00 [INFO] [TRAIN] epoch=52, iter=33740/40000, loss=0.1736, lr=0.001892, batch_cost=0.4424, reader_cost=0.0002 | ETA 00:46:09 2020-11-14 05:18:05 [INFO] [TRAIN] epoch=52, iter=33750/40000, loss=0.2374, lr=0.001890, batch_cost=0.4490, reader_cost=0.0002 | ETA 00:46:46 2020-11-14 05:18:09 [INFO] [TRAIN] epoch=52, iter=33760/40000, loss=0.2056, lr=0.001887, batch_cost=0.4529, reader_cost=0.0002 | ETA 00:47:05 2020-11-14 05:18:14 [INFO] [TRAIN] epoch=52, iter=33770/40000, loss=0.2365, lr=0.001884, batch_cost=0.4391, reader_cost=0.0002 | ETA 00:45:35 2020-11-14 05:18:18 [INFO] [TRAIN] epoch=52, iter=33780/40000, loss=0.1930, lr=0.001881, batch_cost=0.4847, reader_cost=0.0002 | ETA 00:50:14 2020-11-14 05:18:23 [INFO] [TRAIN] epoch=52, iter=33790/40000, loss=0.1987, lr=0.001879, batch_cost=0.4761, reader_cost=0.0002 | ETA 00:49:16 2020-11-14 05:18:28 [INFO] [TRAIN] epoch=52, iter=33800/40000, loss=0.2028, lr=0.001876, batch_cost=0.4456, reader_cost=0.0002 | ETA 00:46:02 2020-11-14 05:18:33 [INFO] [TRAIN] epoch=52, iter=33810/40000, loss=0.1848, lr=0.001873, batch_cost=0.4890, reader_cost=0.0002 | ETA 00:50:27 2020-11-14 05:18:37 [INFO] [TRAIN] epoch=52, iter=33820/40000, loss=0.2114, lr=0.001871, batch_cost=0.4819, reader_cost=0.0002 | ETA 00:49:37 2020-11-14 05:18:42 [INFO] [TRAIN] epoch=52, iter=33830/40000, loss=0.1712, lr=0.001868, batch_cost=0.4674, reader_cost=0.0002 | ETA 00:48:04 2020-11-14 05:18:47 [INFO] [TRAIN] epoch=52, iter=33840/40000, loss=0.1871, lr=0.001865, batch_cost=0.4478, reader_cost=0.0002 | ETA 00:45:58 2020-11-14 05:18:52 [INFO] [TRAIN] epoch=52, iter=33850/40000, loss=0.1912, lr=0.001863, batch_cost=0.5044, reader_cost=0.0002 | ETA 00:51:42 2020-11-14 05:19:00 [INFO] [TRAIN] epoch=52, iter=33860/40000, loss=0.2028, lr=0.001860, batch_cost=0.8634, reader_cost=0.0003 | ETA 01:28:21 2020-11-14 05:19:05 [INFO] [TRAIN] epoch=52, iter=33870/40000, loss=0.1867, lr=0.001857, batch_cost=0.4668, reader_cost=0.0002 | ETA 00:47:41 2020-11-14 05:19:09 [INFO] [TRAIN] epoch=52, iter=33880/40000, loss=0.1838, lr=0.001854, batch_cost=0.4387, reader_cost=0.0002 | ETA 00:44:44 2020-11-14 05:19:14 [INFO] [TRAIN] epoch=52, iter=33890/40000, loss=0.2084, lr=0.001852, batch_cost=0.4400, reader_cost=0.0002 | ETA 00:44:48 2020-11-14 05:19:18 [INFO] [TRAIN] epoch=52, iter=33900/40000, loss=0.2003, lr=0.001849, batch_cost=0.4424, reader_cost=0.0002 | ETA 00:44:58 2020-11-14 05:19:23 [INFO] [TRAIN] epoch=52, iter=33910/40000, loss=0.1452, lr=0.001846, batch_cost=0.4455, reader_cost=0.0003 | ETA 00:45:13 2020-11-14 05:19:27 [INFO] [TRAIN] epoch=52, iter=33920/40000, loss=0.2281, lr=0.001844, batch_cost=0.4494, reader_cost=0.0003 | ETA 00:45:32 2020-11-14 05:19:32 [INFO] [TRAIN] epoch=52, iter=33930/40000, loss=0.1608, lr=0.001841, batch_cost=0.4753, reader_cost=0.0003 | ETA 00:48:05 2020-11-14 05:19:37 [INFO] [TRAIN] epoch=52, iter=33940/40000, loss=0.2217, lr=0.001838, batch_cost=0.4750, reader_cost=0.0005 | ETA 00:47:58 2020-11-14 05:19:41 [INFO] [TRAIN] epoch=52, iter=33950/40000, loss=0.1457, lr=0.001835, batch_cost=0.4693, reader_cost=0.0002 | ETA 00:47:19 2020-11-14 05:19:46 [INFO] [TRAIN] epoch=52, iter=33960/40000, loss=0.2526, lr=0.001833, batch_cost=0.4768, reader_cost=0.0002 | ETA 00:47:59 2020-11-14 05:19:51 [INFO] [TRAIN] epoch=52, iter=33970/40000, loss=0.1889, lr=0.001830, batch_cost=0.4636, reader_cost=0.0004 | ETA 00:46:35 2020-11-14 05:19:55 [INFO] [TRAIN] epoch=52, iter=33980/40000, loss=0.1948, lr=0.001827, batch_cost=0.4425, reader_cost=0.0002 | ETA 00:44:23 2020-11-14 05:20:00 [INFO] [TRAIN] epoch=52, iter=33990/40000, loss=0.1557, lr=0.001825, batch_cost=0.4645, reader_cost=0.0002 | ETA 00:46:31 2020-11-14 05:20:04 [INFO] [TRAIN] epoch=52, iter=34000/40000, loss=0.1931, lr=0.001822, batch_cost=0.4411, reader_cost=0.0002 | ETA 00:44:06 2020-11-14 05:20:04 [INFO] Start evaluating (total_samples=1449, total_iters=363)... 2020-11-14 05:20:29 [INFO] [EVAL] #Images=1449 mIoU=0.8018 Acc=0.9563 Kappa=0.9036 2020-11-14 05:20:29 [INFO] [EVAL] Class IoU: [0.9499 0.9219 0.432 0.8949 0.7151 0.8275 0.9572 0.9157 0.9445 0.4499 0.8925 0.6032 0.9139 0.9213 0.8966 0.8768 0.6595 0.8616 0.5569 0.9242 0.722 ] 2020-11-14 05:20:29 [INFO] [EVAL] Class Acc: [0.9712 0.953 0.4443 0.9461 0.7888 0.8855 0.9771 0.9726 0.9744 0.645 0.9356 0.9105 0.9433 0.9507 0.9335 0.9421 0.8404 0.9551 0.8485 0.9631 0.856 ] 2020-11-14 05:20:37 [INFO] [EVAL] The model with the best validation mIoU (0.8018) was saved at iter 34000. 2020-11-14 05:20:41 [INFO] [TRAIN] epoch=52, iter=34010/40000, loss=0.2153, lr=0.001819, batch_cost=0.4698, reader_cost=0.0005 | ETA 00:46:54 2020-11-14 05:20:46 [INFO] [TRAIN] epoch=52, iter=34020/40000, loss=0.2034, lr=0.001816, batch_cost=0.4743, reader_cost=0.0005 | ETA 00:47:16 2020-11-14 05:20:51 [INFO] [TRAIN] epoch=52, iter=34030/40000, loss=0.1381, lr=0.001814, batch_cost=0.4510, reader_cost=0.0005 | ETA 00:44:52 2020-11-14 05:20:55 [INFO] [TRAIN] epoch=52, iter=34040/40000, loss=0.1392, lr=0.001811, batch_cost=0.4561, reader_cost=0.0005 | ETA 00:45:18 2020-11-14 05:21:00 [INFO] [TRAIN] epoch=52, iter=34050/40000, loss=0.2395, lr=0.001808, batch_cost=0.4597, reader_cost=0.0002 | ETA 00:45:35 2020-11-14 05:21:04 [INFO] [TRAIN] epoch=52, iter=34060/40000, loss=0.1821, lr=0.001805, batch_cost=0.4703, reader_cost=0.0002 | ETA 00:46:33 2020-11-14 05:21:09 [INFO] [TRAIN] epoch=52, iter=34070/40000, loss=0.1587, lr=0.001803, batch_cost=0.4853, reader_cost=0.0002 | ETA 00:47:57 2020-11-14 05:21:14 [INFO] [TRAIN] epoch=52, iter=34080/40000, loss=0.2068, lr=0.001800, batch_cost=0.4445, reader_cost=0.0002 | ETA 00:43:51 2020-11-14 05:21:18 [INFO] [TRAIN] epoch=52, iter=34090/40000, loss=0.2337, lr=0.001797, batch_cost=0.4502, reader_cost=0.0002 | ETA 00:44:20 2020-11-14 05:21:23 [INFO] [TRAIN] epoch=52, iter=34100/40000, loss=0.1601, lr=0.001795, batch_cost=0.4533, reader_cost=0.0002 | ETA 00:44:34 2020-11-14 05:21:27 [INFO] [TRAIN] epoch=52, iter=34110/40000, loss=0.1652, lr=0.001792, batch_cost=0.4642, reader_cost=0.0002 | ETA 00:45:33 2020-11-14 05:21:32 [INFO] [TRAIN] epoch=52, iter=34120/40000, loss=0.1964, lr=0.001789, batch_cost=0.4593, reader_cost=0.0002 | ETA 00:45:00 2020-11-14 05:21:36 [INFO] [TRAIN] epoch=52, iter=34130/40000, loss=0.2025, lr=0.001786, batch_cost=0.4515, reader_cost=0.0002 | ETA 00:44:10 2020-11-14 05:21:41 [INFO] [TRAIN] epoch=52, iter=34140/40000, loss=0.1634, lr=0.001784, batch_cost=0.4484, reader_cost=0.0002 | ETA 00:43:47 2020-11-14 05:21:45 [INFO] [TRAIN] epoch=52, iter=34150/40000, loss=0.2023, lr=0.001781, batch_cost=0.4333, reader_cost=0.0002 | ETA 00:42:14 2020-11-14 05:21:50 [INFO] [TRAIN] epoch=52, iter=34160/40000, loss=0.1852, lr=0.001778, batch_cost=0.4353, reader_cost=0.0002 | ETA 00:42:21 2020-11-14 05:21:54 [INFO] [TRAIN] epoch=52, iter=34170/40000, loss=0.2275, lr=0.001776, batch_cost=0.4451, reader_cost=0.0002 | ETA 00:43:14 2020-11-14 05:21:58 [INFO] [TRAIN] epoch=52, iter=34180/40000, loss=0.2080, lr=0.001773, batch_cost=0.4369, reader_cost=0.0002 | ETA 00:42:22 2020-11-14 05:22:03 [INFO] [TRAIN] epoch=52, iter=34190/40000, loss=0.2268, lr=0.001770, batch_cost=0.4360, reader_cost=0.0002 | ETA 00:42:13 2020-11-14 05:22:07 [INFO] [TRAIN] epoch=52, iter=34200/40000, loss=0.1622, lr=0.001767, batch_cost=0.4460, reader_cost=0.0066 | ETA 00:43:06 2020-11-14 05:22:12 [INFO] [TRAIN] epoch=52, iter=34210/40000, loss=0.1855, lr=0.001765, batch_cost=0.4760, reader_cost=0.0015 | ETA 00:45:56 2020-11-14 05:22:16 [INFO] [TRAIN] epoch=52, iter=34220/40000, loss=0.3040, lr=0.001762, batch_cost=0.4329, reader_cost=0.0002 | ETA 00:41:41 2020-11-14 05:22:21 [INFO] [TRAIN] epoch=52, iter=34230/40000, loss=0.1807, lr=0.001759, batch_cost=0.4459, reader_cost=0.0002 | ETA 00:42:52 2020-11-14 05:22:25 [INFO] [TRAIN] epoch=52, iter=34240/40000, loss=0.1845, lr=0.001756, batch_cost=0.4484, reader_cost=0.0002 | ETA 00:43:02 2020-11-14 05:22:30 [INFO] [TRAIN] epoch=52, iter=34250/40000, loss=0.1777, lr=0.001754, batch_cost=0.4468, reader_cost=0.0002 | ETA 00:42:48 2020-11-14 05:22:34 [INFO] [TRAIN] epoch=52, iter=34260/40000, loss=0.2158, lr=0.001751, batch_cost=0.4449, reader_cost=0.0002 | ETA 00:42:33 2020-11-14 05:22:39 [INFO] [TRAIN] epoch=52, iter=34270/40000, loss=0.1959, lr=0.001748, batch_cost=0.4369, reader_cost=0.0002 | ETA 00:41:43 2020-11-14 05:22:43 [INFO] [TRAIN] epoch=52, iter=34280/40000, loss=0.2371, lr=0.001746, batch_cost=0.4403, reader_cost=0.0002 | ETA 00:41:58 2020-11-14 05:22:47 [INFO] [TRAIN] epoch=52, iter=34290/40000, loss=0.2093, lr=0.001743, batch_cost=0.4334, reader_cost=0.0002 | ETA 00:41:14 2020-11-14 05:22:52 [INFO] [TRAIN] epoch=52, iter=34300/40000, loss=0.1433, lr=0.001740, batch_cost=0.4363, reader_cost=0.0002 | ETA 00:41:26 2020-11-14 05:22:56 [INFO] [TRAIN] epoch=52, iter=34310/40000, loss=0.1687, lr=0.001737, batch_cost=0.4291, reader_cost=0.0002 | ETA 00:40:41 2020-11-14 05:23:00 [INFO] [TRAIN] epoch=52, iter=34320/40000, loss=0.2377, lr=0.001735, batch_cost=0.4313, reader_cost=0.0002 | ETA 00:40:49 2020-11-14 05:23:05 [INFO] [TRAIN] epoch=52, iter=34330/40000, loss=0.2274, lr=0.001732, batch_cost=0.4344, reader_cost=0.0002 | ETA 00:41:03 2020-11-14 05:23:09 [INFO] [TRAIN] epoch=52, iter=34340/40000, loss=0.1703, lr=0.001729, batch_cost=0.4423, reader_cost=0.0002 | ETA 00:41:43 2020-11-14 05:23:13 [INFO] [TRAIN] epoch=52, iter=34350/40000, loss=0.2437, lr=0.001726, batch_cost=0.4354, reader_cost=0.0002 | ETA 00:40:59 2020-11-14 05:23:18 [INFO] [TRAIN] epoch=52, iter=34360/40000, loss=0.2336, lr=0.001724, batch_cost=0.4345, reader_cost=0.0002 | ETA 00:40:50 2020-11-14 05:23:22 [INFO] [TRAIN] epoch=52, iter=34370/40000, loss=0.2074, lr=0.001721, batch_cost=0.4322, reader_cost=0.0002 | ETA 00:40:33 2020-11-14 05:23:28 [INFO] [TRAIN] epoch=53, iter=34380/40000, loss=0.1581, lr=0.001718, batch_cost=0.5800, reader_cost=0.0847 | ETA 00:54:19 2020-11-14 05:23:33 [INFO] [TRAIN] epoch=53, iter=34390/40000, loss=0.1958, lr=0.001715, batch_cost=0.4749, reader_cost=0.0005 | ETA 00:44:24 2020-11-14 05:23:38 [INFO] [TRAIN] epoch=53, iter=34400/40000, loss=0.2353, lr=0.001713, batch_cost=0.5086, reader_cost=0.0002 | ETA 00:47:28 2020-11-14 05:23:43 [INFO] [TRAIN] epoch=53, iter=34410/40000, loss=0.1916, lr=0.001710, batch_cost=0.4911, reader_cost=0.0002 | ETA 00:45:45 2020-11-14 05:23:48 [INFO] [TRAIN] epoch=53, iter=34420/40000, loss=0.2090, lr=0.001707, batch_cost=0.5054, reader_cost=0.0002 | ETA 00:47:00 2020-11-14 05:23:52 [INFO] [TRAIN] epoch=53, iter=34430/40000, loss=0.1931, lr=0.001705, batch_cost=0.4391, reader_cost=0.0002 | ETA 00:40:46 2020-11-14 05:23:57 [INFO] [TRAIN] epoch=53, iter=34440/40000, loss=0.2174, lr=0.001702, batch_cost=0.4764, reader_cost=0.0002 | ETA 00:44:08 2020-11-14 05:24:02 [INFO] [TRAIN] epoch=53, iter=34450/40000, loss=0.1472, lr=0.001699, batch_cost=0.4764, reader_cost=0.0002 | ETA 00:44:04 2020-11-14 05:24:07 [INFO] [TRAIN] epoch=53, iter=34460/40000, loss=0.2299, lr=0.001696, batch_cost=0.4875, reader_cost=0.0002 | ETA 00:45:00 2020-11-14 05:24:11 [INFO] [TRAIN] epoch=53, iter=34470/40000, loss=0.1817, lr=0.001694, batch_cost=0.4744, reader_cost=0.0006 | ETA 00:43:43 2020-11-14 05:24:16 [INFO] [TRAIN] epoch=53, iter=34480/40000, loss=0.1719, lr=0.001691, batch_cost=0.4414, reader_cost=0.0002 | ETA 00:40:36 2020-11-14 05:24:20 [INFO] [TRAIN] epoch=53, iter=34490/40000, loss=0.1573, lr=0.001688, batch_cost=0.4549, reader_cost=0.0002 | ETA 00:41:46 2020-11-14 05:24:25 [INFO] [TRAIN] epoch=53, iter=34500/40000, loss=0.2085, lr=0.001685, batch_cost=0.4504, reader_cost=0.0002 | ETA 00:41:17 2020-11-14 05:24:29 [INFO] [TRAIN] epoch=53, iter=34510/40000, loss=0.2127, lr=0.001683, batch_cost=0.4532, reader_cost=0.0002 | ETA 00:41:27 2020-11-14 05:24:34 [INFO] [TRAIN] epoch=53, iter=34520/40000, loss=0.2304, lr=0.001680, batch_cost=0.4482, reader_cost=0.0002 | ETA 00:40:55 2020-11-14 05:24:38 [INFO] [TRAIN] epoch=53, iter=34530/40000, loss=0.1843, lr=0.001677, batch_cost=0.4355, reader_cost=0.0002 | ETA 00:39:41 2020-11-14 05:24:42 [INFO] [TRAIN] epoch=53, iter=34540/40000, loss=0.1663, lr=0.001674, batch_cost=0.4337, reader_cost=0.0002 | ETA 00:39:27 2020-11-14 05:24:47 [INFO] [TRAIN] epoch=53, iter=34550/40000, loss=0.1468, lr=0.001672, batch_cost=0.4308, reader_cost=0.0002 | ETA 00:39:08 2020-11-14 05:24:51 [INFO] [TRAIN] epoch=53, iter=34560/40000, loss=0.1359, lr=0.001669, batch_cost=0.4322, reader_cost=0.0001 | ETA 00:39:11 2020-11-14 05:24:55 [INFO] [TRAIN] epoch=53, iter=34570/40000, loss=0.2420, lr=0.001666, batch_cost=0.4327, reader_cost=0.0002 | ETA 00:39:09 2020-11-14 05:25:00 [INFO] [TRAIN] epoch=53, iter=34580/40000, loss=0.1576, lr=0.001663, batch_cost=0.4338, reader_cost=0.0002 | ETA 00:39:11 2020-11-14 05:25:04 [INFO] [TRAIN] epoch=53, iter=34590/40000, loss=0.1751, lr=0.001661, batch_cost=0.4423, reader_cost=0.0002 | ETA 00:39:52 2020-11-14 05:25:08 [INFO] [TRAIN] epoch=53, iter=34600/40000, loss=0.2090, lr=0.001658, batch_cost=0.4347, reader_cost=0.0002 | ETA 00:39:07 2020-11-14 05:25:13 [INFO] [TRAIN] epoch=53, iter=34610/40000, loss=0.1904, lr=0.001655, batch_cost=0.4458, reader_cost=0.0002 | ETA 00:40:02 2020-11-14 05:25:18 [INFO] [TRAIN] epoch=53, iter=34620/40000, loss=0.2191, lr=0.001652, batch_cost=0.4762, reader_cost=0.0002 | ETA 00:42:41 2020-11-14 05:25:22 [INFO] [TRAIN] epoch=53, iter=34630/40000, loss=0.2262, lr=0.001650, batch_cost=0.4649, reader_cost=0.0002 | ETA 00:41:36 2020-11-14 05:25:27 [INFO] [TRAIN] epoch=53, iter=34640/40000, loss=0.2292, lr=0.001647, batch_cost=0.4444, reader_cost=0.0002 | ETA 00:39:41 2020-11-14 05:25:31 [INFO] [TRAIN] epoch=53, iter=34650/40000, loss=0.1726, lr=0.001644, batch_cost=0.4474, reader_cost=0.0002 | ETA 00:39:53 2020-11-14 05:25:36 [INFO] [TRAIN] epoch=53, iter=34660/40000, loss=0.1815, lr=0.001641, batch_cost=0.4437, reader_cost=0.0002 | ETA 00:39:29 2020-11-14 05:25:40 [INFO] [TRAIN] epoch=53, iter=34670/40000, loss=0.2102, lr=0.001639, batch_cost=0.4530, reader_cost=0.0002 | ETA 00:40:14 2020-11-14 05:25:45 [INFO] [TRAIN] epoch=53, iter=34680/40000, loss=0.1917, lr=0.001636, batch_cost=0.4679, reader_cost=0.0002 | ETA 00:41:29 2020-11-14 05:25:49 [INFO] [TRAIN] epoch=53, iter=34690/40000, loss=0.1973, lr=0.001633, batch_cost=0.4413, reader_cost=0.0002 | ETA 00:39:03 2020-11-14 05:25:54 [INFO] [TRAIN] epoch=53, iter=34700/40000, loss=0.1380, lr=0.001630, batch_cost=0.4776, reader_cost=0.0002 | ETA 00:42:11 2020-11-14 05:25:59 [INFO] [TRAIN] epoch=53, iter=34710/40000, loss=0.2474, lr=0.001628, batch_cost=0.4931, reader_cost=0.0002 | ETA 00:43:28 2020-11-14 05:26:04 [INFO] [TRAIN] epoch=53, iter=34720/40000, loss=0.2449, lr=0.001625, batch_cost=0.4582, reader_cost=0.0002 | ETA 00:40:19 2020-11-14 05:26:08 [INFO] [TRAIN] epoch=53, iter=34730/40000, loss=0.1823, lr=0.001622, batch_cost=0.4364, reader_cost=0.0002 | ETA 00:38:19 2020-11-14 05:26:12 [INFO] [TRAIN] epoch=53, iter=34740/40000, loss=0.1979, lr=0.001619, batch_cost=0.4430, reader_cost=0.0002 | ETA 00:38:50 2020-11-14 05:26:17 [INFO] [TRAIN] epoch=53, iter=34750/40000, loss=0.1506, lr=0.001617, batch_cost=0.4734, reader_cost=0.0002 | ETA 00:41:25 2020-11-14 05:26:22 [INFO] [TRAIN] epoch=53, iter=34760/40000, loss=0.1968, lr=0.001614, batch_cost=0.4846, reader_cost=0.0002 | ETA 00:42:19 2020-11-14 05:26:27 [INFO] [TRAIN] epoch=53, iter=34770/40000, loss=0.2272, lr=0.001611, batch_cost=0.4620, reader_cost=0.0002 | ETA 00:40:16 2020-11-14 05:26:31 [INFO] [TRAIN] epoch=53, iter=34780/40000, loss=0.2124, lr=0.001608, batch_cost=0.4396, reader_cost=0.0002 | ETA 00:38:14 2020-11-14 05:26:35 [INFO] [TRAIN] epoch=53, iter=34790/40000, loss=0.1611, lr=0.001606, batch_cost=0.4412, reader_cost=0.0002 | ETA 00:38:18 2020-11-14 05:26:40 [INFO] [TRAIN] epoch=53, iter=34800/40000, loss=0.2497, lr=0.001603, batch_cost=0.4595, reader_cost=0.0002 | ETA 00:39:49 2020-11-14 05:26:45 [INFO] [TRAIN] epoch=53, iter=34810/40000, loss=0.1615, lr=0.001600, batch_cost=0.4570, reader_cost=0.0002 | ETA 00:39:32 2020-11-14 05:26:49 [INFO] [TRAIN] epoch=53, iter=34820/40000, loss=0.2248, lr=0.001597, batch_cost=0.4648, reader_cost=0.0002 | ETA 00:40:07 2020-11-14 05:26:54 [INFO] [TRAIN] epoch=53, iter=34830/40000, loss=0.2214, lr=0.001595, batch_cost=0.4588, reader_cost=0.0002 | ETA 00:39:31 2020-11-14 05:26:58 [INFO] [TRAIN] epoch=53, iter=34840/40000, loss=0.1794, lr=0.001592, batch_cost=0.4575, reader_cost=0.0002 | ETA 00:39:20 2020-11-14 05:27:03 [INFO] [TRAIN] epoch=53, iter=34850/40000, loss=0.1457, lr=0.001589, batch_cost=0.4372, reader_cost=0.0002 | ETA 00:37:31 2020-11-14 05:27:07 [INFO] [TRAIN] epoch=53, iter=34860/40000, loss=0.1925, lr=0.001586, batch_cost=0.4486, reader_cost=0.0002 | ETA 00:38:25 2020-11-14 05:27:12 [INFO] [TRAIN] epoch=53, iter=34870/40000, loss=0.1800, lr=0.001584, batch_cost=0.4472, reader_cost=0.0002 | ETA 00:38:14 2020-11-14 05:27:16 [INFO] [TRAIN] epoch=53, iter=34880/40000, loss=0.1615, lr=0.001581, batch_cost=0.4430, reader_cost=0.0002 | ETA 00:37:48 2020-11-14 05:27:21 [INFO] [TRAIN] epoch=53, iter=34890/40000, loss=0.2206, lr=0.001578, batch_cost=0.4638, reader_cost=0.0002 | ETA 00:39:30 2020-11-14 05:27:26 [INFO] [TRAIN] epoch=53, iter=34900/40000, loss=0.2391, lr=0.001575, batch_cost=0.4819, reader_cost=0.0002 | ETA 00:40:57 2020-11-14 05:27:31 [INFO] [TRAIN] epoch=53, iter=34910/40000, loss=0.1862, lr=0.001573, batch_cost=0.5418, reader_cost=0.0002 | ETA 00:45:57 2020-11-14 05:27:36 [INFO] [TRAIN] epoch=53, iter=34920/40000, loss=0.1860, lr=0.001570, batch_cost=0.4667, reader_cost=0.0002 | ETA 00:39:31 2020-11-14 05:27:41 [INFO] [TRAIN] epoch=53, iter=34930/40000, loss=0.1627, lr=0.001567, batch_cost=0.4812, reader_cost=0.0002 | ETA 00:40:39 2020-11-14 05:27:45 [INFO] [TRAIN] epoch=53, iter=34940/40000, loss=0.2314, lr=0.001564, batch_cost=0.4701, reader_cost=0.0002 | ETA 00:39:38 2020-11-14 05:27:50 [INFO] [TRAIN] epoch=53, iter=34950/40000, loss=0.2652, lr=0.001561, batch_cost=0.4617, reader_cost=0.0002 | ETA 00:38:51 2020-11-14 05:27:54 [INFO] [TRAIN] epoch=53, iter=34960/40000, loss=0.2010, lr=0.001559, batch_cost=0.4446, reader_cost=0.0002 | ETA 00:37:20 2020-11-14 05:27:59 [INFO] [TRAIN] epoch=53, iter=34970/40000, loss=0.2434, lr=0.001556, batch_cost=0.4526, reader_cost=0.0002 | ETA 00:37:56 2020-11-14 05:28:03 [INFO] [TRAIN] epoch=53, iter=34980/40000, loss=0.2449, lr=0.001553, batch_cost=0.4441, reader_cost=0.0002 | ETA 00:37:09 2020-11-14 05:28:08 [INFO] [TRAIN] epoch=53, iter=34990/40000, loss=0.1888, lr=0.001550, batch_cost=0.4651, reader_cost=0.0003 | ETA 00:38:50 2020-11-14 05:28:13 [INFO] [TRAIN] epoch=53, iter=35000/40000, loss=0.1907, lr=0.001548, batch_cost=0.4814, reader_cost=0.0002 | ETA 00:40:07 2020-11-14 05:28:18 [INFO] [TRAIN] epoch=53, iter=35010/40000, loss=0.1888, lr=0.001545, batch_cost=0.4870, reader_cost=0.0002 | ETA 00:40:30 2020-11-14 05:28:23 [INFO] [TRAIN] epoch=53, iter=35020/40000, loss=0.2058, lr=0.001542, batch_cost=0.4924, reader_cost=0.0002 | ETA 00:40:52 2020-11-14 05:28:27 [INFO] [TRAIN] epoch=53, iter=35030/40000, loss=0.1923, lr=0.001539, batch_cost=0.4767, reader_cost=0.0002 | ETA 00:39:29 2020-11-14 05:28:34 [INFO] [TRAIN] epoch=54, iter=35040/40000, loss=0.1947, lr=0.001537, batch_cost=0.6262, reader_cost=0.1185 | ETA 00:51:45 2020-11-14 05:28:38 [INFO] [TRAIN] epoch=54, iter=35050/40000, loss=0.1997, lr=0.001534, batch_cost=0.4726, reader_cost=0.0005 | ETA 00:38:59 2020-11-14 05:28:43 [INFO] [TRAIN] epoch=54, iter=35060/40000, loss=0.1547, lr=0.001531, batch_cost=0.4744, reader_cost=0.0002 | ETA 00:39:03 2020-11-14 05:28:48 [INFO] [TRAIN] epoch=54, iter=35070/40000, loss=0.1917, lr=0.001528, batch_cost=0.4439, reader_cost=0.0002 | ETA 00:36:28 2020-11-14 05:28:52 [INFO] [TRAIN] epoch=54, iter=35080/40000, loss=0.1969, lr=0.001526, batch_cost=0.4593, reader_cost=0.0002 | ETA 00:37:39 2020-11-14 05:28:57 [INFO] [TRAIN] epoch=54, iter=35090/40000, loss=0.1635, lr=0.001523, batch_cost=0.4822, reader_cost=0.0002 | ETA 00:39:27 2020-11-14 05:29:02 [INFO] [TRAIN] epoch=54, iter=35100/40000, loss=0.2001, lr=0.001520, batch_cost=0.4887, reader_cost=0.0002 | ETA 00:39:54 2020-11-14 05:29:06 [INFO] [TRAIN] epoch=54, iter=35110/40000, loss=0.1861, lr=0.001517, batch_cost=0.4528, reader_cost=0.0002 | ETA 00:36:54 2020-11-14 05:29:11 [INFO] [TRAIN] epoch=54, iter=35120/40000, loss=0.1520, lr=0.001514, batch_cost=0.5003, reader_cost=0.0002 | ETA 00:40:41 2020-11-14 05:29:16 [INFO] [TRAIN] epoch=54, iter=35130/40000, loss=0.2345, lr=0.001512, batch_cost=0.4678, reader_cost=0.0002 | ETA 00:37:58 2020-11-14 05:29:21 [INFO] [TRAIN] epoch=54, iter=35140/40000, loss=0.2131, lr=0.001509, batch_cost=0.4716, reader_cost=0.0002 | ETA 00:38:12 2020-11-14 05:29:25 [INFO] [TRAIN] epoch=54, iter=35150/40000, loss=0.2208, lr=0.001506, batch_cost=0.4562, reader_cost=0.0002 | ETA 00:36:52 2020-11-14 05:29:30 [INFO] [TRAIN] epoch=54, iter=35160/40000, loss=0.1487, lr=0.001503, batch_cost=0.4352, reader_cost=0.0002 | ETA 00:35:06 2020-11-14 05:29:34 [INFO] [TRAIN] epoch=54, iter=35170/40000, loss=0.1583, lr=0.001501, batch_cost=0.4776, reader_cost=0.0010 | ETA 00:38:26 2020-11-14 05:29:39 [INFO] [TRAIN] epoch=54, iter=35180/40000, loss=0.2436, lr=0.001498, batch_cost=0.4711, reader_cost=0.0011 | ETA 00:37:50 2020-11-14 05:29:44 [INFO] [TRAIN] epoch=54, iter=35190/40000, loss=0.1948, lr=0.001495, batch_cost=0.4410, reader_cost=0.0002 | ETA 00:35:21 2020-11-14 05:29:48 [INFO] [TRAIN] epoch=54, iter=35200/40000, loss=0.2010, lr=0.001492, batch_cost=0.4370, reader_cost=0.0002 | ETA 00:34:57 2020-11-14 05:29:52 [INFO] [TRAIN] epoch=54, iter=35210/40000, loss=0.2245, lr=0.001489, batch_cost=0.4375, reader_cost=0.0002 | ETA 00:34:55 2020-11-14 05:29:57 [INFO] [TRAIN] epoch=54, iter=35220/40000, loss=0.2193, lr=0.001487, batch_cost=0.4358, reader_cost=0.0002 | ETA 00:34:43 2020-11-14 05:30:01 [INFO] [TRAIN] epoch=54, iter=35230/40000, loss=0.1614, lr=0.001484, batch_cost=0.4380, reader_cost=0.0002 | ETA 00:34:49 2020-11-14 05:30:05 [INFO] [TRAIN] epoch=54, iter=35240/40000, loss=0.2055, lr=0.001481, batch_cost=0.4396, reader_cost=0.0002 | ETA 00:34:52 2020-11-14 05:30:10 [INFO] [TRAIN] epoch=54, iter=35250/40000, loss=0.1807, lr=0.001478, batch_cost=0.4349, reader_cost=0.0002 | ETA 00:34:25 2020-11-14 05:30:14 [INFO] [TRAIN] epoch=54, iter=35260/40000, loss=0.1475, lr=0.001476, batch_cost=0.4519, reader_cost=0.0097 | ETA 00:35:42 2020-11-14 05:30:19 [INFO] [TRAIN] epoch=54, iter=35270/40000, loss=0.1791, lr=0.001473, batch_cost=0.4518, reader_cost=0.0015 | ETA 00:35:36 2020-11-14 05:30:23 [INFO] [TRAIN] epoch=54, iter=35280/40000, loss=0.1568, lr=0.001470, batch_cost=0.4365, reader_cost=0.0002 | ETA 00:34:20 2020-11-14 05:30:28 [INFO] [TRAIN] epoch=54, iter=35290/40000, loss=0.2025, lr=0.001467, batch_cost=0.4326, reader_cost=0.0001 | ETA 00:33:57 2020-11-14 05:30:32 [INFO] [TRAIN] epoch=54, iter=35300/40000, loss=0.2262, lr=0.001464, batch_cost=0.4343, reader_cost=0.0001 | ETA 00:34:01 2020-11-14 05:30:36 [INFO] [TRAIN] epoch=54, iter=35310/40000, loss=0.1633, lr=0.001462, batch_cost=0.4464, reader_cost=0.0002 | ETA 00:34:53 2020-11-14 05:30:41 [INFO] [TRAIN] epoch=54, iter=35320/40000, loss=0.1415, lr=0.001459, batch_cost=0.4682, reader_cost=0.0010 | ETA 00:36:31 2020-11-14 05:30:46 [INFO] [TRAIN] epoch=54, iter=35330/40000, loss=0.2060, lr=0.001456, batch_cost=0.4562, reader_cost=0.0007 | ETA 00:35:30 2020-11-14 05:30:50 [INFO] [TRAIN] epoch=54, iter=35340/40000, loss=0.2064, lr=0.001453, batch_cost=0.4360, reader_cost=0.0002 | ETA 00:33:51 2020-11-14 05:30:55 [INFO] [TRAIN] epoch=54, iter=35350/40000, loss=0.2087, lr=0.001450, batch_cost=0.4646, reader_cost=0.0002 | ETA 00:36:00 2020-11-14 05:30:59 [INFO] [TRAIN] epoch=54, iter=35360/40000, loss=0.1905, lr=0.001448, batch_cost=0.4582, reader_cost=0.0002 | ETA 00:35:26 2020-11-14 05:31:04 [INFO] [TRAIN] epoch=54, iter=35370/40000, loss=0.2535, lr=0.001445, batch_cost=0.4704, reader_cost=0.0002 | ETA 00:36:17 2020-11-14 05:31:08 [INFO] [TRAIN] epoch=54, iter=35380/40000, loss=0.1819, lr=0.001442, batch_cost=0.4391, reader_cost=0.0002 | ETA 00:33:48 2020-11-14 05:31:13 [INFO] [TRAIN] epoch=54, iter=35390/40000, loss=0.2454, lr=0.001439, batch_cost=0.4409, reader_cost=0.0002 | ETA 00:33:52 2020-11-14 05:31:17 [INFO] [TRAIN] epoch=54, iter=35400/40000, loss=0.2018, lr=0.001437, batch_cost=0.4512, reader_cost=0.0002 | ETA 00:34:35 2020-11-14 05:31:22 [INFO] [TRAIN] epoch=54, iter=35410/40000, loss=0.1964, lr=0.001434, batch_cost=0.4584, reader_cost=0.0011 | ETA 00:35:03 2020-11-14 05:31:27 [INFO] [TRAIN] epoch=54, iter=35420/40000, loss=0.1829, lr=0.001431, batch_cost=0.5043, reader_cost=0.0002 | ETA 00:38:29 2020-11-14 05:31:32 [INFO] [TRAIN] epoch=54, iter=35430/40000, loss=0.2050, lr=0.001428, batch_cost=0.4845, reader_cost=0.0004 | ETA 00:36:54 2020-11-14 05:31:36 [INFO] [TRAIN] epoch=54, iter=35440/40000, loss=0.1502, lr=0.001425, batch_cost=0.4721, reader_cost=0.0002 | ETA 00:35:52 2020-11-14 05:31:41 [INFO] [TRAIN] epoch=54, iter=35450/40000, loss=0.1928, lr=0.001423, batch_cost=0.4540, reader_cost=0.0003 | ETA 00:34:25 2020-11-14 05:31:46 [INFO] [TRAIN] epoch=54, iter=35460/40000, loss=0.2487, lr=0.001420, batch_cost=0.4662, reader_cost=0.0002 | ETA 00:35:16 2020-11-14 05:31:50 [INFO] [TRAIN] epoch=54, iter=35470/40000, loss=0.2378, lr=0.001417, batch_cost=0.4613, reader_cost=0.0002 | ETA 00:34:49 2020-11-14 05:31:55 [INFO] [TRAIN] epoch=54, iter=35480/40000, loss=0.1910, lr=0.001414, batch_cost=0.4691, reader_cost=0.0002 | ETA 00:35:20 2020-11-14 05:32:00 [INFO] [TRAIN] epoch=54, iter=35490/40000, loss=0.1745, lr=0.001411, batch_cost=0.4884, reader_cost=0.0002 | ETA 00:36:42 2020-11-14 05:32:05 [INFO] [TRAIN] epoch=54, iter=35500/40000, loss=0.1527, lr=0.001409, batch_cost=0.4766, reader_cost=0.0002 | ETA 00:35:44 2020-11-14 05:32:09 [INFO] [TRAIN] epoch=54, iter=35510/40000, loss=0.2239, lr=0.001406, batch_cost=0.4480, reader_cost=0.0002 | ETA 00:33:31 2020-11-14 05:32:14 [INFO] [TRAIN] epoch=54, iter=35520/40000, loss=0.1661, lr=0.001403, batch_cost=0.4739, reader_cost=0.0002 | ETA 00:35:23 2020-11-14 05:32:18 [INFO] [TRAIN] epoch=54, iter=35530/40000, loss=0.2146, lr=0.001400, batch_cost=0.4647, reader_cost=0.0002 | ETA 00:34:37 2020-11-14 05:32:23 [INFO] [TRAIN] epoch=54, iter=35540/40000, loss=0.2125, lr=0.001397, batch_cost=0.4607, reader_cost=0.0002 | ETA 00:34:14 2020-11-14 05:32:28 [INFO] [TRAIN] epoch=54, iter=35550/40000, loss=0.2200, lr=0.001395, batch_cost=0.4578, reader_cost=0.0002 | ETA 00:33:57 2020-11-14 05:32:32 [INFO] [TRAIN] epoch=54, iter=35560/40000, loss=0.2697, lr=0.001392, batch_cost=0.4786, reader_cost=0.0002 | ETA 00:35:25 2020-11-14 05:32:37 [INFO] [TRAIN] epoch=54, iter=35570/40000, loss=0.1703, lr=0.001389, batch_cost=0.4985, reader_cost=0.0002 | ETA 00:36:48 2020-11-14 05:32:42 [INFO] [TRAIN] epoch=54, iter=35580/40000, loss=0.2233, lr=0.001386, batch_cost=0.4598, reader_cost=0.0002 | ETA 00:33:52 2020-11-14 05:32:47 [INFO] [TRAIN] epoch=54, iter=35590/40000, loss=0.1629, lr=0.001383, batch_cost=0.4571, reader_cost=0.0002 | ETA 00:33:35 2020-11-14 05:32:51 [INFO] [TRAIN] epoch=54, iter=35600/40000, loss=0.2216, lr=0.001381, batch_cost=0.4501, reader_cost=0.0002 | ETA 00:33:00 2020-11-14 05:32:55 [INFO] [TRAIN] epoch=54, iter=35610/40000, loss=0.1483, lr=0.001378, batch_cost=0.4381, reader_cost=0.0002 | ETA 00:32:03 2020-11-14 05:33:00 [INFO] [TRAIN] epoch=54, iter=35620/40000, loss=0.1559, lr=0.001375, batch_cost=0.4850, reader_cost=0.0002 | ETA 00:35:24 2020-11-14 05:33:05 [INFO] [TRAIN] epoch=54, iter=35630/40000, loss=0.2016, lr=0.001372, batch_cost=0.4415, reader_cost=0.0002 | ETA 00:32:09 2020-11-14 05:33:09 [INFO] [TRAIN] epoch=54, iter=35640/40000, loss=0.2280, lr=0.001369, batch_cost=0.4739, reader_cost=0.0002 | ETA 00:34:26 2020-11-14 05:33:14 [INFO] [TRAIN] epoch=54, iter=35650/40000, loss=0.2106, lr=0.001367, batch_cost=0.5045, reader_cost=0.0002 | ETA 00:36:34 2020-11-14 05:33:19 [INFO] [TRAIN] epoch=54, iter=35660/40000, loss=0.1911, lr=0.001364, batch_cost=0.4703, reader_cost=0.0002 | ETA 00:34:01 2020-11-14 05:33:27 [INFO] [TRAIN] epoch=54, iter=35670/40000, loss=0.2485, lr=0.001361, batch_cost=0.7356, reader_cost=0.0002 | ETA 00:53:05 2020-11-14 05:33:31 [INFO] [TRAIN] epoch=54, iter=35680/40000, loss=0.1837, lr=0.001358, batch_cost=0.4409, reader_cost=0.0002 | ETA 00:31:44 2020-11-14 05:33:35 [INFO] [TRAIN] epoch=54, iter=35690/40000, loss=0.2948, lr=0.001355, batch_cost=0.4399, reader_cost=0.0002 | ETA 00:31:36 2020-11-14 05:33:41 [INFO] [TRAIN] epoch=55, iter=35700/40000, loss=0.1816, lr=0.001353, batch_cost=0.5754, reader_cost=0.1160 | ETA 00:41:14 2020-11-14 05:33:46 [INFO] [TRAIN] epoch=55, iter=35710/40000, loss=0.2627, lr=0.001350, batch_cost=0.4590, reader_cost=0.0002 | ETA 00:32:49 2020-11-14 05:33:53 [INFO] [TRAIN] epoch=55, iter=35720/40000, loss=0.2117, lr=0.001347, batch_cost=0.7138, reader_cost=0.0004 | ETA 00:50:54 2020-11-14 05:33:58 [INFO] [TRAIN] epoch=55, iter=35730/40000, loss=0.2452, lr=0.001344, batch_cost=0.4948, reader_cost=0.0002 | ETA 00:35:12 2020-11-14 05:34:03 [INFO] [TRAIN] epoch=55, iter=35740/40000, loss=0.2197, lr=0.001341, batch_cost=0.4758, reader_cost=0.0012 | ETA 00:33:46 2020-11-14 05:34:07 [INFO] [TRAIN] epoch=55, iter=35750/40000, loss=0.1546, lr=0.001338, batch_cost=0.4486, reader_cost=0.0002 | ETA 00:31:46 2020-11-14 05:34:12 [INFO] [TRAIN] epoch=55, iter=35760/40000, loss=0.2515, lr=0.001336, batch_cost=0.4818, reader_cost=0.0006 | ETA 00:34:03 2020-11-14 05:34:17 [INFO] [TRAIN] epoch=55, iter=35770/40000, loss=0.1718, lr=0.001333, batch_cost=0.4994, reader_cost=0.0004 | ETA 00:35:12 2020-11-14 05:34:22 [INFO] [TRAIN] epoch=55, iter=35780/40000, loss=0.2051, lr=0.001330, batch_cost=0.4692, reader_cost=0.0002 | ETA 00:33:00 2020-11-14 05:34:26 [INFO] [TRAIN] epoch=55, iter=35790/40000, loss=0.1679, lr=0.001327, batch_cost=0.4760, reader_cost=0.0015 | ETA 00:33:23 2020-11-14 05:34:31 [INFO] [TRAIN] epoch=55, iter=35800/40000, loss=0.2087, lr=0.001324, batch_cost=0.4810, reader_cost=0.0002 | ETA 00:33:40 2020-11-14 05:34:36 [INFO] [TRAIN] epoch=55, iter=35810/40000, loss=0.1235, lr=0.001322, batch_cost=0.4815, reader_cost=0.0030 | ETA 00:33:37 2020-11-14 05:34:41 [INFO] [TRAIN] epoch=55, iter=35820/40000, loss=0.1965, lr=0.001319, batch_cost=0.4644, reader_cost=0.0045 | ETA 00:32:21 2020-11-14 05:34:45 [INFO] [TRAIN] epoch=55, iter=35830/40000, loss=0.2167, lr=0.001316, batch_cost=0.4869, reader_cost=0.0002 | ETA 00:33:50 2020-11-14 05:34:50 [INFO] [TRAIN] epoch=55, iter=35840/40000, loss=0.2598, lr=0.001313, batch_cost=0.4822, reader_cost=0.0002 | ETA 00:33:25 2020-11-14 05:34:55 [INFO] [TRAIN] epoch=55, iter=35850/40000, loss=0.1691, lr=0.001310, batch_cost=0.4890, reader_cost=0.0015 | ETA 00:33:49 2020-11-14 05:35:00 [INFO] [TRAIN] epoch=55, iter=35860/40000, loss=0.2208, lr=0.001307, batch_cost=0.4565, reader_cost=0.0005 | ETA 00:31:29 2020-11-14 05:35:05 [INFO] [TRAIN] epoch=55, iter=35870/40000, loss=0.2286, lr=0.001305, batch_cost=0.5049, reader_cost=0.0002 | ETA 00:34:45 2020-11-14 05:35:09 [INFO] [TRAIN] epoch=55, iter=35880/40000, loss=0.1995, lr=0.001302, batch_cost=0.4604, reader_cost=0.0002 | ETA 00:31:36 2020-11-14 05:35:14 [INFO] [TRAIN] epoch=55, iter=35890/40000, loss=0.1843, lr=0.001299, batch_cost=0.4399, reader_cost=0.0002 | ETA 00:30:07 2020-11-14 05:35:19 [INFO] [TRAIN] epoch=55, iter=35900/40000, loss=0.1707, lr=0.001296, batch_cost=0.5276, reader_cost=0.0002 | ETA 00:36:03 2020-11-14 05:35:24 [INFO] [TRAIN] epoch=55, iter=35910/40000, loss=0.1762, lr=0.001293, batch_cost=0.4605, reader_cost=0.0002 | ETA 00:31:23 2020-11-14 05:35:28 [INFO] [TRAIN] epoch=55, iter=35920/40000, loss=0.2489, lr=0.001291, batch_cost=0.4423, reader_cost=0.0002 | ETA 00:30:04 2020-11-14 05:35:33 [INFO] [TRAIN] epoch=55, iter=35930/40000, loss=0.1855, lr=0.001288, batch_cost=0.4625, reader_cost=0.0002 | ETA 00:31:22 2020-11-14 05:35:37 [INFO] [TRAIN] epoch=55, iter=35940/40000, loss=0.2165, lr=0.001285, batch_cost=0.4573, reader_cost=0.0002 | ETA 00:30:56 2020-11-14 05:35:42 [INFO] [TRAIN] epoch=55, iter=35950/40000, loss=0.1733, lr=0.001282, batch_cost=0.4417, reader_cost=0.0002 | ETA 00:29:48 2020-11-14 05:35:46 [INFO] [TRAIN] epoch=55, iter=35960/40000, loss=0.2415, lr=0.001279, batch_cost=0.4413, reader_cost=0.0002 | ETA 00:29:42 2020-11-14 05:35:51 [INFO] [TRAIN] epoch=55, iter=35970/40000, loss=0.2041, lr=0.001276, batch_cost=0.4357, reader_cost=0.0002 | ETA 00:29:15 2020-11-14 05:35:55 [INFO] [TRAIN] epoch=55, iter=35980/40000, loss=0.1382, lr=0.001274, batch_cost=0.4340, reader_cost=0.0002 | ETA 00:29:04 2020-11-14 05:35:59 [INFO] [TRAIN] epoch=55, iter=35990/40000, loss=0.2251, lr=0.001271, batch_cost=0.4405, reader_cost=0.0002 | ETA 00:29:26 2020-11-14 05:36:04 [INFO] [TRAIN] epoch=55, iter=36000/40000, loss=0.1959, lr=0.001268, batch_cost=0.4723, reader_cost=0.0003 | ETA 00:31:29 2020-11-14 05:36:04 [INFO] Start evaluating (total_samples=1449, total_iters=363)... 2020-11-14 05:36:25 [INFO] [EVAL] #Images=1449 mIoU=0.7999 Acc=0.9559 Kappa=0.9021 2020-11-14 05:36:25 [INFO] [EVAL] Class IoU: [0.9488 0.9255 0.4342 0.8963 0.7003 0.83 0.9587 0.9159 0.9441 0.471 0.8857 0.5609 0.9116 0.9227 0.8985 0.8745 0.6493 0.847 0.5615 0.9186 0.7432] 2020-11-14 05:36:25 [INFO] [EVAL] Class Acc: [0.9683 0.9575 0.4479 0.9495 0.8065 0.9007 0.9799 0.9732 0.967 0.6979 0.9366 0.9433 0.9476 0.9556 0.9321 0.9436 0.8385 0.9397 0.8489 0.9651 0.8961] 2020-11-14 05:36:31 [INFO] [EVAL] The model with the best validation mIoU (0.8018) was saved at iter 34000. 2020-11-14 05:36:35 [INFO] [TRAIN] epoch=55, iter=36010/40000, loss=0.2922, lr=0.001265, batch_cost=0.4547, reader_cost=0.0005 | ETA 00:30:14 2020-11-14 05:36:40 [INFO] [TRAIN] epoch=55, iter=36020/40000, loss=0.1623, lr=0.001262, batch_cost=0.4775, reader_cost=0.0002 | ETA 00:31:40 2020-11-14 05:36:45 [INFO] [TRAIN] epoch=55, iter=36030/40000, loss=0.2180, lr=0.001259, batch_cost=0.4581, reader_cost=0.0005 | ETA 00:30:18 2020-11-14 05:36:49 [INFO] [TRAIN] epoch=55, iter=36040/40000, loss=0.1932, lr=0.001257, batch_cost=0.4345, reader_cost=0.0005 | ETA 00:28:40 2020-11-14 05:36:53 [INFO] [TRAIN] epoch=55, iter=36050/40000, loss=0.1994, lr=0.001254, batch_cost=0.4370, reader_cost=0.0005 | ETA 00:28:46 2020-11-14 05:36:58 [INFO] [TRAIN] epoch=55, iter=36060/40000, loss=0.1550, lr=0.001251, batch_cost=0.4324, reader_cost=0.0002 | ETA 00:28:23 2020-11-14 05:37:02 [INFO] [TRAIN] epoch=55, iter=36070/40000, loss=0.1942, lr=0.001248, batch_cost=0.4383, reader_cost=0.0002 | ETA 00:28:42 2020-11-14 05:37:07 [INFO] [TRAIN] epoch=55, iter=36080/40000, loss=0.1796, lr=0.001245, batch_cost=0.4345, reader_cost=0.0002 | ETA 00:28:23 2020-11-14 05:37:11 [INFO] [TRAIN] epoch=55, iter=36090/40000, loss=0.2037, lr=0.001242, batch_cost=0.4343, reader_cost=0.0002 | ETA 00:28:17 2020-11-14 05:37:15 [INFO] [TRAIN] epoch=55, iter=36100/40000, loss=0.1821, lr=0.001240, batch_cost=0.4340, reader_cost=0.0002 | ETA 00:28:12 2020-11-14 05:37:20 [INFO] [TRAIN] epoch=55, iter=36110/40000, loss=0.1801, lr=0.001237, batch_cost=0.4428, reader_cost=0.0002 | ETA 00:28:42 2020-11-14 05:37:24 [INFO] [TRAIN] epoch=55, iter=36120/40000, loss=0.2287, lr=0.001234, batch_cost=0.4395, reader_cost=0.0002 | ETA 00:28:25 2020-11-14 05:37:29 [INFO] [TRAIN] epoch=55, iter=36130/40000, loss=0.2048, lr=0.001231, batch_cost=0.4586, reader_cost=0.0002 | ETA 00:29:34 2020-11-14 05:37:33 [INFO] [TRAIN] epoch=55, iter=36140/40000, loss=0.1559, lr=0.001228, batch_cost=0.4469, reader_cost=0.0002 | ETA 00:28:45 2020-11-14 05:37:37 [INFO] [TRAIN] epoch=55, iter=36150/40000, loss=0.2342, lr=0.001225, batch_cost=0.4401, reader_cost=0.0002 | ETA 00:28:14 2020-11-14 05:37:42 [INFO] [TRAIN] epoch=55, iter=36160/40000, loss=0.2144, lr=0.001223, batch_cost=0.4422, reader_cost=0.0002 | ETA 00:28:17 2020-11-14 05:37:46 [INFO] [TRAIN] epoch=55, iter=36170/40000, loss=0.2424, lr=0.001220, batch_cost=0.4354, reader_cost=0.0002 | ETA 00:27:47 2020-11-14 05:37:51 [INFO] [TRAIN] epoch=55, iter=36180/40000, loss=0.1910, lr=0.001217, batch_cost=0.4405, reader_cost=0.0002 | ETA 00:28:02 2020-11-14 05:37:55 [INFO] [TRAIN] epoch=55, iter=36190/40000, loss=0.2218, lr=0.001214, batch_cost=0.4530, reader_cost=0.0002 | ETA 00:28:46 2020-11-14 05:38:00 [INFO] [TRAIN] epoch=55, iter=36200/40000, loss=0.2210, lr=0.001211, batch_cost=0.4413, reader_cost=0.0002 | ETA 00:27:57 2020-11-14 05:38:04 [INFO] [TRAIN] epoch=55, iter=36210/40000, loss=0.2254, lr=0.001208, batch_cost=0.4767, reader_cost=0.0002 | ETA 00:30:06 2020-11-14 05:38:09 [INFO] [TRAIN] epoch=55, iter=36220/40000, loss=0.2638, lr=0.001206, batch_cost=0.4971, reader_cost=0.0002 | ETA 00:31:19 2020-11-14 05:38:14 [INFO] [TRAIN] epoch=55, iter=36230/40000, loss=0.1938, lr=0.001203, batch_cost=0.4739, reader_cost=0.0002 | ETA 00:29:46 2020-11-14 05:38:19 [INFO] [TRAIN] epoch=55, iter=36240/40000, loss=0.2540, lr=0.001200, batch_cost=0.4470, reader_cost=0.0002 | ETA 00:28:00 2020-11-14 05:38:23 [INFO] [TRAIN] epoch=55, iter=36250/40000, loss=0.2575, lr=0.001197, batch_cost=0.4512, reader_cost=0.0002 | ETA 00:28:11 2020-11-14 05:38:28 [INFO] [TRAIN] epoch=55, iter=36260/40000, loss=0.1855, lr=0.001194, batch_cost=0.4531, reader_cost=0.0002 | ETA 00:28:14 2020-11-14 05:38:32 [INFO] [TRAIN] epoch=55, iter=36270/40000, loss=0.1864, lr=0.001191, batch_cost=0.4505, reader_cost=0.0002 | ETA 00:28:00 2020-11-14 05:38:37 [INFO] [TRAIN] epoch=55, iter=36280/40000, loss=0.1857, lr=0.001188, batch_cost=0.4432, reader_cost=0.0002 | ETA 00:27:28 2020-11-14 05:38:41 [INFO] [TRAIN] epoch=55, iter=36290/40000, loss=0.1820, lr=0.001186, batch_cost=0.4495, reader_cost=0.0002 | ETA 00:27:47 2020-11-14 05:38:46 [INFO] [TRAIN] epoch=55, iter=36300/40000, loss=0.2031, lr=0.001183, batch_cost=0.4765, reader_cost=0.0002 | ETA 00:29:23 2020-11-14 05:38:50 [INFO] [TRAIN] epoch=55, iter=36310/40000, loss=0.1583, lr=0.001180, batch_cost=0.4442, reader_cost=0.0002 | ETA 00:27:19 2020-11-14 05:38:55 [INFO] [TRAIN] epoch=55, iter=36320/40000, loss=0.1989, lr=0.001177, batch_cost=0.4381, reader_cost=0.0002 | ETA 00:26:52 2020-11-14 05:38:59 [INFO] [TRAIN] epoch=55, iter=36330/40000, loss=0.2158, lr=0.001174, batch_cost=0.4488, reader_cost=0.0002 | ETA 00:27:26 2020-11-14 05:39:04 [INFO] [TRAIN] epoch=55, iter=36340/40000, loss=0.1634, lr=0.001171, batch_cost=0.4468, reader_cost=0.0002 | ETA 00:27:15 2020-11-14 05:39:08 [INFO] [TRAIN] epoch=55, iter=36350/40000, loss=0.1963, lr=0.001168, batch_cost=0.4580, reader_cost=0.0002 | ETA 00:27:51 2020-11-14 05:39:14 [INFO] [TRAIN] epoch=56, iter=36360/40000, loss=0.1380, lr=0.001166, batch_cost=0.5968, reader_cost=0.0982 | ETA 00:36:12 2020-11-14 05:39:19 [INFO] [TRAIN] epoch=56, iter=36370/40000, loss=0.1437, lr=0.001163, batch_cost=0.4811, reader_cost=0.0002 | ETA 00:29:06 2020-11-14 05:39:24 [INFO] [TRAIN] epoch=56, iter=36380/40000, loss=0.1318, lr=0.001160, batch_cost=0.4818, reader_cost=0.0002 | ETA 00:29:03 2020-11-14 05:39:29 [INFO] [TRAIN] epoch=56, iter=36390/40000, loss=0.1329, lr=0.001157, batch_cost=0.4932, reader_cost=0.0002 | ETA 00:29:40 2020-11-14 05:39:33 [INFO] [TRAIN] epoch=56, iter=36400/40000, loss=0.1785, lr=0.001154, batch_cost=0.4667, reader_cost=0.0002 | ETA 00:28:00 2020-11-14 05:39:38 [INFO] [TRAIN] epoch=56, iter=36410/40000, loss=0.2216, lr=0.001151, batch_cost=0.5134, reader_cost=0.0015 | ETA 00:30:43 2020-11-14 05:39:44 [INFO] [TRAIN] epoch=56, iter=36420/40000, loss=0.1915, lr=0.001148, batch_cost=0.5066, reader_cost=0.0002 | ETA 00:30:13 2020-11-14 05:39:49 [INFO] [TRAIN] epoch=56, iter=36430/40000, loss=0.1895, lr=0.001146, batch_cost=0.5071, reader_cost=0.0002 | ETA 00:30:10 2020-11-14 05:39:53 [INFO] [TRAIN] epoch=56, iter=36440/40000, loss=0.1885, lr=0.001143, batch_cost=0.4579, reader_cost=0.0002 | ETA 00:27:10 2020-11-14 05:39:58 [INFO] [TRAIN] epoch=56, iter=36450/40000, loss=0.1896, lr=0.001140, batch_cost=0.4990, reader_cost=0.0002 | ETA 00:29:31 2020-11-14 05:40:03 [INFO] [TRAIN] epoch=56, iter=36460/40000, loss=0.1452, lr=0.001137, batch_cost=0.4578, reader_cost=0.0003 | ETA 00:27:00 2020-11-14 05:40:07 [INFO] [TRAIN] epoch=56, iter=36470/40000, loss=0.2168, lr=0.001134, batch_cost=0.4667, reader_cost=0.0002 | ETA 00:27:27 2020-11-14 05:40:12 [INFO] [TRAIN] epoch=56, iter=36480/40000, loss=0.2297, lr=0.001131, batch_cost=0.4568, reader_cost=0.0002 | ETA 00:26:48 2020-11-14 05:40:17 [INFO] [TRAIN] epoch=56, iter=36490/40000, loss=0.1682, lr=0.001128, batch_cost=0.5079, reader_cost=0.0002 | ETA 00:29:42 2020-11-14 05:40:22 [INFO] [TRAIN] epoch=56, iter=36500/40000, loss=0.1565, lr=0.001126, batch_cost=0.4567, reader_cost=0.0002 | ETA 00:26:38 2020-11-14 05:40:26 [INFO] [TRAIN] epoch=56, iter=36510/40000, loss=0.2829, lr=0.001123, batch_cost=0.4433, reader_cost=0.0002 | ETA 00:25:47 2020-11-14 05:40:31 [INFO] [TRAIN] epoch=56, iter=36520/40000, loss=0.1638, lr=0.001120, batch_cost=0.4597, reader_cost=0.0002 | ETA 00:26:39 2020-11-14 05:40:35 [INFO] [TRAIN] epoch=56, iter=36530/40000, loss=0.2112, lr=0.001117, batch_cost=0.4719, reader_cost=0.0015 | ETA 00:27:17 2020-11-14 05:40:40 [INFO] [TRAIN] epoch=56, iter=36540/40000, loss=0.2102, lr=0.001114, batch_cost=0.4560, reader_cost=0.0010 | ETA 00:26:17 2020-11-14 05:40:45 [INFO] [TRAIN] epoch=56, iter=36550/40000, loss=0.2446, lr=0.001111, batch_cost=0.4506, reader_cost=0.0002 | ETA 00:25:54 2020-11-14 05:40:49 [INFO] [TRAIN] epoch=56, iter=36560/40000, loss=0.1710, lr=0.001108, batch_cost=0.4479, reader_cost=0.0002 | ETA 00:25:40 2020-11-14 05:40:53 [INFO] [TRAIN] epoch=56, iter=36570/40000, loss=0.1897, lr=0.001105, batch_cost=0.4366, reader_cost=0.0002 | ETA 00:24:57 2020-11-14 05:40:58 [INFO] [TRAIN] epoch=56, iter=36580/40000, loss=0.2168, lr=0.001103, batch_cost=0.4628, reader_cost=0.0002 | ETA 00:26:22 2020-11-14 05:41:03 [INFO] [TRAIN] epoch=56, iter=36590/40000, loss=0.2013, lr=0.001100, batch_cost=0.4586, reader_cost=0.0002 | ETA 00:26:03 2020-11-14 05:41:07 [INFO] [TRAIN] epoch=56, iter=36600/40000, loss=0.2076, lr=0.001097, batch_cost=0.4517, reader_cost=0.0002 | ETA 00:25:35 2020-11-14 05:41:12 [INFO] [TRAIN] epoch=56, iter=36610/40000, loss=0.2270, lr=0.001094, batch_cost=0.4809, reader_cost=0.0002 | ETA 00:27:10 2020-11-14 05:41:16 [INFO] [TRAIN] epoch=56, iter=36620/40000, loss=0.2418, lr=0.001091, batch_cost=0.4535, reader_cost=0.0002 | ETA 00:25:32 2020-11-14 05:41:21 [INFO] [TRAIN] epoch=56, iter=36630/40000, loss=0.2873, lr=0.001088, batch_cost=0.4621, reader_cost=0.0002 | ETA 00:25:57 2020-11-14 05:41:26 [INFO] [TRAIN] epoch=56, iter=36640/40000, loss=0.1285, lr=0.001085, batch_cost=0.4621, reader_cost=0.0002 | ETA 00:25:52 2020-11-14 05:41:30 [INFO] [TRAIN] epoch=56, iter=36650/40000, loss=0.1631, lr=0.001082, batch_cost=0.4348, reader_cost=0.0002 | ETA 00:24:16 2020-11-14 05:41:34 [INFO] [TRAIN] epoch=56, iter=36660/40000, loss=0.1905, lr=0.001080, batch_cost=0.4333, reader_cost=0.0002 | ETA 00:24:07 2020-11-14 05:41:39 [INFO] [TRAIN] epoch=56, iter=36670/40000, loss=0.1831, lr=0.001077, batch_cost=0.4514, reader_cost=0.0002 | ETA 00:25:03 2020-11-14 05:41:43 [INFO] [TRAIN] epoch=56, iter=36680/40000, loss=0.1865, lr=0.001074, batch_cost=0.4350, reader_cost=0.0002 | ETA 00:24:04 2020-11-14 05:41:48 [INFO] [TRAIN] epoch=56, iter=36690/40000, loss=0.1873, lr=0.001071, batch_cost=0.4291, reader_cost=0.0002 | ETA 00:23:40 2020-11-14 05:41:52 [INFO] [TRAIN] epoch=56, iter=36700/40000, loss=0.1949, lr=0.001068, batch_cost=0.4393, reader_cost=0.0002 | ETA 00:24:09 2020-11-14 05:41:56 [INFO] [TRAIN] epoch=56, iter=36710/40000, loss=0.1796, lr=0.001065, batch_cost=0.4261, reader_cost=0.0002 | ETA 00:23:21 2020-11-14 05:42:00 [INFO] [TRAIN] epoch=56, iter=36720/40000, loss=0.2185, lr=0.001062, batch_cost=0.4299, reader_cost=0.0002 | ETA 00:23:30 2020-11-14 05:42:05 [INFO] [TRAIN] epoch=56, iter=36730/40000, loss=0.2297, lr=0.001059, batch_cost=0.4978, reader_cost=0.0002 | ETA 00:27:07 2020-11-14 05:42:10 [INFO] [TRAIN] epoch=56, iter=36740/40000, loss=0.1938, lr=0.001056, batch_cost=0.4901, reader_cost=0.0002 | ETA 00:26:37 2020-11-14 05:42:15 [INFO] [TRAIN] epoch=56, iter=36750/40000, loss=0.1331, lr=0.001054, batch_cost=0.4865, reader_cost=0.0002 | ETA 00:26:21 2020-11-14 05:42:20 [INFO] [TRAIN] epoch=56, iter=36760/40000, loss=0.1784, lr=0.001051, batch_cost=0.4611, reader_cost=0.0002 | ETA 00:24:54 2020-11-14 05:42:24 [INFO] [TRAIN] epoch=56, iter=36770/40000, loss=0.1655, lr=0.001048, batch_cost=0.4626, reader_cost=0.0002 | ETA 00:24:54 2020-11-14 05:42:29 [INFO] [TRAIN] epoch=56, iter=36780/40000, loss=0.2045, lr=0.001045, batch_cost=0.4397, reader_cost=0.0002 | ETA 00:23:35 2020-11-14 05:42:33 [INFO] [TRAIN] epoch=56, iter=36790/40000, loss=0.1582, lr=0.001042, batch_cost=0.4350, reader_cost=0.0002 | ETA 00:23:16 2020-11-14 05:42:38 [INFO] [TRAIN] epoch=56, iter=36800/40000, loss=0.1523, lr=0.001039, batch_cost=0.4365, reader_cost=0.0002 | ETA 00:23:16 2020-11-14 05:42:42 [INFO] [TRAIN] epoch=56, iter=36810/40000, loss=0.2135, lr=0.001036, batch_cost=0.4370, reader_cost=0.0002 | ETA 00:23:14 2020-11-14 05:42:46 [INFO] [TRAIN] epoch=56, iter=36820/40000, loss=0.2325, lr=0.001033, batch_cost=0.4410, reader_cost=0.0002 | ETA 00:23:22 2020-11-14 05:42:51 [INFO] [TRAIN] epoch=56, iter=36830/40000, loss=0.1983, lr=0.001030, batch_cost=0.4420, reader_cost=0.0002 | ETA 00:23:21 2020-11-14 05:42:55 [INFO] [TRAIN] epoch=56, iter=36840/40000, loss=0.2065, lr=0.001028, batch_cost=0.4385, reader_cost=0.0002 | ETA 00:23:05 2020-11-14 05:42:59 [INFO] [TRAIN] epoch=56, iter=36850/40000, loss=0.1847, lr=0.001025, batch_cost=0.4342, reader_cost=0.0002 | ETA 00:22:47 2020-11-14 05:43:04 [INFO] [TRAIN] epoch=56, iter=36860/40000, loss=0.1977, lr=0.001022, batch_cost=0.4540, reader_cost=0.0002 | ETA 00:23:45 2020-11-14 05:43:09 [INFO] [TRAIN] epoch=56, iter=36870/40000, loss=0.1683, lr=0.001019, batch_cost=0.4837, reader_cost=0.0002 | ETA 00:25:14 2020-11-14 05:43:13 [INFO] [TRAIN] epoch=56, iter=36880/40000, loss=0.2582, lr=0.001016, batch_cost=0.4419, reader_cost=0.0002 | ETA 00:22:58 2020-11-14 05:43:18 [INFO] [TRAIN] epoch=56, iter=36890/40000, loss=0.1755, lr=0.001013, batch_cost=0.4725, reader_cost=0.0002 | ETA 00:24:29 2020-11-14 05:43:23 [INFO] [TRAIN] epoch=56, iter=36900/40000, loss=0.1853, lr=0.001010, batch_cost=0.4872, reader_cost=0.0002 | ETA 00:25:10 2020-11-14 05:43:28 [INFO] [TRAIN] epoch=56, iter=36910/40000, loss=0.2041, lr=0.001007, batch_cost=0.4634, reader_cost=0.0002 | ETA 00:23:51 2020-11-14 05:43:32 [INFO] [TRAIN] epoch=56, iter=36920/40000, loss=0.1666, lr=0.001004, batch_cost=0.4534, reader_cost=0.0002 | ETA 00:23:16 2020-11-14 05:43:37 [INFO] [TRAIN] epoch=56, iter=36930/40000, loss=0.1642, lr=0.001001, batch_cost=0.4710, reader_cost=0.0002 | ETA 00:24:05 2020-11-14 05:43:41 [INFO] [TRAIN] epoch=56, iter=36940/40000, loss=0.1846, lr=0.000999, batch_cost=0.4352, reader_cost=0.0002 | ETA 00:22:11 2020-11-14 05:43:45 [INFO] [TRAIN] epoch=56, iter=36950/40000, loss=0.2092, lr=0.000996, batch_cost=0.4333, reader_cost=0.0002 | ETA 00:22:01 2020-11-14 05:43:50 [INFO] [TRAIN] epoch=56, iter=36960/40000, loss=0.1971, lr=0.000993, batch_cost=0.4357, reader_cost=0.0002 | ETA 00:22:04 2020-11-14 05:43:54 [INFO] [TRAIN] epoch=56, iter=36970/40000, loss=0.1334, lr=0.000990, batch_cost=0.4339, reader_cost=0.0002 | ETA 00:21:54 2020-11-14 05:43:58 [INFO] [TRAIN] epoch=56, iter=36980/40000, loss=0.2010, lr=0.000987, batch_cost=0.4320, reader_cost=0.0002 | ETA 00:21:44 2020-11-14 05:44:03 [INFO] [TRAIN] epoch=56, iter=36990/40000, loss=0.1649, lr=0.000984, batch_cost=0.4350, reader_cost=0.0002 | ETA 00:21:49 2020-11-14 05:44:07 [INFO] [TRAIN] epoch=56, iter=37000/40000, loss=0.2495, lr=0.000981, batch_cost=0.4309, reader_cost=0.0002 | ETA 00:21:32 2020-11-14 05:44:11 [INFO] [TRAIN] epoch=56, iter=37010/40000, loss=0.1945, lr=0.000978, batch_cost=0.4321, reader_cost=0.0002 | ETA 00:21:32 2020-11-14 05:44:17 [INFO] [TRAIN] epoch=57, iter=37020/40000, loss=0.1922, lr=0.000975, batch_cost=0.5484, reader_cost=0.0856 | ETA 00:27:14 2020-11-14 05:44:21 [INFO] [TRAIN] epoch=57, iter=37030/40000, loss=0.1753, lr=0.000972, batch_cost=0.4363, reader_cost=0.0005 | ETA 00:21:35 2020-11-14 05:44:26 [INFO] [TRAIN] epoch=57, iter=37040/40000, loss=0.1787, lr=0.000969, batch_cost=0.4637, reader_cost=0.0002 | ETA 00:22:52 2020-11-14 05:44:30 [INFO] [TRAIN] epoch=57, iter=37050/40000, loss=0.1614, lr=0.000966, batch_cost=0.4456, reader_cost=0.0002 | ETA 00:21:54 2020-11-14 05:44:35 [INFO] [TRAIN] epoch=57, iter=37060/40000, loss=0.1958, lr=0.000964, batch_cost=0.4581, reader_cost=0.0002 | ETA 00:22:26 2020-11-14 05:44:40 [INFO] [TRAIN] epoch=57, iter=37070/40000, loss=0.1864, lr=0.000961, batch_cost=0.4625, reader_cost=0.0002 | ETA 00:22:35 2020-11-14 05:44:44 [INFO] [TRAIN] epoch=57, iter=37080/40000, loss=0.1498, lr=0.000958, batch_cost=0.4466, reader_cost=0.0002 | ETA 00:21:43 2020-11-14 05:44:48 [INFO] [TRAIN] epoch=57, iter=37090/40000, loss=0.2086, lr=0.000955, batch_cost=0.4369, reader_cost=0.0002 | ETA 00:21:11 2020-11-14 05:44:53 [INFO] [TRAIN] epoch=57, iter=37100/40000, loss=0.3063, lr=0.000952, batch_cost=0.4322, reader_cost=0.0002 | ETA 00:20:53 2020-11-14 05:44:57 [INFO] [TRAIN] epoch=57, iter=37110/40000, loss=0.2230, lr=0.000949, batch_cost=0.4357, reader_cost=0.0002 | ETA 00:20:59 2020-11-14 05:45:01 [INFO] [TRAIN] epoch=57, iter=37120/40000, loss=0.1859, lr=0.000946, batch_cost=0.4373, reader_cost=0.0002 | ETA 00:20:59 2020-11-14 05:45:06 [INFO] [TRAIN] epoch=57, iter=37130/40000, loss=0.2276, lr=0.000943, batch_cost=0.4336, reader_cost=0.0002 | ETA 00:20:44 2020-11-14 05:45:10 [INFO] [TRAIN] epoch=57, iter=37140/40000, loss=0.2058, lr=0.000940, batch_cost=0.4542, reader_cost=0.0002 | ETA 00:21:39 2020-11-14 05:45:15 [INFO] [TRAIN] epoch=57, iter=37150/40000, loss=0.1692, lr=0.000937, batch_cost=0.4392, reader_cost=0.0002 | ETA 00:20:51 2020-11-14 05:45:19 [INFO] [TRAIN] epoch=57, iter=37160/40000, loss=0.1309, lr=0.000934, batch_cost=0.4493, reader_cost=0.0002 | ETA 00:21:16 2020-11-14 05:45:24 [INFO] [TRAIN] epoch=57, iter=37170/40000, loss=0.1739, lr=0.000931, batch_cost=0.4420, reader_cost=0.0002 | ETA 00:20:50 2020-11-14 05:45:28 [INFO] [TRAIN] epoch=57, iter=37180/40000, loss=0.1234, lr=0.000928, batch_cost=0.4346, reader_cost=0.0002 | ETA 00:20:25 2020-11-14 05:45:32 [INFO] [TRAIN] epoch=57, iter=37190/40000, loss=0.1940, lr=0.000926, batch_cost=0.4338, reader_cost=0.0002 | ETA 00:20:18 2020-11-14 05:45:37 [INFO] [TRAIN] epoch=57, iter=37200/40000, loss=0.1581, lr=0.000923, batch_cost=0.4343, reader_cost=0.0002 | ETA 00:20:16 2020-11-14 05:45:41 [INFO] [TRAIN] epoch=57, iter=37210/40000, loss=0.1789, lr=0.000920, batch_cost=0.4321, reader_cost=0.0002 | ETA 00:20:05 2020-11-14 05:45:45 [INFO] [TRAIN] epoch=57, iter=37220/40000, loss=0.1788, lr=0.000917, batch_cost=0.4428, reader_cost=0.0002 | ETA 00:20:31 2020-11-14 05:45:50 [INFO] [TRAIN] epoch=57, iter=37230/40000, loss=0.1774, lr=0.000914, batch_cost=0.4325, reader_cost=0.0002 | ETA 00:19:58 2020-11-14 05:45:54 [INFO] [TRAIN] epoch=57, iter=37240/40000, loss=0.1988, lr=0.000911, batch_cost=0.4350, reader_cost=0.0002 | ETA 00:20:00 2020-11-14 05:45:58 [INFO] [TRAIN] epoch=57, iter=37250/40000, loss=0.1690, lr=0.000908, batch_cost=0.4339, reader_cost=0.0002 | ETA 00:19:53 2020-11-14 05:46:03 [INFO] [TRAIN] epoch=57, iter=37260/40000, loss=0.1846, lr=0.000905, batch_cost=0.4354, reader_cost=0.0002 | ETA 00:19:53 2020-11-14 05:46:07 [INFO] [TRAIN] epoch=57, iter=37270/40000, loss=0.2494, lr=0.000902, batch_cost=0.4458, reader_cost=0.0002 | ETA 00:20:17 2020-11-14 05:46:12 [INFO] [TRAIN] epoch=57, iter=37280/40000, loss=0.1720, lr=0.000899, batch_cost=0.4449, reader_cost=0.0002 | ETA 00:20:10 2020-11-14 05:46:16 [INFO] [TRAIN] epoch=57, iter=37290/40000, loss=0.2239, lr=0.000896, batch_cost=0.4366, reader_cost=0.0002 | ETA 00:19:43 2020-11-14 05:46:20 [INFO] [TRAIN] epoch=57, iter=37300/40000, loss=0.1166, lr=0.000893, batch_cost=0.4369, reader_cost=0.0002 | ETA 00:19:39 2020-11-14 05:46:25 [INFO] [TRAIN] epoch=57, iter=37310/40000, loss=0.2018, lr=0.000890, batch_cost=0.4342, reader_cost=0.0002 | ETA 00:19:27 2020-11-14 05:46:29 [INFO] [TRAIN] epoch=57, iter=37320/40000, loss=0.1853, lr=0.000887, batch_cost=0.4331, reader_cost=0.0002 | ETA 00:19:20 2020-11-14 05:46:34 [INFO] [TRAIN] epoch=57, iter=37330/40000, loss=0.2133, lr=0.000884, batch_cost=0.4663, reader_cost=0.0002 | ETA 00:20:44 2020-11-14 05:46:38 [INFO] [TRAIN] epoch=57, iter=37340/40000, loss=0.1396, lr=0.000881, batch_cost=0.4576, reader_cost=0.0002 | ETA 00:20:17 2020-11-14 05:46:43 [INFO] [TRAIN] epoch=57, iter=37350/40000, loss=0.2211, lr=0.000879, batch_cost=0.4481, reader_cost=0.0002 | ETA 00:19:47 2020-11-14 05:46:47 [INFO] [TRAIN] epoch=57, iter=37360/40000, loss=0.1970, lr=0.000876, batch_cost=0.4408, reader_cost=0.0002 | ETA 00:19:23 2020-11-14 05:46:52 [INFO] [TRAIN] epoch=57, iter=37370/40000, loss=0.1616, lr=0.000873, batch_cost=0.4495, reader_cost=0.0002 | ETA 00:19:42 2020-11-14 05:46:56 [INFO] [TRAIN] epoch=57, iter=37380/40000, loss=0.2175, lr=0.000870, batch_cost=0.4339, reader_cost=0.0002 | ETA 00:18:56 2020-11-14 05:47:00 [INFO] [TRAIN] epoch=57, iter=37390/40000, loss=0.2069, lr=0.000867, batch_cost=0.4350, reader_cost=0.0002 | ETA 00:18:55 2020-11-14 05:47:05 [INFO] [TRAIN] epoch=57, iter=37400/40000, loss=0.1682, lr=0.000864, batch_cost=0.4347, reader_cost=0.0002 | ETA 00:18:50 2020-11-14 05:47:09 [INFO] [TRAIN] epoch=57, iter=37410/40000, loss=0.1885, lr=0.000861, batch_cost=0.4348, reader_cost=0.0002 | ETA 00:18:46 2020-11-14 05:47:14 [INFO] [TRAIN] epoch=57, iter=37420/40000, loss=0.2364, lr=0.000858, batch_cost=0.4463, reader_cost=0.0002 | ETA 00:19:11 2020-11-14 05:47:18 [INFO] [TRAIN] epoch=57, iter=37430/40000, loss=0.2038, lr=0.000855, batch_cost=0.4835, reader_cost=0.0002 | ETA 00:20:42 2020-11-14 05:47:23 [INFO] [TRAIN] epoch=57, iter=37440/40000, loss=0.1957, lr=0.000852, batch_cost=0.4908, reader_cost=0.0002 | ETA 00:20:56 2020-11-14 05:47:28 [INFO] [TRAIN] epoch=57, iter=37450/40000, loss=0.1828, lr=0.000849, batch_cost=0.4874, reader_cost=0.0002 | ETA 00:20:42 2020-11-14 05:47:33 [INFO] [TRAIN] epoch=57, iter=37460/40000, loss=0.2756, lr=0.000846, batch_cost=0.4533, reader_cost=0.0002 | ETA 00:19:11 2020-11-14 05:47:37 [INFO] [TRAIN] epoch=57, iter=37470/40000, loss=0.1775, lr=0.000843, batch_cost=0.4664, reader_cost=0.0002 | ETA 00:19:39 2020-11-14 05:47:42 [INFO] [TRAIN] epoch=57, iter=37480/40000, loss=0.1795, lr=0.000840, batch_cost=0.4507, reader_cost=0.0002 | ETA 00:18:55 2020-11-14 05:47:47 [INFO] [TRAIN] epoch=57, iter=37490/40000, loss=0.1695, lr=0.000837, batch_cost=0.4625, reader_cost=0.0002 | ETA 00:19:20 2020-11-14 05:47:51 [INFO] [TRAIN] epoch=57, iter=37500/40000, loss=0.1871, lr=0.000834, batch_cost=0.4540, reader_cost=0.0002 | ETA 00:18:54 2020-11-14 05:47:56 [INFO] [TRAIN] epoch=57, iter=37510/40000, loss=0.2188, lr=0.000831, batch_cost=0.4492, reader_cost=0.0002 | ETA 00:18:38 2020-11-14 05:48:00 [INFO] [TRAIN] epoch=57, iter=37520/40000, loss=0.1472, lr=0.000828, batch_cost=0.4294, reader_cost=0.0002 | ETA 00:17:44 2020-11-14 05:48:04 [INFO] [TRAIN] epoch=57, iter=37530/40000, loss=0.2188, lr=0.000825, batch_cost=0.4370, reader_cost=0.0002 | ETA 00:17:59 2020-11-14 05:48:09 [INFO] [TRAIN] epoch=57, iter=37540/40000, loss=0.1832, lr=0.000822, batch_cost=0.4400, reader_cost=0.0002 | ETA 00:18:02 2020-11-14 05:48:13 [INFO] [TRAIN] epoch=57, iter=37550/40000, loss=0.4066, lr=0.000819, batch_cost=0.4298, reader_cost=0.0002 | ETA 00:17:32 2020-11-14 05:48:17 [INFO] [TRAIN] epoch=57, iter=37560/40000, loss=0.2201, lr=0.000816, batch_cost=0.4304, reader_cost=0.0002 | ETA 00:17:30 2020-11-14 05:48:22 [INFO] [TRAIN] epoch=57, iter=37570/40000, loss=0.1863, lr=0.000813, batch_cost=0.4310, reader_cost=0.0002 | ETA 00:17:27 2020-11-14 05:48:26 [INFO] [TRAIN] epoch=57, iter=37580/40000, loss=0.2002, lr=0.000810, batch_cost=0.4323, reader_cost=0.0002 | ETA 00:17:26 2020-11-14 05:48:30 [INFO] [TRAIN] epoch=57, iter=37590/40000, loss=0.2515, lr=0.000807, batch_cost=0.4495, reader_cost=0.0002 | ETA 00:18:03 2020-11-14 05:48:35 [INFO] [TRAIN] epoch=57, iter=37600/40000, loss=0.1850, lr=0.000804, batch_cost=0.4536, reader_cost=0.0002 | ETA 00:18:08 2020-11-14 05:48:39 [INFO] [TRAIN] epoch=57, iter=37610/40000, loss=0.2000, lr=0.000801, batch_cost=0.4486, reader_cost=0.0002 | ETA 00:17:52 2020-11-14 05:48:44 [INFO] [TRAIN] epoch=57, iter=37620/40000, loss=0.2658, lr=0.000798, batch_cost=0.4423, reader_cost=0.0002 | ETA 00:17:32 2020-11-14 05:48:48 [INFO] [TRAIN] epoch=57, iter=37630/40000, loss=0.2317, lr=0.000796, batch_cost=0.4537, reader_cost=0.0002 | ETA 00:17:55 2020-11-14 05:48:53 [INFO] [TRAIN] epoch=57, iter=37640/40000, loss=0.1843, lr=0.000793, batch_cost=0.4436, reader_cost=0.0002 | ETA 00:17:26 2020-11-14 05:48:57 [INFO] [TRAIN] epoch=57, iter=37650/40000, loss=0.1582, lr=0.000790, batch_cost=0.4289, reader_cost=0.0002 | ETA 00:16:47 2020-11-14 05:49:01 [INFO] [TRAIN] epoch=57, iter=37660/40000, loss=0.1645, lr=0.000787, batch_cost=0.4280, reader_cost=0.0002 | ETA 00:16:41 2020-11-14 05:49:06 [INFO] [TRAIN] epoch=57, iter=37670/40000, loss=0.2276, lr=0.000784, batch_cost=0.4276, reader_cost=0.0002 | ETA 00:16:36 2020-11-14 05:49:11 [INFO] [TRAIN] epoch=58, iter=37680/40000, loss=0.1610, lr=0.000781, batch_cost=0.5582, reader_cost=0.1092 | ETA 00:21:35 2020-11-14 05:49:16 [INFO] [TRAIN] epoch=58, iter=37690/40000, loss=0.1926, lr=0.000778, batch_cost=0.4353, reader_cost=0.0002 | ETA 00:16:45 2020-11-14 05:49:20 [INFO] [TRAIN] epoch=58, iter=37700/40000, loss=0.1886, lr=0.000775, batch_cost=0.4272, reader_cost=0.0002 | ETA 00:16:22 2020-11-14 05:49:24 [INFO] [TRAIN] epoch=58, iter=37710/40000, loss=0.1561, lr=0.000772, batch_cost=0.4298, reader_cost=0.0002 | ETA 00:16:24 2020-11-14 05:49:28 [INFO] [TRAIN] epoch=58, iter=37720/40000, loss=0.2329, lr=0.000769, batch_cost=0.4280, reader_cost=0.0001 | ETA 00:16:15 2020-11-14 05:49:33 [INFO] [TRAIN] epoch=58, iter=37730/40000, loss=0.1800, lr=0.000766, batch_cost=0.4324, reader_cost=0.0002 | ETA 00:16:21 2020-11-14 05:49:37 [INFO] [TRAIN] epoch=58, iter=37740/40000, loss=0.1911, lr=0.000763, batch_cost=0.4277, reader_cost=0.0002 | ETA 00:16:06 2020-11-14 05:49:41 [INFO] [TRAIN] epoch=58, iter=37750/40000, loss=0.1648, lr=0.000760, batch_cost=0.4284, reader_cost=0.0002 | ETA 00:16:03 2020-11-14 05:49:46 [INFO] [TRAIN] epoch=58, iter=37760/40000, loss=0.2305, lr=0.000757, batch_cost=0.4305, reader_cost=0.0002 | ETA 00:16:04 2020-11-14 05:49:50 [INFO] [TRAIN] epoch=58, iter=37770/40000, loss=0.2347, lr=0.000754, batch_cost=0.4264, reader_cost=0.0001 | ETA 00:15:50 2020-11-14 05:49:54 [INFO] [TRAIN] epoch=58, iter=37780/40000, loss=0.2024, lr=0.000751, batch_cost=0.4258, reader_cost=0.0002 | ETA 00:15:45 2020-11-14 05:49:58 [INFO] [TRAIN] epoch=58, iter=37790/40000, loss=0.2109, lr=0.000748, batch_cost=0.4252, reader_cost=0.0002 | ETA 00:15:39 2020-11-14 05:50:03 [INFO] [TRAIN] epoch=58, iter=37800/40000, loss=0.1810, lr=0.000745, batch_cost=0.4268, reader_cost=0.0002 | ETA 00:15:38 2020-11-14 05:50:07 [INFO] [TRAIN] epoch=58, iter=37810/40000, loss=0.2851, lr=0.000742, batch_cost=0.4263, reader_cost=0.0001 | ETA 00:15:33 2020-11-14 05:50:11 [INFO] [TRAIN] epoch=58, iter=37820/40000, loss=0.1791, lr=0.000739, batch_cost=0.4255, reader_cost=0.0001 | ETA 00:15:27 2020-11-14 05:50:15 [INFO] [TRAIN] epoch=58, iter=37830/40000, loss=0.1573, lr=0.000736, batch_cost=0.4267, reader_cost=0.0002 | ETA 00:15:25 2020-11-14 05:50:20 [INFO] [TRAIN] epoch=58, iter=37840/40000, loss=0.2205, lr=0.000733, batch_cost=0.4303, reader_cost=0.0002 | ETA 00:15:29 2020-11-14 05:50:24 [INFO] [TRAIN] epoch=58, iter=37850/40000, loss=0.1344, lr=0.000730, batch_cost=0.4362, reader_cost=0.0002 | ETA 00:15:37 2020-11-14 05:50:29 [INFO] [TRAIN] epoch=58, iter=37860/40000, loss=0.2345, lr=0.000727, batch_cost=0.4401, reader_cost=0.0002 | ETA 00:15:41 2020-11-14 05:50:33 [INFO] [TRAIN] epoch=58, iter=37870/40000, loss=0.1631, lr=0.000724, batch_cost=0.4437, reader_cost=0.0002 | ETA 00:15:45 2020-11-14 05:50:38 [INFO] [TRAIN] epoch=58, iter=37880/40000, loss=0.1830, lr=0.000721, batch_cost=0.4502, reader_cost=0.0015 | ETA 00:15:54 2020-11-14 05:50:42 [INFO] [TRAIN] epoch=58, iter=37890/40000, loss=0.2111, lr=0.000718, batch_cost=0.4383, reader_cost=0.0004 | ETA 00:15:24 2020-11-14 05:50:46 [INFO] [TRAIN] epoch=58, iter=37900/40000, loss=0.2414, lr=0.000715, batch_cost=0.4549, reader_cost=0.0003 | ETA 00:15:55 2020-11-14 05:50:51 [INFO] [TRAIN] epoch=58, iter=37910/40000, loss=0.1327, lr=0.000712, batch_cost=0.4744, reader_cost=0.0005 | ETA 00:16:31 2020-11-14 05:50:56 [INFO] [TRAIN] epoch=58, iter=37920/40000, loss=0.1705, lr=0.000708, batch_cost=0.4402, reader_cost=0.0002 | ETA 00:15:15 2020-11-14 05:51:00 [INFO] [TRAIN] epoch=58, iter=37930/40000, loss=0.1500, lr=0.000705, batch_cost=0.4383, reader_cost=0.0002 | ETA 00:15:07 2020-11-14 05:51:04 [INFO] [TRAIN] epoch=58, iter=37940/40000, loss=0.2261, lr=0.000702, batch_cost=0.4369, reader_cost=0.0002 | ETA 00:14:59 2020-11-14 05:51:09 [INFO] [TRAIN] epoch=58, iter=37950/40000, loss=0.2118, lr=0.000699, batch_cost=0.4382, reader_cost=0.0002 | ETA 00:14:58 2020-11-14 05:51:13 [INFO] [TRAIN] epoch=58, iter=37960/40000, loss=0.1431, lr=0.000696, batch_cost=0.4461, reader_cost=0.0002 | ETA 00:15:10 2020-11-14 05:51:18 [INFO] [TRAIN] epoch=58, iter=37970/40000, loss=0.2304, lr=0.000693, batch_cost=0.4361, reader_cost=0.0002 | ETA 00:14:45 2020-11-14 05:51:22 [INFO] [TRAIN] epoch=58, iter=37980/40000, loss=0.4072, lr=0.000690, batch_cost=0.4362, reader_cost=0.0002 | ETA 00:14:41 2020-11-14 05:51:26 [INFO] [TRAIN] epoch=58, iter=37990/40000, loss=0.2565, lr=0.000687, batch_cost=0.4363, reader_cost=0.0002 | ETA 00:14:36 2020-11-14 05:51:31 [INFO] [TRAIN] epoch=58, iter=38000/40000, loss=0.1919, lr=0.000684, batch_cost=0.4344, reader_cost=0.0002 | ETA 00:14:28 2020-11-14 05:51:31 [INFO] Start evaluating (total_samples=1449, total_iters=363)... 2020-11-14 05:51:51 [INFO] [EVAL] #Images=1449 mIoU=0.8030 Acc=0.9560 Kappa=0.9031 2020-11-14 05:51:51 [INFO] [EVAL] Class IoU: [0.9487 0.9217 0.4306 0.8913 0.7068 0.8292 0.9579 0.9177 0.9451 0.497 0.8944 0.5483 0.9119 0.9229 0.8998 0.8724 0.6642 0.859 0.571 0.9272 0.7466] 2020-11-14 05:51:51 [INFO] [EVAL] Class Acc: [0.9712 0.9502 0.4454 0.937 0.7998 0.8853 0.9784 0.9714 0.9689 0.6987 0.9346 0.9424 0.9441 0.9581 0.9406 0.9229 0.7927 0.9487 0.8497 0.9639 0.8973] 2020-11-14 05:52:00 [INFO] [EVAL] The model with the best validation mIoU (0.8030) was saved at iter 38000. 2020-11-14 05:52:05 [INFO] [TRAIN] epoch=58, iter=38010/40000, loss=0.1585, lr=0.000681, batch_cost=0.4726, reader_cost=0.0005 | ETA 00:15:40 2020-11-14 05:52:09 [INFO] [TRAIN] epoch=58, iter=38020/40000, loss=0.2496, lr=0.000678, batch_cost=0.4803, reader_cost=0.0002 | ETA 00:15:51 2020-11-14 05:52:14 [INFO] [TRAIN] epoch=58, iter=38030/40000, loss=0.2610, lr=0.000675, batch_cost=0.4937, reader_cost=0.0008 | ETA 00:16:12 2020-11-14 05:52:19 [INFO] [TRAIN] epoch=58, iter=38040/40000, loss=0.2450, lr=0.000672, batch_cost=0.4677, reader_cost=0.0005 | ETA 00:15:16 2020-11-14 05:52:23 [INFO] [TRAIN] epoch=58, iter=38050/40000, loss=0.1606, lr=0.000669, batch_cost=0.4496, reader_cost=0.0002 | ETA 00:14:36 2020-11-14 05:52:28 [INFO] [TRAIN] epoch=58, iter=38060/40000, loss=0.1596, lr=0.000666, batch_cost=0.4703, reader_cost=0.0002 | ETA 00:15:12 2020-11-14 05:52:33 [INFO] [TRAIN] epoch=58, iter=38070/40000, loss=0.1555, lr=0.000663, batch_cost=0.4639, reader_cost=0.0002 | ETA 00:14:55 2020-11-14 05:52:38 [INFO] [TRAIN] epoch=58, iter=38080/40000, loss=0.1270, lr=0.000660, batch_cost=0.4797, reader_cost=0.0002 | ETA 00:15:20 2020-11-14 05:52:42 [INFO] [TRAIN] epoch=58, iter=38090/40000, loss=0.1810, lr=0.000657, batch_cost=0.4662, reader_cost=0.0002 | ETA 00:14:50 2020-11-14 05:52:47 [INFO] [TRAIN] epoch=58, iter=38100/40000, loss=0.2273, lr=0.000654, batch_cost=0.4582, reader_cost=0.0002 | ETA 00:14:30 2020-11-14 05:52:51 [INFO] [TRAIN] epoch=58, iter=38110/40000, loss=0.2423, lr=0.000651, batch_cost=0.4516, reader_cost=0.0002 | ETA 00:14:13 2020-11-14 05:52:56 [INFO] [TRAIN] epoch=58, iter=38120/40000, loss=0.2089, lr=0.000648, batch_cost=0.4411, reader_cost=0.0002 | ETA 00:13:49 2020-11-14 05:53:00 [INFO] [TRAIN] epoch=58, iter=38130/40000, loss=0.2224, lr=0.000645, batch_cost=0.4303, reader_cost=0.0002 | ETA 00:13:24 2020-11-14 05:53:04 [INFO] [TRAIN] epoch=58, iter=38140/40000, loss=0.2367, lr=0.000642, batch_cost=0.4327, reader_cost=0.0002 | ETA 00:13:24 2020-11-14 05:53:09 [INFO] [TRAIN] epoch=58, iter=38150/40000, loss=0.1433, lr=0.000639, batch_cost=0.4392, reader_cost=0.0002 | ETA 00:13:32 2020-11-14 05:53:13 [INFO] [TRAIN] epoch=58, iter=38160/40000, loss=0.1661, lr=0.000636, batch_cost=0.4537, reader_cost=0.0002 | ETA 00:13:54 2020-11-14 05:53:18 [INFO] [TRAIN] epoch=58, iter=38170/40000, loss=0.1787, lr=0.000632, batch_cost=0.4426, reader_cost=0.0002 | ETA 00:13:29 2020-11-14 05:53:22 [INFO] [TRAIN] epoch=58, iter=38180/40000, loss=0.1600, lr=0.000629, batch_cost=0.4464, reader_cost=0.0002 | ETA 00:13:32 2020-11-14 05:53:27 [INFO] [TRAIN] epoch=58, iter=38190/40000, loss=0.2070, lr=0.000626, batch_cost=0.4432, reader_cost=0.0002 | ETA 00:13:22 2020-11-14 05:53:31 [INFO] [TRAIN] epoch=58, iter=38200/40000, loss=0.1487, lr=0.000623, batch_cost=0.4434, reader_cost=0.0002 | ETA 00:13:18 2020-11-14 05:53:35 [INFO] [TRAIN] epoch=58, iter=38210/40000, loss=0.1693, lr=0.000620, batch_cost=0.4336, reader_cost=0.0002 | ETA 00:12:56 2020-11-14 05:53:40 [INFO] [TRAIN] epoch=58, iter=38220/40000, loss=0.1816, lr=0.000617, batch_cost=0.4580, reader_cost=0.0002 | ETA 00:13:35 2020-11-14 05:53:45 [INFO] [TRAIN] epoch=58, iter=38230/40000, loss=0.1462, lr=0.000614, batch_cost=0.4570, reader_cost=0.0002 | ETA 00:13:28 2020-11-14 05:53:49 [INFO] [TRAIN] epoch=58, iter=38240/40000, loss=0.1460, lr=0.000611, batch_cost=0.4341, reader_cost=0.0002 | ETA 00:12:43 2020-11-14 05:53:53 [INFO] [TRAIN] epoch=58, iter=38250/40000, loss=0.1787, lr=0.000608, batch_cost=0.4593, reader_cost=0.0002 | ETA 00:13:23 2020-11-14 05:53:58 [INFO] [TRAIN] epoch=58, iter=38260/40000, loss=0.2099, lr=0.000605, batch_cost=0.4403, reader_cost=0.0002 | ETA 00:12:46 2020-11-14 05:54:03 [INFO] [TRAIN] epoch=58, iter=38270/40000, loss=0.1986, lr=0.000602, batch_cost=0.4698, reader_cost=0.0002 | ETA 00:13:32 2020-11-14 05:54:07 [INFO] [TRAIN] epoch=58, iter=38280/40000, loss=0.2826, lr=0.000599, batch_cost=0.4441, reader_cost=0.0002 | ETA 00:12:43 2020-11-14 05:54:11 [INFO] [TRAIN] epoch=58, iter=38290/40000, loss=0.1832, lr=0.000596, batch_cost=0.4436, reader_cost=0.0002 | ETA 00:12:38 2020-11-14 05:54:16 [INFO] [TRAIN] epoch=58, iter=38300/40000, loss=0.1990, lr=0.000593, batch_cost=0.4281, reader_cost=0.0002 | ETA 00:12:07 2020-11-14 05:54:20 [INFO] [TRAIN] epoch=58, iter=38310/40000, loss=0.2234, lr=0.000589, batch_cost=0.4285, reader_cost=0.0002 | ETA 00:12:04 2020-11-14 05:54:24 [INFO] [TRAIN] epoch=58, iter=38320/40000, loss=0.1838, lr=0.000586, batch_cost=0.4288, reader_cost=0.0002 | ETA 00:12:00 2020-11-14 05:54:29 [INFO] [TRAIN] epoch=58, iter=38330/40000, loss=0.1801, lr=0.000583, batch_cost=0.4276, reader_cost=0.0002 | ETA 00:11:54 2020-11-14 05:54:34 [INFO] [TRAIN] epoch=59, iter=38340/40000, loss=0.2010, lr=0.000580, batch_cost=0.5533, reader_cost=0.1049 | ETA 00:15:18 2020-11-14 05:54:39 [INFO] [TRAIN] epoch=59, iter=38350/40000, loss=0.1497, lr=0.000577, batch_cost=0.4801, reader_cost=0.0005 | ETA 00:13:12 2020-11-14 05:54:44 [INFO] [TRAIN] epoch=59, iter=38360/40000, loss=0.2176, lr=0.000574, batch_cost=0.4675, reader_cost=0.0002 | ETA 00:12:46 2020-11-14 05:54:48 [INFO] [TRAIN] epoch=59, iter=38370/40000, loss=0.1453, lr=0.000571, batch_cost=0.4819, reader_cost=0.0002 | ETA 00:13:05 2020-11-14 05:54:53 [INFO] [TRAIN] epoch=59, iter=38380/40000, loss=0.2091, lr=0.000568, batch_cost=0.4606, reader_cost=0.0002 | ETA 00:12:26 2020-11-14 05:54:58 [INFO] [TRAIN] epoch=59, iter=38390/40000, loss=0.2149, lr=0.000565, batch_cost=0.4608, reader_cost=0.0002 | ETA 00:12:21 2020-11-14 05:55:02 [INFO] [TRAIN] epoch=59, iter=38400/40000, loss=0.1929, lr=0.000562, batch_cost=0.4545, reader_cost=0.0002 | ETA 00:12:07 2020-11-14 05:55:07 [INFO] [TRAIN] epoch=59, iter=38410/40000, loss=0.2133, lr=0.000559, batch_cost=0.4632, reader_cost=0.0002 | ETA 00:12:16 2020-11-14 05:55:11 [INFO] [TRAIN] epoch=59, iter=38420/40000, loss=0.1616, lr=0.000555, batch_cost=0.4529, reader_cost=0.0002 | ETA 00:11:55 2020-11-14 05:55:16 [INFO] [TRAIN] epoch=59, iter=38430/40000, loss=0.1886, lr=0.000552, batch_cost=0.4628, reader_cost=0.0002 | ETA 00:12:06 2020-11-14 05:55:21 [INFO] [TRAIN] epoch=59, iter=38440/40000, loss=0.1796, lr=0.000549, batch_cost=0.4526, reader_cost=0.0002 | ETA 00:11:46 2020-11-14 05:55:25 [INFO] [TRAIN] epoch=59, iter=38450/40000, loss=0.1841, lr=0.000546, batch_cost=0.4634, reader_cost=0.0002 | ETA 00:11:58 2020-11-14 05:55:29 [INFO] [TRAIN] epoch=59, iter=38460/40000, loss=0.2498, lr=0.000543, batch_cost=0.4356, reader_cost=0.0002 | ETA 00:11:10 2020-11-14 05:55:34 [INFO] [TRAIN] epoch=59, iter=38470/40000, loss=0.1911, lr=0.000540, batch_cost=0.4458, reader_cost=0.0002 | ETA 00:11:22 2020-11-14 05:55:38 [INFO] [TRAIN] epoch=59, iter=38480/40000, loss=0.1716, lr=0.000537, batch_cost=0.4356, reader_cost=0.0002 | ETA 00:11:02 2020-11-14 05:55:43 [INFO] [TRAIN] epoch=59, iter=38490/40000, loss=0.1701, lr=0.000534, batch_cost=0.4332, reader_cost=0.0002 | ETA 00:10:54 2020-11-14 05:55:47 [INFO] [TRAIN] epoch=59, iter=38500/40000, loss=0.1735, lr=0.000531, batch_cost=0.4287, reader_cost=0.0002 | ETA 00:10:43 2020-11-14 05:55:51 [INFO] [TRAIN] epoch=59, iter=38510/40000, loss=0.2004, lr=0.000527, batch_cost=0.4314, reader_cost=0.0002 | ETA 00:10:42 2020-11-14 05:55:56 [INFO] [TRAIN] epoch=59, iter=38520/40000, loss=0.1534, lr=0.000524, batch_cost=0.4348, reader_cost=0.0002 | ETA 00:10:43 2020-11-14 05:56:00 [INFO] [TRAIN] epoch=59, iter=38530/40000, loss=0.2145, lr=0.000521, batch_cost=0.4356, reader_cost=0.0002 | ETA 00:10:40 2020-11-14 05:56:04 [INFO] [TRAIN] epoch=59, iter=38540/40000, loss=0.2086, lr=0.000518, batch_cost=0.4368, reader_cost=0.0002 | ETA 00:10:37 2020-11-14 05:56:09 [INFO] [TRAIN] epoch=59, iter=38550/40000, loss=0.2299, lr=0.000515, batch_cost=0.4393, reader_cost=0.0002 | ETA 00:10:37 2020-11-14 05:56:13 [INFO] [TRAIN] epoch=59, iter=38560/40000, loss=0.1970, lr=0.000512, batch_cost=0.4377, reader_cost=0.0002 | ETA 00:10:30 2020-11-14 05:56:17 [INFO] [TRAIN] epoch=59, iter=38570/40000, loss=0.2101, lr=0.000509, batch_cost=0.4374, reader_cost=0.0002 | ETA 00:10:25 2020-11-14 05:56:22 [INFO] [TRAIN] epoch=59, iter=38580/40000, loss=0.2336, lr=0.000506, batch_cost=0.4364, reader_cost=0.0002 | ETA 00:10:19 2020-11-14 05:56:26 [INFO] [TRAIN] epoch=59, iter=38590/40000, loss=0.1457, lr=0.000502, batch_cost=0.4438, reader_cost=0.0036 | ETA 00:10:25 2020-11-14 05:56:31 [INFO] [TRAIN] epoch=59, iter=38600/40000, loss=0.1821, lr=0.000499, batch_cost=0.4558, reader_cost=0.0003 | ETA 00:10:38 2020-11-14 05:56:36 [INFO] [TRAIN] epoch=59, iter=38610/40000, loss=0.1673, lr=0.000496, batch_cost=0.4777, reader_cost=0.0003 | ETA 00:11:04 2020-11-14 05:56:41 [INFO] [TRAIN] epoch=59, iter=38620/40000, loss=0.1563, lr=0.000493, batch_cost=0.4940, reader_cost=0.0004 | ETA 00:11:21 2020-11-14 05:56:45 [INFO] [TRAIN] epoch=59, iter=38630/40000, loss=0.1946, lr=0.000490, batch_cost=0.4623, reader_cost=0.0004 | ETA 00:10:33 2020-11-14 05:56:50 [INFO] [TRAIN] epoch=59, iter=38640/40000, loss=0.1625, lr=0.000487, batch_cost=0.4599, reader_cost=0.0025 | ETA 00:10:25 2020-11-14 05:56:54 [INFO] [TRAIN] epoch=59, iter=38650/40000, loss=0.2315, lr=0.000483, batch_cost=0.4432, reader_cost=0.0002 | ETA 00:09:58 2020-11-14 05:56:59 [INFO] [TRAIN] epoch=59, iter=38660/40000, loss=0.1377, lr=0.000480, batch_cost=0.4377, reader_cost=0.0002 | ETA 00:09:46 2020-11-14 05:57:03 [INFO] [TRAIN] epoch=59, iter=38670/40000, loss=0.1504, lr=0.000477, batch_cost=0.4369, reader_cost=0.0002 | ETA 00:09:41 2020-11-14 05:57:07 [INFO] [TRAIN] epoch=59, iter=38680/40000, loss=0.1754, lr=0.000474, batch_cost=0.4393, reader_cost=0.0002 | ETA 00:09:39 2020-11-14 05:57:12 [INFO] [TRAIN] epoch=59, iter=38690/40000, loss=0.2143, lr=0.000471, batch_cost=0.4402, reader_cost=0.0002 | ETA 00:09:36 2020-11-14 05:57:16 [INFO] [TRAIN] epoch=59, iter=38700/40000, loss=0.1837, lr=0.000468, batch_cost=0.4358, reader_cost=0.0002 | ETA 00:09:26 2020-11-14 05:57:21 [INFO] [TRAIN] epoch=59, iter=38710/40000, loss=0.1677, lr=0.000465, batch_cost=0.4536, reader_cost=0.0002 | ETA 00:09:45 2020-11-14 05:57:25 [INFO] [TRAIN] epoch=59, iter=38720/40000, loss=0.1523, lr=0.000461, batch_cost=0.4364, reader_cost=0.0002 | ETA 00:09:18 2020-11-14 05:57:29 [INFO] [TRAIN] epoch=59, iter=38730/40000, loss=0.2323, lr=0.000458, batch_cost=0.4388, reader_cost=0.0002 | ETA 00:09:17 2020-11-14 05:57:34 [INFO] [TRAIN] epoch=59, iter=38740/40000, loss=0.1321, lr=0.000455, batch_cost=0.4374, reader_cost=0.0002 | ETA 00:09:11 2020-11-14 05:57:38 [INFO] [TRAIN] epoch=59, iter=38750/40000, loss=0.1655, lr=0.000452, batch_cost=0.4398, reader_cost=0.0002 | ETA 00:09:09 2020-11-14 05:57:43 [INFO] [TRAIN] epoch=59, iter=38760/40000, loss=0.1929, lr=0.000449, batch_cost=0.4371, reader_cost=0.0002 | ETA 00:09:02 2020-11-14 05:57:47 [INFO] [TRAIN] epoch=59, iter=38770/40000, loss=0.2299, lr=0.000445, batch_cost=0.4498, reader_cost=0.0002 | ETA 00:09:13 2020-11-14 05:57:52 [INFO] [TRAIN] epoch=59, iter=38780/40000, loss=0.1856, lr=0.000442, batch_cost=0.4786, reader_cost=0.0002 | ETA 00:09:43 2020-11-14 05:57:56 [INFO] [TRAIN] epoch=59, iter=38790/40000, loss=0.2311, lr=0.000439, batch_cost=0.4547, reader_cost=0.0012 | ETA 00:09:10 2020-11-14 05:58:01 [INFO] [TRAIN] epoch=59, iter=38800/40000, loss=0.2194, lr=0.000436, batch_cost=0.4376, reader_cost=0.0003 | ETA 00:08:45 2020-11-14 05:58:05 [INFO] [TRAIN] epoch=59, iter=38810/40000, loss=0.1584, lr=0.000433, batch_cost=0.4664, reader_cost=0.0003 | ETA 00:09:14 2020-11-14 05:58:10 [INFO] [TRAIN] epoch=59, iter=38820/40000, loss=0.2062, lr=0.000430, batch_cost=0.4439, reader_cost=0.0005 | ETA 00:08:43 2020-11-14 05:58:14 [INFO] [TRAIN] epoch=59, iter=38830/40000, loss=0.1623, lr=0.000426, batch_cost=0.4421, reader_cost=0.0003 | ETA 00:08:37 2020-11-14 05:58:19 [INFO] [TRAIN] epoch=59, iter=38840/40000, loss=0.2103, lr=0.000423, batch_cost=0.4417, reader_cost=0.0002 | ETA 00:08:32 2020-11-14 05:58:23 [INFO] [TRAIN] epoch=59, iter=38850/40000, loss=0.2090, lr=0.000420, batch_cost=0.4368, reader_cost=0.0002 | ETA 00:08:22 2020-11-14 05:58:27 [INFO] [TRAIN] epoch=59, iter=38860/40000, loss=0.3003, lr=0.000417, batch_cost=0.4363, reader_cost=0.0002 | ETA 00:08:17 2020-11-14 05:58:32 [INFO] [TRAIN] epoch=59, iter=38870/40000, loss=0.2025, lr=0.000413, batch_cost=0.4327, reader_cost=0.0002 | ETA 00:08:08 2020-11-14 05:58:36 [INFO] [TRAIN] epoch=59, iter=38880/40000, loss=0.1614, lr=0.000410, batch_cost=0.4321, reader_cost=0.0002 | ETA 00:08:03 2020-11-14 05:58:40 [INFO] [TRAIN] epoch=59, iter=38890/40000, loss=0.1877, lr=0.000407, batch_cost=0.4352, reader_cost=0.0002 | ETA 00:08:03 2020-11-14 05:58:45 [INFO] [TRAIN] epoch=59, iter=38900/40000, loss=0.1812, lr=0.000404, batch_cost=0.4346, reader_cost=0.0002 | ETA 00:07:58 2020-11-14 05:58:49 [INFO] [TRAIN] epoch=59, iter=38910/40000, loss=0.1786, lr=0.000401, batch_cost=0.4391, reader_cost=0.0002 | ETA 00:07:58 2020-11-14 05:58:54 [INFO] [TRAIN] epoch=59, iter=38920/40000, loss=0.1712, lr=0.000397, batch_cost=0.4346, reader_cost=0.0002 | ETA 00:07:49 2020-11-14 05:58:58 [INFO] [TRAIN] epoch=59, iter=38930/40000, loss=0.1973, lr=0.000394, batch_cost=0.4356, reader_cost=0.0002 | ETA 00:07:46 2020-11-14 05:59:02 [INFO] [TRAIN] epoch=59, iter=38940/40000, loss=0.1539, lr=0.000391, batch_cost=0.4366, reader_cost=0.0002 | ETA 00:07:42 2020-11-14 05:59:07 [INFO] [TRAIN] epoch=59, iter=38950/40000, loss=0.1875, lr=0.000388, batch_cost=0.4412, reader_cost=0.0002 | ETA 00:07:43 2020-11-14 05:59:11 [INFO] [TRAIN] epoch=59, iter=38960/40000, loss=0.1810, lr=0.000384, batch_cost=0.4349, reader_cost=0.0002 | ETA 00:07:32 2020-11-14 05:59:15 [INFO] [TRAIN] epoch=59, iter=38970/40000, loss=0.1829, lr=0.000381, batch_cost=0.4343, reader_cost=0.0002 | ETA 00:07:27 2020-11-14 05:59:20 [INFO] [TRAIN] epoch=59, iter=38980/40000, loss=0.2201, lr=0.000378, batch_cost=0.4363, reader_cost=0.0002 | ETA 00:07:25 2020-11-14 05:59:24 [INFO] [TRAIN] epoch=59, iter=38990/40000, loss=0.2746, lr=0.000375, batch_cost=0.4574, reader_cost=0.0002 | ETA 00:07:41 2020-11-14 05:59:30 [INFO] [TRAIN] epoch=60, iter=39000/40000, loss=0.2523, lr=0.000371, batch_cost=0.5854, reader_cost=0.1092 | ETA 00:09:45 2020-11-14 05:59:35 [INFO] [TRAIN] epoch=60, iter=39010/40000, loss=0.1700, lr=0.000368, batch_cost=0.4776, reader_cost=0.0005 | ETA 00:07:52 2020-11-14 05:59:40 [INFO] [TRAIN] epoch=60, iter=39020/40000, loss=0.1421, lr=0.000365, batch_cost=0.4861, reader_cost=0.0002 | ETA 00:07:56 2020-11-14 05:59:44 [INFO] [TRAIN] epoch=60, iter=39030/40000, loss=0.2124, lr=0.000362, batch_cost=0.4445, reader_cost=0.0002 | ETA 00:07:11 2020-11-14 05:59:49 [INFO] [TRAIN] epoch=60, iter=39040/40000, loss=0.2016, lr=0.000358, batch_cost=0.4380, reader_cost=0.0002 | ETA 00:07:00 2020-11-14 05:59:53 [INFO] [TRAIN] epoch=60, iter=39050/40000, loss=0.2727, lr=0.000355, batch_cost=0.4393, reader_cost=0.0002 | ETA 00:06:57 2020-11-14 05:59:57 [INFO] [TRAIN] epoch=60, iter=39060/40000, loss=0.1553, lr=0.000352, batch_cost=0.4368, reader_cost=0.0002 | ETA 00:06:50 2020-11-14 06:00:02 [INFO] [TRAIN] epoch=60, iter=39070/40000, loss=0.2073, lr=0.000349, batch_cost=0.4355, reader_cost=0.0002 | ETA 00:06:44 2020-11-14 06:00:06 [INFO] [TRAIN] epoch=60, iter=39080/40000, loss=0.1863, lr=0.000345, batch_cost=0.4319, reader_cost=0.0002 | ETA 00:06:37 2020-11-14 06:00:10 [INFO] [TRAIN] epoch=60, iter=39090/40000, loss=0.1804, lr=0.000342, batch_cost=0.4382, reader_cost=0.0002 | ETA 00:06:38 2020-11-14 06:00:15 [INFO] [TRAIN] epoch=60, iter=39100/40000, loss=0.1675, lr=0.000339, batch_cost=0.4386, reader_cost=0.0002 | ETA 00:06:34 2020-11-14 06:00:19 [INFO] [TRAIN] epoch=60, iter=39110/40000, loss=0.1647, lr=0.000336, batch_cost=0.4355, reader_cost=0.0002 | ETA 00:06:27 2020-11-14 06:00:23 [INFO] [TRAIN] epoch=60, iter=39120/40000, loss=0.2212, lr=0.000332, batch_cost=0.4322, reader_cost=0.0002 | ETA 00:06:20 2020-11-14 06:00:28 [INFO] [TRAIN] epoch=60, iter=39130/40000, loss=0.1884, lr=0.000329, batch_cost=0.4336, reader_cost=0.0002 | ETA 00:06:17 2020-11-14 06:00:32 [INFO] [TRAIN] epoch=60, iter=39140/40000, loss=0.1991, lr=0.000326, batch_cost=0.4351, reader_cost=0.0002 | ETA 00:06:14 2020-11-14 06:00:37 [INFO] [TRAIN] epoch=60, iter=39150/40000, loss=0.1502, lr=0.000322, batch_cost=0.4372, reader_cost=0.0002 | ETA 00:06:11 2020-11-14 06:00:41 [INFO] [TRAIN] epoch=60, iter=39160/40000, loss=0.1581, lr=0.000319, batch_cost=0.4298, reader_cost=0.0002 | ETA 00:06:01 2020-11-14 06:00:45 [INFO] [TRAIN] epoch=60, iter=39170/40000, loss=0.1576, lr=0.000316, batch_cost=0.4300, reader_cost=0.0002 | ETA 00:05:56 2020-11-14 06:00:49 [INFO] [TRAIN] epoch=60, iter=39180/40000, loss=0.2282, lr=0.000312, batch_cost=0.4311, reader_cost=0.0002 | ETA 00:05:53 2020-11-14 06:00:54 [INFO] [TRAIN] epoch=60, iter=39190/40000, loss=0.1261, lr=0.000309, batch_cost=0.4351, reader_cost=0.0002 | ETA 00:05:52 2020-11-14 06:00:58 [INFO] [TRAIN] epoch=60, iter=39200/40000, loss=0.1986, lr=0.000306, batch_cost=0.4327, reader_cost=0.0002 | ETA 00:05:46 2020-11-14 06:01:02 [INFO] [TRAIN] epoch=60, iter=39210/40000, loss=0.1776, lr=0.000302, batch_cost=0.4303, reader_cost=0.0002 | ETA 00:05:39 2020-11-14 06:01:07 [INFO] [TRAIN] epoch=60, iter=39220/40000, loss=0.1371, lr=0.000299, batch_cost=0.4385, reader_cost=0.0002 | ETA 00:05:42 2020-11-14 06:01:11 [INFO] [TRAIN] epoch=60, iter=39230/40000, loss=0.1915, lr=0.000296, batch_cost=0.4382, reader_cost=0.0002 | ETA 00:05:37 2020-11-14 06:01:16 [INFO] [TRAIN] epoch=60, iter=39240/40000, loss=0.1822, lr=0.000292, batch_cost=0.4303, reader_cost=0.0002 | ETA 00:05:27 2020-11-14 06:01:20 [INFO] [TRAIN] epoch=60, iter=39250/40000, loss=0.2642, lr=0.000289, batch_cost=0.4373, reader_cost=0.0002 | ETA 00:05:27 2020-11-14 06:01:24 [INFO] [TRAIN] epoch=60, iter=39260/40000, loss=0.1828, lr=0.000286, batch_cost=0.4585, reader_cost=0.0002 | ETA 00:05:39 2020-11-14 06:01:29 [INFO] [TRAIN] epoch=60, iter=39270/40000, loss=0.2082, lr=0.000282, batch_cost=0.4496, reader_cost=0.0001 | ETA 00:05:28 2020-11-14 06:01:33 [INFO] [TRAIN] epoch=60, iter=39280/40000, loss=0.2010, lr=0.000279, batch_cost=0.4344, reader_cost=0.0002 | ETA 00:05:12 2020-11-14 06:01:38 [INFO] [TRAIN] epoch=60, iter=39290/40000, loss=0.1661, lr=0.000276, batch_cost=0.4466, reader_cost=0.0002 | ETA 00:05:17 2020-11-14 06:01:42 [INFO] [TRAIN] epoch=60, iter=39300/40000, loss=0.2248, lr=0.000272, batch_cost=0.4365, reader_cost=0.0002 | ETA 00:05:05 2020-11-14 06:01:46 [INFO] [TRAIN] epoch=60, iter=39310/40000, loss=0.1596, lr=0.000269, batch_cost=0.4354, reader_cost=0.0002 | ETA 00:05:00 2020-11-14 06:01:51 [INFO] [TRAIN] epoch=60, iter=39320/40000, loss=0.2439, lr=0.000266, batch_cost=0.4824, reader_cost=0.0003 | ETA 00:05:28 2020-11-14 06:01:57 [INFO] [TRAIN] epoch=60, iter=39330/40000, loss=0.1558, lr=0.000262, batch_cost=0.5202, reader_cost=0.0002 | ETA 00:05:48 2020-11-14 06:02:01 [INFO] [TRAIN] epoch=60, iter=39340/40000, loss=0.2352, lr=0.000259, batch_cost=0.4731, reader_cost=0.0002 | ETA 00:05:12 2020-11-14 06:02:06 [INFO] [TRAIN] epoch=60, iter=39350/40000, loss=0.2090, lr=0.000255, batch_cost=0.4997, reader_cost=0.0003 | ETA 00:05:24 2020-11-14 06:02:12 [INFO] [TRAIN] epoch=60, iter=39360/40000, loss=0.2326, lr=0.000252, batch_cost=0.5246, reader_cost=0.0003 | ETA 00:05:35 2020-11-14 06:02:17 [INFO] [TRAIN] epoch=60, iter=39370/40000, loss=0.1809, lr=0.000249, batch_cost=0.5074, reader_cost=0.0003 | ETA 00:05:19 2020-11-14 06:02:21 [INFO] [TRAIN] epoch=60, iter=39380/40000, loss=0.1681, lr=0.000245, batch_cost=0.4584, reader_cost=0.0003 | ETA 00:04:44 2020-11-14 06:02:26 [INFO] [TRAIN] epoch=60, iter=39390/40000, loss=0.1553, lr=0.000242, batch_cost=0.4842, reader_cost=0.0060 | ETA 00:04:55 2020-11-14 06:02:31 [INFO] [TRAIN] epoch=60, iter=39400/40000, loss=0.1894, lr=0.000238, batch_cost=0.4803, reader_cost=0.0074 | ETA 00:04:48 2020-11-14 06:02:35 [INFO] [TRAIN] epoch=60, iter=39410/40000, loss=0.2013, lr=0.000235, batch_cost=0.4505, reader_cost=0.0002 | ETA 00:04:25 2020-11-14 06:02:40 [INFO] [TRAIN] epoch=60, iter=39420/40000, loss=0.1435, lr=0.000232, batch_cost=0.4645, reader_cost=0.0002 | ETA 00:04:29 2020-11-14 06:02:44 [INFO] [TRAIN] epoch=60, iter=39430/40000, loss=0.1627, lr=0.000228, batch_cost=0.4524, reader_cost=0.0002 | ETA 00:04:17 2020-11-14 06:02:49 [INFO] [TRAIN] epoch=60, iter=39440/40000, loss=0.2240, lr=0.000225, batch_cost=0.4542, reader_cost=0.0002 | ETA 00:04:14 2020-11-14 06:02:54 [INFO] [TRAIN] epoch=60, iter=39450/40000, loss=0.2399, lr=0.000221, batch_cost=0.5180, reader_cost=0.0002 | ETA 00:04:44 2020-11-14 06:02:59 [INFO] [TRAIN] epoch=60, iter=39460/40000, loss=0.2101, lr=0.000218, batch_cost=0.4753, reader_cost=0.0002 | ETA 00:04:16 2020-11-14 06:03:04 [INFO] [TRAIN] epoch=60, iter=39470/40000, loss=0.2095, lr=0.000214, batch_cost=0.5030, reader_cost=0.0002 | ETA 00:04:26 2020-11-14 06:03:09 [INFO] [TRAIN] epoch=60, iter=39480/40000, loss=0.1843, lr=0.000211, batch_cost=0.4640, reader_cost=0.0002 | ETA 00:04:01 2020-11-14 06:03:13 [INFO] [TRAIN] epoch=60, iter=39490/40000, loss=0.1555, lr=0.000207, batch_cost=0.4502, reader_cost=0.0002 | ETA 00:03:49 2020-11-14 06:03:18 [INFO] [TRAIN] epoch=60, iter=39500/40000, loss=0.1379, lr=0.000204, batch_cost=0.4360, reader_cost=0.0002 | ETA 00:03:38 2020-11-14 06:03:22 [INFO] [TRAIN] epoch=60, iter=39510/40000, loss=0.1865, lr=0.000200, batch_cost=0.4638, reader_cost=0.0002 | ETA 00:03:47 2020-11-14 06:03:27 [INFO] [TRAIN] epoch=60, iter=39520/40000, loss=0.1926, lr=0.000197, batch_cost=0.4386, reader_cost=0.0002 | ETA 00:03:30 2020-11-14 06:03:31 [INFO] [TRAIN] epoch=60, iter=39530/40000, loss=0.1688, lr=0.000193, batch_cost=0.4629, reader_cost=0.0002 | ETA 00:03:37 2020-11-14 06:03:36 [INFO] [TRAIN] epoch=60, iter=39540/40000, loss=0.1671, lr=0.000190, batch_cost=0.4546, reader_cost=0.0002 | ETA 00:03:29 2020-11-14 06:03:40 [INFO] [TRAIN] epoch=60, iter=39550/40000, loss=0.1517, lr=0.000186, batch_cost=0.4504, reader_cost=0.0002 | ETA 00:03:22 2020-11-14 06:03:45 [INFO] [TRAIN] epoch=60, iter=39560/40000, loss=0.1694, lr=0.000183, batch_cost=0.4403, reader_cost=0.0002 | ETA 00:03:13 2020-11-14 06:03:49 [INFO] [TRAIN] epoch=60, iter=39570/40000, loss=0.2211, lr=0.000179, batch_cost=0.4363, reader_cost=0.0002 | ETA 00:03:07 2020-11-14 06:03:53 [INFO] [TRAIN] epoch=60, iter=39580/40000, loss=0.1916, lr=0.000176, batch_cost=0.4362, reader_cost=0.0002 | ETA 00:03:03 2020-11-14 06:03:59 [INFO] [TRAIN] epoch=60, iter=39590/40000, loss=0.2097, lr=0.000172, batch_cost=0.5740, reader_cost=0.0002 | ETA 00:03:55 2020-11-14 06:04:07 [INFO] [TRAIN] epoch=60, iter=39600/40000, loss=0.1884, lr=0.000169, batch_cost=0.7918, reader_cost=0.0002 | ETA 00:05:16 2020-11-14 06:04:14 [INFO] [TRAIN] epoch=60, iter=39610/40000, loss=0.2394, lr=0.000165, batch_cost=0.7371, reader_cost=0.0002 | ETA 00:04:47 2020-11-14 06:04:21 [INFO] [TRAIN] epoch=60, iter=39620/40000, loss=0.1751, lr=0.000162, batch_cost=0.6190, reader_cost=0.0002 | ETA 00:03:55 2020-11-14 06:04:29 [INFO] [TRAIN] epoch=60, iter=39630/40000, loss=0.1884, lr=0.000158, batch_cost=0.8174, reader_cost=0.0002 | ETA 00:05:02 2020-11-14 06:04:34 [INFO] [TRAIN] epoch=60, iter=39640/40000, loss=0.1787, lr=0.000154, batch_cost=0.5245, reader_cost=0.0002 | ETA 00:03:08 2020-11-14 06:04:39 [INFO] [TRAIN] epoch=60, iter=39650/40000, loss=0.1904, lr=0.000151, batch_cost=0.4923, reader_cost=0.0002 | ETA 00:02:52 2020-11-14 06:04:44 [INFO] [TRAIN] epoch=60, iter=39660/40000, loss=0.1910, lr=0.000147, batch_cost=0.4793, reader_cost=0.0002 | ETA 00:02:42 2020-11-14 06:04:49 [INFO] [TRAIN] epoch=61, iter=39670/40000, loss=0.2280, lr=0.000144, batch_cost=0.5569, reader_cost=0.0872 | ETA 00:03:03 2020-11-14 06:04:54 [INFO] [TRAIN] epoch=61, iter=39680/40000, loss=0.1858, lr=0.000140, batch_cost=0.4560, reader_cost=0.0005 | ETA 00:02:25 2020-11-14 06:04:58 [INFO] [TRAIN] epoch=61, iter=39690/40000, loss=0.1617, lr=0.000136, batch_cost=0.4353, reader_cost=0.0002 | ETA 00:02:14 2020-11-14 06:05:03 [INFO] [TRAIN] epoch=61, iter=39700/40000, loss=0.1432, lr=0.000133, batch_cost=0.4374, reader_cost=0.0002 | ETA 00:02:11 2020-11-14 06:05:07 [INFO] [TRAIN] epoch=61, iter=39710/40000, loss=0.1408, lr=0.000129, batch_cost=0.4371, reader_cost=0.0002 | ETA 00:02:06 2020-11-14 06:05:12 [INFO] [TRAIN] epoch=61, iter=39720/40000, loss=0.1968, lr=0.000125, batch_cost=0.4660, reader_cost=0.0002 | ETA 00:02:10 2020-11-14 06:05:16 [INFO] [TRAIN] epoch=61, iter=39730/40000, loss=0.1803, lr=0.000122, batch_cost=0.4579, reader_cost=0.0002 | ETA 00:02:03 2020-11-14 06:05:21 [INFO] [TRAIN] epoch=61, iter=39740/40000, loss=0.1858, lr=0.000118, batch_cost=0.4595, reader_cost=0.0002 | ETA 00:01:59 2020-11-14 06:05:25 [INFO] [TRAIN] epoch=61, iter=39750/40000, loss=0.1834, lr=0.000114, batch_cost=0.4639, reader_cost=0.0002 | ETA 00:01:55 2020-11-14 06:05:30 [INFO] [TRAIN] epoch=61, iter=39760/40000, loss=0.1674, lr=0.000110, batch_cost=0.4348, reader_cost=0.0002 | ETA 00:01:44 2020-11-14 06:05:34 [INFO] [TRAIN] epoch=61, iter=39770/40000, loss=0.1761, lr=0.000107, batch_cost=0.4398, reader_cost=0.0002 | ETA 00:01:41 2020-11-14 06:05:38 [INFO] [TRAIN] epoch=61, iter=39780/40000, loss=0.1774, lr=0.000103, batch_cost=0.4329, reader_cost=0.0002 | ETA 00:01:35 2020-11-14 06:05:43 [INFO] [TRAIN] epoch=61, iter=39790/40000, loss=0.1918, lr=0.000099, batch_cost=0.4330, reader_cost=0.0010 | ETA 00:01:30 2020-11-14 06:05:47 [INFO] [TRAIN] epoch=61, iter=39800/40000, loss=0.2680, lr=0.000095, batch_cost=0.4339, reader_cost=0.0002 | ETA 00:01:26 2020-11-14 06:05:52 [INFO] [TRAIN] epoch=61, iter=39810/40000, loss=0.1737, lr=0.000091, batch_cost=0.4579, reader_cost=0.0023 | ETA 00:01:26 2020-11-14 06:05:56 [INFO] [TRAIN] epoch=61, iter=39820/40000, loss=0.1866, lr=0.000088, batch_cost=0.4744, reader_cost=0.0014 | ETA 00:01:25 2020-11-14 06:06:01 [INFO] [TRAIN] epoch=61, iter=39830/40000, loss=0.2203, lr=0.000084, batch_cost=0.4845, reader_cost=0.0011 | ETA 00:01:22 2020-11-14 06:06:06 [INFO] [TRAIN] epoch=61, iter=39840/40000, loss=0.2067, lr=0.000080, batch_cost=0.4894, reader_cost=0.0012 | ETA 00:01:18 2020-11-14 06:06:11 [INFO] [TRAIN] epoch=61, iter=39850/40000, loss=0.1739, lr=0.000076, batch_cost=0.4615, reader_cost=0.0019 | ETA 00:01:09 2020-11-14 06:06:16 [INFO] [TRAIN] epoch=61, iter=39860/40000, loss=0.1468, lr=0.000072, batch_cost=0.4775, reader_cost=0.0019 | ETA 00:01:06 2020-11-14 06:06:21 [INFO] [TRAIN] epoch=61, iter=39870/40000, loss=0.2325, lr=0.000068, batch_cost=0.5006, reader_cost=0.0012 | ETA 00:01:05 2020-11-14 06:06:25 [INFO] [TRAIN] epoch=61, iter=39880/40000, loss=0.1746, lr=0.000064, batch_cost=0.4776, reader_cost=0.0065 | ETA 00:00:57 2020-11-14 06:06:30 [INFO] [TRAIN] epoch=61, iter=39890/40000, loss=0.2161, lr=0.000060, batch_cost=0.4899, reader_cost=0.0038 | ETA 00:00:53 2020-11-14 06:06:35 [INFO] [TRAIN] epoch=61, iter=39900/40000, loss=0.1672, lr=0.000056, batch_cost=0.4783, reader_cost=0.0048 | ETA 00:00:47 2020-11-14 06:06:40 [INFO] [TRAIN] epoch=61, iter=39910/40000, loss=0.1678, lr=0.000052, batch_cost=0.4789, reader_cost=0.0002 | ETA 00:00:43 2020-11-14 06:06:44 [INFO] [TRAIN] epoch=61, iter=39920/40000, loss=0.2336, lr=0.000048, batch_cost=0.4298, reader_cost=0.0002 | ETA 00:00:34 2020-11-14 06:06:48 [INFO] [TRAIN] epoch=61, iter=39930/40000, loss=0.1778, lr=0.000043, batch_cost=0.4330, reader_cost=0.0002 | ETA 00:00:30 2020-11-14 06:06:53 [INFO] [TRAIN] epoch=61, iter=39940/40000, loss=0.1689, lr=0.000039, batch_cost=0.4409, reader_cost=0.0002 | ETA 00:00:26 2020-11-14 06:06:57 [INFO] [TRAIN] epoch=61, iter=39950/40000, loss=0.1895, lr=0.000035, batch_cost=0.4308, reader_cost=0.0002 | ETA 00:00:21 2020-11-14 06:07:02 [INFO] [TRAIN] epoch=61, iter=39960/40000, loss=0.2537, lr=0.000030, batch_cost=0.4347, reader_cost=0.0002 | ETA 00:00:17 2020-11-14 06:07:06 [INFO] [TRAIN] epoch=61, iter=39970/40000, loss=0.2501, lr=0.000026, batch_cost=0.4459, reader_cost=0.0002 | ETA 00:00:13 2020-11-14 06:07:10 [INFO] [TRAIN] epoch=61, iter=39980/40000, loss=0.1693, lr=0.000021, batch_cost=0.4272, reader_cost=0.0002 | ETA 00:00:08 2020-11-14 06:07:15 [INFO] [TRAIN] epoch=61, iter=39990/40000, loss=0.1908, lr=0.000016, batch_cost=0.4246, reader_cost=0.0002 | ETA 00:00:04 2020-11-14 06:07:19 [INFO] [TRAIN] epoch=61, iter=40000/40000, loss=0.1590, lr=0.000011, batch_cost=0.4252, reader_cost=0.0002 | ETA 00:00:00 2020-11-14 06:07:19 [INFO] Start evaluating (total_samples=1449, total_iters=363)... 2020-11-14 06:07:37 [INFO] [EVAL] #Images=1449 mIoU=0.8032 Acc=0.9561 Kappa=0.9027 2020-11-14 06:07:37 [INFO] [EVAL] Class IoU: [0.9486 0.9261 0.4348 0.8936 0.7137 0.8331 0.9588 0.9164 0.9452 0.4943 0.891 0.5762 0.9107 0.9227 0.9016 0.8768 0.6624 0.8505 0.54 0.9232 0.7476] 2020-11-14 06:07:37 [INFO] [EVAL] Class Acc: [0.9684 0.9554 0.4483 0.9406 0.8127 0.8961 0.9776 0.9739 0.9699 0.7141 0.9366 0.9323 0.9463 0.957 0.9439 0.947 0.8204 0.9368 0.8499 0.9659 0.9046] 2020-11-14 06:07:46 [INFO] [EVAL] The model with the best validation mIoU (0.8032) was saved at iter 40000.