----------- Configuration Arguments ----------- gpus: None heter_worker_num: None heter_workers: http_port: None ips: 127.0.0.1 log_dir: log nproc_per_node: None server_num: None servers: training_script: train.py training_script_args: ['--do_eval', '--use_vdl', '--config', 'configs/sfnet/resnet50_cityscape.yml'] worker_num: None workers: ------------------------------------------------ launch train in GPU mode which: no nvcc in (/ssd3/haoyuying/anaconda3/envs/latest/bin:/ssd3/haoyuying/anaconda3/bin:/ssd3/haoyuying/anaconda3/condabin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin:/opt/bin:/home/opt/bin:/usr/local/sbin:/usr/sbin:/opt/bin:/home/opt/bin:/ssd3/haoyuying/.local/bin:/ssd3/haoyuying/bin:/opt/bin:/home/opt/bin:/ssd3/haoyuying/.local/bin:/ssd3/haoyuying/bin:/opt/bin:/home/opt/bin) 2021-02-22 18:02:58 [INFO] ------------Environment Information------------- platform: Linux-3.10.0_3-0-0-34-x86_64-with-glibc2.10 Python: 3.8.5 (default, Sep 4 2020, 07:30:14) [GCC 7.3.0] Paddle compiled with cuda: True NVCC: Cuda compilation tools, release 10.2, V10.2.89 cudnn: 7.6 GPUs used: 4 CUDA_VISIBLE_DEVICES: 2,3,4,5 GPU: ['GPU 0: Tesla V100-SXM2-16GB', 'GPU 1: Tesla V100-SXM2-16GB', 'GPU 2: Tesla V100-SXM2-16GB', 'GPU 3: Tesla V100-SXM2-16GB', 'GPU 4: Tesla V100-SXM2-16GB', 'GPU 5: Tesla V100-SXM2-16GB', 'GPU 6: Tesla V100-SXM2-16GB', 'GPU 7: Tesla V100-SXM2-16GB'] GCC: gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-39) PaddlePaddle: 0.0.0 OpenCV: 4.5.1 ------------------------------------------------ 2021-02-22 18:02:59 [INFO] ---------------Config Information--------------- batch_size: 2 iters: 80000 learning_rate: decay: end_lr: 0.0 power: 0.9 type: poly value: 0.01 loss: coef: - 1 types: - ignore_index: 255 type: OhemCrossEntropyLoss model: backbone: output_stride: 8 pretrained: https://bj.bcebos.com/paddleseg/dygraph/resnet50_vd_ssld_v2.tar.gz type: ResNet50_vd backbone_indices: - 0 - 1 - 2 - 3 num_classes: 19 type: SFNet optimizer: momentum: 0.9 type: sgd weight_decay: 0.0005 train_dataset: dataset_root: data/cityscapes mode: train transforms: - max_scale_factor: 2.0 min_scale_factor: 0.5 scale_step_size: 0.25 type: ResizeStepScaling - crop_size: - 1024 - 1024 type: RandomPaddingCrop - type: RandomHorizontalFlip - brightness_range: 0.4 contrast_range: 0.4 saturation_range: 0.4 type: RandomDistort - type: Normalize type: Cityscapes val_dataset: dataset_root: data/cityscapes mode: val transforms: - type: Normalize type: Cityscapes ------------------------------------------------ W0222 18:02:59.184326 33498 device_context.cc:362] Please NOTE: device: 0, GPU Compute Capability: 7.0, Driver API Version: 10.2, Runtime API Version: 10.0 W0222 18:02:59.184371 33498 device_context.cc:372] device: 0, cuDNN Version: 7.6. 2021-02-22 18:03:05 [INFO] Loading pretrained model from https://bj.bcebos.com/paddleseg/dygraph/resnet50_vd_ssld_v2.tar.gz 2021-02-22 18:03:06 [INFO] There are 275/275 variables loaded into ResNet_vd. W0222 18:03:07.538416 33498 nccl_context.cc:142] Socket connect worker 127.0.0.1:27193 failed, try again after 3 seconds. I0222 18:03:10.540354 33498 nccl_context.cc:189] init nccl context nranks: 4 local rank: 0 gpu id: 0 ring id: 0 2021-02-22 18:03:28 [INFO] [TRAIN] epoch=1, iter=10/80000, loss=2.3353, lr=0.009999, batch_cost=1.6477, reader_cost=0.1542 | ETA 36:36:42 2021-02-22 18:03:41 [INFO] [TRAIN] epoch=1, iter=20/80000, loss=1.7848, lr=0.009998, batch_cost=1.3566, reader_cost=0.0001 | ETA 30:08:21 2021-02-22 18:03:55 [INFO] [TRAIN] epoch=1, iter=30/80000, loss=1.6977, lr=0.009997, batch_cost=1.3521, reader_cost=0.0001 | ETA 30:02:04 2021-02-22 18:04:08 [INFO] [TRAIN] epoch=1, iter=40/80000, loss=1.5204, lr=0.009996, batch_cost=1.3389, reader_cost=0.0001 | ETA 29:44:15 2021-02-22 18:04:21 [INFO] [TRAIN] epoch=1, iter=50/80000, loss=1.5871, lr=0.009994, batch_cost=1.3286, reader_cost=0.0001 | ETA 29:30:18 2021-02-22 18:04:35 [INFO] [TRAIN] epoch=1, iter=60/80000, loss=1.4093, lr=0.009993, batch_cost=1.3083, reader_cost=0.0001 | ETA 29:03:04 2021-02-22 18:04:48 [INFO] [TRAIN] epoch=1, iter=70/80000, loss=1.5684, lr=0.009992, batch_cost=1.3364, reader_cost=0.0001 | ETA 29:40:18 2021-02-22 18:05:01 [INFO] [TRAIN] epoch=1, iter=80/80000, loss=1.3216, lr=0.009991, batch_cost=1.3542, reader_cost=0.0001 | ETA 30:03:51 2021-02-22 18:05:15 [INFO] [TRAIN] epoch=1, iter=90/80000, loss=1.4563, lr=0.009990, batch_cost=1.3144, reader_cost=0.0001 | ETA 29:10:37 2021-02-22 18:05:28 [INFO] [TRAIN] epoch=1, iter=100/80000, loss=1.3354, lr=0.009989, batch_cost=1.3896, reader_cost=0.0001 | ETA 30:50:26 2021-02-22 18:05:42 [INFO] [TRAIN] epoch=1, iter=110/80000, loss=1.3037, lr=0.009988, batch_cost=1.3567, reader_cost=0.0001 | ETA 30:06:29 2021-02-22 18:05:56 [INFO] [TRAIN] epoch=1, iter=120/80000, loss=1.3856, lr=0.009987, batch_cost=1.3515, reader_cost=0.0001 | ETA 29:59:19 2021-02-22 18:06:09 [INFO] [TRAIN] epoch=1, iter=130/80000, loss=1.5676, lr=0.009985, batch_cost=1.3592, reader_cost=0.0001 | ETA 30:09:18 2021-02-22 18:06:23 [INFO] [TRAIN] epoch=1, iter=140/80000, loss=1.1816, lr=0.009984, batch_cost=1.3640, reader_cost=0.0001 | ETA 30:15:32 2021-02-22 18:06:36 [INFO] [TRAIN] epoch=1, iter=150/80000, loss=1.2970, lr=0.009983, batch_cost=1.3469, reader_cost=0.0001 | ETA 29:52:29 2021-02-22 18:06:50 [INFO] [TRAIN] epoch=1, iter=160/80000, loss=1.2994, lr=0.009982, batch_cost=1.3575, reader_cost=0.0001 | ETA 30:06:21 2021-02-22 18:07:03 [INFO] [TRAIN] epoch=1, iter=170/80000, loss=1.2822, lr=0.009981, batch_cost=1.3319, reader_cost=0.0001 | ETA 29:32:01 2021-02-22 18:07:17 [INFO] [TRAIN] epoch=1, iter=180/80000, loss=1.2930, lr=0.009980, batch_cost=1.3775, reader_cost=0.0001 | ETA 30:32:29 2021-02-22 18:07:30 [INFO] [TRAIN] epoch=1, iter=190/80000, loss=1.2821, lr=0.009979, batch_cost=1.3542, reader_cost=0.0001 | ETA 30:01:22 2021-02-22 18:07:44 [INFO] [TRAIN] epoch=1, iter=200/80000, loss=1.4081, lr=0.009978, batch_cost=1.3698, reader_cost=0.0001 | ETA 30:21:48 2021-02-22 18:07:58 [INFO] [TRAIN] epoch=1, iter=210/80000, loss=1.2050, lr=0.009976, batch_cost=1.3619, reader_cost=0.0001 | ETA 30:11:09 2021-02-22 18:08:11 [INFO] [TRAIN] epoch=1, iter=220/80000, loss=1.1330, lr=0.009975, batch_cost=1.3501, reader_cost=0.0001 | ETA 29:55:09 2021-02-22 18:08:25 [INFO] [TRAIN] epoch=1, iter=230/80000, loss=1.1534, lr=0.009974, batch_cost=1.3535, reader_cost=0.0001 | ETA 29:59:27 2021-02-22 18:08:38 [INFO] [TRAIN] epoch=1, iter=240/80000, loss=1.5729, lr=0.009973, batch_cost=1.3638, reader_cost=0.0001 | ETA 30:12:58 2021-02-22 18:08:52 [INFO] [TRAIN] epoch=1, iter=250/80000, loss=1.5806, lr=0.009972, batch_cost=1.3555, reader_cost=0.0001 | ETA 30:01:42 2021-02-22 18:09:06 [INFO] [TRAIN] epoch=1, iter=260/80000, loss=1.1814, lr=0.009971, batch_cost=1.3699, reader_cost=0.0001 | ETA 30:20:34 2021-02-22 18:09:19 [INFO] [TRAIN] epoch=1, iter=270/80000, loss=1.2074, lr=0.009970, batch_cost=1.3544, reader_cost=0.0001 | ETA 29:59:49 2021-02-22 18:09:33 [INFO] [TRAIN] epoch=1, iter=280/80000, loss=1.1956, lr=0.009969, batch_cost=1.3431, reader_cost=0.0001 | ETA 29:44:33 2021-02-22 18:09:46 [INFO] [TRAIN] epoch=1, iter=290/80000, loss=1.2645, lr=0.009967, batch_cost=1.3380, reader_cost=0.0001 | ETA 29:37:32 2021-02-22 18:10:00 [INFO] [TRAIN] epoch=1, iter=300/80000, loss=1.0988, lr=0.009966, batch_cost=1.3427, reader_cost=0.0001 | ETA 29:43:30 2021-02-22 18:10:13 [INFO] [TRAIN] epoch=1, iter=310/80000, loss=1.2264, lr=0.009965, batch_cost=1.3554, reader_cost=0.0001 | ETA 30:00:14 2021-02-22 18:10:27 [INFO] [TRAIN] epoch=1, iter=320/80000, loss=1.2311, lr=0.009964, batch_cost=1.3552, reader_cost=0.0001 | ETA 29:59:43 2021-02-22 18:10:40 [INFO] [TRAIN] epoch=1, iter=330/80000, loss=1.2017, lr=0.009963, batch_cost=1.3431, reader_cost=0.0001 | ETA 29:43:22 2021-02-22 18:10:54 [INFO] [TRAIN] epoch=1, iter=340/80000, loss=1.5535, lr=0.009962, batch_cost=1.3520, reader_cost=0.0001 | ETA 29:55:04 2021-02-22 18:11:07 [INFO] [TRAIN] epoch=1, iter=350/80000, loss=1.2834, lr=0.009961, batch_cost=1.3344, reader_cost=0.0001 | ETA 29:31:23 2021-02-22 18:11:20 [INFO] [TRAIN] epoch=1, iter=360/80000, loss=1.1704, lr=0.009960, batch_cost=1.3545, reader_cost=0.0001 | ETA 29:57:56 2021-02-22 18:11:34 [INFO] [TRAIN] epoch=1, iter=370/80000, loss=1.3191, lr=0.009958, batch_cost=1.3271, reader_cost=0.0001 | ETA 29:21:19 2021-02-22 18:11:49 [INFO] [TRAIN] epoch=2, iter=380/80000, loss=1.2731, lr=0.009957, batch_cost=1.4842, reader_cost=0.0906 | ETA 32:49:33 2021-02-22 18:12:02 [INFO] [TRAIN] epoch=2, iter=390/80000, loss=1.2983, lr=0.009956, batch_cost=1.3547, reader_cost=0.0001 | ETA 29:57:29 2021-02-22 18:12:16 [INFO] [TRAIN] epoch=2, iter=400/80000, loss=1.2234, lr=0.009955, batch_cost=1.3823, reader_cost=0.0001 | ETA 30:33:48 2021-02-22 18:12:29 [INFO] [TRAIN] epoch=2, iter=410/80000, loss=1.2068, lr=0.009954, batch_cost=1.3503, reader_cost=0.0001 | ETA 29:51:06 2021-02-22 18:12:43 [INFO] [TRAIN] epoch=2, iter=420/80000, loss=1.2900, lr=0.009953, batch_cost=1.3464, reader_cost=0.0001 | ETA 29:45:48 2021-02-22 18:12:56 [INFO] [TRAIN] epoch=2, iter=430/80000, loss=1.3455, lr=0.009952, batch_cost=1.3420, reader_cost=0.0001 | ETA 29:39:41 2021-02-22 18:13:10 [INFO] [TRAIN] epoch=2, iter=440/80000, loss=1.3693, lr=0.009951, batch_cost=1.3714, reader_cost=0.0001 | ETA 30:18:30 2021-02-22 18:13:24 [INFO] [TRAIN] epoch=2, iter=450/80000, loss=1.0721, lr=0.009949, batch_cost=1.3446, reader_cost=0.0001 | ETA 29:42:45 2021-02-22 18:13:37 [INFO] [TRAIN] epoch=2, iter=460/80000, loss=1.2063, lr=0.009948, batch_cost=1.3753, reader_cost=0.0001 | ETA 30:23:15 2021-02-22 18:13:51 [INFO] [TRAIN] epoch=2, iter=470/80000, loss=1.2225, lr=0.009947, batch_cost=1.3317, reader_cost=0.0001 | ETA 29:25:08 2021-02-22 18:14:04 [INFO] [TRAIN] epoch=2, iter=480/80000, loss=1.1699, lr=0.009946, batch_cost=1.3615, reader_cost=0.0001 | ETA 30:04:28 2021-02-22 18:14:18 [INFO] [TRAIN] epoch=2, iter=490/80000, loss=1.1459, lr=0.009945, batch_cost=1.3528, reader_cost=0.0001 | ETA 29:52:40 2021-02-22 18:14:31 [INFO] [TRAIN] epoch=2, iter=500/80000, loss=1.0122, lr=0.009944, batch_cost=1.3733, reader_cost=0.0001 | ETA 30:19:36 2021-02-22 18:14:45 [INFO] [TRAIN] epoch=2, iter=510/80000, loss=1.2618, lr=0.009943, batch_cost=1.3733, reader_cost=0.0001 | ETA 30:19:25 2021-02-22 18:14:59 [INFO] [TRAIN] epoch=2, iter=520/80000, loss=1.0909, lr=0.009942, batch_cost=1.3509, reader_cost=0.0001 | ETA 29:49:31 2021-02-22 18:15:12 [INFO] [TRAIN] epoch=2, iter=530/80000, loss=1.2259, lr=0.009940, batch_cost=1.3412, reader_cost=0.0001 | ETA 29:36:27 2021-02-22 18:15:26 [INFO] [TRAIN] epoch=2, iter=540/80000, loss=1.2104, lr=0.009939, batch_cost=1.3412, reader_cost=0.0001 | ETA 29:36:08 2021-02-22 18:15:39 [INFO] [TRAIN] epoch=2, iter=550/80000, loss=1.0709, lr=0.009938, batch_cost=1.3504, reader_cost=0.0001 | ETA 29:48:10 2021-02-22 18:15:52 [INFO] [TRAIN] epoch=2, iter=560/80000, loss=1.1437, lr=0.009937, batch_cost=1.3375, reader_cost=0.0001 | ETA 29:30:54 2021-02-22 18:16:06 [INFO] [TRAIN] epoch=2, iter=570/80000, loss=1.1196, lr=0.009936, batch_cost=1.3633, reader_cost=0.0001 | ETA 30:04:50 2021-02-22 18:16:20 [INFO] [TRAIN] epoch=2, iter=580/80000, loss=1.0306, lr=0.009935, batch_cost=1.3495, reader_cost=0.0001 | ETA 29:46:18 2021-02-22 18:16:33 [INFO] [TRAIN] epoch=2, iter=590/80000, loss=1.1637, lr=0.009934, batch_cost=1.3485, reader_cost=0.0001 | ETA 29:44:47 2021-02-22 18:16:46 [INFO] [TRAIN] epoch=2, iter=600/80000, loss=1.1287, lr=0.009933, batch_cost=1.3360, reader_cost=0.0001 | ETA 29:27:59 2021-02-22 18:17:00 [INFO] [TRAIN] epoch=2, iter=610/80000, loss=1.1651, lr=0.009931, batch_cost=1.3518, reader_cost=0.0001 | ETA 29:48:42 2021-02-22 18:17:14 [INFO] [TRAIN] epoch=2, iter=620/80000, loss=1.1692, lr=0.009930, batch_cost=1.3671, reader_cost=0.0001 | ETA 30:08:41 2021-02-22 18:17:27 [INFO] [TRAIN] epoch=2, iter=630/80000, loss=1.0616, lr=0.009929, batch_cost=1.3712, reader_cost=0.0001 | ETA 30:13:49 2021-02-22 18:17:41 [INFO] [TRAIN] epoch=2, iter=640/80000, loss=1.1775, lr=0.009928, batch_cost=1.3698, reader_cost=0.0001 | ETA 30:11:45 2021-02-22 18:17:55 [INFO] [TRAIN] epoch=2, iter=650/80000, loss=1.2243, lr=0.009927, batch_cost=1.3729, reader_cost=0.0001 | ETA 30:15:37 2021-02-22 18:18:08 [INFO] [TRAIN] epoch=2, iter=660/80000, loss=1.2157, lr=0.009926, batch_cost=1.3643, reader_cost=0.0001 | ETA 30:04:00 2021-02-22 18:18:22 [INFO] [TRAIN] epoch=2, iter=670/80000, loss=1.0234, lr=0.009925, batch_cost=1.3863, reader_cost=0.0001 | ETA 30:32:58 2021-02-22 18:18:36 [INFO] [TRAIN] epoch=2, iter=680/80000, loss=1.4829, lr=0.009924, batch_cost=1.3580, reader_cost=0.0001 | ETA 29:55:16 2021-02-22 18:18:49 [INFO] [TRAIN] epoch=2, iter=690/80000, loss=1.1679, lr=0.009922, batch_cost=1.3592, reader_cost=0.0001 | ETA 29:56:38 2021-02-22 18:19:03 [INFO] [TRAIN] epoch=2, iter=700/80000, loss=1.5097, lr=0.009921, batch_cost=1.3337, reader_cost=0.0001 | ETA 29:22:44 2021-02-22 18:19:16 [INFO] [TRAIN] epoch=2, iter=710/80000, loss=1.3196, lr=0.009920, batch_cost=1.3447, reader_cost=0.0001 | ETA 29:36:59 2021-02-22 18:19:30 [INFO] [TRAIN] epoch=2, iter=720/80000, loss=1.1114, lr=0.009919, batch_cost=1.3510, reader_cost=0.0001 | ETA 29:45:08 2021-02-22 18:19:43 [INFO] [TRAIN] epoch=2, iter=730/80000, loss=1.0422, lr=0.009918, batch_cost=1.3752, reader_cost=0.0001 | ETA 30:16:48 2021-02-22 18:19:57 [INFO] [TRAIN] epoch=2, iter=740/80000, loss=1.1247, lr=0.009917, batch_cost=1.3442, reader_cost=0.0001 | ETA 29:35:41 2021-02-22 18:20:12 [INFO] [TRAIN] epoch=3, iter=750/80000, loss=1.1036, lr=0.009916, batch_cost=1.4714, reader_cost=0.0646 | ETA 32:23:26 2021-02-22 18:20:25 [INFO] [TRAIN] epoch=3, iter=760/80000, loss=1.0821, lr=0.009915, batch_cost=1.3549, reader_cost=0.0001 | ETA 29:49:23 2021-02-22 18:20:39 [INFO] [TRAIN] epoch=3, iter=770/80000, loss=1.0141, lr=0.009913, batch_cost=1.3611, reader_cost=0.0001 | ETA 29:57:20 2021-02-22 18:20:52 [INFO] [TRAIN] epoch=3, iter=780/80000, loss=1.1150, lr=0.009912, batch_cost=1.3482, reader_cost=0.0001 | ETA 29:40:06 2021-02-22 18:21:06 [INFO] [TRAIN] epoch=3, iter=790/80000, loss=1.1318, lr=0.009911, batch_cost=1.3689, reader_cost=0.0001 | ETA 30:07:08 2021-02-22 18:21:20 [INFO] [TRAIN] epoch=3, iter=800/80000, loss=1.2380, lr=0.009910, batch_cost=1.3581, reader_cost=0.0001 | ETA 29:52:41 2021-02-22 18:21:33 [INFO] [TRAIN] epoch=3, iter=810/80000, loss=0.9976, lr=0.009909, batch_cost=1.3380, reader_cost=0.0001 | ETA 29:25:55 2021-02-22 18:21:47 [INFO] [TRAIN] epoch=3, iter=820/80000, loss=1.0926, lr=0.009908, batch_cost=1.3654, reader_cost=0.0001 | ETA 30:01:54 2021-02-22 18:22:00 [INFO] [TRAIN] epoch=3, iter=830/80000, loss=1.1289, lr=0.009907, batch_cost=1.3484, reader_cost=0.0001 | ETA 29:39:11 2021-02-22 18:22:14 [INFO] [TRAIN] epoch=3, iter=840/80000, loss=1.1470, lr=0.009906, batch_cost=1.3657, reader_cost=0.0001 | ETA 30:01:50 2021-02-22 18:22:27 [INFO] [TRAIN] epoch=3, iter=850/80000, loss=1.2278, lr=0.009904, batch_cost=1.3662, reader_cost=0.0001 | ETA 30:02:17 2021-02-22 18:22:41 [INFO] [TRAIN] epoch=3, iter=860/80000, loss=1.0531, lr=0.009903, batch_cost=1.3446, reader_cost=0.0001 | ETA 29:33:35 2021-02-22 18:22:55 [INFO] [TRAIN] epoch=3, iter=870/80000, loss=1.1074, lr=0.009902, batch_cost=1.3738, reader_cost=0.0001 | ETA 30:11:45 2021-02-22 18:23:08 [INFO] [TRAIN] epoch=3, iter=880/80000, loss=1.1363, lr=0.009901, batch_cost=1.3255, reader_cost=0.0001 | ETA 29:07:54 2021-02-22 18:23:22 [INFO] [TRAIN] epoch=3, iter=890/80000, loss=1.4125, lr=0.009900, batch_cost=1.3736, reader_cost=0.0001 | ETA 30:11:07 2021-02-22 18:23:35 [INFO] [TRAIN] epoch=3, iter=900/80000, loss=1.3377, lr=0.009899, batch_cost=1.3535, reader_cost=0.0001 | ETA 29:44:24 2021-02-22 18:23:48 [INFO] [TRAIN] epoch=3, iter=910/80000, loss=1.1660, lr=0.009898, batch_cost=1.3394, reader_cost=0.0001 | ETA 29:25:30 2021-02-22 18:24:02 [INFO] [TRAIN] epoch=3, iter=920/80000, loss=1.1072, lr=0.009897, batch_cost=1.3763, reader_cost=0.0001 | ETA 30:14:00 2021-02-22 18:24:16 [INFO] [TRAIN] epoch=3, iter=930/80000, loss=1.0989, lr=0.009895, batch_cost=1.3397, reader_cost=0.0001 | ETA 29:25:32 2021-02-22 18:24:29 [INFO] [TRAIN] epoch=3, iter=940/80000, loss=1.1964, lr=0.009894, batch_cost=1.3581, reader_cost=0.0001 | ETA 29:49:34 2021-02-22 18:24:43 [INFO] [TRAIN] epoch=3, iter=950/80000, loss=1.0517, lr=0.009893, batch_cost=1.3944, reader_cost=0.0001 | ETA 30:37:06 2021-02-22 18:24:57 [INFO] [TRAIN] epoch=3, iter=960/80000, loss=1.0368, lr=0.009892, batch_cost=1.3779, reader_cost=0.0001 | ETA 30:15:13 2021-02-22 18:25:10 [INFO] [TRAIN] epoch=3, iter=970/80000, loss=1.2580, lr=0.009891, batch_cost=1.3441, reader_cost=0.0001 | ETA 29:30:25 2021-02-22 18:25:24 [INFO] [TRAIN] epoch=3, iter=980/80000, loss=1.0288, lr=0.009890, batch_cost=1.3472, reader_cost=0.0001 | ETA 29:34:19 2021-02-22 18:25:37 [INFO] [TRAIN] epoch=3, iter=990/80000, loss=1.1048, lr=0.009889, batch_cost=1.3454, reader_cost=0.0001 | ETA 29:31:38 2021-02-22 18:25:51 [INFO] [TRAIN] epoch=3, iter=1000/80000, loss=1.0443, lr=0.009888, batch_cost=1.3645, reader_cost=0.0001 | ETA 29:56:38 2021-02-22 18:25:51 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:01 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 58s - batch_cost: 0.2315 - reader cost: 0.0992  3/125 [..............................] - ETA: 57s - batch_cost: 0.3095 - reader cost: 0.1167 4/125 [..............................] - ETA: 56s - batch_cost: 0.3456 - reader cost: 0.1095 5/125 [>.............................] - ETA: 55s - batch_cost: 0.3619 - reader cost: 0.0968 6/125 [>.............................] - ETA: 54s - batch_cost: 0.3734 - reader cost: 0.1059 7/125 [>.............................] - ETA: 53s - batch_cost: 0.3832 - reader cost: 0.1166 8/125 [>.............................] - ETA: 52s - batch_cost: 0.3849 - reader cost: 0.1206 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3906 - reader cost: 0.1278 10/125 [=>............................] - ETA: 51s - batch_cost: 0.3950 - reader cost: 0.1335 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3937 - reader cost: 0.1329 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3959 - reader cost: 0.1363 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3964 - reader cost: 0.1372 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3999 - reader cost: 0.1410 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.4015 - reader cost: 0.1431 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.4027 - reader cost: 0.1447 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.4048 - reader cost: 0.1473 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.4066 - reader cost: 0.1493 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.4059 - reader cost: 0.1490 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4067 - reader cost: 0.1502 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4075 - reader cost: 0.1512 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4087 - reader cost: 0.1527 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4083 - reader cost: 0.1525 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4095 - reader cost: 0.1540 25/125 [=====>........................] - ETA: 43s - batch_cost: 0.4104 - reader cost: 0.1552 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4120 - reader cost: 0.1570 27/125 [=====>........................] - ETA: 42s - batch_cost: 0.4124 - reader cost: 0.1577 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4129 - reader cost: 0.1581 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4140 - reader cost: 0.1592 30/125 [======>.......................] - ETA: 41s - batch_cost: 0.4152 - reader cost: 0.1605 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4149 - reader cost: 0.1601 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4134 - reader cost: 0.1588 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4125 - reader cost: 0.1576 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4121 - reader cost: 0.1574 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4113 - reader cost: 0.1564 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4107 - reader cost: 0.1559 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4104 - reader cost: 0.1554 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4109 - reader cost: 0.1560 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4106 - reader cost: 0.1559 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4103 - reader cost: 0.1547 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4118 - reader cost: 0.1550 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4123 - reader cost: 0.1553 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4126 - reader cost: 0.1555 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4121 - reader cost: 0.1545 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4133 - reader cost: 0.1559 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4137 - reader cost: 0.1564 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4140 - reader cost: 0.1568 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4145 - reader cost: 0.1575 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4141 - reader cost: 0.1570 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4144 - reader cost: 0.1574 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4156 - reader cost: 0.1588 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4150 - reader cost: 0.1582 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4154 - reader cost: 0.1588 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4149 - reader cost: 0.1584 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4143 - reader cost: 0.1578 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4145 - reader cost: 0.1581 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4154 - reader cost: 0.1590 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4149 - reader cost: 0.1584 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4144 - reader cost: 0.1580 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4150 - reader cost: 0.1587 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4152 - reader cost: 0.1590 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4157 - reader cost: 0.1594 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4155 - reader cost: 0.1592 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4157 - reader cost: 0.1592 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4161 - reader cost: 0.1595 66/125 [==============>...............] - ETA: 25s - batch_cost: 0.4162 - reader cost: 0.1597 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4168 - reader cost: 0.1603 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4168 - reader cost: 0.1604 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4173 - reader cost: 0.1609 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4175 - reader cost: 0.1611 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4180 - reader cost: 0.1617 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4175 - reader cost: 0.1612 73/125 [================>.............] - ETA: 22s - batch_cost: 0.4178 - reader cost: 0.1616 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4181 - reader cost: 0.1618 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4177 - reader cost: 0.1616 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4181 - reader cost: 0.1619 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4189 - reader cost: 0.1626 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4187 - reader cost: 0.1624 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4182 - reader cost: 0.1619 80/125 [==================>...........] - ETA: 19s - batch_cost: 0.4186 - reader cost: 0.1622 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4184 - reader cost: 0.1620 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4184 - reader cost: 0.1621 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4180 - reader cost: 0.1618 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4177 - reader cost: 0.1613 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4171 - reader cost: 0.1608 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4169 - reader cost: 0.1606 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4171 - reader cost: 0.1609 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4173 - reader cost: 0.1610 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4174 - reader cost: 0.1611 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4175 - reader cost: 0.1613 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4172 - reader cost: 0.1610 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4173 - reader cost: 0.1611 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4170 - reader cost: 0.1608 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4168 - reader cost: 0.1607 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4169 - reader cost: 0.1608 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4168 - reader cost: 0.1608 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4171 - reader cost: 0.1610 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4171 - reader cost: 0.1610 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4174 - reader cost: 0.1614 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4177 - reader cost: 0.1615 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4176 - reader cost: 0.1615 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4178 - reader cost: 0.1617  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4181 - reader cost: 0.1620 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4183 - reader cost: 0.1622 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4186 - reader cost: 0.1626 106/125 [========================>.....] - ETA: 8s - batch_cost: 0.4186 - reader cost: 0.1626 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4188 - reader cost: 0.1628 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4187 - reader cost: 0.1627 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4191 - reader cost: 0.1631 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4192 - reader cost: 0.1633 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4198 - reader cost: 0.1639 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4198 - reader cost: 0.1638 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4199 - reader cost: 0.1640 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4198 - reader cost: 0.1638 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4196 - reader cost: 0.1636 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4197 - reader cost: 0.1637 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4197 - reader cost: 0.1637 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4194 - reader cost: 0.1635 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4192 - reader cost: 0.1633 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4188 - reader cost: 0.1630 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4191 - reader cost: 0.1634 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4192 - reader cost: 0.1635 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4189 - reader cost: 0.1632 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4187 - reader cost: 0.1630 125/125 [==============================] - 53s 423ms/step - batch_cost: 0.4189 - reader cost: 0.1632 2021-02-22 18:26:44 [INFO] [EVAL] #Images=500 mIoU=0.5702 Acc=0.9275 Kappa=0.9059 2021-02-22 18:26:44 [INFO] [EVAL] Class IoU: [0.9584 0.7206 0.8728 0.2233 0.432 0.4959 0.5643 0.6613 0.8817 0.4365 0.8877 0.7225 0.4406 0.8809 0.3405 0.5124 0.0012 0.148 0.6524] 2021-02-22 18:26:44 [INFO] [EVAL] Class Acc: [0.9812 0.7917 0.9418 0.6692 0.6797 0.7613 0.7537 0.8494 0.9093 0.7568 0.9675 0.8549 0.6755 0.9004 0.6987 0.6596 0.0574 0.8565 0.6979] 2021-02-22 18:26:50 [INFO] [EVAL] The model with the best validation mIoU (0.5702) was saved at iter 1000. 2021-02-22 18:27:04 [INFO] [TRAIN] epoch=3, iter=1010/80000, loss=1.2825, lr=0.009886, batch_cost=1.3737, reader_cost=0.0001 | ETA 30:08:24 2021-02-22 18:27:17 [INFO] [TRAIN] epoch=3, iter=1020/80000, loss=0.9508, lr=0.009885, batch_cost=1.3556, reader_cost=0.0001 | ETA 29:44:24 2021-02-22 18:27:31 [INFO] [TRAIN] epoch=3, iter=1030/80000, loss=1.2773, lr=0.009884, batch_cost=1.3714, reader_cost=0.0001 | ETA 30:05:02 2021-02-22 18:27:45 [INFO] [TRAIN] epoch=3, iter=1040/80000, loss=1.2054, lr=0.009883, batch_cost=1.3721, reader_cost=0.0001 | ETA 30:05:37 2021-02-22 18:27:58 [INFO] [TRAIN] epoch=3, iter=1050/80000, loss=1.1184, lr=0.009882, batch_cost=1.3668, reader_cost=0.0001 | ETA 29:58:30 2021-02-22 18:28:12 [INFO] [TRAIN] epoch=3, iter=1060/80000, loss=1.1827, lr=0.009881, batch_cost=1.3621, reader_cost=0.0001 | ETA 29:52:01 2021-02-22 18:28:25 [INFO] [TRAIN] epoch=3, iter=1070/80000, loss=1.1502, lr=0.009880, batch_cost=1.3518, reader_cost=0.0001 | ETA 29:38:17 2021-02-22 18:28:39 [INFO] [TRAIN] epoch=3, iter=1080/80000, loss=1.1012, lr=0.009879, batch_cost=1.3379, reader_cost=0.0001 | ETA 29:19:50 2021-02-22 18:28:52 [INFO] [TRAIN] epoch=3, iter=1090/80000, loss=0.9907, lr=0.009877, batch_cost=1.3552, reader_cost=0.0001 | ETA 29:42:15 2021-02-22 18:29:06 [INFO] [TRAIN] epoch=3, iter=1100/80000, loss=1.1663, lr=0.009876, batch_cost=1.3720, reader_cost=0.0001 | ETA 30:04:10 2021-02-22 18:29:20 [INFO] [TRAIN] epoch=3, iter=1110/80000, loss=1.0213, lr=0.009875, batch_cost=1.3642, reader_cost=0.0001 | ETA 29:53:45 2021-02-22 18:29:34 [INFO] [TRAIN] epoch=4, iter=1120/80000, loss=1.1411, lr=0.009874, batch_cost=1.4512, reader_cost=0.0848 | ETA 31:47:49 2021-02-22 18:29:48 [INFO] [TRAIN] epoch=4, iter=1130/80000, loss=0.9848, lr=0.009873, batch_cost=1.3710, reader_cost=0.0001 | ETA 30:02:12 2021-02-22 18:30:01 [INFO] [TRAIN] epoch=4, iter=1140/80000, loss=1.0789, lr=0.009872, batch_cost=1.3523, reader_cost=0.0001 | ETA 29:37:22 2021-02-22 18:30:15 [INFO] [TRAIN] epoch=4, iter=1150/80000, loss=0.9662, lr=0.009871, batch_cost=1.3741, reader_cost=0.0001 | ETA 30:05:51 2021-02-22 18:30:29 [INFO] [TRAIN] epoch=4, iter=1160/80000, loss=1.1802, lr=0.009870, batch_cost=1.3575, reader_cost=0.0001 | ETA 29:43:46 2021-02-22 18:30:42 [INFO] [TRAIN] epoch=4, iter=1170/80000, loss=1.1675, lr=0.009868, batch_cost=1.3581, reader_cost=0.0001 | ETA 29:44:18 2021-02-22 18:30:56 [INFO] [TRAIN] epoch=4, iter=1180/80000, loss=1.1208, lr=0.009867, batch_cost=1.3676, reader_cost=0.0001 | ETA 29:56:34 2021-02-22 18:31:10 [INFO] [TRAIN] epoch=4, iter=1190/80000, loss=1.3695, lr=0.009866, batch_cost=1.3508, reader_cost=0.0001 | ETA 29:34:13 2021-02-22 18:31:23 [INFO] [TRAIN] epoch=4, iter=1200/80000, loss=0.9948, lr=0.009865, batch_cost=1.3723, reader_cost=0.0001 | ETA 30:02:17 2021-02-22 18:31:37 [INFO] [TRAIN] epoch=4, iter=1210/80000, loss=1.0863, lr=0.009864, batch_cost=1.3534, reader_cost=0.0001 | ETA 29:37:11 2021-02-22 18:31:50 [INFO] [TRAIN] epoch=4, iter=1220/80000, loss=1.3622, lr=0.009863, batch_cost=1.3374, reader_cost=0.0001 | ETA 29:15:59 2021-02-22 18:32:04 [INFO] [TRAIN] epoch=4, iter=1230/80000, loss=1.0728, lr=0.009862, batch_cost=1.3555, reader_cost=0.0001 | ETA 29:39:32 2021-02-22 18:32:17 [INFO] [TRAIN] epoch=4, iter=1240/80000, loss=1.1483, lr=0.009861, batch_cost=1.3593, reader_cost=0.0001 | ETA 29:44:22 2021-02-22 18:32:31 [INFO] [TRAIN] epoch=4, iter=1250/80000, loss=1.2942, lr=0.009859, batch_cost=1.3689, reader_cost=0.0001 | ETA 29:56:41 2021-02-22 18:32:45 [INFO] [TRAIN] epoch=4, iter=1260/80000, loss=1.1075, lr=0.009858, batch_cost=1.3580, reader_cost=0.0001 | ETA 29:42:05 2021-02-22 18:32:58 [INFO] [TRAIN] epoch=4, iter=1270/80000, loss=1.1293, lr=0.009857, batch_cost=1.3360, reader_cost=0.0001 | ETA 29:13:07 2021-02-22 18:33:11 [INFO] [TRAIN] epoch=4, iter=1280/80000, loss=1.0799, lr=0.009856, batch_cost=1.3366, reader_cost=0.0001 | ETA 29:13:38 2021-02-22 18:33:25 [INFO] [TRAIN] epoch=4, iter=1290/80000, loss=0.9931, lr=0.009855, batch_cost=1.3907, reader_cost=0.0001 | ETA 30:24:24 2021-02-22 18:33:39 [INFO] [TRAIN] epoch=4, iter=1300/80000, loss=1.1764, lr=0.009854, batch_cost=1.3631, reader_cost=0.0001 | ETA 29:47:58 2021-02-22 18:33:52 [INFO] [TRAIN] epoch=4, iter=1310/80000, loss=0.9430, lr=0.009853, batch_cost=1.3428, reader_cost=0.0001 | ETA 29:21:05 2021-02-22 18:34:06 [INFO] [TRAIN] epoch=4, iter=1320/80000, loss=0.9894, lr=0.009851, batch_cost=1.3365, reader_cost=0.0001 | ETA 29:12:36 2021-02-22 18:34:19 [INFO] [TRAIN] epoch=4, iter=1330/80000, loss=1.1410, lr=0.009850, batch_cost=1.3620, reader_cost=0.0001 | ETA 29:45:48 2021-02-22 18:34:33 [INFO] [TRAIN] epoch=4, iter=1340/80000, loss=1.0298, lr=0.009849, batch_cost=1.3893, reader_cost=0.0001 | ETA 30:21:25 2021-02-22 18:34:47 [INFO] [TRAIN] epoch=4, iter=1350/80000, loss=1.0402, lr=0.009848, batch_cost=1.3464, reader_cost=0.0001 | ETA 29:24:56 2021-02-22 18:35:00 [INFO] [TRAIN] epoch=4, iter=1360/80000, loss=1.1408, lr=0.009847, batch_cost=1.3433, reader_cost=0.0001 | ETA 29:20:37 2021-02-22 18:35:13 [INFO] [TRAIN] epoch=4, iter=1370/80000, loss=1.0789, lr=0.009846, batch_cost=1.3392, reader_cost=0.0001 | ETA 29:15:04 2021-02-22 18:35:27 [INFO] [TRAIN] epoch=4, iter=1380/80000, loss=0.9700, lr=0.009845, batch_cost=1.3632, reader_cost=0.0001 | ETA 29:46:14 2021-02-22 18:35:41 [INFO] [TRAIN] epoch=4, iter=1390/80000, loss=1.1205, lr=0.009844, batch_cost=1.3564, reader_cost=0.0001 | ETA 29:37:08 2021-02-22 18:35:54 [INFO] [TRAIN] epoch=4, iter=1400/80000, loss=1.1342, lr=0.009842, batch_cost=1.3793, reader_cost=0.0001 | ETA 30:06:52 2021-02-22 18:36:08 [INFO] [TRAIN] epoch=4, iter=1410/80000, loss=1.0431, lr=0.009841, batch_cost=1.3742, reader_cost=0.0001 | ETA 30:00:01 2021-02-22 18:36:22 [INFO] [TRAIN] epoch=4, iter=1420/80000, loss=1.0673, lr=0.009840, batch_cost=1.3869, reader_cost=0.0001 | ETA 30:16:20 2021-02-22 18:36:36 [INFO] [TRAIN] epoch=4, iter=1430/80000, loss=1.0708, lr=0.009839, batch_cost=1.3514, reader_cost=0.0001 | ETA 29:29:38 2021-02-22 18:36:49 [INFO] [TRAIN] epoch=4, iter=1440/80000, loss=0.9169, lr=0.009838, batch_cost=1.3458, reader_cost=0.0001 | ETA 29:22:05 2021-02-22 18:37:03 [INFO] [TRAIN] epoch=4, iter=1450/80000, loss=1.0452, lr=0.009837, batch_cost=1.3601, reader_cost=0.0001 | ETA 29:40:37 2021-02-22 18:37:16 [INFO] [TRAIN] epoch=4, iter=1460/80000, loss=1.0899, lr=0.009836, batch_cost=1.3506, reader_cost=0.0001 | ETA 29:27:55 2021-02-22 18:37:30 [INFO] [TRAIN] epoch=4, iter=1470/80000, loss=1.0431, lr=0.009835, batch_cost=1.3538, reader_cost=0.0001 | ETA 29:31:55 2021-02-22 18:37:43 [INFO] [TRAIN] epoch=4, iter=1480/80000, loss=0.9973, lr=0.009833, batch_cost=1.3748, reader_cost=0.0001 | ETA 29:59:09 2021-02-22 18:37:58 [INFO] [TRAIN] epoch=5, iter=1490/80000, loss=1.0104, lr=0.009832, batch_cost=1.4308, reader_cost=0.0911 | ETA 31:12:14 2021-02-22 18:38:12 [INFO] [TRAIN] epoch=5, iter=1500/80000, loss=1.0531, lr=0.009831, batch_cost=1.3818, reader_cost=0.0002 | ETA 30:07:49 2021-02-22 18:38:25 [INFO] [TRAIN] epoch=5, iter=1510/80000, loss=1.1150, lr=0.009830, batch_cost=1.3706, reader_cost=0.0001 | ETA 29:52:58 2021-02-22 18:38:39 [INFO] [TRAIN] epoch=5, iter=1520/80000, loss=1.1906, lr=0.009829, batch_cost=1.3417, reader_cost=0.0001 | ETA 29:14:55 2021-02-22 18:38:52 [INFO] [TRAIN] epoch=5, iter=1530/80000, loss=1.0360, lr=0.009828, batch_cost=1.3351, reader_cost=0.0001 | ETA 29:06:01 2021-02-22 18:39:06 [INFO] [TRAIN] epoch=5, iter=1540/80000, loss=1.0250, lr=0.009827, batch_cost=1.3481, reader_cost=0.0001 | ETA 29:22:51 2021-02-22 18:39:19 [INFO] [TRAIN] epoch=5, iter=1550/80000, loss=1.0389, lr=0.009826, batch_cost=1.3679, reader_cost=0.0001 | ETA 29:48:28 2021-02-22 18:39:33 [INFO] [TRAIN] epoch=5, iter=1560/80000, loss=0.9954, lr=0.009824, batch_cost=1.3356, reader_cost=0.0001 | ETA 29:06:03 2021-02-22 18:39:46 [INFO] [TRAIN] epoch=5, iter=1570/80000, loss=1.1517, lr=0.009823, batch_cost=1.3452, reader_cost=0.0001 | ETA 29:18:22 2021-02-22 18:39:59 [INFO] [TRAIN] epoch=5, iter=1580/80000, loss=1.1112, lr=0.009822, batch_cost=1.3424, reader_cost=0.0001 | ETA 29:14:31 2021-02-22 18:40:13 [INFO] [TRAIN] epoch=5, iter=1590/80000, loss=0.9408, lr=0.009821, batch_cost=1.3538, reader_cost=0.0001 | ETA 29:29:11 2021-02-22 18:40:27 [INFO] [TRAIN] epoch=5, iter=1600/80000, loss=1.1437, lr=0.009820, batch_cost=1.3574, reader_cost=0.0001 | ETA 29:33:41 2021-02-22 18:40:40 [INFO] [TRAIN] epoch=5, iter=1610/80000, loss=1.0280, lr=0.009819, batch_cost=1.3670, reader_cost=0.0001 | ETA 29:46:02 2021-02-22 18:40:54 [INFO] [TRAIN] epoch=5, iter=1620/80000, loss=1.0581, lr=0.009818, batch_cost=1.3733, reader_cost=0.0001 | ETA 29:54:00 2021-02-22 18:41:08 [INFO] [TRAIN] epoch=5, iter=1630/80000, loss=0.8797, lr=0.009817, batch_cost=1.3731, reader_cost=0.0001 | ETA 29:53:26 2021-02-22 18:41:21 [INFO] [TRAIN] epoch=5, iter=1640/80000, loss=1.1254, lr=0.009815, batch_cost=1.3490, reader_cost=0.0001 | ETA 29:21:46 2021-02-22 18:41:35 [INFO] [TRAIN] epoch=5, iter=1650/80000, loss=1.3079, lr=0.009814, batch_cost=1.3639, reader_cost=0.0001 | ETA 29:41:05 2021-02-22 18:41:48 [INFO] [TRAIN] epoch=5, iter=1660/80000, loss=1.0012, lr=0.009813, batch_cost=1.3687, reader_cost=0.0001 | ETA 29:47:03 2021-02-22 18:42:02 [INFO] [TRAIN] epoch=5, iter=1670/80000, loss=1.1274, lr=0.009812, batch_cost=1.3528, reader_cost=0.0001 | ETA 29:26:04 2021-02-22 18:42:16 [INFO] [TRAIN] epoch=5, iter=1680/80000, loss=1.0186, lr=0.009811, batch_cost=1.3729, reader_cost=0.0001 | ETA 29:52:06 2021-02-22 18:42:29 [INFO] [TRAIN] epoch=5, iter=1690/80000, loss=0.9624, lr=0.009810, batch_cost=1.3415, reader_cost=0.0001 | ETA 29:10:54 2021-02-22 18:42:43 [INFO] [TRAIN] epoch=5, iter=1700/80000, loss=1.1347, lr=0.009809, batch_cost=1.3385, reader_cost=0.0001 | ETA 29:06:44 2021-02-22 18:42:56 [INFO] [TRAIN] epoch=5, iter=1710/80000, loss=0.9431, lr=0.009808, batch_cost=1.3656, reader_cost=0.0001 | ETA 29:41:53 2021-02-22 18:43:10 [INFO] [TRAIN] epoch=5, iter=1720/80000, loss=1.1083, lr=0.009806, batch_cost=1.3621, reader_cost=0.0001 | ETA 29:37:08 2021-02-22 18:43:23 [INFO] [TRAIN] epoch=5, iter=1730/80000, loss=1.1057, lr=0.009805, batch_cost=1.3515, reader_cost=0.0001 | ETA 29:23:03 2021-02-22 18:43:37 [INFO] [TRAIN] epoch=5, iter=1740/80000, loss=1.0661, lr=0.009804, batch_cost=1.3461, reader_cost=0.0001 | ETA 29:15:44 2021-02-22 18:43:50 [INFO] [TRAIN] epoch=5, iter=1750/80000, loss=1.0320, lr=0.009803, batch_cost=1.3484, reader_cost=0.0002 | ETA 29:18:31 2021-02-22 18:44:04 [INFO] [TRAIN] epoch=5, iter=1760/80000, loss=1.0344, lr=0.009802, batch_cost=1.3562, reader_cost=0.0001 | ETA 29:28:28 2021-02-22 18:44:17 [INFO] [TRAIN] epoch=5, iter=1770/80000, loss=1.0461, lr=0.009801, batch_cost=1.3400, reader_cost=0.0001 | ETA 29:07:04 2021-02-22 18:44:31 [INFO] [TRAIN] epoch=5, iter=1780/80000, loss=0.9900, lr=0.009800, batch_cost=1.3633, reader_cost=0.0001 | ETA 29:37:18 2021-02-22 18:44:44 [INFO] [TRAIN] epoch=5, iter=1790/80000, loss=0.9563, lr=0.009799, batch_cost=1.3588, reader_cost=0.0001 | ETA 29:31:15 2021-02-22 18:44:58 [INFO] [TRAIN] epoch=5, iter=1800/80000, loss=0.9888, lr=0.009797, batch_cost=1.3790, reader_cost=0.0001 | ETA 29:57:18 2021-02-22 18:45:12 [INFO] [TRAIN] epoch=5, iter=1810/80000, loss=0.9944, lr=0.009796, batch_cost=1.3630, reader_cost=0.0001 | ETA 29:36:11 2021-02-22 18:45:26 [INFO] [TRAIN] epoch=5, iter=1820/80000, loss=1.2485, lr=0.009795, batch_cost=1.3762, reader_cost=0.0001 | ETA 29:53:13 2021-02-22 18:45:39 [INFO] [TRAIN] epoch=5, iter=1830/80000, loss=1.0344, lr=0.009794, batch_cost=1.3694, reader_cost=0.0001 | ETA 29:44:05 2021-02-22 18:45:53 [INFO] [TRAIN] epoch=5, iter=1840/80000, loss=1.0861, lr=0.009793, batch_cost=1.3690, reader_cost=0.0001 | ETA 29:43:19 2021-02-22 18:46:07 [INFO] [TRAIN] epoch=5, iter=1850/80000, loss=1.1340, lr=0.009792, batch_cost=1.3613, reader_cost=0.0001 | ETA 29:33:05 2021-02-22 18:46:20 [INFO] [TRAIN] epoch=5, iter=1860/80000, loss=1.1133, lr=0.009791, batch_cost=1.3489, reader_cost=0.0001 | ETA 29:16:39 2021-02-22 18:46:35 [INFO] [TRAIN] epoch=6, iter=1870/80000, loss=1.0739, lr=0.009789, batch_cost=1.4551, reader_cost=0.0707 | ETA 31:34:49 2021-02-22 18:46:48 [INFO] [TRAIN] epoch=6, iter=1880/80000, loss=1.1168, lr=0.009788, batch_cost=1.3493, reader_cost=0.0001 | ETA 29:16:47 2021-02-22 18:47:02 [INFO] [TRAIN] epoch=6, iter=1890/80000, loss=1.0616, lr=0.009787, batch_cost=1.3380, reader_cost=0.0001 | ETA 29:01:49 2021-02-22 18:47:15 [INFO] [TRAIN] epoch=6, iter=1900/80000, loss=0.8986, lr=0.009786, batch_cost=1.3697, reader_cost=0.0001 | ETA 29:42:55 2021-02-22 18:47:29 [INFO] [TRAIN] epoch=6, iter=1910/80000, loss=1.1421, lr=0.009785, batch_cost=1.3441, reader_cost=0.0001 | ETA 29:09:24 2021-02-22 18:47:43 [INFO] [TRAIN] epoch=6, iter=1920/80000, loss=0.9175, lr=0.009784, batch_cost=1.3895, reader_cost=0.0001 | ETA 30:08:11 2021-02-22 18:47:56 [INFO] [TRAIN] epoch=6, iter=1930/80000, loss=0.9938, lr=0.009783, batch_cost=1.3540, reader_cost=0.0001 | ETA 29:21:46 2021-02-22 18:48:10 [INFO] [TRAIN] epoch=6, iter=1940/80000, loss=0.9999, lr=0.009782, batch_cost=1.3447, reader_cost=0.0001 | ETA 29:09:28 2021-02-22 18:48:23 [INFO] [TRAIN] epoch=6, iter=1950/80000, loss=1.0375, lr=0.009780, batch_cost=1.3324, reader_cost=0.0001 | ETA 28:53:14 2021-02-22 18:48:37 [INFO] [TRAIN] epoch=6, iter=1960/80000, loss=1.0506, lr=0.009779, batch_cost=1.3633, reader_cost=0.0001 | ETA 29:33:13 2021-02-22 18:48:50 [INFO] [TRAIN] epoch=6, iter=1970/80000, loss=1.0865, lr=0.009778, batch_cost=1.3598, reader_cost=0.0001 | ETA 29:28:23 2021-02-22 18:49:04 [INFO] [TRAIN] epoch=6, iter=1980/80000, loss=1.0583, lr=0.009777, batch_cost=1.3721, reader_cost=0.0001 | ETA 29:44:14 2021-02-22 18:49:18 [INFO] [TRAIN] epoch=6, iter=1990/80000, loss=1.0741, lr=0.009776, batch_cost=1.3887, reader_cost=0.0001 | ETA 30:05:35 2021-02-22 18:49:31 [INFO] [TRAIN] epoch=6, iter=2000/80000, loss=1.0110, lr=0.009775, batch_cost=1.3673, reader_cost=0.0001 | ETA 29:37:26 2021-02-22 18:49:31 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:10 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:01 - batch_cost: 0.2204 - reader cost: 0.0939  3/125 [..............................] - ETA: 58s - batch_cost: 0.2913 - reader cost: 0.1018  4/125 [..............................] - ETA: 56s - batch_cost: 0.3262 - reader cost: 0.0969 5/125 [>.............................] - ETA: 55s - batch_cost: 0.3459 - reader cost: 0.0957 6/125 [>.............................] - ETA: 54s - batch_cost: 0.3605 - reader cost: 0.0990 7/125 [>.............................] - ETA: 53s - batch_cost: 0.3722 - reader cost: 0.1117 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3711 - reader cost: 0.1112 9/125 [=>............................] - ETA: 50s - batch_cost: 0.3716 - reader cost: 0.1128 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3792 - reader cost: 0.1146 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3851 - reader cost: 0.1216 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3908 - reader cost: 0.1281 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3887 - reader cost: 0.1267 14/125 [==>...........................] - ETA: 47s - batch_cost: 0.3898 - reader cost: 0.1285 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3897 - reader cost: 0.1291 16/125 [==>...........................] - ETA: 46s - batch_cost: 0.3933 - reader cost: 0.1333 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3975 - reader cost: 0.1381 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.3994 - reader cost: 0.1404 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3978 - reader cost: 0.1393 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3993 - reader cost: 0.1411 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4006 - reader cost: 0.1396 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4026 - reader cost: 0.1369 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4026 - reader cost: 0.1349 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4036 - reader cost: 0.1329 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4024 - reader cost: 0.1316 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4040 - reader cost: 0.1318 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4052 - reader cost: 0.1323 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4071 - reader cost: 0.1350 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4082 - reader cost: 0.1363 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4109 - reader cost: 0.1397 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4127 - reader cost: 0.1422 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4119 - reader cost: 0.1419 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4125 - reader cost: 0.1431 34/125 [=======>......................] - ETA: 39s - batch_cost: 0.4127 - reader cost: 0.1429 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4139 - reader cost: 0.1441 36/125 [=======>......................] - ETA: 38s - batch_cost: 0.4147 - reader cost: 0.1446 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4151 - reader cost: 0.1455 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4159 - reader cost: 0.1468 39/125 [========>.....................] - ETA: 37s - batch_cost: 0.4161 - reader cost: 0.1474 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4155 - reader cost: 0.1473 41/125 [========>.....................] - ETA: 36s - batch_cost: 0.4159 - reader cost: 0.1481 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4152 - reader cost: 0.1477 43/125 [=========>....................] - ETA: 35s - batch_cost: 0.4164 - reader cost: 0.1492 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4165 - reader cost: 0.1497 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4163 - reader cost: 0.1498 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4172 - reader cost: 0.1511 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4170 - reader cost: 0.1505 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4164 - reader cost: 0.1503 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4171 - reader cost: 0.1513 50/125 [===========>..................] - ETA: 32s - batch_cost: 0.4174 - reader cost: 0.1518 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4166 - reader cost: 0.1512 52/125 [===========>..................] - ETA: 31s - batch_cost: 0.4175 - reader cost: 0.1521 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4178 - reader cost: 0.1526 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4178 - reader cost: 0.1529 55/125 [============>.................] - ETA: 30s - batch_cost: 0.4186 - reader cost: 0.1537 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4185 - reader cost: 0.1538 57/125 [============>.................] - ETA: 29s - batch_cost: 0.4177 - reader cost: 0.1532 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4183 - reader cost: 0.1540 59/125 [=============>................] - ETA: 28s - batch_cost: 0.4185 - reader cost: 0.1543 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4176 - reader cost: 0.1538 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4184 - reader cost: 0.1547 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4179 - reader cost: 0.1545 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4172 - reader cost: 0.1539 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4172 - reader cost: 0.1538 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4176 - reader cost: 0.1544 66/125 [==============>...............] - ETA: 25s - batch_cost: 0.4169 - reader cost: 0.1538 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4177 - reader cost: 0.1548 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4180 - reader cost: 0.1553 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4183 - reader cost: 0.1557 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4189 - reader cost: 0.1565 71/125 [================>.............] - ETA: 23s - batch_cost: 0.4184 - reader cost: 0.1561 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4185 - reader cost: 0.1563 73/125 [================>.............] - ETA: 22s - batch_cost: 0.4192 - reader cost: 0.1571 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4195 - reader cost: 0.1575 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4199 - reader cost: 0.1581 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4204 - reader cost: 0.1586 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4207 - reader cost: 0.1589 78/125 [=================>............] - ETA: 20s - batch_cost: 0.4210 - reader cost: 0.1594 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4208 - reader cost: 0.1593 80/125 [==================>...........] - ETA: 19s - batch_cost: 0.4204 - reader cost: 0.1591 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4208 - reader cost: 0.1595 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4216 - reader cost: 0.1603 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4217 - reader cost: 0.1606 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4213 - reader cost: 0.1603 85/125 [===================>..........] - ETA: 17s - batch_cost: 0.4212 - reader cost: 0.1602 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4214 - reader cost: 0.1606 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4216 - reader cost: 0.1608 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4217 - reader cost: 0.1608 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4217 - reader cost: 0.1609 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4218 - reader cost: 0.1611 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4228 - reader cost: 0.1621 92/125 [=====================>........] - ETA: 14s - batch_cost: 0.4224 - reader cost: 0.1618 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4224 - reader cost: 0.1619 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4227 - reader cost: 0.1622 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4228 - reader cost: 0.1624 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4229 - reader cost: 0.1625 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4225 - reader cost: 0.1622 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4223 - reader cost: 0.1621 99/125 [======================>.......] - ETA: 11s - batch_cost: 0.4219 - reader cost: 0.1618 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4223 - reader cost: 0.1622 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4227 - reader cost: 0.1625 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4223 - reader cost: 0.1621  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4225 - reader cost: 0.1624 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4228 - reader cost: 0.1627 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4228 - reader cost: 0.1629 106/125 [========================>.....] - ETA: 8s - batch_cost: 0.4228 - reader cost: 0.1628 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4232 - reader cost: 0.1632 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4232 - reader cost: 0.1631 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4233 - reader cost: 0.1634 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4233 - reader cost: 0.1635 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4232 - reader cost: 0.1634 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4239 - reader cost: 0.1641 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4241 - reader cost: 0.1643 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4245 - reader cost: 0.1648 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4249 - reader cost: 0.1652 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4246 - reader cost: 0.1650 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4243 - reader cost: 0.1647 118/125 [===========================>..] - ETA: 3s - batch_cost: 0.4246 - reader cost: 0.1649 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4247 - reader cost: 0.1650 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4246 - reader cost: 0.1650 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4249 - reader cost: 0.1653 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4247 - reader cost: 0.1651 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4248 - reader cost: 0.1652 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4245 - reader cost: 0.1649 125/125 [==============================] - 54s 429ms/step - batch_cost: 0.4247 - reader cost: 0.1652 2021-02-22 18:50:25 [INFO] [EVAL] #Images=500 mIoU=0.5991 Acc=0.9314 Kappa=0.9105 2021-02-22 18:50:25 [INFO] [EVAL] Class IoU: [0.9642 0.7289 0.8727 0.2582 0.301 0.3524 0.5219 0.597 0.8966 0.4999 0.9134 0.7457 0.5053 0.8879 0.4909 0.2065 0.4774 0.4645 0.6977] 2021-02-22 18:50:25 [INFO] [EVAL] Class Acc: [0.98 0.8803 0.8941 0.6307 0.7977 0.8639 0.8663 0.9243 0.931 0.8481 0.9845 0.8189 0.5998 0.9106 0.6224 0.8737 0.8786 0.5714 0.8463] 2021-02-22 18:50:31 [INFO] [EVAL] The model with the best validation mIoU (0.5991) was saved at iter 2000. 2021-02-22 18:50:44 [INFO] [TRAIN] epoch=6, iter=2010/80000, loss=0.9454, lr=0.009774, batch_cost=1.3175, reader_cost=0.0001 | ETA 28:32:28 2021-02-22 18:50:58 [INFO] [TRAIN] epoch=6, iter=2020/80000, loss=1.0813, lr=0.009773, batch_cost=1.3737, reader_cost=0.0001 | ETA 29:45:23 2021-02-22 18:51:12 [INFO] [TRAIN] epoch=6, iter=2030/80000, loss=1.0682, lr=0.009771, batch_cost=1.3659, reader_cost=0.0001 | ETA 29:34:58 2021-02-22 18:51:25 [INFO] [TRAIN] epoch=6, iter=2040/80000, loss=1.1080, lr=0.009770, batch_cost=1.3633, reader_cost=0.0001 | ETA 29:31:23 2021-02-22 18:51:39 [INFO] [TRAIN] epoch=6, iter=2050/80000, loss=1.0706, lr=0.009769, batch_cost=1.3632, reader_cost=0.0001 | ETA 29:31:03 2021-02-22 18:51:53 [INFO] [TRAIN] epoch=6, iter=2060/80000, loss=1.1258, lr=0.009768, batch_cost=1.3513, reader_cost=0.0001 | ETA 29:15:20 2021-02-22 18:52:06 [INFO] [TRAIN] epoch=6, iter=2070/80000, loss=1.1136, lr=0.009767, batch_cost=1.3567, reader_cost=0.0001 | ETA 29:22:06 2021-02-22 18:52:20 [INFO] [TRAIN] epoch=6, iter=2080/80000, loss=1.0819, lr=0.009766, batch_cost=1.3517, reader_cost=0.0001 | ETA 29:15:22 2021-02-22 18:52:33 [INFO] [TRAIN] epoch=6, iter=2090/80000, loss=1.1625, lr=0.009765, batch_cost=1.3393, reader_cost=0.0001 | ETA 28:59:05 2021-02-22 18:52:46 [INFO] [TRAIN] epoch=6, iter=2100/80000, loss=1.1651, lr=0.009764, batch_cost=1.3428, reader_cost=0.0001 | ETA 29:03:22 2021-02-22 18:53:00 [INFO] [TRAIN] epoch=6, iter=2110/80000, loss=0.9753, lr=0.009762, batch_cost=1.3529, reader_cost=0.0001 | ETA 29:16:15 2021-02-22 18:53:13 [INFO] [TRAIN] epoch=6, iter=2120/80000, loss=1.0482, lr=0.009761, batch_cost=1.3477, reader_cost=0.0001 | ETA 29:09:20 2021-02-22 18:53:27 [INFO] [TRAIN] epoch=6, iter=2130/80000, loss=1.0244, lr=0.009760, batch_cost=1.3516, reader_cost=0.0001 | ETA 29:14:07 2021-02-22 18:53:41 [INFO] [TRAIN] epoch=6, iter=2140/80000, loss=1.1061, lr=0.009759, batch_cost=1.3782, reader_cost=0.0001 | ETA 29:48:26 2021-02-22 18:53:55 [INFO] [TRAIN] epoch=6, iter=2150/80000, loss=1.1135, lr=0.009758, batch_cost=1.3898, reader_cost=0.0001 | ETA 30:03:12 2021-02-22 18:54:08 [INFO] [TRAIN] epoch=6, iter=2160/80000, loss=1.0010, lr=0.009757, batch_cost=1.3465, reader_cost=0.0001 | ETA 29:06:52 2021-02-22 18:54:22 [INFO] [TRAIN] epoch=6, iter=2170/80000, loss=0.9633, lr=0.009756, batch_cost=1.3939, reader_cost=0.0001 | ETA 30:08:06 2021-02-22 18:54:36 [INFO] [TRAIN] epoch=6, iter=2180/80000, loss=0.9485, lr=0.009755, batch_cost=1.3486, reader_cost=0.0001 | ETA 29:09:08 2021-02-22 18:54:49 [INFO] [TRAIN] epoch=6, iter=2190/80000, loss=0.9823, lr=0.009753, batch_cost=1.3917, reader_cost=0.0001 | ETA 30:04:46 2021-02-22 18:55:03 [INFO] [TRAIN] epoch=6, iter=2200/80000, loss=0.9940, lr=0.009752, batch_cost=1.3632, reader_cost=0.0001 | ETA 29:27:38 2021-02-22 18:55:16 [INFO] [TRAIN] epoch=6, iter=2210/80000, loss=1.1341, lr=0.009751, batch_cost=1.3422, reader_cost=0.0001 | ETA 29:00:11 2021-02-22 18:55:30 [INFO] [TRAIN] epoch=6, iter=2220/80000, loss=1.0689, lr=0.009750, batch_cost=1.3705, reader_cost=0.0001 | ETA 29:36:34 2021-02-22 18:55:44 [INFO] [TRAIN] epoch=6, iter=2230/80000, loss=1.0866, lr=0.009749, batch_cost=1.3558, reader_cost=0.0001 | ETA 29:17:18 2021-02-22 18:55:59 [INFO] [TRAIN] epoch=7, iter=2240/80000, loss=1.0038, lr=0.009748, batch_cost=1.4899, reader_cost=0.0918 | ETA 32:10:57 2021-02-22 18:56:12 [INFO] [TRAIN] epoch=7, iter=2250/80000, loss=1.1327, lr=0.009747, batch_cost=1.3574, reader_cost=0.0001 | ETA 29:18:57 2021-02-22 18:56:26 [INFO] [TRAIN] epoch=7, iter=2260/80000, loss=0.9996, lr=0.009745, batch_cost=1.3589, reader_cost=0.0001 | ETA 29:20:42 2021-02-22 18:56:39 [INFO] [TRAIN] epoch=7, iter=2270/80000, loss=1.2860, lr=0.009744, batch_cost=1.3532, reader_cost=0.0001 | ETA 29:13:05 2021-02-22 18:56:53 [INFO] [TRAIN] epoch=7, iter=2280/80000, loss=0.9576, lr=0.009743, batch_cost=1.3608, reader_cost=0.0001 | ETA 29:22:41 2021-02-22 18:57:07 [INFO] [TRAIN] epoch=7, iter=2290/80000, loss=1.1029, lr=0.009742, batch_cost=1.3660, reader_cost=0.0001 | ETA 29:29:08 2021-02-22 18:57:20 [INFO] [TRAIN] epoch=7, iter=2300/80000, loss=1.0389, lr=0.009741, batch_cost=1.3350, reader_cost=0.0001 | ETA 28:48:45 2021-02-22 18:57:34 [INFO] [TRAIN] epoch=7, iter=2310/80000, loss=0.9805, lr=0.009740, batch_cost=1.3834, reader_cost=0.0001 | ETA 29:51:12 2021-02-22 18:57:47 [INFO] [TRAIN] epoch=7, iter=2320/80000, loss=1.0641, lr=0.009739, batch_cost=1.3309, reader_cost=0.0001 | ETA 28:43:08 2021-02-22 18:58:01 [INFO] [TRAIN] epoch=7, iter=2330/80000, loss=1.0551, lr=0.009738, batch_cost=1.3735, reader_cost=0.0001 | ETA 29:37:57 2021-02-22 18:58:15 [INFO] [TRAIN] epoch=7, iter=2340/80000, loss=1.0669, lr=0.009736, batch_cost=1.3716, reader_cost=0.0001 | ETA 29:35:16 2021-02-22 18:58:28 [INFO] [TRAIN] epoch=7, iter=2350/80000, loss=1.1402, lr=0.009735, batch_cost=1.3465, reader_cost=0.0001 | ETA 29:02:37 2021-02-22 18:58:42 [INFO] [TRAIN] epoch=7, iter=2360/80000, loss=0.9215, lr=0.009734, batch_cost=1.3482, reader_cost=0.0001 | ETA 29:04:35 2021-02-22 18:58:55 [INFO] [TRAIN] epoch=7, iter=2370/80000, loss=1.0513, lr=0.009733, batch_cost=1.3641, reader_cost=0.0001 | ETA 29:24:58 2021-02-22 18:59:09 [INFO] [TRAIN] epoch=7, iter=2380/80000, loss=0.9296, lr=0.009732, batch_cost=1.3684, reader_cost=0.0001 | ETA 29:30:17 2021-02-22 18:59:22 [INFO] [TRAIN] epoch=7, iter=2390/80000, loss=0.9404, lr=0.009731, batch_cost=1.3383, reader_cost=0.0001 | ETA 28:51:03 2021-02-22 18:59:36 [INFO] [TRAIN] epoch=7, iter=2400/80000, loss=0.9328, lr=0.009730, batch_cost=1.3303, reader_cost=0.0001 | ETA 28:40:30 2021-02-22 18:59:49 [INFO] [TRAIN] epoch=7, iter=2410/80000, loss=1.1817, lr=0.009729, batch_cost=1.3540, reader_cost=0.0001 | ETA 29:10:57 2021-02-22 19:00:03 [INFO] [TRAIN] epoch=7, iter=2420/80000, loss=0.9098, lr=0.009727, batch_cost=1.3768, reader_cost=0.0001 | ETA 29:40:13 2021-02-22 19:00:17 [INFO] [TRAIN] epoch=7, iter=2430/80000, loss=0.9908, lr=0.009726, batch_cost=1.3943, reader_cost=0.0001 | ETA 30:02:37 2021-02-22 19:00:30 [INFO] [TRAIN] epoch=7, iter=2440/80000, loss=1.0182, lr=0.009725, batch_cost=1.3422, reader_cost=0.0001 | ETA 28:55:02 2021-02-22 19:00:44 [INFO] [TRAIN] epoch=7, iter=2450/80000, loss=0.9500, lr=0.009724, batch_cost=1.3636, reader_cost=0.0001 | ETA 29:22:29 2021-02-22 19:00:57 [INFO] [TRAIN] epoch=7, iter=2460/80000, loss=1.0852, lr=0.009723, batch_cost=1.3605, reader_cost=0.0001 | ETA 29:18:11 2021-02-22 19:01:11 [INFO] [TRAIN] epoch=7, iter=2470/80000, loss=1.0582, lr=0.009722, batch_cost=1.3855, reader_cost=0.0001 | ETA 29:50:14 2021-02-22 19:01:25 [INFO] [TRAIN] epoch=7, iter=2480/80000, loss=1.0124, lr=0.009721, batch_cost=1.3671, reader_cost=0.0001 | ETA 29:26:15 2021-02-22 19:01:39 [INFO] [TRAIN] epoch=7, iter=2490/80000, loss=1.0408, lr=0.009720, batch_cost=1.3597, reader_cost=0.0001 | ETA 29:16:27 2021-02-22 19:01:52 [INFO] [TRAIN] epoch=7, iter=2500/80000, loss=1.0765, lr=0.009718, batch_cost=1.3577, reader_cost=0.0001 | ETA 29:13:44 2021-02-22 19:02:06 [INFO] [TRAIN] epoch=7, iter=2510/80000, loss=0.9468, lr=0.009717, batch_cost=1.3634, reader_cost=0.0001 | ETA 29:20:52 2021-02-22 19:02:19 [INFO] [TRAIN] epoch=7, iter=2520/80000, loss=0.9785, lr=0.009716, batch_cost=1.3446, reader_cost=0.0001 | ETA 28:56:19 2021-02-22 19:02:33 [INFO] [TRAIN] epoch=7, iter=2530/80000, loss=0.9990, lr=0.009715, batch_cost=1.3694, reader_cost=0.0001 | ETA 29:28:05 2021-02-22 19:02:46 [INFO] [TRAIN] epoch=7, iter=2540/80000, loss=1.0443, lr=0.009714, batch_cost=1.3351, reader_cost=0.0001 | ETA 28:43:35 2021-02-22 19:03:00 [INFO] [TRAIN] epoch=7, iter=2550/80000, loss=0.9776, lr=0.009713, batch_cost=1.3738, reader_cost=0.0001 | ETA 29:33:17 2021-02-22 19:03:13 [INFO] [TRAIN] epoch=7, iter=2560/80000, loss=0.9988, lr=0.009712, batch_cost=1.3436, reader_cost=0.0001 | ETA 28:54:04 2021-02-22 19:03:27 [INFO] [TRAIN] epoch=7, iter=2570/80000, loss=0.9694, lr=0.009711, batch_cost=1.3671, reader_cost=0.0001 | ETA 29:24:10 2021-02-22 19:03:40 [INFO] [TRAIN] epoch=7, iter=2580/80000, loss=1.0685, lr=0.009709, batch_cost=1.3348, reader_cost=0.0001 | ETA 28:42:19 2021-02-22 19:03:54 [INFO] [TRAIN] epoch=7, iter=2590/80000, loss=1.0729, lr=0.009708, batch_cost=1.3482, reader_cost=0.0001 | ETA 28:59:23 2021-02-22 19:04:07 [INFO] [TRAIN] epoch=7, iter=2600/80000, loss=1.4060, lr=0.009707, batch_cost=1.3431, reader_cost=0.0001 | ETA 28:52:39 2021-02-22 19:04:22 [INFO] [TRAIN] epoch=8, iter=2610/80000, loss=1.0367, lr=0.009706, batch_cost=1.4833, reader_cost=0.0819 | ETA 31:53:15 2021-02-22 19:04:36 [INFO] [TRAIN] epoch=8, iter=2620/80000, loss=0.9897, lr=0.009705, batch_cost=1.3456, reader_cost=0.0001 | ETA 28:55:20 2021-02-22 19:04:49 [INFO] [TRAIN] epoch=8, iter=2630/80000, loss=1.0122, lr=0.009704, batch_cost=1.3656, reader_cost=0.0001 | ETA 29:20:53 2021-02-22 19:05:03 [INFO] [TRAIN] epoch=8, iter=2640/80000, loss=1.0064, lr=0.009703, batch_cost=1.3801, reader_cost=0.0001 | ETA 29:39:25 2021-02-22 19:05:17 [INFO] [TRAIN] epoch=8, iter=2650/80000, loss=1.0603, lr=0.009701, batch_cost=1.3616, reader_cost=0.0001 | ETA 29:15:18 2021-02-22 19:05:30 [INFO] [TRAIN] epoch=8, iter=2660/80000, loss=1.0936, lr=0.009700, batch_cost=1.3696, reader_cost=0.0001 | ETA 29:25:28 2021-02-22 19:05:44 [INFO] [TRAIN] epoch=8, iter=2670/80000, loss=1.1139, lr=0.009699, batch_cost=1.3470, reader_cost=0.0001 | ETA 28:56:07 2021-02-22 19:05:58 [INFO] [TRAIN] epoch=8, iter=2680/80000, loss=1.0042, lr=0.009698, batch_cost=1.3799, reader_cost=0.0001 | ETA 29:38:14 2021-02-22 19:06:11 [INFO] [TRAIN] epoch=8, iter=2690/80000, loss=0.9415, lr=0.009697, batch_cost=1.3519, reader_cost=0.0001 | ETA 29:01:58 2021-02-22 19:06:25 [INFO] [TRAIN] epoch=8, iter=2700/80000, loss=1.0237, lr=0.009696, batch_cost=1.3513, reader_cost=0.0001 | ETA 29:00:57 2021-02-22 19:06:38 [INFO] [TRAIN] epoch=8, iter=2710/80000, loss=1.1518, lr=0.009695, batch_cost=1.3508, reader_cost=0.0001 | ETA 29:00:04 2021-02-22 19:06:52 [INFO] [TRAIN] epoch=8, iter=2720/80000, loss=1.2165, lr=0.009694, batch_cost=1.3724, reader_cost=0.0001 | ETA 29:27:38 2021-02-22 19:07:06 [INFO] [TRAIN] epoch=8, iter=2730/80000, loss=1.1755, lr=0.009692, batch_cost=1.3608, reader_cost=0.0001 | ETA 29:12:28 2021-02-22 19:07:19 [INFO] [TRAIN] epoch=8, iter=2740/80000, loss=0.9690, lr=0.009691, batch_cost=1.3780, reader_cost=0.0001 | ETA 29:34:21 2021-02-22 19:07:33 [INFO] [TRAIN] epoch=8, iter=2750/80000, loss=0.9541, lr=0.009690, batch_cost=1.4088, reader_cost=0.0001 | ETA 30:13:50 2021-02-22 19:07:47 [INFO] [TRAIN] epoch=8, iter=2760/80000, loss=1.0363, lr=0.009689, batch_cost=1.3730, reader_cost=0.0001 | ETA 29:27:32 2021-02-22 19:08:01 [INFO] [TRAIN] epoch=8, iter=2770/80000, loss=0.9584, lr=0.009688, batch_cost=1.3525, reader_cost=0.0001 | ETA 29:00:55 2021-02-22 19:08:14 [INFO] [TRAIN] epoch=8, iter=2780/80000, loss=1.0399, lr=0.009687, batch_cost=1.3481, reader_cost=0.0001 | ETA 28:54:58 2021-02-22 19:08:27 [INFO] [TRAIN] epoch=8, iter=2790/80000, loss=0.9160, lr=0.009686, batch_cost=1.3237, reader_cost=0.0001 | ETA 28:23:23 2021-02-22 19:08:41 [INFO] [TRAIN] epoch=8, iter=2800/80000, loss=0.9318, lr=0.009685, batch_cost=1.3714, reader_cost=0.0001 | ETA 29:24:34 2021-02-22 19:08:55 [INFO] [TRAIN] epoch=8, iter=2810/80000, loss=0.9639, lr=0.009683, batch_cost=1.3665, reader_cost=0.0001 | ETA 29:17:56 2021-02-22 19:09:08 [INFO] [TRAIN] epoch=8, iter=2820/80000, loss=1.0296, lr=0.009682, batch_cost=1.3611, reader_cost=0.0001 | ETA 29:10:46 2021-02-22 19:09:22 [INFO] [TRAIN] epoch=8, iter=2830/80000, loss=1.0591, lr=0.009681, batch_cost=1.3771, reader_cost=0.0001 | ETA 29:31:12 2021-02-22 19:09:36 [INFO] [TRAIN] epoch=8, iter=2840/80000, loss=0.8915, lr=0.009680, batch_cost=1.3457, reader_cost=0.0001 | ETA 28:50:34 2021-02-22 19:09:49 [INFO] [TRAIN] epoch=8, iter=2850/80000, loss=1.0431, lr=0.009679, batch_cost=1.3707, reader_cost=0.0001 | ETA 29:22:33 2021-02-22 19:10:03 [INFO] [TRAIN] epoch=8, iter=2860/80000, loss=0.9717, lr=0.009678, batch_cost=1.3763, reader_cost=0.0001 | ETA 29:29:30 2021-02-22 19:10:17 [INFO] [TRAIN] epoch=8, iter=2870/80000, loss=1.0366, lr=0.009677, batch_cost=1.3531, reader_cost=0.0001 | ETA 28:59:22 2021-02-22 19:10:30 [INFO] [TRAIN] epoch=8, iter=2880/80000, loss=0.9918, lr=0.009676, batch_cost=1.3595, reader_cost=0.0001 | ETA 29:07:24 2021-02-22 19:10:44 [INFO] [TRAIN] epoch=8, iter=2890/80000, loss=1.0817, lr=0.009674, batch_cost=1.3632, reader_cost=0.0001 | ETA 29:11:59 2021-02-22 19:10:58 [INFO] [TRAIN] epoch=8, iter=2900/80000, loss=1.0307, lr=0.009673, batch_cost=1.3776, reader_cost=0.0001 | ETA 29:30:15 2021-02-22 19:11:11 [INFO] [TRAIN] epoch=8, iter=2910/80000, loss=1.0397, lr=0.009672, batch_cost=1.3700, reader_cost=0.0001 | ETA 29:20:17 2021-02-22 19:11:25 [INFO] [TRAIN] epoch=8, iter=2920/80000, loss=0.9743, lr=0.009671, batch_cost=1.3529, reader_cost=0.0001 | ETA 28:57:59 2021-02-22 19:11:38 [INFO] [TRAIN] epoch=8, iter=2930/80000, loss=1.0836, lr=0.009670, batch_cost=1.3533, reader_cost=0.0001 | ETA 28:58:15 2021-02-22 19:11:52 [INFO] [TRAIN] epoch=8, iter=2940/80000, loss=0.8760, lr=0.009669, batch_cost=1.3661, reader_cost=0.0001 | ETA 29:14:35 2021-02-22 19:12:06 [INFO] [TRAIN] epoch=8, iter=2950/80000, loss=1.0412, lr=0.009668, batch_cost=1.3714, reader_cost=0.0001 | ETA 29:21:08 2021-02-22 19:12:19 [INFO] [TRAIN] epoch=8, iter=2960/80000, loss=1.0890, lr=0.009666, batch_cost=1.3533, reader_cost=0.0001 | ETA 28:57:41 2021-02-22 19:12:33 [INFO] [TRAIN] epoch=8, iter=2970/80000, loss=1.0134, lr=0.009665, batch_cost=1.3376, reader_cost=0.0001 | ETA 28:37:17 2021-02-22 19:12:47 [INFO] [TRAIN] epoch=9, iter=2980/80000, loss=0.9428, lr=0.009664, batch_cost=1.4445, reader_cost=0.0706 | ETA 30:54:17 2021-02-22 19:13:01 [INFO] [TRAIN] epoch=9, iter=2990/80000, loss=0.9594, lr=0.009663, batch_cost=1.3664, reader_cost=0.0002 | ETA 29:13:48 2021-02-22 19:13:14 [INFO] [TRAIN] epoch=9, iter=3000/80000, loss=0.9639, lr=0.009662, batch_cost=1.3488, reader_cost=0.0001 | ETA 28:50:58 2021-02-22 19:13:14 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:19 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:02 - batch_cost: 0.1859 - reader cost: 0.0593  3/125 [..............................] - ETA: 57s - batch_cost: 0.2553 - reader cost: 0.0874  4/125 [..............................] - ETA: 56s - batch_cost: 0.3062 - reader cost: 0.1181 5/125 [>.............................] - ETA: 54s - batch_cost: 0.3289 - reader cost: 0.1285 6/125 [>.............................] - ETA: 53s - batch_cost: 0.3437 - reader cost: 0.1352 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3523 - reader cost: 0.1378 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3612 - reader cost: 0.1420 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3688 - reader cost: 0.1454 10/125 [=>............................] - ETA: 51s - batch_cost: 0.3801 - reader cost: 0.1475 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3807 - reader cost: 0.1450 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3866 - reader cost: 0.1426 13/125 [==>...........................] - ETA: 49s - batch_cost: 0.3897 - reader cost: 0.1409 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3940 - reader cost: 0.1394 15/125 [==>...........................] - ETA: 48s - batch_cost: 0.3964 - reader cost: 0.1378 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3983 - reader cost: 0.1401 17/125 [===>..........................] - ETA: 47s - batch_cost: 0.4001 - reader cost: 0.1425 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.4024 - reader cost: 0.1449 19/125 [===>..........................] - ETA: 46s - batch_cost: 0.4038 - reader cost: 0.1468 20/125 [===>..........................] - ETA: 46s - batch_cost: 0.4062 - reader cost: 0.1497 21/125 [====>.........................] - ETA: 45s - batch_cost: 0.4077 - reader cost: 0.1514 22/125 [====>.........................] - ETA: 45s - batch_cost: 0.4100 - reader cost: 0.1539 23/125 [====>.........................] - ETA: 44s - batch_cost: 0.4088 - reader cost: 0.1528 24/125 [====>.........................] - ETA: 44s - batch_cost: 0.4094 - reader cost: 0.1536 25/125 [=====>........................] - ETA: 43s - batch_cost: 0.4077 - reader cost: 0.1522 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4091 - reader cost: 0.1533 27/125 [=====>........................] - ETA: 42s - batch_cost: 0.4103 - reader cost: 0.1542 28/125 [=====>........................] - ETA: 42s - batch_cost: 0.4116 - reader cost: 0.1536 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4135 - reader cost: 0.1522 30/125 [======>.......................] - ETA: 41s - batch_cost: 0.4140 - reader cost: 0.1528 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4146 - reader cost: 0.1531 32/125 [======>.......................] - ETA: 40s - batch_cost: 0.4146 - reader cost: 0.1520 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4149 - reader cost: 0.1515 34/125 [=======>......................] - ETA: 39s - batch_cost: 0.4158 - reader cost: 0.1528 35/125 [=======>......................] - ETA: 39s - batch_cost: 0.4171 - reader cost: 0.1524 36/125 [=======>......................] - ETA: 38s - batch_cost: 0.4181 - reader cost: 0.1515 37/125 [=======>......................] - ETA: 38s - batch_cost: 0.4187 - reader cost: 0.1519 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4184 - reader cost: 0.1520 39/125 [========>.....................] - ETA: 37s - batch_cost: 0.4189 - reader cost: 0.1509 40/125 [========>.....................] - ETA: 37s - batch_cost: 0.4201 - reader cost: 0.1477 41/125 [========>.....................] - ETA: 36s - batch_cost: 0.4208 - reader cost: 0.1451 42/125 [=========>....................] - ETA: 36s - batch_cost: 0.4214 - reader cost: 0.1428 43/125 [=========>....................] - ETA: 35s - batch_cost: 0.4218 - reader cost: 0.1421 44/125 [=========>....................] - ETA: 35s - batch_cost: 0.4218 - reader cost: 0.1428 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4212 - reader cost: 0.1429 46/125 [==========>...................] - ETA: 34s - batch_cost: 0.4200 - reader cost: 0.1423 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4206 - reader cost: 0.1436 48/125 [==========>...................] - ETA: 33s - batch_cost: 0.4210 - reader cost: 0.1444 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4205 - reader cost: 0.1438 50/125 [===========>..................] - ETA: 32s - batch_cost: 0.4210 - reader cost: 0.1431 51/125 [===========>..................] - ETA: 32s - batch_cost: 0.4204 - reader cost: 0.1426 52/125 [===========>..................] - ETA: 31s - batch_cost: 0.4205 - reader cost: 0.1425 53/125 [===========>..................] - ETA: 31s - batch_cost: 0.4205 - reader cost: 0.1430 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4204 - reader cost: 0.1428 55/125 [============>.................] - ETA: 30s - batch_cost: 0.4207 - reader cost: 0.1434 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4208 - reader cost: 0.1432 57/125 [============>.................] - ETA: 29s - batch_cost: 0.4209 - reader cost: 0.1437 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4202 - reader cost: 0.1436 59/125 [=============>................] - ETA: 28s - batch_cost: 0.4200 - reader cost: 0.1435 60/125 [=============>................] - ETA: 28s - batch_cost: 0.4207 - reader cost: 0.1442 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4207 - reader cost: 0.1443 62/125 [=============>................] - ETA: 27s - batch_cost: 0.4209 - reader cost: 0.1451 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4214 - reader cost: 0.1459 64/125 [==============>...............] - ETA: 26s - batch_cost: 0.4216 - reader cost: 0.1465 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4219 - reader cost: 0.1470 66/125 [==============>...............] - ETA: 25s - batch_cost: 0.4219 - reader cost: 0.1474 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4212 - reader cost: 0.1469 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4209 - reader cost: 0.1464 69/125 [===============>..............] - ETA: 24s - batch_cost: 0.4211 - reader cost: 0.1469 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4208 - reader cost: 0.1466 71/125 [================>.............] - ETA: 23s - batch_cost: 0.4204 - reader cost: 0.1466 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4206 - reader cost: 0.1465 73/125 [================>.............] - ETA: 22s - batch_cost: 0.4205 - reader cost: 0.1463 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4204 - reader cost: 0.1465 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4209 - reader cost: 0.1470 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4201 - reader cost: 0.1465 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4199 - reader cost: 0.1466 78/125 [=================>............] - ETA: 20s - batch_cost: 0.4200 - reader cost: 0.1465 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4200 - reader cost: 0.1469 80/125 [==================>...........] - ETA: 19s - batch_cost: 0.4204 - reader cost: 0.1472 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4200 - reader cost: 0.1471 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4201 - reader cost: 0.1475 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4198 - reader cost: 0.1475 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4201 - reader cost: 0.1480 85/125 [===================>..........] - ETA: 17s - batch_cost: 0.4200 - reader cost: 0.1482 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4197 - reader cost: 0.1480 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4198 - reader cost: 0.1483 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4201 - reader cost: 0.1487 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4200 - reader cost: 0.1488 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4202 - reader cost: 0.1492 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4203 - reader cost: 0.1494 92/125 [=====================>........] - ETA: 14s - batch_cost: 0.4204 - reader cost: 0.1496 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4197 - reader cost: 0.1492 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4199 - reader cost: 0.1496 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4200 - reader cost: 0.1499 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4195 - reader cost: 0.1495 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4195 - reader cost: 0.1498 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4190 - reader cost: 0.1494 99/125 [======================>.......] - ETA: 11s - batch_cost: 0.4187 - reader cost: 0.1491 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4180 - reader cost: 0.1486 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4183 - reader cost: 0.1488 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4182 - reader cost: 0.1488  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4185 - reader cost: 0.1486 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4180 - reader cost: 0.1482 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4182 - reader cost: 0.1486 106/125 [========================>.....] - ETA: 8s - batch_cost: 0.4183 - reader cost: 0.1489 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4182 - reader cost: 0.1487 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4184 - reader cost: 0.1490 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4184 - reader cost: 0.1491 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4183 - reader cost: 0.1492 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4185 - reader cost: 0.1495 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4183 - reader cost: 0.1493 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4181 - reader cost: 0.1491 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4182 - reader cost: 0.1489 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4184 - reader cost: 0.1492 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4181 - reader cost: 0.1490 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4186 - reader cost: 0.1496 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4182 - reader cost: 0.1493 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4180 - reader cost: 0.1492 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4181 - reader cost: 0.1495 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4182 - reader cost: 0.1497 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4183 - reader cost: 0.1500 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4179 - reader cost: 0.1498 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4180 - reader cost: 0.1500 125/125 [==============================] - 53s 423ms/step - batch_cost: 0.4176 - reader cost: 0.1498 2021-02-22 19:14:07 [INFO] [EVAL] #Images=500 mIoU=0.6160 Acc=0.9371 Kappa=0.9180 2021-02-22 19:14:07 [INFO] [EVAL] Class IoU: [0.9619 0.7137 0.8919 0.2479 0.5031 0.5205 0.6438 0.7167 0.905 0.4657 0.9299 0.7619 0.5517 0.9131 0.3744 0.4053 0.2738 0.2103 0.7132] 2021-02-22 19:14:07 [INFO] [EVAL] Class Acc: [0.9736 0.8824 0.9206 0.7634 0.6265 0.7786 0.7889 0.8535 0.9545 0.8746 0.9642 0.8259 0.6992 0.9403 0.9499 0.8567 0.2937 0.8992 0.7977] 2021-02-22 19:14:13 [INFO] [EVAL] The model with the best validation mIoU (0.6160) was saved at iter 3000. 2021-02-22 19:14:27 [INFO] [TRAIN] epoch=9, iter=3010/80000, loss=1.1412, lr=0.009661, batch_cost=1.3366, reader_cost=0.0001 | ETA 28:35:05 2021-02-22 19:14:40 [INFO] [TRAIN] epoch=9, iter=3020/80000, loss=1.1764, lr=0.009660, batch_cost=1.3407, reader_cost=0.0001 | ETA 28:40:10 2021-02-22 19:14:54 [INFO] [TRAIN] epoch=9, iter=3030/80000, loss=0.9953, lr=0.009659, batch_cost=1.3314, reader_cost=0.0001 | ETA 28:27:58 2021-02-22 19:15:07 [INFO] [TRAIN] epoch=9, iter=3040/80000, loss=0.9376, lr=0.009657, batch_cost=1.3770, reader_cost=0.0001 | ETA 29:26:10 2021-02-22 19:15:21 [INFO] [TRAIN] epoch=9, iter=3050/80000, loss=1.1360, lr=0.009656, batch_cost=1.3571, reader_cost=0.0001 | ETA 29:00:28 2021-02-22 19:15:35 [INFO] [TRAIN] epoch=9, iter=3060/80000, loss=1.0983, lr=0.009655, batch_cost=1.3821, reader_cost=0.0001 | ETA 29:32:16 2021-02-22 19:15:48 [INFO] [TRAIN] epoch=9, iter=3070/80000, loss=1.1884, lr=0.009654, batch_cost=1.3688, reader_cost=0.0001 | ETA 29:14:59 2021-02-22 19:16:02 [INFO] [TRAIN] epoch=9, iter=3080/80000, loss=1.0593, lr=0.009653, batch_cost=1.3288, reader_cost=0.0001 | ETA 28:23:32 2021-02-22 19:16:16 [INFO] [TRAIN] epoch=9, iter=3090/80000, loss=1.1109, lr=0.009652, batch_cost=1.3827, reader_cost=0.0001 | ETA 29:32:21 2021-02-22 19:16:29 [INFO] [TRAIN] epoch=9, iter=3100/80000, loss=1.0743, lr=0.009651, batch_cost=1.3756, reader_cost=0.0001 | ETA 29:23:00 2021-02-22 19:16:43 [INFO] [TRAIN] epoch=9, iter=3110/80000, loss=0.9330, lr=0.009650, batch_cost=1.3356, reader_cost=0.0001 | ETA 28:31:32 2021-02-22 19:16:56 [INFO] [TRAIN] epoch=9, iter=3120/80000, loss=1.0961, lr=0.009648, batch_cost=1.3870, reader_cost=0.0001 | ETA 29:37:16 2021-02-22 19:17:10 [INFO] [TRAIN] epoch=9, iter=3130/80000, loss=1.1315, lr=0.009647, batch_cost=1.3342, reader_cost=0.0001 | ETA 28:29:23 2021-02-22 19:17:23 [INFO] [TRAIN] epoch=9, iter=3140/80000, loss=0.9464, lr=0.009646, batch_cost=1.3531, reader_cost=0.0001 | ETA 28:53:17 2021-02-22 19:17:37 [INFO] [TRAIN] epoch=9, iter=3150/80000, loss=0.9605, lr=0.009645, batch_cost=1.3239, reader_cost=0.0001 | ETA 28:15:44 2021-02-22 19:17:50 [INFO] [TRAIN] epoch=9, iter=3160/80000, loss=1.0645, lr=0.009644, batch_cost=1.3376, reader_cost=0.0001 | ETA 28:32:57 2021-02-22 19:18:04 [INFO] [TRAIN] epoch=9, iter=3170/80000, loss=0.9587, lr=0.009643, batch_cost=1.3771, reader_cost=0.0001 | ETA 29:23:19 2021-02-22 19:18:17 [INFO] [TRAIN] epoch=9, iter=3180/80000, loss=0.9100, lr=0.009642, batch_cost=1.3411, reader_cost=0.0001 | ETA 28:37:02 2021-02-22 19:18:31 [INFO] [TRAIN] epoch=9, iter=3190/80000, loss=1.0447, lr=0.009641, batch_cost=1.3885, reader_cost=0.0001 | ETA 29:37:32 2021-02-22 19:18:45 [INFO] [TRAIN] epoch=9, iter=3200/80000, loss=1.0362, lr=0.009639, batch_cost=1.3690, reader_cost=0.0001 | ETA 29:12:22 2021-02-22 19:18:58 [INFO] [TRAIN] epoch=9, iter=3210/80000, loss=0.9738, lr=0.009638, batch_cost=1.3624, reader_cost=0.0001 | ETA 29:03:38 2021-02-22 19:19:12 [INFO] [TRAIN] epoch=9, iter=3220/80000, loss=0.9294, lr=0.009637, batch_cost=1.3490, reader_cost=0.0001 | ETA 28:46:17 2021-02-22 19:19:26 [INFO] [TRAIN] epoch=9, iter=3230/80000, loss=0.9716, lr=0.009636, batch_cost=1.3651, reader_cost=0.0001 | ETA 29:06:38 2021-02-22 19:19:39 [INFO] [TRAIN] epoch=9, iter=3240/80000, loss=0.9992, lr=0.009635, batch_cost=1.3509, reader_cost=0.0001 | ETA 28:48:16 2021-02-22 19:19:53 [INFO] [TRAIN] epoch=9, iter=3250/80000, loss=1.0396, lr=0.009634, batch_cost=1.3571, reader_cost=0.0001 | ETA 28:55:54 2021-02-22 19:20:06 [INFO] [TRAIN] epoch=9, iter=3260/80000, loss=0.9384, lr=0.009633, batch_cost=1.3536, reader_cost=0.0001 | ETA 28:51:14 2021-02-22 19:20:20 [INFO] [TRAIN] epoch=9, iter=3270/80000, loss=0.9778, lr=0.009631, batch_cost=1.3564, reader_cost=0.0001 | ETA 28:54:33 2021-02-22 19:20:33 [INFO] [TRAIN] epoch=9, iter=3280/80000, loss=1.1005, lr=0.009630, batch_cost=1.3516, reader_cost=0.0001 | ETA 28:48:11 2021-02-22 19:20:47 [INFO] [TRAIN] epoch=9, iter=3290/80000, loss=1.0472, lr=0.009629, batch_cost=1.3574, reader_cost=0.0001 | ETA 28:55:24 2021-02-22 19:21:00 [INFO] [TRAIN] epoch=9, iter=3300/80000, loss=1.1233, lr=0.009628, batch_cost=1.3578, reader_cost=0.0001 | ETA 28:55:39 2021-02-22 19:21:14 [INFO] [TRAIN] epoch=9, iter=3310/80000, loss=1.0098, lr=0.009627, batch_cost=1.3676, reader_cost=0.0001 | ETA 29:07:58 2021-02-22 19:21:28 [INFO] [TRAIN] epoch=9, iter=3320/80000, loss=1.1615, lr=0.009626, batch_cost=1.4015, reader_cost=0.0001 | ETA 29:51:09 2021-02-22 19:21:42 [INFO] [TRAIN] epoch=9, iter=3330/80000, loss=0.9555, lr=0.009625, batch_cost=1.3745, reader_cost=0.0001 | ETA 29:16:21 2021-02-22 19:21:56 [INFO] [TRAIN] epoch=9, iter=3340/80000, loss=1.0041, lr=0.009624, batch_cost=1.3747, reader_cost=0.0001 | ETA 29:16:23 2021-02-22 19:22:10 [INFO] [TRAIN] epoch=10, iter=3350/80000, loss=1.0459, lr=0.009622, batch_cost=1.3968, reader_cost=0.0712 | ETA 29:44:26 2021-02-22 19:22:23 [INFO] [TRAIN] epoch=10, iter=3360/80000, loss=0.9831, lr=0.009621, batch_cost=1.3798, reader_cost=0.0001 | ETA 29:22:25 2021-02-22 19:22:37 [INFO] [TRAIN] epoch=10, iter=3370/80000, loss=0.9029, lr=0.009620, batch_cost=1.3920, reader_cost=0.0001 | ETA 29:37:46 2021-02-22 19:22:51 [INFO] [TRAIN] epoch=10, iter=3380/80000, loss=0.8929, lr=0.009619, batch_cost=1.3784, reader_cost=0.0001 | ETA 29:20:11 2021-02-22 19:23:05 [INFO] [TRAIN] epoch=10, iter=3390/80000, loss=0.9054, lr=0.009618, batch_cost=1.3750, reader_cost=0.0001 | ETA 29:15:40 2021-02-22 19:23:18 [INFO] [TRAIN] epoch=10, iter=3400/80000, loss=1.0161, lr=0.009617, batch_cost=1.3622, reader_cost=0.0001 | ETA 28:59:03 2021-02-22 19:23:32 [INFO] [TRAIN] epoch=10, iter=3410/80000, loss=1.0277, lr=0.009616, batch_cost=1.3828, reader_cost=0.0001 | ETA 29:25:08 2021-02-22 19:23:46 [INFO] [TRAIN] epoch=10, iter=3420/80000, loss=1.0390, lr=0.009615, batch_cost=1.3574, reader_cost=0.0001 | ETA 28:52:28 2021-02-22 19:23:59 [INFO] [TRAIN] epoch=10, iter=3430/80000, loss=0.9741, lr=0.009613, batch_cost=1.3562, reader_cost=0.0001 | ETA 28:50:45 2021-02-22 19:24:13 [INFO] [TRAIN] epoch=10, iter=3440/80000, loss=1.0048, lr=0.009612, batch_cost=1.3644, reader_cost=0.0001 | ETA 29:00:57 2021-02-22 19:24:26 [INFO] [TRAIN] epoch=10, iter=3450/80000, loss=1.0631, lr=0.009611, batch_cost=1.3405, reader_cost=0.0001 | ETA 28:30:17 2021-02-22 19:24:40 [INFO] [TRAIN] epoch=10, iter=3460/80000, loss=0.9334, lr=0.009610, batch_cost=1.3712, reader_cost=0.0001 | ETA 29:09:13 2021-02-22 19:24:54 [INFO] [TRAIN] epoch=10, iter=3470/80000, loss=1.1054, lr=0.009609, batch_cost=1.3977, reader_cost=0.0001 | ETA 29:42:48 2021-02-22 19:25:08 [INFO] [TRAIN] epoch=10, iter=3480/80000, loss=0.9476, lr=0.009608, batch_cost=1.3576, reader_cost=0.0001 | ETA 28:51:23 2021-02-22 19:25:21 [INFO] [TRAIN] epoch=10, iter=3490/80000, loss=0.9461, lr=0.009607, batch_cost=1.3739, reader_cost=0.0001 | ETA 29:11:56 2021-02-22 19:25:35 [INFO] [TRAIN] epoch=10, iter=3500/80000, loss=0.9899, lr=0.009605, batch_cost=1.3735, reader_cost=0.0001 | ETA 29:11:12 2021-02-22 19:25:49 [INFO] [TRAIN] epoch=10, iter=3510/80000, loss=1.0961, lr=0.009604, batch_cost=1.3811, reader_cost=0.0001 | ETA 29:20:39 2021-02-22 19:26:03 [INFO] [TRAIN] epoch=10, iter=3520/80000, loss=1.0406, lr=0.009603, batch_cost=1.3580, reader_cost=0.0001 | ETA 28:50:59 2021-02-22 19:26:16 [INFO] [TRAIN] epoch=10, iter=3530/80000, loss=0.9177, lr=0.009602, batch_cost=1.3591, reader_cost=0.0001 | ETA 28:52:12 2021-02-22 19:26:30 [INFO] [TRAIN] epoch=10, iter=3540/80000, loss=0.8624, lr=0.009601, batch_cost=1.3846, reader_cost=0.0001 | ETA 29:24:29 2021-02-22 19:26:43 [INFO] [TRAIN] epoch=10, iter=3550/80000, loss=0.9140, lr=0.009600, batch_cost=1.3398, reader_cost=0.0001 | ETA 28:27:04 2021-02-22 19:26:57 [INFO] [TRAIN] epoch=10, iter=3560/80000, loss=1.1784, lr=0.009599, batch_cost=1.3551, reader_cost=0.0001 | ETA 28:46:21 2021-02-22 19:27:10 [INFO] [TRAIN] epoch=10, iter=3570/80000, loss=1.1566, lr=0.009598, batch_cost=1.3529, reader_cost=0.0001 | ETA 28:43:22 2021-02-22 19:27:24 [INFO] [TRAIN] epoch=10, iter=3580/80000, loss=1.0359, lr=0.009596, batch_cost=1.3656, reader_cost=0.0001 | ETA 28:59:18 2021-02-22 19:27:38 [INFO] [TRAIN] epoch=10, iter=3590/80000, loss=1.0548, lr=0.009595, batch_cost=1.3467, reader_cost=0.0001 | ETA 28:35:03 2021-02-22 19:27:51 [INFO] [TRAIN] epoch=10, iter=3600/80000, loss=0.9220, lr=0.009594, batch_cost=1.3510, reader_cost=0.0001 | ETA 28:40:16 2021-02-22 19:28:05 [INFO] [TRAIN] epoch=10, iter=3610/80000, loss=1.0174, lr=0.009593, batch_cost=1.4034, reader_cost=0.0001 | ETA 29:46:43 2021-02-22 19:28:19 [INFO] [TRAIN] epoch=10, iter=3620/80000, loss=1.1371, lr=0.009592, batch_cost=1.4136, reader_cost=0.0001 | ETA 29:59:31 2021-02-22 19:28:33 [INFO] [TRAIN] epoch=10, iter=3630/80000, loss=0.9286, lr=0.009591, batch_cost=1.4102, reader_cost=0.0001 | ETA 29:54:58 2021-02-22 19:28:47 [INFO] [TRAIN] epoch=10, iter=3640/80000, loss=0.8844, lr=0.009590, batch_cost=1.3408, reader_cost=0.0001 | ETA 28:26:25 2021-02-22 19:29:01 [INFO] [TRAIN] epoch=10, iter=3650/80000, loss=1.0188, lr=0.009589, batch_cost=1.3723, reader_cost=0.0001 | ETA 29:06:14 2021-02-22 19:29:14 [INFO] [TRAIN] epoch=10, iter=3660/80000, loss=1.0088, lr=0.009587, batch_cost=1.3702, reader_cost=0.0001 | ETA 29:03:21 2021-02-22 19:29:28 [INFO] [TRAIN] epoch=10, iter=3670/80000, loss=0.9773, lr=0.009586, batch_cost=1.3411, reader_cost=0.0001 | ETA 28:26:02 2021-02-22 19:29:41 [INFO] [TRAIN] epoch=10, iter=3680/80000, loss=1.0691, lr=0.009585, batch_cost=1.3713, reader_cost=0.0001 | ETA 29:04:20 2021-02-22 19:29:55 [INFO] [TRAIN] epoch=10, iter=3690/80000, loss=0.9180, lr=0.009584, batch_cost=1.3509, reader_cost=0.0001 | ETA 28:38:06 2021-02-22 19:30:08 [INFO] [TRAIN] epoch=10, iter=3700/80000, loss=0.9813, lr=0.009583, batch_cost=1.3565, reader_cost=0.0001 | ETA 28:44:57 2021-02-22 19:30:22 [INFO] [TRAIN] epoch=10, iter=3710/80000, loss=0.9885, lr=0.009582, batch_cost=1.3428, reader_cost=0.0001 | ETA 28:27:21 2021-02-22 19:30:35 [INFO] [TRAIN] epoch=10, iter=3720/80000, loss=0.8747, lr=0.009581, batch_cost=1.3081, reader_cost=0.0001 | ETA 27:43:01 2021-02-22 19:30:50 [INFO] [TRAIN] epoch=11, iter=3730/80000, loss=0.9029, lr=0.009579, batch_cost=1.4900, reader_cost=0.0868 | ETA 31:34:03 2021-02-22 19:31:03 [INFO] [TRAIN] epoch=11, iter=3740/80000, loss=0.9116, lr=0.009578, batch_cost=1.3308, reader_cost=0.0001 | ETA 28:11:28 2021-02-22 19:31:17 [INFO] [TRAIN] epoch=11, iter=3750/80000, loss=0.9812, lr=0.009577, batch_cost=1.3539, reader_cost=0.0001 | ETA 28:40:34 2021-02-22 19:31:30 [INFO] [TRAIN] epoch=11, iter=3760/80000, loss=1.0185, lr=0.009576, batch_cost=1.3676, reader_cost=0.0001 | ETA 28:57:47 2021-02-22 19:31:44 [INFO] [TRAIN] epoch=11, iter=3770/80000, loss=0.9710, lr=0.009575, batch_cost=1.3558, reader_cost=0.0001 | ETA 28:42:30 2021-02-22 19:31:58 [INFO] [TRAIN] epoch=11, iter=3780/80000, loss=0.9615, lr=0.009574, batch_cost=1.3833, reader_cost=0.0001 | ETA 29:17:17 2021-02-22 19:32:12 [INFO] [TRAIN] epoch=11, iter=3790/80000, loss=1.0355, lr=0.009573, batch_cost=1.3928, reader_cost=0.0001 | ETA 29:29:07 2021-02-22 19:32:25 [INFO] [TRAIN] epoch=11, iter=3800/80000, loss=0.9176, lr=0.009572, batch_cost=1.3749, reader_cost=0.0001 | ETA 29:06:04 2021-02-22 19:32:39 [INFO] [TRAIN] epoch=11, iter=3810/80000, loss=1.0417, lr=0.009570, batch_cost=1.3742, reader_cost=0.0001 | ETA 29:05:01 2021-02-22 19:32:53 [INFO] [TRAIN] epoch=11, iter=3820/80000, loss=1.0627, lr=0.009569, batch_cost=1.3771, reader_cost=0.0001 | ETA 29:08:23 2021-02-22 19:33:07 [INFO] [TRAIN] epoch=11, iter=3830/80000, loss=1.0871, lr=0.009568, batch_cost=1.3734, reader_cost=0.0001 | ETA 29:03:34 2021-02-22 19:33:20 [INFO] [TRAIN] epoch=11, iter=3840/80000, loss=0.9314, lr=0.009567, batch_cost=1.3769, reader_cost=0.0001 | ETA 29:07:41 2021-02-22 19:33:34 [INFO] [TRAIN] epoch=11, iter=3850/80000, loss=1.0737, lr=0.009566, batch_cost=1.3625, reader_cost=0.0001 | ETA 28:49:16 2021-02-22 19:33:48 [INFO] [TRAIN] epoch=11, iter=3860/80000, loss=0.9002, lr=0.009565, batch_cost=1.3944, reader_cost=0.0001 | ETA 29:29:30 2021-02-22 19:34:02 [INFO] [TRAIN] epoch=11, iter=3870/80000, loss=1.0243, lr=0.009564, batch_cost=1.3789, reader_cost=0.0001 | ETA 29:09:36 2021-02-22 19:34:15 [INFO] [TRAIN] epoch=11, iter=3880/80000, loss=0.9502, lr=0.009563, batch_cost=1.3566, reader_cost=0.0001 | ETA 28:41:04 2021-02-22 19:34:29 [INFO] [TRAIN] epoch=11, iter=3890/80000, loss=0.9847, lr=0.009561, batch_cost=1.4023, reader_cost=0.0001 | ETA 29:38:47 2021-02-22 19:34:43 [INFO] [TRAIN] epoch=11, iter=3900/80000, loss=1.0981, lr=0.009560, batch_cost=1.3670, reader_cost=0.0001 | ETA 28:53:48 2021-02-22 19:34:57 [INFO] [TRAIN] epoch=11, iter=3910/80000, loss=1.0257, lr=0.009559, batch_cost=1.3794, reader_cost=0.0002 | ETA 29:09:19 2021-02-22 19:35:11 [INFO] [TRAIN] epoch=11, iter=3920/80000, loss=1.0267, lr=0.009558, batch_cost=1.3721, reader_cost=0.0002 | ETA 28:59:50 2021-02-22 19:35:25 [INFO] [TRAIN] epoch=11, iter=3930/80000, loss=0.9580, lr=0.009557, batch_cost=1.3978, reader_cost=0.0001 | ETA 29:32:11 2021-02-22 19:35:38 [INFO] [TRAIN] epoch=11, iter=3940/80000, loss=0.9902, lr=0.009556, batch_cost=1.3922, reader_cost=0.0001 | ETA 29:24:47 2021-02-22 19:35:52 [INFO] [TRAIN] epoch=11, iter=3950/80000, loss=1.0806, lr=0.009555, batch_cost=1.3783, reader_cost=0.0001 | ETA 29:07:00 2021-02-22 19:36:06 [INFO] [TRAIN] epoch=11, iter=3960/80000, loss=1.0153, lr=0.009553, batch_cost=1.3749, reader_cost=0.0001 | ETA 29:02:26 2021-02-22 19:36:20 [INFO] [TRAIN] epoch=11, iter=3970/80000, loss=0.9766, lr=0.009552, batch_cost=1.3648, reader_cost=0.0001 | ETA 28:49:26 2021-02-22 19:36:33 [INFO] [TRAIN] epoch=11, iter=3980/80000, loss=0.9899, lr=0.009551, batch_cost=1.3637, reader_cost=0.0001 | ETA 28:47:52 2021-02-22 19:36:47 [INFO] [TRAIN] epoch=11, iter=3990/80000, loss=0.9225, lr=0.009550, batch_cost=1.3645, reader_cost=0.0001 | ETA 28:48:35 2021-02-22 19:37:01 [INFO] [TRAIN] epoch=11, iter=4000/80000, loss=0.9647, lr=0.009549, batch_cost=1.3828, reader_cost=0.0001 | ETA 29:11:33 2021-02-22 19:37:01 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:20 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:06 - batch_cost: 0.2141 - reader cost: 0.0811  3/125 [..............................] - ETA: 1:01 - batch_cost: 0.2861 - reader cost: 0.1111 4/125 [..............................] - ETA: 1:00 - batch_cost: 0.3340 - reader cost: 0.1378 5/125 [>.............................] - ETA: 58s - batch_cost: 0.3538 - reader cost: 0.1463  6/125 [>.............................] - ETA: 55s - batch_cost: 0.3597 - reader cost: 0.1452 7/125 [>.............................] - ETA: 54s - batch_cost: 0.3695 - reader cost: 0.1499 8/125 [>.............................] - ETA: 53s - batch_cost: 0.3749 - reader cost: 0.1506 9/125 [=>............................] - ETA: 52s - batch_cost: 0.3825 - reader cost: 0.1550 10/125 [=>............................] - ETA: 52s - batch_cost: 0.3896 - reader cost: 0.1594 11/125 [=>............................] - ETA: 51s - batch_cost: 0.3885 - reader cost: 0.1561 12/125 [=>............................] - ETA: 50s - batch_cost: 0.3956 - reader cost: 0.1613 13/125 [==>...........................] - ETA: 50s - batch_cost: 0.4007 - reader cost: 0.1648 14/125 [==>...........................] - ETA: 49s - batch_cost: 0.4008 - reader cost: 0.1638 15/125 [==>...........................] - ETA: 49s - batch_cost: 0.4044 - reader cost: 0.1655 16/125 [==>...........................] - ETA: 48s - batch_cost: 0.4031 - reader cost: 0.1632 17/125 [===>..........................] - ETA: 47s - batch_cost: 0.4047 - reader cost: 0.1638 18/125 [===>..........................] - ETA: 47s - batch_cost: 0.4068 - reader cost: 0.1652 19/125 [===>..........................] - ETA: 46s - batch_cost: 0.4085 - reader cost: 0.1664 20/125 [===>..........................] - ETA: 46s - batch_cost: 0.4074 - reader cost: 0.1647 21/125 [====>.........................] - ETA: 45s - batch_cost: 0.4106 - reader cost: 0.1666 22/125 [====>.........................] - ETA: 45s - batch_cost: 0.4084 - reader cost: 0.1640 23/125 [====>.........................] - ETA: 44s - batch_cost: 0.4111 - reader cost: 0.1662 24/125 [====>.........................] - ETA: 44s - batch_cost: 0.4131 - reader cost: 0.1676 25/125 [=====>........................] - ETA: 44s - batch_cost: 0.4151 - reader cost: 0.1691 26/125 [=====>........................] - ETA: 43s - batch_cost: 0.4142 - reader cost: 0.1680 27/125 [=====>........................] - ETA: 43s - batch_cost: 0.4147 - reader cost: 0.1681 28/125 [=====>........................] - ETA: 42s - batch_cost: 0.4143 - reader cost: 0.1676 29/125 [=====>........................] - ETA: 42s - batch_cost: 0.4154 - reader cost: 0.1682 30/125 [======>.......................] - ETA: 41s - batch_cost: 0.4159 - reader cost: 0.1687 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4150 - reader cost: 0.1677 32/125 [======>.......................] - ETA: 40s - batch_cost: 0.4136 - reader cost: 0.1662 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4144 - reader cost: 0.1670 34/125 [=======>......................] - ETA: 39s - batch_cost: 0.4146 - reader cost: 0.1671 35/125 [=======>......................] - ETA: 39s - batch_cost: 0.4149 - reader cost: 0.1673 36/125 [=======>......................] - ETA: 38s - batch_cost: 0.4155 - reader cost: 0.1678 37/125 [=======>......................] - ETA: 38s - batch_cost: 0.4164 - reader cost: 0.1684 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4172 - reader cost: 0.1691 39/125 [========>.....................] - ETA: 37s - batch_cost: 0.4187 - reader cost: 0.1699 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4188 - reader cost: 0.1698 41/125 [========>.....................] - ETA: 36s - batch_cost: 0.4191 - reader cost: 0.1699 42/125 [=========>....................] - ETA: 36s - batch_cost: 0.4199 - reader cost: 0.1705 43/125 [=========>....................] - ETA: 35s - batch_cost: 0.4202 - reader cost: 0.1707 44/125 [=========>....................] - ETA: 35s - batch_cost: 0.4207 - reader cost: 0.1712 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4210 - reader cost: 0.1714 46/125 [==========>...................] - ETA: 34s - batch_cost: 0.4216 - reader cost: 0.1719 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4219 - reader cost: 0.1722 48/125 [==========>...................] - ETA: 33s - batch_cost: 0.4213 - reader cost: 0.1715 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4202 - reader cost: 0.1704 50/125 [===========>..................] - ETA: 32s - batch_cost: 0.4195 - reader cost: 0.1697 51/125 [===========>..................] - ETA: 32s - batch_cost: 0.4201 - reader cost: 0.1702 52/125 [===========>..................] - ETA: 31s - batch_cost: 0.4208 - reader cost: 0.1709 53/125 [===========>..................] - ETA: 31s - batch_cost: 0.4211 - reader cost: 0.1712 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4214 - reader cost: 0.1715 55/125 [============>.................] - ETA: 30s - batch_cost: 0.4215 - reader cost: 0.1716 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4219 - reader cost: 0.1718 57/125 [============>.................] - ETA: 29s - batch_cost: 0.4224 - reader cost: 0.1723 58/125 [============>.................] - ETA: 29s - batch_cost: 0.4217 - reader cost: 0.1716 59/125 [=============>................] - ETA: 28s - batch_cost: 0.4219 - reader cost: 0.1718 60/125 [=============>................] - ETA: 28s - batch_cost: 0.4222 - reader cost: 0.1719 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4229 - reader cost: 0.1723 62/125 [=============>................] - ETA: 27s - batch_cost: 0.4227 - reader cost: 0.1721 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4230 - reader cost: 0.1722 64/125 [==============>...............] - ETA: 26s - batch_cost: 0.4231 - reader cost: 0.1723 65/125 [==============>...............] - ETA: 26s - batch_cost: 0.4235 - reader cost: 0.1726 66/125 [==============>...............] - ETA: 25s - batch_cost: 0.4239 - reader cost: 0.1728 67/125 [===============>..............] - ETA: 25s - batch_cost: 0.4242 - reader cost: 0.1731 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4244 - reader cost: 0.1733 69/125 [===============>..............] - ETA: 24s - batch_cost: 0.4248 - reader cost: 0.1735 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4245 - reader cost: 0.1732 71/125 [================>.............] - ETA: 23s - batch_cost: 0.4246 - reader cost: 0.1733 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4247 - reader cost: 0.1733 73/125 [================>.............] - ETA: 22s - batch_cost: 0.4248 - reader cost: 0.1734 74/125 [================>.............] - ETA: 22s - batch_cost: 0.4243 - reader cost: 0.1729 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4239 - reader cost: 0.1725 76/125 [=================>............] - ETA: 21s - batch_cost: 0.4234 - reader cost: 0.1719 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4226 - reader cost: 0.1710 78/125 [=================>............] - ETA: 20s - batch_cost: 0.4220 - reader cost: 0.1704 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4225 - reader cost: 0.1710 80/125 [==================>...........] - ETA: 19s - batch_cost: 0.4225 - reader cost: 0.1704 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4224 - reader cost: 0.1696 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4226 - reader cost: 0.1690 83/125 [==================>...........] - ETA: 18s - batch_cost: 0.4227 - reader cost: 0.1692 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4227 - reader cost: 0.1691 85/125 [===================>..........] - ETA: 17s - batch_cost: 0.4220 - reader cost: 0.1685 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4218 - reader cost: 0.1679 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4218 - reader cost: 0.1680 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4219 - reader cost: 0.1681 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4219 - reader cost: 0.1676 90/125 [====================>.........] - ETA: 15s - batch_cost: 0.4220 - reader cost: 0.1677 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4218 - reader cost: 0.1674 92/125 [=====================>........] - ETA: 14s - batch_cost: 0.4219 - reader cost: 0.1670 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4224 - reader cost: 0.1675 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4226 - reader cost: 0.1677 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4228 - reader cost: 0.1679 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4230 - reader cost: 0.1682 97/125 [======================>.......] - ETA: 12s - batch_cost: 0.4227 - reader cost: 0.1677 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4229 - reader cost: 0.1679 99/125 [======================>.......] - ETA: 11s - batch_cost: 0.4231 - reader cost: 0.1682 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4232 - reader cost: 0.1683 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4234 - reader cost: 0.1687 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4238 - reader cost: 0.1691  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4239 - reader cost: 0.1691 104/125 [=======================>......] - ETA: 9s - batch_cost: 0.4241 - reader cost: 0.1693 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4238 - reader cost: 0.1690 106/125 [========================>.....] - ETA: 8s - batch_cost: 0.4240 - reader cost: 0.1692 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4239 - reader cost: 0.1691 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4235 - reader cost: 0.1687 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4234 - reader cost: 0.1686 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4235 - reader cost: 0.1688 111/125 [=========================>....] - ETA: 6s - batch_cost: 0.4239 - reader cost: 0.1693 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4240 - reader cost: 0.1693 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4242 - reader cost: 0.1696 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4241 - reader cost: 0.1694 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4243 - reader cost: 0.1697 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4247 - reader cost: 0.1701 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4243 - reader cost: 0.1697 118/125 [===========================>..] - ETA: 3s - batch_cost: 0.4238 - reader cost: 0.1693 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4236 - reader cost: 0.1690 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4233 - reader cost: 0.1688 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4235 - reader cost: 0.1690 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4237 - reader cost: 0.1693 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4235 - reader cost: 0.1690 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4233 - reader cost: 0.1688 125/125 [==============================] - 54s 428ms/step - batch_cost: 0.4229 - reader cost: 0.1683 2021-02-22 19:37:54 [INFO] [EVAL] #Images=500 mIoU=0.7005 Acc=0.9454 Kappa=0.9289 2021-02-22 19:37:54 [INFO] [EVAL] Class IoU: [0.9657 0.7581 0.9026 0.2786 0.4897 0.5792 0.6359 0.7106 0.9091 0.5944 0.9361 0.7889 0.5766 0.933 0.6564 0.691 0.7188 0.4491 0.7364] 2021-02-22 19:37:54 [INFO] [EVAL] Class Acc: [0.9788 0.8747 0.9404 0.8164 0.7392 0.774 0.8831 0.9055 0.9415 0.707 0.9639 0.8993 0.7093 0.9688 0.7308 0.9478 0.9524 0.8665 0.8262] 2021-02-22 19:38:01 [INFO] [EVAL] The model with the best validation mIoU (0.7005) was saved at iter 4000. 2021-02-22 19:38:14 [INFO] [TRAIN] epoch=11, iter=4010/80000, loss=1.0696, lr=0.009548, batch_cost=1.3621, reader_cost=0.0001 | ETA 28:45:04 2021-02-22 19:38:28 [INFO] [TRAIN] epoch=11, iter=4020/80000, loss=0.9732, lr=0.009547, batch_cost=1.3553, reader_cost=0.0001 | ETA 28:36:16 2021-02-22 19:38:41 [INFO] [TRAIN] epoch=11, iter=4030/80000, loss=0.8857, lr=0.009546, batch_cost=1.3689, reader_cost=0.0001 | ETA 28:53:15 2021-02-22 19:38:55 [INFO] [TRAIN] epoch=11, iter=4040/80000, loss=1.1365, lr=0.009544, batch_cost=1.3582, reader_cost=0.0001 | ETA 28:39:25 2021-02-22 19:39:09 [INFO] [TRAIN] epoch=11, iter=4050/80000, loss=0.9528, lr=0.009543, batch_cost=1.3541, reader_cost=0.0001 | ETA 28:34:03 2021-02-22 19:39:22 [INFO] [TRAIN] epoch=11, iter=4060/80000, loss=1.0359, lr=0.009542, batch_cost=1.3459, reader_cost=0.0001 | ETA 28:23:24 2021-02-22 19:39:35 [INFO] [TRAIN] epoch=11, iter=4070/80000, loss=1.0737, lr=0.009541, batch_cost=1.3253, reader_cost=0.0001 | ETA 27:57:07 2021-02-22 19:39:49 [INFO] [TRAIN] epoch=11, iter=4080/80000, loss=1.0145, lr=0.009540, batch_cost=1.3667, reader_cost=0.0001 | ETA 28:49:20 2021-02-22 19:40:02 [INFO] [TRAIN] epoch=11, iter=4090/80000, loss=0.9478, lr=0.009539, batch_cost=1.3253, reader_cost=0.0001 | ETA 27:56:40 2021-02-22 19:40:17 [INFO] [TRAIN] epoch=12, iter=4100/80000, loss=0.9730, lr=0.009538, batch_cost=1.5000, reader_cost=0.0824 | ETA 31:37:33 2021-02-22 19:40:31 [INFO] [TRAIN] epoch=12, iter=4110/80000, loss=1.0085, lr=0.009537, batch_cost=1.3574, reader_cost=0.0001 | ETA 28:36:56 2021-02-22 19:40:44 [INFO] [TRAIN] epoch=12, iter=4120/80000, loss=1.0144, lr=0.009535, batch_cost=1.3355, reader_cost=0.0001 | ETA 28:09:01 2021-02-22 19:40:58 [INFO] [TRAIN] epoch=12, iter=4130/80000, loss=1.0655, lr=0.009534, batch_cost=1.3492, reader_cost=0.0001 | ETA 28:26:01 2021-02-22 19:41:11 [INFO] [TRAIN] epoch=12, iter=4140/80000, loss=0.9252, lr=0.009533, batch_cost=1.3630, reader_cost=0.0001 | ETA 28:43:15 2021-02-22 19:41:25 [INFO] [TRAIN] epoch=12, iter=4150/80000, loss=1.0836, lr=0.009532, batch_cost=1.3517, reader_cost=0.0001 | ETA 28:28:45 2021-02-22 19:41:38 [INFO] [TRAIN] epoch=12, iter=4160/80000, loss=1.0335, lr=0.009531, batch_cost=1.3661, reader_cost=0.0001 | ETA 28:46:46 2021-02-22 19:41:52 [INFO] [TRAIN] epoch=12, iter=4170/80000, loss=0.9884, lr=0.009530, batch_cost=1.3534, reader_cost=0.0001 | ETA 28:30:29 2021-02-22 19:42:06 [INFO] [TRAIN] epoch=12, iter=4180/80000, loss=1.0434, lr=0.009529, batch_cost=1.3754, reader_cost=0.0001 | ETA 28:58:01 2021-02-22 19:42:19 [INFO] [TRAIN] epoch=12, iter=4190/80000, loss=1.0392, lr=0.009527, batch_cost=1.3647, reader_cost=0.0001 | ETA 28:44:14 2021-02-22 19:42:33 [INFO] [TRAIN] epoch=12, iter=4200/80000, loss=1.0516, lr=0.009526, batch_cost=1.3439, reader_cost=0.0001 | ETA 28:17:46 2021-02-22 19:42:46 [INFO] [TRAIN] epoch=12, iter=4210/80000, loss=0.8976, lr=0.009525, batch_cost=1.3613, reader_cost=0.0001 | ETA 28:39:31 2021-02-22 19:43:00 [INFO] [TRAIN] epoch=12, iter=4220/80000, loss=0.8842, lr=0.009524, batch_cost=1.3512, reader_cost=0.0001 | ETA 28:26:31 2021-02-22 19:43:14 [INFO] [TRAIN] epoch=12, iter=4230/80000, loss=0.8937, lr=0.009523, batch_cost=1.3585, reader_cost=0.0001 | ETA 28:35:36 2021-02-22 19:43:27 [INFO] [TRAIN] epoch=12, iter=4240/80000, loss=1.0478, lr=0.009522, batch_cost=1.3522, reader_cost=0.0001 | ETA 28:27:22 2021-02-22 19:43:40 [INFO] [TRAIN] epoch=12, iter=4250/80000, loss=0.9143, lr=0.009521, batch_cost=1.3306, reader_cost=0.0001 | ETA 27:59:55 2021-02-22 19:43:54 [INFO] [TRAIN] epoch=12, iter=4260/80000, loss=0.9354, lr=0.009520, batch_cost=1.3390, reader_cost=0.0001 | ETA 28:10:16 2021-02-22 19:44:07 [INFO] [TRAIN] epoch=12, iter=4270/80000, loss=0.9722, lr=0.009518, batch_cost=1.3484, reader_cost=0.0001 | ETA 28:21:55 2021-02-22 19:44:21 [INFO] [TRAIN] epoch=12, iter=4280/80000, loss=1.0003, lr=0.009517, batch_cost=1.3579, reader_cost=0.0001 | ETA 28:33:37 2021-02-22 19:44:34 [INFO] [TRAIN] epoch=12, iter=4290/80000, loss=0.9888, lr=0.009516, batch_cost=1.3616, reader_cost=0.0001 | ETA 28:38:06 2021-02-22 19:44:48 [INFO] [TRAIN] epoch=12, iter=4300/80000, loss=0.9895, lr=0.009515, batch_cost=1.3633, reader_cost=0.0001 | ETA 28:40:04 2021-02-22 19:45:01 [INFO] [TRAIN] epoch=12, iter=4310/80000, loss=0.9185, lr=0.009514, batch_cost=1.3375, reader_cost=0.0001 | ETA 28:07:15 2021-02-22 19:45:15 [INFO] [TRAIN] epoch=12, iter=4320/80000, loss=0.9933, lr=0.009513, batch_cost=1.3599, reader_cost=0.0001 | ETA 28:35:18 2021-02-22 19:45:29 [INFO] [TRAIN] epoch=12, iter=4330/80000, loss=0.9049, lr=0.009512, batch_cost=1.3587, reader_cost=0.0001 | ETA 28:33:31 2021-02-22 19:45:42 [INFO] [TRAIN] epoch=12, iter=4340/80000, loss=1.0657, lr=0.009511, batch_cost=1.3590, reader_cost=0.0001 | ETA 28:33:40 2021-02-22 19:45:56 [INFO] [TRAIN] epoch=12, iter=4350/80000, loss=0.9478, lr=0.009509, batch_cost=1.3780, reader_cost=0.0001 | ETA 28:57:23 2021-02-22 19:46:10 [INFO] [TRAIN] epoch=12, iter=4360/80000, loss=0.9793, lr=0.009508, batch_cost=1.3682, reader_cost=0.0001 | ETA 28:44:49 2021-02-22 19:46:23 [INFO] [TRAIN] epoch=12, iter=4370/80000, loss=0.9767, lr=0.009507, batch_cost=1.3457, reader_cost=0.0001 | ETA 28:16:15 2021-02-22 19:46:37 [INFO] [TRAIN] epoch=12, iter=4380/80000, loss=0.9554, lr=0.009506, batch_cost=1.3825, reader_cost=0.0001 | ETA 29:02:27 2021-02-22 19:46:50 [INFO] [TRAIN] epoch=12, iter=4390/80000, loss=1.0890, lr=0.009505, batch_cost=1.3463, reader_cost=0.0001 | ETA 28:16:35 2021-02-22 19:47:04 [INFO] [TRAIN] epoch=12, iter=4400/80000, loss=0.8825, lr=0.009504, batch_cost=1.3625, reader_cost=0.0001 | ETA 28:36:45 2021-02-22 19:47:18 [INFO] [TRAIN] epoch=12, iter=4410/80000, loss=1.0590, lr=0.009503, batch_cost=1.3598, reader_cost=0.0001 | ETA 28:33:08 2021-02-22 19:47:31 [INFO] [TRAIN] epoch=12, iter=4420/80000, loss=0.9089, lr=0.009501, batch_cost=1.3580, reader_cost=0.0001 | ETA 28:30:36 2021-02-22 19:47:45 [INFO] [TRAIN] epoch=12, iter=4430/80000, loss=1.0438, lr=0.009500, batch_cost=1.3503, reader_cost=0.0001 | ETA 28:20:40 2021-02-22 19:47:59 [INFO] [TRAIN] epoch=12, iter=4440/80000, loss=0.8796, lr=0.009499, batch_cost=1.3810, reader_cost=0.0001 | ETA 28:59:09 2021-02-22 19:48:12 [INFO] [TRAIN] epoch=12, iter=4450/80000, loss=1.0192, lr=0.009498, batch_cost=1.3606, reader_cost=0.0001 | ETA 28:33:16 2021-02-22 19:48:26 [INFO] [TRAIN] epoch=12, iter=4460/80000, loss=1.1776, lr=0.009497, batch_cost=1.3627, reader_cost=0.0001 | ETA 28:35:39 2021-02-22 19:48:40 [INFO] [TRAIN] epoch=13, iter=4470/80000, loss=1.0002, lr=0.009496, batch_cost=1.4592, reader_cost=0.0621 | ETA 30:36:50 2021-02-22 19:48:54 [INFO] [TRAIN] epoch=13, iter=4480/80000, loss=0.9237, lr=0.009495, batch_cost=1.3627, reader_cost=0.0001 | ETA 28:35:14 2021-02-22 19:49:07 [INFO] [TRAIN] epoch=13, iter=4490/80000, loss=1.0992, lr=0.009494, batch_cost=1.3430, reader_cost=0.0001 | ETA 28:10:08 2021-02-22 19:49:21 [INFO] [TRAIN] epoch=13, iter=4500/80000, loss=1.0528, lr=0.009492, batch_cost=1.3623, reader_cost=0.0001 | ETA 28:34:16 2021-02-22 19:49:35 [INFO] [TRAIN] epoch=13, iter=4510/80000, loss=1.1515, lr=0.009491, batch_cost=1.3631, reader_cost=0.0001 | ETA 28:35:03 2021-02-22 19:49:48 [INFO] [TRAIN] epoch=13, iter=4520/80000, loss=0.9363, lr=0.009490, batch_cost=1.3660, reader_cost=0.0001 | ETA 28:38:26 2021-02-22 19:50:02 [INFO] [TRAIN] epoch=13, iter=4530/80000, loss=0.8798, lr=0.009489, batch_cost=1.3715, reader_cost=0.0001 | ETA 28:45:07 2021-02-22 19:50:16 [INFO] [TRAIN] epoch=13, iter=4540/80000, loss=1.1081, lr=0.009488, batch_cost=1.3466, reader_cost=0.0001 | ETA 28:13:37 2021-02-22 19:50:29 [INFO] [TRAIN] epoch=13, iter=4550/80000, loss=0.9377, lr=0.009487, batch_cost=1.3795, reader_cost=0.0001 | ETA 28:54:44 2021-02-22 19:50:43 [INFO] [TRAIN] epoch=13, iter=4560/80000, loss=0.9234, lr=0.009486, batch_cost=1.3362, reader_cost=0.0001 | ETA 28:00:04 2021-02-22 19:50:56 [INFO] [TRAIN] epoch=13, iter=4570/80000, loss=1.0150, lr=0.009484, batch_cost=1.3576, reader_cost=0.0001 | ETA 28:26:47 2021-02-22 19:51:10 [INFO] [TRAIN] epoch=13, iter=4580/80000, loss=1.0984, lr=0.009483, batch_cost=1.3959, reader_cost=0.0001 | ETA 29:14:35 2021-02-22 19:51:24 [INFO] [TRAIN] epoch=13, iter=4590/80000, loss=0.9492, lr=0.009482, batch_cost=1.3718, reader_cost=0.0001 | ETA 28:44:09 2021-02-22 19:51:37 [INFO] [TRAIN] epoch=13, iter=4600/80000, loss=1.0602, lr=0.009481, batch_cost=1.3496, reader_cost=0.0001 | ETA 28:15:57 2021-02-22 19:51:51 [INFO] [TRAIN] epoch=13, iter=4610/80000, loss=1.1014, lr=0.009480, batch_cost=1.3487, reader_cost=0.0001 | ETA 28:14:35 2021-02-22 19:52:05 [INFO] [TRAIN] epoch=13, iter=4620/80000, loss=0.9673, lr=0.009479, batch_cost=1.3680, reader_cost=0.0001 | ETA 28:38:37 2021-02-22 19:52:18 [INFO] [TRAIN] epoch=13, iter=4630/80000, loss=1.0008, lr=0.009478, batch_cost=1.3533, reader_cost=0.0001 | ETA 28:19:57 2021-02-22 19:52:32 [INFO] [TRAIN] epoch=13, iter=4640/80000, loss=1.0487, lr=0.009477, batch_cost=1.3681, reader_cost=0.0001 | ETA 28:38:20 2021-02-22 19:52:45 [INFO] [TRAIN] epoch=13, iter=4650/80000, loss=0.9308, lr=0.009475, batch_cost=1.3613, reader_cost=0.0001 | ETA 28:29:30 2021-02-22 19:52:59 [INFO] [TRAIN] epoch=13, iter=4660/80000, loss=1.0080, lr=0.009474, batch_cost=1.3613, reader_cost=0.0001 | ETA 28:29:21 2021-02-22 19:53:13 [INFO] [TRAIN] epoch=13, iter=4670/80000, loss=1.0209, lr=0.009473, batch_cost=1.3815, reader_cost=0.0001 | ETA 28:54:27 2021-02-22 19:53:26 [INFO] [TRAIN] epoch=13, iter=4680/80000, loss=0.9677, lr=0.009472, batch_cost=1.3562, reader_cost=0.0001 | ETA 28:22:27 2021-02-22 19:53:40 [INFO] [TRAIN] epoch=13, iter=4690/80000, loss=1.0226, lr=0.009471, batch_cost=1.3784, reader_cost=0.0001 | ETA 28:50:07 2021-02-22 19:53:54 [INFO] [TRAIN] epoch=13, iter=4700/80000, loss=0.9337, lr=0.009470, batch_cost=1.3496, reader_cost=0.0001 | ETA 28:13:44 2021-02-22 19:54:07 [INFO] [TRAIN] epoch=13, iter=4710/80000, loss=0.9892, lr=0.009469, batch_cost=1.3446, reader_cost=0.0001 | ETA 28:07:16 2021-02-22 19:54:21 [INFO] [TRAIN] epoch=13, iter=4720/80000, loss=1.0744, lr=0.009468, batch_cost=1.3737, reader_cost=0.0001 | ETA 28:43:33 2021-02-22 19:54:35 [INFO] [TRAIN] epoch=13, iter=4730/80000, loss=0.9316, lr=0.009466, batch_cost=1.3800, reader_cost=0.0001 | ETA 28:51:12 2021-02-22 19:54:48 [INFO] [TRAIN] epoch=13, iter=4740/80000, loss=0.9429, lr=0.009465, batch_cost=1.3484, reader_cost=0.0001 | ETA 28:11:20 2021-02-22 19:55:02 [INFO] [TRAIN] epoch=13, iter=4750/80000, loss=0.8936, lr=0.009464, batch_cost=1.3419, reader_cost=0.0001 | ETA 28:02:58 2021-02-22 19:55:15 [INFO] [TRAIN] epoch=13, iter=4760/80000, loss=0.9845, lr=0.009463, batch_cost=1.3633, reader_cost=0.0001 | ETA 28:29:35 2021-02-22 19:55:29 [INFO] [TRAIN] epoch=13, iter=4770/80000, loss=0.8714, lr=0.009462, batch_cost=1.3538, reader_cost=0.0001 | ETA 28:17:22 2021-02-22 19:55:42 [INFO] [TRAIN] epoch=13, iter=4780/80000, loss=0.9901, lr=0.009461, batch_cost=1.3511, reader_cost=0.0001 | ETA 28:13:46 2021-02-22 19:55:56 [INFO] [TRAIN] epoch=13, iter=4790/80000, loss=1.0360, lr=0.009460, batch_cost=1.3917, reader_cost=0.0001 | ETA 29:04:26 2021-02-22 19:56:10 [INFO] [TRAIN] epoch=13, iter=4800/80000, loss=0.8844, lr=0.009458, batch_cost=1.3607, reader_cost=0.0001 | ETA 28:25:26 2021-02-22 19:56:23 [INFO] [TRAIN] epoch=13, iter=4810/80000, loss=1.2276, lr=0.009457, batch_cost=1.3578, reader_cost=0.0001 | ETA 28:21:32 2021-02-22 19:56:37 [INFO] [TRAIN] epoch=13, iter=4820/80000, loss=0.8957, lr=0.009456, batch_cost=1.3572, reader_cost=0.0001 | ETA 28:20:31 2021-02-22 19:56:51 [INFO] [TRAIN] epoch=13, iter=4830/80000, loss=0.9704, lr=0.009455, batch_cost=1.3573, reader_cost=0.0001 | ETA 28:20:28 2021-02-22 19:57:05 [INFO] [TRAIN] epoch=14, iter=4840/80000, loss=1.0696, lr=0.009454, batch_cost=1.4388, reader_cost=0.0922 | ETA 30:02:17 2021-02-22 19:57:18 [INFO] [TRAIN] epoch=14, iter=4850/80000, loss=0.8130, lr=0.009453, batch_cost=1.3427, reader_cost=0.0001 | ETA 28:01:42 2021-02-22 19:57:32 [INFO] [TRAIN] epoch=14, iter=4860/80000, loss=0.9974, lr=0.009452, batch_cost=1.3553, reader_cost=0.0001 | ETA 28:17:18 2021-02-22 19:57:45 [INFO] [TRAIN] epoch=14, iter=4870/80000, loss=1.0239, lr=0.009451, batch_cost=1.3429, reader_cost=0.0001 | ETA 28:01:29 2021-02-22 19:57:59 [INFO] [TRAIN] epoch=14, iter=4880/80000, loss=1.0025, lr=0.009449, batch_cost=1.3681, reader_cost=0.0001 | ETA 28:32:52 2021-02-22 19:58:12 [INFO] [TRAIN] epoch=14, iter=4890/80000, loss=0.9974, lr=0.009448, batch_cost=1.3447, reader_cost=0.0001 | ETA 28:03:20 2021-02-22 19:58:26 [INFO] [TRAIN] epoch=14, iter=4900/80000, loss=1.1415, lr=0.009447, batch_cost=1.3784, reader_cost=0.0001 | ETA 28:45:18 2021-02-22 19:58:40 [INFO] [TRAIN] epoch=14, iter=4910/80000, loss=1.0578, lr=0.009446, batch_cost=1.3323, reader_cost=0.0001 | ETA 27:47:23 2021-02-22 19:58:53 [INFO] [TRAIN] epoch=14, iter=4920/80000, loss=1.1157, lr=0.009445, batch_cost=1.3842, reader_cost=0.0001 | ETA 28:52:03 2021-02-22 19:59:07 [INFO] [TRAIN] epoch=14, iter=4930/80000, loss=0.9655, lr=0.009444, batch_cost=1.3817, reader_cost=0.0001 | ETA 28:48:43 2021-02-22 19:59:21 [INFO] [TRAIN] epoch=14, iter=4940/80000, loss=1.0113, lr=0.009443, batch_cost=1.3539, reader_cost=0.0001 | ETA 28:13:43 2021-02-22 19:59:34 [INFO] [TRAIN] epoch=14, iter=4950/80000, loss=0.9473, lr=0.009441, batch_cost=1.3522, reader_cost=0.0001 | ETA 28:11:22 2021-02-22 19:59:48 [INFO] [TRAIN] epoch=14, iter=4960/80000, loss=1.0695, lr=0.009440, batch_cost=1.3633, reader_cost=0.0001 | ETA 28:24:58 2021-02-22 20:00:01 [INFO] [TRAIN] epoch=14, iter=4970/80000, loss=1.0852, lr=0.009439, batch_cost=1.3546, reader_cost=0.0001 | ETA 28:13:53 2021-02-22 20:00:15 [INFO] [TRAIN] epoch=14, iter=4980/80000, loss=0.9575, lr=0.009438, batch_cost=1.3842, reader_cost=0.0001 | ETA 28:50:39 2021-02-22 20:00:29 [INFO] [TRAIN] epoch=14, iter=4990/80000, loss=0.9430, lr=0.009437, batch_cost=1.3211, reader_cost=0.0001 | ETA 27:31:35 2021-02-22 20:00:42 [INFO] [TRAIN] epoch=14, iter=5000/80000, loss=0.9561, lr=0.009436, batch_cost=1.3698, reader_cost=0.0001 | ETA 28:32:12 2021-02-22 20:00:42 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:13 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:03 - batch_cost: 0.2154 - reader cost: 0.0889  3/125 [..............................] - ETA: 58s - batch_cost: 0.2855 - reader cost: 0.1176  4/125 [..............................] - ETA: 57s - batch_cost: 0.3261 - reader cost: 0.1335 5/125 [>.............................] - ETA: 55s - batch_cost: 0.3455 - reader cost: 0.1411 6/125 [>.............................] - ETA: 54s - batch_cost: 0.3615 - reader cost: 0.1493 7/125 [>.............................] - ETA: 53s - batch_cost: 0.3705 - reader cost: 0.1528 8/125 [>.............................] - ETA: 52s - batch_cost: 0.3773 - reader cost: 0.1516 9/125 [=>............................] - ETA: 52s - batch_cost: 0.3859 - reader cost: 0.1545 10/125 [=>............................] - ETA: 52s - batch_cost: 0.3938 - reader cost: 0.1565 11/125 [=>............................] - ETA: 51s - batch_cost: 0.3971 - reader cost: 0.1573 12/125 [=>............................] - ETA: 50s - batch_cost: 0.3960 - reader cost: 0.1525 13/125 [==>...........................] - ETA: 49s - batch_cost: 0.4003 - reader cost: 0.1564 14/125 [==>...........................] - ETA: 49s - batch_cost: 0.4007 - reader cost: 0.1562 15/125 [==>...........................] - ETA: 48s - batch_cost: 0.4027 - reader cost: 0.1580 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.4006 - reader cost: 0.1553 17/125 [===>..........................] - ETA: 47s - batch_cost: 0.4044 - reader cost: 0.1563 18/125 [===>..........................] - ETA: 47s - batch_cost: 0.4068 - reader cost: 0.1569 19/125 [===>..........................] - ETA: 46s - batch_cost: 0.4088 - reader cost: 0.1590 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4076 - reader cost: 0.1575 21/125 [====>.........................] - ETA: 45s - batch_cost: 0.4086 - reader cost: 0.1581 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4074 - reader cost: 0.1565 23/125 [====>.........................] - ETA: 44s - batch_cost: 0.4081 - reader cost: 0.1569 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4069 - reader cost: 0.1547 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4043 - reader cost: 0.1520 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4048 - reader cost: 0.1526 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4051 - reader cost: 0.1514 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4058 - reader cost: 0.1519 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4070 - reader cost: 0.1515 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4081 - reader cost: 0.1528 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4087 - reader cost: 0.1535 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4094 - reader cost: 0.1545 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4105 - reader cost: 0.1558 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4095 - reader cost: 0.1549 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4099 - reader cost: 0.1554 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4103 - reader cost: 0.1559 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4111 - reader cost: 0.1565 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4097 - reader cost: 0.1553 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4101 - reader cost: 0.1558 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4089 - reader cost: 0.1547 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4094 - reader cost: 0.1553 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4099 - reader cost: 0.1554 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4100 - reader cost: 0.1556 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4091 - reader cost: 0.1546 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4094 - reader cost: 0.1551 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4099 - reader cost: 0.1557 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4100 - reader cost: 0.1560 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4105 - reader cost: 0.1565 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4112 - reader cost: 0.1571 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4115 - reader cost: 0.1573 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4115 - reader cost: 0.1573 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4110 - reader cost: 0.1565 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4106 - reader cost: 0.1561 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4103 - reader cost: 0.1559 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4111 - reader cost: 0.1565 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4113 - reader cost: 0.1566 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4115 - reader cost: 0.1569 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4107 - reader cost: 0.1562 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4111 - reader cost: 0.1567 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4106 - reader cost: 0.1563 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4108 - reader cost: 0.1566 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4111 - reader cost: 0.1569 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4115 - reader cost: 0.1573 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4119 - reader cost: 0.1577 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4122 - reader cost: 0.1579 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4127 - reader cost: 0.1585 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4129 - reader cost: 0.1588 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4130 - reader cost: 0.1589 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4127 - reader cost: 0.1587 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4122 - reader cost: 0.1582 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4115 - reader cost: 0.1575 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4117 - reader cost: 0.1578 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4119 - reader cost: 0.1579 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4116 - reader cost: 0.1577 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4115 - reader cost: 0.1574 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4118 - reader cost: 0.1578 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4123 - reader cost: 0.1581 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4122 - reader cost: 0.1579 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4118 - reader cost: 0.1576 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4121 - reader cost: 0.1579 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4122 - reader cost: 0.1581 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4120 - reader cost: 0.1576 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4122 - reader cost: 0.1579 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4126 - reader cost: 0.1583 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4126 - reader cost: 0.1584 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4129 - reader cost: 0.1586 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4127 - reader cost: 0.1584 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4130 - reader cost: 0.1587 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4131 - reader cost: 0.1589 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4131 - reader cost: 0.1583 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4133 - reader cost: 0.1579 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4134 - reader cost: 0.1580 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4136 - reader cost: 0.1583 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4133 - reader cost: 0.1579 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4133 - reader cost: 0.1576 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4136 - reader cost: 0.1574 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4135 - reader cost: 0.1568 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4131 - reader cost: 0.1565 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4134 - reader cost: 0.1560 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4137 - reader cost: 0.1557 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4140 - reader cost: 0.1558 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4145 - reader cost: 0.1559  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4144 - reader cost: 0.1556 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4146 - reader cost: 0.1558 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4150 - reader cost: 0.1560 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4151 - reader cost: 0.1562 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4152 - reader cost: 0.1560 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4152 - reader cost: 0.1559 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4152 - reader cost: 0.1555 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4149 - reader cost: 0.1548 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4150 - reader cost: 0.1546 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4152 - reader cost: 0.1539 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4150 - reader cost: 0.1536 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4151 - reader cost: 0.1538 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4154 - reader cost: 0.1542 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4150 - reader cost: 0.1539 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4150 - reader cost: 0.1539 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4150 - reader cost: 0.1538 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4146 - reader cost: 0.1535 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4148 - reader cost: 0.1538 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4149 - reader cost: 0.1540 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4148 - reader cost: 0.1539 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4148 - reader cost: 0.1538 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4151 - reader cost: 0.1535 125/125 [==============================] - 52s 420ms/step - batch_cost: 0.4152 - reader cost: 0.1531 2021-02-22 20:01:35 [INFO] [EVAL] #Images=500 mIoU=0.7121 Acc=0.9478 Kappa=0.9321 2021-02-22 20:01:35 [INFO] [EVAL] Class IoU: [0.9687 0.7772 0.9038 0.4632 0.5071 0.5898 0.6547 0.7533 0.9112 0.529 0.9297 0.7999 0.584 0.9305 0.5908 0.6827 0.6109 0.5927 0.7499] 2021-02-22 20:01:35 [INFO] [EVAL] Class Acc: [0.9787 0.9138 0.9467 0.7255 0.8626 0.8144 0.7256 0.8774 0.9424 0.8557 0.9443 0.8958 0.7653 0.9558 0.6496 0.7627 0.6853 0.7629 0.8323] 2021-02-22 20:01:41 [INFO] [EVAL] The model with the best validation mIoU (0.7121) was saved at iter 5000. 2021-02-22 20:01:55 [INFO] [TRAIN] epoch=14, iter=5010/80000, loss=0.8765, lr=0.009435, batch_cost=1.3590, reader_cost=0.0001 | ETA 28:18:31 2021-02-22 20:02:08 [INFO] [TRAIN] epoch=14, iter=5020/80000, loss=0.9582, lr=0.009434, batch_cost=1.3274, reader_cost=0.0001 | ETA 27:38:46 2021-02-22 20:02:22 [INFO] [TRAIN] epoch=14, iter=5030/80000, loss=0.8808, lr=0.009432, batch_cost=1.3810, reader_cost=0.0001 | ETA 28:45:30 2021-02-22 20:02:35 [INFO] [TRAIN] epoch=14, iter=5040/80000, loss=1.0119, lr=0.009431, batch_cost=1.3486, reader_cost=0.0001 | ETA 28:04:53 2021-02-22 20:02:49 [INFO] [TRAIN] epoch=14, iter=5050/80000, loss=0.8916, lr=0.009430, batch_cost=1.3445, reader_cost=0.0001 | ETA 27:59:32 2021-02-22 20:03:02 [INFO] [TRAIN] epoch=14, iter=5060/80000, loss=0.9576, lr=0.009429, batch_cost=1.3489, reader_cost=0.0001 | ETA 28:04:48 2021-02-22 20:03:16 [INFO] [TRAIN] epoch=14, iter=5070/80000, loss=0.9555, lr=0.009428, batch_cost=1.3847, reader_cost=0.0001 | ETA 28:49:15 2021-02-22 20:03:30 [INFO] [TRAIN] epoch=14, iter=5080/80000, loss=0.9554, lr=0.009427, batch_cost=1.3853, reader_cost=0.0001 | ETA 28:49:49 2021-02-22 20:03:44 [INFO] [TRAIN] epoch=14, iter=5090/80000, loss=0.9677, lr=0.009426, batch_cost=1.3745, reader_cost=0.0001 | ETA 28:36:01 2021-02-22 20:03:57 [INFO] [TRAIN] epoch=14, iter=5100/80000, loss=1.0239, lr=0.009424, batch_cost=1.3628, reader_cost=0.0001 | ETA 28:21:16 2021-02-22 20:04:11 [INFO] [TRAIN] epoch=14, iter=5110/80000, loss=0.8622, lr=0.009423, batch_cost=1.3419, reader_cost=0.0001 | ETA 27:54:55 2021-02-22 20:04:25 [INFO] [TRAIN] epoch=14, iter=5120/80000, loss=1.0358, lr=0.009422, batch_cost=1.3798, reader_cost=0.0001 | ETA 28:41:56 2021-02-22 20:04:38 [INFO] [TRAIN] epoch=14, iter=5130/80000, loss=0.9282, lr=0.009421, batch_cost=1.3653, reader_cost=0.0001 | ETA 28:23:39 2021-02-22 20:04:52 [INFO] [TRAIN] epoch=14, iter=5140/80000, loss=1.0970, lr=0.009420, batch_cost=1.3593, reader_cost=0.0001 | ETA 28:16:00 2021-02-22 20:05:05 [INFO] [TRAIN] epoch=14, iter=5150/80000, loss=0.9399, lr=0.009419, batch_cost=1.3634, reader_cost=0.0001 | ETA 28:20:50 2021-02-22 20:05:19 [INFO] [TRAIN] epoch=14, iter=5160/80000, loss=1.0339, lr=0.009418, batch_cost=1.3513, reader_cost=0.0001 | ETA 28:05:27 2021-02-22 20:05:33 [INFO] [TRAIN] epoch=14, iter=5170/80000, loss=0.9074, lr=0.009417, batch_cost=1.3717, reader_cost=0.0001 | ETA 28:30:43 2021-02-22 20:05:46 [INFO] [TRAIN] epoch=14, iter=5180/80000, loss=0.9751, lr=0.009415, batch_cost=1.3677, reader_cost=0.0001 | ETA 28:25:29 2021-02-22 20:06:00 [INFO] [TRAIN] epoch=14, iter=5190/80000, loss=1.0393, lr=0.009414, batch_cost=1.3615, reader_cost=0.0001 | ETA 28:17:34 2021-02-22 20:06:14 [INFO] [TRAIN] epoch=14, iter=5200/80000, loss=1.0072, lr=0.009413, batch_cost=1.3584, reader_cost=0.0001 | ETA 28:13:25 2021-02-22 20:06:28 [INFO] [TRAIN] epoch=15, iter=5210/80000, loss=0.9593, lr=0.009412, batch_cost=1.4432, reader_cost=0.0738 | ETA 29:58:57 2021-02-22 20:06:42 [INFO] [TRAIN] epoch=15, iter=5220/80000, loss=0.9446, lr=0.009411, batch_cost=1.3884, reader_cost=0.0001 | ETA 28:50:24 2021-02-22 20:06:55 [INFO] [TRAIN] epoch=15, iter=5230/80000, loss=1.0786, lr=0.009410, batch_cost=1.3542, reader_cost=0.0001 | ETA 28:07:31 2021-02-22 20:07:09 [INFO] [TRAIN] epoch=15, iter=5240/80000, loss=1.0100, lr=0.009409, batch_cost=1.3307, reader_cost=0.0001 | ETA 27:38:04 2021-02-22 20:07:22 [INFO] [TRAIN] epoch=15, iter=5250/80000, loss=1.0294, lr=0.009408, batch_cost=1.3595, reader_cost=0.0001 | ETA 28:13:42 2021-02-22 20:07:36 [INFO] [TRAIN] epoch=15, iter=5260/80000, loss=1.0643, lr=0.009406, batch_cost=1.3637, reader_cost=0.0001 | ETA 28:18:46 2021-02-22 20:07:50 [INFO] [TRAIN] epoch=15, iter=5270/80000, loss=0.9215, lr=0.009405, batch_cost=1.3907, reader_cost=0.0001 | ETA 28:52:06 2021-02-22 20:08:03 [INFO] [TRAIN] epoch=15, iter=5280/80000, loss=0.8729, lr=0.009404, batch_cost=1.3471, reader_cost=0.0001 | ETA 27:57:32 2021-02-22 20:08:17 [INFO] [TRAIN] epoch=15, iter=5290/80000, loss=1.0006, lr=0.009403, batch_cost=1.3532, reader_cost=0.0001 | ETA 28:04:55 2021-02-22 20:08:31 [INFO] [TRAIN] epoch=15, iter=5300/80000, loss=1.0035, lr=0.009402, batch_cost=1.3769, reader_cost=0.0001 | ETA 28:34:17 2021-02-22 20:08:44 [INFO] [TRAIN] epoch=15, iter=5310/80000, loss=1.0408, lr=0.009401, batch_cost=1.3650, reader_cost=0.0001 | ETA 28:19:08 2021-02-22 20:08:58 [INFO] [TRAIN] epoch=15, iter=5320/80000, loss=0.9636, lr=0.009400, batch_cost=1.3597, reader_cost=0.0001 | ETA 28:12:24 2021-02-22 20:09:11 [INFO] [TRAIN] epoch=15, iter=5330/80000, loss=0.9514, lr=0.009398, batch_cost=1.3487, reader_cost=0.0001 | ETA 27:58:30 2021-02-22 20:09:25 [INFO] [TRAIN] epoch=15, iter=5340/80000, loss=0.9440, lr=0.009397, batch_cost=1.3649, reader_cost=0.0001 | ETA 28:18:25 2021-02-22 20:09:38 [INFO] [TRAIN] epoch=15, iter=5350/80000, loss=0.9294, lr=0.009396, batch_cost=1.3349, reader_cost=0.0001 | ETA 27:40:49 2021-02-22 20:09:52 [INFO] [TRAIN] epoch=15, iter=5360/80000, loss=1.0164, lr=0.009395, batch_cost=1.3710, reader_cost=0.0001 | ETA 28:25:30 2021-02-22 20:10:06 [INFO] [TRAIN] epoch=15, iter=5370/80000, loss=0.9267, lr=0.009394, batch_cost=1.3550, reader_cost=0.0001 | ETA 28:05:27 2021-02-22 20:10:20 [INFO] [TRAIN] epoch=15, iter=5380/80000, loss=0.9628, lr=0.009393, batch_cost=1.3902, reader_cost=0.0001 | ETA 28:48:53 2021-02-22 20:10:33 [INFO] [TRAIN] epoch=15, iter=5390/80000, loss=0.9841, lr=0.009392, batch_cost=1.3581, reader_cost=0.0001 | ETA 28:08:48 2021-02-22 20:10:47 [INFO] [TRAIN] epoch=15, iter=5400/80000, loss=0.9839, lr=0.009391, batch_cost=1.3725, reader_cost=0.0001 | ETA 28:26:26 2021-02-22 20:11:01 [INFO] [TRAIN] epoch=15, iter=5410/80000, loss=0.9058, lr=0.009389, batch_cost=1.3723, reader_cost=0.0001 | ETA 28:26:02 2021-02-22 20:11:14 [INFO] [TRAIN] epoch=15, iter=5420/80000, loss=0.9875, lr=0.009388, batch_cost=1.3568, reader_cost=0.0001 | ETA 28:06:31 2021-02-22 20:11:28 [INFO] [TRAIN] epoch=15, iter=5430/80000, loss=0.9291, lr=0.009387, batch_cost=1.3440, reader_cost=0.0001 | ETA 27:50:24 2021-02-22 20:11:41 [INFO] [TRAIN] epoch=15, iter=5440/80000, loss=0.9580, lr=0.009386, batch_cost=1.3720, reader_cost=0.0001 | ETA 28:24:55 2021-02-22 20:11:55 [INFO] [TRAIN] epoch=15, iter=5450/80000, loss=0.9319, lr=0.009385, batch_cost=1.3608, reader_cost=0.0001 | ETA 28:10:51 2021-02-22 20:12:09 [INFO] [TRAIN] epoch=15, iter=5460/80000, loss=0.9789, lr=0.009384, batch_cost=1.3676, reader_cost=0.0001 | ETA 28:19:00 2021-02-22 20:12:22 [INFO] [TRAIN] epoch=15, iter=5470/80000, loss=0.9687, lr=0.009383, batch_cost=1.3527, reader_cost=0.0001 | ETA 28:00:14 2021-02-22 20:12:36 [INFO] [TRAIN] epoch=15, iter=5480/80000, loss=0.8250, lr=0.009381, batch_cost=1.3919, reader_cost=0.0001 | ETA 28:48:40 2021-02-22 20:12:49 [INFO] [TRAIN] epoch=15, iter=5490/80000, loss=0.8597, lr=0.009380, batch_cost=1.3388, reader_cost=0.0001 | ETA 27:42:31 2021-02-22 20:13:03 [INFO] [TRAIN] epoch=15, iter=5500/80000, loss=1.0423, lr=0.009379, batch_cost=1.3715, reader_cost=0.0001 | ETA 28:22:54 2021-02-22 20:13:17 [INFO] [TRAIN] epoch=15, iter=5510/80000, loss=1.0324, lr=0.009378, batch_cost=1.3592, reader_cost=0.0001 | ETA 28:07:26 2021-02-22 20:13:30 [INFO] [TRAIN] epoch=15, iter=5520/80000, loss=0.9470, lr=0.009377, batch_cost=1.3655, reader_cost=0.0001 | ETA 28:14:59 2021-02-22 20:13:44 [INFO] [TRAIN] epoch=15, iter=5530/80000, loss=1.0345, lr=0.009376, batch_cost=1.3581, reader_cost=0.0001 | ETA 28:05:39 2021-02-22 20:13:58 [INFO] [TRAIN] epoch=15, iter=5540/80000, loss=0.9788, lr=0.009375, batch_cost=1.3928, reader_cost=0.0001 | ETA 28:48:25 2021-02-22 20:14:12 [INFO] [TRAIN] epoch=15, iter=5550/80000, loss=0.9104, lr=0.009374, batch_cost=1.3708, reader_cost=0.0001 | ETA 28:20:58 2021-02-22 20:14:25 [INFO] [TRAIN] epoch=15, iter=5560/80000, loss=0.9600, lr=0.009372, batch_cost=1.3658, reader_cost=0.0001 | ETA 28:14:29 2021-02-22 20:14:39 [INFO] [TRAIN] epoch=15, iter=5570/80000, loss=0.9511, lr=0.009371, batch_cost=1.3510, reader_cost=0.0001 | ETA 27:55:57 2021-02-22 20:14:52 [INFO] [TRAIN] epoch=15, iter=5580/80000, loss=1.0232, lr=0.009370, batch_cost=1.3450, reader_cost=0.0001 | ETA 27:48:17 2021-02-22 20:15:07 [INFO] [TRAIN] epoch=16, iter=5590/80000, loss=0.9203, lr=0.009369, batch_cost=1.4796, reader_cost=0.0703 | ETA 30:34:57 2021-02-22 20:15:21 [INFO] [TRAIN] epoch=16, iter=5600/80000, loss=0.9419, lr=0.009368, batch_cost=1.3555, reader_cost=0.0001 | ETA 28:00:47 2021-02-22 20:15:34 [INFO] [TRAIN] epoch=16, iter=5610/80000, loss=0.9750, lr=0.009367, batch_cost=1.3612, reader_cost=0.0001 | ETA 28:07:38 2021-02-22 20:15:48 [INFO] [TRAIN] epoch=16, iter=5620/80000, loss=0.9429, lr=0.009366, batch_cost=1.3610, reader_cost=0.0001 | ETA 28:07:08 2021-02-22 20:16:02 [INFO] [TRAIN] epoch=16, iter=5630/80000, loss=0.9880, lr=0.009364, batch_cost=1.3787, reader_cost=0.0001 | ETA 28:28:56 2021-02-22 20:16:15 [INFO] [TRAIN] epoch=16, iter=5640/80000, loss=0.9621, lr=0.009363, batch_cost=1.3373, reader_cost=0.0001 | ETA 27:37:21 2021-02-22 20:16:29 [INFO] [TRAIN] epoch=16, iter=5650/80000, loss=1.0016, lr=0.009362, batch_cost=1.3706, reader_cost=0.0001 | ETA 28:18:22 2021-02-22 20:16:42 [INFO] [TRAIN] epoch=16, iter=5660/80000, loss=1.2406, lr=0.009361, batch_cost=1.3499, reader_cost=0.0001 | ETA 27:52:31 2021-02-22 20:16:56 [INFO] [TRAIN] epoch=16, iter=5670/80000, loss=0.9749, lr=0.009360, batch_cost=1.3600, reader_cost=0.0001 | ETA 28:04:51 2021-02-22 20:17:09 [INFO] [TRAIN] epoch=16, iter=5680/80000, loss=1.1083, lr=0.009359, batch_cost=1.3536, reader_cost=0.0001 | ETA 27:56:42 2021-02-22 20:17:23 [INFO] [TRAIN] epoch=16, iter=5690/80000, loss=0.8586, lr=0.009358, batch_cost=1.3537, reader_cost=0.0001 | ETA 27:56:36 2021-02-22 20:17:37 [INFO] [TRAIN] epoch=16, iter=5700/80000, loss=0.8970, lr=0.009357, batch_cost=1.3686, reader_cost=0.0001 | ETA 28:14:48 2021-02-22 20:17:50 [INFO] [TRAIN] epoch=16, iter=5710/80000, loss=0.8757, lr=0.009355, batch_cost=1.3667, reader_cost=0.0001 | ETA 28:12:08 2021-02-22 20:18:04 [INFO] [TRAIN] epoch=16, iter=5720/80000, loss=0.9474, lr=0.009354, batch_cost=1.3668, reader_cost=0.0001 | ETA 28:12:06 2021-02-22 20:18:17 [INFO] [TRAIN] epoch=16, iter=5730/80000, loss=1.0619, lr=0.009353, batch_cost=1.3633, reader_cost=0.0001 | ETA 28:07:31 2021-02-22 20:18:31 [INFO] [TRAIN] epoch=16, iter=5740/80000, loss=0.9371, lr=0.009352, batch_cost=1.3544, reader_cost=0.0001 | ETA 27:56:19 2021-02-22 20:18:45 [INFO] [TRAIN] epoch=16, iter=5750/80000, loss=0.9859, lr=0.009351, batch_cost=1.3687, reader_cost=0.0001 | ETA 28:13:44 2021-02-22 20:18:58 [INFO] [TRAIN] epoch=16, iter=5760/80000, loss=1.1058, lr=0.009350, batch_cost=1.3344, reader_cost=0.0001 | ETA 27:31:06 2021-02-22 20:19:12 [INFO] [TRAIN] epoch=16, iter=5770/80000, loss=1.0383, lr=0.009349, batch_cost=1.3581, reader_cost=0.0001 | ETA 28:00:11 2021-02-22 20:19:25 [INFO] [TRAIN] epoch=16, iter=5780/80000, loss=0.9240, lr=0.009347, batch_cost=1.3465, reader_cost=0.0001 | ETA 27:45:34 2021-02-22 20:19:39 [INFO] [TRAIN] epoch=16, iter=5790/80000, loss=0.9464, lr=0.009346, batch_cost=1.3606, reader_cost=0.0001 | ETA 28:02:46 2021-02-22 20:19:52 [INFO] [TRAIN] epoch=16, iter=5800/80000, loss=0.9122, lr=0.009345, batch_cost=1.3541, reader_cost=0.0001 | ETA 27:54:35 2021-02-22 20:20:06 [INFO] [TRAIN] epoch=16, iter=5810/80000, loss=0.9619, lr=0.009344, batch_cost=1.3517, reader_cost=0.0001 | ETA 27:51:25 2021-02-22 20:20:19 [INFO] [TRAIN] epoch=16, iter=5820/80000, loss=1.0441, lr=0.009343, batch_cost=1.3490, reader_cost=0.0001 | ETA 27:47:51 2021-02-22 20:20:33 [INFO] [TRAIN] epoch=16, iter=5830/80000, loss=1.1244, lr=0.009342, batch_cost=1.3828, reader_cost=0.0001 | ETA 28:29:19 2021-02-22 20:20:46 [INFO] [TRAIN] epoch=16, iter=5840/80000, loss=0.9859, lr=0.009341, batch_cost=1.3407, reader_cost=0.0001 | ETA 27:37:07 2021-02-22 20:21:00 [INFO] [TRAIN] epoch=16, iter=5850/80000, loss=0.8352, lr=0.009340, batch_cost=1.3691, reader_cost=0.0001 | ETA 28:12:02 2021-02-22 20:21:14 [INFO] [TRAIN] epoch=16, iter=5860/80000, loss=0.9969, lr=0.009338, batch_cost=1.3676, reader_cost=0.0001 | ETA 28:09:50 2021-02-22 20:21:28 [INFO] [TRAIN] epoch=16, iter=5870/80000, loss=1.1030, lr=0.009337, batch_cost=1.3795, reader_cost=0.0001 | ETA 28:24:24 2021-02-22 20:21:41 [INFO] [TRAIN] epoch=16, iter=5880/80000, loss=1.0083, lr=0.009336, batch_cost=1.3838, reader_cost=0.0001 | ETA 28:29:30 2021-02-22 20:21:55 [INFO] [TRAIN] epoch=16, iter=5890/80000, loss=1.0621, lr=0.009335, batch_cost=1.3542, reader_cost=0.0001 | ETA 27:52:42 2021-02-22 20:22:09 [INFO] [TRAIN] epoch=16, iter=5900/80000, loss=0.9974, lr=0.009334, batch_cost=1.3760, reader_cost=0.0001 | ETA 28:19:20 2021-02-22 20:22:22 [INFO] [TRAIN] epoch=16, iter=5910/80000, loss=1.0750, lr=0.009333, batch_cost=1.3505, reader_cost=0.0001 | ETA 27:47:38 2021-02-22 20:22:36 [INFO] [TRAIN] epoch=16, iter=5920/80000, loss=0.8839, lr=0.009332, batch_cost=1.3459, reader_cost=0.0001 | ETA 27:41:44 2021-02-22 20:22:49 [INFO] [TRAIN] epoch=16, iter=5930/80000, loss=1.0393, lr=0.009330, batch_cost=1.3418, reader_cost=0.0001 | ETA 27:36:27 2021-02-22 20:23:03 [INFO] [TRAIN] epoch=16, iter=5940/80000, loss=1.3709, lr=0.009329, batch_cost=1.3715, reader_cost=0.0001 | ETA 28:12:56 2021-02-22 20:23:16 [INFO] [TRAIN] epoch=16, iter=5950/80000, loss=0.9362, lr=0.009328, batch_cost=1.3456, reader_cost=0.0001 | ETA 27:40:38 2021-02-22 20:23:31 [INFO] [TRAIN] epoch=17, iter=5960/80000, loss=0.9222, lr=0.009327, batch_cost=1.4665, reader_cost=0.0858 | ETA 30:09:42 2021-02-22 20:23:45 [INFO] [TRAIN] epoch=17, iter=5970/80000, loss=1.0432, lr=0.009326, batch_cost=1.3831, reader_cost=0.0001 | ETA 28:26:31 2021-02-22 20:23:59 [INFO] [TRAIN] epoch=17, iter=5980/80000, loss=1.0974, lr=0.009325, batch_cost=1.3755, reader_cost=0.0001 | ETA 28:16:51 2021-02-22 20:24:12 [INFO] [TRAIN] epoch=17, iter=5990/80000, loss=1.0304, lr=0.009324, batch_cost=1.3434, reader_cost=0.0001 | ETA 27:37:04 2021-02-22 20:24:26 [INFO] [TRAIN] epoch=17, iter=6000/80000, loss=0.9156, lr=0.009323, batch_cost=1.3748, reader_cost=0.0001 | ETA 28:15:37 2021-02-22 20:24:26 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:08 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:02 - batch_cost: 0.2297 - reader cost: 0.1057  3/125 [..............................] - ETA: 58s - batch_cost: 0.2991 - reader cost: 0.1332  4/125 [..............................] - ETA: 55s - batch_cost: 0.3226 - reader cost: 0.1358 5/125 [>.............................] - ETA: 54s - batch_cost: 0.3473 - reader cost: 0.1306 6/125 [>.............................] - ETA: 53s - batch_cost: 0.3560 - reader cost: 0.1253 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3661 - reader cost: 0.1316 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3745 - reader cost: 0.1376 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3813 - reader cost: 0.1425 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3837 - reader cost: 0.1438 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3851 - reader cost: 0.1443 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3913 - reader cost: 0.1498 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3903 - reader cost: 0.1477 14/125 [==>...........................] - ETA: 47s - batch_cost: 0.3883 - reader cost: 0.1450 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3946 - reader cost: 0.1442 16/125 [==>...........................] - ETA: 46s - batch_cost: 0.3954 - reader cost: 0.1417 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3970 - reader cost: 0.1436 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3990 - reader cost: 0.1459 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3986 - reader cost: 0.1453 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3999 - reader cost: 0.1468 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4008 - reader cost: 0.1479 22/125 [====>.........................] - ETA: 43s - batch_cost: 0.4017 - reader cost: 0.1489 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4005 - reader cost: 0.1478 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.4015 - reader cost: 0.1487 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4027 - reader cost: 0.1501 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4037 - reader cost: 0.1511 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4038 - reader cost: 0.1514 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4038 - reader cost: 0.1514 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4027 - reader cost: 0.1503 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4036 - reader cost: 0.1514 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.4044 - reader cost: 0.1521 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4047 - reader cost: 0.1524 33/125 [======>.......................] - ETA: 38s - batch_cost: 0.4059 - reader cost: 0.1535 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4055 - reader cost: 0.1531 35/125 [=======>......................] - ETA: 37s - batch_cost: 0.4063 - reader cost: 0.1537 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4063 - reader cost: 0.1538 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4057 - reader cost: 0.1533 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4048 - reader cost: 0.1523 39/125 [========>.....................] - ETA: 35s - batch_cost: 0.4036 - reader cost: 0.1511 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4043 - reader cost: 0.1517 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4037 - reader cost: 0.1511 42/125 [=========>....................] - ETA: 34s - batch_cost: 0.4032 - reader cost: 0.1507 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4037 - reader cost: 0.1512 44/125 [=========>....................] - ETA: 33s - batch_cost: 0.4041 - reader cost: 0.1518 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4037 - reader cost: 0.1514 46/125 [==========>...................] - ETA: 32s - batch_cost: 0.4042 - reader cost: 0.1519 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4049 - reader cost: 0.1523 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4054 - reader cost: 0.1526 49/125 [==========>...................] - ETA: 31s - batch_cost: 0.4055 - reader cost: 0.1527 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4056 - reader cost: 0.1518 51/125 [===========>..................] - ETA: 30s - batch_cost: 0.4061 - reader cost: 0.1513 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4068 - reader cost: 0.1513 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4066 - reader cost: 0.1507 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4067 - reader cost: 0.1495 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4061 - reader cost: 0.1489 56/125 [============>.................] - ETA: 28s - batch_cost: 0.4064 - reader cost: 0.1493 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4067 - reader cost: 0.1486 58/125 [============>.................] - ETA: 27s - batch_cost: 0.4067 - reader cost: 0.1480 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4070 - reader cost: 0.1484 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4070 - reader cost: 0.1484 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4075 - reader cost: 0.1491 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4071 - reader cost: 0.1487 63/125 [==============>...............] - ETA: 25s - batch_cost: 0.4076 - reader cost: 0.1491 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4078 - reader cost: 0.1493 65/125 [==============>...............] - ETA: 24s - batch_cost: 0.4081 - reader cost: 0.1498 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4076 - reader cost: 0.1493 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4073 - reader cost: 0.1492 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4076 - reader cost: 0.1495 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4077 - reader cost: 0.1498 70/125 [===============>..............] - ETA: 22s - batch_cost: 0.4080 - reader cost: 0.1502 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4077 - reader cost: 0.1499 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4081 - reader cost: 0.1502 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4082 - reader cost: 0.1504 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4083 - reader cost: 0.1507 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4086 - reader cost: 0.1510 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4082 - reader cost: 0.1507 77/125 [=================>............] - ETA: 19s - batch_cost: 0.4088 - reader cost: 0.1513 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4094 - reader cost: 0.1520 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4097 - reader cost: 0.1522 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4093 - reader cost: 0.1519 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4096 - reader cost: 0.1522 82/125 [==================>...........] - ETA: 17s - batch_cost: 0.4091 - reader cost: 0.1519 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4093 - reader cost: 0.1521 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4089 - reader cost: 0.1517 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4083 - reader cost: 0.1512 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4085 - reader cost: 0.1515 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4087 - reader cost: 0.1518 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4088 - reader cost: 0.1520 89/125 [====================>.........] - ETA: 14s - batch_cost: 0.4091 - reader cost: 0.1522 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4093 - reader cost: 0.1525 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4094 - reader cost: 0.1527 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4097 - reader cost: 0.1530 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4093 - reader cost: 0.1526 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4089 - reader cost: 0.1523 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4093 - reader cost: 0.1529 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4090 - reader cost: 0.1526 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4092 - reader cost: 0.1528 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4094 - reader cost: 0.1530 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4095 - reader cost: 0.1532 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4092 - reader cost: 0.1529 101/125 [=======================>......] - ETA: 9s - batch_cost: 0.4088 - reader cost: 0.1525  102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4084 - reader cost: 0.1521 103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4086 - reader cost: 0.1523 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4087 - reader cost: 0.1523 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4088 - reader cost: 0.1525 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4085 - reader cost: 0.1522 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4086 - reader cost: 0.1523 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4087 - reader cost: 0.1525 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4086 - reader cost: 0.1524 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4088 - reader cost: 0.1527 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4089 - reader cost: 0.1528 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4088 - reader cost: 0.1527 113/125 [==========================>...] - ETA: 4s - batch_cost: 0.4087 - reader cost: 0.1526 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4088 - reader cost: 0.1528 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4086 - reader cost: 0.1527 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4087 - reader cost: 0.1528 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4085 - reader cost: 0.1526 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4083 - reader cost: 0.1524 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4081 - reader cost: 0.1521 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4082 - reader cost: 0.1523 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4086 - reader cost: 0.1526 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4088 - reader cost: 0.1529 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4088 - reader cost: 0.1528 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4084 - reader cost: 0.1525 125/125 [==============================] - 52s 413ms/step - batch_cost: 0.4086 - reader cost: 0.1527 2021-02-22 20:25:17 [INFO] [EVAL] #Images=500 mIoU=0.6518 Acc=0.9270 Kappa=0.9054 2021-02-22 20:25:17 [INFO] [EVAL] Class IoU: [0.9641 0.7392 0.8395 0.2718 0.4917 0.5875 0.6675 0.7324 0.9069 0.5383 0.9331 0.7782 0.5495 0.9159 0.6608 0.6682 0.0514 0.3921 0.6961] 2021-02-22 20:25:17 [INFO] [EVAL] Class Acc: [0.9766 0.8983 0.9354 0.8033 0.6906 0.8086 0.7974 0.9262 0.9426 0.8526 0.977 0.8763 0.7282 0.9494 0.8232 0.7364 0.0518 0.432 0.778 ] 2021-02-22 20:25:22 [INFO] [EVAL] The model with the best validation mIoU (0.7121) was saved at iter 5000. 2021-02-22 20:25:35 [INFO] [TRAIN] epoch=17, iter=6010/80000, loss=1.0158, lr=0.009321, batch_cost=1.3366, reader_cost=0.0001 | ETA 27:28:17 2021-02-22 20:25:49 [INFO] [TRAIN] epoch=17, iter=6020/80000, loss=0.9618, lr=0.009320, batch_cost=1.3615, reader_cost=0.0001 | ETA 27:58:45 2021-02-22 20:26:03 [INFO] [TRAIN] epoch=17, iter=6030/80000, loss=0.9697, lr=0.009319, batch_cost=1.3722, reader_cost=0.0001 | ETA 28:11:41 2021-02-22 20:26:16 [INFO] [TRAIN] epoch=17, iter=6040/80000, loss=0.9630, lr=0.009318, batch_cost=1.3455, reader_cost=0.0001 | ETA 27:38:33 2021-02-22 20:26:30 [INFO] [TRAIN] epoch=17, iter=6050/80000, loss=0.9234, lr=0.009317, batch_cost=1.3750, reader_cost=0.0001 | ETA 28:14:39 2021-02-22 20:26:43 [INFO] [TRAIN] epoch=17, iter=6060/80000, loss=1.0439, lr=0.009316, batch_cost=1.3263, reader_cost=0.0001 | ETA 27:14:25 2021-02-22 20:26:57 [INFO] [TRAIN] epoch=17, iter=6070/80000, loss=0.9479, lr=0.009315, batch_cost=1.3460, reader_cost=0.0001 | ETA 27:38:29 2021-02-22 20:27:10 [INFO] [TRAIN] epoch=17, iter=6080/80000, loss=0.9416, lr=0.009313, batch_cost=1.3582, reader_cost=0.0001 | ETA 27:53:20 2021-02-22 20:27:24 [INFO] [TRAIN] epoch=17, iter=6090/80000, loss=0.9054, lr=0.009312, batch_cost=1.3444, reader_cost=0.0001 | ETA 27:36:04 2021-02-22 20:27:37 [INFO] [TRAIN] epoch=17, iter=6100/80000, loss=1.0503, lr=0.009311, batch_cost=1.3698, reader_cost=0.0001 | ETA 28:07:11 2021-02-22 20:27:51 [INFO] [TRAIN] epoch=17, iter=6110/80000, loss=0.9843, lr=0.009310, batch_cost=1.3524, reader_cost=0.0001 | ETA 27:45:30 2021-02-22 20:28:04 [INFO] [TRAIN] epoch=17, iter=6120/80000, loss=1.0085, lr=0.009309, batch_cost=1.3345, reader_cost=0.0001 | ETA 27:23:10 2021-02-22 20:28:18 [INFO] [TRAIN] epoch=17, iter=6130/80000, loss=0.9966, lr=0.009308, batch_cost=1.3907, reader_cost=0.0001 | ETA 28:32:12 2021-02-22 20:28:32 [INFO] [TRAIN] epoch=17, iter=6140/80000, loss=1.0186, lr=0.009307, batch_cost=1.3456, reader_cost=0.0001 | ETA 27:36:26 2021-02-22 20:28:45 [INFO] [TRAIN] epoch=17, iter=6150/80000, loss=0.9190, lr=0.009306, batch_cost=1.3660, reader_cost=0.0001 | ETA 28:01:18 2021-02-22 20:28:59 [INFO] [TRAIN] epoch=17, iter=6160/80000, loss=0.9414, lr=0.009304, batch_cost=1.3406, reader_cost=0.0001 | ETA 27:29:52 2021-02-22 20:29:12 [INFO] [TRAIN] epoch=17, iter=6170/80000, loss=1.0022, lr=0.009303, batch_cost=1.3532, reader_cost=0.0001 | ETA 27:45:03 2021-02-22 20:29:26 [INFO] [TRAIN] epoch=17, iter=6180/80000, loss=1.1184, lr=0.009302, batch_cost=1.3726, reader_cost=0.0001 | ETA 28:08:43 2021-02-22 20:29:40 [INFO] [TRAIN] epoch=17, iter=6190/80000, loss=1.1040, lr=0.009301, batch_cost=1.3842, reader_cost=0.0001 | ETA 28:22:47 2021-02-22 20:29:53 [INFO] [TRAIN] epoch=17, iter=6200/80000, loss=0.9820, lr=0.009300, batch_cost=1.3505, reader_cost=0.0001 | ETA 27:41:05 2021-02-22 20:30:07 [INFO] [TRAIN] epoch=17, iter=6210/80000, loss=0.9220, lr=0.009299, batch_cost=1.3587, reader_cost=0.0001 | ETA 27:51:00 2021-02-22 20:30:20 [INFO] [TRAIN] epoch=17, iter=6220/80000, loss=0.8708, lr=0.009298, batch_cost=1.3483, reader_cost=0.0001 | ETA 27:37:59 2021-02-22 20:30:34 [INFO] [TRAIN] epoch=17, iter=6230/80000, loss=0.9773, lr=0.009296, batch_cost=1.3538, reader_cost=0.0001 | ETA 27:44:32 2021-02-22 20:30:47 [INFO] [TRAIN] epoch=17, iter=6240/80000, loss=0.9708, lr=0.009295, batch_cost=1.3546, reader_cost=0.0001 | ETA 27:45:16 2021-02-22 20:31:01 [INFO] [TRAIN] epoch=17, iter=6250/80000, loss=1.0448, lr=0.009294, batch_cost=1.3777, reader_cost=0.0001 | ETA 28:13:28 2021-02-22 20:31:15 [INFO] [TRAIN] epoch=17, iter=6260/80000, loss=1.0326, lr=0.009293, batch_cost=1.3656, reader_cost=0.0001 | ETA 27:58:18 2021-02-22 20:31:29 [INFO] [TRAIN] epoch=17, iter=6270/80000, loss=0.9600, lr=0.009292, batch_cost=1.3603, reader_cost=0.0001 | ETA 27:51:33 2021-02-22 20:31:42 [INFO] [TRAIN] epoch=17, iter=6280/80000, loss=0.9281, lr=0.009291, batch_cost=1.3594, reader_cost=0.0001 | ETA 27:50:17 2021-02-22 20:31:56 [INFO] [TRAIN] epoch=17, iter=6290/80000, loss=0.9567, lr=0.009290, batch_cost=1.3553, reader_cost=0.0001 | ETA 27:44:57 2021-02-22 20:32:09 [INFO] [TRAIN] epoch=17, iter=6300/80000, loss=0.9560, lr=0.009288, batch_cost=1.3563, reader_cost=0.0001 | ETA 27:45:56 2021-02-22 20:32:23 [INFO] [TRAIN] epoch=17, iter=6310/80000, loss=0.9189, lr=0.009287, batch_cost=1.3618, reader_cost=0.0001 | ETA 27:52:33 2021-02-22 20:32:36 [INFO] [TRAIN] epoch=17, iter=6320/80000, loss=0.9244, lr=0.009286, batch_cost=1.3599, reader_cost=0.0001 | ETA 27:49:56 2021-02-22 20:32:51 [INFO] [TRAIN] epoch=18, iter=6330/80000, loss=0.9545, lr=0.009285, batch_cost=1.4799, reader_cost=0.0758 | ETA 30:17:05 2021-02-22 20:33:05 [INFO] [TRAIN] epoch=18, iter=6340/80000, loss=0.9526, lr=0.009284, batch_cost=1.3951, reader_cost=0.0001 | ETA 28:32:43 2021-02-22 20:33:19 [INFO] [TRAIN] epoch=18, iter=6350/80000, loss=0.9602, lr=0.009283, batch_cost=1.3566, reader_cost=0.0001 | ETA 27:45:10 2021-02-22 20:33:32 [INFO] [TRAIN] epoch=18, iter=6360/80000, loss=1.0632, lr=0.009282, batch_cost=1.3632, reader_cost=0.0001 | ETA 27:53:06 2021-02-22 20:33:46 [INFO] [TRAIN] epoch=18, iter=6370/80000, loss=1.0554, lr=0.009281, batch_cost=1.3706, reader_cost=0.0001 | ETA 28:01:53 2021-02-22 20:34:00 [INFO] [TRAIN] epoch=18, iter=6380/80000, loss=0.9163, lr=0.009279, batch_cost=1.3832, reader_cost=0.0001 | ETA 28:17:08 2021-02-22 20:34:13 [INFO] [TRAIN] epoch=18, iter=6390/80000, loss=0.9908, lr=0.009278, batch_cost=1.3407, reader_cost=0.0001 | ETA 27:24:48 2021-02-22 20:34:27 [INFO] [TRAIN] epoch=18, iter=6400/80000, loss=0.9600, lr=0.009277, batch_cost=1.3729, reader_cost=0.0001 | ETA 28:04:02 2021-02-22 20:34:41 [INFO] [TRAIN] epoch=18, iter=6410/80000, loss=0.8553, lr=0.009276, batch_cost=1.3732, reader_cost=0.0001 | ETA 28:04:12 2021-02-22 20:34:55 [INFO] [TRAIN] epoch=18, iter=6420/80000, loss=1.0542, lr=0.009275, batch_cost=1.3891, reader_cost=0.0001 | ETA 28:23:26 2021-02-22 20:35:08 [INFO] [TRAIN] epoch=18, iter=6430/80000, loss=0.9750, lr=0.009274, batch_cost=1.3683, reader_cost=0.0001 | ETA 27:57:47 2021-02-22 20:35:22 [INFO] [TRAIN] epoch=18, iter=6440/80000, loss=1.0470, lr=0.009273, batch_cost=1.3684, reader_cost=0.0001 | ETA 27:57:35 2021-02-22 20:35:36 [INFO] [TRAIN] epoch=18, iter=6450/80000, loss=0.9858, lr=0.009271, batch_cost=1.3849, reader_cost=0.0001 | ETA 28:17:40 2021-02-22 20:35:50 [INFO] [TRAIN] epoch=18, iter=6460/80000, loss=1.0935, lr=0.009270, batch_cost=1.3790, reader_cost=0.0001 | ETA 28:10:09 2021-02-22 20:36:04 [INFO] [TRAIN] epoch=18, iter=6470/80000, loss=1.0629, lr=0.009269, batch_cost=1.3900, reader_cost=0.0001 | ETA 28:23:29 2021-02-22 20:36:17 [INFO] [TRAIN] epoch=18, iter=6480/80000, loss=0.8594, lr=0.009268, batch_cost=1.3641, reader_cost=0.0001 | ETA 27:51:30 2021-02-22 20:36:31 [INFO] [TRAIN] epoch=18, iter=6490/80000, loss=0.9996, lr=0.009267, batch_cost=1.4080, reader_cost=0.0001 | ETA 28:45:02 2021-02-22 20:36:45 [INFO] [TRAIN] epoch=18, iter=6500/80000, loss=0.9393, lr=0.009266, batch_cost=1.3462, reader_cost=0.0001 | ETA 27:29:04 2021-02-22 20:36:58 [INFO] [TRAIN] epoch=18, iter=6510/80000, loss=0.9089, lr=0.009265, batch_cost=1.3624, reader_cost=0.0001 | ETA 27:48:43 2021-02-22 20:37:12 [INFO] [TRAIN] epoch=18, iter=6520/80000, loss=0.9175, lr=0.009264, batch_cost=1.3665, reader_cost=0.0001 | ETA 27:53:32 2021-02-22 20:37:26 [INFO] [TRAIN] epoch=18, iter=6530/80000, loss=0.9376, lr=0.009262, batch_cost=1.3499, reader_cost=0.0001 | ETA 27:32:54 2021-02-22 20:37:39 [INFO] [TRAIN] epoch=18, iter=6540/80000, loss=1.1404, lr=0.009261, batch_cost=1.3718, reader_cost=0.0001 | ETA 27:59:32 2021-02-22 20:37:53 [INFO] [TRAIN] epoch=18, iter=6550/80000, loss=1.0635, lr=0.009260, batch_cost=1.3705, reader_cost=0.0001 | ETA 27:57:41 2021-02-22 20:38:07 [INFO] [TRAIN] epoch=18, iter=6560/80000, loss=0.9538, lr=0.009259, batch_cost=1.4212, reader_cost=0.0001 | ETA 28:59:33 2021-02-22 20:38:21 [INFO] [TRAIN] epoch=18, iter=6570/80000, loss=0.9884, lr=0.009258, batch_cost=1.3648, reader_cost=0.0001 | ETA 27:50:16 2021-02-22 20:38:35 [INFO] [TRAIN] epoch=18, iter=6580/80000, loss=0.9817, lr=0.009257, batch_cost=1.3696, reader_cost=0.0001 | ETA 27:55:56 2021-02-22 20:38:48 [INFO] [TRAIN] epoch=18, iter=6590/80000, loss=0.9012, lr=0.009256, batch_cost=1.3607, reader_cost=0.0001 | ETA 27:44:50 2021-02-22 20:39:02 [INFO] [TRAIN] epoch=18, iter=6600/80000, loss=0.9951, lr=0.009254, batch_cost=1.3544, reader_cost=0.0001 | ETA 27:36:54 2021-02-22 20:39:15 [INFO] [TRAIN] epoch=18, iter=6610/80000, loss=1.0363, lr=0.009253, batch_cost=1.3774, reader_cost=0.0001 | ETA 28:04:44 2021-02-22 20:39:29 [INFO] [TRAIN] epoch=18, iter=6620/80000, loss=0.9416, lr=0.009252, batch_cost=1.3671, reader_cost=0.0001 | ETA 27:52:01 2021-02-22 20:39:43 [INFO] [TRAIN] epoch=18, iter=6630/80000, loss=1.0128, lr=0.009251, batch_cost=1.3676, reader_cost=0.0001 | ETA 27:52:18 2021-02-22 20:39:57 [INFO] [TRAIN] epoch=18, iter=6640/80000, loss=1.1666, lr=0.009250, batch_cost=1.3682, reader_cost=0.0001 | ETA 27:52:53 2021-02-22 20:40:10 [INFO] [TRAIN] epoch=18, iter=6650/80000, loss=0.9781, lr=0.009249, batch_cost=1.3576, reader_cost=0.0001 | ETA 27:39:43 2021-02-22 20:40:24 [INFO] [TRAIN] epoch=18, iter=6660/80000, loss=1.0126, lr=0.009248, batch_cost=1.3404, reader_cost=0.0001 | ETA 27:18:22 2021-02-22 20:40:37 [INFO] [TRAIN] epoch=18, iter=6670/80000, loss=0.8937, lr=0.009247, batch_cost=1.3565, reader_cost=0.0001 | ETA 27:37:54 2021-02-22 20:40:50 [INFO] [TRAIN] epoch=18, iter=6680/80000, loss=0.9519, lr=0.009245, batch_cost=1.3338, reader_cost=0.0001 | ETA 27:09:54 2021-02-22 20:41:04 [INFO] [TRAIN] epoch=18, iter=6690/80000, loss=1.0061, lr=0.009244, batch_cost=1.3510, reader_cost=0.0001 | ETA 27:30:43 2021-02-22 20:41:18 [INFO] [TRAIN] epoch=19, iter=6700/80000, loss=0.9324, lr=0.009243, batch_cost=1.4444, reader_cost=0.0623 | ETA 29:24:33 2021-02-22 20:41:32 [INFO] [TRAIN] epoch=19, iter=6710/80000, loss=1.0104, lr=0.009242, batch_cost=1.3551, reader_cost=0.0001 | ETA 27:35:17 2021-02-22 20:41:45 [INFO] [TRAIN] epoch=19, iter=6720/80000, loss=0.9810, lr=0.009241, batch_cost=1.3500, reader_cost=0.0001 | ETA 27:28:50 2021-02-22 20:41:59 [INFO] [TRAIN] epoch=19, iter=6730/80000, loss=0.9187, lr=0.009240, batch_cost=1.3707, reader_cost=0.0001 | ETA 27:53:48 2021-02-22 20:42:13 [INFO] [TRAIN] epoch=19, iter=6740/80000, loss=0.8542, lr=0.009239, batch_cost=1.3560, reader_cost=0.0001 | ETA 27:35:42 2021-02-22 20:42:26 [INFO] [TRAIN] epoch=19, iter=6750/80000, loss=0.9589, lr=0.009237, batch_cost=1.3567, reader_cost=0.0001 | ETA 27:36:17 2021-02-22 20:42:40 [INFO] [TRAIN] epoch=19, iter=6760/80000, loss=0.8929, lr=0.009236, batch_cost=1.3560, reader_cost=0.0001 | ETA 27:35:15 2021-02-22 20:42:53 [INFO] [TRAIN] epoch=19, iter=6770/80000, loss=0.9941, lr=0.009235, batch_cost=1.3661, reader_cost=0.0001 | ETA 27:47:21 2021-02-22 20:43:07 [INFO] [TRAIN] epoch=19, iter=6780/80000, loss=1.0506, lr=0.009234, batch_cost=1.3759, reader_cost=0.0001 | ETA 27:59:04 2021-02-22 20:43:21 [INFO] [TRAIN] epoch=19, iter=6790/80000, loss=0.9366, lr=0.009233, batch_cost=1.3402, reader_cost=0.0001 | ETA 27:15:14 2021-02-22 20:43:34 [INFO] [TRAIN] epoch=19, iter=6800/80000, loss=0.9261, lr=0.009232, batch_cost=1.3366, reader_cost=0.0001 | ETA 27:10:40 2021-02-22 20:43:47 [INFO] [TRAIN] epoch=19, iter=6810/80000, loss=0.9062, lr=0.009231, batch_cost=1.3319, reader_cost=0.0001 | ETA 27:04:44 2021-02-22 20:44:01 [INFO] [TRAIN] epoch=19, iter=6820/80000, loss=1.0016, lr=0.009229, batch_cost=1.3602, reader_cost=0.0001 | ETA 27:38:58 2021-02-22 20:44:15 [INFO] [TRAIN] epoch=19, iter=6830/80000, loss=1.0057, lr=0.009228, batch_cost=1.3715, reader_cost=0.0001 | ETA 27:52:32 2021-02-22 20:44:28 [INFO] [TRAIN] epoch=19, iter=6840/80000, loss=0.8626, lr=0.009227, batch_cost=1.3342, reader_cost=0.0001 | ETA 27:06:46 2021-02-22 20:44:42 [INFO] [TRAIN] epoch=19, iter=6850/80000, loss=0.9086, lr=0.009226, batch_cost=1.3720, reader_cost=0.0001 | ETA 27:52:42 2021-02-22 20:44:55 [INFO] [TRAIN] epoch=19, iter=6860/80000, loss=1.0015, lr=0.009225, batch_cost=1.3717, reader_cost=0.0001 | ETA 27:52:08 2021-02-22 20:45:09 [INFO] [TRAIN] epoch=19, iter=6870/80000, loss=1.1180, lr=0.009224, batch_cost=1.3624, reader_cost=0.0001 | ETA 27:40:31 2021-02-22 20:45:23 [INFO] [TRAIN] epoch=19, iter=6880/80000, loss=0.8811, lr=0.009223, batch_cost=1.3872, reader_cost=0.0001 | ETA 28:10:32 2021-02-22 20:45:37 [INFO] [TRAIN] epoch=19, iter=6890/80000, loss=0.9455, lr=0.009222, batch_cost=1.3594, reader_cost=0.0001 | ETA 27:36:22 2021-02-22 20:45:50 [INFO] [TRAIN] epoch=19, iter=6900/80000, loss=0.9375, lr=0.009220, batch_cost=1.3677, reader_cost=0.0001 | ETA 27:46:18 2021-02-22 20:46:04 [INFO] [TRAIN] epoch=19, iter=6910/80000, loss=0.9952, lr=0.009219, batch_cost=1.3880, reader_cost=0.0001 | ETA 28:10:49 2021-02-22 20:46:18 [INFO] [TRAIN] epoch=19, iter=6920/80000, loss=0.9093, lr=0.009218, batch_cost=1.3584, reader_cost=0.0001 | ETA 27:34:33 2021-02-22 20:46:31 [INFO] [TRAIN] epoch=19, iter=6930/80000, loss=0.8576, lr=0.009217, batch_cost=1.3441, reader_cost=0.0001 | ETA 27:16:53 2021-02-22 20:46:45 [INFO] [TRAIN] epoch=19, iter=6940/80000, loss=0.9993, lr=0.009216, batch_cost=1.3482, reader_cost=0.0001 | ETA 27:21:39 2021-02-22 20:46:58 [INFO] [TRAIN] epoch=19, iter=6950/80000, loss=0.9840, lr=0.009215, batch_cost=1.3688, reader_cost=0.0001 | ETA 27:46:29 2021-02-22 20:47:12 [INFO] [TRAIN] epoch=19, iter=6960/80000, loss=0.9740, lr=0.009214, batch_cost=1.3669, reader_cost=0.0001 | ETA 27:43:56 2021-02-22 20:47:25 [INFO] [TRAIN] epoch=19, iter=6970/80000, loss=0.9364, lr=0.009212, batch_cost=1.3551, reader_cost=0.0001 | ETA 27:29:23 2021-02-22 20:47:39 [INFO] [TRAIN] epoch=19, iter=6980/80000, loss=0.9867, lr=0.009211, batch_cost=1.3545, reader_cost=0.0001 | ETA 27:28:25 2021-02-22 20:47:53 [INFO] [TRAIN] epoch=19, iter=6990/80000, loss=0.9246, lr=0.009210, batch_cost=1.3598, reader_cost=0.0001 | ETA 27:34:39 2021-02-22 20:48:06 [INFO] [TRAIN] epoch=19, iter=7000/80000, loss=0.9654, lr=0.009209, batch_cost=1.3743, reader_cost=0.0001 | ETA 27:52:03 2021-02-22 20:48:06 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:16 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:01 - batch_cost: 0.1883 - reader cost: 0.0617  3/125 [..............................] - ETA: 57s - batch_cost: 0.2612 - reader cost: 0.0935  4/125 [..............................] - ETA: 56s - batch_cost: 0.3097 - reader cost: 0.1218 5/125 [>.............................] - ETA: 55s - batch_cost: 0.3343 - reader cost: 0.1345 6/125 [>.............................] - ETA: 54s - batch_cost: 0.3504 - reader cost: 0.1424 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3550 - reader cost: 0.1411 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3647 - reader cost: 0.1456 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3734 - reader cost: 0.1494 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3777 - reader cost: 0.1509 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3811 - reader cost: 0.1508 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3846 - reader cost: 0.1486 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3891 - reader cost: 0.1520 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3892 - reader cost: 0.1499 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3903 - reader cost: 0.1458 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3929 - reader cost: 0.1439 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3951 - reader cost: 0.1459 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.3973 - reader cost: 0.1479 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3986 - reader cost: 0.1492 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4004 - reader cost: 0.1507 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4018 - reader cost: 0.1520 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4033 - reader cost: 0.1536 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4026 - reader cost: 0.1526 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4039 - reader cost: 0.1540 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4038 - reader cost: 0.1539 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4049 - reader cost: 0.1548 27/125 [=====>........................] - ETA: 42s - batch_cost: 0.4066 - reader cost: 0.1559 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4050 - reader cost: 0.1543 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4055 - reader cost: 0.1548 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4068 - reader cost: 0.1559 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4077 - reader cost: 0.1568 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4089 - reader cost: 0.1579 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4100 - reader cost: 0.1587 34/125 [=======>......................] - ETA: 39s - batch_cost: 0.4108 - reader cost: 0.1596 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4116 - reader cost: 0.1602 36/125 [=======>......................] - ETA: 38s - batch_cost: 0.4122 - reader cost: 0.1608 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4117 - reader cost: 0.1603 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4110 - reader cost: 0.1594 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4117 - reader cost: 0.1601 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4125 - reader cost: 0.1609 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4119 - reader cost: 0.1602 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4109 - reader cost: 0.1592 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4103 - reader cost: 0.1586 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4108 - reader cost: 0.1590 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4116 - reader cost: 0.1594 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4120 - reader cost: 0.1594 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4122 - reader cost: 0.1596 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4125 - reader cost: 0.1599 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4131 - reader cost: 0.1604 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4134 - reader cost: 0.1607 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4134 - reader cost: 0.1607 52/125 [===========>..................] - ETA: 31s - batch_cost: 0.4138 - reader cost: 0.1610 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4140 - reader cost: 0.1613 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4136 - reader cost: 0.1608 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4142 - reader cost: 0.1612 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4145 - reader cost: 0.1616 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4141 - reader cost: 0.1613 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4143 - reader cost: 0.1615 59/125 [=============>................] - ETA: 28s - batch_cost: 0.4139 - reader cost: 0.1612 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4141 - reader cost: 0.1614 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4136 - reader cost: 0.1609 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4127 - reader cost: 0.1601 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4121 - reader cost: 0.1595 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4125 - reader cost: 0.1599 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4121 - reader cost: 0.1595 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4125 - reader cost: 0.1600 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4130 - reader cost: 0.1606 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4135 - reader cost: 0.1611 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4138 - reader cost: 0.1614 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4141 - reader cost: 0.1616 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4136 - reader cost: 0.1611 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4139 - reader cost: 0.1613 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4141 - reader cost: 0.1615 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4146 - reader cost: 0.1619 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4148 - reader cost: 0.1622 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4151 - reader cost: 0.1624 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4153 - reader cost: 0.1625 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4155 - reader cost: 0.1628 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4160 - reader cost: 0.1632 80/125 [==================>...........] - ETA: 19s - batch_cost: 0.4162 - reader cost: 0.1634 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4163 - reader cost: 0.1636 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4159 - reader cost: 0.1630 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4161 - reader cost: 0.1632 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4162 - reader cost: 0.1633 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4162 - reader cost: 0.1633 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4164 - reader cost: 0.1635 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4166 - reader cost: 0.1637 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4167 - reader cost: 0.1638 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4169 - reader cost: 0.1640 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4166 - reader cost: 0.1637 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4168 - reader cost: 0.1639 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4169 - reader cost: 0.1640 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4171 - reader cost: 0.1641 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4165 - reader cost: 0.1634 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4159 - reader cost: 0.1627 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4162 - reader cost: 0.1630 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4158 - reader cost: 0.1625 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4153 - reader cost: 0.1620 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4150 - reader cost: 0.1618 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4149 - reader cost: 0.1615 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4150 - reader cost: 0.1614 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4145 - reader cost: 0.1609  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4147 - reader cost: 0.1610 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4151 - reader cost: 0.1611 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4151 - reader cost: 0.1611 106/125 [========================>.....] - ETA: 8s - batch_cost: 0.4153 - reader cost: 0.1612 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4153 - reader cost: 0.1613 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4154 - reader cost: 0.1615 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4152 - reader cost: 0.1613 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4154 - reader cost: 0.1615 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4157 - reader cost: 0.1617 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4156 - reader cost: 0.1616 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4154 - reader cost: 0.1613 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4154 - reader cost: 0.1614 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4155 - reader cost: 0.1615 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4152 - reader cost: 0.1613 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4153 - reader cost: 0.1614 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4155 - reader cost: 0.1616 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4152 - reader cost: 0.1613 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4150 - reader cost: 0.1610 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4150 - reader cost: 0.1605 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4152 - reader cost: 0.1601 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4153 - reader cost: 0.1597 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4153 - reader cost: 0.1593 125/125 [==============================] - 53s 421ms/step - batch_cost: 0.4156 - reader cost: 0.1595 2021-02-22 20:48:59 [INFO] [EVAL] #Images=500 mIoU=0.6480 Acc=0.9297 Kappa=0.9086 2021-02-22 20:48:59 [INFO] [EVAL] Class IoU: [0.9626 0.7483 0.8751 0.3712 0.5319 0.5673 0.6542 0.7477 0.852 0.3917 0.9375 0.761 0.5468 0.8666 0.4156 0.585 0.3779 0.4137 0.7058] 2021-02-22 20:48:59 [INFO] [EVAL] Class Acc: [0.9771 0.9025 0.9087 0.7183 0.7061 0.7715 0.8083 0.9119 0.9601 0.4549 0.9614 0.8985 0.7416 0.8831 0.9226 0.9042 0.415 0.6176 0.8306] 2021-02-22 20:49:03 [INFO] [EVAL] The model with the best validation mIoU (0.7121) was saved at iter 5000. 2021-02-22 20:49:16 [INFO] [TRAIN] epoch=19, iter=7010/80000, loss=0.9636, lr=0.009208, batch_cost=1.3446, reader_cost=0.0001 | ETA 27:15:41 2021-02-22 20:49:30 [INFO] [TRAIN] epoch=19, iter=7020/80000, loss=1.0497, lr=0.009207, batch_cost=1.3626, reader_cost=0.0001 | ETA 27:37:23 2021-02-22 20:49:44 [INFO] [TRAIN] epoch=19, iter=7030/80000, loss=0.9076, lr=0.009206, batch_cost=1.3530, reader_cost=0.0001 | ETA 27:25:26 2021-02-22 20:49:57 [INFO] [TRAIN] epoch=19, iter=7040/80000, loss=0.9014, lr=0.009205, batch_cost=1.3320, reader_cost=0.0001 | ETA 26:59:39 2021-02-22 20:50:10 [INFO] [TRAIN] epoch=19, iter=7050/80000, loss=1.0153, lr=0.009203, batch_cost=1.3419, reader_cost=0.0001 | ETA 27:11:29 2021-02-22 20:50:24 [INFO] [TRAIN] epoch=19, iter=7060/80000, loss=0.8980, lr=0.009202, batch_cost=1.3744, reader_cost=0.0001 | ETA 27:50:48 2021-02-22 20:50:38 [INFO] [TRAIN] epoch=20, iter=7070/80000, loss=1.0259, lr=0.009201, batch_cost=1.4087, reader_cost=0.0791 | ETA 28:32:14 2021-02-22 20:50:52 [INFO] [TRAIN] epoch=20, iter=7080/80000, loss=0.9736, lr=0.009200, batch_cost=1.4010, reader_cost=0.0003 | ETA 28:22:40 2021-02-22 20:51:06 [INFO] [TRAIN] epoch=20, iter=7090/80000, loss=0.9283, lr=0.009199, batch_cost=1.4003, reader_cost=0.0001 | ETA 28:21:32 2021-02-22 20:51:20 [INFO] [TRAIN] epoch=20, iter=7100/80000, loss=0.9444, lr=0.009198, batch_cost=1.3425, reader_cost=0.0001 | ETA 27:11:11 2021-02-22 20:51:33 [INFO] [TRAIN] epoch=20, iter=7110/80000, loss=1.0001, lr=0.009197, batch_cost=1.3374, reader_cost=0.0001 | ETA 27:04:40 2021-02-22 20:51:47 [INFO] [TRAIN] epoch=20, iter=7120/80000, loss=0.9366, lr=0.009195, batch_cost=1.3492, reader_cost=0.0001 | ETA 27:18:47 2021-02-22 20:52:00 [INFO] [TRAIN] epoch=20, iter=7130/80000, loss=0.8856, lr=0.009194, batch_cost=1.3483, reader_cost=0.0001 | ETA 27:17:28 2021-02-22 20:52:14 [INFO] [TRAIN] epoch=20, iter=7140/80000, loss=1.0288, lr=0.009193, batch_cost=1.3541, reader_cost=0.0001 | ETA 27:24:23 2021-02-22 20:52:27 [INFO] [TRAIN] epoch=20, iter=7150/80000, loss=1.0033, lr=0.009192, batch_cost=1.3551, reader_cost=0.0001 | ETA 27:25:16 2021-02-22 20:52:41 [INFO] [TRAIN] epoch=20, iter=7160/80000, loss=0.8926, lr=0.009191, batch_cost=1.3699, reader_cost=0.0001 | ETA 27:43:04 2021-02-22 20:52:54 [INFO] [TRAIN] epoch=20, iter=7170/80000, loss=0.9229, lr=0.009190, batch_cost=1.3469, reader_cost=0.0001 | ETA 27:14:55 2021-02-22 20:53:08 [INFO] [TRAIN] epoch=20, iter=7180/80000, loss=0.9478, lr=0.009189, batch_cost=1.3334, reader_cost=0.0001 | ETA 26:58:19 2021-02-22 20:53:21 [INFO] [TRAIN] epoch=20, iter=7190/80000, loss=0.8873, lr=0.009187, batch_cost=1.3537, reader_cost=0.0001 | ETA 27:22:42 2021-02-22 20:53:35 [INFO] [TRAIN] epoch=20, iter=7200/80000, loss=1.0074, lr=0.009186, batch_cost=1.3820, reader_cost=0.0001 | ETA 27:56:52 2021-02-22 20:53:48 [INFO] [TRAIN] epoch=20, iter=7210/80000, loss=0.8422, lr=0.009185, batch_cost=1.3526, reader_cost=0.0001 | ETA 27:20:58 2021-02-22 20:54:02 [INFO] [TRAIN] epoch=20, iter=7220/80000, loss=0.9692, lr=0.009184, batch_cost=1.3270, reader_cost=0.0001 | ETA 26:49:39 2021-02-22 20:54:15 [INFO] [TRAIN] epoch=20, iter=7230/80000, loss=0.9466, lr=0.009183, batch_cost=1.3564, reader_cost=0.0001 | ETA 27:25:08 2021-02-22 20:54:29 [INFO] [TRAIN] epoch=20, iter=7240/80000, loss=1.1156, lr=0.009182, batch_cost=1.3712, reader_cost=0.0001 | ETA 27:42:45 2021-02-22 20:54:43 [INFO] [TRAIN] epoch=20, iter=7250/80000, loss=0.9501, lr=0.009181, batch_cost=1.3899, reader_cost=0.0001 | ETA 28:05:18 2021-02-22 20:54:57 [INFO] [TRAIN] epoch=20, iter=7260/80000, loss=0.9619, lr=0.009180, batch_cost=1.3837, reader_cost=0.0001 | ETA 27:57:31 2021-02-22 20:55:10 [INFO] [TRAIN] epoch=20, iter=7270/80000, loss=0.9247, lr=0.009178, batch_cost=1.3556, reader_cost=0.0001 | ETA 27:23:10 2021-02-22 20:55:24 [INFO] [TRAIN] epoch=20, iter=7280/80000, loss=0.9417, lr=0.009177, batch_cost=1.3783, reader_cost=0.0001 | ETA 27:50:29 2021-02-22 20:55:38 [INFO] [TRAIN] epoch=20, iter=7290/80000, loss=1.0580, lr=0.009176, batch_cost=1.3539, reader_cost=0.0001 | ETA 27:20:39 2021-02-22 20:55:51 [INFO] [TRAIN] epoch=20, iter=7300/80000, loss=0.9491, lr=0.009175, batch_cost=1.3786, reader_cost=0.0001 | ETA 27:50:25 2021-02-22 20:56:05 [INFO] [TRAIN] epoch=20, iter=7310/80000, loss=0.9351, lr=0.009174, batch_cost=1.3985, reader_cost=0.0001 | ETA 28:14:16 2021-02-22 20:56:19 [INFO] [TRAIN] epoch=20, iter=7320/80000, loss=0.9717, lr=0.009173, batch_cost=1.3678, reader_cost=0.0001 | ETA 27:36:53 2021-02-22 20:56:33 [INFO] [TRAIN] epoch=20, iter=7330/80000, loss=0.9375, lr=0.009172, batch_cost=1.3544, reader_cost=0.0001 | ETA 27:20:26 2021-02-22 20:56:46 [INFO] [TRAIN] epoch=20, iter=7340/80000, loss=0.9218, lr=0.009170, batch_cost=1.3603, reader_cost=0.0001 | ETA 27:27:21 2021-02-22 20:57:00 [INFO] [TRAIN] epoch=20, iter=7350/80000, loss=1.0205, lr=0.009169, batch_cost=1.3618, reader_cost=0.0001 | ETA 27:28:53 2021-02-22 20:57:13 [INFO] [TRAIN] epoch=20, iter=7360/80000, loss=1.0154, lr=0.009168, batch_cost=1.3576, reader_cost=0.0001 | ETA 27:23:38 2021-02-22 20:57:27 [INFO] [TRAIN] epoch=20, iter=7370/80000, loss=0.9000, lr=0.009167, batch_cost=1.3619, reader_cost=0.0001 | ETA 27:28:36 2021-02-22 20:57:41 [INFO] [TRAIN] epoch=20, iter=7380/80000, loss=0.9295, lr=0.009166, batch_cost=1.3800, reader_cost=0.0001 | ETA 27:50:13 2021-02-22 20:57:55 [INFO] [TRAIN] epoch=20, iter=7390/80000, loss=1.1298, lr=0.009165, batch_cost=1.3762, reader_cost=0.0001 | ETA 27:45:27 2021-02-22 20:58:08 [INFO] [TRAIN] epoch=20, iter=7400/80000, loss=0.8436, lr=0.009164, batch_cost=1.3698, reader_cost=0.0001 | ETA 27:37:30 2021-02-22 20:58:22 [INFO] [TRAIN] epoch=20, iter=7410/80000, loss=0.9396, lr=0.009162, batch_cost=1.3363, reader_cost=0.0001 | ETA 26:56:38 2021-02-22 20:58:35 [INFO] [TRAIN] epoch=20, iter=7420/80000, loss=0.9867, lr=0.009161, batch_cost=1.3595, reader_cost=0.0001 | ETA 27:24:30 2021-02-22 20:58:49 [INFO] [TRAIN] epoch=20, iter=7430/80000, loss=0.9243, lr=0.009160, batch_cost=1.3668, reader_cost=0.0001 | ETA 27:33:10 2021-02-22 20:59:02 [INFO] [TRAIN] epoch=20, iter=7440/80000, loss=0.8917, lr=0.009159, batch_cost=1.3198, reader_cost=0.0001 | ETA 26:36:07 2021-02-22 20:59:17 [INFO] [TRAIN] epoch=21, iter=7450/80000, loss=0.9540, lr=0.009158, batch_cost=1.4971, reader_cost=0.0935 | ETA 30:10:13 2021-02-22 20:59:31 [INFO] [TRAIN] epoch=21, iter=7460/80000, loss=0.9094, lr=0.009157, batch_cost=1.4027, reader_cost=0.0001 | ETA 28:15:52 2021-02-22 20:59:44 [INFO] [TRAIN] epoch=21, iter=7470/80000, loss=1.0199, lr=0.009156, batch_cost=1.3297, reader_cost=0.0001 | ETA 26:47:19 2021-02-22 20:59:58 [INFO] [TRAIN] epoch=21, iter=7480/80000, loss=0.8902, lr=0.009155, batch_cost=1.3447, reader_cost=0.0001 | ETA 27:05:16 2021-02-22 21:00:11 [INFO] [TRAIN] epoch=21, iter=7490/80000, loss=0.9426, lr=0.009153, batch_cost=1.3537, reader_cost=0.0001 | ETA 27:15:58 2021-02-22 21:00:25 [INFO] [TRAIN] epoch=21, iter=7500/80000, loss=0.9707, lr=0.009152, batch_cost=1.3719, reader_cost=0.0001 | ETA 27:37:42 2021-02-22 21:00:39 [INFO] [TRAIN] epoch=21, iter=7510/80000, loss=0.8431, lr=0.009151, batch_cost=1.3868, reader_cost=0.0001 | ETA 27:55:27 2021-02-22 21:00:53 [INFO] [TRAIN] epoch=21, iter=7520/80000, loss=1.1156, lr=0.009150, batch_cost=1.3513, reader_cost=0.0001 | ETA 27:12:24 2021-02-22 21:01:06 [INFO] [TRAIN] epoch=21, iter=7530/80000, loss=1.0085, lr=0.009149, batch_cost=1.3473, reader_cost=0.0001 | ETA 27:07:19 2021-02-22 21:01:20 [INFO] [TRAIN] epoch=21, iter=7540/80000, loss=0.9766, lr=0.009148, batch_cost=1.3739, reader_cost=0.0001 | ETA 27:39:10 2021-02-22 21:01:33 [INFO] [TRAIN] epoch=21, iter=7550/80000, loss=0.8347, lr=0.009147, batch_cost=1.3601, reader_cost=0.0001 | ETA 27:22:19 2021-02-22 21:01:47 [INFO] [TRAIN] epoch=21, iter=7560/80000, loss=0.9061, lr=0.009145, batch_cost=1.3607, reader_cost=0.0001 | ETA 27:22:48 2021-02-22 21:02:01 [INFO] [TRAIN] epoch=21, iter=7570/80000, loss=0.9078, lr=0.009144, batch_cost=1.3839, reader_cost=0.0001 | ETA 27:50:32 2021-02-22 21:02:14 [INFO] [TRAIN] epoch=21, iter=7580/80000, loss=0.9131, lr=0.009143, batch_cost=1.3534, reader_cost=0.0001 | ETA 27:13:33 2021-02-22 21:02:28 [INFO] [TRAIN] epoch=21, iter=7590/80000, loss=1.0461, lr=0.009142, batch_cost=1.3699, reader_cost=0.0001 | ETA 27:33:12 2021-02-22 21:02:42 [INFO] [TRAIN] epoch=21, iter=7600/80000, loss=0.9430, lr=0.009141, batch_cost=1.3539, reader_cost=0.0001 | ETA 27:13:41 2021-02-22 21:02:55 [INFO] [TRAIN] epoch=21, iter=7610/80000, loss=0.9262, lr=0.009140, batch_cost=1.3635, reader_cost=0.0001 | ETA 27:25:03 2021-02-22 21:03:09 [INFO] [TRAIN] epoch=21, iter=7620/80000, loss=0.8580, lr=0.009139, batch_cost=1.3616, reader_cost=0.0001 | ETA 27:22:28 2021-02-22 21:03:23 [INFO] [TRAIN] epoch=21, iter=7630/80000, loss=0.9710, lr=0.009137, batch_cost=1.3817, reader_cost=0.0001 | ETA 27:46:30 2021-02-22 21:03:36 [INFO] [TRAIN] epoch=21, iter=7640/80000, loss=0.9002, lr=0.009136, batch_cost=1.3586, reader_cost=0.0001 | ETA 27:18:29 2021-02-22 21:03:50 [INFO] [TRAIN] epoch=21, iter=7650/80000, loss=1.0654, lr=0.009135, batch_cost=1.3549, reader_cost=0.0001 | ETA 27:13:50 2021-02-22 21:04:04 [INFO] [TRAIN] epoch=21, iter=7660/80000, loss=1.0532, lr=0.009134, batch_cost=1.3719, reader_cost=0.0001 | ETA 27:34:03 2021-02-22 21:04:17 [INFO] [TRAIN] epoch=21, iter=7670/80000, loss=0.9684, lr=0.009133, batch_cost=1.3296, reader_cost=0.0001 | ETA 26:42:48 2021-02-22 21:04:30 [INFO] [TRAIN] epoch=21, iter=7680/80000, loss=1.0302, lr=0.009132, batch_cost=1.3617, reader_cost=0.0001 | ETA 27:21:19 2021-02-22 21:04:44 [INFO] [TRAIN] epoch=21, iter=7690/80000, loss=1.0775, lr=0.009131, batch_cost=1.3817, reader_cost=0.0001 | ETA 27:45:07 2021-02-22 21:04:58 [INFO] [TRAIN] epoch=21, iter=7700/80000, loss=0.8754, lr=0.009130, batch_cost=1.3650, reader_cost=0.0001 | ETA 27:24:51 2021-02-22 21:05:12 [INFO] [TRAIN] epoch=21, iter=7710/80000, loss=0.9331, lr=0.009128, batch_cost=1.3628, reader_cost=0.0001 | ETA 27:21:56 2021-02-22 21:05:25 [INFO] [TRAIN] epoch=21, iter=7720/80000, loss=1.0382, lr=0.009127, batch_cost=1.3572, reader_cost=0.0001 | ETA 27:14:59 2021-02-22 21:05:38 [INFO] [TRAIN] epoch=21, iter=7730/80000, loss=1.0406, lr=0.009126, batch_cost=1.3299, reader_cost=0.0001 | ETA 26:41:52 2021-02-22 21:05:52 [INFO] [TRAIN] epoch=21, iter=7740/80000, loss=1.0244, lr=0.009125, batch_cost=1.3573, reader_cost=0.0001 | ETA 27:14:37 2021-02-22 21:06:05 [INFO] [TRAIN] epoch=21, iter=7750/80000, loss=0.9728, lr=0.009124, batch_cost=1.3402, reader_cost=0.0001 | ETA 26:53:50 2021-02-22 21:06:19 [INFO] [TRAIN] epoch=21, iter=7760/80000, loss=0.9683, lr=0.009123, batch_cost=1.3337, reader_cost=0.0001 | ETA 26:45:50 2021-02-22 21:06:32 [INFO] [TRAIN] epoch=21, iter=7770/80000, loss=0.9236, lr=0.009122, batch_cost=1.3417, reader_cost=0.0001 | ETA 26:55:13 2021-02-22 21:06:45 [INFO] [TRAIN] epoch=21, iter=7780/80000, loss=1.0428, lr=0.009120, batch_cost=1.3307, reader_cost=0.0001 | ETA 26:41:40 2021-02-22 21:06:59 [INFO] [TRAIN] epoch=21, iter=7790/80000, loss=0.9553, lr=0.009119, batch_cost=1.3676, reader_cost=0.0001 | ETA 27:25:55 2021-02-22 21:07:13 [INFO] [TRAIN] epoch=21, iter=7800/80000, loss=0.9887, lr=0.009118, batch_cost=1.3679, reader_cost=0.0001 | ETA 27:26:04 2021-02-22 21:07:26 [INFO] [TRAIN] epoch=21, iter=7810/80000, loss=0.9603, lr=0.009117, batch_cost=1.3510, reader_cost=0.0001 | ETA 27:05:30 2021-02-22 21:07:41 [INFO] [TRAIN] epoch=22, iter=7820/80000, loss=0.9746, lr=0.009116, batch_cost=1.4677, reader_cost=0.0727 | ETA 29:25:38 2021-02-22 21:07:55 [INFO] [TRAIN] epoch=22, iter=7830/80000, loss=0.9518, lr=0.009115, batch_cost=1.3825, reader_cost=0.0001 | ETA 27:42:57 2021-02-22 21:08:08 [INFO] [TRAIN] epoch=22, iter=7840/80000, loss=0.9435, lr=0.009114, batch_cost=1.3433, reader_cost=0.0001 | ETA 26:55:29 2021-02-22 21:08:22 [INFO] [TRAIN] epoch=22, iter=7850/80000, loss=0.8947, lr=0.009112, batch_cost=1.3781, reader_cost=0.0001 | ETA 27:37:12 2021-02-22 21:08:36 [INFO] [TRAIN] epoch=22, iter=7860/80000, loss=1.1111, lr=0.009111, batch_cost=1.3595, reader_cost=0.0001 | ETA 27:14:36 2021-02-22 21:08:49 [INFO] [TRAIN] epoch=22, iter=7870/80000, loss=0.9683, lr=0.009110, batch_cost=1.3754, reader_cost=0.0001 | ETA 27:33:24 2021-02-22 21:09:03 [INFO] [TRAIN] epoch=22, iter=7880/80000, loss=1.3304, lr=0.009109, batch_cost=1.3678, reader_cost=0.0001 | ETA 27:24:04 2021-02-22 21:09:16 [INFO] [TRAIN] epoch=22, iter=7890/80000, loss=1.1175, lr=0.009108, batch_cost=1.3432, reader_cost=0.0001 | ETA 26:54:17 2021-02-22 21:09:30 [INFO] [TRAIN] epoch=22, iter=7900/80000, loss=0.9163, lr=0.009107, batch_cost=1.3531, reader_cost=0.0001 | ETA 27:06:01 2021-02-22 21:09:44 [INFO] [TRAIN] epoch=22, iter=7910/80000, loss=0.8918, lr=0.009106, batch_cost=1.3567, reader_cost=0.0001 | ETA 27:10:03 2021-02-22 21:09:57 [INFO] [TRAIN] epoch=22, iter=7920/80000, loss=0.9205, lr=0.009105, batch_cost=1.3570, reader_cost=0.0001 | ETA 27:10:11 2021-02-22 21:10:11 [INFO] [TRAIN] epoch=22, iter=7930/80000, loss=0.8655, lr=0.009103, batch_cost=1.3824, reader_cost=0.0001 | ETA 27:40:28 2021-02-22 21:10:25 [INFO] [TRAIN] epoch=22, iter=7940/80000, loss=0.9621, lr=0.009102, batch_cost=1.3569, reader_cost=0.0001 | ETA 27:09:40 2021-02-22 21:10:38 [INFO] [TRAIN] epoch=22, iter=7950/80000, loss=0.8778, lr=0.009101, batch_cost=1.3799, reader_cost=0.0001 | ETA 27:37:03 2021-02-22 21:10:52 [INFO] [TRAIN] epoch=22, iter=7960/80000, loss=1.1017, lr=0.009100, batch_cost=1.3540, reader_cost=0.0001 | ETA 27:05:40 2021-02-22 21:11:05 [INFO] [TRAIN] epoch=22, iter=7970/80000, loss=0.9081, lr=0.009099, batch_cost=1.3536, reader_cost=0.0001 | ETA 27:05:02 2021-02-22 21:11:19 [INFO] [TRAIN] epoch=22, iter=7980/80000, loss=0.9780, lr=0.009098, batch_cost=1.3683, reader_cost=0.0001 | ETA 27:22:25 2021-02-22 21:11:33 [INFO] [TRAIN] epoch=22, iter=7990/80000, loss=0.9107, lr=0.009097, batch_cost=1.3758, reader_cost=0.0001 | ETA 27:31:09 2021-02-22 21:11:46 [INFO] [TRAIN] epoch=22, iter=8000/80000, loss=0.9542, lr=0.009095, batch_cost=1.3409, reader_cost=0.0001 | ETA 26:49:05 2021-02-22 21:11:46 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:21 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:06 - batch_cost: 0.2107 - reader cost: 0.0860  3/125 [..............................] - ETA: 1:02 - batch_cost: 0.2931 - reader cost: 0.1212 4/125 [..............................] - ETA: 59s - batch_cost: 0.3247 - reader cost: 0.1328  5/125 [>.............................] - ETA: 56s - batch_cost: 0.3431 - reader cost: 0.1399 6/125 [>.............................] - ETA: 55s - batch_cost: 0.3563 - reader cost: 0.1452 7/125 [>.............................] - ETA: 53s - batch_cost: 0.3579 - reader cost: 0.1396 8/125 [>.............................] - ETA: 52s - batch_cost: 0.3692 - reader cost: 0.1470 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3708 - reader cost: 0.1448 10/125 [=>............................] - ETA: 51s - batch_cost: 0.3790 - reader cost: 0.1507 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3806 - reader cost: 0.1502 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3859 - reader cost: 0.1530 13/125 [==>...........................] - ETA: 49s - batch_cost: 0.3908 - reader cost: 0.1555 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3930 - reader cost: 0.1565 15/125 [==>...........................] - ETA: 48s - batch_cost: 0.3954 - reader cost: 0.1575 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3985 - reader cost: 0.1596 17/125 [===>..........................] - ETA: 47s - batch_cost: 0.4004 - reader cost: 0.1607 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.4022 - reader cost: 0.1613 19/125 [===>..........................] - ETA: 46s - batch_cost: 0.4001 - reader cost: 0.1588 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4015 - reader cost: 0.1598 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.3999 - reader cost: 0.1578 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4017 - reader cost: 0.1591 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4008 - reader cost: 0.1577 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4024 - reader cost: 0.1589 25/125 [=====>........................] - ETA: 43s - batch_cost: 0.4044 - reader cost: 0.1604 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4034 - reader cost: 0.1592 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4020 - reader cost: 0.1575 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4032 - reader cost: 0.1582 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4040 - reader cost: 0.1588 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4043 - reader cost: 0.1586 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4048 - reader cost: 0.1590 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4059 - reader cost: 0.1600 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4066 - reader cost: 0.1605 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4060 - reader cost: 0.1589 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4074 - reader cost: 0.1594 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4082 - reader cost: 0.1601 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4080 - reader cost: 0.1597 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4096 - reader cost: 0.1614 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4092 - reader cost: 0.1601 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4099 - reader cost: 0.1608 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4091 - reader cost: 0.1596 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4093 - reader cost: 0.1598 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4088 - reader cost: 0.1593 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4082 - reader cost: 0.1582 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4077 - reader cost: 0.1576 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4086 - reader cost: 0.1581 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4089 - reader cost: 0.1584 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4091 - reader cost: 0.1587 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4097 - reader cost: 0.1592 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4102 - reader cost: 0.1595 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4097 - reader cost: 0.1590 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4101 - reader cost: 0.1593 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4098 - reader cost: 0.1589 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4102 - reader cost: 0.1590 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4105 - reader cost: 0.1593 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4097 - reader cost: 0.1585 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4102 - reader cost: 0.1589 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4106 - reader cost: 0.1592 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4108 - reader cost: 0.1593 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4101 - reader cost: 0.1586 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4104 - reader cost: 0.1589 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4107 - reader cost: 0.1591 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4111 - reader cost: 0.1594 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4113 - reader cost: 0.1596 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4115 - reader cost: 0.1597 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4111 - reader cost: 0.1594 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4113 - reader cost: 0.1596 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4107 - reader cost: 0.1590 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4109 - reader cost: 0.1592 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4115 - reader cost: 0.1597 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4115 - reader cost: 0.1597 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4118 - reader cost: 0.1599 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4120 - reader cost: 0.1601 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4126 - reader cost: 0.1606 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4128 - reader cost: 0.1608 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4131 - reader cost: 0.1611 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4135 - reader cost: 0.1615 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4139 - reader cost: 0.1617 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4140 - reader cost: 0.1617 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4134 - reader cost: 0.1611 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4129 - reader cost: 0.1605 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4131 - reader cost: 0.1608 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4131 - reader cost: 0.1607 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4130 - reader cost: 0.1605 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4124 - reader cost: 0.1599 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4120 - reader cost: 0.1595 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4117 - reader cost: 0.1591 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4115 - reader cost: 0.1590 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4120 - reader cost: 0.1585 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4120 - reader cost: 0.1577 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4123 - reader cost: 0.1572 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4124 - reader cost: 0.1564 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4121 - reader cost: 0.1557 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4124 - reader cost: 0.1561 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4129 - reader cost: 0.1565 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4131 - reader cost: 0.1568 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4133 - reader cost: 0.1570 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4136 - reader cost: 0.1574 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4137 - reader cost: 0.1575 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4133 - reader cost: 0.1571 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4136 - reader cost: 0.1575 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4140 - reader cost: 0.1578  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4142 - reader cost: 0.1580 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4143 - reader cost: 0.1582 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4144 - reader cost: 0.1583 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4139 - reader cost: 0.1579 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4138 - reader cost: 0.1578 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4139 - reader cost: 0.1580 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4139 - reader cost: 0.1578 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4141 - reader cost: 0.1579 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4143 - reader cost: 0.1580 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4147 - reader cost: 0.1579 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4150 - reader cost: 0.1576 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4151 - reader cost: 0.1572 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4153 - reader cost: 0.1573 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4154 - reader cost: 0.1574 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4156 - reader cost: 0.1573 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4158 - reader cost: 0.1576 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4159 - reader cost: 0.1577 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4160 - reader cost: 0.1579 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4160 - reader cost: 0.1579 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4162 - reader cost: 0.1582 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4163 - reader cost: 0.1584 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4161 - reader cost: 0.1582 125/125 [==============================] - 53s 421ms/step - batch_cost: 0.4162 - reader cost: 0.1584 2021-02-22 21:12:39 [INFO] [EVAL] #Images=500 mIoU=0.6931 Acc=0.9454 Kappa=0.9293 2021-02-22 21:12:39 [INFO] [EVAL] Class IoU: [0.9662 0.7691 0.9114 0.3992 0.5353 0.5747 0.6682 0.7653 0.9065 0.5571 0.9401 0.7824 0.5193 0.924 0.3776 0.7022 0.6445 0.5085 0.7169] 2021-02-22 21:12:39 [INFO] [EVAL] Class Acc: [0.9857 0.8584 0.9492 0.7967 0.6196 0.7212 0.866 0.878 0.9515 0.645 0.972 0.9003 0.8565 0.9513 0.9448 0.9506 0.8834 0.7692 0.7742] 2021-02-22 21:12:43 [INFO] [EVAL] The model with the best validation mIoU (0.7121) was saved at iter 5000. 2021-02-22 21:12:56 [INFO] [TRAIN] epoch=22, iter=8010/80000, loss=0.8441, lr=0.009094, batch_cost=1.3349, reader_cost=0.0001 | ETA 26:41:38 2021-02-22 21:13:10 [INFO] [TRAIN] epoch=22, iter=8020/80000, loss=1.1511, lr=0.009093, batch_cost=1.3918, reader_cost=0.0001 | ETA 27:49:39 2021-02-22 21:13:24 [INFO] [TRAIN] epoch=22, iter=8030/80000, loss=0.9624, lr=0.009092, batch_cost=1.3555, reader_cost=0.0001 | ETA 27:05:54 2021-02-22 21:13:37 [INFO] [TRAIN] epoch=22, iter=8040/80000, loss=0.9634, lr=0.009091, batch_cost=1.3410, reader_cost=0.0001 | ETA 26:48:18 2021-02-22 21:13:51 [INFO] [TRAIN] epoch=22, iter=8050/80000, loss=0.9028, lr=0.009090, batch_cost=1.3415, reader_cost=0.0001 | ETA 26:48:42 2021-02-22 21:14:04 [INFO] [TRAIN] epoch=22, iter=8060/80000, loss=1.1017, lr=0.009089, batch_cost=1.3605, reader_cost=0.0001 | ETA 27:11:15 2021-02-22 21:14:18 [INFO] [TRAIN] epoch=22, iter=8070/80000, loss=0.9443, lr=0.009087, batch_cost=1.3677, reader_cost=0.0001 | ETA 27:19:35 2021-02-22 21:14:31 [INFO] [TRAIN] epoch=22, iter=8080/80000, loss=0.9646, lr=0.009086, batch_cost=1.3348, reader_cost=0.0001 | ETA 26:39:57 2021-02-22 21:14:45 [INFO] [TRAIN] epoch=22, iter=8090/80000, loss=0.9445, lr=0.009085, batch_cost=1.3385, reader_cost=0.0001 | ETA 26:44:14 2021-02-22 21:14:58 [INFO] [TRAIN] epoch=22, iter=8100/80000, loss=0.9547, lr=0.009084, batch_cost=1.3635, reader_cost=0.0001 | ETA 27:13:53 2021-02-22 21:15:12 [INFO] [TRAIN] epoch=22, iter=8110/80000, loss=1.0282, lr=0.009083, batch_cost=1.3654, reader_cost=0.0001 | ETA 27:16:01 2021-02-22 21:15:26 [INFO] [TRAIN] epoch=22, iter=8120/80000, loss=1.0271, lr=0.009082, batch_cost=1.3588, reader_cost=0.0001 | ETA 27:07:48 2021-02-22 21:15:39 [INFO] [TRAIN] epoch=22, iter=8130/80000, loss=0.8814, lr=0.009081, batch_cost=1.3767, reader_cost=0.0001 | ETA 27:29:01 2021-02-22 21:15:54 [INFO] [TRAIN] epoch=22, iter=8140/80000, loss=1.0521, lr=0.009080, batch_cost=1.4126, reader_cost=0.0001 | ETA 28:11:46 2021-02-22 21:16:07 [INFO] [TRAIN] epoch=22, iter=8150/80000, loss=1.0861, lr=0.009078, batch_cost=1.3498, reader_cost=0.0001 | ETA 26:56:25 2021-02-22 21:16:21 [INFO] [TRAIN] epoch=22, iter=8160/80000, loss=0.8595, lr=0.009077, batch_cost=1.3652, reader_cost=0.0001 | ETA 27:14:36 2021-02-22 21:16:34 [INFO] [TRAIN] epoch=22, iter=8170/80000, loss=1.2312, lr=0.009076, batch_cost=1.3571, reader_cost=0.0001 | ETA 27:04:39 2021-02-22 21:16:48 [INFO] [TRAIN] epoch=22, iter=8180/80000, loss=1.0502, lr=0.009075, batch_cost=1.3738, reader_cost=0.0001 | ETA 27:24:28 2021-02-22 21:17:02 [INFO] [TRAIN] epoch=23, iter=8190/80000, loss=1.1310, lr=0.009074, batch_cost=1.4404, reader_cost=0.0697 | ETA 28:43:56 2021-02-22 21:17:16 [INFO] [TRAIN] epoch=23, iter=8200/80000, loss=0.8199, lr=0.009073, batch_cost=1.3521, reader_cost=0.0001 | ETA 26:57:57 2021-02-22 21:17:30 [INFO] [TRAIN] epoch=23, iter=8210/80000, loss=1.0204, lr=0.009072, batch_cost=1.3646, reader_cost=0.0001 | ETA 27:12:44 2021-02-22 21:17:43 [INFO] [TRAIN] epoch=23, iter=8220/80000, loss=0.9955, lr=0.009070, batch_cost=1.3740, reader_cost=0.0001 | ETA 27:23:44 2021-02-22 21:17:57 [INFO] [TRAIN] epoch=23, iter=8230/80000, loss=1.0903, lr=0.009069, batch_cost=1.3427, reader_cost=0.0001 | ETA 26:46:04 2021-02-22 21:18:10 [INFO] [TRAIN] epoch=23, iter=8240/80000, loss=0.9690, lr=0.009068, batch_cost=1.3639, reader_cost=0.0001 | ETA 27:11:16 2021-02-22 21:18:24 [INFO] [TRAIN] epoch=23, iter=8250/80000, loss=0.9422, lr=0.009067, batch_cost=1.3468, reader_cost=0.0001 | ETA 26:50:34 2021-02-22 21:18:37 [INFO] [TRAIN] epoch=23, iter=8260/80000, loss=0.9961, lr=0.009066, batch_cost=1.3547, reader_cost=0.0001 | ETA 26:59:43 2021-02-22 21:18:51 [INFO] [TRAIN] epoch=23, iter=8270/80000, loss=0.9424, lr=0.009065, batch_cost=1.3522, reader_cost=0.0001 | ETA 26:56:31 2021-02-22 21:19:05 [INFO] [TRAIN] epoch=23, iter=8280/80000, loss=1.0417, lr=0.009064, batch_cost=1.3625, reader_cost=0.0001 | ETA 27:08:35 2021-02-22 21:19:18 [INFO] [TRAIN] epoch=23, iter=8290/80000, loss=0.9575, lr=0.009062, batch_cost=1.3401, reader_cost=0.0001 | ETA 26:41:41 2021-02-22 21:19:31 [INFO] [TRAIN] epoch=23, iter=8300/80000, loss=0.9712, lr=0.009061, batch_cost=1.3525, reader_cost=0.0001 | ETA 26:56:17 2021-02-22 21:19:45 [INFO] [TRAIN] epoch=23, iter=8310/80000, loss=1.0153, lr=0.009060, batch_cost=1.3580, reader_cost=0.0001 | ETA 27:02:33 2021-02-22 21:19:58 [INFO] [TRAIN] epoch=23, iter=8320/80000, loss=0.9213, lr=0.009059, batch_cost=1.3396, reader_cost=0.0001 | ETA 26:40:19 2021-02-22 21:20:12 [INFO] [TRAIN] epoch=23, iter=8330/80000, loss=0.9559, lr=0.009058, batch_cost=1.3616, reader_cost=0.0001 | ETA 27:06:26 2021-02-22 21:20:25 [INFO] [TRAIN] epoch=23, iter=8340/80000, loss=0.9012, lr=0.009057, batch_cost=1.3405, reader_cost=0.0001 | ETA 26:41:02 2021-02-22 21:20:39 [INFO] [TRAIN] epoch=23, iter=8350/80000, loss=0.9667, lr=0.009056, batch_cost=1.3674, reader_cost=0.0001 | ETA 27:12:56 2021-02-22 21:20:53 [INFO] [TRAIN] epoch=23, iter=8360/80000, loss=0.8592, lr=0.009055, batch_cost=1.3466, reader_cost=0.0001 | ETA 26:47:53 2021-02-22 21:21:06 [INFO] [TRAIN] epoch=23, iter=8370/80000, loss=0.9844, lr=0.009053, batch_cost=1.3479, reader_cost=0.0001 | ETA 26:49:10 2021-02-22 21:21:20 [INFO] [TRAIN] epoch=23, iter=8380/80000, loss=0.9634, lr=0.009052, batch_cost=1.3962, reader_cost=0.0001 | ETA 27:46:38 2021-02-22 21:21:34 [INFO] [TRAIN] epoch=23, iter=8390/80000, loss=0.9874, lr=0.009051, batch_cost=1.3714, reader_cost=0.0001 | ETA 27:16:46 2021-02-22 21:21:48 [INFO] [TRAIN] epoch=23, iter=8400/80000, loss=0.8459, lr=0.009050, batch_cost=1.3882, reader_cost=0.0001 | ETA 27:36:31 2021-02-22 21:22:01 [INFO] [TRAIN] epoch=23, iter=8410/80000, loss=0.9396, lr=0.009049, batch_cost=1.3136, reader_cost=0.0001 | ETA 26:07:23 2021-02-22 21:22:15 [INFO] [TRAIN] epoch=23, iter=8420/80000, loss=0.8766, lr=0.009048, batch_cost=1.3790, reader_cost=0.0001 | ETA 27:25:10 2021-02-22 21:22:28 [INFO] [TRAIN] epoch=23, iter=8430/80000, loss=0.9263, lr=0.009047, batch_cost=1.3600, reader_cost=0.0001 | ETA 27:02:18 2021-02-22 21:22:42 [INFO] [TRAIN] epoch=23, iter=8440/80000, loss=0.8999, lr=0.009045, batch_cost=1.3394, reader_cost=0.0001 | ETA 26:37:24 2021-02-22 21:22:55 [INFO] [TRAIN] epoch=23, iter=8450/80000, loss=0.9749, lr=0.009044, batch_cost=1.3782, reader_cost=0.0001 | ETA 27:23:30 2021-02-22 21:23:09 [INFO] [TRAIN] epoch=23, iter=8460/80000, loss=0.9417, lr=0.009043, batch_cost=1.3318, reader_cost=0.0001 | ETA 26:27:56 2021-02-22 21:23:22 [INFO] [TRAIN] epoch=23, iter=8470/80000, loss=0.8976, lr=0.009042, batch_cost=1.3766, reader_cost=0.0001 | ETA 27:21:10 2021-02-22 21:23:36 [INFO] [TRAIN] epoch=23, iter=8480/80000, loss=0.9434, lr=0.009041, batch_cost=1.3747, reader_cost=0.0001 | ETA 27:18:36 2021-02-22 21:23:50 [INFO] [TRAIN] epoch=23, iter=8490/80000, loss=1.0216, lr=0.009040, batch_cost=1.3358, reader_cost=0.0001 | ETA 26:32:06 2021-02-22 21:24:03 [INFO] [TRAIN] epoch=23, iter=8500/80000, loss=0.9894, lr=0.009039, batch_cost=1.3768, reader_cost=0.0001 | ETA 27:20:42 2021-02-22 21:24:17 [INFO] [TRAIN] epoch=23, iter=8510/80000, loss=0.9507, lr=0.009037, batch_cost=1.3579, reader_cost=0.0001 | ETA 26:57:53 2021-02-22 21:24:30 [INFO] [TRAIN] epoch=23, iter=8520/80000, loss=0.8807, lr=0.009036, batch_cost=1.3514, reader_cost=0.0001 | ETA 26:49:56 2021-02-22 21:24:44 [INFO] [TRAIN] epoch=23, iter=8530/80000, loss=0.9690, lr=0.009035, batch_cost=1.3475, reader_cost=0.0001 | ETA 26:45:07 2021-02-22 21:24:57 [INFO] [TRAIN] epoch=23, iter=8540/80000, loss=0.9935, lr=0.009034, batch_cost=1.3439, reader_cost=0.0001 | ETA 26:40:38 2021-02-22 21:25:11 [INFO] [TRAIN] epoch=23, iter=8550/80000, loss=0.9533, lr=0.009033, batch_cost=1.3583, reader_cost=0.0001 | ETA 26:57:29 2021-02-22 21:25:25 [INFO] [TRAIN] epoch=24, iter=8560/80000, loss=0.9364, lr=0.009032, batch_cost=1.4410, reader_cost=0.0879 | ETA 28:35:46 2021-02-22 21:25:39 [INFO] [TRAIN] epoch=24, iter=8570/80000, loss=0.9567, lr=0.009031, batch_cost=1.3735, reader_cost=0.0001 | ETA 27:15:11 2021-02-22 21:25:53 [INFO] [TRAIN] epoch=24, iter=8580/80000, loss=0.9458, lr=0.009029, batch_cost=1.3512, reader_cost=0.0001 | ETA 26:48:25 2021-02-22 21:26:06 [INFO] [TRAIN] epoch=24, iter=8590/80000, loss=1.0012, lr=0.009028, batch_cost=1.3561, reader_cost=0.0001 | ETA 26:53:56 2021-02-22 21:26:20 [INFO] [TRAIN] epoch=24, iter=8600/80000, loss=0.9216, lr=0.009027, batch_cost=1.3432, reader_cost=0.0001 | ETA 26:38:24 2021-02-22 21:26:33 [INFO] [TRAIN] epoch=24, iter=8610/80000, loss=0.9109, lr=0.009026, batch_cost=1.3531, reader_cost=0.0001 | ETA 26:49:59 2021-02-22 21:26:47 [INFO] [TRAIN] epoch=24, iter=8620/80000, loss=0.9810, lr=0.009025, batch_cost=1.3591, reader_cost=0.0001 | ETA 26:56:50 2021-02-22 21:27:00 [INFO] [TRAIN] epoch=24, iter=8630/80000, loss=0.9588, lr=0.009024, batch_cost=1.3590, reader_cost=0.0001 | ETA 26:56:32 2021-02-22 21:27:14 [INFO] [TRAIN] epoch=24, iter=8640/80000, loss=0.9207, lr=0.009023, batch_cost=1.3553, reader_cost=0.0001 | ETA 26:51:53 2021-02-22 21:27:28 [INFO] [TRAIN] epoch=24, iter=8650/80000, loss=0.9148, lr=0.009022, batch_cost=1.3744, reader_cost=0.0001 | ETA 27:14:21 2021-02-22 21:27:41 [INFO] [TRAIN] epoch=24, iter=8660/80000, loss=0.9828, lr=0.009020, batch_cost=1.3512, reader_cost=0.0001 | ETA 26:46:35 2021-02-22 21:27:55 [INFO] [TRAIN] epoch=24, iter=8670/80000, loss=0.9861, lr=0.009019, batch_cost=1.3708, reader_cost=0.0001 | ETA 27:09:37 2021-02-22 21:28:09 [INFO] [TRAIN] epoch=24, iter=8680/80000, loss=0.9336, lr=0.009018, batch_cost=1.3859, reader_cost=0.0001 | ETA 27:27:23 2021-02-22 21:28:22 [INFO] [TRAIN] epoch=24, iter=8690/80000, loss=0.9724, lr=0.009017, batch_cost=1.3590, reader_cost=0.0001 | ETA 26:55:13 2021-02-22 21:28:36 [INFO] [TRAIN] epoch=24, iter=8700/80000, loss=1.0045, lr=0.009016, batch_cost=1.3952, reader_cost=0.0001 | ETA 27:37:55 2021-02-22 21:28:50 [INFO] [TRAIN] epoch=24, iter=8710/80000, loss=1.0477, lr=0.009015, batch_cost=1.3591, reader_cost=0.0001 | ETA 26:54:52 2021-02-22 21:29:03 [INFO] [TRAIN] epoch=24, iter=8720/80000, loss=0.8979, lr=0.009014, batch_cost=1.3596, reader_cost=0.0001 | ETA 26:55:10 2021-02-22 21:29:17 [INFO] [TRAIN] epoch=24, iter=8730/80000, loss=0.9817, lr=0.009012, batch_cost=1.3457, reader_cost=0.0001 | ETA 26:38:26 2021-02-22 21:29:30 [INFO] [TRAIN] epoch=24, iter=8740/80000, loss=0.9402, lr=0.009011, batch_cost=1.3594, reader_cost=0.0001 | ETA 26:54:34 2021-02-22 21:29:44 [INFO] [TRAIN] epoch=24, iter=8750/80000, loss=1.0114, lr=0.009010, batch_cost=1.3744, reader_cost=0.0001 | ETA 27:12:07 2021-02-22 21:29:58 [INFO] [TRAIN] epoch=24, iter=8760/80000, loss=0.9675, lr=0.009009, batch_cost=1.3380, reader_cost=0.0001 | ETA 26:28:37 2021-02-22 21:30:11 [INFO] [TRAIN] epoch=24, iter=8770/80000, loss=0.7976, lr=0.009008, batch_cost=1.3675, reader_cost=0.0001 | ETA 27:03:29 2021-02-22 21:30:25 [INFO] [TRAIN] epoch=24, iter=8780/80000, loss=0.9511, lr=0.009007, batch_cost=1.3417, reader_cost=0.0001 | ETA 26:32:36 2021-02-22 21:30:38 [INFO] [TRAIN] epoch=24, iter=8790/80000, loss=0.9492, lr=0.009006, batch_cost=1.3719, reader_cost=0.0001 | ETA 27:08:15 2021-02-22 21:30:52 [INFO] [TRAIN] epoch=24, iter=8800/80000, loss=1.0175, lr=0.009004, batch_cost=1.3565, reader_cost=0.0001 | ETA 26:49:40 2021-02-22 21:31:06 [INFO] [TRAIN] epoch=24, iter=8810/80000, loss=0.8909, lr=0.009003, batch_cost=1.3764, reader_cost=0.0001 | ETA 27:13:09 2021-02-22 21:31:19 [INFO] [TRAIN] epoch=24, iter=8820/80000, loss=0.8590, lr=0.009002, batch_cost=1.3568, reader_cost=0.0001 | ETA 26:49:34 2021-02-22 21:31:33 [INFO] [TRAIN] epoch=24, iter=8830/80000, loss=0.9650, lr=0.009001, batch_cost=1.3778, reader_cost=0.0001 | ETA 27:14:18 2021-02-22 21:31:46 [INFO] [TRAIN] epoch=24, iter=8840/80000, loss=0.9312, lr=0.009000, batch_cost=1.3269, reader_cost=0.0001 | ETA 26:13:44 2021-02-22 21:32:00 [INFO] [TRAIN] epoch=24, iter=8850/80000, loss=0.9471, lr=0.008999, batch_cost=1.3506, reader_cost=0.0001 | ETA 26:41:36 2021-02-22 21:32:13 [INFO] [TRAIN] epoch=24, iter=8860/80000, loss=0.9490, lr=0.008998, batch_cost=1.3591, reader_cost=0.0001 | ETA 26:51:24 2021-02-22 21:32:27 [INFO] [TRAIN] epoch=24, iter=8870/80000, loss=0.9446, lr=0.008996, batch_cost=1.3715, reader_cost=0.0001 | ETA 27:05:58 2021-02-22 21:32:41 [INFO] [TRAIN] epoch=24, iter=8880/80000, loss=1.0452, lr=0.008995, batch_cost=1.3668, reader_cost=0.0001 | ETA 27:00:07 2021-02-22 21:32:55 [INFO] [TRAIN] epoch=24, iter=8890/80000, loss=0.9638, lr=0.008994, batch_cost=1.3712, reader_cost=0.0001 | ETA 27:05:04 2021-02-22 21:33:08 [INFO] [TRAIN] epoch=24, iter=8900/80000, loss=0.9211, lr=0.008993, batch_cost=1.3579, reader_cost=0.0001 | ETA 26:49:06 2021-02-22 21:33:21 [INFO] [TRAIN] epoch=24, iter=8910/80000, loss=0.8990, lr=0.008992, batch_cost=1.3351, reader_cost=0.0001 | ETA 26:21:55 2021-02-22 21:33:35 [INFO] [TRAIN] epoch=24, iter=8920/80000, loss=1.0563, lr=0.008991, batch_cost=1.3669, reader_cost=0.0001 | ETA 26:59:17 2021-02-22 21:33:49 [INFO] [TRAIN] epoch=25, iter=8930/80000, loss=0.9018, lr=0.008990, batch_cost=1.4355, reader_cost=0.0785 | ETA 28:20:17 2021-02-22 21:34:03 [INFO] [TRAIN] epoch=25, iter=8940/80000, loss=0.9975, lr=0.008988, batch_cost=1.3749, reader_cost=0.0001 | ETA 27:08:16 2021-02-22 21:34:17 [INFO] [TRAIN] epoch=25, iter=8950/80000, loss=0.9966, lr=0.008987, batch_cost=1.3556, reader_cost=0.0001 | ETA 26:45:13 2021-02-22 21:34:31 [INFO] [TRAIN] epoch=25, iter=8960/80000, loss=0.9959, lr=0.008986, batch_cost=1.3745, reader_cost=0.0001 | ETA 27:07:23 2021-02-22 21:34:44 [INFO] [TRAIN] epoch=25, iter=8970/80000, loss=0.9991, lr=0.008985, batch_cost=1.3470, reader_cost=0.0001 | ETA 26:34:40 2021-02-22 21:34:58 [INFO] [TRAIN] epoch=25, iter=8980/80000, loss=1.0103, lr=0.008984, batch_cost=1.3608, reader_cost=0.0001 | ETA 26:50:43 2021-02-22 21:35:11 [INFO] [TRAIN] epoch=25, iter=8990/80000, loss=0.9098, lr=0.008983, batch_cost=1.3651, reader_cost=0.0001 | ETA 26:55:35 2021-02-22 21:35:25 [INFO] [TRAIN] epoch=25, iter=9000/80000, loss=0.9311, lr=0.008982, batch_cost=1.3600, reader_cost=0.0001 | ETA 26:49:17 2021-02-22 21:35:25 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:10 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:03 - batch_cost: 0.2290 - reader cost: 0.0979  3/125 [..............................] - ETA: 58s - batch_cost: 0.2904 - reader cost: 0.1194  4/125 [..............................] - ETA: 54s - batch_cost: 0.3117 - reader cost: 0.1210 5/125 [>.............................] - ETA: 52s - batch_cost: 0.3257 - reader cost: 0.1224 6/125 [>.............................] - ETA: 52s - batch_cost: 0.3457 - reader cost: 0.1336 7/125 [>.............................] - ETA: 51s - batch_cost: 0.3588 - reader cost: 0.1411 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3690 - reader cost: 0.1454 9/125 [=>............................] - ETA: 50s - batch_cost: 0.3696 - reader cost: 0.1419 10/125 [=>............................] - ETA: 49s - batch_cost: 0.3764 - reader cost: 0.1454 11/125 [=>............................] - ETA: 48s - batch_cost: 0.3758 - reader cost: 0.1428 12/125 [=>............................] - ETA: 48s - batch_cost: 0.3810 - reader cost: 0.1464 13/125 [==>...........................] - ETA: 47s - batch_cost: 0.3793 - reader cost: 0.1437 14/125 [==>...........................] - ETA: 46s - batch_cost: 0.3800 - reader cost: 0.1427 15/125 [==>...........................] - ETA: 46s - batch_cost: 0.3842 - reader cost: 0.1457 16/125 [==>...........................] - ETA: 46s - batch_cost: 0.3875 - reader cost: 0.1479 17/125 [===>..........................] - ETA: 45s - batch_cost: 0.3902 - reader cost: 0.1490 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3924 - reader cost: 0.1505 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3947 - reader cost: 0.1523 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3948 - reader cost: 0.1518 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.3965 - reader cost: 0.1531 22/125 [====>.........................] - ETA: 43s - batch_cost: 0.3964 - reader cost: 0.1524 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.3975 - reader cost: 0.1532 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.3997 - reader cost: 0.1543 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4001 - reader cost: 0.1543 26/125 [=====>........................] - ETA: 41s - batch_cost: 0.3988 - reader cost: 0.1526 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.3986 - reader cost: 0.1521 28/125 [=====>........................] - ETA: 40s - batch_cost: 0.4001 - reader cost: 0.1533 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.3991 - reader cost: 0.1520 30/125 [======>.......................] - ETA: 39s - batch_cost: 0.3989 - reader cost: 0.1517 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.3999 - reader cost: 0.1525 32/125 [======>.......................] - ETA: 38s - batch_cost: 0.4012 - reader cost: 0.1538 33/125 [======>.......................] - ETA: 38s - batch_cost: 0.4006 - reader cost: 0.1530 34/125 [=======>......................] - ETA: 37s - batch_cost: 0.4001 - reader cost: 0.1522 35/125 [=======>......................] - ETA: 37s - batch_cost: 0.4009 - reader cost: 0.1530 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4019 - reader cost: 0.1538 37/125 [=======>......................] - ETA: 36s - batch_cost: 0.4016 - reader cost: 0.1533 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4027 - reader cost: 0.1542 39/125 [========>.....................] - ETA: 35s - batch_cost: 0.4019 - reader cost: 0.1534 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4029 - reader cost: 0.1543 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4033 - reader cost: 0.1547 42/125 [=========>....................] - ETA: 34s - batch_cost: 0.4033 - reader cost: 0.1542 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4038 - reader cost: 0.1547 44/125 [=========>....................] - ETA: 33s - batch_cost: 0.4036 - reader cost: 0.1544 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4042 - reader cost: 0.1550 46/125 [==========>...................] - ETA: 32s - batch_cost: 0.4046 - reader cost: 0.1554 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4041 - reader cost: 0.1549 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4043 - reader cost: 0.1540 49/125 [==========>...................] - ETA: 31s - batch_cost: 0.4048 - reader cost: 0.1546 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4045 - reader cost: 0.1542 51/125 [===========>..................] - ETA: 30s - batch_cost: 0.4050 - reader cost: 0.1548 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4056 - reader cost: 0.1553 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4061 - reader cost: 0.1558 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4053 - reader cost: 0.1550 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4058 - reader cost: 0.1553 56/125 [============>.................] - ETA: 28s - batch_cost: 0.4062 - reader cost: 0.1555 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4067 - reader cost: 0.1560 58/125 [============>.................] - ETA: 27s - batch_cost: 0.4062 - reader cost: 0.1555 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4067 - reader cost: 0.1560 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4072 - reader cost: 0.1563 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4064 - reader cost: 0.1555 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4068 - reader cost: 0.1559 63/125 [==============>...............] - ETA: 25s - batch_cost: 0.4063 - reader cost: 0.1553 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4066 - reader cost: 0.1556 65/125 [==============>...............] - ETA: 24s - batch_cost: 0.4069 - reader cost: 0.1559 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4065 - reader cost: 0.1554 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4074 - reader cost: 0.1563 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4079 - reader cost: 0.1568 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4084 - reader cost: 0.1573 70/125 [===============>..............] - ETA: 22s - batch_cost: 0.4088 - reader cost: 0.1576 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4093 - reader cost: 0.1581 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4096 - reader cost: 0.1582 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4102 - reader cost: 0.1587 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4106 - reader cost: 0.1592 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4110 - reader cost: 0.1595 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4107 - reader cost: 0.1592 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4111 - reader cost: 0.1596 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4112 - reader cost: 0.1597 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4115 - reader cost: 0.1598 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4118 - reader cost: 0.1601 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4121 - reader cost: 0.1605 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4124 - reader cost: 0.1607 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4126 - reader cost: 0.1609 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4122 - reader cost: 0.1604 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4120 - reader cost: 0.1603 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4121 - reader cost: 0.1604 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4124 - reader cost: 0.1607 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4125 - reader cost: 0.1607 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4120 - reader cost: 0.1603 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4123 - reader cost: 0.1605 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4125 - reader cost: 0.1606 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4122 - reader cost: 0.1603 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4120 - reader cost: 0.1600 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4122 - reader cost: 0.1602 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4123 - reader cost: 0.1602 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4118 - reader cost: 0.1598 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4117 - reader cost: 0.1596 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4121 - reader cost: 0.1601 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4118 - reader cost: 0.1598 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4115 - reader cost: 0.1594 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4113 - reader cost: 0.1591 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4115 - reader cost: 0.1593  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4113 - reader cost: 0.1591 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4112 - reader cost: 0.1590 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4115 - reader cost: 0.1590 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4118 - reader cost: 0.1593 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4119 - reader cost: 0.1588 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4117 - reader cost: 0.1584 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4121 - reader cost: 0.1588 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4122 - reader cost: 0.1589 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4125 - reader cost: 0.1592 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4131 - reader cost: 0.1598 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4130 - reader cost: 0.1596 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4132 - reader cost: 0.1598 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4133 - reader cost: 0.1598 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4130 - reader cost: 0.1595 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4132 - reader cost: 0.1597 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4134 - reader cost: 0.1599 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4137 - reader cost: 0.1601 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4133 - reader cost: 0.1597 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4134 - reader cost: 0.1598 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4133 - reader cost: 0.1597 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4134 - reader cost: 0.1598 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4136 - reader cost: 0.1600 125/125 [==============================] - 52s 418ms/step - batch_cost: 0.4135 - reader cost: 0.1599 2021-02-22 21:36:17 [INFO] [EVAL] #Images=500 mIoU=0.6992 Acc=0.9488 Kappa=0.9334 2021-02-22 21:36:17 [INFO] [EVAL] Class IoU: [0.974 0.8082 0.9036 0.3852 0.3692 0.5711 0.6695 0.7604 0.9102 0.5584 0.9368 0.7961 0.6031 0.9217 0.6012 0.5753 0.659 0.5431 0.739 ] 2021-02-22 21:36:17 [INFO] [EVAL] Class Acc: [0.9849 0.8897 0.9343 0.741 0.8739 0.8605 0.8461 0.8788 0.9373 0.8613 0.9611 0.9057 0.7457 0.9433 0.9477 0.9554 0.9745 0.6185 0.8755] 2021-02-22 21:36:21 [INFO] [EVAL] The model with the best validation mIoU (0.7121) was saved at iter 5000. 2021-02-22 21:36:35 [INFO] [TRAIN] epoch=25, iter=9010/80000, loss=0.9232, lr=0.008981, batch_cost=1.3404, reader_cost=0.0001 | ETA 26:25:55 2021-02-22 21:36:49 [INFO] [TRAIN] epoch=25, iter=9020/80000, loss=0.9724, lr=0.008979, batch_cost=1.3953, reader_cost=0.0001 | ETA 27:30:35 2021-02-22 21:37:02 [INFO] [TRAIN] epoch=25, iter=9030/80000, loss=0.8752, lr=0.008978, batch_cost=1.3477, reader_cost=0.0001 | ETA 26:34:06 2021-02-22 21:37:16 [INFO] [TRAIN] epoch=25, iter=9040/80000, loss=0.9487, lr=0.008977, batch_cost=1.3658, reader_cost=0.0001 | ETA 26:55:13 2021-02-22 21:37:29 [INFO] [TRAIN] epoch=25, iter=9050/80000, loss=0.9120, lr=0.008976, batch_cost=1.3544, reader_cost=0.0001 | ETA 26:41:35 2021-02-22 21:37:43 [INFO] [TRAIN] epoch=25, iter=9060/80000, loss=0.9609, lr=0.008975, batch_cost=1.3778, reader_cost=0.0001 | ETA 27:09:02 2021-02-22 21:37:57 [INFO] [TRAIN] epoch=25, iter=9070/80000, loss=0.9605, lr=0.008974, batch_cost=1.3536, reader_cost=0.0001 | ETA 26:40:10 2021-02-22 21:38:10 [INFO] [TRAIN] epoch=25, iter=9080/80000, loss=1.0030, lr=0.008973, batch_cost=1.3645, reader_cost=0.0001 | ETA 26:52:48 2021-02-22 21:38:24 [INFO] [TRAIN] epoch=25, iter=9090/80000, loss=0.9113, lr=0.008971, batch_cost=1.3865, reader_cost=0.0001 | ETA 27:18:40 2021-02-22 21:38:38 [INFO] [TRAIN] epoch=25, iter=9100/80000, loss=0.9203, lr=0.008970, batch_cost=1.3680, reader_cost=0.0001 | ETA 26:56:32 2021-02-22 21:38:52 [INFO] [TRAIN] epoch=25, iter=9110/80000, loss=1.0528, lr=0.008969, batch_cost=1.3807, reader_cost=0.0001 | ETA 27:11:16 2021-02-22 21:39:05 [INFO] [TRAIN] epoch=25, iter=9120/80000, loss=1.0270, lr=0.008968, batch_cost=1.3520, reader_cost=0.0001 | ETA 26:37:09 2021-02-22 21:39:19 [INFO] [TRAIN] epoch=25, iter=9130/80000, loss=0.9949, lr=0.008967, batch_cost=1.3635, reader_cost=0.0001 | ETA 26:50:33 2021-02-22 21:39:32 [INFO] [TRAIN] epoch=25, iter=9140/80000, loss=0.9905, lr=0.008966, batch_cost=1.3641, reader_cost=0.0001 | ETA 26:50:57 2021-02-22 21:39:46 [INFO] [TRAIN] epoch=25, iter=9150/80000, loss=0.9377, lr=0.008965, batch_cost=1.3499, reader_cost=0.0001 | ETA 26:33:59 2021-02-22 21:39:59 [INFO] [TRAIN] epoch=25, iter=9160/80000, loss=0.9817, lr=0.008963, batch_cost=1.3281, reader_cost=0.0001 | ETA 26:08:02 2021-02-22 21:40:13 [INFO] [TRAIN] epoch=25, iter=9170/80000, loss=0.9245, lr=0.008962, batch_cost=1.3559, reader_cost=0.0001 | ETA 26:40:40 2021-02-22 21:40:26 [INFO] [TRAIN] epoch=25, iter=9180/80000, loss=0.9193, lr=0.008961, batch_cost=1.3589, reader_cost=0.0001 | ETA 26:43:56 2021-02-22 21:40:40 [INFO] [TRAIN] epoch=25, iter=9190/80000, loss=0.9608, lr=0.008960, batch_cost=1.3350, reader_cost=0.0001 | ETA 26:15:30 2021-02-22 21:40:53 [INFO] [TRAIN] epoch=25, iter=9200/80000, loss=0.9517, lr=0.008959, batch_cost=1.3764, reader_cost=0.0001 | ETA 27:04:06 2021-02-22 21:41:07 [INFO] [TRAIN] epoch=25, iter=9210/80000, loss=1.0388, lr=0.008958, batch_cost=1.3547, reader_cost=0.0001 | ETA 26:38:17 2021-02-22 21:41:21 [INFO] [TRAIN] epoch=25, iter=9220/80000, loss=0.9360, lr=0.008957, batch_cost=1.3666, reader_cost=0.0001 | ETA 26:52:07 2021-02-22 21:41:34 [INFO] [TRAIN] epoch=25, iter=9230/80000, loss=0.8397, lr=0.008955, batch_cost=1.3578, reader_cost=0.0001 | ETA 26:41:34 2021-02-22 21:41:48 [INFO] [TRAIN] epoch=25, iter=9240/80000, loss=0.8854, lr=0.008954, batch_cost=1.3805, reader_cost=0.0001 | ETA 27:08:05 2021-02-22 21:42:02 [INFO] [TRAIN] epoch=25, iter=9250/80000, loss=0.9897, lr=0.008953, batch_cost=1.3558, reader_cost=0.0001 | ETA 26:38:40 2021-02-22 21:42:15 [INFO] [TRAIN] epoch=25, iter=9260/80000, loss=0.9589, lr=0.008952, batch_cost=1.3484, reader_cost=0.0001 | ETA 26:29:43 2021-02-22 21:42:29 [INFO] [TRAIN] epoch=25, iter=9270/80000, loss=1.0348, lr=0.008951, batch_cost=1.3452, reader_cost=0.0001 | ETA 26:25:47 2021-02-22 21:42:42 [INFO] [TRAIN] epoch=25, iter=9280/80000, loss=0.9186, lr=0.008950, batch_cost=1.3804, reader_cost=0.0001 | ETA 27:07:04 2021-02-22 21:42:56 [INFO] [TRAIN] epoch=25, iter=9290/80000, loss=0.9871, lr=0.008949, batch_cost=1.3697, reader_cost=0.0001 | ETA 26:54:11 2021-02-22 21:43:09 [INFO] [TRAIN] epoch=25, iter=9300/80000, loss=0.9149, lr=0.008948, batch_cost=1.3085, reader_cost=0.0001 | ETA 25:41:48 2021-02-22 21:43:24 [INFO] [TRAIN] epoch=26, iter=9310/80000, loss=1.1172, lr=0.008946, batch_cost=1.4937, reader_cost=0.0841 | ETA 29:19:46 2021-02-22 21:43:38 [INFO] [TRAIN] epoch=26, iter=9320/80000, loss=0.9330, lr=0.008945, batch_cost=1.3604, reader_cost=0.0001 | ETA 26:42:31 2021-02-22 21:43:51 [INFO] [TRAIN] epoch=26, iter=9330/80000, loss=0.8814, lr=0.008944, batch_cost=1.3510, reader_cost=0.0001 | ETA 26:31:14 2021-02-22 21:44:05 [INFO] [TRAIN] epoch=26, iter=9340/80000, loss=0.9981, lr=0.008943, batch_cost=1.3769, reader_cost=0.0001 | ETA 27:01:34 2021-02-22 21:44:18 [INFO] [TRAIN] epoch=26, iter=9350/80000, loss=0.9491, lr=0.008942, batch_cost=1.3503, reader_cost=0.0001 | ETA 26:30:00 2021-02-22 21:44:32 [INFO] [TRAIN] epoch=26, iter=9360/80000, loss=0.9506, lr=0.008941, batch_cost=1.3912, reader_cost=0.0001 | ETA 27:17:51 2021-02-22 21:44:46 [INFO] [TRAIN] epoch=26, iter=9370/80000, loss=0.9915, lr=0.008940, batch_cost=1.3718, reader_cost=0.0001 | ETA 26:54:50 2021-02-22 21:45:00 [INFO] [TRAIN] epoch=26, iter=9380/80000, loss=1.0393, lr=0.008938, batch_cost=1.3525, reader_cost=0.0001 | ETA 26:31:55 2021-02-22 21:45:13 [INFO] [TRAIN] epoch=26, iter=9390/80000, loss=0.9027, lr=0.008937, batch_cost=1.3486, reader_cost=0.0001 | ETA 26:27:03 2021-02-22 21:45:27 [INFO] [TRAIN] epoch=26, iter=9400/80000, loss=0.9943, lr=0.008936, batch_cost=1.3794, reader_cost=0.0001 | ETA 27:03:03 2021-02-22 21:45:40 [INFO] [TRAIN] epoch=26, iter=9410/80000, loss=0.8677, lr=0.008935, batch_cost=1.3481, reader_cost=0.0001 | ETA 26:26:02 2021-02-22 21:45:54 [INFO] [TRAIN] epoch=26, iter=9420/80000, loss=1.0146, lr=0.008934, batch_cost=1.3631, reader_cost=0.0001 | ETA 26:43:26 2021-02-22 21:46:07 [INFO] [TRAIN] epoch=26, iter=9430/80000, loss=0.8568, lr=0.008933, batch_cost=1.3517, reader_cost=0.0001 | ETA 26:29:47 2021-02-22 21:46:21 [INFO] [TRAIN] epoch=26, iter=9440/80000, loss=0.9873, lr=0.008932, batch_cost=1.3942, reader_cost=0.0001 | ETA 27:19:34 2021-02-22 21:46:35 [INFO] [TRAIN] epoch=26, iter=9450/80000, loss=1.0177, lr=0.008930, batch_cost=1.3747, reader_cost=0.0001 | ETA 26:56:23 2021-02-22 21:46:49 [INFO] [TRAIN] epoch=26, iter=9460/80000, loss=1.0139, lr=0.008929, batch_cost=1.3880, reader_cost=0.0001 | ETA 27:11:52 2021-02-22 21:47:03 [INFO] [TRAIN] epoch=26, iter=9470/80000, loss=0.8893, lr=0.008928, batch_cost=1.3823, reader_cost=0.0001 | ETA 27:04:56 2021-02-22 21:47:17 [INFO] [TRAIN] epoch=26, iter=9480/80000, loss=0.9185, lr=0.008927, batch_cost=1.3715, reader_cost=0.0001 | ETA 26:52:00 2021-02-22 21:47:30 [INFO] [TRAIN] epoch=26, iter=9490/80000, loss=0.9350, lr=0.008926, batch_cost=1.3304, reader_cost=0.0001 | ETA 26:03:27 2021-02-22 21:47:43 [INFO] [TRAIN] epoch=26, iter=9500/80000, loss=0.8982, lr=0.008925, batch_cost=1.3526, reader_cost=0.0001 | ETA 26:29:17 2021-02-22 21:47:57 [INFO] [TRAIN] epoch=26, iter=9510/80000, loss=0.9508, lr=0.008924, batch_cost=1.3587, reader_cost=0.0001 | ETA 26:36:15 2021-02-22 21:48:10 [INFO] [TRAIN] epoch=26, iter=9520/80000, loss=0.8372, lr=0.008922, batch_cost=1.3399, reader_cost=0.0001 | ETA 26:13:55 2021-02-22 21:48:24 [INFO] [TRAIN] epoch=26, iter=9530/80000, loss=0.9280, lr=0.008921, batch_cost=1.3602, reader_cost=0.0001 | ETA 26:37:34 2021-02-22 21:48:38 [INFO] [TRAIN] epoch=26, iter=9540/80000, loss=0.9739, lr=0.008920, batch_cost=1.3579, reader_cost=0.0001 | ETA 26:34:40 2021-02-22 21:48:51 [INFO] [TRAIN] epoch=26, iter=9550/80000, loss=0.9100, lr=0.008919, batch_cost=1.3839, reader_cost=0.0001 | ETA 27:04:57 2021-02-22 21:49:05 [INFO] [TRAIN] epoch=26, iter=9560/80000, loss=0.8893, lr=0.008918, batch_cost=1.3440, reader_cost=0.0001 | ETA 26:17:51 2021-02-22 21:49:18 [INFO] [TRAIN] epoch=26, iter=9570/80000, loss=0.8574, lr=0.008917, batch_cost=1.3437, reader_cost=0.0001 | ETA 26:17:17 2021-02-22 21:49:32 [INFO] [TRAIN] epoch=26, iter=9580/80000, loss=0.8612, lr=0.008916, batch_cost=1.3606, reader_cost=0.0001 | ETA 26:36:55 2021-02-22 21:49:46 [INFO] [TRAIN] epoch=26, iter=9590/80000, loss=1.0111, lr=0.008914, batch_cost=1.3585, reader_cost=0.0001 | ETA 26:34:09 2021-02-22 21:49:59 [INFO] [TRAIN] epoch=26, iter=9600/80000, loss=0.9460, lr=0.008913, batch_cost=1.3684, reader_cost=0.0001 | ETA 26:45:34 2021-02-22 21:50:13 [INFO] [TRAIN] epoch=26, iter=9610/80000, loss=0.8629, lr=0.008912, batch_cost=1.3798, reader_cost=0.0001 | ETA 26:58:42 2021-02-22 21:50:27 [INFO] [TRAIN] epoch=26, iter=9620/80000, loss=0.9418, lr=0.008911, batch_cost=1.3796, reader_cost=0.0001 | ETA 26:58:17 2021-02-22 21:50:40 [INFO] [TRAIN] epoch=26, iter=9630/80000, loss=0.8747, lr=0.008910, batch_cost=1.3405, reader_cost=0.0001 | ETA 26:12:13 2021-02-22 21:50:54 [INFO] [TRAIN] epoch=26, iter=9640/80000, loss=0.9503, lr=0.008909, batch_cost=1.3732, reader_cost=0.0001 | ETA 26:50:19 2021-02-22 21:51:07 [INFO] [TRAIN] epoch=26, iter=9650/80000, loss=0.8711, lr=0.008908, batch_cost=1.3507, reader_cost=0.0001 | ETA 26:23:43 2021-02-22 21:51:21 [INFO] [TRAIN] epoch=26, iter=9660/80000, loss=0.9247, lr=0.008906, batch_cost=1.3787, reader_cost=0.0001 | ETA 26:56:21 2021-02-22 21:51:34 [INFO] [TRAIN] epoch=26, iter=9670/80000, loss=0.9538, lr=0.008905, batch_cost=1.3250, reader_cost=0.0001 | ETA 25:53:07 2021-02-22 21:51:49 [INFO] [TRAIN] epoch=27, iter=9680/80000, loss=0.9975, lr=0.008904, batch_cost=1.4634, reader_cost=0.0696 | ETA 28:35:07 2021-02-22 21:52:03 [INFO] [TRAIN] epoch=27, iter=9690/80000, loss=1.0284, lr=0.008903, batch_cost=1.3721, reader_cost=0.0001 | ETA 26:47:52 2021-02-22 21:52:16 [INFO] [TRAIN] epoch=27, iter=9700/80000, loss=0.9935, lr=0.008902, batch_cost=1.3514, reader_cost=0.0001 | ETA 26:23:22 2021-02-22 21:52:30 [INFO] [TRAIN] epoch=27, iter=9710/80000, loss=0.9415, lr=0.008901, batch_cost=1.3575, reader_cost=0.0001 | ETA 26:30:20 2021-02-22 21:52:44 [INFO] [TRAIN] epoch=27, iter=9720/80000, loss=0.9904, lr=0.008900, batch_cost=1.3600, reader_cost=0.0001 | ETA 26:33:02 2021-02-22 21:52:57 [INFO] [TRAIN] epoch=27, iter=9730/80000, loss=0.9140, lr=0.008899, batch_cost=1.3718, reader_cost=0.0001 | ETA 26:46:35 2021-02-22 21:53:11 [INFO] [TRAIN] epoch=27, iter=9740/80000, loss=1.0382, lr=0.008897, batch_cost=1.3561, reader_cost=0.0001 | ETA 26:27:59 2021-02-22 21:53:25 [INFO] [TRAIN] epoch=27, iter=9750/80000, loss=0.9382, lr=0.008896, batch_cost=1.3850, reader_cost=0.0001 | ETA 27:01:33 2021-02-22 21:53:38 [INFO] [TRAIN] epoch=27, iter=9760/80000, loss=0.9274, lr=0.008895, batch_cost=1.3400, reader_cost=0.0001 | ETA 26:08:40 2021-02-22 21:53:52 [INFO] [TRAIN] epoch=27, iter=9770/80000, loss=0.9533, lr=0.008894, batch_cost=1.3650, reader_cost=0.0001 | ETA 26:37:42 2021-02-22 21:54:05 [INFO] [TRAIN] epoch=27, iter=9780/80000, loss=1.1235, lr=0.008893, batch_cost=1.3591, reader_cost=0.0001 | ETA 26:30:33 2021-02-22 21:54:19 [INFO] [TRAIN] epoch=27, iter=9790/80000, loss=0.9495, lr=0.008892, batch_cost=1.3647, reader_cost=0.0001 | ETA 26:36:52 2021-02-22 21:54:33 [INFO] [TRAIN] epoch=27, iter=9800/80000, loss=1.0250, lr=0.008891, batch_cost=1.3632, reader_cost=0.0001 | ETA 26:34:54 2021-02-22 21:54:46 [INFO] [TRAIN] epoch=27, iter=9810/80000, loss=0.9252, lr=0.008889, batch_cost=1.3610, reader_cost=0.0001 | ETA 26:32:09 2021-02-22 21:55:00 [INFO] [TRAIN] epoch=27, iter=9820/80000, loss=1.1032, lr=0.008888, batch_cost=1.3544, reader_cost=0.0001 | ETA 26:24:13 2021-02-22 21:55:13 [INFO] [TRAIN] epoch=27, iter=9830/80000, loss=0.7869, lr=0.008887, batch_cost=1.3350, reader_cost=0.0001 | ETA 26:01:18 2021-02-22 21:55:27 [INFO] [TRAIN] epoch=27, iter=9840/80000, loss=0.9100, lr=0.008886, batch_cost=1.3590, reader_cost=0.0001 | ETA 26:29:07 2021-02-22 21:55:40 [INFO] [TRAIN] epoch=27, iter=9850/80000, loss=0.8784, lr=0.008885, batch_cost=1.3467, reader_cost=0.0001 | ETA 26:14:33 2021-02-22 21:55:54 [INFO] [TRAIN] epoch=27, iter=9860/80000, loss=0.8795, lr=0.008884, batch_cost=1.3639, reader_cost=0.0001 | ETA 26:34:21 2021-02-22 21:56:07 [INFO] [TRAIN] epoch=27, iter=9870/80000, loss=0.9258, lr=0.008883, batch_cost=1.3362, reader_cost=0.0001 | ETA 26:01:48 2021-02-22 21:56:20 [INFO] [TRAIN] epoch=27, iter=9880/80000, loss=0.8616, lr=0.008881, batch_cost=1.3247, reader_cost=0.0001 | ETA 25:48:04 2021-02-22 21:56:34 [INFO] [TRAIN] epoch=27, iter=9890/80000, loss=1.0518, lr=0.008880, batch_cost=1.3594, reader_cost=0.0001 | ETA 26:28:26 2021-02-22 21:56:48 [INFO] [TRAIN] epoch=27, iter=9900/80000, loss=0.9845, lr=0.008879, batch_cost=1.3550, reader_cost=0.0001 | ETA 26:23:08 2021-02-22 21:57:01 [INFO] [TRAIN] epoch=27, iter=9910/80000, loss=0.9442, lr=0.008878, batch_cost=1.3680, reader_cost=0.0001 | ETA 26:38:02 2021-02-22 21:57:15 [INFO] [TRAIN] epoch=27, iter=9920/80000, loss=0.9601, lr=0.008877, batch_cost=1.3629, reader_cost=0.0001 | ETA 26:31:54 2021-02-22 21:57:29 [INFO] [TRAIN] epoch=27, iter=9930/80000, loss=1.0092, lr=0.008876, batch_cost=1.3753, reader_cost=0.0001 | ETA 26:46:08 2021-02-22 21:57:42 [INFO] [TRAIN] epoch=27, iter=9940/80000, loss=0.8113, lr=0.008875, batch_cost=1.3834, reader_cost=0.0001 | ETA 26:55:20 2021-02-22 21:57:56 [INFO] [TRAIN] epoch=27, iter=9950/80000, loss=1.0079, lr=0.008873, batch_cost=1.3794, reader_cost=0.0001 | ETA 26:50:29 2021-02-22 21:58:10 [INFO] [TRAIN] epoch=27, iter=9960/80000, loss=1.0955, lr=0.008872, batch_cost=1.3587, reader_cost=0.0001 | ETA 26:26:06 2021-02-22 21:58:23 [INFO] [TRAIN] epoch=27, iter=9970/80000, loss=1.0165, lr=0.008871, batch_cost=1.3540, reader_cost=0.0001 | ETA 26:20:19 2021-02-22 21:58:37 [INFO] [TRAIN] epoch=27, iter=9980/80000, loss=0.8781, lr=0.008870, batch_cost=1.3671, reader_cost=0.0001 | ETA 26:35:26 2021-02-22 21:58:51 [INFO] [TRAIN] epoch=27, iter=9990/80000, loss=0.8540, lr=0.008869, batch_cost=1.3831, reader_cost=0.0001 | ETA 26:53:51 2021-02-22 21:59:04 [INFO] [TRAIN] epoch=27, iter=10000/80000, loss=0.9256, lr=0.008868, batch_cost=1.3498, reader_cost=0.0001 | ETA 26:14:43 2021-02-22 21:59:04 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:18 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:06 - batch_cost: 0.2255 - reader cost: 0.0890  3/125 [..............................] - ETA: 1:02 - batch_cost: 0.3034 - reader cost: 0.1244 4/125 [..............................] - ETA: 58s - batch_cost: 0.3224 - reader cost: 0.1242  5/125 [>.............................] - ETA: 57s - batch_cost: 0.3493 - reader cost: 0.1355 6/125 [>.............................] - ETA: 55s - batch_cost: 0.3616 - reader cost: 0.1410 7/125 [>.............................] - ETA: 54s - batch_cost: 0.3710 - reader cost: 0.1457 8/125 [>.............................] - ETA: 53s - batch_cost: 0.3809 - reader cost: 0.1525 9/125 [=>............................] - ETA: 52s - batch_cost: 0.3845 - reader cost: 0.1536 10/125 [=>............................] - ETA: 52s - batch_cost: 0.3891 - reader cost: 0.1562 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3889 - reader cost: 0.1546 12/125 [=>............................] - ETA: 50s - batch_cost: 0.3925 - reader cost: 0.1558 13/125 [==>...........................] - ETA: 49s - batch_cost: 0.3952 - reader cost: 0.1567 14/125 [==>...........................] - ETA: 49s - batch_cost: 0.3968 - reader cost: 0.1575 15/125 [==>...........................] - ETA: 48s - batch_cost: 0.3995 - reader cost: 0.1589 16/125 [==>...........................] - ETA: 48s - batch_cost: 0.4033 - reader cost: 0.1618 17/125 [===>..........................] - ETA: 47s - batch_cost: 0.4046 - reader cost: 0.1627 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.4025 - reader cost: 0.1601 19/125 [===>..........................] - ETA: 46s - batch_cost: 0.4027 - reader cost: 0.1594 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4038 - reader cost: 0.1600 21/125 [====>.........................] - ETA: 45s - batch_cost: 0.4057 - reader cost: 0.1612 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4080 - reader cost: 0.1628 23/125 [====>.........................] - ETA: 44s - batch_cost: 0.4085 - reader cost: 0.1630 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4087 - reader cost: 0.1628 25/125 [=====>........................] - ETA: 43s - batch_cost: 0.4078 - reader cost: 0.1618 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4095 - reader cost: 0.1632 27/125 [=====>........................] - ETA: 42s - batch_cost: 0.4102 - reader cost: 0.1637 28/125 [=====>........................] - ETA: 42s - batch_cost: 0.4112 - reader cost: 0.1640 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4116 - reader cost: 0.1644 30/125 [======>.......................] - ETA: 41s - batch_cost: 0.4118 - reader cost: 0.1643 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4106 - reader cost: 0.1631 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4094 - reader cost: 0.1616 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4103 - reader cost: 0.1622 34/125 [=======>......................] - ETA: 39s - batch_cost: 0.4120 - reader cost: 0.1638 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4109 - reader cost: 0.1627 36/125 [=======>......................] - ETA: 38s - batch_cost: 0.4098 - reader cost: 0.1615 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4110 - reader cost: 0.1624 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4103 - reader cost: 0.1617 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4110 - reader cost: 0.1621 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4116 - reader cost: 0.1627 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4107 - reader cost: 0.1617 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4110 - reader cost: 0.1619 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4103 - reader cost: 0.1612 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4109 - reader cost: 0.1616 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4102 - reader cost: 0.1609 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4098 - reader cost: 0.1603 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4105 - reader cost: 0.1609 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4109 - reader cost: 0.1612 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4114 - reader cost: 0.1616 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4120 - reader cost: 0.1621 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4129 - reader cost: 0.1629 52/125 [===========>..................] - ETA: 31s - batch_cost: 0.4129 - reader cost: 0.1630 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4133 - reader cost: 0.1633 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4126 - reader cost: 0.1626 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4130 - reader cost: 0.1629 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4134 - reader cost: 0.1633 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4132 - reader cost: 0.1629 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4125 - reader cost: 0.1622 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4129 - reader cost: 0.1626 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4133 - reader cost: 0.1629 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4140 - reader cost: 0.1634 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4132 - reader cost: 0.1626 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4136 - reader cost: 0.1630 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4138 - reader cost: 0.1631 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4130 - reader cost: 0.1623 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4125 - reader cost: 0.1616 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4125 - reader cost: 0.1607 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4126 - reader cost: 0.1595 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4128 - reader cost: 0.1578 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4124 - reader cost: 0.1562 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4126 - reader cost: 0.1566 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4130 - reader cost: 0.1567 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4130 - reader cost: 0.1569 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4133 - reader cost: 0.1572 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4135 - reader cost: 0.1575 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4132 - reader cost: 0.1569 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4136 - reader cost: 0.1565 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4137 - reader cost: 0.1563 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4138 - reader cost: 0.1565 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4139 - reader cost: 0.1567 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4140 - reader cost: 0.1569 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4143 - reader cost: 0.1572 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4145 - reader cost: 0.1575 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4148 - reader cost: 0.1578 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4151 - reader cost: 0.1580 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4149 - reader cost: 0.1578 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4151 - reader cost: 0.1581 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4155 - reader cost: 0.1584 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4155 - reader cost: 0.1585 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4150 - reader cost: 0.1581 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4145 - reader cost: 0.1576 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4141 - reader cost: 0.1572 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4147 - reader cost: 0.1578 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4151 - reader cost: 0.1583 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4148 - reader cost: 0.1582 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4149 - reader cost: 0.1583 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4150 - reader cost: 0.1585 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4151 - reader cost: 0.1586 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4149 - reader cost: 0.1585 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4148 - reader cost: 0.1585 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4151 - reader cost: 0.1588 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4146 - reader cost: 0.1583  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4143 - reader cost: 0.1581 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4140 - reader cost: 0.1578 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4142 - reader cost: 0.1581 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4143 - reader cost: 0.1582 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4144 - reader cost: 0.1583 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4145 - reader cost: 0.1585 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4148 - reader cost: 0.1588 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4151 - reader cost: 0.1592 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4153 - reader cost: 0.1593 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4153 - reader cost: 0.1594 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4157 - reader cost: 0.1597 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4159 - reader cost: 0.1600 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4160 - reader cost: 0.1601 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4164 - reader cost: 0.1605 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4166 - reader cost: 0.1607 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4165 - reader cost: 0.1606 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4170 - reader cost: 0.1612 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4172 - reader cost: 0.1615 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4174 - reader cost: 0.1616 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4175 - reader cost: 0.1617 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4173 - reader cost: 0.1614 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4167 - reader cost: 0.1608 125/125 [==============================] - 53s 422ms/step - batch_cost: 0.4168 - reader cost: 0.1610 2021-02-22 21:59:57 [INFO] [EVAL] #Images=500 mIoU=0.7074 Acc=0.9496 Kappa=0.9345 2021-02-22 21:59:57 [INFO] [EVAL] Class IoU: [0.9734 0.8039 0.9061 0.4401 0.5301 0.5445 0.6702 0.7385 0.9155 0.5798 0.9334 0.7851 0.5906 0.9303 0.6564 0.5176 0.5819 0.5943 0.7492] 2021-02-22 21:59:57 [INFO] [EVAL] Class Acc: [0.9906 0.8739 0.9361 0.7483 0.7316 0.8377 0.869 0.9241 0.952 0.8468 0.9519 0.8693 0.7386 0.9486 0.7382 0.9676 0.6373 0.7856 0.8305] 2021-02-22 22:00:01 [INFO] [EVAL] The model with the best validation mIoU (0.7121) was saved at iter 5000. 2021-02-22 22:00:15 [INFO] [TRAIN] epoch=27, iter=10010/80000, loss=1.0717, lr=0.008867, batch_cost=1.3679, reader_cost=0.0001 | ETA 26:35:38 2021-02-22 22:00:28 [INFO] [TRAIN] epoch=27, iter=10020/80000, loss=1.1005, lr=0.008865, batch_cost=1.3470, reader_cost=0.0001 | ETA 26:11:06 2021-02-22 22:00:42 [INFO] [TRAIN] epoch=27, iter=10030/80000, loss=0.9582, lr=0.008864, batch_cost=1.3529, reader_cost=0.0001 | ETA 26:17:40 2021-02-22 22:00:55 [INFO] [TRAIN] epoch=27, iter=10040/80000, loss=0.8916, lr=0.008863, batch_cost=1.3601, reader_cost=0.0001 | ETA 26:25:50 2021-02-22 22:01:10 [INFO] [TRAIN] epoch=28, iter=10050/80000, loss=0.9329, lr=0.008862, batch_cost=1.4386, reader_cost=0.0702 | ETA 27:57:09 2021-02-22 22:01:24 [INFO] [TRAIN] epoch=28, iter=10060/80000, loss=0.9389, lr=0.008861, batch_cost=1.3699, reader_cost=0.0001 | ETA 26:36:51 2021-02-22 22:01:37 [INFO] [TRAIN] epoch=28, iter=10070/80000, loss=0.8764, lr=0.008860, batch_cost=1.3406, reader_cost=0.0001 | ETA 26:02:26 2021-02-22 22:01:51 [INFO] [TRAIN] epoch=28, iter=10080/80000, loss=0.9517, lr=0.008859, batch_cost=1.3591, reader_cost=0.0001 | ETA 26:23:50 2021-02-22 22:02:04 [INFO] [TRAIN] epoch=28, iter=10090/80000, loss=0.9349, lr=0.008857, batch_cost=1.3393, reader_cost=0.0001 | ETA 26:00:33 2021-02-22 22:02:18 [INFO] [TRAIN] epoch=28, iter=10100/80000, loss=0.9133, lr=0.008856, batch_cost=1.3694, reader_cost=0.0001 | ETA 26:35:19 2021-02-22 22:02:31 [INFO] [TRAIN] epoch=28, iter=10110/80000, loss=0.8764, lr=0.008855, batch_cost=1.3675, reader_cost=0.0001 | ETA 26:32:56 2021-02-22 22:02:45 [INFO] [TRAIN] epoch=28, iter=10120/80000, loss=0.8395, lr=0.008854, batch_cost=1.3323, reader_cost=0.0001 | ETA 25:51:39 2021-02-22 22:02:58 [INFO] [TRAIN] epoch=28, iter=10130/80000, loss=1.0424, lr=0.008853, batch_cost=1.3554, reader_cost=0.0001 | ETA 26:18:21 2021-02-22 22:03:11 [INFO] [TRAIN] epoch=28, iter=10140/80000, loss=1.0234, lr=0.008852, batch_cost=1.3259, reader_cost=0.0001 | ETA 25:43:45 2021-02-22 22:03:25 [INFO] [TRAIN] epoch=28, iter=10150/80000, loss=0.9474, lr=0.008851, batch_cost=1.3349, reader_cost=0.0001 | ETA 25:54:02 2021-02-22 22:03:38 [INFO] [TRAIN] epoch=28, iter=10160/80000, loss=0.9324, lr=0.008849, batch_cost=1.3551, reader_cost=0.0001 | ETA 26:17:20 2021-02-22 22:03:52 [INFO] [TRAIN] epoch=28, iter=10170/80000, loss=0.9261, lr=0.008848, batch_cost=1.3717, reader_cost=0.0001 | ETA 26:36:25 2021-02-22 22:04:05 [INFO] [TRAIN] epoch=28, iter=10180/80000, loss=0.8860, lr=0.008847, batch_cost=1.3458, reader_cost=0.0001 | ETA 26:06:03 2021-02-22 22:04:19 [INFO] [TRAIN] epoch=28, iter=10190/80000, loss=0.9641, lr=0.008846, batch_cost=1.3487, reader_cost=0.0001 | ETA 26:09:15 2021-02-22 22:04:33 [INFO] [TRAIN] epoch=28, iter=10200/80000, loss=0.9674, lr=0.008845, batch_cost=1.3766, reader_cost=0.0001 | ETA 26:41:25 2021-02-22 22:04:47 [INFO] [TRAIN] epoch=28, iter=10210/80000, loss=0.8538, lr=0.008844, batch_cost=1.3760, reader_cost=0.0001 | ETA 26:40:30 2021-02-22 22:05:00 [INFO] [TRAIN] epoch=28, iter=10220/80000, loss=1.0060, lr=0.008843, batch_cost=1.3401, reader_cost=0.0001 | ETA 25:58:31 2021-02-22 22:05:14 [INFO] [TRAIN] epoch=28, iter=10230/80000, loss=1.0268, lr=0.008842, batch_cost=1.3702, reader_cost=0.0001 | ETA 26:33:15 2021-02-22 22:05:27 [INFO] [TRAIN] epoch=28, iter=10240/80000, loss=0.9529, lr=0.008840, batch_cost=1.3471, reader_cost=0.0001 | ETA 26:06:11 2021-02-22 22:05:40 [INFO] [TRAIN] epoch=28, iter=10250/80000, loss=0.9971, lr=0.008839, batch_cost=1.3372, reader_cost=0.0001 | ETA 25:54:27 2021-02-22 22:05:54 [INFO] [TRAIN] epoch=28, iter=10260/80000, loss=1.0102, lr=0.008838, batch_cost=1.3561, reader_cost=0.0001 | ETA 26:16:15 2021-02-22 22:06:08 [INFO] [TRAIN] epoch=28, iter=10270/80000, loss=0.9631, lr=0.008837, batch_cost=1.3690, reader_cost=0.0001 | ETA 26:31:00 2021-02-22 22:06:21 [INFO] [TRAIN] epoch=28, iter=10280/80000, loss=0.9073, lr=0.008836, batch_cost=1.3658, reader_cost=0.0001 | ETA 26:27:01 2021-02-22 22:06:35 [INFO] [TRAIN] epoch=28, iter=10290/80000, loss=0.9636, lr=0.008835, batch_cost=1.3711, reader_cost=0.0001 | ETA 26:32:56 2021-02-22 22:06:49 [INFO] [TRAIN] epoch=28, iter=10300/80000, loss=0.9302, lr=0.008834, batch_cost=1.3843, reader_cost=0.0001 | ETA 26:48:03 2021-02-22 22:07:02 [INFO] [TRAIN] epoch=28, iter=10310/80000, loss=0.9322, lr=0.008832, batch_cost=1.3246, reader_cost=0.0001 | ETA 25:38:33 2021-02-22 22:07:16 [INFO] [TRAIN] epoch=28, iter=10320/80000, loss=1.0030, lr=0.008831, batch_cost=1.3634, reader_cost=0.0001 | ETA 26:23:19 2021-02-22 22:07:29 [INFO] [TRAIN] epoch=28, iter=10330/80000, loss=0.9135, lr=0.008830, batch_cost=1.3607, reader_cost=0.0001 | ETA 26:19:58 2021-02-22 22:07:43 [INFO] [TRAIN] epoch=28, iter=10340/80000, loss=0.9653, lr=0.008829, batch_cost=1.3664, reader_cost=0.0001 | ETA 26:26:23 2021-02-22 22:07:57 [INFO] [TRAIN] epoch=28, iter=10350/80000, loss=0.9523, lr=0.008828, batch_cost=1.3505, reader_cost=0.0001 | ETA 26:07:41 2021-02-22 22:08:10 [INFO] [TRAIN] epoch=28, iter=10360/80000, loss=0.9722, lr=0.008827, batch_cost=1.3761, reader_cost=0.0001 | ETA 26:37:14 2021-02-22 22:08:24 [INFO] [TRAIN] epoch=28, iter=10370/80000, loss=0.9490, lr=0.008826, batch_cost=1.3662, reader_cost=0.0001 | ETA 26:25:30 2021-02-22 22:08:37 [INFO] [TRAIN] epoch=28, iter=10380/80000, loss=0.9056, lr=0.008824, batch_cost=1.3428, reader_cost=0.0001 | ETA 25:58:06 2021-02-22 22:08:51 [INFO] [TRAIN] epoch=28, iter=10390/80000, loss=0.8723, lr=0.008823, batch_cost=1.3483, reader_cost=0.0001 | ETA 26:04:14 2021-02-22 22:09:05 [INFO] [TRAIN] epoch=28, iter=10400/80000, loss=0.8589, lr=0.008822, batch_cost=1.3804, reader_cost=0.0001 | ETA 26:41:13 2021-02-22 22:09:18 [INFO] [TRAIN] epoch=28, iter=10410/80000, loss=0.9602, lr=0.008821, batch_cost=1.3615, reader_cost=0.0001 | ETA 26:19:07 2021-02-22 22:09:33 [INFO] [TRAIN] epoch=29, iter=10420/80000, loss=0.9325, lr=0.008820, batch_cost=1.4718, reader_cost=0.0807 | ETA 28:26:46 2021-02-22 22:09:47 [INFO] [TRAIN] epoch=29, iter=10430/80000, loss=0.9959, lr=0.008819, batch_cost=1.3828, reader_cost=0.0001 | ETA 26:43:19 2021-02-22 22:10:01 [INFO] [TRAIN] epoch=29, iter=10440/80000, loss=1.1300, lr=0.008818, batch_cost=1.3770, reader_cost=0.0001 | ETA 26:36:26 2021-02-22 22:10:14 [INFO] [TRAIN] epoch=29, iter=10450/80000, loss=0.9907, lr=0.008816, batch_cost=1.3608, reader_cost=0.0001 | ETA 26:17:22 2021-02-22 22:10:28 [INFO] [TRAIN] epoch=29, iter=10460/80000, loss=0.9291, lr=0.008815, batch_cost=1.3485, reader_cost=0.0001 | ETA 26:02:57 2021-02-22 22:10:41 [INFO] [TRAIN] epoch=29, iter=10470/80000, loss=0.8662, lr=0.008814, batch_cost=1.3684, reader_cost=0.0001 | ETA 26:25:43 2021-02-22 22:10:55 [INFO] [TRAIN] epoch=29, iter=10480/80000, loss=1.0072, lr=0.008813, batch_cost=1.3802, reader_cost=0.0001 | ETA 26:39:13 2021-02-22 22:11:09 [INFO] [TRAIN] epoch=29, iter=10490/80000, loss=0.9238, lr=0.008812, batch_cost=1.3552, reader_cost=0.0001 | ETA 26:10:03 2021-02-22 22:11:22 [INFO] [TRAIN] epoch=29, iter=10500/80000, loss=0.9713, lr=0.008811, batch_cost=1.3582, reader_cost=0.0001 | ETA 26:13:16 2021-02-22 22:11:36 [INFO] [TRAIN] epoch=29, iter=10510/80000, loss=0.9606, lr=0.008810, batch_cost=1.3561, reader_cost=0.0001 | ETA 26:10:38 2021-02-22 22:11:50 [INFO] [TRAIN] epoch=29, iter=10520/80000, loss=0.9080, lr=0.008808, batch_cost=1.3835, reader_cost=0.0001 | ETA 26:42:09 2021-02-22 22:12:03 [INFO] [TRAIN] epoch=29, iter=10530/80000, loss=1.0012, lr=0.008807, batch_cost=1.3599, reader_cost=0.0001 | ETA 26:14:32 2021-02-22 22:12:17 [INFO] [TRAIN] epoch=29, iter=10540/80000, loss=0.9173, lr=0.008806, batch_cost=1.3572, reader_cost=0.0001 | ETA 26:11:09 2021-02-22 22:12:31 [INFO] [TRAIN] epoch=29, iter=10550/80000, loss=0.9398, lr=0.008805, batch_cost=1.3734, reader_cost=0.0001 | ETA 26:29:40 2021-02-22 22:12:45 [INFO] [TRAIN] epoch=29, iter=10560/80000, loss=0.9649, lr=0.008804, batch_cost=1.3975, reader_cost=0.0001 | ETA 26:57:23 2021-02-22 22:12:58 [INFO] [TRAIN] epoch=29, iter=10570/80000, loss=0.9456, lr=0.008803, batch_cost=1.3744, reader_cost=0.0001 | ETA 26:30:24 2021-02-22 22:13:12 [INFO] [TRAIN] epoch=29, iter=10580/80000, loss=0.8632, lr=0.008802, batch_cost=1.3650, reader_cost=0.0001 | ETA 26:19:21 2021-02-22 22:13:26 [INFO] [TRAIN] epoch=29, iter=10590/80000, loss=0.9142, lr=0.008800, batch_cost=1.3914, reader_cost=0.0001 | ETA 26:49:34 2021-02-22 22:13:40 [INFO] [TRAIN] epoch=29, iter=10600/80000, loss=1.1623, lr=0.008799, batch_cost=1.3796, reader_cost=0.0001 | ETA 26:35:44 2021-02-22 22:13:53 [INFO] [TRAIN] epoch=29, iter=10610/80000, loss=0.8496, lr=0.008798, batch_cost=1.3614, reader_cost=0.0001 | ETA 26:14:28 2021-02-22 22:14:08 [INFO] [TRAIN] epoch=29, iter=10620/80000, loss=0.9353, lr=0.008797, batch_cost=1.4157, reader_cost=0.0001 | ETA 27:17:00 2021-02-22 22:14:21 [INFO] [TRAIN] epoch=29, iter=10630/80000, loss=0.8853, lr=0.008796, batch_cost=1.3494, reader_cost=0.0001 | ETA 26:00:05 2021-02-22 22:14:34 [INFO] [TRAIN] epoch=29, iter=10640/80000, loss=0.9438, lr=0.008795, batch_cost=1.3416, reader_cost=0.0001 | ETA 25:50:50 2021-02-22 22:14:48 [INFO] [TRAIN] epoch=29, iter=10650/80000, loss=0.9513, lr=0.008794, batch_cost=1.3627, reader_cost=0.0001 | ETA 26:15:02 2021-02-22 22:15:02 [INFO] [TRAIN] epoch=29, iter=10660/80000, loss=1.0177, lr=0.008792, batch_cost=1.3625, reader_cost=0.0001 | ETA 26:14:38 2021-02-22 22:15:15 [INFO] [TRAIN] epoch=29, iter=10670/80000, loss=0.8927, lr=0.008791, batch_cost=1.3565, reader_cost=0.0001 | ETA 26:07:25 2021-02-22 22:15:29 [INFO] [TRAIN] epoch=29, iter=10680/80000, loss=0.9429, lr=0.008790, batch_cost=1.4136, reader_cost=0.0001 | ETA 27:13:09 2021-02-22 22:15:43 [INFO] [TRAIN] epoch=29, iter=10690/80000, loss=0.8579, lr=0.008789, batch_cost=1.3391, reader_cost=0.0001 | ETA 25:46:51 2021-02-22 22:15:56 [INFO] [TRAIN] epoch=29, iter=10700/80000, loss=0.9586, lr=0.008788, batch_cost=1.3575, reader_cost=0.0001 | ETA 26:07:57 2021-02-22 22:16:10 [INFO] [TRAIN] epoch=29, iter=10710/80000, loss=0.8910, lr=0.008787, batch_cost=1.3798, reader_cost=0.0001 | ETA 26:33:23 2021-02-22 22:16:24 [INFO] [TRAIN] epoch=29, iter=10720/80000, loss=0.9896, lr=0.008786, batch_cost=1.3635, reader_cost=0.0001 | ETA 26:14:24 2021-02-22 22:16:37 [INFO] [TRAIN] epoch=29, iter=10730/80000, loss=0.8903, lr=0.008784, batch_cost=1.3635, reader_cost=0.0001 | ETA 26:14:08 2021-02-22 22:16:51 [INFO] [TRAIN] epoch=29, iter=10740/80000, loss=0.9158, lr=0.008783, batch_cost=1.3470, reader_cost=0.0001 | ETA 25:54:53 2021-02-22 22:17:05 [INFO] [TRAIN] epoch=29, iter=10750/80000, loss=0.9894, lr=0.008782, batch_cost=1.3775, reader_cost=0.0001 | ETA 26:29:52 2021-02-22 22:17:18 [INFO] [TRAIN] epoch=29, iter=10760/80000, loss=0.8604, lr=0.008781, batch_cost=1.3307, reader_cost=0.0001 | ETA 25:35:40 2021-02-22 22:17:32 [INFO] [TRAIN] epoch=29, iter=10770/80000, loss=0.9205, lr=0.008780, batch_cost=1.3742, reader_cost=0.0001 | ETA 26:25:34 2021-02-22 22:17:45 [INFO] [TRAIN] epoch=29, iter=10780/80000, loss=1.0209, lr=0.008779, batch_cost=1.3723, reader_cost=0.0001 | ETA 26:23:10 2021-02-22 22:18:00 [INFO] [TRAIN] epoch=30, iter=10790/80000, loss=0.9261, lr=0.008778, batch_cost=1.4177, reader_cost=0.0690 | ETA 27:15:22 2021-02-22 22:18:13 [INFO] [TRAIN] epoch=30, iter=10800/80000, loss=0.8575, lr=0.008776, batch_cost=1.3649, reader_cost=0.0001 | ETA 26:14:13 2021-02-22 22:18:27 [INFO] [TRAIN] epoch=30, iter=10810/80000, loss=0.9483, lr=0.008775, batch_cost=1.3657, reader_cost=0.0001 | ETA 26:14:53 2021-02-22 22:18:40 [INFO] [TRAIN] epoch=30, iter=10820/80000, loss=0.9831, lr=0.008774, batch_cost=1.3459, reader_cost=0.0001 | ETA 25:51:49 2021-02-22 22:18:54 [INFO] [TRAIN] epoch=30, iter=10830/80000, loss=0.9644, lr=0.008773, batch_cost=1.3826, reader_cost=0.0001 | ETA 26:33:53 2021-02-22 22:19:08 [INFO] [TRAIN] epoch=30, iter=10840/80000, loss=0.9472, lr=0.008772, batch_cost=1.3422, reader_cost=0.0001 | ETA 25:47:06 2021-02-22 22:19:21 [INFO] [TRAIN] epoch=30, iter=10850/80000, loss=0.9403, lr=0.008771, batch_cost=1.3655, reader_cost=0.0001 | ETA 26:13:42 2021-02-22 22:19:35 [INFO] [TRAIN] epoch=30, iter=10860/80000, loss=0.9495, lr=0.008770, batch_cost=1.3632, reader_cost=0.0001 | ETA 26:10:48 2021-02-22 22:19:48 [INFO] [TRAIN] epoch=30, iter=10870/80000, loss=1.0235, lr=0.008768, batch_cost=1.3447, reader_cost=0.0001 | ETA 25:49:21 2021-02-22 22:20:02 [INFO] [TRAIN] epoch=30, iter=10880/80000, loss=0.9044, lr=0.008767, batch_cost=1.3620, reader_cost=0.0001 | ETA 26:09:02 2021-02-22 22:20:15 [INFO] [TRAIN] epoch=30, iter=10890/80000, loss=0.8874, lr=0.008766, batch_cost=1.3259, reader_cost=0.0001 | ETA 25:27:13 2021-02-22 22:20:29 [INFO] [TRAIN] epoch=30, iter=10900/80000, loss=0.8979, lr=0.008765, batch_cost=1.3750, reader_cost=0.0001 | ETA 26:23:29 2021-02-22 22:20:43 [INFO] [TRAIN] epoch=30, iter=10910/80000, loss=1.0108, lr=0.008764, batch_cost=1.3506, reader_cost=0.0001 | ETA 25:55:14 2021-02-22 22:20:56 [INFO] [TRAIN] epoch=30, iter=10920/80000, loss=0.9943, lr=0.008763, batch_cost=1.3745, reader_cost=0.0001 | ETA 26:22:27 2021-02-22 22:21:10 [INFO] [TRAIN] epoch=30, iter=10930/80000, loss=0.8756, lr=0.008762, batch_cost=1.3605, reader_cost=0.0001 | ETA 26:06:12 2021-02-22 22:21:23 [INFO] [TRAIN] epoch=30, iter=10940/80000, loss=1.0157, lr=0.008760, batch_cost=1.3348, reader_cost=0.0001 | ETA 25:36:22 2021-02-22 22:21:37 [INFO] [TRAIN] epoch=30, iter=10950/80000, loss=0.9652, lr=0.008759, batch_cost=1.3547, reader_cost=0.0001 | ETA 25:59:00 2021-02-22 22:21:51 [INFO] [TRAIN] epoch=30, iter=10960/80000, loss=0.9484, lr=0.008758, batch_cost=1.3804, reader_cost=0.0001 | ETA 26:28:20 2021-02-22 22:22:04 [INFO] [TRAIN] epoch=30, iter=10970/80000, loss=0.9721, lr=0.008757, batch_cost=1.3550, reader_cost=0.0001 | ETA 25:58:55 2021-02-22 22:22:18 [INFO] [TRAIN] epoch=30, iter=10980/80000, loss=0.8345, lr=0.008756, batch_cost=1.3886, reader_cost=0.0001 | ETA 26:37:21 2021-02-22 22:22:32 [INFO] [TRAIN] epoch=30, iter=10990/80000, loss=0.9935, lr=0.008755, batch_cost=1.3933, reader_cost=0.0001 | ETA 26:42:30 2021-02-22 22:22:46 [INFO] [TRAIN] epoch=30, iter=11000/80000, loss=1.0000, lr=0.008754, batch_cost=1.3649, reader_cost=0.0001 | ETA 26:09:40 2021-02-22 22:22:46 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:21 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:05 - batch_cost: 0.2019 - reader cost: 0.0765  3/125 [..............................] - ETA: 1:00 - batch_cost: 0.2795 - reader cost: 0.1123 4/125 [..............................] - ETA: 58s - batch_cost: 0.3193 - reader cost: 0.1318  5/125 [>.............................] - ETA: 55s - batch_cost: 0.3339 - reader cost: 0.1327 6/125 [>.............................] - ETA: 54s - batch_cost: 0.3508 - reader cost: 0.1397 7/125 [>.............................] - ETA: 53s - batch_cost: 0.3573 - reader cost: 0.1401 8/125 [>.............................] - ETA: 52s - batch_cost: 0.3690 - reader cost: 0.1463 9/125 [=>............................] - ETA: 52s - batch_cost: 0.3771 - reader cost: 0.1509 10/125 [=>............................] - ETA: 51s - batch_cost: 0.3824 - reader cost: 0.1539 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3853 - reader cost: 0.1537 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3839 - reader cost: 0.1510 13/125 [==>...........................] - ETA: 49s - batch_cost: 0.3883 - reader cost: 0.1540 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3919 - reader cost: 0.1563 15/125 [==>...........................] - ETA: 48s - batch_cost: 0.3955 - reader cost: 0.1580 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3971 - reader cost: 0.1588 17/125 [===>..........................] - ETA: 47s - batch_cost: 0.3997 - reader cost: 0.1602 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.4014 - reader cost: 0.1613 19/125 [===>..........................] - ETA: 46s - batch_cost: 0.4027 - reader cost: 0.1618 20/125 [===>..........................] - ETA: 46s - batch_cost: 0.4073 - reader cost: 0.1658 21/125 [====>.........................] - ETA: 45s - batch_cost: 0.4062 - reader cost: 0.1643 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4052 - reader cost: 0.1625 23/125 [====>.........................] - ETA: 44s - batch_cost: 0.4041 - reader cost: 0.1610 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4047 - reader cost: 0.1613 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4035 - reader cost: 0.1593 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4037 - reader cost: 0.1593 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4033 - reader cost: 0.1586 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4040 - reader cost: 0.1591 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4045 - reader cost: 0.1590 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4031 - reader cost: 0.1573 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.4039 - reader cost: 0.1579 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4049 - reader cost: 0.1587 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4056 - reader cost: 0.1594 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4058 - reader cost: 0.1584 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4075 - reader cost: 0.1589 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4070 - reader cost: 0.1579 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4062 - reader cost: 0.1572 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4072 - reader cost: 0.1580 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4071 - reader cost: 0.1579 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4069 - reader cost: 0.1576 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4068 - reader cost: 0.1573 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4077 - reader cost: 0.1580 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4088 - reader cost: 0.1592 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4093 - reader cost: 0.1596 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4097 - reader cost: 0.1599 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4101 - reader cost: 0.1601 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4104 - reader cost: 0.1605 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4109 - reader cost: 0.1610 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4103 - reader cost: 0.1603 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4108 - reader cost: 0.1608 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4119 - reader cost: 0.1619 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4112 - reader cost: 0.1612 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4104 - reader cost: 0.1603 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4108 - reader cost: 0.1605 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4104 - reader cost: 0.1600 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4111 - reader cost: 0.1608 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4118 - reader cost: 0.1614 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4121 - reader cost: 0.1618 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4124 - reader cost: 0.1620 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4129 - reader cost: 0.1626 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4123 - reader cost: 0.1620 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4116 - reader cost: 0.1612 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4115 - reader cost: 0.1611 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4117 - reader cost: 0.1604 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4123 - reader cost: 0.1610 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4121 - reader cost: 0.1603 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4124 - reader cost: 0.1595 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4125 - reader cost: 0.1583 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4130 - reader cost: 0.1566 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4132 - reader cost: 0.1551 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4135 - reader cost: 0.1542 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4148 - reader cost: 0.1536 73/125 [================>.............] - ETA: 22s - batch_cost: 0.4150 - reader cost: 0.1521 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4153 - reader cost: 0.1515 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4149 - reader cost: 0.1508 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4151 - reader cost: 0.1512 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4156 - reader cost: 0.1517 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4158 - reader cost: 0.1519 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4159 - reader cost: 0.1521 80/125 [==================>...........] - ETA: 19s - batch_cost: 0.4164 - reader cost: 0.1527 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4164 - reader cost: 0.1529 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4158 - reader cost: 0.1524 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4161 - reader cost: 0.1519 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4164 - reader cost: 0.1524 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4166 - reader cost: 0.1527 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4169 - reader cost: 0.1531 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4166 - reader cost: 0.1528 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4169 - reader cost: 0.1532 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4167 - reader cost: 0.1531 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4169 - reader cost: 0.1534 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4171 - reader cost: 0.1537 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4166 - reader cost: 0.1534 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4167 - reader cost: 0.1536 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4162 - reader cost: 0.1532 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4164 - reader cost: 0.1535 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4169 - reader cost: 0.1541 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4170 - reader cost: 0.1543 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4172 - reader cost: 0.1545 99/125 [======================>.......] - ETA: 11s - batch_cost: 0.4169 - reader cost: 0.1544 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4167 - reader cost: 0.1543 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4168 - reader cost: 0.1546 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4171 - reader cost: 0.1549  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4173 - reader cost: 0.1551 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4174 - reader cost: 0.1553 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4175 - reader cost: 0.1555 106/125 [========================>.....] - ETA: 8s - batch_cost: 0.4176 - reader cost: 0.1557 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4172 - reader cost: 0.1553 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4174 - reader cost: 0.1555 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4174 - reader cost: 0.1556 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4170 - reader cost: 0.1553 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4166 - reader cost: 0.1550 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4168 - reader cost: 0.1551 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4170 - reader cost: 0.1550 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4174 - reader cost: 0.1548 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4174 - reader cost: 0.1544 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4175 - reader cost: 0.1546 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4173 - reader cost: 0.1545 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4175 - reader cost: 0.1541 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4176 - reader cost: 0.1537 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4177 - reader cost: 0.1540 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4178 - reader cost: 0.1542 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4180 - reader cost: 0.1545 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4177 - reader cost: 0.1543 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4179 - reader cost: 0.1545 125/125 [==============================] - 53s 423ms/step - batch_cost: 0.4180 - reader cost: 0.1548 2021-02-22 22:23:39 [INFO] [EVAL] #Images=500 mIoU=0.7322 Acc=0.9512 Kappa=0.9365 2021-02-22 22:23:39 [INFO] [EVAL] Class IoU: [0.9728 0.795 0.9069 0.3102 0.5538 0.6262 0.6958 0.7637 0.9156 0.615 0.9384 0.7788 0.5181 0.9348 0.7237 0.8246 0.7576 0.5305 0.751 ] 2021-02-22 22:23:39 [INFO] [EVAL] Class Acc: [0.9837 0.9119 0.9414 0.8204 0.7445 0.8065 0.791 0.9244 0.9476 0.8373 0.9548 0.8315 0.7918 0.9718 0.8124 0.9018 0.8586 0.6499 0.8486] 2021-02-22 22:23:45 [INFO] [EVAL] The model with the best validation mIoU (0.7322) was saved at iter 11000. 2021-02-22 22:23:59 [INFO] [TRAIN] epoch=30, iter=11010/80000, loss=0.9194, lr=0.008753, batch_cost=1.3771, reader_cost=0.0001 | ETA 26:23:27 2021-02-22 22:24:13 [INFO] [TRAIN] epoch=30, iter=11020/80000, loss=0.9186, lr=0.008751, batch_cost=1.3888, reader_cost=0.0001 | ETA 26:36:37 2021-02-22 22:24:26 [INFO] [TRAIN] epoch=30, iter=11030/80000, loss=0.9978, lr=0.008750, batch_cost=1.3663, reader_cost=0.0001 | ETA 26:10:32 2021-02-22 22:24:40 [INFO] [TRAIN] epoch=30, iter=11040/80000, loss=0.8929, lr=0.008749, batch_cost=1.3942, reader_cost=0.0001 | ETA 26:42:25 2021-02-22 22:24:54 [INFO] [TRAIN] epoch=30, iter=11050/80000, loss=1.0202, lr=0.008748, batch_cost=1.3384, reader_cost=0.0001 | ETA 25:38:05 2021-02-22 22:25:07 [INFO] [TRAIN] epoch=30, iter=11060/80000, loss=0.8431, lr=0.008747, batch_cost=1.3809, reader_cost=0.0001 | ETA 26:26:38 2021-02-22 22:25:21 [INFO] [TRAIN] epoch=30, iter=11070/80000, loss=0.8746, lr=0.008746, batch_cost=1.3608, reader_cost=0.0001 | ETA 26:03:18 2021-02-22 22:25:35 [INFO] [TRAIN] epoch=30, iter=11080/80000, loss=1.0276, lr=0.008745, batch_cost=1.3685, reader_cost=0.0001 | ETA 26:11:56 2021-02-22 22:25:48 [INFO] [TRAIN] epoch=30, iter=11090/80000, loss=0.9326, lr=0.008743, batch_cost=1.3593, reader_cost=0.0001 | ETA 26:01:07 2021-02-22 22:26:02 [INFO] [TRAIN] epoch=30, iter=11100/80000, loss=0.8597, lr=0.008742, batch_cost=1.3593, reader_cost=0.0001 | ETA 26:00:53 2021-02-22 22:26:15 [INFO] [TRAIN] epoch=30, iter=11110/80000, loss=1.1525, lr=0.008741, batch_cost=1.3491, reader_cost=0.0001 | ETA 25:49:00 2021-02-22 22:26:29 [INFO] [TRAIN] epoch=30, iter=11120/80000, loss=0.9752, lr=0.008740, batch_cost=1.3352, reader_cost=0.0001 | ETA 25:32:49 2021-02-22 22:26:42 [INFO] [TRAIN] epoch=30, iter=11130/80000, loss=1.1382, lr=0.008739, batch_cost=1.3463, reader_cost=0.0001 | ETA 25:45:16 2021-02-22 22:26:56 [INFO] [TRAIN] epoch=30, iter=11140/80000, loss=1.0258, lr=0.008738, batch_cost=1.3482, reader_cost=0.0001 | ETA 25:47:15 2021-02-22 22:27:09 [INFO] [TRAIN] epoch=30, iter=11150/80000, loss=0.9222, lr=0.008737, batch_cost=1.3501, reader_cost=0.0001 | ETA 25:49:13 2021-02-22 22:27:22 [INFO] [TRAIN] epoch=30, iter=11160/80000, loss=0.9694, lr=0.008735, batch_cost=1.2991, reader_cost=0.0001 | ETA 24:50:29 2021-02-22 22:27:37 [INFO] [TRAIN] epoch=31, iter=11170/80000, loss=0.9989, lr=0.008734, batch_cost=1.4687, reader_cost=0.0723 | ETA 28:04:53 2021-02-22 22:27:50 [INFO] [TRAIN] epoch=31, iter=11180/80000, loss=0.9136, lr=0.008733, batch_cost=1.3522, reader_cost=0.0001 | ETA 25:50:58 2021-02-22 22:28:04 [INFO] [TRAIN] epoch=31, iter=11190/80000, loss=1.0354, lr=0.008732, batch_cost=1.3652, reader_cost=0.0001 | ETA 26:05:38 2021-02-22 22:28:18 [INFO] [TRAIN] epoch=31, iter=11200/80000, loss=0.9597, lr=0.008731, batch_cost=1.3731, reader_cost=0.0001 | ETA 26:14:29 2021-02-22 22:28:32 [INFO] [TRAIN] epoch=31, iter=11210/80000, loss=0.9987, lr=0.008730, batch_cost=1.3789, reader_cost=0.0001 | ETA 26:20:53 2021-02-22 22:28:45 [INFO] [TRAIN] epoch=31, iter=11220/80000, loss=1.1317, lr=0.008729, batch_cost=1.3681, reader_cost=0.0001 | ETA 26:08:17 2021-02-22 22:28:59 [INFO] [TRAIN] epoch=31, iter=11230/80000, loss=0.9471, lr=0.008727, batch_cost=1.3698, reader_cost=0.0001 | ETA 26:10:03 2021-02-22 22:29:12 [INFO] [TRAIN] epoch=31, iter=11240/80000, loss=0.9702, lr=0.008726, batch_cost=1.3465, reader_cost=0.0001 | ETA 25:43:08 2021-02-22 22:29:26 [INFO] [TRAIN] epoch=31, iter=11250/80000, loss=1.0005, lr=0.008725, batch_cost=1.3793, reader_cost=0.0001 | ETA 26:20:27 2021-02-22 22:29:40 [INFO] [TRAIN] epoch=31, iter=11260/80000, loss=0.8790, lr=0.008724, batch_cost=1.3737, reader_cost=0.0001 | ETA 26:13:48 2021-02-22 22:29:53 [INFO] [TRAIN] epoch=31, iter=11270/80000, loss=1.0055, lr=0.008723, batch_cost=1.3406, reader_cost=0.0001 | ETA 25:35:36 2021-02-22 22:30:07 [INFO] [TRAIN] epoch=31, iter=11280/80000, loss=0.9021, lr=0.008722, batch_cost=1.3663, reader_cost=0.0001 | ETA 26:04:54 2021-02-22 22:30:21 [INFO] [TRAIN] epoch=31, iter=11290/80000, loss=1.1034, lr=0.008721, batch_cost=1.3528, reader_cost=0.0001 | ETA 25:49:08 2021-02-22 22:30:34 [INFO] [TRAIN] epoch=31, iter=11300/80000, loss=1.1302, lr=0.008719, batch_cost=1.3425, reader_cost=0.0001 | ETA 25:37:11 2021-02-22 22:30:48 [INFO] [TRAIN] epoch=31, iter=11310/80000, loss=0.9382, lr=0.008718, batch_cost=1.3866, reader_cost=0.0001 | ETA 26:27:25 2021-02-22 22:31:01 [INFO] [TRAIN] epoch=31, iter=11320/80000, loss=0.8820, lr=0.008717, batch_cost=1.3393, reader_cost=0.0001 | ETA 25:33:02 2021-02-22 22:31:15 [INFO] [TRAIN] epoch=31, iter=11330/80000, loss=0.9802, lr=0.008716, batch_cost=1.3605, reader_cost=0.0001 | ETA 25:57:06 2021-02-22 22:31:28 [INFO] [TRAIN] epoch=31, iter=11340/80000, loss=0.8165, lr=0.008715, batch_cost=1.3479, reader_cost=0.0001 | ETA 25:42:24 2021-02-22 22:31:42 [INFO] [TRAIN] epoch=31, iter=11350/80000, loss=0.9222, lr=0.008714, batch_cost=1.3666, reader_cost=0.0001 | ETA 26:03:37 2021-02-22 22:31:55 [INFO] [TRAIN] epoch=31, iter=11360/80000, loss=1.0061, lr=0.008713, batch_cost=1.3371, reader_cost=0.0001 | ETA 25:29:37 2021-02-22 22:32:09 [INFO] [TRAIN] epoch=31, iter=11370/80000, loss=0.8534, lr=0.008711, batch_cost=1.3721, reader_cost=0.0001 | ETA 26:09:26 2021-02-22 22:32:22 [INFO] [TRAIN] epoch=31, iter=11380/80000, loss=0.9479, lr=0.008710, batch_cost=1.3397, reader_cost=0.0001 | ETA 25:32:09 2021-02-22 22:32:36 [INFO] [TRAIN] epoch=31, iter=11390/80000, loss=0.9488, lr=0.008709, batch_cost=1.3431, reader_cost=0.0001 | ETA 25:35:48 2021-02-22 22:32:50 [INFO] [TRAIN] epoch=31, iter=11400/80000, loss=1.1252, lr=0.008708, batch_cost=1.3677, reader_cost=0.0001 | ETA 26:03:45 2021-02-22 22:33:03 [INFO] [TRAIN] epoch=31, iter=11410/80000, loss=0.9699, lr=0.008707, batch_cost=1.3839, reader_cost=0.0001 | ETA 26:22:00 2021-02-22 22:33:17 [INFO] [TRAIN] epoch=31, iter=11420/80000, loss=0.9467, lr=0.008706, batch_cost=1.3377, reader_cost=0.0001 | ETA 25:28:57 2021-02-22 22:33:30 [INFO] [TRAIN] epoch=31, iter=11430/80000, loss=0.9996, lr=0.008705, batch_cost=1.3643, reader_cost=0.0001 | ETA 25:59:09 2021-02-22 22:33:44 [INFO] [TRAIN] epoch=31, iter=11440/80000, loss=0.9591, lr=0.008703, batch_cost=1.3569, reader_cost=0.0001 | ETA 25:50:26 2021-02-22 22:33:57 [INFO] [TRAIN] epoch=31, iter=11450/80000, loss=0.8995, lr=0.008702, batch_cost=1.3495, reader_cost=0.0001 | ETA 25:41:51 2021-02-22 22:34:11 [INFO] [TRAIN] epoch=31, iter=11460/80000, loss=0.9167, lr=0.008701, batch_cost=1.3498, reader_cost=0.0001 | ETA 25:41:53 2021-02-22 22:34:24 [INFO] [TRAIN] epoch=31, iter=11470/80000, loss=0.8839, lr=0.008700, batch_cost=1.3467, reader_cost=0.0001 | ETA 25:38:12 2021-02-22 22:34:38 [INFO] [TRAIN] epoch=31, iter=11480/80000, loss=0.8596, lr=0.008699, batch_cost=1.3608, reader_cost=0.0001 | ETA 25:53:59 2021-02-22 22:34:51 [INFO] [TRAIN] epoch=31, iter=11490/80000, loss=0.9001, lr=0.008698, batch_cost=1.3411, reader_cost=0.0001 | ETA 25:31:19 2021-02-22 22:35:05 [INFO] [TRAIN] epoch=31, iter=11500/80000, loss=0.9491, lr=0.008697, batch_cost=1.3563, reader_cost=0.0001 | ETA 25:48:29 2021-02-22 22:35:19 [INFO] [TRAIN] epoch=31, iter=11510/80000, loss=0.8717, lr=0.008695, batch_cost=1.3586, reader_cost=0.0001 | ETA 25:50:48 2021-02-22 22:35:32 [INFO] [TRAIN] epoch=31, iter=11520/80000, loss=1.1324, lr=0.008694, batch_cost=1.3631, reader_cost=0.0001 | ETA 25:55:46 2021-02-22 22:35:46 [INFO] [TRAIN] epoch=31, iter=11530/80000, loss=1.0241, lr=0.008693, batch_cost=1.3330, reader_cost=0.0001 | ETA 25:21:12 2021-02-22 22:36:00 [INFO] [TRAIN] epoch=32, iter=11540/80000, loss=0.8927, lr=0.008692, batch_cost=1.4462, reader_cost=0.0829 | ETA 27:30:03 2021-02-22 22:36:14 [INFO] [TRAIN] epoch=32, iter=11550/80000, loss=1.0667, lr=0.008691, batch_cost=1.3573, reader_cost=0.0001 | ETA 25:48:24 2021-02-22 22:36:27 [INFO] [TRAIN] epoch=32, iter=11560/80000, loss=1.0002, lr=0.008690, batch_cost=1.3646, reader_cost=0.0001 | ETA 25:56:35 2021-02-22 22:36:41 [INFO] [TRAIN] epoch=32, iter=11570/80000, loss=1.1420, lr=0.008689, batch_cost=1.3499, reader_cost=0.0001 | ETA 25:39:35 2021-02-22 22:36:54 [INFO] [TRAIN] epoch=32, iter=11580/80000, loss=0.9689, lr=0.008687, batch_cost=1.3455, reader_cost=0.0001 | ETA 25:34:17 2021-02-22 22:37:08 [INFO] [TRAIN] epoch=32, iter=11590/80000, loss=0.8331, lr=0.008686, batch_cost=1.3537, reader_cost=0.0001 | ETA 25:43:25 2021-02-22 22:37:21 [INFO] [TRAIN] epoch=32, iter=11600/80000, loss=0.9976, lr=0.008685, batch_cost=1.3642, reader_cost=0.0001 | ETA 25:55:09 2021-02-22 22:37:35 [INFO] [TRAIN] epoch=32, iter=11610/80000, loss=0.8694, lr=0.008684, batch_cost=1.3670, reader_cost=0.0001 | ETA 25:58:10 2021-02-22 22:37:48 [INFO] [TRAIN] epoch=32, iter=11620/80000, loss=1.0054, lr=0.008683, batch_cost=1.3399, reader_cost=0.0001 | ETA 25:27:00 2021-02-22 22:38:02 [INFO] [TRAIN] epoch=32, iter=11630/80000, loss=0.8566, lr=0.008682, batch_cost=1.3601, reader_cost=0.0001 | ETA 25:49:52 2021-02-22 22:38:16 [INFO] [TRAIN] epoch=32, iter=11640/80000, loss=1.0386, lr=0.008681, batch_cost=1.3544, reader_cost=0.0001 | ETA 25:43:07 2021-02-22 22:38:30 [INFO] [TRAIN] epoch=32, iter=11650/80000, loss=1.1530, lr=0.008679, batch_cost=1.4159, reader_cost=0.0001 | ETA 26:52:57 2021-02-22 22:38:43 [INFO] [TRAIN] epoch=32, iter=11660/80000, loss=0.9979, lr=0.008678, batch_cost=1.3563, reader_cost=0.0001 | ETA 25:44:48 2021-02-22 22:38:57 [INFO] [TRAIN] epoch=32, iter=11670/80000, loss=0.9094, lr=0.008677, batch_cost=1.3288, reader_cost=0.0001 | ETA 25:13:19 2021-02-22 22:39:10 [INFO] [TRAIN] epoch=32, iter=11680/80000, loss=1.0179, lr=0.008676, batch_cost=1.3573, reader_cost=0.0001 | ETA 25:45:29 2021-02-22 22:39:24 [INFO] [TRAIN] epoch=32, iter=11690/80000, loss=0.9582, lr=0.008675, batch_cost=1.3681, reader_cost=0.0001 | ETA 25:57:33 2021-02-22 22:39:38 [INFO] [TRAIN] epoch=32, iter=11700/80000, loss=0.9400, lr=0.008674, batch_cost=1.3813, reader_cost=0.0001 | ETA 26:12:24 2021-02-22 22:39:51 [INFO] [TRAIN] epoch=32, iter=11710/80000, loss=0.9480, lr=0.008673, batch_cost=1.3434, reader_cost=0.0001 | ETA 25:28:58 2021-02-22 22:40:05 [INFO] [TRAIN] epoch=32, iter=11720/80000, loss=0.8436, lr=0.008671, batch_cost=1.3531, reader_cost=0.0001 | ETA 25:39:51 2021-02-22 22:40:18 [INFO] [TRAIN] epoch=32, iter=11730/80000, loss=0.8808, lr=0.008670, batch_cost=1.3604, reader_cost=0.0001 | ETA 25:47:56 2021-02-22 22:40:32 [INFO] [TRAIN] epoch=32, iter=11740/80000, loss=1.0265, lr=0.008669, batch_cost=1.3520, reader_cost=0.0001 | ETA 25:38:06 2021-02-22 22:40:45 [INFO] [TRAIN] epoch=32, iter=11750/80000, loss=0.9377, lr=0.008668, batch_cost=1.3568, reader_cost=0.0001 | ETA 25:43:23 2021-02-22 22:40:59 [INFO] [TRAIN] epoch=32, iter=11760/80000, loss=1.0167, lr=0.008667, batch_cost=1.3857, reader_cost=0.0001 | ETA 26:15:59 2021-02-22 22:41:13 [INFO] [TRAIN] epoch=32, iter=11770/80000, loss=0.9335, lr=0.008666, batch_cost=1.3467, reader_cost=0.0001 | ETA 25:31:27 2021-02-22 22:41:26 [INFO] [TRAIN] epoch=32, iter=11780/80000, loss=0.9028, lr=0.008665, batch_cost=1.3751, reader_cost=0.0001 | ETA 26:03:27 2021-02-22 22:41:40 [INFO] [TRAIN] epoch=32, iter=11790/80000, loss=0.9925, lr=0.008663, batch_cost=1.3650, reader_cost=0.0001 | ETA 25:51:48 2021-02-22 22:41:54 [INFO] [TRAIN] epoch=32, iter=11800/80000, loss=1.1472, lr=0.008662, batch_cost=1.3606, reader_cost=0.0001 | ETA 25:46:31 2021-02-22 22:42:08 [INFO] [TRAIN] epoch=32, iter=11810/80000, loss=0.9460, lr=0.008661, batch_cost=1.4054, reader_cost=0.0001 | ETA 26:37:13 2021-02-22 22:42:21 [INFO] [TRAIN] epoch=32, iter=11820/80000, loss=0.9967, lr=0.008660, batch_cost=1.3745, reader_cost=0.0001 | ETA 26:01:50 2021-02-22 22:42:35 [INFO] [TRAIN] epoch=32, iter=11830/80000, loss=0.9345, lr=0.008659, batch_cost=1.3629, reader_cost=0.0001 | ETA 25:48:27 2021-02-22 22:42:49 [INFO] [TRAIN] epoch=32, iter=11840/80000, loss=0.9210, lr=0.008658, batch_cost=1.3583, reader_cost=0.0001 | ETA 25:43:00 2021-02-22 22:43:02 [INFO] [TRAIN] epoch=32, iter=11850/80000, loss=0.9334, lr=0.008657, batch_cost=1.3497, reader_cost=0.0001 | ETA 25:33:01 2021-02-22 22:43:16 [INFO] [TRAIN] epoch=32, iter=11860/80000, loss=0.9228, lr=0.008655, batch_cost=1.3517, reader_cost=0.0001 | ETA 25:35:02 2021-02-22 22:43:29 [INFO] [TRAIN] epoch=32, iter=11870/80000, loss=0.8885, lr=0.008654, batch_cost=1.3364, reader_cost=0.0001 | ETA 25:17:26 2021-02-22 22:43:43 [INFO] [TRAIN] epoch=32, iter=11880/80000, loss=0.9326, lr=0.008653, batch_cost=1.4040, reader_cost=0.0001 | ETA 26:33:59 2021-02-22 22:43:57 [INFO] [TRAIN] epoch=32, iter=11890/80000, loss=0.9293, lr=0.008652, batch_cost=1.3847, reader_cost=0.0001 | ETA 26:11:48 2021-02-22 22:44:11 [INFO] [TRAIN] epoch=32, iter=11900/80000, loss=0.9443, lr=0.008651, batch_cost=1.3553, reader_cost=0.0001 | ETA 25:38:18 2021-02-22 22:44:25 [INFO] [TRAIN] epoch=33, iter=11910/80000, loss=0.9541, lr=0.008650, batch_cost=1.4516, reader_cost=0.0654 | ETA 27:27:21 2021-02-22 22:44:39 [INFO] [TRAIN] epoch=33, iter=11920/80000, loss=0.9493, lr=0.008649, batch_cost=1.3629, reader_cost=0.0001 | ETA 25:46:29 2021-02-22 22:44:52 [INFO] [TRAIN] epoch=33, iter=11930/80000, loss=1.1378, lr=0.008647, batch_cost=1.3459, reader_cost=0.0001 | ETA 25:26:54 2021-02-22 22:45:06 [INFO] [TRAIN] epoch=33, iter=11940/80000, loss=0.9021, lr=0.008646, batch_cost=1.3675, reader_cost=0.0001 | ETA 25:51:14 2021-02-22 22:45:19 [INFO] [TRAIN] epoch=33, iter=11950/80000, loss=0.9155, lr=0.008645, batch_cost=1.3566, reader_cost=0.0001 | ETA 25:38:36 2021-02-22 22:45:33 [INFO] [TRAIN] epoch=33, iter=11960/80000, loss=1.0547, lr=0.008644, batch_cost=1.3449, reader_cost=0.0001 | ETA 25:25:03 2021-02-22 22:45:46 [INFO] [TRAIN] epoch=33, iter=11970/80000, loss=0.9443, lr=0.008643, batch_cost=1.3679, reader_cost=0.0001 | ETA 25:51:00 2021-02-22 22:46:00 [INFO] [TRAIN] epoch=33, iter=11980/80000, loss=0.9060, lr=0.008642, batch_cost=1.3691, reader_cost=0.0001 | ETA 25:52:08 2021-02-22 22:46:14 [INFO] [TRAIN] epoch=33, iter=11990/80000, loss=0.9379, lr=0.008641, batch_cost=1.3337, reader_cost=0.0001 | ETA 25:11:44 2021-02-22 22:46:27 [INFO] [TRAIN] epoch=33, iter=12000/80000, loss=0.8387, lr=0.008639, batch_cost=1.3870, reader_cost=0.0001 | ETA 26:11:58 2021-02-22 22:46:27 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:13 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:03 - batch_cost: 0.2207 - reader cost: 0.0953  3/125 [..............................] - ETA: 59s - batch_cost: 0.2946 - reader cost: 0.1260  4/125 [..............................] - ETA: 57s - batch_cost: 0.3267 - reader cost: 0.1371 5/125 [>.............................] - ETA: 55s - batch_cost: 0.3410 - reader cost: 0.1389 6/125 [>.............................] - ETA: 52s - batch_cost: 0.3465 - reader cost: 0.1343 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3569 - reader cost: 0.1385 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3694 - reader cost: 0.1452 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3756 - reader cost: 0.1479 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3768 - reader cost: 0.1468 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3819 - reader cost: 0.1484 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3849 - reader cost: 0.1499 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3890 - reader cost: 0.1522 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3933 - reader cost: 0.1555 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3918 - reader cost: 0.1530 16/125 [==>...........................] - ETA: 46s - batch_cost: 0.3939 - reader cost: 0.1544 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3951 - reader cost: 0.1546 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3971 - reader cost: 0.1561 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3960 - reader cost: 0.1544 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3975 - reader cost: 0.1555 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.3974 - reader cost: 0.1546 22/125 [====>.........................] - ETA: 43s - batch_cost: 0.3969 - reader cost: 0.1537 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.3959 - reader cost: 0.1518 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.3970 - reader cost: 0.1525 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.3983 - reader cost: 0.1535 26/125 [=====>........................] - ETA: 41s - batch_cost: 0.3983 - reader cost: 0.1525 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.3990 - reader cost: 0.1529 28/125 [=====>........................] - ETA: 40s - batch_cost: 0.4008 - reader cost: 0.1520 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4014 - reader cost: 0.1510 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4025 - reader cost: 0.1520 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.4032 - reader cost: 0.1528 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4042 - reader cost: 0.1536 33/125 [======>.......................] - ETA: 38s - batch_cost: 0.4032 - reader cost: 0.1527 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4025 - reader cost: 0.1518 35/125 [=======>......................] - ETA: 37s - batch_cost: 0.4020 - reader cost: 0.1513 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4022 - reader cost: 0.1503 37/125 [=======>......................] - ETA: 36s - batch_cost: 0.4033 - reader cost: 0.1512 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4039 - reader cost: 0.1507 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4039 - reader cost: 0.1491 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4047 - reader cost: 0.1483 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4061 - reader cost: 0.1477 42/125 [=========>....................] - ETA: 34s - batch_cost: 0.4066 - reader cost: 0.1460 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4070 - reader cost: 0.1436 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4079 - reader cost: 0.1429 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4076 - reader cost: 0.1424 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4084 - reader cost: 0.1429 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4088 - reader cost: 0.1436 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4093 - reader cost: 0.1443 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4094 - reader cost: 0.1446 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4095 - reader cost: 0.1451 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4101 - reader cost: 0.1458 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4104 - reader cost: 0.1463 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4108 - reader cost: 0.1469 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4113 - reader cost: 0.1477 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4106 - reader cost: 0.1472 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4101 - reader cost: 0.1469 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4098 - reader cost: 0.1468 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4105 - reader cost: 0.1474 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4108 - reader cost: 0.1477 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4101 - reader cost: 0.1472 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4105 - reader cost: 0.1477 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4107 - reader cost: 0.1481 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4110 - reader cost: 0.1486 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4119 - reader cost: 0.1494 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4113 - reader cost: 0.1490 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4115 - reader cost: 0.1493 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4110 - reader cost: 0.1491 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4109 - reader cost: 0.1491 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4111 - reader cost: 0.1494 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4107 - reader cost: 0.1490 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4109 - reader cost: 0.1493 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4113 - reader cost: 0.1498 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4110 - reader cost: 0.1496 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4117 - reader cost: 0.1504 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4120 - reader cost: 0.1508 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4122 - reader cost: 0.1512 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4125 - reader cost: 0.1515 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4129 - reader cost: 0.1521 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4126 - reader cost: 0.1519 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4129 - reader cost: 0.1523 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4134 - reader cost: 0.1527 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4136 - reader cost: 0.1528 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4137 - reader cost: 0.1529 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4140 - reader cost: 0.1531 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4140 - reader cost: 0.1531 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4134 - reader cost: 0.1527 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4131 - reader cost: 0.1525 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4128 - reader cost: 0.1521 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4129 - reader cost: 0.1522 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4124 - reader cost: 0.1518 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4124 - reader cost: 0.1517 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4126 - reader cost: 0.1519 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4123 - reader cost: 0.1518 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4124 - reader cost: 0.1520 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4127 - reader cost: 0.1523 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4122 - reader cost: 0.1519 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4123 - reader cost: 0.1521 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4123 - reader cost: 0.1521 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4124 - reader cost: 0.1523 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4124 - reader cost: 0.1521 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4120 - reader cost: 0.1513 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4117 - reader cost: 0.1512  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4119 - reader cost: 0.1514 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4120 - reader cost: 0.1511 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4122 - reader cost: 0.1510 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4119 - reader cost: 0.1508 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4122 - reader cost: 0.1512 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4124 - reader cost: 0.1510 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4127 - reader cost: 0.1511 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4130 - reader cost: 0.1513 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4126 - reader cost: 0.1511 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4128 - reader cost: 0.1513 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4126 - reader cost: 0.1512 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4125 - reader cost: 0.1512 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4127 - reader cost: 0.1515 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4129 - reader cost: 0.1518 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4126 - reader cost: 0.1515 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4127 - reader cost: 0.1517 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4125 - reader cost: 0.1515 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4127 - reader cost: 0.1518 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4124 - reader cost: 0.1516 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4120 - reader cost: 0.1512 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4121 - reader cost: 0.1514 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4122 - reader cost: 0.1516 125/125 [==============================] - 52s 417ms/step - batch_cost: 0.4124 - reader cost: 0.1519 2021-02-22 22:47:20 [INFO] [EVAL] #Images=500 mIoU=0.7138 Acc=0.9497 Kappa=0.9347 2021-02-22 22:47:20 [INFO] [EVAL] Class IoU: [0.9771 0.8192 0.8984 0.3282 0.5654 0.6018 0.6067 0.7537 0.9045 0.6273 0.9351 0.7926 0.504 0.9274 0.6483 0.6547 0.7293 0.5435 0.7442] 2021-02-22 22:47:20 [INFO] [EVAL] Class Acc: [0.9898 0.8902 0.9422 0.8643 0.7596 0.8293 0.9086 0.917 0.9331 0.7594 0.9588 0.86 0.8608 0.9549 0.905 0.9486 0.9652 0.7593 0.807 ] 2021-02-22 22:47:24 [INFO] [EVAL] The model with the best validation mIoU (0.7322) was saved at iter 11000. 2021-02-22 22:47:37 [INFO] [TRAIN] epoch=33, iter=12010/80000, loss=1.3625, lr=0.008638, batch_cost=1.3607, reader_cost=0.0001 | ETA 25:41:57 2021-02-22 22:47:51 [INFO] [TRAIN] epoch=33, iter=12020/80000, loss=0.8987, lr=0.008637, batch_cost=1.3500, reader_cost=0.0001 | ETA 25:29:34 2021-02-22 22:48:04 [INFO] [TRAIN] epoch=33, iter=12030/80000, loss=0.9833, lr=0.008636, batch_cost=1.3576, reader_cost=0.0001 | ETA 25:37:53 2021-02-22 22:48:18 [INFO] [TRAIN] epoch=33, iter=12040/80000, loss=0.9523, lr=0.008635, batch_cost=1.3307, reader_cost=0.0001 | ETA 25:07:13 2021-02-22 22:48:31 [INFO] [TRAIN] epoch=33, iter=12050/80000, loss=0.8591, lr=0.008634, batch_cost=1.3515, reader_cost=0.0001 | ETA 25:30:33 2021-02-22 22:48:45 [INFO] [TRAIN] epoch=33, iter=12060/80000, loss=0.9710, lr=0.008633, batch_cost=1.3895, reader_cost=0.0001 | ETA 26:13:25 2021-02-22 22:48:58 [INFO] [TRAIN] epoch=33, iter=12070/80000, loss=1.0648, lr=0.008631, batch_cost=1.3365, reader_cost=0.0001 | ETA 25:13:07 2021-02-22 22:49:12 [INFO] [TRAIN] epoch=33, iter=12080/80000, loss=0.8566, lr=0.008630, batch_cost=1.3309, reader_cost=0.0001 | ETA 25:06:35 2021-02-22 22:49:25 [INFO] [TRAIN] epoch=33, iter=12090/80000, loss=0.9159, lr=0.008629, batch_cost=1.3338, reader_cost=0.0001 | ETA 25:09:36 2021-02-22 22:49:39 [INFO] [TRAIN] epoch=33, iter=12100/80000, loss=0.9321, lr=0.008628, batch_cost=1.3588, reader_cost=0.0001 | ETA 25:37:43 2021-02-22 22:49:52 [INFO] [TRAIN] epoch=33, iter=12110/80000, loss=1.0158, lr=0.008627, batch_cost=1.3703, reader_cost=0.0001 | ETA 25:50:32 2021-02-22 22:50:06 [INFO] [TRAIN] epoch=33, iter=12120/80000, loss=0.9521, lr=0.008626, batch_cost=1.3691, reader_cost=0.0001 | ETA 25:48:54 2021-02-22 22:50:20 [INFO] [TRAIN] epoch=33, iter=12130/80000, loss=0.9010, lr=0.008625, batch_cost=1.3601, reader_cost=0.0001 | ETA 25:38:29 2021-02-22 22:50:33 [INFO] [TRAIN] epoch=33, iter=12140/80000, loss=0.8586, lr=0.008623, batch_cost=1.3651, reader_cost=0.0001 | ETA 25:43:54 2021-02-22 22:50:47 [INFO] [TRAIN] epoch=33, iter=12150/80000, loss=0.8630, lr=0.008622, batch_cost=1.3968, reader_cost=0.0001 | ETA 26:19:30 2021-02-22 22:51:01 [INFO] [TRAIN] epoch=33, iter=12160/80000, loss=0.9631, lr=0.008621, batch_cost=1.3624, reader_cost=0.0001 | ETA 25:40:25 2021-02-22 22:51:14 [INFO] [TRAIN] epoch=33, iter=12170/80000, loss=1.0408, lr=0.008620, batch_cost=1.3579, reader_cost=0.0001 | ETA 25:35:09 2021-02-22 22:51:28 [INFO] [TRAIN] epoch=33, iter=12180/80000, loss=1.0067, lr=0.008619, batch_cost=1.3719, reader_cost=0.0001 | ETA 25:50:43 2021-02-22 22:51:42 [INFO] [TRAIN] epoch=33, iter=12190/80000, loss=0.9510, lr=0.008618, batch_cost=1.3455, reader_cost=0.0001 | ETA 25:20:37 2021-02-22 22:51:55 [INFO] [TRAIN] epoch=33, iter=12200/80000, loss=1.0594, lr=0.008617, batch_cost=1.3647, reader_cost=0.0001 | ETA 25:42:07 2021-02-22 22:52:09 [INFO] [TRAIN] epoch=33, iter=12210/80000, loss=0.9296, lr=0.008615, batch_cost=1.3731, reader_cost=0.0001 | ETA 25:51:24 2021-02-22 22:52:23 [INFO] [TRAIN] epoch=33, iter=12220/80000, loss=0.9702, lr=0.008614, batch_cost=1.3737, reader_cost=0.0001 | ETA 25:51:46 2021-02-22 22:52:36 [INFO] [TRAIN] epoch=33, iter=12230/80000, loss=0.9151, lr=0.008613, batch_cost=1.3798, reader_cost=0.0001 | ETA 25:58:28 2021-02-22 22:52:50 [INFO] [TRAIN] epoch=33, iter=12240/80000, loss=0.8834, lr=0.008612, batch_cost=1.3701, reader_cost=0.0001 | ETA 25:47:19 2021-02-22 22:53:04 [INFO] [TRAIN] epoch=33, iter=12250/80000, loss=0.9954, lr=0.008611, batch_cost=1.3624, reader_cost=0.0001 | ETA 25:38:19 2021-02-22 22:53:17 [INFO] [TRAIN] epoch=33, iter=12260/80000, loss=1.0651, lr=0.008610, batch_cost=1.3555, reader_cost=0.0001 | ETA 25:30:21 2021-02-22 22:53:31 [INFO] [TRAIN] epoch=33, iter=12270/80000, loss=0.9329, lr=0.008609, batch_cost=1.3507, reader_cost=0.0001 | ETA 25:24:46 2021-02-22 22:53:45 [INFO] [TRAIN] epoch=34, iter=12280/80000, loss=0.8550, lr=0.008607, batch_cost=1.4162, reader_cost=0.0849 | ETA 26:38:27 2021-02-22 22:53:59 [INFO] [TRAIN] epoch=34, iter=12290/80000, loss=0.8915, lr=0.008606, batch_cost=1.3652, reader_cost=0.0001 | ETA 25:40:36 2021-02-22 22:54:12 [INFO] [TRAIN] epoch=34, iter=12300/80000, loss=1.0591, lr=0.008605, batch_cost=1.3612, reader_cost=0.0001 | ETA 25:35:53 2021-02-22 22:54:26 [INFO] [TRAIN] epoch=34, iter=12310/80000, loss=0.8922, lr=0.008604, batch_cost=1.3433, reader_cost=0.0001 | ETA 25:15:29 2021-02-22 22:54:39 [INFO] [TRAIN] epoch=34, iter=12320/80000, loss=0.9075, lr=0.008603, batch_cost=1.3765, reader_cost=0.0001 | ETA 25:52:39 2021-02-22 22:54:53 [INFO] [TRAIN] epoch=34, iter=12330/80000, loss=0.8713, lr=0.008602, batch_cost=1.3479, reader_cost=0.0001 | ETA 25:20:12 2021-02-22 22:55:07 [INFO] [TRAIN] epoch=34, iter=12340/80000, loss=0.8679, lr=0.008600, batch_cost=1.3662, reader_cost=0.0001 | ETA 25:40:38 2021-02-22 22:55:20 [INFO] [TRAIN] epoch=34, iter=12350/80000, loss=0.8958, lr=0.008599, batch_cost=1.3399, reader_cost=0.0001 | ETA 25:10:41 2021-02-22 22:55:33 [INFO] [TRAIN] epoch=34, iter=12360/80000, loss=0.9364, lr=0.008598, batch_cost=1.3408, reader_cost=0.0001 | ETA 25:11:31 2021-02-22 22:55:47 [INFO] [TRAIN] epoch=34, iter=12370/80000, loss=0.9294, lr=0.008597, batch_cost=1.3802, reader_cost=0.0001 | ETA 25:55:43 2021-02-22 22:56:01 [INFO] [TRAIN] epoch=34, iter=12380/80000, loss=0.8926, lr=0.008596, batch_cost=1.3619, reader_cost=0.0001 | ETA 25:34:53 2021-02-22 22:56:15 [INFO] [TRAIN] epoch=34, iter=12390/80000, loss=1.0146, lr=0.008595, batch_cost=1.3665, reader_cost=0.0001 | ETA 25:39:47 2021-02-22 22:56:28 [INFO] [TRAIN] epoch=34, iter=12400/80000, loss=0.9689, lr=0.008594, batch_cost=1.3726, reader_cost=0.0001 | ETA 25:46:24 2021-02-22 22:56:42 [INFO] [TRAIN] epoch=34, iter=12410/80000, loss=0.8954, lr=0.008592, batch_cost=1.3470, reader_cost=0.0001 | ETA 25:17:23 2021-02-22 22:56:55 [INFO] [TRAIN] epoch=34, iter=12420/80000, loss=0.9823, lr=0.008591, batch_cost=1.3693, reader_cost=0.0001 | ETA 25:42:16 2021-02-22 22:57:09 [INFO] [TRAIN] epoch=34, iter=12430/80000, loss=0.8776, lr=0.008590, batch_cost=1.3221, reader_cost=0.0001 | ETA 24:48:53 2021-02-22 22:57:22 [INFO] [TRAIN] epoch=34, iter=12440/80000, loss=0.8285, lr=0.008589, batch_cost=1.3301, reader_cost=0.0001 | ETA 24:57:43 2021-02-22 22:57:36 [INFO] [TRAIN] epoch=34, iter=12450/80000, loss=0.9515, lr=0.008588, batch_cost=1.3622, reader_cost=0.0001 | ETA 25:33:33 2021-02-22 22:57:49 [INFO] [TRAIN] epoch=34, iter=12460/80000, loss=0.9541, lr=0.008587, batch_cost=1.3413, reader_cost=0.0001 | ETA 25:09:49 2021-02-22 22:58:02 [INFO] [TRAIN] epoch=34, iter=12470/80000, loss=0.8360, lr=0.008586, batch_cost=1.3446, reader_cost=0.0001 | ETA 25:13:18 2021-02-22 22:58:16 [INFO] [TRAIN] epoch=34, iter=12480/80000, loss=0.9189, lr=0.008584, batch_cost=1.3664, reader_cost=0.0001 | ETA 25:37:38 2021-02-22 22:58:30 [INFO] [TRAIN] epoch=34, iter=12490/80000, loss=0.9342, lr=0.008583, batch_cost=1.3483, reader_cost=0.0001 | ETA 25:17:02 2021-02-22 22:58:43 [INFO] [TRAIN] epoch=34, iter=12500/80000, loss=0.9958, lr=0.008582, batch_cost=1.3795, reader_cost=0.0001 | ETA 25:51:55 2021-02-22 22:58:57 [INFO] [TRAIN] epoch=34, iter=12510/80000, loss=0.9574, lr=0.008581, batch_cost=1.3728, reader_cost=0.0001 | ETA 25:44:12 2021-02-22 22:59:11 [INFO] [TRAIN] epoch=34, iter=12520/80000, loss=0.9891, lr=0.008580, batch_cost=1.3482, reader_cost=0.0001 | ETA 25:16:16 2021-02-22 22:59:24 [INFO] [TRAIN] epoch=34, iter=12530/80000, loss=0.8993, lr=0.008579, batch_cost=1.3533, reader_cost=0.0001 | ETA 25:21:46 2021-02-22 22:59:38 [INFO] [TRAIN] epoch=34, iter=12540/80000, loss=0.9265, lr=0.008578, batch_cost=1.3785, reader_cost=0.0001 | ETA 25:49:50 2021-02-22 22:59:51 [INFO] [TRAIN] epoch=34, iter=12550/80000, loss=0.9088, lr=0.008576, batch_cost=1.3482, reader_cost=0.0001 | ETA 25:15:37 2021-02-22 23:00:05 [INFO] [TRAIN] epoch=34, iter=12560/80000, loss=1.0800, lr=0.008575, batch_cost=1.3766, reader_cost=0.0001 | ETA 25:47:19 2021-02-22 23:00:19 [INFO] [TRAIN] epoch=34, iter=12570/80000, loss=0.9825, lr=0.008574, batch_cost=1.3550, reader_cost=0.0001 | ETA 25:22:49 2021-02-22 23:00:32 [INFO] [TRAIN] epoch=34, iter=12580/80000, loss=0.9424, lr=0.008573, batch_cost=1.3666, reader_cost=0.0001 | ETA 25:35:37 2021-02-22 23:00:46 [INFO] [TRAIN] epoch=34, iter=12590/80000, loss=0.8826, lr=0.008572, batch_cost=1.3504, reader_cost=0.0001 | ETA 25:17:10 2021-02-22 23:01:00 [INFO] [TRAIN] epoch=34, iter=12600/80000, loss=1.0030, lr=0.008571, batch_cost=1.3710, reader_cost=0.0001 | ETA 25:40:07 2021-02-22 23:01:13 [INFO] [TRAIN] epoch=34, iter=12610/80000, loss=0.8802, lr=0.008570, batch_cost=1.3282, reader_cost=0.0001 | ETA 24:51:49 2021-02-22 23:01:27 [INFO] [TRAIN] epoch=34, iter=12620/80000, loss=0.8955, lr=0.008568, batch_cost=1.3784, reader_cost=0.0001 | ETA 25:47:55 2021-02-22 23:01:40 [INFO] [TRAIN] epoch=34, iter=12630/80000, loss=0.9546, lr=0.008567, batch_cost=1.3708, reader_cost=0.0001 | ETA 25:39:11 2021-02-22 23:01:54 [INFO] [TRAIN] epoch=34, iter=12640/80000, loss=0.9125, lr=0.008566, batch_cost=1.3520, reader_cost=0.0001 | ETA 25:17:50 2021-02-22 23:02:08 [INFO] [TRAIN] epoch=35, iter=12650/80000, loss=1.0018, lr=0.008565, batch_cost=1.4239, reader_cost=0.0632 | ETA 26:38:18 2021-02-22 23:02:22 [INFO] [TRAIN] epoch=35, iter=12660/80000, loss=1.0468, lr=0.008564, batch_cost=1.4173, reader_cost=0.0001 | ETA 26:30:42 2021-02-22 23:02:36 [INFO] [TRAIN] epoch=35, iter=12670/80000, loss=1.0022, lr=0.008563, batch_cost=1.3640, reader_cost=0.0001 | ETA 25:30:35 2021-02-22 23:02:49 [INFO] [TRAIN] epoch=35, iter=12680/80000, loss=0.9026, lr=0.008562, batch_cost=1.3519, reader_cost=0.0001 | ETA 25:16:46 2021-02-22 23:03:03 [INFO] [TRAIN] epoch=35, iter=12690/80000, loss=0.9445, lr=0.008560, batch_cost=1.3560, reader_cost=0.0001 | ETA 25:21:11 2021-02-22 23:03:17 [INFO] [TRAIN] epoch=35, iter=12700/80000, loss=0.8687, lr=0.008559, batch_cost=1.3645, reader_cost=0.0001 | ETA 25:30:28 2021-02-22 23:03:30 [INFO] [TRAIN] epoch=35, iter=12710/80000, loss=0.9601, lr=0.008558, batch_cost=1.3632, reader_cost=0.0001 | ETA 25:28:50 2021-02-22 23:03:44 [INFO] [TRAIN] epoch=35, iter=12720/80000, loss=1.0935, lr=0.008557, batch_cost=1.3657, reader_cost=0.0001 | ETA 25:31:26 2021-02-22 23:03:57 [INFO] [TRAIN] epoch=35, iter=12730/80000, loss=1.0103, lr=0.008556, batch_cost=1.3420, reader_cost=0.0001 | ETA 25:04:33 2021-02-22 23:04:11 [INFO] [TRAIN] epoch=35, iter=12740/80000, loss=0.9419, lr=0.008555, batch_cost=1.3247, reader_cost=0.0001 | ETA 24:45:00 2021-02-22 23:04:24 [INFO] [TRAIN] epoch=35, iter=12750/80000, loss=0.9551, lr=0.008554, batch_cost=1.3681, reader_cost=0.0001 | ETA 25:33:26 2021-02-22 23:04:38 [INFO] [TRAIN] epoch=35, iter=12760/80000, loss=0.8502, lr=0.008552, batch_cost=1.3647, reader_cost=0.0001 | ETA 25:29:22 2021-02-22 23:04:52 [INFO] [TRAIN] epoch=35, iter=12770/80000, loss=0.9181, lr=0.008551, batch_cost=1.3723, reader_cost=0.0001 | ETA 25:37:39 2021-02-22 23:05:05 [INFO] [TRAIN] epoch=35, iter=12780/80000, loss=0.9872, lr=0.008550, batch_cost=1.3554, reader_cost=0.0001 | ETA 25:18:31 2021-02-22 23:05:19 [INFO] [TRAIN] epoch=35, iter=12790/80000, loss=0.9418, lr=0.008549, batch_cost=1.3573, reader_cost=0.0001 | ETA 25:20:25 2021-02-22 23:05:32 [INFO] [TRAIN] epoch=35, iter=12800/80000, loss=0.9194, lr=0.008548, batch_cost=1.3291, reader_cost=0.0001 | ETA 24:48:38 2021-02-22 23:05:46 [INFO] [TRAIN] epoch=35, iter=12810/80000, loss=0.9584, lr=0.008547, batch_cost=1.3470, reader_cost=0.0001 | ETA 25:08:22 2021-02-22 23:05:59 [INFO] [TRAIN] epoch=35, iter=12820/80000, loss=0.8906, lr=0.008546, batch_cost=1.3377, reader_cost=0.0001 | ETA 24:57:43 2021-02-22 23:06:13 [INFO] [TRAIN] epoch=35, iter=12830/80000, loss=0.9844, lr=0.008544, batch_cost=1.3707, reader_cost=0.0001 | ETA 25:34:27 2021-02-22 23:06:26 [INFO] [TRAIN] epoch=35, iter=12840/80000, loss=0.8647, lr=0.008543, batch_cost=1.3607, reader_cost=0.0001 | ETA 25:23:02 2021-02-22 23:06:40 [INFO] [TRAIN] epoch=35, iter=12850/80000, loss=0.9597, lr=0.008542, batch_cost=1.3483, reader_cost=0.0001 | ETA 25:08:58 2021-02-22 23:06:53 [INFO] [TRAIN] epoch=35, iter=12860/80000, loss=0.9275, lr=0.008541, batch_cost=1.3538, reader_cost=0.0001 | ETA 25:14:57 2021-02-22 23:07:07 [INFO] [TRAIN] epoch=35, iter=12870/80000, loss=0.9110, lr=0.008540, batch_cost=1.3708, reader_cost=0.0001 | ETA 25:33:41 2021-02-22 23:07:20 [INFO] [TRAIN] epoch=35, iter=12880/80000, loss=1.0000, lr=0.008539, batch_cost=1.3338, reader_cost=0.0001 | ETA 24:52:02 2021-02-22 23:07:34 [INFO] [TRAIN] epoch=35, iter=12890/80000, loss=0.8751, lr=0.008538, batch_cost=1.3718, reader_cost=0.0001 | ETA 25:34:24 2021-02-22 23:07:48 [INFO] [TRAIN] epoch=35, iter=12900/80000, loss=0.9459, lr=0.008536, batch_cost=1.3644, reader_cost=0.0001 | ETA 25:25:50 2021-02-22 23:08:01 [INFO] [TRAIN] epoch=35, iter=12910/80000, loss=1.1084, lr=0.008535, batch_cost=1.3721, reader_cost=0.0001 | ETA 25:34:13 2021-02-22 23:08:15 [INFO] [TRAIN] epoch=35, iter=12920/80000, loss=0.9680, lr=0.008534, batch_cost=1.3525, reader_cost=0.0001 | ETA 25:12:03 2021-02-22 23:08:28 [INFO] [TRAIN] epoch=35, iter=12930/80000, loss=1.0172, lr=0.008533, batch_cost=1.3584, reader_cost=0.0001 | ETA 25:18:27 2021-02-22 23:08:42 [INFO] [TRAIN] epoch=35, iter=12940/80000, loss=0.8780, lr=0.008532, batch_cost=1.3781, reader_cost=0.0001 | ETA 25:40:18 2021-02-22 23:08:56 [INFO] [TRAIN] epoch=35, iter=12950/80000, loss=1.0698, lr=0.008531, batch_cost=1.3502, reader_cost=0.0001 | ETA 25:08:48 2021-02-22 23:09:09 [INFO] [TRAIN] epoch=35, iter=12960/80000, loss=0.9234, lr=0.008530, batch_cost=1.3665, reader_cost=0.0001 | ETA 25:26:51 2021-02-22 23:09:23 [INFO] [TRAIN] epoch=35, iter=12970/80000, loss=0.9376, lr=0.008528, batch_cost=1.3772, reader_cost=0.0001 | ETA 25:38:31 2021-02-22 23:09:37 [INFO] [TRAIN] epoch=35, iter=12980/80000, loss=0.8805, lr=0.008527, batch_cost=1.3446, reader_cost=0.0001 | ETA 25:01:58 2021-02-22 23:09:51 [INFO] [TRAIN] epoch=35, iter=12990/80000, loss=0.8385, lr=0.008526, batch_cost=1.3852, reader_cost=0.0001 | ETA 25:47:01 2021-02-22 23:10:04 [INFO] [TRAIN] epoch=35, iter=13000/80000, loss=0.8922, lr=0.008525, batch_cost=1.3608, reader_cost=0.0001 | ETA 25:19:33 2021-02-22 23:10:04 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:19 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:03 - batch_cost: 0.1948 - reader cost: 0.0666  3/125 [..............................] - ETA: 59s - batch_cost: 0.2753 - reader cost: 0.1068  4/125 [..............................] - ETA: 57s - batch_cost: 0.3115 - reader cost: 0.1228 5/125 [>.............................] - ETA: 55s - batch_cost: 0.3351 - reader cost: 0.1342 6/125 [>.............................] - ETA: 54s - batch_cost: 0.3520 - reader cost: 0.1419 7/125 [>.............................] - ETA: 53s - batch_cost: 0.3632 - reader cost: 0.1473 8/125 [>.............................] - ETA: 53s - batch_cost: 0.3743 - reader cost: 0.1537 9/125 [=>............................] - ETA: 52s - batch_cost: 0.3818 - reader cost: 0.1571 10/125 [=>............................] - ETA: 51s - batch_cost: 0.3859 - reader cost: 0.1587 11/125 [=>............................] - ETA: 51s - batch_cost: 0.3918 - reader cost: 0.1620 12/125 [=>............................] - ETA: 50s - batch_cost: 0.3909 - reader cost: 0.1593 13/125 [==>...........................] - ETA: 49s - batch_cost: 0.3947 - reader cost: 0.1608 14/125 [==>...........................] - ETA: 49s - batch_cost: 0.3967 - reader cost: 0.1615 15/125 [==>...........................] - ETA: 48s - batch_cost: 0.3989 - reader cost: 0.1624 16/125 [==>...........................] - ETA: 48s - batch_cost: 0.4006 - reader cost: 0.1631 17/125 [===>..........................] - ETA: 47s - batch_cost: 0.4027 - reader cost: 0.1642 18/125 [===>..........................] - ETA: 47s - batch_cost: 0.4059 - reader cost: 0.1662 19/125 [===>..........................] - ETA: 46s - batch_cost: 0.4043 - reader cost: 0.1641 20/125 [===>..........................] - ETA: 46s - batch_cost: 0.4062 - reader cost: 0.1653 21/125 [====>.........................] - ETA: 45s - batch_cost: 0.4068 - reader cost: 0.1655 22/125 [====>.........................] - ETA: 45s - batch_cost: 0.4095 - reader cost: 0.1674 23/125 [====>.........................] - ETA: 44s - batch_cost: 0.4087 - reader cost: 0.1662 24/125 [====>.........................] - ETA: 44s - batch_cost: 0.4118 - reader cost: 0.1686 25/125 [=====>........................] - ETA: 43s - batch_cost: 0.4128 - reader cost: 0.1691 26/125 [=====>........................] - ETA: 43s - batch_cost: 0.4141 - reader cost: 0.1701 27/125 [=====>........................] - ETA: 42s - batch_cost: 0.4147 - reader cost: 0.1701 28/125 [=====>........................] - ETA: 42s - batch_cost: 0.4154 - reader cost: 0.1705 29/125 [=====>........................] - ETA: 42s - batch_cost: 0.4158 - reader cost: 0.1707 30/125 [======>.......................] - ETA: 41s - batch_cost: 0.4146 - reader cost: 0.1692 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4137 - reader cost: 0.1682 32/125 [======>.......................] - ETA: 40s - batch_cost: 0.4142 - reader cost: 0.1686 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4150 - reader cost: 0.1690 34/125 [=======>......................] - ETA: 39s - batch_cost: 0.4156 - reader cost: 0.1694 35/125 [=======>......................] - ETA: 39s - batch_cost: 0.4159 - reader cost: 0.1695 36/125 [=======>......................] - ETA: 38s - batch_cost: 0.4164 - reader cost: 0.1698 37/125 [=======>......................] - ETA: 38s - batch_cost: 0.4168 - reader cost: 0.1699 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4153 - reader cost: 0.1683 39/125 [========>.....................] - ETA: 37s - batch_cost: 0.4156 - reader cost: 0.1684 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4164 - reader cost: 0.1691 41/125 [========>.....................] - ETA: 36s - batch_cost: 0.4155 - reader cost: 0.1681 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4158 - reader cost: 0.1684 43/125 [=========>....................] - ETA: 35s - batch_cost: 0.4153 - reader cost: 0.1675 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4138 - reader cost: 0.1659 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4145 - reader cost: 0.1665 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4135 - reader cost: 0.1656 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4139 - reader cost: 0.1659 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4141 - reader cost: 0.1661 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4148 - reader cost: 0.1668 50/125 [===========>..................] - ETA: 32s - batch_cost: 0.4151 - reader cost: 0.1670 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4150 - reader cost: 0.1669 52/125 [===========>..................] - ETA: 31s - batch_cost: 0.4144 - reader cost: 0.1659 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4147 - reader cost: 0.1662 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4154 - reader cost: 0.1665 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4154 - reader cost: 0.1664 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4159 - reader cost: 0.1667 57/125 [============>.................] - ETA: 29s - batch_cost: 0.4161 - reader cost: 0.1664 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4156 - reader cost: 0.1659 59/125 [=============>................] - ETA: 28s - batch_cost: 0.4161 - reader cost: 0.1663 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4161 - reader cost: 0.1664 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4163 - reader cost: 0.1665 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4158 - reader cost: 0.1660 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4160 - reader cost: 0.1662 64/125 [==============>...............] - ETA: 26s - batch_cost: 0.4163 - reader cost: 0.1664 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4159 - reader cost: 0.1661 66/125 [==============>...............] - ETA: 25s - batch_cost: 0.4154 - reader cost: 0.1655 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4156 - reader cost: 0.1657 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4150 - reader cost: 0.1651 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4151 - reader cost: 0.1652 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4154 - reader cost: 0.1655 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4157 - reader cost: 0.1658 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4160 - reader cost: 0.1660 73/125 [================>.............] - ETA: 22s - batch_cost: 0.4160 - reader cost: 0.1660 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4155 - reader cost: 0.1655 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4150 - reader cost: 0.1648 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4147 - reader cost: 0.1642 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4151 - reader cost: 0.1645 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4155 - reader cost: 0.1641 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4152 - reader cost: 0.1635 80/125 [==================>...........] - ETA: 19s - batch_cost: 0.4153 - reader cost: 0.1636 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4154 - reader cost: 0.1637 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4157 - reader cost: 0.1640 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4154 - reader cost: 0.1637 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4155 - reader cost: 0.1635 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4156 - reader cost: 0.1636 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4158 - reader cost: 0.1637 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4158 - reader cost: 0.1637 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4160 - reader cost: 0.1640 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4154 - reader cost: 0.1633 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4155 - reader cost: 0.1634 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4153 - reader cost: 0.1633 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4153 - reader cost: 0.1630 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4152 - reader cost: 0.1628 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4151 - reader cost: 0.1628 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4151 - reader cost: 0.1626 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4153 - reader cost: 0.1629 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4152 - reader cost: 0.1627 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4155 - reader cost: 0.1631 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4159 - reader cost: 0.1635 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4161 - reader cost: 0.1638 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4157 - reader cost: 0.1633 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4158 - reader cost: 0.1634  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4155 - reader cost: 0.1631 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4157 - reader cost: 0.1633 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4159 - reader cost: 0.1634 106/125 [========================>.....] - ETA: 8s - batch_cost: 0.4161 - reader cost: 0.1637 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4163 - reader cost: 0.1638 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4160 - reader cost: 0.1636 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4156 - reader cost: 0.1632 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4158 - reader cost: 0.1633 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4154 - reader cost: 0.1629 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4159 - reader cost: 0.1633 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4162 - reader cost: 0.1636 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4163 - reader cost: 0.1638 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4166 - reader cost: 0.1640 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4166 - reader cost: 0.1641 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4168 - reader cost: 0.1642 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4164 - reader cost: 0.1639 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4161 - reader cost: 0.1635 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4156 - reader cost: 0.1631 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4156 - reader cost: 0.1631 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4152 - reader cost: 0.1627 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4154 - reader cost: 0.1629 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4155 - reader cost: 0.1631 125/125 [==============================] - 53s 421ms/step - batch_cost: 0.4156 - reader cost: 0.1632 2021-02-22 23:10:57 [INFO] [EVAL] #Images=500 mIoU=0.7294 Acc=0.9518 Kappa=0.9374 2021-02-22 23:10:57 [INFO] [EVAL] Class IoU: [0.9787 0.8309 0.8971 0.4596 0.4812 0.6161 0.6782 0.7773 0.916 0.6396 0.8852 0.7913 0.552 0.9368 0.6889 0.8025 0.6208 0.5541 0.7518] 2021-02-22 23:10:57 [INFO] [EVAL] Class Acc: [0.9876 0.919 0.9448 0.7901 0.8554 0.8345 0.7549 0.9275 0.9442 0.8322 0.8938 0.9176 0.7016 0.956 0.8594 0.8772 0.9468 0.6562 0.8223] 2021-02-22 23:11:01 [INFO] [EVAL] The model with the best validation mIoU (0.7322) was saved at iter 11000. 2021-02-22 23:11:14 [INFO] [TRAIN] epoch=35, iter=13010/80000, loss=1.1228, lr=0.008524, batch_cost=1.3588, reader_cost=0.0001 | ETA 25:17:05 2021-02-22 23:11:27 [INFO] [TRAIN] epoch=35, iter=13020/80000, loss=0.9045, lr=0.008523, batch_cost=1.3127, reader_cost=0.0001 | ETA 24:25:24 2021-02-22 23:11:42 [INFO] [TRAIN] epoch=36, iter=13030/80000, loss=0.8613, lr=0.008522, batch_cost=1.4650, reader_cost=0.0882 | ETA 27:15:11 2021-02-22 23:11:56 [INFO] [TRAIN] epoch=36, iter=13040/80000, loss=0.8823, lr=0.008520, batch_cost=1.3544, reader_cost=0.0001 | ETA 25:11:27 2021-02-22 23:12:09 [INFO] [TRAIN] epoch=36, iter=13050/80000, loss=0.9270, lr=0.008519, batch_cost=1.3404, reader_cost=0.0001 | ETA 24:55:38 2021-02-22 23:12:22 [INFO] [TRAIN] epoch=36, iter=13060/80000, loss=0.8592, lr=0.008518, batch_cost=1.3477, reader_cost=0.0001 | ETA 25:03:32 2021-02-22 23:12:36 [INFO] [TRAIN] epoch=36, iter=13070/80000, loss=0.9832, lr=0.008517, batch_cost=1.3586, reader_cost=0.0001 | ETA 25:15:28 2021-02-22 23:12:50 [INFO] [TRAIN] epoch=36, iter=13080/80000, loss=0.8962, lr=0.008516, batch_cost=1.3583, reader_cost=0.0001 | ETA 25:14:55 2021-02-22 23:13:03 [INFO] [TRAIN] epoch=36, iter=13090/80000, loss=0.8777, lr=0.008515, batch_cost=1.3431, reader_cost=0.0001 | ETA 24:57:46 2021-02-22 23:13:17 [INFO] [TRAIN] epoch=36, iter=13100/80000, loss=0.8324, lr=0.008514, batch_cost=1.3539, reader_cost=0.0001 | ETA 25:09:34 2021-02-22 23:13:30 [INFO] [TRAIN] epoch=36, iter=13110/80000, loss=0.9733, lr=0.008512, batch_cost=1.3444, reader_cost=0.0001 | ETA 24:58:44 2021-02-22 23:13:44 [INFO] [TRAIN] epoch=36, iter=13120/80000, loss=0.9202, lr=0.008511, batch_cost=1.3680, reader_cost=0.0001 | ETA 25:24:54 2021-02-22 23:13:57 [INFO] [TRAIN] epoch=36, iter=13130/80000, loss=0.9909, lr=0.008510, batch_cost=1.3478, reader_cost=0.0001 | ETA 25:02:05 2021-02-22 23:14:11 [INFO] [TRAIN] epoch=36, iter=13140/80000, loss=0.9324, lr=0.008509, batch_cost=1.3511, reader_cost=0.0001 | ETA 25:05:35 2021-02-22 23:14:24 [INFO] [TRAIN] epoch=36, iter=13150/80000, loss=0.9503, lr=0.008508, batch_cost=1.3529, reader_cost=0.0001 | ETA 25:07:24 2021-02-22 23:14:38 [INFO] [TRAIN] epoch=36, iter=13160/80000, loss=1.0525, lr=0.008507, batch_cost=1.3487, reader_cost=0.0001 | ETA 25:02:25 2021-02-22 23:14:51 [INFO] [TRAIN] epoch=36, iter=13170/80000, loss=0.9647, lr=0.008505, batch_cost=1.3535, reader_cost=0.0001 | ETA 25:07:31 2021-02-22 23:15:05 [INFO] [TRAIN] epoch=36, iter=13180/80000, loss=0.9192, lr=0.008504, batch_cost=1.3418, reader_cost=0.0001 | ETA 24:54:21 2021-02-22 23:15:18 [INFO] [TRAIN] epoch=36, iter=13190/80000, loss=0.8545, lr=0.008503, batch_cost=1.3687, reader_cost=0.0001 | ETA 25:24:02 2021-02-22 23:15:32 [INFO] [TRAIN] epoch=36, iter=13200/80000, loss=0.9010, lr=0.008502, batch_cost=1.3684, reader_cost=0.0001 | ETA 25:23:27 2021-02-22 23:15:45 [INFO] [TRAIN] epoch=36, iter=13210/80000, loss=0.9870, lr=0.008501, batch_cost=1.3401, reader_cost=0.0001 | ETA 24:51:44 2021-02-22 23:15:59 [INFO] [TRAIN] epoch=36, iter=13220/80000, loss=0.9379, lr=0.008500, batch_cost=1.3636, reader_cost=0.0001 | ETA 25:17:38 2021-02-22 23:16:13 [INFO] [TRAIN] epoch=36, iter=13230/80000, loss=0.9271, lr=0.008499, batch_cost=1.3557, reader_cost=0.0001 | ETA 25:08:42 2021-02-22 23:16:27 [INFO] [TRAIN] epoch=36, iter=13240/80000, loss=0.8966, lr=0.008497, batch_cost=1.3890, reader_cost=0.0001 | ETA 25:45:32 2021-02-22 23:16:40 [INFO] [TRAIN] epoch=36, iter=13250/80000, loss=0.9463, lr=0.008496, batch_cost=1.3571, reader_cost=0.0001 | ETA 25:09:49 2021-02-22 23:16:54 [INFO] [TRAIN] epoch=36, iter=13260/80000, loss=1.0827, lr=0.008495, batch_cost=1.3652, reader_cost=0.0001 | ETA 25:18:36 2021-02-22 23:17:07 [INFO] [TRAIN] epoch=36, iter=13270/80000, loss=1.0322, lr=0.008494, batch_cost=1.3551, reader_cost=0.0001 | ETA 25:07:03 2021-02-22 23:17:21 [INFO] [TRAIN] epoch=36, iter=13280/80000, loss=0.9308, lr=0.008493, batch_cost=1.3537, reader_cost=0.0001 | ETA 25:05:19 2021-02-22 23:17:34 [INFO] [TRAIN] epoch=36, iter=13290/80000, loss=0.9087, lr=0.008492, batch_cost=1.3476, reader_cost=0.0001 | ETA 24:58:16 2021-02-22 23:17:48 [INFO] [TRAIN] epoch=36, iter=13300/80000, loss=0.9599, lr=0.008491, batch_cost=1.3793, reader_cost=0.0001 | ETA 25:33:17 2021-02-22 23:18:02 [INFO] [TRAIN] epoch=36, iter=13310/80000, loss=0.8777, lr=0.008489, batch_cost=1.3635, reader_cost=0.0001 | ETA 25:15:34 2021-02-22 23:18:16 [INFO] [TRAIN] epoch=36, iter=13320/80000, loss=0.8872, lr=0.008488, batch_cost=1.3813, reader_cost=0.0001 | ETA 25:35:03 2021-02-22 23:18:29 [INFO] [TRAIN] epoch=36, iter=13330/80000, loss=0.9623, lr=0.008487, batch_cost=1.3890, reader_cost=0.0001 | ETA 25:43:21 2021-02-22 23:18:43 [INFO] [TRAIN] epoch=36, iter=13340/80000, loss=0.9185, lr=0.008486, batch_cost=1.3499, reader_cost=0.0001 | ETA 24:59:41 2021-02-22 23:18:56 [INFO] [TRAIN] epoch=36, iter=13350/80000, loss=0.9531, lr=0.008485, batch_cost=1.3451, reader_cost=0.0001 | ETA 24:54:14 2021-02-22 23:19:10 [INFO] [TRAIN] epoch=36, iter=13360/80000, loss=0.8634, lr=0.008484, batch_cost=1.3647, reader_cost=0.0001 | ETA 25:15:43 2021-02-22 23:19:24 [INFO] [TRAIN] epoch=36, iter=13370/80000, loss=0.9269, lr=0.008483, batch_cost=1.3787, reader_cost=0.0001 | ETA 25:31:03 2021-02-22 23:19:37 [INFO] [TRAIN] epoch=36, iter=13380/80000, loss=0.8955, lr=0.008481, batch_cost=1.3530, reader_cost=0.0001 | ETA 25:02:17 2021-02-22 23:19:51 [INFO] [TRAIN] epoch=36, iter=13390/80000, loss=0.9303, lr=0.008480, batch_cost=1.3624, reader_cost=0.0001 | ETA 25:12:31 2021-02-22 23:20:06 [INFO] [TRAIN] epoch=37, iter=13400/80000, loss=1.2809, lr=0.008479, batch_cost=1.4791, reader_cost=0.0925 | ETA 27:21:48 2021-02-22 23:20:19 [INFO] [TRAIN] epoch=37, iter=13410/80000, loss=0.9465, lr=0.008478, batch_cost=1.3593, reader_cost=0.0001 | ETA 25:08:35 2021-02-22 23:20:33 [INFO] [TRAIN] epoch=37, iter=13420/80000, loss=1.0263, lr=0.008477, batch_cost=1.3494, reader_cost=0.0001 | ETA 24:57:22 2021-02-22 23:20:47 [INFO] [TRAIN] epoch=37, iter=13430/80000, loss=0.9528, lr=0.008476, batch_cost=1.3800, reader_cost=0.0001 | ETA 25:31:06 2021-02-22 23:21:00 [INFO] [TRAIN] epoch=37, iter=13440/80000, loss=0.9187, lr=0.008475, batch_cost=1.3551, reader_cost=0.0001 | ETA 25:03:13 2021-02-22 23:21:14 [INFO] [TRAIN] epoch=37, iter=13450/80000, loss=0.8692, lr=0.008473, batch_cost=1.3758, reader_cost=0.0001 | ETA 25:26:00 2021-02-22 23:21:28 [INFO] [TRAIN] epoch=37, iter=13460/80000, loss=0.8644, lr=0.008472, batch_cost=1.3547, reader_cost=0.0001 | ETA 25:02:20 2021-02-22 23:21:41 [INFO] [TRAIN] epoch=37, iter=13470/80000, loss=1.0612, lr=0.008471, batch_cost=1.3427, reader_cost=0.0001 | ETA 24:48:52 2021-02-22 23:21:55 [INFO] [TRAIN] epoch=37, iter=13480/80000, loss=0.9326, lr=0.008470, batch_cost=1.3783, reader_cost=0.0001 | ETA 25:28:07 2021-02-22 23:22:08 [INFO] [TRAIN] epoch=37, iter=13490/80000, loss=0.9453, lr=0.008469, batch_cost=1.3604, reader_cost=0.0001 | ETA 25:08:03 2021-02-22 23:22:22 [INFO] [TRAIN] epoch=37, iter=13500/80000, loss=0.9309, lr=0.008468, batch_cost=1.3572, reader_cost=0.0001 | ETA 25:04:12 2021-02-22 23:22:35 [INFO] [TRAIN] epoch=37, iter=13510/80000, loss=0.8745, lr=0.008467, batch_cost=1.3514, reader_cost=0.0001 | ETA 24:57:33 2021-02-22 23:22:49 [INFO] [TRAIN] epoch=37, iter=13520/80000, loss=0.9768, lr=0.008465, batch_cost=1.3574, reader_cost=0.0001 | ETA 25:03:57 2021-02-22 23:23:03 [INFO] [TRAIN] epoch=37, iter=13530/80000, loss=1.0528, lr=0.008464, batch_cost=1.3584, reader_cost=0.0001 | ETA 25:04:53 2021-02-22 23:23:16 [INFO] [TRAIN] epoch=37, iter=13540/80000, loss=1.0204, lr=0.008463, batch_cost=1.3364, reader_cost=0.0001 | ETA 24:40:19 2021-02-22 23:23:30 [INFO] [TRAIN] epoch=37, iter=13550/80000, loss=0.9561, lr=0.008462, batch_cost=1.3625, reader_cost=0.0001 | ETA 25:08:58 2021-02-22 23:23:43 [INFO] [TRAIN] epoch=37, iter=13560/80000, loss=0.9335, lr=0.008461, batch_cost=1.3481, reader_cost=0.0001 | ETA 24:52:50 2021-02-22 23:23:57 [INFO] [TRAIN] epoch=37, iter=13570/80000, loss=1.0136, lr=0.008460, batch_cost=1.3740, reader_cost=0.0001 | ETA 25:21:13 2021-02-22 23:24:10 [INFO] [TRAIN] epoch=37, iter=13580/80000, loss=0.9226, lr=0.008459, batch_cost=1.3412, reader_cost=0.0001 | ETA 24:44:41 2021-02-22 23:24:24 [INFO] [TRAIN] epoch=37, iter=13590/80000, loss=0.8228, lr=0.008457, batch_cost=1.3753, reader_cost=0.0001 | ETA 25:22:10 2021-02-22 23:24:38 [INFO] [TRAIN] epoch=37, iter=13600/80000, loss=0.8934, lr=0.008456, batch_cost=1.3884, reader_cost=0.0001 | ETA 25:36:32 2021-02-22 23:24:52 [INFO] [TRAIN] epoch=37, iter=13610/80000, loss=1.0274, lr=0.008455, batch_cost=1.3774, reader_cost=0.0001 | ETA 25:24:04 2021-02-22 23:25:05 [INFO] [TRAIN] epoch=37, iter=13620/80000, loss=0.8881, lr=0.008454, batch_cost=1.3416, reader_cost=0.0001 | ETA 24:44:12 2021-02-22 23:25:19 [INFO] [TRAIN] epoch=37, iter=13630/80000, loss=0.9190, lr=0.008453, batch_cost=1.3517, reader_cost=0.0001 | ETA 24:55:13 2021-02-22 23:25:33 [INFO] [TRAIN] epoch=37, iter=13640/80000, loss=0.9224, lr=0.008452, batch_cost=1.4019, reader_cost=0.0001 | ETA 25:50:31 2021-02-22 23:25:46 [INFO] [TRAIN] epoch=37, iter=13650/80000, loss=0.9446, lr=0.008450, batch_cost=1.3724, reader_cost=0.0001 | ETA 25:17:41 2021-02-22 23:26:00 [INFO] [TRAIN] epoch=37, iter=13660/80000, loss=0.9231, lr=0.008449, batch_cost=1.3580, reader_cost=0.0001 | ETA 25:01:26 2021-02-22 23:26:14 [INFO] [TRAIN] epoch=37, iter=13670/80000, loss=0.8905, lr=0.008448, batch_cost=1.3836, reader_cost=0.0001 | ETA 25:29:34 2021-02-22 23:26:27 [INFO] [TRAIN] epoch=37, iter=13680/80000, loss=0.8940, lr=0.008447, batch_cost=1.3667, reader_cost=0.0001 | ETA 25:10:41 2021-02-22 23:26:41 [INFO] [TRAIN] epoch=37, iter=13690/80000, loss=0.8820, lr=0.008446, batch_cost=1.3676, reader_cost=0.0001 | ETA 25:11:28 2021-02-22 23:26:55 [INFO] [TRAIN] epoch=37, iter=13700/80000, loss=0.9177, lr=0.008445, batch_cost=1.3509, reader_cost=0.0001 | ETA 24:52:45 2021-02-22 23:27:08 [INFO] [TRAIN] epoch=37, iter=13710/80000, loss=0.9020, lr=0.008444, batch_cost=1.3741, reader_cost=0.0001 | ETA 25:18:10 2021-02-22 23:27:22 [INFO] [TRAIN] epoch=37, iter=13720/80000, loss=0.9546, lr=0.008442, batch_cost=1.3823, reader_cost=0.0001 | ETA 25:26:58 2021-02-22 23:27:36 [INFO] [TRAIN] epoch=37, iter=13730/80000, loss=0.9015, lr=0.008441, batch_cost=1.3355, reader_cost=0.0001 | ETA 24:35:03 2021-02-22 23:27:49 [INFO] [TRAIN] epoch=37, iter=13740/80000, loss=0.9354, lr=0.008440, batch_cost=1.3569, reader_cost=0.0001 | ETA 24:58:25 2021-02-22 23:28:03 [INFO] [TRAIN] epoch=37, iter=13750/80000, loss=0.8783, lr=0.008439, batch_cost=1.3574, reader_cost=0.0001 | ETA 24:58:48 2021-02-22 23:28:16 [INFO] [TRAIN] epoch=37, iter=13760/80000, loss=1.0752, lr=0.008438, batch_cost=1.3620, reader_cost=0.0001 | ETA 25:03:40 2021-02-22 23:28:31 [INFO] [TRAIN] epoch=38, iter=13770/80000, loss=0.9291, lr=0.008437, batch_cost=1.4467, reader_cost=0.0897 | ETA 26:36:54 2021-02-22 23:28:44 [INFO] [TRAIN] epoch=38, iter=13780/80000, loss=0.9006, lr=0.008436, batch_cost=1.3668, reader_cost=0.0001 | ETA 25:08:30 2021-02-22 23:28:58 [INFO] [TRAIN] epoch=38, iter=13790/80000, loss=0.9756, lr=0.008434, batch_cost=1.3905, reader_cost=0.0001 | ETA 25:34:24 2021-02-22 23:29:12 [INFO] [TRAIN] epoch=38, iter=13800/80000, loss=0.8247, lr=0.008433, batch_cost=1.3596, reader_cost=0.0001 | ETA 25:00:04 2021-02-22 23:29:26 [INFO] [TRAIN] epoch=38, iter=13810/80000, loss=0.9750, lr=0.008432, batch_cost=1.3767, reader_cost=0.0001 | ETA 25:18:45 2021-02-22 23:29:39 [INFO] [TRAIN] epoch=38, iter=13820/80000, loss=1.0277, lr=0.008431, batch_cost=1.3726, reader_cost=0.0001 | ETA 25:13:55 2021-02-22 23:29:53 [INFO] [TRAIN] epoch=38, iter=13830/80000, loss=0.9378, lr=0.008430, batch_cost=1.3530, reader_cost=0.0001 | ETA 24:52:08 2021-02-22 23:30:07 [INFO] [TRAIN] epoch=38, iter=13840/80000, loss=0.8661, lr=0.008429, batch_cost=1.3877, reader_cost=0.0001 | ETA 25:30:07 2021-02-22 23:30:20 [INFO] [TRAIN] epoch=38, iter=13850/80000, loss=0.8627, lr=0.008428, batch_cost=1.3609, reader_cost=0.0001 | ETA 25:00:20 2021-02-22 23:30:34 [INFO] [TRAIN] epoch=38, iter=13860/80000, loss=0.9332, lr=0.008426, batch_cost=1.3523, reader_cost=0.0001 | ETA 24:50:43 2021-02-22 23:30:48 [INFO] [TRAIN] epoch=38, iter=13870/80000, loss=0.9173, lr=0.008425, batch_cost=1.3549, reader_cost=0.0001 | ETA 24:53:21 2021-02-22 23:31:01 [INFO] [TRAIN] epoch=38, iter=13880/80000, loss=0.8962, lr=0.008424, batch_cost=1.3700, reader_cost=0.0001 | ETA 25:09:43 2021-02-22 23:31:15 [INFO] [TRAIN] epoch=38, iter=13890/80000, loss=0.9974, lr=0.008423, batch_cost=1.3759, reader_cost=0.0001 | ETA 25:16:03 2021-02-22 23:31:28 [INFO] [TRAIN] epoch=38, iter=13900/80000, loss=1.0306, lr=0.008422, batch_cost=1.3337, reader_cost=0.0001 | ETA 24:29:18 2021-02-22 23:31:42 [INFO] [TRAIN] epoch=38, iter=13910/80000, loss=0.9228, lr=0.008421, batch_cost=1.3690, reader_cost=0.0001 | ETA 25:07:56 2021-02-22 23:31:56 [INFO] [TRAIN] epoch=38, iter=13920/80000, loss=0.9166, lr=0.008420, batch_cost=1.3784, reader_cost=0.0001 | ETA 25:18:03 2021-02-22 23:32:09 [INFO] [TRAIN] epoch=38, iter=13930/80000, loss=0.9483, lr=0.008418, batch_cost=1.3355, reader_cost=0.0001 | ETA 24:30:38 2021-02-22 23:32:23 [INFO] [TRAIN] epoch=38, iter=13940/80000, loss=0.9553, lr=0.008417, batch_cost=1.3601, reader_cost=0.0001 | ETA 24:57:28 2021-02-22 23:32:36 [INFO] [TRAIN] epoch=38, iter=13950/80000, loss=0.9006, lr=0.008416, batch_cost=1.3468, reader_cost=0.0001 | ETA 24:42:38 2021-02-22 23:32:50 [INFO] [TRAIN] epoch=38, iter=13960/80000, loss=1.0435, lr=0.008415, batch_cost=1.3569, reader_cost=0.0001 | ETA 24:53:27 2021-02-22 23:33:03 [INFO] [TRAIN] epoch=38, iter=13970/80000, loss=0.9227, lr=0.008414, batch_cost=1.3525, reader_cost=0.0001 | ETA 24:48:28 2021-02-22 23:33:17 [INFO] [TRAIN] epoch=38, iter=13980/80000, loss=0.9765, lr=0.008413, batch_cost=1.3512, reader_cost=0.0001 | ETA 24:46:49 2021-02-22 23:33:31 [INFO] [TRAIN] epoch=38, iter=13990/80000, loss=0.9831, lr=0.008412, batch_cost=1.3896, reader_cost=0.0001 | ETA 25:28:49 2021-02-22 23:33:44 [INFO] [TRAIN] epoch=38, iter=14000/80000, loss=0.9442, lr=0.008410, batch_cost=1.3429, reader_cost=0.0001 | ETA 24:37:11 2021-02-22 23:33:44 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:19 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:05 - batch_cost: 0.2103 - reader cost: 0.0855  3/125 [..............................] - ETA: 1:01 - batch_cost: 0.2865 - reader cost: 0.1175 4/125 [..............................] - ETA: 58s - batch_cost: 0.3262 - reader cost: 0.1366  5/125 [>.............................] - ETA: 57s - batch_cost: 0.3480 - reader cost: 0.1461 6/125 [>.............................] - ETA: 56s - batch_cost: 0.3642 - reader cost: 0.1526 7/125 [>.............................] - ETA: 54s - batch_cost: 0.3733 - reader cost: 0.1564 8/125 [>.............................] - ETA: 54s - batch_cost: 0.3817 - reader cost: 0.1599 9/125 [=>............................] - ETA: 52s - batch_cost: 0.3842 - reader cost: 0.1591 10/125 [=>............................] - ETA: 51s - batch_cost: 0.3878 - reader cost: 0.1600 11/125 [=>............................] - ETA: 51s - batch_cost: 0.3924 - reader cost: 0.1620 12/125 [=>............................] - ETA: 50s - batch_cost: 0.3945 - reader cost: 0.1623 13/125 [==>...........................] - ETA: 50s - batch_cost: 0.3973 - reader cost: 0.1631 14/125 [==>...........................] - ETA: 49s - batch_cost: 0.3999 - reader cost: 0.1646 15/125 [==>...........................] - ETA: 49s - batch_cost: 0.4027 - reader cost: 0.1656 16/125 [==>...........................] - ETA: 48s - batch_cost: 0.4041 - reader cost: 0.1659 17/125 [===>..........................] - ETA: 48s - batch_cost: 0.4070 - reader cost: 0.1678 18/125 [===>..........................] - ETA: 47s - batch_cost: 0.4089 - reader cost: 0.1684 19/125 [===>..........................] - ETA: 47s - batch_cost: 0.4103 - reader cost: 0.1687 20/125 [===>..........................] - ETA: 46s - batch_cost: 0.4112 - reader cost: 0.1687 21/125 [====>.........................] - ETA: 45s - batch_cost: 0.4096 - reader cost: 0.1666 22/125 [====>.........................] - ETA: 45s - batch_cost: 0.4114 - reader cost: 0.1673 23/125 [====>.........................] - ETA: 44s - batch_cost: 0.4114 - reader cost: 0.1671 24/125 [====>.........................] - ETA: 44s - batch_cost: 0.4116 - reader cost: 0.1669 25/125 [=====>........................] - ETA: 43s - batch_cost: 0.4101 - reader cost: 0.1653 26/125 [=====>........................] - ETA: 43s - batch_cost: 0.4111 - reader cost: 0.1657 27/125 [=====>........................] - ETA: 42s - batch_cost: 0.4119 - reader cost: 0.1662 28/125 [=====>........................] - ETA: 42s - batch_cost: 0.4138 - reader cost: 0.1674 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4134 - reader cost: 0.1669 30/125 [======>.......................] - ETA: 41s - batch_cost: 0.4135 - reader cost: 0.1668 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4121 - reader cost: 0.1652 32/125 [======>.......................] - ETA: 40s - batch_cost: 0.4126 - reader cost: 0.1654 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4111 - reader cost: 0.1638 34/125 [=======>......................] - ETA: 39s - batch_cost: 0.4105 - reader cost: 0.1631 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4109 - reader cost: 0.1633 36/125 [=======>......................] - ETA: 38s - batch_cost: 0.4118 - reader cost: 0.1641 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4125 - reader cost: 0.1645 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4123 - reader cost: 0.1642 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4112 - reader cost: 0.1630 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4117 - reader cost: 0.1635 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4124 - reader cost: 0.1638 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4126 - reader cost: 0.1640 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4116 - reader cost: 0.1627 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4122 - reader cost: 0.1631 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4123 - reader cost: 0.1632 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4128 - reader cost: 0.1637 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4121 - reader cost: 0.1628 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4127 - reader cost: 0.1632 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4120 - reader cost: 0.1624 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4130 - reader cost: 0.1632 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4132 - reader cost: 0.1634 52/125 [===========>..................] - ETA: 31s - batch_cost: 0.4134 - reader cost: 0.1636 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4135 - reader cost: 0.1636 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4138 - reader cost: 0.1640 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4142 - reader cost: 0.1642 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4144 - reader cost: 0.1643 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4148 - reader cost: 0.1646 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4155 - reader cost: 0.1653 59/125 [=============>................] - ETA: 28s - batch_cost: 0.4157 - reader cost: 0.1655 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4151 - reader cost: 0.1648 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4153 - reader cost: 0.1649 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4157 - reader cost: 0.1653 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4152 - reader cost: 0.1647 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4144 - reader cost: 0.1638 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4148 - reader cost: 0.1641 66/125 [==============>...............] - ETA: 25s - batch_cost: 0.4150 - reader cost: 0.1643 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4149 - reader cost: 0.1641 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4154 - reader cost: 0.1644 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4145 - reader cost: 0.1635 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4140 - reader cost: 0.1631 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4142 - reader cost: 0.1633 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4137 - reader cost: 0.1626 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4140 - reader cost: 0.1627 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4144 - reader cost: 0.1630 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4144 - reader cost: 0.1631 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4141 - reader cost: 0.1628 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4142 - reader cost: 0.1629 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4140 - reader cost: 0.1626 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4139 - reader cost: 0.1626 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4141 - reader cost: 0.1629 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4136 - reader cost: 0.1623 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4138 - reader cost: 0.1625 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4133 - reader cost: 0.1620 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4136 - reader cost: 0.1617 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4132 - reader cost: 0.1607 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4134 - reader cost: 0.1609 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4136 - reader cost: 0.1610 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4136 - reader cost: 0.1611 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4138 - reader cost: 0.1613 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4140 - reader cost: 0.1615 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4142 - reader cost: 0.1617 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4146 - reader cost: 0.1622 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4143 - reader cost: 0.1619 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4144 - reader cost: 0.1620 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4145 - reader cost: 0.1621 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4147 - reader cost: 0.1624 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4141 - reader cost: 0.1618 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4141 - reader cost: 0.1618 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4137 - reader cost: 0.1614 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4138 - reader cost: 0.1611 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4133 - reader cost: 0.1605 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4137 - reader cost: 0.1609  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4135 - reader cost: 0.1607 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4133 - reader cost: 0.1605 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4135 - reader cost: 0.1607 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4136 - reader cost: 0.1608 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4137 - reader cost: 0.1610 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4139 - reader cost: 0.1612 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4138 - reader cost: 0.1610 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4141 - reader cost: 0.1611 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4144 - reader cost: 0.1615 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4146 - reader cost: 0.1613 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4147 - reader cost: 0.1613 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4149 - reader cost: 0.1615 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4149 - reader cost: 0.1613 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4148 - reader cost: 0.1612 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4149 - reader cost: 0.1614 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4147 - reader cost: 0.1611 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4148 - reader cost: 0.1613 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4145 - reader cost: 0.1610 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4144 - reader cost: 0.1609 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4145 - reader cost: 0.1611 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4147 - reader cost: 0.1613 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4148 - reader cost: 0.1614 125/125 [==============================] - 52s 420ms/step - batch_cost: 0.4148 - reader cost: 0.1610 2021-02-22 23:34:37 [INFO] [EVAL] #Images=500 mIoU=0.6718 Acc=0.9437 Kappa=0.9268 2021-02-22 23:34:37 [INFO] [EVAL] Class IoU: [0.9678 0.7859 0.897 0.2729 0.4201 0.6124 0.6771 0.7781 0.9064 0.5512 0.9383 0.7876 0.479 0.9165 0.6382 0.6632 0.6499 0.2288 0.5931] 2021-02-22 23:34:37 [INFO] [EVAL] Class Acc: [0.9811 0.8902 0.9244 0.8227 0.6888 0.8074 0.8481 0.8963 0.9589 0.6789 0.9585 0.879 0.8464 0.9464 0.95 0.8236 0.9638 0.2458 0.8533] 2021-02-22 23:34:41 [INFO] [EVAL] The model with the best validation mIoU (0.7322) was saved at iter 11000. 2021-02-22 23:34:54 [INFO] [TRAIN] epoch=38, iter=14010/80000, loss=0.9651, lr=0.008409, batch_cost=1.3341, reader_cost=0.0001 | ETA 24:27:17 2021-02-22 23:35:08 [INFO] [TRAIN] epoch=38, iter=14020/80000, loss=0.8875, lr=0.008408, batch_cost=1.3866, reader_cost=0.0001 | ETA 25:24:50 2021-02-22 23:35:22 [INFO] [TRAIN] epoch=38, iter=14030/80000, loss=0.9719, lr=0.008407, batch_cost=1.3675, reader_cost=0.0001 | ETA 25:03:37 2021-02-22 23:35:35 [INFO] [TRAIN] epoch=38, iter=14040/80000, loss=0.8214, lr=0.008406, batch_cost=1.3564, reader_cost=0.0001 | ETA 24:51:06 2021-02-22 23:35:49 [INFO] [TRAIN] epoch=38, iter=14050/80000, loss=0.9621, lr=0.008405, batch_cost=1.3559, reader_cost=0.0001 | ETA 24:50:24 2021-02-22 23:36:03 [INFO] [TRAIN] epoch=38, iter=14060/80000, loss=0.8916, lr=0.008403, batch_cost=1.3837, reader_cost=0.0001 | ETA 25:20:44 2021-02-22 23:36:16 [INFO] [TRAIN] epoch=38, iter=14070/80000, loss=0.9244, lr=0.008402, batch_cost=1.3529, reader_cost=0.0001 | ETA 24:46:37 2021-02-22 23:36:30 [INFO] [TRAIN] epoch=38, iter=14080/80000, loss=1.1276, lr=0.008401, batch_cost=1.3841, reader_cost=0.0001 | ETA 25:20:39 2021-02-22 23:36:43 [INFO] [TRAIN] epoch=38, iter=14090/80000, loss=0.8808, lr=0.008400, batch_cost=1.3489, reader_cost=0.0001 | ETA 24:41:47 2021-02-22 23:36:57 [INFO] [TRAIN] epoch=38, iter=14100/80000, loss=0.9663, lr=0.008399, batch_cost=1.3504, reader_cost=0.0001 | ETA 24:43:11 2021-02-22 23:37:10 [INFO] [TRAIN] epoch=38, iter=14110/80000, loss=0.9241, lr=0.008398, batch_cost=1.3527, reader_cost=0.0001 | ETA 24:45:30 2021-02-22 23:37:24 [INFO] [TRAIN] epoch=38, iter=14120/80000, loss=0.9765, lr=0.008397, batch_cost=1.3652, reader_cost=0.0001 | ETA 24:59:02 2021-02-22 23:37:38 [INFO] [TRAIN] epoch=38, iter=14130/80000, loss=1.0394, lr=0.008395, batch_cost=1.3550, reader_cost=0.0001 | ETA 24:47:36 2021-02-22 23:37:52 [INFO] [TRAIN] epoch=39, iter=14140/80000, loss=0.9721, lr=0.008394, batch_cost=1.4236, reader_cost=0.0714 | ETA 26:02:35 2021-02-22 23:38:05 [INFO] [TRAIN] epoch=39, iter=14150/80000, loss=0.9126, lr=0.008393, batch_cost=1.3552, reader_cost=0.0002 | ETA 24:47:19 2021-02-22 23:38:19 [INFO] [TRAIN] epoch=39, iter=14160/80000, loss=0.9277, lr=0.008392, batch_cost=1.3787, reader_cost=0.0001 | ETA 25:12:55 2021-02-22 23:38:33 [INFO] [TRAIN] epoch=39, iter=14170/80000, loss=0.9316, lr=0.008391, batch_cost=1.3767, reader_cost=0.0001 | ETA 25:10:31 2021-02-22 23:38:47 [INFO] [TRAIN] epoch=39, iter=14180/80000, loss=0.8727, lr=0.008390, batch_cost=1.3772, reader_cost=0.0001 | ETA 25:10:49 2021-02-22 23:39:00 [INFO] [TRAIN] epoch=39, iter=14190/80000, loss=0.9626, lr=0.008389, batch_cost=1.3689, reader_cost=0.0001 | ETA 25:01:25 2021-02-22 23:39:14 [INFO] [TRAIN] epoch=39, iter=14200/80000, loss=0.9344, lr=0.008387, batch_cost=1.3683, reader_cost=0.0001 | ETA 25:00:32 2021-02-22 23:39:28 [INFO] [TRAIN] epoch=39, iter=14210/80000, loss=0.9216, lr=0.008386, batch_cost=1.3547, reader_cost=0.0001 | ETA 24:45:27 2021-02-22 23:39:41 [INFO] [TRAIN] epoch=39, iter=14220/80000, loss=1.0538, lr=0.008385, batch_cost=1.3447, reader_cost=0.0001 | ETA 24:34:13 2021-02-22 23:39:55 [INFO] [TRAIN] epoch=39, iter=14230/80000, loss=0.9834, lr=0.008384, batch_cost=1.3998, reader_cost=0.0001 | ETA 25:34:22 2021-02-22 23:40:09 [INFO] [TRAIN] epoch=39, iter=14240/80000, loss=0.9370, lr=0.008383, batch_cost=1.3361, reader_cost=0.0001 | ETA 24:24:21 2021-02-22 23:40:22 [INFO] [TRAIN] epoch=39, iter=14250/80000, loss=0.9167, lr=0.008382, batch_cost=1.3262, reader_cost=0.0001 | ETA 24:13:17 2021-02-22 23:40:36 [INFO] [TRAIN] epoch=39, iter=14260/80000, loss=0.9037, lr=0.008381, batch_cost=1.3747, reader_cost=0.0001 | ETA 25:06:13 2021-02-22 23:40:49 [INFO] [TRAIN] epoch=39, iter=14270/80000, loss=0.9644, lr=0.008379, batch_cost=1.3380, reader_cost=0.0001 | ETA 24:25:45 2021-02-22 23:41:02 [INFO] [TRAIN] epoch=39, iter=14280/80000, loss=0.8838, lr=0.008378, batch_cost=1.3499, reader_cost=0.0001 | ETA 24:38:33 2021-02-22 23:41:16 [INFO] [TRAIN] epoch=39, iter=14290/80000, loss=0.9490, lr=0.008377, batch_cost=1.3843, reader_cost=0.0001 | ETA 25:15:59 2021-02-22 23:41:30 [INFO] [TRAIN] epoch=39, iter=14300/80000, loss=0.9526, lr=0.008376, batch_cost=1.3454, reader_cost=0.0001 | ETA 24:33:11 2021-02-22 23:41:43 [INFO] [TRAIN] epoch=39, iter=14310/80000, loss=0.9424, lr=0.008375, batch_cost=1.3733, reader_cost=0.0001 | ETA 25:03:32 2021-02-22 23:41:57 [INFO] [TRAIN] epoch=39, iter=14320/80000, loss=0.9986, lr=0.008374, batch_cost=1.3455, reader_cost=0.0001 | ETA 24:32:55 2021-02-22 23:42:10 [INFO] [TRAIN] epoch=39, iter=14330/80000, loss=0.8949, lr=0.008373, batch_cost=1.3410, reader_cost=0.0001 | ETA 24:27:43 2021-02-22 23:42:24 [INFO] [TRAIN] epoch=39, iter=14340/80000, loss=0.9033, lr=0.008371, batch_cost=1.3486, reader_cost=0.0001 | ETA 24:35:46 2021-02-22 23:42:37 [INFO] [TRAIN] epoch=39, iter=14350/80000, loss=0.8222, lr=0.008370, batch_cost=1.3590, reader_cost=0.0001 | ETA 24:46:55 2021-02-22 23:42:51 [INFO] [TRAIN] epoch=39, iter=14360/80000, loss=0.9785, lr=0.008369, batch_cost=1.3454, reader_cost=0.0001 | ETA 24:31:52 2021-02-22 23:43:04 [INFO] [TRAIN] epoch=39, iter=14370/80000, loss=0.9178, lr=0.008368, batch_cost=1.3399, reader_cost=0.0001 | ETA 24:25:36 2021-02-22 23:43:18 [INFO] [TRAIN] epoch=39, iter=14380/80000, loss=0.9423, lr=0.008367, batch_cost=1.3701, reader_cost=0.0001 | ETA 24:58:27 2021-02-22 23:43:31 [INFO] [TRAIN] epoch=39, iter=14390/80000, loss=0.9705, lr=0.008366, batch_cost=1.3466, reader_cost=0.0001 | ETA 24:32:28 2021-02-22 23:43:45 [INFO] [TRAIN] epoch=39, iter=14400/80000, loss=0.9085, lr=0.008364, batch_cost=1.3613, reader_cost=0.0001 | ETA 24:48:24 2021-02-22 23:43:59 [INFO] [TRAIN] epoch=39, iter=14410/80000, loss=0.9264, lr=0.008363, batch_cost=1.3527, reader_cost=0.0001 | ETA 24:38:42 2021-02-22 23:44:12 [INFO] [TRAIN] epoch=39, iter=14420/80000, loss=0.9180, lr=0.008362, batch_cost=1.3795, reader_cost=0.0001 | ETA 25:07:44 2021-02-22 23:44:26 [INFO] [TRAIN] epoch=39, iter=14430/80000, loss=1.0085, lr=0.008361, batch_cost=1.3798, reader_cost=0.0001 | ETA 25:07:52 2021-02-22 23:44:40 [INFO] [TRAIN] epoch=39, iter=14440/80000, loss=0.9047, lr=0.008360, batch_cost=1.3742, reader_cost=0.0001 | ETA 25:01:35 2021-02-22 23:44:53 [INFO] [TRAIN] epoch=39, iter=14450/80000, loss=1.0412, lr=0.008359, batch_cost=1.3576, reader_cost=0.0001 | ETA 24:43:11 2021-02-22 23:45:07 [INFO] [TRAIN] epoch=39, iter=14460/80000, loss=0.8492, lr=0.008358, batch_cost=1.3738, reader_cost=0.0001 | ETA 25:00:38 2021-02-22 23:45:21 [INFO] [TRAIN] epoch=39, iter=14470/80000, loss=0.9470, lr=0.008356, batch_cost=1.3723, reader_cost=0.0001 | ETA 24:58:48 2021-02-22 23:45:34 [INFO] [TRAIN] epoch=39, iter=14480/80000, loss=0.8845, lr=0.008355, batch_cost=1.3457, reader_cost=0.0001 | ETA 24:29:27 2021-02-22 23:45:48 [INFO] [TRAIN] epoch=39, iter=14490/80000, loss=0.8859, lr=0.008354, batch_cost=1.3499, reader_cost=0.0001 | ETA 24:33:48 2021-02-22 23:46:01 [INFO] [TRAIN] epoch=39, iter=14500/80000, loss=1.0385, lr=0.008353, batch_cost=1.3481, reader_cost=0.0001 | ETA 24:31:41 2021-02-22 23:46:16 [INFO] [TRAIN] epoch=40, iter=14510/80000, loss=0.9416, lr=0.008352, batch_cost=1.4210, reader_cost=0.0752 | ETA 25:51:03 2021-02-22 23:46:29 [INFO] [TRAIN] epoch=40, iter=14520/80000, loss=0.8396, lr=0.008351, batch_cost=1.3885, reader_cost=0.0001 | ETA 25:15:16 2021-02-22 23:46:43 [INFO] [TRAIN] epoch=40, iter=14530/80000, loss=1.0527, lr=0.008350, batch_cost=1.3584, reader_cost=0.0001 | ETA 24:42:14 2021-02-22 23:46:57 [INFO] [TRAIN] epoch=40, iter=14540/80000, loss=0.9855, lr=0.008348, batch_cost=1.3566, reader_cost=0.0001 | ETA 24:40:05 2021-02-22 23:47:10 [INFO] [TRAIN] epoch=40, iter=14550/80000, loss=0.8261, lr=0.008347, batch_cost=1.3592, reader_cost=0.0001 | ETA 24:42:42 2021-02-22 23:47:23 [INFO] [TRAIN] epoch=40, iter=14560/80000, loss=0.8391, lr=0.008346, batch_cost=1.3168, reader_cost=0.0001 | ETA 23:56:11 2021-02-22 23:47:37 [INFO] [TRAIN] epoch=40, iter=14570/80000, loss=1.0189, lr=0.008345, batch_cost=1.3510, reader_cost=0.0001 | ETA 24:33:14 2021-02-22 23:47:51 [INFO] [TRAIN] epoch=40, iter=14580/80000, loss=1.0151, lr=0.008344, batch_cost=1.3694, reader_cost=0.0001 | ETA 24:53:07 2021-02-22 23:48:04 [INFO] [TRAIN] epoch=40, iter=14590/80000, loss=0.9314, lr=0.008343, batch_cost=1.3679, reader_cost=0.0001 | ETA 24:51:12 2021-02-22 23:48:18 [INFO] [TRAIN] epoch=40, iter=14600/80000, loss=1.0283, lr=0.008342, batch_cost=1.3792, reader_cost=0.0001 | ETA 25:03:19 2021-02-22 23:48:32 [INFO] [TRAIN] epoch=40, iter=14610/80000, loss=0.8634, lr=0.008340, batch_cost=1.3576, reader_cost=0.0001 | ETA 24:39:35 2021-02-22 23:48:46 [INFO] [TRAIN] epoch=40, iter=14620/80000, loss=0.9273, lr=0.008339, batch_cost=1.3899, reader_cost=0.0001 | ETA 25:14:34 2021-02-22 23:48:59 [INFO] [TRAIN] epoch=40, iter=14630/80000, loss=0.9360, lr=0.008338, batch_cost=1.3631, reader_cost=0.0001 | ETA 24:45:03 2021-02-22 23:49:13 [INFO] [TRAIN] epoch=40, iter=14640/80000, loss=0.8962, lr=0.008337, batch_cost=1.3378, reader_cost=0.0001 | ETA 24:17:18 2021-02-22 23:49:26 [INFO] [TRAIN] epoch=40, iter=14650/80000, loss=0.9941, lr=0.008336, batch_cost=1.3775, reader_cost=0.0001 | ETA 25:00:18 2021-02-22 23:49:40 [INFO] [TRAIN] epoch=40, iter=14660/80000, loss=0.9120, lr=0.008335, batch_cost=1.3891, reader_cost=0.0001 | ETA 25:12:42 2021-02-22 23:49:54 [INFO] [TRAIN] epoch=40, iter=14670/80000, loss=0.9676, lr=0.008333, batch_cost=1.3621, reader_cost=0.0001 | ETA 24:43:06 2021-02-22 23:50:08 [INFO] [TRAIN] epoch=40, iter=14680/80000, loss=0.9333, lr=0.008332, batch_cost=1.3819, reader_cost=0.0001 | ETA 25:04:28 2021-02-22 23:50:21 [INFO] [TRAIN] epoch=40, iter=14690/80000, loss=0.8830, lr=0.008331, batch_cost=1.3509, reader_cost=0.0001 | ETA 24:30:27 2021-02-22 23:50:35 [INFO] [TRAIN] epoch=40, iter=14700/80000, loss=1.0041, lr=0.008330, batch_cost=1.3831, reader_cost=0.0001 | ETA 25:05:16 2021-02-22 23:50:49 [INFO] [TRAIN] epoch=40, iter=14710/80000, loss=1.0267, lr=0.008329, batch_cost=1.3577, reader_cost=0.0001 | ETA 24:37:24 2021-02-22 23:51:02 [INFO] [TRAIN] epoch=40, iter=14720/80000, loss=0.9268, lr=0.008328, batch_cost=1.3882, reader_cost=0.0001 | ETA 25:10:19 2021-02-22 23:51:16 [INFO] [TRAIN] epoch=40, iter=14730/80000, loss=0.9429, lr=0.008327, batch_cost=1.3518, reader_cost=0.0001 | ETA 24:30:28 2021-02-22 23:51:30 [INFO] [TRAIN] epoch=40, iter=14740/80000, loss=0.8968, lr=0.008325, batch_cost=1.3670, reader_cost=0.0001 | ETA 24:46:52 2021-02-22 23:51:43 [INFO] [TRAIN] epoch=40, iter=14750/80000, loss=0.9676, lr=0.008324, batch_cost=1.3357, reader_cost=0.0001 | ETA 24:12:36 2021-02-22 23:51:56 [INFO] [TRAIN] epoch=40, iter=14760/80000, loss=0.9111, lr=0.008323, batch_cost=1.3428, reader_cost=0.0001 | ETA 24:20:05 2021-02-22 23:52:10 [INFO] [TRAIN] epoch=40, iter=14770/80000, loss=0.8742, lr=0.008322, batch_cost=1.3645, reader_cost=0.0001 | ETA 24:43:24 2021-02-22 23:52:24 [INFO] [TRAIN] epoch=40, iter=14780/80000, loss=0.9686, lr=0.008321, batch_cost=1.3631, reader_cost=0.0001 | ETA 24:41:43 2021-02-22 23:52:37 [INFO] [TRAIN] epoch=40, iter=14790/80000, loss=0.9288, lr=0.008320, batch_cost=1.3734, reader_cost=0.0001 | ETA 24:52:37 2021-02-22 23:52:51 [INFO] [TRAIN] epoch=40, iter=14800/80000, loss=0.9259, lr=0.008319, batch_cost=1.3536, reader_cost=0.0001 | ETA 24:30:56 2021-02-22 23:53:05 [INFO] [TRAIN] epoch=40, iter=14810/80000, loss=0.8851, lr=0.008317, batch_cost=1.3757, reader_cost=0.0001 | ETA 24:54:42 2021-02-22 23:53:18 [INFO] [TRAIN] epoch=40, iter=14820/80000, loss=0.9620, lr=0.008316, batch_cost=1.3704, reader_cost=0.0001 | ETA 24:48:43 2021-02-22 23:53:32 [INFO] [TRAIN] epoch=40, iter=14830/80000, loss=0.8937, lr=0.008315, batch_cost=1.3564, reader_cost=0.0001 | ETA 24:33:16 2021-02-22 23:53:46 [INFO] [TRAIN] epoch=40, iter=14840/80000, loss=0.9210, lr=0.008314, batch_cost=1.3766, reader_cost=0.0001 | ETA 24:54:57 2021-02-22 23:53:59 [INFO] [TRAIN] epoch=40, iter=14850/80000, loss=0.8759, lr=0.008313, batch_cost=1.3592, reader_cost=0.0001 | ETA 24:35:52 2021-02-22 23:54:13 [INFO] [TRAIN] epoch=40, iter=14860/80000, loss=0.9667, lr=0.008312, batch_cost=1.3584, reader_cost=0.0001 | ETA 24:34:45 2021-02-22 23:54:27 [INFO] [TRAIN] epoch=40, iter=14870/80000, loss=0.9209, lr=0.008311, batch_cost=1.3631, reader_cost=0.0001 | ETA 24:39:39 2021-02-22 23:54:40 [INFO] [TRAIN] epoch=40, iter=14880/80000, loss=0.9386, lr=0.008309, batch_cost=1.3254, reader_cost=0.0001 | ETA 23:58:31 2021-02-22 23:54:55 [INFO] [TRAIN] epoch=41, iter=14890/80000, loss=0.8854, lr=0.008308, batch_cost=1.4789, reader_cost=0.0626 | ETA 26:44:51 2021-02-22 23:55:08 [INFO] [TRAIN] epoch=41, iter=14900/80000, loss=0.9698, lr=0.008307, batch_cost=1.3794, reader_cost=0.0001 | ETA 24:56:38 2021-02-22 23:55:22 [INFO] [TRAIN] epoch=41, iter=14910/80000, loss=0.9033, lr=0.008306, batch_cost=1.3713, reader_cost=0.0001 | ETA 24:47:39 2021-02-22 23:55:36 [INFO] [TRAIN] epoch=41, iter=14920/80000, loss=0.9305, lr=0.008305, batch_cost=1.3867, reader_cost=0.0001 | ETA 25:04:05 2021-02-22 23:55:49 [INFO] [TRAIN] epoch=41, iter=14930/80000, loss=0.8761, lr=0.008304, batch_cost=1.3466, reader_cost=0.0001 | ETA 24:20:21 2021-02-22 23:56:03 [INFO] [TRAIN] epoch=41, iter=14940/80000, loss=1.0127, lr=0.008302, batch_cost=1.3459, reader_cost=0.0001 | ETA 24:19:23 2021-02-22 23:56:17 [INFO] [TRAIN] epoch=41, iter=14950/80000, loss=0.9346, lr=0.008301, batch_cost=1.3610, reader_cost=0.0001 | ETA 24:35:30 2021-02-22 23:56:30 [INFO] [TRAIN] epoch=41, iter=14960/80000, loss=0.9508, lr=0.008300, batch_cost=1.3769, reader_cost=0.0001 | ETA 24:52:36 2021-02-22 23:56:44 [INFO] [TRAIN] epoch=41, iter=14970/80000, loss=0.9040, lr=0.008299, batch_cost=1.3650, reader_cost=0.0001 | ETA 24:39:25 2021-02-22 23:56:57 [INFO] [TRAIN] epoch=41, iter=14980/80000, loss=1.0948, lr=0.008298, batch_cost=1.3512, reader_cost=0.0001 | ETA 24:24:14 2021-02-22 23:57:11 [INFO] [TRAIN] epoch=41, iter=14990/80000, loss=0.8556, lr=0.008297, batch_cost=1.3647, reader_cost=0.0001 | ETA 24:38:39 2021-02-22 23:57:25 [INFO] [TRAIN] epoch=41, iter=15000/80000, loss=0.9149, lr=0.008296, batch_cost=1.3758, reader_cost=0.0001 | ETA 24:50:28 2021-02-22 23:57:25 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:10 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:03 - batch_cost: 0.2310 - reader cost: 0.1059  3/125 [..............................] - ETA: 59s - batch_cost: 0.2994 - reader cost: 0.1296  4/125 [..............................] - ETA: 57s - batch_cost: 0.3343 - reader cost: 0.1438 5/125 [>.............................] - ETA: 56s - batch_cost: 0.3536 - reader cost: 0.1496 6/125 [>.............................] - ETA: 53s - batch_cost: 0.3566 - reader cost: 0.1446 7/125 [>.............................] - ETA: 53s - batch_cost: 0.3692 - reader cost: 0.1501 8/125 [>.............................] - ETA: 52s - batch_cost: 0.3757 - reader cost: 0.1526 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3812 - reader cost: 0.1543 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3857 - reader cost: 0.1564 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3904 - reader cost: 0.1587 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3937 - reader cost: 0.1602 13/125 [==>...........................] - ETA: 49s - batch_cost: 0.3955 - reader cost: 0.1608 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3975 - reader cost: 0.1616 15/125 [==>...........................] - ETA: 48s - batch_cost: 0.3997 - reader cost: 0.1628 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.4026 - reader cost: 0.1635 17/125 [===>..........................] - ETA: 47s - batch_cost: 0.4054 - reader cost: 0.1656 18/125 [===>..........................] - ETA: 47s - batch_cost: 0.4079 - reader cost: 0.1673 19/125 [===>..........................] - ETA: 46s - batch_cost: 0.4090 - reader cost: 0.1676 20/125 [===>..........................] - ETA: 46s - batch_cost: 0.4101 - reader cost: 0.1683 21/125 [====>.........................] - ETA: 45s - batch_cost: 0.4112 - reader cost: 0.1688 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4102 - reader cost: 0.1673 23/125 [====>.........................] - ETA: 44s - batch_cost: 0.4108 - reader cost: 0.1673 24/125 [====>.........................] - ETA: 44s - batch_cost: 0.4122 - reader cost: 0.1685 25/125 [=====>........................] - ETA: 43s - batch_cost: 0.4139 - reader cost: 0.1692 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4124 - reader cost: 0.1668 27/125 [=====>........................] - ETA: 42s - batch_cost: 0.4127 - reader cost: 0.1668 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4112 - reader cost: 0.1652 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4112 - reader cost: 0.1649 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4123 - reader cost: 0.1658 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4114 - reader cost: 0.1645 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4099 - reader cost: 0.1629 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4084 - reader cost: 0.1613 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4093 - reader cost: 0.1620 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4099 - reader cost: 0.1624 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4104 - reader cost: 0.1628 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4099 - reader cost: 0.1621 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4104 - reader cost: 0.1626 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4109 - reader cost: 0.1629 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4115 - reader cost: 0.1633 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4121 - reader cost: 0.1639 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4127 - reader cost: 0.1640 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4117 - reader cost: 0.1630 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4119 - reader cost: 0.1632 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4109 - reader cost: 0.1620 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4116 - reader cost: 0.1627 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4121 - reader cost: 0.1629 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4121 - reader cost: 0.1630 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4127 - reader cost: 0.1634 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4129 - reader cost: 0.1635 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4138 - reader cost: 0.1642 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4134 - reader cost: 0.1638 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4138 - reader cost: 0.1640 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4130 - reader cost: 0.1630 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4135 - reader cost: 0.1635 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4129 - reader cost: 0.1627 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4129 - reader cost: 0.1626 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4123 - reader cost: 0.1620 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4117 - reader cost: 0.1614 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4125 - reader cost: 0.1619 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4129 - reader cost: 0.1623 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4132 - reader cost: 0.1626 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4137 - reader cost: 0.1629 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4141 - reader cost: 0.1633 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4144 - reader cost: 0.1635 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4146 - reader cost: 0.1637 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4148 - reader cost: 0.1637 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4148 - reader cost: 0.1637 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4144 - reader cost: 0.1631 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4143 - reader cost: 0.1630 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4145 - reader cost: 0.1628 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4144 - reader cost: 0.1628 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4146 - reader cost: 0.1629 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4146 - reader cost: 0.1629 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4155 - reader cost: 0.1637 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4156 - reader cost: 0.1636 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4150 - reader cost: 0.1631 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4146 - reader cost: 0.1627 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4147 - reader cost: 0.1628 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4150 - reader cost: 0.1631 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4153 - reader cost: 0.1633 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4149 - reader cost: 0.1630 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4147 - reader cost: 0.1628 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4149 - reader cost: 0.1629 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4151 - reader cost: 0.1631 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4153 - reader cost: 0.1633 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4155 - reader cost: 0.1634 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4157 - reader cost: 0.1636 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4151 - reader cost: 0.1631 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4152 - reader cost: 0.1632 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4149 - reader cost: 0.1629 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4144 - reader cost: 0.1623 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4146 - reader cost: 0.1626 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4140 - reader cost: 0.1620 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4136 - reader cost: 0.1615 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4131 - reader cost: 0.1611 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4137 - reader cost: 0.1616 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4139 - reader cost: 0.1617 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4140 - reader cost: 0.1619 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4143 - reader cost: 0.1620 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4144 - reader cost: 0.1622 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4146 - reader cost: 0.1624  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4148 - reader cost: 0.1625 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4145 - reader cost: 0.1623 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4147 - reader cost: 0.1624 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4147 - reader cost: 0.1625 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4149 - reader cost: 0.1625 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4153 - reader cost: 0.1630 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4149 - reader cost: 0.1626 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4144 - reader cost: 0.1621 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4142 - reader cost: 0.1619 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4143 - reader cost: 0.1620 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4140 - reader cost: 0.1617 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4144 - reader cost: 0.1616 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4145 - reader cost: 0.1618 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4147 - reader cost: 0.1619 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4147 - reader cost: 0.1617 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4150 - reader cost: 0.1618 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4151 - reader cost: 0.1619 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4148 - reader cost: 0.1616 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4150 - reader cost: 0.1619 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4153 - reader cost: 0.1621 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4153 - reader cost: 0.1622 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4154 - reader cost: 0.1622 125/125 [==============================] - 53s 420ms/step - batch_cost: 0.4155 - reader cost: 0.1623 2021-02-22 23:58:17 [INFO] [EVAL] #Images=500 mIoU=0.6181 Acc=0.9404 Kappa=0.9223 2021-02-22 23:58:17 [INFO] [EVAL] Class IoU: [0.9691 0.7789 0.8982 0.2474 0.4955 0.5869 0.6541 0.7092 0.8914 0.4973 0.9373 0.7831 0.5318 0.8733 0.0553 0.347 0.2406 0.5155 0.7317] 2021-02-22 23:58:17 [INFO] [EVAL] Class Acc: [0.9812 0.8782 0.9435 0.8168 0.8495 0.7783 0.8192 0.8873 0.9125 0.8645 0.9625 0.8887 0.7463 0.9045 0.959 0.8733 0.9934 0.7027 0.8337] 2021-02-22 23:58:21 [INFO] [EVAL] The model with the best validation mIoU (0.7322) was saved at iter 11000. 2021-02-22 23:58:35 [INFO] [TRAIN] epoch=41, iter=15010/80000, loss=0.9933, lr=0.008294, batch_cost=1.3439, reader_cost=0.0001 | ETA 24:15:39 2021-02-22 23:58:48 [INFO] [TRAIN] epoch=41, iter=15020/80000, loss=0.8672, lr=0.008293, batch_cost=1.3252, reader_cost=0.0001 | ETA 23:55:12 2021-02-22 23:59:02 [INFO] [TRAIN] epoch=41, iter=15030/80000, loss=0.9225, lr=0.008292, batch_cost=1.3588, reader_cost=0.0001 | ETA 24:31:21 2021-02-22 23:59:15 [INFO] [TRAIN] epoch=41, iter=15040/80000, loss=0.8849, lr=0.008291, batch_cost=1.3325, reader_cost=0.0001 | ETA 24:02:40 2021-02-22 23:59:29 [INFO] [TRAIN] epoch=41, iter=15050/80000, loss=0.9083, lr=0.008290, batch_cost=1.3752, reader_cost=0.0001 | ETA 24:48:37 2021-02-22 23:59:42 [INFO] [TRAIN] epoch=41, iter=15060/80000, loss=0.9023, lr=0.008289, batch_cost=1.3433, reader_cost=0.0001 | ETA 24:13:56 2021-02-22 23:59:56 [INFO] [TRAIN] epoch=41, iter=15070/80000, loss=1.0010, lr=0.008288, batch_cost=1.3405, reader_cost=0.0001 | ETA 24:10:38 2021-02-23 00:00:09 [INFO] [TRAIN] epoch=41, iter=15080/80000, loss=1.0206, lr=0.008286, batch_cost=1.3708, reader_cost=0.0001 | ETA 24:43:13 2021-02-23 00:00:23 [INFO] [TRAIN] epoch=41, iter=15090/80000, loss=0.8666, lr=0.008285, batch_cost=1.3657, reader_cost=0.0001 | ETA 24:37:27 2021-02-23 00:00:36 [INFO] [TRAIN] epoch=41, iter=15100/80000, loss=0.9790, lr=0.008284, batch_cost=1.3554, reader_cost=0.0001 | ETA 24:26:04 2021-02-23 00:00:50 [INFO] [TRAIN] epoch=41, iter=15110/80000, loss=0.8730, lr=0.008283, batch_cost=1.3572, reader_cost=0.0001 | ETA 24:27:49 2021-02-23 00:01:04 [INFO] [TRAIN] epoch=41, iter=15120/80000, loss=0.9114, lr=0.008282, batch_cost=1.3686, reader_cost=0.0001 | ETA 24:39:57 2021-02-23 00:01:17 [INFO] [TRAIN] epoch=41, iter=15130/80000, loss=0.9912, lr=0.008281, batch_cost=1.3671, reader_cost=0.0001 | ETA 24:38:05 2021-02-23 00:01:31 [INFO] [TRAIN] epoch=41, iter=15140/80000, loss=0.8887, lr=0.008280, batch_cost=1.3603, reader_cost=0.0001 | ETA 24:30:31 2021-02-23 00:01:44 [INFO] [TRAIN] epoch=41, iter=15150/80000, loss=1.1739, lr=0.008278, batch_cost=1.3448, reader_cost=0.0001 | ETA 24:13:31 2021-02-23 00:01:58 [INFO] [TRAIN] epoch=41, iter=15160/80000, loss=0.9538, lr=0.008277, batch_cost=1.3728, reader_cost=0.0001 | ETA 24:43:33 2021-02-23 00:02:12 [INFO] [TRAIN] epoch=41, iter=15170/80000, loss=1.1445, lr=0.008276, batch_cost=1.3357, reader_cost=0.0001 | ETA 24:03:12 2021-02-23 00:02:25 [INFO] [TRAIN] epoch=41, iter=15180/80000, loss=0.9919, lr=0.008275, batch_cost=1.3376, reader_cost=0.0001 | ETA 24:05:06 2021-02-23 00:02:38 [INFO] [TRAIN] epoch=41, iter=15190/80000, loss=0.9271, lr=0.008274, batch_cost=1.3578, reader_cost=0.0001 | ETA 24:26:39 2021-02-23 00:02:52 [INFO] [TRAIN] epoch=41, iter=15200/80000, loss=0.9206, lr=0.008273, batch_cost=1.3690, reader_cost=0.0001 | ETA 24:38:30 2021-02-23 00:03:06 [INFO] [TRAIN] epoch=41, iter=15210/80000, loss=0.9110, lr=0.008271, batch_cost=1.3667, reader_cost=0.0001 | ETA 24:35:46 2021-02-23 00:03:19 [INFO] [TRAIN] epoch=41, iter=15220/80000, loss=0.9313, lr=0.008270, batch_cost=1.3576, reader_cost=0.0001 | ETA 24:25:42 2021-02-23 00:03:33 [INFO] [TRAIN] epoch=41, iter=15230/80000, loss=0.8490, lr=0.008269, batch_cost=1.3475, reader_cost=0.0001 | ETA 24:14:40 2021-02-23 00:03:46 [INFO] [TRAIN] epoch=41, iter=15240/80000, loss=0.9919, lr=0.008268, batch_cost=1.3587, reader_cost=0.0001 | ETA 24:26:26 2021-02-23 00:04:00 [INFO] [TRAIN] epoch=41, iter=15250/80000, loss=1.0242, lr=0.008267, batch_cost=1.3321, reader_cost=0.0001 | ETA 23:57:31 2021-02-23 00:04:15 [INFO] [TRAIN] epoch=42, iter=15260/80000, loss=0.9365, lr=0.008266, batch_cost=1.5041, reader_cost=0.0584 | ETA 27:02:54 2021-02-23 00:04:28 [INFO] [TRAIN] epoch=42, iter=15270/80000, loss=1.0579, lr=0.008265, batch_cost=1.3485, reader_cost=0.0001 | ETA 24:14:51 2021-02-23 00:04:42 [INFO] [TRAIN] epoch=42, iter=15280/80000, loss=0.9450, lr=0.008263, batch_cost=1.3542, reader_cost=0.0001 | ETA 24:20:46 2021-02-23 00:04:55 [INFO] [TRAIN] epoch=42, iter=15290/80000, loss=0.8826, lr=0.008262, batch_cost=1.3493, reader_cost=0.0001 | ETA 24:15:13 2021-02-23 00:05:09 [INFO] [TRAIN] epoch=42, iter=15300/80000, loss=0.9868, lr=0.008261, batch_cost=1.3669, reader_cost=0.0001 | ETA 24:33:58 2021-02-23 00:05:23 [INFO] [TRAIN] epoch=42, iter=15310/80000, loss=1.0393, lr=0.008260, batch_cost=1.3903, reader_cost=0.0001 | ETA 24:58:59 2021-02-23 00:05:37 [INFO] [TRAIN] epoch=42, iter=15320/80000, loss=0.9740, lr=0.008259, batch_cost=1.3598, reader_cost=0.0001 | ETA 24:25:54 2021-02-23 00:05:50 [INFO] [TRAIN] epoch=42, iter=15330/80000, loss=0.8647, lr=0.008258, batch_cost=1.3667, reader_cost=0.0001 | ETA 24:33:04 2021-02-23 00:06:04 [INFO] [TRAIN] epoch=42, iter=15340/80000, loss=0.9723, lr=0.008257, batch_cost=1.3503, reader_cost=0.0001 | ETA 24:15:10 2021-02-23 00:06:17 [INFO] [TRAIN] epoch=42, iter=15350/80000, loss=0.9023, lr=0.008255, batch_cost=1.3387, reader_cost=0.0001 | ETA 24:02:28 2021-02-23 00:06:31 [INFO] [TRAIN] epoch=42, iter=15360/80000, loss=0.9338, lr=0.008254, batch_cost=1.3451, reader_cost=0.0001 | ETA 24:09:05 2021-02-23 00:06:44 [INFO] [TRAIN] epoch=42, iter=15370/80000, loss=0.9254, lr=0.008253, batch_cost=1.3941, reader_cost=0.0001 | ETA 25:01:43 2021-02-23 00:06:58 [INFO] [TRAIN] epoch=42, iter=15380/80000, loss=1.0194, lr=0.008252, batch_cost=1.3721, reader_cost=0.0001 | ETA 24:37:47 2021-02-23 00:07:12 [INFO] [TRAIN] epoch=42, iter=15390/80000, loss=0.9429, lr=0.008251, batch_cost=1.3542, reader_cost=0.0001 | ETA 24:18:12 2021-02-23 00:07:25 [INFO] [TRAIN] epoch=42, iter=15400/80000, loss=0.9023, lr=0.008250, batch_cost=1.3718, reader_cost=0.0001 | ETA 24:36:59 2021-02-23 00:07:39 [INFO] [TRAIN] epoch=42, iter=15410/80000, loss=0.9167, lr=0.008248, batch_cost=1.3520, reader_cost=0.0001 | ETA 24:15:26 2021-02-23 00:07:53 [INFO] [TRAIN] epoch=42, iter=15420/80000, loss=0.9127, lr=0.008247, batch_cost=1.3829, reader_cost=0.0001 | ETA 24:48:27 2021-02-23 00:08:06 [INFO] [TRAIN] epoch=42, iter=15430/80000, loss=0.8826, lr=0.008246, batch_cost=1.3569, reader_cost=0.0001 | ETA 24:20:14 2021-02-23 00:08:20 [INFO] [TRAIN] epoch=42, iter=15440/80000, loss=0.9833, lr=0.008245, batch_cost=1.3648, reader_cost=0.0001 | ETA 24:28:29 2021-02-23 00:08:34 [INFO] [TRAIN] epoch=42, iter=15450/80000, loss=0.9516, lr=0.008244, batch_cost=1.3526, reader_cost=0.0001 | ETA 24:15:13 2021-02-23 00:08:47 [INFO] [TRAIN] epoch=42, iter=15460/80000, loss=0.8289, lr=0.008243, batch_cost=1.3402, reader_cost=0.0001 | ETA 24:01:38 2021-02-23 00:09:00 [INFO] [TRAIN] epoch=42, iter=15470/80000, loss=1.0454, lr=0.008242, batch_cost=1.3488, reader_cost=0.0001 | ETA 24:10:35 2021-02-23 00:09:14 [INFO] [TRAIN] epoch=42, iter=15480/80000, loss=0.9039, lr=0.008240, batch_cost=1.3640, reader_cost=0.0001 | ETA 24:26:45 2021-02-23 00:09:28 [INFO] [TRAIN] epoch=42, iter=15490/80000, loss=0.9354, lr=0.008239, batch_cost=1.3675, reader_cost=0.0001 | ETA 24:30:18 2021-02-23 00:09:42 [INFO] [TRAIN] epoch=42, iter=15500/80000, loss=1.0225, lr=0.008238, batch_cost=1.3858, reader_cost=0.0001 | ETA 24:49:41 2021-02-23 00:09:55 [INFO] [TRAIN] epoch=42, iter=15510/80000, loss=0.9670, lr=0.008237, batch_cost=1.3760, reader_cost=0.0001 | ETA 24:38:58 2021-02-23 00:10:09 [INFO] [TRAIN] epoch=42, iter=15520/80000, loss=0.9535, lr=0.008236, batch_cost=1.3528, reader_cost=0.0001 | ETA 24:13:50 2021-02-23 00:10:22 [INFO] [TRAIN] epoch=42, iter=15530/80000, loss=0.9126, lr=0.008235, batch_cost=1.3458, reader_cost=0.0001 | ETA 24:06:03 2021-02-23 00:10:36 [INFO] [TRAIN] epoch=42, iter=15540/80000, loss=0.9040, lr=0.008234, batch_cost=1.3419, reader_cost=0.0001 | ETA 24:01:42 2021-02-23 00:10:50 [INFO] [TRAIN] epoch=42, iter=15550/80000, loss=0.8919, lr=0.008232, batch_cost=1.3777, reader_cost=0.0001 | ETA 24:39:52 2021-02-23 00:11:03 [INFO] [TRAIN] epoch=42, iter=15560/80000, loss=0.9183, lr=0.008231, batch_cost=1.3495, reader_cost=0.0001 | ETA 24:09:24 2021-02-23 00:11:17 [INFO] [TRAIN] epoch=42, iter=15570/80000, loss=0.9016, lr=0.008230, batch_cost=1.3505, reader_cost=0.0001 | ETA 24:10:11 2021-02-23 00:11:31 [INFO] [TRAIN] epoch=42, iter=15580/80000, loss=0.9176, lr=0.008229, batch_cost=1.4012, reader_cost=0.0001 | ETA 25:04:24 2021-02-23 00:11:44 [INFO] [TRAIN] epoch=42, iter=15590/80000, loss=0.8928, lr=0.008228, batch_cost=1.3846, reader_cost=0.0001 | ETA 24:46:22 2021-02-23 00:11:58 [INFO] [TRAIN] epoch=42, iter=15600/80000, loss=0.9546, lr=0.008227, batch_cost=1.3490, reader_cost=0.0001 | ETA 24:07:56 2021-02-23 00:12:12 [INFO] [TRAIN] epoch=42, iter=15610/80000, loss=0.9042, lr=0.008225, batch_cost=1.3737, reader_cost=0.0001 | ETA 24:34:10 2021-02-23 00:12:25 [INFO] [TRAIN] epoch=42, iter=15620/80000, loss=0.9616, lr=0.008224, batch_cost=1.3518, reader_cost=0.0001 | ETA 24:10:31 2021-02-23 00:12:40 [INFO] [TRAIN] epoch=43, iter=15630/80000, loss=0.9425, lr=0.008223, batch_cost=1.4476, reader_cost=0.0838 | ETA 25:53:03 2021-02-23 00:12:53 [INFO] [TRAIN] epoch=43, iter=15640/80000, loss=0.8963, lr=0.008222, batch_cost=1.3656, reader_cost=0.0001 | ETA 24:24:46 2021-02-23 00:13:07 [INFO] [TRAIN] epoch=43, iter=15650/80000, loss=1.0150, lr=0.008221, batch_cost=1.3564, reader_cost=0.0001 | ETA 24:14:41 2021-02-23 00:13:21 [INFO] [TRAIN] epoch=43, iter=15660/80000, loss=0.8465, lr=0.008220, batch_cost=1.3951, reader_cost=0.0001 | ETA 24:56:00 2021-02-23 00:13:34 [INFO] [TRAIN] epoch=43, iter=15670/80000, loss=0.8931, lr=0.008219, batch_cost=1.3595, reader_cost=0.0001 | ETA 24:17:38 2021-02-23 00:13:48 [INFO] [TRAIN] epoch=43, iter=15680/80000, loss=0.9667, lr=0.008217, batch_cost=1.3656, reader_cost=0.0001 | ETA 24:23:54 2021-02-23 00:14:02 [INFO] [TRAIN] epoch=43, iter=15690/80000, loss=0.8966, lr=0.008216, batch_cost=1.3541, reader_cost=0.0001 | ETA 24:11:19 2021-02-23 00:14:15 [INFO] [TRAIN] epoch=43, iter=15700/80000, loss=0.9174, lr=0.008215, batch_cost=1.3348, reader_cost=0.0001 | ETA 23:50:27 2021-02-23 00:14:28 [INFO] [TRAIN] epoch=43, iter=15710/80000, loss=0.9835, lr=0.008214, batch_cost=1.3433, reader_cost=0.0001 | ETA 23:59:23 2021-02-23 00:14:42 [INFO] [TRAIN] epoch=43, iter=15720/80000, loss=0.9017, lr=0.008213, batch_cost=1.3717, reader_cost=0.0001 | ETA 24:29:32 2021-02-23 00:14:56 [INFO] [TRAIN] epoch=43, iter=15730/80000, loss=1.0751, lr=0.008212, batch_cost=1.3501, reader_cost=0.0001 | ETA 24:06:13 2021-02-23 00:15:09 [INFO] [TRAIN] epoch=43, iter=15740/80000, loss=0.9151, lr=0.008211, batch_cost=1.3500, reader_cost=0.0001 | ETA 24:05:48 2021-02-23 00:15:23 [INFO] [TRAIN] epoch=43, iter=15750/80000, loss=0.9356, lr=0.008209, batch_cost=1.3412, reader_cost=0.0001 | ETA 23:56:09 2021-02-23 00:15:36 [INFO] [TRAIN] epoch=43, iter=15760/80000, loss=0.9672, lr=0.008208, batch_cost=1.3559, reader_cost=0.0001 | ETA 24:11:42 2021-02-23 00:15:50 [INFO] [TRAIN] epoch=43, iter=15770/80000, loss=1.0646, lr=0.008207, batch_cost=1.3413, reader_cost=0.0001 | ETA 23:55:54 2021-02-23 00:16:03 [INFO] [TRAIN] epoch=43, iter=15780/80000, loss=0.9402, lr=0.008206, batch_cost=1.3695, reader_cost=0.0001 | ETA 24:25:48 2021-02-23 00:16:17 [INFO] [TRAIN] epoch=43, iter=15790/80000, loss=0.8466, lr=0.008205, batch_cost=1.3597, reader_cost=0.0001 | ETA 24:15:09 2021-02-23 00:16:30 [INFO] [TRAIN] epoch=43, iter=15800/80000, loss=0.9146, lr=0.008204, batch_cost=1.3576, reader_cost=0.0001 | ETA 24:12:37 2021-02-23 00:16:44 [INFO] [TRAIN] epoch=43, iter=15810/80000, loss=0.9310, lr=0.008202, batch_cost=1.3581, reader_cost=0.0001 | ETA 24:12:55 2021-02-23 00:16:57 [INFO] [TRAIN] epoch=43, iter=15820/80000, loss=0.9656, lr=0.008201, batch_cost=1.3523, reader_cost=0.0001 | ETA 24:06:27 2021-02-23 00:17:11 [INFO] [TRAIN] epoch=43, iter=15830/80000, loss=0.9497, lr=0.008200, batch_cost=1.3698, reader_cost=0.0001 | ETA 24:24:58 2021-02-23 00:17:25 [INFO] [TRAIN] epoch=43, iter=15840/80000, loss=0.9639, lr=0.008199, batch_cost=1.3434, reader_cost=0.0001 | ETA 23:56:34 2021-02-23 00:17:38 [INFO] [TRAIN] epoch=43, iter=15850/80000, loss=1.0152, lr=0.008198, batch_cost=1.3474, reader_cost=0.0001 | ETA 24:00:36 2021-02-23 00:17:52 [INFO] [TRAIN] epoch=43, iter=15860/80000, loss=0.9824, lr=0.008197, batch_cost=1.3549, reader_cost=0.0001 | ETA 24:08:25 2021-02-23 00:18:05 [INFO] [TRAIN] epoch=43, iter=15870/80000, loss=0.8617, lr=0.008196, batch_cost=1.3171, reader_cost=0.0001 | ETA 23:27:44 2021-02-23 00:18:18 [INFO] [TRAIN] epoch=43, iter=15880/80000, loss=0.9367, lr=0.008194, batch_cost=1.3263, reader_cost=0.0001 | ETA 23:37:19 2021-02-23 00:18:31 [INFO] [TRAIN] epoch=43, iter=15890/80000, loss=0.8883, lr=0.008193, batch_cost=1.3353, reader_cost=0.0001 | ETA 23:46:47 2021-02-23 00:18:45 [INFO] [TRAIN] epoch=43, iter=15900/80000, loss=1.0110, lr=0.008192, batch_cost=1.3529, reader_cost=0.0001 | ETA 24:05:21 2021-02-23 00:18:59 [INFO] [TRAIN] epoch=43, iter=15910/80000, loss=0.8316, lr=0.008191, batch_cost=1.3727, reader_cost=0.0001 | ETA 24:26:15 2021-02-23 00:19:12 [INFO] [TRAIN] epoch=43, iter=15920/80000, loss=0.8974, lr=0.008190, batch_cost=1.3551, reader_cost=0.0001 | ETA 24:07:11 2021-02-23 00:19:26 [INFO] [TRAIN] epoch=43, iter=15930/80000, loss=0.9991, lr=0.008189, batch_cost=1.3612, reader_cost=0.0001 | ETA 24:13:34 2021-02-23 00:19:40 [INFO] [TRAIN] epoch=43, iter=15940/80000, loss=0.8558, lr=0.008188, batch_cost=1.3800, reader_cost=0.0001 | ETA 24:33:20 2021-02-23 00:19:53 [INFO] [TRAIN] epoch=43, iter=15950/80000, loss=1.0925, lr=0.008186, batch_cost=1.3458, reader_cost=0.0001 | ETA 23:56:40 2021-02-23 00:20:07 [INFO] [TRAIN] epoch=43, iter=15960/80000, loss=0.9406, lr=0.008185, batch_cost=1.3762, reader_cost=0.0001 | ETA 24:28:53 2021-02-23 00:20:21 [INFO] [TRAIN] epoch=43, iter=15970/80000, loss=0.9010, lr=0.008184, batch_cost=1.3913, reader_cost=0.0001 | ETA 24:44:44 2021-02-23 00:20:34 [INFO] [TRAIN] epoch=43, iter=15980/80000, loss=0.9704, lr=0.008183, batch_cost=1.3582, reader_cost=0.0001 | ETA 24:09:08 2021-02-23 00:20:48 [INFO] [TRAIN] epoch=43, iter=15990/80000, loss=0.9128, lr=0.008182, batch_cost=1.3856, reader_cost=0.0001 | ETA 24:38:11 2021-02-23 00:21:03 [INFO] [TRAIN] epoch=44, iter=16000/80000, loss=0.9812, lr=0.008181, batch_cost=1.4328, reader_cost=0.0606 | ETA 25:28:20 2021-02-23 00:21:03 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:09 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:02 - batch_cost: 0.2281 - reader cost: 0.1038  3/125 [..............................] - ETA: 59s - batch_cost: 0.2995 - reader cost: 0.1339  4/125 [..............................] - ETA: 55s - batch_cost: 0.3205 - reader cost: 0.1323 5/125 [>.............................] - ETA: 53s - batch_cost: 0.3363 - reader cost: 0.1358 6/125 [>.............................] - ETA: 53s - batch_cost: 0.3525 - reader cost: 0.1438 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3646 - reader cost: 0.1498 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3726 - reader cost: 0.1531 9/125 [=>............................] - ETA: 50s - batch_cost: 0.3738 - reader cost: 0.1509 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3807 - reader cost: 0.1534 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3857 - reader cost: 0.1556 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3883 - reader cost: 0.1563 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3942 - reader cost: 0.1610 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3945 - reader cost: 0.1599 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3939 - reader cost: 0.1584 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3967 - reader cost: 0.1601 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3953 - reader cost: 0.1579 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3972 - reader cost: 0.1591 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.4000 - reader cost: 0.1610 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4014 - reader cost: 0.1615 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4041 - reader cost: 0.1637 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4055 - reader cost: 0.1646 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4067 - reader cost: 0.1653 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4075 - reader cost: 0.1656 25/125 [=====>........................] - ETA: 43s - batch_cost: 0.4092 - reader cost: 0.1659 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4093 - reader cost: 0.1653 27/125 [=====>........................] - ETA: 42s - batch_cost: 0.4099 - reader cost: 0.1656 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4088 - reader cost: 0.1643 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4081 - reader cost: 0.1634 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4085 - reader cost: 0.1636 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4089 - reader cost: 0.1638 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4096 - reader cost: 0.1641 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4100 - reader cost: 0.1644 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4110 - reader cost: 0.1651 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4114 - reader cost: 0.1652 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4102 - reader cost: 0.1640 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4107 - reader cost: 0.1643 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4111 - reader cost: 0.1644 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4121 - reader cost: 0.1653 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4127 - reader cost: 0.1654 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4122 - reader cost: 0.1644 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4130 - reader cost: 0.1647 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4120 - reader cost: 0.1636 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4126 - reader cost: 0.1640 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4138 - reader cost: 0.1651 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4133 - reader cost: 0.1645 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4129 - reader cost: 0.1641 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4136 - reader cost: 0.1643 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4140 - reader cost: 0.1645 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4142 - reader cost: 0.1647 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4142 - reader cost: 0.1645 52/125 [===========>..................] - ETA: 31s - batch_cost: 0.4145 - reader cost: 0.1648 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4140 - reader cost: 0.1643 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4142 - reader cost: 0.1645 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4144 - reader cost: 0.1646 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4140 - reader cost: 0.1642 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4136 - reader cost: 0.1636 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4141 - reader cost: 0.1640 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4135 - reader cost: 0.1634 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4140 - reader cost: 0.1638 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4140 - reader cost: 0.1638 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4143 - reader cost: 0.1640 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4144 - reader cost: 0.1642 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4147 - reader cost: 0.1643 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4147 - reader cost: 0.1644 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4149 - reader cost: 0.1645 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4151 - reader cost: 0.1646 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4150 - reader cost: 0.1644 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4154 - reader cost: 0.1648 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4156 - reader cost: 0.1650 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4160 - reader cost: 0.1653 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4162 - reader cost: 0.1655 73/125 [================>.............] - ETA: 22s - batch_cost: 0.4167 - reader cost: 0.1660 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4168 - reader cost: 0.1660 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4166 - reader cost: 0.1659 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4162 - reader cost: 0.1654 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4164 - reader cost: 0.1655 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4163 - reader cost: 0.1654 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4165 - reader cost: 0.1655 80/125 [==================>...........] - ETA: 19s - batch_cost: 0.4165 - reader cost: 0.1656 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4167 - reader cost: 0.1657 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4167 - reader cost: 0.1657 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4164 - reader cost: 0.1654 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4165 - reader cost: 0.1654 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4166 - reader cost: 0.1652 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4160 - reader cost: 0.1647 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4161 - reader cost: 0.1648 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4154 - reader cost: 0.1640 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4157 - reader cost: 0.1643 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4151 - reader cost: 0.1637 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4148 - reader cost: 0.1634 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4148 - reader cost: 0.1631 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4149 - reader cost: 0.1632 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4151 - reader cost: 0.1635 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4153 - reader cost: 0.1637 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4150 - reader cost: 0.1634 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4152 - reader cost: 0.1636 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4153 - reader cost: 0.1638 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4154 - reader cost: 0.1638 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4156 - reader cost: 0.1641 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4158 - reader cost: 0.1642 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4159 - reader cost: 0.1642  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4155 - reader cost: 0.1638 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4156 - reader cost: 0.1640 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4153 - reader cost: 0.1636 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4155 - reader cost: 0.1637 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4155 - reader cost: 0.1638 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4156 - reader cost: 0.1638 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4156 - reader cost: 0.1638 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4157 - reader cost: 0.1639 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4160 - reader cost: 0.1642 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4159 - reader cost: 0.1640 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4156 - reader cost: 0.1637 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4159 - reader cost: 0.1639 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4159 - reader cost: 0.1640 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4160 - reader cost: 0.1641 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4162 - reader cost: 0.1642 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4165 - reader cost: 0.1645 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4167 - reader cost: 0.1646 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4167 - reader cost: 0.1645 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4166 - reader cost: 0.1644 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4168 - reader cost: 0.1645 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4164 - reader cost: 0.1642 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4165 - reader cost: 0.1643 125/125 [==============================] - 53s 421ms/step - batch_cost: 0.4165 - reader cost: 0.1642 2021-02-23 00:21:55 [INFO] [EVAL] #Images=500 mIoU=0.7030 Acc=0.9469 Kappa=0.9308 2021-02-23 00:21:55 [INFO] [EVAL] Class IoU: [0.967 0.765 0.9021 0.4283 0.4123 0.6069 0.6851 0.7718 0.9115 0.5972 0.9402 0.7945 0.5757 0.9278 0.5948 0.6475 0.5804 0.5065 0.7417] 2021-02-23 00:21:55 [INFO] [EVAL] Class Acc: [0.9756 0.9134 0.9345 0.6727 0.7568 0.8358 0.8173 0.8741 0.9519 0.8445 0.9552 0.8666 0.7311 0.9561 0.7353 0.9043 0.95 0.8956 0.8561] 2021-02-23 00:21:59 [INFO] [EVAL] The model with the best validation mIoU (0.7322) was saved at iter 11000. 2021-02-23 00:22:13 [INFO] [TRAIN] epoch=44, iter=16010/80000, loss=0.8992, lr=0.008179, batch_cost=1.3715, reader_cost=0.0001 | ETA 24:22:40 2021-02-23 00:22:26 [INFO] [TRAIN] epoch=44, iter=16020/80000, loss=0.9940, lr=0.008178, batch_cost=1.3417, reader_cost=0.0001 | ETA 23:50:44 2021-02-23 00:22:40 [INFO] [TRAIN] epoch=44, iter=16030/80000, loss=1.0387, lr=0.008177, batch_cost=1.3481, reader_cost=0.0001 | ETA 23:57:20 2021-02-23 00:22:54 [INFO] [TRAIN] epoch=44, iter=16040/80000, loss=1.0890, lr=0.008176, batch_cost=1.3655, reader_cost=0.0001 | ETA 24:15:35 2021-02-23 00:23:07 [INFO] [TRAIN] epoch=44, iter=16050/80000, loss=0.8913, lr=0.008175, batch_cost=1.3712, reader_cost=0.0001 | ETA 24:21:26 2021-02-23 00:23:21 [INFO] [TRAIN] epoch=44, iter=16060/80000, loss=0.9504, lr=0.008174, batch_cost=1.3560, reader_cost=0.0001 | ETA 24:04:59 2021-02-23 00:23:35 [INFO] [TRAIN] epoch=44, iter=16070/80000, loss=0.9167, lr=0.008173, batch_cost=1.3748, reader_cost=0.0001 | ETA 24:24:47 2021-02-23 00:23:48 [INFO] [TRAIN] epoch=44, iter=16080/80000, loss=0.8895, lr=0.008171, batch_cost=1.3377, reader_cost=0.0001 | ETA 23:45:03 2021-02-23 00:24:01 [INFO] [TRAIN] epoch=44, iter=16090/80000, loss=0.9058, lr=0.008170, batch_cost=1.3428, reader_cost=0.0001 | ETA 23:50:18 2021-02-23 00:24:15 [INFO] [TRAIN] epoch=44, iter=16100/80000, loss=0.9285, lr=0.008169, batch_cost=1.3657, reader_cost=0.0001 | ETA 24:14:25 2021-02-23 00:24:29 [INFO] [TRAIN] epoch=44, iter=16110/80000, loss=1.0773, lr=0.008168, batch_cost=1.3795, reader_cost=0.0001 | ETA 24:28:56 2021-02-23 00:24:43 [INFO] [TRAIN] epoch=44, iter=16120/80000, loss=1.0512, lr=0.008167, batch_cost=1.3799, reader_cost=0.0001 | ETA 24:29:05 2021-02-23 00:24:56 [INFO] [TRAIN] epoch=44, iter=16130/80000, loss=0.9686, lr=0.008166, batch_cost=1.3494, reader_cost=0.0001 | ETA 23:56:26 2021-02-23 00:25:10 [INFO] [TRAIN] epoch=44, iter=16140/80000, loss=0.9306, lr=0.008165, batch_cost=1.3373, reader_cost=0.0001 | ETA 23:43:18 2021-02-23 00:25:23 [INFO] [TRAIN] epoch=44, iter=16150/80000, loss=0.9598, lr=0.008163, batch_cost=1.3675, reader_cost=0.0001 | ETA 24:15:14 2021-02-23 00:25:37 [INFO] [TRAIN] epoch=44, iter=16160/80000, loss=1.0496, lr=0.008162, batch_cost=1.3603, reader_cost=0.0001 | ETA 24:07:21 2021-02-23 00:25:51 [INFO] [TRAIN] epoch=44, iter=16170/80000, loss=0.9033, lr=0.008161, batch_cost=1.3727, reader_cost=0.0001 | ETA 24:20:21 2021-02-23 00:26:04 [INFO] [TRAIN] epoch=44, iter=16180/80000, loss=0.8514, lr=0.008160, batch_cost=1.3510, reader_cost=0.0001 | ETA 23:57:02 2021-02-23 00:26:18 [INFO] [TRAIN] epoch=44, iter=16190/80000, loss=0.9265, lr=0.008159, batch_cost=1.3529, reader_cost=0.0001 | ETA 23:58:45 2021-02-23 00:26:31 [INFO] [TRAIN] epoch=44, iter=16200/80000, loss=0.9996, lr=0.008158, batch_cost=1.3819, reader_cost=0.0001 | ETA 24:29:27 2021-02-23 00:26:45 [INFO] [TRAIN] epoch=44, iter=16210/80000, loss=1.0055, lr=0.008156, batch_cost=1.3682, reader_cost=0.0001 | ETA 24:14:36 2021-02-23 00:26:59 [INFO] [TRAIN] epoch=44, iter=16220/80000, loss=0.8966, lr=0.008155, batch_cost=1.3574, reader_cost=0.0001 | ETA 24:02:55 2021-02-23 00:27:12 [INFO] [TRAIN] epoch=44, iter=16230/80000, loss=0.9248, lr=0.008154, batch_cost=1.3355, reader_cost=0.0001 | ETA 23:39:27 2021-02-23 00:27:26 [INFO] [TRAIN] epoch=44, iter=16240/80000, loss=0.8994, lr=0.008153, batch_cost=1.3776, reader_cost=0.0001 | ETA 24:23:58 2021-02-23 00:27:39 [INFO] [TRAIN] epoch=44, iter=16250/80000, loss=1.0282, lr=0.008152, batch_cost=1.3472, reader_cost=0.0001 | ETA 23:51:25 2021-02-23 00:27:53 [INFO] [TRAIN] epoch=44, iter=16260/80000, loss=0.8164, lr=0.008151, batch_cost=1.3491, reader_cost=0.0001 | ETA 23:53:14 2021-02-23 00:28:06 [INFO] [TRAIN] epoch=44, iter=16270/80000, loss=0.8435, lr=0.008150, batch_cost=1.3732, reader_cost=0.0001 | ETA 24:18:36 2021-02-23 00:28:20 [INFO] [TRAIN] epoch=44, iter=16280/80000, loss=0.8546, lr=0.008148, batch_cost=1.3503, reader_cost=0.0001 | ETA 23:54:02 2021-02-23 00:28:34 [INFO] [TRAIN] epoch=44, iter=16290/80000, loss=0.8746, lr=0.008147, batch_cost=1.3933, reader_cost=0.0001 | ETA 24:39:24 2021-02-23 00:28:47 [INFO] [TRAIN] epoch=44, iter=16300/80000, loss=0.9271, lr=0.008146, batch_cost=1.3391, reader_cost=0.0001 | ETA 23:41:40 2021-02-23 00:29:01 [INFO] [TRAIN] epoch=44, iter=16310/80000, loss=0.8480, lr=0.008145, batch_cost=1.3872, reader_cost=0.0001 | ETA 24:32:33 2021-02-23 00:29:15 [INFO] [TRAIN] epoch=44, iter=16320/80000, loss=0.9932, lr=0.008144, batch_cost=1.3658, reader_cost=0.0001 | ETA 24:09:35 2021-02-23 00:29:29 [INFO] [TRAIN] epoch=44, iter=16330/80000, loss=0.9554, lr=0.008143, batch_cost=1.3731, reader_cost=0.0001 | ETA 24:17:06 2021-02-23 00:29:42 [INFO] [TRAIN] epoch=44, iter=16340/80000, loss=0.8594, lr=0.008142, batch_cost=1.3647, reader_cost=0.0001 | ETA 24:07:58 2021-02-23 00:29:56 [INFO] [TRAIN] epoch=44, iter=16350/80000, loss=0.8831, lr=0.008140, batch_cost=1.3696, reader_cost=0.0001 | ETA 24:12:52 2021-02-23 00:30:10 [INFO] [TRAIN] epoch=44, iter=16360/80000, loss=0.9590, lr=0.008139, batch_cost=1.3642, reader_cost=0.0001 | ETA 24:06:56 2021-02-23 00:30:24 [INFO] [TRAIN] epoch=45, iter=16370/80000, loss=0.9099, lr=0.008138, batch_cost=1.3985, reader_cost=0.0548 | ETA 24:43:05 2021-02-23 00:30:37 [INFO] [TRAIN] epoch=45, iter=16380/80000, loss=0.8770, lr=0.008137, batch_cost=1.3732, reader_cost=0.0001 | ETA 24:16:03 2021-02-23 00:30:51 [INFO] [TRAIN] epoch=45, iter=16390/80000, loss=0.8445, lr=0.008136, batch_cost=1.3633, reader_cost=0.0001 | ETA 24:05:21 2021-02-23 00:31:05 [INFO] [TRAIN] epoch=45, iter=16400/80000, loss=1.0398, lr=0.008135, batch_cost=1.3695, reader_cost=0.0001 | ETA 24:11:43 2021-02-23 00:31:18 [INFO] [TRAIN] epoch=45, iter=16410/80000, loss=0.8815, lr=0.008133, batch_cost=1.3376, reader_cost=0.0001 | ETA 23:37:35 2021-02-23 00:31:32 [INFO] [TRAIN] epoch=45, iter=16420/80000, loss=0.8866, lr=0.008132, batch_cost=1.3673, reader_cost=0.0001 | ETA 24:08:55 2021-02-23 00:31:45 [INFO] [TRAIN] epoch=45, iter=16430/80000, loss=0.9266, lr=0.008131, batch_cost=1.3373, reader_cost=0.0001 | ETA 23:36:52 2021-02-23 00:31:59 [INFO] [TRAIN] epoch=45, iter=16440/80000, loss=0.9557, lr=0.008130, batch_cost=1.3932, reader_cost=0.0001 | ETA 24:35:51 2021-02-23 00:32:13 [INFO] [TRAIN] epoch=45, iter=16450/80000, loss=0.9088, lr=0.008129, batch_cost=1.3624, reader_cost=0.0001 | ETA 24:03:00 2021-02-23 00:32:26 [INFO] [TRAIN] epoch=45, iter=16460/80000, loss=0.9083, lr=0.008128, batch_cost=1.3655, reader_cost=0.0001 | ETA 24:06:02 2021-02-23 00:32:40 [INFO] [TRAIN] epoch=45, iter=16470/80000, loss=0.8862, lr=0.008127, batch_cost=1.3653, reader_cost=0.0001 | ETA 24:05:40 2021-02-23 00:32:54 [INFO] [TRAIN] epoch=45, iter=16480/80000, loss=0.9129, lr=0.008125, batch_cost=1.3865, reader_cost=0.0001 | ETA 24:27:47 2021-02-23 00:33:07 [INFO] [TRAIN] epoch=45, iter=16490/80000, loss=0.7829, lr=0.008124, batch_cost=1.3564, reader_cost=0.0001 | ETA 23:55:43 2021-02-23 00:33:21 [INFO] [TRAIN] epoch=45, iter=16500/80000, loss=1.0265, lr=0.008123, batch_cost=1.3515, reader_cost=0.0001 | ETA 23:50:19 2021-02-23 00:33:35 [INFO] [TRAIN] epoch=45, iter=16510/80000, loss=0.9467, lr=0.008122, batch_cost=1.3766, reader_cost=0.0001 | ETA 24:16:40 2021-02-23 00:33:48 [INFO] [TRAIN] epoch=45, iter=16520/80000, loss=1.0364, lr=0.008121, batch_cost=1.3555, reader_cost=0.0001 | ETA 23:54:05 2021-02-23 00:34:02 [INFO] [TRAIN] epoch=45, iter=16530/80000, loss=0.9023, lr=0.008120, batch_cost=1.3843, reader_cost=0.0001 | ETA 24:24:21 2021-02-23 00:34:16 [INFO] [TRAIN] epoch=45, iter=16540/80000, loss=0.8639, lr=0.008118, batch_cost=1.3745, reader_cost=0.0001 | ETA 24:13:45 2021-02-23 00:34:29 [INFO] [TRAIN] epoch=45, iter=16550/80000, loss=0.8823, lr=0.008117, batch_cost=1.3625, reader_cost=0.0001 | ETA 24:00:49 2021-02-23 00:34:43 [INFO] [TRAIN] epoch=45, iter=16560/80000, loss=0.9295, lr=0.008116, batch_cost=1.3580, reader_cost=0.0001 | ETA 23:55:48 2021-02-23 00:34:57 [INFO] [TRAIN] epoch=45, iter=16570/80000, loss=0.9902, lr=0.008115, batch_cost=1.3781, reader_cost=0.0001 | ETA 24:16:51 2021-02-23 00:35:11 [INFO] [TRAIN] epoch=45, iter=16580/80000, loss=0.9074, lr=0.008114, batch_cost=1.3796, reader_cost=0.0001 | ETA 24:18:11 2021-02-23 00:35:24 [INFO] [TRAIN] epoch=45, iter=16590/80000, loss=0.9118, lr=0.008113, batch_cost=1.3736, reader_cost=0.0001 | ETA 24:11:41 2021-02-23 00:35:38 [INFO] [TRAIN] epoch=45, iter=16600/80000, loss=0.8614, lr=0.008112, batch_cost=1.3614, reader_cost=0.0001 | ETA 23:58:31 2021-02-23 00:35:51 [INFO] [TRAIN] epoch=45, iter=16610/80000, loss=0.9165, lr=0.008110, batch_cost=1.3392, reader_cost=0.0001 | ETA 23:34:49 2021-02-23 00:36:05 [INFO] [TRAIN] epoch=45, iter=16620/80000, loss=0.8590, lr=0.008109, batch_cost=1.3626, reader_cost=0.0001 | ETA 23:59:19 2021-02-23 00:36:18 [INFO] [TRAIN] epoch=45, iter=16630/80000, loss=0.8843, lr=0.008108, batch_cost=1.3495, reader_cost=0.0001 | ETA 23:45:15 2021-02-23 00:36:32 [INFO] [TRAIN] epoch=45, iter=16640/80000, loss=0.9143, lr=0.008107, batch_cost=1.3638, reader_cost=0.0001 | ETA 24:00:07 2021-02-23 00:36:45 [INFO] [TRAIN] epoch=45, iter=16650/80000, loss=0.8734, lr=0.008106, batch_cost=1.3445, reader_cost=0.0001 | ETA 23:39:33 2021-02-23 00:36:59 [INFO] [TRAIN] epoch=45, iter=16660/80000, loss=0.9441, lr=0.008105, batch_cost=1.3873, reader_cost=0.0001 | ETA 24:24:31 2021-02-23 00:37:13 [INFO] [TRAIN] epoch=45, iter=16670/80000, loss=0.9399, lr=0.008104, batch_cost=1.3908, reader_cost=0.0001 | ETA 24:28:01 2021-02-23 00:37:27 [INFO] [TRAIN] epoch=45, iter=16680/80000, loss=0.8612, lr=0.008102, batch_cost=1.3395, reader_cost=0.0001 | ETA 23:33:37 2021-02-23 00:37:41 [INFO] [TRAIN] epoch=45, iter=16690/80000, loss=1.0244, lr=0.008101, batch_cost=1.3894, reader_cost=0.0001 | ETA 24:26:04 2021-02-23 00:37:54 [INFO] [TRAIN] epoch=45, iter=16700/80000, loss=0.8727, lr=0.008100, batch_cost=1.3533, reader_cost=0.0001 | ETA 23:47:43 2021-02-23 00:38:08 [INFO] [TRAIN] epoch=45, iter=16710/80000, loss=0.9157, lr=0.008099, batch_cost=1.3752, reader_cost=0.0001 | ETA 24:10:36 2021-02-23 00:38:22 [INFO] [TRAIN] epoch=45, iter=16720/80000, loss=0.9025, lr=0.008098, batch_cost=1.3774, reader_cost=0.0001 | ETA 24:12:39 2021-02-23 00:38:35 [INFO] [TRAIN] epoch=45, iter=16730/80000, loss=0.9413, lr=0.008097, batch_cost=1.3648, reader_cost=0.0001 | ETA 23:59:09 2021-02-23 00:38:49 [INFO] [TRAIN] epoch=45, iter=16740/80000, loss=0.8252, lr=0.008095, batch_cost=1.3232, reader_cost=0.0001 | ETA 23:15:08 2021-02-23 00:39:03 [INFO] [TRAIN] epoch=46, iter=16750/80000, loss=0.8498, lr=0.008094, batch_cost=1.4570, reader_cost=0.0712 | ETA 25:35:52 2021-02-23 00:39:17 [INFO] [TRAIN] epoch=46, iter=16760/80000, loss=0.8664, lr=0.008093, batch_cost=1.3579, reader_cost=0.0001 | ETA 23:51:15 2021-02-23 00:39:30 [INFO] [TRAIN] epoch=46, iter=16770/80000, loss=0.8731, lr=0.008092, batch_cost=1.3750, reader_cost=0.0001 | ETA 24:09:02 2021-02-23 00:39:44 [INFO] [TRAIN] epoch=46, iter=16780/80000, loss=0.9499, lr=0.008091, batch_cost=1.3295, reader_cost=0.0001 | ETA 23:20:49 2021-02-23 00:39:57 [INFO] [TRAIN] epoch=46, iter=16790/80000, loss=0.8754, lr=0.008090, batch_cost=1.3616, reader_cost=0.0001 | ETA 23:54:25 2021-02-23 00:40:11 [INFO] [TRAIN] epoch=46, iter=16800/80000, loss=1.0777, lr=0.008089, batch_cost=1.3650, reader_cost=0.0001 | ETA 23:57:46 2021-02-23 00:40:25 [INFO] [TRAIN] epoch=46, iter=16810/80000, loss=0.9374, lr=0.008087, batch_cost=1.3624, reader_cost=0.0001 | ETA 23:54:51 2021-02-23 00:40:38 [INFO] [TRAIN] epoch=46, iter=16820/80000, loss=0.9352, lr=0.008086, batch_cost=1.3190, reader_cost=0.0001 | ETA 23:08:55 2021-02-23 00:40:51 [INFO] [TRAIN] epoch=46, iter=16830/80000, loss=0.8978, lr=0.008085, batch_cost=1.3404, reader_cost=0.0001 | ETA 23:31:11 2021-02-23 00:41:05 [INFO] [TRAIN] epoch=46, iter=16840/80000, loss=0.8389, lr=0.008084, batch_cost=1.3565, reader_cost=0.0001 | ETA 23:47:53 2021-02-23 00:41:18 [INFO] [TRAIN] epoch=46, iter=16850/80000, loss=1.1389, lr=0.008083, batch_cost=1.3304, reader_cost=0.0001 | ETA 23:20:16 2021-02-23 00:41:32 [INFO] [TRAIN] epoch=46, iter=16860/80000, loss=0.8846, lr=0.008082, batch_cost=1.3481, reader_cost=0.0001 | ETA 23:38:39 2021-02-23 00:41:45 [INFO] [TRAIN] epoch=46, iter=16870/80000, loss=1.0463, lr=0.008080, batch_cost=1.3627, reader_cost=0.0001 | ETA 23:53:49 2021-02-23 00:41:59 [INFO] [TRAIN] epoch=46, iter=16880/80000, loss=0.9208, lr=0.008079, batch_cost=1.3392, reader_cost=0.0001 | ETA 23:28:50 2021-02-23 00:42:12 [INFO] [TRAIN] epoch=46, iter=16890/80000, loss=0.8971, lr=0.008078, batch_cost=1.3724, reader_cost=0.0001 | ETA 24:03:34 2021-02-23 00:42:26 [INFO] [TRAIN] epoch=46, iter=16900/80000, loss=0.8635, lr=0.008077, batch_cost=1.3461, reader_cost=0.0001 | ETA 23:35:37 2021-02-23 00:42:40 [INFO] [TRAIN] epoch=46, iter=16910/80000, loss=0.9557, lr=0.008076, batch_cost=1.3773, reader_cost=0.0001 | ETA 24:08:14 2021-02-23 00:42:53 [INFO] [TRAIN] epoch=46, iter=16920/80000, loss=0.9710, lr=0.008075, batch_cost=1.3683, reader_cost=0.0001 | ETA 23:58:33 2021-02-23 00:43:06 [INFO] [TRAIN] epoch=46, iter=16930/80000, loss=0.9514, lr=0.008074, batch_cost=1.3279, reader_cost=0.0001 | ETA 23:15:52 2021-02-23 00:43:20 [INFO] [TRAIN] epoch=46, iter=16940/80000, loss=0.8571, lr=0.008072, batch_cost=1.3695, reader_cost=0.0001 | ETA 23:59:22 2021-02-23 00:43:34 [INFO] [TRAIN] epoch=46, iter=16950/80000, loss=0.8952, lr=0.008071, batch_cost=1.3680, reader_cost=0.0001 | ETA 23:57:30 2021-02-23 00:43:47 [INFO] [TRAIN] epoch=46, iter=16960/80000, loss=0.9632, lr=0.008070, batch_cost=1.3343, reader_cost=0.0001 | ETA 23:21:55 2021-02-23 00:44:01 [INFO] [TRAIN] epoch=46, iter=16970/80000, loss=0.9302, lr=0.008069, batch_cost=1.3612, reader_cost=0.0001 | ETA 23:49:53 2021-02-23 00:44:14 [INFO] [TRAIN] epoch=46, iter=16980/80000, loss=0.9376, lr=0.008068, batch_cost=1.3420, reader_cost=0.0001 | ETA 23:29:30 2021-02-23 00:44:28 [INFO] [TRAIN] epoch=46, iter=16990/80000, loss=0.8086, lr=0.008067, batch_cost=1.3511, reader_cost=0.0001 | ETA 23:38:54 2021-02-23 00:44:41 [INFO] [TRAIN] epoch=46, iter=17000/80000, loss=0.9190, lr=0.008066, batch_cost=1.3724, reader_cost=0.0001 | ETA 24:01:00 2021-02-23 00:44:41 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:18 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:05 - batch_cost: 0.2146 - reader cost: 0.0898  3/125 [..............................] - ETA: 59s - batch_cost: 0.2813 - reader cost: 0.1143  4/125 [..............................] - ETA: 58s - batch_cost: 0.3261 - reader cost: 0.1375 5/125 [>.............................] - ETA: 56s - batch_cost: 0.3465 - reader cost: 0.1459 6/125 [>.............................] - ETA: 55s - batch_cost: 0.3656 - reader cost: 0.1551 7/125 [>.............................] - ETA: 54s - batch_cost: 0.3748 - reader cost: 0.1582 8/125 [>.............................] - ETA: 53s - batch_cost: 0.3807 - reader cost: 0.1597 9/125 [=>............................] - ETA: 52s - batch_cost: 0.3866 - reader cost: 0.1621 10/125 [=>............................] - ETA: 52s - batch_cost: 0.3908 - reader cost: 0.1638 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3895 - reader cost: 0.1600 12/125 [=>............................] - ETA: 50s - batch_cost: 0.3940 - reader cost: 0.1619 13/125 [==>...........................] - ETA: 50s - batch_cost: 0.3995 - reader cost: 0.1649 14/125 [==>...........................] - ETA: 49s - batch_cost: 0.3981 - reader cost: 0.1623 15/125 [==>...........................] - ETA: 48s - batch_cost: 0.3969 - reader cost: 0.1598 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3994 - reader cost: 0.1610 17/125 [===>..........................] - ETA: 47s - batch_cost: 0.4021 - reader cost: 0.1630 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.4017 - reader cost: 0.1620 19/125 [===>..........................] - ETA: 46s - batch_cost: 0.4031 - reader cost: 0.1628 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4043 - reader cost: 0.1637 21/125 [====>.........................] - ETA: 45s - batch_cost: 0.4070 - reader cost: 0.1654 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4064 - reader cost: 0.1641 23/125 [====>.........................] - ETA: 44s - batch_cost: 0.4070 - reader cost: 0.1641 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4077 - reader cost: 0.1645 25/125 [=====>........................] - ETA: 43s - batch_cost: 0.4063 - reader cost: 0.1627 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4079 - reader cost: 0.1637 27/125 [=====>........................] - ETA: 42s - batch_cost: 0.4092 - reader cost: 0.1644 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4080 - reader cost: 0.1630 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4084 - reader cost: 0.1633 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4078 - reader cost: 0.1624 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4082 - reader cost: 0.1627 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4090 - reader cost: 0.1632 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4094 - reader cost: 0.1634 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4084 - reader cost: 0.1623 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4094 - reader cost: 0.1610 36/125 [=======>......................] - ETA: 38s - batch_cost: 0.4099 - reader cost: 0.1598 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4103 - reader cost: 0.1601 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4103 - reader cost: 0.1590 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4111 - reader cost: 0.1568 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4110 - reader cost: 0.1537 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4126 - reader cost: 0.1528 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4129 - reader cost: 0.1519 43/125 [=========>....................] - ETA: 35s - batch_cost: 0.4136 - reader cost: 0.1526 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4126 - reader cost: 0.1513 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4126 - reader cost: 0.1514 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4130 - reader cost: 0.1521 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4133 - reader cost: 0.1524 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4132 - reader cost: 0.1514 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4139 - reader cost: 0.1499 50/125 [===========>..................] - ETA: 32s - batch_cost: 0.4144 - reader cost: 0.1478 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4144 - reader cost: 0.1472 52/125 [===========>..................] - ETA: 31s - batch_cost: 0.4149 - reader cost: 0.1476 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4151 - reader cost: 0.1482 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4154 - reader cost: 0.1488 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4149 - reader cost: 0.1482 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4151 - reader cost: 0.1484 57/125 [============>.................] - ETA: 29s - batch_cost: 0.4158 - reader cost: 0.1494 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4163 - reader cost: 0.1502 59/125 [=============>................] - ETA: 28s - batch_cost: 0.4156 - reader cost: 0.1498 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4158 - reader cost: 0.1503 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4165 - reader cost: 0.1512 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4169 - reader cost: 0.1517 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4169 - reader cost: 0.1519 64/125 [==============>...............] - ETA: 26s - batch_cost: 0.4172 - reader cost: 0.1523 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4175 - reader cost: 0.1528 66/125 [==============>...............] - ETA: 25s - batch_cost: 0.4178 - reader cost: 0.1533 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4182 - reader cost: 0.1538 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4174 - reader cost: 0.1532 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4174 - reader cost: 0.1534 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4177 - reader cost: 0.1538 71/125 [================>.............] - ETA: 23s - batch_cost: 0.4178 - reader cost: 0.1541 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4174 - reader cost: 0.1538 73/125 [================>.............] - ETA: 22s - batch_cost: 0.4177 - reader cost: 0.1543 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4174 - reader cost: 0.1539 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4173 - reader cost: 0.1540 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4176 - reader cost: 0.1543 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4170 - reader cost: 0.1538 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4172 - reader cost: 0.1542 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4165 - reader cost: 0.1536 80/125 [==================>...........] - ETA: 19s - batch_cost: 0.4163 - reader cost: 0.1536 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4166 - reader cost: 0.1538 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4162 - reader cost: 0.1535 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4162 - reader cost: 0.1535 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4161 - reader cost: 0.1536 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4162 - reader cost: 0.1539 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4162 - reader cost: 0.1534 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4164 - reader cost: 0.1537 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4164 - reader cost: 0.1533 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4166 - reader cost: 0.1537 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4166 - reader cost: 0.1538 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4171 - reader cost: 0.1545 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4168 - reader cost: 0.1542 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4170 - reader cost: 0.1544 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4163 - reader cost: 0.1539 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4168 - reader cost: 0.1546 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4165 - reader cost: 0.1543 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4159 - reader cost: 0.1539 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4161 - reader cost: 0.1541 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4162 - reader cost: 0.1539 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4163 - reader cost: 0.1532 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4164 - reader cost: 0.1528 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4161 - reader cost: 0.1525  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4163 - reader cost: 0.1527 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4163 - reader cost: 0.1525 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4159 - reader cost: 0.1523 106/125 [========================>.....] - ETA: 8s - batch_cost: 0.4162 - reader cost: 0.1527 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4161 - reader cost: 0.1525 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4162 - reader cost: 0.1528 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4164 - reader cost: 0.1530 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4164 - reader cost: 0.1531 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4161 - reader cost: 0.1529 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4159 - reader cost: 0.1528 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4157 - reader cost: 0.1527 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4158 - reader cost: 0.1529 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4159 - reader cost: 0.1532 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4162 - reader cost: 0.1535 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4164 - reader cost: 0.1538 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4166 - reader cost: 0.1540 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4163 - reader cost: 0.1538 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4160 - reader cost: 0.1536 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4160 - reader cost: 0.1537 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4162 - reader cost: 0.1540 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4166 - reader cost: 0.1544 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4169 - reader cost: 0.1547 125/125 [==============================] - 53s 422ms/step - batch_cost: 0.4169 - reader cost: 0.1548 2021-02-23 00:45:34 [INFO] [EVAL] #Images=500 mIoU=0.6925 Acc=0.9451 Kappa=0.9289 2021-02-23 00:45:34 [INFO] [EVAL] Class IoU: [0.9738 0.7976 0.8958 0.3791 0.4838 0.5624 0.6415 0.7583 0.9003 0.5747 0.9186 0.8007 0.598 0.9267 0.3021 0.7349 0.5674 0.5916 0.751 ] 2021-02-23 00:45:34 [INFO] [EVAL] Class Acc: [0.9889 0.872 0.9447 0.8183 0.5405 0.8134 0.873 0.9082 0.9474 0.6977 0.9304 0.8766 0.7303 0.9506 0.9872 0.8322 0.7718 0.8184 0.8457] 2021-02-23 00:45:38 [INFO] [EVAL] The model with the best validation mIoU (0.7322) was saved at iter 11000. 2021-02-23 00:45:52 [INFO] [TRAIN] epoch=46, iter=17010/80000, loss=0.8681, lr=0.008064, batch_cost=1.3558, reader_cost=0.0001 | ETA 23:43:23 2021-02-23 00:46:05 [INFO] [TRAIN] epoch=46, iter=17020/80000, loss=0.9207, lr=0.008063, batch_cost=1.3333, reader_cost=0.0001 | ETA 23:19:34 2021-02-23 00:46:19 [INFO] [TRAIN] epoch=46, iter=17030/80000, loss=0.9648, lr=0.008062, batch_cost=1.3487, reader_cost=0.0001 | ETA 23:35:25 2021-02-23 00:46:32 [INFO] [TRAIN] epoch=46, iter=17040/80000, loss=0.9155, lr=0.008061, batch_cost=1.3474, reader_cost=0.0001 | ETA 23:33:49 2021-02-23 00:46:46 [INFO] [TRAIN] epoch=46, iter=17050/80000, loss=0.9849, lr=0.008060, batch_cost=1.3636, reader_cost=0.0001 | ETA 23:50:35 2021-02-23 00:46:59 [INFO] [TRAIN] epoch=46, iter=17060/80000, loss=0.9223, lr=0.008059, batch_cost=1.3334, reader_cost=0.0001 | ETA 23:18:45 2021-02-23 00:47:13 [INFO] [TRAIN] epoch=46, iter=17070/80000, loss=0.9294, lr=0.008057, batch_cost=1.3719, reader_cost=0.0001 | ETA 23:58:51 2021-02-23 00:47:27 [INFO] [TRAIN] epoch=46, iter=17080/80000, loss=0.9384, lr=0.008056, batch_cost=1.3862, reader_cost=0.0001 | ETA 24:13:40 2021-02-23 00:47:40 [INFO] [TRAIN] epoch=46, iter=17090/80000, loss=0.9100, lr=0.008055, batch_cost=1.3554, reader_cost=0.0001 | ETA 23:41:09 2021-02-23 00:47:54 [INFO] [TRAIN] epoch=46, iter=17100/80000, loss=0.9000, lr=0.008054, batch_cost=1.3494, reader_cost=0.0001 | ETA 23:34:40 2021-02-23 00:48:07 [INFO] [TRAIN] epoch=46, iter=17110/80000, loss=0.9527, lr=0.008053, batch_cost=1.3427, reader_cost=0.0001 | ETA 23:27:23 2021-02-23 00:48:22 [INFO] [TRAIN] epoch=47, iter=17120/80000, loss=0.8621, lr=0.008052, batch_cost=1.4665, reader_cost=0.0727 | ETA 25:36:52 2021-02-23 00:48:35 [INFO] [TRAIN] epoch=47, iter=17130/80000, loss=0.9704, lr=0.008051, batch_cost=1.3573, reader_cost=0.0001 | ETA 23:42:15 2021-02-23 00:48:49 [INFO] [TRAIN] epoch=47, iter=17140/80000, loss=1.0298, lr=0.008049, batch_cost=1.3673, reader_cost=0.0001 | ETA 23:52:26 2021-02-23 00:49:03 [INFO] [TRAIN] epoch=47, iter=17150/80000, loss=0.8603, lr=0.008048, batch_cost=1.3563, reader_cost=0.0001 | ETA 23:40:46 2021-02-23 00:49:16 [INFO] [TRAIN] epoch=47, iter=17160/80000, loss=0.9294, lr=0.008047, batch_cost=1.3537, reader_cost=0.0001 | ETA 23:37:44 2021-02-23 00:49:30 [INFO] [TRAIN] epoch=47, iter=17170/80000, loss=0.9619, lr=0.008046, batch_cost=1.3704, reader_cost=0.0001 | ETA 23:55:05 2021-02-23 00:49:43 [INFO] [TRAIN] epoch=47, iter=17180/80000, loss=0.8785, lr=0.008045, batch_cost=1.3630, reader_cost=0.0001 | ETA 23:47:02 2021-02-23 00:49:57 [INFO] [TRAIN] epoch=47, iter=17190/80000, loss=0.9303, lr=0.008044, batch_cost=1.3642, reader_cost=0.0001 | ETA 23:48:07 2021-02-23 00:50:11 [INFO] [TRAIN] epoch=47, iter=17200/80000, loss=0.8897, lr=0.008042, batch_cost=1.3617, reader_cost=0.0001 | ETA 23:45:12 2021-02-23 00:50:24 [INFO] [TRAIN] epoch=47, iter=17210/80000, loss=0.9742, lr=0.008041, batch_cost=1.3592, reader_cost=0.0001 | ETA 23:42:22 2021-02-23 00:50:38 [INFO] [TRAIN] epoch=47, iter=17220/80000, loss=0.8826, lr=0.008040, batch_cost=1.3461, reader_cost=0.0001 | ETA 23:28:25 2021-02-23 00:50:52 [INFO] [TRAIN] epoch=47, iter=17230/80000, loss=0.8774, lr=0.008039, batch_cost=1.3958, reader_cost=0.0001 | ETA 24:20:13 2021-02-23 00:51:05 [INFO] [TRAIN] epoch=47, iter=17240/80000, loss=0.8932, lr=0.008038, batch_cost=1.3393, reader_cost=0.0001 | ETA 23:20:52 2021-02-23 00:51:19 [INFO] [TRAIN] epoch=47, iter=17250/80000, loss=0.9900, lr=0.008037, batch_cost=1.3637, reader_cost=0.0001 | ETA 23:46:11 2021-02-23 00:51:32 [INFO] [TRAIN] epoch=47, iter=17260/80000, loss=0.9035, lr=0.008036, batch_cost=1.3510, reader_cost=0.0001 | ETA 23:32:43 2021-02-23 00:51:46 [INFO] [TRAIN] epoch=47, iter=17270/80000, loss=1.0157, lr=0.008034, batch_cost=1.3804, reader_cost=0.0001 | ETA 24:03:15 2021-02-23 00:52:00 [INFO] [TRAIN] epoch=47, iter=17280/80000, loss=1.0497, lr=0.008033, batch_cost=1.3710, reader_cost=0.0001 | ETA 23:53:06 2021-02-23 00:52:13 [INFO] [TRAIN] epoch=47, iter=17290/80000, loss=1.0540, lr=0.008032, batch_cost=1.3387, reader_cost=0.0001 | ETA 23:19:07 2021-02-23 00:52:27 [INFO] [TRAIN] epoch=47, iter=17300/80000, loss=0.8898, lr=0.008031, batch_cost=1.3811, reader_cost=0.0001 | ETA 24:03:15 2021-02-23 00:52:41 [INFO] [TRAIN] epoch=47, iter=17310/80000, loss=0.8561, lr=0.008030, batch_cost=1.3726, reader_cost=0.0001 | ETA 23:54:11 2021-02-23 00:52:54 [INFO] [TRAIN] epoch=47, iter=17320/80000, loss=0.9567, lr=0.008029, batch_cost=1.3433, reader_cost=0.0001 | ETA 23:23:16 2021-02-23 00:53:08 [INFO] [TRAIN] epoch=47, iter=17330/80000, loss=0.9380, lr=0.008027, batch_cost=1.3603, reader_cost=0.0001 | ETA 23:40:52 2021-02-23 00:53:22 [INFO] [TRAIN] epoch=47, iter=17340/80000, loss=0.8912, lr=0.008026, batch_cost=1.3796, reader_cost=0.0001 | ETA 24:00:44 2021-02-23 00:53:35 [INFO] [TRAIN] epoch=47, iter=17350/80000, loss=0.9274, lr=0.008025, batch_cost=1.3767, reader_cost=0.0001 | ETA 23:57:30 2021-02-23 00:53:49 [INFO] [TRAIN] epoch=47, iter=17360/80000, loss=0.9122, lr=0.008024, batch_cost=1.3549, reader_cost=0.0001 | ETA 23:34:29 2021-02-23 00:54:02 [INFO] [TRAIN] epoch=47, iter=17370/80000, loss=0.8565, lr=0.008023, batch_cost=1.3394, reader_cost=0.0001 | ETA 23:18:03 2021-02-23 00:54:16 [INFO] [TRAIN] epoch=47, iter=17380/80000, loss=1.0926, lr=0.008022, batch_cost=1.3520, reader_cost=0.0001 | ETA 23:31:02 2021-02-23 00:54:29 [INFO] [TRAIN] epoch=47, iter=17390/80000, loss=1.0530, lr=0.008021, batch_cost=1.3560, reader_cost=0.0001 | ETA 23:34:56 2021-02-23 00:54:43 [INFO] [TRAIN] epoch=47, iter=17400/80000, loss=0.9062, lr=0.008019, batch_cost=1.3675, reader_cost=0.0001 | ETA 23:46:45 2021-02-23 00:54:57 [INFO] [TRAIN] epoch=47, iter=17410/80000, loss=0.9106, lr=0.008018, batch_cost=1.3644, reader_cost=0.0001 | ETA 23:43:20 2021-02-23 00:55:10 [INFO] [TRAIN] epoch=47, iter=17420/80000, loss=0.9799, lr=0.008017, batch_cost=1.3596, reader_cost=0.0001 | ETA 23:38:00 2021-02-23 00:55:24 [INFO] [TRAIN] epoch=47, iter=17430/80000, loss=0.9695, lr=0.008016, batch_cost=1.3443, reader_cost=0.0001 | ETA 23:21:54 2021-02-23 00:55:37 [INFO] [TRAIN] epoch=47, iter=17440/80000, loss=0.9676, lr=0.008015, batch_cost=1.3425, reader_cost=0.0001 | ETA 23:19:45 2021-02-23 00:55:51 [INFO] [TRAIN] epoch=47, iter=17450/80000, loss=0.9653, lr=0.008014, batch_cost=1.3554, reader_cost=0.0001 | ETA 23:32:58 2021-02-23 00:56:04 [INFO] [TRAIN] epoch=47, iter=17460/80000, loss=0.9951, lr=0.008012, batch_cost=1.3447, reader_cost=0.0001 | ETA 23:21:36 2021-02-23 00:56:18 [INFO] [TRAIN] epoch=47, iter=17470/80000, loss=0.8673, lr=0.008011, batch_cost=1.3401, reader_cost=0.0001 | ETA 23:16:33 2021-02-23 00:56:31 [INFO] [TRAIN] epoch=47, iter=17480/80000, loss=0.8932, lr=0.008010, batch_cost=1.3704, reader_cost=0.0001 | ETA 23:48:00 2021-02-23 00:56:46 [INFO] [TRAIN] epoch=48, iter=17490/80000, loss=1.1004, lr=0.008009, batch_cost=1.4398, reader_cost=0.0711 | ETA 25:00:00 2021-02-23 00:56:59 [INFO] [TRAIN] epoch=48, iter=17500/80000, loss=0.8735, lr=0.008008, batch_cost=1.3746, reader_cost=0.0001 | ETA 23:51:49 2021-02-23 00:57:13 [INFO] [TRAIN] epoch=48, iter=17510/80000, loss=0.8769, lr=0.008007, batch_cost=1.3344, reader_cost=0.0001 | ETA 23:09:46 2021-02-23 00:57:26 [INFO] [TRAIN] epoch=48, iter=17520/80000, loss=0.9234, lr=0.008006, batch_cost=1.3516, reader_cost=0.0001 | ETA 23:27:30 2021-02-23 00:57:40 [INFO] [TRAIN] epoch=48, iter=17530/80000, loss=0.9208, lr=0.008004, batch_cost=1.3295, reader_cost=0.0001 | ETA 23:04:13 2021-02-23 00:57:53 [INFO] [TRAIN] epoch=48, iter=17540/80000, loss=0.9575, lr=0.008003, batch_cost=1.3579, reader_cost=0.0001 | ETA 23:33:36 2021-02-23 00:58:07 [INFO] [TRAIN] epoch=48, iter=17550/80000, loss=0.9262, lr=0.008002, batch_cost=1.3909, reader_cost=0.0001 | ETA 24:07:41 2021-02-23 00:58:20 [INFO] [TRAIN] epoch=48, iter=17560/80000, loss=0.9745, lr=0.008001, batch_cost=1.3380, reader_cost=0.0001 | ETA 23:12:25 2021-02-23 00:58:34 [INFO] [TRAIN] epoch=48, iter=17570/80000, loss=0.7888, lr=0.008000, batch_cost=1.3667, reader_cost=0.0001 | ETA 23:42:05 2021-02-23 00:58:48 [INFO] [TRAIN] epoch=48, iter=17580/80000, loss=0.9465, lr=0.007999, batch_cost=1.3600, reader_cost=0.0001 | ETA 23:34:49 2021-02-23 00:59:01 [INFO] [TRAIN] epoch=48, iter=17590/80000, loss=0.8334, lr=0.007997, batch_cost=1.3632, reader_cost=0.0001 | ETA 23:37:59 2021-02-23 00:59:15 [INFO] [TRAIN] epoch=48, iter=17600/80000, loss=1.0188, lr=0.007996, batch_cost=1.3527, reader_cost=0.0001 | ETA 23:26:48 2021-02-23 00:59:28 [INFO] [TRAIN] epoch=48, iter=17610/80000, loss=0.9397, lr=0.007995, batch_cost=1.3609, reader_cost=0.0001 | ETA 23:35:05 2021-02-23 00:59:42 [INFO] [TRAIN] epoch=48, iter=17620/80000, loss=0.9501, lr=0.007994, batch_cost=1.3819, reader_cost=0.0001 | ETA 23:56:44 2021-02-23 00:59:56 [INFO] [TRAIN] epoch=48, iter=17630/80000, loss=0.8227, lr=0.007993, batch_cost=1.3522, reader_cost=0.0001 | ETA 23:25:34 2021-02-23 01:00:09 [INFO] [TRAIN] epoch=48, iter=17640/80000, loss=0.9514, lr=0.007992, batch_cost=1.3620, reader_cost=0.0001 | ETA 23:35:35 2021-02-23 01:00:23 [INFO] [TRAIN] epoch=48, iter=17650/80000, loss=0.9904, lr=0.007991, batch_cost=1.3595, reader_cost=0.0001 | ETA 23:32:45 2021-02-23 01:00:37 [INFO] [TRAIN] epoch=48, iter=17660/80000, loss=0.9684, lr=0.007989, batch_cost=1.3591, reader_cost=0.0001 | ETA 23:32:07 2021-02-23 01:00:50 [INFO] [TRAIN] epoch=48, iter=17670/80000, loss=0.8768, lr=0.007988, batch_cost=1.3601, reader_cost=0.0001 | ETA 23:32:57 2021-02-23 01:01:04 [INFO] [TRAIN] epoch=48, iter=17680/80000, loss=0.9356, lr=0.007987, batch_cost=1.3486, reader_cost=0.0001 | ETA 23:20:41 2021-02-23 01:01:17 [INFO] [TRAIN] epoch=48, iter=17690/80000, loss=0.8628, lr=0.007986, batch_cost=1.3717, reader_cost=0.0001 | ETA 23:44:31 2021-02-23 01:01:31 [INFO] [TRAIN] epoch=48, iter=17700/80000, loss=0.9318, lr=0.007985, batch_cost=1.3552, reader_cost=0.0001 | ETA 23:27:08 2021-02-23 01:01:44 [INFO] [TRAIN] epoch=48, iter=17710/80000, loss=0.9837, lr=0.007984, batch_cost=1.3520, reader_cost=0.0001 | ETA 23:23:37 2021-02-23 01:01:58 [INFO] [TRAIN] epoch=48, iter=17720/80000, loss=0.9154, lr=0.007983, batch_cost=1.3480, reader_cost=0.0001 | ETA 23:19:16 2021-02-23 01:02:12 [INFO] [TRAIN] epoch=48, iter=17730/80000, loss=0.8941, lr=0.007981, batch_cost=1.3725, reader_cost=0.0001 | ETA 23:44:27 2021-02-23 01:02:25 [INFO] [TRAIN] epoch=48, iter=17740/80000, loss=0.9272, lr=0.007980, batch_cost=1.3637, reader_cost=0.0001 | ETA 23:35:02 2021-02-23 01:02:39 [INFO] [TRAIN] epoch=48, iter=17750/80000, loss=0.8751, lr=0.007979, batch_cost=1.3572, reader_cost=0.0001 | ETA 23:28:04 2021-02-23 01:02:53 [INFO] [TRAIN] epoch=48, iter=17760/80000, loss=0.9195, lr=0.007978, batch_cost=1.3724, reader_cost=0.0001 | ETA 23:43:35 2021-02-23 01:03:06 [INFO] [TRAIN] epoch=48, iter=17770/80000, loss=0.8697, lr=0.007977, batch_cost=1.3364, reader_cost=0.0001 | ETA 23:06:02 2021-02-23 01:03:20 [INFO] [TRAIN] epoch=48, iter=17780/80000, loss=0.9204, lr=0.007976, batch_cost=1.3840, reader_cost=0.0001 | ETA 23:55:14 2021-02-23 01:03:33 [INFO] [TRAIN] epoch=48, iter=17790/80000, loss=0.9317, lr=0.007974, batch_cost=1.3681, reader_cost=0.0001 | ETA 23:38:28 2021-02-23 01:03:47 [INFO] [TRAIN] epoch=48, iter=17800/80000, loss=0.9334, lr=0.007973, batch_cost=1.3486, reader_cost=0.0001 | ETA 23:18:01 2021-02-23 01:04:01 [INFO] [TRAIN] epoch=48, iter=17810/80000, loss=0.9052, lr=0.007972, batch_cost=1.3665, reader_cost=0.0001 | ETA 23:36:25 2021-02-23 01:04:14 [INFO] [TRAIN] epoch=48, iter=17820/80000, loss=0.9740, lr=0.007971, batch_cost=1.3749, reader_cost=0.0001 | ETA 23:44:51 2021-02-23 01:04:28 [INFO] [TRAIN] epoch=48, iter=17830/80000, loss=0.8933, lr=0.007970, batch_cost=1.3559, reader_cost=0.0001 | ETA 23:24:55 2021-02-23 01:04:41 [INFO] [TRAIN] epoch=48, iter=17840/80000, loss=0.8966, lr=0.007969, batch_cost=1.3525, reader_cost=0.0001 | ETA 23:21:13 2021-02-23 01:04:55 [INFO] [TRAIN] epoch=48, iter=17850/80000, loss=0.9079, lr=0.007968, batch_cost=1.3618, reader_cost=0.0001 | ETA 23:30:34 2021-02-23 01:05:10 [INFO] [TRAIN] epoch=49, iter=17860/80000, loss=0.8784, lr=0.007966, batch_cost=1.4469, reader_cost=0.0648 | ETA 24:58:29 2021-02-23 01:05:23 [INFO] [TRAIN] epoch=49, iter=17870/80000, loss=0.9723, lr=0.007965, batch_cost=1.3510, reader_cost=0.0001 | ETA 23:18:57 2021-02-23 01:05:37 [INFO] [TRAIN] epoch=49, iter=17880/80000, loss=0.9534, lr=0.007964, batch_cost=1.3547, reader_cost=0.0001 | ETA 23:22:32 2021-02-23 01:05:50 [INFO] [TRAIN] epoch=49, iter=17890/80000, loss=0.8519, lr=0.007963, batch_cost=1.3778, reader_cost=0.0001 | ETA 23:46:16 2021-02-23 01:06:04 [INFO] [TRAIN] epoch=49, iter=17900/80000, loss=0.8631, lr=0.007962, batch_cost=1.3406, reader_cost=0.0001 | ETA 23:07:29 2021-02-23 01:06:17 [INFO] [TRAIN] epoch=49, iter=17910/80000, loss=0.8973, lr=0.007961, batch_cost=1.3627, reader_cost=0.0001 | ETA 23:30:11 2021-02-23 01:06:31 [INFO] [TRAIN] epoch=49, iter=17920/80000, loss=0.8991, lr=0.007959, batch_cost=1.3658, reader_cost=0.0001 | ETA 23:33:09 2021-02-23 01:06:45 [INFO] [TRAIN] epoch=49, iter=17930/80000, loss=0.9381, lr=0.007958, batch_cost=1.3503, reader_cost=0.0001 | ETA 23:16:52 2021-02-23 01:06:58 [INFO] [TRAIN] epoch=49, iter=17940/80000, loss=1.0695, lr=0.007957, batch_cost=1.3469, reader_cost=0.0001 | ETA 23:13:06 2021-02-23 01:07:12 [INFO] [TRAIN] epoch=49, iter=17950/80000, loss=0.9055, lr=0.007956, batch_cost=1.3699, reader_cost=0.0001 | ETA 23:36:43 2021-02-23 01:07:25 [INFO] [TRAIN] epoch=49, iter=17960/80000, loss=0.9199, lr=0.007955, batch_cost=1.3742, reader_cost=0.0001 | ETA 23:40:57 2021-02-23 01:07:39 [INFO] [TRAIN] epoch=49, iter=17970/80000, loss=0.8477, lr=0.007954, batch_cost=1.3709, reader_cost=0.0001 | ETA 23:37:14 2021-02-23 01:07:53 [INFO] [TRAIN] epoch=49, iter=17980/80000, loss=0.9944, lr=0.007953, batch_cost=1.3844, reader_cost=0.0001 | ETA 23:51:01 2021-02-23 01:08:07 [INFO] [TRAIN] epoch=49, iter=17990/80000, loss=0.9588, lr=0.007951, batch_cost=1.3553, reader_cost=0.0001 | ETA 23:20:44 2021-02-23 01:08:20 [INFO] [TRAIN] epoch=49, iter=18000/80000, loss=0.8993, lr=0.007950, batch_cost=1.3332, reader_cost=0.0001 | ETA 22:57:39 2021-02-23 01:08:20 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:16 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:03 - batch_cost: 0.2087 - reader cost: 0.0825  3/125 [..............................] - ETA: 1:00 - batch_cost: 0.2858 - reader cost: 0.1195 4/125 [..............................] - ETA: 57s - batch_cost: 0.3227 - reader cost: 0.1339  5/125 [>.............................] - ETA: 54s - batch_cost: 0.3344 - reader cost: 0.1335 6/125 [>.............................] - ETA: 53s - batch_cost: 0.3501 - reader cost: 0.1407 7/125 [>.............................] - ETA: 53s - batch_cost: 0.3614 - reader cost: 0.1458 8/125 [>.............................] - ETA: 52s - batch_cost: 0.3696 - reader cost: 0.1486 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3763 - reader cost: 0.1521 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3813 - reader cost: 0.1543 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3855 - reader cost: 0.1563 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3885 - reader cost: 0.1576 13/125 [==>...........................] - ETA: 49s - batch_cost: 0.3919 - reader cost: 0.1597 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3920 - reader cost: 0.1585 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3945 - reader cost: 0.1600 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3933 - reader cost: 0.1576 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3925 - reader cost: 0.1550 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3926 - reader cost: 0.1521 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3946 - reader cost: 0.1527 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3963 - reader cost: 0.1537 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.3984 - reader cost: 0.1531 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4007 - reader cost: 0.1544 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4005 - reader cost: 0.1517 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.3998 - reader cost: 0.1506 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4014 - reader cost: 0.1521 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4024 - reader cost: 0.1531 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4042 - reader cost: 0.1550 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4051 - reader cost: 0.1558 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4061 - reader cost: 0.1568 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4058 - reader cost: 0.1564 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4065 - reader cost: 0.1570 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4078 - reader cost: 0.1579 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4075 - reader cost: 0.1577 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4091 - reader cost: 0.1590 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4096 - reader cost: 0.1595 36/125 [=======>......................] - ETA: 38s - batch_cost: 0.4103 - reader cost: 0.1600 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4109 - reader cost: 0.1605 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4112 - reader cost: 0.1608 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4119 - reader cost: 0.1613 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4112 - reader cost: 0.1607 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4118 - reader cost: 0.1611 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4124 - reader cost: 0.1617 43/125 [=========>....................] - ETA: 35s - batch_cost: 0.4131 - reader cost: 0.1622 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4132 - reader cost: 0.1623 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4140 - reader cost: 0.1629 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4145 - reader cost: 0.1634 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4152 - reader cost: 0.1641 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4155 - reader cost: 0.1643 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4156 - reader cost: 0.1645 50/125 [===========>..................] - ETA: 32s - batch_cost: 0.4161 - reader cost: 0.1649 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4164 - reader cost: 0.1652 52/125 [===========>..................] - ETA: 31s - batch_cost: 0.4166 - reader cost: 0.1653 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4168 - reader cost: 0.1655 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4170 - reader cost: 0.1658 55/125 [============>.................] - ETA: 30s - batch_cost: 0.4175 - reader cost: 0.1661 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4175 - reader cost: 0.1661 57/125 [============>.................] - ETA: 29s - batch_cost: 0.4178 - reader cost: 0.1662 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4171 - reader cost: 0.1656 59/125 [=============>................] - ETA: 28s - batch_cost: 0.4173 - reader cost: 0.1658 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4178 - reader cost: 0.1662 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4181 - reader cost: 0.1664 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4179 - reader cost: 0.1662 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4172 - reader cost: 0.1655 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4164 - reader cost: 0.1647 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4156 - reader cost: 0.1639 66/125 [==============>...............] - ETA: 25s - batch_cost: 0.4148 - reader cost: 0.1631 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4150 - reader cost: 0.1633 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4154 - reader cost: 0.1637 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4157 - reader cost: 0.1639 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4152 - reader cost: 0.1634 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4153 - reader cost: 0.1636 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4155 - reader cost: 0.1638 73/125 [================>.............] - ETA: 22s - batch_cost: 0.4155 - reader cost: 0.1637 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4151 - reader cost: 0.1633 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4148 - reader cost: 0.1630 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4151 - reader cost: 0.1632 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4151 - reader cost: 0.1633 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4153 - reader cost: 0.1634 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4146 - reader cost: 0.1628 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4141 - reader cost: 0.1623 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4146 - reader cost: 0.1628 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4149 - reader cost: 0.1631 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4144 - reader cost: 0.1627 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4142 - reader cost: 0.1625 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4144 - reader cost: 0.1627 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4141 - reader cost: 0.1623 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4136 - reader cost: 0.1619 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4138 - reader cost: 0.1621 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4139 - reader cost: 0.1622 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4142 - reader cost: 0.1625 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4142 - reader cost: 0.1625 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4136 - reader cost: 0.1619 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4131 - reader cost: 0.1614 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4130 - reader cost: 0.1613 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4132 - reader cost: 0.1616 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4133 - reader cost: 0.1617 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4129 - reader cost: 0.1612 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4131 - reader cost: 0.1614 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4127 - reader cost: 0.1609 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4121 - reader cost: 0.1603 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4119 - reader cost: 0.1601 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4122 - reader cost: 0.1602  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4123 - reader cost: 0.1603 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4120 - reader cost: 0.1600 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4122 - reader cost: 0.1599 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4123 - reader cost: 0.1600 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4125 - reader cost: 0.1601 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4121 - reader cost: 0.1598 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4124 - reader cost: 0.1601 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4125 - reader cost: 0.1602 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4127 - reader cost: 0.1603 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4130 - reader cost: 0.1606 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4132 - reader cost: 0.1607 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4134 - reader cost: 0.1609 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4130 - reader cost: 0.1605 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4131 - reader cost: 0.1607 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4133 - reader cost: 0.1609 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4130 - reader cost: 0.1606 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4126 - reader cost: 0.1601 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4125 - reader cost: 0.1600 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4127 - reader cost: 0.1602 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4129 - reader cost: 0.1604 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4130 - reader cost: 0.1605 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4126 - reader cost: 0.1602 125/125 [==============================] - 52s 417ms/step - batch_cost: 0.4123 - reader cost: 0.1599 2021-02-23 01:09:12 [INFO] [EVAL] #Images=500 mIoU=0.6793 Acc=0.9393 Kappa=0.9211 2021-02-23 01:09:12 [INFO] [EVAL] Class IoU: [0.9592 0.7531 0.8954 0.3406 0.5373 0.5027 0.6352 0.7445 0.9107 0.5517 0.9317 0.7872 0.5693 0.8971 0.3654 0.6304 0.6067 0.5505 0.7389] 2021-02-23 01:09:12 [INFO] [EVAL] Class Acc: [0.9777 0.9013 0.9416 0.7055 0.7604 0.6462 0.7812 0.9409 0.9442 0.8367 0.957 0.8624 0.7058 0.9352 0.3742 0.9551 0.9323 0.7506 0.8525] 2021-02-23 01:09:16 [INFO] [EVAL] The model with the best validation mIoU (0.7322) was saved at iter 11000. 2021-02-23 01:09:30 [INFO] [TRAIN] epoch=49, iter=18010/80000, loss=0.9243, lr=0.007949, batch_cost=1.3480, reader_cost=0.0001 | ETA 23:12:42 2021-02-23 01:09:43 [INFO] [TRAIN] epoch=49, iter=18020/80000, loss=1.0390, lr=0.007948, batch_cost=1.3789, reader_cost=0.0001 | ETA 23:44:21 2021-02-23 01:09:57 [INFO] [TRAIN] epoch=49, iter=18030/80000, loss=0.9339, lr=0.007947, batch_cost=1.3621, reader_cost=0.0001 | ETA 23:26:50 2021-02-23 01:10:11 [INFO] [TRAIN] epoch=49, iter=18040/80000, loss=0.9009, lr=0.007946, batch_cost=1.3693, reader_cost=0.0001 | ETA 23:34:04 2021-02-23 01:10:24 [INFO] [TRAIN] epoch=49, iter=18050/80000, loss=0.8907, lr=0.007944, batch_cost=1.3346, reader_cost=0.0001 | ETA 22:57:56 2021-02-23 01:10:38 [INFO] [TRAIN] epoch=49, iter=18060/80000, loss=0.9893, lr=0.007943, batch_cost=1.3657, reader_cost=0.0001 | ETA 23:29:52 2021-02-23 01:10:52 [INFO] [TRAIN] epoch=49, iter=18070/80000, loss=1.0378, lr=0.007942, batch_cost=1.3714, reader_cost=0.0001 | ETA 23:35:31 2021-02-23 01:11:05 [INFO] [TRAIN] epoch=49, iter=18080/80000, loss=0.9935, lr=0.007941, batch_cost=1.3770, reader_cost=0.0001 | ETA 23:41:01 2021-02-23 01:11:19 [INFO] [TRAIN] epoch=49, iter=18090/80000, loss=0.8765, lr=0.007940, batch_cost=1.3692, reader_cost=0.0001 | ETA 23:32:44 2021-02-23 01:11:33 [INFO] [TRAIN] epoch=49, iter=18100/80000, loss=0.9408, lr=0.007939, batch_cost=1.3582, reader_cost=0.0001 | ETA 23:21:10 2021-02-23 01:11:46 [INFO] [TRAIN] epoch=49, iter=18110/80000, loss=0.8613, lr=0.007938, batch_cost=1.3537, reader_cost=0.0001 | ETA 23:16:18 2021-02-23 01:12:00 [INFO] [TRAIN] epoch=49, iter=18120/80000, loss=1.0069, lr=0.007936, batch_cost=1.3869, reader_cost=0.0001 | ETA 23:50:18 2021-02-23 01:12:14 [INFO] [TRAIN] epoch=49, iter=18130/80000, loss=0.8362, lr=0.007935, batch_cost=1.3607, reader_cost=0.0001 | ETA 23:23:06 2021-02-23 01:12:27 [INFO] [TRAIN] epoch=49, iter=18140/80000, loss=0.9722, lr=0.007934, batch_cost=1.3542, reader_cost=0.0001 | ETA 23:16:13 2021-02-23 01:12:41 [INFO] [TRAIN] epoch=49, iter=18150/80000, loss=0.9028, lr=0.007933, batch_cost=1.3800, reader_cost=0.0001 | ETA 23:42:31 2021-02-23 01:12:55 [INFO] [TRAIN] epoch=49, iter=18160/80000, loss=1.0088, lr=0.007932, batch_cost=1.3578, reader_cost=0.0001 | ETA 23:19:23 2021-02-23 01:13:08 [INFO] [TRAIN] epoch=49, iter=18170/80000, loss=0.8682, lr=0.007931, batch_cost=1.3392, reader_cost=0.0001 | ETA 23:00:04 2021-02-23 01:13:22 [INFO] [TRAIN] epoch=49, iter=18180/80000, loss=0.8736, lr=0.007929, batch_cost=1.3624, reader_cost=0.0001 | ETA 23:23:44 2021-02-23 01:13:35 [INFO] [TRAIN] epoch=49, iter=18190/80000, loss=1.0129, lr=0.007928, batch_cost=1.3591, reader_cost=0.0001 | ETA 23:20:07 2021-02-23 01:13:49 [INFO] [TRAIN] epoch=49, iter=18200/80000, loss=1.1584, lr=0.007927, batch_cost=1.3514, reader_cost=0.0001 | ETA 23:11:54 2021-02-23 01:14:03 [INFO] [TRAIN] epoch=49, iter=18210/80000, loss=0.8925, lr=0.007926, batch_cost=1.4032, reader_cost=0.0001 | ETA 24:05:03 2021-02-23 01:14:16 [INFO] [TRAIN] epoch=49, iter=18220/80000, loss=0.9857, lr=0.007925, batch_cost=1.3769, reader_cost=0.0001 | ETA 23:37:45 2021-02-23 01:14:31 [INFO] [TRAIN] epoch=50, iter=18230/80000, loss=0.8550, lr=0.007924, batch_cost=1.4210, reader_cost=0.0690 | ETA 24:22:53 2021-02-23 01:14:44 [INFO] [TRAIN] epoch=50, iter=18240/80000, loss=1.0149, lr=0.007922, batch_cost=1.3781, reader_cost=0.0001 | ETA 23:38:32 2021-02-23 01:14:58 [INFO] [TRAIN] epoch=50, iter=18250/80000, loss=1.0168, lr=0.007921, batch_cost=1.3625, reader_cost=0.0001 | ETA 23:22:15 2021-02-23 01:15:12 [INFO] [TRAIN] epoch=50, iter=18260/80000, loss=0.8679, lr=0.007920, batch_cost=1.3758, reader_cost=0.0001 | ETA 23:35:43 2021-02-23 01:15:25 [INFO] [TRAIN] epoch=50, iter=18270/80000, loss=0.8975, lr=0.007919, batch_cost=1.3409, reader_cost=0.0001 | ETA 22:59:31 2021-02-23 01:15:39 [INFO] [TRAIN] epoch=50, iter=18280/80000, loss=1.0030, lr=0.007918, batch_cost=1.3533, reader_cost=0.0001 | ETA 23:12:04 2021-02-23 01:15:52 [INFO] [TRAIN] epoch=50, iter=18290/80000, loss=0.9103, lr=0.007917, batch_cost=1.3668, reader_cost=0.0001 | ETA 23:25:47 2021-02-23 01:16:06 [INFO] [TRAIN] epoch=50, iter=18300/80000, loss=0.9122, lr=0.007916, batch_cost=1.3388, reader_cost=0.0001 | ETA 22:56:46 2021-02-23 01:16:19 [INFO] [TRAIN] epoch=50, iter=18310/80000, loss=0.9016, lr=0.007914, batch_cost=1.3501, reader_cost=0.0001 | ETA 23:08:07 2021-02-23 01:16:33 [INFO] [TRAIN] epoch=50, iter=18320/80000, loss=0.8713, lr=0.007913, batch_cost=1.3619, reader_cost=0.0001 | ETA 23:20:02 2021-02-23 01:16:47 [INFO] [TRAIN] epoch=50, iter=18330/80000, loss=0.8852, lr=0.007912, batch_cost=1.3933, reader_cost=0.0001 | ETA 23:52:05 2021-02-23 01:17:00 [INFO] [TRAIN] epoch=50, iter=18340/80000, loss=0.8859, lr=0.007911, batch_cost=1.3403, reader_cost=0.0001 | ETA 22:57:19 2021-02-23 01:17:14 [INFO] [TRAIN] epoch=50, iter=18350/80000, loss=0.9169, lr=0.007910, batch_cost=1.3892, reader_cost=0.0001 | ETA 23:47:25 2021-02-23 01:17:28 [INFO] [TRAIN] epoch=50, iter=18360/80000, loss=0.9073, lr=0.007909, batch_cost=1.3544, reader_cost=0.0001 | ETA 23:11:28 2021-02-23 01:17:41 [INFO] [TRAIN] epoch=50, iter=18370/80000, loss=1.0218, lr=0.007907, batch_cost=1.3619, reader_cost=0.0001 | ETA 23:18:52 2021-02-23 01:17:55 [INFO] [TRAIN] epoch=50, iter=18380/80000, loss=0.8173, lr=0.007906, batch_cost=1.3460, reader_cost=0.0001 | ETA 23:02:21 2021-02-23 01:18:08 [INFO] [TRAIN] epoch=50, iter=18390/80000, loss=0.9995, lr=0.007905, batch_cost=1.3508, reader_cost=0.0001 | ETA 23:07:02 2021-02-23 01:18:22 [INFO] [TRAIN] epoch=50, iter=18400/80000, loss=1.0661, lr=0.007904, batch_cost=1.3469, reader_cost=0.0001 | ETA 23:02:49 2021-02-23 01:18:35 [INFO] [TRAIN] epoch=50, iter=18410/80000, loss=0.9592, lr=0.007903, batch_cost=1.3547, reader_cost=0.0001 | ETA 23:10:37 2021-02-23 01:18:49 [INFO] [TRAIN] epoch=50, iter=18420/80000, loss=0.8572, lr=0.007902, batch_cost=1.3565, reader_cost=0.0001 | ETA 23:12:14 2021-02-23 01:19:03 [INFO] [TRAIN] epoch=50, iter=18430/80000, loss=0.9848, lr=0.007901, batch_cost=1.3777, reader_cost=0.0001 | ETA 23:33:43 2021-02-23 01:19:16 [INFO] [TRAIN] epoch=50, iter=18440/80000, loss=1.0733, lr=0.007899, batch_cost=1.3457, reader_cost=0.0001 | ETA 23:00:38 2021-02-23 01:19:30 [INFO] [TRAIN] epoch=50, iter=18450/80000, loss=0.9512, lr=0.007898, batch_cost=1.3789, reader_cost=0.0001 | ETA 23:34:33 2021-02-23 01:19:43 [INFO] [TRAIN] epoch=50, iter=18460/80000, loss=0.9807, lr=0.007897, batch_cost=1.3594, reader_cost=0.0001 | ETA 23:14:16 2021-02-23 01:19:57 [INFO] [TRAIN] epoch=50, iter=18470/80000, loss=1.0006, lr=0.007896, batch_cost=1.3498, reader_cost=0.0001 | ETA 23:04:16 2021-02-23 01:20:11 [INFO] [TRAIN] epoch=50, iter=18480/80000, loss=0.8528, lr=0.007895, batch_cost=1.3759, reader_cost=0.0001 | ETA 23:30:45 2021-02-23 01:20:25 [INFO] [TRAIN] epoch=50, iter=18490/80000, loss=0.9139, lr=0.007894, batch_cost=1.3760, reader_cost=0.0001 | ETA 23:30:35 2021-02-23 01:20:38 [INFO] [TRAIN] epoch=50, iter=18500/80000, loss=0.9897, lr=0.007892, batch_cost=1.3376, reader_cost=0.0001 | ETA 22:51:02 2021-02-23 01:20:52 [INFO] [TRAIN] epoch=50, iter=18510/80000, loss=0.8662, lr=0.007891, batch_cost=1.3631, reader_cost=0.0001 | ETA 23:16:57 2021-02-23 01:21:05 [INFO] [TRAIN] epoch=50, iter=18520/80000, loss=0.9643, lr=0.007890, batch_cost=1.3725, reader_cost=0.0001 | ETA 23:26:22 2021-02-23 01:21:19 [INFO] [TRAIN] epoch=50, iter=18530/80000, loss=1.0157, lr=0.007889, batch_cost=1.3590, reader_cost=0.0001 | ETA 23:12:19 2021-02-23 01:21:33 [INFO] [TRAIN] epoch=50, iter=18540/80000, loss=0.9044, lr=0.007888, batch_cost=1.3805, reader_cost=0.0001 | ETA 23:34:06 2021-02-23 01:21:46 [INFO] [TRAIN] epoch=50, iter=18550/80000, loss=0.9125, lr=0.007887, batch_cost=1.3575, reader_cost=0.0001 | ETA 23:10:21 2021-02-23 01:22:00 [INFO] [TRAIN] epoch=50, iter=18560/80000, loss=0.8795, lr=0.007886, batch_cost=1.3429, reader_cost=0.0001 | ETA 22:55:08 2021-02-23 01:22:13 [INFO] [TRAIN] epoch=50, iter=18570/80000, loss=0.9075, lr=0.007884, batch_cost=1.3519, reader_cost=0.0001 | ETA 23:04:06 2021-02-23 01:22:27 [INFO] [TRAIN] epoch=50, iter=18580/80000, loss=0.9257, lr=0.007883, batch_cost=1.3626, reader_cost=0.0001 | ETA 23:14:51 2021-02-23 01:22:40 [INFO] [TRAIN] epoch=50, iter=18590/80000, loss=0.9305, lr=0.007882, batch_cost=1.3496, reader_cost=0.0001 | ETA 23:01:21 2021-02-23 01:22:54 [INFO] [TRAIN] epoch=50, iter=18600/80000, loss=0.9429, lr=0.007881, batch_cost=1.3309, reader_cost=0.0001 | ETA 22:41:54 2021-02-23 01:23:08 [INFO] [TRAIN] epoch=51, iter=18610/80000, loss=0.9619, lr=0.007880, batch_cost=1.4813, reader_cost=0.0793 | ETA 25:15:33 2021-02-23 01:23:22 [INFO] [TRAIN] epoch=51, iter=18620/80000, loss=0.9047, lr=0.007879, batch_cost=1.3347, reader_cost=0.0001 | ETA 22:45:25 2021-02-23 01:23:36 [INFO] [TRAIN] epoch=51, iter=18630/80000, loss=0.8853, lr=0.007877, batch_cost=1.3857, reader_cost=0.0001 | ETA 23:37:18 2021-02-23 01:23:49 [INFO] [TRAIN] epoch=51, iter=18640/80000, loss=0.9579, lr=0.007876, batch_cost=1.3611, reader_cost=0.0001 | ETA 23:11:55 2021-02-23 01:24:02 [INFO] [TRAIN] epoch=51, iter=18650/80000, loss=0.8225, lr=0.007875, batch_cost=1.3244, reader_cost=0.0001 | ETA 22:34:14 2021-02-23 01:24:16 [INFO] [TRAIN] epoch=51, iter=18660/80000, loss=0.8322, lr=0.007874, batch_cost=1.3721, reader_cost=0.0001 | ETA 23:22:47 2021-02-23 01:24:30 [INFO] [TRAIN] epoch=51, iter=18670/80000, loss=0.9062, lr=0.007873, batch_cost=1.3460, reader_cost=0.0001 | ETA 22:55:48 2021-02-23 01:24:44 [INFO] [TRAIN] epoch=51, iter=18680/80000, loss=0.9909, lr=0.007872, batch_cost=1.3925, reader_cost=0.0001 | ETA 23:43:09 2021-02-23 01:24:57 [INFO] [TRAIN] epoch=51, iter=18690/80000, loss=0.9485, lr=0.007871, batch_cost=1.3502, reader_cost=0.0001 | ETA 22:59:40 2021-02-23 01:25:11 [INFO] [TRAIN] epoch=51, iter=18700/80000, loss=0.9782, lr=0.007869, batch_cost=1.3621, reader_cost=0.0001 | ETA 23:11:37 2021-02-23 01:25:24 [INFO] [TRAIN] epoch=51, iter=18710/80000, loss=1.0939, lr=0.007868, batch_cost=1.3695, reader_cost=0.0001 | ETA 23:18:59 2021-02-23 01:25:38 [INFO] [TRAIN] epoch=51, iter=18720/80000, loss=0.8804, lr=0.007867, batch_cost=1.3552, reader_cost=0.0001 | ETA 23:04:04 2021-02-23 01:25:52 [INFO] [TRAIN] epoch=51, iter=18730/80000, loss=0.9242, lr=0.007866, batch_cost=1.3795, reader_cost=0.0001 | ETA 23:28:43 2021-02-23 01:26:05 [INFO] [TRAIN] epoch=51, iter=18740/80000, loss=0.8522, lr=0.007865, batch_cost=1.3472, reader_cost=0.0001 | ETA 22:55:27 2021-02-23 01:26:19 [INFO] [TRAIN] epoch=51, iter=18750/80000, loss=0.9537, lr=0.007864, batch_cost=1.3554, reader_cost=0.0001 | ETA 23:03:35 2021-02-23 01:26:32 [INFO] [TRAIN] epoch=51, iter=18760/80000, loss=0.9110, lr=0.007862, batch_cost=1.3427, reader_cost=0.0001 | ETA 22:50:28 2021-02-23 01:26:46 [INFO] [TRAIN] epoch=51, iter=18770/80000, loss=1.0575, lr=0.007861, batch_cost=1.3561, reader_cost=0.0001 | ETA 23:03:53 2021-02-23 01:26:59 [INFO] [TRAIN] epoch=51, iter=18780/80000, loss=0.8796, lr=0.007860, batch_cost=1.3370, reader_cost=0.0001 | ETA 22:44:09 2021-02-23 01:27:13 [INFO] [TRAIN] epoch=51, iter=18790/80000, loss=0.9235, lr=0.007859, batch_cost=1.3621, reader_cost=0.0001 | ETA 23:09:35 2021-02-23 01:27:27 [INFO] [TRAIN] epoch=51, iter=18800/80000, loss=1.0105, lr=0.007858, batch_cost=1.3806, reader_cost=0.0001 | ETA 23:28:11 2021-02-23 01:27:40 [INFO] [TRAIN] epoch=51, iter=18810/80000, loss=0.8661, lr=0.007857, batch_cost=1.3595, reader_cost=0.0001 | ETA 23:06:27 2021-02-23 01:27:54 [INFO] [TRAIN] epoch=51, iter=18820/80000, loss=0.9496, lr=0.007856, batch_cost=1.3515, reader_cost=0.0001 | ETA 22:58:02 2021-02-23 01:28:07 [INFO] [TRAIN] epoch=51, iter=18830/80000, loss=0.8875, lr=0.007854, batch_cost=1.3484, reader_cost=0.0001 | ETA 22:54:40 2021-02-23 01:28:21 [INFO] [TRAIN] epoch=51, iter=18840/80000, loss=0.8963, lr=0.007853, batch_cost=1.3405, reader_cost=0.0001 | ETA 22:46:26 2021-02-23 01:28:34 [INFO] [TRAIN] epoch=51, iter=18850/80000, loss=0.8801, lr=0.007852, batch_cost=1.3572, reader_cost=0.0001 | ETA 23:03:14 2021-02-23 01:28:48 [INFO] [TRAIN] epoch=51, iter=18860/80000, loss=0.8802, lr=0.007851, batch_cost=1.3800, reader_cost=0.0001 | ETA 23:26:12 2021-02-23 01:29:01 [INFO] [TRAIN] epoch=51, iter=18870/80000, loss=0.9942, lr=0.007850, batch_cost=1.3485, reader_cost=0.0001 | ETA 22:53:53 2021-02-23 01:29:15 [INFO] [TRAIN] epoch=51, iter=18880/80000, loss=1.0087, lr=0.007849, batch_cost=1.3324, reader_cost=0.0001 | ETA 22:37:14 2021-02-23 01:29:28 [INFO] [TRAIN] epoch=51, iter=18890/80000, loss=0.9386, lr=0.007847, batch_cost=1.3540, reader_cost=0.0001 | ETA 22:59:05 2021-02-23 01:29:42 [INFO] [TRAIN] epoch=51, iter=18900/80000, loss=0.9146, lr=0.007846, batch_cost=1.3600, reader_cost=0.0001 | ETA 23:04:58 2021-02-23 01:29:56 [INFO] [TRAIN] epoch=51, iter=18910/80000, loss=0.8568, lr=0.007845, batch_cost=1.3785, reader_cost=0.0001 | ETA 23:23:34 2021-02-23 01:30:09 [INFO] [TRAIN] epoch=51, iter=18920/80000, loss=0.9458, lr=0.007844, batch_cost=1.3525, reader_cost=0.0001 | ETA 22:56:51 2021-02-23 01:30:23 [INFO] [TRAIN] epoch=51, iter=18930/80000, loss=0.9633, lr=0.007843, batch_cost=1.3427, reader_cost=0.0001 | ETA 22:46:38 2021-02-23 01:30:36 [INFO] [TRAIN] epoch=51, iter=18940/80000, loss=0.9004, lr=0.007842, batch_cost=1.3637, reader_cost=0.0001 | ETA 23:07:45 2021-02-23 01:30:50 [INFO] [TRAIN] epoch=51, iter=18950/80000, loss=0.8941, lr=0.007840, batch_cost=1.3658, reader_cost=0.0001 | ETA 23:09:42 2021-02-23 01:31:03 [INFO] [TRAIN] epoch=51, iter=18960/80000, loss=1.0386, lr=0.007839, batch_cost=1.3528, reader_cost=0.0001 | ETA 22:56:16 2021-02-23 01:31:17 [INFO] [TRAIN] epoch=51, iter=18970/80000, loss=0.8219, lr=0.007838, batch_cost=1.3209, reader_cost=0.0001 | ETA 22:23:32 2021-02-23 01:31:31 [INFO] [TRAIN] epoch=52, iter=18980/80000, loss=0.8965, lr=0.007837, batch_cost=1.4551, reader_cost=0.0774 | ETA 24:39:49 2021-02-23 01:31:45 [INFO] [TRAIN] epoch=52, iter=18990/80000, loss=0.9516, lr=0.007836, batch_cost=1.3882, reader_cost=0.0001 | ETA 23:31:34 2021-02-23 01:31:59 [INFO] [TRAIN] epoch=52, iter=19000/80000, loss=0.8667, lr=0.007835, batch_cost=1.3597, reader_cost=0.0001 | ETA 23:02:20 2021-02-23 01:31:59 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:17 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:01 - batch_cost: 0.1902 - reader cost: 0.0661  3/125 [..............................] - ETA: 58s - batch_cost: 0.2727 - reader cost: 0.1065  4/125 [..............................] - ETA: 57s - batch_cost: 0.3147 - reader cost: 0.1258 5/125 [>.............................] - ETA: 55s - batch_cost: 0.3412 - reader cost: 0.1397 6/125 [>.............................] - ETA: 55s - batch_cost: 0.3593 - reader cost: 0.1501 7/125 [>.............................] - ETA: 54s - batch_cost: 0.3700 - reader cost: 0.1539 8/125 [>.............................] - ETA: 53s - batch_cost: 0.3772 - reader cost: 0.1566 9/125 [=>............................] - ETA: 52s - batch_cost: 0.3834 - reader cost: 0.1598 10/125 [=>............................] - ETA: 51s - batch_cost: 0.3845 - reader cost: 0.1578 11/125 [=>............................] - ETA: 51s - batch_cost: 0.3907 - reader cost: 0.1613 12/125 [=>............................] - ETA: 50s - batch_cost: 0.3924 - reader cost: 0.1608 13/125 [==>...........................] - ETA: 49s - batch_cost: 0.3911 - reader cost: 0.1580 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3896 - reader cost: 0.1549 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3930 - reader cost: 0.1566 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3954 - reader cost: 0.1583 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3964 - reader cost: 0.1584 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.3989 - reader cost: 0.1594 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3976 - reader cost: 0.1575 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.3978 - reader cost: 0.1567 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.3988 - reader cost: 0.1571 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.3995 - reader cost: 0.1551 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.3996 - reader cost: 0.1549 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.3980 - reader cost: 0.1530 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.3997 - reader cost: 0.1546 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4002 - reader cost: 0.1531 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.3997 - reader cost: 0.1520 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4008 - reader cost: 0.1527 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4020 - reader cost: 0.1539 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4027 - reader cost: 0.1545 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.4036 - reader cost: 0.1554 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4045 - reader cost: 0.1541 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4050 - reader cost: 0.1517 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4063 - reader cost: 0.1506 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4067 - reader cost: 0.1512 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4074 - reader cost: 0.1516 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4078 - reader cost: 0.1522 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4087 - reader cost: 0.1530 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4088 - reader cost: 0.1532 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4099 - reader cost: 0.1542 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4105 - reader cost: 0.1547 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4106 - reader cost: 0.1550 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4113 - reader cost: 0.1558 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4116 - reader cost: 0.1562 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4121 - reader cost: 0.1567 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4124 - reader cost: 0.1571 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4140 - reader cost: 0.1584 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4143 - reader cost: 0.1587 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4136 - reader cost: 0.1582 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4138 - reader cost: 0.1585 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4143 - reader cost: 0.1591 52/125 [===========>..................] - ETA: 31s - batch_cost: 0.4147 - reader cost: 0.1593 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4151 - reader cost: 0.1599 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4151 - reader cost: 0.1599 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4158 - reader cost: 0.1604 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4163 - reader cost: 0.1608 57/125 [============>.................] - ETA: 29s - batch_cost: 0.4166 - reader cost: 0.1611 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4167 - reader cost: 0.1614 59/125 [=============>................] - ETA: 28s - batch_cost: 0.4169 - reader cost: 0.1616 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4173 - reader cost: 0.1620 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4176 - reader cost: 0.1623 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4179 - reader cost: 0.1627 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4184 - reader cost: 0.1633 64/125 [==============>...............] - ETA: 26s - batch_cost: 0.4185 - reader cost: 0.1634 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4188 - reader cost: 0.1636 66/125 [==============>...............] - ETA: 25s - batch_cost: 0.4190 - reader cost: 0.1638 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4187 - reader cost: 0.1633 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4187 - reader cost: 0.1634 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4181 - reader cost: 0.1628 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4173 - reader cost: 0.1621 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4167 - reader cost: 0.1615 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4168 - reader cost: 0.1617 73/125 [================>.............] - ETA: 22s - batch_cost: 0.4164 - reader cost: 0.1614 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4164 - reader cost: 0.1615 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4165 - reader cost: 0.1617 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4161 - reader cost: 0.1610 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4163 - reader cost: 0.1612 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4161 - reader cost: 0.1610 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4163 - reader cost: 0.1612 80/125 [==================>...........] - ETA: 19s - batch_cost: 0.4159 - reader cost: 0.1606 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4162 - reader cost: 0.1609 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4164 - reader cost: 0.1612 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4158 - reader cost: 0.1607 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4159 - reader cost: 0.1608 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4158 - reader cost: 0.1604 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4156 - reader cost: 0.1603 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4156 - reader cost: 0.1602 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4151 - reader cost: 0.1598 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4152 - reader cost: 0.1599 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4152 - reader cost: 0.1596 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4150 - reader cost: 0.1593 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4154 - reader cost: 0.1599 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4156 - reader cost: 0.1601 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4161 - reader cost: 0.1607 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4156 - reader cost: 0.1602 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4151 - reader cost: 0.1597 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4153 - reader cost: 0.1599 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4155 - reader cost: 0.1601 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4157 - reader cost: 0.1604 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4159 - reader cost: 0.1606 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4157 - reader cost: 0.1605 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4161 - reader cost: 0.1608  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4156 - reader cost: 0.1604 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4154 - reader cost: 0.1602 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4154 - reader cost: 0.1603 106/125 [========================>.....] - ETA: 8s - batch_cost: 0.4156 - reader cost: 0.1605 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4152 - reader cost: 0.1601 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4147 - reader cost: 0.1596 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4144 - reader cost: 0.1593 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4141 - reader cost: 0.1591 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4142 - reader cost: 0.1593 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4144 - reader cost: 0.1595 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4146 - reader cost: 0.1598 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4148 - reader cost: 0.1600 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4150 - reader cost: 0.1602 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4148 - reader cost: 0.1601 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4149 - reader cost: 0.1603 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4145 - reader cost: 0.1599 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4144 - reader cost: 0.1597 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4147 - reader cost: 0.1599 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4149 - reader cost: 0.1601 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4144 - reader cost: 0.1597 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4146 - reader cost: 0.1599 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4147 - reader cost: 0.1599 125/125 [==============================] - 52s 420ms/step - batch_cost: 0.4149 - reader cost: 0.1601 2021-02-23 01:32:51 [INFO] [EVAL] #Images=500 mIoU=0.7167 Acc=0.9520 Kappa=0.9377 2021-02-23 01:32:51 [INFO] [EVAL] Class IoU: [0.976 0.8238 0.9072 0.3892 0.432 0.6327 0.6847 0.7701 0.916 0.575 0.943 0.8075 0.5642 0.9331 0.586 0.7941 0.7345 0.3951 0.7529] 2021-02-23 01:32:51 [INFO] [EVAL] Class Acc: [0.9864 0.9144 0.9334 0.7328 0.7992 0.796 0.7815 0.8715 0.9635 0.6855 0.9663 0.8902 0.8659 0.955 0.974 0.9444 0.9345 0.8538 0.8238] 2021-02-23 01:32:55 [INFO] [EVAL] The model with the best validation mIoU (0.7322) was saved at iter 11000. 2021-02-23 01:33:09 [INFO] [TRAIN] epoch=52, iter=19010/80000, loss=0.9138, lr=0.007834, batch_cost=1.3574, reader_cost=0.0001 | ETA 22:59:47 2021-02-23 01:33:22 [INFO] [TRAIN] epoch=52, iter=19020/80000, loss=0.9422, lr=0.007832, batch_cost=1.3422, reader_cost=0.0001 | ETA 22:44:09 2021-02-23 01:33:36 [INFO] [TRAIN] epoch=52, iter=19030/80000, loss=0.9222, lr=0.007831, batch_cost=1.3351, reader_cost=0.0001 | ETA 22:36:38 2021-02-23 01:33:49 [INFO] [TRAIN] epoch=52, iter=19040/80000, loss=0.8702, lr=0.007830, batch_cost=1.3518, reader_cost=0.0001 | ETA 22:53:23 2021-02-23 01:34:03 [INFO] [TRAIN] epoch=52, iter=19050/80000, loss=0.9500, lr=0.007829, batch_cost=1.3600, reader_cost=0.0001 | ETA 23:01:33 2021-02-23 01:34:17 [INFO] [TRAIN] epoch=52, iter=19060/80000, loss=0.7985, lr=0.007828, batch_cost=1.4052, reader_cost=0.0001 | ETA 23:47:11 2021-02-23 01:34:30 [INFO] [TRAIN] epoch=52, iter=19070/80000, loss=0.9331, lr=0.007827, batch_cost=1.3759, reader_cost=0.0001 | ETA 23:17:13 2021-02-23 01:34:44 [INFO] [TRAIN] epoch=52, iter=19080/80000, loss=0.9594, lr=0.007825, batch_cost=1.3544, reader_cost=0.0001 | ETA 22:55:13 2021-02-23 01:34:58 [INFO] [TRAIN] epoch=52, iter=19090/80000, loss=0.8602, lr=0.007824, batch_cost=1.3604, reader_cost=0.0001 | ETA 23:00:59 2021-02-23 01:35:11 [INFO] [TRAIN] epoch=52, iter=19100/80000, loss=0.9021, lr=0.007823, batch_cost=1.3753, reader_cost=0.0001 | ETA 23:15:54 2021-02-23 01:35:25 [INFO] [TRAIN] epoch=52, iter=19110/80000, loss=0.9058, lr=0.007822, batch_cost=1.3452, reader_cost=0.0001 | ETA 22:45:11 2021-02-23 01:35:38 [INFO] [TRAIN] epoch=52, iter=19120/80000, loss=0.8056, lr=0.007821, batch_cost=1.3412, reader_cost=0.0001 | ETA 22:40:54 2021-02-23 01:35:52 [INFO] [TRAIN] epoch=52, iter=19130/80000, loss=1.0809, lr=0.007820, batch_cost=1.3596, reader_cost=0.0001 | ETA 22:59:21 2021-02-23 01:36:05 [INFO] [TRAIN] epoch=52, iter=19140/80000, loss=0.9438, lr=0.007819, batch_cost=1.3403, reader_cost=0.0001 | ETA 22:39:29 2021-02-23 01:36:19 [INFO] [TRAIN] epoch=52, iter=19150/80000, loss=0.9431, lr=0.007817, batch_cost=1.3576, reader_cost=0.0001 | ETA 22:56:48 2021-02-23 01:36:32 [INFO] [TRAIN] epoch=52, iter=19160/80000, loss=0.9113, lr=0.007816, batch_cost=1.3523, reader_cost=0.0001 | ETA 22:51:12 2021-02-23 01:36:46 [INFO] [TRAIN] epoch=52, iter=19170/80000, loss=0.9132, lr=0.007815, batch_cost=1.3500, reader_cost=0.0001 | ETA 22:48:41 2021-02-23 01:37:00 [INFO] [TRAIN] epoch=52, iter=19180/80000, loss=0.9635, lr=0.007814, batch_cost=1.3691, reader_cost=0.0001 | ETA 23:07:48 2021-02-23 01:37:13 [INFO] [TRAIN] epoch=52, iter=19190/80000, loss=0.9653, lr=0.007813, batch_cost=1.3626, reader_cost=0.0001 | ETA 23:01:01 2021-02-23 01:37:27 [INFO] [TRAIN] epoch=52, iter=19200/80000, loss=0.9253, lr=0.007812, batch_cost=1.3381, reader_cost=0.0001 | ETA 22:35:56 2021-02-23 01:37:40 [INFO] [TRAIN] epoch=52, iter=19210/80000, loss=1.0234, lr=0.007810, batch_cost=1.3801, reader_cost=0.0001 | ETA 23:18:16 2021-02-23 01:37:54 [INFO] [TRAIN] epoch=52, iter=19220/80000, loss=1.0200, lr=0.007809, batch_cost=1.3621, reader_cost=0.0001 | ETA 22:59:46 2021-02-23 01:38:08 [INFO] [TRAIN] epoch=52, iter=19230/80000, loss=0.9441, lr=0.007808, batch_cost=1.3760, reader_cost=0.0001 | ETA 23:13:40 2021-02-23 01:38:21 [INFO] [TRAIN] epoch=52, iter=19240/80000, loss=0.9401, lr=0.007807, batch_cost=1.3448, reader_cost=0.0001 | ETA 22:41:49 2021-02-23 01:38:35 [INFO] [TRAIN] epoch=52, iter=19250/80000, loss=1.0299, lr=0.007806, batch_cost=1.3584, reader_cost=0.0001 | ETA 22:55:24 2021-02-23 01:38:48 [INFO] [TRAIN] epoch=52, iter=19260/80000, loss=1.0007, lr=0.007805, batch_cost=1.3539, reader_cost=0.0001 | ETA 22:50:38 2021-02-23 01:39:02 [INFO] [TRAIN] epoch=52, iter=19270/80000, loss=0.9332, lr=0.007803, batch_cost=1.3792, reader_cost=0.0001 | ETA 23:15:56 2021-02-23 01:39:16 [INFO] [TRAIN] epoch=52, iter=19280/80000, loss=0.9054, lr=0.007802, batch_cost=1.3543, reader_cost=0.0001 | ETA 22:50:30 2021-02-23 01:39:29 [INFO] [TRAIN] epoch=52, iter=19290/80000, loss=0.8643, lr=0.007801, batch_cost=1.3409, reader_cost=0.0001 | ETA 22:36:43 2021-02-23 01:39:43 [INFO] [TRAIN] epoch=52, iter=19300/80000, loss=0.8720, lr=0.007800, batch_cost=1.3554, reader_cost=0.0001 | ETA 22:51:11 2021-02-23 01:39:56 [INFO] [TRAIN] epoch=52, iter=19310/80000, loss=0.9677, lr=0.007799, batch_cost=1.3557, reader_cost=0.0001 | ETA 22:51:17 2021-02-23 01:40:10 [INFO] [TRAIN] epoch=52, iter=19320/80000, loss=0.9053, lr=0.007798, batch_cost=1.3431, reader_cost=0.0001 | ETA 22:38:18 2021-02-23 01:40:23 [INFO] [TRAIN] epoch=52, iter=19330/80000, loss=0.9446, lr=0.007797, batch_cost=1.3463, reader_cost=0.0001 | ETA 22:41:17 2021-02-23 01:40:37 [INFO] [TRAIN] epoch=52, iter=19340/80000, loss=0.9411, lr=0.007795, batch_cost=1.3687, reader_cost=0.0001 | ETA 23:03:43 2021-02-23 01:40:51 [INFO] [TRAIN] epoch=53, iter=19350/80000, loss=0.9332, lr=0.007794, batch_cost=1.4454, reader_cost=0.0535 | ETA 24:21:01 2021-02-23 01:41:05 [INFO] [TRAIN] epoch=53, iter=19360/80000, loss=0.8461, lr=0.007793, batch_cost=1.3818, reader_cost=0.0001 | ETA 23:16:32 2021-02-23 01:41:19 [INFO] [TRAIN] epoch=53, iter=19370/80000, loss=0.8809, lr=0.007792, batch_cost=1.3697, reader_cost=0.0001 | ETA 23:04:02 2021-02-23 01:41:32 [INFO] [TRAIN] epoch=53, iter=19380/80000, loss=0.8689, lr=0.007791, batch_cost=1.3692, reader_cost=0.0001 | ETA 23:03:18 2021-02-23 01:41:46 [INFO] [TRAIN] epoch=53, iter=19390/80000, loss=0.9058, lr=0.007790, batch_cost=1.3586, reader_cost=0.0001 | ETA 22:52:27 2021-02-23 01:42:00 [INFO] [TRAIN] epoch=53, iter=19400/80000, loss=0.8253, lr=0.007788, batch_cost=1.3872, reader_cost=0.0001 | ETA 23:21:05 2021-02-23 01:42:14 [INFO] [TRAIN] epoch=53, iter=19410/80000, loss=0.8877, lr=0.007787, batch_cost=1.3732, reader_cost=0.0001 | ETA 23:06:40 2021-02-23 01:42:27 [INFO] [TRAIN] epoch=53, iter=19420/80000, loss=0.9785, lr=0.007786, batch_cost=1.3700, reader_cost=0.0001 | ETA 23:03:16 2021-02-23 01:42:41 [INFO] [TRAIN] epoch=53, iter=19430/80000, loss=0.8977, lr=0.007785, batch_cost=1.3594, reader_cost=0.0001 | ETA 22:52:18 2021-02-23 01:42:54 [INFO] [TRAIN] epoch=53, iter=19440/80000, loss=0.9800, lr=0.007784, batch_cost=1.3576, reader_cost=0.0001 | ETA 22:50:16 2021-02-23 01:43:08 [INFO] [TRAIN] epoch=53, iter=19450/80000, loss=0.8991, lr=0.007783, batch_cost=1.3336, reader_cost=0.0001 | ETA 22:25:49 2021-02-23 01:43:22 [INFO] [TRAIN] epoch=53, iter=19460/80000, loss=1.0013, lr=0.007782, batch_cost=1.3708, reader_cost=0.0001 | ETA 23:03:05 2021-02-23 01:43:36 [INFO] [TRAIN] epoch=53, iter=19470/80000, loss=0.8657, lr=0.007780, batch_cost=1.4051, reader_cost=0.0001 | ETA 23:37:33 2021-02-23 01:43:49 [INFO] [TRAIN] epoch=53, iter=19480/80000, loss=0.8334, lr=0.007779, batch_cost=1.3641, reader_cost=0.0001 | ETA 22:55:52 2021-02-23 01:44:03 [INFO] [TRAIN] epoch=53, iter=19490/80000, loss=0.9333, lr=0.007778, batch_cost=1.3583, reader_cost=0.0001 | ETA 22:49:50 2021-02-23 01:44:16 [INFO] [TRAIN] epoch=53, iter=19500/80000, loss=0.9749, lr=0.007777, batch_cost=1.3410, reader_cost=0.0001 | ETA 22:32:11 2021-02-23 01:44:30 [INFO] [TRAIN] epoch=53, iter=19510/80000, loss=0.8908, lr=0.007776, batch_cost=1.3471, reader_cost=0.0001 | ETA 22:38:03 2021-02-23 01:44:44 [INFO] [TRAIN] epoch=53, iter=19520/80000, loss=0.8580, lr=0.007775, batch_cost=1.3908, reader_cost=0.0001 | ETA 23:21:54 2021-02-23 01:44:57 [INFO] [TRAIN] epoch=53, iter=19530/80000, loss=0.9546, lr=0.007773, batch_cost=1.3885, reader_cost=0.0001 | ETA 23:19:23 2021-02-23 01:45:11 [INFO] [TRAIN] epoch=53, iter=19540/80000, loss=0.9018, lr=0.007772, batch_cost=1.3495, reader_cost=0.0001 | ETA 22:39:50 2021-02-23 01:45:25 [INFO] [TRAIN] epoch=53, iter=19550/80000, loss=0.8368, lr=0.007771, batch_cost=1.3652, reader_cost=0.0001 | ETA 22:55:23 2021-02-23 01:45:38 [INFO] [TRAIN] epoch=53, iter=19560/80000, loss=0.8968, lr=0.007770, batch_cost=1.3434, reader_cost=0.0001 | ETA 22:33:16 2021-02-23 01:45:52 [INFO] [TRAIN] epoch=53, iter=19570/80000, loss=0.9657, lr=0.007769, batch_cost=1.3709, reader_cost=0.0001 | ETA 23:00:41 2021-02-23 01:46:05 [INFO] [TRAIN] epoch=53, iter=19580/80000, loss=1.0405, lr=0.007768, batch_cost=1.3380, reader_cost=0.0001 | ETA 22:27:21 2021-02-23 01:46:19 [INFO] [TRAIN] epoch=53, iter=19590/80000, loss=0.8669, lr=0.007766, batch_cost=1.3812, reader_cost=0.0001 | ETA 23:10:35 2021-02-23 01:46:32 [INFO] [TRAIN] epoch=53, iter=19600/80000, loss=1.0863, lr=0.007765, batch_cost=1.3477, reader_cost=0.0001 | ETA 22:36:42 2021-02-23 01:46:46 [INFO] [TRAIN] epoch=53, iter=19610/80000, loss=0.9385, lr=0.007764, batch_cost=1.3512, reader_cost=0.0001 | ETA 22:39:57 2021-02-23 01:47:00 [INFO] [TRAIN] epoch=53, iter=19620/80000, loss=0.9265, lr=0.007763, batch_cost=1.3756, reader_cost=0.0001 | ETA 23:04:17 2021-02-23 01:47:13 [INFO] [TRAIN] epoch=53, iter=19630/80000, loss=0.8669, lr=0.007762, batch_cost=1.3598, reader_cost=0.0001 | ETA 22:48:08 2021-02-23 01:47:27 [INFO] [TRAIN] epoch=53, iter=19640/80000, loss=0.8923, lr=0.007761, batch_cost=1.3680, reader_cost=0.0001 | ETA 22:56:11 2021-02-23 01:47:41 [INFO] [TRAIN] epoch=53, iter=19650/80000, loss=1.0296, lr=0.007760, batch_cost=1.3749, reader_cost=0.0001 | ETA 23:02:53 2021-02-23 01:47:55 [INFO] [TRAIN] epoch=53, iter=19660/80000, loss=0.8933, lr=0.007758, batch_cost=1.3786, reader_cost=0.0001 | ETA 23:06:22 2021-02-23 01:48:08 [INFO] [TRAIN] epoch=53, iter=19670/80000, loss=0.9088, lr=0.007757, batch_cost=1.3613, reader_cost=0.0001 | ETA 22:48:44 2021-02-23 01:48:22 [INFO] [TRAIN] epoch=53, iter=19680/80000, loss=1.0399, lr=0.007756, batch_cost=1.3870, reader_cost=0.0001 | ETA 23:14:26 2021-02-23 01:48:36 [INFO] [TRAIN] epoch=53, iter=19690/80000, loss=0.9764, lr=0.007755, batch_cost=1.3721, reader_cost=0.0001 | ETA 22:59:12 2021-02-23 01:48:50 [INFO] [TRAIN] epoch=53, iter=19700/80000, loss=0.9741, lr=0.007754, batch_cost=1.3896, reader_cost=0.0001 | ETA 23:16:33 2021-02-23 01:49:03 [INFO] [TRAIN] epoch=53, iter=19710/80000, loss=0.8436, lr=0.007753, batch_cost=1.3624, reader_cost=0.0001 | ETA 22:48:58 2021-02-23 01:49:18 [INFO] [TRAIN] epoch=54, iter=19720/80000, loss=0.9167, lr=0.007751, batch_cost=1.4437, reader_cost=0.0852 | ETA 24:10:23 2021-02-23 01:49:32 [INFO] [TRAIN] epoch=54, iter=19730/80000, loss=0.9566, lr=0.007750, batch_cost=1.3949, reader_cost=0.0001 | ETA 23:21:10 2021-02-23 01:49:45 [INFO] [TRAIN] epoch=54, iter=19740/80000, loss=0.9931, lr=0.007749, batch_cost=1.3400, reader_cost=0.0001 | ETA 22:25:47 2021-02-23 01:49:58 [INFO] [TRAIN] epoch=54, iter=19750/80000, loss=0.8455, lr=0.007748, batch_cost=1.3450, reader_cost=0.0001 | ETA 22:30:38 2021-02-23 01:50:12 [INFO] [TRAIN] epoch=54, iter=19760/80000, loss=0.9766, lr=0.007747, batch_cost=1.3756, reader_cost=0.0001 | ETA 23:01:08 2021-02-23 01:50:26 [INFO] [TRAIN] epoch=54, iter=19770/80000, loss=0.9116, lr=0.007746, batch_cost=1.3325, reader_cost=0.0001 | ETA 22:17:38 2021-02-23 01:50:39 [INFO] [TRAIN] epoch=54, iter=19780/80000, loss=1.0305, lr=0.007744, batch_cost=1.3671, reader_cost=0.0001 | ETA 22:52:07 2021-02-23 01:50:53 [INFO] [TRAIN] epoch=54, iter=19790/80000, loss=0.7889, lr=0.007743, batch_cost=1.3799, reader_cost=0.0001 | ETA 23:04:41 2021-02-23 01:51:07 [INFO] [TRAIN] epoch=54, iter=19800/80000, loss=0.9080, lr=0.007742, batch_cost=1.3604, reader_cost=0.0001 | ETA 22:44:53 2021-02-23 01:51:20 [INFO] [TRAIN] epoch=54, iter=19810/80000, loss=0.8070, lr=0.007741, batch_cost=1.3331, reader_cost=0.0001 | ETA 22:17:16 2021-02-23 01:51:34 [INFO] [TRAIN] epoch=54, iter=19820/80000, loss=0.8416, lr=0.007740, batch_cost=1.3864, reader_cost=0.0001 | ETA 23:10:34 2021-02-23 01:51:48 [INFO] [TRAIN] epoch=54, iter=19830/80000, loss=0.8397, lr=0.007739, batch_cost=1.3840, reader_cost=0.0001 | ETA 23:07:54 2021-02-23 01:52:01 [INFO] [TRAIN] epoch=54, iter=19840/80000, loss=0.9404, lr=0.007738, batch_cost=1.3568, reader_cost=0.0001 | ETA 22:40:26 2021-02-23 01:52:15 [INFO] [TRAIN] epoch=54, iter=19850/80000, loss=0.8800, lr=0.007736, batch_cost=1.3453, reader_cost=0.0001 | ETA 22:28:39 2021-02-23 01:52:29 [INFO] [TRAIN] epoch=54, iter=19860/80000, loss=0.9764, lr=0.007735, batch_cost=1.3874, reader_cost=0.0001 | ETA 23:10:39 2021-02-23 01:52:42 [INFO] [TRAIN] epoch=54, iter=19870/80000, loss=0.9419, lr=0.007734, batch_cost=1.3610, reader_cost=0.0001 | ETA 22:43:57 2021-02-23 01:52:56 [INFO] [TRAIN] epoch=54, iter=19880/80000, loss=0.8467, lr=0.007733, batch_cost=1.3899, reader_cost=0.0001 | ETA 23:12:39 2021-02-23 01:53:09 [INFO] [TRAIN] epoch=54, iter=19890/80000, loss=0.9063, lr=0.007732, batch_cost=1.3330, reader_cost=0.0001 | ETA 22:15:28 2021-02-23 01:53:23 [INFO] [TRAIN] epoch=54, iter=19900/80000, loss=0.8732, lr=0.007731, batch_cost=1.3818, reader_cost=0.0001 | ETA 23:04:08 2021-02-23 01:53:37 [INFO] [TRAIN] epoch=54, iter=19910/80000, loss=0.9525, lr=0.007729, batch_cost=1.3691, reader_cost=0.0001 | ETA 22:51:11 2021-02-23 01:53:50 [INFO] [TRAIN] epoch=54, iter=19920/80000, loss=0.9709, lr=0.007728, batch_cost=1.3567, reader_cost=0.0001 | ETA 22:38:31 2021-02-23 01:54:04 [INFO] [TRAIN] epoch=54, iter=19930/80000, loss=0.8659, lr=0.007727, batch_cost=1.3459, reader_cost=0.0001 | ETA 22:27:29 2021-02-23 01:54:18 [INFO] [TRAIN] epoch=54, iter=19940/80000, loss=1.0131, lr=0.007726, batch_cost=1.3576, reader_cost=0.0001 | ETA 22:38:54 2021-02-23 01:54:31 [INFO] [TRAIN] epoch=54, iter=19950/80000, loss=0.8716, lr=0.007725, batch_cost=1.3410, reader_cost=0.0001 | ETA 22:22:04 2021-02-23 01:54:45 [INFO] [TRAIN] epoch=54, iter=19960/80000, loss=0.9663, lr=0.007724, batch_cost=1.3689, reader_cost=0.0001 | ETA 22:49:49 2021-02-23 01:54:58 [INFO] [TRAIN] epoch=54, iter=19970/80000, loss=0.8329, lr=0.007722, batch_cost=1.3775, reader_cost=0.0001 | ETA 22:58:12 2021-02-23 01:55:12 [INFO] [TRAIN] epoch=54, iter=19980/80000, loss=0.9328, lr=0.007721, batch_cost=1.3714, reader_cost=0.0001 | ETA 22:51:52 2021-02-23 01:55:26 [INFO] [TRAIN] epoch=54, iter=19990/80000, loss=1.0134, lr=0.007720, batch_cost=1.3529, reader_cost=0.0001 | ETA 22:33:09 2021-02-23 01:55:39 [INFO] [TRAIN] epoch=54, iter=20000/80000, loss=0.9925, lr=0.007719, batch_cost=1.3630, reader_cost=0.0001 | ETA 22:42:58 2021-02-23 01:55:39 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:17 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:01 - batch_cost: 0.1883 - reader cost: 0.0629  3/125 [..............................] - ETA: 58s - batch_cost: 0.2726 - reader cost: 0.1057  4/125 [..............................] - ETA: 54s - batch_cost: 0.2939 - reader cost: 0.1059 5/125 [>.............................] - ETA: 53s - batch_cost: 0.3204 - reader cost: 0.1201 6/125 [>.............................] - ETA: 52s - batch_cost: 0.3387 - reader cost: 0.1306 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3562 - reader cost: 0.1422 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3585 - reader cost: 0.1401 9/125 [=>............................] - ETA: 50s - batch_cost: 0.3613 - reader cost: 0.1397 10/125 [=>............................] - ETA: 49s - batch_cost: 0.3683 - reader cost: 0.1436 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3744 - reader cost: 0.1475 12/125 [=>............................] - ETA: 48s - batch_cost: 0.3798 - reader cost: 0.1507 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3830 - reader cost: 0.1525 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3877 - reader cost: 0.1555 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3913 - reader cost: 0.1578 16/125 [==>...........................] - ETA: 46s - batch_cost: 0.3913 - reader cost: 0.1569 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3936 - reader cost: 0.1583 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.3955 - reader cost: 0.1594 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3978 - reader cost: 0.1609 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.3993 - reader cost: 0.1617 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4004 - reader cost: 0.1619 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.3993 - reader cost: 0.1604 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.3993 - reader cost: 0.1598 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4008 - reader cost: 0.1604 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4016 - reader cost: 0.1609 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4010 - reader cost: 0.1599 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4027 - reader cost: 0.1609 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4039 - reader cost: 0.1616 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4027 - reader cost: 0.1600 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4036 - reader cost: 0.1606 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.4049 - reader cost: 0.1617 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4064 - reader cost: 0.1628 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4057 - reader cost: 0.1619 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4063 - reader cost: 0.1622 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4076 - reader cost: 0.1628 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4079 - reader cost: 0.1629 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4085 - reader cost: 0.1631 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4087 - reader cost: 0.1632 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4090 - reader cost: 0.1633 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4096 - reader cost: 0.1638 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4102 - reader cost: 0.1641 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4110 - reader cost: 0.1648 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4104 - reader cost: 0.1642 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4112 - reader cost: 0.1649 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4106 - reader cost: 0.1642 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4100 - reader cost: 0.1636 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4092 - reader cost: 0.1627 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4102 - reader cost: 0.1635 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4109 - reader cost: 0.1641 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4118 - reader cost: 0.1648 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4116 - reader cost: 0.1643 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4119 - reader cost: 0.1644 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4125 - reader cost: 0.1647 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4122 - reader cost: 0.1645 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4120 - reader cost: 0.1641 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4114 - reader cost: 0.1635 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4119 - reader cost: 0.1639 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4122 - reader cost: 0.1641 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4125 - reader cost: 0.1644 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4122 - reader cost: 0.1639 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4115 - reader cost: 0.1632 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4118 - reader cost: 0.1635 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4120 - reader cost: 0.1630 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4126 - reader cost: 0.1628 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4123 - reader cost: 0.1626 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4126 - reader cost: 0.1629 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4122 - reader cost: 0.1625 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4122 - reader cost: 0.1625 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4124 - reader cost: 0.1627 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4129 - reader cost: 0.1631 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4132 - reader cost: 0.1634 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4131 - reader cost: 0.1632 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4125 - reader cost: 0.1626 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4123 - reader cost: 0.1625 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4116 - reader cost: 0.1618 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4118 - reader cost: 0.1620 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4115 - reader cost: 0.1616 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4120 - reader cost: 0.1621 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4116 - reader cost: 0.1616 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4118 - reader cost: 0.1618 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4120 - reader cost: 0.1614 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4116 - reader cost: 0.1608 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4117 - reader cost: 0.1609 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4120 - reader cost: 0.1612 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4113 - reader cost: 0.1606 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4117 - reader cost: 0.1607 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4121 - reader cost: 0.1612 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4117 - reader cost: 0.1608 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4116 - reader cost: 0.1603 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4118 - reader cost: 0.1604 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4119 - reader cost: 0.1604 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4122 - reader cost: 0.1606 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4123 - reader cost: 0.1604 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4123 - reader cost: 0.1599 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4126 - reader cost: 0.1600 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4126 - reader cost: 0.1600 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4128 - reader cost: 0.1602 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4130 - reader cost: 0.1604 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4132 - reader cost: 0.1605 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4135 - reader cost: 0.1608 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4132 - reader cost: 0.1604 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4135 - reader cost: 0.1607  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4136 - reader cost: 0.1609 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4139 - reader cost: 0.1611 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4141 - reader cost: 0.1613 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4143 - reader cost: 0.1615 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4145 - reader cost: 0.1616 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4146 - reader cost: 0.1617 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4147 - reader cost: 0.1618 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4149 - reader cost: 0.1620 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4150 - reader cost: 0.1621 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4152 - reader cost: 0.1623 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4149 - reader cost: 0.1621 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4147 - reader cost: 0.1619 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4145 - reader cost: 0.1616 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4145 - reader cost: 0.1616 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4148 - reader cost: 0.1618 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4147 - reader cost: 0.1618 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4144 - reader cost: 0.1615 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4140 - reader cost: 0.1611 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4136 - reader cost: 0.1607 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4138 - reader cost: 0.1609 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4136 - reader cost: 0.1605 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4138 - reader cost: 0.1607 125/125 [==============================] - 52s 419ms/step - batch_cost: 0.4138 - reader cost: 0.1607 2021-02-23 01:56:32 [INFO] [EVAL] #Images=500 mIoU=0.6914 Acc=0.9481 Kappa=0.9325 2021-02-23 01:56:32 [INFO] [EVAL] Class IoU: [0.9717 0.7832 0.9021 0.3911 0.5382 0.6092 0.6353 0.7457 0.9109 0.5934 0.928 0.8046 0.5832 0.9345 0.6819 0.718 0.4427 0.2287 0.7342] 2021-02-23 01:56:32 [INFO] [EVAL] Class Acc: [0.9792 0.9151 0.9461 0.6792 0.6509 0.7161 0.896 0.9337 0.9522 0.824 0.9465 0.9011 0.8127 0.964 0.9353 0.8477 0.9154 0.836 0.8079] 2021-02-23 01:56:36 [INFO] [EVAL] The model with the best validation mIoU (0.7322) was saved at iter 11000. 2021-02-23 01:56:50 [INFO] [TRAIN] epoch=54, iter=20010/80000, loss=0.9613, lr=0.007718, batch_cost=1.3694, reader_cost=0.0001 | ETA 22:49:07 2021-02-23 01:57:03 [INFO] [TRAIN] epoch=54, iter=20020/80000, loss=0.8510, lr=0.007717, batch_cost=1.3629, reader_cost=0.0001 | ETA 22:42:24 2021-02-23 01:57:17 [INFO] [TRAIN] epoch=54, iter=20030/80000, loss=0.9448, lr=0.007716, batch_cost=1.3736, reader_cost=0.0001 | ETA 22:52:54 2021-02-23 01:57:30 [INFO] [TRAIN] epoch=54, iter=20040/80000, loss=0.9923, lr=0.007714, batch_cost=1.3348, reader_cost=0.0001 | ETA 22:13:52 2021-02-23 01:57:44 [INFO] [TRAIN] epoch=54, iter=20050/80000, loss=0.9522, lr=0.007713, batch_cost=1.3420, reader_cost=0.0001 | ETA 22:20:51 2021-02-23 01:57:57 [INFO] [TRAIN] epoch=54, iter=20060/80000, loss=0.9645, lr=0.007712, batch_cost=1.3654, reader_cost=0.0001 | ETA 22:43:59 2021-02-23 01:58:11 [INFO] [TRAIN] epoch=54, iter=20070/80000, loss=0.8731, lr=0.007711, batch_cost=1.3593, reader_cost=0.0001 | ETA 22:37:43 2021-02-23 01:58:25 [INFO] [TRAIN] epoch=54, iter=20080/80000, loss=0.9539, lr=0.007710, batch_cost=1.3677, reader_cost=0.0001 | ETA 22:45:50 2021-02-23 01:58:39 [INFO] [TRAIN] epoch=55, iter=20090/80000, loss=1.0297, lr=0.007709, batch_cost=1.4290, reader_cost=0.0897 | ETA 23:46:49 2021-02-23 01:58:53 [INFO] [TRAIN] epoch=55, iter=20100/80000, loss=0.8712, lr=0.007707, batch_cost=1.3739, reader_cost=0.0001 | ETA 22:51:33 2021-02-23 01:59:07 [INFO] [TRAIN] epoch=55, iter=20110/80000, loss=0.8595, lr=0.007706, batch_cost=1.3798, reader_cost=0.0001 | ETA 22:57:17 2021-02-23 01:59:20 [INFO] [TRAIN] epoch=55, iter=20120/80000, loss=0.8333, lr=0.007705, batch_cost=1.3698, reader_cost=0.0001 | ETA 22:47:03 2021-02-23 01:59:34 [INFO] [TRAIN] epoch=55, iter=20130/80000, loss=0.9280, lr=0.007704, batch_cost=1.3917, reader_cost=0.0001 | ETA 23:08:43 2021-02-23 01:59:48 [INFO] [TRAIN] epoch=55, iter=20140/80000, loss=0.8756, lr=0.007703, batch_cost=1.3412, reader_cost=0.0001 | ETA 22:18:03 2021-02-23 02:00:01 [INFO] [TRAIN] epoch=55, iter=20150/80000, loss=0.9538, lr=0.007702, batch_cost=1.3399, reader_cost=0.0001 | ETA 22:16:32 2021-02-23 02:00:15 [INFO] [TRAIN] epoch=55, iter=20160/80000, loss=0.8683, lr=0.007700, batch_cost=1.3731, reader_cost=0.0001 | ETA 22:49:24 2021-02-23 02:00:28 [INFO] [TRAIN] epoch=55, iter=20170/80000, loss=0.9878, lr=0.007699, batch_cost=1.3571, reader_cost=0.0001 | ETA 22:33:12 2021-02-23 02:00:42 [INFO] [TRAIN] epoch=55, iter=20180/80000, loss=0.9102, lr=0.007698, batch_cost=1.3525, reader_cost=0.0001 | ETA 22:28:29 2021-02-23 02:00:55 [INFO] [TRAIN] epoch=55, iter=20190/80000, loss=0.9257, lr=0.007697, batch_cost=1.3732, reader_cost=0.0001 | ETA 22:48:48 2021-02-23 02:01:09 [INFO] [TRAIN] epoch=55, iter=20200/80000, loss=0.8928, lr=0.007696, batch_cost=1.3575, reader_cost=0.0001 | ETA 22:32:59 2021-02-23 02:01:23 [INFO] [TRAIN] epoch=55, iter=20210/80000, loss=0.9368, lr=0.007695, batch_cost=1.3558, reader_cost=0.0001 | ETA 22:31:03 2021-02-23 02:01:36 [INFO] [TRAIN] epoch=55, iter=20220/80000, loss=0.9305, lr=0.007694, batch_cost=1.3824, reader_cost=0.0001 | ETA 22:57:19 2021-02-23 02:01:50 [INFO] [TRAIN] epoch=55, iter=20230/80000, loss=0.8705, lr=0.007692, batch_cost=1.3467, reader_cost=0.0001 | ETA 22:21:29 2021-02-23 02:02:03 [INFO] [TRAIN] epoch=55, iter=20240/80000, loss=0.8544, lr=0.007691, batch_cost=1.3360, reader_cost=0.0001 | ETA 22:10:37 2021-02-23 02:02:17 [INFO] [TRAIN] epoch=55, iter=20250/80000, loss=0.9122, lr=0.007690, batch_cost=1.3940, reader_cost=0.0001 | ETA 23:08:09 2021-02-23 02:02:31 [INFO] [TRAIN] epoch=55, iter=20260/80000, loss=0.9392, lr=0.007689, batch_cost=1.3565, reader_cost=0.0001 | ETA 22:30:37 2021-02-23 02:02:44 [INFO] [TRAIN] epoch=55, iter=20270/80000, loss=0.9313, lr=0.007688, batch_cost=1.3580, reader_cost=0.0001 | ETA 22:31:52 2021-02-23 02:02:58 [INFO] [TRAIN] epoch=55, iter=20280/80000, loss=0.9061, lr=0.007687, batch_cost=1.3415, reader_cost=0.0001 | ETA 22:15:14 2021-02-23 02:03:11 [INFO] [TRAIN] epoch=55, iter=20290/80000, loss=0.8712, lr=0.007685, batch_cost=1.3611, reader_cost=0.0001 | ETA 22:34:29 2021-02-23 02:03:25 [INFO] [TRAIN] epoch=55, iter=20300/80000, loss=0.9588, lr=0.007684, batch_cost=1.3625, reader_cost=0.0001 | ETA 22:35:38 2021-02-23 02:03:38 [INFO] [TRAIN] epoch=55, iter=20310/80000, loss=0.9802, lr=0.007683, batch_cost=1.3311, reader_cost=0.0001 | ETA 22:04:14 2021-02-23 02:03:52 [INFO] [TRAIN] epoch=55, iter=20320/80000, loss=0.9045, lr=0.007682, batch_cost=1.3825, reader_cost=0.0001 | ETA 22:55:08 2021-02-23 02:04:06 [INFO] [TRAIN] epoch=55, iter=20330/80000, loss=0.8866, lr=0.007681, batch_cost=1.3694, reader_cost=0.0001 | ETA 22:41:53 2021-02-23 02:04:20 [INFO] [TRAIN] epoch=55, iter=20340/80000, loss=0.8709, lr=0.007680, batch_cost=1.3697, reader_cost=0.0001 | ETA 22:41:58 2021-02-23 02:04:33 [INFO] [TRAIN] epoch=55, iter=20350/80000, loss=0.8584, lr=0.007678, batch_cost=1.3743, reader_cost=0.0001 | ETA 22:46:15 2021-02-23 02:04:47 [INFO] [TRAIN] epoch=55, iter=20360/80000, loss=0.8805, lr=0.007677, batch_cost=1.3779, reader_cost=0.0001 | ETA 22:49:38 2021-02-23 02:05:01 [INFO] [TRAIN] epoch=55, iter=20370/80000, loss=0.8803, lr=0.007676, batch_cost=1.3732, reader_cost=0.0001 | ETA 22:44:43 2021-02-23 02:05:14 [INFO] [TRAIN] epoch=55, iter=20380/80000, loss=0.8626, lr=0.007675, batch_cost=1.3274, reader_cost=0.0001 | ETA 21:59:00 2021-02-23 02:05:27 [INFO] [TRAIN] epoch=55, iter=20390/80000, loss=0.9365, lr=0.007674, batch_cost=1.3390, reader_cost=0.0001 | ETA 22:10:18 2021-02-23 02:05:41 [INFO] [TRAIN] epoch=55, iter=20400/80000, loss=0.8858, lr=0.007673, batch_cost=1.3549, reader_cost=0.0001 | ETA 22:25:53 2021-02-23 02:05:55 [INFO] [TRAIN] epoch=55, iter=20410/80000, loss=0.9242, lr=0.007672, batch_cost=1.3716, reader_cost=0.0001 | ETA 22:42:14 2021-02-23 02:06:08 [INFO] [TRAIN] epoch=55, iter=20420/80000, loss=0.9290, lr=0.007670, batch_cost=1.3489, reader_cost=0.0001 | ETA 22:19:26 2021-02-23 02:06:22 [INFO] [TRAIN] epoch=55, iter=20430/80000, loss=0.9032, lr=0.007669, batch_cost=1.3852, reader_cost=0.0001 | ETA 22:55:17 2021-02-23 02:06:35 [INFO] [TRAIN] epoch=55, iter=20440/80000, loss=0.8870, lr=0.007668, batch_cost=1.3370, reader_cost=0.0001 | ETA 22:07:11 2021-02-23 02:06:49 [INFO] [TRAIN] epoch=55, iter=20450/80000, loss=0.9580, lr=0.007667, batch_cost=1.3732, reader_cost=0.0001 | ETA 22:42:52 2021-02-23 02:07:03 [INFO] [TRAIN] epoch=55, iter=20460/80000, loss=0.9233, lr=0.007666, batch_cost=1.3359, reader_cost=0.0001 | ETA 22:05:40 2021-02-23 02:07:17 [INFO] [TRAIN] epoch=56, iter=20470/80000, loss=0.9095, lr=0.007665, batch_cost=1.4602, reader_cost=0.0593 | ETA 24:08:43 2021-02-23 02:07:31 [INFO] [TRAIN] epoch=56, iter=20480/80000, loss=0.9473, lr=0.007663, batch_cost=1.3440, reader_cost=0.0001 | ETA 22:13:14 2021-02-23 02:07:44 [INFO] [TRAIN] epoch=56, iter=20490/80000, loss=0.8585, lr=0.007662, batch_cost=1.3875, reader_cost=0.0001 | ETA 22:56:08 2021-02-23 02:07:58 [INFO] [TRAIN] epoch=56, iter=20500/80000, loss=0.9001, lr=0.007661, batch_cost=1.3237, reader_cost=0.0001 | ETA 21:52:37 2021-02-23 02:08:11 [INFO] [TRAIN] epoch=56, iter=20510/80000, loss=0.8723, lr=0.007660, batch_cost=1.3672, reader_cost=0.0001 | ETA 22:35:33 2021-02-23 02:08:25 [INFO] [TRAIN] epoch=56, iter=20520/80000, loss=0.9878, lr=0.007659, batch_cost=1.3501, reader_cost=0.0001 | ETA 22:18:21 2021-02-23 02:08:39 [INFO] [TRAIN] epoch=56, iter=20530/80000, loss=0.8698, lr=0.007658, batch_cost=1.3646, reader_cost=0.0001 | ETA 22:32:30 2021-02-23 02:08:52 [INFO] [TRAIN] epoch=56, iter=20540/80000, loss=1.0348, lr=0.007656, batch_cost=1.3377, reader_cost=0.0001 | ETA 22:05:39 2021-02-23 02:09:06 [INFO] [TRAIN] epoch=56, iter=20550/80000, loss=1.0074, lr=0.007655, batch_cost=1.4248, reader_cost=0.0001 | ETA 23:31:44 2021-02-23 02:09:20 [INFO] [TRAIN] epoch=56, iter=20560/80000, loss=0.8580, lr=0.007654, batch_cost=1.3697, reader_cost=0.0001 | ETA 22:36:56 2021-02-23 02:09:33 [INFO] [TRAIN] epoch=56, iter=20570/80000, loss=0.8753, lr=0.007653, batch_cost=1.3662, reader_cost=0.0001 | ETA 22:33:13 2021-02-23 02:09:47 [INFO] [TRAIN] epoch=56, iter=20580/80000, loss=1.0711, lr=0.007652, batch_cost=1.3446, reader_cost=0.0001 | ETA 22:11:33 2021-02-23 02:10:01 [INFO] [TRAIN] epoch=56, iter=20590/80000, loss=0.9210, lr=0.007651, batch_cost=1.3794, reader_cost=0.0001 | ETA 22:45:48 2021-02-23 02:10:14 [INFO] [TRAIN] epoch=56, iter=20600/80000, loss=1.0167, lr=0.007650, batch_cost=1.3649, reader_cost=0.0001 | ETA 22:31:12 2021-02-23 02:10:28 [INFO] [TRAIN] epoch=56, iter=20610/80000, loss=0.8654, lr=0.007648, batch_cost=1.3465, reader_cost=0.0001 | ETA 22:12:48 2021-02-23 02:10:41 [INFO] [TRAIN] epoch=56, iter=20620/80000, loss=0.8343, lr=0.007647, batch_cost=1.3446, reader_cost=0.0001 | ETA 22:10:40 2021-02-23 02:10:55 [INFO] [TRAIN] epoch=56, iter=20630/80000, loss=1.0041, lr=0.007646, batch_cost=1.3436, reader_cost=0.0001 | ETA 22:09:30 2021-02-23 02:11:09 [INFO] [TRAIN] epoch=56, iter=20640/80000, loss=0.9547, lr=0.007645, batch_cost=1.3802, reader_cost=0.0001 | ETA 22:45:29 2021-02-23 02:11:22 [INFO] [TRAIN] epoch=56, iter=20650/80000, loss=0.9274, lr=0.007644, batch_cost=1.3456, reader_cost=0.0001 | ETA 22:11:03 2021-02-23 02:11:35 [INFO] [TRAIN] epoch=56, iter=20660/80000, loss=1.0047, lr=0.007643, batch_cost=1.3297, reader_cost=0.0001 | ETA 21:55:01 2021-02-23 02:11:49 [INFO] [TRAIN] epoch=56, iter=20670/80000, loss=0.9159, lr=0.007641, batch_cost=1.3673, reader_cost=0.0001 | ETA 22:31:58 2021-02-23 02:12:02 [INFO] [TRAIN] epoch=56, iter=20680/80000, loss=0.8864, lr=0.007640, batch_cost=1.3374, reader_cost=0.0001 | ETA 22:02:14 2021-02-23 02:12:16 [INFO] [TRAIN] epoch=56, iter=20690/80000, loss=1.0533, lr=0.007639, batch_cost=1.3482, reader_cost=0.0001 | ETA 22:12:39 2021-02-23 02:12:29 [INFO] [TRAIN] epoch=56, iter=20700/80000, loss=0.9157, lr=0.007638, batch_cost=1.3550, reader_cost=0.0001 | ETA 22:19:13 2021-02-23 02:12:43 [INFO] [TRAIN] epoch=56, iter=20710/80000, loss=0.8789, lr=0.007637, batch_cost=1.3714, reader_cost=0.0001 | ETA 22:35:12 2021-02-23 02:12:57 [INFO] [TRAIN] epoch=56, iter=20720/80000, loss=0.9409, lr=0.007636, batch_cost=1.4020, reader_cost=0.0001 | ETA 23:05:08 2021-02-23 02:13:11 [INFO] [TRAIN] epoch=56, iter=20730/80000, loss=0.9541, lr=0.007634, batch_cost=1.3806, reader_cost=0.0001 | ETA 22:43:50 2021-02-23 02:13:24 [INFO] [TRAIN] epoch=56, iter=20740/80000, loss=0.8982, lr=0.007633, batch_cost=1.3521, reader_cost=0.0001 | ETA 22:15:27 2021-02-23 02:13:38 [INFO] [TRAIN] epoch=56, iter=20750/80000, loss=0.9667, lr=0.007632, batch_cost=1.3647, reader_cost=0.0001 | ETA 22:27:41 2021-02-23 02:13:52 [INFO] [TRAIN] epoch=56, iter=20760/80000, loss=0.8511, lr=0.007631, batch_cost=1.3767, reader_cost=0.0001 | ETA 22:39:13 2021-02-23 02:14:06 [INFO] [TRAIN] epoch=56, iter=20770/80000, loss=1.0840, lr=0.007630, batch_cost=1.3730, reader_cost=0.0001 | ETA 22:35:23 2021-02-23 02:14:19 [INFO] [TRAIN] epoch=56, iter=20780/80000, loss=0.9312, lr=0.007629, batch_cost=1.3664, reader_cost=0.0001 | ETA 22:28:40 2021-02-23 02:14:33 [INFO] [TRAIN] epoch=56, iter=20790/80000, loss=0.8715, lr=0.007627, batch_cost=1.3846, reader_cost=0.0001 | ETA 22:46:20 2021-02-23 02:14:46 [INFO] [TRAIN] epoch=56, iter=20800/80000, loss=0.9872, lr=0.007626, batch_cost=1.3362, reader_cost=0.0001 | ETA 21:58:20 2021-02-23 02:15:00 [INFO] [TRAIN] epoch=56, iter=20810/80000, loss=0.8718, lr=0.007625, batch_cost=1.3598, reader_cost=0.0001 | ETA 22:21:27 2021-02-23 02:15:13 [INFO] [TRAIN] epoch=56, iter=20820/80000, loss=1.1636, lr=0.007624, batch_cost=1.3280, reader_cost=0.0001 | ETA 21:49:48 2021-02-23 02:15:27 [INFO] [TRAIN] epoch=56, iter=20830/80000, loss=0.8790, lr=0.007623, batch_cost=1.3224, reader_cost=0.0001 | ETA 21:44:06 2021-02-23 02:15:41 [INFO] [TRAIN] epoch=57, iter=20840/80000, loss=0.9961, lr=0.007622, batch_cost=1.4632, reader_cost=0.0756 | ETA 24:02:40 2021-02-23 02:15:55 [INFO] [TRAIN] epoch=57, iter=20850/80000, loss=0.9057, lr=0.007621, batch_cost=1.3428, reader_cost=0.0001 | ETA 22:03:46 2021-02-23 02:16:08 [INFO] [TRAIN] epoch=57, iter=20860/80000, loss=1.0175, lr=0.007619, batch_cost=1.3627, reader_cost=0.0001 | ETA 22:23:11 2021-02-23 02:16:22 [INFO] [TRAIN] epoch=57, iter=20870/80000, loss=0.9013, lr=0.007618, batch_cost=1.3692, reader_cost=0.0001 | ETA 22:29:18 2021-02-23 02:16:35 [INFO] [TRAIN] epoch=57, iter=20880/80000, loss=0.8853, lr=0.007617, batch_cost=1.3314, reader_cost=0.0001 | ETA 21:51:52 2021-02-23 02:16:49 [INFO] [TRAIN] epoch=57, iter=20890/80000, loss=0.9594, lr=0.007616, batch_cost=1.3430, reader_cost=0.0001 | ETA 22:03:02 2021-02-23 02:17:02 [INFO] [TRAIN] epoch=57, iter=20900/80000, loss=0.9375, lr=0.007615, batch_cost=1.3481, reader_cost=0.0001 | ETA 22:07:50 2021-02-23 02:17:16 [INFO] [TRAIN] epoch=57, iter=20910/80000, loss=0.9607, lr=0.007614, batch_cost=1.3670, reader_cost=0.0001 | ETA 22:26:14 2021-02-23 02:17:30 [INFO] [TRAIN] epoch=57, iter=20920/80000, loss=1.0171, lr=0.007612, batch_cost=1.3676, reader_cost=0.0001 | ETA 22:26:37 2021-02-23 02:17:43 [INFO] [TRAIN] epoch=57, iter=20930/80000, loss=0.9482, lr=0.007611, batch_cost=1.3676, reader_cost=0.0001 | ETA 22:26:23 2021-02-23 02:17:57 [INFO] [TRAIN] epoch=57, iter=20940/80000, loss=0.9073, lr=0.007610, batch_cost=1.3578, reader_cost=0.0001 | ETA 22:16:29 2021-02-23 02:18:10 [INFO] [TRAIN] epoch=57, iter=20950/80000, loss=0.9205, lr=0.007609, batch_cost=1.3628, reader_cost=0.0001 | ETA 22:21:11 2021-02-23 02:18:24 [INFO] [TRAIN] epoch=57, iter=20960/80000, loss=0.9397, lr=0.007608, batch_cost=1.3472, reader_cost=0.0001 | ETA 22:05:41 2021-02-23 02:18:38 [INFO] [TRAIN] epoch=57, iter=20970/80000, loss=0.8548, lr=0.007607, batch_cost=1.3845, reader_cost=0.0001 | ETA 22:42:05 2021-02-23 02:18:52 [INFO] [TRAIN] epoch=57, iter=20980/80000, loss=0.9644, lr=0.007605, batch_cost=1.3916, reader_cost=0.0001 | ETA 22:48:51 2021-02-23 02:19:05 [INFO] [TRAIN] epoch=57, iter=20990/80000, loss=0.9655, lr=0.007604, batch_cost=1.3708, reader_cost=0.0001 | ETA 22:28:08 2021-02-23 02:19:19 [INFO] [TRAIN] epoch=57, iter=21000/80000, loss=0.8626, lr=0.007603, batch_cost=1.3592, reader_cost=0.0001 | ETA 22:16:31 2021-02-23 02:19:19 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:19 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:04 - batch_cost: 0.2003 - reader cost: 0.0713  3/125 [..............................] - ETA: 1:00 - batch_cost: 0.2843 - reader cost: 0.1097 4/125 [..............................] - ETA: 58s - batch_cost: 0.3250 - reader cost: 0.1314  5/125 [>.............................] - ETA: 56s - batch_cost: 0.3459 - reader cost: 0.1396 6/125 [>.............................] - ETA: 56s - batch_cost: 0.3667 - reader cost: 0.1525 7/125 [>.............................] - ETA: 54s - batch_cost: 0.3691 - reader cost: 0.1503 8/125 [>.............................] - ETA: 53s - batch_cost: 0.3740 - reader cost: 0.1508 9/125 [=>............................] - ETA: 52s - batch_cost: 0.3798 - reader cost: 0.1536 10/125 [=>............................] - ETA: 51s - batch_cost: 0.3794 - reader cost: 0.1504 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3844 - reader cost: 0.1530 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3837 - reader cost: 0.1507 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3879 - reader cost: 0.1533 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3895 - reader cost: 0.1540 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3932 - reader cost: 0.1560 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3925 - reader cost: 0.1546 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3938 - reader cost: 0.1543 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.3950 - reader cost: 0.1550 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3980 - reader cost: 0.1568 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4003 - reader cost: 0.1587 21/125 [====>.........................] - ETA: 45s - batch_cost: 0.4034 - reader cost: 0.1611 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4052 - reader cost: 0.1622 23/125 [====>.........................] - ETA: 44s - batch_cost: 0.4063 - reader cost: 0.1630 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4078 - reader cost: 0.1638 25/125 [=====>........................] - ETA: 43s - batch_cost: 0.4088 - reader cost: 0.1643 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4093 - reader cost: 0.1646 27/125 [=====>........................] - ETA: 42s - batch_cost: 0.4098 - reader cost: 0.1647 28/125 [=====>........................] - ETA: 42s - batch_cost: 0.4102 - reader cost: 0.1648 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4097 - reader cost: 0.1639 30/125 [======>.......................] - ETA: 41s - batch_cost: 0.4105 - reader cost: 0.1642 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4093 - reader cost: 0.1628 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4089 - reader cost: 0.1622 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4083 - reader cost: 0.1610 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4066 - reader cost: 0.1592 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4070 - reader cost: 0.1595 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4077 - reader cost: 0.1602 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4090 - reader cost: 0.1614 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4095 - reader cost: 0.1619 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4100 - reader cost: 0.1623 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4104 - reader cost: 0.1627 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4110 - reader cost: 0.1632 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4122 - reader cost: 0.1636 43/125 [=========>....................] - ETA: 35s - batch_cost: 0.4126 - reader cost: 0.1636 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4129 - reader cost: 0.1635 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4132 - reader cost: 0.1638 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4138 - reader cost: 0.1642 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4133 - reader cost: 0.1636 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4132 - reader cost: 0.1634 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4126 - reader cost: 0.1628 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4132 - reader cost: 0.1631 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4137 - reader cost: 0.1636 52/125 [===========>..................] - ETA: 31s - batch_cost: 0.4132 - reader cost: 0.1631 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4137 - reader cost: 0.1634 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4138 - reader cost: 0.1633 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4131 - reader cost: 0.1627 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4124 - reader cost: 0.1618 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4130 - reader cost: 0.1621 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4119 - reader cost: 0.1610 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4123 - reader cost: 0.1613 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4127 - reader cost: 0.1617 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4129 - reader cost: 0.1619 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4131 - reader cost: 0.1620 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4135 - reader cost: 0.1623 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4137 - reader cost: 0.1625 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4140 - reader cost: 0.1626 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4136 - reader cost: 0.1622 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4141 - reader cost: 0.1625 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4145 - reader cost: 0.1630 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4148 - reader cost: 0.1633 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4148 - reader cost: 0.1631 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4152 - reader cost: 0.1635 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4147 - reader cost: 0.1631 73/125 [================>.............] - ETA: 22s - batch_cost: 0.4150 - reader cost: 0.1634 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4147 - reader cost: 0.1631 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4150 - reader cost: 0.1633 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4154 - reader cost: 0.1637 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4152 - reader cost: 0.1635 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4156 - reader cost: 0.1639 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4157 - reader cost: 0.1640 80/125 [==================>...........] - ETA: 19s - batch_cost: 0.4162 - reader cost: 0.1644 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4164 - reader cost: 0.1645 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4166 - reader cost: 0.1646 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4169 - reader cost: 0.1648 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4164 - reader cost: 0.1642 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4167 - reader cost: 0.1646 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4163 - reader cost: 0.1641 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4157 - reader cost: 0.1635 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4160 - reader cost: 0.1637 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4161 - reader cost: 0.1638 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4163 - reader cost: 0.1639 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4165 - reader cost: 0.1641 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4166 - reader cost: 0.1642 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4168 - reader cost: 0.1644 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4166 - reader cost: 0.1642 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4170 - reader cost: 0.1646 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4172 - reader cost: 0.1647 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4173 - reader cost: 0.1648 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4176 - reader cost: 0.1650 99/125 [======================>.......] - ETA: 11s - batch_cost: 0.4178 - reader cost: 0.1652 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4175 - reader cost: 0.1649 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4178 - reader cost: 0.1651 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4181 - reader cost: 0.1654  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4182 - reader cost: 0.1655 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4179 - reader cost: 0.1652 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4182 - reader cost: 0.1654 106/125 [========================>.....] - ETA: 8s - batch_cost: 0.4184 - reader cost: 0.1654 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4186 - reader cost: 0.1655 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4181 - reader cost: 0.1650 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4181 - reader cost: 0.1650 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4182 - reader cost: 0.1651 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4183 - reader cost: 0.1652 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4185 - reader cost: 0.1653 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4185 - reader cost: 0.1654 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4187 - reader cost: 0.1656 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4189 - reader cost: 0.1657 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4191 - reader cost: 0.1659 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4187 - reader cost: 0.1656 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4188 - reader cost: 0.1657 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4184 - reader cost: 0.1652 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4187 - reader cost: 0.1656 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4189 - reader cost: 0.1657 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4192 - reader cost: 0.1658 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4192 - reader cost: 0.1659 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4191 - reader cost: 0.1657 125/125 [==============================] - 53s 424ms/step - batch_cost: 0.4192 - reader cost: 0.1658 2021-02-23 02:20:12 [INFO] [EVAL] #Images=500 mIoU=0.7362 Acc=0.9493 Kappa=0.9339 2021-02-23 02:20:12 [INFO] [EVAL] Class IoU: [0.9629 0.7365 0.9108 0.5212 0.4819 0.6192 0.6826 0.7612 0.9175 0.5677 0.9348 0.8106 0.5989 0.9436 0.753 0.7617 0.6492 0.6174 0.7569] 2021-02-23 02:20:12 [INFO] [EVAL] Class Acc: [0.9715 0.8995 0.9357 0.7846 0.8804 0.8514 0.884 0.9213 0.9504 0.8954 0.9618 0.9021 0.7325 0.9702 0.8761 0.9112 0.9577 0.8557 0.8839] 2021-02-23 02:20:18 [INFO] [EVAL] The model with the best validation mIoU (0.7362) was saved at iter 21000. 2021-02-23 02:20:32 [INFO] [TRAIN] epoch=57, iter=21010/80000, loss=0.8870, lr=0.007602, batch_cost=1.3478, reader_cost=0.0001 | ETA 22:05:09 2021-02-23 02:20:45 [INFO] [TRAIN] epoch=57, iter=21020/80000, loss=1.0131, lr=0.007601, batch_cost=1.3787, reader_cost=0.0001 | ETA 22:35:16 2021-02-23 02:20:59 [INFO] [TRAIN] epoch=57, iter=21030/80000, loss=1.0125, lr=0.007600, batch_cost=1.4087, reader_cost=0.0001 | ETA 23:04:28 2021-02-23 02:21:13 [INFO] [TRAIN] epoch=57, iter=21040/80000, loss=0.9048, lr=0.007598, batch_cost=1.3697, reader_cost=0.0001 | ETA 22:25:58 2021-02-23 02:21:27 [INFO] [TRAIN] epoch=57, iter=21050/80000, loss=0.9345, lr=0.007597, batch_cost=1.3672, reader_cost=0.0001 | ETA 22:23:14 2021-02-23 02:21:40 [INFO] [TRAIN] epoch=57, iter=21060/80000, loss=0.8775, lr=0.007596, batch_cost=1.3606, reader_cost=0.0001 | ETA 22:16:32 2021-02-23 02:21:54 [INFO] [TRAIN] epoch=57, iter=21070/80000, loss=0.8173, lr=0.007595, batch_cost=1.3495, reader_cost=0.0001 | ETA 22:05:25 2021-02-23 02:22:08 [INFO] [TRAIN] epoch=57, iter=21080/80000, loss=0.9604, lr=0.007594, batch_cost=1.3561, reader_cost=0.0001 | ETA 22:11:43 2021-02-23 02:22:21 [INFO] [TRAIN] epoch=57, iter=21090/80000, loss=0.8874, lr=0.007593, batch_cost=1.3586, reader_cost=0.0001 | ETA 22:13:52 2021-02-23 02:22:35 [INFO] [TRAIN] epoch=57, iter=21100/80000, loss=1.0495, lr=0.007592, batch_cost=1.3440, reader_cost=0.0001 | ETA 21:59:23 2021-02-23 02:22:48 [INFO] [TRAIN] epoch=57, iter=21110/80000, loss=0.8844, lr=0.007590, batch_cost=1.3268, reader_cost=0.0001 | ETA 21:42:14 2021-02-23 02:23:01 [INFO] [TRAIN] epoch=57, iter=21120/80000, loss=1.0383, lr=0.007589, batch_cost=1.3423, reader_cost=0.0001 | ETA 21:57:13 2021-02-23 02:23:16 [INFO] [TRAIN] epoch=57, iter=21130/80000, loss=0.9483, lr=0.007588, batch_cost=1.4367, reader_cost=0.0001 | ETA 23:29:39 2021-02-23 02:23:29 [INFO] [TRAIN] epoch=57, iter=21140/80000, loss=0.8092, lr=0.007587, batch_cost=1.3858, reader_cost=0.0001 | ETA 22:39:29 2021-02-23 02:23:43 [INFO] [TRAIN] epoch=57, iter=21150/80000, loss=0.9447, lr=0.007586, batch_cost=1.3506, reader_cost=0.0001 | ETA 22:04:41 2021-02-23 02:23:57 [INFO] [TRAIN] epoch=57, iter=21160/80000, loss=0.9205, lr=0.007585, batch_cost=1.3784, reader_cost=0.0001 | ETA 22:31:47 2021-02-23 02:24:10 [INFO] [TRAIN] epoch=57, iter=21170/80000, loss=0.9167, lr=0.007583, batch_cost=1.3641, reader_cost=0.0001 | ETA 22:17:32 2021-02-23 02:24:24 [INFO] [TRAIN] epoch=57, iter=21180/80000, loss=0.8479, lr=0.007582, batch_cost=1.3517, reader_cost=0.0001 | ETA 22:05:08 2021-02-23 02:24:37 [INFO] [TRAIN] epoch=57, iter=21190/80000, loss=0.8947, lr=0.007581, batch_cost=1.3535, reader_cost=0.0001 | ETA 22:06:36 2021-02-23 02:24:51 [INFO] [TRAIN] epoch=57, iter=21200/80000, loss=0.9780, lr=0.007580, batch_cost=1.3602, reader_cost=0.0001 | ETA 22:13:00 2021-02-23 02:25:06 [INFO] [TRAIN] epoch=58, iter=21210/80000, loss=0.7770, lr=0.007579, batch_cost=1.4573, reader_cost=0.0828 | ETA 23:47:54 2021-02-23 02:25:20 [INFO] [TRAIN] epoch=58, iter=21220/80000, loss=0.7975, lr=0.007578, batch_cost=1.4390, reader_cost=0.0001 | ETA 23:29:45 2021-02-23 02:25:34 [INFO] [TRAIN] epoch=58, iter=21230/80000, loss=0.9193, lr=0.007576, batch_cost=1.4192, reader_cost=0.0001 | ETA 23:10:08 2021-02-23 02:25:48 [INFO] [TRAIN] epoch=58, iter=21240/80000, loss=0.9189, lr=0.007575, batch_cost=1.3653, reader_cost=0.0001 | ETA 22:17:03 2021-02-23 02:26:01 [INFO] [TRAIN] epoch=58, iter=21250/80000, loss=0.9316, lr=0.007574, batch_cost=1.3517, reader_cost=0.0001 | ETA 22:03:30 2021-02-23 02:26:15 [INFO] [TRAIN] epoch=58, iter=21260/80000, loss=0.9142, lr=0.007573, batch_cost=1.3474, reader_cost=0.0001 | ETA 21:59:08 2021-02-23 02:26:28 [INFO] [TRAIN] epoch=58, iter=21270/80000, loss=0.9098, lr=0.007572, batch_cost=1.3585, reader_cost=0.0001 | ETA 22:09:42 2021-02-23 02:26:42 [INFO] [TRAIN] epoch=58, iter=21280/80000, loss=0.8742, lr=0.007571, batch_cost=1.3605, reader_cost=0.0001 | ETA 22:11:26 2021-02-23 02:26:56 [INFO] [TRAIN] epoch=58, iter=21290/80000, loss=0.8534, lr=0.007569, batch_cost=1.3567, reader_cost=0.0001 | ETA 22:07:32 2021-02-23 02:27:09 [INFO] [TRAIN] epoch=58, iter=21300/80000, loss=0.7998, lr=0.007568, batch_cost=1.3388, reader_cost=0.0001 | ETA 21:49:46 2021-02-23 02:27:23 [INFO] [TRAIN] epoch=58, iter=21310/80000, loss=1.0596, lr=0.007567, batch_cost=1.3611, reader_cost=0.0001 | ETA 22:11:22 2021-02-23 02:27:36 [INFO] [TRAIN] epoch=58, iter=21320/80000, loss=0.8776, lr=0.007566, batch_cost=1.3537, reader_cost=0.0001 | ETA 22:03:55 2021-02-23 02:27:50 [INFO] [TRAIN] epoch=58, iter=21330/80000, loss=0.9192, lr=0.007565, batch_cost=1.3563, reader_cost=0.0001 | ETA 22:06:13 2021-02-23 02:28:03 [INFO] [TRAIN] epoch=58, iter=21340/80000, loss=0.9456, lr=0.007564, batch_cost=1.3295, reader_cost=0.0001 | ETA 21:39:50 2021-02-23 02:28:16 [INFO] [TRAIN] epoch=58, iter=21350/80000, loss=0.9888, lr=0.007563, batch_cost=1.3382, reader_cost=0.0001 | ETA 21:48:06 2021-02-23 02:28:30 [INFO] [TRAIN] epoch=58, iter=21360/80000, loss=0.9409, lr=0.007561, batch_cost=1.3828, reader_cost=0.0001 | ETA 22:31:27 2021-02-23 02:28:44 [INFO] [TRAIN] epoch=58, iter=21370/80000, loss=0.8642, lr=0.007560, batch_cost=1.3623, reader_cost=0.0001 | ETA 22:11:12 2021-02-23 02:28:57 [INFO] [TRAIN] epoch=58, iter=21380/80000, loss=0.7858, lr=0.007559, batch_cost=1.3589, reader_cost=0.0001 | ETA 22:07:41 2021-02-23 02:29:11 [INFO] [TRAIN] epoch=58, iter=21390/80000, loss=0.9515, lr=0.007558, batch_cost=1.3542, reader_cost=0.0001 | ETA 22:02:51 2021-02-23 02:29:25 [INFO] [TRAIN] epoch=58, iter=21400/80000, loss=0.8597, lr=0.007557, batch_cost=1.3734, reader_cost=0.0001 | ETA 22:21:21 2021-02-23 02:29:38 [INFO] [TRAIN] epoch=58, iter=21410/80000, loss=0.9093, lr=0.007556, batch_cost=1.3497, reader_cost=0.0001 | ETA 21:57:59 2021-02-23 02:29:52 [INFO] [TRAIN] epoch=58, iter=21420/80000, loss=1.1617, lr=0.007554, batch_cost=1.3612, reader_cost=0.0001 | ETA 22:08:58 2021-02-23 02:30:06 [INFO] [TRAIN] epoch=58, iter=21430/80000, loss=0.9457, lr=0.007553, batch_cost=1.3745, reader_cost=0.0001 | ETA 22:21:43 2021-02-23 02:30:19 [INFO] [TRAIN] epoch=58, iter=21440/80000, loss=0.9473, lr=0.007552, batch_cost=1.3661, reader_cost=0.0001 | ETA 22:13:19 2021-02-23 02:30:33 [INFO] [TRAIN] epoch=58, iter=21450/80000, loss=0.9351, lr=0.007551, batch_cost=1.3469, reader_cost=0.0001 | ETA 21:54:19 2021-02-23 02:30:46 [INFO] [TRAIN] epoch=58, iter=21460/80000, loss=0.9387, lr=0.007550, batch_cost=1.3490, reader_cost=0.0001 | ETA 21:56:09 2021-02-23 02:31:00 [INFO] [TRAIN] epoch=58, iter=21470/80000, loss=0.9621, lr=0.007549, batch_cost=1.3486, reader_cost=0.0001 | ETA 21:55:30 2021-02-23 02:31:13 [INFO] [TRAIN] epoch=58, iter=21480/80000, loss=0.8691, lr=0.007547, batch_cost=1.3701, reader_cost=0.0001 | ETA 22:16:19 2021-02-23 02:31:27 [INFO] [TRAIN] epoch=58, iter=21490/80000, loss=0.9868, lr=0.007546, batch_cost=1.3487, reader_cost=0.0001 | ETA 21:55:09 2021-02-23 02:31:41 [INFO] [TRAIN] epoch=58, iter=21500/80000, loss=0.8862, lr=0.007545, batch_cost=1.4191, reader_cost=0.0001 | ETA 23:03:36 2021-02-23 02:31:54 [INFO] [TRAIN] epoch=58, iter=21510/80000, loss=0.8910, lr=0.007544, batch_cost=1.3414, reader_cost=0.0001 | ETA 21:47:38 2021-02-23 02:32:08 [INFO] [TRAIN] epoch=58, iter=21520/80000, loss=0.9441, lr=0.007543, batch_cost=1.3701, reader_cost=0.0001 | ETA 22:15:26 2021-02-23 02:32:22 [INFO] [TRAIN] epoch=58, iter=21530/80000, loss=0.9593, lr=0.007542, batch_cost=1.3668, reader_cost=0.0001 | ETA 22:11:57 2021-02-23 02:32:35 [INFO] [TRAIN] epoch=58, iter=21540/80000, loss=0.9501, lr=0.007540, batch_cost=1.3542, reader_cost=0.0001 | ETA 21:59:24 2021-02-23 02:32:49 [INFO] [TRAIN] epoch=58, iter=21550/80000, loss=0.9354, lr=0.007539, batch_cost=1.3485, reader_cost=0.0001 | ETA 21:53:40 2021-02-23 02:33:03 [INFO] [TRAIN] epoch=58, iter=21560/80000, loss=0.8454, lr=0.007538, batch_cost=1.3932, reader_cost=0.0001 | ETA 22:36:58 2021-02-23 02:33:17 [INFO] [TRAIN] epoch=58, iter=21570/80000, loss=1.0349, lr=0.007537, batch_cost=1.3758, reader_cost=0.0001 | ETA 22:19:46 2021-02-23 02:33:31 [INFO] [TRAIN] epoch=59, iter=21580/80000, loss=0.9999, lr=0.007536, batch_cost=1.4390, reader_cost=0.0753 | ETA 23:21:04 2021-02-23 02:33:44 [INFO] [TRAIN] epoch=59, iter=21590/80000, loss=0.9542, lr=0.007535, batch_cost=1.3426, reader_cost=0.0001 | ETA 21:47:03 2021-02-23 02:33:58 [INFO] [TRAIN] epoch=59, iter=21600/80000, loss=0.9043, lr=0.007534, batch_cost=1.3589, reader_cost=0.0001 | ETA 22:02:39 2021-02-23 02:34:11 [INFO] [TRAIN] epoch=59, iter=21610/80000, loss=0.9333, lr=0.007532, batch_cost=1.3405, reader_cost=0.0001 | ETA 21:44:34 2021-02-23 02:34:25 [INFO] [TRAIN] epoch=59, iter=21620/80000, loss=0.8541, lr=0.007531, batch_cost=1.3743, reader_cost=0.0001 | ETA 22:17:12 2021-02-23 02:34:39 [INFO] [TRAIN] epoch=59, iter=21630/80000, loss=0.9374, lr=0.007530, batch_cost=1.3535, reader_cost=0.0001 | ETA 21:56:43 2021-02-23 02:34:52 [INFO] [TRAIN] epoch=59, iter=21640/80000, loss=0.8825, lr=0.007529, batch_cost=1.3723, reader_cost=0.0001 | ETA 22:14:45 2021-02-23 02:35:06 [INFO] [TRAIN] epoch=59, iter=21650/80000, loss=0.8222, lr=0.007528, batch_cost=1.3486, reader_cost=0.0001 | ETA 21:51:30 2021-02-23 02:35:19 [INFO] [TRAIN] epoch=59, iter=21660/80000, loss=0.9595, lr=0.007527, batch_cost=1.3625, reader_cost=0.0001 | ETA 22:04:50 2021-02-23 02:35:33 [INFO] [TRAIN] epoch=59, iter=21670/80000, loss=1.0091, lr=0.007525, batch_cost=1.3636, reader_cost=0.0001 | ETA 22:05:40 2021-02-23 02:35:47 [INFO] [TRAIN] epoch=59, iter=21680/80000, loss=0.8657, lr=0.007524, batch_cost=1.3833, reader_cost=0.0001 | ETA 22:24:36 2021-02-23 02:36:01 [INFO] [TRAIN] epoch=59, iter=21690/80000, loss=0.8647, lr=0.007523, batch_cost=1.3787, reader_cost=0.0001 | ETA 22:19:52 2021-02-23 02:36:14 [INFO] [TRAIN] epoch=59, iter=21700/80000, loss=0.9450, lr=0.007522, batch_cost=1.3533, reader_cost=0.0001 | ETA 21:55:00 2021-02-23 02:36:28 [INFO] [TRAIN] epoch=59, iter=21710/80000, loss=0.9988, lr=0.007521, batch_cost=1.3614, reader_cost=0.0001 | ETA 22:02:34 2021-02-23 02:36:42 [INFO] [TRAIN] epoch=59, iter=21720/80000, loss=0.8779, lr=0.007520, batch_cost=1.3731, reader_cost=0.0001 | ETA 22:13:42 2021-02-23 02:36:55 [INFO] [TRAIN] epoch=59, iter=21730/80000, loss=0.9007, lr=0.007518, batch_cost=1.3503, reader_cost=0.0001 | ETA 21:51:23 2021-02-23 02:37:09 [INFO] [TRAIN] epoch=59, iter=21740/80000, loss=0.8788, lr=0.007517, batch_cost=1.3628, reader_cost=0.0001 | ETA 22:03:16 2021-02-23 02:37:22 [INFO] [TRAIN] epoch=59, iter=21750/80000, loss=0.9413, lr=0.007516, batch_cost=1.3502, reader_cost=0.0001 | ETA 21:50:51 2021-02-23 02:37:36 [INFO] [TRAIN] epoch=59, iter=21760/80000, loss=0.9584, lr=0.007515, batch_cost=1.3707, reader_cost=0.0001 | ETA 22:10:30 2021-02-23 02:37:49 [INFO] [TRAIN] epoch=59, iter=21770/80000, loss=0.9812, lr=0.007514, batch_cost=1.3435, reader_cost=0.0001 | ETA 21:43:53 2021-02-23 02:38:03 [INFO] [TRAIN] epoch=59, iter=21780/80000, loss=0.8160, lr=0.007513, batch_cost=1.4040, reader_cost=0.0001 | ETA 22:42:20 2021-02-23 02:38:17 [INFO] [TRAIN] epoch=59, iter=21790/80000, loss=1.0411, lr=0.007511, batch_cost=1.3682, reader_cost=0.0001 | ETA 22:07:25 2021-02-23 02:38:31 [INFO] [TRAIN] epoch=59, iter=21800/80000, loss=0.9094, lr=0.007510, batch_cost=1.3434, reader_cost=0.0001 | ETA 21:43:05 2021-02-23 02:38:44 [INFO] [TRAIN] epoch=59, iter=21810/80000, loss=0.8986, lr=0.007509, batch_cost=1.3361, reader_cost=0.0001 | ETA 21:35:47 2021-02-23 02:38:57 [INFO] [TRAIN] epoch=59, iter=21820/80000, loss=0.9858, lr=0.007508, batch_cost=1.3381, reader_cost=0.0001 | ETA 21:37:32 2021-02-23 02:39:11 [INFO] [TRAIN] epoch=59, iter=21830/80000, loss=0.9360, lr=0.007507, batch_cost=1.3849, reader_cost=0.0001 | ETA 22:22:41 2021-02-23 02:39:24 [INFO] [TRAIN] epoch=59, iter=21840/80000, loss=0.9557, lr=0.007506, batch_cost=1.3352, reader_cost=0.0001 | ETA 21:34:17 2021-02-23 02:39:38 [INFO] [TRAIN] epoch=59, iter=21850/80000, loss=1.0190, lr=0.007504, batch_cost=1.3650, reader_cost=0.0001 | ETA 22:02:51 2021-02-23 02:39:52 [INFO] [TRAIN] epoch=59, iter=21860/80000, loss=0.9435, lr=0.007503, batch_cost=1.3447, reader_cost=0.0001 | ETA 21:43:00 2021-02-23 02:40:05 [INFO] [TRAIN] epoch=59, iter=21870/80000, loss=0.8699, lr=0.007502, batch_cost=1.3429, reader_cost=0.0001 | ETA 21:41:03 2021-02-23 02:40:19 [INFO] [TRAIN] epoch=59, iter=21880/80000, loss=0.9002, lr=0.007501, batch_cost=1.3509, reader_cost=0.0001 | ETA 21:48:32 2021-02-23 02:40:32 [INFO] [TRAIN] epoch=59, iter=21890/80000, loss=0.8618, lr=0.007500, batch_cost=1.3580, reader_cost=0.0001 | ETA 21:55:10 2021-02-23 02:40:46 [INFO] [TRAIN] epoch=59, iter=21900/80000, loss=0.9105, lr=0.007499, batch_cost=1.3923, reader_cost=0.0001 | ETA 22:28:14 2021-02-23 02:41:00 [INFO] [TRAIN] epoch=59, iter=21910/80000, loss=0.9621, lr=0.007498, batch_cost=1.3803, reader_cost=0.0001 | ETA 22:16:22 2021-02-23 02:41:14 [INFO] [TRAIN] epoch=59, iter=21920/80000, loss=0.9836, lr=0.007496, batch_cost=1.3764, reader_cost=0.0001 | ETA 22:12:22 2021-02-23 02:41:27 [INFO] [TRAIN] epoch=59, iter=21930/80000, loss=0.8692, lr=0.007495, batch_cost=1.3806, reader_cost=0.0001 | ETA 22:16:09 2021-02-23 02:41:41 [INFO] [TRAIN] epoch=59, iter=21940/80000, loss=0.8920, lr=0.007494, batch_cost=1.3803, reader_cost=0.0001 | ETA 22:15:38 2021-02-23 02:41:55 [INFO] [TRAIN] epoch=60, iter=21950/80000, loss=0.9266, lr=0.007493, batch_cost=1.4246, reader_cost=0.0899 | ETA 22:58:19 2021-02-23 02:42:09 [INFO] [TRAIN] epoch=60, iter=21960/80000, loss=1.0105, lr=0.007492, batch_cost=1.3739, reader_cost=0.0001 | ETA 22:09:01 2021-02-23 02:42:23 [INFO] [TRAIN] epoch=60, iter=21970/80000, loss=0.9514, lr=0.007491, batch_cost=1.3510, reader_cost=0.0001 | ETA 21:46:37 2021-02-23 02:42:36 [INFO] [TRAIN] epoch=60, iter=21980/80000, loss=0.8990, lr=0.007489, batch_cost=1.3743, reader_cost=0.0001 | ETA 22:08:55 2021-02-23 02:42:50 [INFO] [TRAIN] epoch=60, iter=21990/80000, loss=0.8993, lr=0.007488, batch_cost=1.3518, reader_cost=0.0001 | ETA 21:46:56 2021-02-23 02:43:03 [INFO] [TRAIN] epoch=60, iter=22000/80000, loss=0.8292, lr=0.007487, batch_cost=1.3374, reader_cost=0.0001 | ETA 21:32:51 2021-02-23 02:43:03 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:15 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:06 - batch_cost: 0.2417 - reader cost: 0.1154  3/125 [..............................] - ETA: 59s - batch_cost: 0.2880 - reader cost: 0.1177  4/125 [..............................] - ETA: 58s - batch_cost: 0.3286 - reader cost: 0.1350 5/125 [>.............................] - ETA: 55s - batch_cost: 0.3372 - reader cost: 0.1293 6/125 [>.............................] - ETA: 52s - batch_cost: 0.3412 - reader cost: 0.1261 7/125 [>.............................] - ETA: 51s - batch_cost: 0.3475 - reader cost: 0.1273 8/125 [>.............................] - ETA: 50s - batch_cost: 0.3579 - reader cost: 0.1338 9/125 [=>............................] - ETA: 50s - batch_cost: 0.3654 - reader cost: 0.1388 10/125 [=>............................] - ETA: 49s - batch_cost: 0.3691 - reader cost: 0.1399 11/125 [=>............................] - ETA: 48s - batch_cost: 0.3741 - reader cost: 0.1429 12/125 [=>............................] - ETA: 47s - batch_cost: 0.3741 - reader cost: 0.1409 13/125 [==>...........................] - ETA: 47s - batch_cost: 0.3788 - reader cost: 0.1442 14/125 [==>...........................] - ETA: 47s - batch_cost: 0.3819 - reader cost: 0.1460 15/125 [==>...........................] - ETA: 46s - batch_cost: 0.3850 - reader cost: 0.1481 16/125 [==>...........................] - ETA: 46s - batch_cost: 0.3855 - reader cost: 0.1468 17/125 [===>..........................] - ETA: 45s - batch_cost: 0.3882 - reader cost: 0.1489 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3903 - reader cost: 0.1504 19/125 [===>..........................] - ETA: 44s - batch_cost: 0.3926 - reader cost: 0.1520 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3957 - reader cost: 0.1540 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.3983 - reader cost: 0.1554 22/125 [====>.........................] - ETA: 43s - batch_cost: 0.3977 - reader cost: 0.1545 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.3986 - reader cost: 0.1550 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.3975 - reader cost: 0.1535 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.3993 - reader cost: 0.1548 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4013 - reader cost: 0.1561 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4021 - reader cost: 0.1568 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4035 - reader cost: 0.1578 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4053 - reader cost: 0.1594 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4064 - reader cost: 0.1605 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4076 - reader cost: 0.1612 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4088 - reader cost: 0.1620 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4091 - reader cost: 0.1623 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4098 - reader cost: 0.1628 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4102 - reader cost: 0.1632 36/125 [=======>......................] - ETA: 38s - batch_cost: 0.4112 - reader cost: 0.1636 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4119 - reader cost: 0.1639 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4117 - reader cost: 0.1636 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4125 - reader cost: 0.1642 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4123 - reader cost: 0.1637 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4126 - reader cost: 0.1640 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4124 - reader cost: 0.1636 43/125 [=========>....................] - ETA: 35s - batch_cost: 0.4132 - reader cost: 0.1643 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4123 - reader cost: 0.1634 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4129 - reader cost: 0.1640 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4126 - reader cost: 0.1636 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4127 - reader cost: 0.1636 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4131 - reader cost: 0.1638 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4133 - reader cost: 0.1640 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4136 - reader cost: 0.1640 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4138 - reader cost: 0.1643 52/125 [===========>..................] - ETA: 31s - batch_cost: 0.4143 - reader cost: 0.1646 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4152 - reader cost: 0.1655 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4146 - reader cost: 0.1648 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4150 - reader cost: 0.1651 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4144 - reader cost: 0.1645 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4148 - reader cost: 0.1649 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4157 - reader cost: 0.1659 59/125 [=============>................] - ETA: 28s - batch_cost: 0.4152 - reader cost: 0.1653 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4156 - reader cost: 0.1654 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4147 - reader cost: 0.1645 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4150 - reader cost: 0.1648 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4153 - reader cost: 0.1651 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4145 - reader cost: 0.1643 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4150 - reader cost: 0.1646 66/125 [==============>...............] - ETA: 25s - batch_cost: 0.4151 - reader cost: 0.1646 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4144 - reader cost: 0.1639 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4145 - reader cost: 0.1639 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4139 - reader cost: 0.1633 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4142 - reader cost: 0.1634 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4136 - reader cost: 0.1628 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4132 - reader cost: 0.1624 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4130 - reader cost: 0.1617 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4134 - reader cost: 0.1610 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4135 - reader cost: 0.1604 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4142 - reader cost: 0.1607 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4144 - reader cost: 0.1610 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4150 - reader cost: 0.1616 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4154 - reader cost: 0.1620 80/125 [==================>...........] - ETA: 19s - batch_cost: 0.4159 - reader cost: 0.1623 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4154 - reader cost: 0.1619 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4158 - reader cost: 0.1621 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4151 - reader cost: 0.1615 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4155 - reader cost: 0.1620 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4156 - reader cost: 0.1621 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4158 - reader cost: 0.1622 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4159 - reader cost: 0.1623 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4162 - reader cost: 0.1625 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4162 - reader cost: 0.1625 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4166 - reader cost: 0.1627 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4166 - reader cost: 0.1627 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4167 - reader cost: 0.1628 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4163 - reader cost: 0.1623 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4159 - reader cost: 0.1618 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4152 - reader cost: 0.1612 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4157 - reader cost: 0.1617 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4161 - reader cost: 0.1621 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4165 - reader cost: 0.1624 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4168 - reader cost: 0.1627 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4168 - reader cost: 0.1628 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4165 - reader cost: 0.1625 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4166 - reader cost: 0.1626  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4167 - reader cost: 0.1627 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4169 - reader cost: 0.1629 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4169 - reader cost: 0.1628 106/125 [========================>.....] - ETA: 8s - batch_cost: 0.4169 - reader cost: 0.1628 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4165 - reader cost: 0.1624 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4166 - reader cost: 0.1625 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4168 - reader cost: 0.1625 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4163 - reader cost: 0.1620 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4165 - reader cost: 0.1622 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4165 - reader cost: 0.1622 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4167 - reader cost: 0.1624 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4169 - reader cost: 0.1626 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4170 - reader cost: 0.1626 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4169 - reader cost: 0.1626 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4165 - reader cost: 0.1622 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4166 - reader cost: 0.1623 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4167 - reader cost: 0.1624 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4162 - reader cost: 0.1620 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4164 - reader cost: 0.1622 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4164 - reader cost: 0.1622 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4161 - reader cost: 0.1619 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4163 - reader cost: 0.1621 125/125 [==============================] - 53s 421ms/step - batch_cost: 0.4160 - reader cost: 0.1619 2021-02-23 02:43:56 [INFO] [EVAL] #Images=500 mIoU=0.6941 Acc=0.9365 Kappa=0.9169 2021-02-23 02:43:56 [INFO] [EVAL] Class IoU: [0.9363 0.7152 0.9119 0.3948 0.3199 0.6024 0.6757 0.775 0.8808 0.488 0.9433 0.7894 0.5841 0.9256 0.6 0.8465 0.5762 0.4777 0.7458] 2021-02-23 02:43:56 [INFO] [EVAL] Class Acc: [0.9443 0.8791 0.9489 0.5539 0.906 0.8341 0.825 0.9118 0.9501 0.8622 0.9686 0.8507 0.6759 0.9643 0.9207 0.954 0.6177 0.5763 0.8655] 2021-02-23 02:44:00 [INFO] [EVAL] The model with the best validation mIoU (0.7362) was saved at iter 21000. 2021-02-23 02:44:14 [INFO] [TRAIN] epoch=60, iter=22010/80000, loss=0.9320, lr=0.007486, batch_cost=1.3639, reader_cost=0.0001 | ETA 21:58:14 2021-02-23 02:44:27 [INFO] [TRAIN] epoch=60, iter=22020/80000, loss=1.0115, lr=0.007485, batch_cost=1.3921, reader_cost=0.0001 | ETA 22:25:13 2021-02-23 02:44:41 [INFO] [TRAIN] epoch=60, iter=22030/80000, loss=0.8791, lr=0.007484, batch_cost=1.3721, reader_cost=0.0001 | ETA 22:05:40 2021-02-23 02:44:55 [INFO] [TRAIN] epoch=60, iter=22040/80000, loss=0.8939, lr=0.007482, batch_cost=1.3591, reader_cost=0.0001 | ETA 21:52:51 2021-02-23 02:45:08 [INFO] [TRAIN] epoch=60, iter=22050/80000, loss=0.8815, lr=0.007481, batch_cost=1.3546, reader_cost=0.0001 | ETA 21:48:19 2021-02-23 02:45:22 [INFO] [TRAIN] epoch=60, iter=22060/80000, loss=0.8803, lr=0.007480, batch_cost=1.3642, reader_cost=0.0001 | ETA 21:57:24 2021-02-23 02:45:36 [INFO] [TRAIN] epoch=60, iter=22070/80000, loss=0.9752, lr=0.007479, batch_cost=1.3630, reader_cost=0.0001 | ETA 21:55:55 2021-02-23 02:45:49 [INFO] [TRAIN] epoch=60, iter=22080/80000, loss=0.8201, lr=0.007478, batch_cost=1.3587, reader_cost=0.0001 | ETA 21:51:35 2021-02-23 02:46:03 [INFO] [TRAIN] epoch=60, iter=22090/80000, loss=0.8258, lr=0.007477, batch_cost=1.3677, reader_cost=0.0001 | ETA 22:00:01 2021-02-23 02:46:16 [INFO] [TRAIN] epoch=60, iter=22100/80000, loss=0.8747, lr=0.007475, batch_cost=1.3471, reader_cost=0.0001 | ETA 21:39:57 2021-02-23 02:46:30 [INFO] [TRAIN] epoch=60, iter=22110/80000, loss=0.8981, lr=0.007474, batch_cost=1.3625, reader_cost=0.0001 | ETA 21:54:35 2021-02-23 02:46:44 [INFO] [TRAIN] epoch=60, iter=22120/80000, loss=0.9078, lr=0.007473, batch_cost=1.3575, reader_cost=0.0001 | ETA 21:49:33 2021-02-23 02:46:57 [INFO] [TRAIN] epoch=60, iter=22130/80000, loss=0.8500, lr=0.007472, batch_cost=1.3363, reader_cost=0.0001 | ETA 21:28:51 2021-02-23 02:47:11 [INFO] [TRAIN] epoch=60, iter=22140/80000, loss=1.1088, lr=0.007471, batch_cost=1.3620, reader_cost=0.0001 | ETA 21:53:25 2021-02-23 02:47:24 [INFO] [TRAIN] epoch=60, iter=22150/80000, loss=0.9769, lr=0.007470, batch_cost=1.3674, reader_cost=0.0001 | ETA 21:58:26 2021-02-23 02:47:38 [INFO] [TRAIN] epoch=60, iter=22160/80000, loss=0.9560, lr=0.007468, batch_cost=1.3337, reader_cost=0.0001 | ETA 21:25:40 2021-02-23 02:47:51 [INFO] [TRAIN] epoch=60, iter=22170/80000, loss=1.0181, lr=0.007467, batch_cost=1.3823, reader_cost=0.0001 | ETA 22:12:19 2021-02-23 02:48:05 [INFO] [TRAIN] epoch=60, iter=22180/80000, loss=1.3710, lr=0.007466, batch_cost=1.3812, reader_cost=0.0001 | ETA 22:11:03 2021-02-23 02:48:19 [INFO] [TRAIN] epoch=60, iter=22190/80000, loss=0.9986, lr=0.007465, batch_cost=1.3488, reader_cost=0.0001 | ETA 21:39:32 2021-02-23 02:48:33 [INFO] [TRAIN] epoch=60, iter=22200/80000, loss=0.9875, lr=0.007464, batch_cost=1.3899, reader_cost=0.0001 | ETA 22:18:53 2021-02-23 02:48:46 [INFO] [TRAIN] epoch=60, iter=22210/80000, loss=0.8707, lr=0.007463, batch_cost=1.3957, reader_cost=0.0001 | ETA 22:24:14 2021-02-23 02:49:00 [INFO] [TRAIN] epoch=60, iter=22220/80000, loss=0.9451, lr=0.007461, batch_cost=1.3594, reader_cost=0.0001 | ETA 21:49:06 2021-02-23 02:49:14 [INFO] [TRAIN] epoch=60, iter=22230/80000, loss=0.8910, lr=0.007460, batch_cost=1.3498, reader_cost=0.0001 | ETA 21:39:39 2021-02-23 02:49:27 [INFO] [TRAIN] epoch=60, iter=22240/80000, loss=0.8801, lr=0.007459, batch_cost=1.3524, reader_cost=0.0001 | ETA 21:41:57 2021-02-23 02:49:41 [INFO] [TRAIN] epoch=60, iter=22250/80000, loss=1.0334, lr=0.007458, batch_cost=1.3595, reader_cost=0.0001 | ETA 21:48:32 2021-02-23 02:49:54 [INFO] [TRAIN] epoch=60, iter=22260/80000, loss=0.9491, lr=0.007457, batch_cost=1.3754, reader_cost=0.0001 | ETA 22:03:35 2021-02-23 02:50:08 [INFO] [TRAIN] epoch=60, iter=22270/80000, loss=1.0368, lr=0.007456, batch_cost=1.3388, reader_cost=0.0001 | ETA 21:28:08 2021-02-23 02:50:22 [INFO] [TRAIN] epoch=60, iter=22280/80000, loss=0.9556, lr=0.007455, batch_cost=1.4070, reader_cost=0.0001 | ETA 22:33:33 2021-02-23 02:50:36 [INFO] [TRAIN] epoch=60, iter=22290/80000, loss=0.9412, lr=0.007453, batch_cost=1.3663, reader_cost=0.0001 | ETA 21:54:09 2021-02-23 02:50:49 [INFO] [TRAIN] epoch=60, iter=22300/80000, loss=0.8508, lr=0.007452, batch_cost=1.3702, reader_cost=0.0001 | ETA 21:57:40 2021-02-23 02:51:03 [INFO] [TRAIN] epoch=60, iter=22310/80000, loss=0.9085, lr=0.007451, batch_cost=1.3495, reader_cost=0.0001 | ETA 21:37:32 2021-02-23 02:51:16 [INFO] [TRAIN] epoch=60, iter=22320/80000, loss=0.9078, lr=0.007450, batch_cost=1.3036, reader_cost=0.0001 | ETA 20:53:10 2021-02-23 02:51:30 [INFO] [TRAIN] epoch=61, iter=22330/80000, loss=0.9128, lr=0.007449, batch_cost=1.4659, reader_cost=0.0665 | ETA 23:28:57 2021-02-23 02:51:44 [INFO] [TRAIN] epoch=61, iter=22340/80000, loss=0.8592, lr=0.007448, batch_cost=1.3594, reader_cost=0.0001 | ETA 21:46:22 2021-02-23 02:51:58 [INFO] [TRAIN] epoch=61, iter=22350/80000, loss=0.9809, lr=0.007446, batch_cost=1.3518, reader_cost=0.0001 | ETA 21:38:52 2021-02-23 02:52:11 [INFO] [TRAIN] epoch=61, iter=22360/80000, loss=0.9134, lr=0.007445, batch_cost=1.3786, reader_cost=0.0001 | ETA 22:04:21 2021-02-23 02:52:25 [INFO] [TRAIN] epoch=61, iter=22370/80000, loss=0.8887, lr=0.007444, batch_cost=1.3456, reader_cost=0.0001 | ETA 21:32:24 2021-02-23 02:52:38 [INFO] [TRAIN] epoch=61, iter=22380/80000, loss=0.8957, lr=0.007443, batch_cost=1.3508, reader_cost=0.0001 | ETA 21:37:14 2021-02-23 02:52:52 [INFO] [TRAIN] epoch=61, iter=22390/80000, loss=0.9228, lr=0.007442, batch_cost=1.3636, reader_cost=0.0001 | ETA 21:49:14 2021-02-23 02:53:05 [INFO] [TRAIN] epoch=61, iter=22400/80000, loss=0.8449, lr=0.007441, batch_cost=1.3505, reader_cost=0.0001 | ETA 21:36:30 2021-02-23 02:53:19 [INFO] [TRAIN] epoch=61, iter=22410/80000, loss=0.9705, lr=0.007439, batch_cost=1.3496, reader_cost=0.0001 | ETA 21:35:22 2021-02-23 02:53:33 [INFO] [TRAIN] epoch=61, iter=22420/80000, loss=1.0289, lr=0.007438, batch_cost=1.3825, reader_cost=0.0001 | ETA 22:06:46 2021-02-23 02:53:46 [INFO] [TRAIN] epoch=61, iter=22430/80000, loss=0.8721, lr=0.007437, batch_cost=1.3501, reader_cost=0.0001 | ETA 21:35:24 2021-02-23 02:54:00 [INFO] [TRAIN] epoch=61, iter=22440/80000, loss=0.9534, lr=0.007436, batch_cost=1.3778, reader_cost=0.0001 | ETA 22:01:44 2021-02-23 02:54:14 [INFO] [TRAIN] epoch=61, iter=22450/80000, loss=1.0942, lr=0.007435, batch_cost=1.3515, reader_cost=0.0001 | ETA 21:36:17 2021-02-23 02:54:27 [INFO] [TRAIN] epoch=61, iter=22460/80000, loss=0.8437, lr=0.007434, batch_cost=1.3782, reader_cost=0.0001 | ETA 22:01:42 2021-02-23 02:54:41 [INFO] [TRAIN] epoch=61, iter=22470/80000, loss=0.9118, lr=0.007432, batch_cost=1.3649, reader_cost=0.0001 | ETA 21:48:40 2021-02-23 02:54:55 [INFO] [TRAIN] epoch=61, iter=22480/80000, loss=0.9598, lr=0.007431, batch_cost=1.3804, reader_cost=0.0001 | ETA 22:03:20 2021-02-23 02:55:08 [INFO] [TRAIN] epoch=61, iter=22490/80000, loss=1.0144, lr=0.007430, batch_cost=1.3403, reader_cost=0.0001 | ETA 21:24:38 2021-02-23 02:55:22 [INFO] [TRAIN] epoch=61, iter=22500/80000, loss=0.8829, lr=0.007429, batch_cost=1.3669, reader_cost=0.0001 | ETA 21:49:55 2021-02-23 02:55:35 [INFO] [TRAIN] epoch=61, iter=22510/80000, loss=0.9127, lr=0.007428, batch_cost=1.3417, reader_cost=0.0001 | ETA 21:25:35 2021-02-23 02:55:49 [INFO] [TRAIN] epoch=61, iter=22520/80000, loss=0.8637, lr=0.007427, batch_cost=1.3868, reader_cost=0.0001 | ETA 22:08:31 2021-02-23 02:56:03 [INFO] [TRAIN] epoch=61, iter=22530/80000, loss=0.9425, lr=0.007425, batch_cost=1.3484, reader_cost=0.0001 | ETA 21:31:31 2021-02-23 02:56:16 [INFO] [TRAIN] epoch=61, iter=22540/80000, loss=0.9301, lr=0.007424, batch_cost=1.3595, reader_cost=0.0001 | ETA 21:41:54 2021-02-23 02:56:30 [INFO] [TRAIN] epoch=61, iter=22550/80000, loss=0.9386, lr=0.007423, batch_cost=1.3654, reader_cost=0.0001 | ETA 21:47:25 2021-02-23 02:56:44 [INFO] [TRAIN] epoch=61, iter=22560/80000, loss=0.9178, lr=0.007422, batch_cost=1.3659, reader_cost=0.0001 | ETA 21:47:38 2021-02-23 02:56:57 [INFO] [TRAIN] epoch=61, iter=22570/80000, loss=0.8944, lr=0.007421, batch_cost=1.3299, reader_cost=0.0001 | ETA 21:12:54 2021-02-23 02:57:10 [INFO] [TRAIN] epoch=61, iter=22580/80000, loss=0.9042, lr=0.007420, batch_cost=1.3536, reader_cost=0.0001 | ETA 21:35:21 2021-02-23 02:57:24 [INFO] [TRAIN] epoch=61, iter=22590/80000, loss=0.9302, lr=0.007418, batch_cost=1.3608, reader_cost=0.0001 | ETA 21:42:06 2021-02-23 02:57:38 [INFO] [TRAIN] epoch=61, iter=22600/80000, loss=0.9388, lr=0.007417, batch_cost=1.3573, reader_cost=0.0001 | ETA 21:38:27 2021-02-23 02:57:51 [INFO] [TRAIN] epoch=61, iter=22610/80000, loss=0.9053, lr=0.007416, batch_cost=1.3627, reader_cost=0.0001 | ETA 21:43:22 2021-02-23 02:58:05 [INFO] [TRAIN] epoch=61, iter=22620/80000, loss=0.9655, lr=0.007415, batch_cost=1.3577, reader_cost=0.0001 | ETA 21:38:24 2021-02-23 02:58:18 [INFO] [TRAIN] epoch=61, iter=22630/80000, loss=0.9392, lr=0.007414, batch_cost=1.3507, reader_cost=0.0001 | ETA 21:31:29 2021-02-23 02:58:32 [INFO] [TRAIN] epoch=61, iter=22640/80000, loss=0.8855, lr=0.007413, batch_cost=1.3448, reader_cost=0.0001 | ETA 21:25:38 2021-02-23 02:58:46 [INFO] [TRAIN] epoch=61, iter=22650/80000, loss=0.9585, lr=0.007411, batch_cost=1.3874, reader_cost=0.0001 | ETA 22:06:05 2021-02-23 02:58:59 [INFO] [TRAIN] epoch=61, iter=22660/80000, loss=0.8943, lr=0.007410, batch_cost=1.3498, reader_cost=0.0001 | ETA 21:29:58 2021-02-23 02:59:13 [INFO] [TRAIN] epoch=61, iter=22670/80000, loss=0.8660, lr=0.007409, batch_cost=1.3503, reader_cost=0.0001 | ETA 21:30:14 2021-02-23 02:59:26 [INFO] [TRAIN] epoch=61, iter=22680/80000, loss=0.9917, lr=0.007408, batch_cost=1.3349, reader_cost=0.0001 | ETA 21:15:16 2021-02-23 02:59:40 [INFO] [TRAIN] epoch=61, iter=22690/80000, loss=0.9401, lr=0.007407, batch_cost=1.3914, reader_cost=0.0001 | ETA 22:09:03 2021-02-23 02:59:55 [INFO] [TRAIN] epoch=62, iter=22700/80000, loss=0.9362, lr=0.007406, batch_cost=1.4845, reader_cost=0.0860 | ETA 23:37:44 2021-02-23 03:00:08 [INFO] [TRAIN] epoch=62, iter=22710/80000, loss=0.9342, lr=0.007405, batch_cost=1.3523, reader_cost=0.0001 | ETA 21:31:12 2021-02-23 03:00:22 [INFO] [TRAIN] epoch=62, iter=22720/80000, loss=0.9411, lr=0.007403, batch_cost=1.3578, reader_cost=0.0001 | ETA 21:36:15 2021-02-23 03:00:35 [INFO] [TRAIN] epoch=62, iter=22730/80000, loss=0.7494, lr=0.007402, batch_cost=1.3560, reader_cost=0.0001 | ETA 21:34:17 2021-02-23 03:00:49 [INFO] [TRAIN] epoch=62, iter=22740/80000, loss=0.9051, lr=0.007401, batch_cost=1.3714, reader_cost=0.0001 | ETA 21:48:47 2021-02-23 03:01:03 [INFO] [TRAIN] epoch=62, iter=22750/80000, loss=1.0419, lr=0.007400, batch_cost=1.3564, reader_cost=0.0001 | ETA 21:34:16 2021-02-23 03:01:16 [INFO] [TRAIN] epoch=62, iter=22760/80000, loss=0.9587, lr=0.007399, batch_cost=1.3675, reader_cost=0.0001 | ETA 21:44:34 2021-02-23 03:01:30 [INFO] [TRAIN] epoch=62, iter=22770/80000, loss=0.8695, lr=0.007398, batch_cost=1.3574, reader_cost=0.0001 | ETA 21:34:43 2021-02-23 03:01:43 [INFO] [TRAIN] epoch=62, iter=22780/80000, loss=0.9292, lr=0.007396, batch_cost=1.3234, reader_cost=0.0001 | ETA 21:02:05 2021-02-23 03:01:57 [INFO] [TRAIN] epoch=62, iter=22790/80000, loss=0.8880, lr=0.007395, batch_cost=1.3536, reader_cost=0.0001 | ETA 21:30:38 2021-02-23 03:02:10 [INFO] [TRAIN] epoch=62, iter=22800/80000, loss=1.1129, lr=0.007394, batch_cost=1.3569, reader_cost=0.0001 | ETA 21:33:34 2021-02-23 03:02:24 [INFO] [TRAIN] epoch=62, iter=22810/80000, loss=0.9889, lr=0.007393, batch_cost=1.3484, reader_cost=0.0001 | ETA 21:25:14 2021-02-23 03:02:38 [INFO] [TRAIN] epoch=62, iter=22820/80000, loss=0.8525, lr=0.007392, batch_cost=1.3921, reader_cost=0.0001 | ETA 22:06:41 2021-02-23 03:02:51 [INFO] [TRAIN] epoch=62, iter=22830/80000, loss=0.8968, lr=0.007391, batch_cost=1.3668, reader_cost=0.0001 | ETA 21:42:18 2021-02-23 03:03:05 [INFO] [TRAIN] epoch=62, iter=22840/80000, loss=0.8832, lr=0.007389, batch_cost=1.3515, reader_cost=0.0001 | ETA 21:27:29 2021-02-23 03:03:18 [INFO] [TRAIN] epoch=62, iter=22850/80000, loss=0.9608, lr=0.007388, batch_cost=1.3422, reader_cost=0.0001 | ETA 21:18:29 2021-02-23 03:03:32 [INFO] [TRAIN] epoch=62, iter=22860/80000, loss=0.8933, lr=0.007387, batch_cost=1.3560, reader_cost=0.0001 | ETA 21:31:23 2021-02-23 03:03:45 [INFO] [TRAIN] epoch=62, iter=22870/80000, loss=0.9187, lr=0.007386, batch_cost=1.3425, reader_cost=0.0001 | ETA 21:18:17 2021-02-23 03:03:59 [INFO] [TRAIN] epoch=62, iter=22880/80000, loss=1.0052, lr=0.007385, batch_cost=1.3684, reader_cost=0.0001 | ETA 21:42:43 2021-02-23 03:04:13 [INFO] [TRAIN] epoch=62, iter=22890/80000, loss=0.8677, lr=0.007384, batch_cost=1.3682, reader_cost=0.0001 | ETA 21:42:19 2021-02-23 03:04:26 [INFO] [TRAIN] epoch=62, iter=22900/80000, loss=0.8285, lr=0.007382, batch_cost=1.3559, reader_cost=0.0001 | ETA 21:30:21 2021-02-23 03:04:40 [INFO] [TRAIN] epoch=62, iter=22910/80000, loss=0.8685, lr=0.007381, batch_cost=1.3725, reader_cost=0.0001 | ETA 21:45:57 2021-02-23 03:04:53 [INFO] [TRAIN] epoch=62, iter=22920/80000, loss=0.9258, lr=0.007380, batch_cost=1.3427, reader_cost=0.0001 | ETA 21:17:23 2021-02-23 03:05:07 [INFO] [TRAIN] epoch=62, iter=22930/80000, loss=0.9191, lr=0.007379, batch_cost=1.3697, reader_cost=0.0001 | ETA 21:42:51 2021-02-23 03:05:21 [INFO] [TRAIN] epoch=62, iter=22940/80000, loss=0.8482, lr=0.007378, batch_cost=1.3506, reader_cost=0.0001 | ETA 21:24:26 2021-02-23 03:05:34 [INFO] [TRAIN] epoch=62, iter=22950/80000, loss=0.9638, lr=0.007377, batch_cost=1.3531, reader_cost=0.0001 | ETA 21:26:34 2021-02-23 03:05:48 [INFO] [TRAIN] epoch=62, iter=22960/80000, loss=0.9091, lr=0.007375, batch_cost=1.4007, reader_cost=0.0001 | ETA 22:11:37 2021-02-23 03:06:02 [INFO] [TRAIN] epoch=62, iter=22970/80000, loss=0.9800, lr=0.007374, batch_cost=1.3639, reader_cost=0.0001 | ETA 21:36:23 2021-02-23 03:06:15 [INFO] [TRAIN] epoch=62, iter=22980/80000, loss=0.8498, lr=0.007373, batch_cost=1.3600, reader_cost=0.0001 | ETA 21:32:26 2021-02-23 03:06:29 [INFO] [TRAIN] epoch=62, iter=22990/80000, loss=0.8984, lr=0.007372, batch_cost=1.3357, reader_cost=0.0001 | ETA 21:09:10 2021-02-23 03:06:43 [INFO] [TRAIN] epoch=62, iter=23000/80000, loss=0.8790, lr=0.007371, batch_cost=1.3827, reader_cost=0.0001 | ETA 21:53:31 2021-02-23 03:06:43 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:09 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 59s - batch_cost: 0.2058 - reader cost: 0.0737  3/125 [..............................] - ETA: 57s - batch_cost: 0.2816 - reader cost: 0.1096 4/125 [..............................] - ETA: 56s - batch_cost: 0.3239 - reader cost: 0.1177 5/125 [>.............................] - ETA: 54s - batch_cost: 0.3429 - reader cost: 0.1083 6/125 [>.............................] - ETA: 53s - batch_cost: 0.3519 - reader cost: 0.1028 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3625 - reader cost: 0.0989 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3703 - reader cost: 0.1018 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3785 - reader cost: 0.1121 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3814 - reader cost: 0.1164 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3870 - reader cost: 0.1234 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3875 - reader cost: 0.1247 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3890 - reader cost: 0.1270 14/125 [==>...........................] - ETA: 47s - batch_cost: 0.3918 - reader cost: 0.1306 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3953 - reader cost: 0.1348 16/125 [==>...........................] - ETA: 46s - batch_cost: 0.3949 - reader cost: 0.1349 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3966 - reader cost: 0.1372 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3980 - reader cost: 0.1392 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3985 - reader cost: 0.1378 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3999 - reader cost: 0.1397 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4013 - reader cost: 0.1415 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4024 - reader cost: 0.1432 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4024 - reader cost: 0.1432 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4039 - reader cost: 0.1447 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4046 - reader cost: 0.1457 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4039 - reader cost: 0.1454 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4050 - reader cost: 0.1468 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4077 - reader cost: 0.1493 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4095 - reader cost: 0.1505 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4082 - reader cost: 0.1494 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4099 - reader cost: 0.1512 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4109 - reader cost: 0.1525 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4098 - reader cost: 0.1516 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4095 - reader cost: 0.1510 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4097 - reader cost: 0.1511 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4106 - reader cost: 0.1523 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4097 - reader cost: 0.1515 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4086 - reader cost: 0.1506 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4089 - reader cost: 0.1496 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4102 - reader cost: 0.1501 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4105 - reader cost: 0.1507 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4113 - reader cost: 0.1517 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4125 - reader cost: 0.1530 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4117 - reader cost: 0.1524 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4122 - reader cost: 0.1531 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4125 - reader cost: 0.1536 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4120 - reader cost: 0.1533 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4123 - reader cost: 0.1538 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4115 - reader cost: 0.1530 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4108 - reader cost: 0.1525 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4103 - reader cost: 0.1517 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4105 - reader cost: 0.1520 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4103 - reader cost: 0.1520 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4103 - reader cost: 0.1520 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4105 - reader cost: 0.1523 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4106 - reader cost: 0.1525 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4102 - reader cost: 0.1522 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4105 - reader cost: 0.1526 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4106 - reader cost: 0.1521 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4106 - reader cost: 0.1517 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4111 - reader cost: 0.1520 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4115 - reader cost: 0.1526 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4117 - reader cost: 0.1524 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4116 - reader cost: 0.1520 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4120 - reader cost: 0.1517 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4124 - reader cost: 0.1522 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4127 - reader cost: 0.1526 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4129 - reader cost: 0.1529 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4126 - reader cost: 0.1528 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4130 - reader cost: 0.1533 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4137 - reader cost: 0.1540 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4139 - reader cost: 0.1543 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4141 - reader cost: 0.1546 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4142 - reader cost: 0.1549 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4145 - reader cost: 0.1552 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4149 - reader cost: 0.1557 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4151 - reader cost: 0.1559 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4153 - reader cost: 0.1562 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4152 - reader cost: 0.1560 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4152 - reader cost: 0.1562 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4155 - reader cost: 0.1565 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4155 - reader cost: 0.1567 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4158 - reader cost: 0.1570 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4153 - reader cost: 0.1566 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4149 - reader cost: 0.1562 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4151 - reader cost: 0.1564 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4152 - reader cost: 0.1566 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4153 - reader cost: 0.1568 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4155 - reader cost: 0.1570 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4156 - reader cost: 0.1573 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4158 - reader cost: 0.1575 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4153 - reader cost: 0.1571 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4150 - reader cost: 0.1568 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4152 - reader cost: 0.1571 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4154 - reader cost: 0.1573 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4149 - reader cost: 0.1568 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4150 - reader cost: 0.1567 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4149 - reader cost: 0.1566 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4153 - reader cost: 0.1571 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4150 - reader cost: 0.1569 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4153 - reader cost: 0.1572 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4149 - reader cost: 0.1569  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4154 - reader cost: 0.1574 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4155 - reader cost: 0.1576 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4156 - reader cost: 0.1578 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4154 - reader cost: 0.1577 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4157 - reader cost: 0.1579 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4160 - reader cost: 0.1582 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4158 - reader cost: 0.1581 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4156 - reader cost: 0.1579 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4153 - reader cost: 0.1577 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4151 - reader cost: 0.1576 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4153 - reader cost: 0.1574 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4150 - reader cost: 0.1570 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4151 - reader cost: 0.1569 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4152 - reader cost: 0.1566 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4154 - reader cost: 0.1568 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4156 - reader cost: 0.1570 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4158 - reader cost: 0.1573 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4160 - reader cost: 0.1575 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4162 - reader cost: 0.1577 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4160 - reader cost: 0.1576 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4163 - reader cost: 0.1578 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4164 - reader cost: 0.1579 125/125 [==============================] - 53s 421ms/step - batch_cost: 0.4165 - reader cost: 0.1581 2021-02-23 03:07:35 [INFO] [EVAL] #Images=500 mIoU=0.7349 Acc=0.9530 Kappa=0.9390 2021-02-23 03:07:35 [INFO] [EVAL] Class IoU: [0.9754 0.8194 0.9145 0.4363 0.4627 0.6377 0.6986 0.7251 0.9125 0.5876 0.94 0.8071 0.6128 0.9415 0.616 0.7355 0.7459 0.6225 0.7721] 2021-02-23 03:07:35 [INFO] [EVAL] Class Acc: [0.9869 0.9057 0.9455 0.8341 0.8367 0.7734 0.8533 0.8133 0.9534 0.6926 0.9755 0.873 0.8124 0.9632 0.8942 0.8417 0.8599 0.849 0.8824] 2021-02-23 03:07:39 [INFO] [EVAL] The model with the best validation mIoU (0.7362) was saved at iter 21000. 2021-02-23 03:07:53 [INFO] [TRAIN] epoch=62, iter=23010/80000, loss=0.8753, lr=0.007370, batch_cost=1.3631, reader_cost=0.0001 | ETA 21:34:43 2021-02-23 03:08:07 [INFO] [TRAIN] epoch=62, iter=23020/80000, loss=0.9292, lr=0.007368, batch_cost=1.3875, reader_cost=0.0001 | ETA 21:57:40 2021-02-23 03:08:20 [INFO] [TRAIN] epoch=62, iter=23030/80000, loss=0.9038, lr=0.007367, batch_cost=1.3652, reader_cost=0.0001 | ETA 21:36:16 2021-02-23 03:08:34 [INFO] [TRAIN] epoch=62, iter=23040/80000, loss=0.8616, lr=0.007366, batch_cost=1.3381, reader_cost=0.0001 | ETA 21:10:18 2021-02-23 03:08:47 [INFO] [TRAIN] epoch=62, iter=23050/80000, loss=0.8645, lr=0.007365, batch_cost=1.3563, reader_cost=0.0001 | ETA 21:27:24 2021-02-23 03:09:01 [INFO] [TRAIN] epoch=62, iter=23060/80000, loss=0.8513, lr=0.007364, batch_cost=1.3528, reader_cost=0.0001 | ETA 21:23:46 2021-02-23 03:09:15 [INFO] [TRAIN] epoch=63, iter=23070/80000, loss=0.9147, lr=0.007363, batch_cost=1.4361, reader_cost=0.0714 | ETA 22:42:34 2021-02-23 03:09:29 [INFO] [TRAIN] epoch=63, iter=23080/80000, loss=0.9226, lr=0.007361, batch_cost=1.3652, reader_cost=0.0001 | ETA 21:35:08 2021-02-23 03:09:42 [INFO] [TRAIN] epoch=63, iter=23090/80000, loss=0.9680, lr=0.007360, batch_cost=1.3740, reader_cost=0.0001 | ETA 21:43:15 2021-02-23 03:09:56 [INFO] [TRAIN] epoch=63, iter=23100/80000, loss=0.8838, lr=0.007359, batch_cost=1.3563, reader_cost=0.0001 | ETA 21:26:15 2021-02-23 03:10:09 [INFO] [TRAIN] epoch=63, iter=23110/80000, loss=0.8686, lr=0.007358, batch_cost=1.3438, reader_cost=0.0001 | ETA 21:14:08 2021-02-23 03:10:23 [INFO] [TRAIN] epoch=63, iter=23120/80000, loss=0.8792, lr=0.007357, batch_cost=1.3615, reader_cost=0.0001 | ETA 21:30:43 2021-02-23 03:10:37 [INFO] [TRAIN] epoch=63, iter=23130/80000, loss=0.9020, lr=0.007356, batch_cost=1.3631, reader_cost=0.0001 | ETA 21:31:57 2021-02-23 03:10:50 [INFO] [TRAIN] epoch=63, iter=23140/80000, loss=0.9560, lr=0.007354, batch_cost=1.3673, reader_cost=0.0001 | ETA 21:35:45 2021-02-23 03:11:04 [INFO] [TRAIN] epoch=63, iter=23150/80000, loss=0.8504, lr=0.007353, batch_cost=1.3755, reader_cost=0.0001 | ETA 21:43:15 2021-02-23 03:11:18 [INFO] [TRAIN] epoch=63, iter=23160/80000, loss=0.8503, lr=0.007352, batch_cost=1.3598, reader_cost=0.0001 | ETA 21:28:10 2021-02-23 03:11:32 [INFO] [TRAIN] epoch=63, iter=23170/80000, loss=0.9599, lr=0.007351, batch_cost=1.3770, reader_cost=0.0001 | ETA 21:44:14 2021-02-23 03:11:46 [INFO] [TRAIN] epoch=63, iter=23180/80000, loss=0.8712, lr=0.007350, batch_cost=1.3964, reader_cost=0.0001 | ETA 22:02:23 2021-02-23 03:11:59 [INFO] [TRAIN] epoch=63, iter=23190/80000, loss=0.9296, lr=0.007349, batch_cost=1.3625, reader_cost=0.0001 | ETA 21:30:01 2021-02-23 03:12:13 [INFO] [TRAIN] epoch=63, iter=23200/80000, loss=0.8197, lr=0.007347, batch_cost=1.3771, reader_cost=0.0001 | ETA 21:43:37 2021-02-23 03:12:27 [INFO] [TRAIN] epoch=63, iter=23210/80000, loss=0.8344, lr=0.007346, batch_cost=1.3648, reader_cost=0.0001 | ETA 21:31:44 2021-02-23 03:12:40 [INFO] [TRAIN] epoch=63, iter=23220/80000, loss=0.8909, lr=0.007345, batch_cost=1.3760, reader_cost=0.0001 | ETA 21:42:08 2021-02-23 03:12:54 [INFO] [TRAIN] epoch=63, iter=23230/80000, loss=0.9542, lr=0.007344, batch_cost=1.3388, reader_cost=0.0001 | ETA 21:06:44 2021-02-23 03:13:07 [INFO] [TRAIN] epoch=63, iter=23240/80000, loss=0.9494, lr=0.007343, batch_cost=1.3443, reader_cost=0.0001 | ETA 21:11:45 2021-02-23 03:13:21 [INFO] [TRAIN] epoch=63, iter=23250/80000, loss=0.8540, lr=0.007342, batch_cost=1.3573, reader_cost=0.0001 | ETA 21:23:44 2021-02-23 03:13:34 [INFO] [TRAIN] epoch=63, iter=23260/80000, loss=0.9070, lr=0.007341, batch_cost=1.3609, reader_cost=0.0001 | ETA 21:26:56 2021-02-23 03:13:48 [INFO] [TRAIN] epoch=63, iter=23270/80000, loss=0.9187, lr=0.007339, batch_cost=1.3368, reader_cost=0.0001 | ETA 21:03:57 2021-02-23 03:14:01 [INFO] [TRAIN] epoch=63, iter=23280/80000, loss=0.8812, lr=0.007338, batch_cost=1.3458, reader_cost=0.0001 | ETA 21:12:12 2021-02-23 03:14:15 [INFO] [TRAIN] epoch=63, iter=23290/80000, loss=1.0096, lr=0.007337, batch_cost=1.3845, reader_cost=0.0001 | ETA 21:48:36 2021-02-23 03:14:29 [INFO] [TRAIN] epoch=63, iter=23300/80000, loss=0.9368, lr=0.007336, batch_cost=1.3606, reader_cost=0.0001 | ETA 21:25:43 2021-02-23 03:14:42 [INFO] [TRAIN] epoch=63, iter=23310/80000, loss=0.9198, lr=0.007335, batch_cost=1.3284, reader_cost=0.0001 | ETA 20:55:05 2021-02-23 03:14:55 [INFO] [TRAIN] epoch=63, iter=23320/80000, loss=0.8980, lr=0.007334, batch_cost=1.3593, reader_cost=0.0001 | ETA 21:24:05 2021-02-23 03:15:09 [INFO] [TRAIN] epoch=63, iter=23330/80000, loss=1.0115, lr=0.007332, batch_cost=1.3821, reader_cost=0.0001 | ETA 21:45:23 2021-02-23 03:15:23 [INFO] [TRAIN] epoch=63, iter=23340/80000, loss=0.9041, lr=0.007331, batch_cost=1.3566, reader_cost=0.0001 | ETA 21:21:04 2021-02-23 03:15:37 [INFO] [TRAIN] epoch=63, iter=23350/80000, loss=0.8933, lr=0.007330, batch_cost=1.3661, reader_cost=0.0001 | ETA 21:29:50 2021-02-23 03:15:50 [INFO] [TRAIN] epoch=63, iter=23360/80000, loss=0.8514, lr=0.007329, batch_cost=1.3360, reader_cost=0.0001 | ETA 21:01:08 2021-02-23 03:16:03 [INFO] [TRAIN] epoch=63, iter=23370/80000, loss=1.0189, lr=0.007328, batch_cost=1.3541, reader_cost=0.0001 | ETA 21:18:00 2021-02-23 03:16:17 [INFO] [TRAIN] epoch=63, iter=23380/80000, loss=0.9126, lr=0.007327, batch_cost=1.3574, reader_cost=0.0001 | ETA 21:20:56 2021-02-23 03:16:31 [INFO] [TRAIN] epoch=63, iter=23390/80000, loss=0.9577, lr=0.007325, batch_cost=1.3633, reader_cost=0.0001 | ETA 21:26:13 2021-02-23 03:16:44 [INFO] [TRAIN] epoch=63, iter=23400/80000, loss=1.0173, lr=0.007324, batch_cost=1.3734, reader_cost=0.0001 | ETA 21:35:34 2021-02-23 03:16:58 [INFO] [TRAIN] epoch=63, iter=23410/80000, loss=0.9741, lr=0.007323, batch_cost=1.3523, reader_cost=0.0001 | ETA 21:15:24 2021-02-23 03:17:11 [INFO] [TRAIN] epoch=63, iter=23420/80000, loss=0.8658, lr=0.007322, batch_cost=1.3578, reader_cost=0.0001 | ETA 21:20:22 2021-02-23 03:17:25 [INFO] [TRAIN] epoch=63, iter=23430/80000, loss=0.9228, lr=0.007321, batch_cost=1.3673, reader_cost=0.0001 | ETA 21:29:08 2021-02-23 03:17:40 [INFO] [TRAIN] epoch=64, iter=23440/80000, loss=0.9425, lr=0.007320, batch_cost=1.4422, reader_cost=0.0868 | ETA 22:39:31 2021-02-23 03:17:53 [INFO] [TRAIN] epoch=64, iter=23450/80000, loss=0.9755, lr=0.007318, batch_cost=1.3564, reader_cost=0.0001 | ETA 21:18:27 2021-02-23 03:18:07 [INFO] [TRAIN] epoch=64, iter=23460/80000, loss=0.8684, lr=0.007317, batch_cost=1.3521, reader_cost=0.0001 | ETA 21:14:06 2021-02-23 03:18:20 [INFO] [TRAIN] epoch=64, iter=23470/80000, loss=0.9379, lr=0.007316, batch_cost=1.3764, reader_cost=0.0001 | ETA 21:36:47 2021-02-23 03:18:34 [INFO] [TRAIN] epoch=64, iter=23480/80000, loss=0.9199, lr=0.007315, batch_cost=1.3354, reader_cost=0.0001 | ETA 20:57:55 2021-02-23 03:18:48 [INFO] [TRAIN] epoch=64, iter=23490/80000, loss=1.0284, lr=0.007314, batch_cost=1.3743, reader_cost=0.0001 | ETA 21:34:21 2021-02-23 03:19:01 [INFO] [TRAIN] epoch=64, iter=23500/80000, loss=0.9519, lr=0.007313, batch_cost=1.3686, reader_cost=0.0001 | ETA 21:28:45 2021-02-23 03:19:15 [INFO] [TRAIN] epoch=64, iter=23510/80000, loss=0.8158, lr=0.007311, batch_cost=1.3552, reader_cost=0.0001 | ETA 21:15:57 2021-02-23 03:19:28 [INFO] [TRAIN] epoch=64, iter=23520/80000, loss=0.9436, lr=0.007310, batch_cost=1.3656, reader_cost=0.0001 | ETA 21:25:30 2021-02-23 03:19:42 [INFO] [TRAIN] epoch=64, iter=23530/80000, loss=0.8976, lr=0.007309, batch_cost=1.3399, reader_cost=0.0001 | ETA 21:01:04 2021-02-23 03:19:56 [INFO] [TRAIN] epoch=64, iter=23540/80000, loss=0.8867, lr=0.007308, batch_cost=1.3822, reader_cost=0.0001 | ETA 21:40:40 2021-02-23 03:20:09 [INFO] [TRAIN] epoch=64, iter=23550/80000, loss=0.9239, lr=0.007307, batch_cost=1.3580, reader_cost=0.0001 | ETA 21:17:39 2021-02-23 03:20:23 [INFO] [TRAIN] epoch=64, iter=23560/80000, loss=0.9556, lr=0.007306, batch_cost=1.3507, reader_cost=0.0001 | ETA 21:10:32 2021-02-23 03:20:37 [INFO] [TRAIN] epoch=64, iter=23570/80000, loss=0.9346, lr=0.007304, batch_cost=1.4230, reader_cost=0.0001 | ETA 22:18:19 2021-02-23 03:20:51 [INFO] [TRAIN] epoch=64, iter=23580/80000, loss=0.9177, lr=0.007303, batch_cost=1.3628, reader_cost=0.0001 | ETA 21:21:26 2021-02-23 03:21:05 [INFO] [TRAIN] epoch=64, iter=23590/80000, loss=0.8345, lr=0.007302, batch_cost=1.4022, reader_cost=0.0001 | ETA 21:58:16 2021-02-23 03:21:18 [INFO] [TRAIN] epoch=64, iter=23600/80000, loss=0.8417, lr=0.007301, batch_cost=1.3449, reader_cost=0.0001 | ETA 21:04:14 2021-02-23 03:21:32 [INFO] [TRAIN] epoch=64, iter=23610/80000, loss=0.9173, lr=0.007300, batch_cost=1.3805, reader_cost=0.0001 | ETA 21:37:25 2021-02-23 03:21:46 [INFO] [TRAIN] epoch=64, iter=23620/80000, loss=0.9761, lr=0.007299, batch_cost=1.3768, reader_cost=0.0001 | ETA 21:33:44 2021-02-23 03:21:59 [INFO] [TRAIN] epoch=64, iter=23630/80000, loss=0.9497, lr=0.007297, batch_cost=1.3555, reader_cost=0.0001 | ETA 21:13:27 2021-02-23 03:22:13 [INFO] [TRAIN] epoch=64, iter=23640/80000, loss=0.8526, lr=0.007296, batch_cost=1.3623, reader_cost=0.0001 | ETA 21:19:40 2021-02-23 03:22:26 [INFO] [TRAIN] epoch=64, iter=23650/80000, loss=0.9568, lr=0.007295, batch_cost=1.3593, reader_cost=0.0001 | ETA 21:16:38 2021-02-23 03:22:40 [INFO] [TRAIN] epoch=64, iter=23660/80000, loss=0.9233, lr=0.007294, batch_cost=1.3682, reader_cost=0.0001 | ETA 21:24:42 2021-02-23 03:22:54 [INFO] [TRAIN] epoch=64, iter=23670/80000, loss=0.9493, lr=0.007293, batch_cost=1.3535, reader_cost=0.0001 | ETA 21:10:44 2021-02-23 03:23:07 [INFO] [TRAIN] epoch=64, iter=23680/80000, loss=0.9148, lr=0.007292, batch_cost=1.3793, reader_cost=0.0001 | ETA 21:34:41 2021-02-23 03:23:21 [INFO] [TRAIN] epoch=64, iter=23690/80000, loss=0.9469, lr=0.007290, batch_cost=1.3701, reader_cost=0.0001 | ETA 21:25:49 2021-02-23 03:23:35 [INFO] [TRAIN] epoch=64, iter=23700/80000, loss=0.9596, lr=0.007289, batch_cost=1.3416, reader_cost=0.0001 | ETA 20:58:49 2021-02-23 03:23:48 [INFO] [TRAIN] epoch=64, iter=23710/80000, loss=0.9023, lr=0.007288, batch_cost=1.3728, reader_cost=0.0001 | ETA 21:27:53 2021-02-23 03:24:02 [INFO] [TRAIN] epoch=64, iter=23720/80000, loss=1.0319, lr=0.007287, batch_cost=1.3469, reader_cost=0.0001 | ETA 21:03:21 2021-02-23 03:24:15 [INFO] [TRAIN] epoch=64, iter=23730/80000, loss=0.9023, lr=0.007286, batch_cost=1.3698, reader_cost=0.0001 | ETA 21:24:38 2021-02-23 03:24:29 [INFO] [TRAIN] epoch=64, iter=23740/80000, loss=0.9391, lr=0.007285, batch_cost=1.3888, reader_cost=0.0001 | ETA 21:42:12 2021-02-23 03:24:43 [INFO] [TRAIN] epoch=64, iter=23750/80000, loss=0.8703, lr=0.007283, batch_cost=1.3578, reader_cost=0.0001 | ETA 21:12:55 2021-02-23 03:24:56 [INFO] [TRAIN] epoch=64, iter=23760/80000, loss=0.9346, lr=0.007282, batch_cost=1.3333, reader_cost=0.0001 | ETA 20:49:42 2021-02-23 03:25:10 [INFO] [TRAIN] epoch=64, iter=23770/80000, loss=0.8612, lr=0.007281, batch_cost=1.3541, reader_cost=0.0001 | ETA 21:08:59 2021-02-23 03:25:23 [INFO] [TRAIN] epoch=64, iter=23780/80000, loss=0.8565, lr=0.007280, batch_cost=1.3447, reader_cost=0.0001 | ETA 21:00:01 2021-02-23 03:25:37 [INFO] [TRAIN] epoch=64, iter=23790/80000, loss=0.8571, lr=0.007279, batch_cost=1.3487, reader_cost=0.0001 | ETA 21:03:32 2021-02-23 03:25:50 [INFO] [TRAIN] epoch=64, iter=23800/80000, loss=0.8935, lr=0.007278, batch_cost=1.3424, reader_cost=0.0001 | ETA 20:57:24 2021-02-23 03:26:04 [INFO] [TRAIN] epoch=65, iter=23810/80000, loss=0.8417, lr=0.007276, batch_cost=1.4221, reader_cost=0.0702 | ETA 22:11:48 2021-02-23 03:26:18 [INFO] [TRAIN] epoch=65, iter=23820/80000, loss=1.0610, lr=0.007275, batch_cost=1.3739, reader_cost=0.0001 | ETA 21:26:27 2021-02-23 03:26:32 [INFO] [TRAIN] epoch=65, iter=23830/80000, loss=1.0089, lr=0.007274, batch_cost=1.3610, reader_cost=0.0001 | ETA 21:14:08 2021-02-23 03:26:45 [INFO] [TRAIN] epoch=65, iter=23840/80000, loss=0.9915, lr=0.007273, batch_cost=1.3659, reader_cost=0.0001 | ETA 21:18:28 2021-02-23 03:26:59 [INFO] [TRAIN] epoch=65, iter=23850/80000, loss=0.9783, lr=0.007272, batch_cost=1.3646, reader_cost=0.0001 | ETA 21:17:00 2021-02-23 03:27:13 [INFO] [TRAIN] epoch=65, iter=23860/80000, loss=0.9109, lr=0.007271, batch_cost=1.3659, reader_cost=0.0001 | ETA 21:18:03 2021-02-23 03:27:26 [INFO] [TRAIN] epoch=65, iter=23870/80000, loss=0.8180, lr=0.007269, batch_cost=1.3806, reader_cost=0.0001 | ETA 21:31:30 2021-02-23 03:27:40 [INFO] [TRAIN] epoch=65, iter=23880/80000, loss=0.9205, lr=0.007268, batch_cost=1.3743, reader_cost=0.0001 | ETA 21:25:27 2021-02-23 03:27:54 [INFO] [TRAIN] epoch=65, iter=23890/80000, loss=0.9400, lr=0.007267, batch_cost=1.3602, reader_cost=0.0001 | ETA 21:12:01 2021-02-23 03:28:07 [INFO] [TRAIN] epoch=65, iter=23900/80000, loss=0.9057, lr=0.007266, batch_cost=1.3520, reader_cost=0.0001 | ETA 21:04:07 2021-02-23 03:28:21 [INFO] [TRAIN] epoch=65, iter=23910/80000, loss=0.8931, lr=0.007265, batch_cost=1.3524, reader_cost=0.0001 | ETA 21:04:13 2021-02-23 03:28:35 [INFO] [TRAIN] epoch=65, iter=23920/80000, loss=0.9451, lr=0.007264, batch_cost=1.3741, reader_cost=0.0001 | ETA 21:24:21 2021-02-23 03:28:48 [INFO] [TRAIN] epoch=65, iter=23930/80000, loss=0.9342, lr=0.007262, batch_cost=1.3652, reader_cost=0.0001 | ETA 21:15:45 2021-02-23 03:29:02 [INFO] [TRAIN] epoch=65, iter=23940/80000, loss=0.9629, lr=0.007261, batch_cost=1.3513, reader_cost=0.0001 | ETA 21:02:34 2021-02-23 03:29:15 [INFO] [TRAIN] epoch=65, iter=23950/80000, loss=1.1836, lr=0.007260, batch_cost=1.3646, reader_cost=0.0001 | ETA 21:14:46 2021-02-23 03:29:29 [INFO] [TRAIN] epoch=65, iter=23960/80000, loss=0.9098, lr=0.007259, batch_cost=1.3903, reader_cost=0.0001 | ETA 21:38:32 2021-02-23 03:29:43 [INFO] [TRAIN] epoch=65, iter=23970/80000, loss=1.0771, lr=0.007258, batch_cost=1.3564, reader_cost=0.0001 | ETA 21:06:39 2021-02-23 03:29:56 [INFO] [TRAIN] epoch=65, iter=23980/80000, loss=0.9799, lr=0.007257, batch_cost=1.3503, reader_cost=0.0001 | ETA 21:00:43 2021-02-23 03:30:10 [INFO] [TRAIN] epoch=65, iter=23990/80000, loss=0.8829, lr=0.007255, batch_cost=1.3759, reader_cost=0.0001 | ETA 21:24:24 2021-02-23 03:30:24 [INFO] [TRAIN] epoch=65, iter=24000/80000, loss=0.8985, lr=0.007254, batch_cost=1.4037, reader_cost=0.0001 | ETA 21:50:09 2021-02-23 03:30:24 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:24 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:05 - batch_cost: 0.1923 - reader cost: 0.0617  3/125 [..............................] - ETA: 1:01 - batch_cost: 0.2756 - reader cost: 0.0987 4/125 [..............................] - ETA: 57s - batch_cost: 0.3026 - reader cost: 0.1072  5/125 [>.............................] - ETA: 54s - batch_cost: 0.3182 - reader cost: 0.1120 6/125 [>.............................] - ETA: 53s - batch_cost: 0.3358 - reader cost: 0.1228 7/125 [>.............................] - ETA: 53s - batch_cost: 0.3525 - reader cost: 0.1342 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3570 - reader cost: 0.1332 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3677 - reader cost: 0.1383 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3730 - reader cost: 0.1397 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3741 - reader cost: 0.1387 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3783 - reader cost: 0.1418 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3827 - reader cost: 0.1450 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3890 - reader cost: 0.1506 15/125 [==>...........................] - ETA: 48s - batch_cost: 0.3917 - reader cost: 0.1527 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3943 - reader cost: 0.1546 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3923 - reader cost: 0.1520 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.3949 - reader cost: 0.1541 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3935 - reader cost: 0.1521 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.3950 - reader cost: 0.1516 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.3982 - reader cost: 0.1540 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.3988 - reader cost: 0.1530 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.3995 - reader cost: 0.1524 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4021 - reader cost: 0.1544 25/125 [=====>........................] - ETA: 43s - batch_cost: 0.4029 - reader cost: 0.1551 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4026 - reader cost: 0.1545 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4032 - reader cost: 0.1551 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4047 - reader cost: 0.1565 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4049 - reader cost: 0.1562 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4049 - reader cost: 0.1563 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4041 - reader cost: 0.1553 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4039 - reader cost: 0.1549 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4043 - reader cost: 0.1552 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4038 - reader cost: 0.1546 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4045 - reader cost: 0.1552 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4059 - reader cost: 0.1567 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4077 - reader cost: 0.1583 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4075 - reader cost: 0.1581 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4079 - reader cost: 0.1584 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4073 - reader cost: 0.1579 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4061 - reader cost: 0.1567 42/125 [=========>....................] - ETA: 34s - batch_cost: 0.4055 - reader cost: 0.1559 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4061 - reader cost: 0.1565 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4051 - reader cost: 0.1555 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4059 - reader cost: 0.1560 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4054 - reader cost: 0.1548 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4060 - reader cost: 0.1550 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4067 - reader cost: 0.1554 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4076 - reader cost: 0.1561 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4080 - reader cost: 0.1563 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4071 - reader cost: 0.1552 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4062 - reader cost: 0.1543 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4058 - reader cost: 0.1537 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4066 - reader cost: 0.1535 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4069 - reader cost: 0.1522 56/125 [============>.................] - ETA: 28s - batch_cost: 0.4062 - reader cost: 0.1515 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4068 - reader cost: 0.1522 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4073 - reader cost: 0.1528 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4078 - reader cost: 0.1534 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4076 - reader cost: 0.1529 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4081 - reader cost: 0.1524 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4082 - reader cost: 0.1521 63/125 [==============>...............] - ETA: 25s - batch_cost: 0.4083 - reader cost: 0.1524 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4085 - reader cost: 0.1526 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4086 - reader cost: 0.1529 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4088 - reader cost: 0.1526 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4090 - reader cost: 0.1519 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4087 - reader cost: 0.1509 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4088 - reader cost: 0.1502 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4089 - reader cost: 0.1505 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4094 - reader cost: 0.1511 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4092 - reader cost: 0.1509 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4094 - reader cost: 0.1512 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4093 - reader cost: 0.1512 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4096 - reader cost: 0.1508 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4097 - reader cost: 0.1501 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4101 - reader cost: 0.1497 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4104 - reader cost: 0.1492 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4108 - reader cost: 0.1495 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4103 - reader cost: 0.1491 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4105 - reader cost: 0.1495 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4109 - reader cost: 0.1494 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4111 - reader cost: 0.1495 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4116 - reader cost: 0.1500 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4118 - reader cost: 0.1502 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4121 - reader cost: 0.1506 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4125 - reader cost: 0.1510 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4123 - reader cost: 0.1510 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4126 - reader cost: 0.1512 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4124 - reader cost: 0.1512 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4126 - reader cost: 0.1515 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4122 - reader cost: 0.1512 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4123 - reader cost: 0.1512 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4117 - reader cost: 0.1506 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4114 - reader cost: 0.1503 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4118 - reader cost: 0.1507 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4119 - reader cost: 0.1503 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4121 - reader cost: 0.1502 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4124 - reader cost: 0.1506 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4121 - reader cost: 0.1504 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4124 - reader cost: 0.1507 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4126 - reader cost: 0.1511  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4125 - reader cost: 0.1510 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4128 - reader cost: 0.1514 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4126 - reader cost: 0.1514 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4128 - reader cost: 0.1517 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4126 - reader cost: 0.1514 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4121 - reader cost: 0.1510 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4120 - reader cost: 0.1510 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4122 - reader cost: 0.1513 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4124 - reader cost: 0.1516 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4126 - reader cost: 0.1519 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4128 - reader cost: 0.1521 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4130 - reader cost: 0.1524 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4132 - reader cost: 0.1526 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4134 - reader cost: 0.1529 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4131 - reader cost: 0.1526 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4133 - reader cost: 0.1529 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4128 - reader cost: 0.1525 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4125 - reader cost: 0.1522 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4127 - reader cost: 0.1525 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4126 - reader cost: 0.1524 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4122 - reader cost: 0.1521 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4123 - reader cost: 0.1523 125/125 [==============================] - 52s 417ms/step - batch_cost: 0.4120 - reader cost: 0.1520 2021-02-23 03:31:17 [INFO] [EVAL] #Images=500 mIoU=0.7087 Acc=0.9484 Kappa=0.9328 2021-02-23 03:31:17 [INFO] [EVAL] Class IoU: [0.9714 0.7879 0.9083 0.2724 0.5711 0.6126 0.6725 0.7429 0.9079 0.558 0.9288 0.7985 0.5887 0.9273 0.4334 0.7235 0.7109 0.5967 0.7528] 2021-02-23 03:31:17 [INFO] [EVAL] Class Acc: [0.9789 0.9021 0.9439 0.815 0.8338 0.7685 0.8373 0.9162 0.9512 0.6756 0.943 0.893 0.6985 0.9693 0.9228 0.7749 0.8381 0.8165 0.8243] 2021-02-23 03:31:21 [INFO] [EVAL] The model with the best validation mIoU (0.7362) was saved at iter 21000. 2021-02-23 03:31:34 [INFO] [TRAIN] epoch=65, iter=24010/80000, loss=1.0271, lr=0.007253, batch_cost=1.3867, reader_cost=0.0001 | ETA 21:34:01 2021-02-23 03:31:48 [INFO] [TRAIN] epoch=65, iter=24020/80000, loss=0.9002, lr=0.007252, batch_cost=1.3829, reader_cost=0.0001 | ETA 21:30:15 2021-02-23 03:32:03 [INFO] [TRAIN] epoch=65, iter=24030/80000, loss=0.8850, lr=0.007251, batch_cost=1.4215, reader_cost=0.0001 | ETA 22:06:01 2021-02-23 03:32:16 [INFO] [TRAIN] epoch=65, iter=24040/80000, loss=0.9804, lr=0.007250, batch_cost=1.3711, reader_cost=0.0001 | ETA 21:18:48 2021-02-23 03:32:29 [INFO] [TRAIN] epoch=65, iter=24050/80000, loss=0.9592, lr=0.007248, batch_cost=1.3239, reader_cost=0.0001 | ETA 20:34:31 2021-02-23 03:32:43 [INFO] [TRAIN] epoch=65, iter=24060/80000, loss=1.0217, lr=0.007247, batch_cost=1.3335, reader_cost=0.0001 | ETA 20:43:14 2021-02-23 03:32:56 [INFO] [TRAIN] epoch=65, iter=24070/80000, loss=0.8439, lr=0.007246, batch_cost=1.3539, reader_cost=0.0001 | ETA 21:02:00 2021-02-23 03:33:10 [INFO] [TRAIN] epoch=65, iter=24080/80000, loss=0.8539, lr=0.007245, batch_cost=1.3678, reader_cost=0.0001 | ETA 21:14:47 2021-02-23 03:33:24 [INFO] [TRAIN] epoch=65, iter=24090/80000, loss=0.9333, lr=0.007244, batch_cost=1.3960, reader_cost=0.0001 | ETA 21:40:49 2021-02-23 03:33:38 [INFO] [TRAIN] epoch=65, iter=24100/80000, loss=0.9209, lr=0.007243, batch_cost=1.3793, reader_cost=0.0001 | ETA 21:25:03 2021-02-23 03:33:51 [INFO] [TRAIN] epoch=65, iter=24110/80000, loss=0.9231, lr=0.007241, batch_cost=1.3602, reader_cost=0.0001 | ETA 21:07:01 2021-02-23 03:34:05 [INFO] [TRAIN] epoch=65, iter=24120/80000, loss=0.9189, lr=0.007240, batch_cost=1.3802, reader_cost=0.0001 | ETA 21:25:25 2021-02-23 03:34:19 [INFO] [TRAIN] epoch=65, iter=24130/80000, loss=0.8594, lr=0.007239, batch_cost=1.3483, reader_cost=0.0001 | ETA 20:55:28 2021-02-23 03:34:32 [INFO] [TRAIN] epoch=65, iter=24140/80000, loss=0.8886, lr=0.007238, batch_cost=1.3669, reader_cost=0.0001 | ETA 21:12:36 2021-02-23 03:34:46 [INFO] [TRAIN] epoch=65, iter=24150/80000, loss=0.8929, lr=0.007237, batch_cost=1.3373, reader_cost=0.0001 | ETA 20:44:48 2021-02-23 03:35:00 [INFO] [TRAIN] epoch=65, iter=24160/80000, loss=0.8775, lr=0.007236, batch_cost=1.3956, reader_cost=0.0001 | ETA 21:38:48 2021-02-23 03:35:13 [INFO] [TRAIN] epoch=65, iter=24170/80000, loss=0.9520, lr=0.007234, batch_cost=1.3628, reader_cost=0.0001 | ETA 21:08:05 2021-02-23 03:35:27 [INFO] [TRAIN] epoch=65, iter=24180/80000, loss=0.8692, lr=0.007233, batch_cost=1.3325, reader_cost=0.0001 | ETA 20:39:37 2021-02-23 03:35:41 [INFO] [TRAIN] epoch=66, iter=24190/80000, loss=0.9810, lr=0.007232, batch_cost=1.4573, reader_cost=0.0826 | ETA 22:35:31 2021-02-23 03:35:55 [INFO] [TRAIN] epoch=66, iter=24200/80000, loss=0.9012, lr=0.007231, batch_cost=1.3754, reader_cost=0.0001 | ETA 21:19:04 2021-02-23 03:36:08 [INFO] [TRAIN] epoch=66, iter=24210/80000, loss=0.9380, lr=0.007230, batch_cost=1.3450, reader_cost=0.0001 | ETA 20:50:40 2021-02-23 03:36:22 [INFO] [TRAIN] epoch=66, iter=24220/80000, loss=0.8255, lr=0.007229, batch_cost=1.3769, reader_cost=0.0001 | ETA 21:20:03 2021-02-23 03:36:36 [INFO] [TRAIN] epoch=66, iter=24230/80000, loss=0.8483, lr=0.007227, batch_cost=1.3692, reader_cost=0.0001 | ETA 21:12:42 2021-02-23 03:36:49 [INFO] [TRAIN] epoch=66, iter=24240/80000, loss=0.9211, lr=0.007226, batch_cost=1.3392, reader_cost=0.0001 | ETA 20:44:31 2021-02-23 03:37:03 [INFO] [TRAIN] epoch=66, iter=24250/80000, loss=0.9627, lr=0.007225, batch_cost=1.3599, reader_cost=0.0001 | ETA 21:03:34 2021-02-23 03:37:16 [INFO] [TRAIN] epoch=66, iter=24260/80000, loss=0.9394, lr=0.007224, batch_cost=1.3509, reader_cost=0.0001 | ETA 20:54:59 2021-02-23 03:37:30 [INFO] [TRAIN] epoch=66, iter=24270/80000, loss=0.8791, lr=0.007223, batch_cost=1.3826, reader_cost=0.0001 | ETA 21:24:13 2021-02-23 03:37:44 [INFO] [TRAIN] epoch=66, iter=24280/80000, loss=0.8696, lr=0.007222, batch_cost=1.3526, reader_cost=0.0001 | ETA 20:56:05 2021-02-23 03:37:57 [INFO] [TRAIN] epoch=66, iter=24290/80000, loss=0.8639, lr=0.007220, batch_cost=1.3308, reader_cost=0.0001 | ETA 20:35:38 2021-02-23 03:38:11 [INFO] [TRAIN] epoch=66, iter=24300/80000, loss=0.8609, lr=0.007219, batch_cost=1.3499, reader_cost=0.0001 | ETA 20:53:10 2021-02-23 03:38:24 [INFO] [TRAIN] epoch=66, iter=24310/80000, loss=0.7612, lr=0.007218, batch_cost=1.3603, reader_cost=0.0001 | ETA 21:02:33 2021-02-23 03:38:38 [INFO] [TRAIN] epoch=66, iter=24320/80000, loss=0.9181, lr=0.007217, batch_cost=1.3405, reader_cost=0.0001 | ETA 20:43:59 2021-02-23 03:38:52 [INFO] [TRAIN] epoch=66, iter=24330/80000, loss=0.8266, lr=0.007216, batch_cost=1.3947, reader_cost=0.0001 | ETA 21:34:04 2021-02-23 03:39:05 [INFO] [TRAIN] epoch=66, iter=24340/80000, loss=0.8986, lr=0.007215, batch_cost=1.3772, reader_cost=0.0001 | ETA 21:17:36 2021-02-23 03:39:19 [INFO] [TRAIN] epoch=66, iter=24350/80000, loss=0.8955, lr=0.007213, batch_cost=1.3577, reader_cost=0.0001 | ETA 20:59:13 2021-02-23 03:39:33 [INFO] [TRAIN] epoch=66, iter=24360/80000, loss=0.8786, lr=0.007212, batch_cost=1.3651, reader_cost=0.0001 | ETA 21:05:52 2021-02-23 03:39:46 [INFO] [TRAIN] epoch=66, iter=24370/80000, loss=0.8898, lr=0.007211, batch_cost=1.3542, reader_cost=0.0001 | ETA 20:55:32 2021-02-23 03:40:00 [INFO] [TRAIN] epoch=66, iter=24380/80000, loss=0.9290, lr=0.007210, batch_cost=1.3643, reader_cost=0.0001 | ETA 21:04:43 2021-02-23 03:40:14 [INFO] [TRAIN] epoch=66, iter=24390/80000, loss=0.9623, lr=0.007209, batch_cost=1.3890, reader_cost=0.0001 | ETA 21:27:22 2021-02-23 03:40:27 [INFO] [TRAIN] epoch=66, iter=24400/80000, loss=0.9196, lr=0.007208, batch_cost=1.3763, reader_cost=0.0001 | ETA 21:15:20 2021-02-23 03:40:41 [INFO] [TRAIN] epoch=66, iter=24410/80000, loss=0.8874, lr=0.007206, batch_cost=1.3563, reader_cost=0.0001 | ETA 20:56:37 2021-02-23 03:40:54 [INFO] [TRAIN] epoch=66, iter=24420/80000, loss=0.9338, lr=0.007205, batch_cost=1.3493, reader_cost=0.0001 | ETA 20:49:53 2021-02-23 03:41:08 [INFO] [TRAIN] epoch=66, iter=24430/80000, loss=0.8275, lr=0.007204, batch_cost=1.3664, reader_cost=0.0001 | ETA 21:05:28 2021-02-23 03:41:22 [INFO] [TRAIN] epoch=66, iter=24440/80000, loss=0.9290, lr=0.007203, batch_cost=1.3641, reader_cost=0.0001 | ETA 21:03:08 2021-02-23 03:41:35 [INFO] [TRAIN] epoch=66, iter=24450/80000, loss=1.0746, lr=0.007202, batch_cost=1.3641, reader_cost=0.0001 | ETA 21:02:58 2021-02-23 03:41:49 [INFO] [TRAIN] epoch=66, iter=24460/80000, loss=1.0038, lr=0.007201, batch_cost=1.3563, reader_cost=0.0001 | ETA 20:55:26 2021-02-23 03:42:03 [INFO] [TRAIN] epoch=66, iter=24470/80000, loss=1.0980, lr=0.007199, batch_cost=1.3622, reader_cost=0.0001 | ETA 21:00:40 2021-02-23 03:42:16 [INFO] [TRAIN] epoch=66, iter=24480/80000, loss=0.8386, lr=0.007198, batch_cost=1.3666, reader_cost=0.0001 | ETA 21:04:32 2021-02-23 03:42:30 [INFO] [TRAIN] epoch=66, iter=24490/80000, loss=0.9143, lr=0.007197, batch_cost=1.3866, reader_cost=0.0001 | ETA 21:22:49 2021-02-23 03:42:44 [INFO] [TRAIN] epoch=66, iter=24500/80000, loss=0.8719, lr=0.007196, batch_cost=1.3492, reader_cost=0.0001 | ETA 20:48:00 2021-02-23 03:42:57 [INFO] [TRAIN] epoch=66, iter=24510/80000, loss=0.9919, lr=0.007195, batch_cost=1.3555, reader_cost=0.0001 | ETA 20:53:37 2021-02-23 03:43:11 [INFO] [TRAIN] epoch=66, iter=24520/80000, loss=0.9190, lr=0.007194, batch_cost=1.3782, reader_cost=0.0001 | ETA 21:14:23 2021-02-23 03:43:24 [INFO] [TRAIN] epoch=66, iter=24530/80000, loss=0.8904, lr=0.007192, batch_cost=1.3599, reader_cost=0.0001 | ETA 20:57:15 2021-02-23 03:43:38 [INFO] [TRAIN] epoch=66, iter=24540/80000, loss=0.9451, lr=0.007191, batch_cost=1.3641, reader_cost=0.0001 | ETA 21:00:53 2021-02-23 03:43:52 [INFO] [TRAIN] epoch=66, iter=24550/80000, loss=0.8540, lr=0.007190, batch_cost=1.3827, reader_cost=0.0001 | ETA 21:17:48 2021-02-23 03:44:07 [INFO] [TRAIN] epoch=67, iter=24560/80000, loss=0.8971, lr=0.007189, batch_cost=1.4777, reader_cost=0.1094 | ETA 22:45:24 2021-02-23 03:44:20 [INFO] [TRAIN] epoch=67, iter=24570/80000, loss=0.9593, lr=0.007188, batch_cost=1.3508, reader_cost=0.0001 | ETA 20:47:54 2021-02-23 03:44:34 [INFO] [TRAIN] epoch=67, iter=24580/80000, loss=0.9673, lr=0.007187, batch_cost=1.3828, reader_cost=0.0001 | ETA 21:17:14 2021-02-23 03:44:48 [INFO] [TRAIN] epoch=67, iter=24590/80000, loss=0.9638, lr=0.007185, batch_cost=1.3497, reader_cost=0.0001 | ETA 20:46:26 2021-02-23 03:45:01 [INFO] [TRAIN] epoch=67, iter=24600/80000, loss=0.9444, lr=0.007184, batch_cost=1.3698, reader_cost=0.0001 | ETA 21:04:48 2021-02-23 03:45:15 [INFO] [TRAIN] epoch=67, iter=24610/80000, loss=0.9665, lr=0.007183, batch_cost=1.3452, reader_cost=0.0001 | ETA 20:41:51 2021-02-23 03:45:28 [INFO] [TRAIN] epoch=67, iter=24620/80000, loss=0.9183, lr=0.007182, batch_cost=1.3585, reader_cost=0.0001 | ETA 20:53:55 2021-02-23 03:45:42 [INFO] [TRAIN] epoch=67, iter=24630/80000, loss=0.8820, lr=0.007181, batch_cost=1.3839, reader_cost=0.0001 | ETA 21:17:06 2021-02-23 03:45:56 [INFO] [TRAIN] epoch=67, iter=24640/80000, loss=0.8992, lr=0.007180, batch_cost=1.3761, reader_cost=0.0001 | ETA 21:09:43 2021-02-23 03:46:09 [INFO] [TRAIN] epoch=67, iter=24650/80000, loss=0.8483, lr=0.007178, batch_cost=1.3499, reader_cost=0.0001 | ETA 20:45:16 2021-02-23 03:46:23 [INFO] [TRAIN] epoch=67, iter=24660/80000, loss=0.9259, lr=0.007177, batch_cost=1.3426, reader_cost=0.0001 | ETA 20:38:21 2021-02-23 03:46:36 [INFO] [TRAIN] epoch=67, iter=24670/80000, loss=0.8293, lr=0.007176, batch_cost=1.3558, reader_cost=0.0001 | ETA 20:50:17 2021-02-23 03:46:50 [INFO] [TRAIN] epoch=67, iter=24680/80000, loss=0.8143, lr=0.007175, batch_cost=1.3759, reader_cost=0.0001 | ETA 21:08:33 2021-02-23 03:47:04 [INFO] [TRAIN] epoch=67, iter=24690/80000, loss=0.8510, lr=0.007174, batch_cost=1.3397, reader_cost=0.0001 | ETA 20:35:01 2021-02-23 03:47:17 [INFO] [TRAIN] epoch=67, iter=24700/80000, loss=0.8411, lr=0.007173, batch_cost=1.3698, reader_cost=0.0001 | ETA 21:02:32 2021-02-23 03:47:31 [INFO] [TRAIN] epoch=67, iter=24710/80000, loss=0.9411, lr=0.007171, batch_cost=1.4059, reader_cost=0.0001 | ETA 21:35:32 2021-02-23 03:47:45 [INFO] [TRAIN] epoch=67, iter=24720/80000, loss=0.8631, lr=0.007170, batch_cost=1.3639, reader_cost=0.0001 | ETA 20:56:38 2021-02-23 03:47:59 [INFO] [TRAIN] epoch=67, iter=24730/80000, loss=0.9695, lr=0.007169, batch_cost=1.3794, reader_cost=0.0001 | ETA 21:10:38 2021-02-23 03:48:13 [INFO] [TRAIN] epoch=67, iter=24740/80000, loss=0.9266, lr=0.007168, batch_cost=1.3949, reader_cost=0.0001 | ETA 21:24:42 2021-02-23 03:48:27 [INFO] [TRAIN] epoch=67, iter=24750/80000, loss=0.9211, lr=0.007167, batch_cost=1.3936, reader_cost=0.0001 | ETA 21:23:16 2021-02-23 03:48:41 [INFO] [TRAIN] epoch=67, iter=24760/80000, loss=0.9080, lr=0.007166, batch_cost=1.3990, reader_cost=0.0001 | ETA 21:28:01 2021-02-23 03:48:55 [INFO] [TRAIN] epoch=67, iter=24770/80000, loss=0.8807, lr=0.007164, batch_cost=1.3973, reader_cost=0.0001 | ETA 21:26:11 2021-02-23 03:49:08 [INFO] [TRAIN] epoch=67, iter=24780/80000, loss=0.8628, lr=0.007163, batch_cost=1.3446, reader_cost=0.0001 | ETA 20:37:31 2021-02-23 03:49:22 [INFO] [TRAIN] epoch=67, iter=24790/80000, loss=0.8954, lr=0.007162, batch_cost=1.3805, reader_cost=0.0001 | ETA 21:10:19 2021-02-23 03:49:36 [INFO] [TRAIN] epoch=67, iter=24800/80000, loss=0.9082, lr=0.007161, batch_cost=1.3814, reader_cost=0.0001 | ETA 21:10:52 2021-02-23 03:49:49 [INFO] [TRAIN] epoch=67, iter=24810/80000, loss=0.9631, lr=0.007160, batch_cost=1.3186, reader_cost=0.0001 | ETA 20:12:54 2021-02-23 03:50:02 [INFO] [TRAIN] epoch=67, iter=24820/80000, loss=0.8421, lr=0.007159, batch_cost=1.3505, reader_cost=0.0001 | ETA 20:41:59 2021-02-23 03:50:16 [INFO] [TRAIN] epoch=67, iter=24830/80000, loss=0.8780, lr=0.007157, batch_cost=1.3444, reader_cost=0.0001 | ETA 20:36:09 2021-02-23 03:50:29 [INFO] [TRAIN] epoch=67, iter=24840/80000, loss=0.9745, lr=0.007156, batch_cost=1.3548, reader_cost=0.0001 | ETA 20:45:28 2021-02-23 03:50:43 [INFO] [TRAIN] epoch=67, iter=24850/80000, loss=0.8499, lr=0.007155, batch_cost=1.3889, reader_cost=0.0001 | ETA 21:16:35 2021-02-23 03:50:57 [INFO] [TRAIN] epoch=67, iter=24860/80000, loss=0.9557, lr=0.007154, batch_cost=1.3457, reader_cost=0.0001 | ETA 20:36:42 2021-02-23 03:51:10 [INFO] [TRAIN] epoch=67, iter=24870/80000, loss=0.9229, lr=0.007153, batch_cost=1.3350, reader_cost=0.0001 | ETA 20:26:40 2021-02-23 03:51:24 [INFO] [TRAIN] epoch=67, iter=24880/80000, loss=0.8931, lr=0.007152, batch_cost=1.3496, reader_cost=0.0001 | ETA 20:39:52 2021-02-23 03:51:37 [INFO] [TRAIN] epoch=67, iter=24890/80000, loss=1.0479, lr=0.007150, batch_cost=1.3748, reader_cost=0.0001 | ETA 21:02:45 2021-02-23 03:51:51 [INFO] [TRAIN] epoch=67, iter=24900/80000, loss=0.9288, lr=0.007149, batch_cost=1.4041, reader_cost=0.0001 | ETA 21:29:24 2021-02-23 03:52:05 [INFO] [TRAIN] epoch=67, iter=24910/80000, loss=0.9087, lr=0.007148, batch_cost=1.3587, reader_cost=0.0001 | ETA 20:47:30 2021-02-23 03:52:18 [INFO] [TRAIN] epoch=67, iter=24920/80000, loss=0.8969, lr=0.007147, batch_cost=1.3429, reader_cost=0.0001 | ETA 20:32:49 2021-02-23 03:52:33 [INFO] [TRAIN] epoch=68, iter=24930/80000, loss=0.8611, lr=0.007146, batch_cost=1.4401, reader_cost=0.0757 | ETA 22:01:45 2021-02-23 03:52:46 [INFO] [TRAIN] epoch=68, iter=24940/80000, loss=0.8297, lr=0.007145, batch_cost=1.3660, reader_cost=0.0001 | ETA 20:53:32 2021-02-23 03:53:00 [INFO] [TRAIN] epoch=68, iter=24950/80000, loss=0.9475, lr=0.007143, batch_cost=1.3522, reader_cost=0.0001 | ETA 20:40:39 2021-02-23 03:53:14 [INFO] [TRAIN] epoch=68, iter=24960/80000, loss=0.8672, lr=0.007142, batch_cost=1.3896, reader_cost=0.0001 | ETA 21:14:42 2021-02-23 03:53:28 [INFO] [TRAIN] epoch=68, iter=24970/80000, loss=0.8558, lr=0.007141, batch_cost=1.3747, reader_cost=0.0001 | ETA 21:00:50 2021-02-23 03:53:42 [INFO] [TRAIN] epoch=68, iter=24980/80000, loss=0.9238, lr=0.007140, batch_cost=1.3933, reader_cost=0.0001 | ETA 21:17:38 2021-02-23 03:53:55 [INFO] [TRAIN] epoch=68, iter=24990/80000, loss=1.0334, lr=0.007139, batch_cost=1.3490, reader_cost=0.0001 | ETA 20:36:50 2021-02-23 03:54:09 [INFO] [TRAIN] epoch=68, iter=25000/80000, loss=0.9385, lr=0.007138, batch_cost=1.3551, reader_cost=0.0001 | ETA 20:42:11 2021-02-23 03:54:09 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:09 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:03 - batch_cost: 0.2338 - reader cost: 0.1084  3/125 [..............................] - ETA: 59s - batch_cost: 0.2982 - reader cost: 0.1314  4/125 [..............................] - ETA: 56s - batch_cost: 0.3291 - reader cost: 0.1416 5/125 [>.............................] - ETA: 55s - batch_cost: 0.3514 - reader cost: 0.1516 6/125 [>.............................] - ETA: 53s - batch_cost: 0.3562 - reader cost: 0.1477 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3671 - reader cost: 0.1526 8/125 [>.............................] - ETA: 52s - batch_cost: 0.3771 - reader cost: 0.1576 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3848 - reader cost: 0.1607 10/125 [=>............................] - ETA: 51s - batch_cost: 0.3894 - reader cost: 0.1608 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3887 - reader cost: 0.1576 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3918 - reader cost: 0.1578 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3894 - reader cost: 0.1537 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3929 - reader cost: 0.1554 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3971 - reader cost: 0.1587 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3967 - reader cost: 0.1558 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3986 - reader cost: 0.1571 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3979 - reader cost: 0.1545 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3988 - reader cost: 0.1522 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4007 - reader cost: 0.1534 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4032 - reader cost: 0.1551 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4040 - reader cost: 0.1557 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4050 - reader cost: 0.1566 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4074 - reader cost: 0.1586 25/125 [=====>........................] - ETA: 43s - batch_cost: 0.4081 - reader cost: 0.1590 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4098 - reader cost: 0.1599 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4079 - reader cost: 0.1577 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4075 - reader cost: 0.1570 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4081 - reader cost: 0.1577 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4068 - reader cost: 0.1561 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4090 - reader cost: 0.1578 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4097 - reader cost: 0.1582 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4104 - reader cost: 0.1590 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4111 - reader cost: 0.1595 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4117 - reader cost: 0.1600 36/125 [=======>......................] - ETA: 38s - batch_cost: 0.4120 - reader cost: 0.1603 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4114 - reader cost: 0.1598 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4119 - reader cost: 0.1602 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4125 - reader cost: 0.1608 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4131 - reader cost: 0.1614 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4136 - reader cost: 0.1617 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4140 - reader cost: 0.1623 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4131 - reader cost: 0.1614 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4125 - reader cost: 0.1606 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4128 - reader cost: 0.1609 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4134 - reader cost: 0.1614 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4127 - reader cost: 0.1607 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4131 - reader cost: 0.1610 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4136 - reader cost: 0.1615 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4139 - reader cost: 0.1617 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4143 - reader cost: 0.1619 52/125 [===========>..................] - ETA: 31s - batch_cost: 0.4146 - reader cost: 0.1620 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4152 - reader cost: 0.1624 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4164 - reader cost: 0.1634 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4173 - reader cost: 0.1643 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4171 - reader cost: 0.1641 57/125 [============>.................] - ETA: 29s - batch_cost: 0.4172 - reader cost: 0.1643 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4174 - reader cost: 0.1645 59/125 [=============>................] - ETA: 28s - batch_cost: 0.4166 - reader cost: 0.1637 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4166 - reader cost: 0.1637 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4172 - reader cost: 0.1644 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4180 - reader cost: 0.1651 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4180 - reader cost: 0.1652 64/125 [==============>...............] - ETA: 26s - batch_cost: 0.4182 - reader cost: 0.1653 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4184 - reader cost: 0.1655 66/125 [==============>...............] - ETA: 25s - batch_cost: 0.4186 - reader cost: 0.1657 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4181 - reader cost: 0.1652 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4183 - reader cost: 0.1653 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4184 - reader cost: 0.1653 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4179 - reader cost: 0.1649 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4180 - reader cost: 0.1650 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4173 - reader cost: 0.1643 73/125 [================>.............] - ETA: 22s - batch_cost: 0.4177 - reader cost: 0.1646 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4169 - reader cost: 0.1639 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4173 - reader cost: 0.1642 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4168 - reader cost: 0.1638 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4170 - reader cost: 0.1639 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4171 - reader cost: 0.1641 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4172 - reader cost: 0.1643 80/125 [==================>...........] - ETA: 19s - batch_cost: 0.4174 - reader cost: 0.1645 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4177 - reader cost: 0.1647 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4180 - reader cost: 0.1648 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4182 - reader cost: 0.1649 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4175 - reader cost: 0.1643 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4174 - reader cost: 0.1642 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4175 - reader cost: 0.1644 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4178 - reader cost: 0.1645 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4178 - reader cost: 0.1646 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4173 - reader cost: 0.1640 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4170 - reader cost: 0.1637 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4171 - reader cost: 0.1639 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4173 - reader cost: 0.1641 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4170 - reader cost: 0.1638 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4172 - reader cost: 0.1640 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4169 - reader cost: 0.1637 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4164 - reader cost: 0.1633 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4165 - reader cost: 0.1627 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4166 - reader cost: 0.1622 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4168 - reader cost: 0.1623 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4167 - reader cost: 0.1623 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4164 - reader cost: 0.1620 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4166 - reader cost: 0.1622  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4166 - reader cost: 0.1623 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4163 - reader cost: 0.1620 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4164 - reader cost: 0.1621 106/125 [========================>.....] - ETA: 8s - batch_cost: 0.4160 - reader cost: 0.1618 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4161 - reader cost: 0.1619 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4163 - reader cost: 0.1622 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4160 - reader cost: 0.1619 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4162 - reader cost: 0.1621 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4165 - reader cost: 0.1625 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4162 - reader cost: 0.1622 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4164 - reader cost: 0.1624 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4162 - reader cost: 0.1622 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4162 - reader cost: 0.1621 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4164 - reader cost: 0.1622 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4165 - reader cost: 0.1623 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4165 - reader cost: 0.1625 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4165 - reader cost: 0.1623 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4166 - reader cost: 0.1624 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4164 - reader cost: 0.1622 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4165 - reader cost: 0.1624 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4161 - reader cost: 0.1620 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4164 - reader cost: 0.1622 125/125 [==============================] - 53s 421ms/step - batch_cost: 0.4163 - reader cost: 0.1621 2021-02-23 03:55:01 [INFO] [EVAL] #Images=500 mIoU=0.6974 Acc=0.9514 Kappa=0.9369 2021-02-23 03:55:01 [INFO] [EVAL] Class IoU: [0.9726 0.7914 0.9164 0.4382 0.5485 0.633 0.7026 0.7658 0.9193 0.5885 0.9371 0.8046 0.5843 0.9325 0.4797 0.6476 0.5152 0.3246 0.7495] 2021-02-23 03:55:01 [INFO] [EVAL] Class Acc: [0.9839 0.8933 0.948 0.7918 0.6956 0.8054 0.8337 0.8738 0.9623 0.7722 0.9573 0.8808 0.8349 0.9667 0.9037 0.6898 0.5533 0.9015 0.8055] 2021-02-23 03:55:05 [INFO] [EVAL] The model with the best validation mIoU (0.7362) was saved at iter 21000. 2021-02-23 03:55:19 [INFO] [TRAIN] epoch=68, iter=25010/80000, loss=0.8271, lr=0.007136, batch_cost=1.3505, reader_cost=0.0001 | ETA 20:37:43 2021-02-23 03:55:33 [INFO] [TRAIN] epoch=68, iter=25020/80000, loss=0.9273, lr=0.007135, batch_cost=1.3760, reader_cost=0.0001 | ETA 21:00:50 2021-02-23 03:55:46 [INFO] [TRAIN] epoch=68, iter=25030/80000, loss=0.8812, lr=0.007134, batch_cost=1.3565, reader_cost=0.0001 | ETA 20:42:44 2021-02-23 03:56:00 [INFO] [TRAIN] epoch=68, iter=25040/80000, loss=0.8891, lr=0.007133, batch_cost=1.3726, reader_cost=0.0001 | ETA 20:57:18 2021-02-23 03:56:14 [INFO] [TRAIN] epoch=68, iter=25050/80000, loss=0.8466, lr=0.007132, batch_cost=1.3777, reader_cost=0.0001 | ETA 21:01:41 2021-02-23 03:56:27 [INFO] [TRAIN] epoch=68, iter=25060/80000, loss=0.8970, lr=0.007131, batch_cost=1.3406, reader_cost=0.0001 | ETA 20:27:31 2021-02-23 03:56:41 [INFO] [TRAIN] epoch=68, iter=25070/80000, loss=0.9165, lr=0.007129, batch_cost=1.3708, reader_cost=0.0001 | ETA 20:54:56 2021-02-23 03:56:54 [INFO] [TRAIN] epoch=68, iter=25080/80000, loss=0.9738, lr=0.007128, batch_cost=1.3613, reader_cost=0.0001 | ETA 20:46:02 2021-02-23 03:57:08 [INFO] [TRAIN] epoch=68, iter=25090/80000, loss=0.8839, lr=0.007127, batch_cost=1.3496, reader_cost=0.0001 | ETA 20:35:06 2021-02-23 03:57:22 [INFO] [TRAIN] epoch=68, iter=25100/80000, loss=1.0381, lr=0.007126, batch_cost=1.3712, reader_cost=0.0001 | ETA 20:54:39 2021-02-23 03:57:35 [INFO] [TRAIN] epoch=68, iter=25110/80000, loss=0.9624, lr=0.007125, batch_cost=1.3541, reader_cost=0.0001 | ETA 20:38:46 2021-02-23 03:57:49 [INFO] [TRAIN] epoch=68, iter=25120/80000, loss=0.9067, lr=0.007124, batch_cost=1.3681, reader_cost=0.0001 | ETA 20:51:21 2021-02-23 03:58:02 [INFO] [TRAIN] epoch=68, iter=25130/80000, loss=0.8966, lr=0.007122, batch_cost=1.3492, reader_cost=0.0001 | ETA 20:33:50 2021-02-23 03:58:16 [INFO] [TRAIN] epoch=68, iter=25140/80000, loss=0.9133, lr=0.007121, batch_cost=1.3642, reader_cost=0.0001 | ETA 20:47:19 2021-02-23 03:58:30 [INFO] [TRAIN] epoch=68, iter=25150/80000, loss=0.9113, lr=0.007120, batch_cost=1.3641, reader_cost=0.0001 | ETA 20:47:02 2021-02-23 03:58:43 [INFO] [TRAIN] epoch=68, iter=25160/80000, loss=0.9328, lr=0.007119, batch_cost=1.3669, reader_cost=0.0001 | ETA 20:49:21 2021-02-23 03:58:57 [INFO] [TRAIN] epoch=68, iter=25170/80000, loss=1.0197, lr=0.007118, batch_cost=1.3381, reader_cost=0.0001 | ETA 20:22:49 2021-02-23 03:59:10 [INFO] [TRAIN] epoch=68, iter=25180/80000, loss=0.9798, lr=0.007117, batch_cost=1.3702, reader_cost=0.0001 | ETA 20:51:55 2021-02-23 03:59:24 [INFO] [TRAIN] epoch=68, iter=25190/80000, loss=1.0242, lr=0.007115, batch_cost=1.3580, reader_cost=0.0001 | ETA 20:40:29 2021-02-23 03:59:38 [INFO] [TRAIN] epoch=68, iter=25200/80000, loss=0.8704, lr=0.007114, batch_cost=1.3601, reader_cost=0.0001 | ETA 20:42:14 2021-02-23 03:59:51 [INFO] [TRAIN] epoch=68, iter=25210/80000, loss=0.8466, lr=0.007113, batch_cost=1.3940, reader_cost=0.0001 | ETA 21:12:57 2021-02-23 04:00:05 [INFO] [TRAIN] epoch=68, iter=25220/80000, loss=0.9385, lr=0.007112, batch_cost=1.3851, reader_cost=0.0001 | ETA 21:04:35 2021-02-23 04:00:19 [INFO] [TRAIN] epoch=68, iter=25230/80000, loss=1.0133, lr=0.007111, batch_cost=1.3537, reader_cost=0.0001 | ETA 20:35:40 2021-02-23 04:00:33 [INFO] [TRAIN] epoch=68, iter=25240/80000, loss=1.0559, lr=0.007110, batch_cost=1.3818, reader_cost=0.0001 | ETA 21:01:07 2021-02-23 04:00:46 [INFO] [TRAIN] epoch=68, iter=25250/80000, loss=1.0053, lr=0.007108, batch_cost=1.3713, reader_cost=0.0001 | ETA 20:51:17 2021-02-23 04:01:00 [INFO] [TRAIN] epoch=68, iter=25260/80000, loss=0.8508, lr=0.007107, batch_cost=1.3525, reader_cost=0.0001 | ETA 20:33:58 2021-02-23 04:01:13 [INFO] [TRAIN] epoch=68, iter=25270/80000, loss=0.8117, lr=0.007106, batch_cost=1.3449, reader_cost=0.0001 | ETA 20:26:43 2021-02-23 04:01:27 [INFO] [TRAIN] epoch=68, iter=25280/80000, loss=1.0514, lr=0.007105, batch_cost=1.4098, reader_cost=0.0001 | ETA 21:25:42 2021-02-23 04:01:41 [INFO] [TRAIN] epoch=68, iter=25290/80000, loss=0.9613, lr=0.007104, batch_cost=1.3568, reader_cost=0.0001 | ETA 20:37:11 2021-02-23 04:01:56 [INFO] [TRAIN] epoch=69, iter=25300/80000, loss=0.8852, lr=0.007103, batch_cost=1.4487, reader_cost=0.0803 | ETA 22:00:43 2021-02-23 04:02:09 [INFO] [TRAIN] epoch=69, iter=25310/80000, loss=0.9691, lr=0.007101, batch_cost=1.3800, reader_cost=0.0001 | ETA 20:57:51 2021-02-23 04:02:23 [INFO] [TRAIN] epoch=69, iter=25320/80000, loss=1.0185, lr=0.007100, batch_cost=1.3643, reader_cost=0.0001 | ETA 20:43:20 2021-02-23 04:02:37 [INFO] [TRAIN] epoch=69, iter=25330/80000, loss=0.8945, lr=0.007099, batch_cost=1.3626, reader_cost=0.0001 | ETA 20:41:30 2021-02-23 04:02:50 [INFO] [TRAIN] epoch=69, iter=25340/80000, loss=0.9082, lr=0.007098, batch_cost=1.3843, reader_cost=0.0001 | ETA 21:01:03 2021-02-23 04:03:04 [INFO] [TRAIN] epoch=69, iter=25350/80000, loss=0.8923, lr=0.007097, batch_cost=1.3136, reader_cost=0.0001 | ETA 19:56:26 2021-02-23 04:03:17 [INFO] [TRAIN] epoch=69, iter=25360/80000, loss=0.9819, lr=0.007096, batch_cost=1.3671, reader_cost=0.0001 | ETA 20:44:57 2021-02-23 04:03:31 [INFO] [TRAIN] epoch=69, iter=25370/80000, loss=0.9178, lr=0.007094, batch_cost=1.3324, reader_cost=0.0001 | ETA 20:13:11 2021-02-23 04:03:44 [INFO] [TRAIN] epoch=69, iter=25380/80000, loss=0.8795, lr=0.007093, batch_cost=1.3795, reader_cost=0.0001 | ETA 20:55:46 2021-02-23 04:03:58 [INFO] [TRAIN] epoch=69, iter=25390/80000, loss=0.9244, lr=0.007092, batch_cost=1.3477, reader_cost=0.0001 | ETA 20:26:35 2021-02-23 04:04:11 [INFO] [TRAIN] epoch=69, iter=25400/80000, loss=0.9222, lr=0.007091, batch_cost=1.3462, reader_cost=0.0001 | ETA 20:25:04 2021-02-23 04:04:25 [INFO] [TRAIN] epoch=69, iter=25410/80000, loss=1.0092, lr=0.007090, batch_cost=1.3420, reader_cost=0.0001 | ETA 20:20:57 2021-02-23 04:04:38 [INFO] [TRAIN] epoch=69, iter=25420/80000, loss=0.9101, lr=0.007089, batch_cost=1.3478, reader_cost=0.0001 | ETA 20:26:02 2021-02-23 04:04:52 [INFO] [TRAIN] epoch=69, iter=25430/80000, loss=0.8518, lr=0.007087, batch_cost=1.3702, reader_cost=0.0001 | ETA 20:46:13 2021-02-23 04:05:05 [INFO] [TRAIN] epoch=69, iter=25440/80000, loss=0.9106, lr=0.007086, batch_cost=1.3303, reader_cost=0.0001 | ETA 20:09:40 2021-02-23 04:05:19 [INFO] [TRAIN] epoch=69, iter=25450/80000, loss=0.8349, lr=0.007085, batch_cost=1.3637, reader_cost=0.0001 | ETA 20:39:47 2021-02-23 04:05:32 [INFO] [TRAIN] epoch=69, iter=25460/80000, loss=0.8569, lr=0.007084, batch_cost=1.3655, reader_cost=0.0001 | ETA 20:41:14 2021-02-23 04:05:46 [INFO] [TRAIN] epoch=69, iter=25470/80000, loss=1.0070, lr=0.007083, batch_cost=1.3369, reader_cost=0.0001 | ETA 20:15:00 2021-02-23 04:06:00 [INFO] [TRAIN] epoch=69, iter=25480/80000, loss=0.9479, lr=0.007082, batch_cost=1.3863, reader_cost=0.0001 | ETA 20:59:40 2021-02-23 04:06:13 [INFO] [TRAIN] epoch=69, iter=25490/80000, loss=0.9683, lr=0.007080, batch_cost=1.3628, reader_cost=0.0001 | ETA 20:38:07 2021-02-23 04:06:27 [INFO] [TRAIN] epoch=69, iter=25500/80000, loss=0.8767, lr=0.007079, batch_cost=1.3556, reader_cost=0.0001 | ETA 20:31:19 2021-02-23 04:06:41 [INFO] [TRAIN] epoch=69, iter=25510/80000, loss=0.9334, lr=0.007078, batch_cost=1.3714, reader_cost=0.0001 | ETA 20:45:26 2021-02-23 04:06:54 [INFO] [TRAIN] epoch=69, iter=25520/80000, loss=0.8813, lr=0.007077, batch_cost=1.3786, reader_cost=0.0001 | ETA 20:51:45 2021-02-23 04:07:08 [INFO] [TRAIN] epoch=69, iter=25530/80000, loss=0.9118, lr=0.007076, batch_cost=1.3594, reader_cost=0.0001 | ETA 20:34:05 2021-02-23 04:07:22 [INFO] [TRAIN] epoch=69, iter=25540/80000, loss=0.8688, lr=0.007075, batch_cost=1.3843, reader_cost=0.0001 | ETA 20:56:29 2021-02-23 04:07:36 [INFO] [TRAIN] epoch=69, iter=25550/80000, loss=0.9319, lr=0.007073, batch_cost=1.3842, reader_cost=0.0001 | ETA 20:56:10 2021-02-23 04:07:49 [INFO] [TRAIN] epoch=69, iter=25560/80000, loss=0.8776, lr=0.007072, batch_cost=1.3690, reader_cost=0.0001 | ETA 20:42:05 2021-02-23 04:08:03 [INFO] [TRAIN] epoch=69, iter=25570/80000, loss=0.9290, lr=0.007071, batch_cost=1.3802, reader_cost=0.0001 | ETA 20:52:04 2021-02-23 04:08:17 [INFO] [TRAIN] epoch=69, iter=25580/80000, loss=1.0030, lr=0.007070, batch_cost=1.3597, reader_cost=0.0001 | ETA 20:33:13 2021-02-23 04:08:30 [INFO] [TRAIN] epoch=69, iter=25590/80000, loss=0.8467, lr=0.007069, batch_cost=1.3472, reader_cost=0.0001 | ETA 20:21:38 2021-02-23 04:08:44 [INFO] [TRAIN] epoch=69, iter=25600/80000, loss=0.8376, lr=0.007067, batch_cost=1.3541, reader_cost=0.0001 | ETA 20:27:44 2021-02-23 04:08:58 [INFO] [TRAIN] epoch=69, iter=25610/80000, loss=1.0022, lr=0.007066, batch_cost=1.3853, reader_cost=0.0001 | ETA 20:55:47 2021-02-23 04:09:11 [INFO] [TRAIN] epoch=69, iter=25620/80000, loss=0.9148, lr=0.007065, batch_cost=1.3547, reader_cost=0.0001 | ETA 20:27:48 2021-02-23 04:09:25 [INFO] [TRAIN] epoch=69, iter=25630/80000, loss=0.8886, lr=0.007064, batch_cost=1.3800, reader_cost=0.0001 | ETA 20:50:28 2021-02-23 04:09:39 [INFO] [TRAIN] epoch=69, iter=25640/80000, loss=0.9389, lr=0.007063, batch_cost=1.3633, reader_cost=0.0001 | ETA 20:35:07 2021-02-23 04:09:52 [INFO] [TRAIN] epoch=69, iter=25650/80000, loss=0.8837, lr=0.007062, batch_cost=1.3734, reader_cost=0.0001 | ETA 20:44:06 2021-02-23 04:10:06 [INFO] [TRAIN] epoch=69, iter=25660/80000, loss=0.9543, lr=0.007060, batch_cost=1.3481, reader_cost=0.0001 | ETA 20:20:56 2021-02-23 04:10:20 [INFO] [TRAIN] epoch=70, iter=25670/80000, loss=0.8395, lr=0.007059, batch_cost=1.4097, reader_cost=0.0694 | ETA 21:16:28 2021-02-23 04:10:34 [INFO] [TRAIN] epoch=70, iter=25680/80000, loss=0.8833, lr=0.007058, batch_cost=1.3773, reader_cost=0.0001 | ETA 20:46:56 2021-02-23 04:10:47 [INFO] [TRAIN] epoch=70, iter=25690/80000, loss=0.9399, lr=0.007057, batch_cost=1.3367, reader_cost=0.0001 | ETA 20:09:53 2021-02-23 04:11:01 [INFO] [TRAIN] epoch=70, iter=25700/80000, loss=0.9975, lr=0.007056, batch_cost=1.3630, reader_cost=0.0001 | ETA 20:33:28 2021-02-23 04:11:14 [INFO] [TRAIN] epoch=70, iter=25710/80000, loss=0.9567, lr=0.007055, batch_cost=1.3637, reader_cost=0.0001 | ETA 20:33:53 2021-02-23 04:11:28 [INFO] [TRAIN] epoch=70, iter=25720/80000, loss=0.8880, lr=0.007053, batch_cost=1.3433, reader_cost=0.0001 | ETA 20:15:11 2021-02-23 04:11:41 [INFO] [TRAIN] epoch=70, iter=25730/80000, loss=0.8856, lr=0.007052, batch_cost=1.3421, reader_cost=0.0001 | ETA 20:13:57 2021-02-23 04:11:55 [INFO] [TRAIN] epoch=70, iter=25740/80000, loss=1.0625, lr=0.007051, batch_cost=1.3978, reader_cost=0.0001 | ETA 21:04:06 2021-02-23 04:12:09 [INFO] [TRAIN] epoch=70, iter=25750/80000, loss=0.9050, lr=0.007050, batch_cost=1.3557, reader_cost=0.0001 | ETA 20:25:45 2021-02-23 04:12:22 [INFO] [TRAIN] epoch=70, iter=25760/80000, loss=0.8198, lr=0.007049, batch_cost=1.3477, reader_cost=0.0001 | ETA 20:18:19 2021-02-23 04:12:36 [INFO] [TRAIN] epoch=70, iter=25770/80000, loss=0.8719, lr=0.007048, batch_cost=1.3765, reader_cost=0.0001 | ETA 20:44:06 2021-02-23 04:12:50 [INFO] [TRAIN] epoch=70, iter=25780/80000, loss=0.9177, lr=0.007046, batch_cost=1.3711, reader_cost=0.0001 | ETA 20:39:01 2021-02-23 04:13:03 [INFO] [TRAIN] epoch=70, iter=25790/80000, loss=0.9558, lr=0.007045, batch_cost=1.3409, reader_cost=0.0001 | ETA 20:11:27 2021-02-23 04:13:17 [INFO] [TRAIN] epoch=70, iter=25800/80000, loss=0.8695, lr=0.007044, batch_cost=1.3513, reader_cost=0.0001 | ETA 20:20:42 2021-02-23 04:13:30 [INFO] [TRAIN] epoch=70, iter=25810/80000, loss=0.9028, lr=0.007043, batch_cost=1.3574, reader_cost=0.0001 | ETA 20:25:59 2021-02-23 04:13:44 [INFO] [TRAIN] epoch=70, iter=25820/80000, loss=0.9296, lr=0.007042, batch_cost=1.3455, reader_cost=0.0001 | ETA 20:14:56 2021-02-23 04:13:57 [INFO] [TRAIN] epoch=70, iter=25830/80000, loss=0.9239, lr=0.007041, batch_cost=1.3341, reader_cost=0.0001 | ETA 20:04:27 2021-02-23 04:14:11 [INFO] [TRAIN] epoch=70, iter=25840/80000, loss=0.8396, lr=0.007039, batch_cost=1.3623, reader_cost=0.0001 | ETA 20:29:41 2021-02-23 04:14:25 [INFO] [TRAIN] epoch=70, iter=25850/80000, loss=0.8783, lr=0.007038, batch_cost=1.3957, reader_cost=0.0001 | ETA 20:59:37 2021-02-23 04:14:38 [INFO] [TRAIN] epoch=70, iter=25860/80000, loss=0.9190, lr=0.007037, batch_cost=1.3308, reader_cost=0.0001 | ETA 20:00:46 2021-02-23 04:14:52 [INFO] [TRAIN] epoch=70, iter=25870/80000, loss=0.8573, lr=0.007036, batch_cost=1.4097, reader_cost=0.0001 | ETA 21:11:47 2021-02-23 04:15:06 [INFO] [TRAIN] epoch=70, iter=25880/80000, loss=0.9836, lr=0.007035, batch_cost=1.3798, reader_cost=0.0001 | ETA 20:44:36 2021-02-23 04:15:19 [INFO] [TRAIN] epoch=70, iter=25890/80000, loss=1.0448, lr=0.007034, batch_cost=1.3715, reader_cost=0.0001 | ETA 20:36:53 2021-02-23 04:15:33 [INFO] [TRAIN] epoch=70, iter=25900/80000, loss=0.8783, lr=0.007032, batch_cost=1.3411, reader_cost=0.0001 | ETA 20:09:12 2021-02-23 04:15:46 [INFO] [TRAIN] epoch=70, iter=25910/80000, loss=0.9618, lr=0.007031, batch_cost=1.3392, reader_cost=0.0001 | ETA 20:07:14 2021-02-23 04:16:00 [INFO] [TRAIN] epoch=70, iter=25920/80000, loss=0.8215, lr=0.007030, batch_cost=1.3769, reader_cost=0.0001 | ETA 20:41:00 2021-02-23 04:16:13 [INFO] [TRAIN] epoch=70, iter=25930/80000, loss=0.8426, lr=0.007029, batch_cost=1.3413, reader_cost=0.0001 | ETA 20:08:42 2021-02-23 04:16:27 [INFO] [TRAIN] epoch=70, iter=25940/80000, loss=0.8938, lr=0.007028, batch_cost=1.3569, reader_cost=0.0001 | ETA 20:22:33 2021-02-23 04:16:41 [INFO] [TRAIN] epoch=70, iter=25950/80000, loss=0.9310, lr=0.007027, batch_cost=1.3672, reader_cost=0.0001 | ETA 20:31:38 2021-02-23 04:16:54 [INFO] [TRAIN] epoch=70, iter=25960/80000, loss=1.1679, lr=0.007025, batch_cost=1.3571, reader_cost=0.0001 | ETA 20:22:19 2021-02-23 04:17:08 [INFO] [TRAIN] epoch=70, iter=25970/80000, loss=0.8814, lr=0.007024, batch_cost=1.3510, reader_cost=0.0001 | ETA 20:16:31 2021-02-23 04:17:21 [INFO] [TRAIN] epoch=70, iter=25980/80000, loss=0.8861, lr=0.007023, batch_cost=1.3522, reader_cost=0.0001 | ETA 20:17:26 2021-02-23 04:17:35 [INFO] [TRAIN] epoch=70, iter=25990/80000, loss=0.8218, lr=0.007022, batch_cost=1.3560, reader_cost=0.0001 | ETA 20:20:40 2021-02-23 04:17:48 [INFO] [TRAIN] epoch=70, iter=26000/80000, loss=0.7915, lr=0.007021, batch_cost=1.3391, reader_cost=0.0001 | ETA 20:05:13 2021-02-23 04:17:48 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:17 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:01 - batch_cost: 0.1872 - reader cost: 0.0625  3/125 [..............................] - ETA: 58s - batch_cost: 0.2735 - reader cost: 0.1037  4/125 [..............................] - ETA: 57s - batch_cost: 0.3165 - reader cost: 0.1260 5/125 [>.............................] - ETA: 55s - batch_cost: 0.3338 - reader cost: 0.1301 6/125 [>.............................] - ETA: 54s - batch_cost: 0.3508 - reader cost: 0.1370 7/125 [>.............................] - ETA: 53s - batch_cost: 0.3611 - reader cost: 0.1410 8/125 [>.............................] - ETA: 52s - batch_cost: 0.3713 - reader cost: 0.1465 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3726 - reader cost: 0.1429 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3737 - reader cost: 0.1411 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3760 - reader cost: 0.1411 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3817 - reader cost: 0.1452 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3856 - reader cost: 0.1475 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3905 - reader cost: 0.1515 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3937 - reader cost: 0.1532 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3962 - reader cost: 0.1549 17/125 [===>..........................] - ETA: 47s - batch_cost: 0.3993 - reader cost: 0.1561 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.4003 - reader cost: 0.1561 19/125 [===>..........................] - ETA: 46s - batch_cost: 0.4016 - reader cost: 0.1572 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4036 - reader cost: 0.1584 21/125 [====>.........................] - ETA: 45s - batch_cost: 0.4043 - reader cost: 0.1589 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4032 - reader cost: 0.1573 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4037 - reader cost: 0.1575 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4030 - reader cost: 0.1563 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4041 - reader cost: 0.1569 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4069 - reader cost: 0.1588 27/125 [=====>........................] - ETA: 42s - batch_cost: 0.4069 - reader cost: 0.1587 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4081 - reader cost: 0.1596 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4084 - reader cost: 0.1598 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4093 - reader cost: 0.1603 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4082 - reader cost: 0.1592 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4090 - reader cost: 0.1598 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4094 - reader cost: 0.1601 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4100 - reader cost: 0.1604 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4089 - reader cost: 0.1592 36/125 [=======>......................] - ETA: 38s - batch_cost: 0.4102 - reader cost: 0.1604 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4111 - reader cost: 0.1612 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4116 - reader cost: 0.1615 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4108 - reader cost: 0.1607 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4102 - reader cost: 0.1600 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4097 - reader cost: 0.1594 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4099 - reader cost: 0.1596 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4093 - reader cost: 0.1589 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4086 - reader cost: 0.1583 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4091 - reader cost: 0.1587 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4096 - reader cost: 0.1590 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4104 - reader cost: 0.1599 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4105 - reader cost: 0.1600 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4097 - reader cost: 0.1590 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4098 - reader cost: 0.1588 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4105 - reader cost: 0.1593 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4106 - reader cost: 0.1594 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4108 - reader cost: 0.1596 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4114 - reader cost: 0.1600 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4115 - reader cost: 0.1601 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4111 - reader cost: 0.1596 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4106 - reader cost: 0.1591 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4112 - reader cost: 0.1597 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4119 - reader cost: 0.1602 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4111 - reader cost: 0.1594 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4109 - reader cost: 0.1592 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4108 - reader cost: 0.1588 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4111 - reader cost: 0.1591 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4114 - reader cost: 0.1595 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4119 - reader cost: 0.1598 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4114 - reader cost: 0.1593 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4107 - reader cost: 0.1586 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4110 - reader cost: 0.1589 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4105 - reader cost: 0.1584 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4107 - reader cost: 0.1586 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4107 - reader cost: 0.1586 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4113 - reader cost: 0.1592 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4109 - reader cost: 0.1588 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4112 - reader cost: 0.1591 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4115 - reader cost: 0.1594 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4109 - reader cost: 0.1587 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4106 - reader cost: 0.1582 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4108 - reader cost: 0.1584 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4112 - reader cost: 0.1588 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4116 - reader cost: 0.1593 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4118 - reader cost: 0.1596 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4123 - reader cost: 0.1600 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4127 - reader cost: 0.1603 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4121 - reader cost: 0.1597 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4121 - reader cost: 0.1598 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4116 - reader cost: 0.1592 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4120 - reader cost: 0.1595 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4114 - reader cost: 0.1589 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4119 - reader cost: 0.1594 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4121 - reader cost: 0.1597 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4118 - reader cost: 0.1591 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4124 - reader cost: 0.1593 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4126 - reader cost: 0.1592 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4126 - reader cost: 0.1585 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4128 - reader cost: 0.1581 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4130 - reader cost: 0.1582 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4132 - reader cost: 0.1584 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4135 - reader cost: 0.1588 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4136 - reader cost: 0.1590 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4137 - reader cost: 0.1591 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4139 - reader cost: 0.1593 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4136 - reader cost: 0.1590  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4137 - reader cost: 0.1591 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4139 - reader cost: 0.1592 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4140 - reader cost: 0.1593 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4142 - reader cost: 0.1595 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4144 - reader cost: 0.1597 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4146 - reader cost: 0.1600 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4149 - reader cost: 0.1602 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4145 - reader cost: 0.1598 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4148 - reader cost: 0.1599 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4148 - reader cost: 0.1599 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4149 - reader cost: 0.1599 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4150 - reader cost: 0.1600 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4151 - reader cost: 0.1601 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4147 - reader cost: 0.1598 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4150 - reader cost: 0.1600 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4152 - reader cost: 0.1603 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4153 - reader cost: 0.1604 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4154 - reader cost: 0.1605 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4155 - reader cost: 0.1607 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4157 - reader cost: 0.1609 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4158 - reader cost: 0.1610 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4161 - reader cost: 0.1612 125/125 [==============================] - 53s 421ms/step - batch_cost: 0.4161 - reader cost: 0.1612 2021-02-23 04:18:41 [INFO] [EVAL] #Images=500 mIoU=0.7384 Acc=0.9530 Kappa=0.9389 2021-02-23 04:18:41 [INFO] [EVAL] Class IoU: [0.9736 0.7965 0.9113 0.3102 0.5064 0.6382 0.6973 0.7885 0.9179 0.6255 0.9417 0.8099 0.6118 0.9441 0.6925 0.8152 0.6896 0.5866 0.7732] 2021-02-23 04:18:41 [INFO] [EVAL] Class Acc: [0.9846 0.886 0.9465 0.8409 0.8091 0.794 0.8526 0.9088 0.9486 0.8394 0.9618 0.8763 0.7127 0.9687 0.8433 0.9099 0.9605 0.8543 0.8694] 2021-02-23 04:18:47 [INFO] [EVAL] The model with the best validation mIoU (0.7384) was saved at iter 26000. 2021-02-23 04:19:01 [INFO] [TRAIN] epoch=70, iter=26010/80000, loss=0.9340, lr=0.007020, batch_cost=1.3873, reader_cost=0.0001 | ETA 20:48:22 2021-02-23 04:19:15 [INFO] [TRAIN] epoch=70, iter=26020/80000, loss=1.0409, lr=0.007018, batch_cost=1.3659, reader_cost=0.0001 | ETA 20:28:51 2021-02-23 04:19:28 [INFO] [TRAIN] epoch=70, iter=26030/80000, loss=0.8312, lr=0.007017, batch_cost=1.3692, reader_cost=0.0001 | ETA 20:31:34 2021-02-23 04:19:41 [INFO] [TRAIN] epoch=70, iter=26040/80000, loss=0.8587, lr=0.007016, batch_cost=1.3207, reader_cost=0.0001 | ETA 19:47:45 2021-02-23 04:19:56 [INFO] [TRAIN] epoch=71, iter=26050/80000, loss=0.8515, lr=0.007015, batch_cost=1.4888, reader_cost=0.0989 | ETA 22:18:42 2021-02-23 04:20:10 [INFO] [TRAIN] epoch=71, iter=26060/80000, loss=0.8150, lr=0.007014, batch_cost=1.3578, reader_cost=0.0001 | ETA 20:20:42 2021-02-23 04:20:24 [INFO] [TRAIN] epoch=71, iter=26070/80000, loss=0.9343, lr=0.007013, batch_cost=1.3568, reader_cost=0.0001 | ETA 20:19:33 2021-02-23 04:20:37 [INFO] [TRAIN] epoch=71, iter=26080/80000, loss=0.9427, lr=0.007011, batch_cost=1.3698, reader_cost=0.0001 | ETA 20:30:59 2021-02-23 04:20:51 [INFO] [TRAIN] epoch=71, iter=26090/80000, loss=0.9087, lr=0.007010, batch_cost=1.3664, reader_cost=0.0001 | ETA 20:27:42 2021-02-23 04:21:04 [INFO] [TRAIN] epoch=71, iter=26100/80000, loss=0.8869, lr=0.007009, batch_cost=1.3384, reader_cost=0.0001 | ETA 20:02:19 2021-02-23 04:21:18 [INFO] [TRAIN] epoch=71, iter=26110/80000, loss=0.8271, lr=0.007008, batch_cost=1.3643, reader_cost=0.0001 | ETA 20:25:21 2021-02-23 04:21:31 [INFO] [TRAIN] epoch=71, iter=26120/80000, loss=0.9586, lr=0.007007, batch_cost=1.3532, reader_cost=0.0001 | ETA 20:15:08 2021-02-23 04:21:45 [INFO] [TRAIN] epoch=71, iter=26130/80000, loss=0.8648, lr=0.007005, batch_cost=1.3365, reader_cost=0.0001 | ETA 19:59:58 2021-02-23 04:21:59 [INFO] [TRAIN] epoch=71, iter=26140/80000, loss=0.9001, lr=0.007004, batch_cost=1.3755, reader_cost=0.0001 | ETA 20:34:43 2021-02-23 04:22:12 [INFO] [TRAIN] epoch=71, iter=26150/80000, loss=0.9184, lr=0.007003, batch_cost=1.3862, reader_cost=0.0001 | ETA 20:44:08 2021-02-23 04:22:26 [INFO] [TRAIN] epoch=71, iter=26160/80000, loss=0.9136, lr=0.007002, batch_cost=1.3514, reader_cost=0.0001 | ETA 20:12:39 2021-02-23 04:22:40 [INFO] [TRAIN] epoch=71, iter=26170/80000, loss=0.8769, lr=0.007001, batch_cost=1.3747, reader_cost=0.0001 | ETA 20:33:17 2021-02-23 04:22:53 [INFO] [TRAIN] epoch=71, iter=26180/80000, loss=0.8560, lr=0.007000, batch_cost=1.3476, reader_cost=0.0001 | ETA 20:08:46 2021-02-23 04:23:07 [INFO] [TRAIN] epoch=71, iter=26190/80000, loss=0.8014, lr=0.006998, batch_cost=1.3496, reader_cost=0.0001 | ETA 20:10:20 2021-02-23 04:23:21 [INFO] [TRAIN] epoch=71, iter=26200/80000, loss=0.8954, lr=0.006997, batch_cost=1.4062, reader_cost=0.0001 | ETA 21:00:50 2021-02-23 04:23:34 [INFO] [TRAIN] epoch=71, iter=26210/80000, loss=0.9525, lr=0.006996, batch_cost=1.3497, reader_cost=0.0001 | ETA 20:10:00 2021-02-23 04:23:47 [INFO] [TRAIN] epoch=71, iter=26220/80000, loss=0.9407, lr=0.006995, batch_cost=1.3221, reader_cost=0.0001 | ETA 19:44:59 2021-02-23 04:24:01 [INFO] [TRAIN] epoch=71, iter=26230/80000, loss=0.8964, lr=0.006994, batch_cost=1.3765, reader_cost=0.0001 | ETA 20:33:33 2021-02-23 04:24:15 [INFO] [TRAIN] epoch=71, iter=26240/80000, loss=0.9508, lr=0.006993, batch_cost=1.3424, reader_cost=0.0001 | ETA 20:02:47 2021-02-23 04:24:29 [INFO] [TRAIN] epoch=71, iter=26250/80000, loss=0.9413, lr=0.006991, batch_cost=1.3855, reader_cost=0.0001 | ETA 20:41:08 2021-02-23 04:24:42 [INFO] [TRAIN] epoch=71, iter=26260/80000, loss=0.9477, lr=0.006990, batch_cost=1.3321, reader_cost=0.0001 | ETA 19:53:04 2021-02-23 04:24:55 [INFO] [TRAIN] epoch=71, iter=26270/80000, loss=0.8645, lr=0.006989, batch_cost=1.3581, reader_cost=0.0001 | ETA 20:16:13 2021-02-23 04:25:09 [INFO] [TRAIN] epoch=71, iter=26280/80000, loss=0.9360, lr=0.006988, batch_cost=1.3538, reader_cost=0.0001 | ETA 20:12:06 2021-02-23 04:25:22 [INFO] [TRAIN] epoch=71, iter=26290/80000, loss=0.9425, lr=0.006987, batch_cost=1.3507, reader_cost=0.0001 | ETA 20:09:06 2021-02-23 04:25:36 [INFO] [TRAIN] epoch=71, iter=26300/80000, loss=0.8472, lr=0.006986, batch_cost=1.3432, reader_cost=0.0001 | ETA 20:02:10 2021-02-23 04:25:50 [INFO] [TRAIN] epoch=71, iter=26310/80000, loss=0.8864, lr=0.006984, batch_cost=1.3740, reader_cost=0.0001 | ETA 20:29:32 2021-02-23 04:26:03 [INFO] [TRAIN] epoch=71, iter=26320/80000, loss=0.8852, lr=0.006983, batch_cost=1.3471, reader_cost=0.0001 | ETA 20:05:13 2021-02-23 04:26:17 [INFO] [TRAIN] epoch=71, iter=26330/80000, loss=1.0268, lr=0.006982, batch_cost=1.3856, reader_cost=0.0001 | ETA 20:39:25 2021-02-23 04:26:31 [INFO] [TRAIN] epoch=71, iter=26340/80000, loss=0.8599, lr=0.006981, batch_cost=1.3584, reader_cost=0.0001 | ETA 20:14:52 2021-02-23 04:26:44 [INFO] [TRAIN] epoch=71, iter=26350/80000, loss=0.9666, lr=0.006980, batch_cost=1.3595, reader_cost=0.0001 | ETA 20:15:36 2021-02-23 04:26:58 [INFO] [TRAIN] epoch=71, iter=26360/80000, loss=0.9055, lr=0.006979, batch_cost=1.3512, reader_cost=0.0001 | ETA 20:08:00 2021-02-23 04:27:11 [INFO] [TRAIN] epoch=71, iter=26370/80000, loss=0.8979, lr=0.006977, batch_cost=1.3487, reader_cost=0.0001 | ETA 20:05:31 2021-02-23 04:27:25 [INFO] [TRAIN] epoch=71, iter=26380/80000, loss=1.0619, lr=0.006976, batch_cost=1.3448, reader_cost=0.0001 | ETA 20:01:50 2021-02-23 04:27:38 [INFO] [TRAIN] epoch=71, iter=26390/80000, loss=0.9328, lr=0.006975, batch_cost=1.3547, reader_cost=0.0001 | ETA 20:10:23 2021-02-23 04:27:52 [INFO] [TRAIN] epoch=71, iter=26400/80000, loss=0.9785, lr=0.006974, batch_cost=1.3453, reader_cost=0.0001 | ETA 20:01:49 2021-02-23 04:28:05 [INFO] [TRAIN] epoch=71, iter=26410/80000, loss=1.0395, lr=0.006973, batch_cost=1.3539, reader_cost=0.0001 | ETA 20:09:14 2021-02-23 04:28:20 [INFO] [TRAIN] epoch=72, iter=26420/80000, loss=0.9187, lr=0.006972, batch_cost=1.4715, reader_cost=0.0817 | ETA 21:54:04 2021-02-23 04:28:34 [INFO] [TRAIN] epoch=72, iter=26430/80000, loss=0.8901, lr=0.006970, batch_cost=1.3712, reader_cost=0.0001 | ETA 20:24:16 2021-02-23 04:28:47 [INFO] [TRAIN] epoch=72, iter=26440/80000, loss=0.8794, lr=0.006969, batch_cost=1.3317, reader_cost=0.0001 | ETA 19:48:43 2021-02-23 04:29:00 [INFO] [TRAIN] epoch=72, iter=26450/80000, loss=0.9568, lr=0.006968, batch_cost=1.3595, reader_cost=0.0001 | ETA 20:13:19 2021-02-23 04:29:14 [INFO] [TRAIN] epoch=72, iter=26460/80000, loss=0.9462, lr=0.006967, batch_cost=1.3458, reader_cost=0.0001 | ETA 20:00:52 2021-02-23 04:29:28 [INFO] [TRAIN] epoch=72, iter=26470/80000, loss=0.8488, lr=0.006966, batch_cost=1.3742, reader_cost=0.0001 | ETA 20:25:59 2021-02-23 04:29:41 [INFO] [TRAIN] epoch=72, iter=26480/80000, loss=0.8753, lr=0.006965, batch_cost=1.3392, reader_cost=0.0001 | ETA 19:54:31 2021-02-23 04:29:55 [INFO] [TRAIN] epoch=72, iter=26490/80000, loss=0.9453, lr=0.006963, batch_cost=1.3488, reader_cost=0.0001 | ETA 20:02:52 2021-02-23 04:30:09 [INFO] [TRAIN] epoch=72, iter=26500/80000, loss=0.9065, lr=0.006962, batch_cost=1.3963, reader_cost=0.0001 | ETA 20:44:59 2021-02-23 04:30:22 [INFO] [TRAIN] epoch=72, iter=26510/80000, loss=0.8447, lr=0.006961, batch_cost=1.3461, reader_cost=0.0001 | ETA 20:00:03 2021-02-23 04:30:36 [INFO] [TRAIN] epoch=72, iter=26520/80000, loss=0.9126, lr=0.006960, batch_cost=1.3589, reader_cost=0.0001 | ETA 20:11:16 2021-02-23 04:30:49 [INFO] [TRAIN] epoch=72, iter=26530/80000, loss=0.9164, lr=0.006959, batch_cost=1.3540, reader_cost=0.0001 | ETA 20:06:40 2021-02-23 04:31:03 [INFO] [TRAIN] epoch=72, iter=26540/80000, loss=0.9916, lr=0.006957, batch_cost=1.3729, reader_cost=0.0001 | ETA 20:23:16 2021-02-23 04:31:16 [INFO] [TRAIN] epoch=72, iter=26550/80000, loss=0.9753, lr=0.006956, batch_cost=1.3301, reader_cost=0.0001 | ETA 19:44:55 2021-02-23 04:31:30 [INFO] [TRAIN] epoch=72, iter=26560/80000, loss=0.9259, lr=0.006955, batch_cost=1.3537, reader_cost=0.0001 | ETA 20:05:42 2021-02-23 04:31:43 [INFO] [TRAIN] epoch=72, iter=26570/80000, loss=0.8533, lr=0.006954, batch_cost=1.3548, reader_cost=0.0001 | ETA 20:06:24 2021-02-23 04:31:57 [INFO] [TRAIN] epoch=72, iter=26580/80000, loss=0.9844, lr=0.006953, batch_cost=1.3432, reader_cost=0.0001 | ETA 19:55:51 2021-02-23 04:32:10 [INFO] [TRAIN] epoch=72, iter=26590/80000, loss=0.8847, lr=0.006952, batch_cost=1.3320, reader_cost=0.0001 | ETA 19:45:41 2021-02-23 04:32:23 [INFO] [TRAIN] epoch=72, iter=26600/80000, loss=1.0754, lr=0.006950, batch_cost=1.3506, reader_cost=0.0001 | ETA 20:01:59 2021-02-23 04:32:37 [INFO] [TRAIN] epoch=72, iter=26610/80000, loss=0.8771, lr=0.006949, batch_cost=1.3624, reader_cost=0.0001 | ETA 20:12:16 2021-02-23 04:32:51 [INFO] [TRAIN] epoch=72, iter=26620/80000, loss=0.9157, lr=0.006948, batch_cost=1.3409, reader_cost=0.0001 | ETA 19:52:55 2021-02-23 04:33:04 [INFO] [TRAIN] epoch=72, iter=26630/80000, loss=0.8860, lr=0.006947, batch_cost=1.3513, reader_cost=0.0001 | ETA 20:01:57 2021-02-23 04:33:17 [INFO] [TRAIN] epoch=72, iter=26640/80000, loss=0.9169, lr=0.006946, batch_cost=1.3335, reader_cost=0.0001 | ETA 19:45:56 2021-02-23 04:33:31 [INFO] [TRAIN] epoch=72, iter=26650/80000, loss=0.8247, lr=0.006945, batch_cost=1.3616, reader_cost=0.0001 | ETA 20:10:39 2021-02-23 04:33:45 [INFO] [TRAIN] epoch=72, iter=26660/80000, loss=0.8697, lr=0.006943, batch_cost=1.3614, reader_cost=0.0001 | ETA 20:10:14 2021-02-23 04:33:58 [INFO] [TRAIN] epoch=72, iter=26670/80000, loss=0.9037, lr=0.006942, batch_cost=1.3788, reader_cost=0.0001 | ETA 20:25:30 2021-02-23 04:34:12 [INFO] [TRAIN] epoch=72, iter=26680/80000, loss=0.9585, lr=0.006941, batch_cost=1.3655, reader_cost=0.0001 | ETA 20:13:26 2021-02-23 04:34:26 [INFO] [TRAIN] epoch=72, iter=26690/80000, loss=0.9406, lr=0.006940, batch_cost=1.4099, reader_cost=0.0001 | ETA 20:52:41 2021-02-23 04:34:40 [INFO] [TRAIN] epoch=72, iter=26700/80000, loss=0.8614, lr=0.006939, batch_cost=1.3681, reader_cost=0.0001 | ETA 20:15:17 2021-02-23 04:34:53 [INFO] [TRAIN] epoch=72, iter=26710/80000, loss=0.9099, lr=0.006938, batch_cost=1.3611, reader_cost=0.0001 | ETA 20:08:50 2021-02-23 04:35:07 [INFO] [TRAIN] epoch=72, iter=26720/80000, loss=0.9115, lr=0.006936, batch_cost=1.3624, reader_cost=0.0001 | ETA 20:09:47 2021-02-23 04:35:21 [INFO] [TRAIN] epoch=72, iter=26730/80000, loss=0.8596, lr=0.006935, batch_cost=1.3695, reader_cost=0.0001 | ETA 20:15:50 2021-02-23 04:35:34 [INFO] [TRAIN] epoch=72, iter=26740/80000, loss=0.9106, lr=0.006934, batch_cost=1.3723, reader_cost=0.0001 | ETA 20:18:08 2021-02-23 04:35:48 [INFO] [TRAIN] epoch=72, iter=26750/80000, loss=0.9222, lr=0.006933, batch_cost=1.3718, reader_cost=0.0001 | ETA 20:17:27 2021-02-23 04:36:02 [INFO] [TRAIN] epoch=72, iter=26760/80000, loss=0.8143, lr=0.006932, batch_cost=1.3449, reader_cost=0.0001 | ETA 19:53:21 2021-02-23 04:36:15 [INFO] [TRAIN] epoch=72, iter=26770/80000, loss=0.9079, lr=0.006931, batch_cost=1.3550, reader_cost=0.0001 | ETA 20:02:04 2021-02-23 04:36:29 [INFO] [TRAIN] epoch=72, iter=26780/80000, loss=0.9800, lr=0.006929, batch_cost=1.3459, reader_cost=0.0001 | ETA 19:53:49 2021-02-23 04:36:43 [INFO] [TRAIN] epoch=73, iter=26790/80000, loss=0.9396, lr=0.006928, batch_cost=1.4411, reader_cost=0.0548 | ETA 21:18:00 2021-02-23 04:36:57 [INFO] [TRAIN] epoch=73, iter=26800/80000, loss=0.9936, lr=0.006927, batch_cost=1.3782, reader_cost=0.0001 | ETA 20:21:59 2021-02-23 04:37:10 [INFO] [TRAIN] epoch=73, iter=26810/80000, loss=0.9050, lr=0.006926, batch_cost=1.3634, reader_cost=0.0001 | ETA 20:08:39 2021-02-23 04:37:24 [INFO] [TRAIN] epoch=73, iter=26820/80000, loss=0.9536, lr=0.006925, batch_cost=1.3686, reader_cost=0.0001 | ETA 20:13:00 2021-02-23 04:37:38 [INFO] [TRAIN] epoch=73, iter=26830/80000, loss=0.8408, lr=0.006924, batch_cost=1.3605, reader_cost=0.0001 | ETA 20:05:38 2021-02-23 04:37:51 [INFO] [TRAIN] epoch=73, iter=26840/80000, loss=0.8771, lr=0.006922, batch_cost=1.3498, reader_cost=0.0001 | ETA 19:55:57 2021-02-23 04:38:05 [INFO] [TRAIN] epoch=73, iter=26850/80000, loss=0.9916, lr=0.006921, batch_cost=1.3865, reader_cost=0.0001 | ETA 20:28:14 2021-02-23 04:38:19 [INFO] [TRAIN] epoch=73, iter=26860/80000, loss=0.9042, lr=0.006920, batch_cost=1.3591, reader_cost=0.0001 | ETA 20:03:43 2021-02-23 04:38:33 [INFO] [TRAIN] epoch=73, iter=26870/80000, loss=0.9547, lr=0.006919, batch_cost=1.3818, reader_cost=0.0001 | ETA 20:23:37 2021-02-23 04:38:46 [INFO] [TRAIN] epoch=73, iter=26880/80000, loss=0.9423, lr=0.006918, batch_cost=1.3922, reader_cost=0.0001 | ETA 20:32:34 2021-02-23 04:39:00 [INFO] [TRAIN] epoch=73, iter=26890/80000, loss=0.9014, lr=0.006916, batch_cost=1.3542, reader_cost=0.0001 | ETA 19:58:42 2021-02-23 04:39:14 [INFO] [TRAIN] epoch=73, iter=26900/80000, loss=0.8706, lr=0.006915, batch_cost=1.3563, reader_cost=0.0001 | ETA 20:00:18 2021-02-23 04:39:27 [INFO] [TRAIN] epoch=73, iter=26910/80000, loss=0.8475, lr=0.006914, batch_cost=1.3705, reader_cost=0.0001 | ETA 20:12:39 2021-02-23 04:39:41 [INFO] [TRAIN] epoch=73, iter=26920/80000, loss=1.0518, lr=0.006913, batch_cost=1.3643, reader_cost=0.0001 | ETA 20:06:56 2021-02-23 04:39:54 [INFO] [TRAIN] epoch=73, iter=26930/80000, loss=0.8847, lr=0.006912, batch_cost=1.3419, reader_cost=0.0001 | ETA 19:46:57 2021-02-23 04:40:08 [INFO] [TRAIN] epoch=73, iter=26940/80000, loss=0.8495, lr=0.006911, batch_cost=1.3460, reader_cost=0.0001 | ETA 19:50:21 2021-02-23 04:40:22 [INFO] [TRAIN] epoch=73, iter=26950/80000, loss=0.8950, lr=0.006909, batch_cost=1.3952, reader_cost=0.0001 | ETA 20:33:35 2021-02-23 04:40:35 [INFO] [TRAIN] epoch=73, iter=26960/80000, loss=0.8811, lr=0.006908, batch_cost=1.3587, reader_cost=0.0001 | ETA 20:01:04 2021-02-23 04:40:49 [INFO] [TRAIN] epoch=73, iter=26970/80000, loss=0.9658, lr=0.006907, batch_cost=1.3623, reader_cost=0.0001 | ETA 20:04:02 2021-02-23 04:41:03 [INFO] [TRAIN] epoch=73, iter=26980/80000, loss=1.0135, lr=0.006906, batch_cost=1.3696, reader_cost=0.0001 | ETA 20:10:15 2021-02-23 04:41:16 [INFO] [TRAIN] epoch=73, iter=26990/80000, loss=0.9870, lr=0.006905, batch_cost=1.3299, reader_cost=0.0001 | ETA 19:34:59 2021-02-23 04:41:29 [INFO] [TRAIN] epoch=73, iter=27000/80000, loss=0.8903, lr=0.006904, batch_cost=1.3506, reader_cost=0.0001 | ETA 19:53:01 2021-02-23 04:41:29 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:13 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:02 - batch_cost: 0.2141 - reader cost: 0.0898  3/125 [..............................] - ETA: 1:01 - batch_cost: 0.3025 - reader cost: 0.1340 4/125 [..............................] - ETA: 58s - batch_cost: 0.3351 - reader cost: 0.1458  5/125 [>.............................] - ETA: 57s - batch_cost: 0.3589 - reader cost: 0.1577 6/125 [>.............................] - ETA: 54s - batch_cost: 0.3596 - reader cost: 0.1497 7/125 [>.............................] - ETA: 53s - batch_cost: 0.3688 - reader cost: 0.1536 8/125 [>.............................] - ETA: 53s - batch_cost: 0.3791 - reader cost: 0.1596 9/125 [=>............................] - ETA: 52s - batch_cost: 0.3841 - reader cost: 0.1616 10/125 [=>............................] - ETA: 51s - batch_cost: 0.3892 - reader cost: 0.1633 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3910 - reader cost: 0.1630 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3896 - reader cost: 0.1585 13/125 [==>...........................] - ETA: 49s - batch_cost: 0.3924 - reader cost: 0.1595 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3904 - reader cost: 0.1563 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3929 - reader cost: 0.1573 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3969 - reader cost: 0.1603 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3986 - reader cost: 0.1608 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.3987 - reader cost: 0.1594 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.4003 - reader cost: 0.1601 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4023 - reader cost: 0.1616 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4001 - reader cost: 0.1589 22/125 [====>.........................] - ETA: 43s - batch_cost: 0.3990 - reader cost: 0.1573 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4002 - reader cost: 0.1582 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4023 - reader cost: 0.1599 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4041 - reader cost: 0.1613 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4052 - reader cost: 0.1621 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4056 - reader cost: 0.1618 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4074 - reader cost: 0.1631 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4092 - reader cost: 0.1645 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4098 - reader cost: 0.1645 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4092 - reader cost: 0.1636 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4105 - reader cost: 0.1646 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4109 - reader cost: 0.1650 34/125 [=======>......................] - ETA: 39s - batch_cost: 0.4120 - reader cost: 0.1658 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4121 - reader cost: 0.1657 36/125 [=======>......................] - ETA: 38s - batch_cost: 0.4116 - reader cost: 0.1651 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4119 - reader cost: 0.1653 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4123 - reader cost: 0.1655 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4125 - reader cost: 0.1656 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4136 - reader cost: 0.1665 41/125 [========>.....................] - ETA: 36s - batch_cost: 0.4141 - reader cost: 0.1667 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4142 - reader cost: 0.1664 43/125 [=========>....................] - ETA: 35s - batch_cost: 0.4141 - reader cost: 0.1663 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4144 - reader cost: 0.1664 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4148 - reader cost: 0.1667 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4155 - reader cost: 0.1671 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4163 - reader cost: 0.1676 48/125 [==========>...................] - ETA: 33s - batch_cost: 0.4163 - reader cost: 0.1676 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4165 - reader cost: 0.1676 50/125 [===========>..................] - ETA: 32s - batch_cost: 0.4167 - reader cost: 0.1678 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4177 - reader cost: 0.1687 52/125 [===========>..................] - ETA: 31s - batch_cost: 0.4179 - reader cost: 0.1688 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4180 - reader cost: 0.1688 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4179 - reader cost: 0.1685 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4176 - reader cost: 0.1682 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4171 - reader cost: 0.1677 57/125 [============>.................] - ETA: 29s - batch_cost: 0.4168 - reader cost: 0.1674 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4162 - reader cost: 0.1667 59/125 [=============>................] - ETA: 28s - batch_cost: 0.4166 - reader cost: 0.1668 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4161 - reader cost: 0.1662 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4169 - reader cost: 0.1667 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4170 - reader cost: 0.1666 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4164 - reader cost: 0.1658 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4169 - reader cost: 0.1664 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4172 - reader cost: 0.1666 66/125 [==============>...............] - ETA: 25s - batch_cost: 0.4174 - reader cost: 0.1668 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4177 - reader cost: 0.1670 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4174 - reader cost: 0.1667 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4175 - reader cost: 0.1668 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4177 - reader cost: 0.1670 71/125 [================>.............] - ETA: 23s - batch_cost: 0.4178 - reader cost: 0.1671 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4172 - reader cost: 0.1664 73/125 [================>.............] - ETA: 22s - batch_cost: 0.4167 - reader cost: 0.1659 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4169 - reader cost: 0.1661 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4171 - reader cost: 0.1663 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4169 - reader cost: 0.1656 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4173 - reader cost: 0.1658 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4169 - reader cost: 0.1654 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4170 - reader cost: 0.1656 80/125 [==================>...........] - ETA: 19s - batch_cost: 0.4172 - reader cost: 0.1658 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4173 - reader cost: 0.1660 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4168 - reader cost: 0.1655 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4169 - reader cost: 0.1656 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4171 - reader cost: 0.1658 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4165 - reader cost: 0.1651 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4161 - reader cost: 0.1646 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4161 - reader cost: 0.1646 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4165 - reader cost: 0.1649 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4161 - reader cost: 0.1643 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4159 - reader cost: 0.1642 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4160 - reader cost: 0.1643 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4159 - reader cost: 0.1642 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4155 - reader cost: 0.1637 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4157 - reader cost: 0.1639 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4153 - reader cost: 0.1635 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4151 - reader cost: 0.1632 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4153 - reader cost: 0.1633 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4154 - reader cost: 0.1634 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4152 - reader cost: 0.1632 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4154 - reader cost: 0.1634 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4151 - reader cost: 0.1631 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4148 - reader cost: 0.1629  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4150 - reader cost: 0.1631 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4152 - reader cost: 0.1633 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4151 - reader cost: 0.1628 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4153 - reader cost: 0.1630 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4151 - reader cost: 0.1627 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4155 - reader cost: 0.1630 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4155 - reader cost: 0.1625 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4152 - reader cost: 0.1620 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4153 - reader cost: 0.1619 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4153 - reader cost: 0.1619 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4156 - reader cost: 0.1622 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4159 - reader cost: 0.1625 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4159 - reader cost: 0.1625 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4161 - reader cost: 0.1626 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4162 - reader cost: 0.1626 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4162 - reader cost: 0.1627 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4162 - reader cost: 0.1627 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4162 - reader cost: 0.1627 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4164 - reader cost: 0.1629 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4164 - reader cost: 0.1630 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4165 - reader cost: 0.1630 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4166 - reader cost: 0.1632 125/125 [==============================] - 53s 421ms/step - batch_cost: 0.4163 - reader cost: 0.1629 2021-02-23 04:42:22 [INFO] [EVAL] #Images=500 mIoU=0.7103 Acc=0.9505 Kappa=0.9357 2021-02-23 04:42:22 [INFO] [EVAL] Class IoU: [0.9718 0.7979 0.9103 0.5163 0.5327 0.6163 0.6722 0.692 0.9161 0.5765 0.9441 0.7971 0.5835 0.9262 0.6306 0.5872 0.4943 0.5625 0.7686] 2021-02-23 04:42:22 [INFO] [EVAL] Class Acc: [0.9862 0.8755 0.9526 0.6944 0.8486 0.8005 0.8968 0.9484 0.946 0.7302 0.9679 0.8909 0.6955 0.9476 0.7249 0.9674 0.9458 0.6808 0.8656] 2021-02-23 04:42:26 [INFO] [EVAL] The model with the best validation mIoU (0.7384) was saved at iter 26000. 2021-02-23 04:42:40 [INFO] [TRAIN] epoch=73, iter=27010/80000, loss=0.9298, lr=0.006902, batch_cost=1.3484, reader_cost=0.0001 | ETA 19:50:53 2021-02-23 04:42:53 [INFO] [TRAIN] epoch=73, iter=27020/80000, loss=0.8535, lr=0.006901, batch_cost=1.3590, reader_cost=0.0001 | ETA 20:00:00 2021-02-23 04:43:07 [INFO] [TRAIN] epoch=73, iter=27030/80000, loss=1.0404, lr=0.006900, batch_cost=1.3615, reader_cost=0.0001 | ETA 20:01:59 2021-02-23 04:43:21 [INFO] [TRAIN] epoch=73, iter=27040/80000, loss=0.8805, lr=0.006899, batch_cost=1.3645, reader_cost=0.0001 | ETA 20:04:21 2021-02-23 04:43:34 [INFO] [TRAIN] epoch=73, iter=27050/80000, loss=1.0061, lr=0.006898, batch_cost=1.3598, reader_cost=0.0001 | ETA 20:00:01 2021-02-23 04:43:48 [INFO] [TRAIN] epoch=73, iter=27060/80000, loss=0.9975, lr=0.006897, batch_cost=1.3540, reader_cost=0.0001 | ETA 19:54:43 2021-02-23 04:44:02 [INFO] [TRAIN] epoch=73, iter=27070/80000, loss=0.8728, lr=0.006895, batch_cost=1.3727, reader_cost=0.0001 | ETA 20:10:58 2021-02-23 04:44:15 [INFO] [TRAIN] epoch=73, iter=27080/80000, loss=0.8707, lr=0.006894, batch_cost=1.3496, reader_cost=0.0001 | ETA 19:50:23 2021-02-23 04:44:29 [INFO] [TRAIN] epoch=73, iter=27090/80000, loss=0.8695, lr=0.006893, batch_cost=1.3535, reader_cost=0.0001 | ETA 19:53:33 2021-02-23 04:44:42 [INFO] [TRAIN] epoch=73, iter=27100/80000, loss=1.0612, lr=0.006892, batch_cost=1.3544, reader_cost=0.0001 | ETA 19:54:05 2021-02-23 04:44:56 [INFO] [TRAIN] epoch=73, iter=27110/80000, loss=0.8586, lr=0.006891, batch_cost=1.3935, reader_cost=0.0001 | ETA 20:28:19 2021-02-23 04:45:10 [INFO] [TRAIN] epoch=73, iter=27120/80000, loss=0.8565, lr=0.006890, batch_cost=1.3476, reader_cost=0.0001 | ETA 19:47:41 2021-02-23 04:45:23 [INFO] [TRAIN] epoch=73, iter=27130/80000, loss=0.9269, lr=0.006888, batch_cost=1.3293, reader_cost=0.0001 | ETA 19:31:18 2021-02-23 04:45:36 [INFO] [TRAIN] epoch=73, iter=27140/80000, loss=0.9898, lr=0.006887, batch_cost=1.3550, reader_cost=0.0001 | ETA 19:53:45 2021-02-23 04:45:50 [INFO] [TRAIN] epoch=73, iter=27150/80000, loss=0.8197, lr=0.006886, batch_cost=1.3729, reader_cost=0.0001 | ETA 20:09:17 2021-02-23 04:46:04 [INFO] [TRAIN] epoch=74, iter=27160/80000, loss=0.8478, lr=0.006885, batch_cost=1.4275, reader_cost=0.0694 | ETA 20:57:06 2021-02-23 04:46:18 [INFO] [TRAIN] epoch=74, iter=27170/80000, loss=0.8701, lr=0.006884, batch_cost=1.3839, reader_cost=0.0001 | ETA 20:18:33 2021-02-23 04:46:32 [INFO] [TRAIN] epoch=74, iter=27180/80000, loss=0.9409, lr=0.006882, batch_cost=1.3682, reader_cost=0.0001 | ETA 20:04:28 2021-02-23 04:46:46 [INFO] [TRAIN] epoch=74, iter=27190/80000, loss=0.9109, lr=0.006881, batch_cost=1.3710, reader_cost=0.0001 | ETA 20:06:41 2021-02-23 04:46:59 [INFO] [TRAIN] epoch=74, iter=27200/80000, loss=0.8920, lr=0.006880, batch_cost=1.3554, reader_cost=0.0001 | ETA 19:52:45 2021-02-23 04:47:13 [INFO] [TRAIN] epoch=74, iter=27210/80000, loss=0.8412, lr=0.006879, batch_cost=1.3621, reader_cost=0.0001 | ETA 19:58:26 2021-02-23 04:47:26 [INFO] [TRAIN] epoch=74, iter=27220/80000, loss=0.9203, lr=0.006878, batch_cost=1.3637, reader_cost=0.0001 | ETA 19:59:36 2021-02-23 04:47:40 [INFO] [TRAIN] epoch=74, iter=27230/80000, loss=0.8165, lr=0.006877, batch_cost=1.3734, reader_cost=0.0001 | ETA 20:07:55 2021-02-23 04:47:54 [INFO] [TRAIN] epoch=74, iter=27240/80000, loss=0.9978, lr=0.006875, batch_cost=1.3418, reader_cost=0.0001 | ETA 19:39:52 2021-02-23 04:48:07 [INFO] [TRAIN] epoch=74, iter=27250/80000, loss=0.9848, lr=0.006874, batch_cost=1.3593, reader_cost=0.0001 | ETA 19:55:04 2021-02-23 04:48:21 [INFO] [TRAIN] epoch=74, iter=27260/80000, loss=1.1625, lr=0.006873, batch_cost=1.3575, reader_cost=0.0001 | ETA 19:53:14 2021-02-23 04:48:34 [INFO] [TRAIN] epoch=74, iter=27270/80000, loss=0.9297, lr=0.006872, batch_cost=1.3571, reader_cost=0.0001 | ETA 19:52:39 2021-02-23 04:48:48 [INFO] [TRAIN] epoch=74, iter=27280/80000, loss=0.9215, lr=0.006871, batch_cost=1.3499, reader_cost=0.0001 | ETA 19:46:06 2021-02-23 04:49:02 [INFO] [TRAIN] epoch=74, iter=27290/80000, loss=0.9991, lr=0.006870, batch_cost=1.3824, reader_cost=0.0001 | ETA 20:14:26 2021-02-23 04:49:15 [INFO] [TRAIN] epoch=74, iter=27300/80000, loss=0.9560, lr=0.006868, batch_cost=1.3459, reader_cost=0.0001 | ETA 19:42:10 2021-02-23 04:49:28 [INFO] [TRAIN] epoch=74, iter=27310/80000, loss=0.8763, lr=0.006867, batch_cost=1.3383, reader_cost=0.0001 | ETA 19:35:14 2021-02-23 04:49:42 [INFO] [TRAIN] epoch=74, iter=27320/80000, loss=0.9043, lr=0.006866, batch_cost=1.3854, reader_cost=0.0001 | ETA 20:16:22 2021-02-23 04:49:56 [INFO] [TRAIN] epoch=74, iter=27330/80000, loss=0.8319, lr=0.006865, batch_cost=1.3757, reader_cost=0.0001 | ETA 20:07:38 2021-02-23 04:50:10 [INFO] [TRAIN] epoch=74, iter=27340/80000, loss=0.9074, lr=0.006864, batch_cost=1.3598, reader_cost=0.0001 | ETA 19:53:26 2021-02-23 04:50:23 [INFO] [TRAIN] epoch=74, iter=27350/80000, loss=1.0340, lr=0.006863, batch_cost=1.3566, reader_cost=0.0001 | ETA 19:50:22 2021-02-23 04:50:37 [INFO] [TRAIN] epoch=74, iter=27360/80000, loss=0.9306, lr=0.006861, batch_cost=1.3582, reader_cost=0.0001 | ETA 19:51:35 2021-02-23 04:50:50 [INFO] [TRAIN] epoch=74, iter=27370/80000, loss=0.9343, lr=0.006860, batch_cost=1.3632, reader_cost=0.0001 | ETA 19:55:47 2021-02-23 04:51:04 [INFO] [TRAIN] epoch=74, iter=27380/80000, loss=0.8776, lr=0.006859, batch_cost=1.3728, reader_cost=0.0001 | ETA 20:03:55 2021-02-23 04:51:18 [INFO] [TRAIN] epoch=74, iter=27390/80000, loss=0.9409, lr=0.006858, batch_cost=1.3641, reader_cost=0.0001 | ETA 19:56:06 2021-02-23 04:51:31 [INFO] [TRAIN] epoch=74, iter=27400/80000, loss=0.8822, lr=0.006857, batch_cost=1.3652, reader_cost=0.0001 | ETA 19:56:49 2021-02-23 04:51:45 [INFO] [TRAIN] epoch=74, iter=27410/80000, loss=0.9128, lr=0.006856, batch_cost=1.3424, reader_cost=0.0001 | ETA 19:36:34 2021-02-23 04:51:58 [INFO] [TRAIN] epoch=74, iter=27420/80000, loss=0.9455, lr=0.006854, batch_cost=1.3557, reader_cost=0.0001 | ETA 19:48:00 2021-02-23 04:52:12 [INFO] [TRAIN] epoch=74, iter=27430/80000, loss=0.9574, lr=0.006853, batch_cost=1.3524, reader_cost=0.0001 | ETA 19:44:55 2021-02-23 04:52:26 [INFO] [TRAIN] epoch=74, iter=27440/80000, loss=0.8271, lr=0.006852, batch_cost=1.3695, reader_cost=0.0001 | ETA 19:59:40 2021-02-23 04:52:39 [INFO] [TRAIN] epoch=74, iter=27450/80000, loss=0.8936, lr=0.006851, batch_cost=1.3642, reader_cost=0.0001 | ETA 19:54:47 2021-02-23 04:52:53 [INFO] [TRAIN] epoch=74, iter=27460/80000, loss=0.9074, lr=0.006850, batch_cost=1.3458, reader_cost=0.0001 | ETA 19:38:30 2021-02-23 04:53:06 [INFO] [TRAIN] epoch=74, iter=27470/80000, loss=1.0185, lr=0.006848, batch_cost=1.3366, reader_cost=0.0001 | ETA 19:30:10 2021-02-23 04:53:20 [INFO] [TRAIN] epoch=74, iter=27480/80000, loss=0.8917, lr=0.006847, batch_cost=1.3554, reader_cost=0.0001 | ETA 19:46:27 2021-02-23 04:53:33 [INFO] [TRAIN] epoch=74, iter=27490/80000, loss=0.9347, lr=0.006846, batch_cost=1.3713, reader_cost=0.0001 | ETA 20:00:06 2021-02-23 04:53:47 [INFO] [TRAIN] epoch=74, iter=27500/80000, loss=0.9470, lr=0.006845, batch_cost=1.3609, reader_cost=0.0001 | ETA 19:50:45 2021-02-23 04:54:01 [INFO] [TRAIN] epoch=74, iter=27510/80000, loss=0.8306, lr=0.006844, batch_cost=1.3559, reader_cost=0.0001 | ETA 19:46:08 2021-02-23 04:54:14 [INFO] [TRAIN] epoch=74, iter=27520/80000, loss=0.8493, lr=0.006843, batch_cost=1.3487, reader_cost=0.0001 | ETA 19:39:41 2021-02-23 04:54:28 [INFO] [TRAIN] epoch=75, iter=27530/80000, loss=0.9523, lr=0.006841, batch_cost=1.4269, reader_cost=0.0841 | ETA 20:47:46 2021-02-23 04:54:42 [INFO] [TRAIN] epoch=75, iter=27540/80000, loss=1.0315, lr=0.006840, batch_cost=1.3855, reader_cost=0.0001 | ETA 20:11:25 2021-02-23 04:54:56 [INFO] [TRAIN] epoch=75, iter=27550/80000, loss=0.9732, lr=0.006839, batch_cost=1.3764, reader_cost=0.0001 | ETA 20:03:10 2021-02-23 04:55:10 [INFO] [TRAIN] epoch=75, iter=27560/80000, loss=0.8960, lr=0.006838, batch_cost=1.3676, reader_cost=0.0001 | ETA 19:55:16 2021-02-23 04:55:23 [INFO] [TRAIN] epoch=75, iter=27570/80000, loss=0.8645, lr=0.006837, batch_cost=1.3587, reader_cost=0.0001 | ETA 19:47:15 2021-02-23 04:55:37 [INFO] [TRAIN] epoch=75, iter=27580/80000, loss=0.9799, lr=0.006836, batch_cost=1.3709, reader_cost=0.0001 | ETA 19:57:40 2021-02-23 04:55:51 [INFO] [TRAIN] epoch=75, iter=27590/80000, loss=0.9355, lr=0.006834, batch_cost=1.3771, reader_cost=0.0001 | ETA 20:02:52 2021-02-23 04:56:05 [INFO] [TRAIN] epoch=75, iter=27600/80000, loss=0.9264, lr=0.006833, batch_cost=1.3856, reader_cost=0.0001 | ETA 20:10:04 2021-02-23 04:56:18 [INFO] [TRAIN] epoch=75, iter=27610/80000, loss=0.8408, lr=0.006832, batch_cost=1.3924, reader_cost=0.0001 | ETA 20:15:47 2021-02-23 04:56:32 [INFO] [TRAIN] epoch=75, iter=27620/80000, loss=0.9164, lr=0.006831, batch_cost=1.3456, reader_cost=0.0001 | ETA 19:34:43 2021-02-23 04:56:45 [INFO] [TRAIN] epoch=75, iter=27630/80000, loss=0.9274, lr=0.006830, batch_cost=1.3558, reader_cost=0.0001 | ETA 19:43:21 2021-02-23 04:56:59 [INFO] [TRAIN] epoch=75, iter=27640/80000, loss=0.9078, lr=0.006829, batch_cost=1.3431, reader_cost=0.0001 | ETA 19:32:03 2021-02-23 04:57:13 [INFO] [TRAIN] epoch=75, iter=27650/80000, loss=0.9356, lr=0.006827, batch_cost=1.3666, reader_cost=0.0001 | ETA 19:52:20 2021-02-23 04:57:26 [INFO] [TRAIN] epoch=75, iter=27660/80000, loss=0.8407, lr=0.006826, batch_cost=1.3574, reader_cost=0.0001 | ETA 19:44:04 2021-02-23 04:57:40 [INFO] [TRAIN] epoch=75, iter=27670/80000, loss=0.8945, lr=0.006825, batch_cost=1.3913, reader_cost=0.0001 | ETA 20:13:25 2021-02-23 04:57:54 [INFO] [TRAIN] epoch=75, iter=27680/80000, loss=0.8314, lr=0.006824, batch_cost=1.3421, reader_cost=0.0001 | ETA 19:30:18 2021-02-23 04:58:07 [INFO] [TRAIN] epoch=75, iter=27690/80000, loss=0.8977, lr=0.006823, batch_cost=1.3484, reader_cost=0.0001 | ETA 19:35:35 2021-02-23 04:58:21 [INFO] [TRAIN] epoch=75, iter=27700/80000, loss=0.8381, lr=0.006821, batch_cost=1.3770, reader_cost=0.0001 | ETA 20:00:18 2021-02-23 04:58:35 [INFO] [TRAIN] epoch=75, iter=27710/80000, loss=0.8668, lr=0.006820, batch_cost=1.3931, reader_cost=0.0001 | ETA 20:14:05 2021-02-23 04:58:48 [INFO] [TRAIN] epoch=75, iter=27720/80000, loss=0.9599, lr=0.006819, batch_cost=1.3463, reader_cost=0.0001 | ETA 19:33:02 2021-02-23 04:59:02 [INFO] [TRAIN] epoch=75, iter=27730/80000, loss=0.8313, lr=0.006818, batch_cost=1.3510, reader_cost=0.0001 | ETA 19:36:54 2021-02-23 04:59:15 [INFO] [TRAIN] epoch=75, iter=27740/80000, loss=0.8841, lr=0.006817, batch_cost=1.3498, reader_cost=0.0001 | ETA 19:35:42 2021-02-23 04:59:29 [INFO] [TRAIN] epoch=75, iter=27750/80000, loss=0.9305, lr=0.006816, batch_cost=1.3497, reader_cost=0.0001 | ETA 19:35:21 2021-02-23 04:59:42 [INFO] [TRAIN] epoch=75, iter=27760/80000, loss=0.8881, lr=0.006814, batch_cost=1.3581, reader_cost=0.0001 | ETA 19:42:25 2021-02-23 04:59:56 [INFO] [TRAIN] epoch=75, iter=27770/80000, loss=0.9131, lr=0.006813, batch_cost=1.3759, reader_cost=0.0001 | ETA 19:57:45 2021-02-23 05:00:10 [INFO] [TRAIN] epoch=75, iter=27780/80000, loss=0.8758, lr=0.006812, batch_cost=1.3688, reader_cost=0.0001 | ETA 19:51:18 2021-02-23 05:00:23 [INFO] [TRAIN] epoch=75, iter=27790/80000, loss=0.9447, lr=0.006811, batch_cost=1.3653, reader_cost=0.0001 | ETA 19:48:00 2021-02-23 05:00:37 [INFO] [TRAIN] epoch=75, iter=27800/80000, loss=0.9375, lr=0.006810, batch_cost=1.3514, reader_cost=0.0001 | ETA 19:35:45 2021-02-23 05:00:51 [INFO] [TRAIN] epoch=75, iter=27810/80000, loss=0.7934, lr=0.006809, batch_cost=1.4085, reader_cost=0.0001 | ETA 20:25:11 2021-02-23 05:01:05 [INFO] [TRAIN] epoch=75, iter=27820/80000, loss=0.8242, lr=0.006807, batch_cost=1.3688, reader_cost=0.0001 | ETA 19:50:25 2021-02-23 05:01:18 [INFO] [TRAIN] epoch=75, iter=27830/80000, loss=0.9924, lr=0.006806, batch_cost=1.3370, reader_cost=0.0001 | ETA 19:22:32 2021-02-23 05:01:32 [INFO] [TRAIN] epoch=75, iter=27840/80000, loss=0.9497, lr=0.006805, batch_cost=1.3848, reader_cost=0.0001 | ETA 20:03:52 2021-02-23 05:01:45 [INFO] [TRAIN] epoch=75, iter=27850/80000, loss=0.8940, lr=0.006804, batch_cost=1.3333, reader_cost=0.0001 | ETA 19:18:52 2021-02-23 05:01:59 [INFO] [TRAIN] epoch=75, iter=27860/80000, loss=0.9508, lr=0.006803, batch_cost=1.3717, reader_cost=0.0001 | ETA 19:52:01 2021-02-23 05:02:12 [INFO] [TRAIN] epoch=75, iter=27870/80000, loss=0.9212, lr=0.006802, batch_cost=1.3442, reader_cost=0.0001 | ETA 19:27:51 2021-02-23 05:02:26 [INFO] [TRAIN] epoch=75, iter=27880/80000, loss=0.9615, lr=0.006800, batch_cost=1.3513, reader_cost=0.0001 | ETA 19:33:50 2021-02-23 05:02:40 [INFO] [TRAIN] epoch=75, iter=27890/80000, loss=0.8758, lr=0.006799, batch_cost=1.3648, reader_cost=0.0001 | ETA 19:45:17 2021-02-23 05:02:53 [INFO] [TRAIN] epoch=75, iter=27900/80000, loss=1.1454, lr=0.006798, batch_cost=1.3224, reader_cost=0.0001 | ETA 19:08:18 2021-02-23 05:03:08 [INFO] [TRAIN] epoch=76, iter=27910/80000, loss=0.8925, lr=0.006797, batch_cost=1.5145, reader_cost=0.0858 | ETA 21:54:49 2021-02-23 05:03:21 [INFO] [TRAIN] epoch=76, iter=27920/80000, loss=0.9134, lr=0.006796, batch_cost=1.3179, reader_cost=0.0001 | ETA 19:03:58 2021-02-23 05:03:35 [INFO] [TRAIN] epoch=76, iter=27930/80000, loss=0.8629, lr=0.006794, batch_cost=1.3762, reader_cost=0.0001 | ETA 19:54:20 2021-02-23 05:03:49 [INFO] [TRAIN] epoch=76, iter=27940/80000, loss=0.9504, lr=0.006793, batch_cost=1.3879, reader_cost=0.0001 | ETA 20:04:16 2021-02-23 05:04:02 [INFO] [TRAIN] epoch=76, iter=27950/80000, loss=0.9211, lr=0.006792, batch_cost=1.3653, reader_cost=0.0001 | ETA 19:44:24 2021-02-23 05:04:16 [INFO] [TRAIN] epoch=76, iter=27960/80000, loss=0.9589, lr=0.006791, batch_cost=1.3595, reader_cost=0.0001 | ETA 19:39:09 2021-02-23 05:04:30 [INFO] [TRAIN] epoch=76, iter=27970/80000, loss=0.9023, lr=0.006790, batch_cost=1.3627, reader_cost=0.0001 | ETA 19:41:43 2021-02-23 05:04:43 [INFO] [TRAIN] epoch=76, iter=27980/80000, loss=0.8047, lr=0.006789, batch_cost=1.3583, reader_cost=0.0001 | ETA 19:37:41 2021-02-23 05:04:57 [INFO] [TRAIN] epoch=76, iter=27990/80000, loss=0.9615, lr=0.006787, batch_cost=1.3699, reader_cost=0.0001 | ETA 19:47:29 2021-02-23 05:05:10 [INFO] [TRAIN] epoch=76, iter=28000/80000, loss=0.9082, lr=0.006786, batch_cost=1.3615, reader_cost=0.0001 | ETA 19:40:00 2021-02-23 05:05:11 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:18 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:04 - batch_cost: 0.2125 - reader cost: 0.0887  3/125 [..............................] - ETA: 59s - batch_cost: 0.2788 - reader cost: 0.1128  4/125 [..............................] - ETA: 57s - batch_cost: 0.3187 - reader cost: 0.1295 5/125 [>.............................] - ETA: 56s - batch_cost: 0.3453 - reader cost: 0.1441 6/125 [>.............................] - ETA: 55s - batch_cost: 0.3578 - reader cost: 0.1486 7/125 [>.............................] - ETA: 53s - batch_cost: 0.3629 - reader cost: 0.1461 8/125 [>.............................] - ETA: 52s - batch_cost: 0.3699 - reader cost: 0.1481 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3754 - reader cost: 0.1455 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3767 - reader cost: 0.1448 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3822 - reader cost: 0.1486 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3854 - reader cost: 0.1505 13/125 [==>...........................] - ETA: 49s - batch_cost: 0.3904 - reader cost: 0.1531 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3883 - reader cost: 0.1492 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3926 - reader cost: 0.1509 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3944 - reader cost: 0.1489 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3955 - reader cost: 0.1471 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.3980 - reader cost: 0.1497 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3977 - reader cost: 0.1491 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.3991 - reader cost: 0.1483 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4007 - reader cost: 0.1469 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4031 - reader cost: 0.1485 23/125 [====>.........................] - ETA: 44s - batch_cost: 0.4042 - reader cost: 0.1498 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4062 - reader cost: 0.1519 25/125 [=====>........................] - ETA: 43s - batch_cost: 0.4080 - reader cost: 0.1540 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4073 - reader cost: 0.1533 27/125 [=====>........................] - ETA: 42s - batch_cost: 0.4086 - reader cost: 0.1548 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4104 - reader cost: 0.1566 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4114 - reader cost: 0.1575 30/125 [======>.......................] - ETA: 41s - batch_cost: 0.4119 - reader cost: 0.1578 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4125 - reader cost: 0.1585 32/125 [======>.......................] - ETA: 40s - batch_cost: 0.4141 - reader cost: 0.1602 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4150 - reader cost: 0.1610 34/125 [=======>......................] - ETA: 39s - batch_cost: 0.4172 - reader cost: 0.1631 35/125 [=======>......................] - ETA: 39s - batch_cost: 0.4178 - reader cost: 0.1637 36/125 [=======>......................] - ETA: 38s - batch_cost: 0.4184 - reader cost: 0.1645 37/125 [=======>......................] - ETA: 38s - batch_cost: 0.4189 - reader cost: 0.1650 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4195 - reader cost: 0.1657 39/125 [========>.....................] - ETA: 37s - batch_cost: 0.4200 - reader cost: 0.1662 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4189 - reader cost: 0.1652 41/125 [========>.....................] - ETA: 36s - batch_cost: 0.4181 - reader cost: 0.1643 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4171 - reader cost: 0.1633 43/125 [=========>....................] - ETA: 35s - batch_cost: 0.4167 - reader cost: 0.1629 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4160 - reader cost: 0.1622 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4155 - reader cost: 0.1618 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4158 - reader cost: 0.1621 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4158 - reader cost: 0.1623 48/125 [==========>...................] - ETA: 33s - batch_cost: 0.4156 - reader cost: 0.1615 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4157 - reader cost: 0.1616 50/125 [===========>..................] - ETA: 32s - batch_cost: 0.4161 - reader cost: 0.1621 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4154 - reader cost: 0.1615 52/125 [===========>..................] - ETA: 31s - batch_cost: 0.4155 - reader cost: 0.1616 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4156 - reader cost: 0.1606 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4157 - reader cost: 0.1605 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4162 - reader cost: 0.1612 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4166 - reader cost: 0.1615 57/125 [============>.................] - ETA: 29s - batch_cost: 0.4169 - reader cost: 0.1619 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4168 - reader cost: 0.1618 59/125 [=============>................] - ETA: 28s - batch_cost: 0.4170 - reader cost: 0.1621 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4165 - reader cost: 0.1617 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4167 - reader cost: 0.1620 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4169 - reader cost: 0.1622 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4160 - reader cost: 0.1614 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4163 - reader cost: 0.1618 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4166 - reader cost: 0.1621 66/125 [==============>...............] - ETA: 25s - batch_cost: 0.4171 - reader cost: 0.1625 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4171 - reader cost: 0.1625 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4173 - reader cost: 0.1628 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4174 - reader cost: 0.1630 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4178 - reader cost: 0.1632 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4168 - reader cost: 0.1622 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4160 - reader cost: 0.1615 73/125 [================>.............] - ETA: 22s - batch_cost: 0.4160 - reader cost: 0.1615 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4157 - reader cost: 0.1613 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4158 - reader cost: 0.1614 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4155 - reader cost: 0.1609 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4156 - reader cost: 0.1611 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4159 - reader cost: 0.1612 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4157 - reader cost: 0.1611 80/125 [==================>...........] - ETA: 19s - batch_cost: 0.4160 - reader cost: 0.1613 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4155 - reader cost: 0.1609 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4150 - reader cost: 0.1604 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4151 - reader cost: 0.1606 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4153 - reader cost: 0.1608 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4154 - reader cost: 0.1610 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4150 - reader cost: 0.1606 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4150 - reader cost: 0.1607 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4147 - reader cost: 0.1602 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4148 - reader cost: 0.1598 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4152 - reader cost: 0.1597 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4154 - reader cost: 0.1591 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4150 - reader cost: 0.1587 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4151 - reader cost: 0.1589 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4150 - reader cost: 0.1589 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4149 - reader cost: 0.1586 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4151 - reader cost: 0.1589 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4152 - reader cost: 0.1590 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4154 - reader cost: 0.1592 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4159 - reader cost: 0.1597 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4162 - reader cost: 0.1600 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4163 - reader cost: 0.1602 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4166 - reader cost: 0.1604  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4160 - reader cost: 0.1600 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4158 - reader cost: 0.1598 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4161 - reader cost: 0.1601 106/125 [========================>.....] - ETA: 8s - batch_cost: 0.4164 - reader cost: 0.1605 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4164 - reader cost: 0.1606 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4161 - reader cost: 0.1603 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4162 - reader cost: 0.1604 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4164 - reader cost: 0.1606 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4166 - reader cost: 0.1608 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4163 - reader cost: 0.1605 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4164 - reader cost: 0.1606 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4165 - reader cost: 0.1608 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4166 - reader cost: 0.1608 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4168 - reader cost: 0.1611 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4172 - reader cost: 0.1614 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4173 - reader cost: 0.1615 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4171 - reader cost: 0.1614 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4173 - reader cost: 0.1616 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4174 - reader cost: 0.1617 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4177 - reader cost: 0.1620 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4179 - reader cost: 0.1622 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4181 - reader cost: 0.1624 125/125 [==============================] - 53s 423ms/step - batch_cost: 0.4182 - reader cost: 0.1625 2021-02-23 05:06:03 [INFO] [EVAL] #Images=500 mIoU=0.6811 Acc=0.9476 Kappa=0.9320 2021-02-23 05:06:03 [INFO] [EVAL] Class IoU: [0.9748 0.8185 0.8984 0.4488 0.4988 0.6169 0.688 0.7865 0.9127 0.5045 0.9439 0.7946 0.587 0.9392 0.6829 0.6055 0.1359 0.3536 0.7509] 2021-02-23 05:06:03 [INFO] [EVAL] Class Acc: [0.9851 0.8991 0.9459 0.7989 0.7118 0.8311 0.8727 0.9024 0.9473 0.8923 0.971 0.8495 0.752 0.9681 0.8271 0.9732 0.1371 0.9221 0.893 ] 2021-02-23 05:06:08 [INFO] [EVAL] The model with the best validation mIoU (0.7384) was saved at iter 26000. 2021-02-23 05:06:21 [INFO] [TRAIN] epoch=76, iter=28010/80000, loss=0.9010, lr=0.006785, batch_cost=1.3337, reader_cost=0.0001 | ETA 19:15:40 2021-02-23 05:06:35 [INFO] [TRAIN] epoch=76, iter=28020/80000, loss=0.9374, lr=0.006784, batch_cost=1.3536, reader_cost=0.0001 | ETA 19:32:39 2021-02-23 05:06:48 [INFO] [TRAIN] epoch=76, iter=28030/80000, loss=0.9172, lr=0.006783, batch_cost=1.3950, reader_cost=0.0001 | ETA 20:08:18 2021-02-23 05:07:02 [INFO] [TRAIN] epoch=76, iter=28040/80000, loss=0.9936, lr=0.006782, batch_cost=1.3835, reader_cost=0.0001 | ETA 19:58:07 2021-02-23 05:07:16 [INFO] [TRAIN] epoch=76, iter=28050/80000, loss=0.9097, lr=0.006780, batch_cost=1.3484, reader_cost=0.0001 | ETA 19:27:30 2021-02-23 05:07:29 [INFO] [TRAIN] epoch=76, iter=28060/80000, loss=0.9713, lr=0.006779, batch_cost=1.3441, reader_cost=0.0001 | ETA 19:23:34 2021-02-23 05:07:43 [INFO] [TRAIN] epoch=76, iter=28070/80000, loss=0.8919, lr=0.006778, batch_cost=1.3452, reader_cost=0.0001 | ETA 19:24:14 2021-02-23 05:07:56 [INFO] [TRAIN] epoch=76, iter=28080/80000, loss=0.9575, lr=0.006777, batch_cost=1.3376, reader_cost=0.0001 | ETA 19:17:29 2021-02-23 05:08:10 [INFO] [TRAIN] epoch=76, iter=28090/80000, loss=0.9247, lr=0.006776, batch_cost=1.3738, reader_cost=0.0001 | ETA 19:48:36 2021-02-23 05:08:23 [INFO] [TRAIN] epoch=76, iter=28100/80000, loss=1.0082, lr=0.006774, batch_cost=1.3446, reader_cost=0.0001 | ETA 19:23:04 2021-02-23 05:08:37 [INFO] [TRAIN] epoch=76, iter=28110/80000, loss=0.9139, lr=0.006773, batch_cost=1.3712, reader_cost=0.0001 | ETA 19:45:53 2021-02-23 05:08:51 [INFO] [TRAIN] epoch=76, iter=28120/80000, loss=0.8947, lr=0.006772, batch_cost=1.3732, reader_cost=0.0001 | ETA 19:47:19 2021-02-23 05:09:04 [INFO] [TRAIN] epoch=76, iter=28130/80000, loss=0.8416, lr=0.006771, batch_cost=1.3598, reader_cost=0.0001 | ETA 19:35:33 2021-02-23 05:09:18 [INFO] [TRAIN] epoch=76, iter=28140/80000, loss=0.9839, lr=0.006770, batch_cost=1.3771, reader_cost=0.0001 | ETA 19:50:17 2021-02-23 05:09:32 [INFO] [TRAIN] epoch=76, iter=28150/80000, loss=0.9480, lr=0.006769, batch_cost=1.3757, reader_cost=0.0001 | ETA 19:48:50 2021-02-23 05:09:46 [INFO] [TRAIN] epoch=76, iter=28160/80000, loss=0.8930, lr=0.006767, batch_cost=1.3760, reader_cost=0.0001 | ETA 19:48:49 2021-02-23 05:09:59 [INFO] [TRAIN] epoch=76, iter=28170/80000, loss=0.8790, lr=0.006766, batch_cost=1.3657, reader_cost=0.0001 | ETA 19:39:42 2021-02-23 05:10:13 [INFO] [TRAIN] epoch=76, iter=28180/80000, loss=0.8735, lr=0.006765, batch_cost=1.3376, reader_cost=0.0001 | ETA 19:15:11 2021-02-23 05:10:26 [INFO] [TRAIN] epoch=76, iter=28190/80000, loss=0.8568, lr=0.006764, batch_cost=1.3656, reader_cost=0.0001 | ETA 19:39:11 2021-02-23 05:10:40 [INFO] [TRAIN] epoch=76, iter=28200/80000, loss=0.8833, lr=0.006763, batch_cost=1.3476, reader_cost=0.0001 | ETA 19:23:28 2021-02-23 05:10:53 [INFO] [TRAIN] epoch=76, iter=28210/80000, loss=0.8335, lr=0.006762, batch_cost=1.3572, reader_cost=0.0001 | ETA 19:31:29 2021-02-23 05:11:07 [INFO] [TRAIN] epoch=76, iter=28220/80000, loss=0.8816, lr=0.006760, batch_cost=1.3290, reader_cost=0.0001 | ETA 19:06:56 2021-02-23 05:11:20 [INFO] [TRAIN] epoch=76, iter=28230/80000, loss=0.8857, lr=0.006759, batch_cost=1.3566, reader_cost=0.0001 | ETA 19:30:29 2021-02-23 05:11:33 [INFO] [TRAIN] epoch=76, iter=28240/80000, loss=0.9521, lr=0.006758, batch_cost=1.3262, reader_cost=0.0001 | ETA 19:04:05 2021-02-23 05:11:47 [INFO] [TRAIN] epoch=76, iter=28250/80000, loss=0.8640, lr=0.006757, batch_cost=1.3607, reader_cost=0.0001 | ETA 19:33:37 2021-02-23 05:12:01 [INFO] [TRAIN] epoch=76, iter=28260/80000, loss=0.8276, lr=0.006756, batch_cost=1.3986, reader_cost=0.0001 | ETA 20:06:01 2021-02-23 05:12:14 [INFO] [TRAIN] epoch=76, iter=28270/80000, loss=0.9080, lr=0.006755, batch_cost=1.3377, reader_cost=0.0001 | ETA 19:13:19 2021-02-23 05:12:29 [INFO] [TRAIN] epoch=77, iter=28280/80000, loss=0.8770, lr=0.006753, batch_cost=1.4504, reader_cost=0.0840 | ETA 20:50:17 2021-02-23 05:12:42 [INFO] [TRAIN] epoch=77, iter=28290/80000, loss=0.9630, lr=0.006752, batch_cost=1.3564, reader_cost=0.0001 | ETA 19:28:57 2021-02-23 05:12:56 [INFO] [TRAIN] epoch=77, iter=28300/80000, loss=1.0146, lr=0.006751, batch_cost=1.3820, reader_cost=0.0001 | ETA 19:50:51 2021-02-23 05:13:10 [INFO] [TRAIN] epoch=77, iter=28310/80000, loss=0.8408, lr=0.006750, batch_cost=1.3514, reader_cost=0.0001 | ETA 19:24:11 2021-02-23 05:13:23 [INFO] [TRAIN] epoch=77, iter=28320/80000, loss=0.8738, lr=0.006749, batch_cost=1.3608, reader_cost=0.0001 | ETA 19:32:05 2021-02-23 05:13:37 [INFO] [TRAIN] epoch=77, iter=28330/80000, loss=0.8420, lr=0.006747, batch_cost=1.3568, reader_cost=0.0001 | ETA 19:28:27 2021-02-23 05:13:51 [INFO] [TRAIN] epoch=77, iter=28340/80000, loss=1.0226, lr=0.006746, batch_cost=1.3703, reader_cost=0.0001 | ETA 19:39:50 2021-02-23 05:14:04 [INFO] [TRAIN] epoch=77, iter=28350/80000, loss=1.0735, lr=0.006745, batch_cost=1.3765, reader_cost=0.0001 | ETA 19:44:58 2021-02-23 05:14:18 [INFO] [TRAIN] epoch=77, iter=28360/80000, loss=0.8300, lr=0.006744, batch_cost=1.3565, reader_cost=0.0001 | ETA 19:27:27 2021-02-23 05:14:32 [INFO] [TRAIN] epoch=77, iter=28370/80000, loss=0.9259, lr=0.006743, batch_cost=1.3640, reader_cost=0.0001 | ETA 19:33:43 2021-02-23 05:14:45 [INFO] [TRAIN] epoch=77, iter=28380/80000, loss=1.0827, lr=0.006742, batch_cost=1.3407, reader_cost=0.0001 | ETA 19:13:27 2021-02-23 05:14:59 [INFO] [TRAIN] epoch=77, iter=28390/80000, loss=0.9383, lr=0.006740, batch_cost=1.3489, reader_cost=0.0001 | ETA 19:20:17 2021-02-23 05:15:12 [INFO] [TRAIN] epoch=77, iter=28400/80000, loss=0.8629, lr=0.006739, batch_cost=1.3521, reader_cost=0.0001 | ETA 19:22:50 2021-02-23 05:15:26 [INFO] [TRAIN] epoch=77, iter=28410/80000, loss=0.8437, lr=0.006738, batch_cost=1.3495, reader_cost=0.0001 | ETA 19:20:22 2021-02-23 05:15:39 [INFO] [TRAIN] epoch=77, iter=28420/80000, loss=0.8508, lr=0.006737, batch_cost=1.3599, reader_cost=0.0001 | ETA 19:29:03 2021-02-23 05:15:53 [INFO] [TRAIN] epoch=77, iter=28430/80000, loss=1.0110, lr=0.006736, batch_cost=1.3342, reader_cost=0.0001 | ETA 19:06:44 2021-02-23 05:16:06 [INFO] [TRAIN] epoch=77, iter=28440/80000, loss=0.8497, lr=0.006735, batch_cost=1.3679, reader_cost=0.0001 | ETA 19:35:29 2021-02-23 05:16:20 [INFO] [TRAIN] epoch=77, iter=28450/80000, loss=0.8538, lr=0.006733, batch_cost=1.3524, reader_cost=0.0001 | ETA 19:21:55 2021-02-23 05:16:33 [INFO] [TRAIN] epoch=77, iter=28460/80000, loss=0.9071, lr=0.006732, batch_cost=1.3524, reader_cost=0.0001 | ETA 19:21:43 2021-02-23 05:16:47 [INFO] [TRAIN] epoch=77, iter=28470/80000, loss=0.9963, lr=0.006731, batch_cost=1.3466, reader_cost=0.0001 | ETA 19:16:30 2021-02-23 05:17:00 [INFO] [TRAIN] epoch=77, iter=28480/80000, loss=0.8558, lr=0.006730, batch_cost=1.3680, reader_cost=0.0001 | ETA 19:34:41 2021-02-23 05:17:14 [INFO] [TRAIN] epoch=77, iter=28490/80000, loss=0.9260, lr=0.006729, batch_cost=1.3655, reader_cost=0.0001 | ETA 19:32:15 2021-02-23 05:17:28 [INFO] [TRAIN] epoch=77, iter=28500/80000, loss=0.9920, lr=0.006727, batch_cost=1.3459, reader_cost=0.0001 | ETA 19:15:14 2021-02-23 05:17:41 [INFO] [TRAIN] epoch=77, iter=28510/80000, loss=0.8106, lr=0.006726, batch_cost=1.3555, reader_cost=0.0001 | ETA 19:23:17 2021-02-23 05:17:55 [INFO] [TRAIN] epoch=77, iter=28520/80000, loss=0.7964, lr=0.006725, batch_cost=1.3631, reader_cost=0.0001 | ETA 19:29:32 2021-02-23 05:18:08 [INFO] [TRAIN] epoch=77, iter=28530/80000, loss=0.8718, lr=0.006724, batch_cost=1.3491, reader_cost=0.0001 | ETA 19:17:19 2021-02-23 05:18:22 [INFO] [TRAIN] epoch=77, iter=28540/80000, loss=0.8879, lr=0.006723, batch_cost=1.3926, reader_cost=0.0001 | ETA 19:54:25 2021-02-23 05:18:36 [INFO] [TRAIN] epoch=77, iter=28550/80000, loss=0.9234, lr=0.006722, batch_cost=1.3404, reader_cost=0.0001 | ETA 19:09:21 2021-02-23 05:18:49 [INFO] [TRAIN] epoch=77, iter=28560/80000, loss=0.8366, lr=0.006720, batch_cost=1.3387, reader_cost=0.0001 | ETA 19:07:42 2021-02-23 05:19:02 [INFO] [TRAIN] epoch=77, iter=28570/80000, loss=0.9478, lr=0.006719, batch_cost=1.3551, reader_cost=0.0001 | ETA 19:21:32 2021-02-23 05:19:16 [INFO] [TRAIN] epoch=77, iter=28580/80000, loss=1.0589, lr=0.006718, batch_cost=1.3593, reader_cost=0.0001 | ETA 19:24:53 2021-02-23 05:19:30 [INFO] [TRAIN] epoch=77, iter=28590/80000, loss=0.9489, lr=0.006717, batch_cost=1.3750, reader_cost=0.0001 | ETA 19:38:07 2021-02-23 05:19:43 [INFO] [TRAIN] epoch=77, iter=28600/80000, loss=0.8540, lr=0.006716, batch_cost=1.3358, reader_cost=0.0001 | ETA 19:04:21 2021-02-23 05:19:57 [INFO] [TRAIN] epoch=77, iter=28610/80000, loss=0.9002, lr=0.006715, batch_cost=1.3547, reader_cost=0.0001 | ETA 19:20:18 2021-02-23 05:20:10 [INFO] [TRAIN] epoch=77, iter=28620/80000, loss=0.8587, lr=0.006713, batch_cost=1.3607, reader_cost=0.0001 | ETA 19:25:14 2021-02-23 05:20:24 [INFO] [TRAIN] epoch=77, iter=28630/80000, loss=1.0894, lr=0.006712, batch_cost=1.3617, reader_cost=0.0001 | ETA 19:25:49 2021-02-23 05:20:38 [INFO] [TRAIN] epoch=77, iter=28640/80000, loss=0.8618, lr=0.006711, batch_cost=1.3568, reader_cost=0.0001 | ETA 19:21:25 2021-02-23 05:20:52 [INFO] [TRAIN] epoch=78, iter=28650/80000, loss=0.8791, lr=0.006710, batch_cost=1.4262, reader_cost=0.0718 | ETA 20:20:35 2021-02-23 05:21:05 [INFO] [TRAIN] epoch=78, iter=28660/80000, loss=0.8811, lr=0.006709, batch_cost=1.3419, reader_cost=0.0001 | ETA 19:08:10 2021-02-23 05:21:19 [INFO] [TRAIN] epoch=78, iter=28670/80000, loss=0.9783, lr=0.006708, batch_cost=1.3776, reader_cost=0.0001 | ETA 19:38:33 2021-02-23 05:21:33 [INFO] [TRAIN] epoch=78, iter=28680/80000, loss=0.9066, lr=0.006706, batch_cost=1.3673, reader_cost=0.0001 | ETA 19:29:31 2021-02-23 05:21:46 [INFO] [TRAIN] epoch=78, iter=28690/80000, loss=0.8912, lr=0.006705, batch_cost=1.3463, reader_cost=0.0001 | ETA 19:11:17 2021-02-23 05:22:00 [INFO] [TRAIN] epoch=78, iter=28700/80000, loss=0.8293, lr=0.006704, batch_cost=1.3524, reader_cost=0.0001 | ETA 19:16:16 2021-02-23 05:22:13 [INFO] [TRAIN] epoch=78, iter=28710/80000, loss=0.8213, lr=0.006703, batch_cost=1.3361, reader_cost=0.0001 | ETA 19:02:09 2021-02-23 05:22:27 [INFO] [TRAIN] epoch=78, iter=28720/80000, loss=0.9119, lr=0.006702, batch_cost=1.3770, reader_cost=0.0001 | ETA 19:36:54 2021-02-23 05:22:40 [INFO] [TRAIN] epoch=78, iter=28730/80000, loss=0.9270, lr=0.006700, batch_cost=1.3560, reader_cost=0.0001 | ETA 19:18:41 2021-02-23 05:22:54 [INFO] [TRAIN] epoch=78, iter=28740/80000, loss=0.9204, lr=0.006699, batch_cost=1.3525, reader_cost=0.0001 | ETA 19:15:27 2021-02-23 05:23:08 [INFO] [TRAIN] epoch=78, iter=28750/80000, loss=0.9059, lr=0.006698, batch_cost=1.3827, reader_cost=0.0001 | ETA 19:41:03 2021-02-23 05:23:21 [INFO] [TRAIN] epoch=78, iter=28760/80000, loss=0.8150, lr=0.006697, batch_cost=1.3503, reader_cost=0.0001 | ETA 19:13:11 2021-02-23 05:23:35 [INFO] [TRAIN] epoch=78, iter=28770/80000, loss=0.9654, lr=0.006696, batch_cost=1.3608, reader_cost=0.0001 | ETA 19:21:51 2021-02-23 05:23:48 [INFO] [TRAIN] epoch=78, iter=28780/80000, loss=0.9466, lr=0.006695, batch_cost=1.3420, reader_cost=0.0001 | ETA 19:05:38 2021-02-23 05:24:02 [INFO] [TRAIN] epoch=78, iter=28790/80000, loss=0.8439, lr=0.006693, batch_cost=1.3652, reader_cost=0.0001 | ETA 19:25:13 2021-02-23 05:24:16 [INFO] [TRAIN] epoch=78, iter=28800/80000, loss=0.8858, lr=0.006692, batch_cost=1.3814, reader_cost=0.0001 | ETA 19:38:50 2021-02-23 05:24:29 [INFO] [TRAIN] epoch=78, iter=28810/80000, loss=0.8397, lr=0.006691, batch_cost=1.3753, reader_cost=0.0001 | ETA 19:33:22 2021-02-23 05:24:43 [INFO] [TRAIN] epoch=78, iter=28820/80000, loss=0.9609, lr=0.006690, batch_cost=1.3473, reader_cost=0.0001 | ETA 19:09:16 2021-02-23 05:24:57 [INFO] [TRAIN] epoch=78, iter=28830/80000, loss=0.8611, lr=0.006689, batch_cost=1.3615, reader_cost=0.0001 | ETA 19:21:07 2021-02-23 05:25:10 [INFO] [TRAIN] epoch=78, iter=28840/80000, loss=0.8640, lr=0.006688, batch_cost=1.3725, reader_cost=0.0001 | ETA 19:30:18 2021-02-23 05:25:24 [INFO] [TRAIN] epoch=78, iter=28850/80000, loss=0.8855, lr=0.006686, batch_cost=1.3444, reader_cost=0.0001 | ETA 19:06:08 2021-02-23 05:25:37 [INFO] [TRAIN] epoch=78, iter=28860/80000, loss=0.8457, lr=0.006685, batch_cost=1.3738, reader_cost=0.0001 | ETA 19:30:55 2021-02-23 05:25:51 [INFO] [TRAIN] epoch=78, iter=28870/80000, loss=0.8939, lr=0.006684, batch_cost=1.3422, reader_cost=0.0001 | ETA 19:03:48 2021-02-23 05:26:05 [INFO] [TRAIN] epoch=78, iter=28880/80000, loss=0.8880, lr=0.006683, batch_cost=1.3724, reader_cost=0.0001 | ETA 19:29:17 2021-02-23 05:26:18 [INFO] [TRAIN] epoch=78, iter=28890/80000, loss=0.8583, lr=0.006682, batch_cost=1.3375, reader_cost=0.0001 | ETA 18:59:20 2021-02-23 05:26:32 [INFO] [TRAIN] epoch=78, iter=28900/80000, loss=1.0063, lr=0.006680, batch_cost=1.3560, reader_cost=0.0001 | ETA 19:14:50 2021-02-23 05:26:45 [INFO] [TRAIN] epoch=78, iter=28910/80000, loss=0.9128, lr=0.006679, batch_cost=1.3643, reader_cost=0.0001 | ETA 19:21:43 2021-02-23 05:26:59 [INFO] [TRAIN] epoch=78, iter=28920/80000, loss=0.9113, lr=0.006678, batch_cost=1.3638, reader_cost=0.0001 | ETA 19:21:02 2021-02-23 05:27:12 [INFO] [TRAIN] epoch=78, iter=28930/80000, loss=0.8986, lr=0.006677, batch_cost=1.3684, reader_cost=0.0001 | ETA 19:24:46 2021-02-23 05:27:26 [INFO] [TRAIN] epoch=78, iter=28940/80000, loss=0.8848, lr=0.006676, batch_cost=1.3573, reader_cost=0.0001 | ETA 19:15:01 2021-02-23 05:27:39 [INFO] [TRAIN] epoch=78, iter=28950/80000, loss=0.8718, lr=0.006675, batch_cost=1.3389, reader_cost=0.0001 | ETA 18:59:11 2021-02-23 05:27:53 [INFO] [TRAIN] epoch=78, iter=28960/80000, loss=0.8844, lr=0.006673, batch_cost=1.3434, reader_cost=0.0001 | ETA 19:02:48 2021-02-23 05:28:06 [INFO] [TRAIN] epoch=78, iter=28970/80000, loss=1.0838, lr=0.006672, batch_cost=1.3535, reader_cost=0.0001 | ETA 19:11:09 2021-02-23 05:28:20 [INFO] [TRAIN] epoch=78, iter=28980/80000, loss=0.9112, lr=0.006671, batch_cost=1.3793, reader_cost=0.0001 | ETA 19:32:50 2021-02-23 05:28:34 [INFO] [TRAIN] epoch=78, iter=28990/80000, loss=0.9436, lr=0.006670, batch_cost=1.3733, reader_cost=0.0001 | ETA 19:27:31 2021-02-23 05:28:48 [INFO] [TRAIN] epoch=78, iter=29000/80000, loss=0.9742, lr=0.006669, batch_cost=1.3588, reader_cost=0.0001 | ETA 19:15:00 2021-02-23 05:28:48 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:13 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:03 - batch_cost: 0.2245 - reader cost: 0.0994  3/125 [..............................] - ETA: 57s - batch_cost: 0.2768 - reader cost: 0.1088  4/125 [..............................] - ETA: 55s - batch_cost: 0.3071 - reader cost: 0.1116 5/125 [>.............................] - ETA: 54s - batch_cost: 0.3329 - reader cost: 0.1176 6/125 [>.............................] - ETA: 53s - batch_cost: 0.3510 - reader cost: 0.1294 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3635 - reader cost: 0.1351 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3649 - reader cost: 0.1338 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3742 - reader cost: 0.1390 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3770 - reader cost: 0.1403 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3795 - reader cost: 0.1412 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3852 - reader cost: 0.1457 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3909 - reader cost: 0.1500 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3949 - reader cost: 0.1533 15/125 [==>...........................] - ETA: 48s - batch_cost: 0.3972 - reader cost: 0.1546 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3995 - reader cost: 0.1563 17/125 [===>..........................] - ETA: 47s - batch_cost: 0.4022 - reader cost: 0.1586 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.4041 - reader cost: 0.1598 19/125 [===>..........................] - ETA: 46s - batch_cost: 0.4030 - reader cost: 0.1584 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4047 - reader cost: 0.1593 21/125 [====>.........................] - ETA: 45s - batch_cost: 0.4060 - reader cost: 0.1598 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4068 - reader cost: 0.1603 23/125 [====>.........................] - ETA: 44s - batch_cost: 0.4078 - reader cost: 0.1611 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4088 - reader cost: 0.1617 25/125 [=====>........................] - ETA: 43s - batch_cost: 0.4076 - reader cost: 0.1604 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4086 - reader cost: 0.1611 27/125 [=====>........................] - ETA: 42s - batch_cost: 0.4094 - reader cost: 0.1619 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4106 - reader cost: 0.1628 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4116 - reader cost: 0.1636 30/125 [======>.......................] - ETA: 41s - batch_cost: 0.4123 - reader cost: 0.1643 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4128 - reader cost: 0.1645 32/125 [======>.......................] - ETA: 40s - batch_cost: 0.4125 - reader cost: 0.1641 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4118 - reader cost: 0.1633 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4104 - reader cost: 0.1617 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4091 - reader cost: 0.1605 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4097 - reader cost: 0.1611 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4090 - reader cost: 0.1604 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4097 - reader cost: 0.1610 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4103 - reader cost: 0.1613 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4107 - reader cost: 0.1616 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4113 - reader cost: 0.1622 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4115 - reader cost: 0.1621 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4123 - reader cost: 0.1628 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4126 - reader cost: 0.1630 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4120 - reader cost: 0.1625 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4119 - reader cost: 0.1622 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4123 - reader cost: 0.1625 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4112 - reader cost: 0.1614 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4118 - reader cost: 0.1619 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4121 - reader cost: 0.1621 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4126 - reader cost: 0.1625 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4132 - reader cost: 0.1631 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4126 - reader cost: 0.1624 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4117 - reader cost: 0.1616 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4112 - reader cost: 0.1607 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4100 - reader cost: 0.1594 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4093 - reader cost: 0.1587 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4096 - reader cost: 0.1591 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4100 - reader cost: 0.1594 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4099 - reader cost: 0.1590 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4103 - reader cost: 0.1594 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4105 - reader cost: 0.1593 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4101 - reader cost: 0.1588 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4105 - reader cost: 0.1584 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4099 - reader cost: 0.1573 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4103 - reader cost: 0.1577 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4107 - reader cost: 0.1576 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4111 - reader cost: 0.1569 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4118 - reader cost: 0.1563 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4123 - reader cost: 0.1557 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4120 - reader cost: 0.1553 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4122 - reader cost: 0.1556 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4120 - reader cost: 0.1553 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4126 - reader cost: 0.1560 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4129 - reader cost: 0.1564 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4133 - reader cost: 0.1568 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4134 - reader cost: 0.1570 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4136 - reader cost: 0.1572 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4136 - reader cost: 0.1572 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4138 - reader cost: 0.1574 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4140 - reader cost: 0.1576 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4145 - reader cost: 0.1574 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4150 - reader cost: 0.1569 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4149 - reader cost: 0.1562 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4150 - reader cost: 0.1564 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4153 - reader cost: 0.1568 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4155 - reader cost: 0.1570 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4150 - reader cost: 0.1565 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4146 - reader cost: 0.1563 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4150 - reader cost: 0.1567 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4152 - reader cost: 0.1570 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4146 - reader cost: 0.1565 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4148 - reader cost: 0.1569 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4152 - reader cost: 0.1573 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4147 - reader cost: 0.1569 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4145 - reader cost: 0.1566 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4146 - reader cost: 0.1568 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4148 - reader cost: 0.1570 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4147 - reader cost: 0.1567 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4149 - reader cost: 0.1570 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4151 - reader cost: 0.1567 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4148 - reader cost: 0.1563  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4149 - reader cost: 0.1561 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4151 - reader cost: 0.1561 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4153 - reader cost: 0.1565 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4154 - reader cost: 0.1564 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4156 - reader cost: 0.1566 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4157 - reader cost: 0.1568 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4157 - reader cost: 0.1569 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4160 - reader cost: 0.1571 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4156 - reader cost: 0.1567 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4157 - reader cost: 0.1569 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4152 - reader cost: 0.1566 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4153 - reader cost: 0.1568 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4154 - reader cost: 0.1569 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4151 - reader cost: 0.1567 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4152 - reader cost: 0.1565 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4155 - reader cost: 0.1567 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4157 - reader cost: 0.1570 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4158 - reader cost: 0.1572 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4161 - reader cost: 0.1575 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4161 - reader cost: 0.1575 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4164 - reader cost: 0.1579 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4164 - reader cost: 0.1579 125/125 [==============================] - 53s 421ms/step - batch_cost: 0.4166 - reader cost: 0.1582 2021-02-23 05:29:40 [INFO] [EVAL] #Images=500 mIoU=0.6696 Acc=0.9476 Kappa=0.9317 2021-02-23 05:29:40 [INFO] [EVAL] Class IoU: [0.9779 0.8294 0.8867 0.2889 0.2917 0.5861 0.5968 0.7344 0.9135 0.5797 0.9401 0.7659 0.4913 0.9319 0.4971 0.725 0.6324 0.3469 0.7074] 2021-02-23 05:29:40 [INFO] [EVAL] Class Acc: [0.9858 0.9185 0.906 0.848 0.8916 0.8508 0.9012 0.9404 0.9577 0.7164 0.963 0.8155 0.6901 0.9721 0.9546 0.8118 0.9327 0.868 0.9078] 2021-02-23 05:29:44 [INFO] [EVAL] The model with the best validation mIoU (0.7384) was saved at iter 26000. 2021-02-23 05:29:58 [INFO] [TRAIN] epoch=78, iter=29010/80000, loss=0.9560, lr=0.006668, batch_cost=1.3242, reader_cost=0.0001 | ETA 18:45:18 2021-02-23 05:30:12 [INFO] [TRAIN] epoch=79, iter=29020/80000, loss=1.0711, lr=0.006666, batch_cost=1.4063, reader_cost=0.0779 | ETA 19:54:50 2021-02-23 05:30:25 [INFO] [TRAIN] epoch=79, iter=29030/80000, loss=0.9100, lr=0.006665, batch_cost=1.3693, reader_cost=0.0001 | ETA 19:23:13 2021-02-23 05:30:39 [INFO] [TRAIN] epoch=79, iter=29040/80000, loss=0.9048, lr=0.006664, batch_cost=1.3478, reader_cost=0.0001 | ETA 19:04:46 2021-02-23 05:30:52 [INFO] [TRAIN] epoch=79, iter=29050/80000, loss=1.0760, lr=0.006663, batch_cost=1.3686, reader_cost=0.0001 | ETA 19:22:10 2021-02-23 05:31:06 [INFO] [TRAIN] epoch=79, iter=29060/80000, loss=0.8969, lr=0.006662, batch_cost=1.3505, reader_cost=0.0001 | ETA 19:06:32 2021-02-23 05:31:19 [INFO] [TRAIN] epoch=79, iter=29070/80000, loss=0.9041, lr=0.006660, batch_cost=1.3450, reader_cost=0.0001 | ETA 19:01:39 2021-02-23 05:31:33 [INFO] [TRAIN] epoch=79, iter=29080/80000, loss=0.8825, lr=0.006659, batch_cost=1.3632, reader_cost=0.0001 | ETA 19:16:53 2021-02-23 05:31:46 [INFO] [TRAIN] epoch=79, iter=29090/80000, loss=0.9239, lr=0.006658, batch_cost=1.3363, reader_cost=0.0001 | ETA 18:53:53 2021-02-23 05:32:00 [INFO] [TRAIN] epoch=79, iter=29100/80000, loss=0.8556, lr=0.006657, batch_cost=1.3503, reader_cost=0.0001 | ETA 19:05:28 2021-02-23 05:32:13 [INFO] [TRAIN] epoch=79, iter=29110/80000, loss=0.9005, lr=0.006656, batch_cost=1.3469, reader_cost=0.0001 | ETA 19:02:23 2021-02-23 05:32:27 [INFO] [TRAIN] epoch=79, iter=29120/80000, loss=0.9334, lr=0.006655, batch_cost=1.3716, reader_cost=0.0001 | ETA 19:23:05 2021-02-23 05:32:41 [INFO] [TRAIN] epoch=79, iter=29130/80000, loss=0.9651, lr=0.006653, batch_cost=1.3508, reader_cost=0.0001 | ETA 19:05:14 2021-02-23 05:32:54 [INFO] [TRAIN] epoch=79, iter=29140/80000, loss=0.8205, lr=0.006652, batch_cost=1.3658, reader_cost=0.0001 | ETA 19:17:46 2021-02-23 05:33:08 [INFO] [TRAIN] epoch=79, iter=29150/80000, loss=0.9027, lr=0.006651, batch_cost=1.3313, reader_cost=0.0001 | ETA 18:48:17 2021-02-23 05:33:21 [INFO] [TRAIN] epoch=79, iter=29160/80000, loss=0.8570, lr=0.006650, batch_cost=1.3468, reader_cost=0.0001 | ETA 19:01:13 2021-02-23 05:33:35 [INFO] [TRAIN] epoch=79, iter=29170/80000, loss=0.8384, lr=0.006649, batch_cost=1.3429, reader_cost=0.0001 | ETA 18:57:38 2021-02-23 05:33:48 [INFO] [TRAIN] epoch=79, iter=29180/80000, loss=0.8217, lr=0.006647, batch_cost=1.3558, reader_cost=0.0001 | ETA 19:08:21 2021-02-23 05:34:02 [INFO] [TRAIN] epoch=79, iter=29190/80000, loss=1.0376, lr=0.006646, batch_cost=1.3824, reader_cost=0.0001 | ETA 19:30:37 2021-02-23 05:34:15 [INFO] [TRAIN] epoch=79, iter=29200/80000, loss=0.9454, lr=0.006645, batch_cost=1.3445, reader_cost=0.0001 | ETA 18:58:18 2021-02-23 05:34:29 [INFO] [TRAIN] epoch=79, iter=29210/80000, loss=0.9911, lr=0.006644, batch_cost=1.3437, reader_cost=0.0001 | ETA 18:57:26 2021-02-23 05:34:43 [INFO] [TRAIN] epoch=79, iter=29220/80000, loss=0.9208, lr=0.006643, batch_cost=1.4091, reader_cost=0.0001 | ETA 19:52:32 2021-02-23 05:34:56 [INFO] [TRAIN] epoch=79, iter=29230/80000, loss=1.0172, lr=0.006642, batch_cost=1.3536, reader_cost=0.0001 | ETA 19:05:21 2021-02-23 05:35:10 [INFO] [TRAIN] epoch=79, iter=29240/80000, loss=0.8829, lr=0.006640, batch_cost=1.3676, reader_cost=0.0001 | ETA 19:16:58 2021-02-23 05:35:24 [INFO] [TRAIN] epoch=79, iter=29250/80000, loss=0.8837, lr=0.006639, batch_cost=1.3526, reader_cost=0.0001 | ETA 19:04:04 2021-02-23 05:35:38 [INFO] [TRAIN] epoch=79, iter=29260/80000, loss=0.8893, lr=0.006638, batch_cost=1.4035, reader_cost=0.0001 | ETA 19:46:54 2021-02-23 05:35:51 [INFO] [TRAIN] epoch=79, iter=29270/80000, loss=0.9113, lr=0.006637, batch_cost=1.3810, reader_cost=0.0001 | ETA 19:27:38 2021-02-23 05:36:05 [INFO] [TRAIN] epoch=79, iter=29280/80000, loss=0.8749, lr=0.006636, batch_cost=1.3351, reader_cost=0.0001 | ETA 18:48:37 2021-02-23 05:36:18 [INFO] [TRAIN] epoch=79, iter=29290/80000, loss=0.9133, lr=0.006635, batch_cost=1.3593, reader_cost=0.0001 | ETA 19:08:48 2021-02-23 05:36:32 [INFO] [TRAIN] epoch=79, iter=29300/80000, loss=0.9463, lr=0.006633, batch_cost=1.3479, reader_cost=0.0001 | ETA 18:58:59 2021-02-23 05:36:46 [INFO] [TRAIN] epoch=79, iter=29310/80000, loss=0.8696, lr=0.006632, batch_cost=1.3898, reader_cost=0.0001 | ETA 19:34:09 2021-02-23 05:36:59 [INFO] [TRAIN] epoch=79, iter=29320/80000, loss=0.9628, lr=0.006631, batch_cost=1.3702, reader_cost=0.0001 | ETA 19:17:23 2021-02-23 05:37:13 [INFO] [TRAIN] epoch=79, iter=29330/80000, loss=0.8384, lr=0.006630, batch_cost=1.3706, reader_cost=0.0001 | ETA 19:17:28 2021-02-23 05:37:27 [INFO] [TRAIN] epoch=79, iter=29340/80000, loss=0.8935, lr=0.006629, batch_cost=1.3527, reader_cost=0.0001 | ETA 19:02:09 2021-02-23 05:37:40 [INFO] [TRAIN] epoch=79, iter=29350/80000, loss=0.9236, lr=0.006627, batch_cost=1.3640, reader_cost=0.0001 | ETA 19:11:27 2021-02-23 05:37:54 [INFO] [TRAIN] epoch=79, iter=29360/80000, loss=0.9235, lr=0.006626, batch_cost=1.3723, reader_cost=0.0001 | ETA 19:18:10 2021-02-23 05:38:08 [INFO] [TRAIN] epoch=79, iter=29370/80000, loss=0.7964, lr=0.006625, batch_cost=1.3815, reader_cost=0.0001 | ETA 19:25:43 2021-02-23 05:38:21 [INFO] [TRAIN] epoch=79, iter=29380/80000, loss=0.8958, lr=0.006624, batch_cost=1.3519, reader_cost=0.0001 | ETA 19:00:32 2021-02-23 05:38:36 [INFO] [TRAIN] epoch=80, iter=29390/80000, loss=0.8819, lr=0.006623, batch_cost=1.4177, reader_cost=0.0710 | ETA 19:55:48 2021-02-23 05:38:49 [INFO] [TRAIN] epoch=80, iter=29400/80000, loss=0.8694, lr=0.006622, batch_cost=1.3732, reader_cost=0.0002 | ETA 19:18:06 2021-02-23 05:39:03 [INFO] [TRAIN] epoch=80, iter=29410/80000, loss=0.9408, lr=0.006620, batch_cost=1.3516, reader_cost=0.0001 | ETA 18:59:35 2021-02-23 05:39:16 [INFO] [TRAIN] epoch=80, iter=29420/80000, loss=0.8582, lr=0.006619, batch_cost=1.3514, reader_cost=0.0001 | ETA 18:59:15 2021-02-23 05:39:30 [INFO] [TRAIN] epoch=80, iter=29430/80000, loss=0.9051, lr=0.006618, batch_cost=1.3266, reader_cost=0.0001 | ETA 18:38:04 2021-02-23 05:39:43 [INFO] [TRAIN] epoch=80, iter=29440/80000, loss=0.9457, lr=0.006617, batch_cost=1.3691, reader_cost=0.0001 | ETA 19:13:43 2021-02-23 05:39:57 [INFO] [TRAIN] epoch=80, iter=29450/80000, loss=0.9292, lr=0.006616, batch_cost=1.3526, reader_cost=0.0001 | ETA 18:59:34 2021-02-23 05:40:10 [INFO] [TRAIN] epoch=80, iter=29460/80000, loss=1.0088, lr=0.006615, batch_cost=1.3469, reader_cost=0.0001 | ETA 18:54:32 2021-02-23 05:40:24 [INFO] [TRAIN] epoch=80, iter=29470/80000, loss=0.8674, lr=0.006613, batch_cost=1.3539, reader_cost=0.0001 | ETA 19:00:13 2021-02-23 05:40:37 [INFO] [TRAIN] epoch=80, iter=29480/80000, loss=0.9139, lr=0.006612, batch_cost=1.3627, reader_cost=0.0001 | ETA 19:07:24 2021-02-23 05:40:51 [INFO] [TRAIN] epoch=80, iter=29490/80000, loss=0.9768, lr=0.006611, batch_cost=1.3499, reader_cost=0.0001 | ETA 18:56:21 2021-02-23 05:41:05 [INFO] [TRAIN] epoch=80, iter=29500/80000, loss=0.9729, lr=0.006610, batch_cost=1.4092, reader_cost=0.0001 | ETA 19:46:04 2021-02-23 05:41:19 [INFO] [TRAIN] epoch=80, iter=29510/80000, loss=0.8181, lr=0.006609, batch_cost=1.3715, reader_cost=0.0001 | ETA 19:14:05 2021-02-23 05:41:33 [INFO] [TRAIN] epoch=80, iter=29520/80000, loss=0.9832, lr=0.006607, batch_cost=1.3891, reader_cost=0.0001 | ETA 19:28:40 2021-02-23 05:41:46 [INFO] [TRAIN] epoch=80, iter=29530/80000, loss=0.9597, lr=0.006606, batch_cost=1.3465, reader_cost=0.0001 | ETA 18:52:35 2021-02-23 05:41:59 [INFO] [TRAIN] epoch=80, iter=29540/80000, loss=0.9199, lr=0.006605, batch_cost=1.3182, reader_cost=0.0001 | ETA 18:28:36 2021-02-23 05:42:13 [INFO] [TRAIN] epoch=80, iter=29550/80000, loss=0.7920, lr=0.006604, batch_cost=1.3600, reader_cost=0.0001 | ETA 19:03:32 2021-02-23 05:42:27 [INFO] [TRAIN] epoch=80, iter=29560/80000, loss=0.9049, lr=0.006603, batch_cost=1.4166, reader_cost=0.0001 | ETA 19:50:55 2021-02-23 05:42:41 [INFO] [TRAIN] epoch=80, iter=29570/80000, loss=1.0288, lr=0.006602, batch_cost=1.3514, reader_cost=0.0001 | ETA 18:55:49 2021-02-23 05:42:54 [INFO] [TRAIN] epoch=80, iter=29580/80000, loss=0.8770, lr=0.006600, batch_cost=1.3334, reader_cost=0.0001 | ETA 18:40:27 2021-02-23 05:43:08 [INFO] [TRAIN] epoch=80, iter=29590/80000, loss=0.8455, lr=0.006599, batch_cost=1.3957, reader_cost=0.0001 | ETA 19:32:39 2021-02-23 05:43:21 [INFO] [TRAIN] epoch=80, iter=29600/80000, loss=0.8820, lr=0.006598, batch_cost=1.3535, reader_cost=0.0001 | ETA 18:56:54 2021-02-23 05:43:35 [INFO] [TRAIN] epoch=80, iter=29610/80000, loss=0.8617, lr=0.006597, batch_cost=1.3628, reader_cost=0.0001 | ETA 19:04:29 2021-02-23 05:43:49 [INFO] [TRAIN] epoch=80, iter=29620/80000, loss=0.9414, lr=0.006596, batch_cost=1.3823, reader_cost=0.0001 | ETA 19:20:42 2021-02-23 05:44:02 [INFO] [TRAIN] epoch=80, iter=29630/80000, loss=0.8762, lr=0.006594, batch_cost=1.3486, reader_cost=0.0001 | ETA 18:52:06 2021-02-23 05:44:16 [INFO] [TRAIN] epoch=80, iter=29640/80000, loss=0.9500, lr=0.006593, batch_cost=1.3490, reader_cost=0.0001 | ETA 18:52:15 2021-02-23 05:44:29 [INFO] [TRAIN] epoch=80, iter=29650/80000, loss=0.9078, lr=0.006592, batch_cost=1.3627, reader_cost=0.0001 | ETA 19:03:30 2021-02-23 05:44:43 [INFO] [TRAIN] epoch=80, iter=29660/80000, loss=0.8638, lr=0.006591, batch_cost=1.3766, reader_cost=0.0001 | ETA 19:14:55 2021-02-23 05:44:57 [INFO] [TRAIN] epoch=80, iter=29670/80000, loss=0.9059, lr=0.006590, batch_cost=1.3546, reader_cost=0.0001 | ETA 18:56:18 2021-02-23 05:45:10 [INFO] [TRAIN] epoch=80, iter=29680/80000, loss=0.9504, lr=0.006589, batch_cost=1.3658, reader_cost=0.0001 | ETA 19:05:25 2021-02-23 05:45:24 [INFO] [TRAIN] epoch=80, iter=29690/80000, loss=0.8610, lr=0.006587, batch_cost=1.3562, reader_cost=0.0001 | ETA 18:57:09 2021-02-23 05:45:38 [INFO] [TRAIN] epoch=80, iter=29700/80000, loss=0.9077, lr=0.006586, batch_cost=1.3765, reader_cost=0.0001 | ETA 19:14:00 2021-02-23 05:45:52 [INFO] [TRAIN] epoch=80, iter=29710/80000, loss=0.8410, lr=0.006585, batch_cost=1.3887, reader_cost=0.0001 | ETA 19:23:56 2021-02-23 05:46:05 [INFO] [TRAIN] epoch=80, iter=29720/80000, loss=0.8640, lr=0.006584, batch_cost=1.3440, reader_cost=0.0001 | ETA 18:46:15 2021-02-23 05:46:19 [INFO] [TRAIN] epoch=80, iter=29730/80000, loss=0.9614, lr=0.006583, batch_cost=1.3670, reader_cost=0.0001 | ETA 19:05:17 2021-02-23 05:46:32 [INFO] [TRAIN] epoch=80, iter=29740/80000, loss=0.8891, lr=0.006582, batch_cost=1.3595, reader_cost=0.0001 | ETA 18:58:49 2021-02-23 05:46:46 [INFO] [TRAIN] epoch=80, iter=29750/80000, loss=0.8711, lr=0.006580, batch_cost=1.3893, reader_cost=0.0001 | ETA 19:23:30 2021-02-23 05:47:00 [INFO] [TRAIN] epoch=80, iter=29760/80000, loss=0.9357, lr=0.006579, batch_cost=1.3539, reader_cost=0.0001 | ETA 18:53:40 2021-02-23 05:47:15 [INFO] [TRAIN] epoch=81, iter=29770/80000, loss=0.9233, lr=0.006578, batch_cost=1.5329, reader_cost=0.0978 | ETA 21:23:19 2021-02-23 05:47:29 [INFO] [TRAIN] epoch=81, iter=29780/80000, loss=1.0003, lr=0.006577, batch_cost=1.3856, reader_cost=0.0001 | ETA 19:19:45 2021-02-23 05:47:43 [INFO] [TRAIN] epoch=81, iter=29790/80000, loss=0.8737, lr=0.006576, batch_cost=1.3667, reader_cost=0.0001 | ETA 19:03:43 2021-02-23 05:47:56 [INFO] [TRAIN] epoch=81, iter=29800/80000, loss=0.8603, lr=0.006574, batch_cost=1.3640, reader_cost=0.0001 | ETA 19:01:12 2021-02-23 05:48:10 [INFO] [TRAIN] epoch=81, iter=29810/80000, loss=0.8865, lr=0.006573, batch_cost=1.3787, reader_cost=0.0001 | ETA 19:13:15 2021-02-23 05:48:24 [INFO] [TRAIN] epoch=81, iter=29820/80000, loss=0.9585, lr=0.006572, batch_cost=1.3757, reader_cost=0.0001 | ETA 19:10:32 2021-02-23 05:48:38 [INFO] [TRAIN] epoch=81, iter=29830/80000, loss=0.9935, lr=0.006571, batch_cost=1.3926, reader_cost=0.0001 | ETA 19:24:24 2021-02-23 05:48:51 [INFO] [TRAIN] epoch=81, iter=29840/80000, loss=0.8402, lr=0.006570, batch_cost=1.3612, reader_cost=0.0001 | ETA 18:57:58 2021-02-23 05:49:05 [INFO] [TRAIN] epoch=81, iter=29850/80000, loss=0.8594, lr=0.006569, batch_cost=1.3550, reader_cost=0.0001 | ETA 18:52:31 2021-02-23 05:49:19 [INFO] [TRAIN] epoch=81, iter=29860/80000, loss=0.9317, lr=0.006567, batch_cost=1.3888, reader_cost=0.0001 | ETA 19:20:33 2021-02-23 05:49:32 [INFO] [TRAIN] epoch=81, iter=29870/80000, loss=0.9265, lr=0.006566, batch_cost=1.3220, reader_cost=0.0001 | ETA 18:24:34 2021-02-23 05:49:46 [INFO] [TRAIN] epoch=81, iter=29880/80000, loss=0.9982, lr=0.006565, batch_cost=1.3603, reader_cost=0.0001 | ETA 18:56:20 2021-02-23 05:49:59 [INFO] [TRAIN] epoch=81, iter=29890/80000, loss=0.9494, lr=0.006564, batch_cost=1.3596, reader_cost=0.0001 | ETA 18:55:28 2021-02-23 05:50:13 [INFO] [TRAIN] epoch=81, iter=29900/80000, loss=0.9346, lr=0.006563, batch_cost=1.3651, reader_cost=0.0001 | ETA 18:59:51 2021-02-23 05:50:27 [INFO] [TRAIN] epoch=81, iter=29910/80000, loss=0.9088, lr=0.006561, batch_cost=1.3666, reader_cost=0.0001 | ETA 19:00:54 2021-02-23 05:50:40 [INFO] [TRAIN] epoch=81, iter=29920/80000, loss=0.8727, lr=0.006560, batch_cost=1.3425, reader_cost=0.0001 | ETA 18:40:30 2021-02-23 05:50:54 [INFO] [TRAIN] epoch=81, iter=29930/80000, loss=0.8264, lr=0.006559, batch_cost=1.3557, reader_cost=0.0001 | ETA 18:51:20 2021-02-23 05:51:07 [INFO] [TRAIN] epoch=81, iter=29940/80000, loss=0.9288, lr=0.006558, batch_cost=1.3674, reader_cost=0.0001 | ETA 19:00:53 2021-02-23 05:51:21 [INFO] [TRAIN] epoch=81, iter=29950/80000, loss=0.9404, lr=0.006557, batch_cost=1.3532, reader_cost=0.0001 | ETA 18:48:46 2021-02-23 05:51:34 [INFO] [TRAIN] epoch=81, iter=29960/80000, loss=0.9875, lr=0.006556, batch_cost=1.3627, reader_cost=0.0001 | ETA 18:56:30 2021-02-23 05:51:48 [INFO] [TRAIN] epoch=81, iter=29970/80000, loss=0.9198, lr=0.006554, batch_cost=1.3498, reader_cost=0.0001 | ETA 18:45:32 2021-02-23 05:52:01 [INFO] [TRAIN] epoch=81, iter=29980/80000, loss=0.8509, lr=0.006553, batch_cost=1.3507, reader_cost=0.0001 | ETA 18:45:59 2021-02-23 05:52:15 [INFO] [TRAIN] epoch=81, iter=29990/80000, loss=0.8838, lr=0.006552, batch_cost=1.3736, reader_cost=0.0001 | ETA 19:04:56 2021-02-23 05:52:29 [INFO] [TRAIN] epoch=81, iter=30000/80000, loss=0.9236, lr=0.006551, batch_cost=1.3682, reader_cost=0.0001 | ETA 19:00:11 2021-02-23 05:52:29 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:15 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:00 - batch_cost: 0.1897 - reader cost: 0.0591  3/125 [..............................] - ETA: 58s - batch_cost: 0.2737 - reader cost: 0.1025  4/125 [..............................] - ETA: 56s - batch_cost: 0.3141 - reader cost: 0.1229 5/125 [>.............................] - ETA: 55s - batch_cost: 0.3376 - reader cost: 0.1335 6/125 [>.............................] - ETA: 52s - batch_cost: 0.3413 - reader cost: 0.1296 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3540 - reader cost: 0.1369 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3657 - reader cost: 0.1442 9/125 [=>............................] - ETA: 50s - batch_cost: 0.3700 - reader cost: 0.1414 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3746 - reader cost: 0.1402 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3800 - reader cost: 0.1441 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3847 - reader cost: 0.1475 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3837 - reader cost: 0.1449 14/125 [==>...........................] - ETA: 47s - batch_cost: 0.3866 - reader cost: 0.1470 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3895 - reader cost: 0.1490 16/125 [==>...........................] - ETA: 46s - batch_cost: 0.3890 - reader cost: 0.1475 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3915 - reader cost: 0.1494 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3936 - reader cost: 0.1512 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3955 - reader cost: 0.1525 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3978 - reader cost: 0.1539 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4000 - reader cost: 0.1547 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4010 - reader cost: 0.1554 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.3996 - reader cost: 0.1536 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.3993 - reader cost: 0.1531 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.3994 - reader cost: 0.1529 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4009 - reader cost: 0.1539 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4025 - reader cost: 0.1554 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4016 - reader cost: 0.1539 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4012 - reader cost: 0.1529 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4014 - reader cost: 0.1530 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.4027 - reader cost: 0.1539 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4034 - reader cost: 0.1546 33/125 [======>.......................] - ETA: 38s - batch_cost: 0.4041 - reader cost: 0.1552 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4050 - reader cost: 0.1559 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4059 - reader cost: 0.1567 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4065 - reader cost: 0.1569 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4070 - reader cost: 0.1574 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4079 - reader cost: 0.1581 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4086 - reader cost: 0.1587 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4091 - reader cost: 0.1591 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4094 - reader cost: 0.1591 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4104 - reader cost: 0.1601 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4112 - reader cost: 0.1607 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4123 - reader cost: 0.1617 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4119 - reader cost: 0.1612 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4124 - reader cost: 0.1615 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4127 - reader cost: 0.1617 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4118 - reader cost: 0.1608 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4109 - reader cost: 0.1599 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4114 - reader cost: 0.1605 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4117 - reader cost: 0.1607 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4112 - reader cost: 0.1601 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4115 - reader cost: 0.1602 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4118 - reader cost: 0.1606 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4126 - reader cost: 0.1613 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4117 - reader cost: 0.1605 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4122 - reader cost: 0.1607 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4123 - reader cost: 0.1610 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4127 - reader cost: 0.1613 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4130 - reader cost: 0.1616 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4135 - reader cost: 0.1620 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4137 - reader cost: 0.1621 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4132 - reader cost: 0.1617 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4134 - reader cost: 0.1618 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4127 - reader cost: 0.1611 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4121 - reader cost: 0.1605 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4120 - reader cost: 0.1604 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4120 - reader cost: 0.1602 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4120 - reader cost: 0.1602 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4123 - reader cost: 0.1603 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4117 - reader cost: 0.1595 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4118 - reader cost: 0.1596 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4122 - reader cost: 0.1598 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4123 - reader cost: 0.1600 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4128 - reader cost: 0.1602 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4131 - reader cost: 0.1604 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4133 - reader cost: 0.1605 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4138 - reader cost: 0.1610 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4144 - reader cost: 0.1614 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4139 - reader cost: 0.1609 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4139 - reader cost: 0.1609 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4140 - reader cost: 0.1610 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4143 - reader cost: 0.1613 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4145 - reader cost: 0.1616 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4148 - reader cost: 0.1617 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4145 - reader cost: 0.1615 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4148 - reader cost: 0.1617 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4150 - reader cost: 0.1620 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4154 - reader cost: 0.1623 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4151 - reader cost: 0.1620 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4156 - reader cost: 0.1623 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4158 - reader cost: 0.1625 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4160 - reader cost: 0.1627 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4156 - reader cost: 0.1624 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4157 - reader cost: 0.1625 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4159 - reader cost: 0.1627 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4155 - reader cost: 0.1623 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4152 - reader cost: 0.1620 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4151 - reader cost: 0.1617 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4151 - reader cost: 0.1618 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4146 - reader cost: 0.1613 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4147 - reader cost: 0.1615  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4144 - reader cost: 0.1612 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4142 - reader cost: 0.1609 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4143 - reader cost: 0.1610 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4148 - reader cost: 0.1615 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4151 - reader cost: 0.1617 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4148 - reader cost: 0.1615 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4143 - reader cost: 0.1610 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4142 - reader cost: 0.1607 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4139 - reader cost: 0.1605 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4137 - reader cost: 0.1603 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4138 - reader cost: 0.1604 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4142 - reader cost: 0.1608 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4143 - reader cost: 0.1609 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4141 - reader cost: 0.1607 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4143 - reader cost: 0.1609 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4140 - reader cost: 0.1607 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4138 - reader cost: 0.1605 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4136 - reader cost: 0.1603 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4138 - reader cost: 0.1605 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4141 - reader cost: 0.1607 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4145 - reader cost: 0.1611 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4142 - reader cost: 0.1608 125/125 [==============================] - 52s 419ms/step - batch_cost: 0.4141 - reader cost: 0.1608 2021-02-23 05:53:21 [INFO] [EVAL] #Images=500 mIoU=0.7243 Acc=0.9498 Kappa=0.9348 2021-02-23 05:53:21 [INFO] [EVAL] Class IoU: [0.9738 0.7923 0.9069 0.3925 0.482 0.6021 0.699 0.7935 0.9078 0.4559 0.946 0.8124 0.6133 0.9341 0.6402 0.7855 0.7847 0.4775 0.7621] 2021-02-23 05:53:21 [INFO] [EVAL] Class Acc: [0.9888 0.8545 0.9376 0.7835 0.8452 0.7196 0.8779 0.9196 0.9513 0.905 0.9681 0.8878 0.7729 0.958 0.9165 0.842 0.8989 0.6998 0.8833] 2021-02-23 05:53:25 [INFO] [EVAL] The model with the best validation mIoU (0.7384) was saved at iter 26000. 2021-02-23 05:53:39 [INFO] [TRAIN] epoch=81, iter=30010/80000, loss=0.8803, lr=0.006550, batch_cost=1.3730, reader_cost=0.0001 | ETA 19:03:54 2021-02-23 05:53:53 [INFO] [TRAIN] epoch=81, iter=30020/80000, loss=0.9472, lr=0.006549, batch_cost=1.3639, reader_cost=0.0001 | ETA 18:56:06 2021-02-23 05:54:07 [INFO] [TRAIN] epoch=81, iter=30030/80000, loss=0.8762, lr=0.006547, batch_cost=1.3922, reader_cost=0.0001 | ETA 19:19:26 2021-02-23 05:54:20 [INFO] [TRAIN] epoch=81, iter=30040/80000, loss=0.9633, lr=0.006546, batch_cost=1.3498, reader_cost=0.0001 | ETA 18:43:57 2021-02-23 05:54:34 [INFO] [TRAIN] epoch=81, iter=30050/80000, loss=0.8983, lr=0.006545, batch_cost=1.3808, reader_cost=0.0001 | ETA 19:09:28 2021-02-23 05:54:48 [INFO] [TRAIN] epoch=81, iter=30060/80000, loss=0.9036, lr=0.006544, batch_cost=1.3764, reader_cost=0.0001 | ETA 19:05:39 2021-02-23 05:55:01 [INFO] [TRAIN] epoch=81, iter=30070/80000, loss=0.8935, lr=0.006543, batch_cost=1.3629, reader_cost=0.0001 | ETA 18:54:07 2021-02-23 05:55:15 [INFO] [TRAIN] epoch=81, iter=30080/80000, loss=0.8434, lr=0.006541, batch_cost=1.3533, reader_cost=0.0001 | ETA 18:45:56 2021-02-23 05:55:29 [INFO] [TRAIN] epoch=81, iter=30090/80000, loss=0.8911, lr=0.006540, batch_cost=1.3597, reader_cost=0.0001 | ETA 18:51:01 2021-02-23 05:55:43 [INFO] [TRAIN] epoch=81, iter=30100/80000, loss=0.8711, lr=0.006539, batch_cost=1.3975, reader_cost=0.0001 | ETA 19:22:14 2021-02-23 05:55:56 [INFO] [TRAIN] epoch=81, iter=30110/80000, loss=0.9476, lr=0.006538, batch_cost=1.3404, reader_cost=0.0001 | ETA 18:34:34 2021-02-23 05:56:10 [INFO] [TRAIN] epoch=81, iter=30120/80000, loss=0.7778, lr=0.006537, batch_cost=1.3566, reader_cost=0.0001 | ETA 18:47:47 2021-02-23 05:56:23 [INFO] [TRAIN] epoch=81, iter=30130/80000, loss=0.9112, lr=0.006536, batch_cost=1.3271, reader_cost=0.0001 | ETA 18:23:01 2021-02-23 05:56:37 [INFO] [TRAIN] epoch=82, iter=30140/80000, loss=0.9341, lr=0.006534, batch_cost=1.4215, reader_cost=0.0728 | ETA 19:41:17 2021-02-23 05:56:51 [INFO] [TRAIN] epoch=82, iter=30150/80000, loss=0.9058, lr=0.006533, batch_cost=1.3792, reader_cost=0.0001 | ETA 19:05:50 2021-02-23 05:57:04 [INFO] [TRAIN] epoch=82, iter=30160/80000, loss=0.8944, lr=0.006532, batch_cost=1.3645, reader_cost=0.0001 | ETA 18:53:26 2021-02-23 05:57:18 [INFO] [TRAIN] epoch=82, iter=30170/80000, loss=0.8044, lr=0.006531, batch_cost=1.3331, reader_cost=0.0001 | ETA 18:27:09 2021-02-23 05:57:32 [INFO] [TRAIN] epoch=82, iter=30180/80000, loss=0.9319, lr=0.006530, batch_cost=1.3764, reader_cost=0.0001 | ETA 19:02:51 2021-02-23 05:57:45 [INFO] [TRAIN] epoch=82, iter=30190/80000, loss=0.9314, lr=0.006528, batch_cost=1.3676, reader_cost=0.0001 | ETA 18:55:22 2021-02-23 05:57:59 [INFO] [TRAIN] epoch=82, iter=30200/80000, loss=0.8739, lr=0.006527, batch_cost=1.3846, reader_cost=0.0001 | ETA 19:09:13 2021-02-23 05:58:13 [INFO] [TRAIN] epoch=82, iter=30210/80000, loss=1.0517, lr=0.006526, batch_cost=1.3731, reader_cost=0.0001 | ETA 18:59:27 2021-02-23 05:58:26 [INFO] [TRAIN] epoch=82, iter=30220/80000, loss=0.9056, lr=0.006525, batch_cost=1.3598, reader_cost=0.0001 | ETA 18:48:12 2021-02-23 05:58:40 [INFO] [TRAIN] epoch=82, iter=30230/80000, loss=0.8587, lr=0.006524, batch_cost=1.3379, reader_cost=0.0001 | ETA 18:29:45 2021-02-23 05:58:54 [INFO] [TRAIN] epoch=82, iter=30240/80000, loss=0.8742, lr=0.006523, batch_cost=1.3959, reader_cost=0.0001 | ETA 19:17:40 2021-02-23 05:59:07 [INFO] [TRAIN] epoch=82, iter=30250/80000, loss=0.8825, lr=0.006521, batch_cost=1.3393, reader_cost=0.0001 | ETA 18:30:27 2021-02-23 05:59:21 [INFO] [TRAIN] epoch=82, iter=30260/80000, loss=0.8900, lr=0.006520, batch_cost=1.3644, reader_cost=0.0001 | ETA 18:51:04 2021-02-23 05:59:35 [INFO] [TRAIN] epoch=82, iter=30270/80000, loss=0.8752, lr=0.006519, batch_cost=1.3780, reader_cost=0.0001 | ETA 19:02:08 2021-02-23 05:59:48 [INFO] [TRAIN] epoch=82, iter=30280/80000, loss=0.8651, lr=0.006518, batch_cost=1.3586, reader_cost=0.0001 | ETA 18:45:49 2021-02-23 06:00:02 [INFO] [TRAIN] epoch=82, iter=30290/80000, loss=0.9349, lr=0.006517, batch_cost=1.3767, reader_cost=0.0001 | ETA 19:00:36 2021-02-23 06:00:15 [INFO] [TRAIN] epoch=82, iter=30300/80000, loss=0.9611, lr=0.006515, batch_cost=1.3595, reader_cost=0.0001 | ETA 18:46:05 2021-02-23 06:00:29 [INFO] [TRAIN] epoch=82, iter=30310/80000, loss=1.0082, lr=0.006514, batch_cost=1.3693, reader_cost=0.0001 | ETA 18:53:59 2021-02-23 06:00:43 [INFO] [TRAIN] epoch=82, iter=30320/80000, loss=0.8846, lr=0.006513, batch_cost=1.3457, reader_cost=0.0001 | ETA 18:34:16 2021-02-23 06:00:56 [INFO] [TRAIN] epoch=82, iter=30330/80000, loss=0.9543, lr=0.006512, batch_cost=1.3611, reader_cost=0.0001 | ETA 18:46:46 2021-02-23 06:01:10 [INFO] [TRAIN] epoch=82, iter=30340/80000, loss=0.9102, lr=0.006511, batch_cost=1.3528, reader_cost=0.0001 | ETA 18:39:41 2021-02-23 06:01:23 [INFO] [TRAIN] epoch=82, iter=30350/80000, loss=0.8896, lr=0.006510, batch_cost=1.3648, reader_cost=0.0001 | ETA 18:49:23 2021-02-23 06:01:37 [INFO] [TRAIN] epoch=82, iter=30360/80000, loss=0.8205, lr=0.006508, batch_cost=1.3650, reader_cost=0.0001 | ETA 18:49:19 2021-02-23 06:01:51 [INFO] [TRAIN] epoch=82, iter=30370/80000, loss=1.0638, lr=0.006507, batch_cost=1.3728, reader_cost=0.0001 | ETA 18:55:32 2021-02-23 06:02:04 [INFO] [TRAIN] epoch=82, iter=30380/80000, loss=0.8588, lr=0.006506, batch_cost=1.3464, reader_cost=0.0001 | ETA 18:33:26 2021-02-23 06:02:18 [INFO] [TRAIN] epoch=82, iter=30390/80000, loss=0.9017, lr=0.006505, batch_cost=1.3584, reader_cost=0.0001 | ETA 18:43:09 2021-02-23 06:02:32 [INFO] [TRAIN] epoch=82, iter=30400/80000, loss=0.8732, lr=0.006504, batch_cost=1.3776, reader_cost=0.0001 | ETA 18:58:47 2021-02-23 06:02:45 [INFO] [TRAIN] epoch=82, iter=30410/80000, loss=0.8880, lr=0.006503, batch_cost=1.3668, reader_cost=0.0001 | ETA 18:49:38 2021-02-23 06:02:59 [INFO] [TRAIN] epoch=82, iter=30420/80000, loss=0.8586, lr=0.006501, batch_cost=1.3650, reader_cost=0.0001 | ETA 18:47:58 2021-02-23 06:03:12 [INFO] [TRAIN] epoch=82, iter=30430/80000, loss=0.9172, lr=0.006500, batch_cost=1.3531, reader_cost=0.0001 | ETA 18:37:51 2021-02-23 06:03:26 [INFO] [TRAIN] epoch=82, iter=30440/80000, loss=0.9233, lr=0.006499, batch_cost=1.3888, reader_cost=0.0001 | ETA 19:07:06 2021-02-23 06:03:40 [INFO] [TRAIN] epoch=82, iter=30450/80000, loss=0.9781, lr=0.006498, batch_cost=1.3362, reader_cost=0.0001 | ETA 18:23:27 2021-02-23 06:03:53 [INFO] [TRAIN] epoch=82, iter=30460/80000, loss=0.9131, lr=0.006497, batch_cost=1.3696, reader_cost=0.0001 | ETA 18:50:52 2021-02-23 06:04:07 [INFO] [TRAIN] epoch=82, iter=30470/80000, loss=0.8793, lr=0.006495, batch_cost=1.3475, reader_cost=0.0001 | ETA 18:32:21 2021-02-23 06:04:21 [INFO] [TRAIN] epoch=82, iter=30480/80000, loss=0.8969, lr=0.006494, batch_cost=1.3855, reader_cost=0.0001 | ETA 19:03:32 2021-02-23 06:04:34 [INFO] [TRAIN] epoch=82, iter=30490/80000, loss=0.9548, lr=0.006493, batch_cost=1.3502, reader_cost=0.0001 | ETA 18:34:08 2021-02-23 06:04:48 [INFO] [TRAIN] epoch=82, iter=30500/80000, loss=0.9004, lr=0.006492, batch_cost=1.3472, reader_cost=0.0001 | ETA 18:31:28 2021-02-23 06:05:02 [INFO] [TRAIN] epoch=83, iter=30510/80000, loss=0.8554, lr=0.006491, batch_cost=1.4457, reader_cost=0.0853 | ETA 19:52:28 2021-02-23 06:05:16 [INFO] [TRAIN] epoch=83, iter=30520/80000, loss=0.8558, lr=0.006490, batch_cost=1.3802, reader_cost=0.0001 | ETA 18:58:10 2021-02-23 06:05:29 [INFO] [TRAIN] epoch=83, iter=30530/80000, loss=0.9165, lr=0.006488, batch_cost=1.3435, reader_cost=0.0001 | ETA 18:27:41 2021-02-23 06:05:43 [INFO] [TRAIN] epoch=83, iter=30540/80000, loss=0.8825, lr=0.006487, batch_cost=1.3833, reader_cost=0.0001 | ETA 19:00:17 2021-02-23 06:05:57 [INFO] [TRAIN] epoch=83, iter=30550/80000, loss=0.8631, lr=0.006486, batch_cost=1.3370, reader_cost=0.0001 | ETA 18:21:54 2021-02-23 06:06:10 [INFO] [TRAIN] epoch=83, iter=30560/80000, loss=0.8071, lr=0.006485, batch_cost=1.3646, reader_cost=0.0001 | ETA 18:44:23 2021-02-23 06:06:24 [INFO] [TRAIN] epoch=83, iter=30570/80000, loss=0.8694, lr=0.006484, batch_cost=1.3370, reader_cost=0.0001 | ETA 18:21:25 2021-02-23 06:06:37 [INFO] [TRAIN] epoch=83, iter=30580/80000, loss=0.9529, lr=0.006482, batch_cost=1.3462, reader_cost=0.0001 | ETA 18:28:47 2021-02-23 06:06:51 [INFO] [TRAIN] epoch=83, iter=30590/80000, loss=0.9760, lr=0.006481, batch_cost=1.3687, reader_cost=0.0001 | ETA 18:47:07 2021-02-23 06:07:05 [INFO] [TRAIN] epoch=83, iter=30600/80000, loss=0.8974, lr=0.006480, batch_cost=1.3835, reader_cost=0.0001 | ETA 18:59:06 2021-02-23 06:07:18 [INFO] [TRAIN] epoch=83, iter=30610/80000, loss=0.8976, lr=0.006479, batch_cost=1.3760, reader_cost=0.0001 | ETA 18:52:39 2021-02-23 06:07:32 [INFO] [TRAIN] epoch=83, iter=30620/80000, loss=0.9047, lr=0.006478, batch_cost=1.3540, reader_cost=0.0001 | ETA 18:34:22 2021-02-23 06:07:45 [INFO] [TRAIN] epoch=83, iter=30630/80000, loss=0.9945, lr=0.006477, batch_cost=1.3263, reader_cost=0.0001 | ETA 18:11:19 2021-02-23 06:07:59 [INFO] [TRAIN] epoch=83, iter=30640/80000, loss=0.8807, lr=0.006475, batch_cost=1.3834, reader_cost=0.0001 | ETA 18:58:05 2021-02-23 06:08:13 [INFO] [TRAIN] epoch=83, iter=30650/80000, loss=0.9222, lr=0.006474, batch_cost=1.3615, reader_cost=0.0001 | ETA 18:39:50 2021-02-23 06:08:26 [INFO] [TRAIN] epoch=83, iter=30660/80000, loss=0.8661, lr=0.006473, batch_cost=1.3715, reader_cost=0.0001 | ETA 18:47:50 2021-02-23 06:08:40 [INFO] [TRAIN] epoch=83, iter=30670/80000, loss=1.0318, lr=0.006472, batch_cost=1.3539, reader_cost=0.0001 | ETA 18:33:09 2021-02-23 06:08:53 [INFO] [TRAIN] epoch=83, iter=30680/80000, loss=0.9112, lr=0.006471, batch_cost=1.3415, reader_cost=0.0001 | ETA 18:22:42 2021-02-23 06:09:07 [INFO] [TRAIN] epoch=83, iter=30690/80000, loss=0.9068, lr=0.006469, batch_cost=1.3537, reader_cost=0.0001 | ETA 18:32:30 2021-02-23 06:09:20 [INFO] [TRAIN] epoch=83, iter=30700/80000, loss=0.8005, lr=0.006468, batch_cost=1.3412, reader_cost=0.0001 | ETA 18:21:59 2021-02-23 06:09:34 [INFO] [TRAIN] epoch=83, iter=30710/80000, loss=0.8902, lr=0.006467, batch_cost=1.3748, reader_cost=0.0001 | ETA 18:49:23 2021-02-23 06:09:48 [INFO] [TRAIN] epoch=83, iter=30720/80000, loss=0.9011, lr=0.006466, batch_cost=1.3600, reader_cost=0.0001 | ETA 18:37:00 2021-02-23 06:10:02 [INFO] [TRAIN] epoch=83, iter=30730/80000, loss=0.9645, lr=0.006465, batch_cost=1.4310, reader_cost=0.0001 | ETA 19:35:05 2021-02-23 06:10:16 [INFO] [TRAIN] epoch=83, iter=30740/80000, loss=0.9247, lr=0.006464, batch_cost=1.3613, reader_cost=0.0001 | ETA 18:37:37 2021-02-23 06:10:29 [INFO] [TRAIN] epoch=83, iter=30750/80000, loss=0.9207, lr=0.006462, batch_cost=1.3722, reader_cost=0.0001 | ETA 18:46:22 2021-02-23 06:10:43 [INFO] [TRAIN] epoch=83, iter=30760/80000, loss=0.8897, lr=0.006461, batch_cost=1.3688, reader_cost=0.0001 | ETA 18:43:21 2021-02-23 06:10:57 [INFO] [TRAIN] epoch=83, iter=30770/80000, loss=0.8630, lr=0.006460, batch_cost=1.3685, reader_cost=0.0001 | ETA 18:42:52 2021-02-23 06:11:11 [INFO] [TRAIN] epoch=83, iter=30780/80000, loss=0.9475, lr=0.006459, batch_cost=1.3890, reader_cost=0.0001 | ETA 18:59:25 2021-02-23 06:11:24 [INFO] [TRAIN] epoch=83, iter=30790/80000, loss=0.8568, lr=0.006458, batch_cost=1.3500, reader_cost=0.0001 | ETA 18:27:15 2021-02-23 06:11:38 [INFO] [TRAIN] epoch=83, iter=30800/80000, loss=1.0054, lr=0.006456, batch_cost=1.3666, reader_cost=0.0001 | ETA 18:40:35 2021-02-23 06:11:51 [INFO] [TRAIN] epoch=83, iter=30810/80000, loss=0.9245, lr=0.006455, batch_cost=1.3401, reader_cost=0.0001 | ETA 18:18:38 2021-02-23 06:12:05 [INFO] [TRAIN] epoch=83, iter=30820/80000, loss=0.9786, lr=0.006454, batch_cost=1.3464, reader_cost=0.0001 | ETA 18:23:33 2021-02-23 06:12:18 [INFO] [TRAIN] epoch=83, iter=30830/80000, loss=0.9477, lr=0.006453, batch_cost=1.3798, reader_cost=0.0001 | ETA 18:50:43 2021-02-23 06:12:32 [INFO] [TRAIN] epoch=83, iter=30840/80000, loss=0.8890, lr=0.006452, batch_cost=1.3748, reader_cost=0.0001 | ETA 18:46:23 2021-02-23 06:12:45 [INFO] [TRAIN] epoch=83, iter=30850/80000, loss=0.8646, lr=0.006451, batch_cost=1.3315, reader_cost=0.0001 | ETA 18:10:42 2021-02-23 06:12:59 [INFO] [TRAIN] epoch=83, iter=30860/80000, loss=0.8986, lr=0.006449, batch_cost=1.3454, reader_cost=0.0001 | ETA 18:21:51 2021-02-23 06:13:12 [INFO] [TRAIN] epoch=83, iter=30870/80000, loss=0.8826, lr=0.006448, batch_cost=1.3421, reader_cost=0.0001 | ETA 18:18:58 2021-02-23 06:13:27 [INFO] [TRAIN] epoch=84, iter=30880/80000, loss=0.9170, lr=0.006447, batch_cost=1.4266, reader_cost=0.0776 | ETA 19:27:55 2021-02-23 06:13:40 [INFO] [TRAIN] epoch=84, iter=30890/80000, loss=0.9226, lr=0.006446, batch_cost=1.3656, reader_cost=0.0001 | ETA 18:37:43 2021-02-23 06:13:54 [INFO] [TRAIN] epoch=84, iter=30900/80000, loss=1.0107, lr=0.006445, batch_cost=1.3521, reader_cost=0.0001 | ETA 18:26:26 2021-02-23 06:14:08 [INFO] [TRAIN] epoch=84, iter=30910/80000, loss=0.9258, lr=0.006443, batch_cost=1.3769, reader_cost=0.0001 | ETA 18:46:32 2021-02-23 06:14:21 [INFO] [TRAIN] epoch=84, iter=30920/80000, loss=0.9510, lr=0.006442, batch_cost=1.3976, reader_cost=0.0001 | ETA 19:03:12 2021-02-23 06:14:35 [INFO] [TRAIN] epoch=84, iter=30930/80000, loss=0.9059, lr=0.006441, batch_cost=1.3703, reader_cost=0.0001 | ETA 18:40:42 2021-02-23 06:14:49 [INFO] [TRAIN] epoch=84, iter=30940/80000, loss=0.8708, lr=0.006440, batch_cost=1.3616, reader_cost=0.0001 | ETA 18:33:17 2021-02-23 06:15:03 [INFO] [TRAIN] epoch=84, iter=30950/80000, loss=1.1811, lr=0.006439, batch_cost=1.3744, reader_cost=0.0001 | ETA 18:43:35 2021-02-23 06:15:16 [INFO] [TRAIN] epoch=84, iter=30960/80000, loss=0.8238, lr=0.006438, batch_cost=1.3375, reader_cost=0.0001 | ETA 18:13:11 2021-02-23 06:15:30 [INFO] [TRAIN] epoch=84, iter=30970/80000, loss=1.0153, lr=0.006436, batch_cost=1.3656, reader_cost=0.0001 | ETA 18:35:53 2021-02-23 06:15:43 [INFO] [TRAIN] epoch=84, iter=30980/80000, loss=0.8971, lr=0.006435, batch_cost=1.3412, reader_cost=0.0001 | ETA 18:15:46 2021-02-23 06:15:56 [INFO] [TRAIN] epoch=84, iter=30990/80000, loss=0.8999, lr=0.006434, batch_cost=1.3371, reader_cost=0.0001 | ETA 18:12:09 2021-02-23 06:16:10 [INFO] [TRAIN] epoch=84, iter=31000/80000, loss=0.9061, lr=0.006433, batch_cost=1.4066, reader_cost=0.0001 | ETA 19:08:45 2021-02-23 06:16:10 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:00 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 59s - batch_cost: 0.2388 - reader cost: 0.0600  3/125 [..............................] - ETA: 57s - batch_cost: 0.3108 - reader cost: 0.1032 4/125 [..............................] - ETA: 56s - batch_cost: 0.3467 - reader cost: 0.1282 5/125 [>.............................] - ETA: 54s - batch_cost: 0.3574 - reader cost: 0.1258 6/125 [>.............................] - ETA: 54s - batch_cost: 0.3727 - reader cost: 0.1356 7/125 [>.............................] - ETA: 53s - batch_cost: 0.3830 - reader cost: 0.1415 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3823 - reader cost: 0.1395 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3873 - reader cost: 0.1436 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3909 - reader cost: 0.1469 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3944 - reader cost: 0.1499 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3986 - reader cost: 0.1526 13/125 [==>...........................] - ETA: 49s - batch_cost: 0.4007 - reader cost: 0.1545 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.4038 - reader cost: 0.1573 15/125 [==>...........................] - ETA: 48s - batch_cost: 0.4056 - reader cost: 0.1591 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.4080 - reader cost: 0.1608 17/125 [===>..........................] - ETA: 47s - batch_cost: 0.4096 - reader cost: 0.1623 18/125 [===>..........................] - ETA: 47s - batch_cost: 0.4124 - reader cost: 0.1645 19/125 [===>..........................] - ETA: 46s - batch_cost: 0.4136 - reader cost: 0.1655 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4122 - reader cost: 0.1640 21/125 [====>.........................] - ETA: 45s - batch_cost: 0.4135 - reader cost: 0.1649 22/125 [====>.........................] - ETA: 45s - batch_cost: 0.4155 - reader cost: 0.1667 23/125 [====>.........................] - ETA: 44s - batch_cost: 0.4140 - reader cost: 0.1652 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4150 - reader cost: 0.1662 25/125 [=====>........................] - ETA: 43s - batch_cost: 0.4156 - reader cost: 0.1663 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4138 - reader cost: 0.1645 27/125 [=====>........................] - ETA: 42s - batch_cost: 0.4127 - reader cost: 0.1631 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4107 - reader cost: 0.1608 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4110 - reader cost: 0.1612 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4116 - reader cost: 0.1618 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4121 - reader cost: 0.1622 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4126 - reader cost: 0.1627 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4133 - reader cost: 0.1633 34/125 [=======>......................] - ETA: 39s - batch_cost: 0.4142 - reader cost: 0.1639 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4148 - reader cost: 0.1645 36/125 [=======>......................] - ETA: 38s - batch_cost: 0.4134 - reader cost: 0.1631 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4140 - reader cost: 0.1636 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4142 - reader cost: 0.1638 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4143 - reader cost: 0.1640 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4147 - reader cost: 0.1643 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4133 - reader cost: 0.1630 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4128 - reader cost: 0.1624 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4123 - reader cost: 0.1619 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4127 - reader cost: 0.1623 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4119 - reader cost: 0.1614 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4114 - reader cost: 0.1608 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4118 - reader cost: 0.1613 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4121 - reader cost: 0.1616 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4121 - reader cost: 0.1609 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4123 - reader cost: 0.1601 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4122 - reader cost: 0.1599 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4124 - reader cost: 0.1602 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4125 - reader cost: 0.1601 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4120 - reader cost: 0.1588 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4116 - reader cost: 0.1581 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4116 - reader cost: 0.1581 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4120 - reader cost: 0.1585 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4123 - reader cost: 0.1581 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4123 - reader cost: 0.1582 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4115 - reader cost: 0.1574 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4119 - reader cost: 0.1578 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4125 - reader cost: 0.1585 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4131 - reader cost: 0.1591 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4132 - reader cost: 0.1589 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4123 - reader cost: 0.1581 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4127 - reader cost: 0.1585 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4124 - reader cost: 0.1582 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4128 - reader cost: 0.1584 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4123 - reader cost: 0.1578 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4127 - reader cost: 0.1581 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4130 - reader cost: 0.1585 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4128 - reader cost: 0.1582 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4121 - reader cost: 0.1576 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4126 - reader cost: 0.1579 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4130 - reader cost: 0.1585 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4134 - reader cost: 0.1587 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4136 - reader cost: 0.1588 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4133 - reader cost: 0.1586 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4135 - reader cost: 0.1588 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4137 - reader cost: 0.1590 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4142 - reader cost: 0.1595 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4138 - reader cost: 0.1590 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4138 - reader cost: 0.1590 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4134 - reader cost: 0.1586 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4136 - reader cost: 0.1588 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4139 - reader cost: 0.1591 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4139 - reader cost: 0.1592 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4142 - reader cost: 0.1594 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4142 - reader cost: 0.1595 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4144 - reader cost: 0.1597 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4143 - reader cost: 0.1596 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4139 - reader cost: 0.1592 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4140 - reader cost: 0.1594 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4141 - reader cost: 0.1595 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4141 - reader cost: 0.1597 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4142 - reader cost: 0.1597 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4145 - reader cost: 0.1600 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4147 - reader cost: 0.1603 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4152 - reader cost: 0.1608 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4153 - reader cost: 0.1609 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4155 - reader cost: 0.1611 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4155 - reader cost: 0.1611  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4158 - reader cost: 0.1613 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4155 - reader cost: 0.1611 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4152 - reader cost: 0.1608 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4148 - reader cost: 0.1605 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4151 - reader cost: 0.1608 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4148 - reader cost: 0.1605 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4145 - reader cost: 0.1602 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4146 - reader cost: 0.1604 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4147 - reader cost: 0.1606 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4151 - reader cost: 0.1610 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4152 - reader cost: 0.1611 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4153 - reader cost: 0.1613 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4149 - reader cost: 0.1609 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4150 - reader cost: 0.1610 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4152 - reader cost: 0.1611 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4151 - reader cost: 0.1605 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4153 - reader cost: 0.1598 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4154 - reader cost: 0.1593 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4155 - reader cost: 0.1592 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4155 - reader cost: 0.1588 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4156 - reader cost: 0.1589 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4157 - reader cost: 0.1591 125/125 [==============================] - 52s 420ms/step - batch_cost: 0.4158 - reader cost: 0.1592 2021-02-23 06:17:03 [INFO] [EVAL] #Images=500 mIoU=0.7576 Acc=0.9562 Kappa=0.9431 2021-02-23 06:17:03 [INFO] [EVAL] Class IoU: [0.975 0.8064 0.9213 0.5276 0.5658 0.6524 0.7289 0.7954 0.9221 0.539 0.9449 0.787 0.435 0.9447 0.7639 0.8666 0.7887 0.661 0.7686] 2021-02-23 06:17:03 [INFO] [EVAL] Class Acc: [0.9877 0.8733 0.9556 0.7574 0.8994 0.8222 0.8189 0.8767 0.9508 0.9245 0.9614 0.8436 0.8464 0.9655 0.9496 0.931 0.8703 0.8159 0.8885] 2021-02-23 06:17:10 [INFO] [EVAL] The model with the best validation mIoU (0.7576) was saved at iter 31000. 2021-02-23 06:17:23 [INFO] [TRAIN] epoch=84, iter=31010/80000, loss=0.8409, lr=0.006432, batch_cost=1.3239, reader_cost=0.0001 | ETA 18:00:55 2021-02-23 06:17:37 [INFO] [TRAIN] epoch=84, iter=31020/80000, loss=0.8573, lr=0.006430, batch_cost=1.3903, reader_cost=0.0001 | ETA 18:54:55 2021-02-23 06:17:51 [INFO] [TRAIN] epoch=84, iter=31030/80000, loss=0.9161, lr=0.006429, batch_cost=1.3544, reader_cost=0.0001 | ETA 18:25:23 2021-02-23 06:18:04 [INFO] [TRAIN] epoch=84, iter=31040/80000, loss=0.9024, lr=0.006428, batch_cost=1.3455, reader_cost=0.0001 | ETA 18:17:54 2021-02-23 06:18:18 [INFO] [TRAIN] epoch=84, iter=31050/80000, loss=0.9100, lr=0.006427, batch_cost=1.3410, reader_cost=0.0001 | ETA 18:14:01 2021-02-23 06:18:31 [INFO] [TRAIN] epoch=84, iter=31060/80000, loss=0.8837, lr=0.006426, batch_cost=1.3906, reader_cost=0.0001 | ETA 18:54:15 2021-02-23 06:18:45 [INFO] [TRAIN] epoch=84, iter=31070/80000, loss=0.8449, lr=0.006425, batch_cost=1.3586, reader_cost=0.0001 | ETA 18:27:58 2021-02-23 06:18:59 [INFO] [TRAIN] epoch=84, iter=31080/80000, loss=0.9408, lr=0.006423, batch_cost=1.3666, reader_cost=0.0001 | ETA 18:34:15 2021-02-23 06:19:12 [INFO] [TRAIN] epoch=84, iter=31090/80000, loss=0.9031, lr=0.006422, batch_cost=1.3403, reader_cost=0.0001 | ETA 18:12:35 2021-02-23 06:19:26 [INFO] [TRAIN] epoch=84, iter=31100/80000, loss=0.9780, lr=0.006421, batch_cost=1.3557, reader_cost=0.0001 | ETA 18:24:55 2021-02-23 06:19:39 [INFO] [TRAIN] epoch=84, iter=31110/80000, loss=0.9344, lr=0.006420, batch_cost=1.3644, reader_cost=0.0001 | ETA 18:31:45 2021-02-23 06:19:53 [INFO] [TRAIN] epoch=84, iter=31120/80000, loss=0.8993, lr=0.006419, batch_cost=1.3542, reader_cost=0.0001 | ETA 18:23:15 2021-02-23 06:20:07 [INFO] [TRAIN] epoch=84, iter=31130/80000, loss=0.8676, lr=0.006417, batch_cost=1.3685, reader_cost=0.0001 | ETA 18:34:40 2021-02-23 06:20:20 [INFO] [TRAIN] epoch=84, iter=31140/80000, loss=0.9505, lr=0.006416, batch_cost=1.3519, reader_cost=0.0001 | ETA 18:20:53 2021-02-23 06:20:34 [INFO] [TRAIN] epoch=84, iter=31150/80000, loss=0.9878, lr=0.006415, batch_cost=1.3744, reader_cost=0.0001 | ETA 18:38:58 2021-02-23 06:20:48 [INFO] [TRAIN] epoch=84, iter=31160/80000, loss=0.8510, lr=0.006414, batch_cost=1.3731, reader_cost=0.0001 | ETA 18:37:44 2021-02-23 06:21:01 [INFO] [TRAIN] epoch=84, iter=31170/80000, loss=0.8341, lr=0.006413, batch_cost=1.3934, reader_cost=0.0001 | ETA 18:54:01 2021-02-23 06:21:15 [INFO] [TRAIN] epoch=84, iter=31180/80000, loss=0.8596, lr=0.006412, batch_cost=1.3468, reader_cost=0.0001 | ETA 18:15:50 2021-02-23 06:21:29 [INFO] [TRAIN] epoch=84, iter=31190/80000, loss=0.9533, lr=0.006410, batch_cost=1.3580, reader_cost=0.0001 | ETA 18:24:42 2021-02-23 06:21:42 [INFO] [TRAIN] epoch=84, iter=31200/80000, loss=0.8866, lr=0.006409, batch_cost=1.3676, reader_cost=0.0001 | ETA 18:32:19 2021-02-23 06:21:56 [INFO] [TRAIN] epoch=84, iter=31210/80000, loss=0.9244, lr=0.006408, batch_cost=1.3537, reader_cost=0.0001 | ETA 18:20:47 2021-02-23 06:22:09 [INFO] [TRAIN] epoch=84, iter=31220/80000, loss=1.0097, lr=0.006407, batch_cost=1.3647, reader_cost=0.0001 | ETA 18:29:28 2021-02-23 06:22:23 [INFO] [TRAIN] epoch=84, iter=31230/80000, loss=0.9409, lr=0.006406, batch_cost=1.3472, reader_cost=0.0001 | ETA 18:15:01 2021-02-23 06:22:37 [INFO] [TRAIN] epoch=84, iter=31240/80000, loss=0.8709, lr=0.006404, batch_cost=1.3803, reader_cost=0.0001 | ETA 18:41:42 2021-02-23 06:22:51 [INFO] [TRAIN] epoch=85, iter=31250/80000, loss=0.8888, lr=0.006403, batch_cost=1.4299, reader_cost=0.0651 | ETA 19:21:48 2021-02-23 06:23:05 [INFO] [TRAIN] epoch=85, iter=31260/80000, loss=0.9334, lr=0.006402, batch_cost=1.3908, reader_cost=0.0001 | ETA 18:49:48 2021-02-23 06:23:18 [INFO] [TRAIN] epoch=85, iter=31270/80000, loss=1.0021, lr=0.006401, batch_cost=1.3469, reader_cost=0.0001 | ETA 18:13:53 2021-02-23 06:23:32 [INFO] [TRAIN] epoch=85, iter=31280/80000, loss=0.9538, lr=0.006400, batch_cost=1.3780, reader_cost=0.0001 | ETA 18:38:58 2021-02-23 06:23:46 [INFO] [TRAIN] epoch=85, iter=31290/80000, loss=0.8395, lr=0.006399, batch_cost=1.3676, reader_cost=0.0001 | ETA 18:30:17 2021-02-23 06:23:59 [INFO] [TRAIN] epoch=85, iter=31300/80000, loss=0.9445, lr=0.006397, batch_cost=1.3508, reader_cost=0.0001 | ETA 18:16:25 2021-02-23 06:24:13 [INFO] [TRAIN] epoch=85, iter=31310/80000, loss=0.9197, lr=0.006396, batch_cost=1.3727, reader_cost=0.0001 | ETA 18:33:56 2021-02-23 06:24:27 [INFO] [TRAIN] epoch=85, iter=31320/80000, loss=0.9303, lr=0.006395, batch_cost=1.3708, reader_cost=0.0001 | ETA 18:32:11 2021-02-23 06:24:40 [INFO] [TRAIN] epoch=85, iter=31330/80000, loss=0.8368, lr=0.006394, batch_cost=1.3441, reader_cost=0.0001 | ETA 18:10:17 2021-02-23 06:24:54 [INFO] [TRAIN] epoch=85, iter=31340/80000, loss=0.8894, lr=0.006393, batch_cost=1.3582, reader_cost=0.0001 | ETA 18:21:31 2021-02-23 06:25:08 [INFO] [TRAIN] epoch=85, iter=31350/80000, loss=0.9535, lr=0.006391, batch_cost=1.3722, reader_cost=0.0001 | ETA 18:32:39 2021-02-23 06:25:21 [INFO] [TRAIN] epoch=85, iter=31360/80000, loss=0.9843, lr=0.006390, batch_cost=1.3511, reader_cost=0.0001 | ETA 18:15:16 2021-02-23 06:25:35 [INFO] [TRAIN] epoch=85, iter=31370/80000, loss=0.9084, lr=0.006389, batch_cost=1.3617, reader_cost=0.0001 | ETA 18:23:38 2021-02-23 06:25:48 [INFO] [TRAIN] epoch=85, iter=31380/80000, loss=0.9405, lr=0.006388, batch_cost=1.3655, reader_cost=0.0001 | ETA 18:26:32 2021-02-23 06:26:02 [INFO] [TRAIN] epoch=85, iter=31390/80000, loss=0.8895, lr=0.006387, batch_cost=1.3516, reader_cost=0.0001 | ETA 18:15:02 2021-02-23 06:26:16 [INFO] [TRAIN] epoch=85, iter=31400/80000, loss=0.8741, lr=0.006386, batch_cost=1.3797, reader_cost=0.0001 | ETA 18:37:32 2021-02-23 06:26:29 [INFO] [TRAIN] epoch=85, iter=31410/80000, loss=0.9614, lr=0.006384, batch_cost=1.3514, reader_cost=0.0001 | ETA 18:14:23 2021-02-23 06:26:43 [INFO] [TRAIN] epoch=85, iter=31420/80000, loss=0.8996, lr=0.006383, batch_cost=1.3756, reader_cost=0.0001 | ETA 18:33:48 2021-02-23 06:26:57 [INFO] [TRAIN] epoch=85, iter=31430/80000, loss=0.9308, lr=0.006382, batch_cost=1.3840, reader_cost=0.0001 | ETA 18:40:23 2021-02-23 06:27:10 [INFO] [TRAIN] epoch=85, iter=31440/80000, loss=1.0073, lr=0.006381, batch_cost=1.3333, reader_cost=0.0001 | ETA 17:59:05 2021-02-23 06:27:24 [INFO] [TRAIN] epoch=85, iter=31450/80000, loss=0.8831, lr=0.006380, batch_cost=1.3693, reader_cost=0.0001 | ETA 18:28:01 2021-02-23 06:27:37 [INFO] [TRAIN] epoch=85, iter=31460/80000, loss=0.9296, lr=0.006378, batch_cost=1.3531, reader_cost=0.0001 | ETA 18:14:40 2021-02-23 06:27:51 [INFO] [TRAIN] epoch=85, iter=31470/80000, loss=0.8425, lr=0.006377, batch_cost=1.3768, reader_cost=0.0001 | ETA 18:33:34 2021-02-23 06:28:05 [INFO] [TRAIN] epoch=85, iter=31480/80000, loss=0.9469, lr=0.006376, batch_cost=1.3703, reader_cost=0.0001 | ETA 18:28:05 2021-02-23 06:28:19 [INFO] [TRAIN] epoch=85, iter=31490/80000, loss=0.8534, lr=0.006375, batch_cost=1.3820, reader_cost=0.0001 | ETA 18:37:22 2021-02-23 06:28:32 [INFO] [TRAIN] epoch=85, iter=31500/80000, loss=0.8892, lr=0.006374, batch_cost=1.3610, reader_cost=0.0001 | ETA 18:20:10 2021-02-23 06:28:46 [INFO] [TRAIN] epoch=85, iter=31510/80000, loss=0.9438, lr=0.006373, batch_cost=1.3686, reader_cost=0.0001 | ETA 18:26:02 2021-02-23 06:29:00 [INFO] [TRAIN] epoch=85, iter=31520/80000, loss=0.8909, lr=0.006371, batch_cost=1.3707, reader_cost=0.0001 | ETA 18:27:33 2021-02-23 06:29:13 [INFO] [TRAIN] epoch=85, iter=31530/80000, loss=0.8012, lr=0.006370, batch_cost=1.3808, reader_cost=0.0001 | ETA 18:35:29 2021-02-23 06:29:27 [INFO] [TRAIN] epoch=85, iter=31540/80000, loss=0.8821, lr=0.006369, batch_cost=1.3659, reader_cost=0.0001 | ETA 18:23:09 2021-02-23 06:29:41 [INFO] [TRAIN] epoch=85, iter=31550/80000, loss=0.8974, lr=0.006368, batch_cost=1.3595, reader_cost=0.0001 | ETA 18:17:48 2021-02-23 06:29:54 [INFO] [TRAIN] epoch=85, iter=31560/80000, loss=1.0196, lr=0.006367, batch_cost=1.3786, reader_cost=0.0001 | ETA 18:32:57 2021-02-23 06:30:08 [INFO] [TRAIN] epoch=85, iter=31570/80000, loss=0.9496, lr=0.006365, batch_cost=1.3743, reader_cost=0.0001 | ETA 18:29:16 2021-02-23 06:30:22 [INFO] [TRAIN] epoch=85, iter=31580/80000, loss=0.9478, lr=0.006364, batch_cost=1.3565, reader_cost=0.0001 | ETA 18:14:42 2021-02-23 06:30:35 [INFO] [TRAIN] epoch=85, iter=31590/80000, loss=0.8688, lr=0.006363, batch_cost=1.3346, reader_cost=0.0001 | ETA 17:56:47 2021-02-23 06:30:49 [INFO] [TRAIN] epoch=85, iter=31600/80000, loss=0.9327, lr=0.006362, batch_cost=1.3476, reader_cost=0.0001 | ETA 18:07:06 2021-02-23 06:31:02 [INFO] [TRAIN] epoch=85, iter=31610/80000, loss=0.8973, lr=0.006361, batch_cost=1.3851, reader_cost=0.0001 | ETA 18:37:03 2021-02-23 06:31:15 [INFO] [TRAIN] epoch=85, iter=31620/80000, loss=0.8661, lr=0.006360, batch_cost=1.3030, reader_cost=0.0001 | ETA 17:30:37 2021-02-23 06:31:30 [INFO] [TRAIN] epoch=86, iter=31630/80000, loss=0.8081, lr=0.006358, batch_cost=1.4705, reader_cost=0.0763 | ETA 19:45:27 2021-02-23 06:31:44 [INFO] [TRAIN] epoch=86, iter=31640/80000, loss=0.9210, lr=0.006357, batch_cost=1.4012, reader_cost=0.0001 | ETA 18:49:20 2021-02-23 06:31:58 [INFO] [TRAIN] epoch=86, iter=31650/80000, loss=0.9310, lr=0.006356, batch_cost=1.3648, reader_cost=0.0001 | ETA 18:19:48 2021-02-23 06:32:12 [INFO] [TRAIN] epoch=86, iter=31660/80000, loss=0.8732, lr=0.006355, batch_cost=1.3724, reader_cost=0.0001 | ETA 18:25:43 2021-02-23 06:32:25 [INFO] [TRAIN] epoch=86, iter=31670/80000, loss=1.0064, lr=0.006354, batch_cost=1.3711, reader_cost=0.0001 | ETA 18:24:26 2021-02-23 06:32:39 [INFO] [TRAIN] epoch=86, iter=31680/80000, loss=0.9216, lr=0.006352, batch_cost=1.3783, reader_cost=0.0001 | ETA 18:30:00 2021-02-23 06:32:53 [INFO] [TRAIN] epoch=86, iter=31690/80000, loss=0.8281, lr=0.006351, batch_cost=1.3545, reader_cost=0.0001 | ETA 18:10:36 2021-02-23 06:33:06 [INFO] [TRAIN] epoch=86, iter=31700/80000, loss=0.8606, lr=0.006350, batch_cost=1.3388, reader_cost=0.0001 | ETA 17:57:43 2021-02-23 06:33:20 [INFO] [TRAIN] epoch=86, iter=31710/80000, loss=0.9273, lr=0.006349, batch_cost=1.3570, reader_cost=0.0001 | ETA 18:12:09 2021-02-23 06:33:33 [INFO] [TRAIN] epoch=86, iter=31720/80000, loss=0.8996, lr=0.006348, batch_cost=1.3433, reader_cost=0.0001 | ETA 18:00:53 2021-02-23 06:33:46 [INFO] [TRAIN] epoch=86, iter=31730/80000, loss=0.8295, lr=0.006347, batch_cost=1.3269, reader_cost=0.0001 | ETA 17:47:29 2021-02-23 06:34:00 [INFO] [TRAIN] epoch=86, iter=31740/80000, loss=0.9833, lr=0.006345, batch_cost=1.3660, reader_cost=0.0001 | ETA 18:18:43 2021-02-23 06:34:14 [INFO] [TRAIN] epoch=86, iter=31750/80000, loss=0.9557, lr=0.006344, batch_cost=1.3733, reader_cost=0.0001 | ETA 18:24:19 2021-02-23 06:34:27 [INFO] [TRAIN] epoch=86, iter=31760/80000, loss=0.8922, lr=0.006343, batch_cost=1.3664, reader_cost=0.0001 | ETA 18:18:33 2021-02-23 06:34:41 [INFO] [TRAIN] epoch=86, iter=31770/80000, loss=0.9103, lr=0.006342, batch_cost=1.3579, reader_cost=0.0001 | ETA 18:11:29 2021-02-23 06:34:55 [INFO] [TRAIN] epoch=86, iter=31780/80000, loss=0.9530, lr=0.006341, batch_cost=1.3729, reader_cost=0.0001 | ETA 18:23:23 2021-02-23 06:35:08 [INFO] [TRAIN] epoch=86, iter=31790/80000, loss=0.9884, lr=0.006339, batch_cost=1.3696, reader_cost=0.0001 | ETA 18:20:26 2021-02-23 06:35:22 [INFO] [TRAIN] epoch=86, iter=31800/80000, loss=0.9274, lr=0.006338, batch_cost=1.3887, reader_cost=0.0001 | ETA 18:35:37 2021-02-23 06:35:36 [INFO] [TRAIN] epoch=86, iter=31810/80000, loss=0.8161, lr=0.006337, batch_cost=1.3759, reader_cost=0.0001 | ETA 18:25:04 2021-02-23 06:35:50 [INFO] [TRAIN] epoch=86, iter=31820/80000, loss=0.9391, lr=0.006336, batch_cost=1.3565, reader_cost=0.0001 | ETA 18:09:17 2021-02-23 06:36:03 [INFO] [TRAIN] epoch=86, iter=31830/80000, loss=0.8671, lr=0.006335, batch_cost=1.3493, reader_cost=0.0001 | ETA 18:03:14 2021-02-23 06:36:17 [INFO] [TRAIN] epoch=86, iter=31840/80000, loss=0.8729, lr=0.006334, batch_cost=1.3549, reader_cost=0.0001 | ETA 18:07:32 2021-02-23 06:36:30 [INFO] [TRAIN] epoch=86, iter=31850/80000, loss=1.0023, lr=0.006332, batch_cost=1.3644, reader_cost=0.0001 | ETA 18:14:54 2021-02-23 06:36:44 [INFO] [TRAIN] epoch=86, iter=31860/80000, loss=0.8800, lr=0.006331, batch_cost=1.3848, reader_cost=0.0001 | ETA 18:31:04 2021-02-23 06:36:58 [INFO] [TRAIN] epoch=86, iter=31870/80000, loss=0.8491, lr=0.006330, batch_cost=1.3649, reader_cost=0.0001 | ETA 18:14:52 2021-02-23 06:37:12 [INFO] [TRAIN] epoch=86, iter=31880/80000, loss=0.8486, lr=0.006329, batch_cost=1.3820, reader_cost=0.0001 | ETA 18:28:22 2021-02-23 06:37:25 [INFO] [TRAIN] epoch=86, iter=31890/80000, loss=0.9116, lr=0.006328, batch_cost=1.3617, reader_cost=0.0001 | ETA 18:11:49 2021-02-23 06:37:39 [INFO] [TRAIN] epoch=86, iter=31900/80000, loss=0.8479, lr=0.006326, batch_cost=1.3930, reader_cost=0.0001 | ETA 18:36:45 2021-02-23 06:37:53 [INFO] [TRAIN] epoch=86, iter=31910/80000, loss=0.9740, lr=0.006325, batch_cost=1.3798, reader_cost=0.0001 | ETA 18:25:54 2021-02-23 06:38:07 [INFO] [TRAIN] epoch=86, iter=31920/80000, loss=0.8700, lr=0.006324, batch_cost=1.3632, reader_cost=0.0001 | ETA 18:12:22 2021-02-23 06:38:20 [INFO] [TRAIN] epoch=86, iter=31930/80000, loss=0.8560, lr=0.006323, batch_cost=1.3916, reader_cost=0.0001 | ETA 18:34:53 2021-02-23 06:38:34 [INFO] [TRAIN] epoch=86, iter=31940/80000, loss=0.9532, lr=0.006322, batch_cost=1.3759, reader_cost=0.0001 | ETA 18:22:06 2021-02-23 06:38:48 [INFO] [TRAIN] epoch=86, iter=31950/80000, loss=0.8713, lr=0.006320, batch_cost=1.3597, reader_cost=0.0001 | ETA 18:08:55 2021-02-23 06:39:01 [INFO] [TRAIN] epoch=86, iter=31960/80000, loss=0.9522, lr=0.006319, batch_cost=1.3521, reader_cost=0.0001 | ETA 18:02:36 2021-02-23 06:39:15 [INFO] [TRAIN] epoch=86, iter=31970/80000, loss=0.9460, lr=0.006318, batch_cost=1.3523, reader_cost=0.0001 | ETA 18:02:30 2021-02-23 06:39:29 [INFO] [TRAIN] epoch=86, iter=31980/80000, loss=0.9834, lr=0.006317, batch_cost=1.3714, reader_cost=0.0001 | ETA 18:17:33 2021-02-23 06:39:42 [INFO] [TRAIN] epoch=86, iter=31990/80000, loss=1.1466, lr=0.006316, batch_cost=1.3274, reader_cost=0.0001 | ETA 17:42:08 2021-02-23 06:39:56 [INFO] [TRAIN] epoch=87, iter=32000/80000, loss=0.8500, lr=0.006315, batch_cost=1.4506, reader_cost=0.0887 | ETA 19:20:29 2021-02-23 06:39:56 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:10 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:02 - batch_cost: 0.2260 - reader cost: 0.1011  3/125 [..............................] - ETA: 58s - batch_cost: 0.2938 - reader cost: 0.1278  4/125 [..............................] - ETA: 58s - batch_cost: 0.3397 - reader cost: 0.1515 5/125 [>.............................] - ETA: 55s - batch_cost: 0.3500 - reader cost: 0.1491 6/125 [>.............................] - ETA: 55s - batch_cost: 0.3678 - reader cost: 0.1575 7/125 [>.............................] - ETA: 53s - batch_cost: 0.3759 - reader cost: 0.1589 8/125 [>.............................] - ETA: 52s - batch_cost: 0.3780 - reader cost: 0.1554 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3831 - reader cost: 0.1574 10/125 [=>............................] - ETA: 51s - batch_cost: 0.3879 - reader cost: 0.1591 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3909 - reader cost: 0.1602 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3887 - reader cost: 0.1565 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3868 - reader cost: 0.1532 14/125 [==>...........................] - ETA: 47s - batch_cost: 0.3870 - reader cost: 0.1517 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3898 - reader cost: 0.1535 16/125 [==>...........................] - ETA: 46s - batch_cost: 0.3893 - reader cost: 0.1522 17/125 [===>..........................] - ETA: 45s - batch_cost: 0.3924 - reader cost: 0.1544 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3920 - reader cost: 0.1534 19/125 [===>..........................] - ETA: 44s - batch_cost: 0.3922 - reader cost: 0.1529 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3934 - reader cost: 0.1536 21/125 [====>.........................] - ETA: 43s - batch_cost: 0.3938 - reader cost: 0.1525 22/125 [====>.........................] - ETA: 43s - batch_cost: 0.3949 - reader cost: 0.1519 23/125 [====>.........................] - ETA: 42s - batch_cost: 0.3962 - reader cost: 0.1528 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.3978 - reader cost: 0.1541 25/125 [=====>........................] - ETA: 41s - batch_cost: 0.3971 - reader cost: 0.1531 26/125 [=====>........................] - ETA: 41s - batch_cost: 0.3968 - reader cost: 0.1525 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.3978 - reader cost: 0.1532 28/125 [=====>........................] - ETA: 40s - batch_cost: 0.3991 - reader cost: 0.1543 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.3992 - reader cost: 0.1537 30/125 [======>.......................] - ETA: 39s - batch_cost: 0.3994 - reader cost: 0.1534 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.3988 - reader cost: 0.1526 32/125 [======>.......................] - ETA: 38s - batch_cost: 0.4002 - reader cost: 0.1538 33/125 [======>.......................] - ETA: 38s - batch_cost: 0.4000 - reader cost: 0.1534 34/125 [=======>......................] - ETA: 37s - batch_cost: 0.3999 - reader cost: 0.1524 35/125 [=======>......................] - ETA: 37s - batch_cost: 0.4009 - reader cost: 0.1532 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4024 - reader cost: 0.1543 37/125 [=======>......................] - ETA: 36s - batch_cost: 0.4027 - reader cost: 0.1544 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4029 - reader cost: 0.1535 39/125 [========>.....................] - ETA: 35s - batch_cost: 0.4033 - reader cost: 0.1533 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4029 - reader cost: 0.1528 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4036 - reader cost: 0.1536 42/125 [=========>....................] - ETA: 34s - batch_cost: 0.4037 - reader cost: 0.1537 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4044 - reader cost: 0.1544 44/125 [=========>....................] - ETA: 33s - batch_cost: 0.4037 - reader cost: 0.1534 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4043 - reader cost: 0.1526 46/125 [==========>...................] - ETA: 32s - batch_cost: 0.4049 - reader cost: 0.1517 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4056 - reader cost: 0.1513 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4059 - reader cost: 0.1517 49/125 [==========>...................] - ETA: 31s - batch_cost: 0.4055 - reader cost: 0.1511 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4059 - reader cost: 0.1515 51/125 [===========>..................] - ETA: 30s - batch_cost: 0.4067 - reader cost: 0.1523 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4062 - reader cost: 0.1517 53/125 [===========>..................] - ETA: 29s - batch_cost: 0.4058 - reader cost: 0.1507 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4051 - reader cost: 0.1501 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4057 - reader cost: 0.1507 56/125 [============>.................] - ETA: 28s - batch_cost: 0.4056 - reader cost: 0.1503 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4051 - reader cost: 0.1498 58/125 [============>.................] - ETA: 27s - batch_cost: 0.4055 - reader cost: 0.1493 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4059 - reader cost: 0.1493 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4067 - reader cost: 0.1497 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4064 - reader cost: 0.1494 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4061 - reader cost: 0.1492 63/125 [==============>...............] - ETA: 25s - batch_cost: 0.4061 - reader cost: 0.1487 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4063 - reader cost: 0.1482 65/125 [==============>...............] - ETA: 24s - batch_cost: 0.4068 - reader cost: 0.1479 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4063 - reader cost: 0.1475 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4067 - reader cost: 0.1480 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4072 - reader cost: 0.1485 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4068 - reader cost: 0.1482 70/125 [===============>..............] - ETA: 22s - batch_cost: 0.4073 - reader cost: 0.1489 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4078 - reader cost: 0.1494 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4082 - reader cost: 0.1498 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4085 - reader cost: 0.1501 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4083 - reader cost: 0.1496 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4087 - reader cost: 0.1501 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4090 - reader cost: 0.1506 77/125 [=================>............] - ETA: 19s - batch_cost: 0.4087 - reader cost: 0.1503 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4091 - reader cost: 0.1508 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4093 - reader cost: 0.1511 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4095 - reader cost: 0.1513 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4091 - reader cost: 0.1509 82/125 [==================>...........] - ETA: 17s - batch_cost: 0.4095 - reader cost: 0.1513 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4096 - reader cost: 0.1515 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4097 - reader cost: 0.1518 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4100 - reader cost: 0.1521 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4097 - reader cost: 0.1519 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4101 - reader cost: 0.1523 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4100 - reader cost: 0.1522 89/125 [====================>.........] - ETA: 14s - batch_cost: 0.4095 - reader cost: 0.1518 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4097 - reader cost: 0.1522 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4096 - reader cost: 0.1520 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4097 - reader cost: 0.1523 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4095 - reader cost: 0.1520 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4097 - reader cost: 0.1523 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4100 - reader cost: 0.1527 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4095 - reader cost: 0.1523 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4098 - reader cost: 0.1525 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4094 - reader cost: 0.1521 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4095 - reader cost: 0.1523 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4092 - reader cost: 0.1521 101/125 [=======================>......] - ETA: 9s - batch_cost: 0.4095 - reader cost: 0.1524  102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4096 - reader cost: 0.1526 103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4092 - reader cost: 0.1523 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4094 - reader cost: 0.1525 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4095 - reader cost: 0.1527 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4098 - reader cost: 0.1530 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4101 - reader cost: 0.1533 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4096 - reader cost: 0.1529 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4092 - reader cost: 0.1526 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4090 - reader cost: 0.1524 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4089 - reader cost: 0.1524 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4088 - reader cost: 0.1522 113/125 [==========================>...] - ETA: 4s - batch_cost: 0.4090 - reader cost: 0.1523 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4091 - reader cost: 0.1525 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4093 - reader cost: 0.1528 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4095 - reader cost: 0.1530 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4093 - reader cost: 0.1529 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4095 - reader cost: 0.1532 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4094 - reader cost: 0.1530 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4093 - reader cost: 0.1529 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4096 - reader cost: 0.1533 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4097 - reader cost: 0.1534 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4099 - reader cost: 0.1536 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4096 - reader cost: 0.1534 125/125 [==============================] - 52s 414ms/step - batch_cost: 0.4098 - reader cost: 0.1536 2021-02-23 06:40:48 [INFO] [EVAL] #Images=500 mIoU=0.6838 Acc=0.9495 Kappa=0.9342 2021-02-23 06:40:48 [INFO] [EVAL] Class IoU: [0.9701 0.7753 0.911 0.3627 0.5341 0.6294 0.6903 0.7744 0.91 0.5107 0.9403 0.8002 0.6005 0.9398 0.6184 0.6863 0.1553 0.4257 0.7573] 2021-02-23 06:40:48 [INFO] [EVAL] Class Acc: [0.9786 0.9131 0.9409 0.8252 0.7758 0.7907 0.8624 0.9261 0.9413 0.8608 0.9693 0.8723 0.8044 0.9698 0.9551 0.7421 0.8718 0.8471 0.8276] 2021-02-23 06:40:52 [INFO] [EVAL] The model with the best validation mIoU (0.7576) was saved at iter 31000. 2021-02-23 06:41:06 [INFO] [TRAIN] epoch=87, iter=32010/80000, loss=0.8628, lr=0.006313, batch_cost=1.3629, reader_cost=0.0001 | ETA 18:10:03 2021-02-23 06:41:20 [INFO] [TRAIN] epoch=87, iter=32020/80000, loss=1.0706, lr=0.006312, batch_cost=1.3980, reader_cost=0.0001 | ETA 18:37:57 2021-02-23 06:41:34 [INFO] [TRAIN] epoch=87, iter=32030/80000, loss=0.8129, lr=0.006311, batch_cost=1.3674, reader_cost=0.0001 | ETA 18:13:13 2021-02-23 06:41:47 [INFO] [TRAIN] epoch=87, iter=32040/80000, loss=0.8025, lr=0.006310, batch_cost=1.3395, reader_cost=0.0001 | ETA 17:50:43 2021-02-23 06:42:01 [INFO] [TRAIN] epoch=87, iter=32050/80000, loss=0.8935, lr=0.006309, batch_cost=1.3771, reader_cost=0.0001 | ETA 18:20:30 2021-02-23 06:42:15 [INFO] [TRAIN] epoch=87, iter=32060/80000, loss=1.0056, lr=0.006307, batch_cost=1.3802, reader_cost=0.0001 | ETA 18:22:44 2021-02-23 06:42:28 [INFO] [TRAIN] epoch=87, iter=32070/80000, loss=0.8712, lr=0.006306, batch_cost=1.3552, reader_cost=0.0001 | ETA 18:02:32 2021-02-23 06:42:41 [INFO] [TRAIN] epoch=87, iter=32080/80000, loss=0.9691, lr=0.006305, batch_cost=1.3387, reader_cost=0.0001 | ETA 17:49:10 2021-02-23 06:42:55 [INFO] [TRAIN] epoch=87, iter=32090/80000, loss=0.9071, lr=0.006304, batch_cost=1.3416, reader_cost=0.0001 | ETA 17:51:15 2021-02-23 06:43:08 [INFO] [TRAIN] epoch=87, iter=32100/80000, loss=0.9170, lr=0.006303, batch_cost=1.3499, reader_cost=0.0001 | ETA 17:57:41 2021-02-23 06:43:22 [INFO] [TRAIN] epoch=87, iter=32110/80000, loss=0.8758, lr=0.006302, batch_cost=1.3770, reader_cost=0.0001 | ETA 18:19:06 2021-02-23 06:43:36 [INFO] [TRAIN] epoch=87, iter=32120/80000, loss=0.8086, lr=0.006300, batch_cost=1.3495, reader_cost=0.0001 | ETA 17:56:55 2021-02-23 06:43:49 [INFO] [TRAIN] epoch=87, iter=32130/80000, loss=0.8678, lr=0.006299, batch_cost=1.3636, reader_cost=0.0001 | ETA 18:07:56 2021-02-23 06:44:03 [INFO] [TRAIN] epoch=87, iter=32140/80000, loss=0.9257, lr=0.006298, batch_cost=1.3318, reader_cost=0.0001 | ETA 17:42:19 2021-02-23 06:44:16 [INFO] [TRAIN] epoch=87, iter=32150/80000, loss=0.9290, lr=0.006297, batch_cost=1.3583, reader_cost=0.0001 | ETA 18:03:12 2021-02-23 06:44:30 [INFO] [TRAIN] epoch=87, iter=32160/80000, loss=0.9529, lr=0.006296, batch_cost=1.3457, reader_cost=0.0001 | ETA 17:52:57 2021-02-23 06:44:43 [INFO] [TRAIN] epoch=87, iter=32170/80000, loss=0.9454, lr=0.006294, batch_cost=1.3398, reader_cost=0.0001 | ETA 17:48:01 2021-02-23 06:44:57 [INFO] [TRAIN] epoch=87, iter=32180/80000, loss=0.9076, lr=0.006293, batch_cost=1.3553, reader_cost=0.0001 | ETA 18:00:11 2021-02-23 06:45:10 [INFO] [TRAIN] epoch=87, iter=32190/80000, loss=0.9896, lr=0.006292, batch_cost=1.3594, reader_cost=0.0001 | ETA 18:03:14 2021-02-23 06:45:24 [INFO] [TRAIN] epoch=87, iter=32200/80000, loss=0.8742, lr=0.006291, batch_cost=1.3520, reader_cost=0.0001 | ETA 17:57:05 2021-02-23 06:45:37 [INFO] [TRAIN] epoch=87, iter=32210/80000, loss=0.8529, lr=0.006290, batch_cost=1.3799, reader_cost=0.0001 | ETA 18:19:04 2021-02-23 06:45:51 [INFO] [TRAIN] epoch=87, iter=32220/80000, loss=0.9003, lr=0.006289, batch_cost=1.3821, reader_cost=0.0001 | ETA 18:20:38 2021-02-23 06:46:05 [INFO] [TRAIN] epoch=87, iter=32230/80000, loss=0.8252, lr=0.006287, batch_cost=1.3596, reader_cost=0.0001 | ETA 18:02:29 2021-02-23 06:46:19 [INFO] [TRAIN] epoch=87, iter=32240/80000, loss=0.8664, lr=0.006286, batch_cost=1.3675, reader_cost=0.0001 | ETA 18:08:31 2021-02-23 06:46:32 [INFO] [TRAIN] epoch=87, iter=32250/80000, loss=0.8325, lr=0.006285, batch_cost=1.3524, reader_cost=0.0001 | ETA 17:56:19 2021-02-23 06:46:46 [INFO] [TRAIN] epoch=87, iter=32260/80000, loss=0.8745, lr=0.006284, batch_cost=1.3435, reader_cost=0.0001 | ETA 17:48:58 2021-02-23 06:47:00 [INFO] [TRAIN] epoch=87, iter=32270/80000, loss=0.9263, lr=0.006283, batch_cost=1.4158, reader_cost=0.0001 | ETA 18:46:13 2021-02-23 06:47:14 [INFO] [TRAIN] epoch=87, iter=32280/80000, loss=0.9254, lr=0.006281, batch_cost=1.3837, reader_cost=0.0001 | ETA 18:20:30 2021-02-23 06:47:27 [INFO] [TRAIN] epoch=87, iter=32290/80000, loss=0.8974, lr=0.006280, batch_cost=1.3563, reader_cost=0.0001 | ETA 17:58:29 2021-02-23 06:47:41 [INFO] [TRAIN] epoch=87, iter=32300/80000, loss=1.0037, lr=0.006279, batch_cost=1.3497, reader_cost=0.0001 | ETA 17:52:58 2021-02-23 06:47:54 [INFO] [TRAIN] epoch=87, iter=32310/80000, loss=0.8896, lr=0.006278, batch_cost=1.3501, reader_cost=0.0001 | ETA 17:53:07 2021-02-23 06:48:08 [INFO] [TRAIN] epoch=87, iter=32320/80000, loss=0.9613, lr=0.006277, batch_cost=1.3544, reader_cost=0.0001 | ETA 17:56:17 2021-02-23 06:48:21 [INFO] [TRAIN] epoch=87, iter=32330/80000, loss=0.8324, lr=0.006275, batch_cost=1.3532, reader_cost=0.0001 | ETA 17:55:06 2021-02-23 06:48:35 [INFO] [TRAIN] epoch=87, iter=32340/80000, loss=0.7945, lr=0.006274, batch_cost=1.3678, reader_cost=0.0001 | ETA 18:06:28 2021-02-23 06:48:48 [INFO] [TRAIN] epoch=87, iter=32350/80000, loss=0.9195, lr=0.006273, batch_cost=1.3313, reader_cost=0.0001 | ETA 17:37:17 2021-02-23 06:49:02 [INFO] [TRAIN] epoch=87, iter=32360/80000, loss=0.8691, lr=0.006272, batch_cost=1.3520, reader_cost=0.0001 | ETA 17:53:30 2021-02-23 06:49:16 [INFO] [TRAIN] epoch=88, iter=32370/80000, loss=0.8992, lr=0.006271, batch_cost=1.4607, reader_cost=0.0748 | ETA 19:19:34 2021-02-23 06:49:30 [INFO] [TRAIN] epoch=88, iter=32380/80000, loss=0.9298, lr=0.006270, batch_cost=1.3516, reader_cost=0.0001 | ETA 17:52:44 2021-02-23 06:49:43 [INFO] [TRAIN] epoch=88, iter=32390/80000, loss=0.8770, lr=0.006268, batch_cost=1.3577, reader_cost=0.0001 | ETA 17:57:21 2021-02-23 06:49:57 [INFO] [TRAIN] epoch=88, iter=32400/80000, loss=1.0178, lr=0.006267, batch_cost=1.3842, reader_cost=0.0001 | ETA 18:18:05 2021-02-23 06:50:11 [INFO] [TRAIN] epoch=88, iter=32410/80000, loss=0.8221, lr=0.006266, batch_cost=1.3779, reader_cost=0.0001 | ETA 18:12:54 2021-02-23 06:50:25 [INFO] [TRAIN] epoch=88, iter=32420/80000, loss=0.9629, lr=0.006265, batch_cost=1.3534, reader_cost=0.0001 | ETA 17:53:15 2021-02-23 06:50:38 [INFO] [TRAIN] epoch=88, iter=32430/80000, loss=0.8696, lr=0.006264, batch_cost=1.3560, reader_cost=0.0001 | ETA 17:55:07 2021-02-23 06:50:52 [INFO] [TRAIN] epoch=88, iter=32440/80000, loss=1.0233, lr=0.006262, batch_cost=1.3533, reader_cost=0.0001 | ETA 17:52:42 2021-02-23 06:51:05 [INFO] [TRAIN] epoch=88, iter=32450/80000, loss=0.8946, lr=0.006261, batch_cost=1.3548, reader_cost=0.0001 | ETA 17:53:39 2021-02-23 06:51:19 [INFO] [TRAIN] epoch=88, iter=32460/80000, loss=0.9587, lr=0.006260, batch_cost=1.3392, reader_cost=0.0001 | ETA 17:41:07 2021-02-23 06:51:32 [INFO] [TRAIN] epoch=88, iter=32470/80000, loss=1.0133, lr=0.006259, batch_cost=1.3700, reader_cost=0.0001 | ETA 18:05:14 2021-02-23 06:51:46 [INFO] [TRAIN] epoch=88, iter=32480/80000, loss=0.8313, lr=0.006258, batch_cost=1.3440, reader_cost=0.0001 | ETA 17:44:28 2021-02-23 06:51:59 [INFO] [TRAIN] epoch=88, iter=32490/80000, loss=0.9366, lr=0.006257, batch_cost=1.3420, reader_cost=0.0001 | ETA 17:42:39 2021-02-23 06:52:13 [INFO] [TRAIN] epoch=88, iter=32500/80000, loss=0.8608, lr=0.006255, batch_cost=1.3450, reader_cost=0.0001 | ETA 17:44:48 2021-02-23 06:52:26 [INFO] [TRAIN] epoch=88, iter=32510/80000, loss=0.8799, lr=0.006254, batch_cost=1.3658, reader_cost=0.0001 | ETA 18:01:02 2021-02-23 06:52:40 [INFO] [TRAIN] epoch=88, iter=32520/80000, loss=0.8892, lr=0.006253, batch_cost=1.3538, reader_cost=0.0001 | ETA 17:51:19 2021-02-23 06:52:53 [INFO] [TRAIN] epoch=88, iter=32530/80000, loss=0.8341, lr=0.006252, batch_cost=1.3624, reader_cost=0.0001 | ETA 17:57:53 2021-02-23 06:53:07 [INFO] [TRAIN] epoch=88, iter=32540/80000, loss=0.8908, lr=0.006251, batch_cost=1.3612, reader_cost=0.0001 | ETA 17:56:41 2021-02-23 06:53:21 [INFO] [TRAIN] epoch=88, iter=32550/80000, loss=0.8797, lr=0.006249, batch_cost=1.3553, reader_cost=0.0001 | ETA 17:51:46 2021-02-23 06:53:34 [INFO] [TRAIN] epoch=88, iter=32560/80000, loss=1.0413, lr=0.006248, batch_cost=1.3415, reader_cost=0.0001 | ETA 17:40:38 2021-02-23 06:53:48 [INFO] [TRAIN] epoch=88, iter=32570/80000, loss=0.8616, lr=0.006247, batch_cost=1.3496, reader_cost=0.0001 | ETA 17:46:52 2021-02-23 06:54:01 [INFO] [TRAIN] epoch=88, iter=32580/80000, loss=0.8795, lr=0.006246, batch_cost=1.3683, reader_cost=0.0001 | ETA 18:01:25 2021-02-23 06:54:15 [INFO] [TRAIN] epoch=88, iter=32590/80000, loss=0.9179, lr=0.006245, batch_cost=1.3415, reader_cost=0.0001 | ETA 17:39:59 2021-02-23 06:54:28 [INFO] [TRAIN] epoch=88, iter=32600/80000, loss=0.8439, lr=0.006243, batch_cost=1.3759, reader_cost=0.0001 | ETA 18:06:56 2021-02-23 06:54:42 [INFO] [TRAIN] epoch=88, iter=32610/80000, loss=0.8899, lr=0.006242, batch_cost=1.3669, reader_cost=0.0001 | ETA 17:59:37 2021-02-23 06:54:56 [INFO] [TRAIN] epoch=88, iter=32620/80000, loss=0.8967, lr=0.006241, batch_cost=1.3786, reader_cost=0.0001 | ETA 18:08:39 2021-02-23 06:55:09 [INFO] [TRAIN] epoch=88, iter=32630/80000, loss=0.8687, lr=0.006240, batch_cost=1.3667, reader_cost=0.0001 | ETA 17:59:01 2021-02-23 06:55:23 [INFO] [TRAIN] epoch=88, iter=32640/80000, loss=0.8008, lr=0.006239, batch_cost=1.3404, reader_cost=0.0001 | ETA 17:38:00 2021-02-23 06:55:37 [INFO] [TRAIN] epoch=88, iter=32650/80000, loss=0.9448, lr=0.006238, batch_cost=1.3665, reader_cost=0.0001 | ETA 17:58:23 2021-02-23 06:55:50 [INFO] [TRAIN] epoch=88, iter=32660/80000, loss=0.9462, lr=0.006236, batch_cost=1.3552, reader_cost=0.0001 | ETA 17:49:13 2021-02-23 06:56:04 [INFO] [TRAIN] epoch=88, iter=32670/80000, loss=0.8731, lr=0.006235, batch_cost=1.3646, reader_cost=0.0001 | ETA 17:56:28 2021-02-23 06:56:17 [INFO] [TRAIN] epoch=88, iter=32680/80000, loss=0.8914, lr=0.006234, batch_cost=1.3700, reader_cost=0.0001 | ETA 18:00:28 2021-02-23 06:56:31 [INFO] [TRAIN] epoch=88, iter=32690/80000, loss=0.8698, lr=0.006233, batch_cost=1.3373, reader_cost=0.0001 | ETA 17:34:25 2021-02-23 06:56:44 [INFO] [TRAIN] epoch=88, iter=32700/80000, loss=0.9465, lr=0.006232, batch_cost=1.3570, reader_cost=0.0001 | ETA 17:49:44 2021-02-23 06:56:58 [INFO] [TRAIN] epoch=88, iter=32710/80000, loss=0.8732, lr=0.006230, batch_cost=1.3596, reader_cost=0.0001 | ETA 17:51:35 2021-02-23 06:57:12 [INFO] [TRAIN] epoch=88, iter=32720/80000, loss=0.8131, lr=0.006229, batch_cost=1.3907, reader_cost=0.0001 | ETA 18:15:53 2021-02-23 06:57:26 [INFO] [TRAIN] epoch=88, iter=32730/80000, loss=0.8671, lr=0.006228, batch_cost=1.3615, reader_cost=0.0001 | ETA 17:52:40 2021-02-23 06:57:40 [INFO] [TRAIN] epoch=89, iter=32740/80000, loss=0.7874, lr=0.006227, batch_cost=1.4339, reader_cost=0.0572 | ETA 18:49:28 2021-02-23 06:57:53 [INFO] [TRAIN] epoch=89, iter=32750/80000, loss=0.8291, lr=0.006226, batch_cost=1.3529, reader_cost=0.0001 | ETA 17:45:24 2021-02-23 06:58:07 [INFO] [TRAIN] epoch=89, iter=32760/80000, loss=0.9143, lr=0.006225, batch_cost=1.3696, reader_cost=0.0001 | ETA 17:58:19 2021-02-23 06:58:20 [INFO] [TRAIN] epoch=89, iter=32770/80000, loss=1.1155, lr=0.006223, batch_cost=1.3292, reader_cost=0.0001 | ETA 17:26:17 2021-02-23 06:58:34 [INFO] [TRAIN] epoch=89, iter=32780/80000, loss=0.8052, lr=0.006222, batch_cost=1.3467, reader_cost=0.0001 | ETA 17:39:49 2021-02-23 06:58:48 [INFO] [TRAIN] epoch=89, iter=32790/80000, loss=0.9200, lr=0.006221, batch_cost=1.3672, reader_cost=0.0001 | ETA 17:55:45 2021-02-23 06:59:01 [INFO] [TRAIN] epoch=89, iter=32800/80000, loss=0.9281, lr=0.006220, batch_cost=1.3617, reader_cost=0.0001 | ETA 17:51:11 2021-02-23 06:59:15 [INFO] [TRAIN] epoch=89, iter=32810/80000, loss=0.9258, lr=0.006219, batch_cost=1.3668, reader_cost=0.0001 | ETA 17:55:01 2021-02-23 06:59:29 [INFO] [TRAIN] epoch=89, iter=32820/80000, loss=0.9251, lr=0.006217, batch_cost=1.3984, reader_cost=0.0001 | ETA 18:19:38 2021-02-23 06:59:43 [INFO] [TRAIN] epoch=89, iter=32830/80000, loss=0.9288, lr=0.006216, batch_cost=1.3809, reader_cost=0.0001 | ETA 18:05:37 2021-02-23 06:59:56 [INFO] [TRAIN] epoch=89, iter=32840/80000, loss=0.8530, lr=0.006215, batch_cost=1.3770, reader_cost=0.0001 | ETA 18:02:17 2021-02-23 07:00:10 [INFO] [TRAIN] epoch=89, iter=32850/80000, loss=0.9555, lr=0.006214, batch_cost=1.3724, reader_cost=0.0001 | ETA 17:58:27 2021-02-23 07:00:24 [INFO] [TRAIN] epoch=89, iter=32860/80000, loss=0.8876, lr=0.006213, batch_cost=1.3596, reader_cost=0.0001 | ETA 17:48:09 2021-02-23 07:00:37 [INFO] [TRAIN] epoch=89, iter=32870/80000, loss=0.9724, lr=0.006211, batch_cost=1.3566, reader_cost=0.0001 | ETA 17:45:35 2021-02-23 07:00:51 [INFO] [TRAIN] epoch=89, iter=32880/80000, loss=1.0509, lr=0.006210, batch_cost=1.3446, reader_cost=0.0001 | ETA 17:35:57 2021-02-23 07:01:04 [INFO] [TRAIN] epoch=89, iter=32890/80000, loss=0.8415, lr=0.006209, batch_cost=1.3511, reader_cost=0.0001 | ETA 17:40:48 2021-02-23 07:01:18 [INFO] [TRAIN] epoch=89, iter=32900/80000, loss=0.8912, lr=0.006208, batch_cost=1.3494, reader_cost=0.0001 | ETA 17:39:17 2021-02-23 07:01:31 [INFO] [TRAIN] epoch=89, iter=32910/80000, loss=0.8537, lr=0.006207, batch_cost=1.3533, reader_cost=0.0001 | ETA 17:42:06 2021-02-23 07:01:45 [INFO] [TRAIN] epoch=89, iter=32920/80000, loss=0.9409, lr=0.006206, batch_cost=1.3648, reader_cost=0.0001 | ETA 17:50:52 2021-02-23 07:01:58 [INFO] [TRAIN] epoch=89, iter=32930/80000, loss=0.8808, lr=0.006204, batch_cost=1.3452, reader_cost=0.0001 | ETA 17:35:17 2021-02-23 07:02:12 [INFO] [TRAIN] epoch=89, iter=32940/80000, loss=0.9385, lr=0.006203, batch_cost=1.3542, reader_cost=0.0001 | ETA 17:42:07 2021-02-23 07:02:26 [INFO] [TRAIN] epoch=89, iter=32950/80000, loss=0.8821, lr=0.006202, batch_cost=1.3653, reader_cost=0.0001 | ETA 17:50:37 2021-02-23 07:02:39 [INFO] [TRAIN] epoch=89, iter=32960/80000, loss=0.8493, lr=0.006201, batch_cost=1.3573, reader_cost=0.0001 | ETA 17:44:06 2021-02-23 07:02:53 [INFO] [TRAIN] epoch=89, iter=32970/80000, loss=0.8849, lr=0.006200, batch_cost=1.3774, reader_cost=0.0001 | ETA 17:59:41 2021-02-23 07:03:06 [INFO] [TRAIN] epoch=89, iter=32980/80000, loss=0.8821, lr=0.006198, batch_cost=1.3516, reader_cost=0.0001 | ETA 17:39:13 2021-02-23 07:03:20 [INFO] [TRAIN] epoch=89, iter=32990/80000, loss=0.9848, lr=0.006197, batch_cost=1.3791, reader_cost=0.0001 | ETA 18:00:29 2021-02-23 07:03:34 [INFO] [TRAIN] epoch=89, iter=33000/80000, loss=0.9020, lr=0.006196, batch_cost=1.3664, reader_cost=0.0001 | ETA 17:50:22 2021-02-23 07:03:34 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:20 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:07 - batch_cost: 0.2231 - reader cost: 0.0852  3/125 [..............................] - ETA: 59s - batch_cost: 0.2728 - reader cost: 0.0984  4/125 [..............................] - ETA: 58s - batch_cost: 0.3205 - reader cost: 0.1265 5/125 [>.............................] - ETA: 56s - batch_cost: 0.3419 - reader cost: 0.1364 6/125 [>.............................] - ETA: 55s - batch_cost: 0.3601 - reader cost: 0.1438 7/125 [>.............................] - ETA: 54s - batch_cost: 0.3708 - reader cost: 0.1493 8/125 [>.............................] - ETA: 53s - batch_cost: 0.3722 - reader cost: 0.1473 9/125 [=>............................] - ETA: 52s - batch_cost: 0.3779 - reader cost: 0.1501 10/125 [=>............................] - ETA: 51s - batch_cost: 0.3803 - reader cost: 0.1499 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3871 - reader cost: 0.1550 12/125 [=>............................] - ETA: 50s - batch_cost: 0.3911 - reader cost: 0.1570 13/125 [==>...........................] - ETA: 49s - batch_cost: 0.3905 - reader cost: 0.1551 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3943 - reader cost: 0.1572 15/125 [==>...........................] - ETA: 48s - batch_cost: 0.3944 - reader cost: 0.1563 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3976 - reader cost: 0.1581 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3961 - reader cost: 0.1558 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.3977 - reader cost: 0.1566 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3982 - reader cost: 0.1566 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4002 - reader cost: 0.1575 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4013 - reader cost: 0.1582 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4040 - reader cost: 0.1601 23/125 [====>.........................] - ETA: 44s - batch_cost: 0.4057 - reader cost: 0.1610 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4065 - reader cost: 0.1616 25/125 [=====>........................] - ETA: 43s - batch_cost: 0.4056 - reader cost: 0.1604 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4069 - reader cost: 0.1616 27/125 [=====>........................] - ETA: 42s - batch_cost: 0.4060 - reader cost: 0.1603 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4062 - reader cost: 0.1600 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4076 - reader cost: 0.1612 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4087 - reader cost: 0.1622 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4091 - reader cost: 0.1621 32/125 [======>.......................] - ETA: 40s - batch_cost: 0.4105 - reader cost: 0.1635 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4114 - reader cost: 0.1641 34/125 [=======>......................] - ETA: 39s - batch_cost: 0.4106 - reader cost: 0.1631 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4113 - reader cost: 0.1635 36/125 [=======>......................] - ETA: 38s - batch_cost: 0.4119 - reader cost: 0.1640 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4125 - reader cost: 0.1644 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4132 - reader cost: 0.1648 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4126 - reader cost: 0.1638 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4126 - reader cost: 0.1638 41/125 [========>.....................] - ETA: 36s - batch_cost: 0.4132 - reader cost: 0.1640 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4131 - reader cost: 0.1637 43/125 [=========>....................] - ETA: 35s - batch_cost: 0.4134 - reader cost: 0.1640 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4148 - reader cost: 0.1650 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4150 - reader cost: 0.1651 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4153 - reader cost: 0.1653 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4158 - reader cost: 0.1656 48/125 [==========>...................] - ETA: 33s - batch_cost: 0.4165 - reader cost: 0.1661 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4167 - reader cost: 0.1661 50/125 [===========>..................] - ETA: 32s - batch_cost: 0.4170 - reader cost: 0.1664 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4172 - reader cost: 0.1664 52/125 [===========>..................] - ETA: 31s - batch_cost: 0.4173 - reader cost: 0.1665 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4178 - reader cost: 0.1668 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4179 - reader cost: 0.1668 55/125 [============>.................] - ETA: 30s - batch_cost: 0.4181 - reader cost: 0.1670 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4185 - reader cost: 0.1672 57/125 [============>.................] - ETA: 29s - batch_cost: 0.4187 - reader cost: 0.1675 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4181 - reader cost: 0.1669 59/125 [=============>................] - ETA: 28s - batch_cost: 0.4181 - reader cost: 0.1669 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4174 - reader cost: 0.1660 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4178 - reader cost: 0.1662 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4178 - reader cost: 0.1661 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4179 - reader cost: 0.1663 64/125 [==============>...............] - ETA: 26s - batch_cost: 0.4176 - reader cost: 0.1658 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4177 - reader cost: 0.1659 66/125 [==============>...............] - ETA: 25s - batch_cost: 0.4179 - reader cost: 0.1661 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4181 - reader cost: 0.1663 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4174 - reader cost: 0.1654 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4174 - reader cost: 0.1654 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4169 - reader cost: 0.1648 71/125 [================>.............] - ETA: 23s - batch_cost: 0.4170 - reader cost: 0.1649 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4171 - reader cost: 0.1650 73/125 [================>.............] - ETA: 22s - batch_cost: 0.4166 - reader cost: 0.1642 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4157 - reader cost: 0.1633 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4150 - reader cost: 0.1626 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4154 - reader cost: 0.1629 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4156 - reader cost: 0.1632 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4161 - reader cost: 0.1636 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4153 - reader cost: 0.1628 80/125 [==================>...........] - ETA: 19s - batch_cost: 0.4149 - reader cost: 0.1623 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4149 - reader cost: 0.1624 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4154 - reader cost: 0.1628 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4155 - reader cost: 0.1628 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4159 - reader cost: 0.1631 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4160 - reader cost: 0.1632 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4155 - reader cost: 0.1627 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4153 - reader cost: 0.1625 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4155 - reader cost: 0.1626 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4153 - reader cost: 0.1624 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4155 - reader cost: 0.1626 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4158 - reader cost: 0.1628 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4153 - reader cost: 0.1624 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4149 - reader cost: 0.1618 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4142 - reader cost: 0.1611 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4142 - reader cost: 0.1611 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4143 - reader cost: 0.1613 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4144 - reader cost: 0.1614 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4142 - reader cost: 0.1611 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4142 - reader cost: 0.1612 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4147 - reader cost: 0.1616 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4149 - reader cost: 0.1618 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4150 - reader cost: 0.1619  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4151 - reader cost: 0.1619 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4147 - reader cost: 0.1616 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4149 - reader cost: 0.1617 106/125 [========================>.....] - ETA: 8s - batch_cost: 0.4150 - reader cost: 0.1619 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4148 - reader cost: 0.1617 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4150 - reader cost: 0.1618 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4151 - reader cost: 0.1619 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4146 - reader cost: 0.1615 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4147 - reader cost: 0.1616 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4149 - reader cost: 0.1617 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4144 - reader cost: 0.1613 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4145 - reader cost: 0.1614 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4145 - reader cost: 0.1614 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4144 - reader cost: 0.1612 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4138 - reader cost: 0.1606 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4135 - reader cost: 0.1603 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4132 - reader cost: 0.1600 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4135 - reader cost: 0.1599 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4132 - reader cost: 0.1594 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4130 - reader cost: 0.1593 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4130 - reader cost: 0.1592 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4131 - reader cost: 0.1594 125/125 [==============================] - 52s 418ms/step - batch_cost: 0.4130 - reader cost: 0.1592 2021-02-23 07:04:26 [INFO] [EVAL] #Images=500 mIoU=0.7333 Acc=0.9551 Kappa=0.9416 2021-02-23 07:04:26 [INFO] [EVAL] Class IoU: [0.9763 0.8198 0.9167 0.4552 0.5432 0.6507 0.7237 0.7978 0.9185 0.5489 0.9375 0.8121 0.6061 0.9426 0.6569 0.7591 0.491 0.608 0.7684] 2021-02-23 07:04:26 [INFO] [EVAL] Class Acc: [0.9831 0.9111 0.9594 0.8135 0.8278 0.8091 0.8299 0.9151 0.9416 0.8994 0.9521 0.9056 0.7432 0.9678 0.872 0.9128 0.5211 0.7442 0.8458] 2021-02-23 07:04:31 [INFO] [EVAL] The model with the best validation mIoU (0.7576) was saved at iter 31000. 2021-02-23 07:04:44 [INFO] [TRAIN] epoch=89, iter=33010/80000, loss=0.9063, lr=0.006195, batch_cost=1.3817, reader_cost=0.0001 | ETA 18:02:04 2021-02-23 07:04:58 [INFO] [TRAIN] epoch=89, iter=33020/80000, loss=0.7861, lr=0.006194, batch_cost=1.3617, reader_cost=0.0001 | ETA 17:46:14 2021-02-23 07:05:11 [INFO] [TRAIN] epoch=89, iter=33030/80000, loss=0.8851, lr=0.006192, batch_cost=1.3440, reader_cost=0.0001 | ETA 17:32:08 2021-02-23 07:05:25 [INFO] [TRAIN] epoch=89, iter=33040/80000, loss=0.8635, lr=0.006191, batch_cost=1.3880, reader_cost=0.0001 | ETA 18:06:21 2021-02-23 07:05:39 [INFO] [TRAIN] epoch=89, iter=33050/80000, loss=0.8923, lr=0.006190, batch_cost=1.3640, reader_cost=0.0001 | ETA 17:47:19 2021-02-23 07:05:53 [INFO] [TRAIN] epoch=89, iter=33060/80000, loss=0.9593, lr=0.006189, batch_cost=1.3665, reader_cost=0.0001 | ETA 17:49:02 2021-02-23 07:06:06 [INFO] [TRAIN] epoch=89, iter=33070/80000, loss=0.8504, lr=0.006188, batch_cost=1.3789, reader_cost=0.0001 | ETA 17:58:31 2021-02-23 07:06:20 [INFO] [TRAIN] epoch=89, iter=33080/80000, loss=0.9101, lr=0.006187, batch_cost=1.3629, reader_cost=0.0001 | ETA 17:45:45 2021-02-23 07:06:34 [INFO] [TRAIN] epoch=89, iter=33090/80000, loss=0.9531, lr=0.006185, batch_cost=1.4076, reader_cost=0.0001 | ETA 18:20:31 2021-02-23 07:06:48 [INFO] [TRAIN] epoch=89, iter=33100/80000, loss=0.8678, lr=0.006184, batch_cost=1.3496, reader_cost=0.0001 | ETA 17:34:55 2021-02-23 07:07:02 [INFO] [TRAIN] epoch=90, iter=33110/80000, loss=0.9360, lr=0.006183, batch_cost=1.3910, reader_cost=0.0724 | ETA 18:07:05 2021-02-23 07:07:15 [INFO] [TRAIN] epoch=90, iter=33120/80000, loss=0.8940, lr=0.006182, batch_cost=1.3457, reader_cost=0.0003 | ETA 17:31:24 2021-02-23 07:07:29 [INFO] [TRAIN] epoch=90, iter=33130/80000, loss=0.8854, lr=0.006181, batch_cost=1.3683, reader_cost=0.0001 | ETA 17:48:52 2021-02-23 07:07:42 [INFO] [TRAIN] epoch=90, iter=33140/80000, loss=0.8464, lr=0.006179, batch_cost=1.3635, reader_cost=0.0001 | ETA 17:44:55 2021-02-23 07:07:56 [INFO] [TRAIN] epoch=90, iter=33150/80000, loss=0.8473, lr=0.006178, batch_cost=1.3512, reader_cost=0.0001 | ETA 17:35:05 2021-02-23 07:08:09 [INFO] [TRAIN] epoch=90, iter=33160/80000, loss=0.8881, lr=0.006177, batch_cost=1.3509, reader_cost=0.0001 | ETA 17:34:36 2021-02-23 07:08:23 [INFO] [TRAIN] epoch=90, iter=33170/80000, loss=0.9167, lr=0.006176, batch_cost=1.3566, reader_cost=0.0001 | ETA 17:38:51 2021-02-23 07:08:37 [INFO] [TRAIN] epoch=90, iter=33180/80000, loss=0.8762, lr=0.006175, batch_cost=1.3780, reader_cost=0.0001 | ETA 17:55:19 2021-02-23 07:08:50 [INFO] [TRAIN] epoch=90, iter=33190/80000, loss=0.9577, lr=0.006174, batch_cost=1.3721, reader_cost=0.0001 | ETA 17:50:25 2021-02-23 07:09:04 [INFO] [TRAIN] epoch=90, iter=33200/80000, loss=0.8579, lr=0.006172, batch_cost=1.3785, reader_cost=0.0001 | ETA 17:55:13 2021-02-23 07:09:18 [INFO] [TRAIN] epoch=90, iter=33210/80000, loss=1.0380, lr=0.006171, batch_cost=1.3619, reader_cost=0.0001 | ETA 17:42:01 2021-02-23 07:09:31 [INFO] [TRAIN] epoch=90, iter=33220/80000, loss=0.8825, lr=0.006170, batch_cost=1.3464, reader_cost=0.0001 | ETA 17:29:45 2021-02-23 07:09:45 [INFO] [TRAIN] epoch=90, iter=33230/80000, loss=0.9741, lr=0.006169, batch_cost=1.3446, reader_cost=0.0001 | ETA 17:28:06 2021-02-23 07:09:59 [INFO] [TRAIN] epoch=90, iter=33240/80000, loss=0.8773, lr=0.006168, batch_cost=1.3856, reader_cost=0.0001 | ETA 17:59:49 2021-02-23 07:10:12 [INFO] [TRAIN] epoch=90, iter=33250/80000, loss=0.8592, lr=0.006166, batch_cost=1.3669, reader_cost=0.0001 | ETA 17:45:04 2021-02-23 07:10:26 [INFO] [TRAIN] epoch=90, iter=33260/80000, loss=0.9069, lr=0.006165, batch_cost=1.3542, reader_cost=0.0001 | ETA 17:34:53 2021-02-23 07:10:39 [INFO] [TRAIN] epoch=90, iter=33270/80000, loss=0.8496, lr=0.006164, batch_cost=1.3622, reader_cost=0.0001 | ETA 17:40:53 2021-02-23 07:10:53 [INFO] [TRAIN] epoch=90, iter=33280/80000, loss=0.9735, lr=0.006163, batch_cost=1.3544, reader_cost=0.0001 | ETA 17:34:35 2021-02-23 07:11:06 [INFO] [TRAIN] epoch=90, iter=33290/80000, loss=0.8417, lr=0.006162, batch_cost=1.3506, reader_cost=0.0001 | ETA 17:31:27 2021-02-23 07:11:20 [INFO] [TRAIN] epoch=90, iter=33300/80000, loss=0.9604, lr=0.006160, batch_cost=1.3616, reader_cost=0.0001 | ETA 17:39:48 2021-02-23 07:11:33 [INFO] [TRAIN] epoch=90, iter=33310/80000, loss=0.9194, lr=0.006159, batch_cost=1.3402, reader_cost=0.0001 | ETA 17:22:52 2021-02-23 07:11:47 [INFO] [TRAIN] epoch=90, iter=33320/80000, loss=0.9451, lr=0.006158, batch_cost=1.3457, reader_cost=0.0001 | ETA 17:26:56 2021-02-23 07:12:01 [INFO] [TRAIN] epoch=90, iter=33330/80000, loss=0.8426, lr=0.006157, batch_cost=1.3787, reader_cost=0.0001 | ETA 17:52:22 2021-02-23 07:12:15 [INFO] [TRAIN] epoch=90, iter=33340/80000, loss=0.8586, lr=0.006156, batch_cost=1.3999, reader_cost=0.0001 | ETA 18:08:37 2021-02-23 07:12:29 [INFO] [TRAIN] epoch=90, iter=33350/80000, loss=0.8588, lr=0.006155, batch_cost=1.3838, reader_cost=0.0001 | ETA 17:55:55 2021-02-23 07:12:42 [INFO] [TRAIN] epoch=90, iter=33360/80000, loss=0.8843, lr=0.006153, batch_cost=1.3605, reader_cost=0.0001 | ETA 17:37:34 2021-02-23 07:12:56 [INFO] [TRAIN] epoch=90, iter=33370/80000, loss=0.9853, lr=0.006152, batch_cost=1.3824, reader_cost=0.0001 | ETA 17:54:22 2021-02-23 07:13:09 [INFO] [TRAIN] epoch=90, iter=33380/80000, loss=0.8580, lr=0.006151, batch_cost=1.3417, reader_cost=0.0001 | ETA 17:22:30 2021-02-23 07:13:23 [INFO] [TRAIN] epoch=90, iter=33390/80000, loss=0.9240, lr=0.006150, batch_cost=1.3403, reader_cost=0.0001 | ETA 17:21:12 2021-02-23 07:13:36 [INFO] [TRAIN] epoch=90, iter=33400/80000, loss=0.9520, lr=0.006149, batch_cost=1.3652, reader_cost=0.0001 | ETA 17:40:17 2021-02-23 07:13:50 [INFO] [TRAIN] epoch=90, iter=33410/80000, loss=0.9422, lr=0.006147, batch_cost=1.3480, reader_cost=0.0001 | ETA 17:26:44 2021-02-23 07:14:04 [INFO] [TRAIN] epoch=90, iter=33420/80000, loss=0.9598, lr=0.006146, batch_cost=1.3713, reader_cost=0.0001 | ETA 17:44:36 2021-02-23 07:14:17 [INFO] [TRAIN] epoch=90, iter=33430/80000, loss=0.8588, lr=0.006145, batch_cost=1.3614, reader_cost=0.0001 | ETA 17:36:38 2021-02-23 07:14:31 [INFO] [TRAIN] epoch=90, iter=33440/80000, loss=0.8965, lr=0.006144, batch_cost=1.3399, reader_cost=0.0001 | ETA 17:19:45 2021-02-23 07:14:44 [INFO] [TRAIN] epoch=90, iter=33450/80000, loss=0.8969, lr=0.006143, batch_cost=1.3471, reader_cost=0.0001 | ETA 17:25:06 2021-02-23 07:14:58 [INFO] [TRAIN] epoch=90, iter=33460/80000, loss=0.9005, lr=0.006141, batch_cost=1.3663, reader_cost=0.0001 | ETA 17:39:47 2021-02-23 07:15:11 [INFO] [TRAIN] epoch=90, iter=33470/80000, loss=0.8891, lr=0.006140, batch_cost=1.3403, reader_cost=0.0001 | ETA 17:19:22 2021-02-23 07:15:25 [INFO] [TRAIN] epoch=90, iter=33480/80000, loss=0.9858, lr=0.006139, batch_cost=1.3342, reader_cost=0.0001 | ETA 17:14:28 2021-02-23 07:15:39 [INFO] [TRAIN] epoch=91, iter=33490/80000, loss=0.8790, lr=0.006138, batch_cost=1.4731, reader_cost=0.0692 | ETA 19:01:55 2021-02-23 07:15:53 [INFO] [TRAIN] epoch=91, iter=33500/80000, loss=0.9239, lr=0.006137, batch_cost=1.3544, reader_cost=0.0001 | ETA 17:29:41 2021-02-23 07:16:06 [INFO] [TRAIN] epoch=91, iter=33510/80000, loss=0.8380, lr=0.006136, batch_cost=1.3413, reader_cost=0.0001 | ETA 17:19:19 2021-02-23 07:16:20 [INFO] [TRAIN] epoch=91, iter=33520/80000, loss=0.8586, lr=0.006134, batch_cost=1.3707, reader_cost=0.0001 | ETA 17:41:51 2021-02-23 07:16:33 [INFO] [TRAIN] epoch=91, iter=33530/80000, loss=0.8920, lr=0.006133, batch_cost=1.3564, reader_cost=0.0001 | ETA 17:30:32 2021-02-23 07:16:47 [INFO] [TRAIN] epoch=91, iter=33540/80000, loss=0.9910, lr=0.006132, batch_cost=1.3800, reader_cost=0.0001 | ETA 17:48:35 2021-02-23 07:17:01 [INFO] [TRAIN] epoch=91, iter=33550/80000, loss=0.9519, lr=0.006131, batch_cost=1.3708, reader_cost=0.0001 | ETA 17:41:12 2021-02-23 07:17:14 [INFO] [TRAIN] epoch=91, iter=33560/80000, loss=0.8736, lr=0.006130, batch_cost=1.3467, reader_cost=0.0001 | ETA 17:22:21 2021-02-23 07:17:28 [INFO] [TRAIN] epoch=91, iter=33570/80000, loss=0.9236, lr=0.006128, batch_cost=1.3799, reader_cost=0.0001 | ETA 17:47:50 2021-02-23 07:17:42 [INFO] [TRAIN] epoch=91, iter=33580/80000, loss=0.8355, lr=0.006127, batch_cost=1.3645, reader_cost=0.0001 | ETA 17:35:42 2021-02-23 07:17:56 [INFO] [TRAIN] epoch=91, iter=33590/80000, loss=0.8816, lr=0.006126, batch_cost=1.3743, reader_cost=0.0001 | ETA 17:43:02 2021-02-23 07:18:09 [INFO] [TRAIN] epoch=91, iter=33600/80000, loss=0.8691, lr=0.006125, batch_cost=1.3472, reader_cost=0.0001 | ETA 17:21:49 2021-02-23 07:18:23 [INFO] [TRAIN] epoch=91, iter=33610/80000, loss=0.9720, lr=0.006124, batch_cost=1.3866, reader_cost=0.0001 | ETA 17:52:06 2021-02-23 07:18:36 [INFO] [TRAIN] epoch=91, iter=33620/80000, loss=0.9479, lr=0.006122, batch_cost=1.3502, reader_cost=0.0001 | ETA 17:23:41 2021-02-23 07:18:50 [INFO] [TRAIN] epoch=91, iter=33630/80000, loss=0.8498, lr=0.006121, batch_cost=1.3780, reader_cost=0.0002 | ETA 17:44:57 2021-02-23 07:19:04 [INFO] [TRAIN] epoch=91, iter=33640/80000, loss=0.9220, lr=0.006120, batch_cost=1.3342, reader_cost=0.0001 | ETA 17:10:54 2021-02-23 07:19:17 [INFO] [TRAIN] epoch=91, iter=33650/80000, loss=0.8365, lr=0.006119, batch_cost=1.3702, reader_cost=0.0001 | ETA 17:38:28 2021-02-23 07:19:31 [INFO] [TRAIN] epoch=91, iter=33660/80000, loss=0.9121, lr=0.006118, batch_cost=1.3880, reader_cost=0.0001 | ETA 17:52:01 2021-02-23 07:19:45 [INFO] [TRAIN] epoch=91, iter=33670/80000, loss=0.8299, lr=0.006117, batch_cost=1.4099, reader_cost=0.0001 | ETA 18:08:40 2021-02-23 07:19:59 [INFO] [TRAIN] epoch=91, iter=33680/80000, loss=0.8254, lr=0.006115, batch_cost=1.3710, reader_cost=0.0001 | ETA 17:38:25 2021-02-23 07:20:12 [INFO] [TRAIN] epoch=91, iter=33690/80000, loss=0.8477, lr=0.006114, batch_cost=1.3452, reader_cost=0.0001 | ETA 17:18:15 2021-02-23 07:20:26 [INFO] [TRAIN] epoch=91, iter=33700/80000, loss=0.8173, lr=0.006113, batch_cost=1.3810, reader_cost=0.0001 | ETA 17:45:41 2021-02-23 07:20:40 [INFO] [TRAIN] epoch=91, iter=33710/80000, loss=0.8209, lr=0.006112, batch_cost=1.3735, reader_cost=0.0001 | ETA 17:39:41 2021-02-23 07:20:54 [INFO] [TRAIN] epoch=91, iter=33720/80000, loss=0.8749, lr=0.006111, batch_cost=1.3572, reader_cost=0.0001 | ETA 17:26:49 2021-02-23 07:21:07 [INFO] [TRAIN] epoch=91, iter=33730/80000, loss=0.8672, lr=0.006109, batch_cost=1.3611, reader_cost=0.0001 | ETA 17:29:36 2021-02-23 07:21:21 [INFO] [TRAIN] epoch=91, iter=33740/80000, loss=0.9148, lr=0.006108, batch_cost=1.3678, reader_cost=0.0001 | ETA 17:34:36 2021-02-23 07:21:34 [INFO] [TRAIN] epoch=91, iter=33750/80000, loss=1.0088, lr=0.006107, batch_cost=1.3443, reader_cost=0.0001 | ETA 17:16:13 2021-02-23 07:21:48 [INFO] [TRAIN] epoch=91, iter=33760/80000, loss=0.8367, lr=0.006106, batch_cost=1.3624, reader_cost=0.0001 | ETA 17:29:57 2021-02-23 07:22:01 [INFO] [TRAIN] epoch=91, iter=33770/80000, loss=0.8897, lr=0.006105, batch_cost=1.3382, reader_cost=0.0001 | ETA 17:11:05 2021-02-23 07:22:15 [INFO] [TRAIN] epoch=91, iter=33780/80000, loss=0.9212, lr=0.006103, batch_cost=1.3817, reader_cost=0.0001 | ETA 17:44:22 2021-02-23 07:22:29 [INFO] [TRAIN] epoch=91, iter=33790/80000, loss=0.8758, lr=0.006102, batch_cost=1.3469, reader_cost=0.0001 | ETA 17:17:20 2021-02-23 07:22:42 [INFO] [TRAIN] epoch=91, iter=33800/80000, loss=1.0554, lr=0.006101, batch_cost=1.3337, reader_cost=0.0001 | ETA 17:06:59 2021-02-23 07:22:56 [INFO] [TRAIN] epoch=91, iter=33810/80000, loss=0.8287, lr=0.006100, batch_cost=1.3810, reader_cost=0.0001 | ETA 17:43:09 2021-02-23 07:23:09 [INFO] [TRAIN] epoch=91, iter=33820/80000, loss=0.9065, lr=0.006099, batch_cost=1.3447, reader_cost=0.0001 | ETA 17:14:59 2021-02-23 07:23:23 [INFO] [TRAIN] epoch=91, iter=33830/80000, loss=0.8364, lr=0.006097, batch_cost=1.3654, reader_cost=0.0001 | ETA 17:30:38 2021-02-23 07:23:36 [INFO] [TRAIN] epoch=91, iter=33840/80000, loss=0.8524, lr=0.006096, batch_cost=1.3547, reader_cost=0.0001 | ETA 17:22:11 2021-02-23 07:23:50 [INFO] [TRAIN] epoch=91, iter=33850/80000, loss=0.8870, lr=0.006095, batch_cost=1.3376, reader_cost=0.0001 | ETA 17:08:51 2021-02-23 07:24:05 [INFO] [TRAIN] epoch=92, iter=33860/80000, loss=1.0351, lr=0.006094, batch_cost=1.4767, reader_cost=0.0829 | ETA 18:55:36 2021-02-23 07:24:18 [INFO] [TRAIN] epoch=92, iter=33870/80000, loss=0.8858, lr=0.006093, batch_cost=1.3796, reader_cost=0.0001 | ETA 17:40:39 2021-02-23 07:24:32 [INFO] [TRAIN] epoch=92, iter=33880/80000, loss=0.9070, lr=0.006092, batch_cost=1.3502, reader_cost=0.0001 | ETA 17:17:52 2021-02-23 07:24:45 [INFO] [TRAIN] epoch=92, iter=33890/80000, loss=0.8544, lr=0.006090, batch_cost=1.3567, reader_cost=0.0001 | ETA 17:22:39 2021-02-23 07:24:59 [INFO] [TRAIN] epoch=92, iter=33900/80000, loss=1.0062, lr=0.006089, batch_cost=1.4000, reader_cost=0.0001 | ETA 17:55:41 2021-02-23 07:25:13 [INFO] [TRAIN] epoch=92, iter=33910/80000, loss=1.0326, lr=0.006088, batch_cost=1.3717, reader_cost=0.0001 | ETA 17:33:41 2021-02-23 07:25:27 [INFO] [TRAIN] epoch=92, iter=33920/80000, loss=0.8370, lr=0.006087, batch_cost=1.3660, reader_cost=0.0001 | ETA 17:29:03 2021-02-23 07:25:40 [INFO] [TRAIN] epoch=92, iter=33930/80000, loss=0.9094, lr=0.006086, batch_cost=1.3459, reader_cost=0.0001 | ETA 17:13:27 2021-02-23 07:25:54 [INFO] [TRAIN] epoch=92, iter=33940/80000, loss=0.9399, lr=0.006084, batch_cost=1.3574, reader_cost=0.0001 | ETA 17:22:02 2021-02-23 07:26:07 [INFO] [TRAIN] epoch=92, iter=33950/80000, loss=0.8518, lr=0.006083, batch_cost=1.3299, reader_cost=0.0001 | ETA 17:00:39 2021-02-23 07:26:21 [INFO] [TRAIN] epoch=92, iter=33960/80000, loss=0.8691, lr=0.006082, batch_cost=1.3683, reader_cost=0.0001 | ETA 17:29:56 2021-02-23 07:26:35 [INFO] [TRAIN] epoch=92, iter=33970/80000, loss=0.8935, lr=0.006081, batch_cost=1.3865, reader_cost=0.0001 | ETA 17:43:39 2021-02-23 07:26:48 [INFO] [TRAIN] epoch=92, iter=33980/80000, loss=0.9263, lr=0.006080, batch_cost=1.3474, reader_cost=0.0001 | ETA 17:13:26 2021-02-23 07:27:02 [INFO] [TRAIN] epoch=92, iter=33990/80000, loss=0.9078, lr=0.006078, batch_cost=1.3353, reader_cost=0.0001 | ETA 17:03:57 2021-02-23 07:27:15 [INFO] [TRAIN] epoch=92, iter=34000/80000, loss=0.8913, lr=0.006077, batch_cost=1.3649, reader_cost=0.0001 | ETA 17:26:25 2021-02-23 07:27:15 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:01 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 58s - batch_cost: 0.2249 - reader cost: 0.0900  3/125 [..............................] - ETA: 58s - batch_cost: 0.3106 - reader cost: 0.1378 4/125 [..............................] - ETA: 55s - batch_cost: 0.3321 - reader cost: 0.1382 5/125 [>.............................] - ETA: 54s - batch_cost: 0.3504 - reader cost: 0.1340 6/125 [>.............................] - ETA: 52s - batch_cost: 0.3616 - reader cost: 0.1395 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3710 - reader cost: 0.1450 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3744 - reader cost: 0.1416 9/125 [=>............................] - ETA: 50s - batch_cost: 0.3762 - reader cost: 0.1417 10/125 [=>............................] - ETA: 49s - batch_cost: 0.3823 - reader cost: 0.1454 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3868 - reader cost: 0.1483 12/125 [=>............................] - ETA: 48s - batch_cost: 0.3891 - reader cost: 0.1461 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3945 - reader cost: 0.1484 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3975 - reader cost: 0.1507 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.4002 - reader cost: 0.1527 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.4019 - reader cost: 0.1521 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.4042 - reader cost: 0.1506 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.4052 - reader cost: 0.1486 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.4068 - reader cost: 0.1507 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4080 - reader cost: 0.1522 21/125 [====>.........................] - ETA: 45s - batch_cost: 0.4091 - reader cost: 0.1538 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4117 - reader cost: 0.1558 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4095 - reader cost: 0.1536 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4098 - reader cost: 0.1536 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4073 - reader cost: 0.1512 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4083 - reader cost: 0.1525 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4090 - reader cost: 0.1534 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4088 - reader cost: 0.1524 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4100 - reader cost: 0.1511 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4082 - reader cost: 0.1482 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4096 - reader cost: 0.1472 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4098 - reader cost: 0.1464 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4112 - reader cost: 0.1474 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4110 - reader cost: 0.1474 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4120 - reader cost: 0.1466 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4126 - reader cost: 0.1458 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4132 - reader cost: 0.1468 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4132 - reader cost: 0.1469 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4138 - reader cost: 0.1472 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4141 - reader cost: 0.1478 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4146 - reader cost: 0.1487 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4138 - reader cost: 0.1481 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4127 - reader cost: 0.1472 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4131 - reader cost: 0.1480 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4144 - reader cost: 0.1493 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4150 - reader cost: 0.1500 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4151 - reader cost: 0.1506 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4145 - reader cost: 0.1502 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4148 - reader cost: 0.1507 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4157 - reader cost: 0.1513 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4162 - reader cost: 0.1519 52/125 [===========>..................] - ETA: 31s - batch_cost: 0.4166 - reader cost: 0.1515 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4171 - reader cost: 0.1519 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4170 - reader cost: 0.1521 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4172 - reader cost: 0.1526 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4167 - reader cost: 0.1523 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4171 - reader cost: 0.1529 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4175 - reader cost: 0.1536 59/125 [=============>................] - ETA: 28s - batch_cost: 0.4176 - reader cost: 0.1539 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4171 - reader cost: 0.1536 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4177 - reader cost: 0.1543 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4172 - reader cost: 0.1539 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4173 - reader cost: 0.1542 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4176 - reader cost: 0.1545 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4180 - reader cost: 0.1551 66/125 [==============>...............] - ETA: 25s - batch_cost: 0.4185 - reader cost: 0.1556 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4187 - reader cost: 0.1560 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4190 - reader cost: 0.1563 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4193 - reader cost: 0.1568 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4188 - reader cost: 0.1564 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4184 - reader cost: 0.1562 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4180 - reader cost: 0.1557 73/125 [================>.............] - ETA: 22s - batch_cost: 0.4173 - reader cost: 0.1550 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4171 - reader cost: 0.1544 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4172 - reader cost: 0.1545 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4175 - reader cost: 0.1545 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4174 - reader cost: 0.1546 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4177 - reader cost: 0.1550 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4174 - reader cost: 0.1545 80/125 [==================>...........] - ETA: 19s - batch_cost: 0.4174 - reader cost: 0.1543 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4178 - reader cost: 0.1545 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4181 - reader cost: 0.1550 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4179 - reader cost: 0.1548 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4180 - reader cost: 0.1551 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4177 - reader cost: 0.1550 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4174 - reader cost: 0.1547 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4176 - reader cost: 0.1550 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4177 - reader cost: 0.1551 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4178 - reader cost: 0.1555 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4180 - reader cost: 0.1557 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4181 - reader cost: 0.1560 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4175 - reader cost: 0.1554 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4176 - reader cost: 0.1557 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4177 - reader cost: 0.1555 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4178 - reader cost: 0.1550 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4179 - reader cost: 0.1546 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4179 - reader cost: 0.1547 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4176 - reader cost: 0.1544 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4174 - reader cost: 0.1544 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4171 - reader cost: 0.1540 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4172 - reader cost: 0.1543 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4167 - reader cost: 0.1538  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4166 - reader cost: 0.1537 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4166 - reader cost: 0.1538 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4164 - reader cost: 0.1537 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4160 - reader cost: 0.1533 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4161 - reader cost: 0.1533 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4163 - reader cost: 0.1530 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4164 - reader cost: 0.1526 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4166 - reader cost: 0.1528 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4165 - reader cost: 0.1527 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4169 - reader cost: 0.1529 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4173 - reader cost: 0.1531 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4174 - reader cost: 0.1533 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4171 - reader cost: 0.1530 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4170 - reader cost: 0.1525 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4171 - reader cost: 0.1523 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4168 - reader cost: 0.1519 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4168 - reader cost: 0.1516 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4170 - reader cost: 0.1519 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4172 - reader cost: 0.1521 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4173 - reader cost: 0.1520 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4174 - reader cost: 0.1522 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4174 - reader cost: 0.1524 125/125 [==============================] - 53s 422ms/step - batch_cost: 0.4176 - reader cost: 0.1528 2021-02-23 07:28:08 [INFO] [EVAL] #Images=500 mIoU=0.7335 Acc=0.9511 Kappa=0.9362 2021-02-23 07:28:08 [INFO] [EVAL] Class IoU: [0.9644 0.7437 0.9181 0.3479 0.5725 0.6617 0.7192 0.779 0.9205 0.5981 0.9499 0.8132 0.6124 0.9405 0.7237 0.7003 0.5772 0.6243 0.7694] 2021-02-23 07:28:08 [INFO] [EVAL] Class Acc: [0.9695 0.9266 0.9527 0.7773 0.7301 0.8083 0.8497 0.8559 0.9528 0.8588 0.9738 0.9251 0.7286 0.9605 0.8852 0.9103 0.9691 0.811 0.8392] 2021-02-23 07:28:12 [INFO] [EVAL] The model with the best validation mIoU (0.7576) was saved at iter 31000. 2021-02-23 07:28:26 [INFO] [TRAIN] epoch=92, iter=34010/80000, loss=0.9328, lr=0.006076, batch_cost=1.3447, reader_cost=0.0001 | ETA 17:10:43 2021-02-23 07:28:39 [INFO] [TRAIN] epoch=92, iter=34020/80000, loss=0.8746, lr=0.006075, batch_cost=1.3652, reader_cost=0.0001 | ETA 17:26:13 2021-02-23 07:28:53 [INFO] [TRAIN] epoch=92, iter=34030/80000, loss=0.8630, lr=0.006074, batch_cost=1.3517, reader_cost=0.0001 | ETA 17:15:38 2021-02-23 07:29:06 [INFO] [TRAIN] epoch=92, iter=34040/80000, loss=0.8704, lr=0.006073, batch_cost=1.3562, reader_cost=0.0001 | ETA 17:18:49 2021-02-23 07:29:20 [INFO] [TRAIN] epoch=92, iter=34050/80000, loss=0.9471, lr=0.006071, batch_cost=1.3897, reader_cost=0.0001 | ETA 17:44:16 2021-02-23 07:29:34 [INFO] [TRAIN] epoch=92, iter=34060/80000, loss=0.8645, lr=0.006070, batch_cost=1.3717, reader_cost=0.0001 | ETA 17:30:16 2021-02-23 07:29:48 [INFO] [TRAIN] epoch=92, iter=34070/80000, loss=0.9714, lr=0.006069, batch_cost=1.3710, reader_cost=0.0001 | ETA 17:29:28 2021-02-23 07:30:01 [INFO] [TRAIN] epoch=92, iter=34080/80000, loss=0.8269, lr=0.006068, batch_cost=1.3647, reader_cost=0.0001 | ETA 17:24:25 2021-02-23 07:30:15 [INFO] [TRAIN] epoch=92, iter=34090/80000, loss=0.9426, lr=0.006067, batch_cost=1.3536, reader_cost=0.0001 | ETA 17:15:43 2021-02-23 07:30:28 [INFO] [TRAIN] epoch=92, iter=34100/80000, loss=0.8030, lr=0.006065, batch_cost=1.3473, reader_cost=0.0001 | ETA 17:10:42 2021-02-23 07:30:42 [INFO] [TRAIN] epoch=92, iter=34110/80000, loss=0.8995, lr=0.006064, batch_cost=1.3483, reader_cost=0.0001 | ETA 17:11:15 2021-02-23 07:30:56 [INFO] [TRAIN] epoch=92, iter=34120/80000, loss=0.8494, lr=0.006063, batch_cost=1.3751, reader_cost=0.0001 | ETA 17:31:27 2021-02-23 07:31:09 [INFO] [TRAIN] epoch=92, iter=34130/80000, loss=0.8339, lr=0.006062, batch_cost=1.3720, reader_cost=0.0001 | ETA 17:28:54 2021-02-23 07:31:23 [INFO] [TRAIN] epoch=92, iter=34140/80000, loss=0.9638, lr=0.006061, batch_cost=1.3560, reader_cost=0.0001 | ETA 17:16:26 2021-02-23 07:31:36 [INFO] [TRAIN] epoch=92, iter=34150/80000, loss=0.8957, lr=0.006059, batch_cost=1.3446, reader_cost=0.0001 | ETA 17:07:28 2021-02-23 07:31:50 [INFO] [TRAIN] epoch=92, iter=34160/80000, loss=0.9556, lr=0.006058, batch_cost=1.3619, reader_cost=0.0001 | ETA 17:20:30 2021-02-23 07:32:04 [INFO] [TRAIN] epoch=92, iter=34170/80000, loss=0.8168, lr=0.006057, batch_cost=1.3519, reader_cost=0.0001 | ETA 17:12:38 2021-02-23 07:32:18 [INFO] [TRAIN] epoch=92, iter=34180/80000, loss=0.8812, lr=0.006056, batch_cost=1.4013, reader_cost=0.0001 | ETA 17:50:07 2021-02-23 07:32:31 [INFO] [TRAIN] epoch=92, iter=34190/80000, loss=0.9058, lr=0.006055, batch_cost=1.3530, reader_cost=0.0001 | ETA 17:13:01 2021-02-23 07:32:45 [INFO] [TRAIN] epoch=92, iter=34200/80000, loss=0.8519, lr=0.006053, batch_cost=1.3454, reader_cost=0.0001 | ETA 17:06:59 2021-02-23 07:32:58 [INFO] [TRAIN] epoch=92, iter=34210/80000, loss=0.9276, lr=0.006052, batch_cost=1.3524, reader_cost=0.0001 | ETA 17:12:06 2021-02-23 07:33:12 [INFO] [TRAIN] epoch=92, iter=34220/80000, loss=0.9173, lr=0.006051, batch_cost=1.3587, reader_cost=0.0001 | ETA 17:16:39 2021-02-23 07:33:26 [INFO] [TRAIN] epoch=93, iter=34230/80000, loss=0.9423, lr=0.006050, batch_cost=1.4579, reader_cost=0.0731 | ETA 18:32:07 2021-02-23 07:33:40 [INFO] [TRAIN] epoch=93, iter=34240/80000, loss=0.8758, lr=0.006049, batch_cost=1.3423, reader_cost=0.0001 | ETA 17:03:41 2021-02-23 07:33:53 [INFO] [TRAIN] epoch=93, iter=34250/80000, loss=0.8513, lr=0.006048, batch_cost=1.3640, reader_cost=0.0001 | ETA 17:20:01 2021-02-23 07:34:07 [INFO] [TRAIN] epoch=93, iter=34260/80000, loss=0.8812, lr=0.006046, batch_cost=1.3562, reader_cost=0.0001 | ETA 17:13:54 2021-02-23 07:34:20 [INFO] [TRAIN] epoch=93, iter=34270/80000, loss=0.8509, lr=0.006045, batch_cost=1.3528, reader_cost=0.0001 | ETA 17:11:02 2021-02-23 07:34:34 [INFO] [TRAIN] epoch=93, iter=34280/80000, loss=0.8439, lr=0.006044, batch_cost=1.3481, reader_cost=0.0001 | ETA 17:07:14 2021-02-23 07:34:48 [INFO] [TRAIN] epoch=93, iter=34290/80000, loss=0.7938, lr=0.006043, batch_cost=1.3758, reader_cost=0.0001 | ETA 17:28:08 2021-02-23 07:35:02 [INFO] [TRAIN] epoch=93, iter=34300/80000, loss=0.8804, lr=0.006042, batch_cost=1.3966, reader_cost=0.0001 | ETA 17:43:46 2021-02-23 07:35:15 [INFO] [TRAIN] epoch=93, iter=34310/80000, loss=0.8706, lr=0.006040, batch_cost=1.3523, reader_cost=0.0001 | ETA 17:09:44 2021-02-23 07:35:29 [INFO] [TRAIN] epoch=93, iter=34320/80000, loss=0.8683, lr=0.006039, batch_cost=1.3721, reader_cost=0.0001 | ETA 17:24:37 2021-02-23 07:35:43 [INFO] [TRAIN] epoch=93, iter=34330/80000, loss=0.8484, lr=0.006038, batch_cost=1.3647, reader_cost=0.0001 | ETA 17:18:43 2021-02-23 07:35:56 [INFO] [TRAIN] epoch=93, iter=34340/80000, loss=0.9557, lr=0.006037, batch_cost=1.3667, reader_cost=0.0001 | ETA 17:20:01 2021-02-23 07:36:10 [INFO] [TRAIN] epoch=93, iter=34350/80000, loss=0.8732, lr=0.006036, batch_cost=1.3688, reader_cost=0.0001 | ETA 17:21:24 2021-02-23 07:36:24 [INFO] [TRAIN] epoch=93, iter=34360/80000, loss=0.8542, lr=0.006034, batch_cost=1.3800, reader_cost=0.0001 | ETA 17:29:44 2021-02-23 07:36:37 [INFO] [TRAIN] epoch=93, iter=34370/80000, loss=0.8336, lr=0.006033, batch_cost=1.3575, reader_cost=0.0001 | ETA 17:12:23 2021-02-23 07:36:51 [INFO] [TRAIN] epoch=93, iter=34380/80000, loss=0.8182, lr=0.006032, batch_cost=1.3530, reader_cost=0.0001 | ETA 17:08:45 2021-02-23 07:37:04 [INFO] [TRAIN] epoch=93, iter=34390/80000, loss=0.7954, lr=0.006031, batch_cost=1.3475, reader_cost=0.0001 | ETA 17:04:21 2021-02-23 07:37:18 [INFO] [TRAIN] epoch=93, iter=34400/80000, loss=0.8805, lr=0.006030, batch_cost=1.3445, reader_cost=0.0001 | ETA 17:01:51 2021-02-23 07:37:31 [INFO] [TRAIN] epoch=93, iter=34410/80000, loss=0.8456, lr=0.006029, batch_cost=1.3507, reader_cost=0.0001 | ETA 17:06:16 2021-02-23 07:37:45 [INFO] [TRAIN] epoch=93, iter=34420/80000, loss=0.8981, lr=0.006027, batch_cost=1.3640, reader_cost=0.0001 | ETA 17:16:12 2021-02-23 07:37:59 [INFO] [TRAIN] epoch=93, iter=34430/80000, loss=0.9862, lr=0.006026, batch_cost=1.3765, reader_cost=0.0001 | ETA 17:25:26 2021-02-23 07:38:12 [INFO] [TRAIN] epoch=93, iter=34440/80000, loss=0.8881, lr=0.006025, batch_cost=1.3623, reader_cost=0.0001 | ETA 17:14:28 2021-02-23 07:38:26 [INFO] [TRAIN] epoch=93, iter=34450/80000, loss=1.0106, lr=0.006024, batch_cost=1.3737, reader_cost=0.0001 | ETA 17:22:50 2021-02-23 07:38:40 [INFO] [TRAIN] epoch=93, iter=34460/80000, loss=0.8564, lr=0.006023, batch_cost=1.3588, reader_cost=0.0001 | ETA 17:11:19 2021-02-23 07:38:53 [INFO] [TRAIN] epoch=93, iter=34470/80000, loss=0.8621, lr=0.006021, batch_cost=1.3607, reader_cost=0.0001 | ETA 17:12:32 2021-02-23 07:39:06 [INFO] [TRAIN] epoch=93, iter=34480/80000, loss=0.9427, lr=0.006020, batch_cost=1.3196, reader_cost=0.0001 | ETA 16:41:09 2021-02-23 07:39:20 [INFO] [TRAIN] epoch=93, iter=34490/80000, loss=0.9266, lr=0.006019, batch_cost=1.3427, reader_cost=0.0001 | ETA 16:58:26 2021-02-23 07:39:33 [INFO] [TRAIN] epoch=93, iter=34500/80000, loss=0.8267, lr=0.006018, batch_cost=1.3616, reader_cost=0.0001 | ETA 17:12:32 2021-02-23 07:39:47 [INFO] [TRAIN] epoch=93, iter=34510/80000, loss=0.9463, lr=0.006017, batch_cost=1.3581, reader_cost=0.0001 | ETA 17:09:39 2021-02-23 07:40:01 [INFO] [TRAIN] epoch=93, iter=34520/80000, loss=0.8739, lr=0.006015, batch_cost=1.3844, reader_cost=0.0001 | ETA 17:29:21 2021-02-23 07:40:14 [INFO] [TRAIN] epoch=93, iter=34530/80000, loss=0.8696, lr=0.006014, batch_cost=1.3609, reader_cost=0.0001 | ETA 17:11:22 2021-02-23 07:40:29 [INFO] [TRAIN] epoch=93, iter=34540/80000, loss=0.9626, lr=0.006013, batch_cost=1.4118, reader_cost=0.0001 | ETA 17:49:42 2021-02-23 07:40:42 [INFO] [TRAIN] epoch=93, iter=34550/80000, loss=0.9424, lr=0.006012, batch_cost=1.3584, reader_cost=0.0001 | ETA 17:08:58 2021-02-23 07:40:56 [INFO] [TRAIN] epoch=93, iter=34560/80000, loss=0.8777, lr=0.006011, batch_cost=1.3645, reader_cost=0.0001 | ETA 17:13:21 2021-02-23 07:41:09 [INFO] [TRAIN] epoch=93, iter=34570/80000, loss=0.8464, lr=0.006009, batch_cost=1.3683, reader_cost=0.0001 | ETA 17:16:03 2021-02-23 07:41:23 [INFO] [TRAIN] epoch=93, iter=34580/80000, loss=0.9095, lr=0.006008, batch_cost=1.3825, reader_cost=0.0001 | ETA 17:26:32 2021-02-23 07:41:37 [INFO] [TRAIN] epoch=93, iter=34590/80000, loss=0.7988, lr=0.006007, batch_cost=1.3328, reader_cost=0.0001 | ETA 16:48:42 2021-02-23 07:41:51 [INFO] [TRAIN] epoch=94, iter=34600/80000, loss=0.9697, lr=0.006006, batch_cost=1.4139, reader_cost=0.0680 | ETA 17:49:49 2021-02-23 07:42:05 [INFO] [TRAIN] epoch=94, iter=34610/80000, loss=0.9114, lr=0.006005, batch_cost=1.3742, reader_cost=0.0001 | ETA 17:19:33 2021-02-23 07:42:18 [INFO] [TRAIN] epoch=94, iter=34620/80000, loss=0.8950, lr=0.006004, batch_cost=1.3765, reader_cost=0.0001 | ETA 17:21:04 2021-02-23 07:42:32 [INFO] [TRAIN] epoch=94, iter=34630/80000, loss=0.9164, lr=0.006002, batch_cost=1.3436, reader_cost=0.0001 | ETA 16:55:57 2021-02-23 07:42:45 [INFO] [TRAIN] epoch=94, iter=34640/80000, loss=0.9180, lr=0.006001, batch_cost=1.3423, reader_cost=0.0001 | ETA 16:54:46 2021-02-23 07:42:59 [INFO] [TRAIN] epoch=94, iter=34650/80000, loss=0.8419, lr=0.006000, batch_cost=1.3589, reader_cost=0.0001 | ETA 17:07:07 2021-02-23 07:43:12 [INFO] [TRAIN] epoch=94, iter=34660/80000, loss=0.8690, lr=0.005999, batch_cost=1.3446, reader_cost=0.0001 | ETA 16:56:02 2021-02-23 07:43:26 [INFO] [TRAIN] epoch=94, iter=34670/80000, loss=0.9159, lr=0.005998, batch_cost=1.3645, reader_cost=0.0001 | ETA 17:10:54 2021-02-23 07:43:39 [INFO] [TRAIN] epoch=94, iter=34680/80000, loss=0.8610, lr=0.005996, batch_cost=1.3422, reader_cost=0.0001 | ETA 16:53:47 2021-02-23 07:43:53 [INFO] [TRAIN] epoch=94, iter=34690/80000, loss=0.9471, lr=0.005995, batch_cost=1.3806, reader_cost=0.0001 | ETA 17:22:33 2021-02-23 07:44:06 [INFO] [TRAIN] epoch=94, iter=34700/80000, loss=0.9062, lr=0.005994, batch_cost=1.3346, reader_cost=0.0001 | ETA 16:47:35 2021-02-23 07:44:20 [INFO] [TRAIN] epoch=94, iter=34710/80000, loss=0.9241, lr=0.005993, batch_cost=1.3717, reader_cost=0.0001 | ETA 17:15:26 2021-02-23 07:44:34 [INFO] [TRAIN] epoch=94, iter=34720/80000, loss=0.9098, lr=0.005992, batch_cost=1.3401, reader_cost=0.0001 | ETA 16:51:21 2021-02-23 07:44:47 [INFO] [TRAIN] epoch=94, iter=34730/80000, loss=0.8527, lr=0.005990, batch_cost=1.3530, reader_cost=0.0001 | ETA 17:00:51 2021-02-23 07:45:01 [INFO] [TRAIN] epoch=94, iter=34740/80000, loss=0.8579, lr=0.005989, batch_cost=1.3710, reader_cost=0.0001 | ETA 17:14:09 2021-02-23 07:45:14 [INFO] [TRAIN] epoch=94, iter=34750/80000, loss=0.8571, lr=0.005988, batch_cost=1.3502, reader_cost=0.0001 | ETA 16:58:16 2021-02-23 07:45:28 [INFO] [TRAIN] epoch=94, iter=34760/80000, loss=0.9196, lr=0.005987, batch_cost=1.3630, reader_cost=0.0001 | ETA 17:07:43 2021-02-23 07:45:42 [INFO] [TRAIN] epoch=94, iter=34770/80000, loss=0.8217, lr=0.005986, batch_cost=1.3832, reader_cost=0.0001 | ETA 17:22:40 2021-02-23 07:45:55 [INFO] [TRAIN] epoch=94, iter=34780/80000, loss=0.8723, lr=0.005984, batch_cost=1.3331, reader_cost=0.0001 | ETA 16:44:42 2021-02-23 07:46:09 [INFO] [TRAIN] epoch=94, iter=34790/80000, loss=0.8891, lr=0.005983, batch_cost=1.3625, reader_cost=0.0001 | ETA 17:06:38 2021-02-23 07:46:22 [INFO] [TRAIN] epoch=94, iter=34800/80000, loss=0.8639, lr=0.005982, batch_cost=1.3599, reader_cost=0.0001 | ETA 17:04:28 2021-02-23 07:46:36 [INFO] [TRAIN] epoch=94, iter=34810/80000, loss=0.8173, lr=0.005981, batch_cost=1.3429, reader_cost=0.0001 | ETA 16:51:26 2021-02-23 07:46:49 [INFO] [TRAIN] epoch=94, iter=34820/80000, loss=0.9789, lr=0.005980, batch_cost=1.3413, reader_cost=0.0001 | ETA 16:50:01 2021-02-23 07:47:03 [INFO] [TRAIN] epoch=94, iter=34830/80000, loss=0.8230, lr=0.005979, batch_cost=1.3928, reader_cost=0.0001 | ETA 17:28:31 2021-02-23 07:47:17 [INFO] [TRAIN] epoch=94, iter=34840/80000, loss=0.8883, lr=0.005977, batch_cost=1.3674, reader_cost=0.0001 | ETA 17:09:13 2021-02-23 07:47:30 [INFO] [TRAIN] epoch=94, iter=34850/80000, loss=0.8125, lr=0.005976, batch_cost=1.3647, reader_cost=0.0001 | ETA 17:06:54 2021-02-23 07:47:44 [INFO] [TRAIN] epoch=94, iter=34860/80000, loss=0.9756, lr=0.005975, batch_cost=1.3456, reader_cost=0.0001 | ETA 16:52:22 2021-02-23 07:47:57 [INFO] [TRAIN] epoch=94, iter=34870/80000, loss=0.8674, lr=0.005974, batch_cost=1.3573, reader_cost=0.0001 | ETA 17:00:53 2021-02-23 07:48:11 [INFO] [TRAIN] epoch=94, iter=34880/80000, loss=0.9684, lr=0.005973, batch_cost=1.3500, reader_cost=0.0001 | ETA 16:55:12 2021-02-23 07:48:24 [INFO] [TRAIN] epoch=94, iter=34890/80000, loss=0.9558, lr=0.005971, batch_cost=1.3482, reader_cost=0.0001 | ETA 16:53:39 2021-02-23 07:48:38 [INFO] [TRAIN] epoch=94, iter=34900/80000, loss=0.8080, lr=0.005970, batch_cost=1.3616, reader_cost=0.0001 | ETA 17:03:29 2021-02-23 07:48:51 [INFO] [TRAIN] epoch=94, iter=34910/80000, loss=0.8423, lr=0.005969, batch_cost=1.3475, reader_cost=0.0001 | ETA 16:52:40 2021-02-23 07:49:05 [INFO] [TRAIN] epoch=94, iter=34920/80000, loss=0.8983, lr=0.005968, batch_cost=1.3516, reader_cost=0.0001 | ETA 16:55:28 2021-02-23 07:49:19 [INFO] [TRAIN] epoch=94, iter=34930/80000, loss=0.9214, lr=0.005967, batch_cost=1.3756, reader_cost=0.0001 | ETA 17:13:18 2021-02-23 07:49:32 [INFO] [TRAIN] epoch=94, iter=34940/80000, loss=0.9727, lr=0.005965, batch_cost=1.3467, reader_cost=0.0001 | ETA 16:51:23 2021-02-23 07:49:46 [INFO] [TRAIN] epoch=94, iter=34950/80000, loss=0.8699, lr=0.005964, batch_cost=1.3574, reader_cost=0.0001 | ETA 16:59:09 2021-02-23 07:49:59 [INFO] [TRAIN] epoch=94, iter=34960/80000, loss=0.8994, lr=0.005963, batch_cost=1.3539, reader_cost=0.0001 | ETA 16:56:19 2021-02-23 07:50:14 [INFO] [TRAIN] epoch=95, iter=34970/80000, loss=0.7859, lr=0.005962, batch_cost=1.4290, reader_cost=0.0539 | ETA 17:52:26 2021-02-23 07:50:27 [INFO] [TRAIN] epoch=95, iter=34980/80000, loss=0.9125, lr=0.005961, batch_cost=1.3785, reader_cost=0.0001 | ETA 17:14:21 2021-02-23 07:50:41 [INFO] [TRAIN] epoch=95, iter=34990/80000, loss=0.8431, lr=0.005959, batch_cost=1.3662, reader_cost=0.0001 | ETA 17:04:53 2021-02-23 07:50:55 [INFO] [TRAIN] epoch=95, iter=35000/80000, loss=0.8861, lr=0.005958, batch_cost=1.3682, reader_cost=0.0001 | ETA 17:06:08 2021-02-23 07:50:55 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:13 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:03 - batch_cost: 0.2220 - reader cost: 0.0973  3/125 [..............................] - ETA: 1:00 - batch_cost: 0.3002 - reader cost: 0.1307 4/125 [..............................] - ETA: 56s - batch_cost: 0.3206 - reader cost: 0.1308  5/125 [>.............................] - ETA: 55s - batch_cost: 0.3432 - reader cost: 0.1409 6/125 [>.............................] - ETA: 54s - batch_cost: 0.3595 - reader cost: 0.1493 7/125 [>.............................] - ETA: 54s - batch_cost: 0.3754 - reader cost: 0.1593 8/125 [>.............................] - ETA: 53s - batch_cost: 0.3845 - reader cost: 0.1631 9/125 [=>............................] - ETA: 52s - batch_cost: 0.3859 - reader cost: 0.1612 10/125 [=>............................] - ETA: 51s - batch_cost: 0.3905 - reader cost: 0.1629 11/125 [=>............................] - ETA: 51s - batch_cost: 0.3947 - reader cost: 0.1652 12/125 [=>............................] - ETA: 50s - batch_cost: 0.3971 - reader cost: 0.1655 13/125 [==>...........................] - ETA: 50s - batch_cost: 0.4015 - reader cost: 0.1667 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3981 - reader cost: 0.1612 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3966 - reader cost: 0.1587 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.4000 - reader cost: 0.1613 17/125 [===>..........................] - ETA: 47s - batch_cost: 0.4027 - reader cost: 0.1634 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.4048 - reader cost: 0.1646 19/125 [===>..........................] - ETA: 46s - batch_cost: 0.4061 - reader cost: 0.1654 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4073 - reader cost: 0.1657 21/125 [====>.........................] - ETA: 45s - batch_cost: 0.4085 - reader cost: 0.1663 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4095 - reader cost: 0.1670 23/125 [====>.........................] - ETA: 44s - batch_cost: 0.4110 - reader cost: 0.1678 24/125 [====>.........................] - ETA: 44s - batch_cost: 0.4121 - reader cost: 0.1686 25/125 [=====>........................] - ETA: 43s - batch_cost: 0.4130 - reader cost: 0.1687 26/125 [=====>........................] - ETA: 43s - batch_cost: 0.4140 - reader cost: 0.1692 27/125 [=====>........................] - ETA: 42s - batch_cost: 0.4149 - reader cost: 0.1698 28/125 [=====>........................] - ETA: 42s - batch_cost: 0.4157 - reader cost: 0.1701 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4165 - reader cost: 0.1708 30/125 [======>.......................] - ETA: 41s - batch_cost: 0.4171 - reader cost: 0.1709 31/125 [======>.......................] - ETA: 41s - batch_cost: 0.4176 - reader cost: 0.1712 32/125 [======>.......................] - ETA: 40s - batch_cost: 0.4187 - reader cost: 0.1722 33/125 [======>.......................] - ETA: 40s - batch_cost: 0.4174 - reader cost: 0.1707 34/125 [=======>......................] - ETA: 39s - batch_cost: 0.4179 - reader cost: 0.1709 35/125 [=======>......................] - ETA: 39s - batch_cost: 0.4185 - reader cost: 0.1714 36/125 [=======>......................] - ETA: 38s - batch_cost: 0.4188 - reader cost: 0.1716 37/125 [=======>......................] - ETA: 38s - batch_cost: 0.4179 - reader cost: 0.1705 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4186 - reader cost: 0.1709 39/125 [========>.....................] - ETA: 37s - batch_cost: 0.4178 - reader cost: 0.1699 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4185 - reader cost: 0.1704 41/125 [========>.....................] - ETA: 36s - batch_cost: 0.4173 - reader cost: 0.1691 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4176 - reader cost: 0.1694 43/125 [=========>....................] - ETA: 35s - batch_cost: 0.4192 - reader cost: 0.1709 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4183 - reader cost: 0.1700 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4189 - reader cost: 0.1703 46/125 [==========>...................] - ETA: 34s - batch_cost: 0.4179 - reader cost: 0.1692 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4182 - reader cost: 0.1696 48/125 [==========>...................] - ETA: 33s - batch_cost: 0.4186 - reader cost: 0.1698 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4179 - reader cost: 0.1689 50/125 [===========>..................] - ETA: 32s - batch_cost: 0.4178 - reader cost: 0.1685 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4168 - reader cost: 0.1675 52/125 [===========>..................] - ETA: 31s - batch_cost: 0.4169 - reader cost: 0.1676 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4174 - reader cost: 0.1679 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4178 - reader cost: 0.1681 55/125 [============>.................] - ETA: 30s - batch_cost: 0.4182 - reader cost: 0.1686 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4186 - reader cost: 0.1688 57/125 [============>.................] - ETA: 29s - batch_cost: 0.4180 - reader cost: 0.1682 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4183 - reader cost: 0.1684 59/125 [=============>................] - ETA: 28s - batch_cost: 0.4183 - reader cost: 0.1684 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4177 - reader cost: 0.1678 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4175 - reader cost: 0.1676 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4170 - reader cost: 0.1668 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4160 - reader cost: 0.1658 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4156 - reader cost: 0.1654 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4161 - reader cost: 0.1657 66/125 [==============>...............] - ETA: 25s - batch_cost: 0.4161 - reader cost: 0.1656 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4162 - reader cost: 0.1658 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4164 - reader cost: 0.1660 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4167 - reader cost: 0.1661 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4168 - reader cost: 0.1662 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4163 - reader cost: 0.1657 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4165 - reader cost: 0.1659 73/125 [================>.............] - ETA: 22s - batch_cost: 0.4159 - reader cost: 0.1652 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4161 - reader cost: 0.1655 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4163 - reader cost: 0.1657 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4158 - reader cost: 0.1650 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4158 - reader cost: 0.1647 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4163 - reader cost: 0.1652 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4163 - reader cost: 0.1646 80/125 [==================>...........] - ETA: 19s - batch_cost: 0.4162 - reader cost: 0.1638 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4167 - reader cost: 0.1632 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4165 - reader cost: 0.1630 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4168 - reader cost: 0.1633 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4169 - reader cost: 0.1635 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4170 - reader cost: 0.1636 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4166 - reader cost: 0.1632 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4168 - reader cost: 0.1634 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4168 - reader cost: 0.1636 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4172 - reader cost: 0.1638 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4166 - reader cost: 0.1632 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4169 - reader cost: 0.1635 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4163 - reader cost: 0.1630 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4165 - reader cost: 0.1632 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4167 - reader cost: 0.1634 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4173 - reader cost: 0.1640 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4174 - reader cost: 0.1641 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4171 - reader cost: 0.1637 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4173 - reader cost: 0.1639 99/125 [======================>.......] - ETA: 11s - batch_cost: 0.4175 - reader cost: 0.1641 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4177 - reader cost: 0.1644 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4177 - reader cost: 0.1643 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4180 - reader cost: 0.1646  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4183 - reader cost: 0.1649 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4181 - reader cost: 0.1647 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4183 - reader cost: 0.1649 106/125 [========================>.....] - ETA: 8s - batch_cost: 0.4185 - reader cost: 0.1650 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4186 - reader cost: 0.1650 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4187 - reader cost: 0.1650 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4187 - reader cost: 0.1651 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4184 - reader cost: 0.1648 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4185 - reader cost: 0.1650 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4191 - reader cost: 0.1653 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4188 - reader cost: 0.1649 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4187 - reader cost: 0.1649 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4185 - reader cost: 0.1647 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4184 - reader cost: 0.1645 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4185 - reader cost: 0.1647 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4185 - reader cost: 0.1647 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4182 - reader cost: 0.1644 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4183 - reader cost: 0.1646 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4186 - reader cost: 0.1648 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4183 - reader cost: 0.1645 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4184 - reader cost: 0.1646 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4182 - reader cost: 0.1644 125/125 [==============================] - 53s 423ms/step - batch_cost: 0.4180 - reader cost: 0.1642 2021-02-23 07:51:48 [INFO] [EVAL] #Images=500 mIoU=0.6779 Acc=0.9433 Kappa=0.9260 2021-02-23 07:51:48 [INFO] [EVAL] Class IoU: [0.9607 0.7369 0.902 0.3219 0.5388 0.5773 0.6459 0.7492 0.9159 0.5167 0.9447 0.7863 0.4814 0.8999 0.4917 0.4932 0.5548 0.6002 0.7628] 2021-02-23 07:51:48 [INFO] [EVAL] Class Acc: [0.9707 0.8677 0.9245 0.7108 0.8017 0.824 0.8698 0.9279 0.962 0.8613 0.967 0.8751 0.8626 0.9331 0.9678 0.9731 0.975 0.7279 0.8558] 2021-02-23 07:51:52 [INFO] [EVAL] The model with the best validation mIoU (0.7576) was saved at iter 31000. 2021-02-23 07:52:05 [INFO] [TRAIN] epoch=95, iter=35010/80000, loss=0.8817, lr=0.005957, batch_cost=1.3404, reader_cost=0.0001 | ETA 16:45:03 2021-02-23 07:52:19 [INFO] [TRAIN] epoch=95, iter=35020/80000, loss=0.9272, lr=0.005956, batch_cost=1.3686, reader_cost=0.0001 | ETA 17:06:01 2021-02-23 07:52:32 [INFO] [TRAIN] epoch=95, iter=35030/80000, loss=0.9158, lr=0.005955, batch_cost=1.3382, reader_cost=0.0001 | ETA 16:42:58 2021-02-23 07:52:46 [INFO] [TRAIN] epoch=95, iter=35040/80000, loss=0.8568, lr=0.005953, batch_cost=1.3933, reader_cost=0.0001 | ETA 17:24:03 2021-02-23 07:53:00 [INFO] [TRAIN] epoch=95, iter=35050/80000, loss=0.8768, lr=0.005952, batch_cost=1.3584, reader_cost=0.0001 | ETA 16:57:39 2021-02-23 07:53:13 [INFO] [TRAIN] epoch=95, iter=35060/80000, loss=0.8917, lr=0.005951, batch_cost=1.3661, reader_cost=0.0001 | ETA 17:03:12 2021-02-23 07:53:27 [INFO] [TRAIN] epoch=95, iter=35070/80000, loss=0.8273, lr=0.005950, batch_cost=1.4009, reader_cost=0.0001 | ETA 17:29:04 2021-02-23 07:53:41 [INFO] [TRAIN] epoch=95, iter=35080/80000, loss=0.9017, lr=0.005949, batch_cost=1.4157, reader_cost=0.0001 | ETA 17:39:51 2021-02-23 07:53:55 [INFO] [TRAIN] epoch=95, iter=35090/80000, loss=0.9134, lr=0.005948, batch_cost=1.3574, reader_cost=0.0001 | ETA 16:56:00 2021-02-23 07:54:09 [INFO] [TRAIN] epoch=95, iter=35100/80000, loss=0.9973, lr=0.005946, batch_cost=1.3825, reader_cost=0.0001 | ETA 17:14:33 2021-02-23 07:54:22 [INFO] [TRAIN] epoch=95, iter=35110/80000, loss=0.8507, lr=0.005945, batch_cost=1.3605, reader_cost=0.0001 | ETA 16:57:52 2021-02-23 07:54:36 [INFO] [TRAIN] epoch=95, iter=35120/80000, loss=0.9503, lr=0.005944, batch_cost=1.3966, reader_cost=0.0001 | ETA 17:24:41 2021-02-23 07:54:50 [INFO] [TRAIN] epoch=95, iter=35130/80000, loss=0.8617, lr=0.005943, batch_cost=1.3488, reader_cost=0.0001 | ETA 16:48:41 2021-02-23 07:55:04 [INFO] [TRAIN] epoch=95, iter=35140/80000, loss=0.9166, lr=0.005942, batch_cost=1.3733, reader_cost=0.0001 | ETA 17:06:45 2021-02-23 07:55:17 [INFO] [TRAIN] epoch=95, iter=35150/80000, loss=0.9474, lr=0.005940, batch_cost=1.3515, reader_cost=0.0001 | ETA 16:50:15 2021-02-23 07:55:31 [INFO] [TRAIN] epoch=95, iter=35160/80000, loss=0.8905, lr=0.005939, batch_cost=1.3607, reader_cost=0.0001 | ETA 16:56:54 2021-02-23 07:55:44 [INFO] [TRAIN] epoch=95, iter=35170/80000, loss=0.9187, lr=0.005938, batch_cost=1.3670, reader_cost=0.0001 | ETA 17:01:21 2021-02-23 07:55:58 [INFO] [TRAIN] epoch=95, iter=35180/80000, loss=0.9012, lr=0.005937, batch_cost=1.3610, reader_cost=0.0001 | ETA 16:56:38 2021-02-23 07:56:11 [INFO] [TRAIN] epoch=95, iter=35190/80000, loss=0.9308, lr=0.005936, batch_cost=1.3436, reader_cost=0.0001 | ETA 16:43:27 2021-02-23 07:56:25 [INFO] [TRAIN] epoch=95, iter=35200/80000, loss=0.8825, lr=0.005934, batch_cost=1.3658, reader_cost=0.0001 | ETA 16:59:47 2021-02-23 07:56:39 [INFO] [TRAIN] epoch=95, iter=35210/80000, loss=0.8390, lr=0.005933, batch_cost=1.3687, reader_cost=0.0001 | ETA 17:01:42 2021-02-23 07:56:52 [INFO] [TRAIN] epoch=95, iter=35220/80000, loss=0.9000, lr=0.005932, batch_cost=1.3074, reader_cost=0.0001 | ETA 16:15:44 2021-02-23 07:57:05 [INFO] [TRAIN] epoch=95, iter=35230/80000, loss=0.8128, lr=0.005931, batch_cost=1.3545, reader_cost=0.0001 | ETA 16:50:42 2021-02-23 07:57:19 [INFO] [TRAIN] epoch=95, iter=35240/80000, loss=0.8561, lr=0.005930, batch_cost=1.3656, reader_cost=0.0001 | ETA 16:58:45 2021-02-23 07:57:33 [INFO] [TRAIN] epoch=95, iter=35250/80000, loss=0.8513, lr=0.005928, batch_cost=1.4023, reader_cost=0.0001 | ETA 17:25:51 2021-02-23 07:57:47 [INFO] [TRAIN] epoch=95, iter=35260/80000, loss=0.8724, lr=0.005927, batch_cost=1.3583, reader_cost=0.0001 | ETA 16:52:51 2021-02-23 07:58:00 [INFO] [TRAIN] epoch=95, iter=35270/80000, loss=0.8790, lr=0.005926, batch_cost=1.3567, reader_cost=0.0001 | ETA 16:51:23 2021-02-23 07:58:14 [INFO] [TRAIN] epoch=95, iter=35280/80000, loss=0.9311, lr=0.005925, batch_cost=1.3436, reader_cost=0.0001 | ETA 16:41:25 2021-02-23 07:58:27 [INFO] [TRAIN] epoch=95, iter=35290/80000, loss=0.8948, lr=0.005924, batch_cost=1.3698, reader_cost=0.0001 | ETA 17:00:43 2021-02-23 07:58:41 [INFO] [TRAIN] epoch=95, iter=35300/80000, loss=0.8480, lr=0.005922, batch_cost=1.3756, reader_cost=0.0001 | ETA 17:04:50 2021-02-23 07:58:55 [INFO] [TRAIN] epoch=95, iter=35310/80000, loss=0.9711, lr=0.005921, batch_cost=1.3682, reader_cost=0.0001 | ETA 16:59:04 2021-02-23 07:59:08 [INFO] [TRAIN] epoch=95, iter=35320/80000, loss=0.8408, lr=0.005920, batch_cost=1.3486, reader_cost=0.0001 | ETA 16:44:16 2021-02-23 07:59:22 [INFO] [TRAIN] epoch=95, iter=35330/80000, loss=0.8704, lr=0.005919, batch_cost=1.3649, reader_cost=0.0001 | ETA 16:56:11 2021-02-23 07:59:35 [INFO] [TRAIN] epoch=95, iter=35340/80000, loss=0.9520, lr=0.005918, batch_cost=1.3064, reader_cost=0.0001 | ETA 16:12:23 2021-02-23 07:59:50 [INFO] [TRAIN] epoch=96, iter=35350/80000, loss=0.8127, lr=0.005917, batch_cost=1.4574, reader_cost=0.0839 | ETA 18:04:31 2021-02-23 08:00:03 [INFO] [TRAIN] epoch=96, iter=35360/80000, loss=0.8448, lr=0.005915, batch_cost=1.3558, reader_cost=0.0001 | ETA 16:48:43 2021-02-23 08:00:17 [INFO] [TRAIN] epoch=96, iter=35370/80000, loss=0.9699, lr=0.005914, batch_cost=1.4018, reader_cost=0.0001 | ETA 17:22:42 2021-02-23 08:00:31 [INFO] [TRAIN] epoch=96, iter=35380/80000, loss=0.8649, lr=0.005913, batch_cost=1.3463, reader_cost=0.0001 | ETA 16:41:09 2021-02-23 08:00:44 [INFO] [TRAIN] epoch=96, iter=35390/80000, loss=0.9113, lr=0.005912, batch_cost=1.3770, reader_cost=0.0001 | ETA 17:03:49 2021-02-23 08:00:58 [INFO] [TRAIN] epoch=96, iter=35400/80000, loss=0.8645, lr=0.005911, batch_cost=1.3466, reader_cost=0.0001 | ETA 16:40:56 2021-02-23 08:01:11 [INFO] [TRAIN] epoch=96, iter=35410/80000, loss=0.9390, lr=0.005909, batch_cost=1.3553, reader_cost=0.0001 | ETA 16:47:14 2021-02-23 08:01:25 [INFO] [TRAIN] epoch=96, iter=35420/80000, loss=0.9388, lr=0.005908, batch_cost=1.3515, reader_cost=0.0001 | ETA 16:44:09 2021-02-23 08:01:39 [INFO] [TRAIN] epoch=96, iter=35430/80000, loss=0.8675, lr=0.005907, batch_cost=1.3647, reader_cost=0.0001 | ETA 16:53:46 2021-02-23 08:01:52 [INFO] [TRAIN] epoch=96, iter=35440/80000, loss=0.8538, lr=0.005906, batch_cost=1.3377, reader_cost=0.0001 | ETA 16:33:27 2021-02-23 08:02:06 [INFO] [TRAIN] epoch=96, iter=35450/80000, loss=1.0257, lr=0.005905, batch_cost=1.3781, reader_cost=0.0001 | ETA 17:03:16 2021-02-23 08:02:20 [INFO] [TRAIN] epoch=96, iter=35460/80000, loss=0.8486, lr=0.005903, batch_cost=1.3822, reader_cost=0.0001 | ETA 17:06:01 2021-02-23 08:02:33 [INFO] [TRAIN] epoch=96, iter=35470/80000, loss=0.8253, lr=0.005902, batch_cost=1.3624, reader_cost=0.0001 | ETA 16:51:07 2021-02-23 08:02:47 [INFO] [TRAIN] epoch=96, iter=35480/80000, loss=0.8818, lr=0.005901, batch_cost=1.3555, reader_cost=0.0001 | ETA 16:45:48 2021-02-23 08:03:00 [INFO] [TRAIN] epoch=96, iter=35490/80000, loss=0.9331, lr=0.005900, batch_cost=1.3468, reader_cost=0.0001 | ETA 16:39:07 2021-02-23 08:03:14 [INFO] [TRAIN] epoch=96, iter=35500/80000, loss=0.8447, lr=0.005899, batch_cost=1.3507, reader_cost=0.0001 | ETA 16:41:47 2021-02-23 08:03:28 [INFO] [TRAIN] epoch=96, iter=35510/80000, loss=0.8805, lr=0.005897, batch_cost=1.3839, reader_cost=0.0001 | ETA 17:06:11 2021-02-23 08:03:41 [INFO] [TRAIN] epoch=96, iter=35520/80000, loss=0.7980, lr=0.005896, batch_cost=1.3438, reader_cost=0.0001 | ETA 16:36:12 2021-02-23 08:03:55 [INFO] [TRAIN] epoch=96, iter=35530/80000, loss=0.8935, lr=0.005895, batch_cost=1.3547, reader_cost=0.0001 | ETA 16:44:03 2021-02-23 08:04:08 [INFO] [TRAIN] epoch=96, iter=35540/80000, loss=0.8897, lr=0.005894, batch_cost=1.3784, reader_cost=0.0001 | ETA 17:01:25 2021-02-23 08:04:22 [INFO] [TRAIN] epoch=96, iter=35550/80000, loss=0.8977, lr=0.005893, batch_cost=1.3598, reader_cost=0.0001 | ETA 16:47:23 2021-02-23 08:04:35 [INFO] [TRAIN] epoch=96, iter=35560/80000, loss=0.9077, lr=0.005891, batch_cost=1.3393, reader_cost=0.0001 | ETA 16:31:58 2021-02-23 08:04:49 [INFO] [TRAIN] epoch=96, iter=35570/80000, loss=0.8635, lr=0.005890, batch_cost=1.3678, reader_cost=0.0003 | ETA 16:52:50 2021-02-23 08:05:02 [INFO] [TRAIN] epoch=96, iter=35580/80000, loss=0.9624, lr=0.005889, batch_cost=1.3351, reader_cost=0.0001 | ETA 16:28:26 2021-02-23 08:05:16 [INFO] [TRAIN] epoch=96, iter=35590/80000, loss=0.8779, lr=0.005888, batch_cost=1.3544, reader_cost=0.0001 | ETA 16:42:27 2021-02-23 08:05:29 [INFO] [TRAIN] epoch=96, iter=35600/80000, loss=0.9874, lr=0.005887, batch_cost=1.3325, reader_cost=0.0001 | ETA 16:26:01 2021-02-23 08:05:43 [INFO] [TRAIN] epoch=96, iter=35610/80000, loss=0.8890, lr=0.005886, batch_cost=1.3799, reader_cost=0.0001 | ETA 17:00:53 2021-02-23 08:05:57 [INFO] [TRAIN] epoch=96, iter=35620/80000, loss=0.8684, lr=0.005884, batch_cost=1.3846, reader_cost=0.0001 | ETA 17:04:10 2021-02-23 08:06:10 [INFO] [TRAIN] epoch=96, iter=35630/80000, loss=0.9131, lr=0.005883, batch_cost=1.3227, reader_cost=0.0001 | ETA 16:18:07 2021-02-23 08:06:24 [INFO] [TRAIN] epoch=96, iter=35640/80000, loss=0.8877, lr=0.005882, batch_cost=1.3693, reader_cost=0.0001 | ETA 16:52:23 2021-02-23 08:06:37 [INFO] [TRAIN] epoch=96, iter=35650/80000, loss=0.8679, lr=0.005881, batch_cost=1.3337, reader_cost=0.0001 | ETA 16:25:50 2021-02-23 08:06:51 [INFO] [TRAIN] epoch=96, iter=35660/80000, loss=0.9321, lr=0.005880, batch_cost=1.3431, reader_cost=0.0001 | ETA 16:32:31 2021-02-23 08:07:04 [INFO] [TRAIN] epoch=96, iter=35670/80000, loss=0.9318, lr=0.005878, batch_cost=1.3478, reader_cost=0.0001 | ETA 16:35:49 2021-02-23 08:07:18 [INFO] [TRAIN] epoch=96, iter=35680/80000, loss=0.9343, lr=0.005877, batch_cost=1.3609, reader_cost=0.0001 | ETA 16:45:15 2021-02-23 08:07:31 [INFO] [TRAIN] epoch=96, iter=35690/80000, loss=0.9468, lr=0.005876, batch_cost=1.3764, reader_cost=0.0001 | ETA 16:56:26 2021-02-23 08:07:45 [INFO] [TRAIN] epoch=96, iter=35700/80000, loss=0.8943, lr=0.005875, batch_cost=1.3419, reader_cost=0.0001 | ETA 16:30:46 2021-02-23 08:07:58 [INFO] [TRAIN] epoch=96, iter=35710/80000, loss=0.7643, lr=0.005874, batch_cost=1.3425, reader_cost=0.0001 | ETA 16:31:01 2021-02-23 08:08:13 [INFO] [TRAIN] epoch=97, iter=35720/80000, loss=0.9173, lr=0.005872, batch_cost=1.4593, reader_cost=0.0707 | ETA 17:56:59 2021-02-23 08:08:27 [INFO] [TRAIN] epoch=97, iter=35730/80000, loss=0.9328, lr=0.005871, batch_cost=1.3727, reader_cost=0.0001 | ETA 16:52:47 2021-02-23 08:08:40 [INFO] [TRAIN] epoch=97, iter=35740/80000, loss=0.8919, lr=0.005870, batch_cost=1.3347, reader_cost=0.0001 | ETA 16:24:33 2021-02-23 08:08:54 [INFO] [TRAIN] epoch=97, iter=35750/80000, loss=0.8825, lr=0.005869, batch_cost=1.3795, reader_cost=0.0001 | ETA 16:57:24 2021-02-23 08:09:07 [INFO] [TRAIN] epoch=97, iter=35760/80000, loss=0.9260, lr=0.005868, batch_cost=1.3489, reader_cost=0.0001 | ETA 16:34:36 2021-02-23 08:09:21 [INFO] [TRAIN] epoch=97, iter=35770/80000, loss=0.8821, lr=0.005866, batch_cost=1.3603, reader_cost=0.0001 | ETA 16:42:46 2021-02-23 08:09:34 [INFO] [TRAIN] epoch=97, iter=35780/80000, loss=0.9547, lr=0.005865, batch_cost=1.3602, reader_cost=0.0001 | ETA 16:42:29 2021-02-23 08:09:48 [INFO] [TRAIN] epoch=97, iter=35790/80000, loss=0.9582, lr=0.005864, batch_cost=1.3661, reader_cost=0.0001 | ETA 16:46:35 2021-02-23 08:10:02 [INFO] [TRAIN] epoch=97, iter=35800/80000, loss=0.9149, lr=0.005863, batch_cost=1.3604, reader_cost=0.0001 | ETA 16:42:07 2021-02-23 08:10:15 [INFO] [TRAIN] epoch=97, iter=35810/80000, loss=0.8743, lr=0.005862, batch_cost=1.3540, reader_cost=0.0001 | ETA 16:37:14 2021-02-23 08:10:29 [INFO] [TRAIN] epoch=97, iter=35820/80000, loss=0.9076, lr=0.005860, batch_cost=1.3752, reader_cost=0.0001 | ETA 16:52:36 2021-02-23 08:10:43 [INFO] [TRAIN] epoch=97, iter=35830/80000, loss=0.8003, lr=0.005859, batch_cost=1.3743, reader_cost=0.0001 | ETA 16:51:44 2021-02-23 08:10:56 [INFO] [TRAIN] epoch=97, iter=35840/80000, loss=0.9221, lr=0.005858, batch_cost=1.3571, reader_cost=0.0001 | ETA 16:38:49 2021-02-23 08:11:10 [INFO] [TRAIN] epoch=97, iter=35850/80000, loss=0.9585, lr=0.005857, batch_cost=1.3335, reader_cost=0.0001 | ETA 16:21:15 2021-02-23 08:11:23 [INFO] [TRAIN] epoch=97, iter=35860/80000, loss=0.8911, lr=0.005856, batch_cost=1.3615, reader_cost=0.0001 | ETA 16:41:36 2021-02-23 08:11:37 [INFO] [TRAIN] epoch=97, iter=35870/80000, loss=0.8817, lr=0.005854, batch_cost=1.3649, reader_cost=0.0001 | ETA 16:43:54 2021-02-23 08:11:51 [INFO] [TRAIN] epoch=97, iter=35880/80000, loss=0.8204, lr=0.005853, batch_cost=1.3728, reader_cost=0.0001 | ETA 16:49:27 2021-02-23 08:12:04 [INFO] [TRAIN] epoch=97, iter=35890/80000, loss=0.9021, lr=0.005852, batch_cost=1.3757, reader_cost=0.0001 | ETA 16:51:23 2021-02-23 08:12:18 [INFO] [TRAIN] epoch=97, iter=35900/80000, loss=0.8401, lr=0.005851, batch_cost=1.4111, reader_cost=0.0001 | ETA 17:17:09 2021-02-23 08:12:32 [INFO] [TRAIN] epoch=97, iter=35910/80000, loss=0.9875, lr=0.005850, batch_cost=1.3629, reader_cost=0.0001 | ETA 16:41:29 2021-02-23 08:12:46 [INFO] [TRAIN] epoch=97, iter=35920/80000, loss=0.8362, lr=0.005849, batch_cost=1.3506, reader_cost=0.0001 | ETA 16:32:12 2021-02-23 08:12:59 [INFO] [TRAIN] epoch=97, iter=35930/80000, loss=0.8767, lr=0.005847, batch_cost=1.3874, reader_cost=0.0001 | ETA 16:59:01 2021-02-23 08:13:13 [INFO] [TRAIN] epoch=97, iter=35940/80000, loss=0.8673, lr=0.005846, batch_cost=1.3519, reader_cost=0.0001 | ETA 16:32:42 2021-02-23 08:13:27 [INFO] [TRAIN] epoch=97, iter=35950/80000, loss=0.8890, lr=0.005845, batch_cost=1.3636, reader_cost=0.0001 | ETA 16:41:06 2021-02-23 08:13:40 [INFO] [TRAIN] epoch=97, iter=35960/80000, loss=0.8775, lr=0.005844, batch_cost=1.3686, reader_cost=0.0001 | ETA 16:44:33 2021-02-23 08:13:54 [INFO] [TRAIN] epoch=97, iter=35970/80000, loss=0.8328, lr=0.005843, batch_cost=1.3927, reader_cost=0.0001 | ETA 17:01:59 2021-02-23 08:14:08 [INFO] [TRAIN] epoch=97, iter=35980/80000, loss=0.9426, lr=0.005841, batch_cost=1.3601, reader_cost=0.0001 | ETA 16:37:50 2021-02-23 08:14:21 [INFO] [TRAIN] epoch=97, iter=35990/80000, loss=1.0165, lr=0.005840, batch_cost=1.3602, reader_cost=0.0001 | ETA 16:37:41 2021-02-23 08:14:35 [INFO] [TRAIN] epoch=97, iter=36000/80000, loss=0.7858, lr=0.005839, batch_cost=1.3430, reader_cost=0.0001 | ETA 16:24:50 2021-02-23 08:14:35 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:09 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:01 - batch_cost: 0.2186 - reader cost: 0.0933  3/125 [..............................] - ETA: 57s - batch_cost: 0.2825 - reader cost: 0.1155  4/125 [..............................] - ETA: 55s - batch_cost: 0.3231 - reader cost: 0.1328 5/125 [>.............................] - ETA: 54s - batch_cost: 0.3454 - reader cost: 0.1432 6/125 [>.............................] - ETA: 54s - batch_cost: 0.3611 - reader cost: 0.1501 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3642 - reader cost: 0.1478 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3682 - reader cost: 0.1477 9/125 [=>............................] - ETA: 50s - batch_cost: 0.3747 - reader cost: 0.1512 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3814 - reader cost: 0.1543 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3853 - reader cost: 0.1560 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3892 - reader cost: 0.1576 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3894 - reader cost: 0.1563 14/125 [==>...........................] - ETA: 47s - batch_cost: 0.3881 - reader cost: 0.1530 15/125 [==>...........................] - ETA: 46s - batch_cost: 0.3879 - reader cost: 0.1512 16/125 [==>...........................] - ETA: 46s - batch_cost: 0.3898 - reader cost: 0.1487 17/125 [===>..........................] - ETA: 45s - batch_cost: 0.3928 - reader cost: 0.1473 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3932 - reader cost: 0.1475 19/125 [===>..........................] - ETA: 44s - batch_cost: 0.3951 - reader cost: 0.1492 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3948 - reader cost: 0.1475 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.3983 - reader cost: 0.1508 22/125 [====>.........................] - ETA: 43s - batch_cost: 0.3994 - reader cost: 0.1518 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4016 - reader cost: 0.1532 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4047 - reader cost: 0.1563 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4057 - reader cost: 0.1571 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4051 - reader cost: 0.1564 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4036 - reader cost: 0.1548 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4045 - reader cost: 0.1557 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4063 - reader cost: 0.1571 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4070 - reader cost: 0.1577 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4080 - reader cost: 0.1585 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4075 - reader cost: 0.1574 33/125 [======>.......................] - ETA: 38s - batch_cost: 0.4060 - reader cost: 0.1557 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4047 - reader cost: 0.1544 35/125 [=======>......................] - ETA: 37s - batch_cost: 0.4037 - reader cost: 0.1533 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4041 - reader cost: 0.1538 37/125 [=======>......................] - ETA: 36s - batch_cost: 0.4049 - reader cost: 0.1545 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4041 - reader cost: 0.1537 39/125 [========>.....................] - ETA: 35s - batch_cost: 0.4035 - reader cost: 0.1530 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4030 - reader cost: 0.1524 41/125 [========>.....................] - ETA: 34s - batch_cost: 0.4030 - reader cost: 0.1514 42/125 [=========>....................] - ETA: 34s - batch_cost: 0.4029 - reader cost: 0.1511 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4033 - reader cost: 0.1517 44/125 [=========>....................] - ETA: 33s - batch_cost: 0.4045 - reader cost: 0.1529 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4041 - reader cost: 0.1525 46/125 [==========>...................] - ETA: 32s - batch_cost: 0.4048 - reader cost: 0.1532 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4055 - reader cost: 0.1539 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4054 - reader cost: 0.1534 49/125 [==========>...................] - ETA: 31s - batch_cost: 0.4051 - reader cost: 0.1531 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4043 - reader cost: 0.1523 51/125 [===========>..................] - ETA: 30s - batch_cost: 0.4039 - reader cost: 0.1518 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4042 - reader cost: 0.1522 53/125 [===========>..................] - ETA: 29s - batch_cost: 0.4046 - reader cost: 0.1527 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4049 - reader cost: 0.1530 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4057 - reader cost: 0.1536 56/125 [============>.................] - ETA: 28s - batch_cost: 0.4052 - reader cost: 0.1532 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4058 - reader cost: 0.1535 58/125 [============>.................] - ETA: 27s - batch_cost: 0.4051 - reader cost: 0.1529 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4056 - reader cost: 0.1527 60/125 [=============>................] - ETA: 26s - batch_cost: 0.4060 - reader cost: 0.1531 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4056 - reader cost: 0.1526 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4061 - reader cost: 0.1530 63/125 [==============>...............] - ETA: 25s - batch_cost: 0.4064 - reader cost: 0.1533 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4068 - reader cost: 0.1537 65/125 [==============>...............] - ETA: 24s - batch_cost: 0.4062 - reader cost: 0.1532 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4071 - reader cost: 0.1541 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4069 - reader cost: 0.1539 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4067 - reader cost: 0.1536 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4070 - reader cost: 0.1530 70/125 [===============>..............] - ETA: 22s - batch_cost: 0.4072 - reader cost: 0.1524 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4070 - reader cost: 0.1522 72/125 [================>.............] - ETA: 21s - batch_cost: 0.4072 - reader cost: 0.1525 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4075 - reader cost: 0.1528 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4072 - reader cost: 0.1523 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4073 - reader cost: 0.1525 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4069 - reader cost: 0.1521 77/125 [=================>............] - ETA: 19s - batch_cost: 0.4068 - reader cost: 0.1520 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4070 - reader cost: 0.1521 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4072 - reader cost: 0.1523 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4073 - reader cost: 0.1525 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4075 - reader cost: 0.1528 82/125 [==================>...........] - ETA: 17s - batch_cost: 0.4078 - reader cost: 0.1530 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4086 - reader cost: 0.1536 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4088 - reader cost: 0.1538 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4090 - reader cost: 0.1540 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4087 - reader cost: 0.1538 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4090 - reader cost: 0.1541 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4093 - reader cost: 0.1544 89/125 [====================>.........] - ETA: 14s - batch_cost: 0.4097 - reader cost: 0.1547 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4101 - reader cost: 0.1550 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4102 - reader cost: 0.1552 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4104 - reader cost: 0.1554 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4101 - reader cost: 0.1551 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4097 - reader cost: 0.1547 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4093 - reader cost: 0.1543 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4087 - reader cost: 0.1538 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4089 - reader cost: 0.1541 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4086 - reader cost: 0.1538 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4088 - reader cost: 0.1540 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4089 - reader cost: 0.1542 101/125 [=======================>......] - ETA: 9s - batch_cost: 0.4088 - reader cost: 0.1541  102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4090 - reader cost: 0.1543 103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4095 - reader cost: 0.1548 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4098 - reader cost: 0.1551 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4100 - reader cost: 0.1554 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4103 - reader cost: 0.1556 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4105 - reader cost: 0.1557 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4106 - reader cost: 0.1558 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4110 - reader cost: 0.1562 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4105 - reader cost: 0.1558 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4103 - reader cost: 0.1556 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4108 - reader cost: 0.1560 113/125 [==========================>...] - ETA: 4s - batch_cost: 0.4104 - reader cost: 0.1556 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4102 - reader cost: 0.1555 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4100 - reader cost: 0.1553 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4096 - reader cost: 0.1549 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4098 - reader cost: 0.1548 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4101 - reader cost: 0.1550 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4100 - reader cost: 0.1546 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4103 - reader cost: 0.1551 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4106 - reader cost: 0.1553 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4102 - reader cost: 0.1550 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4101 - reader cost: 0.1549 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4099 - reader cost: 0.1547 125/125 [==============================] - 52s 415ms/step - batch_cost: 0.4101 - reader cost: 0.1550 2021-02-23 08:15:27 [INFO] [EVAL] #Images=500 mIoU=0.6845 Acc=0.9484 Kappa=0.9330 2021-02-23 08:15:27 [INFO] [EVAL] Class IoU: [0.974 0.8148 0.9058 0.3611 0.507 0.5994 0.6608 0.7421 0.9072 0.5934 0.9473 0.7436 0.5197 0.9278 0.7063 0.6853 0.2553 0.4292 0.7246] 2021-02-23 08:15:27 [INFO] [EVAL] Class Acc: [0.9862 0.9012 0.9502 0.6324 0.6251 0.8486 0.7758 0.9168 0.9416 0.8156 0.9746 0.802 0.6243 0.9589 0.8935 0.7158 0.9457 0.6006 0.8812] 2021-02-23 08:15:31 [INFO] [EVAL] The model with the best validation mIoU (0.7576) was saved at iter 31000. 2021-02-23 08:15:44 [INFO] [TRAIN] epoch=97, iter=36010/80000, loss=0.8880, lr=0.005838, batch_cost=1.3484, reader_cost=0.0001 | ETA 16:28:37 2021-02-23 08:15:58 [INFO] [TRAIN] epoch=97, iter=36020/80000, loss=0.9028, lr=0.005837, batch_cost=1.3458, reader_cost=0.0001 | ETA 16:26:29 2021-02-23 08:16:11 [INFO] [TRAIN] epoch=97, iter=36030/80000, loss=0.8722, lr=0.005835, batch_cost=1.3230, reader_cost=0.0001 | ETA 16:09:33 2021-02-23 08:16:24 [INFO] [TRAIN] epoch=97, iter=36040/80000, loss=0.8845, lr=0.005834, batch_cost=1.3405, reader_cost=0.0001 | ETA 16:22:09 2021-02-23 08:16:38 [INFO] [TRAIN] epoch=97, iter=36050/80000, loss=0.9235, lr=0.005833, batch_cost=1.3597, reader_cost=0.0001 | ETA 16:35:57 2021-02-23 08:16:52 [INFO] [TRAIN] epoch=97, iter=36060/80000, loss=1.0069, lr=0.005832, batch_cost=1.3708, reader_cost=0.0001 | ETA 16:43:54 2021-02-23 08:17:05 [INFO] [TRAIN] epoch=97, iter=36070/80000, loss=0.8899, lr=0.005831, batch_cost=1.3394, reader_cost=0.0001 | ETA 16:20:40 2021-02-23 08:17:19 [INFO] [TRAIN] epoch=97, iter=36080/80000, loss=1.0402, lr=0.005829, batch_cost=1.3529, reader_cost=0.0001 | ETA 16:30:20 2021-02-23 08:17:33 [INFO] [TRAIN] epoch=98, iter=36090/80000, loss=0.8585, lr=0.005828, batch_cost=1.4332, reader_cost=0.0617 | ETA 17:28:51 2021-02-23 08:17:47 [INFO] [TRAIN] epoch=98, iter=36100/80000, loss=0.9111, lr=0.005827, batch_cost=1.3739, reader_cost=0.0001 | ETA 16:45:12 2021-02-23 08:18:00 [INFO] [TRAIN] epoch=98, iter=36110/80000, loss=0.9351, lr=0.005826, batch_cost=1.3658, reader_cost=0.0001 | ETA 16:39:05 2021-02-23 08:18:14 [INFO] [TRAIN] epoch=98, iter=36120/80000, loss=0.8350, lr=0.005825, batch_cost=1.3426, reader_cost=0.0001 | ETA 16:21:53 2021-02-23 08:18:27 [INFO] [TRAIN] epoch=98, iter=36130/80000, loss=0.9239, lr=0.005823, batch_cost=1.3497, reader_cost=0.0001 | ETA 16:26:49 2021-02-23 08:18:41 [INFO] [TRAIN] epoch=98, iter=36140/80000, loss=0.9335, lr=0.005822, batch_cost=1.3672, reader_cost=0.0001 | ETA 16:39:25 2021-02-23 08:18:55 [INFO] [TRAIN] epoch=98, iter=36150/80000, loss=0.9131, lr=0.005821, batch_cost=1.3601, reader_cost=0.0001 | ETA 16:33:58 2021-02-23 08:19:08 [INFO] [TRAIN] epoch=98, iter=36160/80000, loss=0.8772, lr=0.005820, batch_cost=1.3411, reader_cost=0.0001 | ETA 16:19:55 2021-02-23 08:19:22 [INFO] [TRAIN] epoch=98, iter=36170/80000, loss=0.9686, lr=0.005819, batch_cost=1.3492, reader_cost=0.0001 | ETA 16:25:34 2021-02-23 08:19:35 [INFO] [TRAIN] epoch=98, iter=36180/80000, loss=0.8230, lr=0.005817, batch_cost=1.3378, reader_cost=0.0001 | ETA 16:17:03 2021-02-23 08:19:49 [INFO] [TRAIN] epoch=98, iter=36190/80000, loss=0.8947, lr=0.005816, batch_cost=1.3603, reader_cost=0.0001 | ETA 16:33:12 2021-02-23 08:20:02 [INFO] [TRAIN] epoch=98, iter=36200/80000, loss=0.9967, lr=0.005815, batch_cost=1.3268, reader_cost=0.0001 | ETA 16:08:32 2021-02-23 08:20:15 [INFO] [TRAIN] epoch=98, iter=36210/80000, loss=0.9660, lr=0.005814, batch_cost=1.3490, reader_cost=0.0001 | ETA 16:24:32 2021-02-23 08:20:29 [INFO] [TRAIN] epoch=98, iter=36220/80000, loss=0.8296, lr=0.005813, batch_cost=1.3456, reader_cost=0.0001 | ETA 16:21:50 2021-02-23 08:20:42 [INFO] [TRAIN] epoch=98, iter=36230/80000, loss=0.9004, lr=0.005811, batch_cost=1.3340, reader_cost=0.0001 | ETA 16:13:09 2021-02-23 08:20:56 [INFO] [TRAIN] epoch=98, iter=36240/80000, loss=0.8107, lr=0.005810, batch_cost=1.3515, reader_cost=0.0001 | ETA 16:25:43 2021-02-23 08:21:09 [INFO] [TRAIN] epoch=98, iter=36250/80000, loss=1.0100, lr=0.005809, batch_cost=1.3759, reader_cost=0.0001 | ETA 16:43:17 2021-02-23 08:21:23 [INFO] [TRAIN] epoch=98, iter=36260/80000, loss=1.0011, lr=0.005808, batch_cost=1.3771, reader_cost=0.0001 | ETA 16:43:55 2021-02-23 08:21:37 [INFO] [TRAIN] epoch=98, iter=36270/80000, loss=0.8319, lr=0.005807, batch_cost=1.3609, reader_cost=0.0001 | ETA 16:31:50 2021-02-23 08:21:50 [INFO] [TRAIN] epoch=98, iter=36280/80000, loss=0.8317, lr=0.005806, batch_cost=1.3731, reader_cost=0.0001 | ETA 16:40:33 2021-02-23 08:22:04 [INFO] [TRAIN] epoch=98, iter=36290/80000, loss=0.9584, lr=0.005804, batch_cost=1.3741, reader_cost=0.0001 | ETA 16:41:03 2021-02-23 08:22:18 [INFO] [TRAIN] epoch=98, iter=36300/80000, loss=0.9053, lr=0.005803, batch_cost=1.3707, reader_cost=0.0001 | ETA 16:38:20 2021-02-23 08:22:32 [INFO] [TRAIN] epoch=98, iter=36310/80000, loss=0.9179, lr=0.005802, batch_cost=1.3674, reader_cost=0.0001 | ETA 16:35:40 2021-02-23 08:22:45 [INFO] [TRAIN] epoch=98, iter=36320/80000, loss=0.8951, lr=0.005801, batch_cost=1.3574, reader_cost=0.0001 | ETA 16:28:11 2021-02-23 08:22:59 [INFO] [TRAIN] epoch=98, iter=36330/80000, loss=0.9514, lr=0.005800, batch_cost=1.3679, reader_cost=0.0001 | ETA 16:35:37 2021-02-23 08:23:13 [INFO] [TRAIN] epoch=98, iter=36340/80000, loss=0.9032, lr=0.005798, batch_cost=1.3697, reader_cost=0.0001 | ETA 16:36:42 2021-02-23 08:23:26 [INFO] [TRAIN] epoch=98, iter=36350/80000, loss=0.9212, lr=0.005797, batch_cost=1.3699, reader_cost=0.0001 | ETA 16:36:37 2021-02-23 08:23:40 [INFO] [TRAIN] epoch=98, iter=36360/80000, loss=0.8952, lr=0.005796, batch_cost=1.3798, reader_cost=0.0001 | ETA 16:43:32 2021-02-23 08:23:54 [INFO] [TRAIN] epoch=98, iter=36370/80000, loss=0.8705, lr=0.005795, batch_cost=1.3656, reader_cost=0.0001 | ETA 16:33:01 2021-02-23 08:24:07 [INFO] [TRAIN] epoch=98, iter=36380/80000, loss=0.8994, lr=0.005794, batch_cost=1.3615, reader_cost=0.0001 | ETA 16:29:48 2021-02-23 08:24:21 [INFO] [TRAIN] epoch=98, iter=36390/80000, loss=0.7736, lr=0.005792, batch_cost=1.3548, reader_cost=0.0001 | ETA 16:24:40 2021-02-23 08:24:34 [INFO] [TRAIN] epoch=98, iter=36400/80000, loss=0.8882, lr=0.005791, batch_cost=1.3568, reader_cost=0.0001 | ETA 16:25:54 2021-02-23 08:24:48 [INFO] [TRAIN] epoch=98, iter=36410/80000, loss=0.7886, lr=0.005790, batch_cost=1.3404, reader_cost=0.0001 | ETA 16:13:50 2021-02-23 08:25:02 [INFO] [TRAIN] epoch=98, iter=36420/80000, loss=0.7980, lr=0.005789, batch_cost=1.3767, reader_cost=0.0001 | ETA 16:39:56 2021-02-23 08:25:15 [INFO] [TRAIN] epoch=98, iter=36430/80000, loss=0.9057, lr=0.005788, batch_cost=1.3420, reader_cost=0.0001 | ETA 16:14:31 2021-02-23 08:25:29 [INFO] [TRAIN] epoch=98, iter=36440/80000, loss=0.9251, lr=0.005786, batch_cost=1.3493, reader_cost=0.0001 | ETA 16:19:35 2021-02-23 08:25:42 [INFO] [TRAIN] epoch=98, iter=36450/80000, loss=0.8835, lr=0.005785, batch_cost=1.3880, reader_cost=0.0001 | ETA 16:47:26 2021-02-23 08:25:57 [INFO] [TRAIN] epoch=99, iter=36460/80000, loss=0.8204, lr=0.005784, batch_cost=1.4371, reader_cost=0.0781 | ETA 17:22:49 2021-02-23 08:26:10 [INFO] [TRAIN] epoch=99, iter=36470/80000, loss=0.9602, lr=0.005783, batch_cost=1.3642, reader_cost=0.0001 | ETA 16:29:45 2021-02-23 08:26:24 [INFO] [TRAIN] epoch=99, iter=36480/80000, loss=0.8265, lr=0.005782, batch_cost=1.3483, reader_cost=0.0001 | ETA 16:17:56 2021-02-23 08:26:37 [INFO] [TRAIN] epoch=99, iter=36490/80000, loss=0.8699, lr=0.005780, batch_cost=1.3510, reader_cost=0.0001 | ETA 16:19:40 2021-02-23 08:26:51 [INFO] [TRAIN] epoch=99, iter=36500/80000, loss=0.8632, lr=0.005779, batch_cost=1.3964, reader_cost=0.0001 | ETA 16:52:21 2021-02-23 08:27:05 [INFO] [TRAIN] epoch=99, iter=36510/80000, loss=0.8542, lr=0.005778, batch_cost=1.3304, reader_cost=0.0001 | ETA 16:04:20 2021-02-23 08:27:18 [INFO] [TRAIN] epoch=99, iter=36520/80000, loss=0.8758, lr=0.005777, batch_cost=1.3744, reader_cost=0.0001 | ETA 16:35:57 2021-02-23 08:27:32 [INFO] [TRAIN] epoch=99, iter=36530/80000, loss=0.8496, lr=0.005776, batch_cost=1.3599, reader_cost=0.0001 | ETA 16:25:12 2021-02-23 08:27:46 [INFO] [TRAIN] epoch=99, iter=36540/80000, loss=0.8762, lr=0.005774, batch_cost=1.3559, reader_cost=0.0001 | ETA 16:22:08 2021-02-23 08:27:59 [INFO] [TRAIN] epoch=99, iter=36550/80000, loss=0.9195, lr=0.005773, batch_cost=1.3560, reader_cost=0.0001 | ETA 16:21:59 2021-02-23 08:28:13 [INFO] [TRAIN] epoch=99, iter=36560/80000, loss=0.8345, lr=0.005772, batch_cost=1.3518, reader_cost=0.0001 | ETA 16:18:41 2021-02-23 08:28:26 [INFO] [TRAIN] epoch=99, iter=36570/80000, loss=0.9153, lr=0.005771, batch_cost=1.3399, reader_cost=0.0001 | ETA 16:09:53 2021-02-23 08:28:40 [INFO] [TRAIN] epoch=99, iter=36580/80000, loss=0.9452, lr=0.005770, batch_cost=1.3591, reader_cost=0.0001 | ETA 16:23:33 2021-02-23 08:28:53 [INFO] [TRAIN] epoch=99, iter=36590/80000, loss=0.9108, lr=0.005768, batch_cost=1.3569, reader_cost=0.0001 | ETA 16:21:44 2021-02-23 08:29:07 [INFO] [TRAIN] epoch=99, iter=36600/80000, loss=0.8359, lr=0.005767, batch_cost=1.3629, reader_cost=0.0001 | ETA 16:25:49 2021-02-23 08:29:21 [INFO] [TRAIN] epoch=99, iter=36610/80000, loss=0.8619, lr=0.005766, batch_cost=1.3739, reader_cost=0.0001 | ETA 16:33:32 2021-02-23 08:29:34 [INFO] [TRAIN] epoch=99, iter=36620/80000, loss=0.8997, lr=0.005765, batch_cost=1.3681, reader_cost=0.0001 | ETA 16:29:06 2021-02-23 08:29:47 [INFO] [TRAIN] epoch=99, iter=36630/80000, loss=0.9102, lr=0.005764, batch_cost=1.3175, reader_cost=0.0001 | ETA 15:52:20 2021-02-23 08:30:01 [INFO] [TRAIN] epoch=99, iter=36640/80000, loss=0.9454, lr=0.005762, batch_cost=1.3621, reader_cost=0.0001 | ETA 16:24:20 2021-02-23 08:30:15 [INFO] [TRAIN] epoch=99, iter=36650/80000, loss=0.9263, lr=0.005761, batch_cost=1.4004, reader_cost=0.0001 | ETA 16:51:45 2021-02-23 08:30:29 [INFO] [TRAIN] epoch=99, iter=36660/80000, loss=0.8701, lr=0.005760, batch_cost=1.3643, reader_cost=0.0001 | ETA 16:25:28 2021-02-23 08:30:42 [INFO] [TRAIN] epoch=99, iter=36670/80000, loss=0.8932, lr=0.005759, batch_cost=1.3750, reader_cost=0.0001 | ETA 16:32:58 2021-02-23 08:30:56 [INFO] [TRAIN] epoch=99, iter=36680/80000, loss=0.8669, lr=0.005758, batch_cost=1.3629, reader_cost=0.0001 | ETA 16:24:00 2021-02-23 08:31:10 [INFO] [TRAIN] epoch=99, iter=36690/80000, loss=0.8913, lr=0.005756, batch_cost=1.3670, reader_cost=0.0001 | ETA 16:26:46 2021-02-23 08:31:23 [INFO] [TRAIN] epoch=99, iter=36700/80000, loss=0.8972, lr=0.005755, batch_cost=1.3716, reader_cost=0.0001 | ETA 16:29:48 2021-02-23 08:31:37 [INFO] [TRAIN] epoch=99, iter=36710/80000, loss=0.8227, lr=0.005754, batch_cost=1.3926, reader_cost=0.0001 | ETA 16:44:45 2021-02-23 08:31:51 [INFO] [TRAIN] epoch=99, iter=36720/80000, loss=0.8681, lr=0.005753, batch_cost=1.3567, reader_cost=0.0001 | ETA 16:18:37 2021-02-23 08:32:04 [INFO] [TRAIN] epoch=99, iter=36730/80000, loss=0.8765, lr=0.005752, batch_cost=1.3415, reader_cost=0.0001 | ETA 16:07:27 2021-02-23 08:32:18 [INFO] [TRAIN] epoch=99, iter=36740/80000, loss=0.8732, lr=0.005751, batch_cost=1.3483, reader_cost=0.0001 | ETA 16:12:08 2021-02-23 08:32:31 [INFO] [TRAIN] epoch=99, iter=36750/80000, loss=0.8959, lr=0.005749, batch_cost=1.3532, reader_cost=0.0001 | ETA 16:15:26 2021-02-23 08:32:45 [INFO] [TRAIN] epoch=99, iter=36760/80000, loss=0.8600, lr=0.005748, batch_cost=1.3308, reader_cost=0.0001 | ETA 15:59:03 2021-02-23 08:32:59 [INFO] [TRAIN] epoch=99, iter=36770/80000, loss=0.8659, lr=0.005747, batch_cost=1.4071, reader_cost=0.0001 | ETA 16:53:50 2021-02-23 08:33:12 [INFO] [TRAIN] epoch=99, iter=36780/80000, loss=0.9207, lr=0.005746, batch_cost=1.3602, reader_cost=0.0001 | ETA 16:19:47 2021-02-23 08:33:26 [INFO] [TRAIN] epoch=99, iter=36790/80000, loss=1.0048, lr=0.005745, batch_cost=1.3450, reader_cost=0.0001 | ETA 16:08:36 2021-02-23 08:33:39 [INFO] [TRAIN] epoch=99, iter=36800/80000, loss=0.9370, lr=0.005743, batch_cost=1.3586, reader_cost=0.0001 | ETA 16:18:10 2021-02-23 08:33:53 [INFO] [TRAIN] epoch=99, iter=36810/80000, loss=0.9360, lr=0.005742, batch_cost=1.3382, reader_cost=0.0001 | ETA 16:03:16 2021-02-23 08:34:07 [INFO] [TRAIN] epoch=99, iter=36820/80000, loss=0.8719, lr=0.005741, batch_cost=1.3740, reader_cost=0.0001 | ETA 16:28:49 2021-02-23 08:34:21 [INFO] [TRAIN] epoch=100, iter=36830/80000, loss=0.8324, lr=0.005740, batch_cost=1.4334, reader_cost=0.0776 | ETA 17:11:18 2021-02-23 08:34:35 [INFO] [TRAIN] epoch=100, iter=36840/80000, loss=0.9390, lr=0.005739, batch_cost=1.3676, reader_cost=0.0001 | ETA 16:23:47 2021-02-23 08:34:48 [INFO] [TRAIN] epoch=100, iter=36850/80000, loss=0.9296, lr=0.005737, batch_cost=1.3596, reader_cost=0.0001 | ETA 16:17:45 2021-02-23 08:35:02 [INFO] [TRAIN] epoch=100, iter=36860/80000, loss=0.8727, lr=0.005736, batch_cost=1.3519, reader_cost=0.0001 | ETA 16:12:02 2021-02-23 08:35:15 [INFO] [TRAIN] epoch=100, iter=36870/80000, loss=0.8297, lr=0.005735, batch_cost=1.3445, reader_cost=0.0001 | ETA 16:06:27 2021-02-23 08:35:29 [INFO] [TRAIN] epoch=100, iter=36880/80000, loss=1.0644, lr=0.005734, batch_cost=1.3988, reader_cost=0.0001 | ETA 16:45:18 2021-02-23 08:35:42 [INFO] [TRAIN] epoch=100, iter=36890/80000, loss=0.9621, lr=0.005733, batch_cost=1.3296, reader_cost=0.0001 | ETA 15:55:20 2021-02-23 08:35:56 [INFO] [TRAIN] epoch=100, iter=36900/80000, loss=0.9757, lr=0.005731, batch_cost=1.3879, reader_cost=0.0001 | ETA 16:36:58 2021-02-23 08:36:10 [INFO] [TRAIN] epoch=100, iter=36910/80000, loss=0.9275, lr=0.005730, batch_cost=1.3472, reader_cost=0.0001 | ETA 16:07:31 2021-02-23 08:36:24 [INFO] [TRAIN] epoch=100, iter=36920/80000, loss=0.9118, lr=0.005729, batch_cost=1.3806, reader_cost=0.0001 | ETA 16:31:17 2021-02-23 08:36:37 [INFO] [TRAIN] epoch=100, iter=36930/80000, loss=0.9912, lr=0.005728, batch_cost=1.3649, reader_cost=0.0001 | ETA 16:19:44 2021-02-23 08:36:51 [INFO] [TRAIN] epoch=100, iter=36940/80000, loss=0.8747, lr=0.005727, batch_cost=1.3672, reader_cost=0.0001 | ETA 16:21:11 2021-02-23 08:37:04 [INFO] [TRAIN] epoch=100, iter=36950/80000, loss=0.9216, lr=0.005725, batch_cost=1.3545, reader_cost=0.0001 | ETA 16:11:51 2021-02-23 08:37:18 [INFO] [TRAIN] epoch=100, iter=36960/80000, loss=0.9508, lr=0.005724, batch_cost=1.3757, reader_cost=0.0001 | ETA 16:26:51 2021-02-23 08:37:32 [INFO] [TRAIN] epoch=100, iter=36970/80000, loss=0.9321, lr=0.005723, batch_cost=1.4068, reader_cost=0.0001 | ETA 16:48:53 2021-02-23 08:37:46 [INFO] [TRAIN] epoch=100, iter=36980/80000, loss=0.8992, lr=0.005722, batch_cost=1.3769, reader_cost=0.0001 | ETA 16:27:13 2021-02-23 08:37:59 [INFO] [TRAIN] epoch=100, iter=36990/80000, loss=0.8876, lr=0.005721, batch_cost=1.3424, reader_cost=0.0001 | ETA 16:02:17 2021-02-23 08:38:13 [INFO] [TRAIN] epoch=100, iter=37000/80000, loss=0.9552, lr=0.005719, batch_cost=1.3726, reader_cost=0.0001 | ETA 16:23:41 2021-02-23 08:38:13 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:17 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:02 - batch_cost: 0.1927 - reader cost: 0.0649  3/125 [..............................] - ETA: 58s - batch_cost: 0.2677 - reader cost: 0.0851  4/125 [..............................] - ETA: 57s - batch_cost: 0.3154 - reader cost: 0.0951 5/125 [>.............................] - ETA: 56s - batch_cost: 0.3416 - reader cost: 0.1000 6/125 [>.............................] - ETA: 54s - batch_cost: 0.3549 - reader cost: 0.1023 7/125 [>.............................] - ETA: 53s - batch_cost: 0.3643 - reader cost: 0.1118 8/125 [>.............................] - ETA: 52s - batch_cost: 0.3697 - reader cost: 0.1176 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3724 - reader cost: 0.1206 10/125 [=>............................] - ETA: 51s - batch_cost: 0.3808 - reader cost: 0.1290 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3887 - reader cost: 0.1374 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3884 - reader cost: 0.1370 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3873 - reader cost: 0.1361 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3887 - reader cost: 0.1371 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3898 - reader cost: 0.1359 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3919 - reader cost: 0.1383 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3908 - reader cost: 0.1372 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3911 - reader cost: 0.1377 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3919 - reader cost: 0.1385 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3941 - reader cost: 0.1389 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.3957 - reader cost: 0.1403 22/125 [====>.........................] - ETA: 43s - batch_cost: 0.3969 - reader cost: 0.1418 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.3987 - reader cost: 0.1437 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.3973 - reader cost: 0.1425 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.3991 - reader cost: 0.1440 26/125 [=====>........................] - ETA: 41s - batch_cost: 0.3978 - reader cost: 0.1425 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.3993 - reader cost: 0.1441 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4013 - reader cost: 0.1464 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4006 - reader cost: 0.1459 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4020 - reader cost: 0.1476 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.4013 - reader cost: 0.1470 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4022 - reader cost: 0.1480 33/125 [======>.......................] - ETA: 38s - batch_cost: 0.4031 - reader cost: 0.1490 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4038 - reader cost: 0.1500 35/125 [=======>......................] - ETA: 37s - batch_cost: 0.4035 - reader cost: 0.1492 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4036 - reader cost: 0.1493 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4040 - reader cost: 0.1498 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4037 - reader cost: 0.1495 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4043 - reader cost: 0.1502 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4049 - reader cost: 0.1509 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4048 - reader cost: 0.1510 42/125 [=========>....................] - ETA: 34s - batch_cost: 0.4055 - reader cost: 0.1517 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4054 - reader cost: 0.1515 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4057 - reader cost: 0.1519 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4062 - reader cost: 0.1523 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4068 - reader cost: 0.1528 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4073 - reader cost: 0.1535 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4065 - reader cost: 0.1525 49/125 [==========>...................] - ETA: 31s - batch_cost: 0.4070 - reader cost: 0.1530 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4077 - reader cost: 0.1537 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4079 - reader cost: 0.1541 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4075 - reader cost: 0.1537 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4070 - reader cost: 0.1530 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4071 - reader cost: 0.1532 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4075 - reader cost: 0.1536 56/125 [============>.................] - ETA: 28s - batch_cost: 0.4080 - reader cost: 0.1541 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4075 - reader cost: 0.1537 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4080 - reader cost: 0.1541 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4081 - reader cost: 0.1542 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4078 - reader cost: 0.1539 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4080 - reader cost: 0.1542 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4084 - reader cost: 0.1547 63/125 [==============>...............] - ETA: 25s - batch_cost: 0.4087 - reader cost: 0.1550 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4091 - reader cost: 0.1555 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4094 - reader cost: 0.1558 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4098 - reader cost: 0.1562 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4100 - reader cost: 0.1564 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4102 - reader cost: 0.1567 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4099 - reader cost: 0.1563 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4100 - reader cost: 0.1565 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4105 - reader cost: 0.1569 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4098 - reader cost: 0.1563 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4102 - reader cost: 0.1568 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4098 - reader cost: 0.1563 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4100 - reader cost: 0.1564 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4102 - reader cost: 0.1566 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4104 - reader cost: 0.1567 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4107 - reader cost: 0.1572 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4105 - reader cost: 0.1570 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4100 - reader cost: 0.1564 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4102 - reader cost: 0.1567 82/125 [==================>...........] - ETA: 17s - batch_cost: 0.4105 - reader cost: 0.1570 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4106 - reader cost: 0.1572 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4109 - reader cost: 0.1574 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4111 - reader cost: 0.1577 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4106 - reader cost: 0.1572 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4108 - reader cost: 0.1575 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4104 - reader cost: 0.1571 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4106 - reader cost: 0.1574 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4109 - reader cost: 0.1577 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4108 - reader cost: 0.1576 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4110 - reader cost: 0.1579 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4112 - reader cost: 0.1581 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4111 - reader cost: 0.1580 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4114 - reader cost: 0.1583 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4111 - reader cost: 0.1579 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4112 - reader cost: 0.1582 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4116 - reader cost: 0.1584 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4117 - reader cost: 0.1584 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4117 - reader cost: 0.1585 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4120 - reader cost: 0.1587 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4114 - reader cost: 0.1581  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4116 - reader cost: 0.1583 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4118 - reader cost: 0.1585 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4113 - reader cost: 0.1581 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4112 - reader cost: 0.1579 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4108 - reader cost: 0.1576 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4110 - reader cost: 0.1572 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4112 - reader cost: 0.1572 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4110 - reader cost: 0.1567 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4113 - reader cost: 0.1570 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4113 - reader cost: 0.1567 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4113 - reader cost: 0.1565 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4115 - reader cost: 0.1565 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4115 - reader cost: 0.1561 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4112 - reader cost: 0.1558 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4113 - reader cost: 0.1560 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4116 - reader cost: 0.1563 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4116 - reader cost: 0.1559 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4118 - reader cost: 0.1557 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4119 - reader cost: 0.1557 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4119 - reader cost: 0.1558 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4120 - reader cost: 0.1560 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4125 - reader cost: 0.1565 125/125 [==============================] - 52s 417ms/step - batch_cost: 0.4122 - reader cost: 0.1562 2021-02-23 08:39:05 [INFO] [EVAL] #Images=500 mIoU=0.7205 Acc=0.9517 Kappa=0.9372 2021-02-23 08:39:05 [INFO] [EVAL] Class IoU: [0.9674 0.7602 0.9169 0.3569 0.5692 0.6491 0.7215 0.7765 0.9171 0.615 0.9447 0.8214 0.6207 0.9481 0.7574 0.7563 0.2182 0.6078 0.7649] 2021-02-23 08:39:05 [INFO] [EVAL] Class Acc: [0.9749 0.9159 0.947 0.8344 0.7543 0.8489 0.8474 0.9076 0.9544 0.7278 0.9665 0.8978 0.7988 0.9753 0.856 0.8231 0.9847 0.7936 0.8373] 2021-02-23 08:39:09 [INFO] [EVAL] The model with the best validation mIoU (0.7576) was saved at iter 31000. 2021-02-23 08:39:23 [INFO] [TRAIN] epoch=100, iter=37010/80000, loss=0.8536, lr=0.005718, batch_cost=1.3525, reader_cost=0.0001 | ETA 16:09:06 2021-02-23 08:39:36 [INFO] [TRAIN] epoch=100, iter=37020/80000, loss=0.9248, lr=0.005717, batch_cost=1.3476, reader_cost=0.0001 | ETA 16:05:20 2021-02-23 08:39:50 [INFO] [TRAIN] epoch=100, iter=37030/80000, loss=0.8269, lr=0.005716, batch_cost=1.3591, reader_cost=0.0001 | ETA 16:13:21 2021-02-23 08:40:04 [INFO] [TRAIN] epoch=100, iter=37040/80000, loss=0.9546, lr=0.005715, batch_cost=1.3714, reader_cost=0.0001 | ETA 16:21:54 2021-02-23 08:40:17 [INFO] [TRAIN] epoch=100, iter=37050/80000, loss=0.9268, lr=0.005713, batch_cost=1.3370, reader_cost=0.0001 | ETA 15:57:04 2021-02-23 08:40:31 [INFO] [TRAIN] epoch=100, iter=37060/80000, loss=0.8939, lr=0.005712, batch_cost=1.3522, reader_cost=0.0001 | ETA 16:07:44 2021-02-23 08:40:44 [INFO] [TRAIN] epoch=100, iter=37070/80000, loss=0.9028, lr=0.005711, batch_cost=1.3502, reader_cost=0.0001 | ETA 16:06:04 2021-02-23 08:40:58 [INFO] [TRAIN] epoch=100, iter=37080/80000, loss=0.9715, lr=0.005710, batch_cost=1.3444, reader_cost=0.0001 | ETA 16:01:39 2021-02-23 08:41:11 [INFO] [TRAIN] epoch=100, iter=37090/80000, loss=0.9328, lr=0.005709, batch_cost=1.3638, reader_cost=0.0001 | ETA 16:15:22 2021-02-23 08:41:25 [INFO] [TRAIN] epoch=100, iter=37100/80000, loss=0.9580, lr=0.005707, batch_cost=1.3613, reader_cost=0.0001 | ETA 16:13:18 2021-02-23 08:41:38 [INFO] [TRAIN] epoch=100, iter=37110/80000, loss=0.9270, lr=0.005706, batch_cost=1.3509, reader_cost=0.0001 | ETA 16:05:41 2021-02-23 08:41:52 [INFO] [TRAIN] epoch=100, iter=37120/80000, loss=0.8263, lr=0.005705, batch_cost=1.3502, reader_cost=0.0001 | ETA 16:04:56 2021-02-23 08:42:05 [INFO] [TRAIN] epoch=100, iter=37130/80000, loss=0.8964, lr=0.005704, batch_cost=1.3542, reader_cost=0.0001 | ETA 16:07:36 2021-02-23 08:42:19 [INFO] [TRAIN] epoch=100, iter=37140/80000, loss=0.8277, lr=0.005703, batch_cost=1.3769, reader_cost=0.0001 | ETA 16:23:33 2021-02-23 08:42:33 [INFO] [TRAIN] epoch=100, iter=37150/80000, loss=0.9604, lr=0.005701, batch_cost=1.3724, reader_cost=0.0001 | ETA 16:20:05 2021-02-23 08:42:46 [INFO] [TRAIN] epoch=100, iter=37160/80000, loss=1.0300, lr=0.005700, batch_cost=1.3430, reader_cost=0.0001 | ETA 15:58:55 2021-02-23 08:43:00 [INFO] [TRAIN] epoch=100, iter=37170/80000, loss=0.8922, lr=0.005699, batch_cost=1.3730, reader_cost=0.0001 | ETA 16:20:04 2021-02-23 08:43:14 [INFO] [TRAIN] epoch=100, iter=37180/80000, loss=0.8582, lr=0.005698, batch_cost=1.3740, reader_cost=0.0001 | ETA 16:20:34 2021-02-23 08:43:27 [INFO] [TRAIN] epoch=100, iter=37190/80000, loss=1.0555, lr=0.005697, batch_cost=1.3511, reader_cost=0.0001 | ETA 16:03:58 2021-02-23 08:43:41 [INFO] [TRAIN] epoch=100, iter=37200/80000, loss=0.8669, lr=0.005695, batch_cost=1.3521, reader_cost=0.0001 | ETA 16:04:28 2021-02-23 08:43:55 [INFO] [TRAIN] epoch=101, iter=37210/80000, loss=0.9968, lr=0.005694, batch_cost=1.4551, reader_cost=0.0798 | ETA 17:17:43 2021-02-23 08:44:09 [INFO] [TRAIN] epoch=101, iter=37220/80000, loss=0.9762, lr=0.005693, batch_cost=1.3743, reader_cost=0.0001 | ETA 16:19:54 2021-02-23 08:44:23 [INFO] [TRAIN] epoch=101, iter=37230/80000, loss=0.8775, lr=0.005692, batch_cost=1.3523, reader_cost=0.0001 | ETA 16:03:58 2021-02-23 08:44:36 [INFO] [TRAIN] epoch=101, iter=37240/80000, loss=0.9516, lr=0.005691, batch_cost=1.3532, reader_cost=0.0001 | ETA 16:04:23 2021-02-23 08:44:50 [INFO] [TRAIN] epoch=101, iter=37250/80000, loss=0.8816, lr=0.005689, batch_cost=1.3570, reader_cost=0.0001 | ETA 16:06:51 2021-02-23 08:45:03 [INFO] [TRAIN] epoch=101, iter=37260/80000, loss=0.9368, lr=0.005688, batch_cost=1.3687, reader_cost=0.0001 | ETA 16:14:56 2021-02-23 08:45:17 [INFO] [TRAIN] epoch=101, iter=37270/80000, loss=0.9115, lr=0.005687, batch_cost=1.3935, reader_cost=0.0001 | ETA 16:32:25 2021-02-23 08:45:31 [INFO] [TRAIN] epoch=101, iter=37280/80000, loss=0.8552, lr=0.005686, batch_cost=1.3955, reader_cost=0.0001 | ETA 16:33:34 2021-02-23 08:45:45 [INFO] [TRAIN] epoch=101, iter=37290/80000, loss=0.9108, lr=0.005685, batch_cost=1.3434, reader_cost=0.0001 | ETA 15:56:15 2021-02-23 08:45:58 [INFO] [TRAIN] epoch=101, iter=37300/80000, loss=0.8765, lr=0.005683, batch_cost=1.3657, reader_cost=0.0001 | ETA 16:11:54 2021-02-23 08:46:12 [INFO] [TRAIN] epoch=101, iter=37310/80000, loss=0.9652, lr=0.005682, batch_cost=1.3529, reader_cost=0.0001 | ETA 16:02:37 2021-02-23 08:46:26 [INFO] [TRAIN] epoch=101, iter=37320/80000, loss=0.8439, lr=0.005681, batch_cost=1.4063, reader_cost=0.0001 | ETA 16:40:22 2021-02-23 08:46:40 [INFO] [TRAIN] epoch=101, iter=37330/80000, loss=0.9000, lr=0.005680, batch_cost=1.3584, reader_cost=0.0001 | ETA 16:06:01 2021-02-23 08:46:53 [INFO] [TRAIN] epoch=101, iter=37340/80000, loss=0.8376, lr=0.005679, batch_cost=1.3628, reader_cost=0.0001 | ETA 16:08:55 2021-02-23 08:47:07 [INFO] [TRAIN] epoch=101, iter=37350/80000, loss=0.8434, lr=0.005677, batch_cost=1.3835, reader_cost=0.0001 | ETA 16:23:28 2021-02-23 08:47:21 [INFO] [TRAIN] epoch=101, iter=37360/80000, loss=0.9359, lr=0.005676, batch_cost=1.3888, reader_cost=0.0001 | ETA 16:26:58 2021-02-23 08:47:34 [INFO] [TRAIN] epoch=101, iter=37370/80000, loss=0.9196, lr=0.005675, batch_cost=1.3351, reader_cost=0.0001 | ETA 15:48:35 2021-02-23 08:47:48 [INFO] [TRAIN] epoch=101, iter=37380/80000, loss=0.8013, lr=0.005674, batch_cost=1.3301, reader_cost=0.0001 | ETA 15:44:47 2021-02-23 08:48:01 [INFO] [TRAIN] epoch=101, iter=37390/80000, loss=0.8566, lr=0.005673, batch_cost=1.3629, reader_cost=0.0001 | ETA 16:07:53 2021-02-23 08:48:15 [INFO] [TRAIN] epoch=101, iter=37400/80000, loss=0.8696, lr=0.005671, batch_cost=1.3592, reader_cost=0.0001 | ETA 16:05:03 2021-02-23 08:48:28 [INFO] [TRAIN] epoch=101, iter=37410/80000, loss=0.8155, lr=0.005670, batch_cost=1.3645, reader_cost=0.0001 | ETA 16:08:35 2021-02-23 08:48:42 [INFO] [TRAIN] epoch=101, iter=37420/80000, loss=0.8339, lr=0.005669, batch_cost=1.3534, reader_cost=0.0001 | ETA 16:00:27 2021-02-23 08:48:56 [INFO] [TRAIN] epoch=101, iter=37430/80000, loss=0.8949, lr=0.005668, batch_cost=1.3543, reader_cost=0.0001 | ETA 16:00:54 2021-02-23 08:49:09 [INFO] [TRAIN] epoch=101, iter=37440/80000, loss=0.9316, lr=0.005667, batch_cost=1.3803, reader_cost=0.0001 | ETA 16:19:05 2021-02-23 08:49:23 [INFO] [TRAIN] epoch=101, iter=37450/80000, loss=0.8433, lr=0.005665, batch_cost=1.3574, reader_cost=0.0001 | ETA 16:02:38 2021-02-23 08:49:36 [INFO] [TRAIN] epoch=101, iter=37460/80000, loss=0.9831, lr=0.005664, batch_cost=1.3522, reader_cost=0.0001 | ETA 15:58:44 2021-02-23 08:49:50 [INFO] [TRAIN] epoch=101, iter=37470/80000, loss=0.9167, lr=0.005663, batch_cost=1.3929, reader_cost=0.0001 | ETA 16:27:20 2021-02-23 08:50:04 [INFO] [TRAIN] epoch=101, iter=37480/80000, loss=0.9053, lr=0.005662, batch_cost=1.3481, reader_cost=0.0001 | ETA 15:55:19 2021-02-23 08:50:17 [INFO] [TRAIN] epoch=101, iter=37490/80000, loss=0.9205, lr=0.005661, batch_cost=1.3627, reader_cost=0.0001 | ETA 16:05:26 2021-02-23 08:50:31 [INFO] [TRAIN] epoch=101, iter=37500/80000, loss=0.8659, lr=0.005660, batch_cost=1.3792, reader_cost=0.0001 | ETA 16:16:57 2021-02-23 08:50:45 [INFO] [TRAIN] epoch=101, iter=37510/80000, loss=0.9260, lr=0.005658, batch_cost=1.3453, reader_cost=0.0001 | ETA 15:52:43 2021-02-23 08:50:58 [INFO] [TRAIN] epoch=101, iter=37520/80000, loss=0.8942, lr=0.005657, batch_cost=1.3412, reader_cost=0.0001 | ETA 15:49:33 2021-02-23 08:51:12 [INFO] [TRAIN] epoch=101, iter=37530/80000, loss=0.8918, lr=0.005656, batch_cost=1.3555, reader_cost=0.0001 | ETA 15:59:26 2021-02-23 08:51:25 [INFO] [TRAIN] epoch=101, iter=37540/80000, loss=0.9204, lr=0.005655, batch_cost=1.3836, reader_cost=0.0001 | ETA 16:19:07 2021-02-23 08:51:39 [INFO] [TRAIN] epoch=101, iter=37550/80000, loss=0.8129, lr=0.005654, batch_cost=1.3762, reader_cost=0.0001 | ETA 16:13:39 2021-02-23 08:51:53 [INFO] [TRAIN] epoch=101, iter=37560/80000, loss=0.8749, lr=0.005652, batch_cost=1.3736, reader_cost=0.0001 | ETA 16:11:35 2021-02-23 08:52:06 [INFO] [TRAIN] epoch=101, iter=37570/80000, loss=0.9008, lr=0.005651, batch_cost=1.3397, reader_cost=0.0001 | ETA 15:47:23 2021-02-23 08:52:21 [INFO] [TRAIN] epoch=102, iter=37580/80000, loss=0.8673, lr=0.005650, batch_cost=1.4789, reader_cost=0.0757 | ETA 17:25:36 2021-02-23 08:52:35 [INFO] [TRAIN] epoch=102, iter=37590/80000, loss=0.9258, lr=0.005649, batch_cost=1.3845, reader_cost=0.0001 | ETA 16:18:38 2021-02-23 08:52:48 [INFO] [TRAIN] epoch=102, iter=37600/80000, loss=0.8312, lr=0.005648, batch_cost=1.3370, reader_cost=0.0001 | ETA 15:44:50 2021-02-23 08:53:02 [INFO] [TRAIN] epoch=102, iter=37610/80000, loss=0.8862, lr=0.005646, batch_cost=1.3247, reader_cost=0.0001 | ETA 15:35:53 2021-02-23 08:53:15 [INFO] [TRAIN] epoch=102, iter=37620/80000, loss=1.0444, lr=0.005645, batch_cost=1.3520, reader_cost=0.0001 | ETA 15:54:57 2021-02-23 08:53:29 [INFO] [TRAIN] epoch=102, iter=37630/80000, loss=0.8371, lr=0.005644, batch_cost=1.3657, reader_cost=0.0001 | ETA 16:04:26 2021-02-23 08:53:42 [INFO] [TRAIN] epoch=102, iter=37640/80000, loss=0.8706, lr=0.005643, batch_cost=1.3517, reader_cost=0.0001 | ETA 15:54:16 2021-02-23 08:53:56 [INFO] [TRAIN] epoch=102, iter=37650/80000, loss=0.9012, lr=0.005642, batch_cost=1.3640, reader_cost=0.0001 | ETA 16:02:43 2021-02-23 08:54:09 [INFO] [TRAIN] epoch=102, iter=37660/80000, loss=0.8444, lr=0.005640, batch_cost=1.3399, reader_cost=0.0001 | ETA 15:45:31 2021-02-23 08:54:23 [INFO] [TRAIN] epoch=102, iter=37670/80000, loss=0.9168, lr=0.005639, batch_cost=1.3689, reader_cost=0.0001 | ETA 16:05:45 2021-02-23 08:54:37 [INFO] [TRAIN] epoch=102, iter=37680/80000, loss=0.8411, lr=0.005638, batch_cost=1.3453, reader_cost=0.0001 | ETA 15:48:55 2021-02-23 08:54:50 [INFO] [TRAIN] epoch=102, iter=37690/80000, loss=0.9188, lr=0.005637, batch_cost=1.3484, reader_cost=0.0001 | ETA 15:50:50 2021-02-23 08:55:04 [INFO] [TRAIN] epoch=102, iter=37700/80000, loss=0.8293, lr=0.005636, batch_cost=1.3882, reader_cost=0.0001 | ETA 16:18:41 2021-02-23 08:55:18 [INFO] [TRAIN] epoch=102, iter=37710/80000, loss=0.8056, lr=0.005634, batch_cost=1.3622, reader_cost=0.0001 | ETA 16:00:05 2021-02-23 08:55:31 [INFO] [TRAIN] epoch=102, iter=37720/80000, loss=0.8969, lr=0.005633, batch_cost=1.3369, reader_cost=0.0001 | ETA 15:42:04 2021-02-23 08:55:44 [INFO] [TRAIN] epoch=102, iter=37730/80000, loss=0.8263, lr=0.005632, batch_cost=1.3556, reader_cost=0.0001 | ETA 15:54:59 2021-02-23 08:55:58 [INFO] [TRAIN] epoch=102, iter=37740/80000, loss=0.9294, lr=0.005631, batch_cost=1.3705, reader_cost=0.0001 | ETA 16:05:19 2021-02-23 08:56:12 [INFO] [TRAIN] epoch=102, iter=37750/80000, loss=0.9142, lr=0.005630, batch_cost=1.3656, reader_cost=0.0001 | ETA 16:01:35 2021-02-23 08:56:25 [INFO] [TRAIN] epoch=102, iter=37760/80000, loss=0.9597, lr=0.005628, batch_cost=1.3675, reader_cost=0.0001 | ETA 16:02:41 2021-02-23 08:56:39 [INFO] [TRAIN] epoch=102, iter=37770/80000, loss=0.9013, lr=0.005627, batch_cost=1.3615, reader_cost=0.0001 | ETA 15:58:17 2021-02-23 08:56:52 [INFO] [TRAIN] epoch=102, iter=37780/80000, loss=1.0135, lr=0.005626, batch_cost=1.3352, reader_cost=0.0001 | ETA 15:39:33 2021-02-23 08:57:06 [INFO] [TRAIN] epoch=102, iter=37790/80000, loss=0.8527, lr=0.005625, batch_cost=1.3482, reader_cost=0.0001 | ETA 15:48:27 2021-02-23 08:57:20 [INFO] [TRAIN] epoch=102, iter=37800/80000, loss=0.8737, lr=0.005624, batch_cost=1.3988, reader_cost=0.0001 | ETA 16:23:51 2021-02-23 08:57:33 [INFO] [TRAIN] epoch=102, iter=37810/80000, loss=0.8176, lr=0.005622, batch_cost=1.3368, reader_cost=0.0001 | ETA 15:39:59 2021-02-23 08:57:47 [INFO] [TRAIN] epoch=102, iter=37820/80000, loss=0.9120, lr=0.005621, batch_cost=1.3783, reader_cost=0.0001 | ETA 16:08:56 2021-02-23 08:58:01 [INFO] [TRAIN] epoch=102, iter=37830/80000, loss=0.8352, lr=0.005620, batch_cost=1.3648, reader_cost=0.0001 | ETA 15:59:12 2021-02-23 08:58:14 [INFO] [TRAIN] epoch=102, iter=37840/80000, loss=0.8316, lr=0.005619, batch_cost=1.3444, reader_cost=0.0001 | ETA 15:44:40 2021-02-23 08:58:28 [INFO] [TRAIN] epoch=102, iter=37850/80000, loss=0.8095, lr=0.005618, batch_cost=1.3648, reader_cost=0.0001 | ETA 15:58:45 2021-02-23 08:58:42 [INFO] [TRAIN] epoch=102, iter=37860/80000, loss=0.8973, lr=0.005616, batch_cost=1.3986, reader_cost=0.0001 | ETA 16:22:15 2021-02-23 08:58:55 [INFO] [TRAIN] epoch=102, iter=37870/80000, loss=0.8615, lr=0.005615, batch_cost=1.3527, reader_cost=0.0001 | ETA 15:49:49 2021-02-23 08:59:09 [INFO] [TRAIN] epoch=102, iter=37880/80000, loss=0.8086, lr=0.005614, batch_cost=1.3741, reader_cost=0.0001 | ETA 16:04:38 2021-02-23 08:59:22 [INFO] [TRAIN] epoch=102, iter=37890/80000, loss=0.9147, lr=0.005613, batch_cost=1.3423, reader_cost=0.0001 | ETA 15:42:04 2021-02-23 08:59:36 [INFO] [TRAIN] epoch=102, iter=37900/80000, loss=0.9161, lr=0.005612, batch_cost=1.3757, reader_cost=0.0001 | ETA 16:05:18 2021-02-23 08:59:50 [INFO] [TRAIN] epoch=102, iter=37910/80000, loss=0.8784, lr=0.005610, batch_cost=1.3973, reader_cost=0.0001 | ETA 16:20:11 2021-02-23 09:00:04 [INFO] [TRAIN] epoch=102, iter=37920/80000, loss=0.8566, lr=0.005609, batch_cost=1.3490, reader_cost=0.0001 | ETA 15:46:07 2021-02-23 09:00:17 [INFO] [TRAIN] epoch=102, iter=37930/80000, loss=0.8649, lr=0.005608, batch_cost=1.3543, reader_cost=0.0001 | ETA 15:49:36 2021-02-23 09:00:30 [INFO] [TRAIN] epoch=102, iter=37940/80000, loss=0.9198, lr=0.005607, batch_cost=1.3219, reader_cost=0.0001 | ETA 15:26:40 2021-02-23 09:00:45 [INFO] [TRAIN] epoch=103, iter=37950/80000, loss=0.8982, lr=0.005606, batch_cost=1.4534, reader_cost=0.0546 | ETA 16:58:37 2021-02-23 09:00:59 [INFO] [TRAIN] epoch=103, iter=37960/80000, loss=0.8533, lr=0.005604, batch_cost=1.3778, reader_cost=0.0001 | ETA 16:05:22 2021-02-23 09:01:12 [INFO] [TRAIN] epoch=103, iter=37970/80000, loss=0.9072, lr=0.005603, batch_cost=1.3451, reader_cost=0.0001 | ETA 15:42:15 2021-02-23 09:01:26 [INFO] [TRAIN] epoch=103, iter=37980/80000, loss=0.9902, lr=0.005602, batch_cost=1.3686, reader_cost=0.0001 | ETA 15:58:28 2021-02-23 09:01:40 [INFO] [TRAIN] epoch=103, iter=37990/80000, loss=0.8214, lr=0.005601, batch_cost=1.3679, reader_cost=0.0001 | ETA 15:57:45 2021-02-23 09:01:53 [INFO] [TRAIN] epoch=103, iter=38000/80000, loss=0.9150, lr=0.005600, batch_cost=1.3514, reader_cost=0.0001 | ETA 15:45:59 2021-02-23 09:01:53 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:17 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:04 - batch_cost: 0.2150 - reader cost: 0.0905  3/125 [..............................] - ETA: 59s - batch_cost: 0.2829 - reader cost: 0.1140  4/125 [..............................] - ETA: 57s - batch_cost: 0.3179 - reader cost: 0.1290 5/125 [>.............................] - ETA: 55s - batch_cost: 0.3409 - reader cost: 0.1379 6/125 [>.............................] - ETA: 54s - batch_cost: 0.3555 - reader cost: 0.1449 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3588 - reader cost: 0.1421 8/125 [>.............................] - ETA: 52s - batch_cost: 0.3673 - reader cost: 0.1463 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3752 - reader cost: 0.1499 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3801 - reader cost: 0.1524 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3829 - reader cost: 0.1523 12/125 [=>............................] - ETA: 48s - batch_cost: 0.3816 - reader cost: 0.1495 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3853 - reader cost: 0.1520 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3925 - reader cost: 0.1575 15/125 [==>...........................] - ETA: 48s - batch_cost: 0.3974 - reader cost: 0.1611 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3986 - reader cost: 0.1612 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3972 - reader cost: 0.1591 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.3996 - reader cost: 0.1608 19/125 [===>..........................] - ETA: 46s - batch_cost: 0.4018 - reader cost: 0.1620 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4047 - reader cost: 0.1639 21/125 [====>.........................] - ETA: 45s - batch_cost: 0.4059 - reader cost: 0.1647 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4041 - reader cost: 0.1626 23/125 [====>.........................] - ETA: 44s - batch_cost: 0.4050 - reader cost: 0.1632 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4064 - reader cost: 0.1640 25/125 [=====>........................] - ETA: 43s - batch_cost: 0.4078 - reader cost: 0.1650 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4080 - reader cost: 0.1646 27/125 [=====>........................] - ETA: 42s - batch_cost: 0.4084 - reader cost: 0.1647 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4092 - reader cost: 0.1651 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4082 - reader cost: 0.1636 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4066 - reader cost: 0.1616 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.4054 - reader cost: 0.1602 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4062 - reader cost: 0.1608 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4068 - reader cost: 0.1611 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4071 - reader cost: 0.1613 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4068 - reader cost: 0.1608 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4075 - reader cost: 0.1612 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4090 - reader cost: 0.1619 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4085 - reader cost: 0.1610 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4092 - reader cost: 0.1614 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4099 - reader cost: 0.1616 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4104 - reader cost: 0.1617 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4092 - reader cost: 0.1605 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4086 - reader cost: 0.1598 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4089 - reader cost: 0.1599 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4084 - reader cost: 0.1595 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4077 - reader cost: 0.1584 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4081 - reader cost: 0.1587 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4084 - reader cost: 0.1590 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4089 - reader cost: 0.1594 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4098 - reader cost: 0.1603 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4090 - reader cost: 0.1595 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4088 - reader cost: 0.1587 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4095 - reader cost: 0.1594 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4091 - reader cost: 0.1590 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4086 - reader cost: 0.1585 56/125 [============>.................] - ETA: 28s - batch_cost: 0.4083 - reader cost: 0.1582 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4088 - reader cost: 0.1587 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4091 - reader cost: 0.1591 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4097 - reader cost: 0.1594 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4096 - reader cost: 0.1593 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4100 - reader cost: 0.1596 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4102 - reader cost: 0.1598 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4098 - reader cost: 0.1594 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4093 - reader cost: 0.1589 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4096 - reader cost: 0.1592 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4101 - reader cost: 0.1595 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4102 - reader cost: 0.1596 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4106 - reader cost: 0.1599 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4100 - reader cost: 0.1592 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4103 - reader cost: 0.1594 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4098 - reader cost: 0.1589 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4093 - reader cost: 0.1582 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4095 - reader cost: 0.1583 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4087 - reader cost: 0.1575 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4088 - reader cost: 0.1573 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4091 - reader cost: 0.1576 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4087 - reader cost: 0.1572 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4090 - reader cost: 0.1573 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4092 - reader cost: 0.1576 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4089 - reader cost: 0.1573 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4092 - reader cost: 0.1576 82/125 [==================>...........] - ETA: 17s - batch_cost: 0.4094 - reader cost: 0.1578 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4092 - reader cost: 0.1573 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4096 - reader cost: 0.1576 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4096 - reader cost: 0.1570 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4098 - reader cost: 0.1565 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4100 - reader cost: 0.1567 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4104 - reader cost: 0.1570 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4106 - reader cost: 0.1573 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4108 - reader cost: 0.1575 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4103 - reader cost: 0.1570 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4102 - reader cost: 0.1570 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4098 - reader cost: 0.1566 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4099 - reader cost: 0.1565 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4101 - reader cost: 0.1564 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4098 - reader cost: 0.1557 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4098 - reader cost: 0.1548 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4094 - reader cost: 0.1544 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4097 - reader cost: 0.1547 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4098 - reader cost: 0.1549 101/125 [=======================>......] - ETA: 9s - batch_cost: 0.4099 - reader cost: 0.1547  102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4100 - reader cost: 0.1546 103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4104 - reader cost: 0.1549 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4105 - reader cost: 0.1550 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4107 - reader cost: 0.1553 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4103 - reader cost: 0.1549 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4106 - reader cost: 0.1553 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4109 - reader cost: 0.1556 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4107 - reader cost: 0.1555 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4113 - reader cost: 0.1561 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4115 - reader cost: 0.1563 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4115 - reader cost: 0.1564 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4113 - reader cost: 0.1562 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4116 - reader cost: 0.1565 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4118 - reader cost: 0.1567 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4118 - reader cost: 0.1568 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4121 - reader cost: 0.1571 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4123 - reader cost: 0.1573 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4124 - reader cost: 0.1574 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4127 - reader cost: 0.1576 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4124 - reader cost: 0.1573 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4121 - reader cost: 0.1571 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4118 - reader cost: 0.1568 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4120 - reader cost: 0.1570 125/125 [==============================] - 52s 417ms/step - batch_cost: 0.4116 - reader cost: 0.1566 2021-02-23 09:02:45 [INFO] [EVAL] #Images=500 mIoU=0.7162 Acc=0.9552 Kappa=0.9417 2021-02-23 09:02:45 [INFO] [EVAL] Class IoU: [0.9765 0.8229 0.9146 0.4424 0.5734 0.6385 0.7205 0.794 0.9185 0.6115 0.943 0.8127 0.6585 0.9485 0.7662 0.6967 0.0577 0.5441 0.7679] 2021-02-23 09:02:45 [INFO] [EVAL] Class Acc: [0.9874 0.9173 0.9381 0.8105 0.7531 0.8356 0.8092 0.9118 0.9659 0.7776 0.9575 0.8657 0.7913 0.9691 0.9274 0.7488 0.8136 0.6688 0.8867] 2021-02-23 09:02:49 [INFO] [EVAL] The model with the best validation mIoU (0.7576) was saved at iter 31000. 2021-02-23 09:03:03 [INFO] [TRAIN] epoch=103, iter=38010/80000, loss=1.0888, lr=0.005598, batch_cost=1.3436, reader_cost=0.0001 | ETA 15:40:16 2021-02-23 09:03:16 [INFO] [TRAIN] epoch=103, iter=38020/80000, loss=0.8816, lr=0.005597, batch_cost=1.3604, reader_cost=0.0001 | ETA 15:51:48 2021-02-23 09:03:30 [INFO] [TRAIN] epoch=103, iter=38030/80000, loss=0.9654, lr=0.005596, batch_cost=1.3412, reader_cost=0.0001 | ETA 15:38:10 2021-02-23 09:03:43 [INFO] [TRAIN] epoch=103, iter=38040/80000, loss=0.8257, lr=0.005595, batch_cost=1.3565, reader_cost=0.0001 | ETA 15:48:38 2021-02-23 09:03:57 [INFO] [TRAIN] epoch=103, iter=38050/80000, loss=0.8830, lr=0.005594, batch_cost=1.3596, reader_cost=0.0001 | ETA 15:50:37 2021-02-23 09:04:10 [INFO] [TRAIN] epoch=103, iter=38060/80000, loss=0.9325, lr=0.005592, batch_cost=1.3402, reader_cost=0.0001 | ETA 15:36:48 2021-02-23 09:04:24 [INFO] [TRAIN] epoch=103, iter=38070/80000, loss=0.8978, lr=0.005591, batch_cost=1.3650, reader_cost=0.0001 | ETA 15:53:52 2021-02-23 09:04:38 [INFO] [TRAIN] epoch=103, iter=38080/80000, loss=0.9391, lr=0.005590, batch_cost=1.3613, reader_cost=0.0001 | ETA 15:51:04 2021-02-23 09:04:51 [INFO] [TRAIN] epoch=103, iter=38090/80000, loss=0.8580, lr=0.005589, batch_cost=1.3462, reader_cost=0.0001 | ETA 15:40:18 2021-02-23 09:05:05 [INFO] [TRAIN] epoch=103, iter=38100/80000, loss=0.9036, lr=0.005588, batch_cost=1.3717, reader_cost=0.0001 | ETA 15:57:55 2021-02-23 09:05:19 [INFO] [TRAIN] epoch=103, iter=38110/80000, loss=0.8629, lr=0.005586, batch_cost=1.3861, reader_cost=0.0001 | ETA 16:07:41 2021-02-23 09:05:32 [INFO] [TRAIN] epoch=103, iter=38120/80000, loss=0.8189, lr=0.005585, batch_cost=1.3614, reader_cost=0.0001 | ETA 15:50:15 2021-02-23 09:05:46 [INFO] [TRAIN] epoch=103, iter=38130/80000, loss=0.9061, lr=0.005584, batch_cost=1.3745, reader_cost=0.0001 | ETA 15:59:08 2021-02-23 09:06:00 [INFO] [TRAIN] epoch=103, iter=38140/80000, loss=0.8658, lr=0.005583, batch_cost=1.3928, reader_cost=0.0001 | ETA 16:11:44 2021-02-23 09:06:14 [INFO] [TRAIN] epoch=103, iter=38150/80000, loss=0.9217, lr=0.005582, batch_cost=1.3749, reader_cost=0.0001 | ETA 15:58:57 2021-02-23 09:06:27 [INFO] [TRAIN] epoch=103, iter=38160/80000, loss=0.8848, lr=0.005580, batch_cost=1.3677, reader_cost=0.0001 | ETA 15:53:44 2021-02-23 09:06:41 [INFO] [TRAIN] epoch=103, iter=38170/80000, loss=0.8176, lr=0.005579, batch_cost=1.3625, reader_cost=0.0001 | ETA 15:49:51 2021-02-23 09:06:55 [INFO] [TRAIN] epoch=103, iter=38180/80000, loss=0.8524, lr=0.005578, batch_cost=1.3733, reader_cost=0.0001 | ETA 15:57:12 2021-02-23 09:07:08 [INFO] [TRAIN] epoch=103, iter=38190/80000, loss=0.9383, lr=0.005577, batch_cost=1.3764, reader_cost=0.0001 | ETA 15:59:06 2021-02-23 09:07:22 [INFO] [TRAIN] epoch=103, iter=38200/80000, loss=0.9307, lr=0.005576, batch_cost=1.3731, reader_cost=0.0001 | ETA 15:56:35 2021-02-23 09:07:36 [INFO] [TRAIN] epoch=103, iter=38210/80000, loss=0.8342, lr=0.005574, batch_cost=1.3885, reader_cost=0.0001 | ETA 16:07:03 2021-02-23 09:07:50 [INFO] [TRAIN] epoch=103, iter=38220/80000, loss=0.8106, lr=0.005573, batch_cost=1.3551, reader_cost=0.0001 | ETA 15:43:38 2021-02-23 09:08:03 [INFO] [TRAIN] epoch=103, iter=38230/80000, loss=0.8289, lr=0.005572, batch_cost=1.3309, reader_cost=0.0001 | ETA 15:26:31 2021-02-23 09:08:17 [INFO] [TRAIN] epoch=103, iter=38240/80000, loss=0.8328, lr=0.005571, batch_cost=1.3780, reader_cost=0.0001 | ETA 15:59:04 2021-02-23 09:08:30 [INFO] [TRAIN] epoch=103, iter=38250/80000, loss=0.9663, lr=0.005570, batch_cost=1.3663, reader_cost=0.0001 | ETA 15:50:43 2021-02-23 09:08:44 [INFO] [TRAIN] epoch=103, iter=38260/80000, loss=0.9186, lr=0.005568, batch_cost=1.3878, reader_cost=0.0001 | ETA 16:05:26 2021-02-23 09:08:58 [INFO] [TRAIN] epoch=103, iter=38270/80000, loss=0.9176, lr=0.005567, batch_cost=1.3514, reader_cost=0.0001 | ETA 15:39:55 2021-02-23 09:09:11 [INFO] [TRAIN] epoch=103, iter=38280/80000, loss=0.8834, lr=0.005566, batch_cost=1.3555, reader_cost=0.0001 | ETA 15:42:31 2021-02-23 09:09:25 [INFO] [TRAIN] epoch=103, iter=38290/80000, loss=1.0050, lr=0.005565, batch_cost=1.3685, reader_cost=0.0001 | ETA 15:51:22 2021-02-23 09:09:39 [INFO] [TRAIN] epoch=103, iter=38300/80000, loss=0.9947, lr=0.005564, batch_cost=1.3571, reader_cost=0.0001 | ETA 15:43:11 2021-02-23 09:09:52 [INFO] [TRAIN] epoch=103, iter=38310/80000, loss=0.9570, lr=0.005562, batch_cost=1.3495, reader_cost=0.0001 | ETA 15:37:38 2021-02-23 09:10:06 [INFO] [TRAIN] epoch=104, iter=38320/80000, loss=0.9501, lr=0.005561, batch_cost=1.4097, reader_cost=0.0793 | ETA 16:19:14 2021-02-23 09:10:20 [INFO] [TRAIN] epoch=104, iter=38330/80000, loss=0.8349, lr=0.005560, batch_cost=1.3698, reader_cost=0.0001 | ETA 15:51:18 2021-02-23 09:10:33 [INFO] [TRAIN] epoch=104, iter=38340/80000, loss=0.9788, lr=0.005559, batch_cost=1.3469, reader_cost=0.0001 | ETA 15:35:10 2021-02-23 09:10:47 [INFO] [TRAIN] epoch=104, iter=38350/80000, loss=0.8940, lr=0.005558, batch_cost=1.3588, reader_cost=0.0001 | ETA 15:43:14 2021-02-23 09:11:01 [INFO] [TRAIN] epoch=104, iter=38360/80000, loss=0.9037, lr=0.005556, batch_cost=1.3579, reader_cost=0.0001 | ETA 15:42:22 2021-02-23 09:11:14 [INFO] [TRAIN] epoch=104, iter=38370/80000, loss=0.8653, lr=0.005555, batch_cost=1.3921, reader_cost=0.0001 | ETA 16:05:54 2021-02-23 09:11:28 [INFO] [TRAIN] epoch=104, iter=38380/80000, loss=0.8870, lr=0.005554, batch_cost=1.3651, reader_cost=0.0001 | ETA 15:46:54 2021-02-23 09:11:42 [INFO] [TRAIN] epoch=104, iter=38390/80000, loss=0.9862, lr=0.005553, batch_cost=1.3587, reader_cost=0.0001 | ETA 15:42:13 2021-02-23 09:11:55 [INFO] [TRAIN] epoch=104, iter=38400/80000, loss=0.8769, lr=0.005552, batch_cost=1.3443, reader_cost=0.0001 | ETA 15:32:02 2021-02-23 09:12:09 [INFO] [TRAIN] epoch=104, iter=38410/80000, loss=0.9279, lr=0.005550, batch_cost=1.3404, reader_cost=0.0001 | ETA 15:29:05 2021-02-23 09:12:22 [INFO] [TRAIN] epoch=104, iter=38420/80000, loss=0.9299, lr=0.005549, batch_cost=1.3691, reader_cost=0.0001 | ETA 15:48:45 2021-02-23 09:12:36 [INFO] [TRAIN] epoch=104, iter=38430/80000, loss=0.8522, lr=0.005548, batch_cost=1.3448, reader_cost=0.0001 | ETA 15:31:42 2021-02-23 09:12:49 [INFO] [TRAIN] epoch=104, iter=38440/80000, loss=1.0057, lr=0.005547, batch_cost=1.3537, reader_cost=0.0001 | ETA 15:37:40 2021-02-23 09:13:03 [INFO] [TRAIN] epoch=104, iter=38450/80000, loss=0.8603, lr=0.005546, batch_cost=1.3556, reader_cost=0.0001 | ETA 15:38:45 2021-02-23 09:13:17 [INFO] [TRAIN] epoch=104, iter=38460/80000, loss=0.8783, lr=0.005544, batch_cost=1.3766, reader_cost=0.0001 | ETA 15:53:03 2021-02-23 09:13:30 [INFO] [TRAIN] epoch=104, iter=38470/80000, loss=0.8587, lr=0.005543, batch_cost=1.3923, reader_cost=0.0001 | ETA 16:03:40 2021-02-23 09:13:44 [INFO] [TRAIN] epoch=104, iter=38480/80000, loss=0.9513, lr=0.005542, batch_cost=1.3592, reader_cost=0.0001 | ETA 15:40:34 2021-02-23 09:13:58 [INFO] [TRAIN] epoch=104, iter=38490/80000, loss=0.8419, lr=0.005541, batch_cost=1.3482, reader_cost=0.0001 | ETA 15:32:43 2021-02-23 09:14:11 [INFO] [TRAIN] epoch=104, iter=38500/80000, loss=0.8601, lr=0.005540, batch_cost=1.3511, reader_cost=0.0001 | ETA 15:34:29 2021-02-23 09:14:25 [INFO] [TRAIN] epoch=104, iter=38510/80000, loss=0.9066, lr=0.005538, batch_cost=1.3749, reader_cost=0.0001 | ETA 15:50:45 2021-02-23 09:14:39 [INFO] [TRAIN] epoch=104, iter=38520/80000, loss=0.8585, lr=0.005537, batch_cost=1.3777, reader_cost=0.0001 | ETA 15:52:27 2021-02-23 09:14:52 [INFO] [TRAIN] epoch=104, iter=38530/80000, loss=0.8959, lr=0.005536, batch_cost=1.3888, reader_cost=0.0001 | ETA 15:59:54 2021-02-23 09:15:06 [INFO] [TRAIN] epoch=104, iter=38540/80000, loss=0.8507, lr=0.005535, batch_cost=1.3528, reader_cost=0.0001 | ETA 15:34:46 2021-02-23 09:15:20 [INFO] [TRAIN] epoch=104, iter=38550/80000, loss=0.9873, lr=0.005534, batch_cost=1.3662, reader_cost=0.0001 | ETA 15:43:50 2021-02-23 09:15:34 [INFO] [TRAIN] epoch=104, iter=38560/80000, loss=0.8906, lr=0.005532, batch_cost=1.3847, reader_cost=0.0001 | ETA 15:56:22 2021-02-23 09:15:47 [INFO] [TRAIN] epoch=104, iter=38570/80000, loss=0.8656, lr=0.005531, batch_cost=1.3492, reader_cost=0.0001 | ETA 15:31:37 2021-02-23 09:16:01 [INFO] [TRAIN] epoch=104, iter=38580/80000, loss=0.8782, lr=0.005530, batch_cost=1.3805, reader_cost=0.0001 | ETA 15:53:01 2021-02-23 09:16:14 [INFO] [TRAIN] epoch=104, iter=38590/80000, loss=0.8474, lr=0.005529, batch_cost=1.3530, reader_cost=0.0001 | ETA 15:33:48 2021-02-23 09:16:28 [INFO] [TRAIN] epoch=104, iter=38600/80000, loss=0.8428, lr=0.005528, batch_cost=1.3240, reader_cost=0.0001 | ETA 15:13:33 2021-02-23 09:16:41 [INFO] [TRAIN] epoch=104, iter=38610/80000, loss=0.9054, lr=0.005526, batch_cost=1.3652, reader_cost=0.0001 | ETA 15:41:43 2021-02-23 09:16:55 [INFO] [TRAIN] epoch=104, iter=38620/80000, loss=0.8800, lr=0.005525, batch_cost=1.3718, reader_cost=0.0001 | ETA 15:46:05 2021-02-23 09:17:08 [INFO] [TRAIN] epoch=104, iter=38630/80000, loss=0.9167, lr=0.005524, batch_cost=1.3416, reader_cost=0.0001 | ETA 15:25:02 2021-02-23 09:17:22 [INFO] [TRAIN] epoch=104, iter=38640/80000, loss=0.8972, lr=0.005523, batch_cost=1.3489, reader_cost=0.0001 | ETA 15:29:49 2021-02-23 09:17:35 [INFO] [TRAIN] epoch=104, iter=38650/80000, loss=0.9242, lr=0.005521, batch_cost=1.3499, reader_cost=0.0001 | ETA 15:30:20 2021-02-23 09:17:49 [INFO] [TRAIN] epoch=104, iter=38660/80000, loss=0.8583, lr=0.005520, batch_cost=1.3680, reader_cost=0.0001 | ETA 15:42:33 2021-02-23 09:18:03 [INFO] [TRAIN] epoch=104, iter=38670/80000, loss=1.0117, lr=0.005519, batch_cost=1.3727, reader_cost=0.0001 | ETA 15:45:33 2021-02-23 09:18:16 [INFO] [TRAIN] epoch=104, iter=38680/80000, loss=0.9129, lr=0.005518, batch_cost=1.3645, reader_cost=0.0001 | ETA 15:39:41 2021-02-23 09:18:31 [INFO] [TRAIN] epoch=105, iter=38690/80000, loss=0.8540, lr=0.005517, batch_cost=1.4127, reader_cost=0.0872 | ETA 16:12:39 2021-02-23 09:18:44 [INFO] [TRAIN] epoch=105, iter=38700/80000, loss=0.8298, lr=0.005515, batch_cost=1.3451, reader_cost=0.0001 | ETA 15:25:52 2021-02-23 09:18:58 [INFO] [TRAIN] epoch=105, iter=38710/80000, loss=1.0860, lr=0.005514, batch_cost=1.3663, reader_cost=0.0001 | ETA 15:40:15 2021-02-23 09:19:11 [INFO] [TRAIN] epoch=105, iter=38720/80000, loss=0.8324, lr=0.005513, batch_cost=1.3668, reader_cost=0.0001 | ETA 15:40:22 2021-02-23 09:19:25 [INFO] [TRAIN] epoch=105, iter=38730/80000, loss=0.9469, lr=0.005512, batch_cost=1.3449, reader_cost=0.0001 | ETA 15:25:05 2021-02-23 09:19:38 [INFO] [TRAIN] epoch=105, iter=38740/80000, loss=1.0072, lr=0.005511, batch_cost=1.3470, reader_cost=0.0001 | ETA 15:26:17 2021-02-23 09:19:52 [INFO] [TRAIN] epoch=105, iter=38750/80000, loss=0.9571, lr=0.005509, batch_cost=1.3623, reader_cost=0.0001 | ETA 15:36:33 2021-02-23 09:20:06 [INFO] [TRAIN] epoch=105, iter=38760/80000, loss=0.8108, lr=0.005508, batch_cost=1.3661, reader_cost=0.0001 | ETA 15:38:57 2021-02-23 09:20:19 [INFO] [TRAIN] epoch=105, iter=38770/80000, loss=0.9363, lr=0.005507, batch_cost=1.3410, reader_cost=0.0001 | ETA 15:21:28 2021-02-23 09:20:32 [INFO] [TRAIN] epoch=105, iter=38780/80000, loss=0.8845, lr=0.005506, batch_cost=1.3407, reader_cost=0.0001 | ETA 15:21:02 2021-02-23 09:20:46 [INFO] [TRAIN] epoch=105, iter=38790/80000, loss=0.8979, lr=0.005505, batch_cost=1.3731, reader_cost=0.0001 | ETA 15:43:03 2021-02-23 09:20:59 [INFO] [TRAIN] epoch=105, iter=38800/80000, loss=0.8423, lr=0.005503, batch_cost=1.3325, reader_cost=0.0001 | ETA 15:14:58 2021-02-23 09:21:13 [INFO] [TRAIN] epoch=105, iter=38810/80000, loss=0.8480, lr=0.005502, batch_cost=1.3460, reader_cost=0.0001 | ETA 15:24:00 2021-02-23 09:21:27 [INFO] [TRAIN] epoch=105, iter=38820/80000, loss=0.8764, lr=0.005501, batch_cost=1.3777, reader_cost=0.0001 | ETA 15:45:31 2021-02-23 09:21:41 [INFO] [TRAIN] epoch=105, iter=38830/80000, loss=0.9364, lr=0.005500, batch_cost=1.3872, reader_cost=0.0001 | ETA 15:51:53 2021-02-23 09:21:54 [INFO] [TRAIN] epoch=105, iter=38840/80000, loss=0.9439, lr=0.005499, batch_cost=1.3232, reader_cost=0.0001 | ETA 15:07:41 2021-02-23 09:22:07 [INFO] [TRAIN] epoch=105, iter=38850/80000, loss=0.8905, lr=0.005497, batch_cost=1.3522, reader_cost=0.0001 | ETA 15:27:24 2021-02-23 09:22:21 [INFO] [TRAIN] epoch=105, iter=38860/80000, loss=0.8746, lr=0.005496, batch_cost=1.3698, reader_cost=0.0001 | ETA 15:39:15 2021-02-23 09:22:34 [INFO] [TRAIN] epoch=105, iter=38870/80000, loss=0.9589, lr=0.005495, batch_cost=1.3337, reader_cost=0.0001 | ETA 15:14:15 2021-02-23 09:22:48 [INFO] [TRAIN] epoch=105, iter=38880/80000, loss=0.9972, lr=0.005494, batch_cost=1.3954, reader_cost=0.0001 | ETA 15:56:17 2021-02-23 09:23:02 [INFO] [TRAIN] epoch=105, iter=38890/80000, loss=0.8647, lr=0.005493, batch_cost=1.3400, reader_cost=0.0001 | ETA 15:18:09 2021-02-23 09:23:15 [INFO] [TRAIN] epoch=105, iter=38900/80000, loss=0.8625, lr=0.005491, batch_cost=1.3378, reader_cost=0.0001 | ETA 15:16:23 2021-02-23 09:23:29 [INFO] [TRAIN] epoch=105, iter=38910/80000, loss=0.8864, lr=0.005490, batch_cost=1.3555, reader_cost=0.0001 | ETA 15:28:16 2021-02-23 09:23:42 [INFO] [TRAIN] epoch=105, iter=38920/80000, loss=0.8124, lr=0.005489, batch_cost=1.3442, reader_cost=0.0001 | ETA 15:20:18 2021-02-23 09:23:56 [INFO] [TRAIN] epoch=105, iter=38930/80000, loss=0.8071, lr=0.005488, batch_cost=1.3529, reader_cost=0.0001 | ETA 15:26:01 2021-02-23 09:24:09 [INFO] [TRAIN] epoch=105, iter=38940/80000, loss=0.9273, lr=0.005487, batch_cost=1.3929, reader_cost=0.0001 | ETA 15:53:11 2021-02-23 09:24:23 [INFO] [TRAIN] epoch=105, iter=38950/80000, loss=0.8664, lr=0.005485, batch_cost=1.3414, reader_cost=0.0001 | ETA 15:17:42 2021-02-23 09:24:37 [INFO] [TRAIN] epoch=105, iter=38960/80000, loss=0.9000, lr=0.005484, batch_cost=1.3714, reader_cost=0.0001 | ETA 15:38:01 2021-02-23 09:24:50 [INFO] [TRAIN] epoch=105, iter=38970/80000, loss=0.9926, lr=0.005483, batch_cost=1.3609, reader_cost=0.0001 | ETA 15:30:38 2021-02-23 09:25:04 [INFO] [TRAIN] epoch=105, iter=38980/80000, loss=0.9096, lr=0.005482, batch_cost=1.3568, reader_cost=0.0001 | ETA 15:27:34 2021-02-23 09:25:17 [INFO] [TRAIN] epoch=105, iter=38990/80000, loss=0.8814, lr=0.005481, batch_cost=1.3316, reader_cost=0.0001 | ETA 15:10:06 2021-02-23 09:25:31 [INFO] [TRAIN] epoch=105, iter=39000/80000, loss=0.9111, lr=0.005479, batch_cost=1.4022, reader_cost=0.0001 | ETA 15:58:11 2021-02-23 09:25:31 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:14 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:04 - batch_cost: 0.2259 - reader cost: 0.0966  3/125 [..............................] - ETA: 58s - batch_cost: 0.2750 - reader cost: 0.1049  4/125 [..............................] - ETA: 55s - batch_cost: 0.3071 - reader cost: 0.1167 5/125 [>.............................] - ETA: 54s - batch_cost: 0.3328 - reader cost: 0.1305 6/125 [>.............................] - ETA: 53s - batch_cost: 0.3488 - reader cost: 0.1384 7/125 [>.............................] - ETA: 53s - batch_cost: 0.3632 - reader cost: 0.1460 8/125 [>.............................] - ETA: 52s - batch_cost: 0.3732 - reader cost: 0.1502 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3760 - reader cost: 0.1500 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3773 - reader cost: 0.1475 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3780 - reader cost: 0.1462 12/125 [=>............................] - ETA: 48s - batch_cost: 0.3816 - reader cost: 0.1483 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3839 - reader cost: 0.1494 14/125 [==>...........................] - ETA: 47s - batch_cost: 0.3874 - reader cost: 0.1519 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3873 - reader cost: 0.1509 16/125 [==>...........................] - ETA: 46s - batch_cost: 0.3904 - reader cost: 0.1532 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3932 - reader cost: 0.1550 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3943 - reader cost: 0.1553 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3948 - reader cost: 0.1552 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3935 - reader cost: 0.1535 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.3955 - reader cost: 0.1547 22/125 [====>.........................] - ETA: 43s - batch_cost: 0.3945 - reader cost: 0.1534 23/125 [====>.........................] - ETA: 42s - batch_cost: 0.3938 - reader cost: 0.1518 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.3948 - reader cost: 0.1521 25/125 [=====>........................] - ETA: 41s - batch_cost: 0.3942 - reader cost: 0.1511 26/125 [=====>........................] - ETA: 41s - batch_cost: 0.3937 - reader cost: 0.1498 27/125 [=====>........................] - ETA: 40s - batch_cost: 0.3957 - reader cost: 0.1510 28/125 [=====>........................] - ETA: 40s - batch_cost: 0.3970 - reader cost: 0.1515 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.3981 - reader cost: 0.1525 30/125 [======>.......................] - ETA: 39s - batch_cost: 0.3993 - reader cost: 0.1534 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.4004 - reader cost: 0.1544 32/125 [======>.......................] - ETA: 38s - batch_cost: 0.4003 - reader cost: 0.1538 33/125 [======>.......................] - ETA: 38s - batch_cost: 0.3989 - reader cost: 0.1523 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4000 - reader cost: 0.1534 35/125 [=======>......................] - ETA: 37s - batch_cost: 0.4009 - reader cost: 0.1525 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4006 - reader cost: 0.1521 37/125 [=======>......................] - ETA: 36s - batch_cost: 0.4012 - reader cost: 0.1526 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4020 - reader cost: 0.1531 39/125 [========>.....................] - ETA: 35s - batch_cost: 0.4029 - reader cost: 0.1539 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4039 - reader cost: 0.1548 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4042 - reader cost: 0.1548 42/125 [=========>....................] - ETA: 34s - batch_cost: 0.4036 - reader cost: 0.1542 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4045 - reader cost: 0.1549 44/125 [=========>....................] - ETA: 33s - batch_cost: 0.4037 - reader cost: 0.1541 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4047 - reader cost: 0.1549 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4052 - reader cost: 0.1554 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4048 - reader cost: 0.1549 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4053 - reader cost: 0.1554 49/125 [==========>...................] - ETA: 31s - batch_cost: 0.4063 - reader cost: 0.1562 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4060 - reader cost: 0.1560 51/125 [===========>..................] - ETA: 30s - batch_cost: 0.4065 - reader cost: 0.1563 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4069 - reader cost: 0.1567 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4086 - reader cost: 0.1583 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4085 - reader cost: 0.1582 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4080 - reader cost: 0.1577 56/125 [============>.................] - ETA: 28s - batch_cost: 0.4074 - reader cost: 0.1572 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4080 - reader cost: 0.1576 58/125 [============>.................] - ETA: 27s - batch_cost: 0.4073 - reader cost: 0.1569 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4068 - reader cost: 0.1564 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4075 - reader cost: 0.1570 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4068 - reader cost: 0.1563 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4067 - reader cost: 0.1562 63/125 [==============>...............] - ETA: 25s - batch_cost: 0.4071 - reader cost: 0.1566 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4076 - reader cost: 0.1570 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4079 - reader cost: 0.1573 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4077 - reader cost: 0.1570 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4080 - reader cost: 0.1573 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4087 - reader cost: 0.1578 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4091 - reader cost: 0.1581 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4096 - reader cost: 0.1585 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4102 - reader cost: 0.1589 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4092 - reader cost: 0.1579 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4095 - reader cost: 0.1582 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4100 - reader cost: 0.1586 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4101 - reader cost: 0.1587 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4097 - reader cost: 0.1583 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4101 - reader cost: 0.1587 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4095 - reader cost: 0.1581 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4097 - reader cost: 0.1583 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4101 - reader cost: 0.1588 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4100 - reader cost: 0.1586 82/125 [==================>...........] - ETA: 17s - batch_cost: 0.4105 - reader cost: 0.1589 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4108 - reader cost: 0.1592 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4110 - reader cost: 0.1593 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4106 - reader cost: 0.1589 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4110 - reader cost: 0.1592 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4113 - reader cost: 0.1596 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4108 - reader cost: 0.1591 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4113 - reader cost: 0.1596 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4110 - reader cost: 0.1593 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4112 - reader cost: 0.1595 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4115 - reader cost: 0.1598 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4112 - reader cost: 0.1595 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4114 - reader cost: 0.1596 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4112 - reader cost: 0.1593 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4113 - reader cost: 0.1594 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4115 - reader cost: 0.1596 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4118 - reader cost: 0.1600 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4123 - reader cost: 0.1604 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4120 - reader cost: 0.1602 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4119 - reader cost: 0.1601 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4120 - reader cost: 0.1602  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4116 - reader cost: 0.1598 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4119 - reader cost: 0.1600 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4117 - reader cost: 0.1598 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4120 - reader cost: 0.1596 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4118 - reader cost: 0.1594 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4120 - reader cost: 0.1596 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4122 - reader cost: 0.1598 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4125 - reader cost: 0.1601 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4122 - reader cost: 0.1598 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4120 - reader cost: 0.1596 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4123 - reader cost: 0.1598 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4125 - reader cost: 0.1600 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4127 - reader cost: 0.1603 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4129 - reader cost: 0.1605 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4132 - reader cost: 0.1607 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4126 - reader cost: 0.1602 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4129 - reader cost: 0.1605 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4126 - reader cost: 0.1602 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4125 - reader cost: 0.1600 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4128 - reader cost: 0.1603 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4129 - reader cost: 0.1605 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4125 - reader cost: 0.1601 125/125 [==============================] - 52s 417ms/step - batch_cost: 0.4124 - reader cost: 0.1600 2021-02-23 09:26:23 [INFO] [EVAL] #Images=500 mIoU=0.7538 Acc=0.9547 Kappa=0.9411 2021-02-23 09:26:23 [INFO] [EVAL] Class IoU: [0.9767 0.8243 0.9122 0.4168 0.4589 0.6475 0.7022 0.7762 0.9157 0.5708 0.9459 0.8162 0.6203 0.9465 0.7884 0.8625 0.7532 0.6086 0.7784] 2021-02-23 09:26:23 [INFO] [EVAL] Class Acc: [0.9874 0.8926 0.94 0.8444 0.844 0.7756 0.7919 0.89 0.9638 0.7036 0.9609 0.9133 0.8218 0.9693 0.9224 0.9585 0.8845 0.7691 0.8729] 2021-02-23 09:26:27 [INFO] [EVAL] The model with the best validation mIoU (0.7576) was saved at iter 31000. 2021-02-23 09:26:41 [INFO] [TRAIN] epoch=105, iter=39010/80000, loss=0.9250, lr=0.005478, batch_cost=1.3698, reader_cost=0.0001 | ETA 15:35:49 2021-02-23 09:26:55 [INFO] [TRAIN] epoch=105, iter=39020/80000, loss=0.8959, lr=0.005477, batch_cost=1.3461, reader_cost=0.0001 | ETA 15:19:22 2021-02-23 09:27:08 [INFO] [TRAIN] epoch=105, iter=39030/80000, loss=0.8765, lr=0.005476, batch_cost=1.3611, reader_cost=0.0001 | ETA 15:29:23 2021-02-23 09:27:22 [INFO] [TRAIN] epoch=105, iter=39040/80000, loss=0.8916, lr=0.005475, batch_cost=1.3490, reader_cost=0.0001 | ETA 15:20:54 2021-02-23 09:27:35 [INFO] [TRAIN] epoch=105, iter=39050/80000, loss=0.8548, lr=0.005473, batch_cost=1.3460, reader_cost=0.0001 | ETA 15:18:39 2021-02-23 09:27:48 [INFO] [TRAIN] epoch=105, iter=39060/80000, loss=0.8400, lr=0.005472, batch_cost=1.3334, reader_cost=0.0001 | ETA 15:09:51 2021-02-23 09:28:03 [INFO] [TRAIN] epoch=106, iter=39070/80000, loss=0.9251, lr=0.005471, batch_cost=1.4980, reader_cost=0.0711 | ETA 17:01:54 2021-02-23 09:28:17 [INFO] [TRAIN] epoch=106, iter=39080/80000, loss=0.9074, lr=0.005470, batch_cost=1.3467, reader_cost=0.0001 | ETA 15:18:27 2021-02-23 09:28:31 [INFO] [TRAIN] epoch=106, iter=39090/80000, loss=0.8634, lr=0.005469, batch_cost=1.3629, reader_cost=0.0001 | ETA 15:29:16 2021-02-23 09:28:44 [INFO] [TRAIN] epoch=106, iter=39100/80000, loss=0.8077, lr=0.005467, batch_cost=1.3806, reader_cost=0.0001 | ETA 15:41:07 2021-02-23 09:28:58 [INFO] [TRAIN] epoch=106, iter=39110/80000, loss=0.9334, lr=0.005466, batch_cost=1.3834, reader_cost=0.0001 | ETA 15:42:48 2021-02-23 09:29:12 [INFO] [TRAIN] epoch=106, iter=39120/80000, loss=0.9044, lr=0.005465, batch_cost=1.3652, reader_cost=0.0001 | ETA 15:30:10 2021-02-23 09:29:25 [INFO] [TRAIN] epoch=106, iter=39130/80000, loss=1.0331, lr=0.005464, batch_cost=1.3521, reader_cost=0.0001 | ETA 15:21:00 2021-02-23 09:29:39 [INFO] [TRAIN] epoch=106, iter=39140/80000, loss=0.8707, lr=0.005463, batch_cost=1.3766, reader_cost=0.0001 | ETA 15:37:27 2021-02-23 09:29:53 [INFO] [TRAIN] epoch=106, iter=39150/80000, loss=0.8489, lr=0.005461, batch_cost=1.3598, reader_cost=0.0001 | ETA 15:25:47 2021-02-23 09:30:06 [INFO] [TRAIN] epoch=106, iter=39160/80000, loss=0.9172, lr=0.005460, batch_cost=1.3528, reader_cost=0.0001 | ETA 15:20:49 2021-02-23 09:30:20 [INFO] [TRAIN] epoch=106, iter=39170/80000, loss=1.0418, lr=0.005459, batch_cost=1.3788, reader_cost=0.0001 | ETA 15:38:17 2021-02-23 09:30:34 [INFO] [TRAIN] epoch=106, iter=39180/80000, loss=0.8987, lr=0.005458, batch_cost=1.3854, reader_cost=0.0001 | ETA 15:42:31 2021-02-23 09:30:48 [INFO] [TRAIN] epoch=106, iter=39190/80000, loss=0.8755, lr=0.005457, batch_cost=1.3635, reader_cost=0.0001 | ETA 15:27:25 2021-02-23 09:31:01 [INFO] [TRAIN] epoch=106, iter=39200/80000, loss=0.9551, lr=0.005455, batch_cost=1.3421, reader_cost=0.0001 | ETA 15:12:35 2021-02-23 09:31:15 [INFO] [TRAIN] epoch=106, iter=39210/80000, loss=1.0009, lr=0.005454, batch_cost=1.4083, reader_cost=0.0001 | ETA 15:57:25 2021-02-23 09:31:29 [INFO] [TRAIN] epoch=106, iter=39220/80000, loss=0.8779, lr=0.005453, batch_cost=1.3563, reader_cost=0.0001 | ETA 15:21:50 2021-02-23 09:31:42 [INFO] [TRAIN] epoch=106, iter=39230/80000, loss=0.8538, lr=0.005452, batch_cost=1.3567, reader_cost=0.0001 | ETA 15:21:53 2021-02-23 09:31:56 [INFO] [TRAIN] epoch=106, iter=39240/80000, loss=0.8738, lr=0.005451, batch_cost=1.3440, reader_cost=0.0001 | ETA 15:13:00 2021-02-23 09:32:09 [INFO] [TRAIN] epoch=106, iter=39250/80000, loss=0.8491, lr=0.005449, batch_cost=1.3550, reader_cost=0.0001 | ETA 15:20:15 2021-02-23 09:32:23 [INFO] [TRAIN] epoch=106, iter=39260/80000, loss=0.9017, lr=0.005448, batch_cost=1.3728, reader_cost=0.0001 | ETA 15:32:09 2021-02-23 09:32:36 [INFO] [TRAIN] epoch=106, iter=39270/80000, loss=0.8550, lr=0.005447, batch_cost=1.3419, reader_cost=0.0001 | ETA 15:10:56 2021-02-23 09:32:50 [INFO] [TRAIN] epoch=106, iter=39280/80000, loss=0.7850, lr=0.005446, batch_cost=1.3991, reader_cost=0.0001 | ETA 15:49:33 2021-02-23 09:33:04 [INFO] [TRAIN] epoch=106, iter=39290/80000, loss=0.8961, lr=0.005445, batch_cost=1.3748, reader_cost=0.0001 | ETA 15:32:46 2021-02-23 09:33:18 [INFO] [TRAIN] epoch=106, iter=39300/80000, loss=0.9725, lr=0.005443, batch_cost=1.3591, reader_cost=0.0001 | ETA 15:21:55 2021-02-23 09:33:31 [INFO] [TRAIN] epoch=106, iter=39310/80000, loss=0.8664, lr=0.005442, batch_cost=1.3643, reader_cost=0.0001 | ETA 15:25:14 2021-02-23 09:33:45 [INFO] [TRAIN] epoch=106, iter=39320/80000, loss=0.8328, lr=0.005441, batch_cost=1.3417, reader_cost=0.0001 | ETA 15:09:42 2021-02-23 09:33:58 [INFO] [TRAIN] epoch=106, iter=39330/80000, loss=0.8734, lr=0.005440, batch_cost=1.3639, reader_cost=0.0001 | ETA 15:24:29 2021-02-23 09:34:12 [INFO] [TRAIN] epoch=106, iter=39340/80000, loss=0.8543, lr=0.005439, batch_cost=1.3672, reader_cost=0.0001 | ETA 15:26:29 2021-02-23 09:34:25 [INFO] [TRAIN] epoch=106, iter=39350/80000, loss=0.8980, lr=0.005437, batch_cost=1.3427, reader_cost=0.0001 | ETA 15:09:39 2021-02-23 09:34:39 [INFO] [TRAIN] epoch=106, iter=39360/80000, loss=0.9221, lr=0.005436, batch_cost=1.3599, reader_cost=0.0001 | ETA 15:21:07 2021-02-23 09:34:53 [INFO] [TRAIN] epoch=106, iter=39370/80000, loss=1.0199, lr=0.005435, batch_cost=1.3624, reader_cost=0.0001 | ETA 15:22:33 2021-02-23 09:35:06 [INFO] [TRAIN] epoch=106, iter=39380/80000, loss=0.8935, lr=0.005434, batch_cost=1.3504, reader_cost=0.0001 | ETA 15:14:15 2021-02-23 09:35:20 [INFO] [TRAIN] epoch=106, iter=39390/80000, loss=0.9032, lr=0.005432, batch_cost=1.3865, reader_cost=0.0001 | ETA 15:38:27 2021-02-23 09:35:34 [INFO] [TRAIN] epoch=106, iter=39400/80000, loss=0.8463, lr=0.005431, batch_cost=1.3489, reader_cost=0.0001 | ETA 15:12:43 2021-02-23 09:35:47 [INFO] [TRAIN] epoch=106, iter=39410/80000, loss=0.9422, lr=0.005430, batch_cost=1.3574, reader_cost=0.0001 | ETA 15:18:16 2021-02-23 09:36:01 [INFO] [TRAIN] epoch=106, iter=39420/80000, loss=0.9042, lr=0.005429, batch_cost=1.3725, reader_cost=0.0001 | ETA 15:28:16 2021-02-23 09:36:14 [INFO] [TRAIN] epoch=106, iter=39430/80000, loss=0.9357, lr=0.005428, batch_cost=1.3490, reader_cost=0.0001 | ETA 15:12:09 2021-02-23 09:36:29 [INFO] [TRAIN] epoch=107, iter=39440/80000, loss=0.8462, lr=0.005426, batch_cost=1.4675, reader_cost=0.0690 | ETA 16:32:00 2021-02-23 09:36:43 [INFO] [TRAIN] epoch=107, iter=39450/80000, loss=0.8962, lr=0.005425, batch_cost=1.3505, reader_cost=0.0001 | ETA 15:12:43 2021-02-23 09:36:56 [INFO] [TRAIN] epoch=107, iter=39460/80000, loss=0.8395, lr=0.005424, batch_cost=1.3779, reader_cost=0.0001 | ETA 15:31:00 2021-02-23 09:37:10 [INFO] [TRAIN] epoch=107, iter=39470/80000, loss=0.8543, lr=0.005423, batch_cost=1.3437, reader_cost=0.0001 | ETA 15:07:39 2021-02-23 09:37:23 [INFO] [TRAIN] epoch=107, iter=39480/80000, loss=0.9058, lr=0.005422, batch_cost=1.3473, reader_cost=0.0001 | ETA 15:09:51 2021-02-23 09:37:37 [INFO] [TRAIN] epoch=107, iter=39490/80000, loss=0.8633, lr=0.005420, batch_cost=1.3973, reader_cost=0.0001 | ETA 15:43:24 2021-02-23 09:37:51 [INFO] [TRAIN] epoch=107, iter=39500/80000, loss=0.8136, lr=0.005419, batch_cost=1.3668, reader_cost=0.0001 | ETA 15:22:37 2021-02-23 09:38:05 [INFO] [TRAIN] epoch=107, iter=39510/80000, loss=0.8512, lr=0.005418, batch_cost=1.3662, reader_cost=0.0001 | ETA 15:21:56 2021-02-23 09:38:18 [INFO] [TRAIN] epoch=107, iter=39520/80000, loss=0.9840, lr=0.005417, batch_cost=1.3334, reader_cost=0.0001 | ETA 14:59:35 2021-02-23 09:38:31 [INFO] [TRAIN] epoch=107, iter=39530/80000, loss=0.9785, lr=0.005416, batch_cost=1.3600, reader_cost=0.0001 | ETA 15:17:19 2021-02-23 09:38:45 [INFO] [TRAIN] epoch=107, iter=39540/80000, loss=0.9017, lr=0.005414, batch_cost=1.3597, reader_cost=0.0001 | ETA 15:16:52 2021-02-23 09:38:58 [INFO] [TRAIN] epoch=107, iter=39550/80000, loss=0.8484, lr=0.005413, batch_cost=1.3193, reader_cost=0.0001 | ETA 14:49:27 2021-02-23 09:39:12 [INFO] [TRAIN] epoch=107, iter=39560/80000, loss=0.8572, lr=0.005412, batch_cost=1.3614, reader_cost=0.0001 | ETA 15:17:33 2021-02-23 09:39:26 [INFO] [TRAIN] epoch=107, iter=39570/80000, loss=0.9684, lr=0.005411, batch_cost=1.3748, reader_cost=0.0001 | ETA 15:26:21 2021-02-23 09:39:39 [INFO] [TRAIN] epoch=107, iter=39580/80000, loss=0.8487, lr=0.005410, batch_cost=1.3403, reader_cost=0.0001 | ETA 15:02:53 2021-02-23 09:39:53 [INFO] [TRAIN] epoch=107, iter=39590/80000, loss=0.9124, lr=0.005408, batch_cost=1.3590, reader_cost=0.0001 | ETA 15:15:15 2021-02-23 09:40:06 [INFO] [TRAIN] epoch=107, iter=39600/80000, loss=0.8119, lr=0.005407, batch_cost=1.3543, reader_cost=0.0001 | ETA 15:11:54 2021-02-23 09:40:20 [INFO] [TRAIN] epoch=107, iter=39610/80000, loss=0.8748, lr=0.005406, batch_cost=1.3874, reader_cost=0.0001 | ETA 15:33:55 2021-02-23 09:40:34 [INFO] [TRAIN] epoch=107, iter=39620/80000, loss=0.9036, lr=0.005405, batch_cost=1.3551, reader_cost=0.0001 | ETA 15:12:00 2021-02-23 09:40:47 [INFO] [TRAIN] epoch=107, iter=39630/80000, loss=0.9155, lr=0.005404, batch_cost=1.3530, reader_cost=0.0001 | ETA 15:10:22 2021-02-23 09:41:01 [INFO] [TRAIN] epoch=107, iter=39640/80000, loss=0.9289, lr=0.005402, batch_cost=1.3802, reader_cost=0.0001 | ETA 15:28:23 2021-02-23 09:41:15 [INFO] [TRAIN] epoch=107, iter=39650/80000, loss=0.8384, lr=0.005401, batch_cost=1.3883, reader_cost=0.0001 | ETA 15:33:36 2021-02-23 09:41:29 [INFO] [TRAIN] epoch=107, iter=39660/80000, loss=0.8966, lr=0.005400, batch_cost=1.3747, reader_cost=0.0001 | ETA 15:24:16 2021-02-23 09:41:42 [INFO] [TRAIN] epoch=107, iter=39670/80000, loss=0.9261, lr=0.005399, batch_cost=1.3778, reader_cost=0.0001 | ETA 15:26:07 2021-02-23 09:41:56 [INFO] [TRAIN] epoch=107, iter=39680/80000, loss=0.9526, lr=0.005398, batch_cost=1.3248, reader_cost=0.0001 | ETA 14:50:14 2021-02-23 09:42:09 [INFO] [TRAIN] epoch=107, iter=39690/80000, loss=0.8164, lr=0.005396, batch_cost=1.3930, reader_cost=0.0001 | ETA 15:35:51 2021-02-23 09:42:23 [INFO] [TRAIN] epoch=107, iter=39700/80000, loss=0.9735, lr=0.005395, batch_cost=1.3550, reader_cost=0.0001 | ETA 15:10:06 2021-02-23 09:42:37 [INFO] [TRAIN] epoch=107, iter=39710/80000, loss=0.9040, lr=0.005394, batch_cost=1.3766, reader_cost=0.0001 | ETA 15:24:23 2021-02-23 09:42:50 [INFO] [TRAIN] epoch=107, iter=39720/80000, loss=0.8279, lr=0.005393, batch_cost=1.3554, reader_cost=0.0001 | ETA 15:09:53 2021-02-23 09:43:04 [INFO] [TRAIN] epoch=107, iter=39730/80000, loss=0.8061, lr=0.005392, batch_cost=1.3537, reader_cost=0.0001 | ETA 15:08:33 2021-02-23 09:43:17 [INFO] [TRAIN] epoch=107, iter=39740/80000, loss=0.8925, lr=0.005390, batch_cost=1.3594, reader_cost=0.0001 | ETA 15:12:10 2021-02-23 09:43:31 [INFO] [TRAIN] epoch=107, iter=39750/80000, loss=0.8951, lr=0.005389, batch_cost=1.3706, reader_cost=0.0001 | ETA 15:19:28 2021-02-23 09:43:45 [INFO] [TRAIN] epoch=107, iter=39760/80000, loss=0.9871, lr=0.005388, batch_cost=1.3456, reader_cost=0.0001 | ETA 15:02:26 2021-02-23 09:43:58 [INFO] [TRAIN] epoch=107, iter=39770/80000, loss=0.8933, lr=0.005387, batch_cost=1.3661, reader_cost=0.0001 | ETA 15:15:59 2021-02-23 09:44:12 [INFO] [TRAIN] epoch=107, iter=39780/80000, loss=0.8756, lr=0.005386, batch_cost=1.3551, reader_cost=0.0001 | ETA 15:08:20 2021-02-23 09:44:25 [INFO] [TRAIN] epoch=107, iter=39790/80000, loss=0.9614, lr=0.005384, batch_cost=1.3536, reader_cost=0.0001 | ETA 15:07:09 2021-02-23 09:44:39 [INFO] [TRAIN] epoch=107, iter=39800/80000, loss=0.9396, lr=0.005383, batch_cost=1.3666, reader_cost=0.0001 | ETA 15:15:35 2021-02-23 09:44:54 [INFO] [TRAIN] epoch=108, iter=39810/80000, loss=0.9799, lr=0.005382, batch_cost=1.4581, reader_cost=0.1067 | ETA 16:16:41 2021-02-23 09:45:07 [INFO] [TRAIN] epoch=108, iter=39820/80000, loss=0.8653, lr=0.005381, batch_cost=1.3259, reader_cost=0.0001 | ETA 14:47:54 2021-02-23 09:45:20 [INFO] [TRAIN] epoch=108, iter=39830/80000, loss=0.8676, lr=0.005379, batch_cost=1.3573, reader_cost=0.0001 | ETA 15:08:43 2021-02-23 09:45:34 [INFO] [TRAIN] epoch=108, iter=39840/80000, loss=0.8972, lr=0.005378, batch_cost=1.3956, reader_cost=0.0001 | ETA 15:34:07 2021-02-23 09:45:48 [INFO] [TRAIN] epoch=108, iter=39850/80000, loss=0.9088, lr=0.005377, batch_cost=1.3820, reader_cost=0.0001 | ETA 15:24:48 2021-02-23 09:46:02 [INFO] [TRAIN] epoch=108, iter=39860/80000, loss=0.8575, lr=0.005376, batch_cost=1.3542, reader_cost=0.0001 | ETA 15:05:56 2021-02-23 09:46:15 [INFO] [TRAIN] epoch=108, iter=39870/80000, loss=0.8397, lr=0.005375, batch_cost=1.3465, reader_cost=0.0001 | ETA 15:00:35 2021-02-23 09:46:29 [INFO] [TRAIN] epoch=108, iter=39880/80000, loss=1.1635, lr=0.005373, batch_cost=1.3560, reader_cost=0.0001 | ETA 15:06:41 2021-02-23 09:46:43 [INFO] [TRAIN] epoch=108, iter=39890/80000, loss=0.9313, lr=0.005372, batch_cost=1.3673, reader_cost=0.0001 | ETA 15:14:03 2021-02-23 09:46:56 [INFO] [TRAIN] epoch=108, iter=39900/80000, loss=0.9541, lr=0.005371, batch_cost=1.3731, reader_cost=0.0001 | ETA 15:17:42 2021-02-23 09:47:10 [INFO] [TRAIN] epoch=108, iter=39910/80000, loss=0.9220, lr=0.005370, batch_cost=1.3290, reader_cost=0.0001 | ETA 14:48:00 2021-02-23 09:47:23 [INFO] [TRAIN] epoch=108, iter=39920/80000, loss=0.9042, lr=0.005369, batch_cost=1.3682, reader_cost=0.0001 | ETA 15:13:56 2021-02-23 09:47:37 [INFO] [TRAIN] epoch=108, iter=39930/80000, loss=0.8297, lr=0.005367, batch_cost=1.3439, reader_cost=0.0001 | ETA 14:57:28 2021-02-23 09:47:50 [INFO] [TRAIN] epoch=108, iter=39940/80000, loss=0.7915, lr=0.005366, batch_cost=1.3469, reader_cost=0.0001 | ETA 14:59:18 2021-02-23 09:48:04 [INFO] [TRAIN] epoch=108, iter=39950/80000, loss=0.8877, lr=0.005365, batch_cost=1.3538, reader_cost=0.0001 | ETA 15:03:40 2021-02-23 09:48:17 [INFO] [TRAIN] epoch=108, iter=39960/80000, loss=0.8677, lr=0.005364, batch_cost=1.3610, reader_cost=0.0001 | ETA 15:08:13 2021-02-23 09:48:31 [INFO] [TRAIN] epoch=108, iter=39970/80000, loss=1.0112, lr=0.005363, batch_cost=1.3661, reader_cost=0.0001 | ETA 15:11:26 2021-02-23 09:48:44 [INFO] [TRAIN] epoch=108, iter=39980/80000, loss=0.8284, lr=0.005361, batch_cost=1.3432, reader_cost=0.0001 | ETA 14:55:56 2021-02-23 09:48:58 [INFO] [TRAIN] epoch=108, iter=39990/80000, loss=0.9795, lr=0.005360, batch_cost=1.3446, reader_cost=0.0001 | ETA 14:56:38 2021-02-23 09:49:11 [INFO] [TRAIN] epoch=108, iter=40000/80000, loss=0.8978, lr=0.005359, batch_cost=1.3335, reader_cost=0.0001 | ETA 14:49:01 2021-02-23 09:49:11 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:21 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:04 - batch_cost: 0.1991 - reader cost: 0.0658  3/125 [..............................] - ETA: 57s - batch_cost: 0.2499 - reader cost: 0.0769  4/125 [..............................] - ETA: 54s - batch_cost: 0.2854 - reader cost: 0.0876 5/125 [>.............................] - ETA: 53s - batch_cost: 0.3153 - reader cost: 0.1078 6/125 [>.............................] - ETA: 52s - batch_cost: 0.3288 - reader cost: 0.1137 7/125 [>.............................] - ETA: 51s - batch_cost: 0.3434 - reader cost: 0.1238 8/125 [>.............................] - ETA: 50s - batch_cost: 0.3535 - reader cost: 0.1301 9/125 [=>............................] - ETA: 50s - batch_cost: 0.3659 - reader cost: 0.1396 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3720 - reader cost: 0.1434 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3732 - reader cost: 0.1427 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3794 - reader cost: 0.1465 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3812 - reader cost: 0.1468 14/125 [==>...........................] - ETA: 47s - batch_cost: 0.3843 - reader cost: 0.1481 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3848 - reader cost: 0.1469 16/125 [==>...........................] - ETA: 46s - batch_cost: 0.3876 - reader cost: 0.1479 17/125 [===>..........................] - ETA: 45s - batch_cost: 0.3854 - reader cost: 0.1451 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3853 - reader cost: 0.1445 19/125 [===>..........................] - ETA: 44s - batch_cost: 0.3854 - reader cost: 0.1435 20/125 [===>..........................] - ETA: 43s - batch_cost: 0.3861 - reader cost: 0.1429 21/125 [====>.........................] - ETA: 43s - batch_cost: 0.3888 - reader cost: 0.1450 22/125 [====>.........................] - ETA: 43s - batch_cost: 0.3910 - reader cost: 0.1468 23/125 [====>.........................] - ETA: 42s - batch_cost: 0.3912 - reader cost: 0.1461 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.3925 - reader cost: 0.1451 25/125 [=====>........................] - ETA: 41s - batch_cost: 0.3917 - reader cost: 0.1440 26/125 [=====>........................] - ETA: 41s - batch_cost: 0.3932 - reader cost: 0.1432 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.3954 - reader cost: 0.1455 28/125 [=====>........................] - ETA: 40s - batch_cost: 0.3949 - reader cost: 0.1450 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.3961 - reader cost: 0.1461 30/125 [======>.......................] - ETA: 39s - batch_cost: 0.3970 - reader cost: 0.1470 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.3962 - reader cost: 0.1463 32/125 [======>.......................] - ETA: 38s - batch_cost: 0.3958 - reader cost: 0.1459 33/125 [======>.......................] - ETA: 38s - batch_cost: 0.3964 - reader cost: 0.1455 34/125 [=======>......................] - ETA: 37s - batch_cost: 0.3975 - reader cost: 0.1460 35/125 [=======>......................] - ETA: 37s - batch_cost: 0.3985 - reader cost: 0.1461 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.3999 - reader cost: 0.1464 37/125 [=======>......................] - ETA: 36s - batch_cost: 0.4010 - reader cost: 0.1469 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4011 - reader cost: 0.1470 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4018 - reader cost: 0.1477 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4023 - reader cost: 0.1483 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4026 - reader cost: 0.1484 42/125 [=========>....................] - ETA: 34s - batch_cost: 0.4031 - reader cost: 0.1490 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4032 - reader cost: 0.1492 44/125 [=========>....................] - ETA: 33s - batch_cost: 0.4043 - reader cost: 0.1504 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4050 - reader cost: 0.1512 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4055 - reader cost: 0.1516 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4051 - reader cost: 0.1513 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4061 - reader cost: 0.1522 49/125 [==========>...................] - ETA: 31s - batch_cost: 0.4061 - reader cost: 0.1522 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4054 - reader cost: 0.1515 51/125 [===========>..................] - ETA: 30s - batch_cost: 0.4052 - reader cost: 0.1513 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4051 - reader cost: 0.1511 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4052 - reader cost: 0.1512 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4055 - reader cost: 0.1504 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4064 - reader cost: 0.1494 56/125 [============>.................] - ETA: 28s - batch_cost: 0.4062 - reader cost: 0.1488 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4068 - reader cost: 0.1495 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4071 - reader cost: 0.1499 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4066 - reader cost: 0.1496 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4069 - reader cost: 0.1500 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4069 - reader cost: 0.1499 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4075 - reader cost: 0.1505 63/125 [==============>...............] - ETA: 25s - batch_cost: 0.4081 - reader cost: 0.1510 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4083 - reader cost: 0.1514 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4087 - reader cost: 0.1519 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4081 - reader cost: 0.1513 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4083 - reader cost: 0.1516 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4085 - reader cost: 0.1519 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4088 - reader cost: 0.1523 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4090 - reader cost: 0.1526 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4095 - reader cost: 0.1529 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4094 - reader cost: 0.1530 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4099 - reader cost: 0.1536 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4095 - reader cost: 0.1532 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4098 - reader cost: 0.1535 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4103 - reader cost: 0.1542 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4101 - reader cost: 0.1540 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4097 - reader cost: 0.1536 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4091 - reader cost: 0.1531 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4087 - reader cost: 0.1528 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4082 - reader cost: 0.1523 82/125 [==================>...........] - ETA: 17s - batch_cost: 0.4081 - reader cost: 0.1523 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4086 - reader cost: 0.1528 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4088 - reader cost: 0.1531 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4086 - reader cost: 0.1528 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4082 - reader cost: 0.1523 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4082 - reader cost: 0.1524 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4085 - reader cost: 0.1528 89/125 [====================>.........] - ETA: 14s - batch_cost: 0.4084 - reader cost: 0.1523 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4089 - reader cost: 0.1529 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4091 - reader cost: 0.1532 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4089 - reader cost: 0.1528 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4091 - reader cost: 0.1531 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4094 - reader cost: 0.1530 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4096 - reader cost: 0.1532 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4098 - reader cost: 0.1535 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4100 - reader cost: 0.1538 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4099 - reader cost: 0.1537 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4101 - reader cost: 0.1533 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4104 - reader cost: 0.1529 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4105 - reader cost: 0.1530 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4109 - reader cost: 0.1535  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4111 - reader cost: 0.1537 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4112 - reader cost: 0.1539 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4113 - reader cost: 0.1541 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4115 - reader cost: 0.1542 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4112 - reader cost: 0.1539 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4113 - reader cost: 0.1541 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4115 - reader cost: 0.1542 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4115 - reader cost: 0.1543 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4117 - reader cost: 0.1545 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4118 - reader cost: 0.1546 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4121 - reader cost: 0.1550 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4122 - reader cost: 0.1551 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4120 - reader cost: 0.1550 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4122 - reader cost: 0.1552 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4119 - reader cost: 0.1549 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4120 - reader cost: 0.1551 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4122 - reader cost: 0.1554 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4123 - reader cost: 0.1555 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4121 - reader cost: 0.1554 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4118 - reader cost: 0.1551 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4120 - reader cost: 0.1553 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4124 - reader cost: 0.1558 125/125 [==============================] - 52s 418ms/step - batch_cost: 0.4127 - reader cost: 0.1561 2021-02-23 09:50:03 [INFO] [EVAL] #Images=500 mIoU=0.6900 Acc=0.9410 Kappa=0.9229 2021-02-23 09:50:03 [INFO] [EVAL] Class IoU: [0.9666 0.7839 0.877 0.3016 0.5006 0.5991 0.6277 0.7706 0.8838 0.4839 0.9408 0.7996 0.6189 0.9139 0.594 0.5854 0.5545 0.5362 0.7719] 2021-02-23 09:50:03 [INFO] [EVAL] Class Acc: [0.9729 0.9162 0.9009 0.8564 0.8133 0.8603 0.8583 0.9266 0.945 0.8859 0.961 0.9005 0.7909 0.972 0.6656 0.9287 0.9672 0.8305 0.8607] 2021-02-23 09:50:07 [INFO] [EVAL] The model with the best validation mIoU (0.7576) was saved at iter 31000. 2021-02-23 09:50:21 [INFO] [TRAIN] epoch=108, iter=40010/80000, loss=0.8312, lr=0.005358, batch_cost=1.3485, reader_cost=0.0001 | ETA 14:58:46 2021-02-23 09:50:34 [INFO] [TRAIN] epoch=108, iter=40020/80000, loss=0.9154, lr=0.005357, batch_cost=1.3491, reader_cost=0.0001 | ETA 14:58:59 2021-02-23 09:50:48 [INFO] [TRAIN] epoch=108, iter=40030/80000, loss=0.9463, lr=0.005355, batch_cost=1.3411, reader_cost=0.0001 | ETA 14:53:25 2021-02-23 09:51:01 [INFO] [TRAIN] epoch=108, iter=40040/80000, loss=0.8907, lr=0.005354, batch_cost=1.3536, reader_cost=0.0001 | ETA 15:01:29 2021-02-23 09:51:15 [INFO] [TRAIN] epoch=108, iter=40050/80000, loss=0.8593, lr=0.005353, batch_cost=1.3976, reader_cost=0.0001 | ETA 15:30:34 2021-02-23 09:51:29 [INFO] [TRAIN] epoch=108, iter=40060/80000, loss=0.9274, lr=0.005352, batch_cost=1.3747, reader_cost=0.0001 | ETA 15:15:04 2021-02-23 09:51:43 [INFO] [TRAIN] epoch=108, iter=40070/80000, loss=0.8451, lr=0.005351, batch_cost=1.3515, reader_cost=0.0001 | ETA 14:59:26 2021-02-23 09:51:56 [INFO] [TRAIN] epoch=108, iter=40080/80000, loss=0.8879, lr=0.005349, batch_cost=1.3884, reader_cost=0.0001 | ETA 15:23:45 2021-02-23 09:52:10 [INFO] [TRAIN] epoch=108, iter=40090/80000, loss=0.8094, lr=0.005348, batch_cost=1.3596, reader_cost=0.0001 | ETA 15:04:23 2021-02-23 09:52:24 [INFO] [TRAIN] epoch=108, iter=40100/80000, loss=0.8918, lr=0.005347, batch_cost=1.3537, reader_cost=0.0001 | ETA 15:00:14 2021-02-23 09:52:37 [INFO] [TRAIN] epoch=108, iter=40110/80000, loss=0.8987, lr=0.005346, batch_cost=1.3517, reader_cost=0.0001 | ETA 14:58:39 2021-02-23 09:52:51 [INFO] [TRAIN] epoch=108, iter=40120/80000, loss=0.8706, lr=0.005345, batch_cost=1.3582, reader_cost=0.0001 | ETA 15:02:44 2021-02-23 09:53:04 [INFO] [TRAIN] epoch=108, iter=40130/80000, loss=0.8910, lr=0.005343, batch_cost=1.3744, reader_cost=0.0001 | ETA 15:13:19 2021-02-23 09:53:18 [INFO] [TRAIN] epoch=108, iter=40140/80000, loss=0.8408, lr=0.005342, batch_cost=1.3607, reader_cost=0.0001 | ETA 15:03:58 2021-02-23 09:53:32 [INFO] [TRAIN] epoch=108, iter=40150/80000, loss=0.8339, lr=0.005341, batch_cost=1.3771, reader_cost=0.0001 | ETA 15:14:38 2021-02-23 09:53:45 [INFO] [TRAIN] epoch=108, iter=40160/80000, loss=0.8457, lr=0.005340, batch_cost=1.3607, reader_cost=0.0001 | ETA 15:03:29 2021-02-23 09:53:59 [INFO] [TRAIN] epoch=108, iter=40170/80000, loss=0.8806, lr=0.005338, batch_cost=1.3626, reader_cost=0.0001 | ETA 15:04:34 2021-02-23 09:54:13 [INFO] [TRAIN] epoch=109, iter=40180/80000, loss=0.8916, lr=0.005337, batch_cost=1.4322, reader_cost=0.0891 | ETA 15:50:29 2021-02-23 09:54:27 [INFO] [TRAIN] epoch=109, iter=40190/80000, loss=0.8665, lr=0.005336, batch_cost=1.3777, reader_cost=0.0001 | ETA 15:14:07 2021-02-23 09:54:41 [INFO] [TRAIN] epoch=109, iter=40200/80000, loss=0.8588, lr=0.005335, batch_cost=1.3680, reader_cost=0.0001 | ETA 15:07:28 2021-02-23 09:54:54 [INFO] [TRAIN] epoch=109, iter=40210/80000, loss=0.9019, lr=0.005334, batch_cost=1.3514, reader_cost=0.0001 | ETA 14:56:10 2021-02-23 09:55:08 [INFO] [TRAIN] epoch=109, iter=40220/80000, loss=0.9083, lr=0.005332, batch_cost=1.3528, reader_cost=0.0001 | ETA 14:56:55 2021-02-23 09:55:21 [INFO] [TRAIN] epoch=109, iter=40230/80000, loss=0.8389, lr=0.005331, batch_cost=1.3469, reader_cost=0.0001 | ETA 14:52:46 2021-02-23 09:55:35 [INFO] [TRAIN] epoch=109, iter=40240/80000, loss=0.8226, lr=0.005330, batch_cost=1.3577, reader_cost=0.0001 | ETA 14:59:40 2021-02-23 09:55:49 [INFO] [TRAIN] epoch=109, iter=40250/80000, loss=0.8863, lr=0.005329, batch_cost=1.3587, reader_cost=0.0001 | ETA 15:00:07 2021-02-23 09:56:02 [INFO] [TRAIN] epoch=109, iter=40260/80000, loss=0.9322, lr=0.005328, batch_cost=1.3512, reader_cost=0.0001 | ETA 14:54:58 2021-02-23 09:56:16 [INFO] [TRAIN] epoch=109, iter=40270/80000, loss=0.9080, lr=0.005326, batch_cost=1.3793, reader_cost=0.0001 | ETA 15:13:18 2021-02-23 09:56:29 [INFO] [TRAIN] epoch=109, iter=40280/80000, loss=0.8350, lr=0.005325, batch_cost=1.3507, reader_cost=0.0001 | ETA 14:54:10 2021-02-23 09:56:43 [INFO] [TRAIN] epoch=109, iter=40290/80000, loss=0.9388, lr=0.005324, batch_cost=1.3767, reader_cost=0.0001 | ETA 15:11:07 2021-02-23 09:56:57 [INFO] [TRAIN] epoch=109, iter=40300/80000, loss=0.9176, lr=0.005323, batch_cost=1.3730, reader_cost=0.0001 | ETA 15:08:30 2021-02-23 09:57:10 [INFO] [TRAIN] epoch=109, iter=40310/80000, loss=0.9092, lr=0.005322, batch_cost=1.3479, reader_cost=0.0001 | ETA 14:51:37 2021-02-23 09:57:24 [INFO] [TRAIN] epoch=109, iter=40320/80000, loss=0.9435, lr=0.005320, batch_cost=1.3292, reader_cost=0.0001 | ETA 14:39:04 2021-02-23 09:57:38 [INFO] [TRAIN] epoch=109, iter=40330/80000, loss=0.9064, lr=0.005319, batch_cost=1.3897, reader_cost=0.0001 | ETA 15:18:48 2021-02-23 09:57:51 [INFO] [TRAIN] epoch=109, iter=40340/80000, loss=0.9077, lr=0.005318, batch_cost=1.3409, reader_cost=0.0001 | ETA 14:46:21 2021-02-23 09:58:05 [INFO] [TRAIN] epoch=109, iter=40350/80000, loss=0.8529, lr=0.005317, batch_cost=1.3665, reader_cost=0.0001 | ETA 15:03:00 2021-02-23 09:58:18 [INFO] [TRAIN] epoch=109, iter=40360/80000, loss=0.8707, lr=0.005316, batch_cost=1.3487, reader_cost=0.0001 | ETA 14:51:02 2021-02-23 09:58:32 [INFO] [TRAIN] epoch=109, iter=40370/80000, loss=0.9020, lr=0.005314, batch_cost=1.3779, reader_cost=0.0001 | ETA 15:10:07 2021-02-23 09:58:45 [INFO] [TRAIN] epoch=109, iter=40380/80000, loss=0.7738, lr=0.005313, batch_cost=1.3470, reader_cost=0.0001 | ETA 14:49:29 2021-02-23 09:58:59 [INFO] [TRAIN] epoch=109, iter=40390/80000, loss=0.9556, lr=0.005312, batch_cost=1.3753, reader_cost=0.0001 | ETA 15:07:53 2021-02-23 09:59:13 [INFO] [TRAIN] epoch=109, iter=40400/80000, loss=0.9659, lr=0.005311, batch_cost=1.3669, reader_cost=0.0001 | ETA 15:02:10 2021-02-23 09:59:27 [INFO] [TRAIN] epoch=109, iter=40410/80000, loss=0.9248, lr=0.005310, batch_cost=1.3904, reader_cost=0.0001 | ETA 15:17:27 2021-02-23 09:59:41 [INFO] [TRAIN] epoch=109, iter=40420/80000, loss=0.8324, lr=0.005308, batch_cost=1.4075, reader_cost=0.0001 | ETA 15:28:27 2021-02-23 09:59:54 [INFO] [TRAIN] epoch=109, iter=40430/80000, loss=0.9690, lr=0.005307, batch_cost=1.3483, reader_cost=0.0001 | ETA 14:49:11 2021-02-23 10:00:08 [INFO] [TRAIN] epoch=109, iter=40440/80000, loss=0.8925, lr=0.005306, batch_cost=1.3698, reader_cost=0.0001 | ETA 15:03:10 2021-02-23 10:00:21 [INFO] [TRAIN] epoch=109, iter=40450/80000, loss=0.8777, lr=0.005305, batch_cost=1.3573, reader_cost=0.0001 | ETA 14:54:42 2021-02-23 10:00:35 [INFO] [TRAIN] epoch=109, iter=40460/80000, loss=1.0460, lr=0.005303, batch_cost=1.3487, reader_cost=0.0001 | ETA 14:48:46 2021-02-23 10:00:49 [INFO] [TRAIN] epoch=109, iter=40470/80000, loss=1.0075, lr=0.005302, batch_cost=1.3561, reader_cost=0.0001 | ETA 14:53:27 2021-02-23 10:01:02 [INFO] [TRAIN] epoch=109, iter=40480/80000, loss=0.8920, lr=0.005301, batch_cost=1.3615, reader_cost=0.0001 | ETA 14:56:46 2021-02-23 10:01:16 [INFO] [TRAIN] epoch=109, iter=40490/80000, loss=0.8918, lr=0.005300, batch_cost=1.3480, reader_cost=0.0001 | ETA 14:47:40 2021-02-23 10:01:29 [INFO] [TRAIN] epoch=109, iter=40500/80000, loss=0.9374, lr=0.005299, batch_cost=1.3535, reader_cost=0.0001 | ETA 14:51:04 2021-02-23 10:01:43 [INFO] [TRAIN] epoch=109, iter=40510/80000, loss=0.8001, lr=0.005297, batch_cost=1.3622, reader_cost=0.0001 | ETA 14:56:34 2021-02-23 10:01:56 [INFO] [TRAIN] epoch=109, iter=40520/80000, loss=0.9107, lr=0.005296, batch_cost=1.3470, reader_cost=0.0001 | ETA 14:46:20 2021-02-23 10:02:10 [INFO] [TRAIN] epoch=109, iter=40530/80000, loss=0.9345, lr=0.005295, batch_cost=1.3564, reader_cost=0.0001 | ETA 14:52:18 2021-02-23 10:02:23 [INFO] [TRAIN] epoch=109, iter=40540/80000, loss=0.9119, lr=0.005294, batch_cost=1.3630, reader_cost=0.0001 | ETA 14:56:22 2021-02-23 10:02:38 [INFO] [TRAIN] epoch=110, iter=40550/80000, loss=0.8169, lr=0.005293, batch_cost=1.4363, reader_cost=0.0717 | ETA 15:44:20 2021-02-23 10:02:52 [INFO] [TRAIN] epoch=110, iter=40560/80000, loss=0.9020, lr=0.005291, batch_cost=1.3983, reader_cost=0.0001 | ETA 15:19:09 2021-02-23 10:03:05 [INFO] [TRAIN] epoch=110, iter=40570/80000, loss=0.8373, lr=0.005290, batch_cost=1.3664, reader_cost=0.0001 | ETA 14:57:55 2021-02-23 10:03:19 [INFO] [TRAIN] epoch=110, iter=40580/80000, loss=0.9007, lr=0.005289, batch_cost=1.3465, reader_cost=0.0001 | ETA 14:44:40 2021-02-23 10:03:33 [INFO] [TRAIN] epoch=110, iter=40590/80000, loss=0.8162, lr=0.005288, batch_cost=1.3591, reader_cost=0.0001 | ETA 14:52:43 2021-02-23 10:03:46 [INFO] [TRAIN] epoch=110, iter=40600/80000, loss=0.9306, lr=0.005287, batch_cost=1.3565, reader_cost=0.0001 | ETA 14:50:44 2021-02-23 10:04:00 [INFO] [TRAIN] epoch=110, iter=40610/80000, loss=0.8327, lr=0.005285, batch_cost=1.3543, reader_cost=0.0001 | ETA 14:49:06 2021-02-23 10:04:13 [INFO] [TRAIN] epoch=110, iter=40620/80000, loss=0.9020, lr=0.005284, batch_cost=1.3244, reader_cost=0.0001 | ETA 14:29:16 2021-02-23 10:04:27 [INFO] [TRAIN] epoch=110, iter=40630/80000, loss=1.0342, lr=0.005283, batch_cost=1.3850, reader_cost=0.0001 | ETA 15:08:48 2021-02-23 10:04:40 [INFO] [TRAIN] epoch=110, iter=40640/80000, loss=0.9071, lr=0.005282, batch_cost=1.3534, reader_cost=0.0001 | ETA 14:47:51 2021-02-23 10:04:54 [INFO] [TRAIN] epoch=110, iter=40650/80000, loss=0.8765, lr=0.005281, batch_cost=1.3512, reader_cost=0.0001 | ETA 14:46:11 2021-02-23 10:05:08 [INFO] [TRAIN] epoch=110, iter=40660/80000, loss=0.9531, lr=0.005279, batch_cost=1.3831, reader_cost=0.0001 | ETA 15:06:49 2021-02-23 10:05:21 [INFO] [TRAIN] epoch=110, iter=40670/80000, loss=0.9008, lr=0.005278, batch_cost=1.3413, reader_cost=0.0001 | ETA 14:39:11 2021-02-23 10:05:34 [INFO] [TRAIN] epoch=110, iter=40680/80000, loss=0.9119, lr=0.005277, batch_cost=1.3478, reader_cost=0.0001 | ETA 14:43:14 2021-02-23 10:05:48 [INFO] [TRAIN] epoch=110, iter=40690/80000, loss=0.8909, lr=0.005276, batch_cost=1.3737, reader_cost=0.0001 | ETA 15:00:02 2021-02-23 10:06:02 [INFO] [TRAIN] epoch=110, iter=40700/80000, loss=0.8617, lr=0.005275, batch_cost=1.3383, reader_cost=0.0001 | ETA 14:36:35 2021-02-23 10:06:15 [INFO] [TRAIN] epoch=110, iter=40710/80000, loss=1.0401, lr=0.005273, batch_cost=1.3504, reader_cost=0.0001 | ETA 14:44:16 2021-02-23 10:06:29 [INFO] [TRAIN] epoch=110, iter=40720/80000, loss=0.8659, lr=0.005272, batch_cost=1.3527, reader_cost=0.0001 | ETA 14:45:35 2021-02-23 10:06:42 [INFO] [TRAIN] epoch=110, iter=40730/80000, loss=0.8700, lr=0.005271, batch_cost=1.3469, reader_cost=0.0001 | ETA 14:41:31 2021-02-23 10:06:56 [INFO] [TRAIN] epoch=110, iter=40740/80000, loss=0.9171, lr=0.005270, batch_cost=1.3494, reader_cost=0.0001 | ETA 14:42:58 2021-02-23 10:07:09 [INFO] [TRAIN] epoch=110, iter=40750/80000, loss=0.9269, lr=0.005268, batch_cost=1.3567, reader_cost=0.0001 | ETA 14:47:29 2021-02-23 10:07:23 [INFO] [TRAIN] epoch=110, iter=40760/80000, loss=0.8843, lr=0.005267, batch_cost=1.3737, reader_cost=0.0001 | ETA 14:58:24 2021-02-23 10:07:37 [INFO] [TRAIN] epoch=110, iter=40770/80000, loss=0.9151, lr=0.005266, batch_cost=1.3757, reader_cost=0.0001 | ETA 14:59:26 2021-02-23 10:07:50 [INFO] [TRAIN] epoch=110, iter=40780/80000, loss=0.8616, lr=0.005265, batch_cost=1.3574, reader_cost=0.0001 | ETA 14:47:16 2021-02-23 10:08:04 [INFO] [TRAIN] epoch=110, iter=40790/80000, loss=0.8378, lr=0.005264, batch_cost=1.3344, reader_cost=0.0001 | ETA 14:32:03 2021-02-23 10:08:17 [INFO] [TRAIN] epoch=110, iter=40800/80000, loss=0.8741, lr=0.005262, batch_cost=1.3675, reader_cost=0.0001 | ETA 14:53:27 2021-02-23 10:08:31 [INFO] [TRAIN] epoch=110, iter=40810/80000, loss=0.8994, lr=0.005261, batch_cost=1.3621, reader_cost=0.0001 | ETA 14:49:39 2021-02-23 10:08:45 [INFO] [TRAIN] epoch=110, iter=40820/80000, loss=0.8603, lr=0.005260, batch_cost=1.3865, reader_cost=0.0001 | ETA 15:05:22 2021-02-23 10:08:58 [INFO] [TRAIN] epoch=110, iter=40830/80000, loss=0.8935, lr=0.005259, batch_cost=1.3655, reader_cost=0.0001 | ETA 14:51:25 2021-02-23 10:09:12 [INFO] [TRAIN] epoch=110, iter=40840/80000, loss=0.8599, lr=0.005258, batch_cost=1.3500, reader_cost=0.0001 | ETA 14:41:05 2021-02-23 10:09:26 [INFO] [TRAIN] epoch=110, iter=40850/80000, loss=0.9420, lr=0.005256, batch_cost=1.3597, reader_cost=0.0001 | ETA 14:47:13 2021-02-23 10:09:39 [INFO] [TRAIN] epoch=110, iter=40860/80000, loss=0.9110, lr=0.005255, batch_cost=1.3509, reader_cost=0.0001 | ETA 14:41:12 2021-02-23 10:09:53 [INFO] [TRAIN] epoch=110, iter=40870/80000, loss=0.8896, lr=0.005254, batch_cost=1.3564, reader_cost=0.0001 | ETA 14:44:37 2021-02-23 10:10:07 [INFO] [TRAIN] epoch=110, iter=40880/80000, loss=0.9741, lr=0.005253, batch_cost=1.4008, reader_cost=0.0001 | ETA 15:13:20 2021-02-23 10:10:20 [INFO] [TRAIN] epoch=110, iter=40890/80000, loss=0.8486, lr=0.005252, batch_cost=1.3611, reader_cost=0.0001 | ETA 14:47:10 2021-02-23 10:10:34 [INFO] [TRAIN] epoch=110, iter=40900/80000, loss=0.8458, lr=0.005250, batch_cost=1.3719, reader_cost=0.0001 | ETA 14:53:59 2021-02-23 10:10:47 [INFO] [TRAIN] epoch=110, iter=40910/80000, loss=0.8546, lr=0.005249, batch_cost=1.3366, reader_cost=0.0001 | ETA 14:30:46 2021-02-23 10:11:00 [INFO] [TRAIN] epoch=110, iter=40920/80000, loss=0.8210, lr=0.005248, batch_cost=1.2968, reader_cost=0.0001 | ETA 14:04:37 2021-02-23 10:11:15 [INFO] [TRAIN] epoch=111, iter=40930/80000, loss=1.0138, lr=0.005247, batch_cost=1.4753, reader_cost=0.0809 | ETA 16:00:41 2021-02-23 10:11:29 [INFO] [TRAIN] epoch=111, iter=40940/80000, loss=0.9567, lr=0.005246, batch_cost=1.3911, reader_cost=0.0001 | ETA 15:05:34 2021-02-23 10:11:43 [INFO] [TRAIN] epoch=111, iter=40950/80000, loss=0.8494, lr=0.005244, batch_cost=1.3688, reader_cost=0.0001 | ETA 14:50:50 2021-02-23 10:11:56 [INFO] [TRAIN] epoch=111, iter=40960/80000, loss=0.8661, lr=0.005243, batch_cost=1.3526, reader_cost=0.0001 | ETA 14:40:04 2021-02-23 10:12:10 [INFO] [TRAIN] epoch=111, iter=40970/80000, loss=0.9078, lr=0.005242, batch_cost=1.3649, reader_cost=0.0001 | ETA 14:47:52 2021-02-23 10:12:23 [INFO] [TRAIN] epoch=111, iter=40980/80000, loss=0.8465, lr=0.005241, batch_cost=1.3629, reader_cost=0.0001 | ETA 14:46:20 2021-02-23 10:12:37 [INFO] [TRAIN] epoch=111, iter=40990/80000, loss=1.0032, lr=0.005239, batch_cost=1.3576, reader_cost=0.0001 | ETA 14:42:38 2021-02-23 10:12:51 [INFO] [TRAIN] epoch=111, iter=41000/80000, loss=0.9174, lr=0.005238, batch_cost=1.3571, reader_cost=0.0001 | ETA 14:42:06 2021-02-23 10:12:51 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:00 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 57s - batch_cost: 0.2223 - reader cost: 0.0954  3/125 [..............................] - ETA: 56s - batch_cost: 0.3004 - reader cost: 0.1312 4/125 [..............................] - ETA: 55s - batch_cost: 0.3336 - reader cost: 0.1443 5/125 [>.............................] - ETA: 53s - batch_cost: 0.3530 - reader cost: 0.1516 6/125 [>.............................] - ETA: 52s - batch_cost: 0.3642 - reader cost: 0.1547 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3729 - reader cost: 0.1577 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3799 - reader cost: 0.1601 9/125 [=>............................] - ETA: 50s - batch_cost: 0.3852 - reader cost: 0.1622 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3907 - reader cost: 0.1643 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3917 - reader cost: 0.1623 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3961 - reader cost: 0.1650 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3982 - reader cost: 0.1657 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.4012 - reader cost: 0.1667 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.4038 - reader cost: 0.1682 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.4063 - reader cost: 0.1695 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.4040 - reader cost: 0.1663 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.4060 - reader cost: 0.1673 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.4072 - reader cost: 0.1678 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4087 - reader cost: 0.1684 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4090 - reader cost: 0.1680 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4108 - reader cost: 0.1691 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4098 - reader cost: 0.1675 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4113 - reader cost: 0.1683 25/125 [=====>........................] - ETA: 43s - batch_cost: 0.4117 - reader cost: 0.1682 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4102 - reader cost: 0.1664 27/125 [=====>........................] - ETA: 42s - batch_cost: 0.4112 - reader cost: 0.1671 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4119 - reader cost: 0.1674 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4132 - reader cost: 0.1684 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4129 - reader cost: 0.1677 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4118 - reader cost: 0.1663 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4123 - reader cost: 0.1665 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4128 - reader cost: 0.1668 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4136 - reader cost: 0.1674 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4123 - reader cost: 0.1658 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4130 - reader cost: 0.1662 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4141 - reader cost: 0.1673 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4143 - reader cost: 0.1675 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4147 - reader cost: 0.1675 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4152 - reader cost: 0.1678 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4153 - reader cost: 0.1678 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4148 - reader cost: 0.1672 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4142 - reader cost: 0.1665 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4146 - reader cost: 0.1669 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4152 - reader cost: 0.1674 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4148 - reader cost: 0.1670 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4147 - reader cost: 0.1668 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4138 - reader cost: 0.1658 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4128 - reader cost: 0.1647 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4128 - reader cost: 0.1641 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4135 - reader cost: 0.1644 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4140 - reader cost: 0.1645 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4140 - reader cost: 0.1645 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4141 - reader cost: 0.1646 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4146 - reader cost: 0.1649 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4149 - reader cost: 0.1649 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4145 - reader cost: 0.1639 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4148 - reader cost: 0.1630 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4151 - reader cost: 0.1622 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4154 - reader cost: 0.1623 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4158 - reader cost: 0.1627 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4160 - reader cost: 0.1631 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4163 - reader cost: 0.1634 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4165 - reader cost: 0.1636 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4166 - reader cost: 0.1638 66/125 [==============>...............] - ETA: 25s - batch_cost: 0.4168 - reader cost: 0.1640 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4161 - reader cost: 0.1633 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4161 - reader cost: 0.1633 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4164 - reader cost: 0.1631 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4165 - reader cost: 0.1627 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4168 - reader cost: 0.1631 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4165 - reader cost: 0.1626 73/125 [================>.............] - ETA: 22s - batch_cost: 0.4167 - reader cost: 0.1627 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4162 - reader cost: 0.1620 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4165 - reader cost: 0.1617 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4161 - reader cost: 0.1607 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4167 - reader cost: 0.1601 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4171 - reader cost: 0.1591 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4171 - reader cost: 0.1574 80/125 [==================>...........] - ETA: 19s - batch_cost: 0.4164 - reader cost: 0.1558 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4160 - reader cost: 0.1554 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4158 - reader cost: 0.1549 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4160 - reader cost: 0.1552 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4161 - reader cost: 0.1547 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4158 - reader cost: 0.1541 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4163 - reader cost: 0.1543 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4167 - reader cost: 0.1546 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4169 - reader cost: 0.1550 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4169 - reader cost: 0.1551 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4171 - reader cost: 0.1555 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4173 - reader cost: 0.1557 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4175 - reader cost: 0.1560 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4177 - reader cost: 0.1563 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4179 - reader cost: 0.1565 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4173 - reader cost: 0.1561 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4174 - reader cost: 0.1563 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4170 - reader cost: 0.1560 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4171 - reader cost: 0.1562 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4172 - reader cost: 0.1563 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4167 - reader cost: 0.1560 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4163 - reader cost: 0.1555 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4167 - reader cost: 0.1561  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4167 - reader cost: 0.1562 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4163 - reader cost: 0.1557 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4165 - reader cost: 0.1560 106/125 [========================>.....] - ETA: 8s - batch_cost: 0.4166 - reader cost: 0.1563 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4167 - reader cost: 0.1564 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4168 - reader cost: 0.1565 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4168 - reader cost: 0.1567 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4169 - reader cost: 0.1569 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4170 - reader cost: 0.1570 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4170 - reader cost: 0.1571 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4171 - reader cost: 0.1572 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4168 - reader cost: 0.1570 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4169 - reader cost: 0.1571 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4165 - reader cost: 0.1569 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4164 - reader cost: 0.1568 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4166 - reader cost: 0.1570 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4167 - reader cost: 0.1571 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4164 - reader cost: 0.1569 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4166 - reader cost: 0.1571 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4167 - reader cost: 0.1573 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4168 - reader cost: 0.1574 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4168 - reader cost: 0.1576 125/125 [==============================] - 53s 421ms/step - batch_cost: 0.4169 - reader cost: 0.1576 2021-02-23 10:13:43 [INFO] [EVAL] #Images=500 mIoU=0.7275 Acc=0.9534 Kappa=0.9394 2021-02-23 10:13:43 [INFO] [EVAL] Class IoU: [0.9742 0.8062 0.9101 0.3971 0.5266 0.6453 0.6941 0.7901 0.9188 0.6388 0.9456 0.8041 0.6055 0.9393 0.7744 0.7765 0.5945 0.3304 0.7516] 2021-02-23 10:13:43 [INFO] [EVAL] Class Acc: [0.9826 0.8995 0.9387 0.766 0.7484 0.8207 0.897 0.9122 0.959 0.811 0.9722 0.8625 0.8071 0.9804 0.8786 0.9369 0.9867 0.7631 0.8426] 2021-02-23 10:13:47 [INFO] [EVAL] The model with the best validation mIoU (0.7576) was saved at iter 31000. 2021-02-23 10:14:01 [INFO] [TRAIN] epoch=111, iter=41010/80000, loss=0.8932, lr=0.005237, batch_cost=1.3345, reader_cost=0.0001 | ETA 14:27:13 2021-02-23 10:14:15 [INFO] [TRAIN] epoch=111, iter=41020/80000, loss=0.8670, lr=0.005236, batch_cost=1.3949, reader_cost=0.0001 | ETA 15:06:14 2021-02-23 10:14:28 [INFO] [TRAIN] epoch=111, iter=41030/80000, loss=0.8976, lr=0.005235, batch_cost=1.3715, reader_cost=0.0001 | ETA 14:50:46 2021-02-23 10:14:42 [INFO] [TRAIN] epoch=111, iter=41040/80000, loss=0.9923, lr=0.005233, batch_cost=1.3362, reader_cost=0.0001 | ETA 14:27:37 2021-02-23 10:14:55 [INFO] [TRAIN] epoch=111, iter=41050/80000, loss=0.8212, lr=0.005232, batch_cost=1.3439, reader_cost=0.0001 | ETA 14:32:25 2021-02-23 10:15:09 [INFO] [TRAIN] epoch=111, iter=41060/80000, loss=0.9004, lr=0.005231, batch_cost=1.3834, reader_cost=0.0001 | ETA 14:57:50 2021-02-23 10:15:22 [INFO] [TRAIN] epoch=111, iter=41070/80000, loss=0.8584, lr=0.005230, batch_cost=1.3502, reader_cost=0.0001 | ETA 14:36:02 2021-02-23 10:15:36 [INFO] [TRAIN] epoch=111, iter=41080/80000, loss=0.9129, lr=0.005229, batch_cost=1.3671, reader_cost=0.0001 | ETA 14:46:48 2021-02-23 10:15:50 [INFO] [TRAIN] epoch=111, iter=41090/80000, loss=0.8495, lr=0.005227, batch_cost=1.4149, reader_cost=0.0001 | ETA 15:17:35 2021-02-23 10:16:04 [INFO] [TRAIN] epoch=111, iter=41100/80000, loss=0.8431, lr=0.005226, batch_cost=1.3406, reader_cost=0.0001 | ETA 14:29:09 2021-02-23 10:16:17 [INFO] [TRAIN] epoch=111, iter=41110/80000, loss=0.8801, lr=0.005225, batch_cost=1.3483, reader_cost=0.0001 | ETA 14:33:55 2021-02-23 10:16:31 [INFO] [TRAIN] epoch=111, iter=41120/80000, loss=0.9874, lr=0.005224, batch_cost=1.3360, reader_cost=0.0001 | ETA 14:25:43 2021-02-23 10:16:44 [INFO] [TRAIN] epoch=111, iter=41130/80000, loss=0.8579, lr=0.005223, batch_cost=1.3422, reader_cost=0.0001 | ETA 14:29:31 2021-02-23 10:16:58 [INFO] [TRAIN] epoch=111, iter=41140/80000, loss=0.8520, lr=0.005221, batch_cost=1.3584, reader_cost=0.0001 | ETA 14:39:46 2021-02-23 10:17:11 [INFO] [TRAIN] epoch=111, iter=41150/80000, loss=0.9300, lr=0.005220, batch_cost=1.3729, reader_cost=0.0001 | ETA 14:48:57 2021-02-23 10:17:25 [INFO] [TRAIN] epoch=111, iter=41160/80000, loss=0.8840, lr=0.005219, batch_cost=1.3635, reader_cost=0.0001 | ETA 14:42:38 2021-02-23 10:17:39 [INFO] [TRAIN] epoch=111, iter=41170/80000, loss=0.8253, lr=0.005218, batch_cost=1.3684, reader_cost=0.0001 | ETA 14:45:33 2021-02-23 10:17:52 [INFO] [TRAIN] epoch=111, iter=41180/80000, loss=0.8706, lr=0.005216, batch_cost=1.3740, reader_cost=0.0001 | ETA 14:48:59 2021-02-23 10:18:06 [INFO] [TRAIN] epoch=111, iter=41190/80000, loss=0.9003, lr=0.005215, batch_cost=1.3650, reader_cost=0.0001 | ETA 14:42:55 2021-02-23 10:18:19 [INFO] [TRAIN] epoch=111, iter=41200/80000, loss=0.8808, lr=0.005214, batch_cost=1.3505, reader_cost=0.0001 | ETA 14:33:21 2021-02-23 10:18:33 [INFO] [TRAIN] epoch=111, iter=41210/80000, loss=0.8788, lr=0.005213, batch_cost=1.3538, reader_cost=0.0001 | ETA 14:35:14 2021-02-23 10:18:47 [INFO] [TRAIN] epoch=111, iter=41220/80000, loss=0.8375, lr=0.005212, batch_cost=1.3775, reader_cost=0.0001 | ETA 14:50:21 2021-02-23 10:19:00 [INFO] [TRAIN] epoch=111, iter=41230/80000, loss=0.8425, lr=0.005210, batch_cost=1.3617, reader_cost=0.0001 | ETA 14:39:52 2021-02-23 10:19:14 [INFO] [TRAIN] epoch=111, iter=41240/80000, loss=0.8940, lr=0.005209, batch_cost=1.3487, reader_cost=0.0001 | ETA 14:31:16 2021-02-23 10:19:27 [INFO] [TRAIN] epoch=111, iter=41250/80000, loss=0.9130, lr=0.005208, batch_cost=1.3531, reader_cost=0.0001 | ETA 14:33:53 2021-02-23 10:19:41 [INFO] [TRAIN] epoch=111, iter=41260/80000, loss=0.8825, lr=0.005207, batch_cost=1.3461, reader_cost=0.0001 | ETA 14:29:09 2021-02-23 10:19:55 [INFO] [TRAIN] epoch=111, iter=41270/80000, loss=0.8849, lr=0.005206, batch_cost=1.3693, reader_cost=0.0001 | ETA 14:43:54 2021-02-23 10:20:08 [INFO] [TRAIN] epoch=111, iter=41280/80000, loss=0.8460, lr=0.005204, batch_cost=1.3602, reader_cost=0.0001 | ETA 14:37:47 2021-02-23 10:20:22 [INFO] [TRAIN] epoch=111, iter=41290/80000, loss=0.8366, lr=0.005203, batch_cost=1.3382, reader_cost=0.0001 | ETA 14:23:21 2021-02-23 10:20:36 [INFO] [TRAIN] epoch=112, iter=41300/80000, loss=0.9287, lr=0.005202, batch_cost=1.4400, reader_cost=0.0725 | ETA 15:28:49 2021-02-23 10:20:50 [INFO] [TRAIN] epoch=112, iter=41310/80000, loss=0.8793, lr=0.005201, batch_cost=1.3761, reader_cost=0.0001 | ETA 14:47:22 2021-02-23 10:21:03 [INFO] [TRAIN] epoch=112, iter=41320/80000, loss=0.9731, lr=0.005200, batch_cost=1.3349, reader_cost=0.0001 | ETA 14:20:34 2021-02-23 10:21:17 [INFO] [TRAIN] epoch=112, iter=41330/80000, loss=0.8098, lr=0.005198, batch_cost=1.3533, reader_cost=0.0001 | ETA 14:32:10 2021-02-23 10:21:30 [INFO] [TRAIN] epoch=112, iter=41340/80000, loss=0.7688, lr=0.005197, batch_cost=1.3674, reader_cost=0.0001 | ETA 14:41:04 2021-02-23 10:21:44 [INFO] [TRAIN] epoch=112, iter=41350/80000, loss=0.8970, lr=0.005196, batch_cost=1.3344, reader_cost=0.0001 | ETA 14:19:34 2021-02-23 10:21:57 [INFO] [TRAIN] epoch=112, iter=41360/80000, loss=0.8736, lr=0.005195, batch_cost=1.3620, reader_cost=0.0001 | ETA 14:37:06 2021-02-23 10:22:11 [INFO] [TRAIN] epoch=112, iter=41370/80000, loss=0.8885, lr=0.005194, batch_cost=1.3872, reader_cost=0.0001 | ETA 14:53:08 2021-02-23 10:22:25 [INFO] [TRAIN] epoch=112, iter=41380/80000, loss=0.9267, lr=0.005192, batch_cost=1.3390, reader_cost=0.0001 | ETA 14:21:50 2021-02-23 10:22:38 [INFO] [TRAIN] epoch=112, iter=41390/80000, loss=0.9029, lr=0.005191, batch_cost=1.3585, reader_cost=0.0001 | ETA 14:34:10 2021-02-23 10:22:52 [INFO] [TRAIN] epoch=112, iter=41400/80000, loss=0.8541, lr=0.005190, batch_cost=1.3561, reader_cost=0.0001 | ETA 14:32:24 2021-02-23 10:23:05 [INFO] [TRAIN] epoch=112, iter=41410/80000, loss=0.7759, lr=0.005189, batch_cost=1.3559, reader_cost=0.0001 | ETA 14:32:03 2021-02-23 10:23:19 [INFO] [TRAIN] epoch=112, iter=41420/80000, loss=0.8444, lr=0.005187, batch_cost=1.3616, reader_cost=0.0001 | ETA 14:35:29 2021-02-23 10:23:32 [INFO] [TRAIN] epoch=112, iter=41430/80000, loss=0.8809, lr=0.005186, batch_cost=1.3340, reader_cost=0.0001 | ETA 14:17:34 2021-02-23 10:23:46 [INFO] [TRAIN] epoch=112, iter=41440/80000, loss=0.8790, lr=0.005185, batch_cost=1.3493, reader_cost=0.0001 | ETA 14:27:08 2021-02-23 10:23:59 [INFO] [TRAIN] epoch=112, iter=41450/80000, loss=0.8682, lr=0.005184, batch_cost=1.3440, reader_cost=0.0001 | ETA 14:23:29 2021-02-23 10:24:12 [INFO] [TRAIN] epoch=112, iter=41460/80000, loss=0.9016, lr=0.005183, batch_cost=1.3315, reader_cost=0.0001 | ETA 14:15:14 2021-02-23 10:24:26 [INFO] [TRAIN] epoch=112, iter=41470/80000, loss=0.8129, lr=0.005181, batch_cost=1.3573, reader_cost=0.0001 | ETA 14:31:36 2021-02-23 10:24:40 [INFO] [TRAIN] epoch=112, iter=41480/80000, loss=0.9134, lr=0.005180, batch_cost=1.4004, reader_cost=0.0001 | ETA 14:59:04 2021-02-23 10:24:54 [INFO] [TRAIN] epoch=112, iter=41490/80000, loss=0.9325, lr=0.005179, batch_cost=1.3709, reader_cost=0.0001 | ETA 14:39:52 2021-02-23 10:25:07 [INFO] [TRAIN] epoch=112, iter=41500/80000, loss=0.8648, lr=0.005178, batch_cost=1.3675, reader_cost=0.0001 | ETA 14:37:27 2021-02-23 10:25:21 [INFO] [TRAIN] epoch=112, iter=41510/80000, loss=0.7984, lr=0.005177, batch_cost=1.3529, reader_cost=0.0001 | ETA 14:27:51 2021-02-23 10:25:34 [INFO] [TRAIN] epoch=112, iter=41520/80000, loss=0.9997, lr=0.005175, batch_cost=1.3421, reader_cost=0.0001 | ETA 14:20:43 2021-02-23 10:25:48 [INFO] [TRAIN] epoch=112, iter=41530/80000, loss=0.8684, lr=0.005174, batch_cost=1.3899, reader_cost=0.0001 | ETA 14:51:07 2021-02-23 10:26:02 [INFO] [TRAIN] epoch=112, iter=41540/80000, loss=0.8589, lr=0.005173, batch_cost=1.3635, reader_cost=0.0001 | ETA 14:34:01 2021-02-23 10:26:15 [INFO] [TRAIN] epoch=112, iter=41550/80000, loss=0.8694, lr=0.005172, batch_cost=1.3525, reader_cost=0.0001 | ETA 14:26:43 2021-02-23 10:26:29 [INFO] [TRAIN] epoch=112, iter=41560/80000, loss=0.8913, lr=0.005171, batch_cost=1.3591, reader_cost=0.0001 | ETA 14:30:43 2021-02-23 10:26:43 [INFO] [TRAIN] epoch=112, iter=41570/80000, loss=0.8664, lr=0.005169, batch_cost=1.3652, reader_cost=0.0001 | ETA 14:34:25 2021-02-23 10:26:56 [INFO] [TRAIN] epoch=112, iter=41580/80000, loss=0.8668, lr=0.005168, batch_cost=1.3670, reader_cost=0.0001 | ETA 14:35:20 2021-02-23 10:27:10 [INFO] [TRAIN] epoch=112, iter=41590/80000, loss=0.8708, lr=0.005167, batch_cost=1.3662, reader_cost=0.0001 | ETA 14:34:34 2021-02-23 10:27:24 [INFO] [TRAIN] epoch=112, iter=41600/80000, loss=0.9076, lr=0.005166, batch_cost=1.3731, reader_cost=0.0001 | ETA 14:38:48 2021-02-23 10:27:38 [INFO] [TRAIN] epoch=112, iter=41610/80000, loss=0.8875, lr=0.005164, batch_cost=1.3965, reader_cost=0.0001 | ETA 14:53:30 2021-02-23 10:27:51 [INFO] [TRAIN] epoch=112, iter=41620/80000, loss=0.9630, lr=0.005163, batch_cost=1.3529, reader_cost=0.0001 | ETA 14:25:25 2021-02-23 10:28:05 [INFO] [TRAIN] epoch=112, iter=41630/80000, loss=0.9154, lr=0.005162, batch_cost=1.3491, reader_cost=0.0001 | ETA 14:22:43 2021-02-23 10:28:18 [INFO] [TRAIN] epoch=112, iter=41640/80000, loss=0.8271, lr=0.005161, batch_cost=1.3486, reader_cost=0.0001 | ETA 14:22:14 2021-02-23 10:28:32 [INFO] [TRAIN] epoch=112, iter=41650/80000, loss=0.8352, lr=0.005160, batch_cost=1.3334, reader_cost=0.0001 | ETA 14:12:15 2021-02-23 10:28:45 [INFO] [TRAIN] epoch=112, iter=41660/80000, loss=0.9136, lr=0.005158, batch_cost=1.3505, reader_cost=0.0001 | ETA 14:22:57 2021-02-23 10:29:00 [INFO] [TRAIN] epoch=113, iter=41670/80000, loss=0.8926, lr=0.005157, batch_cost=1.4648, reader_cost=0.0679 | ETA 15:35:46 2021-02-23 10:29:13 [INFO] [TRAIN] epoch=113, iter=41680/80000, loss=0.8342, lr=0.005156, batch_cost=1.3709, reader_cost=0.0001 | ETA 14:35:33 2021-02-23 10:29:27 [INFO] [TRAIN] epoch=113, iter=41690/80000, loss=0.8438, lr=0.005155, batch_cost=1.3445, reader_cost=0.0001 | ETA 14:18:29 2021-02-23 10:29:40 [INFO] [TRAIN] epoch=113, iter=41700/80000, loss=0.9144, lr=0.005154, batch_cost=1.3593, reader_cost=0.0001 | ETA 14:27:42 2021-02-23 10:29:54 [INFO] [TRAIN] epoch=113, iter=41710/80000, loss=0.8941, lr=0.005152, batch_cost=1.3470, reader_cost=0.0001 | ETA 14:19:35 2021-02-23 10:30:07 [INFO] [TRAIN] epoch=113, iter=41720/80000, loss=0.8607, lr=0.005151, batch_cost=1.3361, reader_cost=0.0001 | ETA 14:12:25 2021-02-23 10:30:21 [INFO] [TRAIN] epoch=113, iter=41730/80000, loss=0.8307, lr=0.005150, batch_cost=1.3605, reader_cost=0.0001 | ETA 14:27:46 2021-02-23 10:30:34 [INFO] [TRAIN] epoch=113, iter=41740/80000, loss=0.8481, lr=0.005149, batch_cost=1.3473, reader_cost=0.0001 | ETA 14:19:07 2021-02-23 10:30:48 [INFO] [TRAIN] epoch=113, iter=41750/80000, loss=0.8668, lr=0.005148, batch_cost=1.3654, reader_cost=0.0001 | ETA 14:30:28 2021-02-23 10:31:01 [INFO] [TRAIN] epoch=113, iter=41760/80000, loss=0.8877, lr=0.005146, batch_cost=1.3499, reader_cost=0.0001 | ETA 14:20:21 2021-02-23 10:31:15 [INFO] [TRAIN] epoch=113, iter=41770/80000, loss=0.8139, lr=0.005145, batch_cost=1.3588, reader_cost=0.0001 | ETA 14:25:45 2021-02-23 10:31:28 [INFO] [TRAIN] epoch=113, iter=41780/80000, loss=0.8203, lr=0.005144, batch_cost=1.3303, reader_cost=0.0001 | ETA 14:07:24 2021-02-23 10:31:42 [INFO] [TRAIN] epoch=113, iter=41790/80000, loss=0.8528, lr=0.005143, batch_cost=1.3504, reader_cost=0.0001 | ETA 14:19:57 2021-02-23 10:31:55 [INFO] [TRAIN] epoch=113, iter=41800/80000, loss=0.9354, lr=0.005141, batch_cost=1.3391, reader_cost=0.0001 | ETA 14:12:34 2021-02-23 10:32:09 [INFO] [TRAIN] epoch=113, iter=41810/80000, loss=0.9776, lr=0.005140, batch_cost=1.3738, reader_cost=0.0001 | ETA 14:34:25 2021-02-23 10:32:23 [INFO] [TRAIN] epoch=113, iter=41820/80000, loss=1.0235, lr=0.005139, batch_cost=1.3652, reader_cost=0.0001 | ETA 14:28:41 2021-02-23 10:32:36 [INFO] [TRAIN] epoch=113, iter=41830/80000, loss=0.8497, lr=0.005138, batch_cost=1.3205, reader_cost=0.0001 | ETA 14:00:04 2021-02-23 10:32:50 [INFO] [TRAIN] epoch=113, iter=41840/80000, loss=0.8821, lr=0.005137, batch_cost=1.3679, reader_cost=0.0001 | ETA 14:30:00 2021-02-23 10:33:03 [INFO] [TRAIN] epoch=113, iter=41850/80000, loss=0.8512, lr=0.005135, batch_cost=1.3724, reader_cost=0.0001 | ETA 14:32:36 2021-02-23 10:33:17 [INFO] [TRAIN] epoch=113, iter=41860/80000, loss=0.8660, lr=0.005134, batch_cost=1.3571, reader_cost=0.0001 | ETA 14:22:39 2021-02-23 10:33:31 [INFO] [TRAIN] epoch=113, iter=41870/80000, loss=0.9452, lr=0.005133, batch_cost=1.3727, reader_cost=0.0001 | ETA 14:32:22 2021-02-23 10:33:44 [INFO] [TRAIN] epoch=113, iter=41880/80000, loss=0.8175, lr=0.005132, batch_cost=1.3540, reader_cost=0.0001 | ETA 14:20:15 2021-02-23 10:33:58 [INFO] [TRAIN] epoch=113, iter=41890/80000, loss=0.8242, lr=0.005131, batch_cost=1.3507, reader_cost=0.0001 | ETA 14:17:53 2021-02-23 10:34:11 [INFO] [TRAIN] epoch=113, iter=41900/80000, loss=0.8428, lr=0.005129, batch_cost=1.3625, reader_cost=0.0001 | ETA 14:25:12 2021-02-23 10:34:25 [INFO] [TRAIN] epoch=113, iter=41910/80000, loss=0.8584, lr=0.005128, batch_cost=1.3777, reader_cost=0.0001 | ETA 14:34:36 2021-02-23 10:34:39 [INFO] [TRAIN] epoch=113, iter=41920/80000, loss=0.9358, lr=0.005127, batch_cost=1.3592, reader_cost=0.0001 | ETA 14:22:39 2021-02-23 10:34:52 [INFO] [TRAIN] epoch=113, iter=41930/80000, loss=0.9001, lr=0.005126, batch_cost=1.3473, reader_cost=0.0001 | ETA 14:14:52 2021-02-23 10:35:06 [INFO] [TRAIN] epoch=113, iter=41940/80000, loss=0.8730, lr=0.005124, batch_cost=1.3635, reader_cost=0.0001 | ETA 14:24:56 2021-02-23 10:35:19 [INFO] [TRAIN] epoch=113, iter=41950/80000, loss=0.9500, lr=0.005123, batch_cost=1.3493, reader_cost=0.0001 | ETA 14:15:42 2021-02-23 10:35:33 [INFO] [TRAIN] epoch=113, iter=41960/80000, loss=0.8502, lr=0.005122, batch_cost=1.3627, reader_cost=0.0001 | ETA 14:23:55 2021-02-23 10:35:46 [INFO] [TRAIN] epoch=113, iter=41970/80000, loss=0.8860, lr=0.005121, batch_cost=1.3384, reader_cost=0.0001 | ETA 14:08:20 2021-02-23 10:36:00 [INFO] [TRAIN] epoch=113, iter=41980/80000, loss=0.9242, lr=0.005120, batch_cost=1.3914, reader_cost=0.0001 | ETA 14:41:42 2021-02-23 10:36:14 [INFO] [TRAIN] epoch=113, iter=41990/80000, loss=0.8175, lr=0.005118, batch_cost=1.3552, reader_cost=0.0001 | ETA 14:18:30 2021-02-23 10:36:27 [INFO] [TRAIN] epoch=113, iter=42000/80000, loss=0.9254, lr=0.005117, batch_cost=1.3559, reader_cost=0.0001 | ETA 14:18:45 2021-02-23 10:36:27 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:17 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:02 - batch_cost: 0.1995 - reader cost: 0.0743  3/125 [..............................] - ETA: 1:00 - batch_cost: 0.2873 - reader cost: 0.1164 4/125 [..............................] - ETA: 57s - batch_cost: 0.3192 - reader cost: 0.1265  5/125 [>.............................] - ETA: 56s - batch_cost: 0.3449 - reader cost: 0.1406 6/125 [>.............................] - ETA: 55s - batch_cost: 0.3596 - reader cost: 0.1466 7/125 [>.............................] - ETA: 54s - batch_cost: 0.3698 - reader cost: 0.1503 8/125 [>.............................] - ETA: 53s - batch_cost: 0.3759 - reader cost: 0.1529 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3754 - reader cost: 0.1494 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3804 - reader cost: 0.1523 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3801 - reader cost: 0.1497 12/125 [=>............................] - ETA: 48s - batch_cost: 0.3791 - reader cost: 0.1468 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3822 - reader cost: 0.1485 14/125 [==>...........................] - ETA: 47s - batch_cost: 0.3862 - reader cost: 0.1513 15/125 [==>...........................] - ETA: 46s - batch_cost: 0.3845 - reader cost: 0.1485 16/125 [==>...........................] - ETA: 46s - batch_cost: 0.3851 - reader cost: 0.1483 17/125 [===>..........................] - ETA: 45s - batch_cost: 0.3877 - reader cost: 0.1461 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3895 - reader cost: 0.1476 19/125 [===>..........................] - ETA: 44s - batch_cost: 0.3903 - reader cost: 0.1478 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3904 - reader cost: 0.1477 21/125 [====>.........................] - ETA: 43s - batch_cost: 0.3909 - reader cost: 0.1460 22/125 [====>.........................] - ETA: 43s - batch_cost: 0.3923 - reader cost: 0.1461 23/125 [====>.........................] - ETA: 42s - batch_cost: 0.3931 - reader cost: 0.1456 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.3937 - reader cost: 0.1462 25/125 [=====>........................] - ETA: 41s - batch_cost: 0.3926 - reader cost: 0.1451 26/125 [=====>........................] - ETA: 41s - batch_cost: 0.3950 - reader cost: 0.1474 27/125 [=====>........................] - ETA: 40s - batch_cost: 0.3949 - reader cost: 0.1472 28/125 [=====>........................] - ETA: 40s - batch_cost: 0.3960 - reader cost: 0.1483 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.3968 - reader cost: 0.1491 30/125 [======>.......................] - ETA: 39s - batch_cost: 0.3958 - reader cost: 0.1479 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.3961 - reader cost: 0.1478 32/125 [======>.......................] - ETA: 38s - batch_cost: 0.3957 - reader cost: 0.1464 33/125 [======>.......................] - ETA: 38s - batch_cost: 0.3968 - reader cost: 0.1468 34/125 [=======>......................] - ETA: 37s - batch_cost: 0.3992 - reader cost: 0.1485 35/125 [=======>......................] - ETA: 37s - batch_cost: 0.3986 - reader cost: 0.1471 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.3995 - reader cost: 0.1470 37/125 [=======>......................] - ETA: 36s - batch_cost: 0.4000 - reader cost: 0.1475 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4007 - reader cost: 0.1483 39/125 [========>.....................] - ETA: 35s - batch_cost: 0.4015 - reader cost: 0.1492 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4010 - reader cost: 0.1486 41/125 [========>.....................] - ETA: 34s - batch_cost: 0.4000 - reader cost: 0.1476 42/125 [=========>....................] - ETA: 34s - batch_cost: 0.4010 - reader cost: 0.1484 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4010 - reader cost: 0.1482 44/125 [=========>....................] - ETA: 33s - batch_cost: 0.4023 - reader cost: 0.1496 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4030 - reader cost: 0.1504 46/125 [==========>...................] - ETA: 32s - batch_cost: 0.4024 - reader cost: 0.1498 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4024 - reader cost: 0.1495 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4028 - reader cost: 0.1499 49/125 [==========>...................] - ETA: 31s - batch_cost: 0.4034 - reader cost: 0.1506 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4027 - reader cost: 0.1498 51/125 [===========>..................] - ETA: 30s - batch_cost: 0.4021 - reader cost: 0.1493 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4024 - reader cost: 0.1496 53/125 [===========>..................] - ETA: 29s - batch_cost: 0.4028 - reader cost: 0.1501 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4036 - reader cost: 0.1507 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4041 - reader cost: 0.1513 56/125 [============>.................] - ETA: 28s - batch_cost: 0.4034 - reader cost: 0.1506 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4032 - reader cost: 0.1504 58/125 [============>.................] - ETA: 27s - batch_cost: 0.4036 - reader cost: 0.1508 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4035 - reader cost: 0.1507 60/125 [=============>................] - ETA: 26s - batch_cost: 0.4039 - reader cost: 0.1504 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4047 - reader cost: 0.1501 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4050 - reader cost: 0.1497 63/125 [==============>...............] - ETA: 25s - batch_cost: 0.4054 - reader cost: 0.1503 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4050 - reader cost: 0.1501 65/125 [==============>...............] - ETA: 24s - batch_cost: 0.4058 - reader cost: 0.1506 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4050 - reader cost: 0.1499 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4057 - reader cost: 0.1507 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4052 - reader cost: 0.1502 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4053 - reader cost: 0.1504 70/125 [===============>..............] - ETA: 22s - batch_cost: 0.4056 - reader cost: 0.1508 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4059 - reader cost: 0.1512 72/125 [================>.............] - ETA: 21s - batch_cost: 0.4055 - reader cost: 0.1508 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4057 - reader cost: 0.1510 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4052 - reader cost: 0.1506 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4050 - reader cost: 0.1503 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4055 - reader cost: 0.1506 77/125 [=================>............] - ETA: 19s - batch_cost: 0.4057 - reader cost: 0.1508 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4051 - reader cost: 0.1502 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4054 - reader cost: 0.1505 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4057 - reader cost: 0.1510 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4061 - reader cost: 0.1512 82/125 [==================>...........] - ETA: 17s - batch_cost: 0.4056 - reader cost: 0.1508 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4056 - reader cost: 0.1506 84/125 [===================>..........] - ETA: 16s - batch_cost: 0.4058 - reader cost: 0.1505 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4060 - reader cost: 0.1501 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4063 - reader cost: 0.1493 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4068 - reader cost: 0.1490 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4073 - reader cost: 0.1492 89/125 [====================>.........] - ETA: 14s - batch_cost: 0.4071 - reader cost: 0.1488 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4074 - reader cost: 0.1491 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4071 - reader cost: 0.1489 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4071 - reader cost: 0.1487 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4078 - reader cost: 0.1486 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4076 - reader cost: 0.1482 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4074 - reader cost: 0.1480 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4078 - reader cost: 0.1483 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4079 - reader cost: 0.1486 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4081 - reader cost: 0.1483 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4089 - reader cost: 0.1476 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4090 - reader cost: 0.1462 101/125 [=======================>......] - ETA: 9s - batch_cost: 0.4087 - reader cost: 0.1447  102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4087 - reader cost: 0.1433 103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4089 - reader cost: 0.1430 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4092 - reader cost: 0.1432 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4090 - reader cost: 0.1432 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4094 - reader cost: 0.1436 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4095 - reader cost: 0.1439 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4097 - reader cost: 0.1442 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4099 - reader cost: 0.1445 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4101 - reader cost: 0.1448 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4100 - reader cost: 0.1445 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4102 - reader cost: 0.1447 113/125 [==========================>...] - ETA: 4s - batch_cost: 0.4104 - reader cost: 0.1450 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4106 - reader cost: 0.1449 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4110 - reader cost: 0.1452 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4112 - reader cost: 0.1456 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4115 - reader cost: 0.1460 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4117 - reader cost: 0.1463 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4116 - reader cost: 0.1461 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4117 - reader cost: 0.1463 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4118 - reader cost: 0.1465 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4121 - reader cost: 0.1467 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4122 - reader cost: 0.1469 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4120 - reader cost: 0.1467 125/125 [==============================] - 52s 417ms/step - batch_cost: 0.4123 - reader cost: 0.1465 2021-02-23 10:37:20 [INFO] [EVAL] #Images=500 mIoU=0.6864 Acc=0.9524 Kappa=0.9382 2021-02-23 10:37:20 [INFO] [EVAL] Class IoU: [0.9781 0.8266 0.9092 0.3332 0.5624 0.6367 0.7168 0.7906 0.9193 0.5842 0.9389 0.8018 0.5618 0.9382 0.4008 0.6135 0.1973 0.5641 0.7676] 2021-02-23 10:37:20 [INFO] [EVAL] Class Acc: [0.9888 0.8863 0.9435 0.8519 0.8509 0.8419 0.8515 0.923 0.9524 0.891 0.9719 0.8477 0.8331 0.9694 0.4143 0.7796 0.9933 0.6469 0.8872] 2021-02-23 10:37:23 [INFO] [EVAL] The model with the best validation mIoU (0.7576) was saved at iter 31000. 2021-02-23 10:37:37 [INFO] [TRAIN] epoch=113, iter=42010/80000, loss=0.9282, lr=0.005116, batch_cost=1.3517, reader_cost=0.0001 | ETA 14:15:51 2021-02-23 10:37:50 [INFO] [TRAIN] epoch=113, iter=42020/80000, loss=0.9083, lr=0.005115, batch_cost=1.3492, reader_cost=0.0001 | ETA 14:14:01 2021-02-23 10:38:04 [INFO] [TRAIN] epoch=113, iter=42030/80000, loss=0.9328, lr=0.005114, batch_cost=1.3780, reader_cost=0.0001 | ETA 14:32:02 2021-02-23 10:38:19 [INFO] [TRAIN] epoch=114, iter=42040/80000, loss=0.8464, lr=0.005112, batch_cost=1.4439, reader_cost=0.0835 | ETA 15:13:31 2021-02-23 10:38:32 [INFO] [TRAIN] epoch=114, iter=42050/80000, loss=0.9052, lr=0.005111, batch_cost=1.3573, reader_cost=0.0001 | ETA 14:18:27 2021-02-23 10:38:46 [INFO] [TRAIN] epoch=114, iter=42060/80000, loss=0.8960, lr=0.005110, batch_cost=1.3478, reader_cost=0.0001 | ETA 14:12:13 2021-02-23 10:38:59 [INFO] [TRAIN] epoch=114, iter=42070/80000, loss=0.9413, lr=0.005109, batch_cost=1.3397, reader_cost=0.0001 | ETA 14:06:53 2021-02-23 10:39:13 [INFO] [TRAIN] epoch=114, iter=42080/80000, loss=0.9051, lr=0.005108, batch_cost=1.3453, reader_cost=0.0001 | ETA 14:10:12 2021-02-23 10:39:26 [INFO] [TRAIN] epoch=114, iter=42090/80000, loss=0.8613, lr=0.005106, batch_cost=1.3615, reader_cost=0.0001 | ETA 14:20:15 2021-02-23 10:39:40 [INFO] [TRAIN] epoch=114, iter=42100/80000, loss=0.8417, lr=0.005105, batch_cost=1.3532, reader_cost=0.0001 | ETA 14:14:47 2021-02-23 10:39:53 [INFO] [TRAIN] epoch=114, iter=42110/80000, loss=0.8487, lr=0.005104, batch_cost=1.3504, reader_cost=0.0001 | ETA 14:12:47 2021-02-23 10:40:07 [INFO] [TRAIN] epoch=114, iter=42120/80000, loss=0.9538, lr=0.005103, batch_cost=1.3874, reader_cost=0.0001 | ETA 14:35:55 2021-02-23 10:40:21 [INFO] [TRAIN] epoch=114, iter=42130/80000, loss=0.7938, lr=0.005101, batch_cost=1.3683, reader_cost=0.0001 | ETA 14:23:37 2021-02-23 10:40:35 [INFO] [TRAIN] epoch=114, iter=42140/80000, loss=0.8524, lr=0.005100, batch_cost=1.3746, reader_cost=0.0001 | ETA 14:27:21 2021-02-23 10:40:48 [INFO] [TRAIN] epoch=114, iter=42150/80000, loss=0.8456, lr=0.005099, batch_cost=1.3454, reader_cost=0.0001 | ETA 14:08:41 2021-02-23 10:41:01 [INFO] [TRAIN] epoch=114, iter=42160/80000, loss=0.7687, lr=0.005098, batch_cost=1.3434, reader_cost=0.0001 | ETA 14:07:15 2021-02-23 10:41:15 [INFO] [TRAIN] epoch=114, iter=42170/80000, loss=0.8597, lr=0.005097, batch_cost=1.3482, reader_cost=0.0001 | ETA 14:10:00 2021-02-23 10:41:28 [INFO] [TRAIN] epoch=114, iter=42180/80000, loss=0.9128, lr=0.005095, batch_cost=1.3519, reader_cost=0.0001 | ETA 14:12:07 2021-02-23 10:41:42 [INFO] [TRAIN] epoch=114, iter=42190/80000, loss=0.8872, lr=0.005094, batch_cost=1.3552, reader_cost=0.0001 | ETA 14:13:59 2021-02-23 10:41:56 [INFO] [TRAIN] epoch=114, iter=42200/80000, loss=0.8205, lr=0.005093, batch_cost=1.3994, reader_cost=0.0001 | ETA 14:41:37 2021-02-23 10:42:09 [INFO] [TRAIN] epoch=114, iter=42210/80000, loss=0.8627, lr=0.005092, batch_cost=1.3442, reader_cost=0.0001 | ETA 14:06:38 2021-02-23 10:42:23 [INFO] [TRAIN] epoch=114, iter=42220/80000, loss=1.1758, lr=0.005091, batch_cost=1.3482, reader_cost=0.0001 | ETA 14:08:56 2021-02-23 10:42:37 [INFO] [TRAIN] epoch=114, iter=42230/80000, loss=0.8056, lr=0.005089, batch_cost=1.3628, reader_cost=0.0001 | ETA 14:17:53 2021-02-23 10:42:50 [INFO] [TRAIN] epoch=114, iter=42240/80000, loss=0.8874, lr=0.005088, batch_cost=1.3556, reader_cost=0.0001 | ETA 14:13:07 2021-02-23 10:43:04 [INFO] [TRAIN] epoch=114, iter=42250/80000, loss=0.8963, lr=0.005087, batch_cost=1.3703, reader_cost=0.0001 | ETA 14:22:09 2021-02-23 10:43:17 [INFO] [TRAIN] epoch=114, iter=42260/80000, loss=0.8184, lr=0.005086, batch_cost=1.3501, reader_cost=0.0001 | ETA 14:09:13 2021-02-23 10:43:31 [INFO] [TRAIN] epoch=114, iter=42270/80000, loss=0.8159, lr=0.005084, batch_cost=1.3623, reader_cost=0.0001 | ETA 14:16:40 2021-02-23 10:43:45 [INFO] [TRAIN] epoch=114, iter=42280/80000, loss=0.8478, lr=0.005083, batch_cost=1.3698, reader_cost=0.0001 | ETA 14:21:09 2021-02-23 10:43:58 [INFO] [TRAIN] epoch=114, iter=42290/80000, loss=0.9550, lr=0.005082, batch_cost=1.3869, reader_cost=0.0001 | ETA 14:31:41 2021-02-23 10:44:12 [INFO] [TRAIN] epoch=114, iter=42300/80000, loss=0.8389, lr=0.005081, batch_cost=1.3667, reader_cost=0.0001 | ETA 14:18:45 2021-02-23 10:44:26 [INFO] [TRAIN] epoch=114, iter=42310/80000, loss=0.8716, lr=0.005080, batch_cost=1.3654, reader_cost=0.0001 | ETA 14:17:43 2021-02-23 10:44:40 [INFO] [TRAIN] epoch=114, iter=42320/80000, loss=0.9365, lr=0.005078, batch_cost=1.3707, reader_cost=0.0001 | ETA 14:20:47 2021-02-23 10:44:53 [INFO] [TRAIN] epoch=114, iter=42330/80000, loss=0.8476, lr=0.005077, batch_cost=1.3679, reader_cost=0.0001 | ETA 14:18:48 2021-02-23 10:45:07 [INFO] [TRAIN] epoch=114, iter=42340/80000, loss=0.9205, lr=0.005076, batch_cost=1.3655, reader_cost=0.0001 | ETA 14:17:06 2021-02-23 10:45:21 [INFO] [TRAIN] epoch=114, iter=42350/80000, loss=0.8441, lr=0.005075, batch_cost=1.4119, reader_cost=0.0001 | ETA 14:45:59 2021-02-23 10:45:35 [INFO] [TRAIN] epoch=114, iter=42360/80000, loss=0.7968, lr=0.005074, batch_cost=1.3609, reader_cost=0.0001 | ETA 14:13:45 2021-02-23 10:45:48 [INFO] [TRAIN] epoch=114, iter=42370/80000, loss=0.8533, lr=0.005072, batch_cost=1.3563, reader_cost=0.0001 | ETA 14:10:37 2021-02-23 10:46:02 [INFO] [TRAIN] epoch=114, iter=42380/80000, loss=0.9199, lr=0.005071, batch_cost=1.3800, reader_cost=0.0001 | ETA 14:25:17 2021-02-23 10:46:15 [INFO] [TRAIN] epoch=114, iter=42390/80000, loss=0.7846, lr=0.005070, batch_cost=1.3436, reader_cost=0.0001 | ETA 14:02:14 2021-02-23 10:46:29 [INFO] [TRAIN] epoch=114, iter=42400/80000, loss=0.8266, lr=0.005069, batch_cost=1.3594, reader_cost=0.0001 | ETA 14:11:54 2021-02-23 10:46:43 [INFO] [TRAIN] epoch=115, iter=42410/80000, loss=0.9109, lr=0.005068, batch_cost=1.3888, reader_cost=0.0610 | ETA 14:30:05 2021-02-23 10:46:56 [INFO] [TRAIN] epoch=115, iter=42420/80000, loss=0.9089, lr=0.005066, batch_cost=1.3606, reader_cost=0.0023 | ETA 14:12:09 2021-02-23 10:47:10 [INFO] [TRAIN] epoch=115, iter=42430/80000, loss=0.9351, lr=0.005065, batch_cost=1.3761, reader_cost=0.0001 | ETA 14:21:41 2021-02-23 10:47:23 [INFO] [TRAIN] epoch=115, iter=42440/80000, loss=0.8790, lr=0.005064, batch_cost=1.3197, reader_cost=0.0001 | ETA 13:46:08 2021-02-23 10:47:37 [INFO] [TRAIN] epoch=115, iter=42450/80000, loss=0.8434, lr=0.005063, batch_cost=1.3419, reader_cost=0.0001 | ETA 13:59:47 2021-02-23 10:47:50 [INFO] [TRAIN] epoch=115, iter=42460/80000, loss=0.8238, lr=0.005061, batch_cost=1.3601, reader_cost=0.0001 | ETA 14:10:59 2021-02-23 10:48:04 [INFO] [TRAIN] epoch=115, iter=42470/80000, loss=0.9057, lr=0.005060, batch_cost=1.3573, reader_cost=0.0001 | ETA 14:08:58 2021-02-23 10:48:18 [INFO] [TRAIN] epoch=115, iter=42480/80000, loss=0.8497, lr=0.005059, batch_cost=1.3597, reader_cost=0.0001 | ETA 14:10:15 2021-02-23 10:48:31 [INFO] [TRAIN] epoch=115, iter=42490/80000, loss=0.9196, lr=0.005058, batch_cost=1.3852, reader_cost=0.0001 | ETA 14:25:57 2021-02-23 10:48:45 [INFO] [TRAIN] epoch=115, iter=42500/80000, loss=0.8911, lr=0.005057, batch_cost=1.3658, reader_cost=0.0001 | ETA 14:13:37 2021-02-23 10:48:59 [INFO] [TRAIN] epoch=115, iter=42510/80000, loss=0.7378, lr=0.005055, batch_cost=1.3625, reader_cost=0.0001 | ETA 14:11:19 2021-02-23 10:49:12 [INFO] [TRAIN] epoch=115, iter=42520/80000, loss=0.9159, lr=0.005054, batch_cost=1.3666, reader_cost=0.0001 | ETA 14:13:41 2021-02-23 10:49:26 [INFO] [TRAIN] epoch=115, iter=42530/80000, loss=0.8948, lr=0.005053, batch_cost=1.3548, reader_cost=0.0001 | ETA 14:06:03 2021-02-23 10:49:39 [INFO] [TRAIN] epoch=115, iter=42540/80000, loss=0.8740, lr=0.005052, batch_cost=1.3506, reader_cost=0.0001 | ETA 14:03:13 2021-02-23 10:49:53 [INFO] [TRAIN] epoch=115, iter=42550/80000, loss=0.7961, lr=0.005051, batch_cost=1.3471, reader_cost=0.0001 | ETA 14:00:47 2021-02-23 10:50:07 [INFO] [TRAIN] epoch=115, iter=42560/80000, loss=0.8538, lr=0.005049, batch_cost=1.3664, reader_cost=0.0001 | ETA 14:12:37 2021-02-23 10:50:20 [INFO] [TRAIN] epoch=115, iter=42570/80000, loss=0.8741, lr=0.005048, batch_cost=1.3559, reader_cost=0.0001 | ETA 14:05:50 2021-02-23 10:50:34 [INFO] [TRAIN] epoch=115, iter=42580/80000, loss=0.8418, lr=0.005047, batch_cost=1.3777, reader_cost=0.0001 | ETA 14:19:13 2021-02-23 10:50:47 [INFO] [TRAIN] epoch=115, iter=42590/80000, loss=0.9779, lr=0.005046, batch_cost=1.3347, reader_cost=0.0001 | ETA 13:52:10 2021-02-23 10:51:01 [INFO] [TRAIN] epoch=115, iter=42600/80000, loss=0.9216, lr=0.005044, batch_cost=1.3696, reader_cost=0.0001 | ETA 14:13:43 2021-02-23 10:51:15 [INFO] [TRAIN] epoch=115, iter=42610/80000, loss=0.8306, lr=0.005043, batch_cost=1.3872, reader_cost=0.0001 | ETA 14:24:26 2021-02-23 10:51:29 [INFO] [TRAIN] epoch=115, iter=42620/80000, loss=0.8299, lr=0.005042, batch_cost=1.3683, reader_cost=0.0001 | ETA 14:12:26 2021-02-23 10:51:42 [INFO] [TRAIN] epoch=115, iter=42630/80000, loss=0.8867, lr=0.005041, batch_cost=1.3726, reader_cost=0.0001 | ETA 14:14:53 2021-02-23 10:51:56 [INFO] [TRAIN] epoch=115, iter=42640/80000, loss=0.8857, lr=0.005040, batch_cost=1.3681, reader_cost=0.0001 | ETA 14:11:52 2021-02-23 10:52:10 [INFO] [TRAIN] epoch=115, iter=42650/80000, loss=0.8182, lr=0.005038, batch_cost=1.3667, reader_cost=0.0001 | ETA 14:10:46 2021-02-23 10:52:23 [INFO] [TRAIN] epoch=115, iter=42660/80000, loss=0.8934, lr=0.005037, batch_cost=1.3542, reader_cost=0.0001 | ETA 14:02:44 2021-02-23 10:52:37 [INFO] [TRAIN] epoch=115, iter=42670/80000, loss=0.8157, lr=0.005036, batch_cost=1.3651, reader_cost=0.0001 | ETA 14:09:19 2021-02-23 10:52:50 [INFO] [TRAIN] epoch=115, iter=42680/80000, loss=0.8278, lr=0.005035, batch_cost=1.3379, reader_cost=0.0001 | ETA 13:52:09 2021-02-23 10:53:04 [INFO] [TRAIN] epoch=115, iter=42690/80000, loss=0.8226, lr=0.005034, batch_cost=1.3671, reader_cost=0.0001 | ETA 14:10:06 2021-02-23 10:53:17 [INFO] [TRAIN] epoch=115, iter=42700/80000, loss=0.8615, lr=0.005032, batch_cost=1.3499, reader_cost=0.0001 | ETA 13:59:09 2021-02-23 10:53:31 [INFO] [TRAIN] epoch=115, iter=42710/80000, loss=1.0083, lr=0.005031, batch_cost=1.3597, reader_cost=0.0001 | ETA 14:05:01 2021-02-23 10:53:45 [INFO] [TRAIN] epoch=115, iter=42720/80000, loss=0.8044, lr=0.005030, batch_cost=1.3725, reader_cost=0.0002 | ETA 14:12:47 2021-02-23 10:53:59 [INFO] [TRAIN] epoch=115, iter=42730/80000, loss=0.8359, lr=0.005029, batch_cost=1.3849, reader_cost=0.0001 | ETA 14:20:13 2021-02-23 10:54:12 [INFO] [TRAIN] epoch=115, iter=42740/80000, loss=0.8503, lr=0.005027, batch_cost=1.3710, reader_cost=0.0001 | ETA 14:11:24 2021-02-23 10:54:26 [INFO] [TRAIN] epoch=115, iter=42750/80000, loss=0.8957, lr=0.005026, batch_cost=1.3371, reader_cost=0.0001 | ETA 13:50:07 2021-02-23 10:54:40 [INFO] [TRAIN] epoch=115, iter=42760/80000, loss=0.8913, lr=0.005025, batch_cost=1.4141, reader_cost=0.0001 | ETA 14:37:39 2021-02-23 10:54:53 [INFO] [TRAIN] epoch=115, iter=42770/80000, loss=0.8350, lr=0.005024, batch_cost=1.3566, reader_cost=0.0001 | ETA 14:01:48 2021-02-23 10:55:06 [INFO] [TRAIN] epoch=115, iter=42780/80000, loss=0.9926, lr=0.005023, batch_cost=1.3012, reader_cost=0.0001 | ETA 13:27:12 2021-02-23 10:55:21 [INFO] [TRAIN] epoch=116, iter=42790/80000, loss=0.8523, lr=0.005021, batch_cost=1.5081, reader_cost=0.0540 | ETA 15:35:16 2021-02-23 10:55:36 [INFO] [TRAIN] epoch=116, iter=42800/80000, loss=0.8295, lr=0.005020, batch_cost=1.4146, reader_cost=0.0001 | ETA 14:37:04 2021-02-23 10:55:50 [INFO] [TRAIN] epoch=116, iter=42810/80000, loss=0.8548, lr=0.005019, batch_cost=1.3982, reader_cost=0.0001 | ETA 14:26:40 2021-02-23 10:56:03 [INFO] [TRAIN] epoch=116, iter=42820/80000, loss=0.8346, lr=0.005018, batch_cost=1.3462, reader_cost=0.0001 | ETA 13:54:11 2021-02-23 10:56:17 [INFO] [TRAIN] epoch=116, iter=42830/80000, loss=0.8739, lr=0.005017, batch_cost=1.3751, reader_cost=0.0001 | ETA 14:11:51 2021-02-23 10:56:30 [INFO] [TRAIN] epoch=116, iter=42840/80000, loss=0.9314, lr=0.005015, batch_cost=1.3650, reader_cost=0.0001 | ETA 14:05:22 2021-02-23 10:56:44 [INFO] [TRAIN] epoch=116, iter=42850/80000, loss=0.9076, lr=0.005014, batch_cost=1.3752, reader_cost=0.0001 | ETA 14:11:27 2021-02-23 10:56:58 [INFO] [TRAIN] epoch=116, iter=42860/80000, loss=0.8053, lr=0.005013, batch_cost=1.3981, reader_cost=0.0001 | ETA 14:25:23 2021-02-23 10:57:12 [INFO] [TRAIN] epoch=116, iter=42870/80000, loss=0.8075, lr=0.005012, batch_cost=1.3789, reader_cost=0.0001 | ETA 14:13:20 2021-02-23 10:57:25 [INFO] [TRAIN] epoch=116, iter=42880/80000, loss=0.9012, lr=0.005010, batch_cost=1.3432, reader_cost=0.0001 | ETA 13:50:59 2021-02-23 10:57:39 [INFO] [TRAIN] epoch=116, iter=42890/80000, loss=0.8460, lr=0.005009, batch_cost=1.3506, reader_cost=0.0001 | ETA 13:55:19 2021-02-23 10:57:53 [INFO] [TRAIN] epoch=116, iter=42900/80000, loss=0.8856, lr=0.005008, batch_cost=1.3900, reader_cost=0.0001 | ETA 14:19:30 2021-02-23 10:58:06 [INFO] [TRAIN] epoch=116, iter=42910/80000, loss=0.8460, lr=0.005007, batch_cost=1.3643, reader_cost=0.0001 | ETA 14:03:20 2021-02-23 10:58:20 [INFO] [TRAIN] epoch=116, iter=42920/80000, loss=0.8177, lr=0.005006, batch_cost=1.3630, reader_cost=0.0001 | ETA 14:02:18 2021-02-23 10:58:34 [INFO] [TRAIN] epoch=116, iter=42930/80000, loss=0.9352, lr=0.005004, batch_cost=1.3769, reader_cost=0.0001 | ETA 14:10:41 2021-02-23 10:58:47 [INFO] [TRAIN] epoch=116, iter=42940/80000, loss=0.8842, lr=0.005003, batch_cost=1.3610, reader_cost=0.0001 | ETA 14:00:37 2021-02-23 10:59:01 [INFO] [TRAIN] epoch=116, iter=42950/80000, loss=0.9522, lr=0.005002, batch_cost=1.3541, reader_cost=0.0001 | ETA 13:56:08 2021-02-23 10:59:14 [INFO] [TRAIN] epoch=116, iter=42960/80000, loss=0.9207, lr=0.005001, batch_cost=1.3494, reader_cost=0.0001 | ETA 13:53:03 2021-02-23 10:59:28 [INFO] [TRAIN] epoch=116, iter=42970/80000, loss=0.9823, lr=0.005000, batch_cost=1.3702, reader_cost=0.0001 | ETA 14:05:37 2021-02-23 10:59:42 [INFO] [TRAIN] epoch=116, iter=42980/80000, loss=1.0262, lr=0.004998, batch_cost=1.3371, reader_cost=0.0001 | ETA 13:45:01 2021-02-23 10:59:55 [INFO] [TRAIN] epoch=116, iter=42990/80000, loss=0.8598, lr=0.004997, batch_cost=1.3364, reader_cost=0.0001 | ETA 13:44:19 2021-02-23 11:00:08 [INFO] [TRAIN] epoch=116, iter=43000/80000, loss=0.8279, lr=0.004996, batch_cost=1.3398, reader_cost=0.0001 | ETA 13:46:10 2021-02-23 11:00:08 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:18 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:07 - batch_cost: 0.2310 - reader cost: 0.1012  3/125 [..............................] - ETA: 1:00 - batch_cost: 0.2848 - reader cost: 0.1129 4/125 [..............................] - ETA: 58s - batch_cost: 0.3213 - reader cost: 0.1298  5/125 [>.............................] - ETA: 56s - batch_cost: 0.3415 - reader cost: 0.1385 6/125 [>.............................] - ETA: 54s - batch_cost: 0.3479 - reader cost: 0.1363 7/125 [>.............................] - ETA: 53s - batch_cost: 0.3613 - reader cost: 0.1444 8/125 [>.............................] - ETA: 52s - batch_cost: 0.3700 - reader cost: 0.1483 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3770 - reader cost: 0.1517 10/125 [=>............................] - ETA: 51s - batch_cost: 0.3868 - reader cost: 0.1582 11/125 [=>............................] - ETA: 51s - batch_cost: 0.3920 - reader cost: 0.1609 12/125 [=>............................] - ETA: 50s - batch_cost: 0.3966 - reader cost: 0.1640 13/125 [==>...........................] - ETA: 49s - batch_cost: 0.3955 - reader cost: 0.1616 14/125 [==>...........................] - ETA: 49s - batch_cost: 0.3995 - reader cost: 0.1643 15/125 [==>...........................] - ETA: 48s - batch_cost: 0.3980 - reader cost: 0.1616 16/125 [==>...........................] - ETA: 48s - batch_cost: 0.4011 - reader cost: 0.1639 17/125 [===>..........................] - ETA: 47s - batch_cost: 0.4011 - reader cost: 0.1629 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.3988 - reader cost: 0.1599 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3990 - reader cost: 0.1586 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4000 - reader cost: 0.1588 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4016 - reader cost: 0.1600 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4026 - reader cost: 0.1605 23/125 [====>.........................] - ETA: 44s - batch_cost: 0.4039 - reader cost: 0.1615 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4033 - reader cost: 0.1605 25/125 [=====>........................] - ETA: 43s - batch_cost: 0.4046 - reader cost: 0.1615 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4061 - reader cost: 0.1625 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4046 - reader cost: 0.1607 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4059 - reader cost: 0.1615 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4068 - reader cost: 0.1620 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4073 - reader cost: 0.1624 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4085 - reader cost: 0.1634 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4092 - reader cost: 0.1639 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4078 - reader cost: 0.1622 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4071 - reader cost: 0.1614 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4081 - reader cost: 0.1624 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4076 - reader cost: 0.1616 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4089 - reader cost: 0.1628 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4083 - reader cost: 0.1618 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4085 - reader cost: 0.1618 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4078 - reader cost: 0.1610 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4084 - reader cost: 0.1614 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4098 - reader cost: 0.1626 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4098 - reader cost: 0.1626 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4089 - reader cost: 0.1616 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4096 - reader cost: 0.1622 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4099 - reader cost: 0.1624 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4104 - reader cost: 0.1629 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4109 - reader cost: 0.1631 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4115 - reader cost: 0.1636 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4118 - reader cost: 0.1638 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4122 - reader cost: 0.1641 52/125 [===========>..................] - ETA: 31s - batch_cost: 0.4125 - reader cost: 0.1644 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4119 - reader cost: 0.1637 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4122 - reader cost: 0.1638 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4113 - reader cost: 0.1629 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4105 - reader cost: 0.1620 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4097 - reader cost: 0.1611 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4092 - reader cost: 0.1605 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4089 - reader cost: 0.1602 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4081 - reader cost: 0.1594 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4085 - reader cost: 0.1597 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4087 - reader cost: 0.1599 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4093 - reader cost: 0.1603 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4096 - reader cost: 0.1607 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4100 - reader cost: 0.1609 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4095 - reader cost: 0.1603 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4090 - reader cost: 0.1597 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4092 - reader cost: 0.1598 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4096 - reader cost: 0.1601 70/125 [===============>..............] - ETA: 22s - batch_cost: 0.4089 - reader cost: 0.1593 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4093 - reader cost: 0.1598 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4094 - reader cost: 0.1592 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4096 - reader cost: 0.1592 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4100 - reader cost: 0.1591 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4098 - reader cost: 0.1589 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4103 - reader cost: 0.1591 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4103 - reader cost: 0.1583 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4106 - reader cost: 0.1577 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4109 - reader cost: 0.1579 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4106 - reader cost: 0.1576 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4109 - reader cost: 0.1580 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4111 - reader cost: 0.1575 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4114 - reader cost: 0.1573 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4120 - reader cost: 0.1578 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4123 - reader cost: 0.1577 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4124 - reader cost: 0.1572 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4128 - reader cost: 0.1574 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4130 - reader cost: 0.1576 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4127 - reader cost: 0.1573 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4127 - reader cost: 0.1573 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4127 - reader cost: 0.1573 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4129 - reader cost: 0.1571 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4132 - reader cost: 0.1572 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4133 - reader cost: 0.1575 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4133 - reader cost: 0.1575 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4133 - reader cost: 0.1576 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4130 - reader cost: 0.1574 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4132 - reader cost: 0.1576 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4129 - reader cost: 0.1572 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4136 - reader cost: 0.1575 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4134 - reader cost: 0.1569 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4135 - reader cost: 0.1564  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4136 - reader cost: 0.1566 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4131 - reader cost: 0.1562 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4132 - reader cost: 0.1564 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4131 - reader cost: 0.1560 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4133 - reader cost: 0.1563 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4135 - reader cost: 0.1565 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4132 - reader cost: 0.1562 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4134 - reader cost: 0.1564 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4135 - reader cost: 0.1566 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4137 - reader cost: 0.1568 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4140 - reader cost: 0.1571 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4135 - reader cost: 0.1567 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4132 - reader cost: 0.1564 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4133 - reader cost: 0.1564 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4129 - reader cost: 0.1559 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4133 - reader cost: 0.1563 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4134 - reader cost: 0.1565 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4135 - reader cost: 0.1567 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4136 - reader cost: 0.1568 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4138 - reader cost: 0.1570 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4139 - reader cost: 0.1572 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4140 - reader cost: 0.1574 125/125 [==============================] - 52s 419ms/step - batch_cost: 0.4138 - reader cost: 0.1571 2021-02-23 11:01:01 [INFO] [EVAL] #Images=500 mIoU=0.7098 Acc=0.9532 Kappa=0.9392 2021-02-23 11:01:01 [INFO] [EVAL] Class IoU: [0.9761 0.8169 0.9157 0.3571 0.5819 0.6258 0.6989 0.7666 0.9095 0.6149 0.9442 0.8117 0.5953 0.9415 0.6936 0.6502 0.2535 0.5672 0.7658] 2021-02-23 11:01:01 [INFO] [EVAL] Class Acc: [0.9856 0.9085 0.9505 0.7932 0.7543 0.838 0.8605 0.9442 0.9408 0.7839 0.973 0.8726 0.7897 0.9706 0.8333 0.7377 0.9476 0.7712 0.8421] 2021-02-23 11:01:05 [INFO] [EVAL] The model with the best validation mIoU (0.7576) was saved at iter 31000. 2021-02-23 11:01:18 [INFO] [TRAIN] epoch=116, iter=43010/80000, loss=0.9156, lr=0.004995, batch_cost=1.3400, reader_cost=0.0001 | ETA 13:46:05 2021-02-23 11:01:32 [INFO] [TRAIN] epoch=116, iter=43020/80000, loss=0.8765, lr=0.004993, batch_cost=1.3477, reader_cost=0.0001 | ETA 13:50:37 2021-02-23 11:01:46 [INFO] [TRAIN] epoch=116, iter=43030/80000, loss=0.8655, lr=0.004992, batch_cost=1.3888, reader_cost=0.0001 | ETA 14:15:44 2021-02-23 11:01:59 [INFO] [TRAIN] epoch=116, iter=43040/80000, loss=0.9189, lr=0.004991, batch_cost=1.3610, reader_cost=0.0001 | ETA 13:58:23 2021-02-23 11:02:13 [INFO] [TRAIN] epoch=116, iter=43050/80000, loss=0.9590, lr=0.004990, batch_cost=1.3270, reader_cost=0.0001 | ETA 13:37:11 2021-02-23 11:02:26 [INFO] [TRAIN] epoch=116, iter=43060/80000, loss=0.9327, lr=0.004989, batch_cost=1.3612, reader_cost=0.0001 | ETA 13:58:03 2021-02-23 11:02:40 [INFO] [TRAIN] epoch=116, iter=43070/80000, loss=1.0410, lr=0.004987, batch_cost=1.3868, reader_cost=0.0001 | ETA 14:13:35 2021-02-23 11:02:54 [INFO] [TRAIN] epoch=116, iter=43080/80000, loss=0.8352, lr=0.004986, batch_cost=1.3880, reader_cost=0.0001 | ETA 14:14:04 2021-02-23 11:03:08 [INFO] [TRAIN] epoch=116, iter=43090/80000, loss=0.9648, lr=0.004985, batch_cost=1.3673, reader_cost=0.0001 | ETA 14:01:07 2021-02-23 11:03:21 [INFO] [TRAIN] epoch=116, iter=43100/80000, loss=0.8513, lr=0.004984, batch_cost=1.3585, reader_cost=0.0001 | ETA 13:55:26 2021-02-23 11:03:35 [INFO] [TRAIN] epoch=116, iter=43110/80000, loss=0.8917, lr=0.004983, batch_cost=1.3655, reader_cost=0.0001 | ETA 13:59:34 2021-02-23 11:03:48 [INFO] [TRAIN] epoch=116, iter=43120/80000, loss=0.9448, lr=0.004981, batch_cost=1.3581, reader_cost=0.0001 | ETA 13:54:48 2021-02-23 11:04:02 [INFO] [TRAIN] epoch=116, iter=43130/80000, loss=0.9686, lr=0.004980, batch_cost=1.3366, reader_cost=0.0001 | ETA 13:41:19 2021-02-23 11:04:15 [INFO] [TRAIN] epoch=116, iter=43140/80000, loss=0.9132, lr=0.004979, batch_cost=1.3421, reader_cost=0.0001 | ETA 13:44:29 2021-02-23 11:04:29 [INFO] [TRAIN] epoch=116, iter=43150/80000, loss=0.8241, lr=0.004978, batch_cost=1.3316, reader_cost=0.0001 | ETA 13:37:48 2021-02-23 11:04:43 [INFO] [TRAIN] epoch=117, iter=43160/80000, loss=0.9462, lr=0.004976, batch_cost=1.4742, reader_cost=0.0710 | ETA 15:05:08 2021-02-23 11:04:57 [INFO] [TRAIN] epoch=117, iter=43170/80000, loss=0.9095, lr=0.004975, batch_cost=1.3580, reader_cost=0.0001 | ETA 13:53:34 2021-02-23 11:05:11 [INFO] [TRAIN] epoch=117, iter=43180/80000, loss=0.8574, lr=0.004974, batch_cost=1.3770, reader_cost=0.0001 | ETA 14:04:59 2021-02-23 11:05:24 [INFO] [TRAIN] epoch=117, iter=43190/80000, loss=0.8359, lr=0.004973, batch_cost=1.3471, reader_cost=0.0001 | ETA 13:46:25 2021-02-23 11:05:38 [INFO] [TRAIN] epoch=117, iter=43200/80000, loss=0.8575, lr=0.004972, batch_cost=1.3529, reader_cost=0.0001 | ETA 13:49:46 2021-02-23 11:05:51 [INFO] [TRAIN] epoch=117, iter=43210/80000, loss=0.8754, lr=0.004970, batch_cost=1.3513, reader_cost=0.0001 | ETA 13:48:33 2021-02-23 11:06:05 [INFO] [TRAIN] epoch=117, iter=43220/80000, loss=0.8942, lr=0.004969, batch_cost=1.3463, reader_cost=0.0001 | ETA 13:45:16 2021-02-23 11:06:18 [INFO] [TRAIN] epoch=117, iter=43230/80000, loss=1.0642, lr=0.004968, batch_cost=1.3882, reader_cost=0.0001 | ETA 14:10:42 2021-02-23 11:06:32 [INFO] [TRAIN] epoch=117, iter=43240/80000, loss=0.8253, lr=0.004967, batch_cost=1.3560, reader_cost=0.0001 | ETA 13:50:47 2021-02-23 11:06:45 [INFO] [TRAIN] epoch=117, iter=43250/80000, loss=0.8873, lr=0.004965, batch_cost=1.3415, reader_cost=0.0001 | ETA 13:41:41 2021-02-23 11:06:59 [INFO] [TRAIN] epoch=117, iter=43260/80000, loss=0.8887, lr=0.004964, batch_cost=1.3914, reader_cost=0.0001 | ETA 14:12:01 2021-02-23 11:07:13 [INFO] [TRAIN] epoch=117, iter=43270/80000, loss=0.8393, lr=0.004963, batch_cost=1.3815, reader_cost=0.0001 | ETA 14:05:43 2021-02-23 11:07:27 [INFO] [TRAIN] epoch=117, iter=43280/80000, loss=0.8456, lr=0.004962, batch_cost=1.3840, reader_cost=0.0001 | ETA 14:06:59 2021-02-23 11:07:40 [INFO] [TRAIN] epoch=117, iter=43290/80000, loss=0.8888, lr=0.004961, batch_cost=1.3470, reader_cost=0.0001 | ETA 13:44:07 2021-02-23 11:07:54 [INFO] [TRAIN] epoch=117, iter=43300/80000, loss=0.8138, lr=0.004959, batch_cost=1.3501, reader_cost=0.0001 | ETA 13:45:47 2021-02-23 11:08:08 [INFO] [TRAIN] epoch=117, iter=43310/80000, loss=0.9460, lr=0.004958, batch_cost=1.4047, reader_cost=0.0001 | ETA 14:18:57 2021-02-23 11:08:22 [INFO] [TRAIN] epoch=117, iter=43320/80000, loss=0.8696, lr=0.004957, batch_cost=1.3908, reader_cost=0.0001 | ETA 14:10:14 2021-02-23 11:08:36 [INFO] [TRAIN] epoch=117, iter=43330/80000, loss=0.8887, lr=0.004956, batch_cost=1.3917, reader_cost=0.0001 | ETA 14:10:33 2021-02-23 11:08:50 [INFO] [TRAIN] epoch=117, iter=43340/80000, loss=0.8627, lr=0.004955, batch_cost=1.3730, reader_cost=0.0001 | ETA 13:58:52 2021-02-23 11:09:03 [INFO] [TRAIN] epoch=117, iter=43350/80000, loss=0.8736, lr=0.004953, batch_cost=1.3728, reader_cost=0.0001 | ETA 13:58:33 2021-02-23 11:09:17 [INFO] [TRAIN] epoch=117, iter=43360/80000, loss=0.8105, lr=0.004952, batch_cost=1.3990, reader_cost=0.0001 | ETA 14:14:18 2021-02-23 11:09:31 [INFO] [TRAIN] epoch=117, iter=43370/80000, loss=0.8459, lr=0.004951, batch_cost=1.3611, reader_cost=0.0001 | ETA 13:50:58 2021-02-23 11:09:45 [INFO] [TRAIN] epoch=117, iter=43380/80000, loss=0.9583, lr=0.004950, batch_cost=1.3685, reader_cost=0.0001 | ETA 13:55:13 2021-02-23 11:09:58 [INFO] [TRAIN] epoch=117, iter=43390/80000, loss=0.8479, lr=0.004948, batch_cost=1.3750, reader_cost=0.0001 | ETA 13:59:00 2021-02-23 11:10:12 [INFO] [TRAIN] epoch=117, iter=43400/80000, loss=1.0356, lr=0.004947, batch_cost=1.3565, reader_cost=0.0001 | ETA 13:47:28 2021-02-23 11:10:26 [INFO] [TRAIN] epoch=117, iter=43410/80000, loss=0.8617, lr=0.004946, batch_cost=1.3600, reader_cost=0.0001 | ETA 13:49:20 2021-02-23 11:10:40 [INFO] [TRAIN] epoch=117, iter=43420/80000, loss=0.8789, lr=0.004945, batch_cost=1.4125, reader_cost=0.0001 | ETA 14:21:10 2021-02-23 11:10:53 [INFO] [TRAIN] epoch=117, iter=43430/80000, loss=0.8215, lr=0.004944, batch_cost=1.3745, reader_cost=0.0001 | ETA 13:57:46 2021-02-23 11:11:07 [INFO] [TRAIN] epoch=117, iter=43440/80000, loss=0.8691, lr=0.004942, batch_cost=1.3498, reader_cost=0.0001 | ETA 13:42:28 2021-02-23 11:11:20 [INFO] [TRAIN] epoch=117, iter=43450/80000, loss=0.8631, lr=0.004941, batch_cost=1.3327, reader_cost=0.0001 | ETA 13:31:51 2021-02-23 11:11:34 [INFO] [TRAIN] epoch=117, iter=43460/80000, loss=0.9226, lr=0.004940, batch_cost=1.3409, reader_cost=0.0001 | ETA 13:36:37 2021-02-23 11:11:47 [INFO] [TRAIN] epoch=117, iter=43470/80000, loss=0.8800, lr=0.004939, batch_cost=1.3722, reader_cost=0.0001 | ETA 13:55:27 2021-02-23 11:12:01 [INFO] [TRAIN] epoch=117, iter=43480/80000, loss=0.9064, lr=0.004938, batch_cost=1.3935, reader_cost=0.0001 | ETA 14:08:11 2021-02-23 11:12:15 [INFO] [TRAIN] epoch=117, iter=43490/80000, loss=0.8619, lr=0.004936, batch_cost=1.3666, reader_cost=0.0001 | ETA 13:51:35 2021-02-23 11:12:28 [INFO] [TRAIN] epoch=117, iter=43500/80000, loss=0.8371, lr=0.004935, batch_cost=1.3516, reader_cost=0.0001 | ETA 13:42:14 2021-02-23 11:12:42 [INFO] [TRAIN] epoch=117, iter=43510/80000, loss=0.8641, lr=0.004934, batch_cost=1.3755, reader_cost=0.0001 | ETA 13:56:30 2021-02-23 11:12:56 [INFO] [TRAIN] epoch=117, iter=43520/80000, loss=0.8644, lr=0.004933, batch_cost=1.3572, reader_cost=0.0001 | ETA 13:45:09 2021-02-23 11:13:10 [INFO] [TRAIN] epoch=118, iter=43530/80000, loss=0.9547, lr=0.004931, batch_cost=1.4378, reader_cost=0.0937 | ETA 14:33:56 2021-02-23 11:13:24 [INFO] [TRAIN] epoch=118, iter=43540/80000, loss=0.8439, lr=0.004930, batch_cost=1.3820, reader_cost=0.0001 | ETA 13:59:49 2021-02-23 11:13:38 [INFO] [TRAIN] epoch=118, iter=43550/80000, loss=0.8787, lr=0.004929, batch_cost=1.4194, reader_cost=0.0001 | ETA 14:22:16 2021-02-23 11:13:52 [INFO] [TRAIN] epoch=118, iter=43560/80000, loss=0.8990, lr=0.004928, batch_cost=1.3502, reader_cost=0.0001 | ETA 13:40:01 2021-02-23 11:14:06 [INFO] [TRAIN] epoch=118, iter=43570/80000, loss=0.8853, lr=0.004927, batch_cost=1.3831, reader_cost=0.0001 | ETA 13:59:46 2021-02-23 11:14:19 [INFO] [TRAIN] epoch=118, iter=43580/80000, loss=0.8612, lr=0.004925, batch_cost=1.3547, reader_cost=0.0001 | ETA 13:42:19 2021-02-23 11:14:33 [INFO] [TRAIN] epoch=118, iter=43590/80000, loss=0.8608, lr=0.004924, batch_cost=1.3877, reader_cost=0.0001 | ETA 14:02:06 2021-02-23 11:14:47 [INFO] [TRAIN] epoch=118, iter=43600/80000, loss=0.8515, lr=0.004923, batch_cost=1.3745, reader_cost=0.0001 | ETA 13:53:51 2021-02-23 11:15:01 [INFO] [TRAIN] epoch=118, iter=43610/80000, loss=0.8537, lr=0.004922, batch_cost=1.3875, reader_cost=0.0001 | ETA 14:01:30 2021-02-23 11:15:14 [INFO] [TRAIN] epoch=118, iter=43620/80000, loss=0.8366, lr=0.004920, batch_cost=1.3435, reader_cost=0.0001 | ETA 13:34:37 2021-02-23 11:15:28 [INFO] [TRAIN] epoch=118, iter=43630/80000, loss=0.8632, lr=0.004919, batch_cost=1.3508, reader_cost=0.0001 | ETA 13:38:48 2021-02-23 11:15:41 [INFO] [TRAIN] epoch=118, iter=43640/80000, loss=0.8469, lr=0.004918, batch_cost=1.3349, reader_cost=0.0001 | ETA 13:28:58 2021-02-23 11:15:55 [INFO] [TRAIN] epoch=118, iter=43650/80000, loss=0.8471, lr=0.004917, batch_cost=1.3825, reader_cost=0.0001 | ETA 13:57:35 2021-02-23 11:16:08 [INFO] [TRAIN] epoch=118, iter=43660/80000, loss=0.7952, lr=0.004916, batch_cost=1.3502, reader_cost=0.0001 | ETA 13:37:46 2021-02-23 11:16:22 [INFO] [TRAIN] epoch=118, iter=43670/80000, loss=0.8411, lr=0.004914, batch_cost=1.3423, reader_cost=0.0001 | ETA 13:32:47 2021-02-23 11:16:35 [INFO] [TRAIN] epoch=118, iter=43680/80000, loss=0.8427, lr=0.004913, batch_cost=1.3830, reader_cost=0.0001 | ETA 13:57:11 2021-02-23 11:16:49 [INFO] [TRAIN] epoch=118, iter=43690/80000, loss=0.8924, lr=0.004912, batch_cost=1.3568, reader_cost=0.0001 | ETA 13:41:04 2021-02-23 11:17:02 [INFO] [TRAIN] epoch=118, iter=43700/80000, loss=0.8547, lr=0.004911, batch_cost=1.3444, reader_cost=0.0001 | ETA 13:33:22 2021-02-23 11:17:16 [INFO] [TRAIN] epoch=118, iter=43710/80000, loss=0.9714, lr=0.004910, batch_cost=1.3548, reader_cost=0.0001 | ETA 13:39:24 2021-02-23 11:17:30 [INFO] [TRAIN] epoch=118, iter=43720/80000, loss=0.9124, lr=0.004908, batch_cost=1.3741, reader_cost=0.0001 | ETA 13:50:52 2021-02-23 11:17:43 [INFO] [TRAIN] epoch=118, iter=43730/80000, loss=0.8375, lr=0.004907, batch_cost=1.3710, reader_cost=0.0001 | ETA 13:48:47 2021-02-23 11:17:57 [INFO] [TRAIN] epoch=118, iter=43740/80000, loss=0.9151, lr=0.004906, batch_cost=1.3584, reader_cost=0.0001 | ETA 13:40:56 2021-02-23 11:18:11 [INFO] [TRAIN] epoch=118, iter=43750/80000, loss=0.9042, lr=0.004905, batch_cost=1.3778, reader_cost=0.0001 | ETA 13:52:24 2021-02-23 11:18:25 [INFO] [TRAIN] epoch=118, iter=43760/80000, loss=0.8542, lr=0.004903, batch_cost=1.3712, reader_cost=0.0001 | ETA 13:48:10 2021-02-23 11:18:38 [INFO] [TRAIN] epoch=118, iter=43770/80000, loss=0.9702, lr=0.004902, batch_cost=1.3689, reader_cost=0.0001 | ETA 13:46:35 2021-02-23 11:18:52 [INFO] [TRAIN] epoch=118, iter=43780/80000, loss=0.9191, lr=0.004901, batch_cost=1.3776, reader_cost=0.0001 | ETA 13:51:38 2021-02-23 11:19:06 [INFO] [TRAIN] epoch=118, iter=43790/80000, loss=0.8318, lr=0.004900, batch_cost=1.3599, reader_cost=0.0001 | ETA 13:40:41 2021-02-23 11:19:19 [INFO] [TRAIN] epoch=118, iter=43800/80000, loss=0.9716, lr=0.004899, batch_cost=1.3640, reader_cost=0.0001 | ETA 13:42:56 2021-02-23 11:19:33 [INFO] [TRAIN] epoch=118, iter=43810/80000, loss=0.8709, lr=0.004897, batch_cost=1.3296, reader_cost=0.0001 | ETA 13:21:57 2021-02-23 11:19:46 [INFO] [TRAIN] epoch=118, iter=43820/80000, loss=0.9969, lr=0.004896, batch_cost=1.3488, reader_cost=0.0001 | ETA 13:33:19 2021-02-23 11:19:59 [INFO] [TRAIN] epoch=118, iter=43830/80000, loss=0.9166, lr=0.004895, batch_cost=1.3392, reader_cost=0.0001 | ETA 13:27:20 2021-02-23 11:20:13 [INFO] [TRAIN] epoch=118, iter=43840/80000, loss=0.9483, lr=0.004894, batch_cost=1.3676, reader_cost=0.0001 | ETA 13:44:13 2021-02-23 11:20:27 [INFO] [TRAIN] epoch=118, iter=43850/80000, loss=0.9332, lr=0.004892, batch_cost=1.3716, reader_cost=0.0001 | ETA 13:46:25 2021-02-23 11:20:40 [INFO] [TRAIN] epoch=118, iter=43860/80000, loss=0.8493, lr=0.004891, batch_cost=1.3634, reader_cost=0.0001 | ETA 13:41:14 2021-02-23 11:20:54 [INFO] [TRAIN] epoch=118, iter=43870/80000, loss=0.7782, lr=0.004890, batch_cost=1.3709, reader_cost=0.0001 | ETA 13:45:29 2021-02-23 11:21:08 [INFO] [TRAIN] epoch=118, iter=43880/80000, loss=0.7803, lr=0.004889, batch_cost=1.3420, reader_cost=0.0001 | ETA 13:27:53 2021-02-23 11:21:21 [INFO] [TRAIN] epoch=118, iter=43890/80000, loss=0.8858, lr=0.004888, batch_cost=1.3365, reader_cost=0.0001 | ETA 13:24:19 2021-02-23 11:21:36 [INFO] [TRAIN] epoch=119, iter=43900/80000, loss=0.8701, lr=0.004886, batch_cost=1.4805, reader_cost=0.0668 | ETA 14:50:47 2021-02-23 11:21:49 [INFO] [TRAIN] epoch=119, iter=43910/80000, loss=0.7936, lr=0.004885, batch_cost=1.3412, reader_cost=0.0001 | ETA 13:26:45 2021-02-23 11:22:03 [INFO] [TRAIN] epoch=119, iter=43920/80000, loss=0.8346, lr=0.004884, batch_cost=1.3715, reader_cost=0.0001 | ETA 13:44:43 2021-02-23 11:22:17 [INFO] [TRAIN] epoch=119, iter=43930/80000, loss=0.9265, lr=0.004883, batch_cost=1.3701, reader_cost=0.0001 | ETA 13:43:41 2021-02-23 11:22:30 [INFO] [TRAIN] epoch=119, iter=43940/80000, loss=1.0132, lr=0.004881, batch_cost=1.3591, reader_cost=0.0001 | ETA 13:36:47 2021-02-23 11:22:44 [INFO] [TRAIN] epoch=119, iter=43950/80000, loss=0.8406, lr=0.004880, batch_cost=1.3348, reader_cost=0.0001 | ETA 13:22:00 2021-02-23 11:22:57 [INFO] [TRAIN] epoch=119, iter=43960/80000, loss=0.8826, lr=0.004879, batch_cost=1.3806, reader_cost=0.0001 | ETA 13:49:17 2021-02-23 11:23:11 [INFO] [TRAIN] epoch=119, iter=43970/80000, loss=0.8776, lr=0.004878, batch_cost=1.3419, reader_cost=0.0001 | ETA 13:25:49 2021-02-23 11:23:24 [INFO] [TRAIN] epoch=119, iter=43980/80000, loss=0.8837, lr=0.004877, batch_cost=1.3597, reader_cost=0.0001 | ETA 13:36:15 2021-02-23 11:23:38 [INFO] [TRAIN] epoch=119, iter=43990/80000, loss=0.9185, lr=0.004875, batch_cost=1.3585, reader_cost=0.0001 | ETA 13:35:21 2021-02-23 11:23:52 [INFO] [TRAIN] epoch=119, iter=44000/80000, loss=0.8765, lr=0.004874, batch_cost=1.3732, reader_cost=0.0001 | ETA 13:43:54 2021-02-23 11:23:52 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:05 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 56s - batch_cost: 0.1959 - reader cost: 0.0669  3/125 [..............................] - ETA: 52s - batch_cost: 0.2559 - reader cost: 0.0807 4/125 [..............................] - ETA: 51s - batch_cost: 0.2906 - reader cost: 0.0968 5/125 [>.............................] - ETA: 51s - batch_cost: 0.3202 - reader cost: 0.1152 6/125 [>.............................] - ETA: 51s - batch_cost: 0.3439 - reader cost: 0.1317 7/125 [>.............................] - ETA: 50s - batch_cost: 0.3565 - reader cost: 0.1371 8/125 [>.............................] - ETA: 50s - batch_cost: 0.3641 - reader cost: 0.1412 9/125 [=>............................] - ETA: 49s - batch_cost: 0.3675 - reader cost: 0.1410 10/125 [=>............................] - ETA: 49s - batch_cost: 0.3734 - reader cost: 0.1447 11/125 [=>............................] - ETA: 48s - batch_cost: 0.3798 - reader cost: 0.1478 12/125 [=>............................] - ETA: 47s - batch_cost: 0.3795 - reader cost: 0.1462 13/125 [==>...........................] - ETA: 47s - batch_cost: 0.3833 - reader cost: 0.1439 14/125 [==>...........................] - ETA: 46s - batch_cost: 0.3842 - reader cost: 0.1396 15/125 [==>...........................] - ETA: 46s - batch_cost: 0.3866 - reader cost: 0.1377 16/125 [==>...........................] - ETA: 46s - batch_cost: 0.3897 - reader cost: 0.1409 17/125 [===>..........................] - ETA: 45s - batch_cost: 0.3887 - reader cost: 0.1399 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3924 - reader cost: 0.1437 19/125 [===>..........................] - ETA: 44s - batch_cost: 0.3917 - reader cost: 0.1430 20/125 [===>..........................] - ETA: 43s - batch_cost: 0.3914 - reader cost: 0.1424 21/125 [====>.........................] - ETA: 43s - batch_cost: 0.3930 - reader cost: 0.1440 22/125 [====>.........................] - ETA: 43s - batch_cost: 0.3958 - reader cost: 0.1465 23/125 [====>.........................] - ETA: 42s - batch_cost: 0.3956 - reader cost: 0.1464 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.3971 - reader cost: 0.1479 25/125 [=====>........................] - ETA: 41s - batch_cost: 0.3962 - reader cost: 0.1470 26/125 [=====>........................] - ETA: 41s - batch_cost: 0.3976 - reader cost: 0.1485 27/125 [=====>........................] - ETA: 40s - batch_cost: 0.3985 - reader cost: 0.1494 28/125 [=====>........................] - ETA: 40s - batch_cost: 0.4002 - reader cost: 0.1505 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4007 - reader cost: 0.1509 30/125 [======>.......................] - ETA: 39s - batch_cost: 0.4018 - reader cost: 0.1520 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.4009 - reader cost: 0.1511 32/125 [======>.......................] - ETA: 38s - batch_cost: 0.4017 - reader cost: 0.1519 33/125 [======>.......................] - ETA: 38s - batch_cost: 0.4013 - reader cost: 0.1515 34/125 [=======>......................] - ETA: 37s - batch_cost: 0.4015 - reader cost: 0.1517 35/125 [=======>......................] - ETA: 37s - batch_cost: 0.4017 - reader cost: 0.1516 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4025 - reader cost: 0.1525 37/125 [=======>......................] - ETA: 36s - batch_cost: 0.4032 - reader cost: 0.1530 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4038 - reader cost: 0.1536 39/125 [========>.....................] - ETA: 35s - batch_cost: 0.4031 - reader cost: 0.1529 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4040 - reader cost: 0.1537 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4047 - reader cost: 0.1544 42/125 [=========>....................] - ETA: 34s - batch_cost: 0.4049 - reader cost: 0.1547 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4054 - reader cost: 0.1552 44/125 [=========>....................] - ETA: 33s - batch_cost: 0.4046 - reader cost: 0.1544 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4049 - reader cost: 0.1547 46/125 [==========>...................] - ETA: 32s - batch_cost: 0.4054 - reader cost: 0.1550 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4060 - reader cost: 0.1555 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4065 - reader cost: 0.1558 49/125 [==========>...................] - ETA: 31s - batch_cost: 0.4058 - reader cost: 0.1551 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4060 - reader cost: 0.1553 51/125 [===========>..................] - ETA: 30s - batch_cost: 0.4059 - reader cost: 0.1551 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4062 - reader cost: 0.1554 53/125 [===========>..................] - ETA: 29s - batch_cost: 0.4062 - reader cost: 0.1549 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4067 - reader cost: 0.1547 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4065 - reader cost: 0.1533 56/125 [============>.................] - ETA: 28s - batch_cost: 0.4060 - reader cost: 0.1524 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4061 - reader cost: 0.1518 58/125 [============>.................] - ETA: 27s - batch_cost: 0.4067 - reader cost: 0.1524 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4069 - reader cost: 0.1526 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4069 - reader cost: 0.1524 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4069 - reader cost: 0.1525 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4063 - reader cost: 0.1518 63/125 [==============>...............] - ETA: 25s - batch_cost: 0.4057 - reader cost: 0.1513 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4059 - reader cost: 0.1517 65/125 [==============>...............] - ETA: 24s - batch_cost: 0.4061 - reader cost: 0.1511 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4063 - reader cost: 0.1513 67/125 [===============>..............] - ETA: 23s - batch_cost: 0.4059 - reader cost: 0.1507 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4062 - reader cost: 0.1511 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4056 - reader cost: 0.1505 70/125 [===============>..............] - ETA: 22s - batch_cost: 0.4057 - reader cost: 0.1504 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4063 - reader cost: 0.1510 72/125 [================>.............] - ETA: 21s - batch_cost: 0.4068 - reader cost: 0.1508 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4070 - reader cost: 0.1511 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4079 - reader cost: 0.1515 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4080 - reader cost: 0.1517 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4087 - reader cost: 0.1511 77/125 [=================>............] - ETA: 19s - batch_cost: 0.4086 - reader cost: 0.1497 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4087 - reader cost: 0.1489 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4085 - reader cost: 0.1484 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4090 - reader cost: 0.1489 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4084 - reader cost: 0.1484 82/125 [==================>...........] - ETA: 17s - batch_cost: 0.4087 - reader cost: 0.1489 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4088 - reader cost: 0.1490 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4090 - reader cost: 0.1493 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4092 - reader cost: 0.1496 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4095 - reader cost: 0.1499 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4098 - reader cost: 0.1502 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4101 - reader cost: 0.1506 89/125 [====================>.........] - ETA: 14s - batch_cost: 0.4104 - reader cost: 0.1509 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4108 - reader cost: 0.1512 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4109 - reader cost: 0.1514 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4113 - reader cost: 0.1519 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4114 - reader cost: 0.1521 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4113 - reader cost: 0.1520 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4114 - reader cost: 0.1523 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4117 - reader cost: 0.1526 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4118 - reader cost: 0.1526 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4120 - reader cost: 0.1529 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4118 - reader cost: 0.1528 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4115 - reader cost: 0.1526 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4115 - reader cost: 0.1527 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4112 - reader cost: 0.1525  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4107 - reader cost: 0.1521 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4108 - reader cost: 0.1521 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4111 - reader cost: 0.1519 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4108 - reader cost: 0.1513 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4111 - reader cost: 0.1515 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4112 - reader cost: 0.1514 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4114 - reader cost: 0.1517 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4115 - reader cost: 0.1519 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4112 - reader cost: 0.1517 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4110 - reader cost: 0.1516 113/125 [==========================>...] - ETA: 4s - batch_cost: 0.4111 - reader cost: 0.1518 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4111 - reader cost: 0.1514 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4115 - reader cost: 0.1509 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4113 - reader cost: 0.1499 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4117 - reader cost: 0.1493 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4119 - reader cost: 0.1484 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4116 - reader cost: 0.1474 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4117 - reader cost: 0.1471 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4120 - reader cost: 0.1473 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4121 - reader cost: 0.1476 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4123 - reader cost: 0.1479 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4124 - reader cost: 0.1481 125/125 [==============================] - 52s 417ms/step - batch_cost: 0.4125 - reader cost: 0.1484 2021-02-23 11:24:44 [INFO] [EVAL] #Images=500 mIoU=0.7816 Acc=0.9592 Kappa=0.9470 2021-02-23 11:24:44 [INFO] [EVAL] Class IoU: [0.978 0.8254 0.9226 0.4735 0.6181 0.6499 0.7321 0.8039 0.925 0.6224 0.9457 0.83 0.6216 0.9502 0.8038 0.868 0.8176 0.6818 0.7811] 2021-02-23 11:24:44 [INFO] [EVAL] Class Acc: [0.9855 0.9301 0.9533 0.7814 0.772 0.8554 0.8543 0.896 0.9534 0.8676 0.9664 0.9023 0.8371 0.969 0.9505 0.9439 0.9268 0.8502 0.8446] 2021-02-23 11:24:50 [INFO] [EVAL] The model with the best validation mIoU (0.7816) was saved at iter 44000. 2021-02-23 11:25:04 [INFO] [TRAIN] epoch=119, iter=44010/80000, loss=0.8039, lr=0.004873, batch_cost=1.3592, reader_cost=0.0001 | ETA 13:35:18 2021-02-23 11:25:17 [INFO] [TRAIN] epoch=119, iter=44020/80000, loss=0.8368, lr=0.004872, batch_cost=1.3548, reader_cost=0.0001 | ETA 13:32:24 2021-02-23 11:25:31 [INFO] [TRAIN] epoch=119, iter=44030/80000, loss=0.8698, lr=0.004871, batch_cost=1.3432, reader_cost=0.0001 | ETA 13:25:13 2021-02-23 11:25:44 [INFO] [TRAIN] epoch=119, iter=44040/80000, loss=0.8840, lr=0.004869, batch_cost=1.3634, reader_cost=0.0001 | ETA 13:37:06 2021-02-23 11:25:58 [INFO] [TRAIN] epoch=119, iter=44050/80000, loss=0.8420, lr=0.004868, batch_cost=1.3334, reader_cost=0.0001 | ETA 13:18:56 2021-02-23 11:26:11 [INFO] [TRAIN] epoch=119, iter=44060/80000, loss=0.8261, lr=0.004867, batch_cost=1.3718, reader_cost=0.0001 | ETA 13:41:43 2021-02-23 11:26:25 [INFO] [TRAIN] epoch=119, iter=44070/80000, loss=0.9019, lr=0.004866, batch_cost=1.3341, reader_cost=0.0001 | ETA 13:18:54 2021-02-23 11:26:38 [INFO] [TRAIN] epoch=119, iter=44080/80000, loss=0.8245, lr=0.004864, batch_cost=1.3538, reader_cost=0.0001 | ETA 13:30:28 2021-02-23 11:26:52 [INFO] [TRAIN] epoch=119, iter=44090/80000, loss=0.7949, lr=0.004863, batch_cost=1.3437, reader_cost=0.0001 | ETA 13:24:13 2021-02-23 11:27:06 [INFO] [TRAIN] epoch=119, iter=44100/80000, loss=0.8295, lr=0.004862, batch_cost=1.3874, reader_cost=0.0001 | ETA 13:50:06 2021-02-23 11:27:19 [INFO] [TRAIN] epoch=119, iter=44110/80000, loss=0.9221, lr=0.004861, batch_cost=1.3610, reader_cost=0.0001 | ETA 13:34:05 2021-02-23 11:27:33 [INFO] [TRAIN] epoch=119, iter=44120/80000, loss=0.8143, lr=0.004860, batch_cost=1.3512, reader_cost=0.0001 | ETA 13:27:59 2021-02-23 11:27:46 [INFO] [TRAIN] epoch=119, iter=44130/80000, loss=0.8301, lr=0.004858, batch_cost=1.3644, reader_cost=0.0001 | ETA 13:35:41 2021-02-23 11:28:00 [INFO] [TRAIN] epoch=119, iter=44140/80000, loss=0.8809, lr=0.004857, batch_cost=1.3615, reader_cost=0.0001 | ETA 13:33:42 2021-02-23 11:28:14 [INFO] [TRAIN] epoch=119, iter=44150/80000, loss=0.9745, lr=0.004856, batch_cost=1.3672, reader_cost=0.0001 | ETA 13:36:54 2021-02-23 11:28:27 [INFO] [TRAIN] epoch=119, iter=44160/80000, loss=0.8919, lr=0.004855, batch_cost=1.3557, reader_cost=0.0001 | ETA 13:29:48 2021-02-23 11:28:41 [INFO] [TRAIN] epoch=119, iter=44170/80000, loss=0.9799, lr=0.004853, batch_cost=1.3433, reader_cost=0.0001 | ETA 13:22:08 2021-02-23 11:28:54 [INFO] [TRAIN] epoch=119, iter=44180/80000, loss=0.8362, lr=0.004852, batch_cost=1.3672, reader_cost=0.0001 | ETA 13:36:14 2021-02-23 11:29:08 [INFO] [TRAIN] epoch=119, iter=44190/80000, loss=0.8834, lr=0.004851, batch_cost=1.3435, reader_cost=0.0001 | ETA 13:21:50 2021-02-23 11:29:21 [INFO] [TRAIN] epoch=119, iter=44200/80000, loss=0.9267, lr=0.004850, batch_cost=1.3617, reader_cost=0.0001 | ETA 13:32:27 2021-02-23 11:29:35 [INFO] [TRAIN] epoch=119, iter=44210/80000, loss=0.8919, lr=0.004849, batch_cost=1.3582, reader_cost=0.0001 | ETA 13:30:08 2021-02-23 11:29:48 [INFO] [TRAIN] epoch=119, iter=44220/80000, loss=0.9382, lr=0.004847, batch_cost=1.3516, reader_cost=0.0001 | ETA 13:25:58 2021-02-23 11:30:02 [INFO] [TRAIN] epoch=119, iter=44230/80000, loss=0.9653, lr=0.004846, batch_cost=1.3490, reader_cost=0.0001 | ETA 13:24:15 2021-02-23 11:30:16 [INFO] [TRAIN] epoch=119, iter=44240/80000, loss=0.8980, lr=0.004845, batch_cost=1.3892, reader_cost=0.0001 | ETA 13:47:58 2021-02-23 11:30:29 [INFO] [TRAIN] epoch=119, iter=44250/80000, loss=0.8827, lr=0.004844, batch_cost=1.3561, reader_cost=0.0001 | ETA 13:28:01 2021-02-23 11:30:43 [INFO] [TRAIN] epoch=119, iter=44260/80000, loss=0.9323, lr=0.004842, batch_cost=1.3447, reader_cost=0.0001 | ETA 13:20:57 2021-02-23 11:30:57 [INFO] [TRAIN] epoch=120, iter=44270/80000, loss=0.8494, lr=0.004841, batch_cost=1.3866, reader_cost=0.0708 | ETA 13:45:42 2021-02-23 11:31:10 [INFO] [TRAIN] epoch=120, iter=44280/80000, loss=0.8969, lr=0.004840, batch_cost=1.3659, reader_cost=0.0001 | ETA 13:33:11 2021-02-23 11:31:24 [INFO] [TRAIN] epoch=120, iter=44290/80000, loss=0.8303, lr=0.004839, batch_cost=1.3657, reader_cost=0.0001 | ETA 13:32:50 2021-02-23 11:31:38 [INFO] [TRAIN] epoch=120, iter=44300/80000, loss=0.7709, lr=0.004838, batch_cost=1.3491, reader_cost=0.0001 | ETA 13:22:42 2021-02-23 11:31:51 [INFO] [TRAIN] epoch=120, iter=44310/80000, loss=0.8737, lr=0.004836, batch_cost=1.3508, reader_cost=0.0001 | ETA 13:23:29 2021-02-23 11:32:05 [INFO] [TRAIN] epoch=120, iter=44320/80000, loss=0.8591, lr=0.004835, batch_cost=1.3538, reader_cost=0.0001 | ETA 13:25:03 2021-02-23 11:32:18 [INFO] [TRAIN] epoch=120, iter=44330/80000, loss=0.8393, lr=0.004834, batch_cost=1.3537, reader_cost=0.0001 | ETA 13:24:46 2021-02-23 11:32:31 [INFO] [TRAIN] epoch=120, iter=44340/80000, loss=0.8706, lr=0.004833, batch_cost=1.3358, reader_cost=0.0001 | ETA 13:13:53 2021-02-23 11:32:45 [INFO] [TRAIN] epoch=120, iter=44350/80000, loss=0.8741, lr=0.004832, batch_cost=1.3614, reader_cost=0.0001 | ETA 13:28:54 2021-02-23 11:32:58 [INFO] [TRAIN] epoch=120, iter=44360/80000, loss=0.8578, lr=0.004830, batch_cost=1.3391, reader_cost=0.0001 | ETA 13:15:27 2021-02-23 11:33:12 [INFO] [TRAIN] epoch=120, iter=44370/80000, loss=0.9491, lr=0.004829, batch_cost=1.3536, reader_cost=0.0001 | ETA 13:23:47 2021-02-23 11:33:26 [INFO] [TRAIN] epoch=120, iter=44380/80000, loss=0.9301, lr=0.004828, batch_cost=1.3829, reader_cost=0.0001 | ETA 13:40:58 2021-02-23 11:33:40 [INFO] [TRAIN] epoch=120, iter=44390/80000, loss=0.8653, lr=0.004827, batch_cost=1.3874, reader_cost=0.0001 | ETA 13:43:25 2021-02-23 11:33:53 [INFO] [TRAIN] epoch=120, iter=44400/80000, loss=0.9267, lr=0.004825, batch_cost=1.3624, reader_cost=0.0001 | ETA 13:28:20 2021-02-23 11:34:07 [INFO] [TRAIN] epoch=120, iter=44410/80000, loss=0.9642, lr=0.004824, batch_cost=1.3531, reader_cost=0.0001 | ETA 13:22:36 2021-02-23 11:34:20 [INFO] [TRAIN] epoch=120, iter=44420/80000, loss=0.8323, lr=0.004823, batch_cost=1.3488, reader_cost=0.0001 | ETA 13:19:49 2021-02-23 11:34:34 [INFO] [TRAIN] epoch=120, iter=44430/80000, loss=0.9098, lr=0.004822, batch_cost=1.3454, reader_cost=0.0001 | ETA 13:17:34 2021-02-23 11:34:47 [INFO] [TRAIN] epoch=120, iter=44440/80000, loss=0.8986, lr=0.004821, batch_cost=1.3565, reader_cost=0.0001 | ETA 13:23:57 2021-02-23 11:35:01 [INFO] [TRAIN] epoch=120, iter=44450/80000, loss=0.9662, lr=0.004819, batch_cost=1.3573, reader_cost=0.0001 | ETA 13:24:10 2021-02-23 11:35:15 [INFO] [TRAIN] epoch=120, iter=44460/80000, loss=0.7900, lr=0.004818, batch_cost=1.3609, reader_cost=0.0001 | ETA 13:26:05 2021-02-23 11:35:28 [INFO] [TRAIN] epoch=120, iter=44470/80000, loss=0.9404, lr=0.004817, batch_cost=1.3475, reader_cost=0.0001 | ETA 13:17:55 2021-02-23 11:35:41 [INFO] [TRAIN] epoch=120, iter=44480/80000, loss=0.9325, lr=0.004816, batch_cost=1.3430, reader_cost=0.0001 | ETA 13:15:03 2021-02-23 11:35:55 [INFO] [TRAIN] epoch=120, iter=44490/80000, loss=0.9130, lr=0.004814, batch_cost=1.3574, reader_cost=0.0001 | ETA 13:23:19 2021-02-23 11:36:09 [INFO] [TRAIN] epoch=120, iter=44500/80000, loss=0.8047, lr=0.004813, batch_cost=1.3529, reader_cost=0.0001 | ETA 13:20:26 2021-02-23 11:36:22 [INFO] [TRAIN] epoch=120, iter=44510/80000, loss=0.9220, lr=0.004812, batch_cost=1.3507, reader_cost=0.0001 | ETA 13:18:55 2021-02-23 11:36:36 [INFO] [TRAIN] epoch=120, iter=44520/80000, loss=0.8594, lr=0.004811, batch_cost=1.3760, reader_cost=0.0001 | ETA 13:33:40 2021-02-23 11:36:50 [INFO] [TRAIN] epoch=120, iter=44530/80000, loss=0.9122, lr=0.004810, batch_cost=1.3812, reader_cost=0.0001 | ETA 13:36:31 2021-02-23 11:37:03 [INFO] [TRAIN] epoch=120, iter=44540/80000, loss=0.9118, lr=0.004808, batch_cost=1.3715, reader_cost=0.0001 | ETA 13:30:32 2021-02-23 11:37:17 [INFO] [TRAIN] epoch=120, iter=44550/80000, loss=0.8815, lr=0.004807, batch_cost=1.3537, reader_cost=0.0001 | ETA 13:19:49 2021-02-23 11:37:30 [INFO] [TRAIN] epoch=120, iter=44560/80000, loss=0.8605, lr=0.004806, batch_cost=1.3517, reader_cost=0.0001 | ETA 13:18:25 2021-02-23 11:37:44 [INFO] [TRAIN] epoch=120, iter=44570/80000, loss=0.8519, lr=0.004805, batch_cost=1.3360, reader_cost=0.0001 | ETA 13:08:55 2021-02-23 11:37:57 [INFO] [TRAIN] epoch=120, iter=44580/80000, loss=0.8481, lr=0.004803, batch_cost=1.3526, reader_cost=0.0001 | ETA 13:18:28 2021-02-23 11:38:11 [INFO] [TRAIN] epoch=120, iter=44590/80000, loss=0.8163, lr=0.004802, batch_cost=1.3316, reader_cost=0.0001 | ETA 13:05:53 2021-02-23 11:38:24 [INFO] [TRAIN] epoch=120, iter=44600/80000, loss=0.9357, lr=0.004801, batch_cost=1.3402, reader_cost=0.0001 | ETA 13:10:43 2021-02-23 11:38:38 [INFO] [TRAIN] epoch=120, iter=44610/80000, loss=0.7914, lr=0.004800, batch_cost=1.3495, reader_cost=0.0001 | ETA 13:15:58 2021-02-23 11:38:51 [INFO] [TRAIN] epoch=120, iter=44620/80000, loss=0.8553, lr=0.004799, batch_cost=1.3546, reader_cost=0.0001 | ETA 13:18:44 2021-02-23 11:39:05 [INFO] [TRAIN] epoch=120, iter=44630/80000, loss=0.9035, lr=0.004797, batch_cost=1.3534, reader_cost=0.0001 | ETA 13:17:50 2021-02-23 11:39:18 [INFO] [TRAIN] epoch=120, iter=44640/80000, loss=0.8476, lr=0.004796, batch_cost=1.3322, reader_cost=0.0001 | ETA 13:05:07 2021-02-23 11:39:33 [INFO] [TRAIN] epoch=121, iter=44650/80000, loss=0.9076, lr=0.004795, batch_cost=1.4922, reader_cost=0.0843 | ETA 14:39:08 2021-02-23 11:39:46 [INFO] [TRAIN] epoch=121, iter=44660/80000, loss=0.8792, lr=0.004794, batch_cost=1.3598, reader_cost=0.0001 | ETA 13:20:56 2021-02-23 11:40:00 [INFO] [TRAIN] epoch=121, iter=44670/80000, loss=0.8820, lr=0.004792, batch_cost=1.3451, reader_cost=0.0001 | ETA 13:12:01 2021-02-23 11:40:14 [INFO] [TRAIN] epoch=121, iter=44680/80000, loss=0.7940, lr=0.004791, batch_cost=1.3902, reader_cost=0.0001 | ETA 13:38:23 2021-02-23 11:40:27 [INFO] [TRAIN] epoch=121, iter=44690/80000, loss=0.8433, lr=0.004790, batch_cost=1.3374, reader_cost=0.0001 | ETA 13:07:02 2021-02-23 11:40:41 [INFO] [TRAIN] epoch=121, iter=44700/80000, loss=0.9147, lr=0.004789, batch_cost=1.3553, reader_cost=0.0001 | ETA 13:17:21 2021-02-23 11:40:54 [INFO] [TRAIN] epoch=121, iter=44710/80000, loss=0.9486, lr=0.004788, batch_cost=1.3610, reader_cost=0.0001 | ETA 13:20:30 2021-02-23 11:41:08 [INFO] [TRAIN] epoch=121, iter=44720/80000, loss=0.8394, lr=0.004786, batch_cost=1.3445, reader_cost=0.0001 | ETA 13:10:32 2021-02-23 11:41:21 [INFO] [TRAIN] epoch=121, iter=44730/80000, loss=0.8299, lr=0.004785, batch_cost=1.3689, reader_cost=0.0001 | ETA 13:24:41 2021-02-23 11:41:35 [INFO] [TRAIN] epoch=121, iter=44740/80000, loss=0.8441, lr=0.004784, batch_cost=1.3811, reader_cost=0.0001 | ETA 13:31:37 2021-02-23 11:41:49 [INFO] [TRAIN] epoch=121, iter=44750/80000, loss=0.8874, lr=0.004783, batch_cost=1.3792, reader_cost=0.0001 | ETA 13:30:16 2021-02-23 11:42:03 [INFO] [TRAIN] epoch=121, iter=44760/80000, loss=0.8422, lr=0.004781, batch_cost=1.3691, reader_cost=0.0001 | ETA 13:24:08 2021-02-23 11:42:17 [INFO] [TRAIN] epoch=121, iter=44770/80000, loss=0.9045, lr=0.004780, batch_cost=1.3772, reader_cost=0.0001 | ETA 13:28:39 2021-02-23 11:42:30 [INFO] [TRAIN] epoch=121, iter=44780/80000, loss=0.9739, lr=0.004779, batch_cost=1.3930, reader_cost=0.0001 | ETA 13:37:43 2021-02-23 11:42:44 [INFO] [TRAIN] epoch=121, iter=44790/80000, loss=0.8338, lr=0.004778, batch_cost=1.3434, reader_cost=0.0001 | ETA 13:08:22 2021-02-23 11:42:58 [INFO] [TRAIN] epoch=121, iter=44800/80000, loss=0.9002, lr=0.004777, batch_cost=1.3813, reader_cost=0.0001 | ETA 13:30:22 2021-02-23 11:43:11 [INFO] [TRAIN] epoch=121, iter=44810/80000, loss=0.8672, lr=0.004775, batch_cost=1.3604, reader_cost=0.0001 | ETA 13:17:50 2021-02-23 11:43:25 [INFO] [TRAIN] epoch=121, iter=44820/80000, loss=0.9182, lr=0.004774, batch_cost=1.3393, reader_cost=0.0001 | ETA 13:05:17 2021-02-23 11:43:38 [INFO] [TRAIN] epoch=121, iter=44830/80000, loss=0.8519, lr=0.004773, batch_cost=1.3552, reader_cost=0.0001 | ETA 13:14:22 2021-02-23 11:43:52 [INFO] [TRAIN] epoch=121, iter=44840/80000, loss=0.8564, lr=0.004772, batch_cost=1.3433, reader_cost=0.0001 | ETA 13:07:09 2021-02-23 11:44:05 [INFO] [TRAIN] epoch=121, iter=44850/80000, loss=0.8939, lr=0.004770, batch_cost=1.3730, reader_cost=0.0001 | ETA 13:24:19 2021-02-23 11:44:19 [INFO] [TRAIN] epoch=121, iter=44860/80000, loss=0.9054, lr=0.004769, batch_cost=1.3798, reader_cost=0.0001 | ETA 13:28:04 2021-02-23 11:44:33 [INFO] [TRAIN] epoch=121, iter=44870/80000, loss=0.9151, lr=0.004768, batch_cost=1.3674, reader_cost=0.0001 | ETA 13:20:38 2021-02-23 11:44:47 [INFO] [TRAIN] epoch=121, iter=44880/80000, loss=0.9496, lr=0.004767, batch_cost=1.3889, reader_cost=0.0001 | ETA 13:32:58 2021-02-23 11:45:00 [INFO] [TRAIN] epoch=121, iter=44890/80000, loss=0.7979, lr=0.004766, batch_cost=1.3449, reader_cost=0.0001 | ETA 13:06:59 2021-02-23 11:45:14 [INFO] [TRAIN] epoch=121, iter=44900/80000, loss=0.9353, lr=0.004764, batch_cost=1.3791, reader_cost=0.0001 | ETA 13:26:44 2021-02-23 11:45:27 [INFO] [TRAIN] epoch=121, iter=44910/80000, loss=0.8047, lr=0.004763, batch_cost=1.3444, reader_cost=0.0001 | ETA 13:06:13 2021-02-23 11:45:41 [INFO] [TRAIN] epoch=121, iter=44920/80000, loss=0.8010, lr=0.004762, batch_cost=1.3431, reader_cost=0.0001 | ETA 13:05:14 2021-02-23 11:45:55 [INFO] [TRAIN] epoch=121, iter=44930/80000, loss=0.8125, lr=0.004761, batch_cost=1.4004, reader_cost=0.0001 | ETA 13:38:33 2021-02-23 11:46:09 [INFO] [TRAIN] epoch=121, iter=44940/80000, loss=0.9455, lr=0.004759, batch_cost=1.3959, reader_cost=0.0001 | ETA 13:35:39 2021-02-23 11:46:23 [INFO] [TRAIN] epoch=121, iter=44950/80000, loss=0.9100, lr=0.004758, batch_cost=1.4052, reader_cost=0.0001 | ETA 13:40:52 2021-02-23 11:46:37 [INFO] [TRAIN] epoch=121, iter=44960/80000, loss=0.9251, lr=0.004757, batch_cost=1.3619, reader_cost=0.0001 | ETA 13:15:21 2021-02-23 11:46:50 [INFO] [TRAIN] epoch=121, iter=44970/80000, loss=1.0975, lr=0.004756, batch_cost=1.3803, reader_cost=0.0001 | ETA 13:25:51 2021-02-23 11:47:04 [INFO] [TRAIN] epoch=121, iter=44980/80000, loss=0.8184, lr=0.004755, batch_cost=1.3702, reader_cost=0.0001 | ETA 13:19:42 2021-02-23 11:47:18 [INFO] [TRAIN] epoch=121, iter=44990/80000, loss=0.9179, lr=0.004753, batch_cost=1.3748, reader_cost=0.0001 | ETA 13:22:12 2021-02-23 11:47:31 [INFO] [TRAIN] epoch=121, iter=45000/80000, loss=0.9110, lr=0.004752, batch_cost=1.3300, reader_cost=0.0001 | ETA 12:55:50 2021-02-23 11:47:31 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:16 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:06 - batch_cost: 0.2310 - reader cost: 0.1033  3/125 [..............................] - ETA: 1:01 - batch_cost: 0.2953 - reader cost: 0.1245 4/125 [..............................] - ETA: 58s - batch_cost: 0.3303 - reader cost: 0.1389  5/125 [>.............................] - ETA: 57s - batch_cost: 0.3565 - reader cost: 0.1515 6/125 [>.............................] - ETA: 55s - batch_cost: 0.3660 - reader cost: 0.1529 7/125 [>.............................] - ETA: 55s - batch_cost: 0.3791 - reader cost: 0.1594 8/125 [>.............................] - ETA: 53s - batch_cost: 0.3801 - reader cost: 0.1563 9/125 [=>............................] - ETA: 52s - batch_cost: 0.3848 - reader cost: 0.1583 10/125 [=>............................] - ETA: 51s - batch_cost: 0.3867 - reader cost: 0.1563 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3848 - reader cost: 0.1522 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3826 - reader cost: 0.1484 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3864 - reader cost: 0.1511 14/125 [==>...........................] - ETA: 47s - batch_cost: 0.3873 - reader cost: 0.1504 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3900 - reader cost: 0.1522 16/125 [==>...........................] - ETA: 46s - batch_cost: 0.3920 - reader cost: 0.1535 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3949 - reader cost: 0.1549 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3951 - reader cost: 0.1525 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3964 - reader cost: 0.1485 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3959 - reader cost: 0.1431 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.3968 - reader cost: 0.1440 22/125 [====>.........................] - ETA: 43s - batch_cost: 0.3979 - reader cost: 0.1429 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.3992 - reader cost: 0.1437 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4005 - reader cost: 0.1449 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4012 - reader cost: 0.1458 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4033 - reader cost: 0.1474 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4033 - reader cost: 0.1476 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4054 - reader cost: 0.1496 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4064 - reader cost: 0.1508 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4073 - reader cost: 0.1516 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4082 - reader cost: 0.1527 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4074 - reader cost: 0.1521 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4065 - reader cost: 0.1513 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4075 - reader cost: 0.1520 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4061 - reader cost: 0.1508 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4073 - reader cost: 0.1521 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4079 - reader cost: 0.1526 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4082 - reader cost: 0.1530 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4086 - reader cost: 0.1534 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4092 - reader cost: 0.1541 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4090 - reader cost: 0.1540 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4083 - reader cost: 0.1532 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4087 - reader cost: 0.1535 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4079 - reader cost: 0.1527 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4082 - reader cost: 0.1531 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4088 - reader cost: 0.1537 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4081 - reader cost: 0.1531 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4085 - reader cost: 0.1535 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4096 - reader cost: 0.1546 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4101 - reader cost: 0.1552 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4106 - reader cost: 0.1557 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4111 - reader cost: 0.1563 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4111 - reader cost: 0.1562 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4108 - reader cost: 0.1560 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4114 - reader cost: 0.1565 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4117 - reader cost: 0.1570 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4128 - reader cost: 0.1582 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4125 - reader cost: 0.1579 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4128 - reader cost: 0.1581 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4123 - reader cost: 0.1574 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4125 - reader cost: 0.1574 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4121 - reader cost: 0.1571 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4124 - reader cost: 0.1574 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4126 - reader cost: 0.1577 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4120 - reader cost: 0.1571 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4122 - reader cost: 0.1573 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4124 - reader cost: 0.1575 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4124 - reader cost: 0.1576 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4127 - reader cost: 0.1578 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4120 - reader cost: 0.1573 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4122 - reader cost: 0.1575 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4117 - reader cost: 0.1569 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4118 - reader cost: 0.1572 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4125 - reader cost: 0.1578 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4126 - reader cost: 0.1580 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4121 - reader cost: 0.1575 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4122 - reader cost: 0.1577 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4116 - reader cost: 0.1571 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4121 - reader cost: 0.1574 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4124 - reader cost: 0.1576 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4125 - reader cost: 0.1576 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4126 - reader cost: 0.1576 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4127 - reader cost: 0.1578 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4126 - reader cost: 0.1575 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4119 - reader cost: 0.1569 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4120 - reader cost: 0.1571 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4123 - reader cost: 0.1573 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4118 - reader cost: 0.1569 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4119 - reader cost: 0.1571 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4115 - reader cost: 0.1566 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4117 - reader cost: 0.1568 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4116 - reader cost: 0.1567 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4112 - reader cost: 0.1562 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4112 - reader cost: 0.1562 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4112 - reader cost: 0.1558 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4109 - reader cost: 0.1553 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4111 - reader cost: 0.1551 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4112 - reader cost: 0.1553 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4114 - reader cost: 0.1555 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4117 - reader cost: 0.1557 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4113 - reader cost: 0.1554 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4114 - reader cost: 0.1552  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4117 - reader cost: 0.1544 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4113 - reader cost: 0.1540 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4114 - reader cost: 0.1542 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4112 - reader cost: 0.1540 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4114 - reader cost: 0.1543 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4118 - reader cost: 0.1548 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4114 - reader cost: 0.1544 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4109 - reader cost: 0.1539 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4108 - reader cost: 0.1539 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4107 - reader cost: 0.1539 113/125 [==========================>...] - ETA: 4s - batch_cost: 0.4110 - reader cost: 0.1542 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4110 - reader cost: 0.1541 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4105 - reader cost: 0.1536 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4108 - reader cost: 0.1540 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4109 - reader cost: 0.1541 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4109 - reader cost: 0.1542 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4107 - reader cost: 0.1540 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4109 - reader cost: 0.1542 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4111 - reader cost: 0.1544 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4112 - reader cost: 0.1545 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4112 - reader cost: 0.1546 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4108 - reader cost: 0.1542 125/125 [==============================] - 52s 416ms/step - batch_cost: 0.4110 - reader cost: 0.1545 2021-02-23 11:48:23 [INFO] [EVAL] #Images=500 mIoU=0.7528 Acc=0.9552 Kappa=0.9417 2021-02-23 11:48:23 [INFO] [EVAL] Class IoU: [0.9771 0.8112 0.9143 0.4794 0.5638 0.6268 0.6975 0.776 0.9192 0.5859 0.9422 0.8069 0.6001 0.9446 0.6572 0.8425 0.7779 0.6153 0.7644] 2021-02-23 11:48:23 [INFO] [EVAL] Class Acc: [0.9851 0.9126 0.9396 0.7994 0.6856 0.8521 0.9043 0.9247 0.9626 0.8829 0.9579 0.9248 0.8036 0.9665 0.8279 0.8795 0.9168 0.7926 0.8242] 2021-02-23 11:48:28 [INFO] [EVAL] The model with the best validation mIoU (0.7816) was saved at iter 44000. 2021-02-23 11:48:42 [INFO] [TRAIN] epoch=121, iter=45010/80000, loss=0.8928, lr=0.004751, batch_cost=1.3691, reader_cost=0.0001 | ETA 13:18:24 2021-02-23 11:48:56 [INFO] [TRAIN] epoch=122, iter=45020/80000, loss=0.8790, lr=0.004750, batch_cost=1.4402, reader_cost=0.0727 | ETA 13:59:38 2021-02-23 11:49:10 [INFO] [TRAIN] epoch=122, iter=45030/80000, loss=0.8299, lr=0.004748, batch_cost=1.3413, reader_cost=0.0001 | ETA 13:01:43 2021-02-23 11:49:23 [INFO] [TRAIN] epoch=122, iter=45040/80000, loss=0.8981, lr=0.004747, batch_cost=1.3449, reader_cost=0.0001 | ETA 13:03:36 2021-02-23 11:49:37 [INFO] [TRAIN] epoch=122, iter=45050/80000, loss=0.9918, lr=0.004746, batch_cost=1.3748, reader_cost=0.0001 | ETA 13:20:48 2021-02-23 11:49:51 [INFO] [TRAIN] epoch=122, iter=45060/80000, loss=0.8921, lr=0.004745, batch_cost=1.3910, reader_cost=0.0001 | ETA 13:30:02 2021-02-23 11:50:05 [INFO] [TRAIN] epoch=122, iter=45070/80000, loss=0.8394, lr=0.004744, batch_cost=1.3987, reader_cost=0.0006 | ETA 13:34:15 2021-02-23 11:50:18 [INFO] [TRAIN] epoch=122, iter=45080/80000, loss=0.8531, lr=0.004742, batch_cost=1.3622, reader_cost=0.0001 | ETA 13:12:46 2021-02-23 11:50:32 [INFO] [TRAIN] epoch=122, iter=45090/80000, loss=0.8806, lr=0.004741, batch_cost=1.3824, reader_cost=0.0001 | ETA 13:24:19 2021-02-23 11:50:46 [INFO] [TRAIN] epoch=122, iter=45100/80000, loss=0.8518, lr=0.004740, batch_cost=1.3786, reader_cost=0.0001 | ETA 13:21:52 2021-02-23 11:51:00 [INFO] [TRAIN] epoch=122, iter=45110/80000, loss=0.8794, lr=0.004739, batch_cost=1.4023, reader_cost=0.0001 | ETA 13:35:26 2021-02-23 11:51:13 [INFO] [TRAIN] epoch=122, iter=45120/80000, loss=0.8719, lr=0.004737, batch_cost=1.3473, reader_cost=0.0001 | ETA 13:03:13 2021-02-23 11:51:27 [INFO] [TRAIN] epoch=122, iter=45130/80000, loss=0.8698, lr=0.004736, batch_cost=1.3539, reader_cost=0.0001 | ETA 13:06:51 2021-02-23 11:51:41 [INFO] [TRAIN] epoch=122, iter=45140/80000, loss=0.8742, lr=0.004735, batch_cost=1.3677, reader_cost=0.0001 | ETA 13:14:38 2021-02-23 11:51:54 [INFO] [TRAIN] epoch=122, iter=45150/80000, loss=0.8629, lr=0.004734, batch_cost=1.3670, reader_cost=0.0001 | ETA 13:14:00 2021-02-23 11:52:08 [INFO] [TRAIN] epoch=122, iter=45160/80000, loss=0.9851, lr=0.004733, batch_cost=1.3691, reader_cost=0.0001 | ETA 13:14:58 2021-02-23 11:52:22 [INFO] [TRAIN] epoch=122, iter=45170/80000, loss=0.8480, lr=0.004731, batch_cost=1.3614, reader_cost=0.0001 | ETA 13:10:18 2021-02-23 11:52:35 [INFO] [TRAIN] epoch=122, iter=45180/80000, loss=0.8833, lr=0.004730, batch_cost=1.3740, reader_cost=0.0001 | ETA 13:17:21 2021-02-23 11:52:49 [INFO] [TRAIN] epoch=122, iter=45190/80000, loss=0.8827, lr=0.004729, batch_cost=1.3786, reader_cost=0.0001 | ETA 13:19:49 2021-02-23 11:53:03 [INFO] [TRAIN] epoch=122, iter=45200/80000, loss=0.9042, lr=0.004728, batch_cost=1.3706, reader_cost=0.0001 | ETA 13:14:56 2021-02-23 11:53:17 [INFO] [TRAIN] epoch=122, iter=45210/80000, loss=0.8062, lr=0.004726, batch_cost=1.3726, reader_cost=0.0001 | ETA 13:15:51 2021-02-23 11:53:30 [INFO] [TRAIN] epoch=122, iter=45220/80000, loss=0.9208, lr=0.004725, batch_cost=1.3432, reader_cost=0.0001 | ETA 12:58:35 2021-02-23 11:53:43 [INFO] [TRAIN] epoch=122, iter=45230/80000, loss=0.8909, lr=0.004724, batch_cost=1.3284, reader_cost=0.0001 | ETA 12:49:48 2021-02-23 11:53:57 [INFO] [TRAIN] epoch=122, iter=45240/80000, loss=0.9769, lr=0.004723, batch_cost=1.3537, reader_cost=0.0001 | ETA 13:04:14 2021-02-23 11:54:10 [INFO] [TRAIN] epoch=122, iter=45250/80000, loss=0.8559, lr=0.004722, batch_cost=1.3534, reader_cost=0.0001 | ETA 13:03:49 2021-02-23 11:54:24 [INFO] [TRAIN] epoch=122, iter=45260/80000, loss=1.0364, lr=0.004720, batch_cost=1.3604, reader_cost=0.0001 | ETA 13:07:41 2021-02-23 11:54:37 [INFO] [TRAIN] epoch=122, iter=45270/80000, loss=0.7862, lr=0.004719, batch_cost=1.3465, reader_cost=0.0001 | ETA 12:59:24 2021-02-23 11:54:51 [INFO] [TRAIN] epoch=122, iter=45280/80000, loss=0.8719, lr=0.004718, batch_cost=1.3821, reader_cost=0.0001 | ETA 13:19:46 2021-02-23 11:55:05 [INFO] [TRAIN] epoch=122, iter=45290/80000, loss=0.9346, lr=0.004717, batch_cost=1.3392, reader_cost=0.0001 | ETA 12:54:42 2021-02-23 11:55:18 [INFO] [TRAIN] epoch=122, iter=45300/80000, loss=0.9708, lr=0.004715, batch_cost=1.3674, reader_cost=0.0001 | ETA 13:10:48 2021-02-23 11:55:32 [INFO] [TRAIN] epoch=122, iter=45310/80000, loss=0.8865, lr=0.004714, batch_cost=1.3637, reader_cost=0.0001 | ETA 13:08:27 2021-02-23 11:55:45 [INFO] [TRAIN] epoch=122, iter=45320/80000, loss=0.7976, lr=0.004713, batch_cost=1.3440, reader_cost=0.0001 | ETA 12:56:49 2021-02-23 11:55:59 [INFO] [TRAIN] epoch=122, iter=45330/80000, loss=0.8885, lr=0.004712, batch_cost=1.3717, reader_cost=0.0001 | ETA 13:12:35 2021-02-23 11:56:13 [INFO] [TRAIN] epoch=122, iter=45340/80000, loss=0.8614, lr=0.004711, batch_cost=1.4006, reader_cost=0.0001 | ETA 13:29:05 2021-02-23 11:56:27 [INFO] [TRAIN] epoch=122, iter=45350/80000, loss=0.8577, lr=0.004709, batch_cost=1.3647, reader_cost=0.0001 | ETA 13:08:05 2021-02-23 11:56:40 [INFO] [TRAIN] epoch=122, iter=45360/80000, loss=0.8991, lr=0.004708, batch_cost=1.3624, reader_cost=0.0001 | ETA 13:06:34 2021-02-23 11:56:54 [INFO] [TRAIN] epoch=122, iter=45370/80000, loss=0.8653, lr=0.004707, batch_cost=1.4076, reader_cost=0.0001 | ETA 13:32:24 2021-02-23 11:57:08 [INFO] [TRAIN] epoch=122, iter=45380/80000, loss=0.8592, lr=0.004706, batch_cost=1.3859, reader_cost=0.0001 | ETA 13:19:39 2021-02-23 11:57:23 [INFO] [TRAIN] epoch=123, iter=45390/80000, loss=0.8331, lr=0.004704, batch_cost=1.4549, reader_cost=0.0761 | ETA 13:59:14 2021-02-23 11:57:37 [INFO] [TRAIN] epoch=123, iter=45400/80000, loss=0.8429, lr=0.004703, batch_cost=1.3730, reader_cost=0.0001 | ETA 13:11:46 2021-02-23 11:57:50 [INFO] [TRAIN] epoch=123, iter=45410/80000, loss=0.8125, lr=0.004702, batch_cost=1.3695, reader_cost=0.0001 | ETA 13:09:29 2021-02-23 11:58:04 [INFO] [TRAIN] epoch=123, iter=45420/80000, loss=0.8366, lr=0.004701, batch_cost=1.3827, reader_cost=0.0001 | ETA 13:16:53 2021-02-23 11:58:18 [INFO] [TRAIN] epoch=123, iter=45430/80000, loss=0.8797, lr=0.004700, batch_cost=1.3466, reader_cost=0.0001 | ETA 12:55:50 2021-02-23 11:58:31 [INFO] [TRAIN] epoch=123, iter=45440/80000, loss=0.8226, lr=0.004698, batch_cost=1.3624, reader_cost=0.0001 | ETA 13:04:44 2021-02-23 11:58:45 [INFO] [TRAIN] epoch=123, iter=45450/80000, loss=0.8347, lr=0.004697, batch_cost=1.3824, reader_cost=0.0001 | ETA 13:16:01 2021-02-23 11:58:59 [INFO] [TRAIN] epoch=123, iter=45460/80000, loss=0.8511, lr=0.004696, batch_cost=1.3623, reader_cost=0.0001 | ETA 13:04:12 2021-02-23 11:59:13 [INFO] [TRAIN] epoch=123, iter=45470/80000, loss=0.8765, lr=0.004695, batch_cost=1.3914, reader_cost=0.0001 | ETA 13:20:44 2021-02-23 11:59:26 [INFO] [TRAIN] epoch=123, iter=45480/80000, loss=0.8415, lr=0.004693, batch_cost=1.3545, reader_cost=0.0001 | ETA 12:59:17 2021-02-23 11:59:40 [INFO] [TRAIN] epoch=123, iter=45490/80000, loss=0.8118, lr=0.004692, batch_cost=1.3607, reader_cost=0.0001 | ETA 13:02:37 2021-02-23 11:59:53 [INFO] [TRAIN] epoch=123, iter=45500/80000, loss=0.8875, lr=0.004691, batch_cost=1.3439, reader_cost=0.0001 | ETA 12:52:43 2021-02-23 12:00:07 [INFO] [TRAIN] epoch=123, iter=45510/80000, loss=0.8010, lr=0.004690, batch_cost=1.3837, reader_cost=0.0001 | ETA 13:15:24 2021-02-23 12:00:21 [INFO] [TRAIN] epoch=123, iter=45520/80000, loss=0.9736, lr=0.004689, batch_cost=1.3626, reader_cost=0.0001 | ETA 13:03:03 2021-02-23 12:00:34 [INFO] [TRAIN] epoch=123, iter=45530/80000, loss=0.7891, lr=0.004687, batch_cost=1.3378, reader_cost=0.0001 | ETA 12:48:35 2021-02-23 12:00:48 [INFO] [TRAIN] epoch=123, iter=45540/80000, loss=0.9203, lr=0.004686, batch_cost=1.3819, reader_cost=0.0001 | ETA 13:13:39 2021-02-23 12:01:02 [INFO] [TRAIN] epoch=123, iter=45550/80000, loss=0.8354, lr=0.004685, batch_cost=1.4018, reader_cost=0.0001 | ETA 13:24:52 2021-02-23 12:01:15 [INFO] [TRAIN] epoch=123, iter=45560/80000, loss=0.8927, lr=0.004684, batch_cost=1.3652, reader_cost=0.0001 | ETA 13:03:35 2021-02-23 12:01:29 [INFO] [TRAIN] epoch=123, iter=45570/80000, loss=0.8783, lr=0.004682, batch_cost=1.3950, reader_cost=0.0001 | ETA 13:20:29 2021-02-23 12:01:43 [INFO] [TRAIN] epoch=123, iter=45580/80000, loss=0.8514, lr=0.004681, batch_cost=1.3974, reader_cost=0.0001 | ETA 13:21:38 2021-02-23 12:01:57 [INFO] [TRAIN] epoch=123, iter=45590/80000, loss=0.8204, lr=0.004680, batch_cost=1.3698, reader_cost=0.0001 | ETA 13:05:33 2021-02-23 12:02:11 [INFO] [TRAIN] epoch=123, iter=45600/80000, loss=0.8414, lr=0.004679, batch_cost=1.3547, reader_cost=0.0001 | ETA 12:56:40 2021-02-23 12:02:24 [INFO] [TRAIN] epoch=123, iter=45610/80000, loss=0.8854, lr=0.004678, batch_cost=1.3612, reader_cost=0.0001 | ETA 13:00:11 2021-02-23 12:02:38 [INFO] [TRAIN] epoch=123, iter=45620/80000, loss=0.8919, lr=0.004676, batch_cost=1.3785, reader_cost=0.0001 | ETA 13:09:52 2021-02-23 12:02:51 [INFO] [TRAIN] epoch=123, iter=45630/80000, loss=0.8829, lr=0.004675, batch_cost=1.3427, reader_cost=0.0001 | ETA 12:49:07 2021-02-23 12:03:05 [INFO] [TRAIN] epoch=123, iter=45640/80000, loss=0.8751, lr=0.004674, batch_cost=1.3365, reader_cost=0.0001 | ETA 12:45:21 2021-02-23 12:03:19 [INFO] [TRAIN] epoch=123, iter=45650/80000, loss=0.8681, lr=0.004673, batch_cost=1.3680, reader_cost=0.0001 | ETA 13:03:10 2021-02-23 12:03:32 [INFO] [TRAIN] epoch=123, iter=45660/80000, loss=0.9042, lr=0.004671, batch_cost=1.3810, reader_cost=0.0001 | ETA 13:10:23 2021-02-23 12:03:46 [INFO] [TRAIN] epoch=123, iter=45670/80000, loss=0.9015, lr=0.004670, batch_cost=1.3606, reader_cost=0.0001 | ETA 12:58:28 2021-02-23 12:04:00 [INFO] [TRAIN] epoch=123, iter=45680/80000, loss=0.9982, lr=0.004669, batch_cost=1.3860, reader_cost=0.0001 | ETA 13:12:48 2021-02-23 12:04:13 [INFO] [TRAIN] epoch=123, iter=45690/80000, loss=0.8704, lr=0.004668, batch_cost=1.3608, reader_cost=0.0001 | ETA 12:58:10 2021-02-23 12:04:27 [INFO] [TRAIN] epoch=123, iter=45700/80000, loss=0.9211, lr=0.004667, batch_cost=1.3753, reader_cost=0.0001 | ETA 13:06:13 2021-02-23 12:04:41 [INFO] [TRAIN] epoch=123, iter=45710/80000, loss=0.8850, lr=0.004665, batch_cost=1.3670, reader_cost=0.0001 | ETA 13:01:15 2021-02-23 12:04:55 [INFO] [TRAIN] epoch=123, iter=45720/80000, loss=1.0176, lr=0.004664, batch_cost=1.3774, reader_cost=0.0001 | ETA 13:06:56 2021-02-23 12:05:09 [INFO] [TRAIN] epoch=123, iter=45730/80000, loss=0.8472, lr=0.004663, batch_cost=1.3888, reader_cost=0.0001 | ETA 13:13:13 2021-02-23 12:05:22 [INFO] [TRAIN] epoch=123, iter=45740/80000, loss=0.9041, lr=0.004662, batch_cost=1.3507, reader_cost=0.0001 | ETA 12:51:14 2021-02-23 12:05:36 [INFO] [TRAIN] epoch=123, iter=45750/80000, loss=0.8860, lr=0.004660, batch_cost=1.3678, reader_cost=0.0001 | ETA 13:00:47 2021-02-23 12:05:50 [INFO] [TRAIN] epoch=124, iter=45760/80000, loss=0.8564, lr=0.004659, batch_cost=1.4560, reader_cost=0.0641 | ETA 13:50:53 2021-02-23 12:06:04 [INFO] [TRAIN] epoch=124, iter=45770/80000, loss=0.8478, lr=0.004658, batch_cost=1.3429, reader_cost=0.0001 | ETA 12:46:05 2021-02-23 12:06:18 [INFO] [TRAIN] epoch=124, iter=45780/80000, loss=0.8502, lr=0.004657, batch_cost=1.3874, reader_cost=0.0001 | ETA 13:11:18 2021-02-23 12:06:31 [INFO] [TRAIN] epoch=124, iter=45790/80000, loss=0.9577, lr=0.004656, batch_cost=1.3707, reader_cost=0.0001 | ETA 13:01:30 2021-02-23 12:06:45 [INFO] [TRAIN] epoch=124, iter=45800/80000, loss=0.9420, lr=0.004654, batch_cost=1.3584, reader_cost=0.0001 | ETA 12:54:16 2021-02-23 12:06:58 [INFO] [TRAIN] epoch=124, iter=45810/80000, loss=0.7847, lr=0.004653, batch_cost=1.3610, reader_cost=0.0001 | ETA 12:55:32 2021-02-23 12:07:12 [INFO] [TRAIN] epoch=124, iter=45820/80000, loss=0.8732, lr=0.004652, batch_cost=1.3869, reader_cost=0.0001 | ETA 13:10:04 2021-02-23 12:07:26 [INFO] [TRAIN] epoch=124, iter=45830/80000, loss=0.8689, lr=0.004651, batch_cost=1.3257, reader_cost=0.0001 | ETA 12:34:59 2021-02-23 12:07:39 [INFO] [TRAIN] epoch=124, iter=45840/80000, loss=0.8351, lr=0.004649, batch_cost=1.3471, reader_cost=0.0001 | ETA 12:46:56 2021-02-23 12:07:53 [INFO] [TRAIN] epoch=124, iter=45850/80000, loss=1.0233, lr=0.004648, batch_cost=1.3806, reader_cost=0.0001 | ETA 13:05:47 2021-02-23 12:08:06 [INFO] [TRAIN] epoch=124, iter=45860/80000, loss=0.9094, lr=0.004647, batch_cost=1.3549, reader_cost=0.0001 | ETA 12:50:56 2021-02-23 12:08:20 [INFO] [TRAIN] epoch=124, iter=45870/80000, loss=0.8898, lr=0.004646, batch_cost=1.3349, reader_cost=0.0001 | ETA 12:39:21 2021-02-23 12:08:34 [INFO] [TRAIN] epoch=124, iter=45880/80000, loss=0.8442, lr=0.004644, batch_cost=1.3844, reader_cost=0.0001 | ETA 13:07:16 2021-02-23 12:08:47 [INFO] [TRAIN] epoch=124, iter=45890/80000, loss=0.8706, lr=0.004643, batch_cost=1.3265, reader_cost=0.0001 | ETA 12:34:05 2021-02-23 12:09:00 [INFO] [TRAIN] epoch=124, iter=45900/80000, loss=0.9213, lr=0.004642, batch_cost=1.3372, reader_cost=0.0001 | ETA 12:40:00 2021-02-23 12:09:14 [INFO] [TRAIN] epoch=124, iter=45910/80000, loss=0.8509, lr=0.004641, batch_cost=1.3779, reader_cost=0.0001 | ETA 13:02:51 2021-02-23 12:09:28 [INFO] [TRAIN] epoch=124, iter=45920/80000, loss=0.8172, lr=0.004640, batch_cost=1.3627, reader_cost=0.0001 | ETA 12:54:01 2021-02-23 12:09:41 [INFO] [TRAIN] epoch=124, iter=45930/80000, loss=0.9174, lr=0.004638, batch_cost=1.3521, reader_cost=0.0001 | ETA 12:47:45 2021-02-23 12:09:55 [INFO] [TRAIN] epoch=124, iter=45940/80000, loss=0.8354, lr=0.004637, batch_cost=1.3746, reader_cost=0.0001 | ETA 13:00:18 2021-02-23 12:10:08 [INFO] [TRAIN] epoch=124, iter=45950/80000, loss=0.7969, lr=0.004636, batch_cost=1.3498, reader_cost=0.0001 | ETA 12:45:59 2021-02-23 12:10:22 [INFO] [TRAIN] epoch=124, iter=45960/80000, loss=0.8442, lr=0.004635, batch_cost=1.3165, reader_cost=0.0001 | ETA 12:26:54 2021-02-23 12:10:35 [INFO] [TRAIN] epoch=124, iter=45970/80000, loss=0.8351, lr=0.004633, batch_cost=1.3544, reader_cost=0.0001 | ETA 12:48:10 2021-02-23 12:10:49 [INFO] [TRAIN] epoch=124, iter=45980/80000, loss=0.8865, lr=0.004632, batch_cost=1.3764, reader_cost=0.0001 | ETA 13:00:26 2021-02-23 12:11:02 [INFO] [TRAIN] epoch=124, iter=45990/80000, loss=0.9264, lr=0.004631, batch_cost=1.3583, reader_cost=0.0001 | ETA 12:49:56 2021-02-23 12:11:16 [INFO] [TRAIN] epoch=124, iter=46000/80000, loss=0.9369, lr=0.004630, batch_cost=1.3689, reader_cost=0.0001 | ETA 12:55:41 2021-02-23 12:11:16 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:15 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:05 - batch_cost: 0.2326 - reader cost: 0.1065  3/125 [..............................] - ETA: 1:01 - batch_cost: 0.3018 - reader cost: 0.1312 4/125 [..............................] - ETA: 58s - batch_cost: 0.3354 - reader cost: 0.1421  5/125 [>.............................] - ETA: 55s - batch_cost: 0.3407 - reader cost: 0.1362 6/125 [>.............................] - ETA: 54s - batch_cost: 0.3555 - reader cost: 0.1429 7/125 [>.............................] - ETA: 53s - batch_cost: 0.3642 - reader cost: 0.1451 8/125 [>.............................] - ETA: 52s - batch_cost: 0.3734 - reader cost: 0.1503 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3759 - reader cost: 0.1500 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3808 - reader cost: 0.1526 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3809 - reader cost: 0.1508 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3855 - reader cost: 0.1538 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3892 - reader cost: 0.1558 14/125 [==>...........................] - ETA: 47s - batch_cost: 0.3889 - reader cost: 0.1542 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3884 - reader cost: 0.1523 16/125 [==>...........................] - ETA: 46s - batch_cost: 0.3888 - reader cost: 0.1518 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3905 - reader cost: 0.1525 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3896 - reader cost: 0.1507 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3929 - reader cost: 0.1534 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3954 - reader cost: 0.1548 21/125 [====>.........................] - ETA: 43s - batch_cost: 0.3939 - reader cost: 0.1528 22/125 [====>.........................] - ETA: 43s - batch_cost: 0.3959 - reader cost: 0.1522 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.3963 - reader cost: 0.1504 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.3990 - reader cost: 0.1514 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4001 - reader cost: 0.1522 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4018 - reader cost: 0.1539 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4032 - reader cost: 0.1548 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4014 - reader cost: 0.1528 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4027 - reader cost: 0.1539 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4036 - reader cost: 0.1546 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.4051 - reader cost: 0.1555 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4058 - reader cost: 0.1559 33/125 [======>.......................] - ETA: 38s - batch_cost: 0.4048 - reader cost: 0.1547 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4058 - reader cost: 0.1555 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4062 - reader cost: 0.1559 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4073 - reader cost: 0.1567 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4083 - reader cost: 0.1575 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4076 - reader cost: 0.1569 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4081 - reader cost: 0.1573 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4072 - reader cost: 0.1564 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4062 - reader cost: 0.1554 42/125 [=========>....................] - ETA: 34s - batch_cost: 0.4054 - reader cost: 0.1546 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4055 - reader cost: 0.1547 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4062 - reader cost: 0.1550 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4048 - reader cost: 0.1535 46/125 [==========>...................] - ETA: 32s - batch_cost: 0.4039 - reader cost: 0.1526 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4036 - reader cost: 0.1519 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4041 - reader cost: 0.1524 49/125 [==========>...................] - ETA: 31s - batch_cost: 0.4044 - reader cost: 0.1527 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4042 - reader cost: 0.1522 51/125 [===========>..................] - ETA: 30s - batch_cost: 0.4040 - reader cost: 0.1519 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4043 - reader cost: 0.1511 53/125 [===========>..................] - ETA: 29s - batch_cost: 0.4047 - reader cost: 0.1505 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4046 - reader cost: 0.1498 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4052 - reader cost: 0.1504 56/125 [============>.................] - ETA: 28s - batch_cost: 0.4045 - reader cost: 0.1498 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4052 - reader cost: 0.1506 58/125 [============>.................] - ETA: 27s - batch_cost: 0.4057 - reader cost: 0.1511 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4060 - reader cost: 0.1516 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4058 - reader cost: 0.1514 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4060 - reader cost: 0.1516 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4069 - reader cost: 0.1523 63/125 [==============>...............] - ETA: 25s - batch_cost: 0.4063 - reader cost: 0.1515 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4060 - reader cost: 0.1508 65/125 [==============>...............] - ETA: 24s - batch_cost: 0.4060 - reader cost: 0.1503 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4062 - reader cost: 0.1506 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4059 - reader cost: 0.1502 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4065 - reader cost: 0.1505 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4069 - reader cost: 0.1510 70/125 [===============>..............] - ETA: 22s - batch_cost: 0.4071 - reader cost: 0.1508 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4079 - reader cost: 0.1512 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4085 - reader cost: 0.1519 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4081 - reader cost: 0.1515 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4083 - reader cost: 0.1515 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4087 - reader cost: 0.1518 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4089 - reader cost: 0.1521 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4093 - reader cost: 0.1526 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4096 - reader cost: 0.1529 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4092 - reader cost: 0.1525 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4088 - reader cost: 0.1522 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4091 - reader cost: 0.1526 82/125 [==================>...........] - ETA: 17s - batch_cost: 0.4087 - reader cost: 0.1522 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4085 - reader cost: 0.1521 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4088 - reader cost: 0.1524 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4085 - reader cost: 0.1522 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4083 - reader cost: 0.1518 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4087 - reader cost: 0.1521 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4088 - reader cost: 0.1524 89/125 [====================>.........] - ETA: 14s - batch_cost: 0.4093 - reader cost: 0.1530 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4093 - reader cost: 0.1530 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4090 - reader cost: 0.1527 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4095 - reader cost: 0.1532 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4097 - reader cost: 0.1534 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4099 - reader cost: 0.1537 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4100 - reader cost: 0.1539 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4102 - reader cost: 0.1542 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4100 - reader cost: 0.1540 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4103 - reader cost: 0.1544 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4108 - reader cost: 0.1549 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4112 - reader cost: 0.1554 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4117 - reader cost: 0.1557 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4116 - reader cost: 0.1556  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4113 - reader cost: 0.1554 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4109 - reader cost: 0.1550 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4104 - reader cost: 0.1546 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4105 - reader cost: 0.1547 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4108 - reader cost: 0.1549 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4105 - reader cost: 0.1546 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4108 - reader cost: 0.1551 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4110 - reader cost: 0.1553 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4108 - reader cost: 0.1551 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4108 - reader cost: 0.1552 113/125 [==========================>...] - ETA: 4s - batch_cost: 0.4108 - reader cost: 0.1551 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4104 - reader cost: 0.1547 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4100 - reader cost: 0.1543 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4101 - reader cost: 0.1546 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4104 - reader cost: 0.1549 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4103 - reader cost: 0.1548 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4102 - reader cost: 0.1547 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4104 - reader cost: 0.1550 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4106 - reader cost: 0.1553 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4110 - reader cost: 0.1557 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4107 - reader cost: 0.1555 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4109 - reader cost: 0.1557 125/125 [==============================] - 52s 416ms/step - batch_cost: 0.4111 - reader cost: 0.1559 2021-02-23 12:12:08 [INFO] [EVAL] #Images=500 mIoU=0.7484 Acc=0.9553 Kappa=0.9418 2021-02-23 12:12:08 [INFO] [EVAL] Class IoU: [0.971 0.7922 0.9231 0.5119 0.6123 0.6576 0.7139 0.8042 0.9196 0.5822 0.9413 0.8136 0.6126 0.9488 0.6808 0.8056 0.7414 0.4294 0.7589] 2021-02-23 12:12:08 [INFO] [EVAL] Class Acc: [0.9799 0.9247 0.9567 0.8317 0.8574 0.8377 0.8634 0.9209 0.9521 0.6883 0.9634 0.8687 0.717 0.9711 0.9038 0.9041 0.9413 0.8288 0.8225] 2021-02-23 12:12:13 [INFO] [EVAL] The model with the best validation mIoU (0.7816) was saved at iter 44000. 2021-02-23 12:12:26 [INFO] [TRAIN] epoch=124, iter=46010/80000, loss=0.8689, lr=0.004629, batch_cost=1.3544, reader_cost=0.0001 | ETA 12:47:17 2021-02-23 12:12:40 [INFO] [TRAIN] epoch=124, iter=46020/80000, loss=0.7983, lr=0.004627, batch_cost=1.3588, reader_cost=0.0001 | ETA 12:49:31 2021-02-23 12:12:54 [INFO] [TRAIN] epoch=124, iter=46030/80000, loss=0.9166, lr=0.004626, batch_cost=1.3578, reader_cost=0.0001 | ETA 12:48:45 2021-02-23 12:13:08 [INFO] [TRAIN] epoch=124, iter=46040/80000, loss=1.1216, lr=0.004625, batch_cost=1.4005, reader_cost=0.0001 | ETA 13:12:40 2021-02-23 12:13:21 [INFO] [TRAIN] epoch=124, iter=46050/80000, loss=0.7735, lr=0.004624, batch_cost=1.3703, reader_cost=0.0001 | ETA 12:55:20 2021-02-23 12:13:35 [INFO] [TRAIN] epoch=124, iter=46060/80000, loss=0.8717, lr=0.004622, batch_cost=1.3752, reader_cost=0.0001 | ETA 12:57:55 2021-02-23 12:13:49 [INFO] [TRAIN] epoch=124, iter=46070/80000, loss=0.8047, lr=0.004621, batch_cost=1.4032, reader_cost=0.0001 | ETA 13:13:32 2021-02-23 12:14:03 [INFO] [TRAIN] epoch=124, iter=46080/80000, loss=0.8246, lr=0.004620, batch_cost=1.3713, reader_cost=0.0001 | ETA 12:55:16 2021-02-23 12:14:16 [INFO] [TRAIN] epoch=124, iter=46090/80000, loss=0.8862, lr=0.004619, batch_cost=1.3623, reader_cost=0.0001 | ETA 12:49:56 2021-02-23 12:14:30 [INFO] [TRAIN] epoch=124, iter=46100/80000, loss=0.8638, lr=0.004618, batch_cost=1.3307, reader_cost=0.0001 | ETA 12:31:49 2021-02-23 12:14:43 [INFO] [TRAIN] epoch=124, iter=46110/80000, loss=0.8195, lr=0.004616, batch_cost=1.3365, reader_cost=0.0001 | ETA 12:34:55 2021-02-23 12:14:57 [INFO] [TRAIN] epoch=124, iter=46120/80000, loss=0.8305, lr=0.004615, batch_cost=1.3749, reader_cost=0.0001 | ETA 12:56:20 2021-02-23 12:15:11 [INFO] [TRAIN] epoch=125, iter=46130/80000, loss=0.8761, lr=0.004614, batch_cost=1.4388, reader_cost=0.0821 | ETA 13:32:13 2021-02-23 12:15:25 [INFO] [TRAIN] epoch=125, iter=46140/80000, loss=0.8362, lr=0.004613, batch_cost=1.3602, reader_cost=0.0001 | ETA 12:47:36 2021-02-23 12:15:38 [INFO] [TRAIN] epoch=125, iter=46150/80000, loss=0.8626, lr=0.004611, batch_cost=1.3502, reader_cost=0.0001 | ETA 12:41:45 2021-02-23 12:15:52 [INFO] [TRAIN] epoch=125, iter=46160/80000, loss=0.8350, lr=0.004610, batch_cost=1.3688, reader_cost=0.0001 | ETA 12:52:01 2021-02-23 12:16:06 [INFO] [TRAIN] epoch=125, iter=46170/80000, loss=0.8559, lr=0.004609, batch_cost=1.3522, reader_cost=0.0001 | ETA 12:42:23 2021-02-23 12:16:19 [INFO] [TRAIN] epoch=125, iter=46180/80000, loss=0.8680, lr=0.004608, batch_cost=1.3560, reader_cost=0.0001 | ETA 12:44:19 2021-02-23 12:16:33 [INFO] [TRAIN] epoch=125, iter=46190/80000, loss=0.8993, lr=0.004607, batch_cost=1.3762, reader_cost=0.0001 | ETA 12:55:29 2021-02-23 12:16:47 [INFO] [TRAIN] epoch=125, iter=46200/80000, loss=0.9203, lr=0.004605, batch_cost=1.3756, reader_cost=0.0001 | ETA 12:54:56 2021-02-23 12:17:01 [INFO] [TRAIN] epoch=125, iter=46210/80000, loss=0.8784, lr=0.004604, batch_cost=1.3946, reader_cost=0.0001 | ETA 13:05:24 2021-02-23 12:17:14 [INFO] [TRAIN] epoch=125, iter=46220/80000, loss=0.9557, lr=0.004603, batch_cost=1.3631, reader_cost=0.0001 | ETA 12:47:27 2021-02-23 12:17:28 [INFO] [TRAIN] epoch=125, iter=46230/80000, loss=0.8614, lr=0.004602, batch_cost=1.3935, reader_cost=0.0001 | ETA 13:04:18 2021-02-23 12:17:42 [INFO] [TRAIN] epoch=125, iter=46240/80000, loss=0.9180, lr=0.004600, batch_cost=1.3766, reader_cost=0.0001 | ETA 12:54:35 2021-02-23 12:17:56 [INFO] [TRAIN] epoch=125, iter=46250/80000, loss=0.9991, lr=0.004599, batch_cost=1.3945, reader_cost=0.0001 | ETA 13:04:24 2021-02-23 12:18:10 [INFO] [TRAIN] epoch=125, iter=46260/80000, loss=0.8659, lr=0.004598, batch_cost=1.3808, reader_cost=0.0001 | ETA 12:56:29 2021-02-23 12:18:24 [INFO] [TRAIN] epoch=125, iter=46270/80000, loss=0.9023, lr=0.004597, batch_cost=1.3814, reader_cost=0.0001 | ETA 12:56:34 2021-02-23 12:18:37 [INFO] [TRAIN] epoch=125, iter=46280/80000, loss=0.8097, lr=0.004595, batch_cost=1.3491, reader_cost=0.0001 | ETA 12:38:11 2021-02-23 12:18:51 [INFO] [TRAIN] epoch=125, iter=46290/80000, loss=0.8827, lr=0.004594, batch_cost=1.3498, reader_cost=0.0001 | ETA 12:38:21 2021-02-23 12:19:04 [INFO] [TRAIN] epoch=125, iter=46300/80000, loss=0.9019, lr=0.004593, batch_cost=1.3772, reader_cost=0.0001 | ETA 12:53:30 2021-02-23 12:19:18 [INFO] [TRAIN] epoch=125, iter=46310/80000, loss=0.8133, lr=0.004592, batch_cost=1.3741, reader_cost=0.0001 | ETA 12:51:34 2021-02-23 12:19:32 [INFO] [TRAIN] epoch=125, iter=46320/80000, loss=0.8007, lr=0.004591, batch_cost=1.3650, reader_cost=0.0001 | ETA 12:46:12 2021-02-23 12:19:45 [INFO] [TRAIN] epoch=125, iter=46330/80000, loss=0.8453, lr=0.004589, batch_cost=1.3642, reader_cost=0.0001 | ETA 12:45:33 2021-02-23 12:19:59 [INFO] [TRAIN] epoch=125, iter=46340/80000, loss=0.8834, lr=0.004588, batch_cost=1.3829, reader_cost=0.0001 | ETA 12:55:49 2021-02-23 12:20:13 [INFO] [TRAIN] epoch=125, iter=46350/80000, loss=0.8939, lr=0.004587, batch_cost=1.3646, reader_cost=0.0001 | ETA 12:45:18 2021-02-23 12:20:27 [INFO] [TRAIN] epoch=125, iter=46360/80000, loss=0.8441, lr=0.004586, batch_cost=1.3861, reader_cost=0.0001 | ETA 12:57:09 2021-02-23 12:20:41 [INFO] [TRAIN] epoch=125, iter=46370/80000, loss=0.8116, lr=0.004584, batch_cost=1.3903, reader_cost=0.0001 | ETA 12:59:14 2021-02-23 12:20:54 [INFO] [TRAIN] epoch=125, iter=46380/80000, loss=0.9225, lr=0.004583, batch_cost=1.3662, reader_cost=0.0001 | ETA 12:45:33 2021-02-23 12:21:08 [INFO] [TRAIN] epoch=125, iter=46390/80000, loss=0.9299, lr=0.004582, batch_cost=1.3827, reader_cost=0.0001 | ETA 12:54:33 2021-02-23 12:21:22 [INFO] [TRAIN] epoch=125, iter=46400/80000, loss=0.9127, lr=0.004581, batch_cost=1.3764, reader_cost=0.0001 | ETA 12:50:47 2021-02-23 12:21:36 [INFO] [TRAIN] epoch=125, iter=46410/80000, loss=1.0056, lr=0.004580, batch_cost=1.3696, reader_cost=0.0001 | ETA 12:46:44 2021-02-23 12:21:49 [INFO] [TRAIN] epoch=125, iter=46420/80000, loss=0.8825, lr=0.004578, batch_cost=1.3913, reader_cost=0.0001 | ETA 12:58:38 2021-02-23 12:22:03 [INFO] [TRAIN] epoch=125, iter=46430/80000, loss=0.8914, lr=0.004577, batch_cost=1.3647, reader_cost=0.0001 | ETA 12:43:32 2021-02-23 12:22:17 [INFO] [TRAIN] epoch=125, iter=46440/80000, loss=0.8573, lr=0.004576, batch_cost=1.3656, reader_cost=0.0001 | ETA 12:43:49 2021-02-23 12:22:30 [INFO] [TRAIN] epoch=125, iter=46450/80000, loss=0.8638, lr=0.004575, batch_cost=1.3379, reader_cost=0.0001 | ETA 12:28:07 2021-02-23 12:22:44 [INFO] [TRAIN] epoch=125, iter=46460/80000, loss=0.9185, lr=0.004573, batch_cost=1.3429, reader_cost=0.0001 | ETA 12:30:39 2021-02-23 12:22:57 [INFO] [TRAIN] epoch=125, iter=46470/80000, loss=0.9019, lr=0.004572, batch_cost=1.3590, reader_cost=0.0001 | ETA 12:39:28 2021-02-23 12:23:11 [INFO] [TRAIN] epoch=125, iter=46480/80000, loss=0.9490, lr=0.004571, batch_cost=1.3604, reader_cost=0.0001 | ETA 12:40:02 2021-02-23 12:23:25 [INFO] [TRAIN] epoch=125, iter=46490/80000, loss=0.8174, lr=0.004570, batch_cost=1.3844, reader_cost=0.0001 | ETA 12:53:12 2021-02-23 12:23:38 [INFO] [TRAIN] epoch=125, iter=46500/80000, loss=1.0090, lr=0.004568, batch_cost=1.3232, reader_cost=0.0001 | ETA 12:18:47 2021-02-23 12:23:52 [INFO] [TRAIN] epoch=126, iter=46510/80000, loss=0.8784, lr=0.004567, batch_cost=1.4629, reader_cost=0.0855 | ETA 13:36:33 2021-02-23 12:24:06 [INFO] [TRAIN] epoch=126, iter=46520/80000, loss=0.9092, lr=0.004566, batch_cost=1.3399, reader_cost=0.0001 | ETA 12:27:41 2021-02-23 12:24:19 [INFO] [TRAIN] epoch=126, iter=46530/80000, loss=0.8274, lr=0.004565, batch_cost=1.3566, reader_cost=0.0001 | ETA 12:36:46 2021-02-23 12:24:33 [INFO] [TRAIN] epoch=126, iter=46540/80000, loss=0.8880, lr=0.004564, batch_cost=1.3577, reader_cost=0.0001 | ETA 12:37:07 2021-02-23 12:24:47 [INFO] [TRAIN] epoch=126, iter=46550/80000, loss=0.8557, lr=0.004562, batch_cost=1.3789, reader_cost=0.0001 | ETA 12:48:43 2021-02-23 12:25:00 [INFO] [TRAIN] epoch=126, iter=46560/80000, loss=0.8582, lr=0.004561, batch_cost=1.3462, reader_cost=0.0001 | ETA 12:30:18 2021-02-23 12:25:14 [INFO] [TRAIN] epoch=126, iter=46570/80000, loss=0.8061, lr=0.004560, batch_cost=1.3644, reader_cost=0.0001 | ETA 12:40:12 2021-02-23 12:25:28 [INFO] [TRAIN] epoch=126, iter=46580/80000, loss=0.8807, lr=0.004559, batch_cost=1.3688, reader_cost=0.0001 | ETA 12:42:26 2021-02-23 12:25:41 [INFO] [TRAIN] epoch=126, iter=46590/80000, loss=0.8581, lr=0.004557, batch_cost=1.3778, reader_cost=0.0001 | ETA 12:47:13 2021-02-23 12:25:55 [INFO] [TRAIN] epoch=126, iter=46600/80000, loss=0.8921, lr=0.004556, batch_cost=1.3789, reader_cost=0.0001 | ETA 12:47:34 2021-02-23 12:26:09 [INFO] [TRAIN] epoch=126, iter=46610/80000, loss=0.8630, lr=0.004555, batch_cost=1.3671, reader_cost=0.0001 | ETA 12:40:48 2021-02-23 12:26:23 [INFO] [TRAIN] epoch=126, iter=46620/80000, loss=0.8603, lr=0.004554, batch_cost=1.3790, reader_cost=0.0006 | ETA 12:47:11 2021-02-23 12:26:36 [INFO] [TRAIN] epoch=126, iter=46630/80000, loss=0.9038, lr=0.004553, batch_cost=1.3658, reader_cost=0.0001 | ETA 12:39:37 2021-02-23 12:26:50 [INFO] [TRAIN] epoch=126, iter=46640/80000, loss=0.9089, lr=0.004551, batch_cost=1.3525, reader_cost=0.0001 | ETA 12:32:00 2021-02-23 12:27:03 [INFO] [TRAIN] epoch=126, iter=46650/80000, loss=0.8812, lr=0.004550, batch_cost=1.3628, reader_cost=0.0001 | ETA 12:37:29 2021-02-23 12:27:17 [INFO] [TRAIN] epoch=126, iter=46660/80000, loss=1.0242, lr=0.004549, batch_cost=1.3817, reader_cost=0.0001 | ETA 12:47:45 2021-02-23 12:27:31 [INFO] [TRAIN] epoch=126, iter=46670/80000, loss=0.8602, lr=0.004548, batch_cost=1.3532, reader_cost=0.0001 | ETA 12:31:42 2021-02-23 12:27:44 [INFO] [TRAIN] epoch=126, iter=46680/80000, loss=0.8377, lr=0.004546, batch_cost=1.3552, reader_cost=0.0001 | ETA 12:32:35 2021-02-23 12:27:58 [INFO] [TRAIN] epoch=126, iter=46690/80000, loss=0.8535, lr=0.004545, batch_cost=1.3358, reader_cost=0.0001 | ETA 12:21:36 2021-02-23 12:28:11 [INFO] [TRAIN] epoch=126, iter=46700/80000, loss=0.8198, lr=0.004544, batch_cost=1.3684, reader_cost=0.0001 | ETA 12:39:29 2021-02-23 12:28:25 [INFO] [TRAIN] epoch=126, iter=46710/80000, loss=0.8101, lr=0.004543, batch_cost=1.3518, reader_cost=0.0001 | ETA 12:30:01 2021-02-23 12:28:38 [INFO] [TRAIN] epoch=126, iter=46720/80000, loss=0.8738, lr=0.004541, batch_cost=1.3514, reader_cost=0.0001 | ETA 12:29:33 2021-02-23 12:28:52 [INFO] [TRAIN] epoch=126, iter=46730/80000, loss=0.8765, lr=0.004540, batch_cost=1.3551, reader_cost=0.0001 | ETA 12:31:22 2021-02-23 12:29:06 [INFO] [TRAIN] epoch=126, iter=46740/80000, loss=0.8579, lr=0.004539, batch_cost=1.3707, reader_cost=0.0001 | ETA 12:39:50 2021-02-23 12:29:19 [INFO] [TRAIN] epoch=126, iter=46750/80000, loss=0.9107, lr=0.004538, batch_cost=1.3490, reader_cost=0.0001 | ETA 12:27:34 2021-02-23 12:29:33 [INFO] [TRAIN] epoch=126, iter=46760/80000, loss=0.9259, lr=0.004537, batch_cost=1.3678, reader_cost=0.0001 | ETA 12:37:46 2021-02-23 12:29:46 [INFO] [TRAIN] epoch=126, iter=46770/80000, loss=0.8106, lr=0.004535, batch_cost=1.3631, reader_cost=0.0001 | ETA 12:34:57 2021-02-23 12:30:00 [INFO] [TRAIN] epoch=126, iter=46780/80000, loss=0.9522, lr=0.004534, batch_cost=1.3524, reader_cost=0.0001 | ETA 12:28:47 2021-02-23 12:30:14 [INFO] [TRAIN] epoch=126, iter=46790/80000, loss=0.9705, lr=0.004533, batch_cost=1.3817, reader_cost=0.0001 | ETA 12:44:46 2021-02-23 12:30:27 [INFO] [TRAIN] epoch=126, iter=46800/80000, loss=0.8168, lr=0.004532, batch_cost=1.3574, reader_cost=0.0001 | ETA 12:31:05 2021-02-23 12:30:41 [INFO] [TRAIN] epoch=126, iter=46810/80000, loss=0.9203, lr=0.004530, batch_cost=1.3756, reader_cost=0.0001 | ETA 12:40:57 2021-02-23 12:30:55 [INFO] [TRAIN] epoch=126, iter=46820/80000, loss=0.7874, lr=0.004529, batch_cost=1.3662, reader_cost=0.0001 | ETA 12:35:30 2021-02-23 12:31:09 [INFO] [TRAIN] epoch=126, iter=46830/80000, loss=0.8823, lr=0.004528, batch_cost=1.3708, reader_cost=0.0001 | ETA 12:37:50 2021-02-23 12:31:22 [INFO] [TRAIN] epoch=126, iter=46840/80000, loss=0.8979, lr=0.004527, batch_cost=1.3681, reader_cost=0.0001 | ETA 12:36:05 2021-02-23 12:31:36 [INFO] [TRAIN] epoch=126, iter=46850/80000, loss=0.9155, lr=0.004525, batch_cost=1.3706, reader_cost=0.0001 | ETA 12:37:16 2021-02-23 12:31:50 [INFO] [TRAIN] epoch=126, iter=46860/80000, loss=0.8228, lr=0.004524, batch_cost=1.3838, reader_cost=0.0001 | ETA 12:44:18 2021-02-23 12:32:03 [INFO] [TRAIN] epoch=126, iter=46870/80000, loss=0.9722, lr=0.004523, batch_cost=1.3301, reader_cost=0.0001 | ETA 12:14:25 2021-02-23 12:32:18 [INFO] [TRAIN] epoch=127, iter=46880/80000, loss=0.8581, lr=0.004522, batch_cost=1.4557, reader_cost=0.0787 | ETA 13:23:33 2021-02-23 12:32:31 [INFO] [TRAIN] epoch=127, iter=46890/80000, loss=0.8245, lr=0.004521, batch_cost=1.3626, reader_cost=0.0001 | ETA 12:31:56 2021-02-23 12:32:45 [INFO] [TRAIN] epoch=127, iter=46900/80000, loss=0.9167, lr=0.004519, batch_cost=1.3887, reader_cost=0.0001 | ETA 12:46:07 2021-02-23 12:32:59 [INFO] [TRAIN] epoch=127, iter=46910/80000, loss=0.8333, lr=0.004518, batch_cost=1.3522, reader_cost=0.0001 | ETA 12:25:45 2021-02-23 12:33:12 [INFO] [TRAIN] epoch=127, iter=46920/80000, loss=0.8511, lr=0.004517, batch_cost=1.3541, reader_cost=0.0022 | ETA 12:26:34 2021-02-23 12:33:26 [INFO] [TRAIN] epoch=127, iter=46930/80000, loss=0.8912, lr=0.004516, batch_cost=1.3710, reader_cost=0.0001 | ETA 12:35:37 2021-02-23 12:33:40 [INFO] [TRAIN] epoch=127, iter=46940/80000, loss=0.9821, lr=0.004514, batch_cost=1.3708, reader_cost=0.0001 | ETA 12:35:18 2021-02-23 12:33:53 [INFO] [TRAIN] epoch=127, iter=46950/80000, loss=0.8526, lr=0.004513, batch_cost=1.3562, reader_cost=0.0001 | ETA 12:27:01 2021-02-23 12:34:07 [INFO] [TRAIN] epoch=127, iter=46960/80000, loss=0.8970, lr=0.004512, batch_cost=1.3481, reader_cost=0.0001 | ETA 12:22:20 2021-02-23 12:34:20 [INFO] [TRAIN] epoch=127, iter=46970/80000, loss=0.8539, lr=0.004511, batch_cost=1.3528, reader_cost=0.0001 | ETA 12:24:42 2021-02-23 12:34:33 [INFO] [TRAIN] epoch=127, iter=46980/80000, loss=0.8790, lr=0.004510, batch_cost=1.3232, reader_cost=0.0001 | ETA 12:08:11 2021-02-23 12:34:47 [INFO] [TRAIN] epoch=127, iter=46990/80000, loss=0.8085, lr=0.004508, batch_cost=1.4043, reader_cost=0.0001 | ETA 12:52:35 2021-02-23 12:35:01 [INFO] [TRAIN] epoch=127, iter=47000/80000, loss=0.9608, lr=0.004507, batch_cost=1.3440, reader_cost=0.0001 | ETA 12:19:12 2021-02-23 12:35:01 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:18 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:03 - batch_cost: 0.1965 - reader cost: 0.0715  3/125 [..............................] - ETA: 1:00 - batch_cost: 0.2816 - reader cost: 0.1129 4/125 [..............................] - ETA: 57s - batch_cost: 0.3150 - reader cost: 0.1262  5/125 [>.............................] - ETA: 55s - batch_cost: 0.3380 - reader cost: 0.1350 6/125 [>.............................] - ETA: 54s - batch_cost: 0.3528 - reader cost: 0.1411 7/125 [>.............................] - ETA: 53s - batch_cost: 0.3630 - reader cost: 0.1455 8/125 [>.............................] - ETA: 52s - batch_cost: 0.3670 - reader cost: 0.1455 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3750 - reader cost: 0.1496 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3747 - reader cost: 0.1470 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3795 - reader cost: 0.1496 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3830 - reader cost: 0.1515 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3873 - reader cost: 0.1535 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3902 - reader cost: 0.1551 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3933 - reader cost: 0.1567 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3966 - reader cost: 0.1590 17/125 [===>..........................] - ETA: 47s - batch_cost: 0.4017 - reader cost: 0.1622 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.3986 - reader cost: 0.1584 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3996 - reader cost: 0.1586 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.3990 - reader cost: 0.1574 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4014 - reader cost: 0.1593 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4009 - reader cost: 0.1580 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4023 - reader cost: 0.1590 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4037 - reader cost: 0.1603 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4025 - reader cost: 0.1588 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4044 - reader cost: 0.1605 27/125 [=====>........................] - ETA: 42s - batch_cost: 0.4065 - reader cost: 0.1625 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4086 - reader cost: 0.1641 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4087 - reader cost: 0.1640 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4092 - reader cost: 0.1643 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4097 - reader cost: 0.1647 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4085 - reader cost: 0.1634 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4073 - reader cost: 0.1619 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4060 - reader cost: 0.1606 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4053 - reader cost: 0.1597 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4057 - reader cost: 0.1600 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4063 - reader cost: 0.1602 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4071 - reader cost: 0.1596 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4065 - reader cost: 0.1584 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4070 - reader cost: 0.1588 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4067 - reader cost: 0.1577 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4075 - reader cost: 0.1582 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4078 - reader cost: 0.1583 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4069 - reader cost: 0.1574 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4074 - reader cost: 0.1578 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4067 - reader cost: 0.1572 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4061 - reader cost: 0.1565 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4066 - reader cost: 0.1570 49/125 [==========>...................] - ETA: 31s - batch_cost: 0.4059 - reader cost: 0.1563 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4064 - reader cost: 0.1568 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4070 - reader cost: 0.1575 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4065 - reader cost: 0.1565 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4060 - reader cost: 0.1558 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4063 - reader cost: 0.1560 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4067 - reader cost: 0.1565 56/125 [============>.................] - ETA: 28s - batch_cost: 0.4063 - reader cost: 0.1561 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4062 - reader cost: 0.1557 58/125 [============>.................] - ETA: 27s - batch_cost: 0.4068 - reader cost: 0.1561 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4076 - reader cost: 0.1567 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4069 - reader cost: 0.1558 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4073 - reader cost: 0.1561 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4077 - reader cost: 0.1558 63/125 [==============>...............] - ETA: 25s - batch_cost: 0.4080 - reader cost: 0.1560 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4084 - reader cost: 0.1564 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4090 - reader cost: 0.1569 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4082 - reader cost: 0.1561 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4086 - reader cost: 0.1565 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4092 - reader cost: 0.1570 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4092 - reader cost: 0.1569 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4095 - reader cost: 0.1573 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4093 - reader cost: 0.1571 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4095 - reader cost: 0.1573 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4097 - reader cost: 0.1575 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4093 - reader cost: 0.1571 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4099 - reader cost: 0.1576 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4101 - reader cost: 0.1578 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4105 - reader cost: 0.1580 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4109 - reader cost: 0.1583 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4111 - reader cost: 0.1586 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4114 - reader cost: 0.1589 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4115 - reader cost: 0.1590 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4119 - reader cost: 0.1593 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4122 - reader cost: 0.1595 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4123 - reader cost: 0.1597 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4120 - reader cost: 0.1594 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4122 - reader cost: 0.1595 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4119 - reader cost: 0.1592 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4122 - reader cost: 0.1594 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4120 - reader cost: 0.1592 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4122 - reader cost: 0.1594 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4123 - reader cost: 0.1595 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4124 - reader cost: 0.1596 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4125 - reader cost: 0.1597 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4120 - reader cost: 0.1591 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4115 - reader cost: 0.1587 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4116 - reader cost: 0.1589 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4117 - reader cost: 0.1590 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4113 - reader cost: 0.1586 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4113 - reader cost: 0.1587 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4112 - reader cost: 0.1586 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4110 - reader cost: 0.1584 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4113 - reader cost: 0.1587  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4109 - reader cost: 0.1584 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4104 - reader cost: 0.1579 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4101 - reader cost: 0.1576 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4105 - reader cost: 0.1579 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4105 - reader cost: 0.1579 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4101 - reader cost: 0.1575 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4103 - reader cost: 0.1577 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4103 - reader cost: 0.1578 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4104 - reader cost: 0.1580 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4106 - reader cost: 0.1582 113/125 [==========================>...] - ETA: 4s - batch_cost: 0.4107 - reader cost: 0.1583 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4109 - reader cost: 0.1585 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4110 - reader cost: 0.1586 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4112 - reader cost: 0.1588 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4113 - reader cost: 0.1589 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4114 - reader cost: 0.1589 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4110 - reader cost: 0.1586 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4106 - reader cost: 0.1582 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4104 - reader cost: 0.1580 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4102 - reader cost: 0.1579 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4099 - reader cost: 0.1576 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4100 - reader cost: 0.1573 125/125 [==============================] - 52s 415ms/step - batch_cost: 0.4100 - reader cost: 0.1569 2021-02-23 12:35:53 [INFO] [EVAL] #Images=500 mIoU=0.7230 Acc=0.9496 Kappa=0.9344 2021-02-23 12:35:53 [INFO] [EVAL] Class IoU: [0.9723 0.8029 0.8991 0.3138 0.5008 0.6374 0.6889 0.7939 0.9055 0.6163 0.9413 0.8172 0.6271 0.9352 0.6361 0.6688 0.5631 0.643 0.7739] 2021-02-23 12:35:53 [INFO] [EVAL] Class Acc: [0.9816 0.8962 0.9247 0.79 0.8107 0.8452 0.8381 0.9188 0.9566 0.7771 0.956 0.9079 0.8304 0.9685 0.934 0.8717 0.9705 0.8194 0.8608] 2021-02-23 12:35:57 [INFO] [EVAL] The model with the best validation mIoU (0.7816) was saved at iter 44000. 2021-02-23 12:36:10 [INFO] [TRAIN] epoch=127, iter=47010/80000, loss=0.8814, lr=0.004506, batch_cost=1.3261, reader_cost=0.0001 | ETA 12:09:08 2021-02-23 12:36:24 [INFO] [TRAIN] epoch=127, iter=47020/80000, loss=0.8359, lr=0.004505, batch_cost=1.3609, reader_cost=0.0001 | ETA 12:28:01 2021-02-23 12:36:37 [INFO] [TRAIN] epoch=127, iter=47030/80000, loss=0.8446, lr=0.004503, batch_cost=1.3594, reader_cost=0.0001 | ETA 12:26:58 2021-02-23 12:36:51 [INFO] [TRAIN] epoch=127, iter=47040/80000, loss=0.8603, lr=0.004502, batch_cost=1.3374, reader_cost=0.0001 | ETA 12:14:39 2021-02-23 12:37:04 [INFO] [TRAIN] epoch=127, iter=47050/80000, loss=0.8723, lr=0.004501, batch_cost=1.3430, reader_cost=0.0001 | ETA 12:17:30 2021-02-23 12:37:17 [INFO] [TRAIN] epoch=127, iter=47060/80000, loss=0.8662, lr=0.004500, batch_cost=1.3261, reader_cost=0.0001 | ETA 12:08:02 2021-02-23 12:37:31 [INFO] [TRAIN] epoch=127, iter=47070/80000, loss=0.9390, lr=0.004498, batch_cost=1.3516, reader_cost=0.0001 | ETA 12:21:47 2021-02-23 12:37:44 [INFO] [TRAIN] epoch=127, iter=47080/80000, loss=0.8652, lr=0.004497, batch_cost=1.3441, reader_cost=0.0001 | ETA 12:17:27 2021-02-23 12:37:58 [INFO] [TRAIN] epoch=127, iter=47090/80000, loss=0.8696, lr=0.004496, batch_cost=1.3368, reader_cost=0.0001 | ETA 12:13:14 2021-02-23 12:38:12 [INFO] [TRAIN] epoch=127, iter=47100/80000, loss=0.8647, lr=0.004495, batch_cost=1.3864, reader_cost=0.0001 | ETA 12:40:11 2021-02-23 12:38:26 [INFO] [TRAIN] epoch=127, iter=47110/80000, loss=0.8785, lr=0.004494, batch_cost=1.3927, reader_cost=0.0001 | ETA 12:43:24 2021-02-23 12:38:39 [INFO] [TRAIN] epoch=127, iter=47120/80000, loss=0.8738, lr=0.004492, batch_cost=1.3724, reader_cost=0.0001 | ETA 12:32:05 2021-02-23 12:38:53 [INFO] [TRAIN] epoch=127, iter=47130/80000, loss=0.9419, lr=0.004491, batch_cost=1.3504, reader_cost=0.0001 | ETA 12:19:49 2021-02-23 12:39:06 [INFO] [TRAIN] epoch=127, iter=47140/80000, loss=0.8516, lr=0.004490, batch_cost=1.3590, reader_cost=0.0001 | ETA 12:24:18 2021-02-23 12:39:20 [INFO] [TRAIN] epoch=127, iter=47150/80000, loss=0.9847, lr=0.004489, batch_cost=1.3338, reader_cost=0.0001 | ETA 12:10:16 2021-02-23 12:39:34 [INFO] [TRAIN] epoch=127, iter=47160/80000, loss=0.8955, lr=0.004487, batch_cost=1.4117, reader_cost=0.0001 | ETA 12:52:41 2021-02-23 12:39:47 [INFO] [TRAIN] epoch=127, iter=47170/80000, loss=0.9115, lr=0.004486, batch_cost=1.3439, reader_cost=0.0001 | ETA 12:15:19 2021-02-23 12:40:01 [INFO] [TRAIN] epoch=127, iter=47180/80000, loss=0.8043, lr=0.004485, batch_cost=1.3470, reader_cost=0.0001 | ETA 12:16:47 2021-02-23 12:40:14 [INFO] [TRAIN] epoch=127, iter=47190/80000, loss=0.9416, lr=0.004484, batch_cost=1.3482, reader_cost=0.0001 | ETA 12:17:13 2021-02-23 12:40:27 [INFO] [TRAIN] epoch=127, iter=47200/80000, loss=0.8337, lr=0.004482, batch_cost=1.3223, reader_cost=0.0001 | ETA 12:02:51 2021-02-23 12:40:41 [INFO] [TRAIN] epoch=127, iter=47210/80000, loss=0.8438, lr=0.004481, batch_cost=1.3551, reader_cost=0.0001 | ETA 12:20:33 2021-02-23 12:40:54 [INFO] [TRAIN] epoch=127, iter=47220/80000, loss=0.9650, lr=0.004480, batch_cost=1.3410, reader_cost=0.0001 | ETA 12:12:39 2021-02-23 12:41:08 [INFO] [TRAIN] epoch=127, iter=47230/80000, loss=0.8365, lr=0.004479, batch_cost=1.3569, reader_cost=0.0001 | ETA 12:21:04 2021-02-23 12:41:22 [INFO] [TRAIN] epoch=127, iter=47240/80000, loss=0.9017, lr=0.004478, batch_cost=1.3526, reader_cost=0.0001 | ETA 12:18:31 2021-02-23 12:41:36 [INFO] [TRAIN] epoch=128, iter=47250/80000, loss=1.0016, lr=0.004476, batch_cost=1.4779, reader_cost=0.0934 | ETA 13:26:40 2021-02-23 12:41:50 [INFO] [TRAIN] epoch=128, iter=47260/80000, loss=0.9294, lr=0.004475, batch_cost=1.3215, reader_cost=0.0001 | ETA 12:01:07 2021-02-23 12:42:03 [INFO] [TRAIN] epoch=128, iter=47270/80000, loss=0.7962, lr=0.004474, batch_cost=1.3649, reader_cost=0.0001 | ETA 12:24:33 2021-02-23 12:42:17 [INFO] [TRAIN] epoch=128, iter=47280/80000, loss=0.7990, lr=0.004473, batch_cost=1.3397, reader_cost=0.0001 | ETA 12:10:34 2021-02-23 12:42:30 [INFO] [TRAIN] epoch=128, iter=47290/80000, loss=0.8978, lr=0.004471, batch_cost=1.3559, reader_cost=0.0001 | ETA 12:19:13 2021-02-23 12:42:44 [INFO] [TRAIN] epoch=128, iter=47300/80000, loss=0.8701, lr=0.004470, batch_cost=1.3528, reader_cost=0.0001 | ETA 12:17:16 2021-02-23 12:42:57 [INFO] [TRAIN] epoch=128, iter=47310/80000, loss=0.8412, lr=0.004469, batch_cost=1.3574, reader_cost=0.0001 | ETA 12:19:32 2021-02-23 12:43:11 [INFO] [TRAIN] epoch=128, iter=47320/80000, loss=0.8154, lr=0.004468, batch_cost=1.3480, reader_cost=0.0001 | ETA 12:14:12 2021-02-23 12:43:24 [INFO] [TRAIN] epoch=128, iter=47330/80000, loss=0.8434, lr=0.004466, batch_cost=1.3579, reader_cost=0.0001 | ETA 12:19:23 2021-02-23 12:43:38 [INFO] [TRAIN] epoch=128, iter=47340/80000, loss=0.8155, lr=0.004465, batch_cost=1.3549, reader_cost=0.0001 | ETA 12:17:31 2021-02-23 12:43:51 [INFO] [TRAIN] epoch=128, iter=47350/80000, loss=0.9070, lr=0.004464, batch_cost=1.3378, reader_cost=0.0001 | ETA 12:07:59 2021-02-23 12:44:05 [INFO] [TRAIN] epoch=128, iter=47360/80000, loss=0.9250, lr=0.004463, batch_cost=1.3470, reader_cost=0.0001 | ETA 12:12:45 2021-02-23 12:44:18 [INFO] [TRAIN] epoch=128, iter=47370/80000, loss=0.8891, lr=0.004462, batch_cost=1.3243, reader_cost=0.0001 | ETA 12:00:10 2021-02-23 12:44:32 [INFO] [TRAIN] epoch=128, iter=47380/80000, loss=0.8760, lr=0.004460, batch_cost=1.3792, reader_cost=0.0001 | ETA 12:29:49 2021-02-23 12:44:45 [INFO] [TRAIN] epoch=128, iter=47390/80000, loss=0.8348, lr=0.004459, batch_cost=1.3585, reader_cost=0.0001 | ETA 12:18:20 2021-02-23 12:44:59 [INFO] [TRAIN] epoch=128, iter=47400/80000, loss=0.9891, lr=0.004458, batch_cost=1.3707, reader_cost=0.0001 | ETA 12:24:44 2021-02-23 12:45:13 [INFO] [TRAIN] epoch=128, iter=47410/80000, loss=0.8849, lr=0.004457, batch_cost=1.3644, reader_cost=0.0001 | ETA 12:21:05 2021-02-23 12:45:26 [INFO] [TRAIN] epoch=128, iter=47420/80000, loss=0.7857, lr=0.004455, batch_cost=1.3701, reader_cost=0.0001 | ETA 12:23:56 2021-02-23 12:45:40 [INFO] [TRAIN] epoch=128, iter=47430/80000, loss=0.8595, lr=0.004454, batch_cost=1.3508, reader_cost=0.0001 | ETA 12:13:14 2021-02-23 12:45:53 [INFO] [TRAIN] epoch=128, iter=47440/80000, loss=0.8807, lr=0.004453, batch_cost=1.3590, reader_cost=0.0001 | ETA 12:17:28 2021-02-23 12:46:07 [INFO] [TRAIN] epoch=128, iter=47450/80000, loss=0.9005, lr=0.004452, batch_cost=1.3433, reader_cost=0.0001 | ETA 12:08:42 2021-02-23 12:46:21 [INFO] [TRAIN] epoch=128, iter=47460/80000, loss=0.8791, lr=0.004450, batch_cost=1.3659, reader_cost=0.0001 | ETA 12:20:47 2021-02-23 12:46:35 [INFO] [TRAIN] epoch=128, iter=47470/80000, loss=0.7813, lr=0.004449, batch_cost=1.3978, reader_cost=0.0001 | ETA 12:37:50 2021-02-23 12:46:48 [INFO] [TRAIN] epoch=128, iter=47480/80000, loss=0.9012, lr=0.004448, batch_cost=1.3593, reader_cost=0.0001 | ETA 12:16:42 2021-02-23 12:47:02 [INFO] [TRAIN] epoch=128, iter=47490/80000, loss=0.8503, lr=0.004447, batch_cost=1.3714, reader_cost=0.0001 | ETA 12:23:04 2021-02-23 12:47:15 [INFO] [TRAIN] epoch=128, iter=47500/80000, loss=0.8866, lr=0.004446, batch_cost=1.3484, reader_cost=0.0001 | ETA 12:10:23 2021-02-23 12:47:29 [INFO] [TRAIN] epoch=128, iter=47510/80000, loss=0.8627, lr=0.004444, batch_cost=1.3726, reader_cost=0.0001 | ETA 12:23:16 2021-02-23 12:47:43 [INFO] [TRAIN] epoch=128, iter=47520/80000, loss=0.8237, lr=0.004443, batch_cost=1.3557, reader_cost=0.0001 | ETA 12:13:52 2021-02-23 12:47:56 [INFO] [TRAIN] epoch=128, iter=47530/80000, loss=0.8983, lr=0.004442, batch_cost=1.3680, reader_cost=0.0008 | ETA 12:20:19 2021-02-23 12:48:10 [INFO] [TRAIN] epoch=128, iter=47540/80000, loss=0.8833, lr=0.004441, batch_cost=1.3373, reader_cost=0.0001 | ETA 12:03:29 2021-02-23 12:48:23 [INFO] [TRAIN] epoch=128, iter=47550/80000, loss=0.8442, lr=0.004439, batch_cost=1.3670, reader_cost=0.0001 | ETA 12:19:20 2021-02-23 12:48:37 [INFO] [TRAIN] epoch=128, iter=47560/80000, loss=0.8594, lr=0.004438, batch_cost=1.4024, reader_cost=0.0001 | ETA 12:38:12 2021-02-23 12:48:51 [INFO] [TRAIN] epoch=128, iter=47570/80000, loss=0.8756, lr=0.004437, batch_cost=1.3722, reader_cost=0.0001 | ETA 12:21:41 2021-02-23 12:49:05 [INFO] [TRAIN] epoch=128, iter=47580/80000, loss=0.8091, lr=0.004436, batch_cost=1.4002, reader_cost=0.0001 | ETA 12:36:34 2021-02-23 12:49:19 [INFO] [TRAIN] epoch=128, iter=47590/80000, loss=0.8622, lr=0.004434, batch_cost=1.3667, reader_cost=0.0001 | ETA 12:18:14 2021-02-23 12:49:33 [INFO] [TRAIN] epoch=128, iter=47600/80000, loss=0.8450, lr=0.004433, batch_cost=1.3876, reader_cost=0.0001 | ETA 12:29:19 2021-02-23 12:49:46 [INFO] [TRAIN] epoch=128, iter=47610/80000, loss=0.8884, lr=0.004432, batch_cost=1.3779, reader_cost=0.0001 | ETA 12:23:48 2021-02-23 12:50:01 [INFO] [TRAIN] epoch=129, iter=47620/80000, loss=0.8777, lr=0.004431, batch_cost=1.4366, reader_cost=0.0668 | ETA 12:55:17 2021-02-23 12:50:14 [INFO] [TRAIN] epoch=129, iter=47630/80000, loss=0.8728, lr=0.004430, batch_cost=1.3580, reader_cost=0.0001 | ETA 12:12:39 2021-02-23 12:50:28 [INFO] [TRAIN] epoch=129, iter=47640/80000, loss=0.9089, lr=0.004428, batch_cost=1.3559, reader_cost=0.0001 | ETA 12:11:16 2021-02-23 12:50:41 [INFO] [TRAIN] epoch=129, iter=47650/80000, loss=0.8346, lr=0.004427, batch_cost=1.3546, reader_cost=0.0001 | ETA 12:10:22 2021-02-23 12:50:55 [INFO] [TRAIN] epoch=129, iter=47660/80000, loss=0.8535, lr=0.004426, batch_cost=1.3561, reader_cost=0.0001 | ETA 12:10:55 2021-02-23 12:51:09 [INFO] [TRAIN] epoch=129, iter=47670/80000, loss=0.8709, lr=0.004425, batch_cost=1.3865, reader_cost=0.0001 | ETA 12:27:05 2021-02-23 12:51:22 [INFO] [TRAIN] epoch=129, iter=47680/80000, loss=0.8801, lr=0.004423, batch_cost=1.3413, reader_cost=0.0001 | ETA 12:02:31 2021-02-23 12:51:36 [INFO] [TRAIN] epoch=129, iter=47690/80000, loss=0.8674, lr=0.004422, batch_cost=1.4102, reader_cost=0.0001 | ETA 12:39:23 2021-02-23 12:51:50 [INFO] [TRAIN] epoch=129, iter=47700/80000, loss=0.8447, lr=0.004421, batch_cost=1.3880, reader_cost=0.0001 | ETA 12:27:13 2021-02-23 12:52:04 [INFO] [TRAIN] epoch=129, iter=47710/80000, loss=0.8746, lr=0.004420, batch_cost=1.3787, reader_cost=0.0001 | ETA 12:21:57 2021-02-23 12:52:18 [INFO] [TRAIN] epoch=129, iter=47720/80000, loss=0.9031, lr=0.004418, batch_cost=1.3856, reader_cost=0.0001 | ETA 12:25:28 2021-02-23 12:52:32 [INFO] [TRAIN] epoch=129, iter=47730/80000, loss=0.7830, lr=0.004417, batch_cost=1.3667, reader_cost=0.0001 | ETA 12:15:04 2021-02-23 12:52:45 [INFO] [TRAIN] epoch=129, iter=47740/80000, loss=0.9064, lr=0.004416, batch_cost=1.3880, reader_cost=0.0001 | ETA 12:26:15 2021-02-23 12:52:59 [INFO] [TRAIN] epoch=129, iter=47750/80000, loss=0.7950, lr=0.004415, batch_cost=1.3507, reader_cost=0.0001 | ETA 12:06:01 2021-02-23 12:53:12 [INFO] [TRAIN] epoch=129, iter=47760/80000, loss=0.8911, lr=0.004414, batch_cost=1.3485, reader_cost=0.0001 | ETA 12:04:34 2021-02-23 12:53:26 [INFO] [TRAIN] epoch=129, iter=47770/80000, loss=0.9144, lr=0.004412, batch_cost=1.3726, reader_cost=0.0001 | ETA 12:17:19 2021-02-23 12:53:40 [INFO] [TRAIN] epoch=129, iter=47780/80000, loss=0.8342, lr=0.004411, batch_cost=1.3587, reader_cost=0.0001 | ETA 12:09:37 2021-02-23 12:53:53 [INFO] [TRAIN] epoch=129, iter=47790/80000, loss=0.8657, lr=0.004410, batch_cost=1.3266, reader_cost=0.0001 | ETA 11:52:10 2021-02-23 12:54:07 [INFO] [TRAIN] epoch=129, iter=47800/80000, loss=0.9450, lr=0.004409, batch_cost=1.3596, reader_cost=0.0001 | ETA 12:09:39 2021-02-23 12:54:20 [INFO] [TRAIN] epoch=129, iter=47810/80000, loss=0.9173, lr=0.004407, batch_cost=1.3773, reader_cost=0.0001 | ETA 12:18:54 2021-02-23 12:54:34 [INFO] [TRAIN] epoch=129, iter=47820/80000, loss=0.8701, lr=0.004406, batch_cost=1.3611, reader_cost=0.0001 | ETA 12:10:00 2021-02-23 12:54:48 [INFO] [TRAIN] epoch=129, iter=47830/80000, loss=0.8991, lr=0.004405, batch_cost=1.3626, reader_cost=0.0001 | ETA 12:10:33 2021-02-23 12:55:01 [INFO] [TRAIN] epoch=129, iter=47840/80000, loss=0.9042, lr=0.004404, batch_cost=1.3478, reader_cost=0.0001 | ETA 12:02:25 2021-02-23 12:55:14 [INFO] [TRAIN] epoch=129, iter=47850/80000, loss=0.8942, lr=0.004402, batch_cost=1.3327, reader_cost=0.0001 | ETA 11:54:05 2021-02-23 12:55:28 [INFO] [TRAIN] epoch=129, iter=47860/80000, loss=0.9572, lr=0.004401, batch_cost=1.3610, reader_cost=0.0001 | ETA 12:09:02 2021-02-23 12:55:42 [INFO] [TRAIN] epoch=129, iter=47870/80000, loss=0.8763, lr=0.004400, batch_cost=1.3712, reader_cost=0.0001 | ETA 12:14:16 2021-02-23 12:55:55 [INFO] [TRAIN] epoch=129, iter=47880/80000, loss=0.8250, lr=0.004399, batch_cost=1.3539, reader_cost=0.0001 | ETA 12:04:48 2021-02-23 12:56:09 [INFO] [TRAIN] epoch=129, iter=47890/80000, loss=0.8639, lr=0.004398, batch_cost=1.3507, reader_cost=0.0001 | ETA 12:02:50 2021-02-23 12:56:22 [INFO] [TRAIN] epoch=129, iter=47900/80000, loss=0.9072, lr=0.004396, batch_cost=1.3609, reader_cost=0.0001 | ETA 12:08:06 2021-02-23 12:56:36 [INFO] [TRAIN] epoch=129, iter=47910/80000, loss=0.8655, lr=0.004395, batch_cost=1.3309, reader_cost=0.0001 | ETA 11:51:47 2021-02-23 12:56:49 [INFO] [TRAIN] epoch=129, iter=47920/80000, loss=0.9024, lr=0.004394, batch_cost=1.3666, reader_cost=0.0001 | ETA 12:10:39 2021-02-23 12:57:03 [INFO] [TRAIN] epoch=129, iter=47930/80000, loss=0.8894, lr=0.004393, batch_cost=1.3398, reader_cost=0.0001 | ETA 11:56:08 2021-02-23 12:57:17 [INFO] [TRAIN] epoch=129, iter=47940/80000, loss=0.8546, lr=0.004391, batch_cost=1.4003, reader_cost=0.0001 | ETA 12:28:14 2021-02-23 12:57:30 [INFO] [TRAIN] epoch=129, iter=47950/80000, loss=0.8545, lr=0.004390, batch_cost=1.3282, reader_cost=0.0001 | ETA 11:49:30 2021-02-23 12:57:44 [INFO] [TRAIN] epoch=129, iter=47960/80000, loss=0.9012, lr=0.004389, batch_cost=1.3524, reader_cost=0.0001 | ETA 12:02:09 2021-02-23 12:57:57 [INFO] [TRAIN] epoch=129, iter=47970/80000, loss=0.7937, lr=0.004388, batch_cost=1.3391, reader_cost=0.0001 | ETA 11:54:49 2021-02-23 12:58:11 [INFO] [TRAIN] epoch=129, iter=47980/80000, loss=0.8467, lr=0.004386, batch_cost=1.3810, reader_cost=0.0001 | ETA 12:16:59 2021-02-23 12:58:25 [INFO] [TRAIN] epoch=130, iter=47990/80000, loss=0.8056, lr=0.004385, batch_cost=1.4337, reader_cost=0.0744 | ETA 12:44:53 2021-02-23 12:58:39 [INFO] [TRAIN] epoch=130, iter=48000/80000, loss=0.8406, lr=0.004384, batch_cost=1.3911, reader_cost=0.0001 | ETA 12:21:55 2021-02-23 12:58:39 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:21 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:05 - batch_cost: 0.2016 - reader cost: 0.0749  3/125 [..............................] - ETA: 1:01 - batch_cost: 0.2840 - reader cost: 0.1128 4/125 [..............................] - ETA: 57s - batch_cost: 0.3155 - reader cost: 0.1229  5/125 [>.............................] - ETA: 56s - batch_cost: 0.3430 - reader cost: 0.1390 6/125 [>.............................] - ETA: 55s - batch_cost: 0.3570 - reader cost: 0.1446 7/125 [>.............................] - ETA: 54s - batch_cost: 0.3661 - reader cost: 0.1484 8/125 [>.............................] - ETA: 52s - batch_cost: 0.3675 - reader cost: 0.1452 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3706 - reader cost: 0.1452 10/125 [=>............................] - ETA: 51s - batch_cost: 0.3795 - reader cost: 0.1508 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3850 - reader cost: 0.1535 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3829 - reader cost: 0.1494 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3870 - reader cost: 0.1513 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3894 - reader cost: 0.1524 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3919 - reader cost: 0.1538 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3949 - reader cost: 0.1559 17/125 [===>..........................] - ETA: 47s - batch_cost: 0.3972 - reader cost: 0.1576 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.3960 - reader cost: 0.1556 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3969 - reader cost: 0.1561 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.3982 - reader cost: 0.1569 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.3966 - reader cost: 0.1548 22/125 [====>.........................] - ETA: 43s - batch_cost: 0.3964 - reader cost: 0.1539 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.3978 - reader cost: 0.1548 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.3978 - reader cost: 0.1546 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.3997 - reader cost: 0.1556 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4007 - reader cost: 0.1562 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4018 - reader cost: 0.1568 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4030 - reader cost: 0.1578 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4036 - reader cost: 0.1580 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4031 - reader cost: 0.1573 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.4020 - reader cost: 0.1560 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4032 - reader cost: 0.1568 33/125 [======>.......................] - ETA: 38s - batch_cost: 0.4039 - reader cost: 0.1574 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4056 - reader cost: 0.1587 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4064 - reader cost: 0.1592 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4071 - reader cost: 0.1598 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4078 - reader cost: 0.1602 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4081 - reader cost: 0.1605 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4087 - reader cost: 0.1609 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4095 - reader cost: 0.1614 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4098 - reader cost: 0.1616 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4098 - reader cost: 0.1616 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4088 - reader cost: 0.1606 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4077 - reader cost: 0.1594 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4084 - reader cost: 0.1601 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4090 - reader cost: 0.1607 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4096 - reader cost: 0.1610 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4098 - reader cost: 0.1612 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4088 - reader cost: 0.1602 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4091 - reader cost: 0.1605 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4086 - reader cost: 0.1600 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4089 - reader cost: 0.1599 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4097 - reader cost: 0.1599 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4102 - reader cost: 0.1602 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4104 - reader cost: 0.1604 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4108 - reader cost: 0.1607 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4110 - reader cost: 0.1609 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4116 - reader cost: 0.1616 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4116 - reader cost: 0.1613 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4114 - reader cost: 0.1611 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4119 - reader cost: 0.1610 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4120 - reader cost: 0.1611 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4116 - reader cost: 0.1606 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4112 - reader cost: 0.1600 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4115 - reader cost: 0.1602 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4118 - reader cost: 0.1605 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4122 - reader cost: 0.1602 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4125 - reader cost: 0.1604 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4130 - reader cost: 0.1608 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4134 - reader cost: 0.1608 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4124 - reader cost: 0.1598 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4121 - reader cost: 0.1596 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4123 - reader cost: 0.1598 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4126 - reader cost: 0.1602 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4125 - reader cost: 0.1601 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4121 - reader cost: 0.1597 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4118 - reader cost: 0.1594 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4115 - reader cost: 0.1591 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4119 - reader cost: 0.1596 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4121 - reader cost: 0.1598 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4124 - reader cost: 0.1601 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4126 - reader cost: 0.1603 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4127 - reader cost: 0.1605 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4123 - reader cost: 0.1601 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4125 - reader cost: 0.1603 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4126 - reader cost: 0.1604 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4129 - reader cost: 0.1607 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4131 - reader cost: 0.1608 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4134 - reader cost: 0.1610 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4134 - reader cost: 0.1610 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4132 - reader cost: 0.1607 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4126 - reader cost: 0.1601 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4125 - reader cost: 0.1598 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4122 - reader cost: 0.1592 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4124 - reader cost: 0.1592 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4128 - reader cost: 0.1591 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4129 - reader cost: 0.1588 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4130 - reader cost: 0.1590 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4127 - reader cost: 0.1586 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4132 - reader cost: 0.1590 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4134 - reader cost: 0.1593 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4138 - reader cost: 0.1596  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4139 - reader cost: 0.1597 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4142 - reader cost: 0.1600 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4138 - reader cost: 0.1596 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4134 - reader cost: 0.1592 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4135 - reader cost: 0.1593 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4137 - reader cost: 0.1594 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4133 - reader cost: 0.1591 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4129 - reader cost: 0.1587 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4127 - reader cost: 0.1586 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4128 - reader cost: 0.1587 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4124 - reader cost: 0.1583 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4120 - reader cost: 0.1579 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4118 - reader cost: 0.1578 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4119 - reader cost: 0.1579 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4118 - reader cost: 0.1578 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4120 - reader cost: 0.1576 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4122 - reader cost: 0.1569 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4122 - reader cost: 0.1559 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4123 - reader cost: 0.1556 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4125 - reader cost: 0.1557 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4128 - reader cost: 0.1558 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4129 - reader cost: 0.1560 125/125 [==============================] - 52s 418ms/step - batch_cost: 0.4130 - reader cost: 0.1562 2021-02-23 12:59:32 [INFO] [EVAL] #Images=500 mIoU=0.7533 Acc=0.9543 Kappa=0.9407 2021-02-23 12:59:32 [INFO] [EVAL] Class IoU: [0.9717 0.8075 0.9176 0.4317 0.5812 0.6387 0.7275 0.7905 0.9135 0.6579 0.9471 0.8139 0.6053 0.9421 0.6254 0.7635 0.7798 0.6283 0.7692] 2021-02-23 12:59:32 [INFO] [EVAL] Class Acc: [0.9872 0.8932 0.9503 0.8397 0.831 0.8485 0.8701 0.9257 0.938 0.8488 0.9713 0.8949 0.706 0.9671 0.9291 0.8733 0.9458 0.8236 0.8246] 2021-02-23 12:59:36 [INFO] [EVAL] The model with the best validation mIoU (0.7816) was saved at iter 44000. 2021-02-23 12:59:49 [INFO] [TRAIN] epoch=130, iter=48010/80000, loss=0.8617, lr=0.004383, batch_cost=1.3632, reader_cost=0.0001 | ETA 12:06:48 2021-02-23 13:00:03 [INFO] [TRAIN] epoch=130, iter=48020/80000, loss=0.8910, lr=0.004381, batch_cost=1.3563, reader_cost=0.0001 | ETA 12:02:55 2021-02-23 13:00:16 [INFO] [TRAIN] epoch=130, iter=48030/80000, loss=0.8462, lr=0.004380, batch_cost=1.3539, reader_cost=0.0001 | ETA 12:01:24 2021-02-23 13:00:30 [INFO] [TRAIN] epoch=130, iter=48040/80000, loss=0.8725, lr=0.004379, batch_cost=1.3603, reader_cost=0.0001 | ETA 12:04:34 2021-02-23 13:00:44 [INFO] [TRAIN] epoch=130, iter=48050/80000, loss=0.8307, lr=0.004378, batch_cost=1.3830, reader_cost=0.0001 | ETA 12:16:27 2021-02-23 13:00:58 [INFO] [TRAIN] epoch=130, iter=48060/80000, loss=0.8560, lr=0.004377, batch_cost=1.3955, reader_cost=0.0001 | ETA 12:22:50 2021-02-23 13:01:11 [INFO] [TRAIN] epoch=130, iter=48070/80000, loss=0.8769, lr=0.004375, batch_cost=1.3511, reader_cost=0.0001 | ETA 11:58:59 2021-02-23 13:01:25 [INFO] [TRAIN] epoch=130, iter=48080/80000, loss=0.8763, lr=0.004374, batch_cost=1.3457, reader_cost=0.0001 | ETA 11:55:54 2021-02-23 13:01:38 [INFO] [TRAIN] epoch=130, iter=48090/80000, loss=0.8197, lr=0.004373, batch_cost=1.3651, reader_cost=0.0001 | ETA 12:06:01 2021-02-23 13:01:52 [INFO] [TRAIN] epoch=130, iter=48100/80000, loss=0.8436, lr=0.004372, batch_cost=1.3687, reader_cost=0.0001 | ETA 12:07:40 2021-02-23 13:02:06 [INFO] [TRAIN] epoch=130, iter=48110/80000, loss=0.8578, lr=0.004370, batch_cost=1.3750, reader_cost=0.0001 | ETA 12:10:48 2021-02-23 13:02:19 [INFO] [TRAIN] epoch=130, iter=48120/80000, loss=0.9160, lr=0.004369, batch_cost=1.3626, reader_cost=0.0001 | ETA 12:03:58 2021-02-23 13:02:33 [INFO] [TRAIN] epoch=130, iter=48130/80000, loss=0.8015, lr=0.004368, batch_cost=1.3358, reader_cost=0.0001 | ETA 11:49:31 2021-02-23 13:02:46 [INFO] [TRAIN] epoch=130, iter=48140/80000, loss=0.7774, lr=0.004367, batch_cost=1.3307, reader_cost=0.0001 | ETA 11:46:35 2021-02-23 13:03:00 [INFO] [TRAIN] epoch=130, iter=48150/80000, loss=0.8721, lr=0.004365, batch_cost=1.3691, reader_cost=0.0001 | ETA 12:06:44 2021-02-23 13:03:13 [INFO] [TRAIN] epoch=130, iter=48160/80000, loss=0.8393, lr=0.004364, batch_cost=1.3646, reader_cost=0.0001 | ETA 12:04:09 2021-02-23 13:03:27 [INFO] [TRAIN] epoch=130, iter=48170/80000, loss=0.9046, lr=0.004363, batch_cost=1.3576, reader_cost=0.0001 | ETA 12:00:10 2021-02-23 13:03:41 [INFO] [TRAIN] epoch=130, iter=48180/80000, loss=0.8530, lr=0.004362, batch_cost=1.3712, reader_cost=0.0001 | ETA 12:07:10 2021-02-23 13:03:55 [INFO] [TRAIN] epoch=130, iter=48190/80000, loss=0.8397, lr=0.004361, batch_cost=1.3838, reader_cost=0.0001 | ETA 12:13:38 2021-02-23 13:04:08 [INFO] [TRAIN] epoch=130, iter=48200/80000, loss=0.8215, lr=0.004359, batch_cost=1.3702, reader_cost=0.0001 | ETA 12:06:10 2021-02-23 13:04:22 [INFO] [TRAIN] epoch=130, iter=48210/80000, loss=0.9922, lr=0.004358, batch_cost=1.3551, reader_cost=0.0001 | ETA 11:57:58 2021-02-23 13:04:35 [INFO] [TRAIN] epoch=130, iter=48220/80000, loss=0.8619, lr=0.004357, batch_cost=1.3615, reader_cost=0.0001 | ETA 12:01:08 2021-02-23 13:04:49 [INFO] [TRAIN] epoch=130, iter=48230/80000, loss=0.9346, lr=0.004356, batch_cost=1.3864, reader_cost=0.0001 | ETA 12:14:06 2021-02-23 13:05:03 [INFO] [TRAIN] epoch=130, iter=48240/80000, loss=0.8251, lr=0.004354, batch_cost=1.3353, reader_cost=0.0001 | ETA 11:46:47 2021-02-23 13:05:16 [INFO] [TRAIN] epoch=130, iter=48250/80000, loss=0.8789, lr=0.004353, batch_cost=1.3549, reader_cost=0.0001 | ETA 11:56:58 2021-02-23 13:05:30 [INFO] [TRAIN] epoch=130, iter=48260/80000, loss=0.9127, lr=0.004352, batch_cost=1.3445, reader_cost=0.0001 | ETA 11:51:14 2021-02-23 13:05:43 [INFO] [TRAIN] epoch=130, iter=48270/80000, loss=0.9575, lr=0.004351, batch_cost=1.3709, reader_cost=0.0001 | ETA 12:04:58 2021-02-23 13:05:57 [INFO] [TRAIN] epoch=130, iter=48280/80000, loss=0.8878, lr=0.004349, batch_cost=1.3912, reader_cost=0.0001 | ETA 12:15:30 2021-02-23 13:06:10 [INFO] [TRAIN] epoch=130, iter=48290/80000, loss=0.8225, lr=0.004348, batch_cost=1.3026, reader_cost=0.0001 | ETA 11:28:25 2021-02-23 13:06:24 [INFO] [TRAIN] epoch=130, iter=48300/80000, loss=0.9058, lr=0.004347, batch_cost=1.3575, reader_cost=0.0001 | ETA 11:57:13 2021-02-23 13:06:38 [INFO] [TRAIN] epoch=130, iter=48310/80000, loss=0.8835, lr=0.004346, batch_cost=1.3614, reader_cost=0.0001 | ETA 11:59:03 2021-02-23 13:06:51 [INFO] [TRAIN] epoch=130, iter=48320/80000, loss=0.8357, lr=0.004344, batch_cost=1.3266, reader_cost=0.0001 | ETA 11:40:27 2021-02-23 13:07:04 [INFO] [TRAIN] epoch=130, iter=48330/80000, loss=0.9573, lr=0.004343, batch_cost=1.3513, reader_cost=0.0001 | ETA 11:53:14 2021-02-23 13:07:18 [INFO] [TRAIN] epoch=130, iter=48340/80000, loss=0.9416, lr=0.004342, batch_cost=1.3457, reader_cost=0.0001 | ETA 11:50:03 2021-02-23 13:07:32 [INFO] [TRAIN] epoch=130, iter=48350/80000, loss=0.8891, lr=0.004341, batch_cost=1.3800, reader_cost=0.0001 | ETA 12:07:56 2021-02-23 13:07:45 [INFO] [TRAIN] epoch=130, iter=48360/80000, loss=0.9279, lr=0.004340, batch_cost=1.3401, reader_cost=0.0001 | ETA 11:46:41 2021-02-23 13:07:59 [INFO] [TRAIN] epoch=131, iter=48370/80000, loss=0.8865, lr=0.004338, batch_cost=1.4328, reader_cost=0.0672 | ETA 12:35:19 2021-02-23 13:08:13 [INFO] [TRAIN] epoch=131, iter=48380/80000, loss=0.8507, lr=0.004337, batch_cost=1.3505, reader_cost=0.0001 | ETA 11:51:42 2021-02-23 13:08:27 [INFO] [TRAIN] epoch=131, iter=48390/80000, loss=0.8742, lr=0.004336, batch_cost=1.3974, reader_cost=0.0001 | ETA 12:16:11 2021-02-23 13:08:40 [INFO] [TRAIN] epoch=131, iter=48400/80000, loss=0.9640, lr=0.004335, batch_cost=1.3632, reader_cost=0.0001 | ETA 11:57:57 2021-02-23 13:08:54 [INFO] [TRAIN] epoch=131, iter=48410/80000, loss=0.8292, lr=0.004333, batch_cost=1.3793, reader_cost=0.0001 | ETA 12:06:12 2021-02-23 13:09:08 [INFO] [TRAIN] epoch=131, iter=48420/80000, loss=0.8559, lr=0.004332, batch_cost=1.3832, reader_cost=0.0001 | ETA 12:08:02 2021-02-23 13:09:22 [INFO] [TRAIN] epoch=131, iter=48430/80000, loss=0.8520, lr=0.004331, batch_cost=1.3520, reader_cost=0.0001 | ETA 11:51:21 2021-02-23 13:09:35 [INFO] [TRAIN] epoch=131, iter=48440/80000, loss=0.9477, lr=0.004330, batch_cost=1.3773, reader_cost=0.0001 | ETA 12:04:28 2021-02-23 13:09:49 [INFO] [TRAIN] epoch=131, iter=48450/80000, loss=1.0011, lr=0.004328, batch_cost=1.3847, reader_cost=0.0001 | ETA 12:08:07 2021-02-23 13:10:03 [INFO] [TRAIN] epoch=131, iter=48460/80000, loss=0.7872, lr=0.004327, batch_cost=1.3351, reader_cost=0.0001 | ETA 11:41:49 2021-02-23 13:10:16 [INFO] [TRAIN] epoch=131, iter=48470/80000, loss=0.8555, lr=0.004326, batch_cost=1.3572, reader_cost=0.0001 | ETA 11:53:12 2021-02-23 13:10:29 [INFO] [TRAIN] epoch=131, iter=48480/80000, loss=0.8611, lr=0.004325, batch_cost=1.3356, reader_cost=0.0001 | ETA 11:41:37 2021-02-23 13:10:43 [INFO] [TRAIN] epoch=131, iter=48490/80000, loss=0.9059, lr=0.004323, batch_cost=1.3666, reader_cost=0.0001 | ETA 11:57:41 2021-02-23 13:10:57 [INFO] [TRAIN] epoch=131, iter=48500/80000, loss=0.8416, lr=0.004322, batch_cost=1.3473, reader_cost=0.0001 | ETA 11:47:19 2021-02-23 13:11:10 [INFO] [TRAIN] epoch=131, iter=48510/80000, loss=0.8746, lr=0.004321, batch_cost=1.3730, reader_cost=0.0001 | ETA 12:00:36 2021-02-23 13:11:24 [INFO] [TRAIN] epoch=131, iter=48520/80000, loss=0.8419, lr=0.004320, batch_cost=1.3823, reader_cost=0.0001 | ETA 12:05:13 2021-02-23 13:11:38 [INFO] [TRAIN] epoch=131, iter=48530/80000, loss=0.9090, lr=0.004319, batch_cost=1.3700, reader_cost=0.0001 | ETA 11:58:35 2021-02-23 13:11:52 [INFO] [TRAIN] epoch=131, iter=48540/80000, loss=0.8823, lr=0.004317, batch_cost=1.3885, reader_cost=0.0001 | ETA 12:08:00 2021-02-23 13:12:05 [INFO] [TRAIN] epoch=131, iter=48550/80000, loss=0.9014, lr=0.004316, batch_cost=1.3560, reader_cost=0.0001 | ETA 11:50:46 2021-02-23 13:12:19 [INFO] [TRAIN] epoch=131, iter=48560/80000, loss=0.8232, lr=0.004315, batch_cost=1.3461, reader_cost=0.0001 | ETA 11:45:20 2021-02-23 13:12:32 [INFO] [TRAIN] epoch=131, iter=48570/80000, loss=0.8569, lr=0.004314, batch_cost=1.3605, reader_cost=0.0001 | ETA 11:52:39 2021-02-23 13:12:46 [INFO] [TRAIN] epoch=131, iter=48580/80000, loss=0.8465, lr=0.004312, batch_cost=1.3670, reader_cost=0.0001 | ETA 11:55:52 2021-02-23 13:13:00 [INFO] [TRAIN] epoch=131, iter=48590/80000, loss=0.8687, lr=0.004311, batch_cost=1.4067, reader_cost=0.0001 | ETA 12:16:25 2021-02-23 13:13:14 [INFO] [TRAIN] epoch=131, iter=48600/80000, loss=0.8168, lr=0.004310, batch_cost=1.3764, reader_cost=0.0001 | ETA 12:00:19 2021-02-23 13:13:27 [INFO] [TRAIN] epoch=131, iter=48610/80000, loss=0.9126, lr=0.004309, batch_cost=1.3564, reader_cost=0.0001 | ETA 11:49:37 2021-02-23 13:13:41 [INFO] [TRAIN] epoch=131, iter=48620/80000, loss=0.8802, lr=0.004307, batch_cost=1.3769, reader_cost=0.0001 | ETA 12:00:05 2021-02-23 13:13:55 [INFO] [TRAIN] epoch=131, iter=48630/80000, loss=0.8314, lr=0.004306, batch_cost=1.3664, reader_cost=0.0001 | ETA 11:54:25 2021-02-23 13:14:09 [INFO] [TRAIN] epoch=131, iter=48640/80000, loss=0.9430, lr=0.004305, batch_cost=1.3836, reader_cost=0.0001 | ETA 12:03:08 2021-02-23 13:14:23 [INFO] [TRAIN] epoch=131, iter=48650/80000, loss=0.8292, lr=0.004304, batch_cost=1.3883, reader_cost=0.0001 | ETA 12:05:22 2021-02-23 13:14:36 [INFO] [TRAIN] epoch=131, iter=48660/80000, loss=0.8693, lr=0.004302, batch_cost=1.3317, reader_cost=0.0001 | ETA 11:35:35 2021-02-23 13:14:49 [INFO] [TRAIN] epoch=131, iter=48670/80000, loss=0.9026, lr=0.004301, batch_cost=1.3401, reader_cost=0.0001 | ETA 11:39:46 2021-02-23 13:15:03 [INFO] [TRAIN] epoch=131, iter=48680/80000, loss=0.8668, lr=0.004300, batch_cost=1.4132, reader_cost=0.0001 | ETA 12:17:42 2021-02-23 13:15:17 [INFO] [TRAIN] epoch=131, iter=48690/80000, loss=0.8366, lr=0.004299, batch_cost=1.3820, reader_cost=0.0001 | ETA 12:01:11 2021-02-23 13:15:31 [INFO] [TRAIN] epoch=131, iter=48700/80000, loss=0.8874, lr=0.004298, batch_cost=1.3566, reader_cost=0.0001 | ETA 11:47:41 2021-02-23 13:15:44 [INFO] [TRAIN] epoch=131, iter=48710/80000, loss=0.8461, lr=0.004296, batch_cost=1.3475, reader_cost=0.0001 | ETA 11:42:44 2021-02-23 13:15:58 [INFO] [TRAIN] epoch=131, iter=48720/80000, loss=0.8444, lr=0.004295, batch_cost=1.3598, reader_cost=0.0001 | ETA 11:48:54 2021-02-23 13:16:11 [INFO] [TRAIN] epoch=131, iter=48730/80000, loss=0.8224, lr=0.004294, batch_cost=1.3297, reader_cost=0.0001 | ETA 11:32:59 2021-02-23 13:16:26 [INFO] [TRAIN] epoch=132, iter=48740/80000, loss=0.8710, lr=0.004293, batch_cost=1.4524, reader_cost=0.0865 | ETA 12:36:42 2021-02-23 13:16:39 [INFO] [TRAIN] epoch=132, iter=48750/80000, loss=0.8062, lr=0.004291, batch_cost=1.3572, reader_cost=0.0001 | ETA 11:46:53 2021-02-23 13:16:53 [INFO] [TRAIN] epoch=132, iter=48760/80000, loss=0.8795, lr=0.004290, batch_cost=1.3538, reader_cost=0.0001 | ETA 11:44:52 2021-02-23 13:17:06 [INFO] [TRAIN] epoch=132, iter=48770/80000, loss=0.8009, lr=0.004289, batch_cost=1.3495, reader_cost=0.0001 | ETA 11:42:24 2021-02-23 13:17:20 [INFO] [TRAIN] epoch=132, iter=48780/80000, loss=0.8372, lr=0.004288, batch_cost=1.3479, reader_cost=0.0001 | ETA 11:41:21 2021-02-23 13:17:33 [INFO] [TRAIN] epoch=132, iter=48790/80000, loss=0.8853, lr=0.004286, batch_cost=1.3559, reader_cost=0.0001 | ETA 11:45:16 2021-02-23 13:17:47 [INFO] [TRAIN] epoch=132, iter=48800/80000, loss=0.8039, lr=0.004285, batch_cost=1.3761, reader_cost=0.0001 | ETA 11:55:32 2021-02-23 13:18:01 [INFO] [TRAIN] epoch=132, iter=48810/80000, loss=0.8139, lr=0.004284, batch_cost=1.3517, reader_cost=0.0001 | ETA 11:42:40 2021-02-23 13:18:14 [INFO] [TRAIN] epoch=132, iter=48820/80000, loss=0.8624, lr=0.004283, batch_cost=1.3498, reader_cost=0.0001 | ETA 11:41:25 2021-02-23 13:18:28 [INFO] [TRAIN] epoch=132, iter=48830/80000, loss=0.9525, lr=0.004281, batch_cost=1.3688, reader_cost=0.0001 | ETA 11:51:04 2021-02-23 13:18:41 [INFO] [TRAIN] epoch=132, iter=48840/80000, loss=0.8536, lr=0.004280, batch_cost=1.3529, reader_cost=0.0001 | ETA 11:42:35 2021-02-23 13:18:55 [INFO] [TRAIN] epoch=132, iter=48850/80000, loss=0.8802, lr=0.004279, batch_cost=1.3467, reader_cost=0.0001 | ETA 11:39:09 2021-02-23 13:19:09 [INFO] [TRAIN] epoch=132, iter=48860/80000, loss=0.8990, lr=0.004278, batch_cost=1.3828, reader_cost=0.0001 | ETA 11:57:40 2021-02-23 13:19:23 [INFO] [TRAIN] epoch=132, iter=48870/80000, loss=0.8906, lr=0.004277, batch_cost=1.3973, reader_cost=0.0001 | ETA 12:04:58 2021-02-23 13:19:36 [INFO] [TRAIN] epoch=132, iter=48880/80000, loss=0.9014, lr=0.004275, batch_cost=1.3582, reader_cost=0.0001 | ETA 11:44:28 2021-02-23 13:19:50 [INFO] [TRAIN] epoch=132, iter=48890/80000, loss=0.7820, lr=0.004274, batch_cost=1.3483, reader_cost=0.0001 | ETA 11:39:07 2021-02-23 13:20:04 [INFO] [TRAIN] epoch=132, iter=48900/80000, loss=0.9540, lr=0.004273, batch_cost=1.3860, reader_cost=0.0001 | ETA 11:58:25 2021-02-23 13:20:17 [INFO] [TRAIN] epoch=132, iter=48910/80000, loss=0.9294, lr=0.004272, batch_cost=1.3449, reader_cost=0.0001 | ETA 11:36:51 2021-02-23 13:20:31 [INFO] [TRAIN] epoch=132, iter=48920/80000, loss=0.8574, lr=0.004270, batch_cost=1.3531, reader_cost=0.0001 | ETA 11:40:55 2021-02-23 13:20:44 [INFO] [TRAIN] epoch=132, iter=48930/80000, loss=0.7735, lr=0.004269, batch_cost=1.3938, reader_cost=0.0001 | ETA 12:01:44 2021-02-23 13:20:58 [INFO] [TRAIN] epoch=132, iter=48940/80000, loss=0.8757, lr=0.004268, batch_cost=1.3913, reader_cost=0.0001 | ETA 12:00:13 2021-02-23 13:21:12 [INFO] [TRAIN] epoch=132, iter=48950/80000, loss=0.8910, lr=0.004267, batch_cost=1.3619, reader_cost=0.0001 | ETA 11:44:45 2021-02-23 13:21:25 [INFO] [TRAIN] epoch=132, iter=48960/80000, loss=0.8013, lr=0.004265, batch_cost=1.3432, reader_cost=0.0001 | ETA 11:34:53 2021-02-23 13:21:39 [INFO] [TRAIN] epoch=132, iter=48970/80000, loss=0.8869, lr=0.004264, batch_cost=1.3667, reader_cost=0.0001 | ETA 11:46:47 2021-02-23 13:21:53 [INFO] [TRAIN] epoch=132, iter=48980/80000, loss=0.8942, lr=0.004263, batch_cost=1.3614, reader_cost=0.0001 | ETA 11:43:51 2021-02-23 13:22:06 [INFO] [TRAIN] epoch=132, iter=48990/80000, loss=0.8330, lr=0.004262, batch_cost=1.3767, reader_cost=0.0001 | ETA 11:51:32 2021-02-23 13:22:20 [INFO] [TRAIN] epoch=132, iter=49000/80000, loss=0.8477, lr=0.004260, batch_cost=1.3765, reader_cost=0.0001 | ETA 11:51:11 2021-02-23 13:22:20 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:00 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 56s - batch_cost: 0.2170 - reader cost: 0.0932  3/125 [..............................] - ETA: 55s - batch_cost: 0.2904 - reader cost: 0.1254 4/125 [..............................] - ETA: 55s - batch_cost: 0.3352 - reader cost: 0.1490 5/125 [>.............................] - ETA: 53s - batch_cost: 0.3457 - reader cost: 0.1456 6/125 [>.............................] - ETA: 52s - batch_cost: 0.3589 - reader cost: 0.1508 7/125 [>.............................] - ETA: 51s - batch_cost: 0.3682 - reader cost: 0.1541 8/125 [>.............................] - ETA: 50s - batch_cost: 0.3748 - reader cost: 0.1562 9/125 [=>............................] - ETA: 50s - batch_cost: 0.3817 - reader cost: 0.1592 10/125 [=>............................] - ETA: 49s - batch_cost: 0.3857 - reader cost: 0.1606 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3903 - reader cost: 0.1617 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3945 - reader cost: 0.1636 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3969 - reader cost: 0.1648 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.4002 - reader cost: 0.1669 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.4023 - reader cost: 0.1680 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.4059 - reader cost: 0.1707 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.4036 - reader cost: 0.1677 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.4062 - reader cost: 0.1685 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.4077 - reader cost: 0.1688 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4056 - reader cost: 0.1658 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4032 - reader cost: 0.1629 22/125 [====>.........................] - ETA: 43s - batch_cost: 0.4025 - reader cost: 0.1618 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4037 - reader cost: 0.1627 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.4024 - reader cost: 0.1610 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4035 - reader cost: 0.1619 26/125 [=====>........................] - ETA: 41s - batch_cost: 0.4053 - reader cost: 0.1632 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4061 - reader cost: 0.1635 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4074 - reader cost: 0.1645 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4102 - reader cost: 0.1669 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4096 - reader cost: 0.1661 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4110 - reader cost: 0.1672 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4115 - reader cost: 0.1673 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4102 - reader cost: 0.1658 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4108 - reader cost: 0.1663 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4115 - reader cost: 0.1665 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4116 - reader cost: 0.1665 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4125 - reader cost: 0.1670 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4116 - reader cost: 0.1659 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4110 - reader cost: 0.1651 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4113 - reader cost: 0.1653 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4115 - reader cost: 0.1653 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4118 - reader cost: 0.1656 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4128 - reader cost: 0.1659 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4127 - reader cost: 0.1657 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4130 - reader cost: 0.1658 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4132 - reader cost: 0.1660 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4124 - reader cost: 0.1651 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4128 - reader cost: 0.1654 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4136 - reader cost: 0.1657 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4144 - reader cost: 0.1663 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4142 - reader cost: 0.1659 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4143 - reader cost: 0.1660 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4135 - reader cost: 0.1652 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4139 - reader cost: 0.1653 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4134 - reader cost: 0.1647 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4125 - reader cost: 0.1639 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4118 - reader cost: 0.1631 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4123 - reader cost: 0.1636 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4124 - reader cost: 0.1637 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4117 - reader cost: 0.1630 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4122 - reader cost: 0.1632 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4124 - reader cost: 0.1632 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4128 - reader cost: 0.1634 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4120 - reader cost: 0.1625 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4122 - reader cost: 0.1627 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4124 - reader cost: 0.1628 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4127 - reader cost: 0.1630 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4128 - reader cost: 0.1632 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4122 - reader cost: 0.1625 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4125 - reader cost: 0.1628 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4121 - reader cost: 0.1624 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4123 - reader cost: 0.1625 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4125 - reader cost: 0.1626 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4132 - reader cost: 0.1633 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4136 - reader cost: 0.1636 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4137 - reader cost: 0.1638 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4131 - reader cost: 0.1631 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4134 - reader cost: 0.1632 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4136 - reader cost: 0.1633 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4136 - reader cost: 0.1634 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4140 - reader cost: 0.1636 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4140 - reader cost: 0.1636 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4142 - reader cost: 0.1638 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4138 - reader cost: 0.1634 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4142 - reader cost: 0.1637 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4143 - reader cost: 0.1639 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4146 - reader cost: 0.1641 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4150 - reader cost: 0.1645 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4152 - reader cost: 0.1647 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4155 - reader cost: 0.1648 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4157 - reader cost: 0.1650 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4159 - reader cost: 0.1650 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4155 - reader cost: 0.1646 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4151 - reader cost: 0.1643 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4150 - reader cost: 0.1641 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4152 - reader cost: 0.1643 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4155 - reader cost: 0.1645 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4155 - reader cost: 0.1644 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4154 - reader cost: 0.1643 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4156 - reader cost: 0.1645 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4158 - reader cost: 0.1647 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4153 - reader cost: 0.1642  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4150 - reader cost: 0.1638 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4151 - reader cost: 0.1639 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4154 - reader cost: 0.1641 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4155 - reader cost: 0.1642 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4156 - reader cost: 0.1642 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4159 - reader cost: 0.1645 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4161 - reader cost: 0.1647 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4157 - reader cost: 0.1643 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4153 - reader cost: 0.1639 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4147 - reader cost: 0.1634 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4147 - reader cost: 0.1633 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4148 - reader cost: 0.1632 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4148 - reader cost: 0.1633 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4144 - reader cost: 0.1629 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4143 - reader cost: 0.1627 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4144 - reader cost: 0.1629 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4146 - reader cost: 0.1630 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4146 - reader cost: 0.1630 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4147 - reader cost: 0.1631 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4148 - reader cost: 0.1631 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4148 - reader cost: 0.1632 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4148 - reader cost: 0.1632 125/125 [==============================] - 52s 419ms/step - batch_cost: 0.4151 - reader cost: 0.1635 2021-02-23 13:23:13 [INFO] [EVAL] #Images=500 mIoU=0.7649 Acc=0.9579 Kappa=0.9454 2021-02-23 13:23:13 [INFO] [EVAL] Class IoU: [0.9765 0.8224 0.9224 0.4575 0.5622 0.6737 0.7196 0.7963 0.9243 0.6533 0.9415 0.8312 0.635 0.9431 0.6641 0.8234 0.7804 0.6211 0.7847] 2021-02-23 13:23:13 [INFO] [EVAL] Class Acc: [0.9895 0.8844 0.9515 0.7235 0.8812 0.8201 0.9018 0.9434 0.9531 0.8757 0.9758 0.8961 0.816 0.9598 0.9611 0.9542 0.9483 0.8149 0.8882] 2021-02-23 13:23:17 [INFO] [EVAL] The model with the best validation mIoU (0.7816) was saved at iter 44000. 2021-02-23 13:23:30 [INFO] [TRAIN] epoch=132, iter=49010/80000, loss=0.8749, lr=0.004259, batch_cost=1.3382, reader_cost=0.0001 | ETA 11:31:09 2021-02-23 13:23:44 [INFO] [TRAIN] epoch=132, iter=49020/80000, loss=0.9502, lr=0.004258, batch_cost=1.3462, reader_cost=0.0001 | ETA 11:35:03 2021-02-23 13:23:57 [INFO] [TRAIN] epoch=132, iter=49030/80000, loss=0.8440, lr=0.004257, batch_cost=1.3754, reader_cost=0.0001 | ETA 11:49:56 2021-02-23 13:24:11 [INFO] [TRAIN] epoch=132, iter=49040/80000, loss=0.8396, lr=0.004256, batch_cost=1.3842, reader_cost=0.0001 | ETA 11:54:13 2021-02-23 13:24:24 [INFO] [TRAIN] epoch=132, iter=49050/80000, loss=0.8328, lr=0.004254, batch_cost=1.3264, reader_cost=0.0001 | ETA 11:24:13 2021-02-23 13:24:39 [INFO] [TRAIN] epoch=132, iter=49060/80000, loss=0.7866, lr=0.004253, batch_cost=1.4113, reader_cost=0.0001 | ETA 12:07:46 2021-02-23 13:24:52 [INFO] [TRAIN] epoch=132, iter=49070/80000, loss=0.8067, lr=0.004252, batch_cost=1.3741, reader_cost=0.0001 | ETA 11:48:21 2021-02-23 13:25:06 [INFO] [TRAIN] epoch=132, iter=49080/80000, loss=0.9146, lr=0.004251, batch_cost=1.3576, reader_cost=0.0001 | ETA 11:39:36 2021-02-23 13:25:19 [INFO] [TRAIN] epoch=132, iter=49090/80000, loss=0.9603, lr=0.004249, batch_cost=1.3422, reader_cost=0.0001 | ETA 11:31:26 2021-02-23 13:25:33 [INFO] [TRAIN] epoch=132, iter=49100/80000, loss=0.8424, lr=0.004248, batch_cost=1.3635, reader_cost=0.0001 | ETA 11:42:13 2021-02-23 13:25:47 [INFO] [TRAIN] epoch=133, iter=49110/80000, loss=0.8902, lr=0.004247, batch_cost=1.4470, reader_cost=0.0719 | ETA 12:24:58 2021-02-23 13:26:01 [INFO] [TRAIN] epoch=133, iter=49120/80000, loss=0.8971, lr=0.004246, batch_cost=1.3564, reader_cost=0.0001 | ETA 11:38:06 2021-02-23 13:26:15 [INFO] [TRAIN] epoch=133, iter=49130/80000, loss=0.8617, lr=0.004244, batch_cost=1.3565, reader_cost=0.0001 | ETA 11:37:54 2021-02-23 13:26:28 [INFO] [TRAIN] epoch=133, iter=49140/80000, loss=1.0160, lr=0.004243, batch_cost=1.3650, reader_cost=0.0001 | ETA 11:42:03 2021-02-23 13:26:42 [INFO] [TRAIN] epoch=133, iter=49150/80000, loss=0.8791, lr=0.004242, batch_cost=1.3717, reader_cost=0.0001 | ETA 11:45:17 2021-02-23 13:26:55 [INFO] [TRAIN] epoch=133, iter=49160/80000, loss=0.8632, lr=0.004241, batch_cost=1.3461, reader_cost=0.0001 | ETA 11:31:52 2021-02-23 13:27:09 [INFO] [TRAIN] epoch=133, iter=49170/80000, loss=0.9051, lr=0.004239, batch_cost=1.3480, reader_cost=0.0001 | ETA 11:32:40 2021-02-23 13:27:23 [INFO] [TRAIN] epoch=133, iter=49180/80000, loss=0.7991, lr=0.004238, batch_cost=1.3732, reader_cost=0.0001 | ETA 11:45:22 2021-02-23 13:27:36 [INFO] [TRAIN] epoch=133, iter=49190/80000, loss=0.8596, lr=0.004237, batch_cost=1.3435, reader_cost=0.0001 | ETA 11:29:52 2021-02-23 13:27:50 [INFO] [TRAIN] epoch=133, iter=49200/80000, loss=0.8601, lr=0.004236, batch_cost=1.3540, reader_cost=0.0001 | ETA 11:35:01 2021-02-23 13:28:03 [INFO] [TRAIN] epoch=133, iter=49210/80000, loss=0.8955, lr=0.004234, batch_cost=1.3468, reader_cost=0.0001 | ETA 11:31:06 2021-02-23 13:28:17 [INFO] [TRAIN] epoch=133, iter=49220/80000, loss=0.8942, lr=0.004233, batch_cost=1.3601, reader_cost=0.0001 | ETA 11:37:44 2021-02-23 13:28:30 [INFO] [TRAIN] epoch=133, iter=49230/80000, loss=0.9189, lr=0.004232, batch_cost=1.3451, reader_cost=0.0001 | ETA 11:29:50 2021-02-23 13:28:44 [INFO] [TRAIN] epoch=133, iter=49240/80000, loss=0.8484, lr=0.004231, batch_cost=1.3998, reader_cost=0.0001 | ETA 11:57:37 2021-02-23 13:28:58 [INFO] [TRAIN] epoch=133, iter=49250/80000, loss=0.9111, lr=0.004230, batch_cost=1.3692, reader_cost=0.0001 | ETA 11:41:41 2021-02-23 13:29:11 [INFO] [TRAIN] epoch=133, iter=49260/80000, loss=0.8010, lr=0.004228, batch_cost=1.3523, reader_cost=0.0001 | ETA 11:32:50 2021-02-23 13:29:25 [INFO] [TRAIN] epoch=133, iter=49270/80000, loss=0.8695, lr=0.004227, batch_cost=1.3681, reader_cost=0.0001 | ETA 11:40:41 2021-02-23 13:29:39 [INFO] [TRAIN] epoch=133, iter=49280/80000, loss=0.7867, lr=0.004226, batch_cost=1.3610, reader_cost=0.0001 | ETA 11:36:51 2021-02-23 13:29:52 [INFO] [TRAIN] epoch=133, iter=49290/80000, loss=0.8617, lr=0.004225, batch_cost=1.3576, reader_cost=0.0001 | ETA 11:34:53 2021-02-23 13:30:06 [INFO] [TRAIN] epoch=133, iter=49300/80000, loss=0.8829, lr=0.004223, batch_cost=1.3643, reader_cost=0.0001 | ETA 11:38:05 2021-02-23 13:30:19 [INFO] [TRAIN] epoch=133, iter=49310/80000, loss=0.8241, lr=0.004222, batch_cost=1.3404, reader_cost=0.0001 | ETA 11:25:36 2021-02-23 13:30:33 [INFO] [TRAIN] epoch=133, iter=49320/80000, loss=0.8376, lr=0.004221, batch_cost=1.3514, reader_cost=0.0001 | ETA 11:31:02 2021-02-23 13:30:46 [INFO] [TRAIN] epoch=133, iter=49330/80000, loss=0.8738, lr=0.004220, batch_cost=1.3575, reader_cost=0.0001 | ETA 11:33:53 2021-02-23 13:31:00 [INFO] [TRAIN] epoch=133, iter=49340/80000, loss=0.8832, lr=0.004218, batch_cost=1.3771, reader_cost=0.0001 | ETA 11:43:40 2021-02-23 13:31:14 [INFO] [TRAIN] epoch=133, iter=49350/80000, loss=0.8204, lr=0.004217, batch_cost=1.3776, reader_cost=0.0001 | ETA 11:43:42 2021-02-23 13:31:27 [INFO] [TRAIN] epoch=133, iter=49360/80000, loss=0.8313, lr=0.004216, batch_cost=1.3403, reader_cost=0.0001 | ETA 11:24:27 2021-02-23 13:31:41 [INFO] [TRAIN] epoch=133, iter=49370/80000, loss=0.8291, lr=0.004215, batch_cost=1.4046, reader_cost=0.0001 | ETA 11:57:02 2021-02-23 13:31:55 [INFO] [TRAIN] epoch=133, iter=49380/80000, loss=0.8581, lr=0.004213, batch_cost=1.3402, reader_cost=0.0001 | ETA 11:23:56 2021-02-23 13:32:08 [INFO] [TRAIN] epoch=133, iter=49390/80000, loss=0.8148, lr=0.004212, batch_cost=1.3443, reader_cost=0.0001 | ETA 11:25:49 2021-02-23 13:32:22 [INFO] [TRAIN] epoch=133, iter=49400/80000, loss=0.9299, lr=0.004211, batch_cost=1.3776, reader_cost=0.0001 | ETA 11:42:35 2021-02-23 13:32:35 [INFO] [TRAIN] epoch=133, iter=49410/80000, loss=0.8469, lr=0.004210, batch_cost=1.3560, reader_cost=0.0001 | ETA 11:31:19 2021-02-23 13:32:49 [INFO] [TRAIN] epoch=133, iter=49420/80000, loss=0.8811, lr=0.004208, batch_cost=1.3533, reader_cost=0.0001 | ETA 11:29:42 2021-02-23 13:33:03 [INFO] [TRAIN] epoch=133, iter=49430/80000, loss=0.9377, lr=0.004207, batch_cost=1.3510, reader_cost=0.0001 | ETA 11:28:20 2021-02-23 13:33:16 [INFO] [TRAIN] epoch=133, iter=49440/80000, loss=0.8256, lr=0.004206, batch_cost=1.3641, reader_cost=0.0001 | ETA 11:34:45 2021-02-23 13:33:30 [INFO] [TRAIN] epoch=133, iter=49450/80000, loss=0.8369, lr=0.004205, batch_cost=1.3682, reader_cost=0.0001 | ETA 11:36:37 2021-02-23 13:33:43 [INFO] [TRAIN] epoch=133, iter=49460/80000, loss=0.8924, lr=0.004204, batch_cost=1.3543, reader_cost=0.0001 | ETA 11:29:19 2021-02-23 13:33:57 [INFO] [TRAIN] epoch=133, iter=49470/80000, loss=0.8724, lr=0.004202, batch_cost=1.4072, reader_cost=0.0001 | ETA 11:56:01 2021-02-23 13:34:12 [INFO] [TRAIN] epoch=134, iter=49480/80000, loss=0.8432, lr=0.004201, batch_cost=1.4343, reader_cost=0.0821 | ETA 12:09:33 2021-02-23 13:34:26 [INFO] [TRAIN] epoch=134, iter=49490/80000, loss=0.9436, lr=0.004200, batch_cost=1.3914, reader_cost=0.0001 | ETA 11:47:31 2021-02-23 13:34:40 [INFO] [TRAIN] epoch=134, iter=49500/80000, loss=0.8259, lr=0.004199, batch_cost=1.3950, reader_cost=0.0001 | ETA 11:49:07 2021-02-23 13:34:53 [INFO] [TRAIN] epoch=134, iter=49510/80000, loss=0.8759, lr=0.004197, batch_cost=1.3492, reader_cost=0.0001 | ETA 11:25:36 2021-02-23 13:35:07 [INFO] [TRAIN] epoch=134, iter=49520/80000, loss=0.8832, lr=0.004196, batch_cost=1.3890, reader_cost=0.0001 | ETA 11:45:37 2021-02-23 13:35:21 [INFO] [TRAIN] epoch=134, iter=49530/80000, loss=0.8496, lr=0.004195, batch_cost=1.3851, reader_cost=0.0001 | ETA 11:43:22 2021-02-23 13:35:35 [INFO] [TRAIN] epoch=134, iter=49540/80000, loss=0.8386, lr=0.004194, batch_cost=1.3906, reader_cost=0.0001 | ETA 11:45:58 2021-02-23 13:35:49 [INFO] [TRAIN] epoch=134, iter=49550/80000, loss=0.8151, lr=0.004192, batch_cost=1.3944, reader_cost=0.0001 | ETA 11:47:39 2021-02-23 13:36:03 [INFO] [TRAIN] epoch=134, iter=49560/80000, loss=0.8353, lr=0.004191, batch_cost=1.3775, reader_cost=0.0001 | ETA 11:38:50 2021-02-23 13:36:16 [INFO] [TRAIN] epoch=134, iter=49570/80000, loss=0.8608, lr=0.004190, batch_cost=1.3705, reader_cost=0.0001 | ETA 11:35:04 2021-02-23 13:36:29 [INFO] [TRAIN] epoch=134, iter=49580/80000, loss=0.9167, lr=0.004189, batch_cost=1.3226, reader_cost=0.0001 | ETA 11:10:33 2021-02-23 13:36:43 [INFO] [TRAIN] epoch=134, iter=49590/80000, loss=0.8331, lr=0.004187, batch_cost=1.3606, reader_cost=0.0001 | ETA 11:29:36 2021-02-23 13:36:57 [INFO] [TRAIN] epoch=134, iter=49600/80000, loss=0.8287, lr=0.004186, batch_cost=1.3805, reader_cost=0.0001 | ETA 11:39:28 2021-02-23 13:37:11 [INFO] [TRAIN] epoch=134, iter=49610/80000, loss=0.9460, lr=0.004185, batch_cost=1.3875, reader_cost=0.0001 | ETA 11:42:46 2021-02-23 13:37:25 [INFO] [TRAIN] epoch=134, iter=49620/80000, loss=0.8624, lr=0.004184, batch_cost=1.3826, reader_cost=0.0001 | ETA 11:40:02 2021-02-23 13:37:38 [INFO] [TRAIN] epoch=134, iter=49630/80000, loss=0.8274, lr=0.004182, batch_cost=1.3377, reader_cost=0.0001 | ETA 11:17:06 2021-02-23 13:37:51 [INFO] [TRAIN] epoch=134, iter=49640/80000, loss=0.8478, lr=0.004181, batch_cost=1.3302, reader_cost=0.0001 | ETA 11:13:06 2021-02-23 13:38:05 [INFO] [TRAIN] epoch=134, iter=49650/80000, loss=0.8566, lr=0.004180, batch_cost=1.3951, reader_cost=0.0001 | ETA 11:45:40 2021-02-23 13:38:19 [INFO] [TRAIN] epoch=134, iter=49660/80000, loss=0.9561, lr=0.004179, batch_cost=1.3949, reader_cost=0.0001 | ETA 11:45:22 2021-02-23 13:38:33 [INFO] [TRAIN] epoch=134, iter=49670/80000, loss=0.9516, lr=0.004178, batch_cost=1.3564, reader_cost=0.0001 | ETA 11:25:40 2021-02-23 13:38:46 [INFO] [TRAIN] epoch=134, iter=49680/80000, loss=0.9052, lr=0.004176, batch_cost=1.3721, reader_cost=0.0001 | ETA 11:33:21 2021-02-23 13:39:00 [INFO] [TRAIN] epoch=134, iter=49690/80000, loss=0.8426, lr=0.004175, batch_cost=1.3430, reader_cost=0.0001 | ETA 11:18:26 2021-02-23 13:39:14 [INFO] [TRAIN] epoch=134, iter=49700/80000, loss=1.1502, lr=0.004174, batch_cost=1.3881, reader_cost=0.0001 | ETA 11:40:59 2021-02-23 13:39:27 [INFO] [TRAIN] epoch=134, iter=49710/80000, loss=0.8641, lr=0.004173, batch_cost=1.3571, reader_cost=0.0001 | ETA 11:25:06 2021-02-23 13:39:41 [INFO] [TRAIN] epoch=134, iter=49720/80000, loss=0.7992, lr=0.004171, batch_cost=1.3747, reader_cost=0.0001 | ETA 11:33:44 2021-02-23 13:39:55 [INFO] [TRAIN] epoch=134, iter=49730/80000, loss=0.9237, lr=0.004170, batch_cost=1.3945, reader_cost=0.0001 | ETA 11:43:30 2021-02-23 13:40:09 [INFO] [TRAIN] epoch=134, iter=49740/80000, loss=0.8815, lr=0.004169, batch_cost=1.3655, reader_cost=0.0001 | ETA 11:28:41 2021-02-23 13:40:22 [INFO] [TRAIN] epoch=134, iter=49750/80000, loss=0.8291, lr=0.004168, batch_cost=1.3288, reader_cost=0.0001 | ETA 11:09:57 2021-02-23 13:40:36 [INFO] [TRAIN] epoch=134, iter=49760/80000, loss=0.9061, lr=0.004166, batch_cost=1.3849, reader_cost=0.0001 | ETA 11:38:00 2021-02-23 13:40:49 [INFO] [TRAIN] epoch=134, iter=49770/80000, loss=0.8581, lr=0.004165, batch_cost=1.3623, reader_cost=0.0001 | ETA 11:26:22 2021-02-23 13:41:03 [INFO] [TRAIN] epoch=134, iter=49780/80000, loss=0.8280, lr=0.004164, batch_cost=1.3487, reader_cost=0.0001 | ETA 11:19:17 2021-02-23 13:41:17 [INFO] [TRAIN] epoch=134, iter=49790/80000, loss=0.9345, lr=0.004163, batch_cost=1.3565, reader_cost=0.0001 | ETA 11:22:58 2021-02-23 13:41:30 [INFO] [TRAIN] epoch=134, iter=49800/80000, loss=0.8992, lr=0.004161, batch_cost=1.3851, reader_cost=0.0001 | ETA 11:37:10 2021-02-23 13:41:44 [INFO] [TRAIN] epoch=134, iter=49810/80000, loss=0.8626, lr=0.004160, batch_cost=1.3560, reader_cost=0.0001 | ETA 11:22:17 2021-02-23 13:41:58 [INFO] [TRAIN] epoch=134, iter=49820/80000, loss=0.7815, lr=0.004159, batch_cost=1.4181, reader_cost=0.0001 | ETA 11:53:17 2021-02-23 13:42:12 [INFO] [TRAIN] epoch=134, iter=49830/80000, loss=0.9410, lr=0.004158, batch_cost=1.3747, reader_cost=0.0001 | ETA 11:31:13 2021-02-23 13:42:25 [INFO] [TRAIN] epoch=134, iter=49840/80000, loss=0.9593, lr=0.004156, batch_cost=1.3578, reader_cost=0.0001 | ETA 11:22:31 2021-02-23 13:42:40 [INFO] [TRAIN] epoch=135, iter=49850/80000, loss=0.8368, lr=0.004155, batch_cost=1.4153, reader_cost=0.0903 | ETA 11:51:10 2021-02-23 13:42:53 [INFO] [TRAIN] epoch=135, iter=49860/80000, loss=0.9845, lr=0.004154, batch_cost=1.3754, reader_cost=0.0001 | ETA 11:30:53 2021-02-23 13:43:07 [INFO] [TRAIN] epoch=135, iter=49870/80000, loss=0.8126, lr=0.004153, batch_cost=1.3398, reader_cost=0.0001 | ETA 11:12:47 2021-02-23 13:43:20 [INFO] [TRAIN] epoch=135, iter=49880/80000, loss=0.9466, lr=0.004151, batch_cost=1.3568, reader_cost=0.0001 | ETA 11:21:05 2021-02-23 13:43:34 [INFO] [TRAIN] epoch=135, iter=49890/80000, loss=0.8956, lr=0.004150, batch_cost=1.3599, reader_cost=0.0001 | ETA 11:22:25 2021-02-23 13:43:48 [INFO] [TRAIN] epoch=135, iter=49900/80000, loss=0.8593, lr=0.004149, batch_cost=1.3716, reader_cost=0.0001 | ETA 11:28:03 2021-02-23 13:44:01 [INFO] [TRAIN] epoch=135, iter=49910/80000, loss=0.7859, lr=0.004148, batch_cost=1.3621, reader_cost=0.0001 | ETA 11:23:06 2021-02-23 13:44:15 [INFO] [TRAIN] epoch=135, iter=49920/80000, loss=0.9733, lr=0.004147, batch_cost=1.3687, reader_cost=0.0001 | ETA 11:26:09 2021-02-23 13:44:29 [INFO] [TRAIN] epoch=135, iter=49930/80000, loss=0.7869, lr=0.004145, batch_cost=1.3753, reader_cost=0.0001 | ETA 11:29:15 2021-02-23 13:44:42 [INFO] [TRAIN] epoch=135, iter=49940/80000, loss=0.8680, lr=0.004144, batch_cost=1.3427, reader_cost=0.0001 | ETA 11:12:41 2021-02-23 13:44:56 [INFO] [TRAIN] epoch=135, iter=49950/80000, loss=0.8635, lr=0.004143, batch_cost=1.3567, reader_cost=0.0001 | ETA 11:19:30 2021-02-23 13:45:09 [INFO] [TRAIN] epoch=135, iter=49960/80000, loss=0.9039, lr=0.004142, batch_cost=1.3489, reader_cost=0.0001 | ETA 11:15:20 2021-02-23 13:45:23 [INFO] [TRAIN] epoch=135, iter=49970/80000, loss=0.8357, lr=0.004140, batch_cost=1.3573, reader_cost=0.0001 | ETA 11:19:19 2021-02-23 13:45:37 [INFO] [TRAIN] epoch=135, iter=49980/80000, loss=0.9183, lr=0.004139, batch_cost=1.3903, reader_cost=0.0001 | ETA 11:35:36 2021-02-23 13:45:51 [INFO] [TRAIN] epoch=135, iter=49990/80000, loss=0.7558, lr=0.004138, batch_cost=1.4072, reader_cost=0.0001 | ETA 11:43:48 2021-02-23 13:46:05 [INFO] [TRAIN] epoch=135, iter=50000/80000, loss=0.8364, lr=0.004137, batch_cost=1.3964, reader_cost=0.0001 | ETA 11:38:10 2021-02-23 13:46:05 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:18 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:06 - batch_cost: 0.2217 - reader cost: 0.0972  3/125 [..............................] - ETA: 1:03 - batch_cost: 0.3069 - reader cost: 0.1381 4/125 [..............................] - ETA: 59s - batch_cost: 0.3325 - reader cost: 0.1420  5/125 [>.............................] - ETA: 58s - batch_cost: 0.3581 - reader cost: 0.1515 6/125 [>.............................] - ETA: 56s - batch_cost: 0.3727 - reader cost: 0.1576 7/125 [>.............................] - ETA: 55s - batch_cost: 0.3772 - reader cost: 0.1572 8/125 [>.............................] - ETA: 54s - batch_cost: 0.3854 - reader cost: 0.1605 9/125 [=>............................] - ETA: 53s - batch_cost: 0.3900 - reader cost: 0.1619 10/125 [=>............................] - ETA: 51s - batch_cost: 0.3883 - reader cost: 0.1579 11/125 [=>............................] - ETA: 51s - batch_cost: 0.3914 - reader cost: 0.1593 12/125 [=>............................] - ETA: 50s - batch_cost: 0.3898 - reader cost: 0.1560 13/125 [==>...........................] - ETA: 49s - batch_cost: 0.3931 - reader cost: 0.1577 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3914 - reader cost: 0.1547 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3899 - reader cost: 0.1522 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3942 - reader cost: 0.1557 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3958 - reader cost: 0.1567 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.3974 - reader cost: 0.1576 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3973 - reader cost: 0.1567 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3965 - reader cost: 0.1548 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.3987 - reader cost: 0.1561 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.3998 - reader cost: 0.1566 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4018 - reader cost: 0.1578 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4007 - reader cost: 0.1565 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4032 - reader cost: 0.1588 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4042 - reader cost: 0.1595 27/125 [=====>........................] - ETA: 42s - batch_cost: 0.4057 - reader cost: 0.1606 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4051 - reader cost: 0.1595 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4064 - reader cost: 0.1605 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4054 - reader cost: 0.1595 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4063 - reader cost: 0.1601 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4051 - reader cost: 0.1587 33/125 [======>.......................] - ETA: 38s - batch_cost: 0.4038 - reader cost: 0.1574 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4044 - reader cost: 0.1579 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4044 - reader cost: 0.1573 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4046 - reader cost: 0.1574 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4041 - reader cost: 0.1568 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4050 - reader cost: 0.1576 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4057 - reader cost: 0.1579 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4046 - reader cost: 0.1565 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4055 - reader cost: 0.1560 42/125 [=========>....................] - ETA: 34s - batch_cost: 0.4065 - reader cost: 0.1558 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4068 - reader cost: 0.1558 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4074 - reader cost: 0.1564 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4081 - reader cost: 0.1568 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4081 - reader cost: 0.1568 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4088 - reader cost: 0.1574 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4095 - reader cost: 0.1581 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4087 - reader cost: 0.1573 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4084 - reader cost: 0.1571 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4089 - reader cost: 0.1575 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4094 - reader cost: 0.1581 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4089 - reader cost: 0.1571 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4090 - reader cost: 0.1570 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4102 - reader cost: 0.1574 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4106 - reader cost: 0.1577 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4107 - reader cost: 0.1580 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4103 - reader cost: 0.1576 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4105 - reader cost: 0.1578 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4107 - reader cost: 0.1581 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4112 - reader cost: 0.1585 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4114 - reader cost: 0.1587 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4117 - reader cost: 0.1589 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4111 - reader cost: 0.1584 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4107 - reader cost: 0.1580 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4110 - reader cost: 0.1583 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4105 - reader cost: 0.1578 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4107 - reader cost: 0.1580 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4108 - reader cost: 0.1582 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4110 - reader cost: 0.1584 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4113 - reader cost: 0.1587 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4116 - reader cost: 0.1590 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4119 - reader cost: 0.1593 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4123 - reader cost: 0.1596 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4127 - reader cost: 0.1600 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4122 - reader cost: 0.1596 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4127 - reader cost: 0.1599 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4130 - reader cost: 0.1601 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4133 - reader cost: 0.1604 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4128 - reader cost: 0.1600 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4132 - reader cost: 0.1603 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4126 - reader cost: 0.1598 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4131 - reader cost: 0.1603 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4132 - reader cost: 0.1604 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4134 - reader cost: 0.1605 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4129 - reader cost: 0.1600 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4130 - reader cost: 0.1601 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4133 - reader cost: 0.1604 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4134 - reader cost: 0.1605 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4130 - reader cost: 0.1602 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4132 - reader cost: 0.1604 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4134 - reader cost: 0.1605 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4136 - reader cost: 0.1607 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4139 - reader cost: 0.1610 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4138 - reader cost: 0.1609 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4134 - reader cost: 0.1605 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4135 - reader cost: 0.1606 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4138 - reader cost: 0.1609 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4134 - reader cost: 0.1605 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4133 - reader cost: 0.1605 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4133 - reader cost: 0.1603 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4127 - reader cost: 0.1596  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4128 - reader cost: 0.1597 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4132 - reader cost: 0.1601 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4133 - reader cost: 0.1602 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4131 - reader cost: 0.1600 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4134 - reader cost: 0.1604 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4137 - reader cost: 0.1605 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4137 - reader cost: 0.1605 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4136 - reader cost: 0.1604 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4138 - reader cost: 0.1606 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4140 - reader cost: 0.1607 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4135 - reader cost: 0.1602 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4137 - reader cost: 0.1605 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4135 - reader cost: 0.1603 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4136 - reader cost: 0.1604 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4139 - reader cost: 0.1606 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4139 - reader cost: 0.1607 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4141 - reader cost: 0.1608 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4137 - reader cost: 0.1605 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4142 - reader cost: 0.1610 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4141 - reader cost: 0.1608 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4141 - reader cost: 0.1609 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4139 - reader cost: 0.1607 125/125 [==============================] - 52s 419ms/step - batch_cost: 0.4138 - reader cost: 0.1605 2021-02-23 13:46:57 [INFO] [EVAL] #Images=500 mIoU=0.7413 Acc=0.9597 Kappa=0.9476 2021-02-23 13:46:57 [INFO] [EVAL] Class IoU: [0.9788 0.8324 0.9253 0.439 0.6247 0.6777 0.7366 0.8119 0.9259 0.6327 0.9498 0.837 0.6529 0.9518 0.7778 0.7108 0.1472 0.6838 0.7889] 2021-02-23 13:46:57 [INFO] [EVAL] Class Acc: [0.9857 0.9294 0.9575 0.8766 0.8312 0.8149 0.8656 0.9088 0.9525 0.8345 0.9692 0.9008 0.7382 0.9747 0.881 0.7697 0.8947 0.8562 0.8752] 2021-02-23 13:47:01 [INFO] [EVAL] The model with the best validation mIoU (0.7816) was saved at iter 44000. 2021-02-23 13:47:15 [INFO] [TRAIN] epoch=135, iter=50010/80000, loss=0.8379, lr=0.004135, batch_cost=1.3365, reader_cost=0.0001 | ETA 11:08:01 2021-02-23 13:47:29 [INFO] [TRAIN] epoch=135, iter=50020/80000, loss=0.9194, lr=0.004134, batch_cost=1.4121, reader_cost=0.0001 | ETA 11:45:34 2021-02-23 13:47:42 [INFO] [TRAIN] epoch=135, iter=50030/80000, loss=0.8751, lr=0.004133, batch_cost=1.3743, reader_cost=0.0001 | ETA 11:26:26 2021-02-23 13:47:56 [INFO] [TRAIN] epoch=135, iter=50040/80000, loss=0.9619, lr=0.004132, batch_cost=1.3553, reader_cost=0.0001 | ETA 11:16:44 2021-02-23 13:48:10 [INFO] [TRAIN] epoch=135, iter=50050/80000, loss=0.9066, lr=0.004130, batch_cost=1.3580, reader_cost=0.0001 | ETA 11:17:53 2021-02-23 13:48:23 [INFO] [TRAIN] epoch=135, iter=50060/80000, loss=0.9028, lr=0.004129, batch_cost=1.3821, reader_cost=0.0001 | ETA 11:29:39 2021-02-23 13:48:37 [INFO] [TRAIN] epoch=135, iter=50070/80000, loss=0.8684, lr=0.004128, batch_cost=1.3513, reader_cost=0.0001 | ETA 11:14:05 2021-02-23 13:48:51 [INFO] [TRAIN] epoch=135, iter=50080/80000, loss=0.9213, lr=0.004127, batch_cost=1.3895, reader_cost=0.0001 | ETA 11:32:52 2021-02-23 13:49:04 [INFO] [TRAIN] epoch=135, iter=50090/80000, loss=0.8121, lr=0.004125, batch_cost=1.3176, reader_cost=0.0001 | ETA 10:56:49 2021-02-23 13:49:18 [INFO] [TRAIN] epoch=135, iter=50100/80000, loss=0.8308, lr=0.004124, batch_cost=1.3517, reader_cost=0.0001 | ETA 11:13:35 2021-02-23 13:49:31 [INFO] [TRAIN] epoch=135, iter=50110/80000, loss=0.8584, lr=0.004123, batch_cost=1.3913, reader_cost=0.0001 | ETA 11:33:06 2021-02-23 13:49:45 [INFO] [TRAIN] epoch=135, iter=50120/80000, loss=0.8157, lr=0.004122, batch_cost=1.3929, reader_cost=0.0001 | ETA 11:33:38 2021-02-23 13:49:59 [INFO] [TRAIN] epoch=135, iter=50130/80000, loss=0.8816, lr=0.004120, batch_cost=1.3604, reader_cost=0.0001 | ETA 11:17:16 2021-02-23 13:50:13 [INFO] [TRAIN] epoch=135, iter=50140/80000, loss=0.8609, lr=0.004119, batch_cost=1.3783, reader_cost=0.0001 | ETA 11:25:56 2021-02-23 13:50:27 [INFO] [TRAIN] epoch=135, iter=50150/80000, loss=0.8251, lr=0.004118, batch_cost=1.3865, reader_cost=0.0001 | ETA 11:29:47 2021-02-23 13:50:40 [INFO] [TRAIN] epoch=135, iter=50160/80000, loss=0.8662, lr=0.004117, batch_cost=1.3803, reader_cost=0.0001 | ETA 11:26:27 2021-02-23 13:50:54 [INFO] [TRAIN] epoch=135, iter=50170/80000, loss=0.8527, lr=0.004115, batch_cost=1.3639, reader_cost=0.0001 | ETA 11:18:06 2021-02-23 13:51:08 [INFO] [TRAIN] epoch=135, iter=50180/80000, loss=0.8630, lr=0.004114, batch_cost=1.3592, reader_cost=0.0001 | ETA 11:15:32 2021-02-23 13:51:21 [INFO] [TRAIN] epoch=135, iter=50190/80000, loss=0.9242, lr=0.004113, batch_cost=1.3817, reader_cost=0.0001 | ETA 11:26:27 2021-02-23 13:51:36 [INFO] [TRAIN] epoch=135, iter=50200/80000, loss=0.8649, lr=0.004112, batch_cost=1.4029, reader_cost=0.0001 | ETA 11:36:46 2021-02-23 13:51:49 [INFO] [TRAIN] epoch=135, iter=50210/80000, loss=0.8017, lr=0.004111, batch_cost=1.3397, reader_cost=0.0001 | ETA 11:05:09 2021-02-23 13:52:02 [INFO] [TRAIN] epoch=135, iter=50220/80000, loss=0.8089, lr=0.004109, batch_cost=1.3021, reader_cost=0.0001 | ETA 10:46:17 2021-02-23 13:52:17 [INFO] [TRAIN] epoch=136, iter=50230/80000, loss=0.8350, lr=0.004108, batch_cost=1.4762, reader_cost=0.0746 | ETA 12:12:25 2021-02-23 13:52:30 [INFO] [TRAIN] epoch=136, iter=50240/80000, loss=0.8394, lr=0.004107, batch_cost=1.3532, reader_cost=0.0001 | ETA 11:11:12 2021-02-23 13:52:44 [INFO] [TRAIN] epoch=136, iter=50250/80000, loss=0.9412, lr=0.004106, batch_cost=1.3658, reader_cost=0.0001 | ETA 11:17:13 2021-02-23 13:52:57 [INFO] [TRAIN] epoch=136, iter=50260/80000, loss=0.8490, lr=0.004104, batch_cost=1.3602, reader_cost=0.0001 | ETA 11:14:13 2021-02-23 13:53:11 [INFO] [TRAIN] epoch=136, iter=50270/80000, loss=0.9279, lr=0.004103, batch_cost=1.3757, reader_cost=0.0001 | ETA 11:21:40 2021-02-23 13:53:25 [INFO] [TRAIN] epoch=136, iter=50280/80000, loss=0.8441, lr=0.004102, batch_cost=1.3944, reader_cost=0.0001 | ETA 11:30:42 2021-02-23 13:53:39 [INFO] [TRAIN] epoch=136, iter=50290/80000, loss=0.8575, lr=0.004101, batch_cost=1.3758, reader_cost=0.0001 | ETA 11:21:14 2021-02-23 13:53:52 [INFO] [TRAIN] epoch=136, iter=50300/80000, loss=0.9278, lr=0.004099, batch_cost=1.3469, reader_cost=0.0001 | ETA 11:06:43 2021-02-23 13:54:06 [INFO] [TRAIN] epoch=136, iter=50310/80000, loss=0.8550, lr=0.004098, batch_cost=1.3678, reader_cost=0.0001 | ETA 11:16:51 2021-02-23 13:54:20 [INFO] [TRAIN] epoch=136, iter=50320/80000, loss=0.9144, lr=0.004097, batch_cost=1.3509, reader_cost=0.0001 | ETA 11:08:13 2021-02-23 13:54:33 [INFO] [TRAIN] epoch=136, iter=50330/80000, loss=0.8564, lr=0.004096, batch_cost=1.3580, reader_cost=0.0001 | ETA 11:11:32 2021-02-23 13:54:47 [INFO] [TRAIN] epoch=136, iter=50340/80000, loss=0.8806, lr=0.004094, batch_cost=1.3627, reader_cost=0.0001 | ETA 11:13:36 2021-02-23 13:55:00 [INFO] [TRAIN] epoch=136, iter=50350/80000, loss=0.8450, lr=0.004093, batch_cost=1.3305, reader_cost=0.0001 | ETA 10:57:30 2021-02-23 13:55:14 [INFO] [TRAIN] epoch=136, iter=50360/80000, loss=0.8070, lr=0.004092, batch_cost=1.3684, reader_cost=0.0001 | ETA 11:15:59 2021-02-23 13:55:27 [INFO] [TRAIN] epoch=136, iter=50370/80000, loss=0.8798, lr=0.004091, batch_cost=1.3468, reader_cost=0.0001 | ETA 11:05:05 2021-02-23 13:55:41 [INFO] [TRAIN] epoch=136, iter=50380/80000, loss=0.8502, lr=0.004089, batch_cost=1.3690, reader_cost=0.0001 | ETA 11:15:50 2021-02-23 13:55:55 [INFO] [TRAIN] epoch=136, iter=50390/80000, loss=0.8125, lr=0.004088, batch_cost=1.3653, reader_cost=0.0001 | ETA 11:13:46 2021-02-23 13:56:08 [INFO] [TRAIN] epoch=136, iter=50400/80000, loss=0.8555, lr=0.004087, batch_cost=1.3814, reader_cost=0.0001 | ETA 11:21:28 2021-02-23 13:56:22 [INFO] [TRAIN] epoch=136, iter=50410/80000, loss=0.8940, lr=0.004086, batch_cost=1.3439, reader_cost=0.0001 | ETA 11:02:44 2021-02-23 13:56:35 [INFO] [TRAIN] epoch=136, iter=50420/80000, loss=0.8555, lr=0.004084, batch_cost=1.3557, reader_cost=0.0001 | ETA 11:08:20 2021-02-23 13:56:49 [INFO] [TRAIN] epoch=136, iter=50430/80000, loss=0.8342, lr=0.004083, batch_cost=1.3528, reader_cost=0.0001 | ETA 11:06:43 2021-02-23 13:57:03 [INFO] [TRAIN] epoch=136, iter=50440/80000, loss=0.9124, lr=0.004082, batch_cost=1.3607, reader_cost=0.0001 | ETA 11:10:22 2021-02-23 13:57:16 [INFO] [TRAIN] epoch=136, iter=50450/80000, loss=0.8321, lr=0.004081, batch_cost=1.3470, reader_cost=0.0001 | ETA 11:03:25 2021-02-23 13:57:30 [INFO] [TRAIN] epoch=136, iter=50460/80000, loss=0.8708, lr=0.004079, batch_cost=1.4000, reader_cost=0.0001 | ETA 11:29:16 2021-02-23 13:57:44 [INFO] [TRAIN] epoch=136, iter=50470/80000, loss=0.8300, lr=0.004078, batch_cost=1.3867, reader_cost=0.0001 | ETA 11:22:29 2021-02-23 13:57:58 [INFO] [TRAIN] epoch=136, iter=50480/80000, loss=0.9546, lr=0.004077, batch_cost=1.3921, reader_cost=0.0001 | ETA 11:24:53 2021-02-23 13:58:11 [INFO] [TRAIN] epoch=136, iter=50490/80000, loss=0.8947, lr=0.004076, batch_cost=1.3629, reader_cost=0.0001 | ETA 11:10:20 2021-02-23 13:58:25 [INFO] [TRAIN] epoch=136, iter=50500/80000, loss=0.8515, lr=0.004074, batch_cost=1.3600, reader_cost=0.0001 | ETA 11:08:39 2021-02-23 13:58:39 [INFO] [TRAIN] epoch=136, iter=50510/80000, loss=0.8019, lr=0.004073, batch_cost=1.3790, reader_cost=0.0001 | ETA 11:17:47 2021-02-23 13:58:52 [INFO] [TRAIN] epoch=136, iter=50520/80000, loss=0.8564, lr=0.004072, batch_cost=1.3617, reader_cost=0.0001 | ETA 11:09:03 2021-02-23 13:59:06 [INFO] [TRAIN] epoch=136, iter=50530/80000, loss=0.9148, lr=0.004071, batch_cost=1.3831, reader_cost=0.0001 | ETA 11:19:20 2021-02-23 13:59:20 [INFO] [TRAIN] epoch=136, iter=50540/80000, loss=0.8875, lr=0.004070, batch_cost=1.3608, reader_cost=0.0001 | ETA 11:08:10 2021-02-23 13:59:33 [INFO] [TRAIN] epoch=136, iter=50550/80000, loss=0.9706, lr=0.004068, batch_cost=1.3511, reader_cost=0.0001 | ETA 11:03:09 2021-02-23 13:59:47 [INFO] [TRAIN] epoch=136, iter=50560/80000, loss=0.9670, lr=0.004067, batch_cost=1.3495, reader_cost=0.0001 | ETA 11:02:08 2021-02-23 14:00:00 [INFO] [TRAIN] epoch=136, iter=50570/80000, loss=0.9019, lr=0.004066, batch_cost=1.3306, reader_cost=0.0001 | ETA 10:52:40 2021-02-23 14:00:14 [INFO] [TRAIN] epoch=136, iter=50580/80000, loss=0.8544, lr=0.004065, batch_cost=1.3619, reader_cost=0.0001 | ETA 11:07:47 2021-02-23 14:00:28 [INFO] [TRAIN] epoch=136, iter=50590/80000, loss=0.8253, lr=0.004063, batch_cost=1.3673, reader_cost=0.0001 | ETA 11:10:13 2021-02-23 14:00:42 [INFO] [TRAIN] epoch=137, iter=50600/80000, loss=0.8150, lr=0.004062, batch_cost=1.4264, reader_cost=0.0712 | ETA 11:38:55 2021-02-23 14:00:55 [INFO] [TRAIN] epoch=137, iter=50610/80000, loss=0.8289, lr=0.004061, batch_cost=1.3598, reader_cost=0.0001 | ETA 11:06:03 2021-02-23 14:01:10 [INFO] [TRAIN] epoch=137, iter=50620/80000, loss=0.8472, lr=0.004060, batch_cost=1.4233, reader_cost=0.0001 | ETA 11:36:55 2021-02-23 14:01:24 [INFO] [TRAIN] epoch=137, iter=50630/80000, loss=0.9359, lr=0.004058, batch_cost=1.3948, reader_cost=0.0001 | ETA 11:22:46 2021-02-23 14:01:37 [INFO] [TRAIN] epoch=137, iter=50640/80000, loss=1.0011, lr=0.004057, batch_cost=1.3833, reader_cost=0.0001 | ETA 11:16:54 2021-02-23 14:01:51 [INFO] [TRAIN] epoch=137, iter=50650/80000, loss=0.8529, lr=0.004056, batch_cost=1.3752, reader_cost=0.0001 | ETA 11:12:42 2021-02-23 14:02:05 [INFO] [TRAIN] epoch=137, iter=50660/80000, loss=0.8746, lr=0.004055, batch_cost=1.3579, reader_cost=0.0001 | ETA 11:04:01 2021-02-23 14:02:19 [INFO] [TRAIN] epoch=137, iter=50670/80000, loss=0.8372, lr=0.004053, batch_cost=1.3885, reader_cost=0.0001 | ETA 11:18:43 2021-02-23 14:02:32 [INFO] [TRAIN] epoch=137, iter=50680/80000, loss=0.9508, lr=0.004052, batch_cost=1.3386, reader_cost=0.0001 | ETA 10:54:08 2021-02-23 14:02:46 [INFO] [TRAIN] epoch=137, iter=50690/80000, loss=0.8321, lr=0.004051, batch_cost=1.3939, reader_cost=0.0001 | ETA 11:20:54 2021-02-23 14:03:00 [INFO] [TRAIN] epoch=137, iter=50700/80000, loss=0.8793, lr=0.004050, batch_cost=1.3835, reader_cost=0.0001 | ETA 11:15:37 2021-02-23 14:03:13 [INFO] [TRAIN] epoch=137, iter=50710/80000, loss=0.8549, lr=0.004048, batch_cost=1.3176, reader_cost=0.0001 | ETA 10:43:12 2021-02-23 14:03:27 [INFO] [TRAIN] epoch=137, iter=50720/80000, loss=0.8067, lr=0.004047, batch_cost=1.3766, reader_cost=0.0001 | ETA 11:11:46 2021-02-23 14:03:40 [INFO] [TRAIN] epoch=137, iter=50730/80000, loss=0.9258, lr=0.004046, batch_cost=1.3341, reader_cost=0.0001 | ETA 10:50:49 2021-02-23 14:03:54 [INFO] [TRAIN] epoch=137, iter=50740/80000, loss=0.8850, lr=0.004045, batch_cost=1.3475, reader_cost=0.0001 | ETA 10:57:07 2021-02-23 14:04:07 [INFO] [TRAIN] epoch=137, iter=50750/80000, loss=0.8802, lr=0.004043, batch_cost=1.3470, reader_cost=0.0001 | ETA 10:56:38 2021-02-23 14:04:21 [INFO] [TRAIN] epoch=137, iter=50760/80000, loss=0.8732, lr=0.004042, batch_cost=1.3636, reader_cost=0.0001 | ETA 11:04:30 2021-02-23 14:04:34 [INFO] [TRAIN] epoch=137, iter=50770/80000, loss=0.9720, lr=0.004041, batch_cost=1.3594, reader_cost=0.0001 | ETA 11:02:14 2021-02-23 14:04:48 [INFO] [TRAIN] epoch=137, iter=50780/80000, loss=0.8116, lr=0.004040, batch_cost=1.3958, reader_cost=0.0001 | ETA 11:19:45 2021-02-23 14:05:02 [INFO] [TRAIN] epoch=137, iter=50790/80000, loss=1.0993, lr=0.004038, batch_cost=1.3329, reader_cost=0.0001 | ETA 10:48:52 2021-02-23 14:05:15 [INFO] [TRAIN] epoch=137, iter=50800/80000, loss=0.9118, lr=0.004037, batch_cost=1.3398, reader_cost=0.0001 | ETA 10:52:01 2021-02-23 14:05:29 [INFO] [TRAIN] epoch=137, iter=50810/80000, loss=0.8353, lr=0.004036, batch_cost=1.3636, reader_cost=0.0001 | ETA 11:03:23 2021-02-23 14:05:42 [INFO] [TRAIN] epoch=137, iter=50820/80000, loss=0.8355, lr=0.004035, batch_cost=1.3709, reader_cost=0.0001 | ETA 11:06:43 2021-02-23 14:05:56 [INFO] [TRAIN] epoch=137, iter=50830/80000, loss=0.8184, lr=0.004033, batch_cost=1.3535, reader_cost=0.0001 | ETA 10:58:02 2021-02-23 14:06:10 [INFO] [TRAIN] epoch=137, iter=50840/80000, loss=0.8644, lr=0.004032, batch_cost=1.4021, reader_cost=0.0001 | ETA 11:21:23 2021-02-23 14:06:24 [INFO] [TRAIN] epoch=137, iter=50850/80000, loss=0.8537, lr=0.004031, batch_cost=1.3898, reader_cost=0.0001 | ETA 11:15:11 2021-02-23 14:06:38 [INFO] [TRAIN] epoch=137, iter=50860/80000, loss=0.8024, lr=0.004030, batch_cost=1.3936, reader_cost=0.0001 | ETA 11:16:48 2021-02-23 14:06:51 [INFO] [TRAIN] epoch=137, iter=50870/80000, loss=0.8147, lr=0.004028, batch_cost=1.3725, reader_cost=0.0001 | ETA 11:06:20 2021-02-23 14:07:05 [INFO] [TRAIN] epoch=137, iter=50880/80000, loss=0.8099, lr=0.004027, batch_cost=1.3526, reader_cost=0.0001 | ETA 10:56:28 2021-02-23 14:07:19 [INFO] [TRAIN] epoch=137, iter=50890/80000, loss=0.8583, lr=0.004026, batch_cost=1.3986, reader_cost=0.0001 | ETA 11:18:34 2021-02-23 14:07:33 [INFO] [TRAIN] epoch=137, iter=50900/80000, loss=0.8526, lr=0.004025, batch_cost=1.3616, reader_cost=0.0001 | ETA 11:00:22 2021-02-23 14:07:46 [INFO] [TRAIN] epoch=137, iter=50910/80000, loss=0.8422, lr=0.004023, batch_cost=1.3702, reader_cost=0.0001 | ETA 11:04:19 2021-02-23 14:08:00 [INFO] [TRAIN] epoch=137, iter=50920/80000, loss=0.8199, lr=0.004022, batch_cost=1.3564, reader_cost=0.0001 | ETA 10:57:23 2021-02-23 14:08:13 [INFO] [TRAIN] epoch=137, iter=50930/80000, loss=0.9160, lr=0.004021, batch_cost=1.3487, reader_cost=0.0001 | ETA 10:53:28 2021-02-23 14:08:27 [INFO] [TRAIN] epoch=137, iter=50940/80000, loss=0.9160, lr=0.004020, batch_cost=1.3640, reader_cost=0.0001 | ETA 11:00:38 2021-02-23 14:08:41 [INFO] [TRAIN] epoch=137, iter=50950/80000, loss=0.9221, lr=0.004019, batch_cost=1.3798, reader_cost=0.0001 | ETA 11:08:02 2021-02-23 14:08:54 [INFO] [TRAIN] epoch=137, iter=50960/80000, loss=0.9058, lr=0.004017, batch_cost=1.3631, reader_cost=0.0001 | ETA 10:59:45 2021-02-23 14:09:09 [INFO] [TRAIN] epoch=138, iter=50970/80000, loss=0.8451, lr=0.004016, batch_cost=1.5009, reader_cost=0.0897 | ETA 12:06:10 2021-02-23 14:09:23 [INFO] [TRAIN] epoch=138, iter=50980/80000, loss=0.8085, lr=0.004015, batch_cost=1.3396, reader_cost=0.0001 | ETA 10:47:55 2021-02-23 14:09:36 [INFO] [TRAIN] epoch=138, iter=50990/80000, loss=0.9282, lr=0.004014, batch_cost=1.3509, reader_cost=0.0001 | ETA 10:53:08 2021-02-23 14:09:50 [INFO] [TRAIN] epoch=138, iter=51000/80000, loss=0.7989, lr=0.004012, batch_cost=1.3692, reader_cost=0.0001 | ETA 11:01:47 2021-02-23 14:09:50 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:20 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:07 - batch_cost: 0.2261 - reader cost: 0.0998  3/125 [..............................] - ETA: 1:00 - batch_cost: 0.2773 - reader cost: 0.1096 4/125 [..............................] - ETA: 58s - batch_cost: 0.3178 - reader cost: 0.1294  5/125 [>.............................] - ETA: 56s - batch_cost: 0.3402 - reader cost: 0.1398 6/125 [>.............................] - ETA: 55s - batch_cost: 0.3545 - reader cost: 0.1458 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3561 - reader cost: 0.1417 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3622 - reader cost: 0.1434 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3690 - reader cost: 0.1466 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3716 - reader cost: 0.1465 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3772 - reader cost: 0.1498 12/125 [=>............................] - ETA: 48s - batch_cost: 0.3771 - reader cost: 0.1477 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3826 - reader cost: 0.1516 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3865 - reader cost: 0.1537 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3899 - reader cost: 0.1556 16/125 [==>...........................] - ETA: 46s - batch_cost: 0.3902 - reader cost: 0.1542 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3927 - reader cost: 0.1554 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3924 - reader cost: 0.1544 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3914 - reader cost: 0.1521 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3906 - reader cost: 0.1503 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.3930 - reader cost: 0.1517 22/125 [====>.........................] - ETA: 43s - batch_cost: 0.3947 - reader cost: 0.1528 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.3947 - reader cost: 0.1518 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.3930 - reader cost: 0.1497 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.3945 - reader cost: 0.1507 26/125 [=====>........................] - ETA: 41s - batch_cost: 0.3940 - reader cost: 0.1492 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.3955 - reader cost: 0.1502 28/125 [=====>........................] - ETA: 40s - batch_cost: 0.3956 - reader cost: 0.1493 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.3962 - reader cost: 0.1487 30/125 [======>.......................] - ETA: 39s - batch_cost: 0.3970 - reader cost: 0.1495 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.3961 - reader cost: 0.1484 32/125 [======>.......................] - ETA: 38s - batch_cost: 0.3970 - reader cost: 0.1492 33/125 [======>.......................] - ETA: 38s - batch_cost: 0.3976 - reader cost: 0.1499 34/125 [=======>......................] - ETA: 37s - batch_cost: 0.3985 - reader cost: 0.1506 35/125 [=======>......................] - ETA: 37s - batch_cost: 0.3991 - reader cost: 0.1512 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.3997 - reader cost: 0.1518 37/125 [=======>......................] - ETA: 36s - batch_cost: 0.3997 - reader cost: 0.1513 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4000 - reader cost: 0.1515 39/125 [========>.....................] - ETA: 35s - batch_cost: 0.3996 - reader cost: 0.1510 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.3990 - reader cost: 0.1503 41/125 [========>.....................] - ETA: 34s - batch_cost: 0.4003 - reader cost: 0.1515 42/125 [=========>....................] - ETA: 34s - batch_cost: 0.4002 - reader cost: 0.1513 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4012 - reader cost: 0.1522 44/125 [=========>....................] - ETA: 33s - batch_cost: 0.4016 - reader cost: 0.1526 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4012 - reader cost: 0.1518 46/125 [==========>...................] - ETA: 32s - batch_cost: 0.4016 - reader cost: 0.1515 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4018 - reader cost: 0.1507 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4024 - reader cost: 0.1511 49/125 [==========>...................] - ETA: 31s - batch_cost: 0.4028 - reader cost: 0.1511 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4032 - reader cost: 0.1511 51/125 [===========>..................] - ETA: 30s - batch_cost: 0.4037 - reader cost: 0.1517 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4036 - reader cost: 0.1510 53/125 [===========>..................] - ETA: 29s - batch_cost: 0.4040 - reader cost: 0.1514 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4042 - reader cost: 0.1510 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4045 - reader cost: 0.1513 56/125 [============>.................] - ETA: 28s - batch_cost: 0.4047 - reader cost: 0.1506 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4049 - reader cost: 0.1509 58/125 [============>.................] - ETA: 27s - batch_cost: 0.4053 - reader cost: 0.1513 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4055 - reader cost: 0.1516 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4053 - reader cost: 0.1513 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4056 - reader cost: 0.1516 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4059 - reader cost: 0.1520 63/125 [==============>...............] - ETA: 25s - batch_cost: 0.4068 - reader cost: 0.1529 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4071 - reader cost: 0.1532 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4067 - reader cost: 0.1529 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4062 - reader cost: 0.1525 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4066 - reader cost: 0.1528 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4061 - reader cost: 0.1523 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4063 - reader cost: 0.1525 70/125 [===============>..............] - ETA: 22s - batch_cost: 0.4068 - reader cost: 0.1529 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4068 - reader cost: 0.1530 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4070 - reader cost: 0.1532 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4077 - reader cost: 0.1538 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4079 - reader cost: 0.1541 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4079 - reader cost: 0.1539 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4082 - reader cost: 0.1540 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4083 - reader cost: 0.1540 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4079 - reader cost: 0.1537 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4081 - reader cost: 0.1539 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4083 - reader cost: 0.1542 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4084 - reader cost: 0.1542 82/125 [==================>...........] - ETA: 17s - batch_cost: 0.4086 - reader cost: 0.1545 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4089 - reader cost: 0.1548 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4088 - reader cost: 0.1547 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4090 - reader cost: 0.1550 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4089 - reader cost: 0.1549 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4086 - reader cost: 0.1547 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4082 - reader cost: 0.1543 89/125 [====================>.........] - ETA: 14s - batch_cost: 0.4086 - reader cost: 0.1547 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4084 - reader cost: 0.1545 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4090 - reader cost: 0.1550 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4092 - reader cost: 0.1553 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4096 - reader cost: 0.1556 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4097 - reader cost: 0.1556 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4095 - reader cost: 0.1554 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4094 - reader cost: 0.1553 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4097 - reader cost: 0.1557 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4104 - reader cost: 0.1564 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4101 - reader cost: 0.1561 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4106 - reader cost: 0.1564 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4108 - reader cost: 0.1567 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4109 - reader cost: 0.1568  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4110 - reader cost: 0.1569 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4113 - reader cost: 0.1571 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4113 - reader cost: 0.1571 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4115 - reader cost: 0.1573 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4118 - reader cost: 0.1576 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4119 - reader cost: 0.1577 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4115 - reader cost: 0.1573 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4118 - reader cost: 0.1577 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4120 - reader cost: 0.1579 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4117 - reader cost: 0.1577 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4114 - reader cost: 0.1573 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4115 - reader cost: 0.1575 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4116 - reader cost: 0.1576 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4118 - reader cost: 0.1577 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4121 - reader cost: 0.1580 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4117 - reader cost: 0.1576 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4116 - reader cost: 0.1576 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4118 - reader cost: 0.1577 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4118 - reader cost: 0.1578 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4119 - reader cost: 0.1578 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4121 - reader cost: 0.1580 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4122 - reader cost: 0.1581 125/125 [==============================] - 52s 418ms/step - batch_cost: 0.4124 - reader cost: 0.1583 2021-02-23 14:10:42 [INFO] [EVAL] #Images=500 mIoU=0.7380 Acc=0.9543 Kappa=0.9406 2021-02-23 14:10:42 [INFO] [EVAL] Class IoU: [0.9748 0.8108 0.9161 0.4 0.5288 0.616 0.7189 0.8107 0.9149 0.6478 0.9442 0.8085 0.6232 0.9401 0.6501 0.756 0.6662 0.5216 0.7725] 2021-02-23 14:10:42 [INFO] [EVAL] Class Acc: [0.9871 0.9001 0.9457 0.7304 0.906 0.8405 0.8665 0.9305 0.9432 0.8311 0.959 0.8658 0.8217 0.9616 0.9531 0.9622 0.7801 0.8992 0.8694] 2021-02-23 14:10:47 [INFO] [EVAL] The model with the best validation mIoU (0.7816) was saved at iter 44000. 2021-02-23 14:11:00 [INFO] [TRAIN] epoch=138, iter=51010/80000, loss=1.0195, lr=0.004011, batch_cost=1.3493, reader_cost=0.0001 | ETA 10:51:55 2021-02-23 14:11:13 [INFO] [TRAIN] epoch=138, iter=51020/80000, loss=0.8959, lr=0.004010, batch_cost=1.3185, reader_cost=0.0001 | ETA 10:36:50 2021-02-23 14:11:27 [INFO] [TRAIN] epoch=138, iter=51030/80000, loss=1.0384, lr=0.004009, batch_cost=1.3708, reader_cost=0.0001 | ETA 11:01:51 2021-02-23 14:11:41 [INFO] [TRAIN] epoch=138, iter=51040/80000, loss=0.8439, lr=0.004007, batch_cost=1.3689, reader_cost=0.0001 | ETA 11:00:42 2021-02-23 14:11:54 [INFO] [TRAIN] epoch=138, iter=51050/80000, loss=0.8748, lr=0.004006, batch_cost=1.3373, reader_cost=0.0001 | ETA 10:45:15 2021-02-23 14:12:08 [INFO] [TRAIN] epoch=138, iter=51060/80000, loss=0.9501, lr=0.004005, batch_cost=1.4040, reader_cost=0.0001 | ETA 11:17:12 2021-02-23 14:12:22 [INFO] [TRAIN] epoch=138, iter=51070/80000, loss=0.8499, lr=0.004004, batch_cost=1.3644, reader_cost=0.0001 | ETA 10:57:51 2021-02-23 14:12:35 [INFO] [TRAIN] epoch=138, iter=51080/80000, loss=0.8636, lr=0.004002, batch_cost=1.3389, reader_cost=0.0001 | ETA 10:45:21 2021-02-23 14:12:49 [INFO] [TRAIN] epoch=138, iter=51090/80000, loss=0.8701, lr=0.004001, batch_cost=1.3480, reader_cost=0.0001 | ETA 10:49:30 2021-02-23 14:13:02 [INFO] [TRAIN] epoch=138, iter=51100/80000, loss=0.8566, lr=0.004000, batch_cost=1.3740, reader_cost=0.0001 | ETA 11:01:47 2021-02-23 14:13:16 [INFO] [TRAIN] epoch=138, iter=51110/80000, loss=0.8505, lr=0.003999, batch_cost=1.3404, reader_cost=0.0001 | ETA 10:45:25 2021-02-23 14:13:29 [INFO] [TRAIN] epoch=138, iter=51120/80000, loss=0.8834, lr=0.003997, batch_cost=1.3567, reader_cost=0.0001 | ETA 10:53:00 2021-02-23 14:13:43 [INFO] [TRAIN] epoch=138, iter=51130/80000, loss=0.9013, lr=0.003996, batch_cost=1.3945, reader_cost=0.0001 | ETA 11:10:59 2021-02-23 14:13:57 [INFO] [TRAIN] epoch=138, iter=51140/80000, loss=0.8413, lr=0.003995, batch_cost=1.4111, reader_cost=0.0001 | ETA 11:18:45 2021-02-23 14:14:11 [INFO] [TRAIN] epoch=138, iter=51150/80000, loss=0.9811, lr=0.003994, batch_cost=1.3401, reader_cost=0.0001 | ETA 10:44:22 2021-02-23 14:14:24 [INFO] [TRAIN] epoch=138, iter=51160/80000, loss=0.8174, lr=0.003992, batch_cost=1.3662, reader_cost=0.0001 | ETA 10:56:42 2021-02-23 14:14:38 [INFO] [TRAIN] epoch=138, iter=51170/80000, loss=0.8772, lr=0.003991, batch_cost=1.3596, reader_cost=0.0001 | ETA 10:53:16 2021-02-23 14:14:52 [INFO] [TRAIN] epoch=138, iter=51180/80000, loss=0.8522, lr=0.003990, batch_cost=1.3957, reader_cost=0.0001 | ETA 11:10:23 2021-02-23 14:15:06 [INFO] [TRAIN] epoch=138, iter=51190/80000, loss=0.7998, lr=0.003989, batch_cost=1.4100, reader_cost=0.0001 | ETA 11:17:02 2021-02-23 14:15:20 [INFO] [TRAIN] epoch=138, iter=51200/80000, loss=0.8753, lr=0.003987, batch_cost=1.3437, reader_cost=0.0001 | ETA 10:44:57 2021-02-23 14:15:33 [INFO] [TRAIN] epoch=138, iter=51210/80000, loss=0.8160, lr=0.003986, batch_cost=1.3778, reader_cost=0.0001 | ETA 11:01:05 2021-02-23 14:15:47 [INFO] [TRAIN] epoch=138, iter=51220/80000, loss=0.8224, lr=0.003985, batch_cost=1.3909, reader_cost=0.0001 | ETA 11:07:10 2021-02-23 14:16:01 [INFO] [TRAIN] epoch=138, iter=51230/80000, loss=0.8554, lr=0.003984, batch_cost=1.3694, reader_cost=0.0001 | ETA 10:56:38 2021-02-23 14:16:14 [INFO] [TRAIN] epoch=138, iter=51240/80000, loss=0.9058, lr=0.003982, batch_cost=1.3485, reader_cost=0.0001 | ETA 10:46:23 2021-02-23 14:16:28 [INFO] [TRAIN] epoch=138, iter=51250/80000, loss=0.9950, lr=0.003981, batch_cost=1.3492, reader_cost=0.0001 | ETA 10:46:30 2021-02-23 14:16:42 [INFO] [TRAIN] epoch=138, iter=51260/80000, loss=0.8381, lr=0.003980, batch_cost=1.3775, reader_cost=0.0001 | ETA 10:59:47 2021-02-23 14:16:56 [INFO] [TRAIN] epoch=138, iter=51270/80000, loss=0.8868, lr=0.003979, batch_cost=1.4127, reader_cost=0.0001 | ETA 11:16:26 2021-02-23 14:17:09 [INFO] [TRAIN] epoch=138, iter=51280/80000, loss=0.9063, lr=0.003977, batch_cost=1.3609, reader_cost=0.0001 | ETA 10:51:26 2021-02-23 14:17:23 [INFO] [TRAIN] epoch=138, iter=51290/80000, loss=0.9283, lr=0.003976, batch_cost=1.3487, reader_cost=0.0001 | ETA 10:45:21 2021-02-23 14:17:37 [INFO] [TRAIN] epoch=138, iter=51300/80000, loss=0.7959, lr=0.003975, batch_cost=1.3719, reader_cost=0.0001 | ETA 10:56:13 2021-02-23 14:17:50 [INFO] [TRAIN] epoch=138, iter=51310/80000, loss=0.8110, lr=0.003974, batch_cost=1.3735, reader_cost=0.0001 | ETA 10:56:44 2021-02-23 14:18:04 [INFO] [TRAIN] epoch=138, iter=51320/80000, loss=0.8614, lr=0.003972, batch_cost=1.3275, reader_cost=0.0001 | ETA 10:34:32 2021-02-23 14:18:17 [INFO] [TRAIN] epoch=138, iter=51330/80000, loss=0.9588, lr=0.003971, batch_cost=1.3348, reader_cost=0.0001 | ETA 10:37:48 2021-02-23 14:18:32 [INFO] [TRAIN] epoch=139, iter=51340/80000, loss=0.8516, lr=0.003970, batch_cost=1.4809, reader_cost=0.0687 | ETA 11:47:21 2021-02-23 14:18:46 [INFO] [TRAIN] epoch=139, iter=51350/80000, loss=0.8101, lr=0.003969, batch_cost=1.3778, reader_cost=0.0001 | ETA 10:57:54 2021-02-23 14:18:59 [INFO] [TRAIN] epoch=139, iter=51360/80000, loss=0.8638, lr=0.003967, batch_cost=1.3519, reader_cost=0.0001 | ETA 10:45:17 2021-02-23 14:19:13 [INFO] [TRAIN] epoch=139, iter=51370/80000, loss=0.8491, lr=0.003966, batch_cost=1.3627, reader_cost=0.0001 | ETA 10:50:14 2021-02-23 14:19:26 [INFO] [TRAIN] epoch=139, iter=51380/80000, loss=0.8838, lr=0.003965, batch_cost=1.3705, reader_cost=0.0001 | ETA 10:53:45 2021-02-23 14:19:40 [INFO] [TRAIN] epoch=139, iter=51390/80000, loss=0.9178, lr=0.003964, batch_cost=1.3558, reader_cost=0.0001 | ETA 10:46:28 2021-02-23 14:19:54 [INFO] [TRAIN] epoch=139, iter=51400/80000, loss=0.9261, lr=0.003962, batch_cost=1.3643, reader_cost=0.0001 | ETA 10:50:18 2021-02-23 14:20:07 [INFO] [TRAIN] epoch=139, iter=51410/80000, loss=0.9100, lr=0.003961, batch_cost=1.3475, reader_cost=0.0001 | ETA 10:42:04 2021-02-23 14:20:21 [INFO] [TRAIN] epoch=139, iter=51420/80000, loss=0.9688, lr=0.003960, batch_cost=1.3858, reader_cost=0.0001 | ETA 11:00:06 2021-02-23 14:20:35 [INFO] [TRAIN] epoch=139, iter=51430/80000, loss=0.9404, lr=0.003959, batch_cost=1.4196, reader_cost=0.0001 | ETA 11:15:58 2021-02-23 14:20:49 [INFO] [TRAIN] epoch=139, iter=51440/80000, loss=0.8759, lr=0.003957, batch_cost=1.3889, reader_cost=0.0001 | ETA 11:01:08 2021-02-23 14:21:03 [INFO] [TRAIN] epoch=139, iter=51450/80000, loss=0.9142, lr=0.003956, batch_cost=1.3569, reader_cost=0.0001 | ETA 10:45:39 2021-02-23 14:21:16 [INFO] [TRAIN] epoch=139, iter=51460/80000, loss=0.8970, lr=0.003955, batch_cost=1.3778, reader_cost=0.0001 | ETA 10:55:23 2021-02-23 14:21:30 [INFO] [TRAIN] epoch=139, iter=51470/80000, loss=0.8636, lr=0.003954, batch_cost=1.3620, reader_cost=0.0001 | ETA 10:47:38 2021-02-23 14:21:43 [INFO] [TRAIN] epoch=139, iter=51480/80000, loss=0.8436, lr=0.003952, batch_cost=1.3444, reader_cost=0.0001 | ETA 10:39:01 2021-02-23 14:21:57 [INFO] [TRAIN] epoch=139, iter=51490/80000, loss=0.8188, lr=0.003951, batch_cost=1.3626, reader_cost=0.0001 | ETA 10:47:26 2021-02-23 14:22:11 [INFO] [TRAIN] epoch=139, iter=51500/80000, loss=0.8929, lr=0.003950, batch_cost=1.3682, reader_cost=0.0001 | ETA 10:49:53 2021-02-23 14:22:24 [INFO] [TRAIN] epoch=139, iter=51510/80000, loss=0.9538, lr=0.003949, batch_cost=1.3459, reader_cost=0.0001 | ETA 10:39:03 2021-02-23 14:22:38 [INFO] [TRAIN] epoch=139, iter=51520/80000, loss=0.8069, lr=0.003947, batch_cost=1.3842, reader_cost=0.0001 | ETA 10:57:03 2021-02-23 14:22:52 [INFO] [TRAIN] epoch=139, iter=51530/80000, loss=0.9488, lr=0.003946, batch_cost=1.3636, reader_cost=0.0001 | ETA 10:47:00 2021-02-23 14:23:05 [INFO] [TRAIN] epoch=139, iter=51540/80000, loss=0.8535, lr=0.003945, batch_cost=1.3756, reader_cost=0.0001 | ETA 10:52:30 2021-02-23 14:23:19 [INFO] [TRAIN] epoch=139, iter=51550/80000, loss=0.8405, lr=0.003944, batch_cost=1.3995, reader_cost=0.0001 | ETA 11:03:36 2021-02-23 14:23:33 [INFO] [TRAIN] epoch=139, iter=51560/80000, loss=0.8411, lr=0.003942, batch_cost=1.3394, reader_cost=0.0001 | ETA 10:34:53 2021-02-23 14:23:47 [INFO] [TRAIN] epoch=139, iter=51570/80000, loss=0.8434, lr=0.003941, batch_cost=1.3702, reader_cost=0.0001 | ETA 10:49:14 2021-02-23 14:24:00 [INFO] [TRAIN] epoch=139, iter=51580/80000, loss=0.8747, lr=0.003940, batch_cost=1.3766, reader_cost=0.0001 | ETA 10:52:03 2021-02-23 14:24:14 [INFO] [TRAIN] epoch=139, iter=51590/80000, loss=0.8721, lr=0.003939, batch_cost=1.3717, reader_cost=0.0001 | ETA 10:49:30 2021-02-23 14:24:28 [INFO] [TRAIN] epoch=139, iter=51600/80000, loss=0.9547, lr=0.003937, batch_cost=1.3785, reader_cost=0.0001 | ETA 10:52:29 2021-02-23 14:24:41 [INFO] [TRAIN] epoch=139, iter=51610/80000, loss=0.8599, lr=0.003936, batch_cost=1.3575, reader_cost=0.0001 | ETA 10:42:18 2021-02-23 14:24:55 [INFO] [TRAIN] epoch=139, iter=51620/80000, loss=0.8849, lr=0.003935, batch_cost=1.3937, reader_cost=0.0001 | ETA 10:59:12 2021-02-23 14:25:09 [INFO] [TRAIN] epoch=139, iter=51630/80000, loss=0.8325, lr=0.003934, batch_cost=1.3627, reader_cost=0.0001 | ETA 10:44:19 2021-02-23 14:25:22 [INFO] [TRAIN] epoch=139, iter=51640/80000, loss=0.8135, lr=0.003932, batch_cost=1.3510, reader_cost=0.0001 | ETA 10:38:34 2021-02-23 14:25:37 [INFO] [TRAIN] epoch=139, iter=51650/80000, loss=0.8876, lr=0.003931, batch_cost=1.4196, reader_cost=0.0001 | ETA 11:10:45 2021-02-23 14:25:50 [INFO] [TRAIN] epoch=139, iter=51660/80000, loss=0.8429, lr=0.003930, batch_cost=1.3608, reader_cost=0.0001 | ETA 10:42:45 2021-02-23 14:26:04 [INFO] [TRAIN] epoch=139, iter=51670/80000, loss=0.7641, lr=0.003929, batch_cost=1.3776, reader_cost=0.0001 | ETA 10:50:27 2021-02-23 14:26:18 [INFO] [TRAIN] epoch=139, iter=51680/80000, loss=0.8094, lr=0.003928, batch_cost=1.3630, reader_cost=0.0001 | ETA 10:43:18 2021-02-23 14:26:31 [INFO] [TRAIN] epoch=139, iter=51690/80000, loss=0.9157, lr=0.003926, batch_cost=1.3640, reader_cost=0.0001 | ETA 10:43:35 2021-02-23 14:26:45 [INFO] [TRAIN] epoch=139, iter=51700/80000, loss=0.9178, lr=0.003925, batch_cost=1.3363, reader_cost=0.0001 | ETA 10:30:17 2021-02-23 14:26:59 [INFO] [TRAIN] epoch=140, iter=51710/80000, loss=0.8717, lr=0.003924, batch_cost=1.4344, reader_cost=0.0887 | ETA 11:16:20 2021-02-23 14:27:13 [INFO] [TRAIN] epoch=140, iter=51720/80000, loss=0.7821, lr=0.003923, batch_cost=1.3926, reader_cost=0.0001 | ETA 10:56:22 2021-02-23 14:27:26 [INFO] [TRAIN] epoch=140, iter=51730/80000, loss=0.8581, lr=0.003921, batch_cost=1.3531, reader_cost=0.0001 | ETA 10:37:31 2021-02-23 14:27:40 [INFO] [TRAIN] epoch=140, iter=51740/80000, loss=0.9042, lr=0.003920, batch_cost=1.3746, reader_cost=0.0001 | ETA 10:47:27 2021-02-23 14:27:54 [INFO] [TRAIN] epoch=140, iter=51750/80000, loss=0.8568, lr=0.003919, batch_cost=1.3329, reader_cost=0.0001 | ETA 10:27:33 2021-02-23 14:28:07 [INFO] [TRAIN] epoch=140, iter=51760/80000, loss=0.8770, lr=0.003918, batch_cost=1.3722, reader_cost=0.0001 | ETA 10:45:50 2021-02-23 14:28:21 [INFO] [TRAIN] epoch=140, iter=51770/80000, loss=0.9057, lr=0.003916, batch_cost=1.3888, reader_cost=0.0001 | ETA 10:53:25 2021-02-23 14:28:35 [INFO] [TRAIN] epoch=140, iter=51780/80000, loss=0.8389, lr=0.003915, batch_cost=1.3752, reader_cost=0.0001 | ETA 10:46:48 2021-02-23 14:28:49 [INFO] [TRAIN] epoch=140, iter=51790/80000, loss=0.8395, lr=0.003914, batch_cost=1.3736, reader_cost=0.0001 | ETA 10:45:49 2021-02-23 14:29:02 [INFO] [TRAIN] epoch=140, iter=51800/80000, loss=0.8544, lr=0.003913, batch_cost=1.3658, reader_cost=0.0001 | ETA 10:41:56 2021-02-23 14:29:16 [INFO] [TRAIN] epoch=140, iter=51810/80000, loss=0.8553, lr=0.003911, batch_cost=1.3534, reader_cost=0.0001 | ETA 10:35:51 2021-02-23 14:29:29 [INFO] [TRAIN] epoch=140, iter=51820/80000, loss=0.9813, lr=0.003910, batch_cost=1.3412, reader_cost=0.0001 | ETA 10:29:53 2021-02-23 14:29:44 [INFO] [TRAIN] epoch=140, iter=51830/80000, loss=0.8356, lr=0.003909, batch_cost=1.4275, reader_cost=0.0001 | ETA 11:10:13 2021-02-23 14:29:58 [INFO] [TRAIN] epoch=140, iter=51840/80000, loss=0.8405, lr=0.003908, batch_cost=1.4128, reader_cost=0.0001 | ETA 11:03:03 2021-02-23 14:30:12 [INFO] [TRAIN] epoch=140, iter=51850/80000, loss=0.7804, lr=0.003906, batch_cost=1.4137, reader_cost=0.0001 | ETA 11:03:16 2021-02-23 14:30:26 [INFO] [TRAIN] epoch=140, iter=51860/80000, loss=0.9236, lr=0.003905, batch_cost=1.4086, reader_cost=0.0001 | ETA 11:00:37 2021-02-23 14:30:39 [INFO] [TRAIN] epoch=140, iter=51870/80000, loss=0.8869, lr=0.003904, batch_cost=1.3413, reader_cost=0.0001 | ETA 10:28:49 2021-02-23 14:30:53 [INFO] [TRAIN] epoch=140, iter=51880/80000, loss=0.8170, lr=0.003903, batch_cost=1.3713, reader_cost=0.0001 | ETA 10:42:41 2021-02-23 14:31:07 [INFO] [TRAIN] epoch=140, iter=51890/80000, loss=0.8033, lr=0.003901, batch_cost=1.3608, reader_cost=0.0001 | ETA 10:37:32 2021-02-23 14:31:20 [INFO] [TRAIN] epoch=140, iter=51900/80000, loss=0.8649, lr=0.003900, batch_cost=1.3556, reader_cost=0.0001 | ETA 10:34:51 2021-02-23 14:31:34 [INFO] [TRAIN] epoch=140, iter=51910/80000, loss=0.9316, lr=0.003899, batch_cost=1.3414, reader_cost=0.0001 | ETA 10:27:59 2021-02-23 14:31:47 [INFO] [TRAIN] epoch=140, iter=51920/80000, loss=0.8767, lr=0.003898, batch_cost=1.3775, reader_cost=0.0001 | ETA 10:44:40 2021-02-23 14:32:01 [INFO] [TRAIN] epoch=140, iter=51930/80000, loss=0.8305, lr=0.003896, batch_cost=1.3601, reader_cost=0.0001 | ETA 10:36:17 2021-02-23 14:32:15 [INFO] [TRAIN] epoch=140, iter=51940/80000, loss=0.8195, lr=0.003895, batch_cost=1.3781, reader_cost=0.0001 | ETA 10:44:29 2021-02-23 14:32:28 [INFO] [TRAIN] epoch=140, iter=51950/80000, loss=0.8631, lr=0.003894, batch_cost=1.3688, reader_cost=0.0001 | ETA 10:39:54 2021-02-23 14:32:42 [INFO] [TRAIN] epoch=140, iter=51960/80000, loss=0.8877, lr=0.003893, batch_cost=1.3315, reader_cost=0.0001 | ETA 10:22:14 2021-02-23 14:32:55 [INFO] [TRAIN] epoch=140, iter=51970/80000, loss=0.8421, lr=0.003891, batch_cost=1.3706, reader_cost=0.0001 | ETA 10:40:18 2021-02-23 14:33:09 [INFO] [TRAIN] epoch=140, iter=51980/80000, loss=0.8724, lr=0.003890, batch_cost=1.3986, reader_cost=0.0001 | ETA 10:53:09 2021-02-23 14:33:23 [INFO] [TRAIN] epoch=140, iter=51990/80000, loss=0.9789, lr=0.003889, batch_cost=1.3525, reader_cost=0.0001 | ETA 10:31:22 2021-02-23 14:33:37 [INFO] [TRAIN] epoch=140, iter=52000/80000, loss=0.8337, lr=0.003888, batch_cost=1.3626, reader_cost=0.0001 | ETA 10:35:51 2021-02-23 14:33:37 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:10 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:01 - batch_cost: 0.2145 - reader cost: 0.0904  3/125 [..............................] - ETA: 58s - batch_cost: 0.2924 - reader cost: 0.1261  4/125 [..............................] - ETA: 56s - batch_cost: 0.3260 - reader cost: 0.1387 5/125 [>.............................] - ETA: 54s - batch_cost: 0.3375 - reader cost: 0.1357 6/125 [>.............................] - ETA: 51s - batch_cost: 0.3413 - reader cost: 0.1311 7/125 [>.............................] - ETA: 51s - batch_cost: 0.3543 - reader cost: 0.1382 8/125 [>.............................] - ETA: 50s - batch_cost: 0.3643 - reader cost: 0.1442 9/125 [=>............................] - ETA: 50s - batch_cost: 0.3739 - reader cost: 0.1505 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3837 - reader cost: 0.1536 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3889 - reader cost: 0.1503 12/125 [=>............................] - ETA: 50s - batch_cost: 0.3959 - reader cost: 0.1476 13/125 [==>...........................] - ETA: 49s - batch_cost: 0.3976 - reader cost: 0.1485 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.4001 - reader cost: 0.1508 15/125 [==>...........................] - ETA: 48s - batch_cost: 0.4022 - reader cost: 0.1529 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.4039 - reader cost: 0.1543 17/125 [===>..........................] - ETA: 47s - batch_cost: 0.4053 - reader cost: 0.1554 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.4067 - reader cost: 0.1564 19/125 [===>..........................] - ETA: 46s - batch_cost: 0.4055 - reader cost: 0.1552 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4044 - reader cost: 0.1539 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4054 - reader cost: 0.1550 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4073 - reader cost: 0.1564 23/125 [====>.........................] - ETA: 44s - batch_cost: 0.4080 - reader cost: 0.1571 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4092 - reader cost: 0.1581 25/125 [=====>........................] - ETA: 43s - batch_cost: 0.4090 - reader cost: 0.1579 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4077 - reader cost: 0.1566 27/125 [=====>........................] - ETA: 42s - batch_cost: 0.4081 - reader cost: 0.1571 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4092 - reader cost: 0.1579 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4103 - reader cost: 0.1590 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4114 - reader cost: 0.1600 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4117 - reader cost: 0.1603 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4122 - reader cost: 0.1606 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4126 - reader cost: 0.1610 34/125 [=======>......................] - ETA: 39s - batch_cost: 0.4131 - reader cost: 0.1616 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4142 - reader cost: 0.1621 36/125 [=======>......................] - ETA: 38s - batch_cost: 0.4153 - reader cost: 0.1630 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4145 - reader cost: 0.1623 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4147 - reader cost: 0.1625 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4153 - reader cost: 0.1631 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4144 - reader cost: 0.1622 41/125 [========>.....................] - ETA: 36s - batch_cost: 0.4149 - reader cost: 0.1624 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4154 - reader cost: 0.1627 43/125 [=========>....................] - ETA: 35s - batch_cost: 0.4156 - reader cost: 0.1629 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4151 - reader cost: 0.1624 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4157 - reader cost: 0.1629 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4162 - reader cost: 0.1634 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4164 - reader cost: 0.1637 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4167 - reader cost: 0.1640 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4168 - reader cost: 0.1641 50/125 [===========>..................] - ETA: 32s - batch_cost: 0.4168 - reader cost: 0.1640 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4177 - reader cost: 0.1650 52/125 [===========>..................] - ETA: 31s - batch_cost: 0.4184 - reader cost: 0.1653 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4181 - reader cost: 0.1650 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4192 - reader cost: 0.1660 55/125 [============>.................] - ETA: 30s - batch_cost: 0.4194 - reader cost: 0.1662 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4196 - reader cost: 0.1665 57/125 [============>.................] - ETA: 29s - batch_cost: 0.4199 - reader cost: 0.1668 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4201 - reader cost: 0.1669 59/125 [=============>................] - ETA: 28s - batch_cost: 0.4196 - reader cost: 0.1665 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4201 - reader cost: 0.1669 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4203 - reader cost: 0.1671 62/125 [=============>................] - ETA: 27s - batch_cost: 0.4204 - reader cost: 0.1672 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4198 - reader cost: 0.1665 64/125 [==============>...............] - ETA: 26s - batch_cost: 0.4198 - reader cost: 0.1665 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4200 - reader cost: 0.1666 66/125 [==============>...............] - ETA: 25s - batch_cost: 0.4203 - reader cost: 0.1668 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4203 - reader cost: 0.1668 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4196 - reader cost: 0.1662 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4198 - reader cost: 0.1663 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4199 - reader cost: 0.1664 71/125 [================>.............] - ETA: 23s - batch_cost: 0.4200 - reader cost: 0.1665 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4199 - reader cost: 0.1664 73/125 [================>.............] - ETA: 22s - batch_cost: 0.4200 - reader cost: 0.1664 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4202 - reader cost: 0.1665 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4204 - reader cost: 0.1667 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4205 - reader cost: 0.1668 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4199 - reader cost: 0.1663 78/125 [=================>............] - ETA: 20s - batch_cost: 0.4196 - reader cost: 0.1660 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4195 - reader cost: 0.1660 80/125 [==================>...........] - ETA: 19s - batch_cost: 0.4191 - reader cost: 0.1653 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4190 - reader cost: 0.1652 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4190 - reader cost: 0.1653 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4185 - reader cost: 0.1648 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4186 - reader cost: 0.1649 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4182 - reader cost: 0.1646 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4180 - reader cost: 0.1642 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4180 - reader cost: 0.1643 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4183 - reader cost: 0.1644 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4174 - reader cost: 0.1636 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4177 - reader cost: 0.1638 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4170 - reader cost: 0.1631 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4164 - reader cost: 0.1625 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4162 - reader cost: 0.1623 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4164 - reader cost: 0.1624 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4167 - reader cost: 0.1627 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4168 - reader cost: 0.1623 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4172 - reader cost: 0.1623 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4172 - reader cost: 0.1618 99/125 [======================>.......] - ETA: 11s - batch_cost: 0.4174 - reader cost: 0.1618 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4171 - reader cost: 0.1616 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4172 - reader cost: 0.1617 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4174 - reader cost: 0.1620  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4170 - reader cost: 0.1615 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4172 - reader cost: 0.1618 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4170 - reader cost: 0.1614 106/125 [========================>.....] - ETA: 8s - batch_cost: 0.4165 - reader cost: 0.1607 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4166 - reader cost: 0.1604 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4167 - reader cost: 0.1604 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4167 - reader cost: 0.1604 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4168 - reader cost: 0.1605 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4170 - reader cost: 0.1607 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4170 - reader cost: 0.1608 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4171 - reader cost: 0.1610 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4171 - reader cost: 0.1611 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4172 - reader cost: 0.1612 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4169 - reader cost: 0.1610 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4168 - reader cost: 0.1608 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4167 - reader cost: 0.1603 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4162 - reader cost: 0.1593 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4163 - reader cost: 0.1589 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4163 - reader cost: 0.1584 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4165 - reader cost: 0.1581 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4167 - reader cost: 0.1579 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4169 - reader cost: 0.1581 125/125 [==============================] - 53s 422ms/step - batch_cost: 0.4170 - reader cost: 0.1583 2021-02-23 14:34:29 [INFO] [EVAL] #Images=500 mIoU=0.7347 Acc=0.9504 Kappa=0.9355 2021-02-23 14:34:29 [INFO] [EVAL] Class IoU: [0.9703 0.8186 0.8979 0.3583 0.5795 0.653 0.7094 0.8011 0.9079 0.5936 0.9465 0.8129 0.5695 0.9328 0.6227 0.7456 0.6963 0.5697 0.7746] 2021-02-23 14:34:29 [INFO] [EVAL] Class Acc: [0.9832 0.9065 0.9219 0.7799 0.8429 0.8189 0.8536 0.8829 0.9615 0.7511 0.9682 0.8951 0.8283 0.9707 0.9517 0.9405 0.9771 0.7878 0.8425] 2021-02-23 14:34:34 [INFO] [EVAL] The model with the best validation mIoU (0.7816) was saved at iter 44000. 2021-02-23 14:34:47 [INFO] [TRAIN] epoch=140, iter=52010/80000, loss=0.8834, lr=0.003886, batch_cost=1.3487, reader_cost=0.0001 | ETA 10:29:09 2021-02-23 14:35:01 [INFO] [TRAIN] epoch=140, iter=52020/80000, loss=0.8506, lr=0.003885, batch_cost=1.3621, reader_cost=0.0001 | ETA 10:35:12 2021-02-23 14:35:14 [INFO] [TRAIN] epoch=140, iter=52030/80000, loss=0.8185, lr=0.003884, batch_cost=1.3583, reader_cost=0.0001 | ETA 10:33:10 2021-02-23 14:35:28 [INFO] [TRAIN] epoch=140, iter=52040/80000, loss=0.7918, lr=0.003883, batch_cost=1.3465, reader_cost=0.0001 | ETA 10:27:28 2021-02-23 14:35:41 [INFO] [TRAIN] epoch=140, iter=52050/80000, loss=0.8486, lr=0.003881, batch_cost=1.3767, reader_cost=0.0001 | ETA 10:41:18 2021-02-23 14:35:55 [INFO] [TRAIN] epoch=140, iter=52060/80000, loss=0.9143, lr=0.003880, batch_cost=1.3395, reader_cost=0.0001 | ETA 10:23:45 2021-02-23 14:36:08 [INFO] [TRAIN] epoch=140, iter=52070/80000, loss=0.8633, lr=0.003879, batch_cost=1.3590, reader_cost=0.0001 | ETA 10:32:35 2021-02-23 14:36:22 [INFO] [TRAIN] epoch=140, iter=52080/80000, loss=0.8311, lr=0.003878, batch_cost=1.3164, reader_cost=0.0001 | ETA 10:12:34 2021-02-23 14:36:37 [INFO] [TRAIN] epoch=141, iter=52090/80000, loss=0.8296, lr=0.003876, batch_cost=1.5211, reader_cost=0.0575 | ETA 11:47:33 2021-02-23 14:36:50 [INFO] [TRAIN] epoch=141, iter=52100/80000, loss=0.8631, lr=0.003875, batch_cost=1.3619, reader_cost=0.0001 | ETA 10:33:17 2021-02-23 14:37:04 [INFO] [TRAIN] epoch=141, iter=52110/80000, loss=0.8428, lr=0.003874, batch_cost=1.3498, reader_cost=0.0001 | ETA 10:27:25 2021-02-23 14:37:18 [INFO] [TRAIN] epoch=141, iter=52120/80000, loss=0.8615, lr=0.003873, batch_cost=1.3640, reader_cost=0.0001 | ETA 10:33:48 2021-02-23 14:37:31 [INFO] [TRAIN] epoch=141, iter=52130/80000, loss=0.8879, lr=0.003871, batch_cost=1.3573, reader_cost=0.0001 | ETA 10:30:29 2021-02-23 14:37:45 [INFO] [TRAIN] epoch=141, iter=52140/80000, loss=0.8921, lr=0.003870, batch_cost=1.3447, reader_cost=0.0001 | ETA 10:24:24 2021-02-23 14:37:58 [INFO] [TRAIN] epoch=141, iter=52150/80000, loss=0.9185, lr=0.003869, batch_cost=1.3534, reader_cost=0.0001 | ETA 10:28:13 2021-02-23 14:38:12 [INFO] [TRAIN] epoch=141, iter=52160/80000, loss=0.8151, lr=0.003868, batch_cost=1.3680, reader_cost=0.0001 | ETA 10:34:44 2021-02-23 14:38:26 [INFO] [TRAIN] epoch=141, iter=52170/80000, loss=0.9134, lr=0.003866, batch_cost=1.3970, reader_cost=0.0001 | ETA 10:47:58 2021-02-23 14:38:40 [INFO] [TRAIN] epoch=141, iter=52180/80000, loss=0.7676, lr=0.003865, batch_cost=1.4079, reader_cost=0.0001 | ETA 10:52:48 2021-02-23 14:38:54 [INFO] [TRAIN] epoch=141, iter=52190/80000, loss=0.8181, lr=0.003864, batch_cost=1.3895, reader_cost=0.0001 | ETA 10:44:02 2021-02-23 14:39:07 [INFO] [TRAIN] epoch=141, iter=52200/80000, loss=0.9234, lr=0.003863, batch_cost=1.3433, reader_cost=0.0001 | ETA 10:22:23 2021-02-23 14:39:21 [INFO] [TRAIN] epoch=141, iter=52210/80000, loss=0.7978, lr=0.003861, batch_cost=1.3599, reader_cost=0.0001 | ETA 10:29:51 2021-02-23 14:39:35 [INFO] [TRAIN] epoch=141, iter=52220/80000, loss=0.8978, lr=0.003860, batch_cost=1.3719, reader_cost=0.0001 | ETA 10:35:11 2021-02-23 14:39:48 [INFO] [TRAIN] epoch=141, iter=52230/80000, loss=0.7959, lr=0.003859, batch_cost=1.3688, reader_cost=0.0001 | ETA 10:33:31 2021-02-23 14:40:02 [INFO] [TRAIN] epoch=141, iter=52240/80000, loss=0.9019, lr=0.003858, batch_cost=1.3680, reader_cost=0.0001 | ETA 10:32:56 2021-02-23 14:40:15 [INFO] [TRAIN] epoch=141, iter=52250/80000, loss=0.8442, lr=0.003856, batch_cost=1.3384, reader_cost=0.0001 | ETA 10:19:00 2021-02-23 14:40:29 [INFO] [TRAIN] epoch=141, iter=52260/80000, loss=0.8302, lr=0.003855, batch_cost=1.3530, reader_cost=0.0001 | ETA 10:25:33 2021-02-23 14:40:43 [INFO] [TRAIN] epoch=141, iter=52270/80000, loss=0.8723, lr=0.003854, batch_cost=1.3963, reader_cost=0.0001 | ETA 10:45:18 2021-02-23 14:40:56 [INFO] [TRAIN] epoch=141, iter=52280/80000, loss=0.8813, lr=0.003853, batch_cost=1.3663, reader_cost=0.0001 | ETA 10:31:13 2021-02-23 14:41:10 [INFO] [TRAIN] epoch=141, iter=52290/80000, loss=0.8612, lr=0.003851, batch_cost=1.3985, reader_cost=0.0001 | ETA 10:45:52 2021-02-23 14:41:24 [INFO] [TRAIN] epoch=141, iter=52300/80000, loss=0.9173, lr=0.003850, batch_cost=1.3922, reader_cost=0.0001 | ETA 10:42:45 2021-02-23 14:41:38 [INFO] [TRAIN] epoch=141, iter=52310/80000, loss=0.7959, lr=0.003849, batch_cost=1.3708, reader_cost=0.0001 | ETA 10:32:36 2021-02-23 14:41:52 [INFO] [TRAIN] epoch=141, iter=52320/80000, loss=0.8256, lr=0.003848, batch_cost=1.4058, reader_cost=0.0001 | ETA 10:48:31 2021-02-23 14:42:06 [INFO] [TRAIN] epoch=141, iter=52330/80000, loss=0.8178, lr=0.003846, batch_cost=1.3651, reader_cost=0.0001 | ETA 10:29:32 2021-02-23 14:42:20 [INFO] [TRAIN] epoch=141, iter=52340/80000, loss=0.8102, lr=0.003845, batch_cost=1.3924, reader_cost=0.0001 | ETA 10:41:54 2021-02-23 14:42:33 [INFO] [TRAIN] epoch=141, iter=52350/80000, loss=0.8904, lr=0.003844, batch_cost=1.3723, reader_cost=0.0001 | ETA 10:32:23 2021-02-23 14:42:47 [INFO] [TRAIN] epoch=141, iter=52360/80000, loss=0.8170, lr=0.003843, batch_cost=1.3776, reader_cost=0.0001 | ETA 10:34:36 2021-02-23 14:43:01 [INFO] [TRAIN] epoch=141, iter=52370/80000, loss=0.8462, lr=0.003841, batch_cost=1.3616, reader_cost=0.0001 | ETA 10:27:01 2021-02-23 14:43:14 [INFO] [TRAIN] epoch=141, iter=52380/80000, loss=0.9144, lr=0.003840, batch_cost=1.3613, reader_cost=0.0001 | ETA 10:26:40 2021-02-23 14:43:28 [INFO] [TRAIN] epoch=141, iter=52390/80000, loss=0.8223, lr=0.003839, batch_cost=1.3429, reader_cost=0.0001 | ETA 10:17:57 2021-02-23 14:43:42 [INFO] [TRAIN] epoch=141, iter=52400/80000, loss=0.8686, lr=0.003838, batch_cost=1.4161, reader_cost=0.0001 | ETA 10:51:25 2021-02-23 14:43:55 [INFO] [TRAIN] epoch=141, iter=52410/80000, loss=0.8687, lr=0.003836, batch_cost=1.3443, reader_cost=0.0001 | ETA 10:18:07 2021-02-23 14:44:09 [INFO] [TRAIN] epoch=141, iter=52420/80000, loss=0.8900, lr=0.003835, batch_cost=1.3503, reader_cost=0.0001 | ETA 10:20:40 2021-02-23 14:44:22 [INFO] [TRAIN] epoch=141, iter=52430/80000, loss=0.9421, lr=0.003834, batch_cost=1.3394, reader_cost=0.0001 | ETA 10:15:28 2021-02-23 14:44:36 [INFO] [TRAIN] epoch=141, iter=52440/80000, loss=0.7724, lr=0.003833, batch_cost=1.3568, reader_cost=0.0001 | ETA 10:23:12 2021-02-23 14:44:49 [INFO] [TRAIN] epoch=141, iter=52450/80000, loss=0.9407, lr=0.003831, batch_cost=1.3407, reader_cost=0.0001 | ETA 10:15:37 2021-02-23 14:45:04 [INFO] [TRAIN] epoch=142, iter=52460/80000, loss=0.9269, lr=0.003830, batch_cost=1.4620, reader_cost=0.0570 | ETA 11:11:03 2021-02-23 14:45:17 [INFO] [TRAIN] epoch=142, iter=52470/80000, loss=0.8498, lr=0.003829, batch_cost=1.3414, reader_cost=0.0001 | ETA 10:15:28 2021-02-23 14:45:31 [INFO] [TRAIN] epoch=142, iter=52480/80000, loss=0.8810, lr=0.003828, batch_cost=1.3479, reader_cost=0.0001 | ETA 10:18:15 2021-02-23 14:45:44 [INFO] [TRAIN] epoch=142, iter=52490/80000, loss=0.8732, lr=0.003826, batch_cost=1.3426, reader_cost=0.0001 | ETA 10:15:35 2021-02-23 14:45:58 [INFO] [TRAIN] epoch=142, iter=52500/80000, loss=0.9015, lr=0.003825, batch_cost=1.3807, reader_cost=0.0001 | ETA 10:32:48 2021-02-23 14:46:12 [INFO] [TRAIN] epoch=142, iter=52510/80000, loss=0.8062, lr=0.003824, batch_cost=1.3644, reader_cost=0.0001 | ETA 10:25:08 2021-02-23 14:46:25 [INFO] [TRAIN] epoch=142, iter=52520/80000, loss=0.9282, lr=0.003823, batch_cost=1.3463, reader_cost=0.0001 | ETA 10:16:37 2021-02-23 14:46:39 [INFO] [TRAIN] epoch=142, iter=52530/80000, loss=0.9048, lr=0.003821, batch_cost=1.3814, reader_cost=0.0001 | ETA 10:32:28 2021-02-23 14:46:53 [INFO] [TRAIN] epoch=142, iter=52540/80000, loss=0.8092, lr=0.003820, batch_cost=1.3495, reader_cost=0.0001 | ETA 10:17:36 2021-02-23 14:47:07 [INFO] [TRAIN] epoch=142, iter=52550/80000, loss=0.8686, lr=0.003819, batch_cost=1.4098, reader_cost=0.0001 | ETA 10:44:59 2021-02-23 14:47:20 [INFO] [TRAIN] epoch=142, iter=52560/80000, loss=0.8389, lr=0.003817, batch_cost=1.3413, reader_cost=0.0001 | ETA 10:13:25 2021-02-23 14:47:34 [INFO] [TRAIN] epoch=142, iter=52570/80000, loss=0.8796, lr=0.003816, batch_cost=1.3934, reader_cost=0.0001 | ETA 10:36:59 2021-02-23 14:47:47 [INFO] [TRAIN] epoch=142, iter=52580/80000, loss=0.8465, lr=0.003815, batch_cost=1.3515, reader_cost=0.0001 | ETA 10:17:38 2021-02-23 14:48:01 [INFO] [TRAIN] epoch=142, iter=52590/80000, loss=0.8377, lr=0.003814, batch_cost=1.3886, reader_cost=0.0001 | ETA 10:34:21 2021-02-23 14:48:16 [INFO] [TRAIN] epoch=142, iter=52600/80000, loss=0.8378, lr=0.003812, batch_cost=1.4137, reader_cost=0.0001 | ETA 10:45:34 2021-02-23 14:48:29 [INFO] [TRAIN] epoch=142, iter=52610/80000, loss=0.9806, lr=0.003811, batch_cost=1.3638, reader_cost=0.0001 | ETA 10:22:33 2021-02-23 14:48:43 [INFO] [TRAIN] epoch=142, iter=52620/80000, loss=0.8225, lr=0.003810, batch_cost=1.3573, reader_cost=0.0001 | ETA 10:19:22 2021-02-23 14:48:56 [INFO] [TRAIN] epoch=142, iter=52630/80000, loss=0.8142, lr=0.003809, batch_cost=1.3681, reader_cost=0.0001 | ETA 10:24:05 2021-02-23 14:49:10 [INFO] [TRAIN] epoch=142, iter=52640/80000, loss=0.9173, lr=0.003807, batch_cost=1.3491, reader_cost=0.0001 | ETA 10:15:12 2021-02-23 14:49:24 [INFO] [TRAIN] epoch=142, iter=52650/80000, loss=0.8680, lr=0.003806, batch_cost=1.3656, reader_cost=0.0001 | ETA 10:22:29 2021-02-23 14:49:37 [INFO] [TRAIN] epoch=142, iter=52660/80000, loss=0.8771, lr=0.003805, batch_cost=1.3728, reader_cost=0.0001 | ETA 10:25:32 2021-02-23 14:49:51 [INFO] [TRAIN] epoch=142, iter=52670/80000, loss=0.9061, lr=0.003804, batch_cost=1.4190, reader_cost=0.0001 | ETA 10:46:21 2021-02-23 14:50:05 [INFO] [TRAIN] epoch=142, iter=52680/80000, loss=0.8127, lr=0.003802, batch_cost=1.3940, reader_cost=0.0001 | ETA 10:34:43 2021-02-23 14:50:19 [INFO] [TRAIN] epoch=142, iter=52690/80000, loss=0.8411, lr=0.003801, batch_cost=1.3668, reader_cost=0.0001 | ETA 10:22:06 2021-02-23 14:50:33 [INFO] [TRAIN] epoch=142, iter=52700/80000, loss=0.9089, lr=0.003800, batch_cost=1.3574, reader_cost=0.0001 | ETA 10:17:35 2021-02-23 14:50:46 [INFO] [TRAIN] epoch=142, iter=52710/80000, loss=0.8636, lr=0.003799, batch_cost=1.3468, reader_cost=0.0001 | ETA 10:12:33 2021-02-23 14:50:59 [INFO] [TRAIN] epoch=142, iter=52720/80000, loss=0.8233, lr=0.003797, batch_cost=1.3314, reader_cost=0.0001 | ETA 10:05:21 2021-02-23 14:51:13 [INFO] [TRAIN] epoch=142, iter=52730/80000, loss=1.0278, lr=0.003796, batch_cost=1.3717, reader_cost=0.0001 | ETA 10:23:26 2021-02-23 14:51:27 [INFO] [TRAIN] epoch=142, iter=52740/80000, loss=0.8627, lr=0.003795, batch_cost=1.3596, reader_cost=0.0001 | ETA 10:17:43 2021-02-23 14:51:40 [INFO] [TRAIN] epoch=142, iter=52750/80000, loss=0.8167, lr=0.003794, batch_cost=1.3554, reader_cost=0.0001 | ETA 10:15:34 2021-02-23 14:51:54 [INFO] [TRAIN] epoch=142, iter=52760/80000, loss=0.8134, lr=0.003792, batch_cost=1.3978, reader_cost=0.0001 | ETA 10:34:36 2021-02-23 14:52:08 [INFO] [TRAIN] epoch=142, iter=52770/80000, loss=0.9639, lr=0.003791, batch_cost=1.3830, reader_cost=0.0001 | ETA 10:27:39 2021-02-23 14:52:22 [INFO] [TRAIN] epoch=142, iter=52780/80000, loss=0.8161, lr=0.003790, batch_cost=1.3547, reader_cost=0.0001 | ETA 10:14:33 2021-02-23 14:52:35 [INFO] [TRAIN] epoch=142, iter=52790/80000, loss=0.8518, lr=0.003789, batch_cost=1.3820, reader_cost=0.0001 | ETA 10:26:44 2021-02-23 14:52:49 [INFO] [TRAIN] epoch=142, iter=52800/80000, loss=0.8016, lr=0.003787, batch_cost=1.3493, reader_cost=0.0001 | ETA 10:11:40 2021-02-23 14:53:03 [INFO] [TRAIN] epoch=142, iter=52810/80000, loss=0.8257, lr=0.003786, batch_cost=1.3647, reader_cost=0.0001 | ETA 10:18:25 2021-02-23 14:53:16 [INFO] [TRAIN] epoch=142, iter=52820/80000, loss=0.9396, lr=0.003785, batch_cost=1.3235, reader_cost=0.0001 | ETA 09:59:33 2021-02-23 14:53:30 [INFO] [TRAIN] epoch=143, iter=52830/80000, loss=0.8188, lr=0.003784, batch_cost=1.4633, reader_cost=0.0734 | ETA 11:02:37 2021-02-23 14:53:44 [INFO] [TRAIN] epoch=143, iter=52840/80000, loss=0.8644, lr=0.003782, batch_cost=1.3841, reader_cost=0.0001 | ETA 10:26:33 2021-02-23 14:53:58 [INFO] [TRAIN] epoch=143, iter=52850/80000, loss=0.8492, lr=0.003781, batch_cost=1.3598, reader_cost=0.0001 | ETA 10:15:18 2021-02-23 14:54:11 [INFO] [TRAIN] epoch=143, iter=52860/80000, loss=0.8254, lr=0.003780, batch_cost=1.3329, reader_cost=0.0001 | ETA 10:02:54 2021-02-23 14:54:25 [INFO] [TRAIN] epoch=143, iter=52870/80000, loss=0.8543, lr=0.003779, batch_cost=1.3541, reader_cost=0.0001 | ETA 10:12:16 2021-02-23 14:54:38 [INFO] [TRAIN] epoch=143, iter=52880/80000, loss=0.8736, lr=0.003777, batch_cost=1.3332, reader_cost=0.0001 | ETA 10:02:36 2021-02-23 14:54:52 [INFO] [TRAIN] epoch=143, iter=52890/80000, loss=0.8000, lr=0.003776, batch_cost=1.3752, reader_cost=0.0001 | ETA 10:21:21 2021-02-23 14:55:05 [INFO] [TRAIN] epoch=143, iter=52900/80000, loss=0.8066, lr=0.003775, batch_cost=1.3601, reader_cost=0.0001 | ETA 10:14:18 2021-02-23 14:55:19 [INFO] [TRAIN] epoch=143, iter=52910/80000, loss=0.8704, lr=0.003774, batch_cost=1.3603, reader_cost=0.0001 | ETA 10:14:10 2021-02-23 14:55:33 [INFO] [TRAIN] epoch=143, iter=52920/80000, loss=0.8500, lr=0.003772, batch_cost=1.3943, reader_cost=0.0001 | ETA 10:29:17 2021-02-23 14:55:47 [INFO] [TRAIN] epoch=143, iter=52930/80000, loss=0.8672, lr=0.003771, batch_cost=1.3493, reader_cost=0.0001 | ETA 10:08:46 2021-02-23 14:56:00 [INFO] [TRAIN] epoch=143, iter=52940/80000, loss=0.7827, lr=0.003770, batch_cost=1.3730, reader_cost=0.0001 | ETA 10:19:12 2021-02-23 14:56:14 [INFO] [TRAIN] epoch=143, iter=52950/80000, loss=0.8034, lr=0.003769, batch_cost=1.3886, reader_cost=0.0001 | ETA 10:26:01 2021-02-23 14:56:28 [INFO] [TRAIN] epoch=143, iter=52960/80000, loss=0.8988, lr=0.003767, batch_cost=1.3647, reader_cost=0.0001 | ETA 10:15:00 2021-02-23 14:56:41 [INFO] [TRAIN] epoch=143, iter=52970/80000, loss=0.8227, lr=0.003766, batch_cost=1.3504, reader_cost=0.0001 | ETA 10:08:21 2021-02-23 14:56:55 [INFO] [TRAIN] epoch=143, iter=52980/80000, loss=0.8872, lr=0.003765, batch_cost=1.3471, reader_cost=0.0001 | ETA 10:06:37 2021-02-23 14:57:08 [INFO] [TRAIN] epoch=143, iter=52990/80000, loss=0.8608, lr=0.003764, batch_cost=1.3344, reader_cost=0.0001 | ETA 10:00:42 2021-02-23 14:57:22 [INFO] [TRAIN] epoch=143, iter=53000/80000, loss=0.8718, lr=0.003762, batch_cost=1.3959, reader_cost=0.0001 | ETA 10:28:10 2021-02-23 14:57:22 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:18 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:06 - batch_cost: 0.2285 - reader cost: 0.1031  3/125 [..............................] - ETA: 59s - batch_cost: 0.2773 - reader cost: 0.1091  4/125 [..............................] - ETA: 56s - batch_cost: 0.3102 - reader cost: 0.1169 5/125 [>.............................] - ETA: 54s - batch_cost: 0.3321 - reader cost: 0.1254 6/125 [>.............................] - ETA: 52s - batch_cost: 0.3377 - reader cost: 0.1230 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3510 - reader cost: 0.1311 8/125 [>.............................] - ETA: 52s - batch_cost: 0.3671 - reader cost: 0.1426 9/125 [=>............................] - ETA: 50s - batch_cost: 0.3693 - reader cost: 0.1419 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3763 - reader cost: 0.1458 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3811 - reader cost: 0.1488 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3812 - reader cost: 0.1473 13/125 [==>...........................] - ETA: 49s - batch_cost: 0.3902 - reader cost: 0.1536 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3883 - reader cost: 0.1507 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3919 - reader cost: 0.1532 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3933 - reader cost: 0.1540 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3958 - reader cost: 0.1558 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.3976 - reader cost: 0.1571 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3989 - reader cost: 0.1577 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.3987 - reader cost: 0.1570 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4001 - reader cost: 0.1573 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.3998 - reader cost: 0.1567 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4011 - reader cost: 0.1575 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4020 - reader cost: 0.1580 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4030 - reader cost: 0.1584 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4023 - reader cost: 0.1576 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4024 - reader cost: 0.1575 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4028 - reader cost: 0.1574 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4046 - reader cost: 0.1591 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4046 - reader cost: 0.1586 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4053 - reader cost: 0.1592 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4067 - reader cost: 0.1603 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4073 - reader cost: 0.1604 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4064 - reader cost: 0.1593 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4051 - reader cost: 0.1580 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4058 - reader cost: 0.1582 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4049 - reader cost: 0.1573 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4055 - reader cost: 0.1579 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4045 - reader cost: 0.1569 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4063 - reader cost: 0.1582 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4069 - reader cost: 0.1587 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4072 - reader cost: 0.1590 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4079 - reader cost: 0.1596 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4089 - reader cost: 0.1601 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4087 - reader cost: 0.1598 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4095 - reader cost: 0.1604 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4098 - reader cost: 0.1607 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4092 - reader cost: 0.1600 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4104 - reader cost: 0.1613 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4100 - reader cost: 0.1608 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4090 - reader cost: 0.1599 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4094 - reader cost: 0.1602 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4089 - reader cost: 0.1593 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4079 - reader cost: 0.1580 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4079 - reader cost: 0.1580 56/125 [============>.................] - ETA: 28s - batch_cost: 0.4082 - reader cost: 0.1582 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4084 - reader cost: 0.1584 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4087 - reader cost: 0.1587 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4088 - reader cost: 0.1582 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4093 - reader cost: 0.1585 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4100 - reader cost: 0.1590 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4100 - reader cost: 0.1590 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4103 - reader cost: 0.1593 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4107 - reader cost: 0.1597 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4110 - reader cost: 0.1598 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4112 - reader cost: 0.1601 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4114 - reader cost: 0.1603 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4115 - reader cost: 0.1604 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4118 - reader cost: 0.1606 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4119 - reader cost: 0.1608 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4121 - reader cost: 0.1609 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4121 - reader cost: 0.1607 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4123 - reader cost: 0.1608 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4127 - reader cost: 0.1613 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4127 - reader cost: 0.1614 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4131 - reader cost: 0.1618 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4135 - reader cost: 0.1622 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4138 - reader cost: 0.1624 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4135 - reader cost: 0.1621 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4130 - reader cost: 0.1615 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4132 - reader cost: 0.1617 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4135 - reader cost: 0.1620 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4136 - reader cost: 0.1621 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4131 - reader cost: 0.1615 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4130 - reader cost: 0.1613 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4123 - reader cost: 0.1606 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4125 - reader cost: 0.1608 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4127 - reader cost: 0.1610 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4127 - reader cost: 0.1610 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4124 - reader cost: 0.1607 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4126 - reader cost: 0.1609 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4129 - reader cost: 0.1611 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4131 - reader cost: 0.1614 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4129 - reader cost: 0.1612 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4131 - reader cost: 0.1614 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4128 - reader cost: 0.1611 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4131 - reader cost: 0.1614 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4126 - reader cost: 0.1609 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4128 - reader cost: 0.1611 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4129 - reader cost: 0.1612 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4126 - reader cost: 0.1609 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4129 - reader cost: 0.1612  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4129 - reader cost: 0.1612 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4124 - reader cost: 0.1607 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4123 - reader cost: 0.1604 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4124 - reader cost: 0.1603 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4122 - reader cost: 0.1601 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4122 - reader cost: 0.1600 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4125 - reader cost: 0.1599 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4121 - reader cost: 0.1595 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4125 - reader cost: 0.1599 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4128 - reader cost: 0.1600 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4127 - reader cost: 0.1600 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4127 - reader cost: 0.1596 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4130 - reader cost: 0.1599 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4131 - reader cost: 0.1601 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4129 - reader cost: 0.1598 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4130 - reader cost: 0.1599 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4125 - reader cost: 0.1595 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4126 - reader cost: 0.1595 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4128 - reader cost: 0.1597 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4124 - reader cost: 0.1594 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4120 - reader cost: 0.1590 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4118 - reader cost: 0.1587 125/125 [==============================] - 52s 417ms/step - batch_cost: 0.4119 - reader cost: 0.1589 2021-02-23 14:58:14 [INFO] [EVAL] #Images=500 mIoU=0.7690 Acc=0.9594 Kappa=0.9473 2021-02-23 14:58:14 [INFO] [EVAL] Class IoU: [0.9789 0.8385 0.9227 0.5178 0.5894 0.67 0.7392 0.8094 0.9252 0.6476 0.9385 0.8158 0.632 0.9451 0.6762 0.8341 0.7668 0.5906 0.7732] 2021-02-23 14:58:14 [INFO] [EVAL] Class Acc: [0.9904 0.9062 0.9558 0.8744 0.8785 0.8231 0.843 0.8903 0.9527 0.8606 0.9545 0.8834 0.7929 0.9672 0.8311 0.9541 0.9057 0.7384 0.8412] 2021-02-23 14:58:18 [INFO] [EVAL] The model with the best validation mIoU (0.7816) was saved at iter 44000. 2021-02-23 14:58:32 [INFO] [TRAIN] epoch=143, iter=53010/80000, loss=0.8095, lr=0.003761, batch_cost=1.3419, reader_cost=0.0001 | ETA 10:03:38 2021-02-23 14:58:46 [INFO] [TRAIN] epoch=143, iter=53020/80000, loss=0.8704, lr=0.003760, batch_cost=1.3850, reader_cost=0.0001 | ETA 10:22:47 2021-02-23 14:59:00 [INFO] [TRAIN] epoch=143, iter=53030/80000, loss=0.8365, lr=0.003759, batch_cost=1.3942, reader_cost=0.0001 | ETA 10:26:41 2021-02-23 14:59:13 [INFO] [TRAIN] epoch=143, iter=53040/80000, loss=0.9167, lr=0.003757, batch_cost=1.3678, reader_cost=0.0001 | ETA 10:14:35 2021-02-23 14:59:27 [INFO] [TRAIN] epoch=143, iter=53050/80000, loss=0.8686, lr=0.003756, batch_cost=1.3794, reader_cost=0.0001 | ETA 10:19:34 2021-02-23 14:59:41 [INFO] [TRAIN] epoch=143, iter=53060/80000, loss=0.9077, lr=0.003755, batch_cost=1.3572, reader_cost=0.0001 | ETA 10:09:24 2021-02-23 14:59:54 [INFO] [TRAIN] epoch=143, iter=53070/80000, loss=0.9216, lr=0.003754, batch_cost=1.3649, reader_cost=0.0001 | ETA 10:12:36 2021-02-23 15:00:08 [INFO] [TRAIN] epoch=143, iter=53080/80000, loss=0.8925, lr=0.003752, batch_cost=1.3613, reader_cost=0.0001 | ETA 10:10:46 2021-02-23 15:00:21 [INFO] [TRAIN] epoch=143, iter=53090/80000, loss=0.8322, lr=0.003751, batch_cost=1.3435, reader_cost=0.0001 | ETA 10:02:34 2021-02-23 15:00:35 [INFO] [TRAIN] epoch=143, iter=53100/80000, loss=0.8361, lr=0.003750, batch_cost=1.3408, reader_cost=0.0001 | ETA 10:01:07 2021-02-23 15:00:48 [INFO] [TRAIN] epoch=143, iter=53110/80000, loss=0.9583, lr=0.003749, batch_cost=1.3644, reader_cost=0.0001 | ETA 10:11:28 2021-02-23 15:01:02 [INFO] [TRAIN] epoch=143, iter=53120/80000, loss=0.9306, lr=0.003747, batch_cost=1.3650, reader_cost=0.0001 | ETA 10:11:30 2021-02-23 15:01:16 [INFO] [TRAIN] epoch=143, iter=53130/80000, loss=0.8557, lr=0.003746, batch_cost=1.3582, reader_cost=0.0001 | ETA 10:08:15 2021-02-23 15:01:29 [INFO] [TRAIN] epoch=143, iter=53140/80000, loss=0.8703, lr=0.003745, batch_cost=1.3688, reader_cost=0.0001 | ETA 10:12:47 2021-02-23 15:01:43 [INFO] [TRAIN] epoch=143, iter=53150/80000, loss=1.0144, lr=0.003744, batch_cost=1.3551, reader_cost=0.0001 | ETA 10:06:25 2021-02-23 15:01:57 [INFO] [TRAIN] epoch=143, iter=53160/80000, loss=0.8632, lr=0.003742, batch_cost=1.3894, reader_cost=0.0001 | ETA 10:21:30 2021-02-23 15:02:11 [INFO] [TRAIN] epoch=143, iter=53170/80000, loss=0.8750, lr=0.003741, batch_cost=1.4002, reader_cost=0.0001 | ETA 10:26:07 2021-02-23 15:02:24 [INFO] [TRAIN] epoch=143, iter=53180/80000, loss=0.8166, lr=0.003740, batch_cost=1.3511, reader_cost=0.0001 | ETA 10:03:56 2021-02-23 15:02:38 [INFO] [TRAIN] epoch=143, iter=53190/80000, loss=0.8472, lr=0.003739, batch_cost=1.3642, reader_cost=0.0001 | ETA 10:09:34 2021-02-23 15:02:52 [INFO] [TRAIN] epoch=144, iter=53200/80000, loss=0.8827, lr=0.003737, batch_cost=1.4645, reader_cost=0.0952 | ETA 10:54:08 2021-02-23 15:03:06 [INFO] [TRAIN] epoch=144, iter=53210/80000, loss=0.8558, lr=0.003736, batch_cost=1.3377, reader_cost=0.0001 | ETA 09:57:16 2021-02-23 15:03:20 [INFO] [TRAIN] epoch=144, iter=53220/80000, loss=0.8239, lr=0.003735, batch_cost=1.3740, reader_cost=0.0001 | ETA 10:13:14 2021-02-23 15:03:33 [INFO] [TRAIN] epoch=144, iter=53230/80000, loss=0.8153, lr=0.003734, batch_cost=1.3687, reader_cost=0.0001 | ETA 10:10:38 2021-02-23 15:03:47 [INFO] [TRAIN] epoch=144, iter=53240/80000, loss=0.8508, lr=0.003732, batch_cost=1.3281, reader_cost=0.0001 | ETA 09:52:19 2021-02-23 15:04:00 [INFO] [TRAIN] epoch=144, iter=53250/80000, loss=0.8837, lr=0.003731, batch_cost=1.3583, reader_cost=0.0001 | ETA 10:05:33 2021-02-23 15:04:14 [INFO] [TRAIN] epoch=144, iter=53260/80000, loss=0.8307, lr=0.003730, batch_cost=1.3797, reader_cost=0.0001 | ETA 10:14:52 2021-02-23 15:04:28 [INFO] [TRAIN] epoch=144, iter=53270/80000, loss=0.8392, lr=0.003728, batch_cost=1.3656, reader_cost=0.0001 | ETA 10:08:21 2021-02-23 15:04:41 [INFO] [TRAIN] epoch=144, iter=53280/80000, loss=0.8611, lr=0.003727, batch_cost=1.3362, reader_cost=0.0001 | ETA 09:55:02 2021-02-23 15:04:55 [INFO] [TRAIN] epoch=144, iter=53290/80000, loss=0.8726, lr=0.003726, batch_cost=1.3741, reader_cost=0.0001 | ETA 10:11:41 2021-02-23 15:05:09 [INFO] [TRAIN] epoch=144, iter=53300/80000, loss=0.7872, lr=0.003725, batch_cost=1.3901, reader_cost=0.0001 | ETA 10:18:36 2021-02-23 15:05:22 [INFO] [TRAIN] epoch=144, iter=53310/80000, loss=0.8100, lr=0.003723, batch_cost=1.3737, reader_cost=0.0001 | ETA 10:11:04 2021-02-23 15:05:36 [INFO] [TRAIN] epoch=144, iter=53320/80000, loss=0.8597, lr=0.003722, batch_cost=1.3754, reader_cost=0.0001 | ETA 10:11:34 2021-02-23 15:05:50 [INFO] [TRAIN] epoch=144, iter=53330/80000, loss=0.9316, lr=0.003721, batch_cost=1.3584, reader_cost=0.0001 | ETA 10:03:48 2021-02-23 15:06:04 [INFO] [TRAIN] epoch=144, iter=53340/80000, loss=0.8325, lr=0.003720, batch_cost=1.3972, reader_cost=0.0001 | ETA 10:20:49 2021-02-23 15:06:17 [INFO] [TRAIN] epoch=144, iter=53350/80000, loss=0.8521, lr=0.003718, batch_cost=1.3650, reader_cost=0.0001 | ETA 10:06:16 2021-02-23 15:06:31 [INFO] [TRAIN] epoch=144, iter=53360/80000, loss=0.8147, lr=0.003717, batch_cost=1.3414, reader_cost=0.0001 | ETA 09:55:35 2021-02-23 15:06:45 [INFO] [TRAIN] epoch=144, iter=53370/80000, loss=0.9512, lr=0.003716, batch_cost=1.3816, reader_cost=0.0001 | ETA 10:13:13 2021-02-23 15:06:58 [INFO] [TRAIN] epoch=144, iter=53380/80000, loss=0.8382, lr=0.003715, batch_cost=1.3509, reader_cost=0.0001 | ETA 09:59:20 2021-02-23 15:07:12 [INFO] [TRAIN] epoch=144, iter=53390/80000, loss=0.8591, lr=0.003713, batch_cost=1.3513, reader_cost=0.0001 | ETA 09:59:17 2021-02-23 15:07:25 [INFO] [TRAIN] epoch=144, iter=53400/80000, loss=0.8590, lr=0.003712, batch_cost=1.3866, reader_cost=0.0001 | ETA 10:14:44 2021-02-23 15:07:39 [INFO] [TRAIN] epoch=144, iter=53410/80000, loss=1.1125, lr=0.003711, batch_cost=1.3288, reader_cost=0.0001 | ETA 09:48:53 2021-02-23 15:07:52 [INFO] [TRAIN] epoch=144, iter=53420/80000, loss=0.8406, lr=0.003710, batch_cost=1.3430, reader_cost=0.0001 | ETA 09:54:57 2021-02-23 15:08:06 [INFO] [TRAIN] epoch=144, iter=53430/80000, loss=0.8574, lr=0.003708, batch_cost=1.3570, reader_cost=0.0001 | ETA 10:00:56 2021-02-23 15:08:19 [INFO] [TRAIN] epoch=144, iter=53440/80000, loss=0.8683, lr=0.003707, batch_cost=1.3678, reader_cost=0.0001 | ETA 10:05:27 2021-02-23 15:08:33 [INFO] [TRAIN] epoch=144, iter=53450/80000, loss=0.8489, lr=0.003706, batch_cost=1.3268, reader_cost=0.0001 | ETA 09:47:07 2021-02-23 15:08:46 [INFO] [TRAIN] epoch=144, iter=53460/80000, loss=0.7951, lr=0.003705, batch_cost=1.3612, reader_cost=0.0001 | ETA 10:02:05 2021-02-23 15:09:00 [INFO] [TRAIN] epoch=144, iter=53470/80000, loss=0.8852, lr=0.003703, batch_cost=1.3627, reader_cost=0.0001 | ETA 10:02:32 2021-02-23 15:09:13 [INFO] [TRAIN] epoch=144, iter=53480/80000, loss=0.8266, lr=0.003702, batch_cost=1.3382, reader_cost=0.0001 | ETA 09:51:29 2021-02-23 15:09:27 [INFO] [TRAIN] epoch=144, iter=53490/80000, loss=0.8543, lr=0.003701, batch_cost=1.3749, reader_cost=0.0001 | ETA 10:07:28 2021-02-23 15:09:41 [INFO] [TRAIN] epoch=144, iter=53500/80000, loss=0.8382, lr=0.003700, batch_cost=1.3916, reader_cost=0.0001 | ETA 10:14:37 2021-02-23 15:09:54 [INFO] [TRAIN] epoch=144, iter=53510/80000, loss=0.8389, lr=0.003698, batch_cost=1.3524, reader_cost=0.0001 | ETA 09:57:04 2021-02-23 15:10:08 [INFO] [TRAIN] epoch=144, iter=53520/80000, loss=0.9050, lr=0.003697, batch_cost=1.3371, reader_cost=0.0001 | ETA 09:50:05 2021-02-23 15:10:22 [INFO] [TRAIN] epoch=144, iter=53530/80000, loss=0.9024, lr=0.003696, batch_cost=1.3711, reader_cost=0.0001 | ETA 10:04:53 2021-02-23 15:10:35 [INFO] [TRAIN] epoch=144, iter=53540/80000, loss=0.7821, lr=0.003695, batch_cost=1.3645, reader_cost=0.0001 | ETA 10:01:45 2021-02-23 15:10:49 [INFO] [TRAIN] epoch=144, iter=53550/80000, loss=0.8697, lr=0.003693, batch_cost=1.3703, reader_cost=0.0001 | ETA 10:04:04 2021-02-23 15:11:03 [INFO] [TRAIN] epoch=144, iter=53560/80000, loss=0.8462, lr=0.003692, batch_cost=1.3765, reader_cost=0.0001 | ETA 10:06:34 2021-02-23 15:11:17 [INFO] [TRAIN] epoch=145, iter=53570/80000, loss=0.8372, lr=0.003691, batch_cost=1.4169, reader_cost=0.0633 | ETA 10:24:08 2021-02-23 15:11:31 [INFO] [TRAIN] epoch=145, iter=53580/80000, loss=0.8726, lr=0.003690, batch_cost=1.4083, reader_cost=0.0001 | ETA 10:20:06 2021-02-23 15:11:44 [INFO] [TRAIN] epoch=145, iter=53590/80000, loss=0.8604, lr=0.003688, batch_cost=1.3516, reader_cost=0.0001 | ETA 09:54:55 2021-02-23 15:11:58 [INFO] [TRAIN] epoch=145, iter=53600/80000, loss=0.9191, lr=0.003687, batch_cost=1.3664, reader_cost=0.0001 | ETA 10:01:13 2021-02-23 15:12:12 [INFO] [TRAIN] epoch=145, iter=53610/80000, loss=0.8399, lr=0.003686, batch_cost=1.3661, reader_cost=0.0001 | ETA 10:00:52 2021-02-23 15:12:25 [INFO] [TRAIN] epoch=145, iter=53620/80000, loss=0.8910, lr=0.003685, batch_cost=1.3681, reader_cost=0.0001 | ETA 10:01:31 2021-02-23 15:12:39 [INFO] [TRAIN] epoch=145, iter=53630/80000, loss=0.7783, lr=0.003683, batch_cost=1.3615, reader_cost=0.0001 | ETA 09:58:22 2021-02-23 15:12:53 [INFO] [TRAIN] epoch=145, iter=53640/80000, loss=0.7896, lr=0.003682, batch_cost=1.3694, reader_cost=0.0001 | ETA 10:01:37 2021-02-23 15:13:06 [INFO] [TRAIN] epoch=145, iter=53650/80000, loss=0.9905, lr=0.003681, batch_cost=1.3463, reader_cost=0.0001 | ETA 09:51:14 2021-02-23 15:13:20 [INFO] [TRAIN] epoch=145, iter=53660/80000, loss=0.9089, lr=0.003679, batch_cost=1.3759, reader_cost=0.0001 | ETA 10:04:01 2021-02-23 15:13:34 [INFO] [TRAIN] epoch=145, iter=53670/80000, loss=0.8493, lr=0.003678, batch_cost=1.3572, reader_cost=0.0001 | ETA 09:55:35 2021-02-23 15:13:47 [INFO] [TRAIN] epoch=145, iter=53680/80000, loss=0.8245, lr=0.003677, batch_cost=1.3872, reader_cost=0.0001 | ETA 10:08:31 2021-02-23 15:14:01 [INFO] [TRAIN] epoch=145, iter=53690/80000, loss=0.7971, lr=0.003676, batch_cost=1.3924, reader_cost=0.0001 | ETA 10:10:33 2021-02-23 15:14:15 [INFO] [TRAIN] epoch=145, iter=53700/80000, loss=0.8492, lr=0.003674, batch_cost=1.3648, reader_cost=0.0001 | ETA 09:58:13 2021-02-23 15:14:29 [INFO] [TRAIN] epoch=145, iter=53710/80000, loss=0.8604, lr=0.003673, batch_cost=1.3543, reader_cost=0.0001 | ETA 09:53:25 2021-02-23 15:14:42 [INFO] [TRAIN] epoch=145, iter=53720/80000, loss=0.8381, lr=0.003672, batch_cost=1.3570, reader_cost=0.0001 | ETA 09:54:21 2021-02-23 15:14:56 [INFO] [TRAIN] epoch=145, iter=53730/80000, loss=0.8287, lr=0.003671, batch_cost=1.3638, reader_cost=0.0001 | ETA 09:57:08 2021-02-23 15:15:10 [INFO] [TRAIN] epoch=145, iter=53740/80000, loss=0.8695, lr=0.003669, batch_cost=1.4221, reader_cost=0.0001 | ETA 10:22:24 2021-02-23 15:15:23 [INFO] [TRAIN] epoch=145, iter=53750/80000, loss=0.7821, lr=0.003668, batch_cost=1.3295, reader_cost=0.0001 | ETA 09:41:39 2021-02-23 15:15:37 [INFO] [TRAIN] epoch=145, iter=53760/80000, loss=0.8173, lr=0.003667, batch_cost=1.3481, reader_cost=0.0001 | ETA 09:49:35 2021-02-23 15:15:51 [INFO] [TRAIN] epoch=145, iter=53770/80000, loss=0.8337, lr=0.003666, batch_cost=1.3867, reader_cost=0.0001 | ETA 10:06:13 2021-02-23 15:16:05 [INFO] [TRAIN] epoch=145, iter=53780/80000, loss=0.8818, lr=0.003664, batch_cost=1.3893, reader_cost=0.0001 | ETA 10:07:07 2021-02-23 15:16:18 [INFO] [TRAIN] epoch=145, iter=53790/80000, loss=0.8907, lr=0.003663, batch_cost=1.3838, reader_cost=0.0001 | ETA 10:04:30 2021-02-23 15:16:32 [INFO] [TRAIN] epoch=145, iter=53800/80000, loss=0.8604, lr=0.003662, batch_cost=1.3721, reader_cost=0.0001 | ETA 09:59:10 2021-02-23 15:16:46 [INFO] [TRAIN] epoch=145, iter=53810/80000, loss=0.9193, lr=0.003661, batch_cost=1.3709, reader_cost=0.0001 | ETA 09:58:25 2021-02-23 15:16:59 [INFO] [TRAIN] epoch=145, iter=53820/80000, loss=0.8669, lr=0.003659, batch_cost=1.3554, reader_cost=0.0001 | ETA 09:51:24 2021-02-23 15:17:13 [INFO] [TRAIN] epoch=145, iter=53830/80000, loss=0.8438, lr=0.003658, batch_cost=1.3799, reader_cost=0.0001 | ETA 10:01:52 2021-02-23 15:17:27 [INFO] [TRAIN] epoch=145, iter=53840/80000, loss=0.8311, lr=0.003657, batch_cost=1.3773, reader_cost=0.0001 | ETA 10:00:29 2021-02-23 15:17:40 [INFO] [TRAIN] epoch=145, iter=53850/80000, loss=0.8461, lr=0.003656, batch_cost=1.3462, reader_cost=0.0001 | ETA 09:46:42 2021-02-23 15:17:54 [INFO] [TRAIN] epoch=145, iter=53860/80000, loss=0.8088, lr=0.003654, batch_cost=1.3608, reader_cost=0.0001 | ETA 09:52:51 2021-02-23 15:18:08 [INFO] [TRAIN] epoch=145, iter=53870/80000, loss=0.9064, lr=0.003653, batch_cost=1.3688, reader_cost=0.0001 | ETA 09:56:07 2021-02-23 15:18:22 [INFO] [TRAIN] epoch=145, iter=53880/80000, loss=0.8918, lr=0.003652, batch_cost=1.3912, reader_cost=0.0001 | ETA 10:05:38 2021-02-23 15:18:35 [INFO] [TRAIN] epoch=145, iter=53890/80000, loss=0.8591, lr=0.003651, batch_cost=1.3295, reader_cost=0.0001 | ETA 09:38:33 2021-02-23 15:18:49 [INFO] [TRAIN] epoch=145, iter=53900/80000, loss=0.8341, lr=0.003649, batch_cost=1.3612, reader_cost=0.0001 | ETA 09:52:07 2021-02-23 15:19:02 [INFO] [TRAIN] epoch=145, iter=53910/80000, loss=0.8738, lr=0.003648, batch_cost=1.3505, reader_cost=0.0001 | ETA 09:47:14 2021-02-23 15:19:16 [INFO] [TRAIN] epoch=145, iter=53920/80000, loss=0.8433, lr=0.003647, batch_cost=1.3610, reader_cost=0.0001 | ETA 09:51:34 2021-02-23 15:19:29 [INFO] [TRAIN] epoch=145, iter=53930/80000, loss=0.8991, lr=0.003646, batch_cost=1.3546, reader_cost=0.0001 | ETA 09:48:35 2021-02-23 15:19:42 [INFO] [TRAIN] epoch=145, iter=53940/80000, loss=0.8754, lr=0.003644, batch_cost=1.3195, reader_cost=0.0001 | ETA 09:33:06 2021-02-23 15:19:57 [INFO] [TRAIN] epoch=146, iter=53950/80000, loss=0.8054, lr=0.003643, batch_cost=1.4485, reader_cost=0.0724 | ETA 10:28:54 2021-02-23 15:20:10 [INFO] [TRAIN] epoch=146, iter=53960/80000, loss=0.8248, lr=0.003642, batch_cost=1.3421, reader_cost=0.0001 | ETA 09:42:28 2021-02-23 15:20:24 [INFO] [TRAIN] epoch=146, iter=53970/80000, loss=0.9044, lr=0.003640, batch_cost=1.3574, reader_cost=0.0001 | ETA 09:48:52 2021-02-23 15:20:37 [INFO] [TRAIN] epoch=146, iter=53980/80000, loss=0.8338, lr=0.003639, batch_cost=1.3485, reader_cost=0.0001 | ETA 09:44:49 2021-02-23 15:20:51 [INFO] [TRAIN] epoch=146, iter=53990/80000, loss=0.8474, lr=0.003638, batch_cost=1.3674, reader_cost=0.0001 | ETA 09:52:46 2021-02-23 15:21:05 [INFO] [TRAIN] epoch=146, iter=54000/80000, loss=0.8263, lr=0.003637, batch_cost=1.3804, reader_cost=0.0001 | ETA 09:58:11 2021-02-23 15:21:05 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:14 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:03 - batch_cost: 0.2202 - reader cost: 0.0951  3/125 [..............................] - ETA: 1:00 - batch_cost: 0.2938 - reader cost: 0.1240 4/125 [..............................] - ETA: 55s - batch_cost: 0.3113 - reader cost: 0.1222  5/125 [>.............................] - ETA: 53s - batch_cost: 0.3247 - reader cost: 0.1216 6/125 [>.............................] - ETA: 52s - batch_cost: 0.3419 - reader cost: 0.1305 7/125 [>.............................] - ETA: 51s - batch_cost: 0.3548 - reader cost: 0.1379 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3639 - reader cost: 0.1420 9/125 [=>............................] - ETA: 50s - batch_cost: 0.3713 - reader cost: 0.1458 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3786 - reader cost: 0.1501 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3836 - reader cost: 0.1529 12/125 [=>............................] - ETA: 48s - batch_cost: 0.3817 - reader cost: 0.1495 13/125 [==>...........................] - ETA: 47s - batch_cost: 0.3801 - reader cost: 0.1466 14/125 [==>...........................] - ETA: 47s - batch_cost: 0.3844 - reader cost: 0.1485 15/125 [==>...........................] - ETA: 46s - batch_cost: 0.3828 - reader cost: 0.1448 16/125 [==>...........................] - ETA: 46s - batch_cost: 0.3852 - reader cost: 0.1462 17/125 [===>..........................] - ETA: 45s - batch_cost: 0.3881 - reader cost: 0.1484 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3912 - reader cost: 0.1508 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3932 - reader cost: 0.1518 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3950 - reader cost: 0.1530 21/125 [====>.........................] - ETA: 43s - batch_cost: 0.3941 - reader cost: 0.1518 22/125 [====>.........................] - ETA: 43s - batch_cost: 0.3959 - reader cost: 0.1532 23/125 [====>.........................] - ETA: 42s - batch_cost: 0.3952 - reader cost: 0.1522 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.3943 - reader cost: 0.1505 25/125 [=====>........................] - ETA: 41s - batch_cost: 0.3959 - reader cost: 0.1517 26/125 [=====>........................] - ETA: 41s - batch_cost: 0.3973 - reader cost: 0.1529 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.3987 - reader cost: 0.1541 28/125 [=====>........................] - ETA: 40s - batch_cost: 0.4000 - reader cost: 0.1552 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4012 - reader cost: 0.1562 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4022 - reader cost: 0.1557 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.4032 - reader cost: 0.1562 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4022 - reader cost: 0.1543 33/125 [======>.......................] - ETA: 38s - batch_cost: 0.4021 - reader cost: 0.1532 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4015 - reader cost: 0.1523 35/125 [=======>......................] - ETA: 37s - batch_cost: 0.4026 - reader cost: 0.1531 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4029 - reader cost: 0.1534 37/125 [=======>......................] - ETA: 36s - batch_cost: 0.4037 - reader cost: 0.1538 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4040 - reader cost: 0.1539 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4050 - reader cost: 0.1545 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4038 - reader cost: 0.1531 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4042 - reader cost: 0.1536 42/125 [=========>....................] - ETA: 34s - batch_cost: 0.4048 - reader cost: 0.1540 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4036 - reader cost: 0.1529 44/125 [=========>....................] - ETA: 33s - batch_cost: 0.4041 - reader cost: 0.1535 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4039 - reader cost: 0.1530 46/125 [==========>...................] - ETA: 32s - batch_cost: 0.4043 - reader cost: 0.1534 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4050 - reader cost: 0.1541 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4066 - reader cost: 0.1555 49/125 [==========>...................] - ETA: 31s - batch_cost: 0.4057 - reader cost: 0.1547 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4062 - reader cost: 0.1551 51/125 [===========>..................] - ETA: 30s - batch_cost: 0.4066 - reader cost: 0.1547 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4074 - reader cost: 0.1549 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4077 - reader cost: 0.1545 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4081 - reader cost: 0.1550 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4076 - reader cost: 0.1546 56/125 [============>.................] - ETA: 28s - batch_cost: 0.4081 - reader cost: 0.1551 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4075 - reader cost: 0.1546 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4080 - reader cost: 0.1550 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4085 - reader cost: 0.1555 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4090 - reader cost: 0.1559 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4083 - reader cost: 0.1553 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4090 - reader cost: 0.1557 63/125 [==============>...............] - ETA: 25s - batch_cost: 0.4091 - reader cost: 0.1559 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4096 - reader cost: 0.1562 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4098 - reader cost: 0.1565 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4095 - reader cost: 0.1561 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4099 - reader cost: 0.1565 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4101 - reader cost: 0.1568 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4102 - reader cost: 0.1570 70/125 [===============>..............] - ETA: 22s - batch_cost: 0.4096 - reader cost: 0.1564 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4101 - reader cost: 0.1569 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4098 - reader cost: 0.1566 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4100 - reader cost: 0.1569 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4097 - reader cost: 0.1566 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4092 - reader cost: 0.1562 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4095 - reader cost: 0.1564 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4100 - reader cost: 0.1568 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4093 - reader cost: 0.1562 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4091 - reader cost: 0.1559 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4093 - reader cost: 0.1561 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4090 - reader cost: 0.1558 82/125 [==================>...........] - ETA: 17s - batch_cost: 0.4092 - reader cost: 0.1561 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4088 - reader cost: 0.1557 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4090 - reader cost: 0.1560 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4092 - reader cost: 0.1563 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4091 - reader cost: 0.1558 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4089 - reader cost: 0.1555 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4091 - reader cost: 0.1557 89/125 [====================>.........] - ETA: 14s - batch_cost: 0.4093 - reader cost: 0.1559 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4096 - reader cost: 0.1561 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4097 - reader cost: 0.1562 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4099 - reader cost: 0.1565 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4096 - reader cost: 0.1562 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4091 - reader cost: 0.1557 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4094 - reader cost: 0.1560 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4091 - reader cost: 0.1558 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4094 - reader cost: 0.1560 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4098 - reader cost: 0.1564 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4101 - reader cost: 0.1567 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4102 - reader cost: 0.1568 101/125 [=======================>......] - ETA: 9s - batch_cost: 0.4098 - reader cost: 0.1564  102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4100 - reader cost: 0.1565 103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4102 - reader cost: 0.1568 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4104 - reader cost: 0.1570 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4106 - reader cost: 0.1572 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4111 - reader cost: 0.1576 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4110 - reader cost: 0.1574 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4113 - reader cost: 0.1577 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4109 - reader cost: 0.1573 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4108 - reader cost: 0.1572 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4104 - reader cost: 0.1568 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4106 - reader cost: 0.1570 113/125 [==========================>...] - ETA: 4s - batch_cost: 0.4109 - reader cost: 0.1573 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4109 - reader cost: 0.1573 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4112 - reader cost: 0.1575 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4114 - reader cost: 0.1577 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4116 - reader cost: 0.1579 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4113 - reader cost: 0.1576 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4116 - reader cost: 0.1579 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4118 - reader cost: 0.1581 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4117 - reader cost: 0.1580 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4118 - reader cost: 0.1581 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4119 - reader cost: 0.1583 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4121 - reader cost: 0.1585 125/125 [==============================] - 52s 417ms/step - batch_cost: 0.4119 - reader cost: 0.1582 2021-02-23 15:21:57 [INFO] [EVAL] #Images=500 mIoU=0.6842 Acc=0.9470 Kappa=0.9310 2021-02-23 15:21:57 [INFO] [EVAL] Class IoU: [0.9719 0.8045 0.9002 0.2763 0.6078 0.6227 0.7021 0.7785 0.8898 0.5409 0.9408 0.8092 0.6014 0.9355 0.5599 0.5871 0.1211 0.5731 0.7778] 2021-02-23 15:21:57 [INFO] [EVAL] Class Acc: [0.9817 0.8892 0.9277 0.7011 0.8287 0.8322 0.8648 0.9299 0.9496 0.7979 0.9549 0.8997 0.7834 0.9695 0.8791 0.63 0.9248 0.8028 0.863 ] 2021-02-23 15:22:01 [INFO] [EVAL] The model with the best validation mIoU (0.7816) was saved at iter 44000. 2021-02-23 15:22:15 [INFO] [TRAIN] epoch=146, iter=54010/80000, loss=0.8415, lr=0.003635, batch_cost=1.3520, reader_cost=0.0001 | ETA 09:45:39 2021-02-23 15:22:28 [INFO] [TRAIN] epoch=146, iter=54020/80000, loss=0.7804, lr=0.003634, batch_cost=1.3660, reader_cost=0.0001 | ETA 09:51:27 2021-02-23 15:22:42 [INFO] [TRAIN] epoch=146, iter=54030/80000, loss=0.8515, lr=0.003633, batch_cost=1.3907, reader_cost=0.0001 | ETA 10:01:57 2021-02-23 15:22:56 [INFO] [TRAIN] epoch=146, iter=54040/80000, loss=0.9025, lr=0.003632, batch_cost=1.3899, reader_cost=0.0001 | ETA 10:01:20 2021-02-23 15:23:10 [INFO] [TRAIN] epoch=146, iter=54050/80000, loss=0.9382, lr=0.003630, batch_cost=1.3607, reader_cost=0.0001 | ETA 09:48:28 2021-02-23 15:23:24 [INFO] [TRAIN] epoch=146, iter=54060/80000, loss=0.9079, lr=0.003629, batch_cost=1.3775, reader_cost=0.0001 | ETA 09:55:32 2021-02-23 15:23:37 [INFO] [TRAIN] epoch=146, iter=54070/80000, loss=0.8830, lr=0.003628, batch_cost=1.3504, reader_cost=0.0001 | ETA 09:43:35 2021-02-23 15:23:51 [INFO] [TRAIN] epoch=146, iter=54080/80000, loss=0.8500, lr=0.003627, batch_cost=1.3468, reader_cost=0.0001 | ETA 09:41:47 2021-02-23 15:24:04 [INFO] [TRAIN] epoch=146, iter=54090/80000, loss=0.8728, lr=0.003625, batch_cost=1.3561, reader_cost=0.0001 | ETA 09:45:35 2021-02-23 15:24:18 [INFO] [TRAIN] epoch=146, iter=54100/80000, loss=0.8663, lr=0.003624, batch_cost=1.3548, reader_cost=0.0001 | ETA 09:44:50 2021-02-23 15:24:31 [INFO] [TRAIN] epoch=146, iter=54110/80000, loss=0.8093, lr=0.003623, batch_cost=1.3621, reader_cost=0.0001 | ETA 09:47:43 2021-02-23 15:24:45 [INFO] [TRAIN] epoch=146, iter=54120/80000, loss=0.8347, lr=0.003622, batch_cost=1.3896, reader_cost=0.0001 | ETA 09:59:23 2021-02-23 15:24:59 [INFO] [TRAIN] epoch=146, iter=54130/80000, loss=0.8043, lr=0.003620, batch_cost=1.3540, reader_cost=0.0001 | ETA 09:43:48 2021-02-23 15:25:12 [INFO] [TRAIN] epoch=146, iter=54140/80000, loss=0.8153, lr=0.003619, batch_cost=1.3689, reader_cost=0.0001 | ETA 09:49:59 2021-02-23 15:25:26 [INFO] [TRAIN] epoch=146, iter=54150/80000, loss=0.8590, lr=0.003618, batch_cost=1.3690, reader_cost=0.0001 | ETA 09:49:48 2021-02-23 15:25:39 [INFO] [TRAIN] epoch=146, iter=54160/80000, loss=0.9609, lr=0.003617, batch_cost=1.3341, reader_cost=0.0001 | ETA 09:34:33 2021-02-23 15:25:53 [INFO] [TRAIN] epoch=146, iter=54170/80000, loss=0.8649, lr=0.003615, batch_cost=1.3326, reader_cost=0.0001 | ETA 09:33:40 2021-02-23 15:26:06 [INFO] [TRAIN] epoch=146, iter=54180/80000, loss=0.8743, lr=0.003614, batch_cost=1.3300, reader_cost=0.0001 | ETA 09:32:19 2021-02-23 15:26:19 [INFO] [TRAIN] epoch=146, iter=54190/80000, loss=0.9522, lr=0.003613, batch_cost=1.3313, reader_cost=0.0001 | ETA 09:32:39 2021-02-23 15:26:33 [INFO] [TRAIN] epoch=146, iter=54200/80000, loss=0.9339, lr=0.003612, batch_cost=1.3550, reader_cost=0.0001 | ETA 09:42:40 2021-02-23 15:26:46 [INFO] [TRAIN] epoch=146, iter=54210/80000, loss=0.8596, lr=0.003610, batch_cost=1.3547, reader_cost=0.0001 | ETA 09:42:16 2021-02-23 15:27:00 [INFO] [TRAIN] epoch=146, iter=54220/80000, loss=0.8617, lr=0.003609, batch_cost=1.3887, reader_cost=0.0001 | ETA 09:56:39 2021-02-23 15:27:14 [INFO] [TRAIN] epoch=146, iter=54230/80000, loss=0.8658, lr=0.003608, batch_cost=1.3780, reader_cost=0.0001 | ETA 09:51:51 2021-02-23 15:27:28 [INFO] [TRAIN] epoch=146, iter=54240/80000, loss=0.8985, lr=0.003606, batch_cost=1.3666, reader_cost=0.0001 | ETA 09:46:44 2021-02-23 15:27:41 [INFO] [TRAIN] epoch=146, iter=54250/80000, loss=0.8073, lr=0.003605, batch_cost=1.3366, reader_cost=0.0001 | ETA 09:33:36 2021-02-23 15:27:55 [INFO] [TRAIN] epoch=146, iter=54260/80000, loss=0.9115, lr=0.003604, batch_cost=1.3700, reader_cost=0.0001 | ETA 09:47:44 2021-02-23 15:28:08 [INFO] [TRAIN] epoch=146, iter=54270/80000, loss=0.8705, lr=0.003603, batch_cost=1.3503, reader_cost=0.0001 | ETA 09:39:02 2021-02-23 15:28:22 [INFO] [TRAIN] epoch=146, iter=54280/80000, loss=0.8997, lr=0.003601, batch_cost=1.3548, reader_cost=0.0001 | ETA 09:40:45 2021-02-23 15:28:35 [INFO] [TRAIN] epoch=146, iter=54290/80000, loss=0.8532, lr=0.003600, batch_cost=1.3522, reader_cost=0.0001 | ETA 09:39:24 2021-02-23 15:28:49 [INFO] [TRAIN] epoch=146, iter=54300/80000, loss=0.8539, lr=0.003599, batch_cost=1.3440, reader_cost=0.0001 | ETA 09:35:40 2021-02-23 15:29:02 [INFO] [TRAIN] epoch=146, iter=54310/80000, loss=0.9308, lr=0.003598, batch_cost=1.3201, reader_cost=0.0001 | ETA 09:25:13 2021-02-23 15:29:17 [INFO] [TRAIN] epoch=147, iter=54320/80000, loss=0.8931, lr=0.003596, batch_cost=1.4626, reader_cost=0.0867 | ETA 10:25:58 2021-02-23 15:29:30 [INFO] [TRAIN] epoch=147, iter=54330/80000, loss=0.8285, lr=0.003595, batch_cost=1.3643, reader_cost=0.0001 | ETA 09:43:40 2021-02-23 15:29:44 [INFO] [TRAIN] epoch=147, iter=54340/80000, loss=0.8445, lr=0.003594, batch_cost=1.3440, reader_cost=0.0001 | ETA 09:34:46 2021-02-23 15:29:57 [INFO] [TRAIN] epoch=147, iter=54350/80000, loss=0.8424, lr=0.003593, batch_cost=1.3616, reader_cost=0.0001 | ETA 09:42:04 2021-02-23 15:30:11 [INFO] [TRAIN] epoch=147, iter=54360/80000, loss=0.8566, lr=0.003591, batch_cost=1.3782, reader_cost=0.0001 | ETA 09:48:56 2021-02-23 15:30:25 [INFO] [TRAIN] epoch=147, iter=54370/80000, loss=0.8097, lr=0.003590, batch_cost=1.3600, reader_cost=0.0001 | ETA 09:40:55 2021-02-23 15:30:38 [INFO] [TRAIN] epoch=147, iter=54380/80000, loss=0.8249, lr=0.003589, batch_cost=1.3428, reader_cost=0.0001 | ETA 09:33:21 2021-02-23 15:30:52 [INFO] [TRAIN] epoch=147, iter=54390/80000, loss=0.8209, lr=0.003588, batch_cost=1.3938, reader_cost=0.0001 | ETA 09:54:54 2021-02-23 15:31:05 [INFO] [TRAIN] epoch=147, iter=54400/80000, loss=0.9215, lr=0.003586, batch_cost=1.3328, reader_cost=0.0001 | ETA 09:28:38 2021-02-23 15:31:19 [INFO] [TRAIN] epoch=147, iter=54410/80000, loss=0.8755, lr=0.003585, batch_cost=1.3818, reader_cost=0.0001 | ETA 09:49:19 2021-02-23 15:31:33 [INFO] [TRAIN] epoch=147, iter=54420/80000, loss=0.8633, lr=0.003584, batch_cost=1.3851, reader_cost=0.0001 | ETA 09:50:30 2021-02-23 15:31:47 [INFO] [TRAIN] epoch=147, iter=54430/80000, loss=0.8388, lr=0.003583, batch_cost=1.3896, reader_cost=0.0001 | ETA 09:52:11 2021-02-23 15:32:01 [INFO] [TRAIN] epoch=147, iter=54440/80000, loss=0.8986, lr=0.003581, batch_cost=1.3828, reader_cost=0.0001 | ETA 09:49:04 2021-02-23 15:32:14 [INFO] [TRAIN] epoch=147, iter=54450/80000, loss=0.8637, lr=0.003580, batch_cost=1.3480, reader_cost=0.0001 | ETA 09:34:01 2021-02-23 15:32:28 [INFO] [TRAIN] epoch=147, iter=54460/80000, loss=0.8563, lr=0.003579, batch_cost=1.3587, reader_cost=0.0001 | ETA 09:38:22 2021-02-23 15:32:42 [INFO] [TRAIN] epoch=147, iter=54470/80000, loss=0.8747, lr=0.003578, batch_cost=1.3573, reader_cost=0.0001 | ETA 09:37:32 2021-02-23 15:32:55 [INFO] [TRAIN] epoch=147, iter=54480/80000, loss=0.8557, lr=0.003576, batch_cost=1.3498, reader_cost=0.0001 | ETA 09:34:07 2021-02-23 15:33:08 [INFO] [TRAIN] epoch=147, iter=54490/80000, loss=0.8686, lr=0.003575, batch_cost=1.3302, reader_cost=0.0001 | ETA 09:25:34 2021-02-23 15:33:22 [INFO] [TRAIN] epoch=147, iter=54500/80000, loss=0.8398, lr=0.003574, batch_cost=1.3607, reader_cost=0.0001 | ETA 09:38:17 2021-02-23 15:33:36 [INFO] [TRAIN] epoch=147, iter=54510/80000, loss=0.8397, lr=0.003572, batch_cost=1.3830, reader_cost=0.0001 | ETA 09:47:32 2021-02-23 15:33:49 [INFO] [TRAIN] epoch=147, iter=54520/80000, loss=0.8304, lr=0.003571, batch_cost=1.3681, reader_cost=0.0001 | ETA 09:40:59 2021-02-23 15:34:03 [INFO] [TRAIN] epoch=147, iter=54530/80000, loss=0.7691, lr=0.003570, batch_cost=1.3384, reader_cost=0.0001 | ETA 09:28:09 2021-02-23 15:34:16 [INFO] [TRAIN] epoch=147, iter=54540/80000, loss=0.9663, lr=0.003569, batch_cost=1.3400, reader_cost=0.0001 | ETA 09:28:37 2021-02-23 15:34:30 [INFO] [TRAIN] epoch=147, iter=54550/80000, loss=0.8359, lr=0.003567, batch_cost=1.3519, reader_cost=0.0001 | ETA 09:33:25 2021-02-23 15:34:43 [INFO] [TRAIN] epoch=147, iter=54560/80000, loss=0.8344, lr=0.003566, batch_cost=1.3296, reader_cost=0.0001 | ETA 09:23:44 2021-02-23 15:34:57 [INFO] [TRAIN] epoch=147, iter=54570/80000, loss=1.0063, lr=0.003565, batch_cost=1.3706, reader_cost=0.0001 | ETA 09:40:53 2021-02-23 15:35:10 [INFO] [TRAIN] epoch=147, iter=54580/80000, loss=0.8290, lr=0.003564, batch_cost=1.3610, reader_cost=0.0001 | ETA 09:36:37 2021-02-23 15:35:24 [INFO] [TRAIN] epoch=147, iter=54590/80000, loss=0.9014, lr=0.003562, batch_cost=1.3696, reader_cost=0.0001 | ETA 09:40:02 2021-02-23 15:35:38 [INFO] [TRAIN] epoch=147, iter=54600/80000, loss=0.8376, lr=0.003561, batch_cost=1.4062, reader_cost=0.0001 | ETA 09:55:16 2021-02-23 15:35:52 [INFO] [TRAIN] epoch=147, iter=54610/80000, loss=0.8153, lr=0.003560, batch_cost=1.4089, reader_cost=0.0001 | ETA 09:56:11 2021-02-23 15:36:06 [INFO] [TRAIN] epoch=147, iter=54620/80000, loss=0.9270, lr=0.003559, batch_cost=1.4224, reader_cost=0.0001 | ETA 10:01:40 2021-02-23 15:36:20 [INFO] [TRAIN] epoch=147, iter=54630/80000, loss=0.7808, lr=0.003557, batch_cost=1.3371, reader_cost=0.0001 | ETA 09:25:23 2021-02-23 15:36:34 [INFO] [TRAIN] epoch=147, iter=54640/80000, loss=0.7634, lr=0.003556, batch_cost=1.4196, reader_cost=0.0001 | ETA 10:00:01 2021-02-23 15:36:48 [INFO] [TRAIN] epoch=147, iter=54650/80000, loss=0.8900, lr=0.003555, batch_cost=1.3926, reader_cost=0.0001 | ETA 09:48:21 2021-02-23 15:37:01 [INFO] [TRAIN] epoch=147, iter=54660/80000, loss=0.9134, lr=0.003554, batch_cost=1.3426, reader_cost=0.0001 | ETA 09:27:00 2021-02-23 15:37:15 [INFO] [TRAIN] epoch=147, iter=54670/80000, loss=0.8504, lr=0.003552, batch_cost=1.3772, reader_cost=0.0001 | ETA 09:41:25 2021-02-23 15:37:29 [INFO] [TRAIN] epoch=147, iter=54680/80000, loss=0.7829, lr=0.003551, batch_cost=1.3443, reader_cost=0.0001 | ETA 09:27:18 2021-02-23 15:37:43 [INFO] [TRAIN] epoch=148, iter=54690/80000, loss=0.8218, lr=0.003550, batch_cost=1.4408, reader_cost=0.0515 | ETA 10:07:47 2021-02-23 15:37:57 [INFO] [TRAIN] epoch=148, iter=54700/80000, loss=0.7974, lr=0.003548, batch_cost=1.4172, reader_cost=0.0001 | ETA 09:57:36 2021-02-23 15:38:11 [INFO] [TRAIN] epoch=148, iter=54710/80000, loss=0.8066, lr=0.003547, batch_cost=1.3614, reader_cost=0.0001 | ETA 09:33:49 2021-02-23 15:38:25 [INFO] [TRAIN] epoch=148, iter=54720/80000, loss=0.8359, lr=0.003546, batch_cost=1.4043, reader_cost=0.0001 | ETA 09:51:40 2021-02-23 15:38:38 [INFO] [TRAIN] epoch=148, iter=54730/80000, loss=0.8139, lr=0.003545, batch_cost=1.3195, reader_cost=0.0001 | ETA 09:15:43 2021-02-23 15:38:52 [INFO] [TRAIN] epoch=148, iter=54740/80000, loss=0.8314, lr=0.003543, batch_cost=1.4230, reader_cost=0.0001 | ETA 09:59:04 2021-02-23 15:39:06 [INFO] [TRAIN] epoch=148, iter=54750/80000, loss=0.8167, lr=0.003542, batch_cost=1.3560, reader_cost=0.0001 | ETA 09:30:37 2021-02-23 15:39:20 [INFO] [TRAIN] epoch=148, iter=54760/80000, loss=0.7773, lr=0.003541, batch_cost=1.4028, reader_cost=0.0001 | ETA 09:50:05 2021-02-23 15:39:34 [INFO] [TRAIN] epoch=148, iter=54770/80000, loss=0.9616, lr=0.003540, batch_cost=1.3716, reader_cost=0.0001 | ETA 09:36:44 2021-02-23 15:39:47 [INFO] [TRAIN] epoch=148, iter=54780/80000, loss=0.8617, lr=0.003538, batch_cost=1.3520, reader_cost=0.0001 | ETA 09:28:16 2021-02-23 15:40:01 [INFO] [TRAIN] epoch=148, iter=54790/80000, loss=0.9013, lr=0.003537, batch_cost=1.3529, reader_cost=0.0001 | ETA 09:28:27 2021-02-23 15:40:14 [INFO] [TRAIN] epoch=148, iter=54800/80000, loss=0.8822, lr=0.003536, batch_cost=1.3796, reader_cost=0.0001 | ETA 09:39:24 2021-02-23 15:40:28 [INFO] [TRAIN] epoch=148, iter=54810/80000, loss=0.9365, lr=0.003535, batch_cost=1.3672, reader_cost=0.0001 | ETA 09:33:59 2021-02-23 15:40:42 [INFO] [TRAIN] epoch=148, iter=54820/80000, loss=0.8194, lr=0.003533, batch_cost=1.3494, reader_cost=0.0001 | ETA 09:26:17 2021-02-23 15:40:55 [INFO] [TRAIN] epoch=148, iter=54830/80000, loss=0.7760, lr=0.003532, batch_cost=1.3523, reader_cost=0.0001 | ETA 09:27:17 2021-02-23 15:41:09 [INFO] [TRAIN] epoch=148, iter=54840/80000, loss=0.8462, lr=0.003531, batch_cost=1.3491, reader_cost=0.0001 | ETA 09:25:42 2021-02-23 15:41:23 [INFO] [TRAIN] epoch=148, iter=54850/80000, loss=0.8913, lr=0.003530, batch_cost=1.4135, reader_cost=0.0001 | ETA 09:52:30 2021-02-23 15:41:37 [INFO] [TRAIN] epoch=148, iter=54860/80000, loss=0.8830, lr=0.003528, batch_cost=1.3817, reader_cost=0.0001 | ETA 09:38:55 2021-02-23 15:41:50 [INFO] [TRAIN] epoch=148, iter=54870/80000, loss=0.8279, lr=0.003527, batch_cost=1.3573, reader_cost=0.0001 | ETA 09:28:29 2021-02-23 15:42:04 [INFO] [TRAIN] epoch=148, iter=54880/80000, loss=0.8634, lr=0.003526, batch_cost=1.3661, reader_cost=0.0001 | ETA 09:31:57 2021-02-23 15:42:17 [INFO] [TRAIN] epoch=148, iter=54890/80000, loss=0.8492, lr=0.003524, batch_cost=1.3611, reader_cost=0.0001 | ETA 09:29:38 2021-02-23 15:42:31 [INFO] [TRAIN] epoch=148, iter=54900/80000, loss=0.9552, lr=0.003523, batch_cost=1.3857, reader_cost=0.0001 | ETA 09:39:41 2021-02-23 15:42:45 [INFO] [TRAIN] epoch=148, iter=54910/80000, loss=0.8058, lr=0.003522, batch_cost=1.4119, reader_cost=0.0001 | ETA 09:50:25 2021-02-23 15:42:59 [INFO] [TRAIN] epoch=148, iter=54920/80000, loss=0.8328, lr=0.003521, batch_cost=1.3671, reader_cost=0.0001 | ETA 09:31:27 2021-02-23 15:43:13 [INFO] [TRAIN] epoch=148, iter=54930/80000, loss=0.7861, lr=0.003519, batch_cost=1.3864, reader_cost=0.0001 | ETA 09:39:18 2021-02-23 15:43:27 [INFO] [TRAIN] epoch=148, iter=54940/80000, loss=0.8341, lr=0.003518, batch_cost=1.3700, reader_cost=0.0001 | ETA 09:32:13 2021-02-23 15:43:40 [INFO] [TRAIN] epoch=148, iter=54950/80000, loss=0.8548, lr=0.003517, batch_cost=1.3550, reader_cost=0.0001 | ETA 09:25:43 2021-02-23 15:43:54 [INFO] [TRAIN] epoch=148, iter=54960/80000, loss=0.8733, lr=0.003516, batch_cost=1.3683, reader_cost=0.0001 | ETA 09:31:02 2021-02-23 15:44:07 [INFO] [TRAIN] epoch=148, iter=54970/80000, loss=0.8927, lr=0.003514, batch_cost=1.3464, reader_cost=0.0001 | ETA 09:21:39 2021-02-23 15:44:21 [INFO] [TRAIN] epoch=148, iter=54980/80000, loss=0.8585, lr=0.003513, batch_cost=1.3574, reader_cost=0.0001 | ETA 09:26:02 2021-02-23 15:44:35 [INFO] [TRAIN] epoch=148, iter=54990/80000, loss=0.9037, lr=0.003512, batch_cost=1.3847, reader_cost=0.0001 | ETA 09:37:11 2021-02-23 15:44:48 [INFO] [TRAIN] epoch=148, iter=55000/80000, loss=0.8274, lr=0.003511, batch_cost=1.3495, reader_cost=0.0001 | ETA 09:22:16 2021-02-23 15:44:48 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:18 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:05 - batch_cost: 0.2182 - reader cost: 0.0939  3/125 [..............................] - ETA: 58s - batch_cost: 0.2703 - reader cost: 0.1013  4/125 [..............................] - ETA: 56s - batch_cost: 0.3061 - reader cost: 0.1166 5/125 [>.............................] - ETA: 54s - batch_cost: 0.3294 - reader cost: 0.1275 6/125 [>.............................] - ETA: 54s - batch_cost: 0.3511 - reader cost: 0.1404 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3541 - reader cost: 0.1353 8/125 [>.............................] - ETA: 50s - batch_cost: 0.3556 - reader cost: 0.1311 9/125 [=>............................] - ETA: 49s - batch_cost: 0.3597 - reader cost: 0.1318 10/125 [=>............................] - ETA: 49s - batch_cost: 0.3663 - reader cost: 0.1361 11/125 [=>............................] - ETA: 48s - batch_cost: 0.3679 - reader cost: 0.1348 12/125 [=>............................] - ETA: 48s - batch_cost: 0.3729 - reader cost: 0.1380 13/125 [==>...........................] - ETA: 47s - batch_cost: 0.3770 - reader cost: 0.1407 14/125 [==>...........................] - ETA: 47s - batch_cost: 0.3799 - reader cost: 0.1397 15/125 [==>...........................] - ETA: 46s - batch_cost: 0.3822 - reader cost: 0.1380 16/125 [==>...........................] - ETA: 46s - batch_cost: 0.3856 - reader cost: 0.1399 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3894 - reader cost: 0.1436 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3892 - reader cost: 0.1430 19/125 [===>..........................] - ETA: 44s - batch_cost: 0.3880 - reader cost: 0.1417 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3907 - reader cost: 0.1441 21/125 [====>.........................] - ETA: 43s - batch_cost: 0.3926 - reader cost: 0.1458 22/125 [====>.........................] - ETA: 43s - batch_cost: 0.3945 - reader cost: 0.1473 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.3956 - reader cost: 0.1483 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.3973 - reader cost: 0.1494 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.3974 - reader cost: 0.1493 26/125 [=====>........................] - ETA: 41s - batch_cost: 0.3992 - reader cost: 0.1506 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.3979 - reader cost: 0.1492 28/125 [=====>........................] - ETA: 40s - batch_cost: 0.3990 - reader cost: 0.1503 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4001 - reader cost: 0.1512 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4011 - reader cost: 0.1520 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.4019 - reader cost: 0.1529 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4035 - reader cost: 0.1542 33/125 [======>.......................] - ETA: 38s - batch_cost: 0.4042 - reader cost: 0.1548 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4033 - reader cost: 0.1539 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4043 - reader cost: 0.1548 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4049 - reader cost: 0.1551 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4043 - reader cost: 0.1546 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4036 - reader cost: 0.1537 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4041 - reader cost: 0.1541 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4045 - reader cost: 0.1545 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4052 - reader cost: 0.1551 42/125 [=========>....................] - ETA: 34s - batch_cost: 0.4047 - reader cost: 0.1544 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4038 - reader cost: 0.1533 44/125 [=========>....................] - ETA: 33s - batch_cost: 0.4046 - reader cost: 0.1541 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4054 - reader cost: 0.1548 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4057 - reader cost: 0.1551 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4053 - reader cost: 0.1547 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4058 - reader cost: 0.1549 49/125 [==========>...................] - ETA: 31s - batch_cost: 0.4058 - reader cost: 0.1549 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4060 - reader cost: 0.1552 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4065 - reader cost: 0.1555 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4055 - reader cost: 0.1544 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4059 - reader cost: 0.1546 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4049 - reader cost: 0.1536 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4053 - reader cost: 0.1541 56/125 [============>.................] - ETA: 28s - batch_cost: 0.4057 - reader cost: 0.1544 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4062 - reader cost: 0.1549 58/125 [============>.................] - ETA: 27s - batch_cost: 0.4068 - reader cost: 0.1555 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4064 - reader cost: 0.1551 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4070 - reader cost: 0.1557 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4072 - reader cost: 0.1559 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4076 - reader cost: 0.1564 63/125 [==============>...............] - ETA: 25s - batch_cost: 0.4079 - reader cost: 0.1567 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4081 - reader cost: 0.1569 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4074 - reader cost: 0.1562 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4076 - reader cost: 0.1564 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4077 - reader cost: 0.1559 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4079 - reader cost: 0.1560 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4085 - reader cost: 0.1563 70/125 [===============>..............] - ETA: 22s - batch_cost: 0.4088 - reader cost: 0.1567 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4094 - reader cost: 0.1573 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4097 - reader cost: 0.1576 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4100 - reader cost: 0.1579 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4098 - reader cost: 0.1578 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4106 - reader cost: 0.1585 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4108 - reader cost: 0.1589 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4113 - reader cost: 0.1592 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4107 - reader cost: 0.1585 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4109 - reader cost: 0.1587 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4108 - reader cost: 0.1582 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4114 - reader cost: 0.1585 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4117 - reader cost: 0.1588 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4119 - reader cost: 0.1590 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4121 - reader cost: 0.1593 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4123 - reader cost: 0.1596 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4126 - reader cost: 0.1598 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4123 - reader cost: 0.1595 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4130 - reader cost: 0.1602 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4134 - reader cost: 0.1605 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4135 - reader cost: 0.1606 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4132 - reader cost: 0.1603 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4128 - reader cost: 0.1599 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4129 - reader cost: 0.1598 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4130 - reader cost: 0.1599 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4133 - reader cost: 0.1601 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4134 - reader cost: 0.1603 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4131 - reader cost: 0.1600 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4134 - reader cost: 0.1602 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4136 - reader cost: 0.1605 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4137 - reader cost: 0.1606 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4140 - reader cost: 0.1609 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4146 - reader cost: 0.1614  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4146 - reader cost: 0.1614 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4143 - reader cost: 0.1611 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4145 - reader cost: 0.1612 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4146 - reader cost: 0.1613 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4147 - reader cost: 0.1613 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4142 - reader cost: 0.1609 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4145 - reader cost: 0.1611 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4147 - reader cost: 0.1612 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4148 - reader cost: 0.1613 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4145 - reader cost: 0.1610 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4142 - reader cost: 0.1607 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4143 - reader cost: 0.1609 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4142 - reader cost: 0.1608 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4139 - reader cost: 0.1605 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4139 - reader cost: 0.1605 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4136 - reader cost: 0.1603 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4134 - reader cost: 0.1601 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4132 - reader cost: 0.1599 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4130 - reader cost: 0.1597 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4129 - reader cost: 0.1595 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4132 - reader cost: 0.1598 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4129 - reader cost: 0.1596 125/125 [==============================] - 52s 418ms/step - batch_cost: 0.4130 - reader cost: 0.1592 2021-02-23 15:45:41 [INFO] [EVAL] #Images=500 mIoU=0.7533 Acc=0.9578 Kappa=0.9451 2021-02-23 15:45:41 [INFO] [EVAL] Class IoU: [0.9776 0.8277 0.9183 0.505 0.5188 0.6465 0.7377 0.8058 0.9238 0.6311 0.9466 0.8271 0.6181 0.9509 0.7056 0.7833 0.6264 0.5828 0.7799] 2021-02-23 15:45:41 [INFO] [EVAL] Class Acc: [0.9864 0.925 0.9456 0.8594 0.8209 0.8816 0.8544 0.9338 0.9545 0.7681 0.9618 0.912 0.7463 0.9704 0.963 0.8433 0.8897 0.6404 0.8608] 2021-02-23 15:45:45 [INFO] [EVAL] The model with the best validation mIoU (0.7816) was saved at iter 44000. 2021-02-23 15:45:59 [INFO] [TRAIN] epoch=148, iter=55010/80000, loss=0.8285, lr=0.003509, batch_cost=1.3801, reader_cost=0.0001 | ETA 09:34:49 2021-02-23 15:46:12 [INFO] [TRAIN] epoch=148, iter=55020/80000, loss=0.8676, lr=0.003508, batch_cost=1.3336, reader_cost=0.0001 | ETA 09:15:12 2021-02-23 15:46:26 [INFO] [TRAIN] epoch=148, iter=55030/80000, loss=0.8784, lr=0.003507, batch_cost=1.3479, reader_cost=0.0001 | ETA 09:20:57 2021-02-23 15:46:39 [INFO] [TRAIN] epoch=148, iter=55040/80000, loss=0.8706, lr=0.003506, batch_cost=1.3528, reader_cost=0.0001 | ETA 09:22:46 2021-02-23 15:46:53 [INFO] [TRAIN] epoch=148, iter=55050/80000, loss=0.8836, lr=0.003504, batch_cost=1.3881, reader_cost=0.0001 | ETA 09:37:14 2021-02-23 15:47:08 [INFO] [TRAIN] epoch=149, iter=55060/80000, loss=0.8367, lr=0.003503, batch_cost=1.4657, reader_cost=0.0805 | ETA 10:09:15 2021-02-23 15:47:21 [INFO] [TRAIN] epoch=149, iter=55070/80000, loss=0.8044, lr=0.003502, batch_cost=1.3481, reader_cost=0.0001 | ETA 09:20:07 2021-02-23 15:47:35 [INFO] [TRAIN] epoch=149, iter=55080/80000, loss=0.8532, lr=0.003500, batch_cost=1.3718, reader_cost=0.0001 | ETA 09:29:46 2021-02-23 15:47:49 [INFO] [TRAIN] epoch=149, iter=55090/80000, loss=0.8458, lr=0.003499, batch_cost=1.3804, reader_cost=0.0001 | ETA 09:33:04 2021-02-23 15:48:03 [INFO] [TRAIN] epoch=149, iter=55100/80000, loss=0.8560, lr=0.003498, batch_cost=1.3833, reader_cost=0.0001 | ETA 09:34:04 2021-02-23 15:48:16 [INFO] [TRAIN] epoch=149, iter=55110/80000, loss=0.8170, lr=0.003497, batch_cost=1.3426, reader_cost=0.0001 | ETA 09:16:58 2021-02-23 15:48:30 [INFO] [TRAIN] epoch=149, iter=55120/80000, loss=0.8901, lr=0.003495, batch_cost=1.3440, reader_cost=0.0001 | ETA 09:17:19 2021-02-23 15:48:43 [INFO] [TRAIN] epoch=149, iter=55130/80000, loss=0.7955, lr=0.003494, batch_cost=1.3824, reader_cost=0.0001 | ETA 09:32:59 2021-02-23 15:48:57 [INFO] [TRAIN] epoch=149, iter=55140/80000, loss=0.8213, lr=0.003493, batch_cost=1.3919, reader_cost=0.0001 | ETA 09:36:41 2021-02-23 15:49:11 [INFO] [TRAIN] epoch=149, iter=55150/80000, loss=0.8218, lr=0.003492, batch_cost=1.3688, reader_cost=0.0001 | ETA 09:26:53 2021-02-23 15:49:24 [INFO] [TRAIN] epoch=149, iter=55160/80000, loss=0.9577, lr=0.003490, batch_cost=1.3451, reader_cost=0.0001 | ETA 09:16:51 2021-02-23 15:49:38 [INFO] [TRAIN] epoch=149, iter=55170/80000, loss=0.7736, lr=0.003489, batch_cost=1.3451, reader_cost=0.0001 | ETA 09:16:38 2021-02-23 15:49:52 [INFO] [TRAIN] epoch=149, iter=55180/80000, loss=0.9418, lr=0.003488, batch_cost=1.3828, reader_cost=0.0001 | ETA 09:32:01 2021-02-23 15:50:05 [INFO] [TRAIN] epoch=149, iter=55190/80000, loss=0.8266, lr=0.003487, batch_cost=1.3164, reader_cost=0.0001 | ETA 09:04:18 2021-02-23 15:50:18 [INFO] [TRAIN] epoch=149, iter=55200/80000, loss=0.8897, lr=0.003485, batch_cost=1.3385, reader_cost=0.0001 | ETA 09:13:14 2021-02-23 15:50:32 [INFO] [TRAIN] epoch=149, iter=55210/80000, loss=0.8904, lr=0.003484, batch_cost=1.3869, reader_cost=0.0001 | ETA 09:33:01 2021-02-23 15:50:46 [INFO] [TRAIN] epoch=149, iter=55220/80000, loss=0.9334, lr=0.003483, batch_cost=1.3610, reader_cost=0.0001 | ETA 09:22:05 2021-02-23 15:50:59 [INFO] [TRAIN] epoch=149, iter=55230/80000, loss=0.8567, lr=0.003482, batch_cost=1.3656, reader_cost=0.0001 | ETA 09:23:46 2021-02-23 15:51:13 [INFO] [TRAIN] epoch=149, iter=55240/80000, loss=0.8819, lr=0.003480, batch_cost=1.3934, reader_cost=0.0001 | ETA 09:35:01 2021-02-23 15:51:27 [INFO] [TRAIN] epoch=149, iter=55250/80000, loss=0.8139, lr=0.003479, batch_cost=1.4113, reader_cost=0.0001 | ETA 09:42:10 2021-02-23 15:51:41 [INFO] [TRAIN] epoch=149, iter=55260/80000, loss=0.8512, lr=0.003478, batch_cost=1.3785, reader_cost=0.0001 | ETA 09:28:24 2021-02-23 15:51:55 [INFO] [TRAIN] epoch=149, iter=55270/80000, loss=0.8324, lr=0.003476, batch_cost=1.3486, reader_cost=0.0001 | ETA 09:15:51 2021-02-23 15:52:08 [INFO] [TRAIN] epoch=149, iter=55280/80000, loss=0.8346, lr=0.003475, batch_cost=1.3813, reader_cost=0.0001 | ETA 09:29:05 2021-02-23 15:52:22 [INFO] [TRAIN] epoch=149, iter=55290/80000, loss=0.8113, lr=0.003474, batch_cost=1.3722, reader_cost=0.0001 | ETA 09:25:06 2021-02-23 15:52:36 [INFO] [TRAIN] epoch=149, iter=55300/80000, loss=0.8659, lr=0.003473, batch_cost=1.3727, reader_cost=0.0001 | ETA 09:25:05 2021-02-23 15:52:50 [INFO] [TRAIN] epoch=149, iter=55310/80000, loss=0.8879, lr=0.003471, batch_cost=1.3695, reader_cost=0.0001 | ETA 09:23:32 2021-02-23 15:53:04 [INFO] [TRAIN] epoch=149, iter=55320/80000, loss=0.8082, lr=0.003470, batch_cost=1.3901, reader_cost=0.0001 | ETA 09:31:47 2021-02-23 15:53:17 [INFO] [TRAIN] epoch=149, iter=55330/80000, loss=0.8831, lr=0.003469, batch_cost=1.3735, reader_cost=0.0001 | ETA 09:24:43 2021-02-23 15:53:31 [INFO] [TRAIN] epoch=149, iter=55340/80000, loss=0.7920, lr=0.003468, batch_cost=1.3451, reader_cost=0.0001 | ETA 09:12:49 2021-02-23 15:53:44 [INFO] [TRAIN] epoch=149, iter=55350/80000, loss=0.8476, lr=0.003466, batch_cost=1.3725, reader_cost=0.0001 | ETA 09:23:51 2021-02-23 15:53:58 [INFO] [TRAIN] epoch=149, iter=55360/80000, loss=0.8893, lr=0.003465, batch_cost=1.3684, reader_cost=0.0001 | ETA 09:21:56 2021-02-23 15:54:12 [INFO] [TRAIN] epoch=149, iter=55370/80000, loss=0.8810, lr=0.003464, batch_cost=1.3545, reader_cost=0.0001 | ETA 09:16:01 2021-02-23 15:54:25 [INFO] [TRAIN] epoch=149, iter=55380/80000, loss=0.8837, lr=0.003463, batch_cost=1.3746, reader_cost=0.0001 | ETA 09:24:03 2021-02-23 15:54:39 [INFO] [TRAIN] epoch=149, iter=55390/80000, loss=0.8959, lr=0.003461, batch_cost=1.3509, reader_cost=0.0001 | ETA 09:14:05 2021-02-23 15:54:53 [INFO] [TRAIN] epoch=149, iter=55400/80000, loss=0.8445, lr=0.003460, batch_cost=1.3670, reader_cost=0.0001 | ETA 09:20:28 2021-02-23 15:55:06 [INFO] [TRAIN] epoch=149, iter=55410/80000, loss=0.8258, lr=0.003459, batch_cost=1.3585, reader_cost=0.0001 | ETA 09:16:44 2021-02-23 15:55:20 [INFO] [TRAIN] epoch=149, iter=55420/80000, loss=0.8457, lr=0.003457, batch_cost=1.3734, reader_cost=0.0001 | ETA 09:22:38 2021-02-23 15:55:34 [INFO] [TRAIN] epoch=150, iter=55430/80000, loss=0.8513, lr=0.003456, batch_cost=1.4298, reader_cost=0.0660 | ETA 09:45:29 2021-02-23 15:55:48 [INFO] [TRAIN] epoch=150, iter=55440/80000, loss=0.7816, lr=0.003455, batch_cost=1.3657, reader_cost=0.0001 | ETA 09:19:00 2021-02-23 15:56:02 [INFO] [TRAIN] epoch=150, iter=55450/80000, loss=0.8323, lr=0.003454, batch_cost=1.3768, reader_cost=0.0001 | ETA 09:23:20 2021-02-23 15:56:15 [INFO] [TRAIN] epoch=150, iter=55460/80000, loss=0.8404, lr=0.003452, batch_cost=1.3829, reader_cost=0.0001 | ETA 09:25:37 2021-02-23 15:56:29 [INFO] [TRAIN] epoch=150, iter=55470/80000, loss=0.8630, lr=0.003451, batch_cost=1.3397, reader_cost=0.0001 | ETA 09:07:41 2021-02-23 15:56:42 [INFO] [TRAIN] epoch=150, iter=55480/80000, loss=0.8205, lr=0.003450, batch_cost=1.3592, reader_cost=0.0001 | ETA 09:15:26 2021-02-23 15:56:56 [INFO] [TRAIN] epoch=150, iter=55490/80000, loss=0.9008, lr=0.003449, batch_cost=1.3875, reader_cost=0.0001 | ETA 09:26:47 2021-02-23 15:57:10 [INFO] [TRAIN] epoch=150, iter=55500/80000, loss=0.8398, lr=0.003447, batch_cost=1.3872, reader_cost=0.0001 | ETA 09:26:25 2021-02-23 15:57:24 [INFO] [TRAIN] epoch=150, iter=55510/80000, loss=0.8633, lr=0.003446, batch_cost=1.3697, reader_cost=0.0001 | ETA 09:19:04 2021-02-23 15:57:37 [INFO] [TRAIN] epoch=150, iter=55520/80000, loss=0.8596, lr=0.003445, batch_cost=1.3404, reader_cost=0.0001 | ETA 09:06:53 2021-02-23 15:57:51 [INFO] [TRAIN] epoch=150, iter=55530/80000, loss=0.9010, lr=0.003444, batch_cost=1.3588, reader_cost=0.0001 | ETA 09:14:09 2021-02-23 15:58:04 [INFO] [TRAIN] epoch=150, iter=55540/80000, loss=0.7890, lr=0.003442, batch_cost=1.3484, reader_cost=0.0001 | ETA 09:09:41 2021-02-23 15:58:18 [INFO] [TRAIN] epoch=150, iter=55550/80000, loss=0.9562, lr=0.003441, batch_cost=1.3522, reader_cost=0.0001 | ETA 09:11:00 2021-02-23 15:58:32 [INFO] [TRAIN] epoch=150, iter=55560/80000, loss=0.7606, lr=0.003440, batch_cost=1.3626, reader_cost=0.0001 | ETA 09:15:02 2021-02-23 15:58:46 [INFO] [TRAIN] epoch=150, iter=55570/80000, loss=0.8617, lr=0.003438, batch_cost=1.4087, reader_cost=0.0001 | ETA 09:33:33 2021-02-23 15:58:59 [INFO] [TRAIN] epoch=150, iter=55580/80000, loss=0.8116, lr=0.003437, batch_cost=1.3694, reader_cost=0.0001 | ETA 09:17:19 2021-02-23 15:59:13 [INFO] [TRAIN] epoch=150, iter=55590/80000, loss=0.8625, lr=0.003436, batch_cost=1.3617, reader_cost=0.0001 | ETA 09:13:59 2021-02-23 15:59:27 [INFO] [TRAIN] epoch=150, iter=55600/80000, loss=0.8393, lr=0.003435, batch_cost=1.3635, reader_cost=0.0001 | ETA 09:14:29 2021-02-23 15:59:40 [INFO] [TRAIN] epoch=150, iter=55610/80000, loss=0.8663, lr=0.003433, batch_cost=1.3545, reader_cost=0.0001 | ETA 09:10:37 2021-02-23 15:59:54 [INFO] [TRAIN] epoch=150, iter=55620/80000, loss=0.8241, lr=0.003432, batch_cost=1.3452, reader_cost=0.0001 | ETA 09:06:36 2021-02-23 16:00:07 [INFO] [TRAIN] epoch=150, iter=55630/80000, loss=0.8253, lr=0.003431, batch_cost=1.3413, reader_cost=0.0001 | ETA 09:04:46 2021-02-23 16:00:21 [INFO] [TRAIN] epoch=150, iter=55640/80000, loss=0.9123, lr=0.003430, batch_cost=1.3574, reader_cost=0.0001 | ETA 09:11:05 2021-02-23 16:00:34 [INFO] [TRAIN] epoch=150, iter=55650/80000, loss=0.8536, lr=0.003428, batch_cost=1.3470, reader_cost=0.0001 | ETA 09:06:39 2021-02-23 16:00:48 [INFO] [TRAIN] epoch=150, iter=55660/80000, loss=0.8241, lr=0.003427, batch_cost=1.3518, reader_cost=0.0001 | ETA 09:08:21 2021-02-23 16:01:01 [INFO] [TRAIN] epoch=150, iter=55670/80000, loss=0.8889, lr=0.003426, batch_cost=1.3349, reader_cost=0.0001 | ETA 09:01:17 2021-02-23 16:01:14 [INFO] [TRAIN] epoch=150, iter=55680/80000, loss=0.9240, lr=0.003425, batch_cost=1.3577, reader_cost=0.0001 | ETA 09:10:19 2021-02-23 16:01:28 [INFO] [TRAIN] epoch=150, iter=55690/80000, loss=0.8815, lr=0.003423, batch_cost=1.3798, reader_cost=0.0001 | ETA 09:19:03 2021-02-23 16:01:42 [INFO] [TRAIN] epoch=150, iter=55700/80000, loss=0.8161, lr=0.003422, batch_cost=1.3595, reader_cost=0.0001 | ETA 09:10:35 2021-02-23 16:01:55 [INFO] [TRAIN] epoch=150, iter=55710/80000, loss=0.8041, lr=0.003421, batch_cost=1.3484, reader_cost=0.0001 | ETA 09:05:51 2021-02-23 16:02:09 [INFO] [TRAIN] epoch=150, iter=55720/80000, loss=0.9132, lr=0.003419, batch_cost=1.3422, reader_cost=0.0001 | ETA 09:03:08 2021-02-23 16:02:22 [INFO] [TRAIN] epoch=150, iter=55730/80000, loss=0.8171, lr=0.003418, batch_cost=1.3355, reader_cost=0.0001 | ETA 09:00:12 2021-02-23 16:02:36 [INFO] [TRAIN] epoch=150, iter=55740/80000, loss=0.7887, lr=0.003417, batch_cost=1.3395, reader_cost=0.0001 | ETA 09:01:35 2021-02-23 16:02:49 [INFO] [TRAIN] epoch=150, iter=55750/80000, loss=0.8665, lr=0.003416, batch_cost=1.3557, reader_cost=0.0001 | ETA 09:07:55 2021-02-23 16:03:02 [INFO] [TRAIN] epoch=150, iter=55760/80000, loss=0.8094, lr=0.003414, batch_cost=1.3343, reader_cost=0.0001 | ETA 08:59:03 2021-02-23 16:03:16 [INFO] [TRAIN] epoch=150, iter=55770/80000, loss=0.9901, lr=0.003413, batch_cost=1.3479, reader_cost=0.0001 | ETA 09:04:19 2021-02-23 16:03:29 [INFO] [TRAIN] epoch=150, iter=55780/80000, loss=0.7831, lr=0.003412, batch_cost=1.3244, reader_cost=0.0001 | ETA 08:54:37 2021-02-23 16:03:43 [INFO] [TRAIN] epoch=150, iter=55790/80000, loss=0.8743, lr=0.003411, batch_cost=1.3440, reader_cost=0.0001 | ETA 09:02:17 2021-02-23 16:03:56 [INFO] [TRAIN] epoch=150, iter=55800/80000, loss=0.8505, lr=0.003409, batch_cost=1.3007, reader_cost=0.0001 | ETA 08:44:35 2021-02-23 16:04:10 [INFO] [TRAIN] epoch=151, iter=55810/80000, loss=0.8293, lr=0.003408, batch_cost=1.4323, reader_cost=0.0541 | ETA 09:37:26 2021-02-23 16:04:24 [INFO] [TRAIN] epoch=151, iter=55820/80000, loss=0.7926, lr=0.003407, batch_cost=1.3714, reader_cost=0.0001 | ETA 09:12:40 2021-02-23 16:04:37 [INFO] [TRAIN] epoch=151, iter=55830/80000, loss=0.7775, lr=0.003406, batch_cost=1.3321, reader_cost=0.0001 | ETA 08:56:37 2021-02-23 16:04:50 [INFO] [TRAIN] epoch=151, iter=55840/80000, loss=0.8933, lr=0.003404, batch_cost=1.3315, reader_cost=0.0001 | ETA 08:56:09 2021-02-23 16:05:04 [INFO] [TRAIN] epoch=151, iter=55850/80000, loss=0.8241, lr=0.003403, batch_cost=1.3614, reader_cost=0.0001 | ETA 09:07:57 2021-02-23 16:05:17 [INFO] [TRAIN] epoch=151, iter=55860/80000, loss=0.8633, lr=0.003402, batch_cost=1.3510, reader_cost=0.0001 | ETA 09:03:32 2021-02-23 16:05:31 [INFO] [TRAIN] epoch=151, iter=55870/80000, loss=0.8608, lr=0.003400, batch_cost=1.3472, reader_cost=0.0001 | ETA 09:01:48 2021-02-23 16:05:45 [INFO] [TRAIN] epoch=151, iter=55880/80000, loss=0.9061, lr=0.003399, batch_cost=1.3676, reader_cost=0.0001 | ETA 09:09:45 2021-02-23 16:05:58 [INFO] [TRAIN] epoch=151, iter=55890/80000, loss=0.8301, lr=0.003398, batch_cost=1.3426, reader_cost=0.0001 | ETA 08:59:29 2021-02-23 16:06:11 [INFO] [TRAIN] epoch=151, iter=55900/80000, loss=0.8379, lr=0.003397, batch_cost=1.3387, reader_cost=0.0001 | ETA 08:57:41 2021-02-23 16:06:25 [INFO] [TRAIN] epoch=151, iter=55910/80000, loss=0.9279, lr=0.003395, batch_cost=1.3581, reader_cost=0.0001 | ETA 09:05:16 2021-02-23 16:06:38 [INFO] [TRAIN] epoch=151, iter=55920/80000, loss=0.8418, lr=0.003394, batch_cost=1.3497, reader_cost=0.0001 | ETA 09:01:41 2021-02-23 16:06:52 [INFO] [TRAIN] epoch=151, iter=55930/80000, loss=0.8478, lr=0.003393, batch_cost=1.3313, reader_cost=0.0001 | ETA 08:54:03 2021-02-23 16:07:06 [INFO] [TRAIN] epoch=151, iter=55940/80000, loss=0.8195, lr=0.003392, batch_cost=1.3789, reader_cost=0.0001 | ETA 09:12:57 2021-02-23 16:07:19 [INFO] [TRAIN] epoch=151, iter=55950/80000, loss=0.8110, lr=0.003390, batch_cost=1.3654, reader_cost=0.0001 | ETA 09:07:18 2021-02-23 16:07:33 [INFO] [TRAIN] epoch=151, iter=55960/80000, loss=0.8520, lr=0.003389, batch_cost=1.3502, reader_cost=0.0001 | ETA 09:00:59 2021-02-23 16:07:46 [INFO] [TRAIN] epoch=151, iter=55970/80000, loss=0.9229, lr=0.003388, batch_cost=1.3725, reader_cost=0.0001 | ETA 09:09:40 2021-02-23 16:08:00 [INFO] [TRAIN] epoch=151, iter=55980/80000, loss=0.8636, lr=0.003386, batch_cost=1.3477, reader_cost=0.0001 | ETA 08:59:30 2021-02-23 16:08:13 [INFO] [TRAIN] epoch=151, iter=55990/80000, loss=0.8004, lr=0.003385, batch_cost=1.3266, reader_cost=0.0001 | ETA 08:50:52 2021-02-23 16:08:27 [INFO] [TRAIN] epoch=151, iter=56000/80000, loss=0.8559, lr=0.003384, batch_cost=1.3713, reader_cost=0.0001 | ETA 09:08:31 2021-02-23 16:08:27 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:10 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:02 - batch_cost: 0.2210 - reader cost: 0.0958  3/125 [..............................] - ETA: 57s - batch_cost: 0.2794 - reader cost: 0.1134  4/125 [..............................] - ETA: 55s - batch_cost: 0.3158 - reader cost: 0.1290 5/125 [>.............................] - ETA: 54s - batch_cost: 0.3372 - reader cost: 0.1384 6/125 [>.............................] - ETA: 53s - batch_cost: 0.3511 - reader cost: 0.1442 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3627 - reader cost: 0.1501 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3665 - reader cost: 0.1477 9/125 [=>............................] - ETA: 50s - batch_cost: 0.3716 - reader cost: 0.1474 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3780 - reader cost: 0.1481 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3824 - reader cost: 0.1508 12/125 [=>............................] - ETA: 48s - batch_cost: 0.3829 - reader cost: 0.1499 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3879 - reader cost: 0.1538 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3940 - reader cost: 0.1583 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3944 - reader cost: 0.1576 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3962 - reader cost: 0.1582 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3983 - reader cost: 0.1593 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.4013 - reader cost: 0.1617 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.4033 - reader cost: 0.1628 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4043 - reader cost: 0.1635 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4030 - reader cost: 0.1617 22/125 [====>.........................] - ETA: 43s - batch_cost: 0.4012 - reader cost: 0.1596 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4000 - reader cost: 0.1582 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.4019 - reader cost: 0.1597 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4027 - reader cost: 0.1603 26/125 [=====>........................] - ETA: 41s - batch_cost: 0.4018 - reader cost: 0.1585 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4021 - reader cost: 0.1585 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4025 - reader cost: 0.1587 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4038 - reader cost: 0.1596 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4050 - reader cost: 0.1601 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.4063 - reader cost: 0.1612 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4075 - reader cost: 0.1618 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4076 - reader cost: 0.1618 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4065 - reader cost: 0.1607 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4071 - reader cost: 0.1612 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4079 - reader cost: 0.1617 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4072 - reader cost: 0.1609 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4076 - reader cost: 0.1612 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4079 - reader cost: 0.1614 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4085 - reader cost: 0.1617 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4077 - reader cost: 0.1608 42/125 [=========>....................] - ETA: 34s - batch_cost: 0.4066 - reader cost: 0.1596 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4075 - reader cost: 0.1604 44/125 [=========>....................] - ETA: 33s - batch_cost: 0.4068 - reader cost: 0.1597 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4074 - reader cost: 0.1603 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4079 - reader cost: 0.1607 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4084 - reader cost: 0.1610 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4086 - reader cost: 0.1611 49/125 [==========>...................] - ETA: 31s - batch_cost: 0.4092 - reader cost: 0.1615 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4096 - reader cost: 0.1616 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4084 - reader cost: 0.1603 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4086 - reader cost: 0.1605 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4077 - reader cost: 0.1596 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4072 - reader cost: 0.1588 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4067 - reader cost: 0.1576 56/125 [============>.................] - ETA: 28s - batch_cost: 0.4067 - reader cost: 0.1567 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4060 - reader cost: 0.1560 58/125 [============>.................] - ETA: 27s - batch_cost: 0.4064 - reader cost: 0.1564 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4066 - reader cost: 0.1566 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4070 - reader cost: 0.1569 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4074 - reader cost: 0.1570 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4076 - reader cost: 0.1571 63/125 [==============>...............] - ETA: 25s - batch_cost: 0.4077 - reader cost: 0.1573 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4088 - reader cost: 0.1582 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4091 - reader cost: 0.1586 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4092 - reader cost: 0.1588 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4090 - reader cost: 0.1584 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4092 - reader cost: 0.1585 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4086 - reader cost: 0.1579 70/125 [===============>..............] - ETA: 22s - batch_cost: 0.4079 - reader cost: 0.1572 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4082 - reader cost: 0.1574 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4077 - reader cost: 0.1570 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4078 - reader cost: 0.1571 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4080 - reader cost: 0.1573 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4078 - reader cost: 0.1570 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4075 - reader cost: 0.1567 77/125 [=================>............] - ETA: 19s - batch_cost: 0.4072 - reader cost: 0.1565 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4075 - reader cost: 0.1568 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4074 - reader cost: 0.1566 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4075 - reader cost: 0.1566 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4076 - reader cost: 0.1568 82/125 [==================>...........] - ETA: 17s - batch_cost: 0.4073 - reader cost: 0.1565 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4074 - reader cost: 0.1562 84/125 [===================>..........] - ETA: 16s - batch_cost: 0.4075 - reader cost: 0.1564 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4078 - reader cost: 0.1567 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4076 - reader cost: 0.1562 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4081 - reader cost: 0.1564 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4082 - reader cost: 0.1564 89/125 [====================>.........] - ETA: 14s - batch_cost: 0.4086 - reader cost: 0.1566 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4089 - reader cost: 0.1570 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4091 - reader cost: 0.1572 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4094 - reader cost: 0.1576 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4094 - reader cost: 0.1576 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4095 - reader cost: 0.1576 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4098 - reader cost: 0.1579 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4094 - reader cost: 0.1575 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4092 - reader cost: 0.1574 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4093 - reader cost: 0.1575 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4095 - reader cost: 0.1577 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4096 - reader cost: 0.1579 101/125 [=======================>......] - ETA: 9s - batch_cost: 0.4093 - reader cost: 0.1576  102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4095 - reader cost: 0.1578 103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4097 - reader cost: 0.1580 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4092 - reader cost: 0.1576 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4088 - reader cost: 0.1571 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4090 - reader cost: 0.1573 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4091 - reader cost: 0.1575 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4092 - reader cost: 0.1571 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4089 - reader cost: 0.1567 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4088 - reader cost: 0.1563 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4090 - reader cost: 0.1564 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4092 - reader cost: 0.1566 113/125 [==========================>...] - ETA: 4s - batch_cost: 0.4091 - reader cost: 0.1560 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4091 - reader cost: 0.1555 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4092 - reader cost: 0.1552 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4093 - reader cost: 0.1553 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4094 - reader cost: 0.1555 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4096 - reader cost: 0.1557 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4098 - reader cost: 0.1559 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4099 - reader cost: 0.1561 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4101 - reader cost: 0.1562 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4101 - reader cost: 0.1563 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4098 - reader cost: 0.1560 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4100 - reader cost: 0.1562 125/125 [==============================] - 52s 415ms/step - batch_cost: 0.4101 - reader cost: 0.1563 2021-02-23 16:09:19 [INFO] [EVAL] #Images=500 mIoU=0.7583 Acc=0.9604 Kappa=0.9486 2021-02-23 16:09:19 [INFO] [EVAL] Class IoU: [0.9804 0.8441 0.9272 0.5188 0.6269 0.6677 0.7274 0.8241 0.9193 0.6307 0.9455 0.836 0.638 0.9536 0.8138 0.7593 0.3298 0.6726 0.7932] 2021-02-23 16:09:19 [INFO] [EVAL] Class Acc: [0.9896 0.9093 0.966 0.8819 0.8189 0.8382 0.8856 0.9252 0.9417 0.7917 0.9629 0.918 0.8128 0.9769 0.9461 0.7918 0.9301 0.7594 0.8746] 2021-02-23 16:09:23 [INFO] [EVAL] The model with the best validation mIoU (0.7816) was saved at iter 44000. 2021-02-23 16:09:37 [INFO] [TRAIN] epoch=151, iter=56010/80000, loss=0.8359, lr=0.003383, batch_cost=1.3679, reader_cost=0.0001 | ETA 09:06:55 2021-02-23 16:09:50 [INFO] [TRAIN] epoch=151, iter=56020/80000, loss=0.8585, lr=0.003381, batch_cost=1.3477, reader_cost=0.0001 | ETA 08:58:38 2021-02-23 16:10:04 [INFO] [TRAIN] epoch=151, iter=56030/80000, loss=0.8929, lr=0.003380, batch_cost=1.3646, reader_cost=0.0001 | ETA 09:05:10 2021-02-23 16:10:17 [INFO] [TRAIN] epoch=151, iter=56040/80000, loss=0.9178, lr=0.003379, batch_cost=1.3602, reader_cost=0.0001 | ETA 09:03:09 2021-02-23 16:10:31 [INFO] [TRAIN] epoch=151, iter=56050/80000, loss=0.8589, lr=0.003378, batch_cost=1.3757, reader_cost=0.0001 | ETA 09:09:07 2021-02-23 16:10:45 [INFO] [TRAIN] epoch=151, iter=56060/80000, loss=0.7984, lr=0.003376, batch_cost=1.3590, reader_cost=0.0001 | ETA 09:02:13 2021-02-23 16:10:58 [INFO] [TRAIN] epoch=151, iter=56070/80000, loss=0.8183, lr=0.003375, batch_cost=1.3517, reader_cost=0.0001 | ETA 08:59:07 2021-02-23 16:11:12 [INFO] [TRAIN] epoch=151, iter=56080/80000, loss=0.8588, lr=0.003374, batch_cost=1.3661, reader_cost=0.0001 | ETA 09:04:36 2021-02-23 16:11:26 [INFO] [TRAIN] epoch=151, iter=56090/80000, loss=0.8226, lr=0.003373, batch_cost=1.3865, reader_cost=0.0001 | ETA 09:12:30 2021-02-23 16:11:39 [INFO] [TRAIN] epoch=151, iter=56100/80000, loss=0.8670, lr=0.003371, batch_cost=1.3576, reader_cost=0.0001 | ETA 09:00:46 2021-02-23 16:11:53 [INFO] [TRAIN] epoch=151, iter=56110/80000, loss=0.8151, lr=0.003370, batch_cost=1.3720, reader_cost=0.0001 | ETA 09:06:18 2021-02-23 16:12:07 [INFO] [TRAIN] epoch=151, iter=56120/80000, loss=0.8267, lr=0.003369, batch_cost=1.3592, reader_cost=0.0001 | ETA 09:00:57 2021-02-23 16:12:20 [INFO] [TRAIN] epoch=151, iter=56130/80000, loss=0.8773, lr=0.003367, batch_cost=1.3832, reader_cost=0.0001 | ETA 09:10:17 2021-02-23 16:12:34 [INFO] [TRAIN] epoch=151, iter=56140/80000, loss=0.9449, lr=0.003366, batch_cost=1.3598, reader_cost=0.0001 | ETA 09:00:45 2021-02-23 16:12:48 [INFO] [TRAIN] epoch=151, iter=56150/80000, loss=0.9015, lr=0.003365, batch_cost=1.3544, reader_cost=0.0001 | ETA 08:58:23 2021-02-23 16:13:01 [INFO] [TRAIN] epoch=151, iter=56160/80000, loss=0.8350, lr=0.003364, batch_cost=1.3386, reader_cost=0.0001 | ETA 08:51:52 2021-02-23 16:13:15 [INFO] [TRAIN] epoch=151, iter=56170/80000, loss=0.8435, lr=0.003362, batch_cost=1.3586, reader_cost=0.0001 | ETA 08:59:34 2021-02-23 16:13:29 [INFO] [TRAIN] epoch=152, iter=56180/80000, loss=0.8697, lr=0.003361, batch_cost=1.4553, reader_cost=0.0646 | ETA 09:37:45 2021-02-23 16:13:43 [INFO] [TRAIN] epoch=152, iter=56190/80000, loss=0.8172, lr=0.003360, batch_cost=1.3905, reader_cost=0.0001 | ETA 09:11:48 2021-02-23 16:13:57 [INFO] [TRAIN] epoch=152, iter=56200/80000, loss=0.8993, lr=0.003359, batch_cost=1.3866, reader_cost=0.0001 | ETA 09:10:02 2021-02-23 16:14:10 [INFO] [TRAIN] epoch=152, iter=56210/80000, loss=0.7761, lr=0.003357, batch_cost=1.3374, reader_cost=0.0001 | ETA 08:50:15 2021-02-23 16:14:24 [INFO] [TRAIN] epoch=152, iter=56220/80000, loss=0.8816, lr=0.003356, batch_cost=1.4204, reader_cost=0.0001 | ETA 09:22:58 2021-02-23 16:14:38 [INFO] [TRAIN] epoch=152, iter=56230/80000, loss=0.7903, lr=0.003355, batch_cost=1.3798, reader_cost=0.0001 | ETA 09:06:37 2021-02-23 16:14:52 [INFO] [TRAIN] epoch=152, iter=56240/80000, loss=0.9684, lr=0.003353, batch_cost=1.4181, reader_cost=0.0001 | ETA 09:21:34 2021-02-23 16:15:06 [INFO] [TRAIN] epoch=152, iter=56250/80000, loss=0.8965, lr=0.003352, batch_cost=1.3786, reader_cost=0.0001 | ETA 09:05:41 2021-02-23 16:15:20 [INFO] [TRAIN] epoch=152, iter=56260/80000, loss=0.8087, lr=0.003351, batch_cost=1.3723, reader_cost=0.0001 | ETA 09:02:57 2021-02-23 16:15:33 [INFO] [TRAIN] epoch=152, iter=56270/80000, loss=0.8302, lr=0.003350, batch_cost=1.3556, reader_cost=0.0001 | ETA 08:56:07 2021-02-23 16:15:47 [INFO] [TRAIN] epoch=152, iter=56280/80000, loss=0.8457, lr=0.003348, batch_cost=1.3747, reader_cost=0.0001 | ETA 09:03:28 2021-02-23 16:16:01 [INFO] [TRAIN] epoch=152, iter=56290/80000, loss=0.7967, lr=0.003347, batch_cost=1.3678, reader_cost=0.0001 | ETA 09:00:30 2021-02-23 16:16:15 [INFO] [TRAIN] epoch=152, iter=56300/80000, loss=0.9024, lr=0.003346, batch_cost=1.3873, reader_cost=0.0001 | ETA 09:07:59 2021-02-23 16:16:29 [INFO] [TRAIN] epoch=152, iter=56310/80000, loss=0.8591, lr=0.003345, batch_cost=1.3784, reader_cost=0.0001 | ETA 09:04:15 2021-02-23 16:16:42 [INFO] [TRAIN] epoch=152, iter=56320/80000, loss=0.8621, lr=0.003343, batch_cost=1.3509, reader_cost=0.0001 | ETA 08:53:09 2021-02-23 16:16:56 [INFO] [TRAIN] epoch=152, iter=56330/80000, loss=0.7957, lr=0.003342, batch_cost=1.3760, reader_cost=0.0001 | ETA 09:02:48 2021-02-23 16:17:10 [INFO] [TRAIN] epoch=152, iter=56340/80000, loss=0.8131, lr=0.003341, batch_cost=1.3775, reader_cost=0.0001 | ETA 09:03:11 2021-02-23 16:17:23 [INFO] [TRAIN] epoch=152, iter=56350/80000, loss=0.8876, lr=0.003340, batch_cost=1.3714, reader_cost=0.0001 | ETA 09:00:34 2021-02-23 16:17:37 [INFO] [TRAIN] epoch=152, iter=56360/80000, loss=0.9223, lr=0.003338, batch_cost=1.3454, reader_cost=0.0001 | ETA 08:50:04 2021-02-23 16:17:51 [INFO] [TRAIN] epoch=152, iter=56370/80000, loss=0.8524, lr=0.003337, batch_cost=1.3781, reader_cost=0.0001 | ETA 09:02:44 2021-02-23 16:18:04 [INFO] [TRAIN] epoch=152, iter=56380/80000, loss=0.8564, lr=0.003336, batch_cost=1.3452, reader_cost=0.0001 | ETA 08:49:32 2021-02-23 16:18:18 [INFO] [TRAIN] epoch=152, iter=56390/80000, loss=0.9186, lr=0.003334, batch_cost=1.3720, reader_cost=0.0001 | ETA 08:59:52 2021-02-23 16:18:31 [INFO] [TRAIN] epoch=152, iter=56400/80000, loss=0.8188, lr=0.003333, batch_cost=1.3592, reader_cost=0.0001 | ETA 08:54:38 2021-02-23 16:18:45 [INFO] [TRAIN] epoch=152, iter=56410/80000, loss=0.8911, lr=0.003332, batch_cost=1.3581, reader_cost=0.0001 | ETA 08:53:57 2021-02-23 16:18:59 [INFO] [TRAIN] epoch=152, iter=56420/80000, loss=0.8082, lr=0.003331, batch_cost=1.3641, reader_cost=0.0001 | ETA 08:56:05 2021-02-23 16:19:12 [INFO] [TRAIN] epoch=152, iter=56430/80000, loss=0.9299, lr=0.003329, batch_cost=1.3396, reader_cost=0.0001 | ETA 08:46:15 2021-02-23 16:19:26 [INFO] [TRAIN] epoch=152, iter=56440/80000, loss=0.8003, lr=0.003328, batch_cost=1.3693, reader_cost=0.0001 | ETA 08:57:40 2021-02-23 16:19:39 [INFO] [TRAIN] epoch=152, iter=56450/80000, loss=0.8617, lr=0.003327, batch_cost=1.3523, reader_cost=0.0001 | ETA 08:50:47 2021-02-23 16:19:53 [INFO] [TRAIN] epoch=152, iter=56460/80000, loss=0.8373, lr=0.003326, batch_cost=1.3867, reader_cost=0.0001 | ETA 09:04:03 2021-02-23 16:20:06 [INFO] [TRAIN] epoch=152, iter=56470/80000, loss=0.8362, lr=0.003324, batch_cost=1.3459, reader_cost=0.0001 | ETA 08:47:49 2021-02-23 16:20:20 [INFO] [TRAIN] epoch=152, iter=56480/80000, loss=0.8503, lr=0.003323, batch_cost=1.3493, reader_cost=0.0001 | ETA 08:48:54 2021-02-23 16:20:33 [INFO] [TRAIN] epoch=152, iter=56490/80000, loss=0.9267, lr=0.003322, batch_cost=1.3312, reader_cost=0.0001 | ETA 08:41:36 2021-02-23 16:20:47 [INFO] [TRAIN] epoch=152, iter=56500/80000, loss=0.8166, lr=0.003320, batch_cost=1.3796, reader_cost=0.0001 | ETA 09:00:20 2021-02-23 16:21:01 [INFO] [TRAIN] epoch=152, iter=56510/80000, loss=0.8397, lr=0.003319, batch_cost=1.4227, reader_cost=0.0001 | ETA 09:16:59 2021-02-23 16:21:15 [INFO] [TRAIN] epoch=152, iter=56520/80000, loss=0.8756, lr=0.003318, batch_cost=1.3922, reader_cost=0.0001 | ETA 09:04:50 2021-02-23 16:21:29 [INFO] [TRAIN] epoch=152, iter=56530/80000, loss=0.8033, lr=0.003317, batch_cost=1.3876, reader_cost=0.0001 | ETA 09:02:46 2021-02-23 16:21:43 [INFO] [TRAIN] epoch=152, iter=56540/80000, loss=0.8895, lr=0.003315, batch_cost=1.3792, reader_cost=0.0001 | ETA 08:59:17 2021-02-23 16:21:57 [INFO] [TRAIN] epoch=153, iter=56550/80000, loss=0.8343, lr=0.003314, batch_cost=1.4092, reader_cost=0.0677 | ETA 09:10:45 2021-02-23 16:22:11 [INFO] [TRAIN] epoch=153, iter=56560/80000, loss=0.8748, lr=0.003313, batch_cost=1.3991, reader_cost=0.0001 | ETA 09:06:34 2021-02-23 16:22:25 [INFO] [TRAIN] epoch=153, iter=56570/80000, loss=0.8182, lr=0.003312, batch_cost=1.3708, reader_cost=0.0001 | ETA 08:55:16 2021-02-23 16:22:38 [INFO] [TRAIN] epoch=153, iter=56580/80000, loss=0.8326, lr=0.003310, batch_cost=1.3722, reader_cost=0.0001 | ETA 08:55:36 2021-02-23 16:22:52 [INFO] [TRAIN] epoch=153, iter=56590/80000, loss=0.8520, lr=0.003309, batch_cost=1.3449, reader_cost=0.0001 | ETA 08:44:43 2021-02-23 16:23:05 [INFO] [TRAIN] epoch=153, iter=56600/80000, loss=1.0295, lr=0.003308, batch_cost=1.3525, reader_cost=0.0001 | ETA 08:47:27 2021-02-23 16:23:19 [INFO] [TRAIN] epoch=153, iter=56610/80000, loss=0.8096, lr=0.003306, batch_cost=1.3599, reader_cost=0.0001 | ETA 08:50:08 2021-02-23 16:23:32 [INFO] [TRAIN] epoch=153, iter=56620/80000, loss=0.8201, lr=0.003305, batch_cost=1.3333, reader_cost=0.0001 | ETA 08:39:32 2021-02-23 16:23:46 [INFO] [TRAIN] epoch=153, iter=56630/80000, loss=0.8563, lr=0.003304, batch_cost=1.3742, reader_cost=0.0001 | ETA 08:55:14 2021-02-23 16:24:00 [INFO] [TRAIN] epoch=153, iter=56640/80000, loss=0.8542, lr=0.003303, batch_cost=1.3758, reader_cost=0.0001 | ETA 08:55:38 2021-02-23 16:24:13 [INFO] [TRAIN] epoch=153, iter=56650/80000, loss=0.7866, lr=0.003301, batch_cost=1.3605, reader_cost=0.0001 | ETA 08:49:27 2021-02-23 16:24:27 [INFO] [TRAIN] epoch=153, iter=56660/80000, loss=0.9251, lr=0.003300, batch_cost=1.3785, reader_cost=0.0001 | ETA 08:56:14 2021-02-23 16:24:41 [INFO] [TRAIN] epoch=153, iter=56670/80000, loss=0.8059, lr=0.003299, batch_cost=1.3666, reader_cost=0.0001 | ETA 08:51:22 2021-02-23 16:24:54 [INFO] [TRAIN] epoch=153, iter=56680/80000, loss=0.8713, lr=0.003298, batch_cost=1.3556, reader_cost=0.0001 | ETA 08:46:53 2021-02-23 16:25:08 [INFO] [TRAIN] epoch=153, iter=56690/80000, loss=0.8469, lr=0.003296, batch_cost=1.3698, reader_cost=0.0001 | ETA 08:52:10 2021-02-23 16:25:22 [INFO] [TRAIN] epoch=153, iter=56700/80000, loss=0.8871, lr=0.003295, batch_cost=1.4117, reader_cost=0.0001 | ETA 09:08:11 2021-02-23 16:25:36 [INFO] [TRAIN] epoch=153, iter=56710/80000, loss=0.8450, lr=0.003294, batch_cost=1.3748, reader_cost=0.0001 | ETA 08:53:40 2021-02-23 16:25:50 [INFO] [TRAIN] epoch=153, iter=56720/80000, loss=0.8613, lr=0.003292, batch_cost=1.4093, reader_cost=0.0001 | ETA 09:06:48 2021-02-23 16:26:04 [INFO] [TRAIN] epoch=153, iter=56730/80000, loss=0.8864, lr=0.003291, batch_cost=1.4047, reader_cost=0.0001 | ETA 09:04:47 2021-02-23 16:26:18 [INFO] [TRAIN] epoch=153, iter=56740/80000, loss=0.8269, lr=0.003290, batch_cost=1.3721, reader_cost=0.0001 | ETA 08:51:55 2021-02-23 16:26:31 [INFO] [TRAIN] epoch=153, iter=56750/80000, loss=0.8396, lr=0.003289, batch_cost=1.3542, reader_cost=0.0001 | ETA 08:44:45 2021-02-23 16:26:45 [INFO] [TRAIN] epoch=153, iter=56760/80000, loss=0.8335, lr=0.003287, batch_cost=1.3743, reader_cost=0.0001 | ETA 08:52:19 2021-02-23 16:26:59 [INFO] [TRAIN] epoch=153, iter=56770/80000, loss=0.8286, lr=0.003286, batch_cost=1.3999, reader_cost=0.0001 | ETA 09:02:00 2021-02-23 16:27:12 [INFO] [TRAIN] epoch=153, iter=56780/80000, loss=0.8061, lr=0.003285, batch_cost=1.3299, reader_cost=0.0001 | ETA 08:34:41 2021-02-23 16:27:26 [INFO] [TRAIN] epoch=153, iter=56790/80000, loss=0.8356, lr=0.003284, batch_cost=1.3546, reader_cost=0.0001 | ETA 08:43:59 2021-02-23 16:27:40 [INFO] [TRAIN] epoch=153, iter=56800/80000, loss=0.8636, lr=0.003282, batch_cost=1.3619, reader_cost=0.0001 | ETA 08:46:36 2021-02-23 16:27:54 [INFO] [TRAIN] epoch=153, iter=56810/80000, loss=0.9113, lr=0.003281, batch_cost=1.3912, reader_cost=0.0001 | ETA 08:57:41 2021-02-23 16:28:07 [INFO] [TRAIN] epoch=153, iter=56820/80000, loss=0.8867, lr=0.003280, batch_cost=1.3850, reader_cost=0.0001 | ETA 08:55:04 2021-02-23 16:28:21 [INFO] [TRAIN] epoch=153, iter=56830/80000, loss=0.7976, lr=0.003278, batch_cost=1.3709, reader_cost=0.0001 | ETA 08:49:23 2021-02-23 16:28:35 [INFO] [TRAIN] epoch=153, iter=56840/80000, loss=0.9025, lr=0.003277, batch_cost=1.3526, reader_cost=0.0001 | ETA 08:42:06 2021-02-23 16:28:48 [INFO] [TRAIN] epoch=153, iter=56850/80000, loss=0.8369, lr=0.003276, batch_cost=1.3579, reader_cost=0.0001 | ETA 08:43:55 2021-02-23 16:29:02 [INFO] [TRAIN] epoch=153, iter=56860/80000, loss=0.8563, lr=0.003275, batch_cost=1.3907, reader_cost=0.0001 | ETA 08:56:21 2021-02-23 16:29:16 [INFO] [TRAIN] epoch=153, iter=56870/80000, loss=0.8867, lr=0.003273, batch_cost=1.3894, reader_cost=0.0001 | ETA 08:55:37 2021-02-23 16:29:29 [INFO] [TRAIN] epoch=153, iter=56880/80000, loss=0.8383, lr=0.003272, batch_cost=1.3252, reader_cost=0.0001 | ETA 08:30:39 2021-02-23 16:29:43 [INFO] [TRAIN] epoch=153, iter=56890/80000, loss=0.8576, lr=0.003271, batch_cost=1.3861, reader_cost=0.0001 | ETA 08:53:52 2021-02-23 16:29:57 [INFO] [TRAIN] epoch=153, iter=56900/80000, loss=0.8706, lr=0.003270, batch_cost=1.3703, reader_cost=0.0001 | ETA 08:47:33 2021-02-23 16:30:11 [INFO] [TRAIN] epoch=153, iter=56910/80000, loss=0.8492, lr=0.003268, batch_cost=1.3901, reader_cost=0.0001 | ETA 08:54:58 2021-02-23 16:30:25 [INFO] [TRAIN] epoch=154, iter=56920/80000, loss=0.8297, lr=0.003267, batch_cost=1.4173, reader_cost=0.0721 | ETA 09:05:12 2021-02-23 16:30:39 [INFO] [TRAIN] epoch=154, iter=56930/80000, loss=0.8101, lr=0.003266, batch_cost=1.3673, reader_cost=0.0001 | ETA 08:45:42 2021-02-23 16:30:52 [INFO] [TRAIN] epoch=154, iter=56940/80000, loss=0.8278, lr=0.003264, batch_cost=1.3463, reader_cost=0.0001 | ETA 08:37:25 2021-02-23 16:31:06 [INFO] [TRAIN] epoch=154, iter=56950/80000, loss=0.8664, lr=0.003263, batch_cost=1.3612, reader_cost=0.0001 | ETA 08:42:56 2021-02-23 16:31:20 [INFO] [TRAIN] epoch=154, iter=56960/80000, loss=0.8340, lr=0.003262, batch_cost=1.3909, reader_cost=0.0001 | ETA 08:54:07 2021-02-23 16:31:33 [INFO] [TRAIN] epoch=154, iter=56970/80000, loss=0.8140, lr=0.003261, batch_cost=1.3324, reader_cost=0.0001 | ETA 08:31:24 2021-02-23 16:31:47 [INFO] [TRAIN] epoch=154, iter=56980/80000, loss=0.8533, lr=0.003259, batch_cost=1.3885, reader_cost=0.0001 | ETA 08:52:44 2021-02-23 16:32:00 [INFO] [TRAIN] epoch=154, iter=56990/80000, loss=0.8349, lr=0.003258, batch_cost=1.3499, reader_cost=0.0001 | ETA 08:37:40 2021-02-23 16:32:14 [INFO] [TRAIN] epoch=154, iter=57000/80000, loss=0.9530, lr=0.003257, batch_cost=1.3442, reader_cost=0.0001 | ETA 08:35:16 2021-02-23 16:32:14 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:19 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:07 - batch_cost: 0.2323 - reader cost: 0.1086  3/125 [..............................] - ETA: 1:02 - batch_cost: 0.3009 - reader cost: 0.1326 4/125 [..............................] - ETA: 59s - batch_cost: 0.3355 - reader cost: 0.1418  5/125 [>.............................] - ETA: 57s - batch_cost: 0.3515 - reader cost: 0.1468 6/125 [>.............................] - ETA: 56s - batch_cost: 0.3718 - reader cost: 0.1588 7/125 [>.............................] - ETA: 54s - batch_cost: 0.3717 - reader cost: 0.1531 8/125 [>.............................] - ETA: 54s - batch_cost: 0.3851 - reader cost: 0.1618 9/125 [=>............................] - ETA: 53s - batch_cost: 0.3901 - reader cost: 0.1636 10/125 [=>............................] - ETA: 52s - batch_cost: 0.3934 - reader cost: 0.1647 11/125 [=>............................] - ETA: 51s - batch_cost: 0.3932 - reader cost: 0.1626 12/125 [=>............................] - ETA: 51s - batch_cost: 0.3994 - reader cost: 0.1667 13/125 [==>...........................] - ETA: 50s - batch_cost: 0.4001 - reader cost: 0.1653 14/125 [==>...........................] - ETA: 49s - batch_cost: 0.4020 - reader cost: 0.1663 15/125 [==>...........................] - ETA: 48s - batch_cost: 0.4015 - reader cost: 0.1638 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3991 - reader cost: 0.1605 17/125 [===>..........................] - ETA: 47s - batch_cost: 0.4001 - reader cost: 0.1609 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.4010 - reader cost: 0.1613 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3999 - reader cost: 0.1596 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4012 - reader cost: 0.1605 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4008 - reader cost: 0.1588 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4028 - reader cost: 0.1604 23/125 [====>.........................] - ETA: 44s - batch_cost: 0.4044 - reader cost: 0.1618 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4029 - reader cost: 0.1600 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4013 - reader cost: 0.1579 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4018 - reader cost: 0.1571 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4029 - reader cost: 0.1581 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4040 - reader cost: 0.1592 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4058 - reader cost: 0.1608 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4064 - reader cost: 0.1613 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4056 - reader cost: 0.1602 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4050 - reader cost: 0.1594 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4055 - reader cost: 0.1598 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4060 - reader cost: 0.1601 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4065 - reader cost: 0.1606 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4059 - reader cost: 0.1598 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4066 - reader cost: 0.1604 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4056 - reader cost: 0.1593 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4047 - reader cost: 0.1582 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4055 - reader cost: 0.1588 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4065 - reader cost: 0.1593 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4067 - reader cost: 0.1595 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4074 - reader cost: 0.1602 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4066 - reader cost: 0.1593 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4067 - reader cost: 0.1589 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4080 - reader cost: 0.1598 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4080 - reader cost: 0.1597 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4076 - reader cost: 0.1593 49/125 [==========>...................] - ETA: 31s - batch_cost: 0.4075 - reader cost: 0.1587 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4081 - reader cost: 0.1594 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4092 - reader cost: 0.1604 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4086 - reader cost: 0.1598 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4086 - reader cost: 0.1598 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4094 - reader cost: 0.1606 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4099 - reader cost: 0.1611 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4093 - reader cost: 0.1605 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4095 - reader cost: 0.1606 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4100 - reader cost: 0.1610 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4097 - reader cost: 0.1608 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4089 - reader cost: 0.1599 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4097 - reader cost: 0.1606 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4102 - reader cost: 0.1610 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4099 - reader cost: 0.1604 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4099 - reader cost: 0.1602 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4102 - reader cost: 0.1603 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4094 - reader cost: 0.1595 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4098 - reader cost: 0.1598 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4093 - reader cost: 0.1593 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4098 - reader cost: 0.1597 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4102 - reader cost: 0.1601 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4098 - reader cost: 0.1597 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4100 - reader cost: 0.1598 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4096 - reader cost: 0.1595 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4100 - reader cost: 0.1598 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4103 - reader cost: 0.1599 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4104 - reader cost: 0.1600 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4107 - reader cost: 0.1602 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4108 - reader cost: 0.1600 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4110 - reader cost: 0.1600 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4108 - reader cost: 0.1598 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4103 - reader cost: 0.1593 82/125 [==================>...........] - ETA: 17s - batch_cost: 0.4099 - reader cost: 0.1590 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4103 - reader cost: 0.1594 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4108 - reader cost: 0.1598 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4110 - reader cost: 0.1599 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4108 - reader cost: 0.1597 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4110 - reader cost: 0.1599 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4113 - reader cost: 0.1601 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4115 - reader cost: 0.1603 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4115 - reader cost: 0.1602 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4118 - reader cost: 0.1606 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4116 - reader cost: 0.1604 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4117 - reader cost: 0.1605 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4120 - reader cost: 0.1608 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4121 - reader cost: 0.1608 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4121 - reader cost: 0.1609 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4124 - reader cost: 0.1611 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4124 - reader cost: 0.1612 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4126 - reader cost: 0.1612 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4128 - reader cost: 0.1615 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4126 - reader cost: 0.1612 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4127 - reader cost: 0.1614  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4126 - reader cost: 0.1613 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4128 - reader cost: 0.1615 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4131 - reader cost: 0.1617 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4132 - reader cost: 0.1618 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4134 - reader cost: 0.1620 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4132 - reader cost: 0.1616 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4126 - reader cost: 0.1610 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4123 - reader cost: 0.1606 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4117 - reader cost: 0.1600 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4115 - reader cost: 0.1598 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4116 - reader cost: 0.1600 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4118 - reader cost: 0.1602 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4117 - reader cost: 0.1601 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4115 - reader cost: 0.1598 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4116 - reader cost: 0.1600 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4117 - reader cost: 0.1601 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4118 - reader cost: 0.1602 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4122 - reader cost: 0.1607 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4125 - reader cost: 0.1609 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4126 - reader cost: 0.1610 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4123 - reader cost: 0.1607 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4124 - reader cost: 0.1609 125/125 [==============================] - 52s 418ms/step - batch_cost: 0.4126 - reader cost: 0.1609 2021-02-23 16:33:06 [INFO] [EVAL] #Images=500 mIoU=0.7634 Acc=0.9587 Kappa=0.9462 2021-02-23 16:33:06 [INFO] [EVAL] Class IoU: [0.9774 0.8249 0.9248 0.4207 0.6127 0.6721 0.7436 0.8083 0.9217 0.6122 0.9483 0.794 0.4684 0.9505 0.8019 0.8498 0.7905 0.601 0.7821] 2021-02-23 16:33:06 [INFO] [EVAL] Class Acc: [0.9841 0.9174 0.9586 0.8765 0.8244 0.8452 0.8463 0.8998 0.9479 0.8686 0.9668 0.8371 0.8634 0.9727 0.9362 0.9198 0.9354 0.8455 0.8715] 2021-02-23 16:33:10 [INFO] [EVAL] The model with the best validation mIoU (0.7816) was saved at iter 44000. 2021-02-23 16:33:23 [INFO] [TRAIN] epoch=154, iter=57010/80000, loss=0.8593, lr=0.003256, batch_cost=1.3396, reader_cost=0.0001 | ETA 08:33:16 2021-02-23 16:33:37 [INFO] [TRAIN] epoch=154, iter=57020/80000, loss=0.8173, lr=0.003254, batch_cost=1.3532, reader_cost=0.0001 | ETA 08:38:16 2021-02-23 16:33:51 [INFO] [TRAIN] epoch=154, iter=57030/80000, loss=0.8702, lr=0.003253, batch_cost=1.3636, reader_cost=0.0001 | ETA 08:42:01 2021-02-23 16:34:04 [INFO] [TRAIN] epoch=154, iter=57040/80000, loss=0.8681, lr=0.003252, batch_cost=1.3390, reader_cost=0.0001 | ETA 08:32:24 2021-02-23 16:34:18 [INFO] [TRAIN] epoch=154, iter=57050/80000, loss=0.8991, lr=0.003250, batch_cost=1.3693, reader_cost=0.0001 | ETA 08:43:45 2021-02-23 16:34:31 [INFO] [TRAIN] epoch=154, iter=57060/80000, loss=0.7999, lr=0.003249, batch_cost=1.3686, reader_cost=0.0001 | ETA 08:43:16 2021-02-23 16:34:45 [INFO] [TRAIN] epoch=154, iter=57070/80000, loss=0.8856, lr=0.003248, batch_cost=1.3733, reader_cost=0.0001 | ETA 08:44:49 2021-02-23 16:34:59 [INFO] [TRAIN] epoch=154, iter=57080/80000, loss=0.9210, lr=0.003247, batch_cost=1.3440, reader_cost=0.0001 | ETA 08:33:23 2021-02-23 16:35:12 [INFO] [TRAIN] epoch=154, iter=57090/80000, loss=0.7994, lr=0.003245, batch_cost=1.3573, reader_cost=0.0001 | ETA 08:38:15 2021-02-23 16:35:26 [INFO] [TRAIN] epoch=154, iter=57100/80000, loss=0.8443, lr=0.003244, batch_cost=1.3521, reader_cost=0.0001 | ETA 08:36:03 2021-02-23 16:35:39 [INFO] [TRAIN] epoch=154, iter=57110/80000, loss=0.9167, lr=0.003243, batch_cost=1.3736, reader_cost=0.0001 | ETA 08:44:02 2021-02-23 16:35:53 [INFO] [TRAIN] epoch=154, iter=57120/80000, loss=0.9033, lr=0.003242, batch_cost=1.3643, reader_cost=0.0001 | ETA 08:40:14 2021-02-23 16:36:07 [INFO] [TRAIN] epoch=154, iter=57130/80000, loss=0.8593, lr=0.003240, batch_cost=1.3597, reader_cost=0.0001 | ETA 08:38:16 2021-02-23 16:36:20 [INFO] [TRAIN] epoch=154, iter=57140/80000, loss=0.7999, lr=0.003239, batch_cost=1.3550, reader_cost=0.0001 | ETA 08:36:15 2021-02-23 16:36:34 [INFO] [TRAIN] epoch=154, iter=57150/80000, loss=0.8757, lr=0.003238, batch_cost=1.3662, reader_cost=0.0001 | ETA 08:40:17 2021-02-23 16:36:48 [INFO] [TRAIN] epoch=154, iter=57160/80000, loss=0.8585, lr=0.003236, batch_cost=1.3907, reader_cost=0.0001 | ETA 08:49:24 2021-02-23 16:37:01 [INFO] [TRAIN] epoch=154, iter=57170/80000, loss=0.8454, lr=0.003235, batch_cost=1.3646, reader_cost=0.0001 | ETA 08:39:13 2021-02-23 16:37:15 [INFO] [TRAIN] epoch=154, iter=57180/80000, loss=0.8888, lr=0.003234, batch_cost=1.3385, reader_cost=0.0001 | ETA 08:29:04 2021-02-23 16:37:28 [INFO] [TRAIN] epoch=154, iter=57190/80000, loss=0.8613, lr=0.003233, batch_cost=1.3600, reader_cost=0.0001 | ETA 08:37:02 2021-02-23 16:37:42 [INFO] [TRAIN] epoch=154, iter=57200/80000, loss=0.8368, lr=0.003231, batch_cost=1.3418, reader_cost=0.0001 | ETA 08:29:52 2021-02-23 16:37:55 [INFO] [TRAIN] epoch=154, iter=57210/80000, loss=0.8288, lr=0.003230, batch_cost=1.3325, reader_cost=0.0001 | ETA 08:26:07 2021-02-23 16:38:08 [INFO] [TRAIN] epoch=154, iter=57220/80000, loss=0.8555, lr=0.003229, batch_cost=1.3272, reader_cost=0.0001 | ETA 08:23:52 2021-02-23 16:38:22 [INFO] [TRAIN] epoch=154, iter=57230/80000, loss=0.8249, lr=0.003227, batch_cost=1.3593, reader_cost=0.0001 | ETA 08:35:51 2021-02-23 16:38:36 [INFO] [TRAIN] epoch=154, iter=57240/80000, loss=0.8801, lr=0.003226, batch_cost=1.3908, reader_cost=0.0001 | ETA 08:47:35 2021-02-23 16:38:49 [INFO] [TRAIN] epoch=154, iter=57250/80000, loss=0.8568, lr=0.003225, batch_cost=1.3597, reader_cost=0.0001 | ETA 08:35:33 2021-02-23 16:39:03 [INFO] [TRAIN] epoch=154, iter=57260/80000, loss=0.8477, lr=0.003224, batch_cost=1.3692, reader_cost=0.0001 | ETA 08:38:55 2021-02-23 16:39:17 [INFO] [TRAIN] epoch=154, iter=57270/80000, loss=0.7757, lr=0.003222, batch_cost=1.3473, reader_cost=0.0001 | ETA 08:30:24 2021-02-23 16:39:30 [INFO] [TRAIN] epoch=154, iter=57280/80000, loss=0.9281, lr=0.003221, batch_cost=1.3829, reader_cost=0.0001 | ETA 08:43:40 2021-02-23 16:39:45 [INFO] [TRAIN] epoch=155, iter=57290/80000, loss=0.8192, lr=0.003220, batch_cost=1.4376, reader_cost=0.0762 | ETA 09:04:06 2021-02-23 16:39:59 [INFO] [TRAIN] epoch=155, iter=57300/80000, loss=0.8650, lr=0.003219, batch_cost=1.3668, reader_cost=0.0001 | ETA 08:37:05 2021-02-23 16:40:12 [INFO] [TRAIN] epoch=155, iter=57310/80000, loss=0.8893, lr=0.003217, batch_cost=1.3604, reader_cost=0.0001 | ETA 08:34:27 2021-02-23 16:40:26 [INFO] [TRAIN] epoch=155, iter=57320/80000, loss=0.9553, lr=0.003216, batch_cost=1.3672, reader_cost=0.0001 | ETA 08:36:48 2021-02-23 16:40:39 [INFO] [TRAIN] epoch=155, iter=57330/80000, loss=0.8014, lr=0.003215, batch_cost=1.3642, reader_cost=0.0001 | ETA 08:35:25 2021-02-23 16:40:53 [INFO] [TRAIN] epoch=155, iter=57340/80000, loss=0.8143, lr=0.003213, batch_cost=1.3489, reader_cost=0.0001 | ETA 08:29:26 2021-02-23 16:41:07 [INFO] [TRAIN] epoch=155, iter=57350/80000, loss=0.9208, lr=0.003212, batch_cost=1.3781, reader_cost=0.0001 | ETA 08:40:15 2021-02-23 16:41:20 [INFO] [TRAIN] epoch=155, iter=57360/80000, loss=0.8122, lr=0.003211, batch_cost=1.3333, reader_cost=0.0001 | ETA 08:23:06 2021-02-23 16:41:34 [INFO] [TRAIN] epoch=155, iter=57370/80000, loss=0.8287, lr=0.003210, batch_cost=1.4109, reader_cost=0.0001 | ETA 08:52:08 2021-02-23 16:41:48 [INFO] [TRAIN] epoch=155, iter=57380/80000, loss=0.8355, lr=0.003208, batch_cost=1.4137, reader_cost=0.0001 | ETA 08:52:57 2021-02-23 16:42:02 [INFO] [TRAIN] epoch=155, iter=57390/80000, loss=0.8680, lr=0.003207, batch_cost=1.3482, reader_cost=0.0001 | ETA 08:28:03 2021-02-23 16:42:16 [INFO] [TRAIN] epoch=155, iter=57400/80000, loss=0.8448, lr=0.003206, batch_cost=1.3964, reader_cost=0.0001 | ETA 08:45:59 2021-02-23 16:42:29 [INFO] [TRAIN] epoch=155, iter=57410/80000, loss=0.8206, lr=0.003205, batch_cost=1.3678, reader_cost=0.0001 | ETA 08:34:57 2021-02-23 16:42:43 [INFO] [TRAIN] epoch=155, iter=57420/80000, loss=0.7813, lr=0.003203, batch_cost=1.3076, reader_cost=0.0001 | ETA 08:12:05 2021-02-23 16:42:56 [INFO] [TRAIN] epoch=155, iter=57430/80000, loss=0.8695, lr=0.003202, batch_cost=1.3989, reader_cost=0.0001 | ETA 08:46:12 2021-02-23 16:43:11 [INFO] [TRAIN] epoch=155, iter=57440/80000, loss=0.8389, lr=0.003201, batch_cost=1.4011, reader_cost=0.0001 | ETA 08:46:49 2021-02-23 16:43:24 [INFO] [TRAIN] epoch=155, iter=57450/80000, loss=0.8799, lr=0.003199, batch_cost=1.3929, reader_cost=0.0001 | ETA 08:43:30 2021-02-23 16:43:38 [INFO] [TRAIN] epoch=155, iter=57460/80000, loss=0.8393, lr=0.003198, batch_cost=1.3861, reader_cost=0.0001 | ETA 08:40:41 2021-02-23 16:43:52 [INFO] [TRAIN] epoch=155, iter=57470/80000, loss=0.8329, lr=0.003197, batch_cost=1.3351, reader_cost=0.0001 | ETA 08:21:19 2021-02-23 16:44:06 [INFO] [TRAIN] epoch=155, iter=57480/80000, loss=0.8531, lr=0.003196, batch_cost=1.3954, reader_cost=0.0001 | ETA 08:43:44 2021-02-23 16:44:19 [INFO] [TRAIN] epoch=155, iter=57490/80000, loss=0.8260, lr=0.003194, batch_cost=1.3807, reader_cost=0.0001 | ETA 08:37:59 2021-02-23 16:44:33 [INFO] [TRAIN] epoch=155, iter=57500/80000, loss=0.8434, lr=0.003193, batch_cost=1.3506, reader_cost=0.0001 | ETA 08:26:28 2021-02-23 16:44:47 [INFO] [TRAIN] epoch=155, iter=57510/80000, loss=0.8495, lr=0.003192, batch_cost=1.3805, reader_cost=0.0001 | ETA 08:37:28 2021-02-23 16:45:01 [INFO] [TRAIN] epoch=155, iter=57520/80000, loss=0.8294, lr=0.003190, batch_cost=1.3902, reader_cost=0.0001 | ETA 08:40:51 2021-02-23 16:45:14 [INFO] [TRAIN] epoch=155, iter=57530/80000, loss=0.8501, lr=0.003189, batch_cost=1.3369, reader_cost=0.0006 | ETA 08:20:40 2021-02-23 16:45:28 [INFO] [TRAIN] epoch=155, iter=57540/80000, loss=0.8190, lr=0.003188, batch_cost=1.3805, reader_cost=0.0001 | ETA 08:36:46 2021-02-23 16:45:41 [INFO] [TRAIN] epoch=155, iter=57550/80000, loss=0.7838, lr=0.003187, batch_cost=1.3685, reader_cost=0.0001 | ETA 08:32:03 2021-02-23 16:45:56 [INFO] [TRAIN] epoch=155, iter=57560/80000, loss=0.8595, lr=0.003185, batch_cost=1.4082, reader_cost=0.0001 | ETA 08:46:40 2021-02-23 16:46:09 [INFO] [TRAIN] epoch=155, iter=57570/80000, loss=0.8299, lr=0.003184, batch_cost=1.3719, reader_cost=0.0001 | ETA 08:32:52 2021-02-23 16:46:23 [INFO] [TRAIN] epoch=155, iter=57580/80000, loss=0.8358, lr=0.003183, batch_cost=1.3663, reader_cost=0.0001 | ETA 08:30:31 2021-02-23 16:46:37 [INFO] [TRAIN] epoch=155, iter=57590/80000, loss=0.8617, lr=0.003182, batch_cost=1.3764, reader_cost=0.0001 | ETA 08:34:06 2021-02-23 16:46:50 [INFO] [TRAIN] epoch=155, iter=57600/80000, loss=0.8880, lr=0.003180, batch_cost=1.3465, reader_cost=0.0001 | ETA 08:22:41 2021-02-23 16:47:04 [INFO] [TRAIN] epoch=155, iter=57610/80000, loss=0.8525, lr=0.003179, batch_cost=1.3484, reader_cost=0.0001 | ETA 08:23:09 2021-02-23 16:47:17 [INFO] [TRAIN] epoch=155, iter=57620/80000, loss=0.8941, lr=0.003178, batch_cost=1.3595, reader_cost=0.0001 | ETA 08:27:05 2021-02-23 16:47:31 [INFO] [TRAIN] epoch=155, iter=57630/80000, loss=0.8935, lr=0.003176, batch_cost=1.4024, reader_cost=0.0001 | ETA 08:42:51 2021-02-23 16:47:45 [INFO] [TRAIN] epoch=155, iter=57640/80000, loss=0.8047, lr=0.003175, batch_cost=1.3800, reader_cost=0.0001 | ETA 08:34:16 2021-02-23 16:47:59 [INFO] [TRAIN] epoch=155, iter=57650/80000, loss=0.8391, lr=0.003174, batch_cost=1.3703, reader_cost=0.0001 | ETA 08:30:25 2021-02-23 16:48:12 [INFO] [TRAIN] epoch=155, iter=57660/80000, loss=0.8441, lr=0.003173, batch_cost=1.3327, reader_cost=0.0001 | ETA 08:16:11 2021-02-23 16:48:27 [INFO] [TRAIN] epoch=156, iter=57670/80000, loss=0.9466, lr=0.003171, batch_cost=1.4620, reader_cost=0.0822 | ETA 09:04:07 2021-02-23 16:48:41 [INFO] [TRAIN] epoch=156, iter=57680/80000, loss=0.8780, lr=0.003170, batch_cost=1.3882, reader_cost=0.0001 | ETA 08:36:25 2021-02-23 16:48:54 [INFO] [TRAIN] epoch=156, iter=57690/80000, loss=0.8497, lr=0.003169, batch_cost=1.3697, reader_cost=0.0001 | ETA 08:29:17 2021-02-23 16:49:08 [INFO] [TRAIN] epoch=156, iter=57700/80000, loss=0.8782, lr=0.003167, batch_cost=1.3651, reader_cost=0.0001 | ETA 08:27:21 2021-02-23 16:49:22 [INFO] [TRAIN] epoch=156, iter=57710/80000, loss=0.8700, lr=0.003166, batch_cost=1.3808, reader_cost=0.0001 | ETA 08:32:57 2021-02-23 16:49:36 [INFO] [TRAIN] epoch=156, iter=57720/80000, loss=0.8571, lr=0.003165, batch_cost=1.3933, reader_cost=0.0001 | ETA 08:37:22 2021-02-23 16:49:49 [INFO] [TRAIN] epoch=156, iter=57730/80000, loss=0.9676, lr=0.003164, batch_cost=1.3519, reader_cost=0.0001 | ETA 08:21:46 2021-02-23 16:50:03 [INFO] [TRAIN] epoch=156, iter=57740/80000, loss=0.7973, lr=0.003162, batch_cost=1.3754, reader_cost=0.0001 | ETA 08:30:17 2021-02-23 16:50:17 [INFO] [TRAIN] epoch=156, iter=57750/80000, loss=0.8162, lr=0.003161, batch_cost=1.3706, reader_cost=0.0001 | ETA 08:28:15 2021-02-23 16:50:30 [INFO] [TRAIN] epoch=156, iter=57760/80000, loss=0.8699, lr=0.003160, batch_cost=1.3691, reader_cost=0.0001 | ETA 08:27:28 2021-02-23 16:50:44 [INFO] [TRAIN] epoch=156, iter=57770/80000, loss=0.9034, lr=0.003159, batch_cost=1.3874, reader_cost=0.0001 | ETA 08:34:02 2021-02-23 16:50:58 [INFO] [TRAIN] epoch=156, iter=57780/80000, loss=0.8749, lr=0.003157, batch_cost=1.3275, reader_cost=0.0001 | ETA 08:11:35 2021-02-23 16:51:11 [INFO] [TRAIN] epoch=156, iter=57790/80000, loss=0.8198, lr=0.003156, batch_cost=1.3793, reader_cost=0.0001 | ETA 08:30:34 2021-02-23 16:51:25 [INFO] [TRAIN] epoch=156, iter=57800/80000, loss=0.7935, lr=0.003155, batch_cost=1.3751, reader_cost=0.0001 | ETA 08:28:48 2021-02-23 16:51:39 [INFO] [TRAIN] epoch=156, iter=57810/80000, loss=0.8106, lr=0.003153, batch_cost=1.3772, reader_cost=0.0001 | ETA 08:29:20 2021-02-23 16:51:53 [INFO] [TRAIN] epoch=156, iter=57820/80000, loss=0.8764, lr=0.003152, batch_cost=1.3983, reader_cost=0.0001 | ETA 08:36:54 2021-02-23 16:52:07 [INFO] [TRAIN] epoch=156, iter=57830/80000, loss=0.8405, lr=0.003151, batch_cost=1.3746, reader_cost=0.0001 | ETA 08:27:55 2021-02-23 16:52:20 [INFO] [TRAIN] epoch=156, iter=57840/80000, loss=0.9023, lr=0.003150, batch_cost=1.3480, reader_cost=0.0001 | ETA 08:17:52 2021-02-23 16:52:34 [INFO] [TRAIN] epoch=156, iter=57850/80000, loss=0.8209, lr=0.003148, batch_cost=1.3677, reader_cost=0.0001 | ETA 08:24:54 2021-02-23 16:52:47 [INFO] [TRAIN] epoch=156, iter=57860/80000, loss=0.9263, lr=0.003147, batch_cost=1.3432, reader_cost=0.0001 | ETA 08:15:39 2021-02-23 16:53:01 [INFO] [TRAIN] epoch=156, iter=57870/80000, loss=0.8749, lr=0.003146, batch_cost=1.3687, reader_cost=0.0001 | ETA 08:24:50 2021-02-23 16:53:14 [INFO] [TRAIN] epoch=156, iter=57880/80000, loss=0.8239, lr=0.003144, batch_cost=1.3631, reader_cost=0.0001 | ETA 08:22:30 2021-02-23 16:53:28 [INFO] [TRAIN] epoch=156, iter=57890/80000, loss=0.8935, lr=0.003143, batch_cost=1.3365, reader_cost=0.0001 | ETA 08:12:30 2021-02-23 16:53:42 [INFO] [TRAIN] epoch=156, iter=57900/80000, loss=0.7930, lr=0.003142, batch_cost=1.3754, reader_cost=0.0001 | ETA 08:26:35 2021-02-23 16:53:55 [INFO] [TRAIN] epoch=156, iter=57910/80000, loss=0.8815, lr=0.003141, batch_cost=1.3734, reader_cost=0.0001 | ETA 08:25:37 2021-02-23 16:54:09 [INFO] [TRAIN] epoch=156, iter=57920/80000, loss=0.7867, lr=0.003139, batch_cost=1.3536, reader_cost=0.0001 | ETA 08:18:06 2021-02-23 16:54:22 [INFO] [TRAIN] epoch=156, iter=57930/80000, loss=0.7490, lr=0.003138, batch_cost=1.3576, reader_cost=0.0001 | ETA 08:19:22 2021-02-23 16:54:36 [INFO] [TRAIN] epoch=156, iter=57940/80000, loss=0.7931, lr=0.003137, batch_cost=1.3665, reader_cost=0.0001 | ETA 08:22:25 2021-02-23 16:54:50 [INFO] [TRAIN] epoch=156, iter=57950/80000, loss=0.8862, lr=0.003135, batch_cost=1.3649, reader_cost=0.0001 | ETA 08:21:35 2021-02-23 16:55:03 [INFO] [TRAIN] epoch=156, iter=57960/80000, loss=0.8169, lr=0.003134, batch_cost=1.3555, reader_cost=0.0001 | ETA 08:17:55 2021-02-23 16:55:17 [INFO] [TRAIN] epoch=156, iter=57970/80000, loss=0.8525, lr=0.003133, batch_cost=1.3399, reader_cost=0.0001 | ETA 08:11:57 2021-02-23 16:55:30 [INFO] [TRAIN] epoch=156, iter=57980/80000, loss=0.8827, lr=0.003132, batch_cost=1.3482, reader_cost=0.0001 | ETA 08:14:46 2021-02-23 16:55:44 [INFO] [TRAIN] epoch=156, iter=57990/80000, loss=0.8325, lr=0.003130, batch_cost=1.3708, reader_cost=0.0001 | ETA 08:22:51 2021-02-23 16:55:57 [INFO] [TRAIN] epoch=156, iter=58000/80000, loss=0.8472, lr=0.003129, batch_cost=1.3402, reader_cost=0.0001 | ETA 08:11:24 2021-02-23 16:55:57 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:14 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:00 - batch_cost: 0.1945 - reader cost: 0.0678  3/125 [..............................] - ETA: 57s - batch_cost: 0.2686 - reader cost: 0.1010  4/125 [..............................] - ETA: 55s - batch_cost: 0.3079 - reader cost: 0.1195 5/125 [>.............................] - ETA: 54s - batch_cost: 0.3307 - reader cost: 0.1260 6/125 [>.............................] - ETA: 52s - batch_cost: 0.3443 - reader cost: 0.1319 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3563 - reader cost: 0.1376 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3665 - reader cost: 0.1438 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3778 - reader cost: 0.1502 10/125 [=>............................] - ETA: 51s - batch_cost: 0.3845 - reader cost: 0.1540 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3840 - reader cost: 0.1517 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3885 - reader cost: 0.1542 13/125 [==>...........................] - ETA: 49s - batch_cost: 0.3922 - reader cost: 0.1557 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3936 - reader cost: 0.1557 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3938 - reader cost: 0.1552 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3970 - reader cost: 0.1572 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3993 - reader cost: 0.1588 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.3986 - reader cost: 0.1576 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.4000 - reader cost: 0.1586 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4017 - reader cost: 0.1596 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4028 - reader cost: 0.1603 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4009 - reader cost: 0.1580 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.3992 - reader cost: 0.1558 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.4005 - reader cost: 0.1568 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4005 - reader cost: 0.1563 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4032 - reader cost: 0.1587 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4049 - reader cost: 0.1600 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4056 - reader cost: 0.1604 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4063 - reader cost: 0.1609 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4072 - reader cost: 0.1613 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4072 - reader cost: 0.1612 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4086 - reader cost: 0.1621 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4084 - reader cost: 0.1619 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4077 - reader cost: 0.1608 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4066 - reader cost: 0.1595 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4068 - reader cost: 0.1598 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4072 - reader cost: 0.1599 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4061 - reader cost: 0.1588 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4068 - reader cost: 0.1594 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4072 - reader cost: 0.1598 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4076 - reader cost: 0.1601 42/125 [=========>....................] - ETA: 34s - batch_cost: 0.4064 - reader cost: 0.1588 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4074 - reader cost: 0.1595 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4076 - reader cost: 0.1596 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4081 - reader cost: 0.1600 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4084 - reader cost: 0.1603 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4086 - reader cost: 0.1606 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4079 - reader cost: 0.1597 49/125 [==========>...................] - ETA: 31s - batch_cost: 0.4082 - reader cost: 0.1600 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4087 - reader cost: 0.1602 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4082 - reader cost: 0.1597 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4086 - reader cost: 0.1600 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4091 - reader cost: 0.1605 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4083 - reader cost: 0.1596 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4080 - reader cost: 0.1592 56/125 [============>.................] - ETA: 28s - batch_cost: 0.4075 - reader cost: 0.1587 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4078 - reader cost: 0.1590 58/125 [============>.................] - ETA: 27s - batch_cost: 0.4073 - reader cost: 0.1582 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4078 - reader cost: 0.1587 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4083 - reader cost: 0.1591 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4077 - reader cost: 0.1586 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4079 - reader cost: 0.1588 63/125 [==============>...............] - ETA: 25s - batch_cost: 0.4081 - reader cost: 0.1590 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4087 - reader cost: 0.1593 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4091 - reader cost: 0.1597 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4094 - reader cost: 0.1599 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4097 - reader cost: 0.1602 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4099 - reader cost: 0.1604 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4106 - reader cost: 0.1609 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4098 - reader cost: 0.1601 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4096 - reader cost: 0.1597 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4093 - reader cost: 0.1593 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4097 - reader cost: 0.1598 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4101 - reader cost: 0.1601 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4106 - reader cost: 0.1605 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4099 - reader cost: 0.1598 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4100 - reader cost: 0.1599 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4102 - reader cost: 0.1600 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4099 - reader cost: 0.1597 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4096 - reader cost: 0.1594 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4092 - reader cost: 0.1589 82/125 [==================>...........] - ETA: 17s - batch_cost: 0.4096 - reader cost: 0.1594 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4094 - reader cost: 0.1589 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4091 - reader cost: 0.1587 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4091 - reader cost: 0.1587 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4089 - reader cost: 0.1584 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4091 - reader cost: 0.1586 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4093 - reader cost: 0.1588 89/125 [====================>.........] - ETA: 14s - batch_cost: 0.4091 - reader cost: 0.1584 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4094 - reader cost: 0.1587 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4093 - reader cost: 0.1582 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4094 - reader cost: 0.1583 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4098 - reader cost: 0.1586 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4099 - reader cost: 0.1587 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4101 - reader cost: 0.1588 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4099 - reader cost: 0.1585 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4099 - reader cost: 0.1586 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4098 - reader cost: 0.1582 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4098 - reader cost: 0.1582 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4103 - reader cost: 0.1584 101/125 [=======================>......] - ETA: 9s - batch_cost: 0.4104 - reader cost: 0.1586  102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4102 - reader cost: 0.1583 103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4105 - reader cost: 0.1585 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4107 - reader cost: 0.1587 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4108 - reader cost: 0.1588 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4104 - reader cost: 0.1584 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4105 - reader cost: 0.1585 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4105 - reader cost: 0.1585 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4105 - reader cost: 0.1581 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4100 - reader cost: 0.1575 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4102 - reader cost: 0.1577 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4102 - reader cost: 0.1575 113/125 [==========================>...] - ETA: 4s - batch_cost: 0.4098 - reader cost: 0.1572 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4097 - reader cost: 0.1570 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4099 - reader cost: 0.1568 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4102 - reader cost: 0.1571 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4103 - reader cost: 0.1573 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4105 - reader cost: 0.1575 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4103 - reader cost: 0.1574 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4105 - reader cost: 0.1572 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4106 - reader cost: 0.1573 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4107 - reader cost: 0.1570 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4108 - reader cost: 0.1566 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4110 - reader cost: 0.1568 125/125 [==============================] - 52s 416ms/step - batch_cost: 0.4113 - reader cost: 0.1571 2021-02-23 16:56:50 [INFO] [EVAL] #Images=500 mIoU=0.7632 Acc=0.9591 Kappa=0.9469 2021-02-23 16:56:50 [INFO] [EVAL] Class IoU: [0.9783 0.8313 0.925 0.3921 0.5987 0.673 0.7413 0.8202 0.9248 0.6358 0.9461 0.8367 0.6696 0.9487 0.6203 0.8085 0.8032 0.5608 0.7855] 2021-02-23 16:56:50 [INFO] [EVAL] Class Acc: [0.985 0.9264 0.957 0.8256 0.7189 0.8463 0.8872 0.9227 0.957 0.8168 0.962 0.8875 0.7848 0.9699 0.9496 0.8837 0.8916 0.8034 0.8741] 2021-02-23 16:56:54 [INFO] [EVAL] The model with the best validation mIoU (0.7816) was saved at iter 44000. 2021-02-23 16:57:07 [INFO] [TRAIN] epoch=156, iter=58010/80000, loss=0.8875, lr=0.003128, batch_cost=1.3758, reader_cost=0.0001 | ETA 08:24:14 2021-02-23 16:57:21 [INFO] [TRAIN] epoch=156, iter=58020/80000, loss=0.7689, lr=0.003127, batch_cost=1.3689, reader_cost=0.0001 | ETA 08:21:27 2021-02-23 16:57:34 [INFO] [TRAIN] epoch=156, iter=58030/80000, loss=0.8383, lr=0.003125, batch_cost=1.3337, reader_cost=0.0001 | ETA 08:08:21 2021-02-23 16:57:49 [INFO] [TRAIN] epoch=157, iter=58040/80000, loss=0.8347, lr=0.003124, batch_cost=1.4432, reader_cost=0.0663 | ETA 08:48:12 2021-02-23 16:58:02 [INFO] [TRAIN] epoch=157, iter=58050/80000, loss=0.8117, lr=0.003123, batch_cost=1.3695, reader_cost=0.0001 | ETA 08:21:01 2021-02-23 16:58:16 [INFO] [TRAIN] epoch=157, iter=58060/80000, loss=0.8352, lr=0.003121, batch_cost=1.3808, reader_cost=0.0001 | ETA 08:24:53 2021-02-23 16:58:30 [INFO] [TRAIN] epoch=157, iter=58070/80000, loss=0.8832, lr=0.003120, batch_cost=1.3381, reader_cost=0.0001 | ETA 08:09:04 2021-02-23 16:58:43 [INFO] [TRAIN] epoch=157, iter=58080/80000, loss=0.8275, lr=0.003119, batch_cost=1.3821, reader_cost=0.0001 | ETA 08:24:55 2021-02-23 16:58:57 [INFO] [TRAIN] epoch=157, iter=58090/80000, loss=0.8668, lr=0.003118, batch_cost=1.3695, reader_cost=0.0001 | ETA 08:20:06 2021-02-23 16:59:11 [INFO] [TRAIN] epoch=157, iter=58100/80000, loss=0.8271, lr=0.003116, batch_cost=1.3728, reader_cost=0.0001 | ETA 08:21:03 2021-02-23 16:59:25 [INFO] [TRAIN] epoch=157, iter=58110/80000, loss=0.8291, lr=0.003115, batch_cost=1.3621, reader_cost=0.0001 | ETA 08:16:55 2021-02-23 16:59:38 [INFO] [TRAIN] epoch=157, iter=58120/80000, loss=0.8053, lr=0.003114, batch_cost=1.3794, reader_cost=0.0001 | ETA 08:23:01 2021-02-23 16:59:52 [INFO] [TRAIN] epoch=157, iter=58130/80000, loss=0.8663, lr=0.003112, batch_cost=1.3492, reader_cost=0.0001 | ETA 08:11:46 2021-02-23 17:00:05 [INFO] [TRAIN] epoch=157, iter=58140/80000, loss=0.8156, lr=0.003111, batch_cost=1.3604, reader_cost=0.0001 | ETA 08:15:38 2021-02-23 17:00:19 [INFO] [TRAIN] epoch=157, iter=58150/80000, loss=0.8331, lr=0.003110, batch_cost=1.3462, reader_cost=0.0001 | ETA 08:10:13 2021-02-23 17:00:33 [INFO] [TRAIN] epoch=157, iter=58160/80000, loss=0.8726, lr=0.003109, batch_cost=1.3932, reader_cost=0.0001 | ETA 08:27:06 2021-02-23 17:00:46 [INFO] [TRAIN] epoch=157, iter=58170/80000, loss=0.8503, lr=0.003107, batch_cost=1.3414, reader_cost=0.0001 | ETA 08:08:02 2021-02-23 17:01:00 [INFO] [TRAIN] epoch=157, iter=58180/80000, loss=0.8857, lr=0.003106, batch_cost=1.3718, reader_cost=0.0001 | ETA 08:18:52 2021-02-23 17:01:13 [INFO] [TRAIN] epoch=157, iter=58190/80000, loss=0.8648, lr=0.003105, batch_cost=1.3504, reader_cost=0.0001 | ETA 08:10:52 2021-02-23 17:01:27 [INFO] [TRAIN] epoch=157, iter=58200/80000, loss=0.8344, lr=0.003103, batch_cost=1.3483, reader_cost=0.0001 | ETA 08:09:53 2021-02-23 17:01:41 [INFO] [TRAIN] epoch=157, iter=58210/80000, loss=0.8943, lr=0.003102, batch_cost=1.3941, reader_cost=0.0001 | ETA 08:26:16 2021-02-23 17:01:55 [INFO] [TRAIN] epoch=157, iter=58220/80000, loss=0.7985, lr=0.003101, batch_cost=1.3727, reader_cost=0.0001 | ETA 08:18:16 2021-02-23 17:02:08 [INFO] [TRAIN] epoch=157, iter=58230/80000, loss=0.8248, lr=0.003100, batch_cost=1.3543, reader_cost=0.0001 | ETA 08:11:22 2021-02-23 17:02:21 [INFO] [TRAIN] epoch=157, iter=58240/80000, loss=0.9261, lr=0.003098, batch_cost=1.3323, reader_cost=0.0001 | ETA 08:03:11 2021-02-23 17:02:35 [INFO] [TRAIN] epoch=157, iter=58250/80000, loss=0.7968, lr=0.003097, batch_cost=1.3541, reader_cost=0.0001 | ETA 08:10:51 2021-02-23 17:02:48 [INFO] [TRAIN] epoch=157, iter=58260/80000, loss=0.8200, lr=0.003096, batch_cost=1.3409, reader_cost=0.0001 | ETA 08:05:50 2021-02-23 17:03:02 [INFO] [TRAIN] epoch=157, iter=58270/80000, loss=0.8103, lr=0.003095, batch_cost=1.3579, reader_cost=0.0001 | ETA 08:11:46 2021-02-23 17:03:16 [INFO] [TRAIN] epoch=157, iter=58280/80000, loss=0.8471, lr=0.003093, batch_cost=1.3886, reader_cost=0.0001 | ETA 08:22:39 2021-02-23 17:03:30 [INFO] [TRAIN] epoch=157, iter=58290/80000, loss=0.8497, lr=0.003092, batch_cost=1.3994, reader_cost=0.0001 | ETA 08:26:21 2021-02-23 17:03:44 [INFO] [TRAIN] epoch=157, iter=58300/80000, loss=0.8155, lr=0.003091, batch_cost=1.3747, reader_cost=0.0001 | ETA 08:17:12 2021-02-23 17:03:57 [INFO] [TRAIN] epoch=157, iter=58310/80000, loss=0.8438, lr=0.003089, batch_cost=1.3586, reader_cost=0.0001 | ETA 08:11:08 2021-02-23 17:04:11 [INFO] [TRAIN] epoch=157, iter=58320/80000, loss=0.8697, lr=0.003088, batch_cost=1.3546, reader_cost=0.0001 | ETA 08:09:28 2021-02-23 17:04:25 [INFO] [TRAIN] epoch=157, iter=58330/80000, loss=0.8269, lr=0.003087, batch_cost=1.3736, reader_cost=0.0001 | ETA 08:16:05 2021-02-23 17:04:39 [INFO] [TRAIN] epoch=157, iter=58340/80000, loss=0.7843, lr=0.003086, batch_cost=1.4025, reader_cost=0.0001 | ETA 08:26:18 2021-02-23 17:04:52 [INFO] [TRAIN] epoch=157, iter=58350/80000, loss=0.8392, lr=0.003084, batch_cost=1.3945, reader_cost=0.0001 | ETA 08:23:11 2021-02-23 17:05:06 [INFO] [TRAIN] epoch=157, iter=58360/80000, loss=0.7714, lr=0.003083, batch_cost=1.3490, reader_cost=0.0001 | ETA 08:06:31 2021-02-23 17:05:20 [INFO] [TRAIN] epoch=157, iter=58370/80000, loss=0.7986, lr=0.003082, batch_cost=1.3749, reader_cost=0.0001 | ETA 08:15:39 2021-02-23 17:05:33 [INFO] [TRAIN] epoch=157, iter=58380/80000, loss=0.8662, lr=0.003080, batch_cost=1.3417, reader_cost=0.0001 | ETA 08:03:28 2021-02-23 17:05:47 [INFO] [TRAIN] epoch=157, iter=58390/80000, loss=0.8478, lr=0.003079, batch_cost=1.3626, reader_cost=0.0001 | ETA 08:10:46 2021-02-23 17:06:01 [INFO] [TRAIN] epoch=157, iter=58400/80000, loss=0.8289, lr=0.003078, batch_cost=1.3868, reader_cost=0.0001 | ETA 08:19:15 2021-02-23 17:06:15 [INFO] [TRAIN] epoch=158, iter=58410/80000, loss=0.8168, lr=0.003077, batch_cost=1.4305, reader_cost=0.0628 | ETA 08:34:43 2021-02-23 17:06:28 [INFO] [TRAIN] epoch=158, iter=58420/80000, loss=0.8762, lr=0.003075, batch_cost=1.3452, reader_cost=0.0001 | ETA 08:03:49 2021-02-23 17:06:42 [INFO] [TRAIN] epoch=158, iter=58430/80000, loss=0.8205, lr=0.003074, batch_cost=1.4000, reader_cost=0.0001 | ETA 08:23:18 2021-02-23 17:06:56 [INFO] [TRAIN] epoch=158, iter=58440/80000, loss=0.7939, lr=0.003073, batch_cost=1.3532, reader_cost=0.0001 | ETA 08:06:15 2021-02-23 17:07:09 [INFO] [TRAIN] epoch=158, iter=58450/80000, loss=0.8009, lr=0.003071, batch_cost=1.3332, reader_cost=0.0001 | ETA 07:58:50 2021-02-23 17:07:23 [INFO] [TRAIN] epoch=158, iter=58460/80000, loss=0.8517, lr=0.003070, batch_cost=1.3545, reader_cost=0.0001 | ETA 08:06:16 2021-02-23 17:07:37 [INFO] [TRAIN] epoch=158, iter=58470/80000, loss=0.9039, lr=0.003069, batch_cost=1.3693, reader_cost=0.0001 | ETA 08:11:21 2021-02-23 17:07:50 [INFO] [TRAIN] epoch=158, iter=58480/80000, loss=0.9062, lr=0.003068, batch_cost=1.3839, reader_cost=0.0001 | ETA 08:16:20 2021-02-23 17:08:04 [INFO] [TRAIN] epoch=158, iter=58490/80000, loss=0.8472, lr=0.003066, batch_cost=1.3318, reader_cost=0.0001 | ETA 07:57:27 2021-02-23 17:08:17 [INFO] [TRAIN] epoch=158, iter=58500/80000, loss=0.8380, lr=0.003065, batch_cost=1.3531, reader_cost=0.0001 | ETA 08:04:50 2021-02-23 17:08:31 [INFO] [TRAIN] epoch=158, iter=58510/80000, loss=0.8437, lr=0.003064, batch_cost=1.3399, reader_cost=0.0001 | ETA 07:59:55 2021-02-23 17:08:44 [INFO] [TRAIN] epoch=158, iter=58520/80000, loss=0.8311, lr=0.003062, batch_cost=1.3906, reader_cost=0.0001 | ETA 08:17:50 2021-02-23 17:08:58 [INFO] [TRAIN] epoch=158, iter=58530/80000, loss=0.8734, lr=0.003061, batch_cost=1.3882, reader_cost=0.0001 | ETA 08:16:45 2021-02-23 17:09:12 [INFO] [TRAIN] epoch=158, iter=58540/80000, loss=0.7644, lr=0.003060, batch_cost=1.3820, reader_cost=0.0001 | ETA 08:14:17 2021-02-23 17:09:26 [INFO] [TRAIN] epoch=158, iter=58550/80000, loss=0.8313, lr=0.003059, batch_cost=1.3456, reader_cost=0.0001 | ETA 08:01:02 2021-02-23 17:09:40 [INFO] [TRAIN] epoch=158, iter=58560/80000, loss=0.8637, lr=0.003057, batch_cost=1.3889, reader_cost=0.0001 | ETA 08:16:18 2021-02-23 17:09:53 [INFO] [TRAIN] epoch=158, iter=58570/80000, loss=0.8173, lr=0.003056, batch_cost=1.3529, reader_cost=0.0001 | ETA 08:03:12 2021-02-23 17:10:07 [INFO] [TRAIN] epoch=158, iter=58580/80000, loss=0.8447, lr=0.003055, batch_cost=1.3669, reader_cost=0.0001 | ETA 08:08:00 2021-02-23 17:10:20 [INFO] [TRAIN] epoch=158, iter=58590/80000, loss=0.8160, lr=0.003053, batch_cost=1.3433, reader_cost=0.0001 | ETA 07:59:20 2021-02-23 17:10:34 [INFO] [TRAIN] epoch=158, iter=58600/80000, loss=0.8383, lr=0.003052, batch_cost=1.3784, reader_cost=0.0001 | ETA 08:11:38 2021-02-23 17:10:48 [INFO] [TRAIN] epoch=158, iter=58610/80000, loss=0.8514, lr=0.003051, batch_cost=1.3785, reader_cost=0.0001 | ETA 08:11:25 2021-02-23 17:11:02 [INFO] [TRAIN] epoch=158, iter=58620/80000, loss=0.8420, lr=0.003050, batch_cost=1.3958, reader_cost=0.0001 | ETA 08:17:21 2021-02-23 17:11:16 [INFO] [TRAIN] epoch=158, iter=58630/80000, loss=0.8755, lr=0.003048, batch_cost=1.3837, reader_cost=0.0001 | ETA 08:12:50 2021-02-23 17:11:29 [INFO] [TRAIN] epoch=158, iter=58640/80000, loss=0.9299, lr=0.003047, batch_cost=1.3416, reader_cost=0.0001 | ETA 07:57:37 2021-02-23 17:11:43 [INFO] [TRAIN] epoch=158, iter=58650/80000, loss=0.8246, lr=0.003046, batch_cost=1.3594, reader_cost=0.0001 | ETA 08:03:42 2021-02-23 17:11:56 [INFO] [TRAIN] epoch=158, iter=58660/80000, loss=0.8095, lr=0.003044, batch_cost=1.3226, reader_cost=0.0001 | ETA 07:50:23 2021-02-23 17:12:09 [INFO] [TRAIN] epoch=158, iter=58670/80000, loss=0.8526, lr=0.003043, batch_cost=1.3686, reader_cost=0.0001 | ETA 08:06:31 2021-02-23 17:12:24 [INFO] [TRAIN] epoch=158, iter=58680/80000, loss=0.9125, lr=0.003042, batch_cost=1.4102, reader_cost=0.0001 | ETA 08:21:05 2021-02-23 17:12:37 [INFO] [TRAIN] epoch=158, iter=58690/80000, loss=0.8394, lr=0.003041, batch_cost=1.3852, reader_cost=0.0001 | ETA 08:11:59 2021-02-23 17:12:52 [INFO] [TRAIN] epoch=158, iter=58700/80000, loss=0.8286, lr=0.003039, batch_cost=1.4154, reader_cost=0.0001 | ETA 08:22:27 2021-02-23 17:13:05 [INFO] [TRAIN] epoch=158, iter=58710/80000, loss=0.8437, lr=0.003038, batch_cost=1.3817, reader_cost=0.0001 | ETA 08:10:17 2021-02-23 17:13:19 [INFO] [TRAIN] epoch=158, iter=58720/80000, loss=0.9118, lr=0.003037, batch_cost=1.3409, reader_cost=0.0001 | ETA 07:55:34 2021-02-23 17:13:33 [INFO] [TRAIN] epoch=158, iter=58730/80000, loss=0.7845, lr=0.003035, batch_cost=1.3936, reader_cost=0.0001 | ETA 08:14:02 2021-02-23 17:13:46 [INFO] [TRAIN] epoch=158, iter=58740/80000, loss=0.8105, lr=0.003034, batch_cost=1.3669, reader_cost=0.0001 | ETA 08:04:19 2021-02-23 17:14:00 [INFO] [TRAIN] epoch=158, iter=58750/80000, loss=0.8354, lr=0.003033, batch_cost=1.3747, reader_cost=0.0001 | ETA 08:06:51 2021-02-23 17:14:14 [INFO] [TRAIN] epoch=158, iter=58760/80000, loss=0.8698, lr=0.003032, batch_cost=1.3630, reader_cost=0.0001 | ETA 08:02:30 2021-02-23 17:14:27 [INFO] [TRAIN] epoch=158, iter=58770/80000, loss=0.7743, lr=0.003030, batch_cost=1.3508, reader_cost=0.0001 | ETA 07:57:57 2021-02-23 17:14:42 [INFO] [TRAIN] epoch=159, iter=58780/80000, loss=0.8189, lr=0.003029, batch_cost=1.4713, reader_cost=0.0648 | ETA 08:40:21 2021-02-23 17:14:56 [INFO] [TRAIN] epoch=159, iter=58790/80000, loss=0.8870, lr=0.003028, batch_cost=1.3748, reader_cost=0.0001 | ETA 08:06:00 2021-02-23 17:15:10 [INFO] [TRAIN] epoch=159, iter=58800/80000, loss=0.8830, lr=0.003026, batch_cost=1.3777, reader_cost=0.0001 | ETA 08:06:46 2021-02-23 17:15:23 [INFO] [TRAIN] epoch=159, iter=58810/80000, loss=0.8464, lr=0.003025, batch_cost=1.3705, reader_cost=0.0001 | ETA 08:04:00 2021-02-23 17:15:37 [INFO] [TRAIN] epoch=159, iter=58820/80000, loss=0.8242, lr=0.003024, batch_cost=1.3709, reader_cost=0.0001 | ETA 08:03:55 2021-02-23 17:15:51 [INFO] [TRAIN] epoch=159, iter=58830/80000, loss=0.7609, lr=0.003023, batch_cost=1.3919, reader_cost=0.0001 | ETA 08:11:05 2021-02-23 17:16:05 [INFO] [TRAIN] epoch=159, iter=58840/80000, loss=0.9121, lr=0.003021, batch_cost=1.3683, reader_cost=0.0001 | ETA 08:02:33 2021-02-23 17:16:18 [INFO] [TRAIN] epoch=159, iter=58850/80000, loss=0.8484, lr=0.003020, batch_cost=1.3327, reader_cost=0.0001 | ETA 07:49:46 2021-02-23 17:16:31 [INFO] [TRAIN] epoch=159, iter=58860/80000, loss=0.8931, lr=0.003019, batch_cost=1.3108, reader_cost=0.0001 | ETA 07:41:51 2021-02-23 17:16:44 [INFO] [TRAIN] epoch=159, iter=58870/80000, loss=0.8412, lr=0.003017, batch_cost=1.3382, reader_cost=0.0001 | ETA 07:51:17 2021-02-23 17:16:58 [INFO] [TRAIN] epoch=159, iter=58880/80000, loss=0.8469, lr=0.003016, batch_cost=1.3539, reader_cost=0.0001 | ETA 07:56:35 2021-02-23 17:17:12 [INFO] [TRAIN] epoch=159, iter=58890/80000, loss=0.8628, lr=0.003015, batch_cost=1.3831, reader_cost=0.0001 | ETA 08:06:37 2021-02-23 17:17:25 [INFO] [TRAIN] epoch=159, iter=58900/80000, loss=0.8532, lr=0.003014, batch_cost=1.3619, reader_cost=0.0001 | ETA 07:58:55 2021-02-23 17:17:39 [INFO] [TRAIN] epoch=159, iter=58910/80000, loss=0.8432, lr=0.003012, batch_cost=1.3553, reader_cost=0.0001 | ETA 07:56:23 2021-02-23 17:17:52 [INFO] [TRAIN] epoch=159, iter=58920/80000, loss=0.8336, lr=0.003011, batch_cost=1.3542, reader_cost=0.0001 | ETA 07:55:45 2021-02-23 17:18:06 [INFO] [TRAIN] epoch=159, iter=58930/80000, loss=0.9706, lr=0.003010, batch_cost=1.3411, reader_cost=0.0001 | ETA 07:50:57 2021-02-23 17:18:19 [INFO] [TRAIN] epoch=159, iter=58940/80000, loss=0.8847, lr=0.003009, batch_cost=1.3540, reader_cost=0.0001 | ETA 07:55:15 2021-02-23 17:18:33 [INFO] [TRAIN] epoch=159, iter=58950/80000, loss=0.8680, lr=0.003007, batch_cost=1.3542, reader_cost=0.0001 | ETA 07:55:05 2021-02-23 17:18:46 [INFO] [TRAIN] epoch=159, iter=58960/80000, loss=0.8617, lr=0.003006, batch_cost=1.3527, reader_cost=0.0001 | ETA 07:54:20 2021-02-23 17:19:00 [INFO] [TRAIN] epoch=159, iter=58970/80000, loss=0.8465, lr=0.003005, batch_cost=1.3492, reader_cost=0.0001 | ETA 07:52:54 2021-02-23 17:19:14 [INFO] [TRAIN] epoch=159, iter=58980/80000, loss=0.7462, lr=0.003003, batch_cost=1.3550, reader_cost=0.0001 | ETA 07:54:42 2021-02-23 17:19:27 [INFO] [TRAIN] epoch=159, iter=58990/80000, loss=0.9346, lr=0.003002, batch_cost=1.3738, reader_cost=0.0001 | ETA 08:01:03 2021-02-23 17:19:41 [INFO] [TRAIN] epoch=159, iter=59000/80000, loss=0.8923, lr=0.003001, batch_cost=1.3797, reader_cost=0.0001 | ETA 08:02:53 2021-02-23 17:19:41 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:19 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:05 - batch_cost: 0.2083 - reader cost: 0.0803  3/125 [..............................] - ETA: 1:00 - batch_cost: 0.2822 - reader cost: 0.1142 4/125 [..............................] - ETA: 58s - batch_cost: 0.3221 - reader cost: 0.1293  5/125 [>.............................] - ETA: 57s - batch_cost: 0.3470 - reader cost: 0.1431 6/125 [>.............................] - ETA: 54s - batch_cost: 0.3547 - reader cost: 0.1429 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3553 - reader cost: 0.1378 8/125 [>.............................] - ETA: 52s - batch_cost: 0.3674 - reader cost: 0.1434 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3766 - reader cost: 0.1496 10/125 [=>............................] - ETA: 51s - batch_cost: 0.3824 - reader cost: 0.1530 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3852 - reader cost: 0.1537 12/125 [=>............................] - ETA: 50s - batch_cost: 0.3906 - reader cost: 0.1574 13/125 [==>...........................] - ETA: 49s - batch_cost: 0.3933 - reader cost: 0.1582 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3924 - reader cost: 0.1562 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3921 - reader cost: 0.1550 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3956 - reader cost: 0.1572 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3956 - reader cost: 0.1557 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3935 - reader cost: 0.1529 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3941 - reader cost: 0.1529 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3960 - reader cost: 0.1544 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.3976 - reader cost: 0.1552 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.3990 - reader cost: 0.1557 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.3995 - reader cost: 0.1559 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4005 - reader cost: 0.1564 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.3992 - reader cost: 0.1549 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4001 - reader cost: 0.1556 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.3988 - reader cost: 0.1539 28/125 [=====>........................] - ETA: 40s - batch_cost: 0.3979 - reader cost: 0.1529 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.3972 - reader cost: 0.1520 30/125 [======>.......................] - ETA: 39s - batch_cost: 0.3984 - reader cost: 0.1531 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.3997 - reader cost: 0.1543 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.3996 - reader cost: 0.1541 33/125 [======>.......................] - ETA: 38s - batch_cost: 0.3990 - reader cost: 0.1533 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.3999 - reader cost: 0.1542 35/125 [=======>......................] - ETA: 37s - batch_cost: 0.4012 - reader cost: 0.1552 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4017 - reader cost: 0.1557 37/125 [=======>......................] - ETA: 36s - batch_cost: 0.4026 - reader cost: 0.1565 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4015 - reader cost: 0.1553 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4024 - reader cost: 0.1559 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4030 - reader cost: 0.1565 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4031 - reader cost: 0.1564 42/125 [=========>....................] - ETA: 34s - batch_cost: 0.4037 - reader cost: 0.1567 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4031 - reader cost: 0.1556 44/125 [=========>....................] - ETA: 33s - batch_cost: 0.4020 - reader cost: 0.1544 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4026 - reader cost: 0.1550 46/125 [==========>...................] - ETA: 32s - batch_cost: 0.4018 - reader cost: 0.1541 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4022 - reader cost: 0.1545 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4027 - reader cost: 0.1550 49/125 [==========>...................] - ETA: 31s - batch_cost: 0.4030 - reader cost: 0.1552 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4035 - reader cost: 0.1558 51/125 [===========>..................] - ETA: 30s - batch_cost: 0.4036 - reader cost: 0.1558 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4038 - reader cost: 0.1556 53/125 [===========>..................] - ETA: 29s - batch_cost: 0.4035 - reader cost: 0.1551 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4038 - reader cost: 0.1554 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4048 - reader cost: 0.1560 56/125 [============>.................] - ETA: 28s - batch_cost: 0.4050 - reader cost: 0.1562 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4054 - reader cost: 0.1565 58/125 [============>.................] - ETA: 27s - batch_cost: 0.4050 - reader cost: 0.1561 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4046 - reader cost: 0.1553 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4050 - reader cost: 0.1556 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4055 - reader cost: 0.1560 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4052 - reader cost: 0.1558 63/125 [==============>...............] - ETA: 25s - batch_cost: 0.4057 - reader cost: 0.1562 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4060 - reader cost: 0.1565 65/125 [==============>...............] - ETA: 24s - batch_cost: 0.4064 - reader cost: 0.1567 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4067 - reader cost: 0.1571 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4065 - reader cost: 0.1568 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4068 - reader cost: 0.1571 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4071 - reader cost: 0.1572 70/125 [===============>..............] - ETA: 22s - batch_cost: 0.4071 - reader cost: 0.1572 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4066 - reader cost: 0.1566 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4068 - reader cost: 0.1567 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4071 - reader cost: 0.1570 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4070 - reader cost: 0.1569 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4072 - reader cost: 0.1571 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4068 - reader cost: 0.1567 77/125 [=================>............] - ETA: 19s - batch_cost: 0.4064 - reader cost: 0.1564 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4067 - reader cost: 0.1566 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4063 - reader cost: 0.1560 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4065 - reader cost: 0.1563 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4069 - reader cost: 0.1565 82/125 [==================>...........] - ETA: 17s - batch_cost: 0.4065 - reader cost: 0.1561 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4068 - reader cost: 0.1564 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4072 - reader cost: 0.1568 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4076 - reader cost: 0.1572 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4078 - reader cost: 0.1574 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4074 - reader cost: 0.1570 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4077 - reader cost: 0.1573 89/125 [====================>.........] - ETA: 14s - batch_cost: 0.4082 - reader cost: 0.1578 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4085 - reader cost: 0.1581 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4086 - reader cost: 0.1581 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4084 - reader cost: 0.1579 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4086 - reader cost: 0.1580 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4081 - reader cost: 0.1576 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4076 - reader cost: 0.1571 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4077 - reader cost: 0.1572 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4075 - reader cost: 0.1570 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4076 - reader cost: 0.1571 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4074 - reader cost: 0.1569 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4073 - reader cost: 0.1568 101/125 [=======================>......] - ETA: 9s - batch_cost: 0.4075 - reader cost: 0.1565  102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4078 - reader cost: 0.1566 103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4079 - reader cost: 0.1568 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4079 - reader cost: 0.1568 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4080 - reader cost: 0.1569 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4083 - reader cost: 0.1572 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4083 - reader cost: 0.1572 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4082 - reader cost: 0.1570 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4077 - reader cost: 0.1565 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4080 - reader cost: 0.1569 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4079 - reader cost: 0.1567 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4083 - reader cost: 0.1566 113/125 [==========================>...] - ETA: 4s - batch_cost: 0.4081 - reader cost: 0.1562 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4084 - reader cost: 0.1565 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4086 - reader cost: 0.1567 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4087 - reader cost: 0.1569 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4090 - reader cost: 0.1571 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4091 - reader cost: 0.1571 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4092 - reader cost: 0.1573 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4094 - reader cost: 0.1575 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4096 - reader cost: 0.1577 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4097 - reader cost: 0.1578 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4096 - reader cost: 0.1577 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4097 - reader cost: 0.1578 125/125 [==============================] - 52s 415ms/step - batch_cost: 0.4098 - reader cost: 0.1579 2021-02-23 17:20:33 [INFO] [EVAL] #Images=500 mIoU=0.7381 Acc=0.9533 Kappa=0.9395 2021-02-23 17:20:33 [INFO] [EVAL] Class IoU: [0.9701 0.8277 0.9224 0.4436 0.5894 0.5485 0.7298 0.8199 0.914 0.5343 0.9449 0.7979 0.6322 0.947 0.6719 0.7449 0.5898 0.615 0.7798] 2021-02-23 17:20:33 [INFO] [EVAL] Class Acc: [0.9913 0.8856 0.9486 0.8581 0.7811 0.6628 0.8811 0.916 0.9524 0.9057 0.9573 0.8621 0.73 0.9704 0.9616 0.7871 0.9629 0.8333 0.8891] 2021-02-23 17:20:37 [INFO] [EVAL] The model with the best validation mIoU (0.7816) was saved at iter 44000. 2021-02-23 17:20:50 [INFO] [TRAIN] epoch=159, iter=59010/80000, loss=0.8042, lr=0.002999, batch_cost=1.3137, reader_cost=0.0001 | ETA 07:39:33 2021-02-23 17:21:04 [INFO] [TRAIN] epoch=159, iter=59020/80000, loss=0.8949, lr=0.002998, batch_cost=1.3491, reader_cost=0.0001 | ETA 07:51:44 2021-02-23 17:21:17 [INFO] [TRAIN] epoch=159, iter=59030/80000, loss=0.8684, lr=0.002997, batch_cost=1.3612, reader_cost=0.0001 | ETA 07:55:44 2021-02-23 17:21:31 [INFO] [TRAIN] epoch=159, iter=59040/80000, loss=0.8316, lr=0.002996, batch_cost=1.3734, reader_cost=0.0001 | ETA 07:59:46 2021-02-23 17:21:45 [INFO] [TRAIN] epoch=159, iter=59050/80000, loss=0.7944, lr=0.002994, batch_cost=1.3630, reader_cost=0.0001 | ETA 07:55:55 2021-02-23 17:21:59 [INFO] [TRAIN] epoch=159, iter=59060/80000, loss=0.8072, lr=0.002993, batch_cost=1.4073, reader_cost=0.0001 | ETA 08:11:08 2021-02-23 17:22:13 [INFO] [TRAIN] epoch=159, iter=59070/80000, loss=0.8378, lr=0.002992, batch_cost=1.3859, reader_cost=0.0001 | ETA 08:03:26 2021-02-23 17:22:26 [INFO] [TRAIN] epoch=159, iter=59080/80000, loss=0.8287, lr=0.002990, batch_cost=1.3464, reader_cost=0.0001 | ETA 07:49:26 2021-02-23 17:22:40 [INFO] [TRAIN] epoch=159, iter=59090/80000, loss=0.8751, lr=0.002989, batch_cost=1.3511, reader_cost=0.0001 | ETA 07:50:52 2021-02-23 17:22:53 [INFO] [TRAIN] epoch=159, iter=59100/80000, loss=0.8727, lr=0.002988, batch_cost=1.3382, reader_cost=0.0001 | ETA 07:46:07 2021-02-23 17:23:06 [INFO] [TRAIN] epoch=159, iter=59110/80000, loss=0.7859, lr=0.002987, batch_cost=1.3413, reader_cost=0.0001 | ETA 07:47:00 2021-02-23 17:23:20 [INFO] [TRAIN] epoch=159, iter=59120/80000, loss=0.7740, lr=0.002985, batch_cost=1.3797, reader_cost=0.0001 | ETA 08:00:08 2021-02-23 17:23:34 [INFO] [TRAIN] epoch=159, iter=59130/80000, loss=0.8358, lr=0.002984, batch_cost=1.3757, reader_cost=0.0001 | ETA 07:58:30 2021-02-23 17:23:48 [INFO] [TRAIN] epoch=159, iter=59140/80000, loss=0.8304, lr=0.002983, batch_cost=1.3802, reader_cost=0.0001 | ETA 07:59:50 2021-02-23 17:24:02 [INFO] [TRAIN] epoch=160, iter=59150/80000, loss=0.8283, lr=0.002981, batch_cost=1.4473, reader_cost=0.0736 | ETA 08:22:56 2021-02-23 17:24:16 [INFO] [TRAIN] epoch=160, iter=59160/80000, loss=0.8283, lr=0.002980, batch_cost=1.3696, reader_cost=0.0001 | ETA 07:55:41 2021-02-23 17:24:30 [INFO] [TRAIN] epoch=160, iter=59170/80000, loss=0.7993, lr=0.002979, batch_cost=1.3788, reader_cost=0.0001 | ETA 07:58:39 2021-02-23 17:24:43 [INFO] [TRAIN] epoch=160, iter=59180/80000, loss=0.8431, lr=0.002978, batch_cost=1.3324, reader_cost=0.0001 | ETA 07:42:20 2021-02-23 17:24:56 [INFO] [TRAIN] epoch=160, iter=59190/80000, loss=0.8368, lr=0.002976, batch_cost=1.3447, reader_cost=0.0001 | ETA 07:46:22 2021-02-23 17:25:10 [INFO] [TRAIN] epoch=160, iter=59200/80000, loss=0.8266, lr=0.002975, batch_cost=1.3656, reader_cost=0.0001 | ETA 07:53:24 2021-02-23 17:25:23 [INFO] [TRAIN] epoch=160, iter=59210/80000, loss=0.8772, lr=0.002974, batch_cost=1.3210, reader_cost=0.0001 | ETA 07:37:44 2021-02-23 17:25:37 [INFO] [TRAIN] epoch=160, iter=59220/80000, loss=0.7871, lr=0.002972, batch_cost=1.3626, reader_cost=0.0001 | ETA 07:51:53 2021-02-23 17:25:51 [INFO] [TRAIN] epoch=160, iter=59230/80000, loss=0.7797, lr=0.002971, batch_cost=1.3813, reader_cost=0.0001 | ETA 07:58:08 2021-02-23 17:26:05 [INFO] [TRAIN] epoch=160, iter=59240/80000, loss=0.8417, lr=0.002970, batch_cost=1.3794, reader_cost=0.0001 | ETA 07:57:16 2021-02-23 17:26:18 [INFO] [TRAIN] epoch=160, iter=59250/80000, loss=0.8735, lr=0.002969, batch_cost=1.3619, reader_cost=0.0001 | ETA 07:50:59 2021-02-23 17:26:32 [INFO] [TRAIN] epoch=160, iter=59260/80000, loss=0.8223, lr=0.002967, batch_cost=1.3919, reader_cost=0.0001 | ETA 08:01:08 2021-02-23 17:26:46 [INFO] [TRAIN] epoch=160, iter=59270/80000, loss=0.8158, lr=0.002966, batch_cost=1.4032, reader_cost=0.0001 | ETA 08:04:47 2021-02-23 17:27:00 [INFO] [TRAIN] epoch=160, iter=59280/80000, loss=1.0015, lr=0.002965, batch_cost=1.3738, reader_cost=0.0001 | ETA 07:54:24 2021-02-23 17:27:13 [INFO] [TRAIN] epoch=160, iter=59290/80000, loss=0.8123, lr=0.002963, batch_cost=1.3636, reader_cost=0.0001 | ETA 07:50:39 2021-02-23 17:27:27 [INFO] [TRAIN] epoch=160, iter=59300/80000, loss=0.7764, lr=0.002962, batch_cost=1.3474, reader_cost=0.0001 | ETA 07:44:50 2021-02-23 17:27:41 [INFO] [TRAIN] epoch=160, iter=59310/80000, loss=0.7903, lr=0.002961, batch_cost=1.3717, reader_cost=0.0001 | ETA 07:53:01 2021-02-23 17:27:54 [INFO] [TRAIN] epoch=160, iter=59320/80000, loss=0.8498, lr=0.002960, batch_cost=1.3520, reader_cost=0.0001 | ETA 07:45:59 2021-02-23 17:28:08 [INFO] [TRAIN] epoch=160, iter=59330/80000, loss=0.8419, lr=0.002958, batch_cost=1.3697, reader_cost=0.0001 | ETA 07:51:51 2021-02-23 17:28:22 [INFO] [TRAIN] epoch=160, iter=59340/80000, loss=0.8748, lr=0.002957, batch_cost=1.3669, reader_cost=0.0001 | ETA 07:50:39 2021-02-23 17:28:35 [INFO] [TRAIN] epoch=160, iter=59350/80000, loss=0.8574, lr=0.002956, batch_cost=1.3653, reader_cost=0.0001 | ETA 07:49:54 2021-02-23 17:28:49 [INFO] [TRAIN] epoch=160, iter=59360/80000, loss=0.8564, lr=0.002954, batch_cost=1.3553, reader_cost=0.0001 | ETA 07:46:12 2021-02-23 17:29:03 [INFO] [TRAIN] epoch=160, iter=59370/80000, loss=0.9620, lr=0.002953, batch_cost=1.3775, reader_cost=0.0001 | ETA 07:53:37 2021-02-23 17:29:16 [INFO] [TRAIN] epoch=160, iter=59380/80000, loss=0.9244, lr=0.002952, batch_cost=1.3659, reader_cost=0.0001 | ETA 07:49:24 2021-02-23 17:29:30 [INFO] [TRAIN] epoch=160, iter=59390/80000, loss=0.8435, lr=0.002951, batch_cost=1.3551, reader_cost=0.0001 | ETA 07:45:29 2021-02-23 17:29:43 [INFO] [TRAIN] epoch=160, iter=59400/80000, loss=0.8279, lr=0.002949, batch_cost=1.3568, reader_cost=0.0001 | ETA 07:45:49 2021-02-23 17:29:57 [INFO] [TRAIN] epoch=160, iter=59410/80000, loss=0.7542, lr=0.002948, batch_cost=1.3799, reader_cost=0.0001 | ETA 07:53:33 2021-02-23 17:30:11 [INFO] [TRAIN] epoch=160, iter=59420/80000, loss=0.9339, lr=0.002947, batch_cost=1.3435, reader_cost=0.0001 | ETA 07:40:49 2021-02-23 17:30:24 [INFO] [TRAIN] epoch=160, iter=59430/80000, loss=0.8847, lr=0.002945, batch_cost=1.3490, reader_cost=0.0001 | ETA 07:42:29 2021-02-23 17:30:38 [INFO] [TRAIN] epoch=160, iter=59440/80000, loss=0.8024, lr=0.002944, batch_cost=1.3567, reader_cost=0.0001 | ETA 07:44:53 2021-02-23 17:30:51 [INFO] [TRAIN] epoch=160, iter=59450/80000, loss=0.8575, lr=0.002943, batch_cost=1.3715, reader_cost=0.0001 | ETA 07:49:43 2021-02-23 17:31:05 [INFO] [TRAIN] epoch=160, iter=59460/80000, loss=0.8296, lr=0.002942, batch_cost=1.3392, reader_cost=0.0001 | ETA 07:38:27 2021-02-23 17:31:18 [INFO] [TRAIN] epoch=160, iter=59470/80000, loss=0.8576, lr=0.002940, batch_cost=1.3556, reader_cost=0.0001 | ETA 07:43:49 2021-02-23 17:31:32 [INFO] [TRAIN] epoch=160, iter=59480/80000, loss=0.8740, lr=0.002939, batch_cost=1.3823, reader_cost=0.0001 | ETA 07:52:44 2021-02-23 17:31:46 [INFO] [TRAIN] epoch=160, iter=59490/80000, loss=0.8010, lr=0.002938, batch_cost=1.3856, reader_cost=0.0001 | ETA 07:53:38 2021-02-23 17:32:00 [INFO] [TRAIN] epoch=160, iter=59500/80000, loss=0.8030, lr=0.002936, batch_cost=1.4114, reader_cost=0.0001 | ETA 08:02:14 2021-02-23 17:32:14 [INFO] [TRAIN] epoch=160, iter=59510/80000, loss=0.7625, lr=0.002935, batch_cost=1.4030, reader_cost=0.0001 | ETA 07:59:06 2021-02-23 17:32:27 [INFO] [TRAIN] epoch=160, iter=59520/80000, loss=0.8609, lr=0.002934, batch_cost=1.3128, reader_cost=0.0001 | ETA 07:28:07 2021-02-23 17:32:42 [INFO] [TRAIN] epoch=161, iter=59530/80000, loss=0.8735, lr=0.002933, batch_cost=1.4737, reader_cost=0.0827 | ETA 08:22:47 2021-02-23 17:32:56 [INFO] [TRAIN] epoch=161, iter=59540/80000, loss=0.8579, lr=0.002931, batch_cost=1.3539, reader_cost=0.0001 | ETA 07:41:41 2021-02-23 17:33:09 [INFO] [TRAIN] epoch=161, iter=59550/80000, loss=0.8554, lr=0.002930, batch_cost=1.3636, reader_cost=0.0001 | ETA 07:44:45 2021-02-23 17:33:23 [INFO] [TRAIN] epoch=161, iter=59560/80000, loss=0.8900, lr=0.002929, batch_cost=1.3891, reader_cost=0.0001 | ETA 07:53:13 2021-02-23 17:33:37 [INFO] [TRAIN] epoch=161, iter=59570/80000, loss=0.8628, lr=0.002927, batch_cost=1.3837, reader_cost=0.0001 | ETA 07:51:09 2021-02-23 17:33:51 [INFO] [TRAIN] epoch=161, iter=59580/80000, loss=0.8709, lr=0.002926, batch_cost=1.3834, reader_cost=0.0001 | ETA 07:50:49 2021-02-23 17:34:05 [INFO] [TRAIN] epoch=161, iter=59590/80000, loss=0.8864, lr=0.002925, batch_cost=1.3787, reader_cost=0.0001 | ETA 07:48:59 2021-02-23 17:34:18 [INFO] [TRAIN] epoch=161, iter=59600/80000, loss=0.8995, lr=0.002924, batch_cost=1.3373, reader_cost=0.0001 | ETA 07:34:40 2021-02-23 17:34:32 [INFO] [TRAIN] epoch=161, iter=59610/80000, loss=0.8862, lr=0.002922, batch_cost=1.3693, reader_cost=0.0001 | ETA 07:45:20 2021-02-23 17:34:45 [INFO] [TRAIN] epoch=161, iter=59620/80000, loss=0.8259, lr=0.002921, batch_cost=1.3595, reader_cost=0.0001 | ETA 07:41:46 2021-02-23 17:34:59 [INFO] [TRAIN] epoch=161, iter=59630/80000, loss=0.7945, lr=0.002920, batch_cost=1.3549, reader_cost=0.0001 | ETA 07:39:59 2021-02-23 17:35:12 [INFO] [TRAIN] epoch=161, iter=59640/80000, loss=0.8329, lr=0.002918, batch_cost=1.3733, reader_cost=0.0001 | ETA 07:46:01 2021-02-23 17:35:26 [INFO] [TRAIN] epoch=161, iter=59650/80000, loss=0.8647, lr=0.002917, batch_cost=1.3752, reader_cost=0.0001 | ETA 07:46:24 2021-02-23 17:35:40 [INFO] [TRAIN] epoch=161, iter=59660/80000, loss=0.8087, lr=0.002916, batch_cost=1.3750, reader_cost=0.0001 | ETA 07:46:07 2021-02-23 17:35:54 [INFO] [TRAIN] epoch=161, iter=59670/80000, loss=0.8120, lr=0.002914, batch_cost=1.3742, reader_cost=0.0001 | ETA 07:45:37 2021-02-23 17:36:07 [INFO] [TRAIN] epoch=161, iter=59680/80000, loss=0.8713, lr=0.002913, batch_cost=1.3373, reader_cost=0.0001 | ETA 07:32:53 2021-02-23 17:36:21 [INFO] [TRAIN] epoch=161, iter=59690/80000, loss=0.8661, lr=0.002912, batch_cost=1.3879, reader_cost=0.0001 | ETA 07:49:48 2021-02-23 17:36:35 [INFO] [TRAIN] epoch=161, iter=59700/80000, loss=0.8593, lr=0.002911, batch_cost=1.3732, reader_cost=0.0001 | ETA 07:44:35 2021-02-23 17:36:48 [INFO] [TRAIN] epoch=161, iter=59710/80000, loss=0.8336, lr=0.002909, batch_cost=1.3568, reader_cost=0.0001 | ETA 07:38:49 2021-02-23 17:37:02 [INFO] [TRAIN] epoch=161, iter=59720/80000, loss=0.8566, lr=0.002908, batch_cost=1.3388, reader_cost=0.0001 | ETA 07:32:31 2021-02-23 17:37:16 [INFO] [TRAIN] epoch=161, iter=59730/80000, loss=0.9539, lr=0.002907, batch_cost=1.3902, reader_cost=0.0001 | ETA 07:49:38 2021-02-23 17:37:29 [INFO] [TRAIN] epoch=161, iter=59740/80000, loss=0.7840, lr=0.002905, batch_cost=1.3583, reader_cost=0.0001 | ETA 07:38:39 2021-02-23 17:37:43 [INFO] [TRAIN] epoch=161, iter=59750/80000, loss=0.8397, lr=0.002904, batch_cost=1.3566, reader_cost=0.0001 | ETA 07:37:50 2021-02-23 17:37:56 [INFO] [TRAIN] epoch=161, iter=59760/80000, loss=0.8800, lr=0.002903, batch_cost=1.3668, reader_cost=0.0001 | ETA 07:41:04 2021-02-23 17:38:10 [INFO] [TRAIN] epoch=161, iter=59770/80000, loss=0.7489, lr=0.002902, batch_cost=1.3393, reader_cost=0.0001 | ETA 07:31:34 2021-02-23 17:38:23 [INFO] [TRAIN] epoch=161, iter=59780/80000, loss=0.9220, lr=0.002900, batch_cost=1.3709, reader_cost=0.0001 | ETA 07:41:59 2021-02-23 17:38:37 [INFO] [TRAIN] epoch=161, iter=59790/80000, loss=0.8222, lr=0.002899, batch_cost=1.3686, reader_cost=0.0001 | ETA 07:40:59 2021-02-23 17:38:51 [INFO] [TRAIN] epoch=161, iter=59800/80000, loss=0.8607, lr=0.002898, batch_cost=1.3821, reader_cost=0.0001 | ETA 07:45:17 2021-02-23 17:39:04 [INFO] [TRAIN] epoch=161, iter=59810/80000, loss=0.8108, lr=0.002896, batch_cost=1.3436, reader_cost=0.0001 | ETA 07:32:06 2021-02-23 17:39:18 [INFO] [TRAIN] epoch=161, iter=59820/80000, loss=0.8513, lr=0.002895, batch_cost=1.3547, reader_cost=0.0001 | ETA 07:35:38 2021-02-23 17:39:32 [INFO] [TRAIN] epoch=161, iter=59830/80000, loss=0.8842, lr=0.002894, batch_cost=1.3936, reader_cost=0.0001 | ETA 07:48:28 2021-02-23 17:39:46 [INFO] [TRAIN] epoch=161, iter=59840/80000, loss=0.8037, lr=0.002893, batch_cost=1.3613, reader_cost=0.0001 | ETA 07:37:23 2021-02-23 17:39:59 [INFO] [TRAIN] epoch=161, iter=59850/80000, loss=0.8821, lr=0.002891, batch_cost=1.3518, reader_cost=0.0001 | ETA 07:33:58 2021-02-23 17:40:13 [INFO] [TRAIN] epoch=161, iter=59860/80000, loss=0.8532, lr=0.002890, batch_cost=1.3519, reader_cost=0.0001 | ETA 07:33:47 2021-02-23 17:40:27 [INFO] [TRAIN] epoch=161, iter=59870/80000, loss=0.8334, lr=0.002889, batch_cost=1.3960, reader_cost=0.0001 | ETA 07:48:21 2021-02-23 17:40:40 [INFO] [TRAIN] epoch=161, iter=59880/80000, loss=0.8380, lr=0.002887, batch_cost=1.3977, reader_cost=0.0001 | ETA 07:48:42 2021-02-23 17:40:54 [INFO] [TRAIN] epoch=161, iter=59890/80000, loss=0.8419, lr=0.002886, batch_cost=1.3235, reader_cost=0.0001 | ETA 07:23:35 2021-02-23 17:41:08 [INFO] [TRAIN] epoch=162, iter=59900/80000, loss=0.8481, lr=0.002885, batch_cost=1.4415, reader_cost=0.0793 | ETA 08:02:54 2021-02-23 17:41:22 [INFO] [TRAIN] epoch=162, iter=59910/80000, loss=0.8698, lr=0.002884, batch_cost=1.3553, reader_cost=0.0001 | ETA 07:33:47 2021-02-23 17:41:35 [INFO] [TRAIN] epoch=162, iter=59920/80000, loss=0.8469, lr=0.002882, batch_cost=1.3281, reader_cost=0.0001 | ETA 07:24:28 2021-02-23 17:41:49 [INFO] [TRAIN] epoch=162, iter=59930/80000, loss=0.8232, lr=0.002881, batch_cost=1.3936, reader_cost=0.0001 | ETA 07:46:09 2021-02-23 17:42:02 [INFO] [TRAIN] epoch=162, iter=59940/80000, loss=0.8157, lr=0.002880, batch_cost=1.3488, reader_cost=0.0001 | ETA 07:30:57 2021-02-23 17:42:16 [INFO] [TRAIN] epoch=162, iter=59950/80000, loss=0.7757, lr=0.002878, batch_cost=1.3685, reader_cost=0.0001 | ETA 07:37:19 2021-02-23 17:42:30 [INFO] [TRAIN] epoch=162, iter=59960/80000, loss=0.8402, lr=0.002877, batch_cost=1.3734, reader_cost=0.0001 | ETA 07:38:42 2021-02-23 17:42:43 [INFO] [TRAIN] epoch=162, iter=59970/80000, loss=0.8276, lr=0.002876, batch_cost=1.3567, reader_cost=0.0001 | ETA 07:32:54 2021-02-23 17:42:57 [INFO] [TRAIN] epoch=162, iter=59980/80000, loss=0.8742, lr=0.002874, batch_cost=1.3595, reader_cost=0.0001 | ETA 07:33:36 2021-02-23 17:43:10 [INFO] [TRAIN] epoch=162, iter=59990/80000, loss=0.8332, lr=0.002873, batch_cost=1.3499, reader_cost=0.0001 | ETA 07:30:12 2021-02-23 17:43:24 [INFO] [TRAIN] epoch=162, iter=60000/80000, loss=0.8816, lr=0.002872, batch_cost=1.3780, reader_cost=0.0001 | ETA 07:39:19 2021-02-23 17:43:24 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:21 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:08 - batch_cost: 0.2288 - reader cost: 0.0987  3/125 [..............................] - ETA: 1:02 - batch_cost: 0.2956 - reader cost: 0.1256 4/125 [..............................] - ETA: 1:00 - batch_cost: 0.3323 - reader cost: 0.1398 5/125 [>.............................] - ETA: 58s - batch_cost: 0.3594 - reader cost: 0.1549  6/125 [>.............................] - ETA: 56s - batch_cost: 0.3630 - reader cost: 0.1512 7/125 [>.............................] - ETA: 55s - batch_cost: 0.3749 - reader cost: 0.1542 8/125 [>.............................] - ETA: 53s - batch_cost: 0.3784 - reader cost: 0.1538 9/125 [=>............................] - ETA: 52s - batch_cost: 0.3807 - reader cost: 0.1530 10/125 [=>............................] - ETA: 51s - batch_cost: 0.3856 - reader cost: 0.1557 11/125 [=>............................] - ETA: 51s - batch_cost: 0.3895 - reader cost: 0.1573 12/125 [=>............................] - ETA: 50s - batch_cost: 0.3911 - reader cost: 0.1577 13/125 [==>...........................] - ETA: 49s - batch_cost: 0.3943 - reader cost: 0.1595 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3921 - reader cost: 0.1564 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3913 - reader cost: 0.1547 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3931 - reader cost: 0.1553 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3950 - reader cost: 0.1566 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.3969 - reader cost: 0.1574 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3978 - reader cost: 0.1580 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4001 - reader cost: 0.1594 21/125 [====>.........................] - ETA: 45s - batch_cost: 0.4020 - reader cost: 0.1607 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4008 - reader cost: 0.1590 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4007 - reader cost: 0.1587 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.3998 - reader cost: 0.1574 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4025 - reader cost: 0.1596 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4040 - reader cost: 0.1605 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4029 - reader cost: 0.1592 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4044 - reader cost: 0.1598 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4024 - reader cost: 0.1576 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4032 - reader cost: 0.1583 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.4038 - reader cost: 0.1588 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4039 - reader cost: 0.1587 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4048 - reader cost: 0.1594 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4040 - reader cost: 0.1585 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4053 - reader cost: 0.1592 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4046 - reader cost: 0.1573 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4050 - reader cost: 0.1575 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4054 - reader cost: 0.1579 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4058 - reader cost: 0.1584 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4069 - reader cost: 0.1590 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4070 - reader cost: 0.1591 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4067 - reader cost: 0.1587 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4074 - reader cost: 0.1590 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4077 - reader cost: 0.1593 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4081 - reader cost: 0.1597 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4090 - reader cost: 0.1605 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4097 - reader cost: 0.1611 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4087 - reader cost: 0.1600 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4094 - reader cost: 0.1605 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4096 - reader cost: 0.1606 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4101 - reader cost: 0.1609 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4106 - reader cost: 0.1614 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4112 - reader cost: 0.1619 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4116 - reader cost: 0.1621 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4107 - reader cost: 0.1612 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4110 - reader cost: 0.1615 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4111 - reader cost: 0.1613 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4104 - reader cost: 0.1605 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4097 - reader cost: 0.1598 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4104 - reader cost: 0.1600 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4093 - reader cost: 0.1590 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4094 - reader cost: 0.1591 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4089 - reader cost: 0.1585 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4094 - reader cost: 0.1588 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4095 - reader cost: 0.1586 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4097 - reader cost: 0.1587 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4090 - reader cost: 0.1580 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4085 - reader cost: 0.1574 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4088 - reader cost: 0.1577 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4092 - reader cost: 0.1581 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4086 - reader cost: 0.1576 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4088 - reader cost: 0.1578 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4090 - reader cost: 0.1580 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4087 - reader cost: 0.1578 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4090 - reader cost: 0.1581 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4091 - reader cost: 0.1582 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4097 - reader cost: 0.1586 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4096 - reader cost: 0.1585 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4098 - reader cost: 0.1587 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4095 - reader cost: 0.1585 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4094 - reader cost: 0.1582 82/125 [==================>...........] - ETA: 17s - batch_cost: 0.4095 - reader cost: 0.1583 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4091 - reader cost: 0.1578 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4092 - reader cost: 0.1580 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4090 - reader cost: 0.1578 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4093 - reader cost: 0.1581 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4094 - reader cost: 0.1583 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4092 - reader cost: 0.1581 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4096 - reader cost: 0.1584 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4098 - reader cost: 0.1586 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4100 - reader cost: 0.1586 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4100 - reader cost: 0.1588 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4101 - reader cost: 0.1589 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4098 - reader cost: 0.1585 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4099 - reader cost: 0.1586 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4097 - reader cost: 0.1583 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4100 - reader cost: 0.1586 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4101 - reader cost: 0.1582 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4104 - reader cost: 0.1585 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4103 - reader cost: 0.1583 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4104 - reader cost: 0.1584 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4106 - reader cost: 0.1587  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4107 - reader cost: 0.1588 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4112 - reader cost: 0.1592 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4113 - reader cost: 0.1593 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4114 - reader cost: 0.1594 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4110 - reader cost: 0.1590 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4108 - reader cost: 0.1587 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4106 - reader cost: 0.1585 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4107 - reader cost: 0.1587 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4106 - reader cost: 0.1586 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4102 - reader cost: 0.1582 113/125 [==========================>...] - ETA: 4s - batch_cost: 0.4104 - reader cost: 0.1585 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4106 - reader cost: 0.1587 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4108 - reader cost: 0.1589 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4108 - reader cost: 0.1590 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4110 - reader cost: 0.1592 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4112 - reader cost: 0.1593 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4111 - reader cost: 0.1592 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4109 - reader cost: 0.1590 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4111 - reader cost: 0.1592 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4109 - reader cost: 0.1589 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4107 - reader cost: 0.1587 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4105 - reader cost: 0.1584 125/125 [==============================] - 52s 416ms/step - batch_cost: 0.4106 - reader cost: 0.1585 2021-02-23 17:44:16 [INFO] [EVAL] #Images=500 mIoU=0.7259 Acc=0.9584 Kappa=0.9459 2021-02-23 17:44:16 [INFO] [EVAL] Class IoU: [0.9763 0.822 0.9267 0.4862 0.586 0.6835 0.7448 0.8202 0.9239 0.6553 0.9436 0.8287 0.5998 0.948 0.6501 0.7011 0.2201 0.4944 0.7818] 2021-02-23 17:44:16 [INFO] [EVAL] Class Acc: [0.9851 0.916 0.9616 0.856 0.8286 0.84 0.8318 0.9082 0.9489 0.7953 0.9574 0.9011 0.8556 0.9659 0.9653 0.739 0.9214 0.9064 0.8884] 2021-02-23 17:44:20 [INFO] [EVAL] The model with the best validation mIoU (0.7816) was saved at iter 44000. 2021-02-23 17:44:34 [INFO] [TRAIN] epoch=162, iter=60010/80000, loss=0.8046, lr=0.002871, batch_cost=1.3546, reader_cost=0.0001 | ETA 07:31:17 2021-02-23 17:44:48 [INFO] [TRAIN] epoch=162, iter=60020/80000, loss=0.8174, lr=0.002869, batch_cost=1.3726, reader_cost=0.0001 | ETA 07:37:03 2021-02-23 17:45:01 [INFO] [TRAIN] epoch=162, iter=60030/80000, loss=0.8357, lr=0.002868, batch_cost=1.3677, reader_cost=0.0001 | ETA 07:35:13 2021-02-23 17:45:15 [INFO] [TRAIN] epoch=162, iter=60040/80000, loss=0.8674, lr=0.002867, batch_cost=1.3597, reader_cost=0.0001 | ETA 07:32:19 2021-02-23 17:45:29 [INFO] [TRAIN] epoch=162, iter=60050/80000, loss=0.8251, lr=0.002865, batch_cost=1.3726, reader_cost=0.0001 | ETA 07:36:23 2021-02-23 17:45:43 [INFO] [TRAIN] epoch=162, iter=60060/80000, loss=0.8133, lr=0.002864, batch_cost=1.3874, reader_cost=0.0001 | ETA 07:41:03 2021-02-23 17:45:56 [INFO] [TRAIN] epoch=162, iter=60070/80000, loss=0.8641, lr=0.002863, batch_cost=1.3570, reader_cost=0.0001 | ETA 07:30:45 2021-02-23 17:46:10 [INFO] [TRAIN] epoch=162, iter=60080/80000, loss=0.7998, lr=0.002862, batch_cost=1.3470, reader_cost=0.0001 | ETA 07:27:12 2021-02-23 17:46:23 [INFO] [TRAIN] epoch=162, iter=60090/80000, loss=0.8361, lr=0.002860, batch_cost=1.3518, reader_cost=0.0001 | ETA 07:28:35 2021-02-23 17:46:37 [INFO] [TRAIN] epoch=162, iter=60100/80000, loss=0.8214, lr=0.002859, batch_cost=1.3544, reader_cost=0.0001 | ETA 07:29:13 2021-02-23 17:46:50 [INFO] [TRAIN] epoch=162, iter=60110/80000, loss=0.8186, lr=0.002858, batch_cost=1.3468, reader_cost=0.0001 | ETA 07:26:27 2021-02-23 17:47:04 [INFO] [TRAIN] epoch=162, iter=60120/80000, loss=0.8058, lr=0.002856, batch_cost=1.3537, reader_cost=0.0001 | ETA 07:28:31 2021-02-23 17:47:17 [INFO] [TRAIN] epoch=162, iter=60130/80000, loss=0.8528, lr=0.002855, batch_cost=1.3683, reader_cost=0.0001 | ETA 07:33:07 2021-02-23 17:47:31 [INFO] [TRAIN] epoch=162, iter=60140/80000, loss=0.9521, lr=0.002854, batch_cost=1.3907, reader_cost=0.0001 | ETA 07:40:18 2021-02-23 17:47:45 [INFO] [TRAIN] epoch=162, iter=60150/80000, loss=0.8325, lr=0.002852, batch_cost=1.3662, reader_cost=0.0001 | ETA 07:31:58 2021-02-23 17:47:59 [INFO] [TRAIN] epoch=162, iter=60160/80000, loss=0.8663, lr=0.002851, batch_cost=1.3737, reader_cost=0.0001 | ETA 07:34:13 2021-02-23 17:48:13 [INFO] [TRAIN] epoch=162, iter=60170/80000, loss=0.8486, lr=0.002850, batch_cost=1.4052, reader_cost=0.0001 | ETA 07:44:25 2021-02-23 17:48:26 [INFO] [TRAIN] epoch=162, iter=60180/80000, loss=0.8456, lr=0.002849, batch_cost=1.3433, reader_cost=0.0001 | ETA 07:23:44 2021-02-23 17:48:40 [INFO] [TRAIN] epoch=162, iter=60190/80000, loss=0.8333, lr=0.002847, batch_cost=1.3496, reader_cost=0.0001 | ETA 07:25:34 2021-02-23 17:48:54 [INFO] [TRAIN] epoch=162, iter=60200/80000, loss=0.9117, lr=0.002846, batch_cost=1.3864, reader_cost=0.0001 | ETA 07:37:30 2021-02-23 17:49:07 [INFO] [TRAIN] epoch=162, iter=60210/80000, loss=0.8121, lr=0.002845, batch_cost=1.3544, reader_cost=0.0001 | ETA 07:26:43 2021-02-23 17:49:21 [INFO] [TRAIN] epoch=162, iter=60220/80000, loss=0.8479, lr=0.002843, batch_cost=1.3755, reader_cost=0.0001 | ETA 07:33:26 2021-02-23 17:49:35 [INFO] [TRAIN] epoch=162, iter=60230/80000, loss=0.8719, lr=0.002842, batch_cost=1.3804, reader_cost=0.0001 | ETA 07:34:49 2021-02-23 17:49:48 [INFO] [TRAIN] epoch=162, iter=60240/80000, loss=0.8336, lr=0.002841, batch_cost=1.3498, reader_cost=0.0001 | ETA 07:24:31 2021-02-23 17:50:02 [INFO] [TRAIN] epoch=162, iter=60250/80000, loss=0.7789, lr=0.002840, batch_cost=1.3557, reader_cost=0.0001 | ETA 07:26:15 2021-02-23 17:50:15 [INFO] [TRAIN] epoch=162, iter=60260/80000, loss=0.8366, lr=0.002838, batch_cost=1.3556, reader_cost=0.0001 | ETA 07:25:58 2021-02-23 17:50:29 [INFO] [TRAIN] epoch=163, iter=60270/80000, loss=0.8029, lr=0.002837, batch_cost=1.4138, reader_cost=0.0840 | ETA 07:44:53 2021-02-23 17:50:43 [INFO] [TRAIN] epoch=163, iter=60280/80000, loss=0.8226, lr=0.002836, batch_cost=1.3663, reader_cost=0.0001 | ETA 07:29:03 2021-02-23 17:50:57 [INFO] [TRAIN] epoch=163, iter=60290/80000, loss=0.8268, lr=0.002834, batch_cost=1.3488, reader_cost=0.0001 | ETA 07:23:04 2021-02-23 17:51:11 [INFO] [TRAIN] epoch=163, iter=60300/80000, loss=0.8894, lr=0.002833, batch_cost=1.3963, reader_cost=0.0001 | ETA 07:38:26 2021-02-23 17:51:24 [INFO] [TRAIN] epoch=163, iter=60310/80000, loss=0.7831, lr=0.002832, batch_cost=1.3503, reader_cost=0.0001 | ETA 07:23:08 2021-02-23 17:51:37 [INFO] [TRAIN] epoch=163, iter=60320/80000, loss=0.8324, lr=0.002830, batch_cost=1.3406, reader_cost=0.0001 | ETA 07:19:43 2021-02-23 17:51:51 [INFO] [TRAIN] epoch=163, iter=60330/80000, loss=0.8286, lr=0.002829, batch_cost=1.3548, reader_cost=0.0001 | ETA 07:24:09 2021-02-23 17:52:05 [INFO] [TRAIN] epoch=163, iter=60340/80000, loss=0.8561, lr=0.002828, batch_cost=1.3571, reader_cost=0.0001 | ETA 07:24:39 2021-02-23 17:52:18 [INFO] [TRAIN] epoch=163, iter=60350/80000, loss=0.7927, lr=0.002827, batch_cost=1.3813, reader_cost=0.0001 | ETA 07:32:21 2021-02-23 17:52:32 [INFO] [TRAIN] epoch=163, iter=60360/80000, loss=0.8009, lr=0.002825, batch_cost=1.3535, reader_cost=0.0001 | ETA 07:23:03 2021-02-23 17:52:46 [INFO] [TRAIN] epoch=163, iter=60370/80000, loss=0.8364, lr=0.002824, batch_cost=1.3631, reader_cost=0.0001 | ETA 07:25:58 2021-02-23 17:52:59 [INFO] [TRAIN] epoch=163, iter=60380/80000, loss=0.8098, lr=0.002823, batch_cost=1.3660, reader_cost=0.0001 | ETA 07:26:40 2021-02-23 17:53:13 [INFO] [TRAIN] epoch=163, iter=60390/80000, loss=0.9205, lr=0.002821, batch_cost=1.3645, reader_cost=0.0001 | ETA 07:25:57 2021-02-23 17:53:27 [INFO] [TRAIN] epoch=163, iter=60400/80000, loss=0.9079, lr=0.002820, batch_cost=1.3740, reader_cost=0.0001 | ETA 07:28:49 2021-02-23 17:53:40 [INFO] [TRAIN] epoch=163, iter=60410/80000, loss=0.8281, lr=0.002819, batch_cost=1.3607, reader_cost=0.0001 | ETA 07:24:16 2021-02-23 17:53:54 [INFO] [TRAIN] epoch=163, iter=60420/80000, loss=0.8072, lr=0.002818, batch_cost=1.3447, reader_cost=0.0001 | ETA 07:18:48 2021-02-23 17:54:07 [INFO] [TRAIN] epoch=163, iter=60430/80000, loss=0.8862, lr=0.002816, batch_cost=1.3573, reader_cost=0.0001 | ETA 07:22:42 2021-02-23 17:54:21 [INFO] [TRAIN] epoch=163, iter=60440/80000, loss=0.7792, lr=0.002815, batch_cost=1.3499, reader_cost=0.0001 | ETA 07:20:04 2021-02-23 17:54:35 [INFO] [TRAIN] epoch=163, iter=60450/80000, loss=0.8239, lr=0.002814, batch_cost=1.3769, reader_cost=0.0001 | ETA 07:28:38 2021-02-23 17:54:48 [INFO] [TRAIN] epoch=163, iter=60460/80000, loss=0.8635, lr=0.002812, batch_cost=1.3646, reader_cost=0.0001 | ETA 07:24:23 2021-02-23 17:55:02 [INFO] [TRAIN] epoch=163, iter=60470/80000, loss=0.7731, lr=0.002811, batch_cost=1.3638, reader_cost=0.0001 | ETA 07:23:54 2021-02-23 17:55:15 [INFO] [TRAIN] epoch=163, iter=60480/80000, loss=0.8552, lr=0.002810, batch_cost=1.3664, reader_cost=0.0001 | ETA 07:24:32 2021-02-23 17:55:29 [INFO] [TRAIN] epoch=163, iter=60490/80000, loss=0.8502, lr=0.002808, batch_cost=1.3364, reader_cost=0.0001 | ETA 07:14:32 2021-02-23 17:55:43 [INFO] [TRAIN] epoch=163, iter=60500/80000, loss=0.8354, lr=0.002807, batch_cost=1.4183, reader_cost=0.0001 | ETA 07:40:57 2021-02-23 17:55:56 [INFO] [TRAIN] epoch=163, iter=60510/80000, loss=0.8193, lr=0.002806, batch_cost=1.3415, reader_cost=0.0001 | ETA 07:15:46 2021-02-23 17:56:10 [INFO] [TRAIN] epoch=163, iter=60520/80000, loss=0.9002, lr=0.002805, batch_cost=1.3230, reader_cost=0.0001 | ETA 07:09:32 2021-02-23 17:56:23 [INFO] [TRAIN] epoch=163, iter=60530/80000, loss=0.8664, lr=0.002803, batch_cost=1.3560, reader_cost=0.0001 | ETA 07:20:01 2021-02-23 17:56:37 [INFO] [TRAIN] epoch=163, iter=60540/80000, loss=0.7992, lr=0.002802, batch_cost=1.3575, reader_cost=0.0001 | ETA 07:20:16 2021-02-23 17:56:50 [INFO] [TRAIN] epoch=163, iter=60550/80000, loss=0.8060, lr=0.002801, batch_cost=1.3545, reader_cost=0.0001 | ETA 07:19:04 2021-02-23 17:57:04 [INFO] [TRAIN] epoch=163, iter=60560/80000, loss=0.8242, lr=0.002799, batch_cost=1.3326, reader_cost=0.0001 | ETA 07:11:45 2021-02-23 17:57:18 [INFO] [TRAIN] epoch=163, iter=60570/80000, loss=0.8340, lr=0.002798, batch_cost=1.3905, reader_cost=0.0001 | ETA 07:30:18 2021-02-23 17:57:31 [INFO] [TRAIN] epoch=163, iter=60580/80000, loss=0.8648, lr=0.002797, batch_cost=1.3358, reader_cost=0.0001 | ETA 07:12:21 2021-02-23 17:57:45 [INFO] [TRAIN] epoch=163, iter=60590/80000, loss=0.7892, lr=0.002796, batch_cost=1.3680, reader_cost=0.0001 | ETA 07:22:33 2021-02-23 17:57:58 [INFO] [TRAIN] epoch=163, iter=60600/80000, loss=0.8338, lr=0.002794, batch_cost=1.3355, reader_cost=0.0001 | ETA 07:11:48 2021-02-23 17:58:12 [INFO] [TRAIN] epoch=163, iter=60610/80000, loss=0.8725, lr=0.002793, batch_cost=1.3669, reader_cost=0.0001 | ETA 07:21:44 2021-02-23 17:58:25 [INFO] [TRAIN] epoch=163, iter=60620/80000, loss=0.8329, lr=0.002792, batch_cost=1.3630, reader_cost=0.0001 | ETA 07:20:15 2021-02-23 17:58:39 [INFO] [TRAIN] epoch=163, iter=60630/80000, loss=0.8994, lr=0.002790, batch_cost=1.3625, reader_cost=0.0001 | ETA 07:19:51 2021-02-23 17:58:53 [INFO] [TRAIN] epoch=164, iter=60640/80000, loss=0.8056, lr=0.002789, batch_cost=1.4461, reader_cost=0.0898 | ETA 07:46:35 2021-02-23 17:59:07 [INFO] [TRAIN] epoch=164, iter=60650/80000, loss=0.8820, lr=0.002788, batch_cost=1.3511, reader_cost=0.0001 | ETA 07:15:44 2021-02-23 17:59:21 [INFO] [TRAIN] epoch=164, iter=60660/80000, loss=0.8161, lr=0.002786, batch_cost=1.3826, reader_cost=0.0001 | ETA 07:25:39 2021-02-23 17:59:35 [INFO] [TRAIN] epoch=164, iter=60670/80000, loss=0.8554, lr=0.002785, batch_cost=1.3901, reader_cost=0.0001 | ETA 07:27:50 2021-02-23 17:59:48 [INFO] [TRAIN] epoch=164, iter=60680/80000, loss=0.8408, lr=0.002784, batch_cost=1.3726, reader_cost=0.0001 | ETA 07:21:58 2021-02-23 18:00:02 [INFO] [TRAIN] epoch=164, iter=60690/80000, loss=0.7912, lr=0.002783, batch_cost=1.3440, reader_cost=0.0001 | ETA 07:12:32 2021-02-23 18:00:15 [INFO] [TRAIN] epoch=164, iter=60700/80000, loss=0.8304, lr=0.002781, batch_cost=1.3414, reader_cost=0.0001 | ETA 07:11:28 2021-02-23 18:00:29 [INFO] [TRAIN] epoch=164, iter=60710/80000, loss=0.8620, lr=0.002780, batch_cost=1.3948, reader_cost=0.0001 | ETA 07:28:25 2021-02-23 18:00:43 [INFO] [TRAIN] epoch=164, iter=60720/80000, loss=0.9247, lr=0.002779, batch_cost=1.3499, reader_cost=0.0001 | ETA 07:13:46 2021-02-23 18:00:56 [INFO] [TRAIN] epoch=164, iter=60730/80000, loss=0.8293, lr=0.002777, batch_cost=1.3749, reader_cost=0.0001 | ETA 07:21:34 2021-02-23 18:01:10 [INFO] [TRAIN] epoch=164, iter=60740/80000, loss=0.8631, lr=0.002776, batch_cost=1.3729, reader_cost=0.0001 | ETA 07:20:41 2021-02-23 18:01:24 [INFO] [TRAIN] epoch=164, iter=60750/80000, loss=0.8391, lr=0.002775, batch_cost=1.3631, reader_cost=0.0001 | ETA 07:17:19 2021-02-23 18:01:37 [INFO] [TRAIN] epoch=164, iter=60760/80000, loss=0.9325, lr=0.002773, batch_cost=1.3545, reader_cost=0.0001 | ETA 07:14:20 2021-02-23 18:01:51 [INFO] [TRAIN] epoch=164, iter=60770/80000, loss=0.7844, lr=0.002772, batch_cost=1.3913, reader_cost=0.0001 | ETA 07:25:55 2021-02-23 18:02:05 [INFO] [TRAIN] epoch=164, iter=60780/80000, loss=0.8460, lr=0.002771, batch_cost=1.3371, reader_cost=0.0001 | ETA 07:08:19 2021-02-23 18:02:18 [INFO] [TRAIN] epoch=164, iter=60790/80000, loss=0.8094, lr=0.002770, batch_cost=1.3491, reader_cost=0.0001 | ETA 07:11:55 2021-02-23 18:02:32 [INFO] [TRAIN] epoch=164, iter=60800/80000, loss=0.8134, lr=0.002768, batch_cost=1.3577, reader_cost=0.0001 | ETA 07:14:28 2021-02-23 18:02:45 [INFO] [TRAIN] epoch=164, iter=60810/80000, loss=0.8124, lr=0.002767, batch_cost=1.3667, reader_cost=0.0001 | ETA 07:17:07 2021-02-23 18:02:59 [INFO] [TRAIN] epoch=164, iter=60820/80000, loss=0.8591, lr=0.002766, batch_cost=1.3814, reader_cost=0.0001 | ETA 07:21:34 2021-02-23 18:03:13 [INFO] [TRAIN] epoch=164, iter=60830/80000, loss=0.9342, lr=0.002764, batch_cost=1.3627, reader_cost=0.0001 | ETA 07:15:22 2021-02-23 18:03:27 [INFO] [TRAIN] epoch=164, iter=60840/80000, loss=0.8448, lr=0.002763, batch_cost=1.4035, reader_cost=0.0001 | ETA 07:28:11 2021-02-23 18:03:40 [INFO] [TRAIN] epoch=164, iter=60850/80000, loss=0.8430, lr=0.002762, batch_cost=1.3430, reader_cost=0.0001 | ETA 07:08:38 2021-02-23 18:03:54 [INFO] [TRAIN] epoch=164, iter=60860/80000, loss=0.8486, lr=0.002760, batch_cost=1.3703, reader_cost=0.0001 | ETA 07:17:07 2021-02-23 18:04:07 [INFO] [TRAIN] epoch=164, iter=60870/80000, loss=0.8277, lr=0.002759, batch_cost=1.3525, reader_cost=0.0001 | ETA 07:11:12 2021-02-23 18:04:21 [INFO] [TRAIN] epoch=164, iter=60880/80000, loss=0.8274, lr=0.002758, batch_cost=1.3800, reader_cost=0.0001 | ETA 07:19:46 2021-02-23 18:04:35 [INFO] [TRAIN] epoch=164, iter=60890/80000, loss=0.7915, lr=0.002757, batch_cost=1.3619, reader_cost=0.0001 | ETA 07:13:45 2021-02-23 18:04:48 [INFO] [TRAIN] epoch=164, iter=60900/80000, loss=0.8524, lr=0.002755, batch_cost=1.3437, reader_cost=0.0001 | ETA 07:07:43 2021-02-23 18:05:02 [INFO] [TRAIN] epoch=164, iter=60910/80000, loss=0.8351, lr=0.002754, batch_cost=1.3881, reader_cost=0.0001 | ETA 07:21:38 2021-02-23 18:05:16 [INFO] [TRAIN] epoch=164, iter=60920/80000, loss=0.8059, lr=0.002753, batch_cost=1.3412, reader_cost=0.0001 | ETA 07:06:30 2021-02-23 18:05:29 [INFO] [TRAIN] epoch=164, iter=60930/80000, loss=0.8243, lr=0.002751, batch_cost=1.3644, reader_cost=0.0001 | ETA 07:13:39 2021-02-23 18:05:43 [INFO] [TRAIN] epoch=164, iter=60940/80000, loss=0.7487, lr=0.002750, batch_cost=1.3379, reader_cost=0.0001 | ETA 07:04:59 2021-02-23 18:05:57 [INFO] [TRAIN] epoch=164, iter=60950/80000, loss=0.8508, lr=0.002749, batch_cost=1.3996, reader_cost=0.0001 | ETA 07:24:22 2021-02-23 18:06:10 [INFO] [TRAIN] epoch=164, iter=60960/80000, loss=0.7845, lr=0.002748, batch_cost=1.3644, reader_cost=0.0001 | ETA 07:12:58 2021-02-23 18:06:24 [INFO] [TRAIN] epoch=164, iter=60970/80000, loss=0.8579, lr=0.002746, batch_cost=1.3828, reader_cost=0.0001 | ETA 07:18:34 2021-02-23 18:06:38 [INFO] [TRAIN] epoch=164, iter=60980/80000, loss=0.8270, lr=0.002745, batch_cost=1.3560, reader_cost=0.0001 | ETA 07:09:50 2021-02-23 18:06:51 [INFO] [TRAIN] epoch=164, iter=60990/80000, loss=0.9261, lr=0.002744, batch_cost=1.3564, reader_cost=0.0001 | ETA 07:09:45 2021-02-23 18:07:05 [INFO] [TRAIN] epoch=164, iter=61000/80000, loss=0.8041, lr=0.002742, batch_cost=1.3720, reader_cost=0.0001 | ETA 07:14:27 2021-02-23 18:07:05 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:09 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:01 - batch_cost: 0.2160 - reader cost: 0.0918  3/125 [..............................] - ETA: 55s - batch_cost: 0.2701 - reader cost: 0.1032  4/125 [..............................] - ETA: 53s - batch_cost: 0.3049 - reader cost: 0.1129 5/125 [>.............................] - ETA: 53s - batch_cost: 0.3347 - reader cost: 0.1272 6/125 [>.............................] - ETA: 53s - batch_cost: 0.3543 - reader cost: 0.1360 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3664 - reader cost: 0.1420 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3724 - reader cost: 0.1450 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3804 - reader cost: 0.1501 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3860 - reader cost: 0.1535 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3897 - reader cost: 0.1557 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3934 - reader cost: 0.1573 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3920 - reader cost: 0.1550 14/125 [==>...........................] - ETA: 47s - batch_cost: 0.3910 - reader cost: 0.1529 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3901 - reader cost: 0.1499 16/125 [==>...........................] - ETA: 46s - batch_cost: 0.3901 - reader cost: 0.1463 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3950 - reader cost: 0.1424 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3923 - reader cost: 0.1359 19/125 [===>..........................] - ETA: 44s - batch_cost: 0.3943 - reader cost: 0.1385 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3934 - reader cost: 0.1379 21/125 [====>.........................] - ETA: 43s - batch_cost: 0.3952 - reader cost: 0.1399 22/125 [====>.........................] - ETA: 43s - batch_cost: 0.3970 - reader cost: 0.1420 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.3992 - reader cost: 0.1444 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.4006 - reader cost: 0.1461 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4003 - reader cost: 0.1456 26/125 [=====>........................] - ETA: 41s - batch_cost: 0.4017 - reader cost: 0.1465 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4033 - reader cost: 0.1476 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4034 - reader cost: 0.1478 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4020 - reader cost: 0.1465 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4027 - reader cost: 0.1474 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.4036 - reader cost: 0.1485 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4052 - reader cost: 0.1495 33/125 [======>.......................] - ETA: 38s - batch_cost: 0.4032 - reader cost: 0.1476 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4019 - reader cost: 0.1466 35/125 [=======>......................] - ETA: 37s - batch_cost: 0.4024 - reader cost: 0.1472 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4029 - reader cost: 0.1478 37/125 [=======>......................] - ETA: 36s - batch_cost: 0.4038 - reader cost: 0.1488 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4033 - reader cost: 0.1485 39/125 [========>.....................] - ETA: 35s - batch_cost: 0.4035 - reader cost: 0.1483 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4044 - reader cost: 0.1493 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4049 - reader cost: 0.1500 42/125 [=========>....................] - ETA: 34s - batch_cost: 0.4042 - reader cost: 0.1494 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4048 - reader cost: 0.1500 44/125 [=========>....................] - ETA: 33s - batch_cost: 0.4055 - reader cost: 0.1508 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4061 - reader cost: 0.1516 46/125 [==========>...................] - ETA: 32s - batch_cost: 0.4053 - reader cost: 0.1509 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4059 - reader cost: 0.1516 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4053 - reader cost: 0.1509 49/125 [==========>...................] - ETA: 31s - batch_cost: 0.4053 - reader cost: 0.1509 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4057 - reader cost: 0.1513 51/125 [===========>..................] - ETA: 30s - batch_cost: 0.4051 - reader cost: 0.1508 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4054 - reader cost: 0.1512 53/125 [===========>..................] - ETA: 29s - batch_cost: 0.4059 - reader cost: 0.1518 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4052 - reader cost: 0.1512 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4056 - reader cost: 0.1516 56/125 [============>.................] - ETA: 28s - batch_cost: 0.4058 - reader cost: 0.1519 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4054 - reader cost: 0.1515 58/125 [============>.................] - ETA: 27s - batch_cost: 0.4062 - reader cost: 0.1525 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4070 - reader cost: 0.1532 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4071 - reader cost: 0.1533 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4067 - reader cost: 0.1528 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4070 - reader cost: 0.1530 63/125 [==============>...............] - ETA: 25s - batch_cost: 0.4071 - reader cost: 0.1532 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4064 - reader cost: 0.1524 65/125 [==============>...............] - ETA: 24s - batch_cost: 0.4068 - reader cost: 0.1529 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4069 - reader cost: 0.1529 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4071 - reader cost: 0.1532 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4075 - reader cost: 0.1536 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4078 - reader cost: 0.1539 70/125 [===============>..............] - ETA: 22s - batch_cost: 0.4074 - reader cost: 0.1533 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4067 - reader cost: 0.1526 72/125 [================>.............] - ETA: 21s - batch_cost: 0.4070 - reader cost: 0.1528 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4074 - reader cost: 0.1531 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4077 - reader cost: 0.1536 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4075 - reader cost: 0.1534 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4078 - reader cost: 0.1538 77/125 [=================>............] - ETA: 19s - batch_cost: 0.4082 - reader cost: 0.1542 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4079 - reader cost: 0.1538 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4078 - reader cost: 0.1536 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4079 - reader cost: 0.1536 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4083 - reader cost: 0.1540 82/125 [==================>...........] - ETA: 17s - batch_cost: 0.4080 - reader cost: 0.1535 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4083 - reader cost: 0.1538 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4085 - reader cost: 0.1541 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4087 - reader cost: 0.1544 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4089 - reader cost: 0.1546 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4093 - reader cost: 0.1550 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4090 - reader cost: 0.1547 89/125 [====================>.........] - ETA: 14s - batch_cost: 0.4087 - reader cost: 0.1544 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4087 - reader cost: 0.1541 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4090 - reader cost: 0.1545 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4093 - reader cost: 0.1549 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4090 - reader cost: 0.1545 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4091 - reader cost: 0.1546 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4092 - reader cost: 0.1548 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4091 - reader cost: 0.1546 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4091 - reader cost: 0.1547 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4093 - reader cost: 0.1545 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4094 - reader cost: 0.1546 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4098 - reader cost: 0.1548 101/125 [=======================>......] - ETA: 9s - batch_cost: 0.4099 - reader cost: 0.1551  102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4100 - reader cost: 0.1552 103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4102 - reader cost: 0.1555 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4101 - reader cost: 0.1553 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4103 - reader cost: 0.1556 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4104 - reader cost: 0.1557 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4105 - reader cost: 0.1559 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4106 - reader cost: 0.1560 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4108 - reader cost: 0.1562 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4110 - reader cost: 0.1564 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4108 - reader cost: 0.1562 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4109 - reader cost: 0.1563 113/125 [==========================>...] - ETA: 4s - batch_cost: 0.4111 - reader cost: 0.1566 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4114 - reader cost: 0.1568 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4118 - reader cost: 0.1573 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4121 - reader cost: 0.1576 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4124 - reader cost: 0.1578 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4121 - reader cost: 0.1576 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4122 - reader cost: 0.1577 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4122 - reader cost: 0.1578 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4123 - reader cost: 0.1579 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4120 - reader cost: 0.1576 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4116 - reader cost: 0.1573 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4117 - reader cost: 0.1574 125/125 [==============================] - 52s 416ms/step - batch_cost: 0.4119 - reader cost: 0.1576 2021-02-23 18:07:57 [INFO] [EVAL] #Images=500 mIoU=0.7778 Acc=0.9617 Kappa=0.9502 2021-02-23 18:07:57 [INFO] [EVAL] Class IoU: [0.9824 0.8569 0.9292 0.4197 0.6185 0.6858 0.7534 0.8258 0.9232 0.6475 0.9457 0.8404 0.6516 0.9443 0.5862 0.8902 0.8366 0.652 0.7886] 2021-02-23 18:07:57 [INFO] [EVAL] Class Acc: [0.9903 0.932 0.9591 0.8586 0.807 0.8376 0.8573 0.9103 0.9506 0.8576 0.9664 0.8995 0.7835 0.9607 0.9471 0.9477 0.9431 0.8479 0.8528] 2021-02-23 18:08:01 [INFO] [EVAL] The model with the best validation mIoU (0.7816) was saved at iter 44000. 2021-02-23 18:08:15 [INFO] [TRAIN] epoch=165, iter=61010/80000, loss=0.7965, lr=0.002741, batch_cost=1.4161, reader_cost=0.0782 | ETA 07:28:11 2021-02-23 18:08:29 [INFO] [TRAIN] epoch=165, iter=61020/80000, loss=0.7992, lr=0.002740, batch_cost=1.3743, reader_cost=0.0005 | ETA 07:14:43 2021-02-23 18:08:43 [INFO] [TRAIN] epoch=165, iter=61030/80000, loss=0.8456, lr=0.002738, batch_cost=1.3479, reader_cost=0.0001 | ETA 07:06:09 2021-02-23 18:08:56 [INFO] [TRAIN] epoch=165, iter=61040/80000, loss=0.8037, lr=0.002737, batch_cost=1.3715, reader_cost=0.0001 | ETA 07:13:24 2021-02-23 18:09:10 [INFO] [TRAIN] epoch=165, iter=61050/80000, loss=0.8210, lr=0.002736, batch_cost=1.3790, reader_cost=0.0001 | ETA 07:15:31 2021-02-23 18:09:24 [INFO] [TRAIN] epoch=165, iter=61060/80000, loss=0.8033, lr=0.002735, batch_cost=1.3930, reader_cost=0.0001 | ETA 07:19:43 2021-02-23 18:09:38 [INFO] [TRAIN] epoch=165, iter=61070/80000, loss=0.8677, lr=0.002733, batch_cost=1.3961, reader_cost=0.0001 | ETA 07:20:28 2021-02-23 18:09:52 [INFO] [TRAIN] epoch=165, iter=61080/80000, loss=0.8626, lr=0.002732, batch_cost=1.3745, reader_cost=0.0001 | ETA 07:13:25 2021-02-23 18:10:06 [INFO] [TRAIN] epoch=165, iter=61090/80000, loss=0.8197, lr=0.002731, batch_cost=1.3881, reader_cost=0.0001 | ETA 07:17:28 2021-02-23 18:10:19 [INFO] [TRAIN] epoch=165, iter=61100/80000, loss=0.8591, lr=0.002729, batch_cost=1.3552, reader_cost=0.0001 | ETA 07:06:54 2021-02-23 18:10:33 [INFO] [TRAIN] epoch=165, iter=61110/80000, loss=0.8193, lr=0.002728, batch_cost=1.3801, reader_cost=0.0001 | ETA 07:14:30 2021-02-23 18:10:47 [INFO] [TRAIN] epoch=165, iter=61120/80000, loss=0.7934, lr=0.002727, batch_cost=1.3765, reader_cost=0.0001 | ETA 07:13:07 2021-02-23 18:11:00 [INFO] [TRAIN] epoch=165, iter=61130/80000, loss=0.7548, lr=0.002725, batch_cost=1.3392, reader_cost=0.0001 | ETA 07:01:11 2021-02-23 18:11:14 [INFO] [TRAIN] epoch=165, iter=61140/80000, loss=0.9032, lr=0.002724, batch_cost=1.3913, reader_cost=0.0001 | ETA 07:17:19 2021-02-23 18:11:28 [INFO] [TRAIN] epoch=165, iter=61150/80000, loss=0.8537, lr=0.002723, batch_cost=1.3697, reader_cost=0.0001 | ETA 07:10:19 2021-02-23 18:11:41 [INFO] [TRAIN] epoch=165, iter=61160/80000, loss=0.8518, lr=0.002722, batch_cost=1.3623, reader_cost=0.0001 | ETA 07:07:45 2021-02-23 18:11:55 [INFO] [TRAIN] epoch=165, iter=61170/80000, loss=0.8008, lr=0.002720, batch_cost=1.3592, reader_cost=0.0001 | ETA 07:06:34 2021-02-23 18:12:09 [INFO] [TRAIN] epoch=165, iter=61180/80000, loss=0.8354, lr=0.002719, batch_cost=1.3578, reader_cost=0.0001 | ETA 07:05:53 2021-02-23 18:12:22 [INFO] [TRAIN] epoch=165, iter=61190/80000, loss=0.8515, lr=0.002718, batch_cost=1.3707, reader_cost=0.0001 | ETA 07:09:43 2021-02-23 18:12:36 [INFO] [TRAIN] epoch=165, iter=61200/80000, loss=0.8276, lr=0.002716, batch_cost=1.3899, reader_cost=0.0001 | ETA 07:15:30 2021-02-23 18:12:50 [INFO] [TRAIN] epoch=165, iter=61210/80000, loss=0.8024, lr=0.002715, batch_cost=1.3575, reader_cost=0.0001 | ETA 07:05:08 2021-02-23 18:13:03 [INFO] [TRAIN] epoch=165, iter=61220/80000, loss=0.8545, lr=0.002714, batch_cost=1.3590, reader_cost=0.0001 | ETA 07:05:21 2021-02-23 18:13:17 [INFO] [TRAIN] epoch=165, iter=61230/80000, loss=0.7748, lr=0.002712, batch_cost=1.3441, reader_cost=0.0001 | ETA 07:00:28 2021-02-23 18:13:30 [INFO] [TRAIN] epoch=165, iter=61240/80000, loss=0.8064, lr=0.002711, batch_cost=1.3714, reader_cost=0.0001 | ETA 07:08:47 2021-02-23 18:13:44 [INFO] [TRAIN] epoch=165, iter=61250/80000, loss=0.8133, lr=0.002710, batch_cost=1.3388, reader_cost=0.0001 | ETA 06:58:21 2021-02-23 18:13:58 [INFO] [TRAIN] epoch=165, iter=61260/80000, loss=0.8491, lr=0.002709, batch_cost=1.4069, reader_cost=0.0001 | ETA 07:19:25 2021-02-23 18:14:12 [INFO] [TRAIN] epoch=165, iter=61270/80000, loss=0.8534, lr=0.002707, batch_cost=1.3605, reader_cost=0.0001 | ETA 07:04:41 2021-02-23 18:14:25 [INFO] [TRAIN] epoch=165, iter=61280/80000, loss=0.8545, lr=0.002706, batch_cost=1.3583, reader_cost=0.0001 | ETA 07:03:47 2021-02-23 18:14:39 [INFO] [TRAIN] epoch=165, iter=61290/80000, loss=0.8186, lr=0.002705, batch_cost=1.3652, reader_cost=0.0001 | ETA 07:05:42 2021-02-23 18:14:52 [INFO] [TRAIN] epoch=165, iter=61300/80000, loss=0.8420, lr=0.002703, batch_cost=1.3558, reader_cost=0.0001 | ETA 07:02:32 2021-02-23 18:15:06 [INFO] [TRAIN] epoch=165, iter=61310/80000, loss=0.9572, lr=0.002702, batch_cost=1.3980, reader_cost=0.0001 | ETA 07:15:28 2021-02-23 18:15:20 [INFO] [TRAIN] epoch=165, iter=61320/80000, loss=0.8269, lr=0.002701, batch_cost=1.3734, reader_cost=0.0001 | ETA 07:07:34 2021-02-23 18:15:34 [INFO] [TRAIN] epoch=165, iter=61330/80000, loss=0.8647, lr=0.002699, batch_cost=1.3546, reader_cost=0.0001 | ETA 07:01:30 2021-02-23 18:15:47 [INFO] [TRAIN] epoch=165, iter=61340/80000, loss=0.8308, lr=0.002698, batch_cost=1.3591, reader_cost=0.0001 | ETA 07:02:41 2021-02-23 18:16:01 [INFO] [TRAIN] epoch=165, iter=61350/80000, loss=0.8676, lr=0.002697, batch_cost=1.3523, reader_cost=0.0001 | ETA 07:00:19 2021-02-23 18:16:14 [INFO] [TRAIN] epoch=165, iter=61360/80000, loss=0.8202, lr=0.002696, batch_cost=1.3491, reader_cost=0.0001 | ETA 06:59:07 2021-02-23 18:16:28 [INFO] [TRAIN] epoch=165, iter=61370/80000, loss=0.8348, lr=0.002694, batch_cost=1.3674, reader_cost=0.0001 | ETA 07:04:34 2021-02-23 18:16:41 [INFO] [TRAIN] epoch=165, iter=61380/80000, loss=0.8204, lr=0.002693, batch_cost=1.3318, reader_cost=0.0001 | ETA 06:53:17 2021-02-23 18:16:56 [INFO] [TRAIN] epoch=166, iter=61390/80000, loss=0.8683, lr=0.002692, batch_cost=1.4844, reader_cost=0.0594 | ETA 07:40:24 2021-02-23 18:17:10 [INFO] [TRAIN] epoch=166, iter=61400/80000, loss=0.8744, lr=0.002690, batch_cost=1.3690, reader_cost=0.0001 | ETA 07:04:22 2021-02-23 18:17:23 [INFO] [TRAIN] epoch=166, iter=61410/80000, loss=0.7818, lr=0.002689, batch_cost=1.3573, reader_cost=0.0001 | ETA 07:00:32 2021-02-23 18:17:37 [INFO] [TRAIN] epoch=166, iter=61420/80000, loss=0.8921, lr=0.002688, batch_cost=1.3456, reader_cost=0.0001 | ETA 06:56:40 2021-02-23 18:17:50 [INFO] [TRAIN] epoch=166, iter=61430/80000, loss=0.8064, lr=0.002686, batch_cost=1.3649, reader_cost=0.0001 | ETA 07:02:26 2021-02-23 18:18:04 [INFO] [TRAIN] epoch=166, iter=61440/80000, loss=0.8293, lr=0.002685, batch_cost=1.3734, reader_cost=0.0001 | ETA 07:04:50 2021-02-23 18:18:17 [INFO] [TRAIN] epoch=166, iter=61450/80000, loss=0.8112, lr=0.002684, batch_cost=1.3228, reader_cost=0.0001 | ETA 06:48:57 2021-02-23 18:18:31 [INFO] [TRAIN] epoch=166, iter=61460/80000, loss=0.8338, lr=0.002682, batch_cost=1.3665, reader_cost=0.0001 | ETA 07:02:15 2021-02-23 18:18:45 [INFO] [TRAIN] epoch=166, iter=61470/80000, loss=0.8298, lr=0.002681, batch_cost=1.3535, reader_cost=0.0001 | ETA 06:57:59 2021-02-23 18:18:58 [INFO] [TRAIN] epoch=166, iter=61480/80000, loss=0.8116, lr=0.002680, batch_cost=1.3755, reader_cost=0.0001 | ETA 07:04:33 2021-02-23 18:19:12 [INFO] [TRAIN] epoch=166, iter=61490/80000, loss=0.8162, lr=0.002679, batch_cost=1.3364, reader_cost=0.0001 | ETA 06:52:17 2021-02-23 18:19:25 [INFO] [TRAIN] epoch=166, iter=61500/80000, loss=0.8105, lr=0.002677, batch_cost=1.3609, reader_cost=0.0001 | ETA 06:59:37 2021-02-23 18:19:39 [INFO] [TRAIN] epoch=166, iter=61510/80000, loss=0.8537, lr=0.002676, batch_cost=1.3435, reader_cost=0.0001 | ETA 06:54:02 2021-02-23 18:19:52 [INFO] [TRAIN] epoch=166, iter=61520/80000, loss=0.8996, lr=0.002675, batch_cost=1.3652, reader_cost=0.0001 | ETA 07:00:28 2021-02-23 18:20:06 [INFO] [TRAIN] epoch=166, iter=61530/80000, loss=0.8237, lr=0.002673, batch_cost=1.3410, reader_cost=0.0001 | ETA 06:52:47 2021-02-23 18:20:19 [INFO] [TRAIN] epoch=166, iter=61540/80000, loss=0.8676, lr=0.002672, batch_cost=1.3579, reader_cost=0.0001 | ETA 06:57:47 2021-02-23 18:20:33 [INFO] [TRAIN] epoch=166, iter=61550/80000, loss=0.8574, lr=0.002671, batch_cost=1.3518, reader_cost=0.0001 | ETA 06:55:39 2021-02-23 18:20:47 [INFO] [TRAIN] epoch=166, iter=61560/80000, loss=0.8123, lr=0.002669, batch_cost=1.3610, reader_cost=0.0001 | ETA 06:58:15 2021-02-23 18:21:00 [INFO] [TRAIN] epoch=166, iter=61570/80000, loss=0.8123, lr=0.002668, batch_cost=1.3183, reader_cost=0.0001 | ETA 06:44:55 2021-02-23 18:21:14 [INFO] [TRAIN] epoch=166, iter=61580/80000, loss=0.8870, lr=0.002667, batch_cost=1.3839, reader_cost=0.0001 | ETA 07:04:52 2021-02-23 18:21:27 [INFO] [TRAIN] epoch=166, iter=61590/80000, loss=0.8038, lr=0.002666, batch_cost=1.3824, reader_cost=0.0001 | ETA 07:04:10 2021-02-23 18:21:41 [INFO] [TRAIN] epoch=166, iter=61600/80000, loss=0.8782, lr=0.002664, batch_cost=1.3605, reader_cost=0.0001 | ETA 06:57:14 2021-02-23 18:21:55 [INFO] [TRAIN] epoch=166, iter=61610/80000, loss=0.8093, lr=0.002663, batch_cost=1.3795, reader_cost=0.0001 | ETA 07:02:48 2021-02-23 18:22:08 [INFO] [TRAIN] epoch=166, iter=61620/80000, loss=0.8092, lr=0.002662, batch_cost=1.3569, reader_cost=0.0001 | ETA 06:55:39 2021-02-23 18:22:22 [INFO] [TRAIN] epoch=166, iter=61630/80000, loss=0.8463, lr=0.002660, batch_cost=1.3739, reader_cost=0.0001 | ETA 07:00:39 2021-02-23 18:22:36 [INFO] [TRAIN] epoch=166, iter=61640/80000, loss=0.8446, lr=0.002659, batch_cost=1.3806, reader_cost=0.0001 | ETA 07:02:28 2021-02-23 18:22:50 [INFO] [TRAIN] epoch=166, iter=61650/80000, loss=0.8593, lr=0.002658, batch_cost=1.3634, reader_cost=0.0001 | ETA 06:56:58 2021-02-23 18:23:03 [INFO] [TRAIN] epoch=166, iter=61660/80000, loss=0.8778, lr=0.002656, batch_cost=1.3784, reader_cost=0.0001 | ETA 07:01:19 2021-02-23 18:23:17 [INFO] [TRAIN] epoch=166, iter=61670/80000, loss=0.7898, lr=0.002655, batch_cost=1.3753, reader_cost=0.0001 | ETA 07:00:08 2021-02-23 18:23:31 [INFO] [TRAIN] epoch=166, iter=61680/80000, loss=0.8279, lr=0.002654, batch_cost=1.3846, reader_cost=0.0001 | ETA 07:02:45 2021-02-23 18:23:44 [INFO] [TRAIN] epoch=166, iter=61690/80000, loss=0.8454, lr=0.002653, batch_cost=1.3285, reader_cost=0.0001 | ETA 06:45:25 2021-02-23 18:23:58 [INFO] [TRAIN] epoch=166, iter=61700/80000, loss=0.8771, lr=0.002651, batch_cost=1.3503, reader_cost=0.0001 | ETA 06:51:50 2021-02-23 18:24:12 [INFO] [TRAIN] epoch=166, iter=61710/80000, loss=0.8957, lr=0.002650, batch_cost=1.3859, reader_cost=0.0001 | ETA 07:02:28 2021-02-23 18:24:25 [INFO] [TRAIN] epoch=166, iter=61720/80000, loss=0.8089, lr=0.002649, batch_cost=1.3407, reader_cost=0.0001 | ETA 06:48:28 2021-02-23 18:24:38 [INFO] [TRAIN] epoch=166, iter=61730/80000, loss=0.7956, lr=0.002647, batch_cost=1.3470, reader_cost=0.0001 | ETA 06:50:10 2021-02-23 18:24:52 [INFO] [TRAIN] epoch=166, iter=61740/80000, loss=0.9207, lr=0.002646, batch_cost=1.3743, reader_cost=0.0001 | ETA 06:58:14 2021-02-23 18:25:06 [INFO] [TRAIN] epoch=166, iter=61750/80000, loss=0.8809, lr=0.002645, batch_cost=1.3481, reader_cost=0.0001 | ETA 06:50:01 2021-02-23 18:25:20 [INFO] [TRAIN] epoch=167, iter=61760/80000, loss=0.8235, lr=0.002643, batch_cost=1.4517, reader_cost=0.0618 | ETA 07:21:18 2021-02-23 18:25:34 [INFO] [TRAIN] epoch=167, iter=61770/80000, loss=0.9013, lr=0.002642, batch_cost=1.3505, reader_cost=0.0001 | ETA 06:50:19 2021-02-23 18:25:47 [INFO] [TRAIN] epoch=167, iter=61780/80000, loss=0.8223, lr=0.002641, batch_cost=1.3324, reader_cost=0.0001 | ETA 06:44:36 2021-02-23 18:26:01 [INFO] [TRAIN] epoch=167, iter=61790/80000, loss=0.8397, lr=0.002639, batch_cost=1.3898, reader_cost=0.0001 | ETA 07:01:48 2021-02-23 18:26:15 [INFO] [TRAIN] epoch=167, iter=61800/80000, loss=0.7602, lr=0.002638, batch_cost=1.3724, reader_cost=0.0001 | ETA 06:56:17 2021-02-23 18:26:28 [INFO] [TRAIN] epoch=167, iter=61810/80000, loss=0.7907, lr=0.002637, batch_cost=1.3342, reader_cost=0.0001 | ETA 06:44:29 2021-02-23 18:26:41 [INFO] [TRAIN] epoch=167, iter=61820/80000, loss=0.8290, lr=0.002636, batch_cost=1.3524, reader_cost=0.0001 | ETA 06:49:46 2021-02-23 18:26:55 [INFO] [TRAIN] epoch=167, iter=61830/80000, loss=0.8202, lr=0.002634, batch_cost=1.3913, reader_cost=0.0001 | ETA 07:01:19 2021-02-23 18:27:09 [INFO] [TRAIN] epoch=167, iter=61840/80000, loss=0.8741, lr=0.002633, batch_cost=1.4019, reader_cost=0.0001 | ETA 07:04:19 2021-02-23 18:27:23 [INFO] [TRAIN] epoch=167, iter=61850/80000, loss=0.8053, lr=0.002632, batch_cost=1.3905, reader_cost=0.0001 | ETA 07:00:37 2021-02-23 18:27:37 [INFO] [TRAIN] epoch=167, iter=61860/80000, loss=0.7866, lr=0.002630, batch_cost=1.4140, reader_cost=0.0001 | ETA 07:07:29 2021-02-23 18:27:52 [INFO] [TRAIN] epoch=167, iter=61870/80000, loss=0.8225, lr=0.002629, batch_cost=1.4255, reader_cost=0.0001 | ETA 07:10:44 2021-02-23 18:28:06 [INFO] [TRAIN] epoch=167, iter=61880/80000, loss=0.8579, lr=0.002628, batch_cost=1.3876, reader_cost=0.0001 | ETA 06:59:02 2021-02-23 18:28:19 [INFO] [TRAIN] epoch=167, iter=61890/80000, loss=0.7887, lr=0.002626, batch_cost=1.3760, reader_cost=0.0001 | ETA 06:55:19 2021-02-23 18:28:33 [INFO] [TRAIN] epoch=167, iter=61900/80000, loss=0.8183, lr=0.002625, batch_cost=1.3713, reader_cost=0.0001 | ETA 06:53:41 2021-02-23 18:28:47 [INFO] [TRAIN] epoch=167, iter=61910/80000, loss=0.8793, lr=0.002624, batch_cost=1.3785, reader_cost=0.0001 | ETA 06:55:37 2021-02-23 18:29:00 [INFO] [TRAIN] epoch=167, iter=61920/80000, loss=0.8301, lr=0.002623, batch_cost=1.3593, reader_cost=0.0001 | ETA 06:49:35 2021-02-23 18:29:14 [INFO] [TRAIN] epoch=167, iter=61930/80000, loss=0.8596, lr=0.002621, batch_cost=1.3758, reader_cost=0.0001 | ETA 06:54:20 2021-02-23 18:29:28 [INFO] [TRAIN] epoch=167, iter=61940/80000, loss=0.8656, lr=0.002620, batch_cost=1.3846, reader_cost=0.0001 | ETA 06:56:46 2021-02-23 18:29:42 [INFO] [TRAIN] epoch=167, iter=61950/80000, loss=0.8100, lr=0.002619, batch_cost=1.3798, reader_cost=0.0001 | ETA 06:55:04 2021-02-23 18:29:56 [INFO] [TRAIN] epoch=167, iter=61960/80000, loss=0.8538, lr=0.002617, batch_cost=1.3825, reader_cost=0.0001 | ETA 06:55:40 2021-02-23 18:30:09 [INFO] [TRAIN] epoch=167, iter=61970/80000, loss=0.8569, lr=0.002616, batch_cost=1.3420, reader_cost=0.0001 | ETA 06:43:16 2021-02-23 18:30:23 [INFO] [TRAIN] epoch=167, iter=61980/80000, loss=0.7935, lr=0.002615, batch_cost=1.3959, reader_cost=0.0001 | ETA 06:59:14 2021-02-23 18:30:37 [INFO] [TRAIN] epoch=167, iter=61990/80000, loss=0.8395, lr=0.002613, batch_cost=1.3970, reader_cost=0.0001 | ETA 06:59:20 2021-02-23 18:30:50 [INFO] [TRAIN] epoch=167, iter=62000/80000, loss=0.8069, lr=0.002612, batch_cost=1.3247, reader_cost=0.0001 | ETA 06:37:25 2021-02-23 18:30:50 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:18 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:03 - batch_cost: 0.2003 - reader cost: 0.0773  3/125 [..............................] - ETA: 57s - batch_cost: 0.2580 - reader cost: 0.0922  4/125 [..............................] - ETA: 55s - batch_cost: 0.3029 - reader cost: 0.1146 5/125 [>.............................] - ETA: 53s - batch_cost: 0.3182 - reader cost: 0.1179 6/125 [>.............................] - ETA: 52s - batch_cost: 0.3371 - reader cost: 0.1171 7/125 [>.............................] - ETA: 51s - batch_cost: 0.3492 - reader cost: 0.1123 8/125 [>.............................] - ETA: 50s - batch_cost: 0.3557 - reader cost: 0.1125 9/125 [=>............................] - ETA: 50s - batch_cost: 0.3656 - reader cost: 0.1188 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3726 - reader cost: 0.1236 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3796 - reader cost: 0.1306 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3842 - reader cost: 0.1324 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3879 - reader cost: 0.1334 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3921 - reader cost: 0.1371 15/125 [==>...........................] - ETA: 48s - batch_cost: 0.3947 - reader cost: 0.1403 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3977 - reader cost: 0.1427 17/125 [===>..........................] - ETA: 47s - batch_cost: 0.3984 - reader cost: 0.1436 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.3971 - reader cost: 0.1424 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3986 - reader cost: 0.1439 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.3993 - reader cost: 0.1449 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4003 - reader cost: 0.1462 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4007 - reader cost: 0.1453 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4033 - reader cost: 0.1476 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4030 - reader cost: 0.1462 25/125 [=====>........................] - ETA: 43s - batch_cost: 0.4054 - reader cost: 0.1472 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4061 - reader cost: 0.1478 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4044 - reader cost: 0.1463 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4049 - reader cost: 0.1468 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4058 - reader cost: 0.1480 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4074 - reader cost: 0.1499 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4062 - reader cost: 0.1490 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4054 - reader cost: 0.1485 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4049 - reader cost: 0.1482 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4055 - reader cost: 0.1490 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4064 - reader cost: 0.1500 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4069 - reader cost: 0.1506 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4079 - reader cost: 0.1517 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4067 - reader cost: 0.1508 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4059 - reader cost: 0.1502 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4068 - reader cost: 0.1512 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4082 - reader cost: 0.1528 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4088 - reader cost: 0.1536 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4082 - reader cost: 0.1531 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4087 - reader cost: 0.1537 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4086 - reader cost: 0.1536 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4091 - reader cost: 0.1542 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4095 - reader cost: 0.1547 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4098 - reader cost: 0.1551 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4095 - reader cost: 0.1549 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4099 - reader cost: 0.1553 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4101 - reader cost: 0.1557 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4101 - reader cost: 0.1552 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4108 - reader cost: 0.1560 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4111 - reader cost: 0.1556 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4114 - reader cost: 0.1549 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4118 - reader cost: 0.1555 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4123 - reader cost: 0.1560 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4116 - reader cost: 0.1554 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4119 - reader cost: 0.1558 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4122 - reader cost: 0.1562 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4123 - reader cost: 0.1564 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4128 - reader cost: 0.1568 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4128 - reader cost: 0.1568 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4128 - reader cost: 0.1566 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4131 - reader cost: 0.1564 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4133 - reader cost: 0.1568 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4135 - reader cost: 0.1571 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4140 - reader cost: 0.1577 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4142 - reader cost: 0.1580 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4142 - reader cost: 0.1581 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4147 - reader cost: 0.1585 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4143 - reader cost: 0.1583 73/125 [================>.............] - ETA: 22s - batch_cost: 0.4147 - reader cost: 0.1587 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4141 - reader cost: 0.1582 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4143 - reader cost: 0.1584 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4146 - reader cost: 0.1586 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4146 - reader cost: 0.1587 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4149 - reader cost: 0.1588 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4150 - reader cost: 0.1589 80/125 [==================>...........] - ETA: 19s - batch_cost: 0.4145 - reader cost: 0.1585 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4146 - reader cost: 0.1587 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4148 - reader cost: 0.1588 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4149 - reader cost: 0.1591 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4150 - reader cost: 0.1593 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4152 - reader cost: 0.1595 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4149 - reader cost: 0.1592 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4147 - reader cost: 0.1591 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4149 - reader cost: 0.1593 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4151 - reader cost: 0.1596 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4153 - reader cost: 0.1597 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4153 - reader cost: 0.1597 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4154 - reader cost: 0.1598 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4155 - reader cost: 0.1600 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4159 - reader cost: 0.1604 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4161 - reader cost: 0.1607 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4165 - reader cost: 0.1610 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4160 - reader cost: 0.1605 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4163 - reader cost: 0.1609 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4165 - reader cost: 0.1610 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4166 - reader cost: 0.1612 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4166 - reader cost: 0.1612 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4168 - reader cost: 0.1614  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4169 - reader cost: 0.1615 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4170 - reader cost: 0.1616 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4172 - reader cost: 0.1618 106/125 [========================>.....] - ETA: 8s - batch_cost: 0.4167 - reader cost: 0.1614 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4168 - reader cost: 0.1615 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4168 - reader cost: 0.1615 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4170 - reader cost: 0.1617 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4172 - reader cost: 0.1620 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4173 - reader cost: 0.1621 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4174 - reader cost: 0.1622 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4175 - reader cost: 0.1623 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4175 - reader cost: 0.1623 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4175 - reader cost: 0.1623 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4170 - reader cost: 0.1619 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4172 - reader cost: 0.1620 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4171 - reader cost: 0.1620 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4171 - reader cost: 0.1621 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4173 - reader cost: 0.1622 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4170 - reader cost: 0.1620 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4172 - reader cost: 0.1620 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4173 - reader cost: 0.1622 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4174 - reader cost: 0.1623 125/125 [==============================] - 53s 422ms/step - batch_cost: 0.4169 - reader cost: 0.1619 2021-02-23 18:31:43 [INFO] [EVAL] #Images=500 mIoU=0.7914 Acc=0.9612 Kappa=0.9497 2021-02-23 18:31:43 [INFO] [EVAL] Class IoU: [0.9795 0.837 0.9286 0.4821 0.6363 0.666 0.7406 0.8163 0.9232 0.6385 0.9503 0.8397 0.6533 0.9535 0.8205 0.8565 0.8452 0.6753 0.7944] 2021-02-23 18:31:43 [INFO] [EVAL] Class Acc: [0.9903 0.9046 0.957 0.825 0.8767 0.8645 0.8536 0.908 0.9531 0.8098 0.9644 0.8975 0.7861 0.9712 0.9521 0.9711 0.9346 0.8158 0.8666] 2021-02-23 18:31:50 [INFO] [EVAL] The model with the best validation mIoU (0.7914) was saved at iter 62000. 2021-02-23 18:32:03 [INFO] [TRAIN] epoch=167, iter=62010/80000, loss=0.8219, lr=0.002611, batch_cost=1.3502, reader_cost=0.0001 | ETA 06:44:49 2021-02-23 18:32:17 [INFO] [TRAIN] epoch=167, iter=62020/80000, loss=0.8047, lr=0.002609, batch_cost=1.3492, reader_cost=0.0001 | ETA 06:44:18 2021-02-23 18:32:30 [INFO] [TRAIN] epoch=167, iter=62030/80000, loss=0.7803, lr=0.002608, batch_cost=1.3366, reader_cost=0.0001 | ETA 06:40:18 2021-02-23 18:32:43 [INFO] [TRAIN] epoch=167, iter=62040/80000, loss=0.8448, lr=0.002607, batch_cost=1.3440, reader_cost=0.0001 | ETA 06:42:18 2021-02-23 18:32:57 [INFO] [TRAIN] epoch=167, iter=62050/80000, loss=0.8979, lr=0.002606, batch_cost=1.3900, reader_cost=0.0001 | ETA 06:55:51 2021-02-23 18:33:12 [INFO] [TRAIN] epoch=167, iter=62060/80000, loss=0.8219, lr=0.002604, batch_cost=1.4280, reader_cost=0.0001 | ETA 07:06:58 2021-02-23 18:33:26 [INFO] [TRAIN] epoch=167, iter=62070/80000, loss=0.8093, lr=0.002603, batch_cost=1.4048, reader_cost=0.0001 | ETA 06:59:48 2021-02-23 18:33:39 [INFO] [TRAIN] epoch=167, iter=62080/80000, loss=0.8291, lr=0.002602, batch_cost=1.3566, reader_cost=0.0001 | ETA 06:45:10 2021-02-23 18:33:53 [INFO] [TRAIN] epoch=167, iter=62090/80000, loss=0.7492, lr=0.002600, batch_cost=1.3718, reader_cost=0.0001 | ETA 06:49:28 2021-02-23 18:34:07 [INFO] [TRAIN] epoch=167, iter=62100/80000, loss=0.8035, lr=0.002599, batch_cost=1.3653, reader_cost=0.0001 | ETA 06:47:19 2021-02-23 18:34:20 [INFO] [TRAIN] epoch=167, iter=62110/80000, loss=0.8148, lr=0.002598, batch_cost=1.3750, reader_cost=0.0001 | ETA 06:49:59 2021-02-23 18:34:34 [INFO] [TRAIN] epoch=167, iter=62120/80000, loss=0.8548, lr=0.002596, batch_cost=1.3332, reader_cost=0.0001 | ETA 06:37:18 2021-02-23 18:34:48 [INFO] [TRAIN] epoch=168, iter=62130/80000, loss=0.7704, lr=0.002595, batch_cost=1.4415, reader_cost=0.0665 | ETA 07:09:19 2021-02-23 18:35:02 [INFO] [TRAIN] epoch=168, iter=62140/80000, loss=0.8371, lr=0.002594, batch_cost=1.3651, reader_cost=0.0001 | ETA 06:46:20 2021-02-23 18:35:16 [INFO] [TRAIN] epoch=168, iter=62150/80000, loss=0.8367, lr=0.002592, batch_cost=1.3787, reader_cost=0.0001 | ETA 06:50:09 2021-02-23 18:35:30 [INFO] [TRAIN] epoch=168, iter=62160/80000, loss=0.8789, lr=0.002591, batch_cost=1.3993, reader_cost=0.0001 | ETA 06:56:04 2021-02-23 18:35:43 [INFO] [TRAIN] epoch=168, iter=62170/80000, loss=0.8297, lr=0.002590, batch_cost=1.3826, reader_cost=0.0001 | ETA 06:50:51 2021-02-23 18:35:57 [INFO] [TRAIN] epoch=168, iter=62180/80000, loss=0.8201, lr=0.002589, batch_cost=1.3465, reader_cost=0.0001 | ETA 06:39:53 2021-02-23 18:36:10 [INFO] [TRAIN] epoch=168, iter=62190/80000, loss=0.8033, lr=0.002587, batch_cost=1.3503, reader_cost=0.0001 | ETA 06:40:48 2021-02-23 18:36:24 [INFO] [TRAIN] epoch=168, iter=62200/80000, loss=0.7783, lr=0.002586, batch_cost=1.3661, reader_cost=0.0001 | ETA 06:45:17 2021-02-23 18:36:38 [INFO] [TRAIN] epoch=168, iter=62210/80000, loss=0.9506, lr=0.002585, batch_cost=1.3622, reader_cost=0.0001 | ETA 06:43:53 2021-02-23 18:36:52 [INFO] [TRAIN] epoch=168, iter=62220/80000, loss=0.8062, lr=0.002583, batch_cost=1.3852, reader_cost=0.0001 | ETA 06:50:28 2021-02-23 18:37:05 [INFO] [TRAIN] epoch=168, iter=62230/80000, loss=0.8134, lr=0.002582, batch_cost=1.3588, reader_cost=0.0001 | ETA 06:42:25 2021-02-23 18:37:19 [INFO] [TRAIN] epoch=168, iter=62240/80000, loss=0.8149, lr=0.002581, batch_cost=1.3432, reader_cost=0.0001 | ETA 06:37:35 2021-02-23 18:37:32 [INFO] [TRAIN] epoch=168, iter=62250/80000, loss=0.8712, lr=0.002579, batch_cost=1.3374, reader_cost=0.0001 | ETA 06:35:37 2021-02-23 18:37:45 [INFO] [TRAIN] epoch=168, iter=62260/80000, loss=0.8496, lr=0.002578, batch_cost=1.3558, reader_cost=0.0001 | ETA 06:40:51 2021-02-23 18:37:59 [INFO] [TRAIN] epoch=168, iter=62270/80000, loss=0.8533, lr=0.002577, batch_cost=1.3824, reader_cost=0.0001 | ETA 06:48:29 2021-02-23 18:38:13 [INFO] [TRAIN] epoch=168, iter=62280/80000, loss=0.9019, lr=0.002575, batch_cost=1.3646, reader_cost=0.0001 | ETA 06:43:00 2021-02-23 18:38:26 [INFO] [TRAIN] epoch=168, iter=62290/80000, loss=0.8810, lr=0.002574, batch_cost=1.3394, reader_cost=0.0001 | ETA 06:35:20 2021-02-23 18:38:40 [INFO] [TRAIN] epoch=168, iter=62300/80000, loss=0.8448, lr=0.002573, batch_cost=1.3650, reader_cost=0.0001 | ETA 06:42:40 2021-02-23 18:38:54 [INFO] [TRAIN] epoch=168, iter=62310/80000, loss=0.8248, lr=0.002572, batch_cost=1.3690, reader_cost=0.0001 | ETA 06:43:38 2021-02-23 18:39:07 [INFO] [TRAIN] epoch=168, iter=62320/80000, loss=0.8880, lr=0.002570, batch_cost=1.3648, reader_cost=0.0001 | ETA 06:42:10 2021-02-23 18:39:21 [INFO] [TRAIN] epoch=168, iter=62330/80000, loss=0.7936, lr=0.002569, batch_cost=1.3619, reader_cost=0.0001 | ETA 06:41:05 2021-02-23 18:39:35 [INFO] [TRAIN] epoch=168, iter=62340/80000, loss=0.8337, lr=0.002568, batch_cost=1.3651, reader_cost=0.0001 | ETA 06:41:46 2021-02-23 18:39:48 [INFO] [TRAIN] epoch=168, iter=62350/80000, loss=0.8270, lr=0.002566, batch_cost=1.3832, reader_cost=0.0001 | ETA 06:46:54 2021-02-23 18:40:02 [INFO] [TRAIN] epoch=168, iter=62360/80000, loss=0.7745, lr=0.002565, batch_cost=1.3542, reader_cost=0.0001 | ETA 06:38:08 2021-02-23 18:40:16 [INFO] [TRAIN] epoch=168, iter=62370/80000, loss=0.8447, lr=0.002564, batch_cost=1.3566, reader_cost=0.0001 | ETA 06:38:36 2021-02-23 18:40:29 [INFO] [TRAIN] epoch=168, iter=62380/80000, loss=0.8652, lr=0.002562, batch_cost=1.3665, reader_cost=0.0001 | ETA 06:41:18 2021-02-23 18:40:43 [INFO] [TRAIN] epoch=168, iter=62390/80000, loss=1.0369, lr=0.002561, batch_cost=1.3721, reader_cost=0.0001 | ETA 06:42:42 2021-02-23 18:40:57 [INFO] [TRAIN] epoch=168, iter=62400/80000, loss=0.7746, lr=0.002560, batch_cost=1.3931, reader_cost=0.0001 | ETA 06:48:38 2021-02-23 18:41:10 [INFO] [TRAIN] epoch=168, iter=62410/80000, loss=0.7725, lr=0.002558, batch_cost=1.3624, reader_cost=0.0001 | ETA 06:39:23 2021-02-23 18:41:24 [INFO] [TRAIN] epoch=168, iter=62420/80000, loss=0.8359, lr=0.002557, batch_cost=1.3747, reader_cost=0.0001 | ETA 06:42:47 2021-02-23 18:41:38 [INFO] [TRAIN] epoch=168, iter=62430/80000, loss=0.7654, lr=0.002556, batch_cost=1.3437, reader_cost=0.0001 | ETA 06:33:28 2021-02-23 18:41:51 [INFO] [TRAIN] epoch=168, iter=62440/80000, loss=0.9548, lr=0.002555, batch_cost=1.3717, reader_cost=0.0001 | ETA 06:41:27 2021-02-23 18:42:05 [INFO] [TRAIN] epoch=168, iter=62450/80000, loss=0.8543, lr=0.002553, batch_cost=1.3687, reader_cost=0.0001 | ETA 06:40:20 2021-02-23 18:42:19 [INFO] [TRAIN] epoch=168, iter=62460/80000, loss=0.8586, lr=0.002552, batch_cost=1.3429, reader_cost=0.0001 | ETA 06:32:34 2021-02-23 18:42:32 [INFO] [TRAIN] epoch=168, iter=62470/80000, loss=0.8726, lr=0.002551, batch_cost=1.3397, reader_cost=0.0001 | ETA 06:31:25 2021-02-23 18:42:46 [INFO] [TRAIN] epoch=168, iter=62480/80000, loss=0.8777, lr=0.002549, batch_cost=1.3745, reader_cost=0.0001 | ETA 06:41:21 2021-02-23 18:42:59 [INFO] [TRAIN] epoch=168, iter=62490/80000, loss=0.9176, lr=0.002548, batch_cost=1.3403, reader_cost=0.0001 | ETA 06:31:08 2021-02-23 18:43:13 [INFO] [TRAIN] epoch=169, iter=62500/80000, loss=0.9067, lr=0.002547, batch_cost=1.4311, reader_cost=0.0905 | ETA 06:57:24 2021-02-23 18:43:27 [INFO] [TRAIN] epoch=169, iter=62510/80000, loss=0.8953, lr=0.002545, batch_cost=1.3574, reader_cost=0.0001 | ETA 06:35:41 2021-02-23 18:43:40 [INFO] [TRAIN] epoch=169, iter=62520/80000, loss=0.8504, lr=0.002544, batch_cost=1.3497, reader_cost=0.0001 | ETA 06:33:12 2021-02-23 18:43:54 [INFO] [TRAIN] epoch=169, iter=62530/80000, loss=0.7972, lr=0.002543, batch_cost=1.3826, reader_cost=0.0001 | ETA 06:42:34 2021-02-23 18:44:08 [INFO] [TRAIN] epoch=169, iter=62540/80000, loss=0.8066, lr=0.002541, batch_cost=1.3513, reader_cost=0.0001 | ETA 06:33:14 2021-02-23 18:44:22 [INFO] [TRAIN] epoch=169, iter=62550/80000, loss=0.8125, lr=0.002540, batch_cost=1.3747, reader_cost=0.0001 | ETA 06:39:48 2021-02-23 18:44:35 [INFO] [TRAIN] epoch=169, iter=62560/80000, loss=0.8269, lr=0.002539, batch_cost=1.3421, reader_cost=0.0001 | ETA 06:30:07 2021-02-23 18:44:48 [INFO] [TRAIN] epoch=169, iter=62570/80000, loss=0.8547, lr=0.002538, batch_cost=1.3348, reader_cost=0.0001 | ETA 06:27:45 2021-02-23 18:45:02 [INFO] [TRAIN] epoch=169, iter=62580/80000, loss=0.7806, lr=0.002536, batch_cost=1.3461, reader_cost=0.0001 | ETA 06:30:49 2021-02-23 18:45:15 [INFO] [TRAIN] epoch=169, iter=62590/80000, loss=0.8594, lr=0.002535, batch_cost=1.3489, reader_cost=0.0001 | ETA 06:31:24 2021-02-23 18:45:29 [INFO] [TRAIN] epoch=169, iter=62600/80000, loss=0.8261, lr=0.002534, batch_cost=1.3821, reader_cost=0.0001 | ETA 06:40:48 2021-02-23 18:45:42 [INFO] [TRAIN] epoch=169, iter=62610/80000, loss=0.8774, lr=0.002532, batch_cost=1.3390, reader_cost=0.0001 | ETA 06:28:05 2021-02-23 18:45:56 [INFO] [TRAIN] epoch=169, iter=62620/80000, loss=0.7870, lr=0.002531, batch_cost=1.3510, reader_cost=0.0001 | ETA 06:31:19 2021-02-23 18:46:09 [INFO] [TRAIN] epoch=169, iter=62630/80000, loss=0.8426, lr=0.002530, batch_cost=1.3409, reader_cost=0.0001 | ETA 06:28:10 2021-02-23 18:46:23 [INFO] [TRAIN] epoch=169, iter=62640/80000, loss=0.8871, lr=0.002528, batch_cost=1.3660, reader_cost=0.0001 | ETA 06:35:13 2021-02-23 18:46:37 [INFO] [TRAIN] epoch=169, iter=62650/80000, loss=0.8174, lr=0.002527, batch_cost=1.3491, reader_cost=0.0001 | ETA 06:30:06 2021-02-23 18:46:50 [INFO] [TRAIN] epoch=169, iter=62660/80000, loss=0.8923, lr=0.002526, batch_cost=1.3700, reader_cost=0.0001 | ETA 06:35:55 2021-02-23 18:47:04 [INFO] [TRAIN] epoch=169, iter=62670/80000, loss=0.7920, lr=0.002524, batch_cost=1.3768, reader_cost=0.0001 | ETA 06:37:39 2021-02-23 18:47:18 [INFO] [TRAIN] epoch=169, iter=62680/80000, loss=0.8651, lr=0.002523, batch_cost=1.3733, reader_cost=0.0001 | ETA 06:36:25 2021-02-23 18:47:32 [INFO] [TRAIN] epoch=169, iter=62690/80000, loss=0.8940, lr=0.002522, batch_cost=1.3780, reader_cost=0.0001 | ETA 06:37:33 2021-02-23 18:47:45 [INFO] [TRAIN] epoch=169, iter=62700/80000, loss=0.8750, lr=0.002520, batch_cost=1.3428, reader_cost=0.0001 | ETA 06:27:10 2021-02-23 18:47:58 [INFO] [TRAIN] epoch=169, iter=62710/80000, loss=0.8066, lr=0.002519, batch_cost=1.3473, reader_cost=0.0001 | ETA 06:28:14 2021-02-23 18:48:12 [INFO] [TRAIN] epoch=169, iter=62720/80000, loss=0.9206, lr=0.002518, batch_cost=1.3911, reader_cost=0.0001 | ETA 06:40:38 2021-02-23 18:48:26 [INFO] [TRAIN] epoch=169, iter=62730/80000, loss=0.8037, lr=0.002517, batch_cost=1.3899, reader_cost=0.0001 | ETA 06:40:03 2021-02-23 18:48:40 [INFO] [TRAIN] epoch=169, iter=62740/80000, loss=0.8335, lr=0.002515, batch_cost=1.3505, reader_cost=0.0001 | ETA 06:28:29 2021-02-23 18:48:53 [INFO] [TRAIN] epoch=169, iter=62750/80000, loss=0.8244, lr=0.002514, batch_cost=1.3650, reader_cost=0.0001 | ETA 06:32:26 2021-02-23 18:49:07 [INFO] [TRAIN] epoch=169, iter=62760/80000, loss=0.9034, lr=0.002513, batch_cost=1.3612, reader_cost=0.0001 | ETA 06:31:07 2021-02-23 18:49:21 [INFO] [TRAIN] epoch=169, iter=62770/80000, loss=0.8311, lr=0.002511, batch_cost=1.3849, reader_cost=0.0001 | ETA 06:37:42 2021-02-23 18:49:35 [INFO] [TRAIN] epoch=169, iter=62780/80000, loss=0.8287, lr=0.002510, batch_cost=1.3987, reader_cost=0.0001 | ETA 06:41:26 2021-02-23 18:49:48 [INFO] [TRAIN] epoch=169, iter=62790/80000, loss=0.8151, lr=0.002509, batch_cost=1.3612, reader_cost=0.0001 | ETA 06:30:26 2021-02-23 18:50:02 [INFO] [TRAIN] epoch=169, iter=62800/80000, loss=0.8894, lr=0.002507, batch_cost=1.3975, reader_cost=0.0001 | ETA 06:40:37 2021-02-23 18:50:16 [INFO] [TRAIN] epoch=169, iter=62810/80000, loss=0.8094, lr=0.002506, batch_cost=1.3847, reader_cost=0.0001 | ETA 06:36:43 2021-02-23 18:50:30 [INFO] [TRAIN] epoch=169, iter=62820/80000, loss=0.8216, lr=0.002505, batch_cost=1.3708, reader_cost=0.0001 | ETA 06:32:30 2021-02-23 18:50:44 [INFO] [TRAIN] epoch=169, iter=62830/80000, loss=0.7983, lr=0.002503, batch_cost=1.3676, reader_cost=0.0001 | ETA 06:31:22 2021-02-23 18:50:57 [INFO] [TRAIN] epoch=169, iter=62840/80000, loss=0.8766, lr=0.002502, batch_cost=1.3511, reader_cost=0.0001 | ETA 06:26:25 2021-02-23 18:51:11 [INFO] [TRAIN] epoch=169, iter=62850/80000, loss=0.8690, lr=0.002501, batch_cost=1.3555, reader_cost=0.0001 | ETA 06:27:27 2021-02-23 18:51:25 [INFO] [TRAIN] epoch=169, iter=62860/80000, loss=0.8579, lr=0.002499, batch_cost=1.3801, reader_cost=0.0001 | ETA 06:34:15 2021-02-23 18:51:39 [INFO] [TRAIN] epoch=170, iter=62870/80000, loss=0.8202, lr=0.002498, batch_cost=1.4643, reader_cost=0.0791 | ETA 06:58:02 2021-02-23 18:51:53 [INFO] [TRAIN] epoch=170, iter=62880/80000, loss=0.7884, lr=0.002497, batch_cost=1.4119, reader_cost=0.0001 | ETA 06:42:51 2021-02-23 18:52:07 [INFO] [TRAIN] epoch=170, iter=62890/80000, loss=1.0305, lr=0.002496, batch_cost=1.3675, reader_cost=0.0001 | ETA 06:29:57 2021-02-23 18:52:21 [INFO] [TRAIN] epoch=170, iter=62900/80000, loss=0.8265, lr=0.002494, batch_cost=1.3886, reader_cost=0.0001 | ETA 06:35:45 2021-02-23 18:52:35 [INFO] [TRAIN] epoch=170, iter=62910/80000, loss=0.7854, lr=0.002493, batch_cost=1.3795, reader_cost=0.0001 | ETA 06:32:55 2021-02-23 18:52:48 [INFO] [TRAIN] epoch=170, iter=62920/80000, loss=0.8425, lr=0.002492, batch_cost=1.3486, reader_cost=0.0001 | ETA 06:23:53 2021-02-23 18:53:02 [INFO] [TRAIN] epoch=170, iter=62930/80000, loss=0.7462, lr=0.002490, batch_cost=1.3603, reader_cost=0.0001 | ETA 06:27:00 2021-02-23 18:53:16 [INFO] [TRAIN] epoch=170, iter=62940/80000, loss=0.7828, lr=0.002489, batch_cost=1.3884, reader_cost=0.0001 | ETA 06:34:45 2021-02-23 18:53:29 [INFO] [TRAIN] epoch=170, iter=62950/80000, loss=0.8429, lr=0.002488, batch_cost=1.3755, reader_cost=0.0001 | ETA 06:30:51 2021-02-23 18:53:43 [INFO] [TRAIN] epoch=170, iter=62960/80000, loss=0.8499, lr=0.002486, batch_cost=1.3652, reader_cost=0.0001 | ETA 06:27:42 2021-02-23 18:53:57 [INFO] [TRAIN] epoch=170, iter=62970/80000, loss=0.8680, lr=0.002485, batch_cost=1.3527, reader_cost=0.0001 | ETA 06:23:56 2021-02-23 18:54:10 [INFO] [TRAIN] epoch=170, iter=62980/80000, loss=0.8125, lr=0.002484, batch_cost=1.3595, reader_cost=0.0001 | ETA 06:25:39 2021-02-23 18:54:24 [INFO] [TRAIN] epoch=170, iter=62990/80000, loss=0.8729, lr=0.002482, batch_cost=1.3855, reader_cost=0.0001 | ETA 06:32:47 2021-02-23 18:54:38 [INFO] [TRAIN] epoch=170, iter=63000/80000, loss=0.8198, lr=0.002481, batch_cost=1.3624, reader_cost=0.0001 | ETA 06:26:01 2021-02-23 18:54:38 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:15 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:03 - batch_cost: 0.2145 - reader cost: 0.0876  3/125 [..............................] - ETA: 59s - batch_cost: 0.2868 - reader cost: 0.1185  4/125 [..............................] - ETA: 56s - batch_cost: 0.3164 - reader cost: 0.1279 5/125 [>.............................] - ETA: 56s - batch_cost: 0.3451 - reader cost: 0.1443 6/125 [>.............................] - ETA: 54s - batch_cost: 0.3592 - reader cost: 0.1503 7/125 [>.............................] - ETA: 53s - batch_cost: 0.3643 - reader cost: 0.1493 8/125 [>.............................] - ETA: 52s - batch_cost: 0.3768 - reader cost: 0.1563 9/125 [=>............................] - ETA: 52s - batch_cost: 0.3843 - reader cost: 0.1592 10/125 [=>............................] - ETA: 51s - batch_cost: 0.3849 - reader cost: 0.1572 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3846 - reader cost: 0.1542 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3857 - reader cost: 0.1534 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3881 - reader cost: 0.1547 14/125 [==>...........................] - ETA: 47s - batch_cost: 0.3884 - reader cost: 0.1535 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3905 - reader cost: 0.1537 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3938 - reader cost: 0.1558 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3960 - reader cost: 0.1562 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.3976 - reader cost: 0.1528 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.4002 - reader cost: 0.1534 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4016 - reader cost: 0.1544 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4004 - reader cost: 0.1523 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4014 - reader cost: 0.1531 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4023 - reader cost: 0.1523 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4032 - reader cost: 0.1513 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4042 - reader cost: 0.1505 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4048 - reader cost: 0.1500 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4057 - reader cost: 0.1510 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4066 - reader cost: 0.1519 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4072 - reader cost: 0.1527 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4084 - reader cost: 0.1538 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4076 - reader cost: 0.1532 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4067 - reader cost: 0.1522 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4075 - reader cost: 0.1532 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4080 - reader cost: 0.1537 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4087 - reader cost: 0.1545 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4081 - reader cost: 0.1537 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4074 - reader cost: 0.1530 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4083 - reader cost: 0.1540 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4093 - reader cost: 0.1546 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4101 - reader cost: 0.1551 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4103 - reader cost: 0.1553 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4111 - reader cost: 0.1560 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4117 - reader cost: 0.1567 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4123 - reader cost: 0.1572 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4126 - reader cost: 0.1576 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4130 - reader cost: 0.1582 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4136 - reader cost: 0.1587 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4139 - reader cost: 0.1591 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4138 - reader cost: 0.1588 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4141 - reader cost: 0.1589 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4133 - reader cost: 0.1580 52/125 [===========>..................] - ETA: 31s - batch_cost: 0.4136 - reader cost: 0.1583 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4137 - reader cost: 0.1585 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4141 - reader cost: 0.1590 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4144 - reader cost: 0.1592 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4139 - reader cost: 0.1587 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4142 - reader cost: 0.1590 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4143 - reader cost: 0.1592 59/125 [=============>................] - ETA: 28s - batch_cost: 0.4146 - reader cost: 0.1596 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4147 - reader cost: 0.1597 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4142 - reader cost: 0.1592 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4133 - reader cost: 0.1583 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4128 - reader cost: 0.1579 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4131 - reader cost: 0.1583 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4128 - reader cost: 0.1580 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4132 - reader cost: 0.1584 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4135 - reader cost: 0.1584 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4135 - reader cost: 0.1585 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4140 - reader cost: 0.1590 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4134 - reader cost: 0.1585 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4129 - reader cost: 0.1579 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4122 - reader cost: 0.1573 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4124 - reader cost: 0.1575 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4127 - reader cost: 0.1577 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4128 - reader cost: 0.1579 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4127 - reader cost: 0.1578 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4128 - reader cost: 0.1579 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4131 - reader cost: 0.1582 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4136 - reader cost: 0.1588 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4140 - reader cost: 0.1591 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4142 - reader cost: 0.1593 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4144 - reader cost: 0.1596 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4140 - reader cost: 0.1593 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4144 - reader cost: 0.1597 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4146 - reader cost: 0.1598 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4146 - reader cost: 0.1599 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4142 - reader cost: 0.1595 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4142 - reader cost: 0.1594 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4145 - reader cost: 0.1597 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4148 - reader cost: 0.1600 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4144 - reader cost: 0.1597 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4146 - reader cost: 0.1599 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4141 - reader cost: 0.1593 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4142 - reader cost: 0.1594 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4142 - reader cost: 0.1595 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4140 - reader cost: 0.1593 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4142 - reader cost: 0.1595 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4143 - reader cost: 0.1596 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4144 - reader cost: 0.1597 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4146 - reader cost: 0.1598 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4148 - reader cost: 0.1601 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4149 - reader cost: 0.1602  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4151 - reader cost: 0.1603 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4152 - reader cost: 0.1604 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4154 - reader cost: 0.1606 106/125 [========================>.....] - ETA: 8s - batch_cost: 0.4155 - reader cost: 0.1607 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4158 - reader cost: 0.1609 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4157 - reader cost: 0.1609 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4158 - reader cost: 0.1610 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4157 - reader cost: 0.1608 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4154 - reader cost: 0.1606 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4156 - reader cost: 0.1608 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4152 - reader cost: 0.1605 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4153 - reader cost: 0.1606 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4154 - reader cost: 0.1606 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4155 - reader cost: 0.1608 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4156 - reader cost: 0.1609 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4152 - reader cost: 0.1605 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4153 - reader cost: 0.1606 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4150 - reader cost: 0.1604 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4147 - reader cost: 0.1599 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4142 - reader cost: 0.1595 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4143 - reader cost: 0.1596 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4143 - reader cost: 0.1597 125/125 [==============================] - 52s 419ms/step - batch_cost: 0.4140 - reader cost: 0.1594 2021-02-23 18:55:30 [INFO] [EVAL] #Images=500 mIoU=0.7909 Acc=0.9620 Kappa=0.9506 2021-02-23 18:55:30 [INFO] [EVAL] Class IoU: [0.9815 0.8463 0.9269 0.5224 0.6345 0.6788 0.7482 0.8199 0.9256 0.6162 0.9494 0.8369 0.6326 0.955 0.7992 0.8909 0.817 0.6564 0.79 ] 2021-02-23 18:55:30 [INFO] [EVAL] Class Acc: [0.9917 0.897 0.9495 0.8181 0.8341 0.8474 0.8666 0.925 0.9662 0.8019 0.9647 0.9063 0.8346 0.9777 0.9566 0.957 0.9741 0.8328 0.8786] 2021-02-23 18:55:35 [INFO] [EVAL] The model with the best validation mIoU (0.7914) was saved at iter 62000. 2021-02-23 18:55:48 [INFO] [TRAIN] epoch=170, iter=63010/80000, loss=0.8321, lr=0.002480, batch_cost=1.3718, reader_cost=0.0001 | ETA 06:28:27 2021-02-23 18:56:02 [INFO] [TRAIN] epoch=170, iter=63020/80000, loss=0.8185, lr=0.002478, batch_cost=1.3855, reader_cost=0.0001 | ETA 06:32:05 2021-02-23 18:56:16 [INFO] [TRAIN] epoch=170, iter=63030/80000, loss=0.7903, lr=0.002477, batch_cost=1.3533, reader_cost=0.0001 | ETA 06:22:45 2021-02-23 18:56:29 [INFO] [TRAIN] epoch=170, iter=63040/80000, loss=0.7959, lr=0.002476, batch_cost=1.3546, reader_cost=0.0001 | ETA 06:22:54 2021-02-23 18:56:43 [INFO] [TRAIN] epoch=170, iter=63050/80000, loss=0.8335, lr=0.002475, batch_cost=1.3934, reader_cost=0.0001 | ETA 06:33:37 2021-02-23 18:56:57 [INFO] [TRAIN] epoch=170, iter=63060/80000, loss=0.8392, lr=0.002473, batch_cost=1.3359, reader_cost=0.0001 | ETA 06:17:09 2021-02-23 18:57:10 [INFO] [TRAIN] epoch=170, iter=63070/80000, loss=0.8117, lr=0.002472, batch_cost=1.3662, reader_cost=0.0001 | ETA 06:25:30 2021-02-23 18:57:24 [INFO] [TRAIN] epoch=170, iter=63080/80000, loss=0.7991, lr=0.002471, batch_cost=1.3645, reader_cost=0.0001 | ETA 06:24:48 2021-02-23 18:57:37 [INFO] [TRAIN] epoch=170, iter=63090/80000, loss=0.8138, lr=0.002469, batch_cost=1.3461, reader_cost=0.0001 | ETA 06:19:22 2021-02-23 18:57:51 [INFO] [TRAIN] epoch=170, iter=63100/80000, loss=0.8528, lr=0.002468, batch_cost=1.3609, reader_cost=0.0001 | ETA 06:23:19 2021-02-23 18:58:05 [INFO] [TRAIN] epoch=170, iter=63110/80000, loss=0.7909, lr=0.002467, batch_cost=1.3601, reader_cost=0.0001 | ETA 06:22:51 2021-02-23 18:58:18 [INFO] [TRAIN] epoch=170, iter=63120/80000, loss=0.7714, lr=0.002465, batch_cost=1.3788, reader_cost=0.0001 | ETA 06:27:54 2021-02-23 18:58:32 [INFO] [TRAIN] epoch=170, iter=63130/80000, loss=0.8056, lr=0.002464, batch_cost=1.3496, reader_cost=0.0001 | ETA 06:19:28 2021-02-23 18:58:46 [INFO] [TRAIN] epoch=170, iter=63140/80000, loss=0.8062, lr=0.002463, batch_cost=1.4032, reader_cost=0.0001 | ETA 06:34:17 2021-02-23 18:59:00 [INFO] [TRAIN] epoch=170, iter=63150/80000, loss=0.7790, lr=0.002461, batch_cost=1.3680, reader_cost=0.0001 | ETA 06:24:10 2021-02-23 18:59:13 [INFO] [TRAIN] epoch=170, iter=63160/80000, loss=0.8377, lr=0.002460, batch_cost=1.3903, reader_cost=0.0001 | ETA 06:30:13 2021-02-23 18:59:27 [INFO] [TRAIN] epoch=170, iter=63170/80000, loss=0.8221, lr=0.002459, batch_cost=1.3464, reader_cost=0.0001 | ETA 06:17:40 2021-02-23 18:59:40 [INFO] [TRAIN] epoch=170, iter=63180/80000, loss=0.8572, lr=0.002457, batch_cost=1.3519, reader_cost=0.0001 | ETA 06:18:58 2021-02-23 18:59:54 [INFO] [TRAIN] epoch=170, iter=63190/80000, loss=0.8308, lr=0.002456, batch_cost=1.3605, reader_cost=0.0001 | ETA 06:21:10 2021-02-23 19:00:07 [INFO] [TRAIN] epoch=170, iter=63200/80000, loss=0.8806, lr=0.002455, batch_cost=1.3347, reader_cost=0.0001 | ETA 06:13:42 2021-02-23 19:00:21 [INFO] [TRAIN] epoch=170, iter=63210/80000, loss=0.8810, lr=0.002454, batch_cost=1.3443, reader_cost=0.0001 | ETA 06:16:11 2021-02-23 19:00:34 [INFO] [TRAIN] epoch=170, iter=63220/80000, loss=0.8614, lr=0.002452, batch_cost=1.3576, reader_cost=0.0001 | ETA 06:19:40 2021-02-23 19:00:48 [INFO] [TRAIN] epoch=170, iter=63230/80000, loss=0.8557, lr=0.002451, batch_cost=1.3424, reader_cost=0.0001 | ETA 06:15:12 2021-02-23 19:01:01 [INFO] [TRAIN] epoch=170, iter=63240/80000, loss=0.8120, lr=0.002450, batch_cost=1.3119, reader_cost=0.0001 | ETA 06:06:28 2021-02-23 19:01:16 [INFO] [TRAIN] epoch=171, iter=63250/80000, loss=0.8896, lr=0.002448, batch_cost=1.4720, reader_cost=0.0796 | ETA 06:50:56 2021-02-23 19:01:29 [INFO] [TRAIN] epoch=171, iter=63260/80000, loss=0.8189, lr=0.002447, batch_cost=1.3695, reader_cost=0.0001 | ETA 06:22:05 2021-02-23 19:01:43 [INFO] [TRAIN] epoch=171, iter=63270/80000, loss=0.8475, lr=0.002446, batch_cost=1.3329, reader_cost=0.0001 | ETA 06:11:39 2021-02-23 19:01:56 [INFO] [TRAIN] epoch=171, iter=63280/80000, loss=0.8168, lr=0.002444, batch_cost=1.3613, reader_cost=0.0001 | ETA 06:19:21 2021-02-23 19:02:10 [INFO] [TRAIN] epoch=171, iter=63290/80000, loss=0.7935, lr=0.002443, batch_cost=1.3426, reader_cost=0.0001 | ETA 06:13:54 2021-02-23 19:02:24 [INFO] [TRAIN] epoch=171, iter=63300/80000, loss=0.8064, lr=0.002442, batch_cost=1.3827, reader_cost=0.0001 | ETA 06:24:51 2021-02-23 19:02:38 [INFO] [TRAIN] epoch=171, iter=63310/80000, loss=0.8308, lr=0.002440, batch_cost=1.3922, reader_cost=0.0001 | ETA 06:27:15 2021-02-23 19:02:51 [INFO] [TRAIN] epoch=171, iter=63320/80000, loss=0.7925, lr=0.002439, batch_cost=1.3398, reader_cost=0.0001 | ETA 06:12:27 2021-02-23 19:03:05 [INFO] [TRAIN] epoch=171, iter=63330/80000, loss=0.8393, lr=0.002438, batch_cost=1.3769, reader_cost=0.0001 | ETA 06:22:33 2021-02-23 19:03:18 [INFO] [TRAIN] epoch=171, iter=63340/80000, loss=0.8485, lr=0.002436, batch_cost=1.3695, reader_cost=0.0001 | ETA 06:20:16 2021-02-23 19:03:32 [INFO] [TRAIN] epoch=171, iter=63350/80000, loss=0.7841, lr=0.002435, batch_cost=1.3672, reader_cost=0.0001 | ETA 06:19:23 2021-02-23 19:03:46 [INFO] [TRAIN] epoch=171, iter=63360/80000, loss=0.8421, lr=0.002434, batch_cost=1.3512, reader_cost=0.0001 | ETA 06:14:44 2021-02-23 19:03:59 [INFO] [TRAIN] epoch=171, iter=63370/80000, loss=0.8346, lr=0.002432, batch_cost=1.3729, reader_cost=0.0001 | ETA 06:20:31 2021-02-23 19:04:12 [INFO] [TRAIN] epoch=171, iter=63380/80000, loss=0.8565, lr=0.002431, batch_cost=1.3174, reader_cost=0.0001 | ETA 06:04:54 2021-02-23 19:04:26 [INFO] [TRAIN] epoch=171, iter=63390/80000, loss=0.8395, lr=0.002430, batch_cost=1.3435, reader_cost=0.0001 | ETA 06:11:54 2021-02-23 19:04:39 [INFO] [TRAIN] epoch=171, iter=63400/80000, loss=0.8613, lr=0.002429, batch_cost=1.3574, reader_cost=0.0001 | ETA 06:15:32 2021-02-23 19:04:53 [INFO] [TRAIN] epoch=171, iter=63410/80000, loss=0.8258, lr=0.002427, batch_cost=1.3336, reader_cost=0.0001 | ETA 06:08:45 2021-02-23 19:05:07 [INFO] [TRAIN] epoch=171, iter=63420/80000, loss=0.7920, lr=0.002426, batch_cost=1.4037, reader_cost=0.0001 | ETA 06:27:52 2021-02-23 19:05:21 [INFO] [TRAIN] epoch=171, iter=63430/80000, loss=0.8648, lr=0.002425, batch_cost=1.3978, reader_cost=0.0001 | ETA 06:26:01 2021-02-23 19:05:34 [INFO] [TRAIN] epoch=171, iter=63440/80000, loss=0.8470, lr=0.002423, batch_cost=1.3625, reader_cost=0.0001 | ETA 06:16:03 2021-02-23 19:05:48 [INFO] [TRAIN] epoch=171, iter=63450/80000, loss=0.8252, lr=0.002422, batch_cost=1.3574, reader_cost=0.0001 | ETA 06:14:24 2021-02-23 19:06:02 [INFO] [TRAIN] epoch=171, iter=63460/80000, loss=0.8108, lr=0.002421, batch_cost=1.3775, reader_cost=0.0001 | ETA 06:19:43 2021-02-23 19:06:16 [INFO] [TRAIN] epoch=171, iter=63470/80000, loss=0.8053, lr=0.002419, batch_cost=1.4101, reader_cost=0.0001 | ETA 06:28:28 2021-02-23 19:06:29 [INFO] [TRAIN] epoch=171, iter=63480/80000, loss=0.7935, lr=0.002418, batch_cost=1.3287, reader_cost=0.0001 | ETA 06:05:50 2021-02-23 19:06:43 [INFO] [TRAIN] epoch=171, iter=63490/80000, loss=0.8418, lr=0.002417, batch_cost=1.3814, reader_cost=0.0001 | ETA 06:20:07 2021-02-23 19:06:57 [INFO] [TRAIN] epoch=171, iter=63500/80000, loss=0.9724, lr=0.002415, batch_cost=1.4022, reader_cost=0.0001 | ETA 06:25:36 2021-02-23 19:07:11 [INFO] [TRAIN] epoch=171, iter=63510/80000, loss=0.8501, lr=0.002414, batch_cost=1.3813, reader_cost=0.0001 | ETA 06:19:37 2021-02-23 19:07:24 [INFO] [TRAIN] epoch=171, iter=63520/80000, loss=0.8174, lr=0.002413, batch_cost=1.3631, reader_cost=0.0001 | ETA 06:14:23 2021-02-23 19:07:38 [INFO] [TRAIN] epoch=171, iter=63530/80000, loss=0.8071, lr=0.002411, batch_cost=1.3729, reader_cost=0.0001 | ETA 06:16:51 2021-02-23 19:07:52 [INFO] [TRAIN] epoch=171, iter=63540/80000, loss=0.8710, lr=0.002410, batch_cost=1.3621, reader_cost=0.0001 | ETA 06:13:39 2021-02-23 19:08:05 [INFO] [TRAIN] epoch=171, iter=63550/80000, loss=0.8588, lr=0.002409, batch_cost=1.3461, reader_cost=0.0001 | ETA 06:09:03 2021-02-23 19:08:19 [INFO] [TRAIN] epoch=171, iter=63560/80000, loss=0.8415, lr=0.002407, batch_cost=1.3952, reader_cost=0.0001 | ETA 06:22:17 2021-02-23 19:08:33 [INFO] [TRAIN] epoch=171, iter=63570/80000, loss=0.8333, lr=0.002406, batch_cost=1.3506, reader_cost=0.0001 | ETA 06:09:50 2021-02-23 19:08:46 [INFO] [TRAIN] epoch=171, iter=63580/80000, loss=0.8685, lr=0.002405, batch_cost=1.3622, reader_cost=0.0001 | ETA 06:12:47 2021-02-23 19:09:00 [INFO] [TRAIN] epoch=171, iter=63590/80000, loss=0.8208, lr=0.002403, batch_cost=1.3393, reader_cost=0.0001 | ETA 06:06:17 2021-02-23 19:09:14 [INFO] [TRAIN] epoch=171, iter=63600/80000, loss=0.9389, lr=0.002402, batch_cost=1.3763, reader_cost=0.0001 | ETA 06:16:11 2021-02-23 19:09:27 [INFO] [TRAIN] epoch=171, iter=63610/80000, loss=0.7784, lr=0.002401, batch_cost=1.3462, reader_cost=0.0001 | ETA 06:07:44 2021-02-23 19:09:42 [INFO] [TRAIN] epoch=172, iter=63620/80000, loss=0.7885, lr=0.002400, batch_cost=1.4758, reader_cost=0.0821 | ETA 06:42:53 2021-02-23 19:09:55 [INFO] [TRAIN] epoch=172, iter=63630/80000, loss=0.7752, lr=0.002398, batch_cost=1.3558, reader_cost=0.0001 | ETA 06:09:54 2021-02-23 19:10:09 [INFO] [TRAIN] epoch=172, iter=63640/80000, loss=0.8556, lr=0.002397, batch_cost=1.3384, reader_cost=0.0001 | ETA 06:04:56 2021-02-23 19:10:23 [INFO] [TRAIN] epoch=172, iter=63650/80000, loss=0.8653, lr=0.002396, batch_cost=1.4049, reader_cost=0.0001 | ETA 06:22:49 2021-02-23 19:10:36 [INFO] [TRAIN] epoch=172, iter=63660/80000, loss=0.9514, lr=0.002394, batch_cost=1.3431, reader_cost=0.0001 | ETA 06:05:46 2021-02-23 19:10:50 [INFO] [TRAIN] epoch=172, iter=63670/80000, loss=0.9137, lr=0.002393, batch_cost=1.3580, reader_cost=0.0001 | ETA 06:09:35 2021-02-23 19:11:03 [INFO] [TRAIN] epoch=172, iter=63680/80000, loss=0.7915, lr=0.002392, batch_cost=1.3690, reader_cost=0.0001 | ETA 06:12:21 2021-02-23 19:11:17 [INFO] [TRAIN] epoch=172, iter=63690/80000, loss=0.8319, lr=0.002390, batch_cost=1.3551, reader_cost=0.0001 | ETA 06:08:22 2021-02-23 19:11:31 [INFO] [TRAIN] epoch=172, iter=63700/80000, loss=0.7995, lr=0.002389, batch_cost=1.4172, reader_cost=0.0001 | ETA 06:25:00 2021-02-23 19:11:45 [INFO] [TRAIN] epoch=172, iter=63710/80000, loss=0.8331, lr=0.002388, batch_cost=1.3724, reader_cost=0.0001 | ETA 06:12:35 2021-02-23 19:11:59 [INFO] [TRAIN] epoch=172, iter=63720/80000, loss=0.7861, lr=0.002386, batch_cost=1.3857, reader_cost=0.0001 | ETA 06:15:58 2021-02-23 19:12:12 [INFO] [TRAIN] epoch=172, iter=63730/80000, loss=0.8214, lr=0.002385, batch_cost=1.3646, reader_cost=0.0001 | ETA 06:10:01 2021-02-23 19:12:26 [INFO] [TRAIN] epoch=172, iter=63740/80000, loss=0.8353, lr=0.002384, batch_cost=1.3993, reader_cost=0.0001 | ETA 06:19:12 2021-02-23 19:12:40 [INFO] [TRAIN] epoch=172, iter=63750/80000, loss=0.7908, lr=0.002382, batch_cost=1.3794, reader_cost=0.0001 | ETA 06:13:35 2021-02-23 19:12:54 [INFO] [TRAIN] epoch=172, iter=63760/80000, loss=0.8315, lr=0.002381, batch_cost=1.3668, reader_cost=0.0001 | ETA 06:09:57 2021-02-23 19:13:07 [INFO] [TRAIN] epoch=172, iter=63770/80000, loss=0.7881, lr=0.002380, batch_cost=1.3588, reader_cost=0.0001 | ETA 06:07:32 2021-02-23 19:13:21 [INFO] [TRAIN] epoch=172, iter=63780/80000, loss=0.7828, lr=0.002378, batch_cost=1.3392, reader_cost=0.0001 | ETA 06:02:01 2021-02-23 19:13:34 [INFO] [TRAIN] epoch=172, iter=63790/80000, loss=0.8124, lr=0.002377, batch_cost=1.3532, reader_cost=0.0001 | ETA 06:05:35 2021-02-23 19:13:48 [INFO] [TRAIN] epoch=172, iter=63800/80000, loss=0.8739, lr=0.002376, batch_cost=1.3673, reader_cost=0.0001 | ETA 06:09:10 2021-02-23 19:14:02 [INFO] [TRAIN] epoch=172, iter=63810/80000, loss=0.8075, lr=0.002374, batch_cost=1.3778, reader_cost=0.0001 | ETA 06:11:46 2021-02-23 19:14:16 [INFO] [TRAIN] epoch=172, iter=63820/80000, loss=0.8649, lr=0.002373, batch_cost=1.3692, reader_cost=0.0001 | ETA 06:09:13 2021-02-23 19:14:29 [INFO] [TRAIN] epoch=172, iter=63830/80000, loss=0.8475, lr=0.002372, batch_cost=1.3606, reader_cost=0.0001 | ETA 06:06:40 2021-02-23 19:14:43 [INFO] [TRAIN] epoch=172, iter=63840/80000, loss=0.8602, lr=0.002371, batch_cost=1.3667, reader_cost=0.0001 | ETA 06:08:05 2021-02-23 19:14:56 [INFO] [TRAIN] epoch=172, iter=63850/80000, loss=0.8076, lr=0.002369, batch_cost=1.3640, reader_cost=0.0001 | ETA 06:07:07 2021-02-23 19:15:10 [INFO] [TRAIN] epoch=172, iter=63860/80000, loss=0.8466, lr=0.002368, batch_cost=1.3593, reader_cost=0.0001 | ETA 06:05:38 2021-02-23 19:15:23 [INFO] [TRAIN] epoch=172, iter=63870/80000, loss=0.8238, lr=0.002367, batch_cost=1.3304, reader_cost=0.0001 | ETA 05:57:38 2021-02-23 19:15:37 [INFO] [TRAIN] epoch=172, iter=63880/80000, loss=0.7942, lr=0.002365, batch_cost=1.3661, reader_cost=0.0001 | ETA 06:07:01 2021-02-23 19:15:51 [INFO] [TRAIN] epoch=172, iter=63890/80000, loss=0.8148, lr=0.002364, batch_cost=1.3546, reader_cost=0.0001 | ETA 06:03:42 2021-02-23 19:16:04 [INFO] [TRAIN] epoch=172, iter=63900/80000, loss=0.8163, lr=0.002363, batch_cost=1.3587, reader_cost=0.0001 | ETA 06:04:35 2021-02-23 19:16:18 [INFO] [TRAIN] epoch=172, iter=63910/80000, loss=0.8140, lr=0.002361, batch_cost=1.3579, reader_cost=0.0001 | ETA 06:04:08 2021-02-23 19:16:31 [INFO] [TRAIN] epoch=172, iter=63920/80000, loss=0.8804, lr=0.002360, batch_cost=1.3640, reader_cost=0.0001 | ETA 06:05:32 2021-02-23 19:16:45 [INFO] [TRAIN] epoch=172, iter=63930/80000, loss=0.8482, lr=0.002359, batch_cost=1.3325, reader_cost=0.0001 | ETA 05:56:52 2021-02-23 19:16:58 [INFO] [TRAIN] epoch=172, iter=63940/80000, loss=0.8654, lr=0.002357, batch_cost=1.3384, reader_cost=0.0001 | ETA 05:58:14 2021-02-23 19:17:12 [INFO] [TRAIN] epoch=172, iter=63950/80000, loss=0.8991, lr=0.002356, batch_cost=1.3587, reader_cost=0.0001 | ETA 06:03:27 2021-02-23 19:17:25 [INFO] [TRAIN] epoch=172, iter=63960/80000, loss=0.8670, lr=0.002355, batch_cost=1.3434, reader_cost=0.0001 | ETA 05:59:07 2021-02-23 19:17:39 [INFO] [TRAIN] epoch=172, iter=63970/80000, loss=0.8027, lr=0.002353, batch_cost=1.3951, reader_cost=0.0001 | ETA 06:12:42 2021-02-23 19:17:53 [INFO] [TRAIN] epoch=172, iter=63980/80000, loss=0.7859, lr=0.002352, batch_cost=1.3907, reader_cost=0.0001 | ETA 06:11:18 2021-02-23 19:18:07 [INFO] [TRAIN] epoch=173, iter=63990/80000, loss=0.8598, lr=0.002351, batch_cost=1.4501, reader_cost=0.0696 | ETA 06:26:56 2021-02-23 19:18:21 [INFO] [TRAIN] epoch=173, iter=64000/80000, loss=0.8337, lr=0.002349, batch_cost=1.3905, reader_cost=0.0001 | ETA 06:10:48 2021-02-23 19:18:21 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:05 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 58s - batch_cost: 0.2117 - reader cost: 0.0872  3/125 [..............................] - ETA: 57s - batch_cost: 0.2922 - reader cost: 0.1250 4/125 [..............................] - ETA: 55s - batch_cost: 0.3247 - reader cost: 0.1369 5/125 [>.............................] - ETA: 54s - batch_cost: 0.3463 - reader cost: 0.1464 6/125 [>.............................] - ETA: 54s - batch_cost: 0.3683 - reader cost: 0.1596 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3734 - reader cost: 0.1591 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3752 - reader cost: 0.1561 9/125 [=>............................] - ETA: 50s - batch_cost: 0.3802 - reader cost: 0.1582 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3837 - reader cost: 0.1587 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3842 - reader cost: 0.1570 12/125 [=>............................] - ETA: 48s - batch_cost: 0.3869 - reader cost: 0.1579 13/125 [==>...........................] - ETA: 47s - batch_cost: 0.3867 - reader cost: 0.1560 14/125 [==>...........................] - ETA: 47s - batch_cost: 0.3899 - reader cost: 0.1580 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3920 - reader cost: 0.1590 16/125 [==>...........................] - ETA: 46s - batch_cost: 0.3940 - reader cost: 0.1601 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3977 - reader cost: 0.1621 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3993 - reader cost: 0.1628 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.4017 - reader cost: 0.1643 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4034 - reader cost: 0.1651 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4043 - reader cost: 0.1655 22/125 [====>.........................] - ETA: 43s - batch_cost: 0.4028 - reader cost: 0.1635 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4040 - reader cost: 0.1637 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.4033 - reader cost: 0.1625 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4040 - reader cost: 0.1629 26/125 [=====>........................] - ETA: 41s - batch_cost: 0.4039 - reader cost: 0.1620 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4052 - reader cost: 0.1632 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4064 - reader cost: 0.1641 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4079 - reader cost: 0.1650 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4083 - reader cost: 0.1649 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4085 - reader cost: 0.1650 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4097 - reader cost: 0.1651 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4098 - reader cost: 0.1648 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4102 - reader cost: 0.1648 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4100 - reader cost: 0.1642 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4099 - reader cost: 0.1638 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4087 - reader cost: 0.1625 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4090 - reader cost: 0.1626 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4095 - reader cost: 0.1629 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4104 - reader cost: 0.1638 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4108 - reader cost: 0.1639 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4114 - reader cost: 0.1641 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4115 - reader cost: 0.1641 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4117 - reader cost: 0.1643 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4109 - reader cost: 0.1634 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4098 - reader cost: 0.1624 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4106 - reader cost: 0.1631 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4113 - reader cost: 0.1638 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4107 - reader cost: 0.1630 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4109 - reader cost: 0.1632 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4112 - reader cost: 0.1634 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4116 - reader cost: 0.1636 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4117 - reader cost: 0.1636 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4118 - reader cost: 0.1638 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4110 - reader cost: 0.1629 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4114 - reader cost: 0.1634 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4116 - reader cost: 0.1635 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4117 - reader cost: 0.1636 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4113 - reader cost: 0.1629 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4113 - reader cost: 0.1619 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4119 - reader cost: 0.1612 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4119 - reader cost: 0.1612 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4121 - reader cost: 0.1614 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4125 - reader cost: 0.1617 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4126 - reader cost: 0.1619 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4129 - reader cost: 0.1621 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4122 - reader cost: 0.1613 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4125 - reader cost: 0.1615 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4130 - reader cost: 0.1620 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4125 - reader cost: 0.1615 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4129 - reader cost: 0.1619 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4132 - reader cost: 0.1621 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4132 - reader cost: 0.1620 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4132 - reader cost: 0.1620 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4133 - reader cost: 0.1622 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4128 - reader cost: 0.1617 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4130 - reader cost: 0.1618 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4131 - reader cost: 0.1619 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4127 - reader cost: 0.1615 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4119 - reader cost: 0.1607 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4118 - reader cost: 0.1606 82/125 [==================>...........] - ETA: 17s - batch_cost: 0.4116 - reader cost: 0.1603 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4117 - reader cost: 0.1604 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4117 - reader cost: 0.1605 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4120 - reader cost: 0.1608 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4122 - reader cost: 0.1610 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4125 - reader cost: 0.1612 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4118 - reader cost: 0.1605 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4121 - reader cost: 0.1608 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4123 - reader cost: 0.1610 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4126 - reader cost: 0.1613 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4129 - reader cost: 0.1616 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4129 - reader cost: 0.1616 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4126 - reader cost: 0.1613 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4121 - reader cost: 0.1609 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4123 - reader cost: 0.1611 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4125 - reader cost: 0.1613 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4125 - reader cost: 0.1613 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4126 - reader cost: 0.1614 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4128 - reader cost: 0.1615 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4128 - reader cost: 0.1614 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4123 - reader cost: 0.1609  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4121 - reader cost: 0.1606 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4123 - reader cost: 0.1607 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4123 - reader cost: 0.1608 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4125 - reader cost: 0.1609 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4126 - reader cost: 0.1609 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4123 - reader cost: 0.1607 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4124 - reader cost: 0.1608 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4121 - reader cost: 0.1605 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4118 - reader cost: 0.1601 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4117 - reader cost: 0.1597 113/125 [==========================>...] - ETA: 4s - batch_cost: 0.4117 - reader cost: 0.1597 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4118 - reader cost: 0.1595 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4118 - reader cost: 0.1592 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4120 - reader cost: 0.1585 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4117 - reader cost: 0.1575 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4117 - reader cost: 0.1576 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4118 - reader cost: 0.1577 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4119 - reader cost: 0.1574 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4122 - reader cost: 0.1578 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4124 - reader cost: 0.1580 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4125 - reader cost: 0.1581 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4120 - reader cost: 0.1577 125/125 [==============================] - 52s 416ms/step - batch_cost: 0.4122 - reader cost: 0.1579 2021-02-23 19:19:13 [INFO] [EVAL] #Images=500 mIoU=0.7720 Acc=0.9579 Kappa=0.9452 2021-02-23 19:19:13 [INFO] [EVAL] Class IoU: [0.9794 0.8433 0.9119 0.375 0.5745 0.642 0.6834 0.8083 0.9197 0.6264 0.9505 0.8279 0.6171 0.9491 0.8321 0.849 0.8238 0.6656 0.7883] 2021-02-23 19:19:13 [INFO] [EVAL] Class Acc: [0.9888 0.9026 0.9344 0.834 0.8895 0.8728 0.9131 0.9353 0.9531 0.863 0.9733 0.9038 0.8202 0.9816 0.9387 0.9588 0.9574 0.8292 0.8757] 2021-02-23 19:19:18 [INFO] [EVAL] The model with the best validation mIoU (0.7914) was saved at iter 62000. 2021-02-23 19:19:32 [INFO] [TRAIN] epoch=173, iter=64010/80000, loss=0.8071, lr=0.002348, batch_cost=1.3692, reader_cost=0.0001 | ETA 06:04:53 2021-02-23 19:19:46 [INFO] [TRAIN] epoch=173, iter=64020/80000, loss=0.8022, lr=0.002347, batch_cost=1.3609, reader_cost=0.0001 | ETA 06:02:26 2021-02-23 19:19:59 [INFO] [TRAIN] epoch=173, iter=64030/80000, loss=0.8283, lr=0.002345, batch_cost=1.3217, reader_cost=0.0001 | ETA 05:51:47 2021-02-23 19:20:13 [INFO] [TRAIN] epoch=173, iter=64040/80000, loss=0.8073, lr=0.002344, batch_cost=1.3927, reader_cost=0.0001 | ETA 06:10:27 2021-02-23 19:20:27 [INFO] [TRAIN] epoch=173, iter=64050/80000, loss=0.8893, lr=0.002343, batch_cost=1.4062, reader_cost=0.0001 | ETA 06:13:49 2021-02-23 19:20:41 [INFO] [TRAIN] epoch=173, iter=64060/80000, loss=0.8164, lr=0.002341, batch_cost=1.3643, reader_cost=0.0001 | ETA 06:02:27 2021-02-23 19:20:54 [INFO] [TRAIN] epoch=173, iter=64070/80000, loss=0.8588, lr=0.002340, batch_cost=1.3392, reader_cost=0.0001 | ETA 05:55:33 2021-02-23 19:21:08 [INFO] [TRAIN] epoch=173, iter=64080/80000, loss=0.7749, lr=0.002339, batch_cost=1.3723, reader_cost=0.0001 | ETA 06:04:06 2021-02-23 19:21:21 [INFO] [TRAIN] epoch=173, iter=64090/80000, loss=0.8227, lr=0.002337, batch_cost=1.3630, reader_cost=0.0001 | ETA 06:01:25 2021-02-23 19:21:35 [INFO] [TRAIN] epoch=173, iter=64100/80000, loss=0.8226, lr=0.002336, batch_cost=1.3331, reader_cost=0.0001 | ETA 05:53:17 2021-02-23 19:21:49 [INFO] [TRAIN] epoch=173, iter=64110/80000, loss=0.8331, lr=0.002335, batch_cost=1.3891, reader_cost=0.0001 | ETA 06:07:52 2021-02-23 19:22:02 [INFO] [TRAIN] epoch=173, iter=64120/80000, loss=0.7624, lr=0.002334, batch_cost=1.3915, reader_cost=0.0001 | ETA 06:08:17 2021-02-23 19:22:16 [INFO] [TRAIN] epoch=173, iter=64130/80000, loss=0.8070, lr=0.002332, batch_cost=1.3423, reader_cost=0.0001 | ETA 05:55:01 2021-02-23 19:22:29 [INFO] [TRAIN] epoch=173, iter=64140/80000, loss=0.8757, lr=0.002331, batch_cost=1.3529, reader_cost=0.0001 | ETA 05:57:36 2021-02-23 19:22:43 [INFO] [TRAIN] epoch=173, iter=64150/80000, loss=0.8439, lr=0.002330, batch_cost=1.3520, reader_cost=0.0001 | ETA 05:57:08 2021-02-23 19:22:56 [INFO] [TRAIN] epoch=173, iter=64160/80000, loss=0.8013, lr=0.002328, batch_cost=1.3339, reader_cost=0.0001 | ETA 05:52:09 2021-02-23 19:23:10 [INFO] [TRAIN] epoch=173, iter=64170/80000, loss=0.8360, lr=0.002327, batch_cost=1.3760, reader_cost=0.0001 | ETA 06:03:01 2021-02-23 19:23:24 [INFO] [TRAIN] epoch=173, iter=64180/80000, loss=0.8116, lr=0.002326, batch_cost=1.3481, reader_cost=0.0001 | ETA 05:55:27 2021-02-23 19:23:37 [INFO] [TRAIN] epoch=173, iter=64190/80000, loss=0.8353, lr=0.002324, batch_cost=1.3747, reader_cost=0.0001 | ETA 06:02:14 2021-02-23 19:23:51 [INFO] [TRAIN] epoch=173, iter=64200/80000, loss=0.8069, lr=0.002323, batch_cost=1.3562, reader_cost=0.0001 | ETA 05:57:08 2021-02-23 19:24:05 [INFO] [TRAIN] epoch=173, iter=64210/80000, loss=0.8647, lr=0.002322, batch_cost=1.4240, reader_cost=0.0001 | ETA 06:14:45 2021-02-23 19:24:19 [INFO] [TRAIN] epoch=173, iter=64220/80000, loss=0.7966, lr=0.002320, batch_cost=1.4139, reader_cost=0.0001 | ETA 06:11:51 2021-02-23 19:24:33 [INFO] [TRAIN] epoch=173, iter=64230/80000, loss=0.8296, lr=0.002319, batch_cost=1.3770, reader_cost=0.0001 | ETA 06:01:55 2021-02-23 19:24:46 [INFO] [TRAIN] epoch=173, iter=64240/80000, loss=0.7225, lr=0.002318, batch_cost=1.3349, reader_cost=0.0001 | ETA 05:50:37 2021-02-23 19:25:00 [INFO] [TRAIN] epoch=173, iter=64250/80000, loss=0.7546, lr=0.002316, batch_cost=1.3988, reader_cost=0.0001 | ETA 06:07:11 2021-02-23 19:25:14 [INFO] [TRAIN] epoch=173, iter=64260/80000, loss=0.8357, lr=0.002315, batch_cost=1.3464, reader_cost=0.0001 | ETA 05:53:12 2021-02-23 19:25:28 [INFO] [TRAIN] epoch=173, iter=64270/80000, loss=0.9038, lr=0.002314, batch_cost=1.3756, reader_cost=0.0001 | ETA 06:00:38 2021-02-23 19:25:41 [INFO] [TRAIN] epoch=173, iter=64280/80000, loss=0.8218, lr=0.002312, batch_cost=1.3754, reader_cost=0.0001 | ETA 06:00:21 2021-02-23 19:25:55 [INFO] [TRAIN] epoch=173, iter=64290/80000, loss=0.7885, lr=0.002311, batch_cost=1.3589, reader_cost=0.0001 | ETA 05:55:47 2021-02-23 19:26:09 [INFO] [TRAIN] epoch=173, iter=64300/80000, loss=0.8707, lr=0.002310, batch_cost=1.3837, reader_cost=0.0001 | ETA 06:02:04 2021-02-23 19:26:22 [INFO] [TRAIN] epoch=173, iter=64310/80000, loss=0.7511, lr=0.002308, batch_cost=1.3548, reader_cost=0.0001 | ETA 05:54:16 2021-02-23 19:26:36 [INFO] [TRAIN] epoch=173, iter=64320/80000, loss=0.8008, lr=0.002307, batch_cost=1.3512, reader_cost=0.0001 | ETA 05:53:06 2021-02-23 19:26:49 [INFO] [TRAIN] epoch=173, iter=64330/80000, loss=0.8575, lr=0.002306, batch_cost=1.3595, reader_cost=0.0001 | ETA 05:55:03 2021-02-23 19:27:03 [INFO] [TRAIN] epoch=173, iter=64340/80000, loss=0.8218, lr=0.002304, batch_cost=1.3666, reader_cost=0.0001 | ETA 05:56:40 2021-02-23 19:27:17 [INFO] [TRAIN] epoch=173, iter=64350/80000, loss=0.8201, lr=0.002303, batch_cost=1.3452, reader_cost=0.0001 | ETA 05:50:52 2021-02-23 19:27:31 [INFO] [TRAIN] epoch=174, iter=64360/80000, loss=0.7792, lr=0.002302, batch_cost=1.4413, reader_cost=0.0777 | ETA 06:15:42 2021-02-23 19:27:45 [INFO] [TRAIN] epoch=174, iter=64370/80000, loss=0.8071, lr=0.002300, batch_cost=1.3604, reader_cost=0.0001 | ETA 05:54:22 2021-02-23 19:27:58 [INFO] [TRAIN] epoch=174, iter=64380/80000, loss=0.8243, lr=0.002299, batch_cost=1.3717, reader_cost=0.0001 | ETA 05:57:06 2021-02-23 19:28:12 [INFO] [TRAIN] epoch=174, iter=64390/80000, loss=0.7911, lr=0.002298, batch_cost=1.3466, reader_cost=0.0001 | ETA 05:50:20 2021-02-23 19:28:26 [INFO] [TRAIN] epoch=174, iter=64400/80000, loss=0.8228, lr=0.002296, batch_cost=1.3890, reader_cost=0.0001 | ETA 06:01:08 2021-02-23 19:28:39 [INFO] [TRAIN] epoch=174, iter=64410/80000, loss=0.8604, lr=0.002295, batch_cost=1.3546, reader_cost=0.0001 | ETA 05:51:57 2021-02-23 19:28:53 [INFO] [TRAIN] epoch=174, iter=64420/80000, loss=0.8836, lr=0.002294, batch_cost=1.3651, reader_cost=0.0001 | ETA 05:54:27 2021-02-23 19:29:07 [INFO] [TRAIN] epoch=174, iter=64430/80000, loss=0.8240, lr=0.002292, batch_cost=1.3924, reader_cost=0.0001 | ETA 06:01:20 2021-02-23 19:29:20 [INFO] [TRAIN] epoch=174, iter=64440/80000, loss=0.8468, lr=0.002291, batch_cost=1.3718, reader_cost=0.0001 | ETA 05:55:44 2021-02-23 19:29:34 [INFO] [TRAIN] epoch=174, iter=64450/80000, loss=0.8841, lr=0.002290, batch_cost=1.3727, reader_cost=0.0001 | ETA 05:55:46 2021-02-23 19:29:48 [INFO] [TRAIN] epoch=174, iter=64460/80000, loss=0.8474, lr=0.002288, batch_cost=1.4026, reader_cost=0.0001 | ETA 06:03:16 2021-02-23 19:30:02 [INFO] [TRAIN] epoch=174, iter=64470/80000, loss=0.8546, lr=0.002287, batch_cost=1.3845, reader_cost=0.0001 | ETA 05:58:20 2021-02-23 19:30:16 [INFO] [TRAIN] epoch=174, iter=64480/80000, loss=0.8102, lr=0.002286, batch_cost=1.3531, reader_cost=0.0001 | ETA 05:50:00 2021-02-23 19:30:29 [INFO] [TRAIN] epoch=174, iter=64490/80000, loss=0.8562, lr=0.002285, batch_cost=1.3698, reader_cost=0.0001 | ETA 05:54:05 2021-02-23 19:30:43 [INFO] [TRAIN] epoch=174, iter=64500/80000, loss=0.7851, lr=0.002283, batch_cost=1.3590, reader_cost=0.0001 | ETA 05:51:04 2021-02-23 19:30:57 [INFO] [TRAIN] epoch=174, iter=64510/80000, loss=0.8390, lr=0.002282, batch_cost=1.3702, reader_cost=0.0001 | ETA 05:53:44 2021-02-23 19:31:10 [INFO] [TRAIN] epoch=174, iter=64520/80000, loss=0.8331, lr=0.002281, batch_cost=1.3684, reader_cost=0.0001 | ETA 05:53:02 2021-02-23 19:31:24 [INFO] [TRAIN] epoch=174, iter=64530/80000, loss=0.8215, lr=0.002279, batch_cost=1.3924, reader_cost=0.0001 | ETA 05:59:01 2021-02-23 19:31:38 [INFO] [TRAIN] epoch=174, iter=64540/80000, loss=0.7992, lr=0.002278, batch_cost=1.3808, reader_cost=0.0001 | ETA 05:55:47 2021-02-23 19:31:52 [INFO] [TRAIN] epoch=174, iter=64550/80000, loss=0.8065, lr=0.002277, batch_cost=1.4103, reader_cost=0.0001 | ETA 06:03:09 2021-02-23 19:32:05 [INFO] [TRAIN] epoch=174, iter=64560/80000, loss=0.8597, lr=0.002275, batch_cost=1.3309, reader_cost=0.0001 | ETA 05:42:29 2021-02-23 19:32:19 [INFO] [TRAIN] epoch=174, iter=64570/80000, loss=0.8069, lr=0.002274, batch_cost=1.3613, reader_cost=0.0001 | ETA 05:50:05 2021-02-23 19:32:33 [INFO] [TRAIN] epoch=174, iter=64580/80000, loss=0.8351, lr=0.002273, batch_cost=1.3494, reader_cost=0.0001 | ETA 05:46:47 2021-02-23 19:32:46 [INFO] [TRAIN] epoch=174, iter=64590/80000, loss=0.8582, lr=0.002271, batch_cost=1.3878, reader_cost=0.0001 | ETA 05:56:26 2021-02-23 19:33:00 [INFO] [TRAIN] epoch=174, iter=64600/80000, loss=0.7983, lr=0.002270, batch_cost=1.3485, reader_cost=0.0001 | ETA 05:46:07 2021-02-23 19:33:14 [INFO] [TRAIN] epoch=174, iter=64610/80000, loss=0.8189, lr=0.002269, batch_cost=1.3726, reader_cost=0.0001 | ETA 05:52:03 2021-02-23 19:33:27 [INFO] [TRAIN] epoch=174, iter=64620/80000, loss=0.9146, lr=0.002267, batch_cost=1.3539, reader_cost=0.0001 | ETA 05:47:02 2021-02-23 19:33:41 [INFO] [TRAIN] epoch=174, iter=64630/80000, loss=0.8299, lr=0.002266, batch_cost=1.3760, reader_cost=0.0001 | ETA 05:52:28 2021-02-23 19:33:55 [INFO] [TRAIN] epoch=174, iter=64640/80000, loss=0.7805, lr=0.002265, batch_cost=1.3908, reader_cost=0.0001 | ETA 05:56:03 2021-02-23 19:34:08 [INFO] [TRAIN] epoch=174, iter=64650/80000, loss=0.7746, lr=0.002263, batch_cost=1.3252, reader_cost=0.0001 | ETA 05:39:02 2021-02-23 19:34:22 [INFO] [TRAIN] epoch=174, iter=64660/80000, loss=0.8841, lr=0.002262, batch_cost=1.3772, reader_cost=0.0001 | ETA 05:52:05 2021-02-23 19:34:36 [INFO] [TRAIN] epoch=174, iter=64670/80000, loss=0.7590, lr=0.002261, batch_cost=1.3815, reader_cost=0.0001 | ETA 05:52:58 2021-02-23 19:34:50 [INFO] [TRAIN] epoch=174, iter=64680/80000, loss=0.8366, lr=0.002259, batch_cost=1.4101, reader_cost=0.0001 | ETA 06:00:02 2021-02-23 19:35:03 [INFO] [TRAIN] epoch=174, iter=64690/80000, loss=0.8358, lr=0.002258, batch_cost=1.3708, reader_cost=0.0001 | ETA 05:49:47 2021-02-23 19:35:17 [INFO] [TRAIN] epoch=174, iter=64700/80000, loss=0.7861, lr=0.002257, batch_cost=1.3520, reader_cost=0.0001 | ETA 05:44:46 2021-02-23 19:35:31 [INFO] [TRAIN] epoch=174, iter=64710/80000, loss=0.7868, lr=0.002255, batch_cost=1.3661, reader_cost=0.0001 | ETA 05:48:08 2021-02-23 19:35:44 [INFO] [TRAIN] epoch=174, iter=64720/80000, loss=0.8218, lr=0.002254, batch_cost=1.3604, reader_cost=0.0001 | ETA 05:46:27 2021-02-23 19:35:58 [INFO] [TRAIN] epoch=175, iter=64730/80000, loss=0.8578, lr=0.002253, batch_cost=1.4052, reader_cost=0.0770 | ETA 05:57:38 2021-02-23 19:36:12 [INFO] [TRAIN] epoch=175, iter=64740/80000, loss=0.7894, lr=0.002251, batch_cost=1.3825, reader_cost=0.0001 | ETA 05:51:37 2021-02-23 19:36:26 [INFO] [TRAIN] epoch=175, iter=64750/80000, loss=0.8268, lr=0.002250, batch_cost=1.3704, reader_cost=0.0001 | ETA 05:48:19 2021-02-23 19:36:39 [INFO] [TRAIN] epoch=175, iter=64760/80000, loss=0.7940, lr=0.002249, batch_cost=1.3364, reader_cost=0.0001 | ETA 05:39:26 2021-02-23 19:36:53 [INFO] [TRAIN] epoch=175, iter=64770/80000, loss=0.8307, lr=0.002247, batch_cost=1.3495, reader_cost=0.0001 | ETA 05:42:32 2021-02-23 19:37:06 [INFO] [TRAIN] epoch=175, iter=64780/80000, loss=0.8681, lr=0.002246, batch_cost=1.3336, reader_cost=0.0001 | ETA 05:38:17 2021-02-23 19:37:20 [INFO] [TRAIN] epoch=175, iter=64790/80000, loss=0.8134, lr=0.002245, batch_cost=1.4285, reader_cost=0.0001 | ETA 06:02:07 2021-02-23 19:37:34 [INFO] [TRAIN] epoch=175, iter=64800/80000, loss=0.7854, lr=0.002243, batch_cost=1.3553, reader_cost=0.0001 | ETA 05:43:20 2021-02-23 19:37:48 [INFO] [TRAIN] epoch=175, iter=64810/80000, loss=0.8104, lr=0.002242, batch_cost=1.3817, reader_cost=0.0001 | ETA 05:49:48 2021-02-23 19:38:01 [INFO] [TRAIN] epoch=175, iter=64820/80000, loss=0.8918, lr=0.002241, batch_cost=1.3482, reader_cost=0.0001 | ETA 05:41:05 2021-02-23 19:38:15 [INFO] [TRAIN] epoch=175, iter=64830/80000, loss=0.8718, lr=0.002239, batch_cost=1.3374, reader_cost=0.0001 | ETA 05:38:08 2021-02-23 19:38:28 [INFO] [TRAIN] epoch=175, iter=64840/80000, loss=0.8074, lr=0.002238, batch_cost=1.3827, reader_cost=0.0001 | ETA 05:49:22 2021-02-23 19:38:42 [INFO] [TRAIN] epoch=175, iter=64850/80000, loss=0.7914, lr=0.002237, batch_cost=1.3547, reader_cost=0.0001 | ETA 05:42:03 2021-02-23 19:38:56 [INFO] [TRAIN] epoch=175, iter=64860/80000, loss=0.8139, lr=0.002235, batch_cost=1.3853, reader_cost=0.0001 | ETA 05:49:33 2021-02-23 19:39:10 [INFO] [TRAIN] epoch=175, iter=64870/80000, loss=0.8592, lr=0.002234, batch_cost=1.3976, reader_cost=0.0001 | ETA 05:52:25 2021-02-23 19:39:24 [INFO] [TRAIN] epoch=175, iter=64880/80000, loss=0.8194, lr=0.002233, batch_cost=1.3801, reader_cost=0.0001 | ETA 05:47:47 2021-02-23 19:39:37 [INFO] [TRAIN] epoch=175, iter=64890/80000, loss=0.8465, lr=0.002231, batch_cost=1.3469, reader_cost=0.0001 | ETA 05:39:11 2021-02-23 19:39:51 [INFO] [TRAIN] epoch=175, iter=64900/80000, loss=0.8293, lr=0.002230, batch_cost=1.3991, reader_cost=0.0001 | ETA 05:52:07 2021-02-23 19:40:05 [INFO] [TRAIN] epoch=175, iter=64910/80000, loss=0.8201, lr=0.002229, batch_cost=1.3523, reader_cost=0.0001 | ETA 05:40:05 2021-02-23 19:40:18 [INFO] [TRAIN] epoch=175, iter=64920/80000, loss=0.8035, lr=0.002227, batch_cost=1.3580, reader_cost=0.0001 | ETA 05:41:18 2021-02-23 19:40:32 [INFO] [TRAIN] epoch=175, iter=64930/80000, loss=0.8506, lr=0.002226, batch_cost=1.3480, reader_cost=0.0001 | ETA 05:38:34 2021-02-23 19:40:45 [INFO] [TRAIN] epoch=175, iter=64940/80000, loss=0.8005, lr=0.002225, batch_cost=1.3442, reader_cost=0.0001 | ETA 05:37:22 2021-02-23 19:40:59 [INFO] [TRAIN] epoch=175, iter=64950/80000, loss=0.7953, lr=0.002223, batch_cost=1.3713, reader_cost=0.0001 | ETA 05:43:58 2021-02-23 19:41:13 [INFO] [TRAIN] epoch=175, iter=64960/80000, loss=0.8511, lr=0.002222, batch_cost=1.3991, reader_cost=0.0001 | ETA 05:50:41 2021-02-23 19:41:26 [INFO] [TRAIN] epoch=175, iter=64970/80000, loss=0.7485, lr=0.002221, batch_cost=1.3492, reader_cost=0.0001 | ETA 05:37:58 2021-02-23 19:41:40 [INFO] [TRAIN] epoch=175, iter=64980/80000, loss=0.7985, lr=0.002219, batch_cost=1.3799, reader_cost=0.0001 | ETA 05:45:25 2021-02-23 19:41:54 [INFO] [TRAIN] epoch=175, iter=64990/80000, loss=0.8470, lr=0.002218, batch_cost=1.3560, reader_cost=0.0001 | ETA 05:39:13 2021-02-23 19:42:07 [INFO] [TRAIN] epoch=175, iter=65000/80000, loss=0.7892, lr=0.002217, batch_cost=1.3499, reader_cost=0.0001 | ETA 05:37:27 2021-02-23 19:42:07 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:18 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:06 - batch_cost: 0.2193 - reader cost: 0.0893  3/125 [..............................] - ETA: 58s - batch_cost: 0.2676 - reader cost: 0.0966  4/125 [..............................] - ETA: 57s - batch_cost: 0.3164 - reader cost: 0.1247 5/125 [>.............................] - ETA: 55s - batch_cost: 0.3313 - reader cost: 0.1247 6/125 [>.............................] - ETA: 53s - batch_cost: 0.3397 - reader cost: 0.1250 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3518 - reader cost: 0.1228 8/125 [>.............................] - ETA: 52s - batch_cost: 0.3657 - reader cost: 0.1219 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3729 - reader cost: 0.1206 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3791 - reader cost: 0.1255 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3845 - reader cost: 0.1267 12/125 [=>............................] - ETA: 50s - batch_cost: 0.3913 - reader cost: 0.1311 13/125 [==>...........................] - ETA: 49s - batch_cost: 0.3949 - reader cost: 0.1323 14/125 [==>...........................] - ETA: 49s - batch_cost: 0.3978 - reader cost: 0.1361 15/125 [==>...........................] - ETA: 48s - batch_cost: 0.3996 - reader cost: 0.1388 16/125 [==>...........................] - ETA: 48s - batch_cost: 0.4015 - reader cost: 0.1413 17/125 [===>..........................] - ETA: 47s - batch_cost: 0.3991 - reader cost: 0.1395 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.3999 - reader cost: 0.1396 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3998 - reader cost: 0.1394 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4007 - reader cost: 0.1407 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4015 - reader cost: 0.1419 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4005 - reader cost: 0.1413 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4011 - reader cost: 0.1423 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4011 - reader cost: 0.1426 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4019 - reader cost: 0.1427 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4029 - reader cost: 0.1413 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4030 - reader cost: 0.1387 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4039 - reader cost: 0.1378 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4040 - reader cost: 0.1358 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4048 - reader cost: 0.1371 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4060 - reader cost: 0.1388 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4072 - reader cost: 0.1404 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4064 - reader cost: 0.1402 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4060 - reader cost: 0.1400 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4048 - reader cost: 0.1392 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4050 - reader cost: 0.1396 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4045 - reader cost: 0.1386 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4053 - reader cost: 0.1393 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4058 - reader cost: 0.1393 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4068 - reader cost: 0.1406 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4071 - reader cost: 0.1404 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4078 - reader cost: 0.1396 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4079 - reader cost: 0.1390 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4081 - reader cost: 0.1396 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4086 - reader cost: 0.1405 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4082 - reader cost: 0.1400 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4085 - reader cost: 0.1407 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4092 - reader cost: 0.1418 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4099 - reader cost: 0.1428 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4097 - reader cost: 0.1427 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4094 - reader cost: 0.1428 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4097 - reader cost: 0.1427 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4106 - reader cost: 0.1433 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4113 - reader cost: 0.1442 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4120 - reader cost: 0.1451 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4115 - reader cost: 0.1449 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4116 - reader cost: 0.1453 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4120 - reader cost: 0.1458 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4116 - reader cost: 0.1456 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4110 - reader cost: 0.1450 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4113 - reader cost: 0.1455 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4116 - reader cost: 0.1461 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4109 - reader cost: 0.1456 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4114 - reader cost: 0.1454 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4114 - reader cost: 0.1456 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4110 - reader cost: 0.1454 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4111 - reader cost: 0.1449 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4107 - reader cost: 0.1440 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4108 - reader cost: 0.1430 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4110 - reader cost: 0.1422 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4112 - reader cost: 0.1419 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4109 - reader cost: 0.1418 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4106 - reader cost: 0.1418 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4111 - reader cost: 0.1424 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4117 - reader cost: 0.1433 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4119 - reader cost: 0.1437 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4113 - reader cost: 0.1433 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4115 - reader cost: 0.1437 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4118 - reader cost: 0.1443 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4122 - reader cost: 0.1449 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4124 - reader cost: 0.1452 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4126 - reader cost: 0.1456 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4124 - reader cost: 0.1455 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4128 - reader cost: 0.1461 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4127 - reader cost: 0.1461 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4125 - reader cost: 0.1461 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4122 - reader cost: 0.1460 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4126 - reader cost: 0.1466 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4123 - reader cost: 0.1463 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4124 - reader cost: 0.1466 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4127 - reader cost: 0.1464 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4125 - reader cost: 0.1460 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4129 - reader cost: 0.1466 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4131 - reader cost: 0.1470 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4129 - reader cost: 0.1469 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4123 - reader cost: 0.1465 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4126 - reader cost: 0.1470 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4123 - reader cost: 0.1467 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4125 - reader cost: 0.1470 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4128 - reader cost: 0.1473 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4130 - reader cost: 0.1475 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4133 - reader cost: 0.1471  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4134 - reader cost: 0.1464 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4133 - reader cost: 0.1459 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4134 - reader cost: 0.1462 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4131 - reader cost: 0.1461 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4134 - reader cost: 0.1460 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4137 - reader cost: 0.1463 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4138 - reader cost: 0.1465 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4139 - reader cost: 0.1467 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4140 - reader cost: 0.1470 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4141 - reader cost: 0.1472 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4141 - reader cost: 0.1475 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4142 - reader cost: 0.1477 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4144 - reader cost: 0.1480 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4142 - reader cost: 0.1479 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4139 - reader cost: 0.1477 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4140 - reader cost: 0.1476 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4142 - reader cost: 0.1479 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4138 - reader cost: 0.1475 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4140 - reader cost: 0.1478 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4142 - reader cost: 0.1481 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4144 - reader cost: 0.1484 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4142 - reader cost: 0.1483 125/125 [==============================] - 52s 419ms/step - batch_cost: 0.4140 - reader cost: 0.1482 2021-02-23 19:43:00 [INFO] [EVAL] #Images=500 mIoU=0.8019 Acc=0.9633 Kappa=0.9524 2021-02-23 19:43:00 [INFO] [EVAL] Class IoU: [0.9811 0.8506 0.9329 0.6174 0.6509 0.6807 0.7543 0.8294 0.9243 0.6082 0.9531 0.8406 0.6563 0.9549 0.8266 0.8867 0.8163 0.6782 0.7932] 2021-02-23 19:43:00 [INFO] [EVAL] Class Acc: [0.9924 0.9062 0.9636 0.8882 0.8441 0.8544 0.8663 0.9117 0.9536 0.7585 0.9763 0.9038 0.8032 0.9702 0.9555 0.9354 0.9489 0.7891 0.8704] 2021-02-23 19:43:07 [INFO] [EVAL] The model with the best validation mIoU (0.8019) was saved at iter 65000. 2021-02-23 19:43:21 [INFO] [TRAIN] epoch=175, iter=65010/80000, loss=0.8561, lr=0.002215, batch_cost=1.3520, reader_cost=0.0001 | ETA 05:37:46 2021-02-23 19:43:35 [INFO] [TRAIN] epoch=175, iter=65020/80000, loss=0.8448, lr=0.002214, batch_cost=1.3898, reader_cost=0.0001 | ETA 05:46:58 2021-02-23 19:43:48 [INFO] [TRAIN] epoch=175, iter=65030/80000, loss=0.8330, lr=0.002213, batch_cost=1.3693, reader_cost=0.0001 | ETA 05:41:38 2021-02-23 19:44:02 [INFO] [TRAIN] epoch=175, iter=65040/80000, loss=0.7938, lr=0.002211, batch_cost=1.3587, reader_cost=0.0001 | ETA 05:38:46 2021-02-23 19:44:16 [INFO] [TRAIN] epoch=175, iter=65050/80000, loss=0.8511, lr=0.002210, batch_cost=1.4069, reader_cost=0.0001 | ETA 05:50:33 2021-02-23 19:44:30 [INFO] [TRAIN] epoch=175, iter=65060/80000, loss=0.7740, lr=0.002209, batch_cost=1.3543, reader_cost=0.0001 | ETA 05:37:13 2021-02-23 19:44:43 [INFO] [TRAIN] epoch=175, iter=65070/80000, loss=0.7916, lr=0.002207, batch_cost=1.3551, reader_cost=0.0001 | ETA 05:37:12 2021-02-23 19:44:57 [INFO] [TRAIN] epoch=175, iter=65080/80000, loss=0.8776, lr=0.002206, batch_cost=1.3505, reader_cost=0.0001 | ETA 05:35:49 2021-02-23 19:45:10 [INFO] [TRAIN] epoch=175, iter=65090/80000, loss=0.8189, lr=0.002205, batch_cost=1.3331, reader_cost=0.0001 | ETA 05:31:17 2021-02-23 19:45:23 [INFO] [TRAIN] epoch=175, iter=65100/80000, loss=0.8470, lr=0.002203, batch_cost=1.3136, reader_cost=0.0001 | ETA 05:26:12 2021-02-23 19:45:38 [INFO] [TRAIN] epoch=176, iter=65110/80000, loss=0.9045, lr=0.002202, batch_cost=1.4775, reader_cost=0.0579 | ETA 06:06:39 2021-02-23 19:45:51 [INFO] [TRAIN] epoch=176, iter=65120/80000, loss=0.7856, lr=0.002201, batch_cost=1.3560, reader_cost=0.0001 | ETA 05:36:17 2021-02-23 19:46:05 [INFO] [TRAIN] epoch=176, iter=65130/80000, loss=0.8105, lr=0.002200, batch_cost=1.3296, reader_cost=0.0001 | ETA 05:29:31 2021-02-23 19:46:18 [INFO] [TRAIN] epoch=176, iter=65140/80000, loss=0.7996, lr=0.002198, batch_cost=1.3567, reader_cost=0.0001 | ETA 05:36:00 2021-02-23 19:46:32 [INFO] [TRAIN] epoch=176, iter=65150/80000, loss=0.8038, lr=0.002197, batch_cost=1.3531, reader_cost=0.0001 | ETA 05:34:53 2021-02-23 19:46:46 [INFO] [TRAIN] epoch=176, iter=65160/80000, loss=0.7945, lr=0.002196, batch_cost=1.3932, reader_cost=0.0001 | ETA 05:44:35 2021-02-23 19:47:00 [INFO] [TRAIN] epoch=176, iter=65170/80000, loss=0.7989, lr=0.002194, batch_cost=1.3911, reader_cost=0.0001 | ETA 05:43:50 2021-02-23 19:47:13 [INFO] [TRAIN] epoch=176, iter=65180/80000, loss=0.8029, lr=0.002193, batch_cost=1.3529, reader_cost=0.0001 | ETA 05:34:10 2021-02-23 19:47:27 [INFO] [TRAIN] epoch=176, iter=65190/80000, loss=0.8779, lr=0.002192, batch_cost=1.4053, reader_cost=0.0001 | ETA 05:46:52 2021-02-23 19:47:41 [INFO] [TRAIN] epoch=176, iter=65200/80000, loss=0.7962, lr=0.002190, batch_cost=1.3350, reader_cost=0.0001 | ETA 05:29:17 2021-02-23 19:47:54 [INFO] [TRAIN] epoch=176, iter=65210/80000, loss=0.8525, lr=0.002189, batch_cost=1.3692, reader_cost=0.0001 | ETA 05:37:31 2021-02-23 19:48:08 [INFO] [TRAIN] epoch=176, iter=65220/80000, loss=0.8414, lr=0.002188, batch_cost=1.3514, reader_cost=0.0001 | ETA 05:32:53 2021-02-23 19:48:21 [INFO] [TRAIN] epoch=176, iter=65230/80000, loss=0.8630, lr=0.002186, batch_cost=1.3528, reader_cost=0.0001 | ETA 05:33:00 2021-02-23 19:48:35 [INFO] [TRAIN] epoch=176, iter=65240/80000, loss=0.7833, lr=0.002185, batch_cost=1.3607, reader_cost=0.0001 | ETA 05:34:43 2021-02-23 19:48:49 [INFO] [TRAIN] epoch=176, iter=65250/80000, loss=0.9108, lr=0.002184, batch_cost=1.3600, reader_cost=0.0001 | ETA 05:34:20 2021-02-23 19:49:02 [INFO] [TRAIN] epoch=176, iter=65260/80000, loss=0.7536, lr=0.002182, batch_cost=1.3450, reader_cost=0.0001 | ETA 05:30:25 2021-02-23 19:49:15 [INFO] [TRAIN] epoch=176, iter=65270/80000, loss=0.7945, lr=0.002181, batch_cost=1.3415, reader_cost=0.0001 | ETA 05:29:20 2021-02-23 19:49:29 [INFO] [TRAIN] epoch=176, iter=65280/80000, loss=0.8761, lr=0.002180, batch_cost=1.3441, reader_cost=0.0001 | ETA 05:29:44 2021-02-23 19:49:42 [INFO] [TRAIN] epoch=176, iter=65290/80000, loss=0.8687, lr=0.002178, batch_cost=1.3554, reader_cost=0.0001 | ETA 05:32:17 2021-02-23 19:49:56 [INFO] [TRAIN] epoch=176, iter=65300/80000, loss=0.8322, lr=0.002177, batch_cost=1.3594, reader_cost=0.0001 | ETA 05:33:02 2021-02-23 19:50:10 [INFO] [TRAIN] epoch=176, iter=65310/80000, loss=0.8400, lr=0.002176, batch_cost=1.3600, reader_cost=0.0001 | ETA 05:32:58 2021-02-23 19:50:23 [INFO] [TRAIN] epoch=176, iter=65320/80000, loss=0.7726, lr=0.002174, batch_cost=1.3599, reader_cost=0.0001 | ETA 05:32:42 2021-02-23 19:50:37 [INFO] [TRAIN] epoch=176, iter=65330/80000, loss=0.8363, lr=0.002173, batch_cost=1.3628, reader_cost=0.0001 | ETA 05:33:11 2021-02-23 19:50:50 [INFO] [TRAIN] epoch=176, iter=65340/80000, loss=0.9218, lr=0.002172, batch_cost=1.3440, reader_cost=0.0001 | ETA 05:28:22 2021-02-23 19:51:04 [INFO] [TRAIN] epoch=176, iter=65350/80000, loss=0.7856, lr=0.002170, batch_cost=1.3844, reader_cost=0.0001 | ETA 05:38:01 2021-02-23 19:51:17 [INFO] [TRAIN] epoch=176, iter=65360/80000, loss=0.8597, lr=0.002169, batch_cost=1.3353, reader_cost=0.0001 | ETA 05:25:48 2021-02-23 19:51:31 [INFO] [TRAIN] epoch=176, iter=65370/80000, loss=0.8150, lr=0.002168, batch_cost=1.3633, reader_cost=0.0001 | ETA 05:32:25 2021-02-23 19:51:45 [INFO] [TRAIN] epoch=176, iter=65380/80000, loss=0.8024, lr=0.002166, batch_cost=1.3581, reader_cost=0.0001 | ETA 05:30:55 2021-02-23 19:51:58 [INFO] [TRAIN] epoch=176, iter=65390/80000, loss=0.7945, lr=0.002165, batch_cost=1.3329, reader_cost=0.0001 | ETA 05:24:34 2021-02-23 19:52:11 [INFO] [TRAIN] epoch=176, iter=65400/80000, loss=0.7880, lr=0.002164, batch_cost=1.3444, reader_cost=0.0001 | ETA 05:27:08 2021-02-23 19:52:25 [INFO] [TRAIN] epoch=176, iter=65410/80000, loss=0.8013, lr=0.002162, batch_cost=1.3365, reader_cost=0.0001 | ETA 05:24:58 2021-02-23 19:52:38 [INFO] [TRAIN] epoch=176, iter=65420/80000, loss=0.7771, lr=0.002161, batch_cost=1.3483, reader_cost=0.0001 | ETA 05:27:38 2021-02-23 19:52:52 [INFO] [TRAIN] epoch=176, iter=65430/80000, loss=0.7952, lr=0.002160, batch_cost=1.3750, reader_cost=0.0001 | ETA 05:33:53 2021-02-23 19:53:06 [INFO] [TRAIN] epoch=176, iter=65440/80000, loss=0.8406, lr=0.002158, batch_cost=1.3498, reader_cost=0.0001 | ETA 05:27:32 2021-02-23 19:53:19 [INFO] [TRAIN] epoch=176, iter=65450/80000, loss=0.8878, lr=0.002157, batch_cost=1.3636, reader_cost=0.0001 | ETA 05:30:41 2021-02-23 19:53:33 [INFO] [TRAIN] epoch=176, iter=65460/80000, loss=0.7582, lr=0.002156, batch_cost=1.3637, reader_cost=0.0001 | ETA 05:30:28 2021-02-23 19:53:46 [INFO] [TRAIN] epoch=176, iter=65470/80000, loss=0.8540, lr=0.002154, batch_cost=1.3141, reader_cost=0.0001 | ETA 05:18:14 2021-02-23 19:54:01 [INFO] [TRAIN] epoch=177, iter=65480/80000, loss=0.8295, lr=0.002153, batch_cost=1.4684, reader_cost=0.0856 | ETA 05:55:20 2021-02-23 19:54:14 [INFO] [TRAIN] epoch=177, iter=65490/80000, loss=0.8668, lr=0.002152, batch_cost=1.3413, reader_cost=0.0001 | ETA 05:24:21 2021-02-23 19:54:28 [INFO] [TRAIN] epoch=177, iter=65500/80000, loss=0.8446, lr=0.002150, batch_cost=1.3645, reader_cost=0.0001 | ETA 05:29:45 2021-02-23 19:54:41 [INFO] [TRAIN] epoch=177, iter=65510/80000, loss=0.7354, lr=0.002149, batch_cost=1.3422, reader_cost=0.0001 | ETA 05:24:08 2021-02-23 19:54:55 [INFO] [TRAIN] epoch=177, iter=65520/80000, loss=0.7838, lr=0.002148, batch_cost=1.3706, reader_cost=0.0001 | ETA 05:30:46 2021-02-23 19:55:09 [INFO] [TRAIN] epoch=177, iter=65530/80000, loss=0.9347, lr=0.002146, batch_cost=1.3721, reader_cost=0.0001 | ETA 05:30:53 2021-02-23 19:55:22 [INFO] [TRAIN] epoch=177, iter=65540/80000, loss=0.8297, lr=0.002145, batch_cost=1.3776, reader_cost=0.0001 | ETA 05:32:00 2021-02-23 19:55:36 [INFO] [TRAIN] epoch=177, iter=65550/80000, loss=0.8175, lr=0.002144, batch_cost=1.3575, reader_cost=0.0001 | ETA 05:26:56 2021-02-23 19:55:49 [INFO] [TRAIN] epoch=177, iter=65560/80000, loss=0.8395, lr=0.002142, batch_cost=1.3561, reader_cost=0.0001 | ETA 05:26:22 2021-02-23 19:56:03 [INFO] [TRAIN] epoch=177, iter=65570/80000, loss=0.8454, lr=0.002141, batch_cost=1.3819, reader_cost=0.0001 | ETA 05:32:21 2021-02-23 19:56:17 [INFO] [TRAIN] epoch=177, iter=65580/80000, loss=0.8438, lr=0.002140, batch_cost=1.3699, reader_cost=0.0001 | ETA 05:29:13 2021-02-23 19:56:30 [INFO] [TRAIN] epoch=177, iter=65590/80000, loss=0.7920, lr=0.002138, batch_cost=1.3512, reader_cost=0.0001 | ETA 05:24:30 2021-02-23 19:56:44 [INFO] [TRAIN] epoch=177, iter=65600/80000, loss=0.8671, lr=0.002137, batch_cost=1.3680, reader_cost=0.0001 | ETA 05:28:19 2021-02-23 19:56:58 [INFO] [TRAIN] epoch=177, iter=65610/80000, loss=0.8467, lr=0.002136, batch_cost=1.3573, reader_cost=0.0001 | ETA 05:25:32 2021-02-23 19:57:11 [INFO] [TRAIN] epoch=177, iter=65620/80000, loss=0.8016, lr=0.002134, batch_cost=1.3565, reader_cost=0.0001 | ETA 05:25:07 2021-02-23 19:57:25 [INFO] [TRAIN] epoch=177, iter=65630/80000, loss=0.8007, lr=0.002133, batch_cost=1.3573, reader_cost=0.0001 | ETA 05:25:03 2021-02-23 19:57:38 [INFO] [TRAIN] epoch=177, iter=65640/80000, loss=0.8322, lr=0.002131, batch_cost=1.3460, reader_cost=0.0001 | ETA 05:22:08 2021-02-23 19:57:52 [INFO] [TRAIN] epoch=177, iter=65650/80000, loss=0.7957, lr=0.002130, batch_cost=1.3477, reader_cost=0.0001 | ETA 05:22:19 2021-02-23 19:58:06 [INFO] [TRAIN] epoch=177, iter=65660/80000, loss=0.8678, lr=0.002129, batch_cost=1.3786, reader_cost=0.0001 | ETA 05:29:29 2021-02-23 19:58:19 [INFO] [TRAIN] epoch=177, iter=65670/80000, loss=0.8584, lr=0.002127, batch_cost=1.3546, reader_cost=0.0001 | ETA 05:23:30 2021-02-23 19:58:33 [INFO] [TRAIN] epoch=177, iter=65680/80000, loss=0.7828, lr=0.002126, batch_cost=1.3671, reader_cost=0.0001 | ETA 05:26:16 2021-02-23 19:58:46 [INFO] [TRAIN] epoch=177, iter=65690/80000, loss=0.7856, lr=0.002125, batch_cost=1.3465, reader_cost=0.0001 | ETA 05:21:08 2021-02-23 19:59:00 [INFO] [TRAIN] epoch=177, iter=65700/80000, loss=0.8287, lr=0.002123, batch_cost=1.3536, reader_cost=0.0001 | ETA 05:22:36 2021-02-23 19:59:14 [INFO] [TRAIN] epoch=177, iter=65710/80000, loss=0.7981, lr=0.002122, batch_cost=1.3797, reader_cost=0.0001 | ETA 05:28:35 2021-02-23 19:59:27 [INFO] [TRAIN] epoch=177, iter=65720/80000, loss=0.8258, lr=0.002121, batch_cost=1.3733, reader_cost=0.0001 | ETA 05:26:50 2021-02-23 19:59:41 [INFO] [TRAIN] epoch=177, iter=65730/80000, loss=0.7886, lr=0.002119, batch_cost=1.3857, reader_cost=0.0001 | ETA 05:29:33 2021-02-23 19:59:55 [INFO] [TRAIN] epoch=177, iter=65740/80000, loss=0.8096, lr=0.002118, batch_cost=1.3417, reader_cost=0.0001 | ETA 05:18:53 2021-02-23 20:00:08 [INFO] [TRAIN] epoch=177, iter=65750/80000, loss=0.8766, lr=0.002117, batch_cost=1.3639, reader_cost=0.0001 | ETA 05:23:55 2021-02-23 20:00:22 [INFO] [TRAIN] epoch=177, iter=65760/80000, loss=0.8212, lr=0.002115, batch_cost=1.3722, reader_cost=0.0001 | ETA 05:25:40 2021-02-23 20:00:36 [INFO] [TRAIN] epoch=177, iter=65770/80000, loss=0.8790, lr=0.002114, batch_cost=1.3523, reader_cost=0.0001 | ETA 05:20:42 2021-02-23 20:00:49 [INFO] [TRAIN] epoch=177, iter=65780/80000, loss=0.7830, lr=0.002113, batch_cost=1.3446, reader_cost=0.0001 | ETA 05:18:40 2021-02-23 20:01:03 [INFO] [TRAIN] epoch=177, iter=65790/80000, loss=0.8268, lr=0.002111, batch_cost=1.3636, reader_cost=0.0001 | ETA 05:22:56 2021-02-23 20:01:16 [INFO] [TRAIN] epoch=177, iter=65800/80000, loss=0.8479, lr=0.002110, batch_cost=1.3541, reader_cost=0.0001 | ETA 05:20:28 2021-02-23 20:01:30 [INFO] [TRAIN] epoch=177, iter=65810/80000, loss=0.8264, lr=0.002109, batch_cost=1.3540, reader_cost=0.0001 | ETA 05:20:12 2021-02-23 20:01:43 [INFO] [TRAIN] epoch=177, iter=65820/80000, loss=0.8052, lr=0.002107, batch_cost=1.3490, reader_cost=0.0001 | ETA 05:18:48 2021-02-23 20:01:57 [INFO] [TRAIN] epoch=177, iter=65830/80000, loss=0.8613, lr=0.002106, batch_cost=1.3383, reader_cost=0.0001 | ETA 05:16:04 2021-02-23 20:02:10 [INFO] [TRAIN] epoch=177, iter=65840/80000, loss=0.8302, lr=0.002105, batch_cost=1.3268, reader_cost=0.0001 | ETA 05:13:06 2021-02-23 20:02:24 [INFO] [TRAIN] epoch=178, iter=65850/80000, loss=0.7607, lr=0.002103, batch_cost=1.4299, reader_cost=0.0926 | ETA 05:37:12 2021-02-23 20:02:38 [INFO] [TRAIN] epoch=178, iter=65860/80000, loss=0.8035, lr=0.002102, batch_cost=1.3517, reader_cost=0.0001 | ETA 05:18:33 2021-02-23 20:02:51 [INFO] [TRAIN] epoch=178, iter=65870/80000, loss=0.8370, lr=0.002101, batch_cost=1.3552, reader_cost=0.0001 | ETA 05:19:09 2021-02-23 20:03:05 [INFO] [TRAIN] epoch=178, iter=65880/80000, loss=0.7945, lr=0.002099, batch_cost=1.3526, reader_cost=0.0001 | ETA 05:18:18 2021-02-23 20:03:18 [INFO] [TRAIN] epoch=178, iter=65890/80000, loss=0.8594, lr=0.002098, batch_cost=1.3594, reader_cost=0.0001 | ETA 05:19:41 2021-02-23 20:03:32 [INFO] [TRAIN] epoch=178, iter=65900/80000, loss=0.9373, lr=0.002097, batch_cost=1.3463, reader_cost=0.0001 | ETA 05:16:22 2021-02-23 20:03:45 [INFO] [TRAIN] epoch=178, iter=65910/80000, loss=0.8057, lr=0.002095, batch_cost=1.3480, reader_cost=0.0001 | ETA 05:16:33 2021-02-23 20:03:59 [INFO] [TRAIN] epoch=178, iter=65920/80000, loss=0.8447, lr=0.002094, batch_cost=1.3472, reader_cost=0.0001 | ETA 05:16:08 2021-02-23 20:04:12 [INFO] [TRAIN] epoch=178, iter=65930/80000, loss=0.8897, lr=0.002093, batch_cost=1.3499, reader_cost=0.0001 | ETA 05:16:32 2021-02-23 20:04:26 [INFO] [TRAIN] epoch=178, iter=65940/80000, loss=0.8362, lr=0.002091, batch_cost=1.3841, reader_cost=0.0001 | ETA 05:24:20 2021-02-23 20:04:40 [INFO] [TRAIN] epoch=178, iter=65950/80000, loss=0.8712, lr=0.002090, batch_cost=1.3988, reader_cost=0.0001 | ETA 05:27:32 2021-02-23 20:04:54 [INFO] [TRAIN] epoch=178, iter=65960/80000, loss=0.8191, lr=0.002089, batch_cost=1.3567, reader_cost=0.0001 | ETA 05:17:28 2021-02-23 20:05:07 [INFO] [TRAIN] epoch=178, iter=65970/80000, loss=0.8280, lr=0.002087, batch_cost=1.3522, reader_cost=0.0001 | ETA 05:16:11 2021-02-23 20:05:21 [INFO] [TRAIN] epoch=178, iter=65980/80000, loss=0.8549, lr=0.002086, batch_cost=1.3816, reader_cost=0.0001 | ETA 05:22:49 2021-02-23 20:05:35 [INFO] [TRAIN] epoch=178, iter=65990/80000, loss=0.8361, lr=0.002085, batch_cost=1.3755, reader_cost=0.0001 | ETA 05:21:11 2021-02-23 20:05:49 [INFO] [TRAIN] epoch=178, iter=66000/80000, loss=0.7593, lr=0.002083, batch_cost=1.3839, reader_cost=0.0001 | ETA 05:22:55 2021-02-23 20:05:49 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:10 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:01 - batch_cost: 0.2189 - reader cost: 0.0940  3/125 [..............................] - ETA: 58s - batch_cost: 0.2927 - reader cost: 0.1236  4/125 [..............................] - ETA: 57s - batch_cost: 0.3304 - reader cost: 0.1352 5/125 [>.............................] - ETA: 55s - batch_cost: 0.3472 - reader cost: 0.1408 6/125 [>.............................] - ETA: 53s - batch_cost: 0.3519 - reader cost: 0.1378 7/125 [>.............................] - ETA: 51s - batch_cost: 0.3540 - reader cost: 0.1347 8/125 [>.............................] - ETA: 50s - batch_cost: 0.3628 - reader cost: 0.1399 9/125 [=>............................] - ETA: 50s - batch_cost: 0.3702 - reader cost: 0.1433 10/125 [=>............................] - ETA: 49s - batch_cost: 0.3761 - reader cost: 0.1468 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3807 - reader cost: 0.1488 12/125 [=>............................] - ETA: 48s - batch_cost: 0.3830 - reader cost: 0.1495 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3871 - reader cost: 0.1519 14/125 [==>...........................] - ETA: 47s - batch_cost: 0.3894 - reader cost: 0.1532 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3918 - reader cost: 0.1547 16/125 [==>...........................] - ETA: 46s - batch_cost: 0.3929 - reader cost: 0.1545 17/125 [===>..........................] - ETA: 45s - batch_cost: 0.3917 - reader cost: 0.1518 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3932 - reader cost: 0.1526 19/125 [===>..........................] - ETA: 44s - batch_cost: 0.3934 - reader cost: 0.1521 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3959 - reader cost: 0.1542 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.3974 - reader cost: 0.1554 22/125 [====>.........................] - ETA: 43s - batch_cost: 0.3978 - reader cost: 0.1555 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.3995 - reader cost: 0.1564 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.4004 - reader cost: 0.1570 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4016 - reader cost: 0.1579 26/125 [=====>........................] - ETA: 41s - batch_cost: 0.4023 - reader cost: 0.1585 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4015 - reader cost: 0.1575 28/125 [=====>........................] - ETA: 40s - batch_cost: 0.4023 - reader cost: 0.1583 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4012 - reader cost: 0.1568 30/125 [======>.......................] - ETA: 39s - batch_cost: 0.4007 - reader cost: 0.1553 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.4019 - reader cost: 0.1563 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4020 - reader cost: 0.1554 33/125 [======>.......................] - ETA: 38s - batch_cost: 0.4032 - reader cost: 0.1562 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4034 - reader cost: 0.1562 35/125 [=======>......................] - ETA: 37s - batch_cost: 0.4039 - reader cost: 0.1567 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4037 - reader cost: 0.1563 37/125 [=======>......................] - ETA: 36s - batch_cost: 0.4030 - reader cost: 0.1556 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4037 - reader cost: 0.1562 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4047 - reader cost: 0.1572 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4036 - reader cost: 0.1561 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4043 - reader cost: 0.1567 42/125 [=========>....................] - ETA: 34s - batch_cost: 0.4048 - reader cost: 0.1572 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4040 - reader cost: 0.1564 44/125 [=========>....................] - ETA: 33s - batch_cost: 0.4051 - reader cost: 0.1574 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4057 - reader cost: 0.1579 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4054 - reader cost: 0.1576 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4059 - reader cost: 0.1580 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4050 - reader cost: 0.1571 49/125 [==========>...................] - ETA: 31s - batch_cost: 0.4042 - reader cost: 0.1562 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4046 - reader cost: 0.1566 51/125 [===========>..................] - ETA: 30s - batch_cost: 0.4052 - reader cost: 0.1572 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4058 - reader cost: 0.1577 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4061 - reader cost: 0.1581 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4065 - reader cost: 0.1583 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4067 - reader cost: 0.1586 56/125 [============>.................] - ETA: 28s - batch_cost: 0.4071 - reader cost: 0.1589 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4067 - reader cost: 0.1583 58/125 [============>.................] - ETA: 27s - batch_cost: 0.4074 - reader cost: 0.1572 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4077 - reader cost: 0.1553 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4080 - reader cost: 0.1531 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4075 - reader cost: 0.1524 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4078 - reader cost: 0.1528 63/125 [==============>...............] - ETA: 25s - batch_cost: 0.4087 - reader cost: 0.1527 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4087 - reader cost: 0.1521 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4090 - reader cost: 0.1523 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4094 - reader cost: 0.1524 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4098 - reader cost: 0.1520 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4110 - reader cost: 0.1526 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4110 - reader cost: 0.1528 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4112 - reader cost: 0.1530 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4105 - reader cost: 0.1524 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4106 - reader cost: 0.1525 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4107 - reader cost: 0.1526 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4108 - reader cost: 0.1528 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4104 - reader cost: 0.1525 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4101 - reader cost: 0.1522 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4103 - reader cost: 0.1525 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4106 - reader cost: 0.1528 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4100 - reader cost: 0.1524 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4105 - reader cost: 0.1527 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4105 - reader cost: 0.1528 82/125 [==================>...........] - ETA: 17s - batch_cost: 0.4107 - reader cost: 0.1531 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4107 - reader cost: 0.1532 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4110 - reader cost: 0.1534 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4112 - reader cost: 0.1538 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4109 - reader cost: 0.1535 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4105 - reader cost: 0.1531 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4108 - reader cost: 0.1535 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4110 - reader cost: 0.1538 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4113 - reader cost: 0.1541 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4110 - reader cost: 0.1539 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4112 - reader cost: 0.1542 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4114 - reader cost: 0.1544 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4111 - reader cost: 0.1541 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4112 - reader cost: 0.1543 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4108 - reader cost: 0.1540 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4111 - reader cost: 0.1543 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4106 - reader cost: 0.1539 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4101 - reader cost: 0.1535 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4104 - reader cost: 0.1538 101/125 [=======================>......] - ETA: 9s - batch_cost: 0.4103 - reader cost: 0.1536  102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4104 - reader cost: 0.1537 103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4107 - reader cost: 0.1540 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4103 - reader cost: 0.1537 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4105 - reader cost: 0.1539 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4100 - reader cost: 0.1535 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4102 - reader cost: 0.1538 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4099 - reader cost: 0.1535 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4097 - reader cost: 0.1534 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4093 - reader cost: 0.1530 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4091 - reader cost: 0.1528 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4091 - reader cost: 0.1529 113/125 [==========================>...] - ETA: 4s - batch_cost: 0.4094 - reader cost: 0.1528 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4091 - reader cost: 0.1526 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4088 - reader cost: 0.1523 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4088 - reader cost: 0.1523 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4090 - reader cost: 0.1520 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4090 - reader cost: 0.1517 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4092 - reader cost: 0.1519 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4093 - reader cost: 0.1520 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4094 - reader cost: 0.1521 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4097 - reader cost: 0.1523 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4100 - reader cost: 0.1526 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4096 - reader cost: 0.1522 125/125 [==============================] - 52s 414ms/step - batch_cost: 0.4097 - reader cost: 0.1523 2021-02-23 20:06:40 [INFO] [EVAL] #Images=500 mIoU=0.8000 Acc=0.9627 Kappa=0.9516 2021-02-23 20:06:40 [INFO] [EVAL] Class IoU: [0.9802 0.8429 0.9289 0.5304 0.6187 0.6823 0.7539 0.8277 0.9281 0.6458 0.95 0.8435 0.6625 0.9567 0.8046 0.9064 0.8444 0.6938 0.799 ] 2021-02-23 20:06:40 [INFO] [EVAL] Class Acc: [0.9898 0.9096 0.9553 0.9106 0.8422 0.8511 0.857 0.9135 0.9587 0.8513 0.9725 0.8953 0.7961 0.9747 0.9435 0.947 0.9326 0.8287 0.8781] 2021-02-23 20:06:45 [INFO] [EVAL] The model with the best validation mIoU (0.8019) was saved at iter 65000. 2021-02-23 20:06:59 [INFO] [TRAIN] epoch=178, iter=66010/80000, loss=0.8131, lr=0.002082, batch_cost=1.3634, reader_cost=0.0001 | ETA 05:17:53 2021-02-23 20:07:12 [INFO] [TRAIN] epoch=178, iter=66020/80000, loss=0.8054, lr=0.002081, batch_cost=1.3470, reader_cost=0.0001 | ETA 05:13:51 2021-02-23 20:07:26 [INFO] [TRAIN] epoch=178, iter=66030/80000, loss=0.8341, lr=0.002079, batch_cost=1.3982, reader_cost=0.0001 | ETA 05:25:33 2021-02-23 20:07:40 [INFO] [TRAIN] epoch=178, iter=66040/80000, loss=0.8493, lr=0.002078, batch_cost=1.3518, reader_cost=0.0001 | ETA 05:14:31 2021-02-23 20:07:54 [INFO] [TRAIN] epoch=178, iter=66050/80000, loss=0.8151, lr=0.002077, batch_cost=1.3810, reader_cost=0.0001 | ETA 05:21:04 2021-02-23 20:08:07 [INFO] [TRAIN] epoch=178, iter=66060/80000, loss=0.8445, lr=0.002075, batch_cost=1.3566, reader_cost=0.0001 | ETA 05:15:11 2021-02-23 20:08:21 [INFO] [TRAIN] epoch=178, iter=66070/80000, loss=0.8680, lr=0.002074, batch_cost=1.3713, reader_cost=0.0001 | ETA 05:18:22 2021-02-23 20:08:34 [INFO] [TRAIN] epoch=178, iter=66080/80000, loss=0.8061, lr=0.002073, batch_cost=1.3520, reader_cost=0.0001 | ETA 05:13:39 2021-02-23 20:08:48 [INFO] [TRAIN] epoch=178, iter=66090/80000, loss=0.8541, lr=0.002071, batch_cost=1.3792, reader_cost=0.0001 | ETA 05:19:44 2021-02-23 20:09:02 [INFO] [TRAIN] epoch=178, iter=66100/80000, loss=0.8799, lr=0.002070, batch_cost=1.3685, reader_cost=0.0001 | ETA 05:17:02 2021-02-23 20:09:16 [INFO] [TRAIN] epoch=178, iter=66110/80000, loss=0.8443, lr=0.002069, batch_cost=1.3841, reader_cost=0.0001 | ETA 05:20:25 2021-02-23 20:09:29 [INFO] [TRAIN] epoch=178, iter=66120/80000, loss=0.8342, lr=0.002067, batch_cost=1.3761, reader_cost=0.0001 | ETA 05:18:19 2021-02-23 20:09:43 [INFO] [TRAIN] epoch=178, iter=66130/80000, loss=0.8326, lr=0.002066, batch_cost=1.3426, reader_cost=0.0001 | ETA 05:10:21 2021-02-23 20:09:56 [INFO] [TRAIN] epoch=178, iter=66140/80000, loss=0.8095, lr=0.002065, batch_cost=1.3376, reader_cost=0.0001 | ETA 05:08:59 2021-02-23 20:10:10 [INFO] [TRAIN] epoch=178, iter=66150/80000, loss=0.8417, lr=0.002063, batch_cost=1.3581, reader_cost=0.0001 | ETA 05:13:29 2021-02-23 20:10:23 [INFO] [TRAIN] epoch=178, iter=66160/80000, loss=0.8024, lr=0.002062, batch_cost=1.3348, reader_cost=0.0001 | ETA 05:07:53 2021-02-23 20:10:37 [INFO] [TRAIN] epoch=178, iter=66170/80000, loss=0.8185, lr=0.002061, batch_cost=1.3841, reader_cost=0.0001 | ETA 05:19:01 2021-02-23 20:10:51 [INFO] [TRAIN] epoch=178, iter=66180/80000, loss=0.8216, lr=0.002059, batch_cost=1.3772, reader_cost=0.0001 | ETA 05:17:12 2021-02-23 20:11:04 [INFO] [TRAIN] epoch=178, iter=66190/80000, loss=0.8918, lr=0.002058, batch_cost=1.3596, reader_cost=0.0001 | ETA 05:12:56 2021-02-23 20:11:18 [INFO] [TRAIN] epoch=178, iter=66200/80000, loss=0.8185, lr=0.002057, batch_cost=1.3636, reader_cost=0.0001 | ETA 05:13:37 2021-02-23 20:11:31 [INFO] [TRAIN] epoch=178, iter=66210/80000, loss=0.8255, lr=0.002055, batch_cost=1.3413, reader_cost=0.0001 | ETA 05:08:16 2021-02-23 20:11:46 [INFO] [TRAIN] epoch=179, iter=66220/80000, loss=0.8012, lr=0.002054, batch_cost=1.4489, reader_cost=0.0762 | ETA 05:32:45 2021-02-23 20:11:59 [INFO] [TRAIN] epoch=179, iter=66230/80000, loss=0.8604, lr=0.002053, batch_cost=1.3357, reader_cost=0.0001 | ETA 05:06:32 2021-02-23 20:12:13 [INFO] [TRAIN] epoch=179, iter=66240/80000, loss=0.8620, lr=0.002051, batch_cost=1.3887, reader_cost=0.0001 | ETA 05:18:28 2021-02-23 20:12:27 [INFO] [TRAIN] epoch=179, iter=66250/80000, loss=0.8556, lr=0.002050, batch_cost=1.3539, reader_cost=0.0001 | ETA 05:10:16 2021-02-23 20:12:40 [INFO] [TRAIN] epoch=179, iter=66260/80000, loss=0.8289, lr=0.002048, batch_cost=1.3461, reader_cost=0.0001 | ETA 05:08:15 2021-02-23 20:12:54 [INFO] [TRAIN] epoch=179, iter=66270/80000, loss=0.7791, lr=0.002047, batch_cost=1.3486, reader_cost=0.0001 | ETA 05:08:36 2021-02-23 20:13:07 [INFO] [TRAIN] epoch=179, iter=66280/80000, loss=0.8120, lr=0.002046, batch_cost=1.3754, reader_cost=0.0004 | ETA 05:14:30 2021-02-23 20:13:21 [INFO] [TRAIN] epoch=179, iter=66290/80000, loss=0.8420, lr=0.002044, batch_cost=1.3489, reader_cost=0.0001 | ETA 05:08:13 2021-02-23 20:13:34 [INFO] [TRAIN] epoch=179, iter=66300/80000, loss=0.8005, lr=0.002043, batch_cost=1.3346, reader_cost=0.0001 | ETA 05:04:44 2021-02-23 20:13:48 [INFO] [TRAIN] epoch=179, iter=66310/80000, loss=0.7797, lr=0.002042, batch_cost=1.3707, reader_cost=0.0001 | ETA 05:12:44 2021-02-23 20:14:02 [INFO] [TRAIN] epoch=179, iter=66320/80000, loss=0.8606, lr=0.002040, batch_cost=1.3565, reader_cost=0.0001 | ETA 05:09:17 2021-02-23 20:14:15 [INFO] [TRAIN] epoch=179, iter=66330/80000, loss=0.8271, lr=0.002039, batch_cost=1.3570, reader_cost=0.0001 | ETA 05:09:10 2021-02-23 20:14:29 [INFO] [TRAIN] epoch=179, iter=66340/80000, loss=0.8083, lr=0.002038, batch_cost=1.3695, reader_cost=0.0001 | ETA 05:11:46 2021-02-23 20:14:42 [INFO] [TRAIN] epoch=179, iter=66350/80000, loss=0.8071, lr=0.002036, batch_cost=1.3405, reader_cost=0.0001 | ETA 05:04:57 2021-02-23 20:14:56 [INFO] [TRAIN] epoch=179, iter=66360/80000, loss=0.8437, lr=0.002035, batch_cost=1.4001, reader_cost=0.0001 | ETA 05:18:17 2021-02-23 20:15:10 [INFO] [TRAIN] epoch=179, iter=66370/80000, loss=0.8430, lr=0.002034, batch_cost=1.3562, reader_cost=0.0001 | ETA 05:08:05 2021-02-23 20:15:23 [INFO] [TRAIN] epoch=179, iter=66380/80000, loss=0.8099, lr=0.002032, batch_cost=1.3670, reader_cost=0.0001 | ETA 05:10:18 2021-02-23 20:15:37 [INFO] [TRAIN] epoch=179, iter=66390/80000, loss=0.8397, lr=0.002031, batch_cost=1.3692, reader_cost=0.0001 | ETA 05:10:34 2021-02-23 20:15:51 [INFO] [TRAIN] epoch=179, iter=66400/80000, loss=0.8155, lr=0.002030, batch_cost=1.3564, reader_cost=0.0001 | ETA 05:07:26 2021-02-23 20:16:04 [INFO] [TRAIN] epoch=179, iter=66410/80000, loss=0.7723, lr=0.002028, batch_cost=1.3757, reader_cost=0.0001 | ETA 05:11:36 2021-02-23 20:16:18 [INFO] [TRAIN] epoch=179, iter=66420/80000, loss=0.8175, lr=0.002027, batch_cost=1.3708, reader_cost=0.0001 | ETA 05:10:15 2021-02-23 20:16:32 [INFO] [TRAIN] epoch=179, iter=66430/80000, loss=0.8356, lr=0.002026, batch_cost=1.3471, reader_cost=0.0001 | ETA 05:04:40 2021-02-23 20:16:45 [INFO] [TRAIN] epoch=179, iter=66440/80000, loss=0.8067, lr=0.002024, batch_cost=1.3597, reader_cost=0.0001 | ETA 05:07:17 2021-02-23 20:16:59 [INFO] [TRAIN] epoch=179, iter=66450/80000, loss=0.8281, lr=0.002023, batch_cost=1.3566, reader_cost=0.0001 | ETA 05:06:22 2021-02-23 20:17:12 [INFO] [TRAIN] epoch=179, iter=66460/80000, loss=0.7541, lr=0.002022, batch_cost=1.3512, reader_cost=0.0001 | ETA 05:04:55 2021-02-23 20:17:26 [INFO] [TRAIN] epoch=179, iter=66470/80000, loss=0.7954, lr=0.002020, batch_cost=1.3459, reader_cost=0.0001 | ETA 05:03:29 2021-02-23 20:17:39 [INFO] [TRAIN] epoch=179, iter=66480/80000, loss=0.8713, lr=0.002019, batch_cost=1.3516, reader_cost=0.0001 | ETA 05:04:33 2021-02-23 20:17:53 [INFO] [TRAIN] epoch=179, iter=66490/80000, loss=0.8117, lr=0.002018, batch_cost=1.3558, reader_cost=0.0001 | ETA 05:05:16 2021-02-23 20:18:07 [INFO] [TRAIN] epoch=179, iter=66500/80000, loss=0.8033, lr=0.002016, batch_cost=1.3790, reader_cost=0.0001 | ETA 05:10:16 2021-02-23 20:18:20 [INFO] [TRAIN] epoch=179, iter=66510/80000, loss=0.7760, lr=0.002015, batch_cost=1.3614, reader_cost=0.0001 | ETA 05:06:04 2021-02-23 20:18:34 [INFO] [TRAIN] epoch=179, iter=66520/80000, loss=0.8342, lr=0.002014, batch_cost=1.3562, reader_cost=0.0001 | ETA 05:04:41 2021-02-23 20:18:47 [INFO] [TRAIN] epoch=179, iter=66530/80000, loss=0.8434, lr=0.002012, batch_cost=1.3458, reader_cost=0.0001 | ETA 05:02:07 2021-02-23 20:19:01 [INFO] [TRAIN] epoch=179, iter=66540/80000, loss=0.8213, lr=0.002011, batch_cost=1.3667, reader_cost=0.0001 | ETA 05:06:36 2021-02-23 20:19:14 [INFO] [TRAIN] epoch=179, iter=66550/80000, loss=0.8685, lr=0.002010, batch_cost=1.3449, reader_cost=0.0001 | ETA 05:01:29 2021-02-23 20:19:28 [INFO] [TRAIN] epoch=179, iter=66560/80000, loss=0.9021, lr=0.002008, batch_cost=1.3902, reader_cost=0.0001 | ETA 05:11:24 2021-02-23 20:19:42 [INFO] [TRAIN] epoch=179, iter=66570/80000, loss=0.8180, lr=0.002007, batch_cost=1.3821, reader_cost=0.0001 | ETA 05:09:21 2021-02-23 20:19:56 [INFO] [TRAIN] epoch=179, iter=66580/80000, loss=0.8339, lr=0.002006, batch_cost=1.3743, reader_cost=0.0001 | ETA 05:07:22 2021-02-23 20:20:10 [INFO] [TRAIN] epoch=180, iter=66590/80000, loss=0.8398, lr=0.002004, batch_cost=1.4261, reader_cost=0.0791 | ETA 05:18:43 2021-02-23 20:20:24 [INFO] [TRAIN] epoch=180, iter=66600/80000, loss=0.7919, lr=0.002003, batch_cost=1.3592, reader_cost=0.0001 | ETA 05:03:33 2021-02-23 20:20:37 [INFO] [TRAIN] epoch=180, iter=66610/80000, loss=0.9254, lr=0.002001, batch_cost=1.3488, reader_cost=0.0001 | ETA 05:01:00 2021-02-23 20:20:51 [INFO] [TRAIN] epoch=180, iter=66620/80000, loss=0.7710, lr=0.002000, batch_cost=1.3491, reader_cost=0.0001 | ETA 05:00:50 2021-02-23 20:21:04 [INFO] [TRAIN] epoch=180, iter=66630/80000, loss=0.8745, lr=0.001999, batch_cost=1.3355, reader_cost=0.0001 | ETA 04:57:35 2021-02-23 20:21:18 [INFO] [TRAIN] epoch=180, iter=66640/80000, loss=0.8071, lr=0.001997, batch_cost=1.3596, reader_cost=0.0001 | ETA 05:02:43 2021-02-23 20:21:31 [INFO] [TRAIN] epoch=180, iter=66650/80000, loss=0.8030, lr=0.001996, batch_cost=1.3833, reader_cost=0.0001 | ETA 05:07:47 2021-02-23 20:21:45 [INFO] [TRAIN] epoch=180, iter=66660/80000, loss=0.8010, lr=0.001995, batch_cost=1.3555, reader_cost=0.0001 | ETA 05:01:22 2021-02-23 20:21:59 [INFO] [TRAIN] epoch=180, iter=66670/80000, loss=0.7975, lr=0.001993, batch_cost=1.3673, reader_cost=0.0001 | ETA 05:03:46 2021-02-23 20:22:12 [INFO] [TRAIN] epoch=180, iter=66680/80000, loss=0.8507, lr=0.001992, batch_cost=1.3395, reader_cost=0.0001 | ETA 04:57:22 2021-02-23 20:22:26 [INFO] [TRAIN] epoch=180, iter=66690/80000, loss=0.8048, lr=0.001991, batch_cost=1.3852, reader_cost=0.0001 | ETA 05:07:17 2021-02-23 20:22:40 [INFO] [TRAIN] epoch=180, iter=66700/80000, loss=0.8717, lr=0.001989, batch_cost=1.3561, reader_cost=0.0001 | ETA 05:00:36 2021-02-23 20:22:53 [INFO] [TRAIN] epoch=180, iter=66710/80000, loss=0.7517, lr=0.001988, batch_cost=1.3813, reader_cost=0.0001 | ETA 05:05:58 2021-02-23 20:23:07 [INFO] [TRAIN] epoch=180, iter=66720/80000, loss=0.8586, lr=0.001987, batch_cost=1.3885, reader_cost=0.0001 | ETA 05:07:19 2021-02-23 20:23:21 [INFO] [TRAIN] epoch=180, iter=66730/80000, loss=0.8874, lr=0.001985, batch_cost=1.3862, reader_cost=0.0001 | ETA 05:06:34 2021-02-23 20:23:35 [INFO] [TRAIN] epoch=180, iter=66740/80000, loss=0.8434, lr=0.001984, batch_cost=1.3481, reader_cost=0.0001 | ETA 04:57:55 2021-02-23 20:23:48 [INFO] [TRAIN] epoch=180, iter=66750/80000, loss=0.8162, lr=0.001983, batch_cost=1.3828, reader_cost=0.0001 | ETA 05:05:22 2021-02-23 20:24:02 [INFO] [TRAIN] epoch=180, iter=66760/80000, loss=0.7480, lr=0.001981, batch_cost=1.3749, reader_cost=0.0001 | ETA 05:03:23 2021-02-23 20:24:16 [INFO] [TRAIN] epoch=180, iter=66770/80000, loss=0.7952, lr=0.001980, batch_cost=1.3812, reader_cost=0.0001 | ETA 05:04:33 2021-02-23 20:24:29 [INFO] [TRAIN] epoch=180, iter=66780/80000, loss=0.8786, lr=0.001979, batch_cost=1.3467, reader_cost=0.0001 | ETA 04:56:43 2021-02-23 20:24:43 [INFO] [TRAIN] epoch=180, iter=66790/80000, loss=0.7730, lr=0.001977, batch_cost=1.3549, reader_cost=0.0001 | ETA 04:58:17 2021-02-23 20:24:57 [INFO] [TRAIN] epoch=180, iter=66800/80000, loss=0.8326, lr=0.001976, batch_cost=1.3566, reader_cost=0.0001 | ETA 04:58:26 2021-02-23 20:25:10 [INFO] [TRAIN] epoch=180, iter=66810/80000, loss=0.8319, lr=0.001975, batch_cost=1.3580, reader_cost=0.0001 | ETA 04:58:31 2021-02-23 20:25:24 [INFO] [TRAIN] epoch=180, iter=66820/80000, loss=0.8258, lr=0.001973, batch_cost=1.3590, reader_cost=0.0001 | ETA 04:58:31 2021-02-23 20:25:37 [INFO] [TRAIN] epoch=180, iter=66830/80000, loss=0.8094, lr=0.001972, batch_cost=1.3416, reader_cost=0.0001 | ETA 04:54:29 2021-02-23 20:25:51 [INFO] [TRAIN] epoch=180, iter=66840/80000, loss=0.7899, lr=0.001971, batch_cost=1.3513, reader_cost=0.0001 | ETA 04:56:23 2021-02-23 20:26:05 [INFO] [TRAIN] epoch=180, iter=66850/80000, loss=0.7758, lr=0.001969, batch_cost=1.3924, reader_cost=0.0001 | ETA 05:05:09 2021-02-23 20:26:18 [INFO] [TRAIN] epoch=180, iter=66860/80000, loss=0.8649, lr=0.001968, batch_cost=1.3312, reader_cost=0.0001 | ETA 04:51:32 2021-02-23 20:26:31 [INFO] [TRAIN] epoch=180, iter=66870/80000, loss=0.7851, lr=0.001966, batch_cost=1.3506, reader_cost=0.0001 | ETA 04:55:33 2021-02-23 20:26:45 [INFO] [TRAIN] epoch=180, iter=66880/80000, loss=0.8200, lr=0.001965, batch_cost=1.3429, reader_cost=0.0001 | ETA 04:53:38 2021-02-23 20:26:58 [INFO] [TRAIN] epoch=180, iter=66890/80000, loss=0.8125, lr=0.001964, batch_cost=1.3467, reader_cost=0.0001 | ETA 04:54:14 2021-02-23 20:27:12 [INFO] [TRAIN] epoch=180, iter=66900/80000, loss=0.7981, lr=0.001962, batch_cost=1.3473, reader_cost=0.0001 | ETA 04:54:09 2021-02-23 20:27:25 [INFO] [TRAIN] epoch=180, iter=66910/80000, loss=0.9009, lr=0.001961, batch_cost=1.3448, reader_cost=0.0001 | ETA 04:53:23 2021-02-23 20:27:39 [INFO] [TRAIN] epoch=180, iter=66920/80000, loss=0.7438, lr=0.001960, batch_cost=1.3662, reader_cost=0.0001 | ETA 04:57:49 2021-02-23 20:27:52 [INFO] [TRAIN] epoch=180, iter=66930/80000, loss=0.8106, lr=0.001958, batch_cost=1.3604, reader_cost=0.0001 | ETA 04:56:20 2021-02-23 20:28:06 [INFO] [TRAIN] epoch=180, iter=66940/80000, loss=0.8670, lr=0.001957, batch_cost=1.3424, reader_cost=0.0001 | ETA 04:52:11 2021-02-23 20:28:19 [INFO] [TRAIN] epoch=180, iter=66950/80000, loss=0.8249, lr=0.001956, batch_cost=1.3441, reader_cost=0.0001 | ETA 04:52:20 2021-02-23 20:28:33 [INFO] [TRAIN] epoch=180, iter=66960/80000, loss=0.8193, lr=0.001954, batch_cost=1.3659, reader_cost=0.0001 | ETA 04:56:51 2021-02-23 20:28:47 [INFO] [TRAIN] epoch=181, iter=66970/80000, loss=0.8046, lr=0.001953, batch_cost=1.4441, reader_cost=0.0660 | ETA 05:13:36 2021-02-23 20:29:01 [INFO] [TRAIN] epoch=181, iter=66980/80000, loss=0.7945, lr=0.001952, batch_cost=1.3285, reader_cost=0.0001 | ETA 04:48:17 2021-02-23 20:29:15 [INFO] [TRAIN] epoch=181, iter=66990/80000, loss=0.8312, lr=0.001950, batch_cost=1.3826, reader_cost=0.0001 | ETA 04:59:47 2021-02-23 20:29:28 [INFO] [TRAIN] epoch=181, iter=67000/80000, loss=0.7956, lr=0.001949, batch_cost=1.3529, reader_cost=0.0001 | ETA 04:53:07 2021-02-23 20:29:28 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:20 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:04 - batch_cost: 0.1975 - reader cost: 0.0717  3/125 [..............................] - ETA: 59s - batch_cost: 0.2745 - reader cost: 0.1078  4/125 [..............................] - ETA: 57s - batch_cost: 0.3123 - reader cost: 0.1250 5/125 [>.............................] - ETA: 54s - batch_cost: 0.3253 - reader cost: 0.1254 6/125 [>.............................] - ETA: 52s - batch_cost: 0.3332 - reader cost: 0.1253 7/125 [>.............................] - ETA: 50s - batch_cost: 0.3374 - reader cost: 0.1235 8/125 [>.............................] - ETA: 50s - batch_cost: 0.3485 - reader cost: 0.1282 9/125 [=>............................] - ETA: 49s - batch_cost: 0.3554 - reader cost: 0.1318 10/125 [=>............................] - ETA: 48s - batch_cost: 0.3582 - reader cost: 0.1318 11/125 [=>............................] - ETA: 47s - batch_cost: 0.3602 - reader cost: 0.1315 12/125 [=>............................] - ETA: 47s - batch_cost: 0.3642 - reader cost: 0.1338 13/125 [==>...........................] - ETA: 46s - batch_cost: 0.3657 - reader cost: 0.1336 14/125 [==>...........................] - ETA: 46s - batch_cost: 0.3706 - reader cost: 0.1373 15/125 [==>...........................] - ETA: 45s - batch_cost: 0.3708 - reader cost: 0.1356 16/125 [==>...........................] - ETA: 45s - batch_cost: 0.3776 - reader cost: 0.1391 17/125 [===>..........................] - ETA: 45s - batch_cost: 0.3813 - reader cost: 0.1389 18/125 [===>..........................] - ETA: 44s - batch_cost: 0.3843 - reader cost: 0.1348 19/125 [===>..........................] - ETA: 44s - batch_cost: 0.3850 - reader cost: 0.1301 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3872 - reader cost: 0.1290 21/125 [====>.........................] - ETA: 43s - batch_cost: 0.3895 - reader cost: 0.1282 22/125 [====>.........................] - ETA: 43s - batch_cost: 0.3908 - reader cost: 0.1298 23/125 [====>.........................] - ETA: 42s - batch_cost: 0.3908 - reader cost: 0.1295 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.3923 - reader cost: 0.1315 25/125 [=====>........................] - ETA: 41s - batch_cost: 0.3934 - reader cost: 0.1307 26/125 [=====>........................] - ETA: 41s - batch_cost: 0.3951 - reader cost: 0.1290 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.3948 - reader cost: 0.1262 28/125 [=====>........................] - ETA: 40s - batch_cost: 0.3964 - reader cost: 0.1244 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.3986 - reader cost: 0.1243 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4007 - reader cost: 0.1261 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.4036 - reader cost: 0.1293 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4047 - reader cost: 0.1285 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4055 - reader cost: 0.1280 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4060 - reader cost: 0.1270 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4049 - reader cost: 0.1266 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4042 - reader cost: 0.1264 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4047 - reader cost: 0.1264 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4053 - reader cost: 0.1271 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4049 - reader cost: 0.1274 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4049 - reader cost: 0.1281 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4059 - reader cost: 0.1281 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4068 - reader cost: 0.1281 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4061 - reader cost: 0.1270 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4062 - reader cost: 0.1272 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4061 - reader cost: 0.1274 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4069 - reader cost: 0.1286 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4072 - reader cost: 0.1296 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4076 - reader cost: 0.1305 49/125 [==========>...................] - ETA: 31s - batch_cost: 0.4067 - reader cost: 0.1302 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4066 - reader cost: 0.1303 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4070 - reader cost: 0.1312 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4065 - reader cost: 0.1309 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4062 - reader cost: 0.1311 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4057 - reader cost: 0.1310 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4063 - reader cost: 0.1305 56/125 [============>.................] - ETA: 28s - batch_cost: 0.4063 - reader cost: 0.1302 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4067 - reader cost: 0.1310 58/125 [============>.................] - ETA: 27s - batch_cost: 0.4063 - reader cost: 0.1308 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4059 - reader cost: 0.1308 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4060 - reader cost: 0.1311 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4051 - reader cost: 0.1305 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4055 - reader cost: 0.1313 63/125 [==============>...............] - ETA: 25s - batch_cost: 0.4058 - reader cost: 0.1319 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4064 - reader cost: 0.1327 65/125 [==============>...............] - ETA: 24s - batch_cost: 0.4064 - reader cost: 0.1331 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4059 - reader cost: 0.1328 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4057 - reader cost: 0.1328 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4051 - reader cost: 0.1325 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4055 - reader cost: 0.1331 70/125 [===============>..............] - ETA: 22s - batch_cost: 0.4055 - reader cost: 0.1334 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4058 - reader cost: 0.1339 72/125 [================>.............] - ETA: 21s - batch_cost: 0.4056 - reader cost: 0.1338 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4062 - reader cost: 0.1343 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4056 - reader cost: 0.1341 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4061 - reader cost: 0.1346 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4061 - reader cost: 0.1345 77/125 [=================>............] - ETA: 19s - batch_cost: 0.4054 - reader cost: 0.1341 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4053 - reader cost: 0.1339 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4052 - reader cost: 0.1335 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4054 - reader cost: 0.1338 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4052 - reader cost: 0.1339 82/125 [==================>...........] - ETA: 17s - batch_cost: 0.4054 - reader cost: 0.1343 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4054 - reader cost: 0.1342 84/125 [===================>..........] - ETA: 16s - batch_cost: 0.4055 - reader cost: 0.1345 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4052 - reader cost: 0.1343 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4056 - reader cost: 0.1342 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4052 - reader cost: 0.1338 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4054 - reader cost: 0.1337 89/125 [====================>.........] - ETA: 14s - batch_cost: 0.4055 - reader cost: 0.1330 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4050 - reader cost: 0.1324 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4049 - reader cost: 0.1324 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4050 - reader cost: 0.1328 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4052 - reader cost: 0.1329 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4058 - reader cost: 0.1331 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4057 - reader cost: 0.1329 96/125 [======================>.......] - ETA: 11s - batch_cost: 0.4058 - reader cost: 0.1333 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4062 - reader cost: 0.1339 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4058 - reader cost: 0.1336 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4061 - reader cost: 0.1340 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4063 - reader cost: 0.1342 101/125 [=======================>......] - ETA: 9s - batch_cost: 0.4065 - reader cost: 0.1347  102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4067 - reader cost: 0.1350 103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4064 - reader cost: 0.1350 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4065 - reader cost: 0.1351 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4066 - reader cost: 0.1352 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4061 - reader cost: 0.1349 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4058 - reader cost: 0.1348 108/125 [========================>.....] - ETA: 6s - batch_cost: 0.4056 - reader cost: 0.1347 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4059 - reader cost: 0.1350 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4055 - reader cost: 0.1347 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4058 - reader cost: 0.1352 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4056 - reader cost: 0.1350 113/125 [==========================>...] - ETA: 4s - batch_cost: 0.4058 - reader cost: 0.1353 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4059 - reader cost: 0.1356 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4061 - reader cost: 0.1360 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4062 - reader cost: 0.1363 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4065 - reader cost: 0.1366 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4071 - reader cost: 0.1373 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4073 - reader cost: 0.1376 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4074 - reader cost: 0.1378 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4077 - reader cost: 0.1381 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4078 - reader cost: 0.1385 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4076 - reader cost: 0.1384 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4072 - reader cost: 0.1382 125/125 [==============================] - 52s 413ms/step - batch_cost: 0.4074 - reader cost: 0.1385 2021-02-23 20:30:20 [INFO] [EVAL] #Images=500 mIoU=0.7696 Acc=0.9580 Kappa=0.9455 2021-02-23 20:30:20 [INFO] [EVAL] Class IoU: [0.978 0.8293 0.9259 0.5073 0.5537 0.6528 0.7299 0.821 0.9165 0.5352 0.9508 0.8333 0.6574 0.9471 0.8037 0.8361 0.7897 0.5731 0.7813] 2021-02-23 20:30:20 [INFO] [EVAL] Class Acc: [0.9866 0.9201 0.9603 0.6486 0.8413 0.8183 0.8828 0.9322 0.9439 0.8432 0.9689 0.9026 0.8034 0.9682 0.9359 0.9576 0.9797 0.7415 0.8826] 2021-02-23 20:30:24 [INFO] [EVAL] The model with the best validation mIoU (0.8019) was saved at iter 65000. 2021-02-23 20:30:38 [INFO] [TRAIN] epoch=181, iter=67010/80000, loss=0.8938, lr=0.001948, batch_cost=1.3607, reader_cost=0.0001 | ETA 04:54:35 2021-02-23 20:30:51 [INFO] [TRAIN] epoch=181, iter=67020/80000, loss=0.8088, lr=0.001946, batch_cost=1.3842, reader_cost=0.0001 | ETA 04:59:26 2021-02-23 20:31:05 [INFO] [TRAIN] epoch=181, iter=67030/80000, loss=0.8193, lr=0.001945, batch_cost=1.3493, reader_cost=0.0001 | ETA 04:51:40 2021-02-23 20:31:19 [INFO] [TRAIN] epoch=181, iter=67040/80000, loss=0.7495, lr=0.001944, batch_cost=1.3659, reader_cost=0.0001 | ETA 04:55:02 2021-02-23 20:31:32 [INFO] [TRAIN] epoch=181, iter=67050/80000, loss=0.8428, lr=0.001942, batch_cost=1.3775, reader_cost=0.0001 | ETA 04:57:18 2021-02-23 20:31:46 [INFO] [TRAIN] epoch=181, iter=67060/80000, loss=0.7969, lr=0.001941, batch_cost=1.3607, reader_cost=0.0003 | ETA 04:53:27 2021-02-23 20:32:00 [INFO] [TRAIN] epoch=181, iter=67070/80000, loss=0.8188, lr=0.001939, batch_cost=1.3609, reader_cost=0.0001 | ETA 04:53:16 2021-02-23 20:32:13 [INFO] [TRAIN] epoch=181, iter=67080/80000, loss=0.8406, lr=0.001938, batch_cost=1.3828, reader_cost=0.0001 | ETA 04:57:46 2021-02-23 20:32:27 [INFO] [TRAIN] epoch=181, iter=67090/80000, loss=0.7995, lr=0.001937, batch_cost=1.3397, reader_cost=0.0001 | ETA 04:48:15 2021-02-23 20:32:40 [INFO] [TRAIN] epoch=181, iter=67100/80000, loss=0.7726, lr=0.001935, batch_cost=1.3580, reader_cost=0.0001 | ETA 04:51:57 2021-02-23 20:32:54 [INFO] [TRAIN] epoch=181, iter=67110/80000, loss=0.8269, lr=0.001934, batch_cost=1.3547, reader_cost=0.0001 | ETA 04:51:02 2021-02-23 20:33:07 [INFO] [TRAIN] epoch=181, iter=67120/80000, loss=0.8322, lr=0.001933, batch_cost=1.3438, reader_cost=0.0001 | ETA 04:48:28 2021-02-23 20:33:21 [INFO] [TRAIN] epoch=181, iter=67130/80000, loss=0.7963, lr=0.001931, batch_cost=1.3572, reader_cost=0.0001 | ETA 04:51:07 2021-02-23 20:33:34 [INFO] [TRAIN] epoch=181, iter=67140/80000, loss=0.8031, lr=0.001930, batch_cost=1.3454, reader_cost=0.0001 | ETA 04:48:21 2021-02-23 20:33:48 [INFO] [TRAIN] epoch=181, iter=67150/80000, loss=0.7944, lr=0.001929, batch_cost=1.3773, reader_cost=0.0001 | ETA 04:54:57 2021-02-23 20:34:01 [INFO] [TRAIN] epoch=181, iter=67160/80000, loss=0.8748, lr=0.001927, batch_cost=1.3202, reader_cost=0.0001 | ETA 04:42:31 2021-02-23 20:34:15 [INFO] [TRAIN] epoch=181, iter=67170/80000, loss=0.7841, lr=0.001926, batch_cost=1.3533, reader_cost=0.0002 | ETA 04:49:23 2021-02-23 20:34:28 [INFO] [TRAIN] epoch=181, iter=67180/80000, loss=0.8328, lr=0.001925, batch_cost=1.3592, reader_cost=0.0001 | ETA 04:50:24 2021-02-23 20:34:42 [INFO] [TRAIN] epoch=181, iter=67190/80000, loss=0.8408, lr=0.001923, batch_cost=1.3536, reader_cost=0.0001 | ETA 04:48:59 2021-02-23 20:34:55 [INFO] [TRAIN] epoch=181, iter=67200/80000, loss=0.7536, lr=0.001922, batch_cost=1.3435, reader_cost=0.0001 | ETA 04:46:36 2021-02-23 20:35:09 [INFO] [TRAIN] epoch=181, iter=67210/80000, loss=0.8242, lr=0.001921, batch_cost=1.3697, reader_cost=0.0001 | ETA 04:51:58 2021-02-23 20:35:23 [INFO] [TRAIN] epoch=181, iter=67220/80000, loss=0.8148, lr=0.001919, batch_cost=1.3681, reader_cost=0.0001 | ETA 04:51:24 2021-02-23 20:35:36 [INFO] [TRAIN] epoch=181, iter=67230/80000, loss=0.7497, lr=0.001918, batch_cost=1.3589, reader_cost=0.0001 | ETA 04:49:13 2021-02-23 20:35:50 [INFO] [TRAIN] epoch=181, iter=67240/80000, loss=0.7875, lr=0.001917, batch_cost=1.3623, reader_cost=0.0001 | ETA 04:49:43 2021-02-23 20:36:03 [INFO] [TRAIN] epoch=181, iter=67250/80000, loss=0.8202, lr=0.001915, batch_cost=1.3375, reader_cost=0.0001 | ETA 04:44:13 2021-02-23 20:36:17 [INFO] [TRAIN] epoch=181, iter=67260/80000, loss=0.8034, lr=0.001914, batch_cost=1.3832, reader_cost=0.0001 | ETA 04:53:42 2021-02-23 20:36:31 [INFO] [TRAIN] epoch=181, iter=67270/80000, loss=0.8413, lr=0.001912, batch_cost=1.3615, reader_cost=0.0001 | ETA 04:48:51 2021-02-23 20:36:45 [INFO] [TRAIN] epoch=181, iter=67280/80000, loss=0.7733, lr=0.001911, batch_cost=1.3723, reader_cost=0.0001 | ETA 04:50:55 2021-02-23 20:36:59 [INFO] [TRAIN] epoch=181, iter=67290/80000, loss=0.8951, lr=0.001910, batch_cost=1.3959, reader_cost=0.0001 | ETA 04:55:42 2021-02-23 20:37:12 [INFO] [TRAIN] epoch=181, iter=67300/80000, loss=0.8172, lr=0.001908, batch_cost=1.3574, reader_cost=0.0001 | ETA 04:47:18 2021-02-23 20:37:26 [INFO] [TRAIN] epoch=181, iter=67310/80000, loss=0.7410, lr=0.001907, batch_cost=1.3509, reader_cost=0.0001 | ETA 04:45:42 2021-02-23 20:37:40 [INFO] [TRAIN] epoch=181, iter=67320/80000, loss=0.8195, lr=0.001906, batch_cost=1.4253, reader_cost=0.0001 | ETA 05:01:12 2021-02-23 20:37:53 [INFO] [TRAIN] epoch=181, iter=67330/80000, loss=0.8150, lr=0.001904, batch_cost=1.3170, reader_cost=0.0001 | ETA 04:38:07 2021-02-23 20:38:08 [INFO] [TRAIN] epoch=182, iter=67340/80000, loss=0.7913, lr=0.001903, batch_cost=1.4803, reader_cost=0.0683 | ETA 05:12:20 2021-02-23 20:38:21 [INFO] [TRAIN] epoch=182, iter=67350/80000, loss=0.8637, lr=0.001902, batch_cost=1.3643, reader_cost=0.0001 | ETA 04:47:38 2021-02-23 20:38:35 [INFO] [TRAIN] epoch=182, iter=67360/80000, loss=0.7780, lr=0.001900, batch_cost=1.3596, reader_cost=0.0001 | ETA 04:46:25 2021-02-23 20:38:49 [INFO] [TRAIN] epoch=182, iter=67370/80000, loss=0.8213, lr=0.001899, batch_cost=1.3428, reader_cost=0.0001 | ETA 04:42:39 2021-02-23 20:39:02 [INFO] [TRAIN] epoch=182, iter=67380/80000, loss=0.8610, lr=0.001898, batch_cost=1.3518, reader_cost=0.0001 | ETA 04:44:20 2021-02-23 20:39:15 [INFO] [TRAIN] epoch=182, iter=67390/80000, loss=0.8558, lr=0.001896, batch_cost=1.3397, reader_cost=0.0001 | ETA 04:41:33 2021-02-23 20:39:29 [INFO] [TRAIN] epoch=182, iter=67400/80000, loss=0.8891, lr=0.001895, batch_cost=1.3753, reader_cost=0.0001 | ETA 04:48:49 2021-02-23 20:39:43 [INFO] [TRAIN] epoch=182, iter=67410/80000, loss=0.8873, lr=0.001894, batch_cost=1.3587, reader_cost=0.0001 | ETA 04:45:06 2021-02-23 20:39:56 [INFO] [TRAIN] epoch=182, iter=67420/80000, loss=0.8217, lr=0.001892, batch_cost=1.3438, reader_cost=0.0001 | ETA 04:41:44 2021-02-23 20:40:10 [INFO] [TRAIN] epoch=182, iter=67430/80000, loss=0.8509, lr=0.001891, batch_cost=1.3545, reader_cost=0.0001 | ETA 04:43:45 2021-02-23 20:40:24 [INFO] [TRAIN] epoch=182, iter=67440/80000, loss=0.8013, lr=0.001889, batch_cost=1.3790, reader_cost=0.0001 | ETA 04:48:39 2021-02-23 20:40:37 [INFO] [TRAIN] epoch=182, iter=67450/80000, loss=0.7919, lr=0.001888, batch_cost=1.3632, reader_cost=0.0001 | ETA 04:45:08 2021-02-23 20:40:51 [INFO] [TRAIN] epoch=182, iter=67460/80000, loss=0.8364, lr=0.001887, batch_cost=1.3585, reader_cost=0.0001 | ETA 04:43:55 2021-02-23 20:41:04 [INFO] [TRAIN] epoch=182, iter=67470/80000, loss=0.8362, lr=0.001885, batch_cost=1.3460, reader_cost=0.0001 | ETA 04:41:05 2021-02-23 20:41:18 [INFO] [TRAIN] epoch=182, iter=67480/80000, loss=0.7779, lr=0.001884, batch_cost=1.3491, reader_cost=0.0001 | ETA 04:41:30 2021-02-23 20:41:32 [INFO] [TRAIN] epoch=182, iter=67490/80000, loss=0.8018, lr=0.001883, batch_cost=1.3861, reader_cost=0.0001 | ETA 04:49:00 2021-02-23 20:41:45 [INFO] [TRAIN] epoch=182, iter=67500/80000, loss=0.8237, lr=0.001881, batch_cost=1.3523, reader_cost=0.0001 | ETA 04:41:44 2021-02-23 20:41:59 [INFO] [TRAIN] epoch=182, iter=67510/80000, loss=0.7978, lr=0.001880, batch_cost=1.3798, reader_cost=0.0001 | ETA 04:47:14 2021-02-23 20:42:13 [INFO] [TRAIN] epoch=182, iter=67520/80000, loss=0.8708, lr=0.001879, batch_cost=1.3612, reader_cost=0.0001 | ETA 04:43:07 2021-02-23 20:42:26 [INFO] [TRAIN] epoch=182, iter=67530/80000, loss=0.8720, lr=0.001877, batch_cost=1.3593, reader_cost=0.0001 | ETA 04:42:30 2021-02-23 20:42:40 [INFO] [TRAIN] epoch=182, iter=67540/80000, loss=0.8164, lr=0.001876, batch_cost=1.3428, reader_cost=0.0001 | ETA 04:38:50 2021-02-23 20:42:53 [INFO] [TRAIN] epoch=182, iter=67550/80000, loss=0.8488, lr=0.001875, batch_cost=1.3259, reader_cost=0.0001 | ETA 04:35:07 2021-02-23 20:43:07 [INFO] [TRAIN] epoch=182, iter=67560/80000, loss=0.7803, lr=0.001873, batch_cost=1.4136, reader_cost=0.0001 | ETA 04:53:04 2021-02-23 20:43:21 [INFO] [TRAIN] epoch=182, iter=67570/80000, loss=0.8154, lr=0.001872, batch_cost=1.3708, reader_cost=0.0001 | ETA 04:43:59 2021-02-23 20:43:34 [INFO] [TRAIN] epoch=182, iter=67580/80000, loss=0.7960, lr=0.001871, batch_cost=1.3553, reader_cost=0.0001 | ETA 04:40:32 2021-02-23 20:43:48 [INFO] [TRAIN] epoch=182, iter=67590/80000, loss=0.8393, lr=0.001869, batch_cost=1.3317, reader_cost=0.0001 | ETA 04:35:26 2021-02-23 20:44:01 [INFO] [TRAIN] epoch=182, iter=67600/80000, loss=0.8412, lr=0.001868, batch_cost=1.3682, reader_cost=0.0001 | ETA 04:42:45 2021-02-23 20:44:15 [INFO] [TRAIN] epoch=182, iter=67610/80000, loss=0.8517, lr=0.001866, batch_cost=1.3603, reader_cost=0.0001 | ETA 04:40:54 2021-02-23 20:44:28 [INFO] [TRAIN] epoch=182, iter=67620/80000, loss=0.7861, lr=0.001865, batch_cost=1.3398, reader_cost=0.0001 | ETA 04:36:26 2021-02-23 20:44:42 [INFO] [TRAIN] epoch=182, iter=67630/80000, loss=0.8497, lr=0.001864, batch_cost=1.3700, reader_cost=0.0001 | ETA 04:42:27 2021-02-23 20:44:56 [INFO] [TRAIN] epoch=182, iter=67640/80000, loss=0.8536, lr=0.001862, batch_cost=1.3746, reader_cost=0.0001 | ETA 04:43:10 2021-02-23 20:45:09 [INFO] [TRAIN] epoch=182, iter=67650/80000, loss=0.7681, lr=0.001861, batch_cost=1.3464, reader_cost=0.0001 | ETA 04:37:08 2021-02-23 20:45:23 [INFO] [TRAIN] epoch=182, iter=67660/80000, loss=0.8448, lr=0.001860, batch_cost=1.3409, reader_cost=0.0001 | ETA 04:35:47 2021-02-23 20:45:36 [INFO] [TRAIN] epoch=182, iter=67670/80000, loss=0.7586, lr=0.001858, batch_cost=1.3669, reader_cost=0.0001 | ETA 04:40:53 2021-02-23 20:45:50 [INFO] [TRAIN] epoch=182, iter=67680/80000, loss=0.8166, lr=0.001857, batch_cost=1.3571, reader_cost=0.0001 | ETA 04:38:39 2021-02-23 20:46:04 [INFO] [TRAIN] epoch=182, iter=67690/80000, loss=0.8943, lr=0.001856, batch_cost=1.3785, reader_cost=0.0001 | ETA 04:42:49 2021-02-23 20:46:17 [INFO] [TRAIN] epoch=182, iter=67700/80000, loss=0.8464, lr=0.001854, batch_cost=1.3615, reader_cost=0.0001 | ETA 04:39:05 2021-02-23 20:46:32 [INFO] [TRAIN] epoch=183, iter=67710/80000, loss=0.8012, lr=0.001853, batch_cost=1.4508, reader_cost=0.0907 | ETA 04:57:10 2021-02-23 20:46:45 [INFO] [TRAIN] epoch=183, iter=67720/80000, loss=0.7811, lr=0.001852, batch_cost=1.3692, reader_cost=0.0001 | ETA 04:40:13 2021-02-23 20:46:59 [INFO] [TRAIN] epoch=183, iter=67730/80000, loss=0.8170, lr=0.001850, batch_cost=1.3629, reader_cost=0.0001 | ETA 04:38:42 2021-02-23 20:47:13 [INFO] [TRAIN] epoch=183, iter=67740/80000, loss=0.8377, lr=0.001849, batch_cost=1.3845, reader_cost=0.0001 | ETA 04:42:54 2021-02-23 20:47:26 [INFO] [TRAIN] epoch=183, iter=67750/80000, loss=0.8106, lr=0.001847, batch_cost=1.3509, reader_cost=0.0001 | ETA 04:35:48 2021-02-23 20:47:40 [INFO] [TRAIN] epoch=183, iter=67760/80000, loss=0.7686, lr=0.001846, batch_cost=1.3398, reader_cost=0.0001 | ETA 04:33:19 2021-02-23 20:47:54 [INFO] [TRAIN] epoch=183, iter=67770/80000, loss=0.8182, lr=0.001845, batch_cost=1.3822, reader_cost=0.0001 | ETA 04:41:44 2021-02-23 20:48:07 [INFO] [TRAIN] epoch=183, iter=67780/80000, loss=0.7998, lr=0.001843, batch_cost=1.3926, reader_cost=0.0001 | ETA 04:43:38 2021-02-23 20:48:21 [INFO] [TRAIN] epoch=183, iter=67790/80000, loss=0.8149, lr=0.001842, batch_cost=1.3601, reader_cost=0.0001 | ETA 04:36:46 2021-02-23 20:48:35 [INFO] [TRAIN] epoch=183, iter=67800/80000, loss=0.8108, lr=0.001841, batch_cost=1.3612, reader_cost=0.0001 | ETA 04:36:47 2021-02-23 20:48:48 [INFO] [TRAIN] epoch=183, iter=67810/80000, loss=0.7764, lr=0.001839, batch_cost=1.3401, reader_cost=0.0001 | ETA 04:32:15 2021-02-23 20:49:02 [INFO] [TRAIN] epoch=183, iter=67820/80000, loss=0.8535, lr=0.001838, batch_cost=1.3786, reader_cost=0.0001 | ETA 04:39:51 2021-02-23 20:49:15 [INFO] [TRAIN] epoch=183, iter=67830/80000, loss=0.7952, lr=0.001837, batch_cost=1.3439, reader_cost=0.0001 | ETA 04:32:35 2021-02-23 20:49:29 [INFO] [TRAIN] epoch=183, iter=67840/80000, loss=0.7897, lr=0.001835, batch_cost=1.3728, reader_cost=0.0001 | ETA 04:38:13 2021-02-23 20:49:43 [INFO] [TRAIN] epoch=183, iter=67850/80000, loss=0.8011, lr=0.001834, batch_cost=1.3573, reader_cost=0.0001 | ETA 04:34:50 2021-02-23 20:49:56 [INFO] [TRAIN] epoch=183, iter=67860/80000, loss=0.8388, lr=0.001833, batch_cost=1.3478, reader_cost=0.0001 | ETA 04:32:41 2021-02-23 20:50:10 [INFO] [TRAIN] epoch=183, iter=67870/80000, loss=0.7886, lr=0.001831, batch_cost=1.3632, reader_cost=0.0001 | ETA 04:35:35 2021-02-23 20:50:24 [INFO] [TRAIN] epoch=183, iter=67880/80000, loss=0.8688, lr=0.001830, batch_cost=1.3769, reader_cost=0.0001 | ETA 04:38:08 2021-02-23 20:50:37 [INFO] [TRAIN] epoch=183, iter=67890/80000, loss=0.8776, lr=0.001828, batch_cost=1.3750, reader_cost=0.0001 | ETA 04:37:30 2021-02-23 20:50:51 [INFO] [TRAIN] epoch=183, iter=67900/80000, loss=0.8348, lr=0.001827, batch_cost=1.3491, reader_cost=0.0001 | ETA 04:32:03 2021-02-23 20:51:04 [INFO] [TRAIN] epoch=183, iter=67910/80000, loss=0.8724, lr=0.001826, batch_cost=1.3660, reader_cost=0.0001 | ETA 04:35:14 2021-02-23 20:51:18 [INFO] [TRAIN] epoch=183, iter=67920/80000, loss=0.8438, lr=0.001824, batch_cost=1.3858, reader_cost=0.0001 | ETA 04:39:00 2021-02-23 20:51:32 [INFO] [TRAIN] epoch=183, iter=67930/80000, loss=0.8267, lr=0.001823, batch_cost=1.3405, reader_cost=0.0001 | ETA 04:29:39 2021-02-23 20:51:46 [INFO] [TRAIN] epoch=183, iter=67940/80000, loss=0.8237, lr=0.001822, batch_cost=1.3918, reader_cost=0.0001 | ETA 04:39:45 2021-02-23 20:51:59 [INFO] [TRAIN] epoch=183, iter=67950/80000, loss=0.8191, lr=0.001820, batch_cost=1.3616, reader_cost=0.0001 | ETA 04:33:27 2021-02-23 20:52:13 [INFO] [TRAIN] epoch=183, iter=67960/80000, loss=0.8372, lr=0.001819, batch_cost=1.3673, reader_cost=0.0001 | ETA 04:34:22 2021-02-23 20:52:26 [INFO] [TRAIN] epoch=183, iter=67970/80000, loss=0.8475, lr=0.001818, batch_cost=1.3604, reader_cost=0.0001 | ETA 04:32:45 2021-02-23 20:52:40 [INFO] [TRAIN] epoch=183, iter=67980/80000, loss=0.8348, lr=0.001816, batch_cost=1.3603, reader_cost=0.0001 | ETA 04:32:30 2021-02-23 20:52:54 [INFO] [TRAIN] epoch=183, iter=67990/80000, loss=0.9082, lr=0.001815, batch_cost=1.3655, reader_cost=0.0001 | ETA 04:33:19 2021-02-23 20:53:07 [INFO] [TRAIN] epoch=183, iter=68000/80000, loss=0.8160, lr=0.001813, batch_cost=1.3538, reader_cost=0.0001 | ETA 04:30:45 2021-02-23 20:53:07 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:14 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:04 - batch_cost: 0.2205 - reader cost: 0.0935  3/125 [..............................] - ETA: 1:00 - batch_cost: 0.2927 - reader cost: 0.1244 4/125 [..............................] - ETA: 58s - batch_cost: 0.3293 - reader cost: 0.1387  5/125 [>.............................] - ETA: 56s - batch_cost: 0.3471 - reader cost: 0.1442 6/125 [>.............................] - ETA: 54s - batch_cost: 0.3600 - reader cost: 0.1489 7/125 [>.............................] - ETA: 53s - batch_cost: 0.3704 - reader cost: 0.1524 8/125 [>.............................] - ETA: 52s - batch_cost: 0.3699 - reader cost: 0.1479 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3757 - reader cost: 0.1507 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3826 - reader cost: 0.1532 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3813 - reader cost: 0.1499 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3879 - reader cost: 0.1543 13/125 [==>...........................] - ETA: 49s - batch_cost: 0.3918 - reader cost: 0.1567 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3937 - reader cost: 0.1576 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3956 - reader cost: 0.1584 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3987 - reader cost: 0.1606 17/125 [===>..........................] - ETA: 47s - batch_cost: 0.4025 - reader cost: 0.1629 18/125 [===>..........................] - ETA: 47s - batch_cost: 0.4064 - reader cost: 0.1660 19/125 [===>..........................] - ETA: 46s - batch_cost: 0.4086 - reader cost: 0.1676 20/125 [===>..........................] - ETA: 46s - batch_cost: 0.4107 - reader cost: 0.1690 21/125 [====>.........................] - ETA: 45s - batch_cost: 0.4093 - reader cost: 0.1670 22/125 [====>.........................] - ETA: 45s - batch_cost: 0.4105 - reader cost: 0.1676 23/125 [====>.........................] - ETA: 44s - batch_cost: 0.4113 - reader cost: 0.1676 24/125 [====>.........................] - ETA: 44s - batch_cost: 0.4119 - reader cost: 0.1680 25/125 [=====>........................] - ETA: 43s - batch_cost: 0.4127 - reader cost: 0.1682 26/125 [=====>........................] - ETA: 43s - batch_cost: 0.4132 - reader cost: 0.1686 27/125 [=====>........................] - ETA: 42s - batch_cost: 0.4140 - reader cost: 0.1688 28/125 [=====>........................] - ETA: 42s - batch_cost: 0.4146 - reader cost: 0.1690 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4151 - reader cost: 0.1693 30/125 [======>.......................] - ETA: 41s - batch_cost: 0.4138 - reader cost: 0.1679 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4143 - reader cost: 0.1679 32/125 [======>.......................] - ETA: 40s - batch_cost: 0.4149 - reader cost: 0.1683 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4159 - reader cost: 0.1686 34/125 [=======>......................] - ETA: 39s - batch_cost: 0.4142 - reader cost: 0.1667 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4143 - reader cost: 0.1664 36/125 [=======>......................] - ETA: 38s - batch_cost: 0.4144 - reader cost: 0.1666 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4150 - reader cost: 0.1668 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4161 - reader cost: 0.1679 39/125 [========>.....................] - ETA: 37s - batch_cost: 0.4171 - reader cost: 0.1686 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4170 - reader cost: 0.1682 41/125 [========>.....................] - ETA: 36s - batch_cost: 0.4172 - reader cost: 0.1683 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4159 - reader cost: 0.1669 43/125 [=========>....................] - ETA: 35s - batch_cost: 0.4161 - reader cost: 0.1669 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4162 - reader cost: 0.1670 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4154 - reader cost: 0.1662 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4151 - reader cost: 0.1658 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4155 - reader cost: 0.1660 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4145 - reader cost: 0.1650 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4148 - reader cost: 0.1653 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4141 - reader cost: 0.1643 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4143 - reader cost: 0.1644 52/125 [===========>..................] - ETA: 31s - batch_cost: 0.4145 - reader cost: 0.1645 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4147 - reader cost: 0.1647 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4150 - reader cost: 0.1650 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4141 - reader cost: 0.1640 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4137 - reader cost: 0.1636 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4143 - reader cost: 0.1642 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4137 - reader cost: 0.1636 59/125 [=============>................] - ETA: 28s - batch_cost: 0.4144 - reader cost: 0.1641 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4151 - reader cost: 0.1647 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4145 - reader cost: 0.1641 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4136 - reader cost: 0.1633 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4143 - reader cost: 0.1638 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4145 - reader cost: 0.1639 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4146 - reader cost: 0.1641 66/125 [==============>...............] - ETA: 25s - batch_cost: 0.4150 - reader cost: 0.1645 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4152 - reader cost: 0.1646 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4154 - reader cost: 0.1648 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4158 - reader cost: 0.1651 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4162 - reader cost: 0.1654 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4157 - reader cost: 0.1648 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4158 - reader cost: 0.1650 73/125 [================>.............] - ETA: 22s - batch_cost: 0.4163 - reader cost: 0.1653 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4158 - reader cost: 0.1649 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4160 - reader cost: 0.1650 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4162 - reader cost: 0.1652 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4162 - reader cost: 0.1651 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4158 - reader cost: 0.1647 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4155 - reader cost: 0.1643 80/125 [==================>...........] - ETA: 19s - batch_cost: 0.4159 - reader cost: 0.1647 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4161 - reader cost: 0.1648 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4165 - reader cost: 0.1651 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4161 - reader cost: 0.1647 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4162 - reader cost: 0.1648 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4164 - reader cost: 0.1647 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4165 - reader cost: 0.1648 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4167 - reader cost: 0.1649 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4169 - reader cost: 0.1651 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4164 - reader cost: 0.1646 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4165 - reader cost: 0.1648 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4167 - reader cost: 0.1650 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4162 - reader cost: 0.1645 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4159 - reader cost: 0.1642 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4158 - reader cost: 0.1641 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4154 - reader cost: 0.1636 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4151 - reader cost: 0.1633 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4147 - reader cost: 0.1630 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4144 - reader cost: 0.1627 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4145 - reader cost: 0.1628 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4150 - reader cost: 0.1633 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4154 - reader cost: 0.1636 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4153 - reader cost: 0.1635  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4156 - reader cost: 0.1637 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4152 - reader cost: 0.1634 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4150 - reader cost: 0.1631 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4151 - reader cost: 0.1632 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4154 - reader cost: 0.1634 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4149 - reader cost: 0.1629 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4145 - reader cost: 0.1625 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4150 - reader cost: 0.1629 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4147 - reader cost: 0.1626 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4145 - reader cost: 0.1621 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4143 - reader cost: 0.1620 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4146 - reader cost: 0.1622 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4142 - reader cost: 0.1619 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4143 - reader cost: 0.1619 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4145 - reader cost: 0.1621 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4146 - reader cost: 0.1622 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4148 - reader cost: 0.1624 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4150 - reader cost: 0.1625 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4151 - reader cost: 0.1627 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4149 - reader cost: 0.1625 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4146 - reader cost: 0.1621 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4147 - reader cost: 0.1622 125/125 [==============================] - 52s 420ms/step - batch_cost: 0.4148 - reader cost: 0.1624 2021-02-23 20:54:00 [INFO] [EVAL] #Images=500 mIoU=0.7825 Acc=0.9612 Kappa=0.9495 2021-02-23 20:54:00 [INFO] [EVAL] Class IoU: [0.9796 0.8417 0.9239 0.5201 0.6093 0.6437 0.7461 0.826 0.927 0.6559 0.9507 0.8385 0.6529 0.9534 0.7438 0.8761 0.7358 0.6523 0.7911] 2021-02-23 20:54:00 [INFO] [EVAL] Class Acc: [0.9912 0.9039 0.9482 0.9065 0.8191 0.8811 0.8456 0.9331 0.9548 0.8623 0.9676 0.9127 0.8289 0.9707 0.9604 0.911 0.9656 0.7945 0.8996] 2021-02-23 20:54:04 [INFO] [EVAL] The model with the best validation mIoU (0.8019) was saved at iter 65000. 2021-02-23 20:54:18 [INFO] [TRAIN] epoch=183, iter=68010/80000, loss=0.7461, lr=0.001812, batch_cost=1.3751, reader_cost=0.0001 | ETA 04:34:47 2021-02-23 20:54:31 [INFO] [TRAIN] epoch=183, iter=68020/80000, loss=0.8641, lr=0.001811, batch_cost=1.3573, reader_cost=0.0001 | ETA 04:30:59 2021-02-23 20:54:45 [INFO] [TRAIN] epoch=183, iter=68030/80000, loss=0.7635, lr=0.001809, batch_cost=1.3691, reader_cost=0.0001 | ETA 04:33:08 2021-02-23 20:54:58 [INFO] [TRAIN] epoch=183, iter=68040/80000, loss=0.7684, lr=0.001808, batch_cost=1.3499, reader_cost=0.0001 | ETA 04:29:04 2021-02-23 20:55:12 [INFO] [TRAIN] epoch=183, iter=68050/80000, loss=0.8542, lr=0.001807, batch_cost=1.3421, reader_cost=0.0001 | ETA 04:27:18 2021-02-23 20:55:25 [INFO] [TRAIN] epoch=183, iter=68060/80000, loss=0.9279, lr=0.001805, batch_cost=1.3608, reader_cost=0.0001 | ETA 04:30:48 2021-02-23 20:55:39 [INFO] [TRAIN] epoch=183, iter=68070/80000, loss=0.7832, lr=0.001804, batch_cost=1.3556, reader_cost=0.0001 | ETA 04:29:31 2021-02-23 20:55:54 [INFO] [TRAIN] epoch=184, iter=68080/80000, loss=0.8168, lr=0.001803, batch_cost=1.4716, reader_cost=0.0952 | ETA 04:52:21 2021-02-23 20:56:07 [INFO] [TRAIN] epoch=184, iter=68090/80000, loss=0.8552, lr=0.001801, batch_cost=1.3697, reader_cost=0.0001 | ETA 04:31:52 2021-02-23 20:56:21 [INFO] [TRAIN] epoch=184, iter=68100/80000, loss=0.7677, lr=0.001800, batch_cost=1.3614, reader_cost=0.0001 | ETA 04:30:01 2021-02-23 20:56:34 [INFO] [TRAIN] epoch=184, iter=68110/80000, loss=0.8503, lr=0.001799, batch_cost=1.3363, reader_cost=0.0001 | ETA 04:24:48 2021-02-23 20:56:48 [INFO] [TRAIN] epoch=184, iter=68120/80000, loss=0.7893, lr=0.001797, batch_cost=1.3287, reader_cost=0.0001 | ETA 04:23:05 2021-02-23 20:57:02 [INFO] [TRAIN] epoch=184, iter=68130/80000, loss=0.7859, lr=0.001796, batch_cost=1.3825, reader_cost=0.0001 | ETA 04:33:30 2021-02-23 20:57:15 [INFO] [TRAIN] epoch=184, iter=68140/80000, loss=0.8353, lr=0.001794, batch_cost=1.3731, reader_cost=0.0001 | ETA 04:31:24 2021-02-23 20:57:29 [INFO] [TRAIN] epoch=184, iter=68150/80000, loss=0.8383, lr=0.001793, batch_cost=1.3939, reader_cost=0.0001 | ETA 04:35:18 2021-02-23 20:57:43 [INFO] [TRAIN] epoch=184, iter=68160/80000, loss=0.8992, lr=0.001792, batch_cost=1.3328, reader_cost=0.0001 | ETA 04:23:00 2021-02-23 20:57:56 [INFO] [TRAIN] epoch=184, iter=68170/80000, loss=0.8154, lr=0.001790, batch_cost=1.3810, reader_cost=0.0001 | ETA 04:32:17 2021-02-23 20:58:10 [INFO] [TRAIN] epoch=184, iter=68180/80000, loss=0.8494, lr=0.001789, batch_cost=1.3917, reader_cost=0.0001 | ETA 04:34:09 2021-02-23 20:58:24 [INFO] [TRAIN] epoch=184, iter=68190/80000, loss=0.8078, lr=0.001788, batch_cost=1.3433, reader_cost=0.0001 | ETA 04:24:24 2021-02-23 20:58:37 [INFO] [TRAIN] epoch=184, iter=68200/80000, loss=0.7667, lr=0.001786, batch_cost=1.3789, reader_cost=0.0001 | ETA 04:31:10 2021-02-23 20:58:51 [INFO] [TRAIN] epoch=184, iter=68210/80000, loss=0.8283, lr=0.001785, batch_cost=1.3622, reader_cost=0.0001 | ETA 04:27:40 2021-02-23 20:59:05 [INFO] [TRAIN] epoch=184, iter=68220/80000, loss=0.8452, lr=0.001784, batch_cost=1.3901, reader_cost=0.0001 | ETA 04:32:54 2021-02-23 20:59:19 [INFO] [TRAIN] epoch=184, iter=68230/80000, loss=0.7674, lr=0.001782, batch_cost=1.3642, reader_cost=0.0001 | ETA 04:27:36 2021-02-23 20:59:32 [INFO] [TRAIN] epoch=184, iter=68240/80000, loss=0.7727, lr=0.001781, batch_cost=1.3451, reader_cost=0.0001 | ETA 04:23:38 2021-02-23 20:59:46 [INFO] [TRAIN] epoch=184, iter=68250/80000, loss=0.7899, lr=0.001779, batch_cost=1.3435, reader_cost=0.0001 | ETA 04:23:06 2021-02-23 20:59:59 [INFO] [TRAIN] epoch=184, iter=68260/80000, loss=0.8244, lr=0.001778, batch_cost=1.3711, reader_cost=0.0001 | ETA 04:28:16 2021-02-23 21:00:13 [INFO] [TRAIN] epoch=184, iter=68270/80000, loss=0.8073, lr=0.001777, batch_cost=1.3678, reader_cost=0.0001 | ETA 04:27:24 2021-02-23 21:00:26 [INFO] [TRAIN] epoch=184, iter=68280/80000, loss=0.7944, lr=0.001775, batch_cost=1.3380, reader_cost=0.0001 | ETA 04:21:20 2021-02-23 21:00:40 [INFO] [TRAIN] epoch=184, iter=68290/80000, loss=0.8082, lr=0.001774, batch_cost=1.3743, reader_cost=0.0001 | ETA 04:28:13 2021-02-23 21:00:54 [INFO] [TRAIN] epoch=184, iter=68300/80000, loss=0.9488, lr=0.001773, batch_cost=1.3533, reader_cost=0.0001 | ETA 04:23:53 2021-02-23 21:01:07 [INFO] [TRAIN] epoch=184, iter=68310/80000, loss=0.8086, lr=0.001771, batch_cost=1.3557, reader_cost=0.0001 | ETA 04:24:08 2021-02-23 21:01:21 [INFO] [TRAIN] epoch=184, iter=68320/80000, loss=0.8247, lr=0.001770, batch_cost=1.3674, reader_cost=0.0001 | ETA 04:26:10 2021-02-23 21:01:34 [INFO] [TRAIN] epoch=184, iter=68330/80000, loss=0.8395, lr=0.001769, batch_cost=1.3461, reader_cost=0.0001 | ETA 04:21:48 2021-02-23 21:01:48 [INFO] [TRAIN] epoch=184, iter=68340/80000, loss=0.8167, lr=0.001767, batch_cost=1.4001, reader_cost=0.0001 | ETA 04:32:05 2021-02-23 21:02:02 [INFO] [TRAIN] epoch=184, iter=68350/80000, loss=0.7781, lr=0.001766, batch_cost=1.3669, reader_cost=0.0001 | ETA 04:25:24 2021-02-23 21:02:15 [INFO] [TRAIN] epoch=184, iter=68360/80000, loss=0.8236, lr=0.001764, batch_cost=1.3544, reader_cost=0.0001 | ETA 04:22:45 2021-02-23 21:02:29 [INFO] [TRAIN] epoch=184, iter=68370/80000, loss=0.8576, lr=0.001763, batch_cost=1.3695, reader_cost=0.0001 | ETA 04:25:26 2021-02-23 21:02:43 [INFO] [TRAIN] epoch=184, iter=68380/80000, loss=0.7809, lr=0.001762, batch_cost=1.3614, reader_cost=0.0001 | ETA 04:23:39 2021-02-23 21:02:57 [INFO] [TRAIN] epoch=184, iter=68390/80000, loss=0.7822, lr=0.001760, batch_cost=1.3782, reader_cost=0.0001 | ETA 04:26:40 2021-02-23 21:03:11 [INFO] [TRAIN] epoch=184, iter=68400/80000, loss=0.8234, lr=0.001759, batch_cost=1.3973, reader_cost=0.0001 | ETA 04:30:08 2021-02-23 21:03:24 [INFO] [TRAIN] epoch=184, iter=68410/80000, loss=0.8040, lr=0.001758, batch_cost=1.3651, reader_cost=0.0001 | ETA 04:23:41 2021-02-23 21:03:38 [INFO] [TRAIN] epoch=184, iter=68420/80000, loss=0.8241, lr=0.001756, batch_cost=1.3895, reader_cost=0.0001 | ETA 04:28:10 2021-02-23 21:03:51 [INFO] [TRAIN] epoch=184, iter=68430/80000, loss=0.7810, lr=0.001755, batch_cost=1.3296, reader_cost=0.0001 | ETA 04:16:23 2021-02-23 21:04:05 [INFO] [TRAIN] epoch=184, iter=68440/80000, loss=0.8120, lr=0.001754, batch_cost=1.3950, reader_cost=0.0001 | ETA 04:28:46 2021-02-23 21:04:20 [INFO] [TRAIN] epoch=185, iter=68450/80000, loss=0.7742, lr=0.001752, batch_cost=1.4427, reader_cost=0.0627 | ETA 04:37:43 2021-02-23 21:04:33 [INFO] [TRAIN] epoch=185, iter=68460/80000, loss=0.8387, lr=0.001751, batch_cost=1.3611, reader_cost=0.0001 | ETA 04:21:47 2021-02-23 21:04:47 [INFO] [TRAIN] epoch=185, iter=68470/80000, loss=0.8040, lr=0.001749, batch_cost=1.3432, reader_cost=0.0001 | ETA 04:18:06 2021-02-23 21:05:01 [INFO] [TRAIN] epoch=185, iter=68480/80000, loss=0.7707, lr=0.001748, batch_cost=1.3791, reader_cost=0.0001 | ETA 04:24:47 2021-02-23 21:05:14 [INFO] [TRAIN] epoch=185, iter=68490/80000, loss=0.8169, lr=0.001747, batch_cost=1.3082, reader_cost=0.0001 | ETA 04:10:56 2021-02-23 21:05:27 [INFO] [TRAIN] epoch=185, iter=68500/80000, loss=0.7697, lr=0.001745, batch_cost=1.3459, reader_cost=0.0001 | ETA 04:17:58 2021-02-23 21:05:41 [INFO] [TRAIN] epoch=185, iter=68510/80000, loss=0.8622, lr=0.001744, batch_cost=1.3689, reader_cost=0.0001 | ETA 04:22:08 2021-02-23 21:05:54 [INFO] [TRAIN] epoch=185, iter=68520/80000, loss=0.8617, lr=0.001743, batch_cost=1.3525, reader_cost=0.0001 | ETA 04:18:46 2021-02-23 21:06:08 [INFO] [TRAIN] epoch=185, iter=68530/80000, loss=0.8119, lr=0.001741, batch_cost=1.3670, reader_cost=0.0001 | ETA 04:21:19 2021-02-23 21:06:22 [INFO] [TRAIN] epoch=185, iter=68540/80000, loss=0.8188, lr=0.001740, batch_cost=1.3755, reader_cost=0.0001 | ETA 04:22:42 2021-02-23 21:06:35 [INFO] [TRAIN] epoch=185, iter=68550/80000, loss=0.8146, lr=0.001739, batch_cost=1.3414, reader_cost=0.0001 | ETA 04:15:59 2021-02-23 21:06:49 [INFO] [TRAIN] epoch=185, iter=68560/80000, loss=0.8262, lr=0.001737, batch_cost=1.3340, reader_cost=0.0001 | ETA 04:14:20 2021-02-23 21:07:02 [INFO] [TRAIN] epoch=185, iter=68570/80000, loss=0.7476, lr=0.001736, batch_cost=1.3557, reader_cost=0.0001 | ETA 04:18:15 2021-02-23 21:07:16 [INFO] [TRAIN] epoch=185, iter=68580/80000, loss=0.8303, lr=0.001734, batch_cost=1.3613, reader_cost=0.0001 | ETA 04:19:06 2021-02-23 21:07:29 [INFO] [TRAIN] epoch=185, iter=68590/80000, loss=0.7976, lr=0.001733, batch_cost=1.3496, reader_cost=0.0001 | ETA 04:16:38 2021-02-23 21:07:43 [INFO] [TRAIN] epoch=185, iter=68600/80000, loss=0.8307, lr=0.001732, batch_cost=1.3638, reader_cost=0.0001 | ETA 04:19:07 2021-02-23 21:07:57 [INFO] [TRAIN] epoch=185, iter=68610/80000, loss=0.8064, lr=0.001730, batch_cost=1.3730, reader_cost=0.0001 | ETA 04:20:39 2021-02-23 21:08:10 [INFO] [TRAIN] epoch=185, iter=68620/80000, loss=0.8047, lr=0.001729, batch_cost=1.3515, reader_cost=0.0001 | ETA 04:16:19 2021-02-23 21:08:23 [INFO] [TRAIN] epoch=185, iter=68630/80000, loss=0.8658, lr=0.001728, batch_cost=1.3341, reader_cost=0.0001 | ETA 04:12:48 2021-02-23 21:08:37 [INFO] [TRAIN] epoch=185, iter=68640/80000, loss=0.8628, lr=0.001726, batch_cost=1.3548, reader_cost=0.0001 | ETA 04:16:29 2021-02-23 21:08:50 [INFO] [TRAIN] epoch=185, iter=68650/80000, loss=0.8167, lr=0.001725, batch_cost=1.3491, reader_cost=0.0001 | ETA 04:15:11 2021-02-23 21:09:04 [INFO] [TRAIN] epoch=185, iter=68660/80000, loss=0.7919, lr=0.001723, batch_cost=1.3664, reader_cost=0.0001 | ETA 04:18:15 2021-02-23 21:09:18 [INFO] [TRAIN] epoch=185, iter=68670/80000, loss=0.8408, lr=0.001722, batch_cost=1.3717, reader_cost=0.0001 | ETA 04:19:01 2021-02-23 21:09:31 [INFO] [TRAIN] epoch=185, iter=68680/80000, loss=0.7737, lr=0.001721, batch_cost=1.3436, reader_cost=0.0001 | ETA 04:13:29 2021-02-23 21:09:45 [INFO] [TRAIN] epoch=185, iter=68690/80000, loss=0.7957, lr=0.001719, batch_cost=1.3550, reader_cost=0.0001 | ETA 04:15:24 2021-02-23 21:09:59 [INFO] [TRAIN] epoch=185, iter=68700/80000, loss=0.8015, lr=0.001718, batch_cost=1.3747, reader_cost=0.0001 | ETA 04:18:53 2021-02-23 21:10:12 [INFO] [TRAIN] epoch=185, iter=68710/80000, loss=0.8474, lr=0.001717, batch_cost=1.3473, reader_cost=0.0001 | ETA 04:13:31 2021-02-23 21:10:26 [INFO] [TRAIN] epoch=185, iter=68720/80000, loss=0.7763, lr=0.001715, batch_cost=1.3738, reader_cost=0.0001 | ETA 04:18:17 2021-02-23 21:10:40 [INFO] [TRAIN] epoch=185, iter=68730/80000, loss=0.8130, lr=0.001714, batch_cost=1.3844, reader_cost=0.0001 | ETA 04:20:02 2021-02-23 21:10:54 [INFO] [TRAIN] epoch=185, iter=68740/80000, loss=0.8158, lr=0.001713, batch_cost=1.3861, reader_cost=0.0001 | ETA 04:20:07 2021-02-23 21:11:07 [INFO] [TRAIN] epoch=185, iter=68750/80000, loss=0.8466, lr=0.001711, batch_cost=1.3652, reader_cost=0.0001 | ETA 04:15:58 2021-02-23 21:11:21 [INFO] [TRAIN] epoch=185, iter=68760/80000, loss=0.9453, lr=0.001710, batch_cost=1.3437, reader_cost=0.0001 | ETA 04:11:43 2021-02-23 21:11:34 [INFO] [TRAIN] epoch=185, iter=68770/80000, loss=0.8648, lr=0.001708, batch_cost=1.3722, reader_cost=0.0001 | ETA 04:16:50 2021-02-23 21:11:48 [INFO] [TRAIN] epoch=185, iter=68780/80000, loss=0.8363, lr=0.001707, batch_cost=1.3553, reader_cost=0.0001 | ETA 04:13:26 2021-02-23 21:12:02 [INFO] [TRAIN] epoch=185, iter=68790/80000, loss=0.8325, lr=0.001706, batch_cost=1.3862, reader_cost=0.0001 | ETA 04:18:59 2021-02-23 21:12:15 [INFO] [TRAIN] epoch=185, iter=68800/80000, loss=0.8380, lr=0.001704, batch_cost=1.3748, reader_cost=0.0001 | ETA 04:16:38 2021-02-23 21:12:29 [INFO] [TRAIN] epoch=185, iter=68810/80000, loss=0.8315, lr=0.001703, batch_cost=1.3574, reader_cost=0.0001 | ETA 04:13:08 2021-02-23 21:12:42 [INFO] [TRAIN] epoch=185, iter=68820/80000, loss=0.8371, lr=0.001702, batch_cost=1.3081, reader_cost=0.0001 | ETA 04:03:44 2021-02-23 21:12:57 [INFO] [TRAIN] epoch=186, iter=68830/80000, loss=0.8635, lr=0.001700, batch_cost=1.4862, reader_cost=0.0661 | ETA 04:36:40 2021-02-23 21:13:11 [INFO] [TRAIN] epoch=186, iter=68840/80000, loss=0.8090, lr=0.001699, batch_cost=1.3570, reader_cost=0.0001 | ETA 04:12:24 2021-02-23 21:13:24 [INFO] [TRAIN] epoch=186, iter=68850/80000, loss=0.7737, lr=0.001697, batch_cost=1.3678, reader_cost=0.0001 | ETA 04:14:10 2021-02-23 21:13:38 [INFO] [TRAIN] epoch=186, iter=68860/80000, loss=0.8142, lr=0.001696, batch_cost=1.3730, reader_cost=0.0001 | ETA 04:14:54 2021-02-23 21:13:51 [INFO] [TRAIN] epoch=186, iter=68870/80000, loss=0.8400, lr=0.001695, batch_cost=1.3488, reader_cost=0.0001 | ETA 04:10:11 2021-02-23 21:14:05 [INFO] [TRAIN] epoch=186, iter=68880/80000, loss=0.8411, lr=0.001693, batch_cost=1.3789, reader_cost=0.0001 | ETA 04:15:33 2021-02-23 21:14:19 [INFO] [TRAIN] epoch=186, iter=68890/80000, loss=0.7819, lr=0.001692, batch_cost=1.3455, reader_cost=0.0001 | ETA 04:09:08 2021-02-23 21:14:32 [INFO] [TRAIN] epoch=186, iter=68900/80000, loss=0.8268, lr=0.001691, batch_cost=1.3577, reader_cost=0.0001 | ETA 04:11:10 2021-02-23 21:14:46 [INFO] [TRAIN] epoch=186, iter=68910/80000, loss=0.7835, lr=0.001689, batch_cost=1.3515, reader_cost=0.0001 | ETA 04:09:47 2021-02-23 21:15:00 [INFO] [TRAIN] epoch=186, iter=68920/80000, loss=0.8144, lr=0.001688, batch_cost=1.3698, reader_cost=0.0001 | ETA 04:12:57 2021-02-23 21:15:13 [INFO] [TRAIN] epoch=186, iter=68930/80000, loss=0.8687, lr=0.001687, batch_cost=1.3599, reader_cost=0.0001 | ETA 04:10:54 2021-02-23 21:15:27 [INFO] [TRAIN] epoch=186, iter=68940/80000, loss=0.7838, lr=0.001685, batch_cost=1.3716, reader_cost=0.0001 | ETA 04:12:50 2021-02-23 21:15:41 [INFO] [TRAIN] epoch=186, iter=68950/80000, loss=0.8693, lr=0.001684, batch_cost=1.4191, reader_cost=0.0001 | ETA 04:21:20 2021-02-23 21:15:55 [INFO] [TRAIN] epoch=186, iter=68960/80000, loss=0.8778, lr=0.001682, batch_cost=1.3537, reader_cost=0.0001 | ETA 04:09:04 2021-02-23 21:16:08 [INFO] [TRAIN] epoch=186, iter=68970/80000, loss=0.8405, lr=0.001681, batch_cost=1.3585, reader_cost=0.0001 | ETA 04:09:44 2021-02-23 21:16:22 [INFO] [TRAIN] epoch=186, iter=68980/80000, loss=0.8039, lr=0.001680, batch_cost=1.3706, reader_cost=0.0001 | ETA 04:11:43 2021-02-23 21:16:36 [INFO] [TRAIN] epoch=186, iter=68990/80000, loss=0.7968, lr=0.001678, batch_cost=1.3813, reader_cost=0.0001 | ETA 04:13:28 2021-02-23 21:16:49 [INFO] [TRAIN] epoch=186, iter=69000/80000, loss=0.8430, lr=0.001677, batch_cost=1.3471, reader_cost=0.0001 | ETA 04:06:57 2021-02-23 21:16:49 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:13 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:03 - batch_cost: 0.2219 - reader cost: 0.0939  3/125 [..............................] - ETA: 57s - batch_cost: 0.2777 - reader cost: 0.1085  4/125 [..............................] - ETA: 56s - batch_cost: 0.3221 - reader cost: 0.1322 5/125 [>.............................] - ETA: 54s - batch_cost: 0.3392 - reader cost: 0.1354 6/125 [>.............................] - ETA: 54s - batch_cost: 0.3563 - reader cost: 0.1448 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3633 - reader cost: 0.1456 8/125 [>.............................] - ETA: 52s - batch_cost: 0.3726 - reader cost: 0.1508 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3808 - reader cost: 0.1535 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3843 - reader cost: 0.1547 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3884 - reader cost: 0.1565 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3919 - reader cost: 0.1585 13/125 [==>...........................] - ETA: 49s - batch_cost: 0.3959 - reader cost: 0.1606 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3946 - reader cost: 0.1580 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3968 - reader cost: 0.1589 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3991 - reader cost: 0.1604 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3989 - reader cost: 0.1594 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.4007 - reader cost: 0.1605 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.4010 - reader cost: 0.1599 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4024 - reader cost: 0.1608 21/125 [====>.........................] - ETA: 45s - batch_cost: 0.4049 - reader cost: 0.1619 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4060 - reader cost: 0.1620 23/125 [====>.........................] - ETA: 44s - batch_cost: 0.4074 - reader cost: 0.1632 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4087 - reader cost: 0.1640 25/125 [=====>........................] - ETA: 43s - batch_cost: 0.4099 - reader cost: 0.1649 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4114 - reader cost: 0.1656 27/125 [=====>........................] - ETA: 42s - batch_cost: 0.4123 - reader cost: 0.1659 28/125 [=====>........................] - ETA: 42s - batch_cost: 0.4129 - reader cost: 0.1664 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4120 - reader cost: 0.1654 30/125 [======>.......................] - ETA: 41s - batch_cost: 0.4127 - reader cost: 0.1660 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4132 - reader cost: 0.1662 32/125 [======>.......................] - ETA: 40s - batch_cost: 0.4121 - reader cost: 0.1650 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4130 - reader cost: 0.1655 34/125 [=======>......................] - ETA: 39s - batch_cost: 0.4122 - reader cost: 0.1646 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4117 - reader cost: 0.1640 36/125 [=======>......................] - ETA: 38s - batch_cost: 0.4132 - reader cost: 0.1650 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4140 - reader cost: 0.1655 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4144 - reader cost: 0.1659 39/125 [========>.....................] - ETA: 37s - batch_cost: 0.4153 - reader cost: 0.1665 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4158 - reader cost: 0.1668 41/125 [========>.....................] - ETA: 36s - batch_cost: 0.4161 - reader cost: 0.1670 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4165 - reader cost: 0.1672 43/125 [=========>....................] - ETA: 35s - batch_cost: 0.4169 - reader cost: 0.1674 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4171 - reader cost: 0.1675 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4174 - reader cost: 0.1678 46/125 [==========>...................] - ETA: 34s - batch_cost: 0.4177 - reader cost: 0.1679 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4179 - reader cost: 0.1682 48/125 [==========>...................] - ETA: 33s - batch_cost: 0.4185 - reader cost: 0.1686 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4179 - reader cost: 0.1679 50/125 [===========>..................] - ETA: 32s - batch_cost: 0.4170 - reader cost: 0.1670 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4173 - reader cost: 0.1673 52/125 [===========>..................] - ETA: 31s - batch_cost: 0.4175 - reader cost: 0.1674 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4179 - reader cost: 0.1678 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4182 - reader cost: 0.1680 55/125 [============>.................] - ETA: 30s - batch_cost: 0.4186 - reader cost: 0.1683 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4188 - reader cost: 0.1684 57/125 [============>.................] - ETA: 29s - batch_cost: 0.4190 - reader cost: 0.1686 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4193 - reader cost: 0.1689 59/125 [=============>................] - ETA: 28s - batch_cost: 0.4196 - reader cost: 0.1690 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4199 - reader cost: 0.1693 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4204 - reader cost: 0.1696 62/125 [=============>................] - ETA: 27s - batch_cost: 0.4197 - reader cost: 0.1690 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4202 - reader cost: 0.1693 64/125 [==============>...............] - ETA: 26s - batch_cost: 0.4204 - reader cost: 0.1695 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4206 - reader cost: 0.1697 66/125 [==============>...............] - ETA: 25s - batch_cost: 0.4198 - reader cost: 0.1689 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4201 - reader cost: 0.1691 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4201 - reader cost: 0.1691 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4195 - reader cost: 0.1685 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4196 - reader cost: 0.1686 71/125 [================>.............] - ETA: 23s - batch_cost: 0.4198 - reader cost: 0.1688 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4191 - reader cost: 0.1681 73/125 [================>.............] - ETA: 22s - batch_cost: 0.4193 - reader cost: 0.1682 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4188 - reader cost: 0.1676 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4184 - reader cost: 0.1672 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4182 - reader cost: 0.1668 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4184 - reader cost: 0.1665 78/125 [=================>............] - ETA: 20s - batch_cost: 0.4180 - reader cost: 0.1661 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4177 - reader cost: 0.1658 80/125 [==================>...........] - ETA: 19s - batch_cost: 0.4181 - reader cost: 0.1660 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4181 - reader cost: 0.1661 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4175 - reader cost: 0.1654 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4173 - reader cost: 0.1652 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4173 - reader cost: 0.1650 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4172 - reader cost: 0.1650 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4174 - reader cost: 0.1652 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4178 - reader cost: 0.1656 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4174 - reader cost: 0.1652 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4170 - reader cost: 0.1647 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4164 - reader cost: 0.1641 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4167 - reader cost: 0.1644 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4164 - reader cost: 0.1641 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4168 - reader cost: 0.1644 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4171 - reader cost: 0.1646 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4171 - reader cost: 0.1645 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4164 - reader cost: 0.1638 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4167 - reader cost: 0.1641 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4171 - reader cost: 0.1644 99/125 [======================>.......] - ETA: 11s - batch_cost: 0.4174 - reader cost: 0.1645 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4169 - reader cost: 0.1640 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4171 - reader cost: 0.1642 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4172 - reader cost: 0.1643  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4174 - reader cost: 0.1645 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4176 - reader cost: 0.1646 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4178 - reader cost: 0.1648 106/125 [========================>.....] - ETA: 8s - batch_cost: 0.4181 - reader cost: 0.1649 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4177 - reader cost: 0.1644 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4171 - reader cost: 0.1638 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4171 - reader cost: 0.1639 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4172 - reader cost: 0.1639 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4175 - reader cost: 0.1643 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4178 - reader cost: 0.1645 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4176 - reader cost: 0.1643 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4178 - reader cost: 0.1645 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4179 - reader cost: 0.1646 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4175 - reader cost: 0.1642 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4176 - reader cost: 0.1644 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4177 - reader cost: 0.1644 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4179 - reader cost: 0.1647 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4180 - reader cost: 0.1647 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4181 - reader cost: 0.1648 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4182 - reader cost: 0.1649 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4183 - reader cost: 0.1650 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4184 - reader cost: 0.1651 125/125 [==============================] - 53s 423ms/step - batch_cost: 0.4185 - reader cost: 0.1651 2021-02-23 21:17:42 [INFO] [EVAL] #Images=500 mIoU=0.7742 Acc=0.9601 Kappa=0.9481 2021-02-23 21:17:42 [INFO] [EVAL] Class IoU: [0.9807 0.8462 0.9224 0.4207 0.5921 0.6581 0.7418 0.8222 0.9226 0.6169 0.9472 0.8361 0.6506 0.953 0.6653 0.8539 0.8219 0.6635 0.7938] 2021-02-23 21:17:42 [INFO] [EVAL] Class Acc: [0.9905 0.9199 0.948 0.8341 0.8448 0.8751 0.8821 0.9147 0.9515 0.8028 0.9642 0.9131 0.8369 0.9714 0.927 0.8988 0.9491 0.8101 0.8593] 2021-02-23 21:17:47 [INFO] [EVAL] The model with the best validation mIoU (0.8019) was saved at iter 65000. 2021-02-23 21:18:00 [INFO] [TRAIN] epoch=186, iter=69010/80000, loss=0.7879, lr=0.001676, batch_cost=1.3545, reader_cost=0.0001 | ETA 04:08:05 2021-02-23 21:18:14 [INFO] [TRAIN] epoch=186, iter=69020/80000, loss=0.8383, lr=0.001674, batch_cost=1.3581, reader_cost=0.0001 | ETA 04:08:32 2021-02-23 21:18:27 [INFO] [TRAIN] epoch=186, iter=69030/80000, loss=0.8091, lr=0.001673, batch_cost=1.3515, reader_cost=0.0001 | ETA 04:07:05 2021-02-23 21:18:41 [INFO] [TRAIN] epoch=186, iter=69040/80000, loss=0.8475, lr=0.001671, batch_cost=1.3691, reader_cost=0.0001 | ETA 04:10:04 2021-02-23 21:18:55 [INFO] [TRAIN] epoch=186, iter=69050/80000, loss=0.7922, lr=0.001670, batch_cost=1.3487, reader_cost=0.0001 | ETA 04:06:08 2021-02-23 21:19:08 [INFO] [TRAIN] epoch=186, iter=69060/80000, loss=0.8065, lr=0.001669, batch_cost=1.3589, reader_cost=0.0001 | ETA 04:07:46 2021-02-23 21:19:22 [INFO] [TRAIN] epoch=186, iter=69070/80000, loss=0.8136, lr=0.001667, batch_cost=1.3676, reader_cost=0.0001 | ETA 04:09:08 2021-02-23 21:19:35 [INFO] [TRAIN] epoch=186, iter=69080/80000, loss=0.9357, lr=0.001666, batch_cost=1.3527, reader_cost=0.0001 | ETA 04:06:11 2021-02-23 21:19:49 [INFO] [TRAIN] epoch=186, iter=69090/80000, loss=0.7783, lr=0.001665, batch_cost=1.3465, reader_cost=0.0001 | ETA 04:04:50 2021-02-23 21:20:03 [INFO] [TRAIN] epoch=186, iter=69100/80000, loss=0.8622, lr=0.001663, batch_cost=1.3798, reader_cost=0.0001 | ETA 04:10:39 2021-02-23 21:20:16 [INFO] [TRAIN] epoch=186, iter=69110/80000, loss=0.7996, lr=0.001662, batch_cost=1.3452, reader_cost=0.0001 | ETA 04:04:09 2021-02-23 21:20:30 [INFO] [TRAIN] epoch=186, iter=69120/80000, loss=0.7671, lr=0.001660, batch_cost=1.3580, reader_cost=0.0001 | ETA 04:06:14 2021-02-23 21:20:43 [INFO] [TRAIN] epoch=186, iter=69130/80000, loss=0.8870, lr=0.001659, batch_cost=1.3608, reader_cost=0.0001 | ETA 04:06:32 2021-02-23 21:20:57 [INFO] [TRAIN] epoch=186, iter=69140/80000, loss=0.7843, lr=0.001658, batch_cost=1.3465, reader_cost=0.0001 | ETA 04:03:43 2021-02-23 21:21:10 [INFO] [TRAIN] epoch=186, iter=69150/80000, loss=0.8081, lr=0.001656, batch_cost=1.3371, reader_cost=0.0001 | ETA 04:01:47 2021-02-23 21:21:24 [INFO] [TRAIN] epoch=186, iter=69160/80000, loss=0.7883, lr=0.001655, batch_cost=1.3650, reader_cost=0.0001 | ETA 04:06:36 2021-02-23 21:21:37 [INFO] [TRAIN] epoch=186, iter=69170/80000, loss=0.8164, lr=0.001654, batch_cost=1.3392, reader_cost=0.0001 | ETA 04:01:43 2021-02-23 21:21:51 [INFO] [TRAIN] epoch=186, iter=69180/80000, loss=0.8335, lr=0.001652, batch_cost=1.3686, reader_cost=0.0001 | ETA 04:06:48 2021-02-23 21:22:04 [INFO] [TRAIN] epoch=186, iter=69190/80000, loss=0.8174, lr=0.001651, batch_cost=1.3493, reader_cost=0.0001 | ETA 04:03:05 2021-02-23 21:22:19 [INFO] [TRAIN] epoch=187, iter=69200/80000, loss=0.8732, lr=0.001649, batch_cost=1.4492, reader_cost=0.0841 | ETA 04:20:51 2021-02-23 21:22:32 [INFO] [TRAIN] epoch=187, iter=69210/80000, loss=0.8123, lr=0.001648, batch_cost=1.3567, reader_cost=0.0001 | ETA 04:03:59 2021-02-23 21:22:46 [INFO] [TRAIN] epoch=187, iter=69220/80000, loss=0.8454, lr=0.001647, batch_cost=1.3855, reader_cost=0.0001 | ETA 04:08:55 2021-02-23 21:23:00 [INFO] [TRAIN] epoch=187, iter=69230/80000, loss=0.8071, lr=0.001645, batch_cost=1.3413, reader_cost=0.0001 | ETA 04:00:46 2021-02-23 21:23:13 [INFO] [TRAIN] epoch=187, iter=69240/80000, loss=0.8131, lr=0.001644, batch_cost=1.3585, reader_cost=0.0001 | ETA 04:03:37 2021-02-23 21:23:27 [INFO] [TRAIN] epoch=187, iter=69250/80000, loss=0.7822, lr=0.001643, batch_cost=1.3617, reader_cost=0.0001 | ETA 04:03:58 2021-02-23 21:23:40 [INFO] [TRAIN] epoch=187, iter=69260/80000, loss=0.8133, lr=0.001641, batch_cost=1.3237, reader_cost=0.0001 | ETA 03:56:56 2021-02-23 21:23:54 [INFO] [TRAIN] epoch=187, iter=69270/80000, loss=0.7868, lr=0.001640, batch_cost=1.3668, reader_cost=0.0001 | ETA 04:04:25 2021-02-23 21:24:07 [INFO] [TRAIN] epoch=187, iter=69280/80000, loss=0.8017, lr=0.001638, batch_cost=1.3524, reader_cost=0.0001 | ETA 04:01:37 2021-02-23 21:24:21 [INFO] [TRAIN] epoch=187, iter=69290/80000, loss=0.8394, lr=0.001637, batch_cost=1.3727, reader_cost=0.0001 | ETA 04:05:01 2021-02-23 21:24:35 [INFO] [TRAIN] epoch=187, iter=69300/80000, loss=0.8082, lr=0.001636, batch_cost=1.3667, reader_cost=0.0001 | ETA 04:03:43 2021-02-23 21:24:48 [INFO] [TRAIN] epoch=187, iter=69310/80000, loss=0.7545, lr=0.001634, batch_cost=1.3758, reader_cost=0.0001 | ETA 04:05:07 2021-02-23 21:25:02 [INFO] [TRAIN] epoch=187, iter=69320/80000, loss=0.8596, lr=0.001633, batch_cost=1.3555, reader_cost=0.0001 | ETA 04:01:16 2021-02-23 21:25:15 [INFO] [TRAIN] epoch=187, iter=69330/80000, loss=0.8248, lr=0.001632, batch_cost=1.3245, reader_cost=0.0001 | ETA 03:55:32 2021-02-23 21:25:29 [INFO] [TRAIN] epoch=187, iter=69340/80000, loss=0.8228, lr=0.001630, batch_cost=1.3339, reader_cost=0.0001 | ETA 03:56:59 2021-02-23 21:25:42 [INFO] [TRAIN] epoch=187, iter=69350/80000, loss=0.8538, lr=0.001629, batch_cost=1.3377, reader_cost=0.0001 | ETA 03:57:26 2021-02-23 21:25:55 [INFO] [TRAIN] epoch=187, iter=69360/80000, loss=0.7896, lr=0.001627, batch_cost=1.3460, reader_cost=0.0001 | ETA 03:58:41 2021-02-23 21:26:09 [INFO] [TRAIN] epoch=187, iter=69370/80000, loss=0.7521, lr=0.001626, batch_cost=1.3666, reader_cost=0.0001 | ETA 04:02:06 2021-02-23 21:26:23 [INFO] [TRAIN] epoch=187, iter=69380/80000, loss=0.7753, lr=0.001625, batch_cost=1.3616, reader_cost=0.0001 | ETA 04:01:00 2021-02-23 21:26:36 [INFO] [TRAIN] epoch=187, iter=69390/80000, loss=0.8222, lr=0.001623, batch_cost=1.3404, reader_cost=0.0001 | ETA 03:57:02 2021-02-23 21:26:50 [INFO] [TRAIN] epoch=187, iter=69400/80000, loss=0.7811, lr=0.001622, batch_cost=1.3836, reader_cost=0.0001 | ETA 04:04:26 2021-02-23 21:27:03 [INFO] [TRAIN] epoch=187, iter=69410/80000, loss=0.8148, lr=0.001621, batch_cost=1.3371, reader_cost=0.0001 | ETA 03:55:59 2021-02-23 21:27:17 [INFO] [TRAIN] epoch=187, iter=69420/80000, loss=0.7875, lr=0.001619, batch_cost=1.3243, reader_cost=0.0001 | ETA 03:53:30 2021-02-23 21:27:30 [INFO] [TRAIN] epoch=187, iter=69430/80000, loss=0.8528, lr=0.001618, batch_cost=1.3436, reader_cost=0.0001 | ETA 03:56:41 2021-02-23 21:27:44 [INFO] [TRAIN] epoch=187, iter=69440/80000, loss=0.8178, lr=0.001616, batch_cost=1.3924, reader_cost=0.0001 | ETA 04:05:03 2021-02-23 21:27:58 [INFO] [TRAIN] epoch=187, iter=69450/80000, loss=0.8270, lr=0.001615, batch_cost=1.3719, reader_cost=0.0001 | ETA 04:01:13 2021-02-23 21:28:11 [INFO] [TRAIN] epoch=187, iter=69460/80000, loss=0.8141, lr=0.001614, batch_cost=1.3588, reader_cost=0.0001 | ETA 03:58:41 2021-02-23 21:28:25 [INFO] [TRAIN] epoch=187, iter=69470/80000, loss=0.7979, lr=0.001612, batch_cost=1.3615, reader_cost=0.0001 | ETA 03:58:56 2021-02-23 21:28:39 [INFO] [TRAIN] epoch=187, iter=69480/80000, loss=0.8037, lr=0.001611, batch_cost=1.3645, reader_cost=0.0001 | ETA 03:59:14 2021-02-23 21:28:52 [INFO] [TRAIN] epoch=187, iter=69490/80000, loss=0.8583, lr=0.001610, batch_cost=1.3599, reader_cost=0.0001 | ETA 03:58:12 2021-02-23 21:29:06 [INFO] [TRAIN] epoch=187, iter=69500/80000, loss=0.7898, lr=0.001608, batch_cost=1.3554, reader_cost=0.0001 | ETA 03:57:11 2021-02-23 21:29:19 [INFO] [TRAIN] epoch=187, iter=69510/80000, loss=0.8490, lr=0.001607, batch_cost=1.3541, reader_cost=0.0001 | ETA 03:56:44 2021-02-23 21:29:33 [INFO] [TRAIN] epoch=187, iter=69520/80000, loss=0.7939, lr=0.001605, batch_cost=1.3671, reader_cost=0.0001 | ETA 03:58:47 2021-02-23 21:29:47 [INFO] [TRAIN] epoch=187, iter=69530/80000, loss=0.8027, lr=0.001604, batch_cost=1.3789, reader_cost=0.0001 | ETA 04:00:36 2021-02-23 21:30:01 [INFO] [TRAIN] epoch=187, iter=69540/80000, loss=0.8540, lr=0.001603, batch_cost=1.3856, reader_cost=0.0001 | ETA 04:01:33 2021-02-23 21:30:14 [INFO] [TRAIN] epoch=187, iter=69550/80000, loss=0.7817, lr=0.001601, batch_cost=1.3331, reader_cost=0.0001 | ETA 03:52:10 2021-02-23 21:30:27 [INFO] [TRAIN] epoch=187, iter=69560/80000, loss=0.7980, lr=0.001600, batch_cost=1.3577, reader_cost=0.0001 | ETA 03:56:14 2021-02-23 21:30:42 [INFO] [TRAIN] epoch=188, iter=69570/80000, loss=0.8081, lr=0.001598, batch_cost=1.4353, reader_cost=0.0642 | ETA 04:09:30 2021-02-23 21:30:55 [INFO] [TRAIN] epoch=188, iter=69580/80000, loss=0.8104, lr=0.001597, batch_cost=1.3622, reader_cost=0.0001 | ETA 03:56:34 2021-02-23 21:31:09 [INFO] [TRAIN] epoch=188, iter=69590/80000, loss=0.7938, lr=0.001596, batch_cost=1.3230, reader_cost=0.0001 | ETA 03:49:32 2021-02-23 21:31:22 [INFO] [TRAIN] epoch=188, iter=69600/80000, loss=0.8522, lr=0.001594, batch_cost=1.3621, reader_cost=0.0001 | ETA 03:56:06 2021-02-23 21:31:36 [INFO] [TRAIN] epoch=188, iter=69610/80000, loss=0.7760, lr=0.001593, batch_cost=1.3376, reader_cost=0.0001 | ETA 03:51:37 2021-02-23 21:31:49 [INFO] [TRAIN] epoch=188, iter=69620/80000, loss=0.8216, lr=0.001592, batch_cost=1.3489, reader_cost=0.0001 | ETA 03:53:21 2021-02-23 21:32:03 [INFO] [TRAIN] epoch=188, iter=69630/80000, loss=0.8120, lr=0.001590, batch_cost=1.3680, reader_cost=0.0001 | ETA 03:56:26 2021-02-23 21:32:16 [INFO] [TRAIN] epoch=188, iter=69640/80000, loss=0.8304, lr=0.001589, batch_cost=1.3595, reader_cost=0.0001 | ETA 03:54:44 2021-02-23 21:32:30 [INFO] [TRAIN] epoch=188, iter=69650/80000, loss=0.8143, lr=0.001587, batch_cost=1.3472, reader_cost=0.0001 | ETA 03:52:23 2021-02-23 21:32:43 [INFO] [TRAIN] epoch=188, iter=69660/80000, loss=0.8274, lr=0.001586, batch_cost=1.3488, reader_cost=0.0001 | ETA 03:52:26 2021-02-23 21:32:57 [INFO] [TRAIN] epoch=188, iter=69670/80000, loss=0.8263, lr=0.001585, batch_cost=1.3585, reader_cost=0.0001 | ETA 03:53:52 2021-02-23 21:33:11 [INFO] [TRAIN] epoch=188, iter=69680/80000, loss=0.8059, lr=0.001583, batch_cost=1.3677, reader_cost=0.0001 | ETA 03:55:14 2021-02-23 21:33:24 [INFO] [TRAIN] epoch=188, iter=69690/80000, loss=0.9100, lr=0.001582, batch_cost=1.3647, reader_cost=0.0001 | ETA 03:54:29 2021-02-23 21:33:38 [INFO] [TRAIN] epoch=188, iter=69700/80000, loss=0.8572, lr=0.001581, batch_cost=1.3385, reader_cost=0.0001 | ETA 03:49:46 2021-02-23 21:33:51 [INFO] [TRAIN] epoch=188, iter=69710/80000, loss=0.7942, lr=0.001579, batch_cost=1.3472, reader_cost=0.0001 | ETA 03:51:03 2021-02-23 21:34:05 [INFO] [TRAIN] epoch=188, iter=69720/80000, loss=0.7983, lr=0.001578, batch_cost=1.3414, reader_cost=0.0001 | ETA 03:49:49 2021-02-23 21:34:18 [INFO] [TRAIN] epoch=188, iter=69730/80000, loss=0.7999, lr=0.001576, batch_cost=1.3418, reader_cost=0.0001 | ETA 03:49:39 2021-02-23 21:34:32 [INFO] [TRAIN] epoch=188, iter=69740/80000, loss=0.8075, lr=0.001575, batch_cost=1.3609, reader_cost=0.0001 | ETA 03:52:42 2021-02-23 21:34:45 [INFO] [TRAIN] epoch=188, iter=69750/80000, loss=0.8370, lr=0.001574, batch_cost=1.3797, reader_cost=0.0001 | ETA 03:55:42 2021-02-23 21:34:59 [INFO] [TRAIN] epoch=188, iter=69760/80000, loss=0.8481, lr=0.001572, batch_cost=1.3702, reader_cost=0.0001 | ETA 03:53:50 2021-02-23 21:35:13 [INFO] [TRAIN] epoch=188, iter=69770/80000, loss=0.7739, lr=0.001571, batch_cost=1.3533, reader_cost=0.0001 | ETA 03:50:44 2021-02-23 21:35:26 [INFO] [TRAIN] epoch=188, iter=69780/80000, loss=0.7614, lr=0.001570, batch_cost=1.3466, reader_cost=0.0001 | ETA 03:49:22 2021-02-23 21:35:40 [INFO] [TRAIN] epoch=188, iter=69790/80000, loss=0.8167, lr=0.001568, batch_cost=1.3479, reader_cost=0.0001 | ETA 03:49:21 2021-02-23 21:35:53 [INFO] [TRAIN] epoch=188, iter=69800/80000, loss=0.8001, lr=0.001567, batch_cost=1.3650, reader_cost=0.0001 | ETA 03:52:02 2021-02-23 21:36:07 [INFO] [TRAIN] epoch=188, iter=69810/80000, loss=0.7955, lr=0.001565, batch_cost=1.3650, reader_cost=0.0001 | ETA 03:51:49 2021-02-23 21:36:21 [INFO] [TRAIN] epoch=188, iter=69820/80000, loss=0.7685, lr=0.001564, batch_cost=1.3913, reader_cost=0.0001 | ETA 03:56:03 2021-02-23 21:36:34 [INFO] [TRAIN] epoch=188, iter=69830/80000, loss=0.8038, lr=0.001563, batch_cost=1.3483, reader_cost=0.0001 | ETA 03:48:31 2021-02-23 21:36:48 [INFO] [TRAIN] epoch=188, iter=69840/80000, loss=0.8125, lr=0.001561, batch_cost=1.3485, reader_cost=0.0001 | ETA 03:48:20 2021-02-23 21:37:01 [INFO] [TRAIN] epoch=188, iter=69850/80000, loss=0.7806, lr=0.001560, batch_cost=1.3497, reader_cost=0.0001 | ETA 03:48:19 2021-02-23 21:37:15 [INFO] [TRAIN] epoch=188, iter=69860/80000, loss=0.8616, lr=0.001558, batch_cost=1.3445, reader_cost=0.0001 | ETA 03:47:12 2021-02-23 21:37:28 [INFO] [TRAIN] epoch=188, iter=69870/80000, loss=0.7960, lr=0.001557, batch_cost=1.3496, reader_cost=0.0001 | ETA 03:47:51 2021-02-23 21:37:42 [INFO] [TRAIN] epoch=188, iter=69880/80000, loss=0.8132, lr=0.001556, batch_cost=1.3512, reader_cost=0.0001 | ETA 03:47:53 2021-02-23 21:37:55 [INFO] [TRAIN] epoch=188, iter=69890/80000, loss=0.7927, lr=0.001554, batch_cost=1.3790, reader_cost=0.0001 | ETA 03:52:21 2021-02-23 21:38:09 [INFO] [TRAIN] epoch=188, iter=69900/80000, loss=0.8136, lr=0.001553, batch_cost=1.3688, reader_cost=0.0001 | ETA 03:50:25 2021-02-23 21:38:23 [INFO] [TRAIN] epoch=188, iter=69910/80000, loss=0.8289, lr=0.001552, batch_cost=1.3784, reader_cost=0.0001 | ETA 03:51:47 2021-02-23 21:38:37 [INFO] [TRAIN] epoch=188, iter=69920/80000, loss=0.7922, lr=0.001550, batch_cost=1.3670, reader_cost=0.0001 | ETA 03:49:38 2021-02-23 21:38:50 [INFO] [TRAIN] epoch=188, iter=69930/80000, loss=0.7808, lr=0.001549, batch_cost=1.3684, reader_cost=0.0001 | ETA 03:49:39 2021-02-23 21:39:05 [INFO] [TRAIN] epoch=189, iter=69940/80000, loss=0.7936, lr=0.001547, batch_cost=1.4429, reader_cost=0.0765 | ETA 04:01:55 2021-02-23 21:39:18 [INFO] [TRAIN] epoch=189, iter=69950/80000, loss=0.8810, lr=0.001546, batch_cost=1.3733, reader_cost=0.0001 | ETA 03:50:01 2021-02-23 21:39:32 [INFO] [TRAIN] epoch=189, iter=69960/80000, loss=0.7827, lr=0.001545, batch_cost=1.3686, reader_cost=0.0001 | ETA 03:49:00 2021-02-23 21:39:46 [INFO] [TRAIN] epoch=189, iter=69970/80000, loss=0.7846, lr=0.001543, batch_cost=1.3629, reader_cost=0.0001 | ETA 03:47:50 2021-02-23 21:39:59 [INFO] [TRAIN] epoch=189, iter=69980/80000, loss=0.7945, lr=0.001542, batch_cost=1.3518, reader_cost=0.0001 | ETA 03:45:44 2021-02-23 21:40:13 [INFO] [TRAIN] epoch=189, iter=69990/80000, loss=0.8464, lr=0.001540, batch_cost=1.3313, reader_cost=0.0001 | ETA 03:42:06 2021-02-23 21:40:26 [INFO] [TRAIN] epoch=189, iter=70000/80000, loss=0.8362, lr=0.001539, batch_cost=1.3474, reader_cost=0.0001 | ETA 03:44:34 2021-02-23 21:40:26 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:12 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 59s - batch_cost: 0.1909 - reader cost: 0.0661  3/125 [..............................] - ETA: 56s - batch_cost: 0.2657 - reader cost: 0.0953 4/125 [..............................] - ETA: 55s - batch_cost: 0.3100 - reader cost: 0.1099 5/125 [>.............................] - ETA: 54s - batch_cost: 0.3354 - reader cost: 0.1249 6/125 [>.............................] - ETA: 52s - batch_cost: 0.3427 - reader cost: 0.1253 7/125 [>.............................] - ETA: 51s - batch_cost: 0.3552 - reader cost: 0.1331 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3640 - reader cost: 0.1352 9/125 [=>............................] - ETA: 50s - batch_cost: 0.3719 - reader cost: 0.1386 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3782 - reader cost: 0.1428 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3833 - reader cost: 0.1462 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3884 - reader cost: 0.1502 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3878 - reader cost: 0.1484 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3915 - reader cost: 0.1514 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3913 - reader cost: 0.1504 16/125 [==>...........................] - ETA: 46s - batch_cost: 0.3901 - reader cost: 0.1487 17/125 [===>..........................] - ETA: 45s - batch_cost: 0.3886 - reader cost: 0.1466 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3912 - reader cost: 0.1488 19/125 [===>..........................] - ETA: 44s - batch_cost: 0.3931 - reader cost: 0.1500 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3954 - reader cost: 0.1516 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.3982 - reader cost: 0.1541 22/125 [====>.........................] - ETA: 43s - batch_cost: 0.3999 - reader cost: 0.1554 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.3986 - reader cost: 0.1539 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.3981 - reader cost: 0.1531 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.3994 - reader cost: 0.1538 26/125 [=====>........................] - ETA: 41s - batch_cost: 0.4009 - reader cost: 0.1551 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4012 - reader cost: 0.1552 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4022 - reader cost: 0.1559 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4017 - reader cost: 0.1554 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4027 - reader cost: 0.1562 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.4015 - reader cost: 0.1550 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4024 - reader cost: 0.1557 33/125 [======>.......................] - ETA: 38s - batch_cost: 0.4015 - reader cost: 0.1546 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4022 - reader cost: 0.1550 35/125 [=======>......................] - ETA: 37s - batch_cost: 0.4016 - reader cost: 0.1543 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4031 - reader cost: 0.1555 37/125 [=======>......................] - ETA: 36s - batch_cost: 0.4038 - reader cost: 0.1561 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4053 - reader cost: 0.1573 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4060 - reader cost: 0.1577 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4064 - reader cost: 0.1582 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4073 - reader cost: 0.1589 42/125 [=========>....................] - ETA: 34s - batch_cost: 0.4067 - reader cost: 0.1582 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4074 - reader cost: 0.1586 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4077 - reader cost: 0.1590 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4082 - reader cost: 0.1593 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4087 - reader cost: 0.1597 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4089 - reader cost: 0.1598 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4089 - reader cost: 0.1597 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4094 - reader cost: 0.1599 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4093 - reader cost: 0.1597 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4094 - reader cost: 0.1596 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4096 - reader cost: 0.1599 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4103 - reader cost: 0.1604 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4104 - reader cost: 0.1605 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4109 - reader cost: 0.1609 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4102 - reader cost: 0.1603 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4096 - reader cost: 0.1595 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4094 - reader cost: 0.1591 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4092 - reader cost: 0.1587 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4083 - reader cost: 0.1577 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4086 - reader cost: 0.1580 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4088 - reader cost: 0.1582 63/125 [==============>...............] - ETA: 25s - batch_cost: 0.4083 - reader cost: 0.1576 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4084 - reader cost: 0.1578 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4087 - reader cost: 0.1580 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4091 - reader cost: 0.1584 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4087 - reader cost: 0.1581 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4085 - reader cost: 0.1579 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4083 - reader cost: 0.1577 70/125 [===============>..............] - ETA: 22s - batch_cost: 0.4087 - reader cost: 0.1581 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4090 - reader cost: 0.1580 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4094 - reader cost: 0.1582 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4097 - reader cost: 0.1585 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4106 - reader cost: 0.1588 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4108 - reader cost: 0.1589 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4108 - reader cost: 0.1590 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4114 - reader cost: 0.1594 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4107 - reader cost: 0.1585 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4108 - reader cost: 0.1587 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4110 - reader cost: 0.1589 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4112 - reader cost: 0.1587 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4117 - reader cost: 0.1589 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4119 - reader cost: 0.1591 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4117 - reader cost: 0.1589 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4121 - reader cost: 0.1592 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4124 - reader cost: 0.1596 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4126 - reader cost: 0.1599 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4124 - reader cost: 0.1597 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4127 - reader cost: 0.1600 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4128 - reader cost: 0.1602 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4125 - reader cost: 0.1599 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4122 - reader cost: 0.1596 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4120 - reader cost: 0.1594 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4119 - reader cost: 0.1593 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4123 - reader cost: 0.1589 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4120 - reader cost: 0.1582 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4122 - reader cost: 0.1585 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4124 - reader cost: 0.1587 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4122 - reader cost: 0.1585 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4120 - reader cost: 0.1584 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4116 - reader cost: 0.1580 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4118 - reader cost: 0.1581  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4120 - reader cost: 0.1583 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4123 - reader cost: 0.1585 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4125 - reader cost: 0.1586 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4124 - reader cost: 0.1580 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4126 - reader cost: 0.1576 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4129 - reader cost: 0.1578 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4131 - reader cost: 0.1580 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4128 - reader cost: 0.1576 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4129 - reader cost: 0.1576 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4132 - reader cost: 0.1579 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4133 - reader cost: 0.1576 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4134 - reader cost: 0.1571 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4132 - reader cost: 0.1563 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4131 - reader cost: 0.1558 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4133 - reader cost: 0.1561 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4134 - reader cost: 0.1563 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4135 - reader cost: 0.1564 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4131 - reader cost: 0.1560 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4134 - reader cost: 0.1565 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4138 - reader cost: 0.1568 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4140 - reader cost: 0.1571 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4140 - reader cost: 0.1571 125/125 [==============================] - 52s 419ms/step - batch_cost: 0.4141 - reader cost: 0.1573 2021-02-23 21:41:19 [INFO] [EVAL] #Images=500 mIoU=0.7984 Acc=0.9631 Kappa=0.9521 2021-02-23 21:41:19 [INFO] [EVAL] Class IoU: [0.9812 0.8453 0.9306 0.4534 0.6212 0.6936 0.7579 0.8306 0.9287 0.6279 0.9527 0.8447 0.6499 0.9573 0.8274 0.9105 0.8713 0.6896 0.7954] 2021-02-23 21:41:19 [INFO] [EVAL] Class Acc: [0.9893 0.9093 0.961 0.8661 0.8746 0.8446 0.8534 0.9095 0.9546 0.8456 0.9703 0.9075 0.7733 0.9747 0.9383 0.9736 0.9501 0.8496 0.8694] 2021-02-23 21:41:23 [INFO] [EVAL] The model with the best validation mIoU (0.8019) was saved at iter 65000. 2021-02-23 21:41:37 [INFO] [TRAIN] epoch=189, iter=70010/80000, loss=0.7991, lr=0.001538, batch_cost=1.3839, reader_cost=0.0001 | ETA 03:50:24 2021-02-23 21:41:50 [INFO] [TRAIN] epoch=189, iter=70020/80000, loss=0.8035, lr=0.001536, batch_cost=1.3516, reader_cost=0.0001 | ETA 03:44:48 2021-02-23 21:42:04 [INFO] [TRAIN] epoch=189, iter=70030/80000, loss=0.7773, lr=0.001535, batch_cost=1.3539, reader_cost=0.0001 | ETA 03:44:58 2021-02-23 21:42:17 [INFO] [TRAIN] epoch=189, iter=70040/80000, loss=0.7971, lr=0.001534, batch_cost=1.3429, reader_cost=0.0001 | ETA 03:42:54 2021-02-23 21:42:31 [INFO] [TRAIN] epoch=189, iter=70050/80000, loss=0.7695, lr=0.001532, batch_cost=1.3533, reader_cost=0.0001 | ETA 03:44:25 2021-02-23 21:42:45 [INFO] [TRAIN] epoch=189, iter=70060/80000, loss=0.7642, lr=0.001531, batch_cost=1.4132, reader_cost=0.0001 | ETA 03:54:07 2021-02-23 21:42:58 [INFO] [TRAIN] epoch=189, iter=70070/80000, loss=0.8280, lr=0.001529, batch_cost=1.3533, reader_cost=0.0001 | ETA 03:43:58 2021-02-23 21:43:12 [INFO] [TRAIN] epoch=189, iter=70080/80000, loss=0.8722, lr=0.001528, batch_cost=1.3634, reader_cost=0.0001 | ETA 03:45:25 2021-02-23 21:43:26 [INFO] [TRAIN] epoch=189, iter=70090/80000, loss=0.8118, lr=0.001527, batch_cost=1.4007, reader_cost=0.0001 | ETA 03:51:20 2021-02-23 21:43:39 [INFO] [TRAIN] epoch=189, iter=70100/80000, loss=0.7432, lr=0.001525, batch_cost=1.3462, reader_cost=0.0001 | ETA 03:42:07 2021-02-23 21:43:53 [INFO] [TRAIN] epoch=189, iter=70110/80000, loss=0.8879, lr=0.001524, batch_cost=1.3353, reader_cost=0.0001 | ETA 03:40:06 2021-02-23 21:44:07 [INFO] [TRAIN] epoch=189, iter=70120/80000, loss=0.8871, lr=0.001522, batch_cost=1.4050, reader_cost=0.0001 | ETA 03:51:21 2021-02-23 21:44:20 [INFO] [TRAIN] epoch=189, iter=70130/80000, loss=0.8794, lr=0.001521, batch_cost=1.3271, reader_cost=0.0001 | ETA 03:38:18 2021-02-23 21:44:34 [INFO] [TRAIN] epoch=189, iter=70140/80000, loss=0.7943, lr=0.001520, batch_cost=1.3757, reader_cost=0.0001 | ETA 03:46:04 2021-02-23 21:44:47 [INFO] [TRAIN] epoch=189, iter=70150/80000, loss=0.8862, lr=0.001518, batch_cost=1.3508, reader_cost=0.0001 | ETA 03:41:45 2021-02-23 21:45:01 [INFO] [TRAIN] epoch=189, iter=70160/80000, loss=0.8086, lr=0.001517, batch_cost=1.3399, reader_cost=0.0001 | ETA 03:39:44 2021-02-23 21:45:14 [INFO] [TRAIN] epoch=189, iter=70170/80000, loss=0.8404, lr=0.001516, batch_cost=1.3299, reader_cost=0.0001 | ETA 03:37:53 2021-02-23 21:45:28 [INFO] [TRAIN] epoch=189, iter=70180/80000, loss=0.8578, lr=0.001514, batch_cost=1.3744, reader_cost=0.0001 | ETA 03:44:56 2021-02-23 21:45:41 [INFO] [TRAIN] epoch=189, iter=70190/80000, loss=0.8548, lr=0.001513, batch_cost=1.3179, reader_cost=0.0001 | ETA 03:35:28 2021-02-23 21:45:54 [INFO] [TRAIN] epoch=189, iter=70200/80000, loss=0.8979, lr=0.001511, batch_cost=1.3345, reader_cost=0.0002 | ETA 03:37:57 2021-02-23 21:46:08 [INFO] [TRAIN] epoch=189, iter=70210/80000, loss=0.7765, lr=0.001510, batch_cost=1.3634, reader_cost=0.0001 | ETA 03:42:27 2021-02-23 21:46:21 [INFO] [TRAIN] epoch=189, iter=70220/80000, loss=0.8301, lr=0.001509, batch_cost=1.3524, reader_cost=0.0001 | ETA 03:40:26 2021-02-23 21:46:35 [INFO] [TRAIN] epoch=189, iter=70230/80000, loss=0.8154, lr=0.001507, batch_cost=1.3584, reader_cost=0.0001 | ETA 03:41:11 2021-02-23 21:46:49 [INFO] [TRAIN] epoch=189, iter=70240/80000, loss=0.8094, lr=0.001506, batch_cost=1.3920, reader_cost=0.0001 | ETA 03:46:25 2021-02-23 21:47:02 [INFO] [TRAIN] epoch=189, iter=70250/80000, loss=0.8182, lr=0.001504, batch_cost=1.3545, reader_cost=0.0001 | ETA 03:40:06 2021-02-23 21:47:16 [INFO] [TRAIN] epoch=189, iter=70260/80000, loss=0.7744, lr=0.001503, batch_cost=1.3595, reader_cost=0.0001 | ETA 03:40:41 2021-02-23 21:47:30 [INFO] [TRAIN] epoch=189, iter=70270/80000, loss=0.7788, lr=0.001502, batch_cost=1.3546, reader_cost=0.0001 | ETA 03:39:39 2021-02-23 21:47:43 [INFO] [TRAIN] epoch=189, iter=70280/80000, loss=0.8448, lr=0.001500, batch_cost=1.3716, reader_cost=0.0001 | ETA 03:42:11 2021-02-23 21:47:57 [INFO] [TRAIN] epoch=189, iter=70290/80000, loss=0.7944, lr=0.001499, batch_cost=1.3931, reader_cost=0.0001 | ETA 03:45:27 2021-02-23 21:48:11 [INFO] [TRAIN] epoch=189, iter=70300/80000, loss=0.8288, lr=0.001497, batch_cost=1.3979, reader_cost=0.0001 | ETA 03:45:59 2021-02-23 21:48:25 [INFO] [TRAIN] epoch=190, iter=70310/80000, loss=0.8231, lr=0.001496, batch_cost=1.3952, reader_cost=0.0627 | ETA 03:45:19 2021-02-23 21:48:39 [INFO] [TRAIN] epoch=190, iter=70320/80000, loss=0.7986, lr=0.001495, batch_cost=1.3717, reader_cost=0.0001 | ETA 03:41:18 2021-02-23 21:48:53 [INFO] [TRAIN] epoch=190, iter=70330/80000, loss=0.8905, lr=0.001493, batch_cost=1.3857, reader_cost=0.0001 | ETA 03:43:19 2021-02-23 21:49:06 [INFO] [TRAIN] epoch=190, iter=70340/80000, loss=0.7862, lr=0.001492, batch_cost=1.3391, reader_cost=0.0001 | ETA 03:35:35 2021-02-23 21:49:20 [INFO] [TRAIN] epoch=190, iter=70350/80000, loss=0.8430, lr=0.001491, batch_cost=1.3625, reader_cost=0.0001 | ETA 03:39:08 2021-02-23 21:49:34 [INFO] [TRAIN] epoch=190, iter=70360/80000, loss=0.7660, lr=0.001489, batch_cost=1.3788, reader_cost=0.0001 | ETA 03:41:31 2021-02-23 21:49:47 [INFO] [TRAIN] epoch=190, iter=70370/80000, loss=0.7989, lr=0.001488, batch_cost=1.3687, reader_cost=0.0001 | ETA 03:39:40 2021-02-23 21:50:01 [INFO] [TRAIN] epoch=190, iter=70380/80000, loss=0.8880, lr=0.001486, batch_cost=1.3615, reader_cost=0.0001 | ETA 03:38:17 2021-02-23 21:50:14 [INFO] [TRAIN] epoch=190, iter=70390/80000, loss=0.7734, lr=0.001485, batch_cost=1.3256, reader_cost=0.0001 | ETA 03:32:19 2021-02-23 21:50:28 [INFO] [TRAIN] epoch=190, iter=70400/80000, loss=0.7954, lr=0.001484, batch_cost=1.3549, reader_cost=0.0001 | ETA 03:36:46 2021-02-23 21:50:41 [INFO] [TRAIN] epoch=190, iter=70410/80000, loss=0.8090, lr=0.001482, batch_cost=1.3620, reader_cost=0.0001 | ETA 03:37:41 2021-02-23 21:50:54 [INFO] [TRAIN] epoch=190, iter=70420/80000, loss=0.7795, lr=0.001481, batch_cost=1.3069, reader_cost=0.0001 | ETA 03:28:39 2021-02-23 21:51:08 [INFO] [TRAIN] epoch=190, iter=70430/80000, loss=0.7868, lr=0.001479, batch_cost=1.3638, reader_cost=0.0001 | ETA 03:37:32 2021-02-23 21:51:21 [INFO] [TRAIN] epoch=190, iter=70440/80000, loss=0.8033, lr=0.001478, batch_cost=1.3466, reader_cost=0.0001 | ETA 03:34:33 2021-02-23 21:51:35 [INFO] [TRAIN] epoch=190, iter=70450/80000, loss=0.8216, lr=0.001477, batch_cost=1.3478, reader_cost=0.0001 | ETA 03:34:31 2021-02-23 21:51:49 [INFO] [TRAIN] epoch=190, iter=70460/80000, loss=0.7563, lr=0.001475, batch_cost=1.3606, reader_cost=0.0001 | ETA 03:36:20 2021-02-23 21:52:03 [INFO] [TRAIN] epoch=190, iter=70470/80000, loss=0.8111, lr=0.001474, batch_cost=1.4078, reader_cost=0.0001 | ETA 03:43:36 2021-02-23 21:52:16 [INFO] [TRAIN] epoch=190, iter=70480/80000, loss=0.8439, lr=0.001472, batch_cost=1.3311, reader_cost=0.0001 | ETA 03:31:11 2021-02-23 21:52:30 [INFO] [TRAIN] epoch=190, iter=70490/80000, loss=0.7951, lr=0.001471, batch_cost=1.3651, reader_cost=0.0001 | ETA 03:36:22 2021-02-23 21:52:43 [INFO] [TRAIN] epoch=190, iter=70500/80000, loss=0.8363, lr=0.001470, batch_cost=1.3328, reader_cost=0.0001 | ETA 03:31:02 2021-02-23 21:52:56 [INFO] [TRAIN] epoch=190, iter=70510/80000, loss=0.8607, lr=0.001468, batch_cost=1.3243, reader_cost=0.0001 | ETA 03:29:27 2021-02-23 21:53:10 [INFO] [TRAIN] epoch=190, iter=70520/80000, loss=0.7691, lr=0.001467, batch_cost=1.3379, reader_cost=0.0001 | ETA 03:31:23 2021-02-23 21:53:23 [INFO] [TRAIN] epoch=190, iter=70530/80000, loss=0.8676, lr=0.001465, batch_cost=1.3883, reader_cost=0.0001 | ETA 03:39:07 2021-02-23 21:53:37 [INFO] [TRAIN] epoch=190, iter=70540/80000, loss=0.7498, lr=0.001464, batch_cost=1.3899, reader_cost=0.0001 | ETA 03:39:08 2021-02-23 21:53:51 [INFO] [TRAIN] epoch=190, iter=70550/80000, loss=0.8241, lr=0.001463, batch_cost=1.3611, reader_cost=0.0001 | ETA 03:34:22 2021-02-23 21:54:04 [INFO] [TRAIN] epoch=190, iter=70560/80000, loss=0.7800, lr=0.001461, batch_cost=1.3477, reader_cost=0.0001 | ETA 03:32:02 2021-02-23 21:54:18 [INFO] [TRAIN] epoch=190, iter=70570/80000, loss=0.7808, lr=0.001460, batch_cost=1.3539, reader_cost=0.0001 | ETA 03:32:47 2021-02-23 21:54:31 [INFO] [TRAIN] epoch=190, iter=70580/80000, loss=0.7982, lr=0.001458, batch_cost=1.3462, reader_cost=0.0001 | ETA 03:31:21 2021-02-23 21:54:45 [INFO] [TRAIN] epoch=190, iter=70590/80000, loss=0.8730, lr=0.001457, batch_cost=1.3554, reader_cost=0.0001 | ETA 03:32:34 2021-02-23 21:54:59 [INFO] [TRAIN] epoch=190, iter=70600/80000, loss=0.7880, lr=0.001456, batch_cost=1.3661, reader_cost=0.0001 | ETA 03:34:00 2021-02-23 21:55:12 [INFO] [TRAIN] epoch=190, iter=70610/80000, loss=0.7840, lr=0.001454, batch_cost=1.3392, reader_cost=0.0001 | ETA 03:29:35 2021-02-23 21:55:26 [INFO] [TRAIN] epoch=190, iter=70620/80000, loss=0.7713, lr=0.001453, batch_cost=1.3498, reader_cost=0.0001 | ETA 03:31:00 2021-02-23 21:55:39 [INFO] [TRAIN] epoch=190, iter=70630/80000, loss=0.8203, lr=0.001452, batch_cost=1.3835, reader_cost=0.0001 | ETA 03:36:03 2021-02-23 21:55:53 [INFO] [TRAIN] epoch=190, iter=70640/80000, loss=0.8189, lr=0.001450, batch_cost=1.3434, reader_cost=0.0001 | ETA 03:29:34 2021-02-23 21:56:06 [INFO] [TRAIN] epoch=190, iter=70650/80000, loss=0.8571, lr=0.001449, batch_cost=1.3539, reader_cost=0.0001 | ETA 03:30:58 2021-02-23 21:56:20 [INFO] [TRAIN] epoch=190, iter=70660/80000, loss=0.7836, lr=0.001447, batch_cost=1.3780, reader_cost=0.0001 | ETA 03:34:30 2021-02-23 21:56:34 [INFO] [TRAIN] epoch=190, iter=70670/80000, loss=0.7934, lr=0.001446, batch_cost=1.3537, reader_cost=0.0001 | ETA 03:30:29 2021-02-23 21:56:47 [INFO] [TRAIN] epoch=190, iter=70680/80000, loss=0.8055, lr=0.001445, batch_cost=1.3171, reader_cost=0.0001 | ETA 03:24:35 2021-02-23 21:57:02 [INFO] [TRAIN] epoch=191, iter=70690/80000, loss=0.7923, lr=0.001443, batch_cost=1.5339, reader_cost=0.0744 | ETA 03:58:00 2021-02-23 21:57:16 [INFO] [TRAIN] epoch=191, iter=70700/80000, loss=0.7963, lr=0.001442, batch_cost=1.3544, reader_cost=0.0001 | ETA 03:29:56 2021-02-23 21:57:29 [INFO] [TRAIN] epoch=191, iter=70710/80000, loss=0.8222, lr=0.001440, batch_cost=1.3661, reader_cost=0.0001 | ETA 03:31:31 2021-02-23 21:57:43 [INFO] [TRAIN] epoch=191, iter=70720/80000, loss=0.8136, lr=0.001439, batch_cost=1.3492, reader_cost=0.0001 | ETA 03:28:40 2021-02-23 21:57:57 [INFO] [TRAIN] epoch=191, iter=70730/80000, loss=0.8326, lr=0.001438, batch_cost=1.3665, reader_cost=0.0001 | ETA 03:31:07 2021-02-23 21:58:10 [INFO] [TRAIN] epoch=191, iter=70740/80000, loss=0.8142, lr=0.001436, batch_cost=1.3355, reader_cost=0.0001 | ETA 03:26:06 2021-02-23 21:58:23 [INFO] [TRAIN] epoch=191, iter=70750/80000, loss=0.7664, lr=0.001435, batch_cost=1.3552, reader_cost=0.0001 | ETA 03:28:55 2021-02-23 21:58:37 [INFO] [TRAIN] epoch=191, iter=70760/80000, loss=0.7742, lr=0.001433, batch_cost=1.3426, reader_cost=0.0001 | ETA 03:26:45 2021-02-23 21:58:50 [INFO] [TRAIN] epoch=191, iter=70770/80000, loss=0.8391, lr=0.001432, batch_cost=1.3606, reader_cost=0.0001 | ETA 03:29:17 2021-02-23 21:59:04 [INFO] [TRAIN] epoch=191, iter=70780/80000, loss=0.7662, lr=0.001431, batch_cost=1.3584, reader_cost=0.0001 | ETA 03:28:44 2021-02-23 21:59:18 [INFO] [TRAIN] epoch=191, iter=70790/80000, loss=0.8134, lr=0.001429, batch_cost=1.3458, reader_cost=0.0001 | ETA 03:26:34 2021-02-23 21:59:31 [INFO] [TRAIN] epoch=191, iter=70800/80000, loss=0.8644, lr=0.001428, batch_cost=1.3489, reader_cost=0.0001 | ETA 03:26:49 2021-02-23 21:59:45 [INFO] [TRAIN] epoch=191, iter=70810/80000, loss=0.7675, lr=0.001426, batch_cost=1.4078, reader_cost=0.0001 | ETA 03:35:37 2021-02-23 21:59:59 [INFO] [TRAIN] epoch=191, iter=70820/80000, loss=0.8564, lr=0.001425, batch_cost=1.3718, reader_cost=0.0001 | ETA 03:29:52 2021-02-23 22:00:12 [INFO] [TRAIN] epoch=191, iter=70830/80000, loss=0.7774, lr=0.001424, batch_cost=1.3613, reader_cost=0.0001 | ETA 03:28:03 2021-02-23 22:00:26 [INFO] [TRAIN] epoch=191, iter=70840/80000, loss=0.8060, lr=0.001422, batch_cost=1.3695, reader_cost=0.0001 | ETA 03:29:04 2021-02-23 22:00:39 [INFO] [TRAIN] epoch=191, iter=70850/80000, loss=0.8816, lr=0.001421, batch_cost=1.3271, reader_cost=0.0001 | ETA 03:22:22 2021-02-23 22:00:53 [INFO] [TRAIN] epoch=191, iter=70860/80000, loss=0.8463, lr=0.001419, batch_cost=1.3659, reader_cost=0.0001 | ETA 03:28:04 2021-02-23 22:01:07 [INFO] [TRAIN] epoch=191, iter=70870/80000, loss=0.8409, lr=0.001418, batch_cost=1.3789, reader_cost=0.0001 | ETA 03:29:49 2021-02-23 22:01:20 [INFO] [TRAIN] epoch=191, iter=70880/80000, loss=0.7948, lr=0.001417, batch_cost=1.3396, reader_cost=0.0001 | ETA 03:23:37 2021-02-23 22:01:34 [INFO] [TRAIN] epoch=191, iter=70890/80000, loss=0.7714, lr=0.001415, batch_cost=1.3842, reader_cost=0.0001 | ETA 03:30:10 2021-02-23 22:01:48 [INFO] [TRAIN] epoch=191, iter=70900/80000, loss=0.7719, lr=0.001414, batch_cost=1.3512, reader_cost=0.0001 | ETA 03:24:55 2021-02-23 22:02:01 [INFO] [TRAIN] epoch=191, iter=70910/80000, loss=0.8385, lr=0.001412, batch_cost=1.3740, reader_cost=0.0001 | ETA 03:28:09 2021-02-23 22:02:15 [INFO] [TRAIN] epoch=191, iter=70920/80000, loss=0.8272, lr=0.001411, batch_cost=1.3561, reader_cost=0.0001 | ETA 03:25:13 2021-02-23 22:02:28 [INFO] [TRAIN] epoch=191, iter=70930/80000, loss=0.8424, lr=0.001410, batch_cost=1.3499, reader_cost=0.0001 | ETA 03:24:03 2021-02-23 22:02:42 [INFO] [TRAIN] epoch=191, iter=70940/80000, loss=0.7857, lr=0.001408, batch_cost=1.3579, reader_cost=0.0001 | ETA 03:25:02 2021-02-23 22:02:55 [INFO] [TRAIN] epoch=191, iter=70950/80000, loss=0.7813, lr=0.001407, batch_cost=1.3533, reader_cost=0.0001 | ETA 03:24:07 2021-02-23 22:03:09 [INFO] [TRAIN] epoch=191, iter=70960/80000, loss=0.7893, lr=0.001405, batch_cost=1.3441, reader_cost=0.0001 | ETA 03:22:30 2021-02-23 22:03:23 [INFO] [TRAIN] epoch=191, iter=70970/80000, loss=0.8400, lr=0.001404, batch_cost=1.3714, reader_cost=0.0001 | ETA 03:26:24 2021-02-23 22:03:36 [INFO] [TRAIN] epoch=191, iter=70980/80000, loss=0.8036, lr=0.001403, batch_cost=1.3602, reader_cost=0.0001 | ETA 03:24:28 2021-02-23 22:03:50 [INFO] [TRAIN] epoch=191, iter=70990/80000, loss=0.8587, lr=0.001401, batch_cost=1.3624, reader_cost=0.0001 | ETA 03:24:35 2021-02-23 22:04:03 [INFO] [TRAIN] epoch=191, iter=71000/80000, loss=0.8300, lr=0.001400, batch_cost=1.3551, reader_cost=0.0001 | ETA 03:23:15 2021-02-23 22:04:03 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:13 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:04 - batch_cost: 0.2247 - reader cost: 0.1003  3/125 [..............................] - ETA: 57s - batch_cost: 0.2738 - reader cost: 0.1059  4/125 [..............................] - ETA: 56s - batch_cost: 0.3155 - reader cost: 0.1273 5/125 [>.............................] - ETA: 55s - batch_cost: 0.3415 - reader cost: 0.1411 6/125 [>.............................] - ETA: 54s - batch_cost: 0.3559 - reader cost: 0.1472 7/125 [>.............................] - ETA: 53s - batch_cost: 0.3666 - reader cost: 0.1513 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3689 - reader cost: 0.1474 9/125 [=>............................] - ETA: 50s - batch_cost: 0.3676 - reader cost: 0.1427 10/125 [=>............................] - ETA: 49s - batch_cost: 0.3688 - reader cost: 0.1416 11/125 [=>............................] - ETA: 48s - batch_cost: 0.3743 - reader cost: 0.1452 12/125 [=>............................] - ETA: 48s - batch_cost: 0.3807 - reader cost: 0.1486 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3837 - reader cost: 0.1503 14/125 [==>...........................] - ETA: 47s - batch_cost: 0.3877 - reader cost: 0.1527 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3906 - reader cost: 0.1545 16/125 [==>...........................] - ETA: 46s - batch_cost: 0.3927 - reader cost: 0.1557 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3945 - reader cost: 0.1567 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3964 - reader cost: 0.1579 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3983 - reader cost: 0.1587 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3971 - reader cost: 0.1568 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4001 - reader cost: 0.1592 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4012 - reader cost: 0.1600 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4027 - reader cost: 0.1607 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4035 - reader cost: 0.1612 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4026 - reader cost: 0.1601 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4040 - reader cost: 0.1613 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4053 - reader cost: 0.1622 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4060 - reader cost: 0.1627 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4070 - reader cost: 0.1633 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4078 - reader cost: 0.1639 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4091 - reader cost: 0.1648 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4103 - reader cost: 0.1656 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4097 - reader cost: 0.1650 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4109 - reader cost: 0.1657 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4114 - reader cost: 0.1660 36/125 [=======>......................] - ETA: 38s - batch_cost: 0.4125 - reader cost: 0.1668 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4131 - reader cost: 0.1672 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4129 - reader cost: 0.1667 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4133 - reader cost: 0.1669 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4124 - reader cost: 0.1661 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4127 - reader cost: 0.1662 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4141 - reader cost: 0.1674 43/125 [=========>....................] - ETA: 35s - batch_cost: 0.4135 - reader cost: 0.1668 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4131 - reader cost: 0.1661 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4138 - reader cost: 0.1667 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4143 - reader cost: 0.1669 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4133 - reader cost: 0.1657 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4141 - reader cost: 0.1662 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4134 - reader cost: 0.1655 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4126 - reader cost: 0.1646 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4130 - reader cost: 0.1649 52/125 [===========>..................] - ETA: 31s - batch_cost: 0.4134 - reader cost: 0.1654 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4141 - reader cost: 0.1660 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4145 - reader cost: 0.1664 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4136 - reader cost: 0.1655 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4139 - reader cost: 0.1657 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4139 - reader cost: 0.1651 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4132 - reader cost: 0.1644 59/125 [=============>................] - ETA: 28s - batch_cost: 0.4142 - reader cost: 0.1651 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4143 - reader cost: 0.1649 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4144 - reader cost: 0.1650 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4145 - reader cost: 0.1651 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4147 - reader cost: 0.1653 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4150 - reader cost: 0.1654 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4153 - reader cost: 0.1658 66/125 [==============>...............] - ETA: 25s - batch_cost: 0.4155 - reader cost: 0.1659 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4149 - reader cost: 0.1653 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4152 - reader cost: 0.1656 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4154 - reader cost: 0.1658 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4156 - reader cost: 0.1659 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4150 - reader cost: 0.1653 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4144 - reader cost: 0.1647 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4138 - reader cost: 0.1640 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4141 - reader cost: 0.1643 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4136 - reader cost: 0.1638 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4140 - reader cost: 0.1641 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4135 - reader cost: 0.1636 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4131 - reader cost: 0.1631 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4132 - reader cost: 0.1633 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4133 - reader cost: 0.1634 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4129 - reader cost: 0.1629 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4129 - reader cost: 0.1624 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4131 - reader cost: 0.1626 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4134 - reader cost: 0.1628 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4135 - reader cost: 0.1627 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4141 - reader cost: 0.1630 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4147 - reader cost: 0.1633 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4151 - reader cost: 0.1637 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4153 - reader cost: 0.1639 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4156 - reader cost: 0.1642 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4156 - reader cost: 0.1642 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4158 - reader cost: 0.1644 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4164 - reader cost: 0.1650 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4166 - reader cost: 0.1651 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4162 - reader cost: 0.1648 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4158 - reader cost: 0.1643 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4159 - reader cost: 0.1644 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4161 - reader cost: 0.1646 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4162 - reader cost: 0.1647 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4158 - reader cost: 0.1643 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4155 - reader cost: 0.1640 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4156 - reader cost: 0.1641  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4158 - reader cost: 0.1642 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4154 - reader cost: 0.1638 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4150 - reader cost: 0.1634 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4153 - reader cost: 0.1636 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4148 - reader cost: 0.1632 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4144 - reader cost: 0.1628 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4141 - reader cost: 0.1623 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4143 - reader cost: 0.1625 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4143 - reader cost: 0.1620 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4142 - reader cost: 0.1613 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4144 - reader cost: 0.1609 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4145 - reader cost: 0.1608 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4146 - reader cost: 0.1610 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4147 - reader cost: 0.1608 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4147 - reader cost: 0.1602 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4144 - reader cost: 0.1596 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4147 - reader cost: 0.1597 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4145 - reader cost: 0.1593 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4151 - reader cost: 0.1586 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4150 - reader cost: 0.1574 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4147 - reader cost: 0.1564 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4148 - reader cost: 0.1566 125/125 [==============================] - 52s 420ms/step - batch_cost: 0.4150 - reader cost: 0.1569 2021-02-23 22:04:56 [INFO] [EVAL] #Images=500 mIoU=0.7934 Acc=0.9634 Kappa=0.9524 2021-02-23 22:04:56 [INFO] [EVAL] Class IoU: [0.9811 0.8501 0.9314 0.5226 0.6356 0.6934 0.7569 0.835 0.9278 0.6433 0.9508 0.8492 0.6751 0.9581 0.8007 0.854 0.7104 0.6978 0.8019] 2021-02-23 22:04:56 [INFO] [EVAL] Class Acc: [0.9881 0.9292 0.9607 0.8795 0.8292 0.8161 0.861 0.9276 0.9588 0.8056 0.9649 0.925 0.7931 0.9767 0.9606 0.8993 0.9622 0.8714 0.8761] 2021-02-23 22:05:01 [INFO] [EVAL] The model with the best validation mIoU (0.8019) was saved at iter 65000. 2021-02-23 22:05:14 [INFO] [TRAIN] epoch=191, iter=71010/80000, loss=0.7942, lr=0.001398, batch_cost=1.3460, reader_cost=0.0001 | ETA 03:21:40 2021-02-23 22:05:28 [INFO] [TRAIN] epoch=191, iter=71020/80000, loss=0.8191, lr=0.001397, batch_cost=1.3710, reader_cost=0.0001 | ETA 03:25:12 2021-02-23 22:05:41 [INFO] [TRAIN] epoch=191, iter=71030/80000, loss=0.8148, lr=0.001396, batch_cost=1.3603, reader_cost=0.0001 | ETA 03:23:22 2021-02-23 22:05:55 [INFO] [TRAIN] epoch=191, iter=71040/80000, loss=0.8747, lr=0.001394, batch_cost=1.3446, reader_cost=0.0001 | ETA 03:20:47 2021-02-23 22:06:08 [INFO] [TRAIN] epoch=191, iter=71050/80000, loss=0.8032, lr=0.001393, batch_cost=1.3602, reader_cost=0.0001 | ETA 03:22:53 2021-02-23 22:06:23 [INFO] [TRAIN] epoch=192, iter=71060/80000, loss=0.7759, lr=0.001391, batch_cost=1.4856, reader_cost=0.0794 | ETA 03:41:21 2021-02-23 22:06:37 [INFO] [TRAIN] epoch=192, iter=71070/80000, loss=0.8099, lr=0.001390, batch_cost=1.3439, reader_cost=0.0001 | ETA 03:20:01 2021-02-23 22:06:50 [INFO] [TRAIN] epoch=192, iter=71080/80000, loss=0.8082, lr=0.001389, batch_cost=1.3559, reader_cost=0.0001 | ETA 03:21:34 2021-02-23 22:07:04 [INFO] [TRAIN] epoch=192, iter=71090/80000, loss=0.8306, lr=0.001387, batch_cost=1.3644, reader_cost=0.0001 | ETA 03:22:37 2021-02-23 22:07:18 [INFO] [TRAIN] epoch=192, iter=71100/80000, loss=0.7951, lr=0.001386, batch_cost=1.3591, reader_cost=0.0001 | ETA 03:21:36 2021-02-23 22:07:31 [INFO] [TRAIN] epoch=192, iter=71110/80000, loss=0.8273, lr=0.001384, batch_cost=1.3816, reader_cost=0.0001 | ETA 03:24:42 2021-02-23 22:07:45 [INFO] [TRAIN] epoch=192, iter=71120/80000, loss=0.7598, lr=0.001383, batch_cost=1.3802, reader_cost=0.0001 | ETA 03:24:16 2021-02-23 22:07:59 [INFO] [TRAIN] epoch=192, iter=71130/80000, loss=0.8493, lr=0.001382, batch_cost=1.3796, reader_cost=0.0001 | ETA 03:23:56 2021-02-23 22:08:13 [INFO] [TRAIN] epoch=192, iter=71140/80000, loss=0.8254, lr=0.001380, batch_cost=1.3729, reader_cost=0.0001 | ETA 03:22:43 2021-02-23 22:08:26 [INFO] [TRAIN] epoch=192, iter=71150/80000, loss=0.9024, lr=0.001379, batch_cost=1.3686, reader_cost=0.0001 | ETA 03:21:51 2021-02-23 22:08:40 [INFO] [TRAIN] epoch=192, iter=71160/80000, loss=0.7654, lr=0.001377, batch_cost=1.3553, reader_cost=0.0001 | ETA 03:19:40 2021-02-23 22:08:54 [INFO] [TRAIN] epoch=192, iter=71170/80000, loss=0.7936, lr=0.001376, batch_cost=1.3795, reader_cost=0.0001 | ETA 03:23:01 2021-02-23 22:09:07 [INFO] [TRAIN] epoch=192, iter=71180/80000, loss=0.8097, lr=0.001375, batch_cost=1.3618, reader_cost=0.0001 | ETA 03:20:10 2021-02-23 22:09:21 [INFO] [TRAIN] epoch=192, iter=71190/80000, loss=0.9056, lr=0.001373, batch_cost=1.3545, reader_cost=0.0001 | ETA 03:18:52 2021-02-23 22:09:35 [INFO] [TRAIN] epoch=192, iter=71200/80000, loss=0.8429, lr=0.001372, batch_cost=1.3829, reader_cost=0.0001 | ETA 03:22:49 2021-02-23 22:09:48 [INFO] [TRAIN] epoch=192, iter=71210/80000, loss=0.8369, lr=0.001370, batch_cost=1.3328, reader_cost=0.0001 | ETA 03:15:14 2021-02-23 22:10:02 [INFO] [TRAIN] epoch=192, iter=71220/80000, loss=0.7624, lr=0.001369, batch_cost=1.3416, reader_cost=0.0001 | ETA 03:16:19 2021-02-23 22:10:15 [INFO] [TRAIN] epoch=192, iter=71230/80000, loss=0.8130, lr=0.001368, batch_cost=1.3503, reader_cost=0.0001 | ETA 03:17:21 2021-02-23 22:10:28 [INFO] [TRAIN] epoch=192, iter=71240/80000, loss=0.7929, lr=0.001366, batch_cost=1.3317, reader_cost=0.0001 | ETA 03:14:25 2021-02-23 22:10:42 [INFO] [TRAIN] epoch=192, iter=71250/80000, loss=0.8296, lr=0.001365, batch_cost=1.3515, reader_cost=0.0001 | ETA 03:17:05 2021-02-23 22:10:55 [INFO] [TRAIN] epoch=192, iter=71260/80000, loss=0.8727, lr=0.001363, batch_cost=1.3505, reader_cost=0.0001 | ETA 03:16:43 2021-02-23 22:11:09 [INFO] [TRAIN] epoch=192, iter=71270/80000, loss=0.7683, lr=0.001362, batch_cost=1.3740, reader_cost=0.0001 | ETA 03:19:55 2021-02-23 22:11:23 [INFO] [TRAIN] epoch=192, iter=71280/80000, loss=0.8333, lr=0.001361, batch_cost=1.3646, reader_cost=0.0001 | ETA 03:18:19 2021-02-23 22:11:37 [INFO] [TRAIN] epoch=192, iter=71290/80000, loss=0.7830, lr=0.001359, batch_cost=1.3858, reader_cost=0.0001 | ETA 03:21:10 2021-02-23 22:11:51 [INFO] [TRAIN] epoch=192, iter=71300/80000, loss=0.7776, lr=0.001358, batch_cost=1.4088, reader_cost=0.0001 | ETA 03:24:16 2021-02-23 22:12:04 [INFO] [TRAIN] epoch=192, iter=71310/80000, loss=0.7879, lr=0.001356, batch_cost=1.3667, reader_cost=0.0001 | ETA 03:17:56 2021-02-23 22:12:18 [INFO] [TRAIN] epoch=192, iter=71320/80000, loss=0.7902, lr=0.001355, batch_cost=1.3491, reader_cost=0.0001 | ETA 03:15:10 2021-02-23 22:12:31 [INFO] [TRAIN] epoch=192, iter=71330/80000, loss=0.8137, lr=0.001354, batch_cost=1.3597, reader_cost=0.0001 | ETA 03:16:28 2021-02-23 22:12:45 [INFO] [TRAIN] epoch=192, iter=71340/80000, loss=0.7935, lr=0.001352, batch_cost=1.3570, reader_cost=0.0001 | ETA 03:15:51 2021-02-23 22:12:59 [INFO] [TRAIN] epoch=192, iter=71350/80000, loss=0.8344, lr=0.001351, batch_cost=1.3599, reader_cost=0.0001 | ETA 03:16:02 2021-02-23 22:13:12 [INFO] [TRAIN] epoch=192, iter=71360/80000, loss=0.8227, lr=0.001349, batch_cost=1.3508, reader_cost=0.0001 | ETA 03:14:30 2021-02-23 22:13:26 [INFO] [TRAIN] epoch=192, iter=71370/80000, loss=0.7568, lr=0.001348, batch_cost=1.3439, reader_cost=0.0001 | ETA 03:13:17 2021-02-23 22:13:39 [INFO] [TRAIN] epoch=192, iter=71380/80000, loss=0.8523, lr=0.001347, batch_cost=1.3761, reader_cost=0.0001 | ETA 03:17:42 2021-02-23 22:13:53 [INFO] [TRAIN] epoch=192, iter=71390/80000, loss=0.8158, lr=0.001345, batch_cost=1.3666, reader_cost=0.0001 | ETA 03:16:06 2021-02-23 22:14:07 [INFO] [TRAIN] epoch=192, iter=71400/80000, loss=0.8509, lr=0.001344, batch_cost=1.3993, reader_cost=0.0001 | ETA 03:20:34 2021-02-23 22:14:20 [INFO] [TRAIN] epoch=192, iter=71410/80000, loss=0.7311, lr=0.001342, batch_cost=1.3517, reader_cost=0.0001 | ETA 03:13:31 2021-02-23 22:14:34 [INFO] [TRAIN] epoch=192, iter=71420/80000, loss=0.8141, lr=0.001341, batch_cost=1.3545, reader_cost=0.0001 | ETA 03:13:41 2021-02-23 22:14:48 [INFO] [TRAIN] epoch=193, iter=71430/80000, loss=0.7905, lr=0.001340, batch_cost=1.4306, reader_cost=0.0783 | ETA 03:24:20 2021-02-23 22:15:02 [INFO] [TRAIN] epoch=193, iter=71440/80000, loss=0.8141, lr=0.001338, batch_cost=1.3922, reader_cost=0.0001 | ETA 03:18:37 2021-02-23 22:15:16 [INFO] [TRAIN] epoch=193, iter=71450/80000, loss=0.8208, lr=0.001337, batch_cost=1.3423, reader_cost=0.0001 | ETA 03:11:16 2021-02-23 22:15:30 [INFO] [TRAIN] epoch=193, iter=71460/80000, loss=0.7901, lr=0.001335, batch_cost=1.4003, reader_cost=0.0001 | ETA 03:19:18 2021-02-23 22:15:43 [INFO] [TRAIN] epoch=193, iter=71470/80000, loss=0.8297, lr=0.001334, batch_cost=1.3293, reader_cost=0.0001 | ETA 03:08:59 2021-02-23 22:15:56 [INFO] [TRAIN] epoch=193, iter=71480/80000, loss=0.8253, lr=0.001332, batch_cost=1.3195, reader_cost=0.0001 | ETA 03:07:22 2021-02-23 22:16:10 [INFO] [TRAIN] epoch=193, iter=71490/80000, loss=0.7645, lr=0.001331, batch_cost=1.3691, reader_cost=0.0001 | ETA 03:14:10 2021-02-23 22:16:24 [INFO] [TRAIN] epoch=193, iter=71500/80000, loss=0.8408, lr=0.001330, batch_cost=1.3673, reader_cost=0.0001 | ETA 03:13:42 2021-02-23 22:16:37 [INFO] [TRAIN] epoch=193, iter=71510/80000, loss=0.7767, lr=0.001328, batch_cost=1.3740, reader_cost=0.0001 | ETA 03:14:25 2021-02-23 22:16:51 [INFO] [TRAIN] epoch=193, iter=71520/80000, loss=0.8332, lr=0.001327, batch_cost=1.3617, reader_cost=0.0001 | ETA 03:12:27 2021-02-23 22:17:04 [INFO] [TRAIN] epoch=193, iter=71530/80000, loss=0.8016, lr=0.001325, batch_cost=1.3437, reader_cost=0.0001 | ETA 03:09:41 2021-02-23 22:17:18 [INFO] [TRAIN] epoch=193, iter=71540/80000, loss=0.8034, lr=0.001324, batch_cost=1.3543, reader_cost=0.0001 | ETA 03:10:57 2021-02-23 22:17:32 [INFO] [TRAIN] epoch=193, iter=71550/80000, loss=0.7737, lr=0.001323, batch_cost=1.3938, reader_cost=0.0001 | ETA 03:16:17 2021-02-23 22:17:46 [INFO] [TRAIN] epoch=193, iter=71560/80000, loss=0.8739, lr=0.001321, batch_cost=1.3784, reader_cost=0.0001 | ETA 03:13:53 2021-02-23 22:17:59 [INFO] [TRAIN] epoch=193, iter=71570/80000, loss=0.7791, lr=0.001320, batch_cost=1.3534, reader_cost=0.0001 | ETA 03:10:09 2021-02-23 22:18:13 [INFO] [TRAIN] epoch=193, iter=71580/80000, loss=0.7851, lr=0.001318, batch_cost=1.3585, reader_cost=0.0001 | ETA 03:10:38 2021-02-23 22:18:26 [INFO] [TRAIN] epoch=193, iter=71590/80000, loss=0.7745, lr=0.001317, batch_cost=1.3510, reader_cost=0.0001 | ETA 03:09:21 2021-02-23 22:18:40 [INFO] [TRAIN] epoch=193, iter=71600/80000, loss=0.8436, lr=0.001316, batch_cost=1.3505, reader_cost=0.0001 | ETA 03:09:04 2021-02-23 22:18:53 [INFO] [TRAIN] epoch=193, iter=71610/80000, loss=0.8248, lr=0.001314, batch_cost=1.3685, reader_cost=0.0001 | ETA 03:11:21 2021-02-23 22:19:07 [INFO] [TRAIN] epoch=193, iter=71620/80000, loss=0.7840, lr=0.001313, batch_cost=1.3529, reader_cost=0.0001 | ETA 03:08:57 2021-02-23 22:19:21 [INFO] [TRAIN] epoch=193, iter=71630/80000, loss=0.8048, lr=0.001311, batch_cost=1.4069, reader_cost=0.0002 | ETA 03:16:15 2021-02-23 22:19:35 [INFO] [TRAIN] epoch=193, iter=71640/80000, loss=0.8058, lr=0.001310, batch_cost=1.3706, reader_cost=0.0001 | ETA 03:10:58 2021-02-23 22:19:49 [INFO] [TRAIN] epoch=193, iter=71650/80000, loss=0.7856, lr=0.001309, batch_cost=1.3870, reader_cost=0.0001 | ETA 03:13:01 2021-02-23 22:20:02 [INFO] [TRAIN] epoch=193, iter=71660/80000, loss=0.7696, lr=0.001307, batch_cost=1.3661, reader_cost=0.0001 | ETA 03:09:53 2021-02-23 22:20:16 [INFO] [TRAIN] epoch=193, iter=71670/80000, loss=0.7975, lr=0.001306, batch_cost=1.3578, reader_cost=0.0001 | ETA 03:08:30 2021-02-23 22:20:29 [INFO] [TRAIN] epoch=193, iter=71680/80000, loss=0.7675, lr=0.001304, batch_cost=1.3555, reader_cost=0.0001 | ETA 03:07:57 2021-02-23 22:20:43 [INFO] [TRAIN] epoch=193, iter=71690/80000, loss=0.8196, lr=0.001303, batch_cost=1.3711, reader_cost=0.0001 | ETA 03:09:53 2021-02-23 22:20:57 [INFO] [TRAIN] epoch=193, iter=71700/80000, loss=0.8275, lr=0.001301, batch_cost=1.3834, reader_cost=0.0001 | ETA 03:11:22 2021-02-23 22:21:11 [INFO] [TRAIN] epoch=193, iter=71710/80000, loss=0.8382, lr=0.001300, batch_cost=1.3648, reader_cost=0.0001 | ETA 03:08:33 2021-02-23 22:21:24 [INFO] [TRAIN] epoch=193, iter=71720/80000, loss=0.8012, lr=0.001299, batch_cost=1.3702, reader_cost=0.0001 | ETA 03:09:05 2021-02-23 22:21:38 [INFO] [TRAIN] epoch=193, iter=71730/80000, loss=0.7987, lr=0.001297, batch_cost=1.3268, reader_cost=0.0001 | ETA 03:02:52 2021-02-23 22:21:51 [INFO] [TRAIN] epoch=193, iter=71740/80000, loss=0.8036, lr=0.001296, batch_cost=1.3574, reader_cost=0.0001 | ETA 03:06:52 2021-02-23 22:22:05 [INFO] [TRAIN] epoch=193, iter=71750/80000, loss=0.8004, lr=0.001294, batch_cost=1.3872, reader_cost=0.0001 | ETA 03:10:44 2021-02-23 22:22:18 [INFO] [TRAIN] epoch=193, iter=71760/80000, loss=0.8152, lr=0.001293, batch_cost=1.3245, reader_cost=0.0001 | ETA 03:01:54 2021-02-23 22:22:32 [INFO] [TRAIN] epoch=193, iter=71770/80000, loss=0.8055, lr=0.001292, batch_cost=1.3437, reader_cost=0.0001 | ETA 03:04:18 2021-02-23 22:22:45 [INFO] [TRAIN] epoch=193, iter=71780/80000, loss=0.8378, lr=0.001290, batch_cost=1.3519, reader_cost=0.0001 | ETA 03:05:12 2021-02-23 22:22:59 [INFO] [TRAIN] epoch=193, iter=71790/80000, loss=0.7646, lr=0.001289, batch_cost=1.3306, reader_cost=0.0001 | ETA 03:02:04 2021-02-23 22:23:13 [INFO] [TRAIN] epoch=194, iter=71800/80000, loss=0.7772, lr=0.001287, batch_cost=1.4317, reader_cost=0.0740 | ETA 03:15:40 2021-02-23 22:23:26 [INFO] [TRAIN] epoch=194, iter=71810/80000, loss=0.7839, lr=0.001286, batch_cost=1.3491, reader_cost=0.0001 | ETA 03:04:08 2021-02-23 22:23:40 [INFO] [TRAIN] epoch=194, iter=71820/80000, loss=0.8263, lr=0.001285, batch_cost=1.3521, reader_cost=0.0001 | ETA 03:04:19 2021-02-23 22:23:54 [INFO] [TRAIN] epoch=194, iter=71830/80000, loss=0.7920, lr=0.001283, batch_cost=1.3758, reader_cost=0.0001 | ETA 03:07:19 2021-02-23 22:24:07 [INFO] [TRAIN] epoch=194, iter=71840/80000, loss=0.8344, lr=0.001282, batch_cost=1.3524, reader_cost=0.0001 | ETA 03:03:55 2021-02-23 22:24:21 [INFO] [TRAIN] epoch=194, iter=71850/80000, loss=0.8330, lr=0.001280, batch_cost=1.3380, reader_cost=0.0001 | ETA 03:01:44 2021-02-23 22:24:34 [INFO] [TRAIN] epoch=194, iter=71860/80000, loss=0.8671, lr=0.001279, batch_cost=1.3697, reader_cost=0.0001 | ETA 03:05:49 2021-02-23 22:24:48 [INFO] [TRAIN] epoch=194, iter=71870/80000, loss=0.8233, lr=0.001277, batch_cost=1.3631, reader_cost=0.0001 | ETA 03:04:42 2021-02-23 22:25:01 [INFO] [TRAIN] epoch=194, iter=71880/80000, loss=0.7815, lr=0.001276, batch_cost=1.3436, reader_cost=0.0001 | ETA 03:01:50 2021-02-23 22:25:15 [INFO] [TRAIN] epoch=194, iter=71890/80000, loss=0.7832, lr=0.001275, batch_cost=1.3528, reader_cost=0.0001 | ETA 03:02:51 2021-02-23 22:25:28 [INFO] [TRAIN] epoch=194, iter=71900/80000, loss=0.8856, lr=0.001273, batch_cost=1.3594, reader_cost=0.0001 | ETA 03:03:31 2021-02-23 22:25:42 [INFO] [TRAIN] epoch=194, iter=71910/80000, loss=0.8260, lr=0.001272, batch_cost=1.3819, reader_cost=0.0001 | ETA 03:06:19 2021-02-23 22:25:56 [INFO] [TRAIN] epoch=194, iter=71920/80000, loss=0.7880, lr=0.001270, batch_cost=1.3652, reader_cost=0.0001 | ETA 03:03:50 2021-02-23 22:26:09 [INFO] [TRAIN] epoch=194, iter=71930/80000, loss=0.7703, lr=0.001269, batch_cost=1.3583, reader_cost=0.0001 | ETA 03:02:41 2021-02-23 22:26:23 [INFO] [TRAIN] epoch=194, iter=71940/80000, loss=0.8263, lr=0.001268, batch_cost=1.3588, reader_cost=0.0001 | ETA 03:02:31 2021-02-23 22:26:37 [INFO] [TRAIN] epoch=194, iter=71950/80000, loss=0.7666, lr=0.001266, batch_cost=1.3601, reader_cost=0.0001 | ETA 03:02:28 2021-02-23 22:26:50 [INFO] [TRAIN] epoch=194, iter=71960/80000, loss=0.8307, lr=0.001265, batch_cost=1.3550, reader_cost=0.0001 | ETA 03:01:34 2021-02-23 22:27:04 [INFO] [TRAIN] epoch=194, iter=71970/80000, loss=0.8306, lr=0.001263, batch_cost=1.3509, reader_cost=0.0001 | ETA 03:00:48 2021-02-23 22:27:17 [INFO] [TRAIN] epoch=194, iter=71980/80000, loss=0.7904, lr=0.001262, batch_cost=1.3773, reader_cost=0.0001 | ETA 03:04:06 2021-02-23 22:27:31 [INFO] [TRAIN] epoch=194, iter=71990/80000, loss=0.8032, lr=0.001260, batch_cost=1.3688, reader_cost=0.0001 | ETA 03:02:44 2021-02-23 22:27:45 [INFO] [TRAIN] epoch=194, iter=72000/80000, loss=0.8159, lr=0.001259, batch_cost=1.3662, reader_cost=0.0001 | ETA 03:02:09 2021-02-23 22:27:45 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:17 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:01 - batch_cost: 0.1892 - reader cost: 0.0649  3/125 [..............................] - ETA: 56s - batch_cost: 0.2553 - reader cost: 0.0881  4/125 [..............................] - ETA: 53s - batch_cost: 0.2891 - reader cost: 0.0983 5/125 [>.............................] - ETA: 53s - batch_cost: 0.3243 - reader cost: 0.1217 6/125 [>.............................] - ETA: 53s - batch_cost: 0.3439 - reader cost: 0.1310 7/125 [>.............................] - ETA: 51s - batch_cost: 0.3445 - reader cost: 0.1260 8/125 [>.............................] - ETA: 50s - batch_cost: 0.3558 - reader cost: 0.1332 9/125 [=>............................] - ETA: 50s - batch_cost: 0.3666 - reader cost: 0.1392 10/125 [=>............................] - ETA: 49s - batch_cost: 0.3715 - reader cost: 0.1413 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3773 - reader cost: 0.1453 12/125 [=>............................] - ETA: 48s - batch_cost: 0.3803 - reader cost: 0.1461 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3838 - reader cost: 0.1484 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3895 - reader cost: 0.1525 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3930 - reader cost: 0.1545 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3953 - reader cost: 0.1559 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3978 - reader cost: 0.1568 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.3954 - reader cost: 0.1538 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3963 - reader cost: 0.1542 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.3995 - reader cost: 0.1566 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4003 - reader cost: 0.1565 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4013 - reader cost: 0.1573 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4024 - reader cost: 0.1579 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4025 - reader cost: 0.1579 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4039 - reader cost: 0.1586 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4028 - reader cost: 0.1575 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4046 - reader cost: 0.1590 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4060 - reader cost: 0.1602 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4068 - reader cost: 0.1607 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4084 - reader cost: 0.1621 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4074 - reader cost: 0.1611 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4061 - reader cost: 0.1597 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4053 - reader cost: 0.1585 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4044 - reader cost: 0.1573 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4049 - reader cost: 0.1568 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4054 - reader cost: 0.1572 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4052 - reader cost: 0.1570 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4060 - reader cost: 0.1578 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4053 - reader cost: 0.1568 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4062 - reader cost: 0.1577 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4070 - reader cost: 0.1584 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4074 - reader cost: 0.1588 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4079 - reader cost: 0.1578 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4075 - reader cost: 0.1561 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4081 - reader cost: 0.1561 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4087 - reader cost: 0.1567 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4093 - reader cost: 0.1574 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4096 - reader cost: 0.1578 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4102 - reader cost: 0.1585 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4106 - reader cost: 0.1588 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4109 - reader cost: 0.1590 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4112 - reader cost: 0.1594 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4115 - reader cost: 0.1597 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4117 - reader cost: 0.1599 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4113 - reader cost: 0.1595 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4108 - reader cost: 0.1587 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4109 - reader cost: 0.1585 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4112 - reader cost: 0.1588 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4117 - reader cost: 0.1592 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4119 - reader cost: 0.1593 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4114 - reader cost: 0.1588 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4110 - reader cost: 0.1582 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4112 - reader cost: 0.1584 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4105 - reader cost: 0.1577 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4102 - reader cost: 0.1575 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4096 - reader cost: 0.1570 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4100 - reader cost: 0.1574 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4103 - reader cost: 0.1577 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4105 - reader cost: 0.1572 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4100 - reader cost: 0.1564 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4108 - reader cost: 0.1569 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4109 - reader cost: 0.1568 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4113 - reader cost: 0.1573 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4115 - reader cost: 0.1574 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4118 - reader cost: 0.1572 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4120 - reader cost: 0.1570 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4117 - reader cost: 0.1565 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4123 - reader cost: 0.1572 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4123 - reader cost: 0.1568 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4127 - reader cost: 0.1573 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4122 - reader cost: 0.1568 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4129 - reader cost: 0.1576 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4125 - reader cost: 0.1572 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4125 - reader cost: 0.1573 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4128 - reader cost: 0.1574 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4124 - reader cost: 0.1571 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4126 - reader cost: 0.1573 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4127 - reader cost: 0.1574 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4126 - reader cost: 0.1574 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4121 - reader cost: 0.1569 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4116 - reader cost: 0.1565 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4119 - reader cost: 0.1568 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4122 - reader cost: 0.1571 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4125 - reader cost: 0.1573 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4126 - reader cost: 0.1575 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4128 - reader cost: 0.1577 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4124 - reader cost: 0.1573 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4125 - reader cost: 0.1575 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4127 - reader cost: 0.1578 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4130 - reader cost: 0.1581 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4127 - reader cost: 0.1578 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4129 - reader cost: 0.1579  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4126 - reader cost: 0.1578 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4128 - reader cost: 0.1579 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4130 - reader cost: 0.1582 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4127 - reader cost: 0.1579 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4124 - reader cost: 0.1577 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4119 - reader cost: 0.1572 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4123 - reader cost: 0.1576 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4124 - reader cost: 0.1578 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4122 - reader cost: 0.1576 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4124 - reader cost: 0.1579 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4123 - reader cost: 0.1578 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4125 - reader cost: 0.1580 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4123 - reader cost: 0.1579 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4123 - reader cost: 0.1577 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4125 - reader cost: 0.1578 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4126 - reader cost: 0.1580 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4128 - reader cost: 0.1582 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4129 - reader cost: 0.1583 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4132 - reader cost: 0.1586 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4134 - reader cost: 0.1588 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4136 - reader cost: 0.1590 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4137 - reader cost: 0.1592 125/125 [==============================] - 52s 419ms/step - batch_cost: 0.4139 - reader cost: 0.1594 2021-02-23 22:28:37 [INFO] [EVAL] #Images=500 mIoU=0.7955 Acc=0.9626 Kappa=0.9514 2021-02-23 22:28:37 [INFO] [EVAL] Class IoU: [0.9788 0.8365 0.9331 0.4699 0.656 0.691 0.755 0.8344 0.9277 0.6231 0.9517 0.8486 0.6775 0.9581 0.727 0.8481 0.8741 0.7183 0.8054] 2021-02-23 22:28:37 [INFO] [EVAL] Class Acc: [0.9879 0.9082 0.9602 0.8489 0.8355 0.8483 0.8812 0.9191 0.9559 0.8651 0.9674 0.923 0.7879 0.9768 0.9551 0.891 0.9631 0.8285 0.8835] 2021-02-23 22:28:42 [INFO] [EVAL] The model with the best validation mIoU (0.8019) was saved at iter 65000. 2021-02-23 22:28:55 [INFO] [TRAIN] epoch=194, iter=72010/80000, loss=0.8230, lr=0.001258, batch_cost=1.3637, reader_cost=0.0001 | ETA 03:01:35 2021-02-23 22:29:09 [INFO] [TRAIN] epoch=194, iter=72020/80000, loss=0.7735, lr=0.001256, batch_cost=1.3489, reader_cost=0.0001 | ETA 02:59:24 2021-02-23 22:29:22 [INFO] [TRAIN] epoch=194, iter=72030/80000, loss=0.7897, lr=0.001255, batch_cost=1.3443, reader_cost=0.0001 | ETA 02:58:33 2021-02-23 22:29:36 [INFO] [TRAIN] epoch=194, iter=72040/80000, loss=0.8242, lr=0.001253, batch_cost=1.3525, reader_cost=0.0001 | ETA 02:59:25 2021-02-23 22:29:49 [INFO] [TRAIN] epoch=194, iter=72050/80000, loss=0.8518, lr=0.001252, batch_cost=1.3211, reader_cost=0.0001 | ETA 02:55:02 2021-02-23 22:30:03 [INFO] [TRAIN] epoch=194, iter=72060/80000, loss=0.7680, lr=0.001251, batch_cost=1.3426, reader_cost=0.0001 | ETA 02:57:40 2021-02-23 22:30:16 [INFO] [TRAIN] epoch=194, iter=72070/80000, loss=0.8218, lr=0.001249, batch_cost=1.3545, reader_cost=0.0001 | ETA 02:59:01 2021-02-23 22:30:30 [INFO] [TRAIN] epoch=194, iter=72080/80000, loss=0.8288, lr=0.001248, batch_cost=1.3462, reader_cost=0.0001 | ETA 02:57:41 2021-02-23 22:30:43 [INFO] [TRAIN] epoch=194, iter=72090/80000, loss=0.8034, lr=0.001246, batch_cost=1.3510, reader_cost=0.0001 | ETA 02:58:06 2021-02-23 22:30:57 [INFO] [TRAIN] epoch=194, iter=72100/80000, loss=0.8192, lr=0.001245, batch_cost=1.3529, reader_cost=0.0001 | ETA 02:58:07 2021-02-23 22:31:10 [INFO] [TRAIN] epoch=194, iter=72110/80000, loss=0.7890, lr=0.001243, batch_cost=1.3496, reader_cost=0.0001 | ETA 02:57:28 2021-02-23 22:31:24 [INFO] [TRAIN] epoch=194, iter=72120/80000, loss=0.7737, lr=0.001242, batch_cost=1.3748, reader_cost=0.0001 | ETA 03:00:33 2021-02-23 22:31:37 [INFO] [TRAIN] epoch=194, iter=72130/80000, loss=0.7890, lr=0.001241, batch_cost=1.3572, reader_cost=0.0001 | ETA 02:58:01 2021-02-23 22:31:51 [INFO] [TRAIN] epoch=194, iter=72140/80000, loss=0.7610, lr=0.001239, batch_cost=1.3545, reader_cost=0.0001 | ETA 02:57:26 2021-02-23 22:32:04 [INFO] [TRAIN] epoch=194, iter=72150/80000, loss=0.8203, lr=0.001238, batch_cost=1.3427, reader_cost=0.0001 | ETA 02:55:40 2021-02-23 22:32:18 [INFO] [TRAIN] epoch=194, iter=72160/80000, loss=0.8287, lr=0.001236, batch_cost=1.3585, reader_cost=0.0001 | ETA 02:57:30 2021-02-23 22:32:33 [INFO] [TRAIN] epoch=195, iter=72170/80000, loss=0.8025, lr=0.001235, batch_cost=1.4532, reader_cost=0.0597 | ETA 03:09:38 2021-02-23 22:32:46 [INFO] [TRAIN] epoch=195, iter=72180/80000, loss=0.7516, lr=0.001234, batch_cost=1.3418, reader_cost=0.0001 | ETA 02:54:52 2021-02-23 22:32:59 [INFO] [TRAIN] epoch=195, iter=72190/80000, loss=0.7696, lr=0.001232, batch_cost=1.3283, reader_cost=0.0001 | ETA 02:52:54 2021-02-23 22:33:13 [INFO] [TRAIN] epoch=195, iter=72200/80000, loss=0.8349, lr=0.001231, batch_cost=1.3702, reader_cost=0.0001 | ETA 02:58:07 2021-02-23 22:33:26 [INFO] [TRAIN] epoch=195, iter=72210/80000, loss=0.7750, lr=0.001229, batch_cost=1.3533, reader_cost=0.0001 | ETA 02:55:42 2021-02-23 22:33:40 [INFO] [TRAIN] epoch=195, iter=72220/80000, loss=0.8437, lr=0.001228, batch_cost=1.3790, reader_cost=0.0001 | ETA 02:58:48 2021-02-23 22:33:54 [INFO] [TRAIN] epoch=195, iter=72230/80000, loss=0.7879, lr=0.001226, batch_cost=1.3489, reader_cost=0.0001 | ETA 02:54:40 2021-02-23 22:34:08 [INFO] [TRAIN] epoch=195, iter=72240/80000, loss=0.8166, lr=0.001225, batch_cost=1.3854, reader_cost=0.0001 | ETA 02:59:10 2021-02-23 22:34:21 [INFO] [TRAIN] epoch=195, iter=72250/80000, loss=0.7695, lr=0.001224, batch_cost=1.3473, reader_cost=0.0001 | ETA 02:54:01 2021-02-23 22:34:35 [INFO] [TRAIN] epoch=195, iter=72260/80000, loss=0.8063, lr=0.001222, batch_cost=1.3876, reader_cost=0.0001 | ETA 02:59:00 2021-02-23 22:34:49 [INFO] [TRAIN] epoch=195, iter=72270/80000, loss=0.7408, lr=0.001221, batch_cost=1.3570, reader_cost=0.0001 | ETA 02:54:49 2021-02-23 22:35:02 [INFO] [TRAIN] epoch=195, iter=72280/80000, loss=0.7977, lr=0.001219, batch_cost=1.3621, reader_cost=0.0001 | ETA 02:55:15 2021-02-23 22:35:16 [INFO] [TRAIN] epoch=195, iter=72290/80000, loss=0.7973, lr=0.001218, batch_cost=1.3380, reader_cost=0.0001 | ETA 02:51:55 2021-02-23 22:35:30 [INFO] [TRAIN] epoch=195, iter=72300/80000, loss=0.7806, lr=0.001216, batch_cost=1.4161, reader_cost=0.0001 | ETA 03:01:43 2021-02-23 22:35:43 [INFO] [TRAIN] epoch=195, iter=72310/80000, loss=0.8152, lr=0.001215, batch_cost=1.3629, reader_cost=0.0001 | ETA 02:54:40 2021-02-23 22:35:57 [INFO] [TRAIN] epoch=195, iter=72320/80000, loss=0.7953, lr=0.001214, batch_cost=1.3516, reader_cost=0.0001 | ETA 02:53:00 2021-02-23 22:36:10 [INFO] [TRAIN] epoch=195, iter=72330/80000, loss=0.7922, lr=0.001212, batch_cost=1.3389, reader_cost=0.0001 | ETA 02:51:09 2021-02-23 22:36:24 [INFO] [TRAIN] epoch=195, iter=72340/80000, loss=0.7968, lr=0.001211, batch_cost=1.3463, reader_cost=0.0001 | ETA 02:51:52 2021-02-23 22:36:37 [INFO] [TRAIN] epoch=195, iter=72350/80000, loss=0.7982, lr=0.001209, batch_cost=1.3675, reader_cost=0.0001 | ETA 02:54:21 2021-02-23 22:36:51 [INFO] [TRAIN] epoch=195, iter=72360/80000, loss=0.7483, lr=0.001208, batch_cost=1.3533, reader_cost=0.0001 | ETA 02:52:19 2021-02-23 22:37:04 [INFO] [TRAIN] epoch=195, iter=72370/80000, loss=0.7393, lr=0.001207, batch_cost=1.3461, reader_cost=0.0001 | ETA 02:51:11 2021-02-23 22:37:19 [INFO] [TRAIN] epoch=195, iter=72380/80000, loss=0.8183, lr=0.001205, batch_cost=1.4168, reader_cost=0.0001 | ETA 02:59:56 2021-02-23 22:37:32 [INFO] [TRAIN] epoch=195, iter=72390/80000, loss=0.7960, lr=0.001204, batch_cost=1.3375, reader_cost=0.0001 | ETA 02:49:38 2021-02-23 22:37:46 [INFO] [TRAIN] epoch=195, iter=72400/80000, loss=0.8100, lr=0.001202, batch_cost=1.3746, reader_cost=0.0001 | ETA 02:54:06 2021-02-23 22:37:59 [INFO] [TRAIN] epoch=195, iter=72410/80000, loss=0.8290, lr=0.001201, batch_cost=1.3504, reader_cost=0.0001 | ETA 02:50:49 2021-02-23 22:38:13 [INFO] [TRAIN] epoch=195, iter=72420/80000, loss=0.7894, lr=0.001199, batch_cost=1.3544, reader_cost=0.0001 | ETA 02:51:06 2021-02-23 22:38:26 [INFO] [TRAIN] epoch=195, iter=72430/80000, loss=0.8491, lr=0.001198, batch_cost=1.3442, reader_cost=0.0001 | ETA 02:49:35 2021-02-23 22:38:40 [INFO] [TRAIN] epoch=195, iter=72440/80000, loss=0.7673, lr=0.001197, batch_cost=1.3805, reader_cost=0.0001 | ETA 02:53:56 2021-02-23 22:38:53 [INFO] [TRAIN] epoch=195, iter=72450/80000, loss=0.7740, lr=0.001195, batch_cost=1.3531, reader_cost=0.0001 | ETA 02:50:16 2021-02-23 22:39:07 [INFO] [TRAIN] epoch=195, iter=72460/80000, loss=0.8058, lr=0.001194, batch_cost=1.3667, reader_cost=0.0001 | ETA 02:51:44 2021-02-23 22:39:21 [INFO] [TRAIN] epoch=195, iter=72470/80000, loss=0.8058, lr=0.001192, batch_cost=1.3859, reader_cost=0.0001 | ETA 02:53:55 2021-02-23 22:39:34 [INFO] [TRAIN] epoch=195, iter=72480/80000, loss=0.7745, lr=0.001191, batch_cost=1.3345, reader_cost=0.0001 | ETA 02:47:15 2021-02-23 22:39:48 [INFO] [TRAIN] epoch=195, iter=72490/80000, loss=0.8199, lr=0.001189, batch_cost=1.3312, reader_cost=0.0001 | ETA 02:46:37 2021-02-23 22:40:01 [INFO] [TRAIN] epoch=195, iter=72500/80000, loss=0.8672, lr=0.001188, batch_cost=1.3576, reader_cost=0.0001 | ETA 02:49:41 2021-02-23 22:40:15 [INFO] [TRAIN] epoch=195, iter=72510/80000, loss=0.8143, lr=0.001187, batch_cost=1.3609, reader_cost=0.0001 | ETA 02:49:53 2021-02-23 22:40:28 [INFO] [TRAIN] epoch=195, iter=72520/80000, loss=0.7738, lr=0.001185, batch_cost=1.3510, reader_cost=0.0001 | ETA 02:48:25 2021-02-23 22:40:42 [INFO] [TRAIN] epoch=195, iter=72530/80000, loss=0.8123, lr=0.001184, batch_cost=1.3696, reader_cost=0.0001 | ETA 02:50:30 2021-02-23 22:40:55 [INFO] [TRAIN] epoch=195, iter=72540/80000, loss=0.7774, lr=0.001182, batch_cost=1.3146, reader_cost=0.0001 | ETA 02:43:26 2021-02-23 22:41:10 [INFO] [TRAIN] epoch=196, iter=72550/80000, loss=0.7676, lr=0.001181, batch_cost=1.4838, reader_cost=0.0708 | ETA 03:04:14 2021-02-23 22:41:24 [INFO] [TRAIN] epoch=196, iter=72560/80000, loss=0.8705, lr=0.001179, batch_cost=1.3615, reader_cost=0.0001 | ETA 02:48:49 2021-02-23 22:41:37 [INFO] [TRAIN] epoch=196, iter=72570/80000, loss=0.8102, lr=0.001178, batch_cost=1.3480, reader_cost=0.0001 | ETA 02:46:55 2021-02-23 22:41:51 [INFO] [TRAIN] epoch=196, iter=72580/80000, loss=0.7912, lr=0.001177, batch_cost=1.3616, reader_cost=0.0001 | ETA 02:48:22 2021-02-23 22:42:04 [INFO] [TRAIN] epoch=196, iter=72590/80000, loss=0.8084, lr=0.001175, batch_cost=1.3685, reader_cost=0.0001 | ETA 02:49:00 2021-02-23 22:42:18 [INFO] [TRAIN] epoch=196, iter=72600/80000, loss=0.7791, lr=0.001174, batch_cost=1.3524, reader_cost=0.0001 | ETA 02:46:47 2021-02-23 22:42:32 [INFO] [TRAIN] epoch=196, iter=72610/80000, loss=0.7900, lr=0.001172, batch_cost=1.4216, reader_cost=0.0001 | ETA 02:55:05 2021-02-23 22:42:46 [INFO] [TRAIN] epoch=196, iter=72620/80000, loss=0.8410, lr=0.001171, batch_cost=1.3750, reader_cost=0.0001 | ETA 02:49:07 2021-02-23 22:43:00 [INFO] [TRAIN] epoch=196, iter=72630/80000, loss=0.8200, lr=0.001169, batch_cost=1.3596, reader_cost=0.0001 | ETA 02:46:59 2021-02-23 22:43:13 [INFO] [TRAIN] epoch=196, iter=72640/80000, loss=0.8070, lr=0.001168, batch_cost=1.3407, reader_cost=0.0001 | ETA 02:44:27 2021-02-23 22:43:26 [INFO] [TRAIN] epoch=196, iter=72650/80000, loss=0.7801, lr=0.001167, batch_cost=1.3527, reader_cost=0.0001 | ETA 02:45:42 2021-02-23 22:43:40 [INFO] [TRAIN] epoch=196, iter=72660/80000, loss=0.8051, lr=0.001165, batch_cost=1.3637, reader_cost=0.0001 | ETA 02:46:49 2021-02-23 22:43:54 [INFO] [TRAIN] epoch=196, iter=72670/80000, loss=0.7660, lr=0.001164, batch_cost=1.3517, reader_cost=0.0001 | ETA 02:45:08 2021-02-23 22:44:07 [INFO] [TRAIN] epoch=196, iter=72680/80000, loss=0.8406, lr=0.001162, batch_cost=1.3278, reader_cost=0.0001 | ETA 02:41:59 2021-02-23 22:44:21 [INFO] [TRAIN] epoch=196, iter=72690/80000, loss=0.7789, lr=0.001161, batch_cost=1.3638, reader_cost=0.0001 | ETA 02:46:09 2021-02-23 22:44:34 [INFO] [TRAIN] epoch=196, iter=72700/80000, loss=0.8301, lr=0.001159, batch_cost=1.3480, reader_cost=0.0001 | ETA 02:44:00 2021-02-23 22:44:48 [INFO] [TRAIN] epoch=196, iter=72710/80000, loss=0.7926, lr=0.001158, batch_cost=1.3690, reader_cost=0.0001 | ETA 02:46:19 2021-02-23 22:45:01 [INFO] [TRAIN] epoch=196, iter=72720/80000, loss=0.8294, lr=0.001157, batch_cost=1.3497, reader_cost=0.0001 | ETA 02:43:46 2021-02-23 22:45:15 [INFO] [TRAIN] epoch=196, iter=72730/80000, loss=0.8124, lr=0.001155, batch_cost=1.3766, reader_cost=0.0001 | ETA 02:46:47 2021-02-23 22:45:29 [INFO] [TRAIN] epoch=196, iter=72740/80000, loss=0.8709, lr=0.001154, batch_cost=1.3893, reader_cost=0.0001 | ETA 02:48:06 2021-02-23 22:45:42 [INFO] [TRAIN] epoch=196, iter=72750/80000, loss=0.8468, lr=0.001152, batch_cost=1.3304, reader_cost=0.0001 | ETA 02:40:45 2021-02-23 22:45:56 [INFO] [TRAIN] epoch=196, iter=72760/80000, loss=0.7729, lr=0.001151, batch_cost=1.3505, reader_cost=0.0001 | ETA 02:42:57 2021-02-23 22:46:09 [INFO] [TRAIN] epoch=196, iter=72770/80000, loss=0.7707, lr=0.001149, batch_cost=1.3737, reader_cost=0.0001 | ETA 02:45:31 2021-02-23 22:46:23 [INFO] [TRAIN] epoch=196, iter=72780/80000, loss=0.8270, lr=0.001148, batch_cost=1.3830, reader_cost=0.0001 | ETA 02:46:25 2021-02-23 22:46:37 [INFO] [TRAIN] epoch=196, iter=72790/80000, loss=0.8360, lr=0.001147, batch_cost=1.3306, reader_cost=0.0001 | ETA 02:39:53 2021-02-23 22:46:50 [INFO] [TRAIN] epoch=196, iter=72800/80000, loss=0.7581, lr=0.001145, batch_cost=1.3644, reader_cost=0.0001 | ETA 02:43:43 2021-02-23 22:47:04 [INFO] [TRAIN] epoch=196, iter=72810/80000, loss=0.7328, lr=0.001144, batch_cost=1.3536, reader_cost=0.0001 | ETA 02:42:12 2021-02-23 22:47:18 [INFO] [TRAIN] epoch=196, iter=72820/80000, loss=0.8270, lr=0.001142, batch_cost=1.3783, reader_cost=0.0001 | ETA 02:44:56 2021-02-23 22:47:31 [INFO] [TRAIN] epoch=196, iter=72830/80000, loss=0.8359, lr=0.001141, batch_cost=1.3351, reader_cost=0.0001 | ETA 02:39:32 2021-02-23 22:47:44 [INFO] [TRAIN] epoch=196, iter=72840/80000, loss=0.8116, lr=0.001139, batch_cost=1.3321, reader_cost=0.0001 | ETA 02:38:58 2021-02-23 22:47:58 [INFO] [TRAIN] epoch=196, iter=72850/80000, loss=0.7959, lr=0.001138, batch_cost=1.3338, reader_cost=0.0001 | ETA 02:38:56 2021-02-23 22:48:11 [INFO] [TRAIN] epoch=196, iter=72860/80000, loss=0.7788, lr=0.001137, batch_cost=1.3659, reader_cost=0.0001 | ETA 02:42:32 2021-02-23 22:48:25 [INFO] [TRAIN] epoch=196, iter=72870/80000, loss=0.8539, lr=0.001135, batch_cost=1.3815, reader_cost=0.0001 | ETA 02:44:10 2021-02-23 22:48:39 [INFO] [TRAIN] epoch=196, iter=72880/80000, loss=0.8077, lr=0.001134, batch_cost=1.3901, reader_cost=0.0001 | ETA 02:44:57 2021-02-23 22:48:52 [INFO] [TRAIN] epoch=196, iter=72890/80000, loss=0.8454, lr=0.001132, batch_cost=1.3510, reader_cost=0.0001 | ETA 02:40:05 2021-02-23 22:49:06 [INFO] [TRAIN] epoch=196, iter=72900/80000, loss=0.7783, lr=0.001131, batch_cost=1.3752, reader_cost=0.0001 | ETA 02:42:43 2021-02-23 22:49:19 [INFO] [TRAIN] epoch=196, iter=72910/80000, loss=0.8212, lr=0.001129, batch_cost=1.3061, reader_cost=0.0001 | ETA 02:34:20 2021-02-23 22:49:34 [INFO] [TRAIN] epoch=197, iter=72920/80000, loss=0.8042, lr=0.001128, batch_cost=1.4681, reader_cost=0.1016 | ETA 02:53:14 2021-02-23 22:49:48 [INFO] [TRAIN] epoch=197, iter=72930/80000, loss=0.7928, lr=0.001127, batch_cost=1.3735, reader_cost=0.0001 | ETA 02:41:50 2021-02-23 22:50:01 [INFO] [TRAIN] epoch=197, iter=72940/80000, loss=0.7870, lr=0.001125, batch_cost=1.3371, reader_cost=0.0001 | ETA 02:37:20 2021-02-23 22:50:14 [INFO] [TRAIN] epoch=197, iter=72950/80000, loss=0.8184, lr=0.001124, batch_cost=1.3336, reader_cost=0.0001 | ETA 02:36:41 2021-02-23 22:50:28 [INFO] [TRAIN] epoch=197, iter=72960/80000, loss=0.8174, lr=0.001122, batch_cost=1.3423, reader_cost=0.0001 | ETA 02:37:30 2021-02-23 22:50:41 [INFO] [TRAIN] epoch=197, iter=72970/80000, loss=0.8249, lr=0.001121, batch_cost=1.3572, reader_cost=0.0001 | ETA 02:39:00 2021-02-23 22:50:55 [INFO] [TRAIN] epoch=197, iter=72980/80000, loss=0.8579, lr=0.001119, batch_cost=1.3686, reader_cost=0.0001 | ETA 02:40:07 2021-02-23 22:51:09 [INFO] [TRAIN] epoch=197, iter=72990/80000, loss=0.7593, lr=0.001118, batch_cost=1.3611, reader_cost=0.0001 | ETA 02:39:01 2021-02-23 22:51:22 [INFO] [TRAIN] epoch=197, iter=73000/80000, loss=0.8164, lr=0.001117, batch_cost=1.3504, reader_cost=0.0001 | ETA 02:37:32 2021-02-23 22:51:22 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:15 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:05 - batch_cost: 0.2253 - reader cost: 0.0952  3/125 [..............................] - ETA: 1:02 - batch_cost: 0.3071 - reader cost: 0.1350 4/125 [..............................] - ETA: 1:00 - batch_cost: 0.3483 - reader cost: 0.1554 5/125 [>.............................] - ETA: 57s - batch_cost: 0.3594 - reader cost: 0.1541  6/125 [>.............................] - ETA: 55s - batch_cost: 0.3687 - reader cost: 0.1547 7/125 [>.............................] - ETA: 54s - batch_cost: 0.3762 - reader cost: 0.1573 8/125 [>.............................] - ETA: 53s - batch_cost: 0.3851 - reader cost: 0.1617 9/125 [=>............................] - ETA: 52s - batch_cost: 0.3862 - reader cost: 0.1598 10/125 [=>............................] - ETA: 52s - batch_cost: 0.3951 - reader cost: 0.1660 11/125 [=>............................] - ETA: 51s - batch_cost: 0.3987 - reader cost: 0.1675 12/125 [=>............................] - ETA: 50s - batch_cost: 0.3970 - reader cost: 0.1645 13/125 [==>...........................] - ETA: 49s - batch_cost: 0.3968 - reader cost: 0.1621 14/125 [==>...........................] - ETA: 49s - batch_cost: 0.3999 - reader cost: 0.1632 15/125 [==>...........................] - ETA: 48s - batch_cost: 0.4031 - reader cost: 0.1642 16/125 [==>...........................] - ETA: 48s - batch_cost: 0.4059 - reader cost: 0.1656 17/125 [===>..........................] - ETA: 48s - batch_cost: 0.4091 - reader cost: 0.1680 18/125 [===>..........................] - ETA: 47s - batch_cost: 0.4083 - reader cost: 0.1665 19/125 [===>..........................] - ETA: 46s - batch_cost: 0.4102 - reader cost: 0.1679 20/125 [===>..........................] - ETA: 46s - batch_cost: 0.4092 - reader cost: 0.1666 21/125 [====>.........................] - ETA: 45s - batch_cost: 0.4091 - reader cost: 0.1660 22/125 [====>.........................] - ETA: 45s - batch_cost: 0.4100 - reader cost: 0.1663 23/125 [====>.........................] - ETA: 44s - batch_cost: 0.4111 - reader cost: 0.1669 24/125 [====>.........................] - ETA: 44s - batch_cost: 0.4103 - reader cost: 0.1659 25/125 [=====>........................] - ETA: 43s - batch_cost: 0.4118 - reader cost: 0.1669 26/125 [=====>........................] - ETA: 43s - batch_cost: 0.4127 - reader cost: 0.1676 27/125 [=====>........................] - ETA: 42s - batch_cost: 0.4131 - reader cost: 0.1679 28/125 [=====>........................] - ETA: 42s - batch_cost: 0.4141 - reader cost: 0.1684 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4126 - reader cost: 0.1669 30/125 [======>.......................] - ETA: 41s - batch_cost: 0.4130 - reader cost: 0.1672 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4114 - reader cost: 0.1654 32/125 [======>.......................] - ETA: 40s - batch_cost: 0.4116 - reader cost: 0.1656 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4104 - reader cost: 0.1642 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4091 - reader cost: 0.1629 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4094 - reader cost: 0.1631 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4100 - reader cost: 0.1637 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4108 - reader cost: 0.1641 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4097 - reader cost: 0.1628 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4103 - reader cost: 0.1635 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4113 - reader cost: 0.1643 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4119 - reader cost: 0.1648 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4125 - reader cost: 0.1654 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4121 - reader cost: 0.1649 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4125 - reader cost: 0.1653 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4127 - reader cost: 0.1655 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4125 - reader cost: 0.1653 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4119 - reader cost: 0.1648 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4125 - reader cost: 0.1651 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4111 - reader cost: 0.1637 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4121 - reader cost: 0.1646 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4125 - reader cost: 0.1651 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4119 - reader cost: 0.1643 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4112 - reader cost: 0.1636 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4116 - reader cost: 0.1640 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4121 - reader cost: 0.1643 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4123 - reader cost: 0.1646 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4126 - reader cost: 0.1647 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4129 - reader cost: 0.1650 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4123 - reader cost: 0.1645 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4127 - reader cost: 0.1647 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4119 - reader cost: 0.1639 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4127 - reader cost: 0.1645 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4129 - reader cost: 0.1647 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4135 - reader cost: 0.1652 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4137 - reader cost: 0.1654 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4139 - reader cost: 0.1655 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4141 - reader cost: 0.1657 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4143 - reader cost: 0.1657 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4145 - reader cost: 0.1660 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4146 - reader cost: 0.1660 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4143 - reader cost: 0.1657 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4144 - reader cost: 0.1658 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4147 - reader cost: 0.1660 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4149 - reader cost: 0.1662 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4150 - reader cost: 0.1662 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4154 - reader cost: 0.1665 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4155 - reader cost: 0.1666 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4158 - reader cost: 0.1668 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4159 - reader cost: 0.1668 80/125 [==================>...........] - ETA: 19s - batch_cost: 0.4156 - reader cost: 0.1665 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4158 - reader cost: 0.1667 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4160 - reader cost: 0.1668 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4160 - reader cost: 0.1668 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4162 - reader cost: 0.1670 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4165 - reader cost: 0.1671 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4166 - reader cost: 0.1672 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4169 - reader cost: 0.1674 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4167 - reader cost: 0.1671 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4169 - reader cost: 0.1672 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4174 - reader cost: 0.1677 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4171 - reader cost: 0.1673 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4173 - reader cost: 0.1676 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4172 - reader cost: 0.1675 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4171 - reader cost: 0.1673 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4176 - reader cost: 0.1677 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4181 - reader cost: 0.1681 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4186 - reader cost: 0.1685 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4188 - reader cost: 0.1687 99/125 [======================>.......] - ETA: 11s - batch_cost: 0.4190 - reader cost: 0.1689 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4187 - reader cost: 0.1686 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4189 - reader cost: 0.1688 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4185 - reader cost: 0.1683  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4188 - reader cost: 0.1687 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4191 - reader cost: 0.1689 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4189 - reader cost: 0.1688 106/125 [========================>.....] - ETA: 8s - batch_cost: 0.4187 - reader cost: 0.1686 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4191 - reader cost: 0.1689 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4196 - reader cost: 0.1694 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4197 - reader cost: 0.1695 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4201 - reader cost: 0.1698 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4202 - reader cost: 0.1698 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4205 - reader cost: 0.1702 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4207 - reader cost: 0.1703 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4207 - reader cost: 0.1703 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4204 - reader cost: 0.1700 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4205 - reader cost: 0.1701 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4203 - reader cost: 0.1699 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4204 - reader cost: 0.1700 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4203 - reader cost: 0.1698 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4203 - reader cost: 0.1698 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4203 - reader cost: 0.1698 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4204 - reader cost: 0.1699 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4200 - reader cost: 0.1695 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4197 - reader cost: 0.1692 125/125 [==============================] - 53s 425ms/step - batch_cost: 0.4198 - reader cost: 0.1693 2021-02-23 22:52:15 [INFO] [EVAL] #Images=500 mIoU=0.8021 Acc=0.9644 Kappa=0.9538 2021-02-23 22:52:15 [INFO] [EVAL] Class IoU: [0.9819 0.8552 0.9334 0.5895 0.6282 0.6944 0.7608 0.8286 0.9299 0.6504 0.9478 0.8471 0.6653 0.9575 0.7515 0.8825 0.822 0.7108 0.8035] 2021-02-23 22:52:15 [INFO] [EVAL] Class Acc: [0.9896 0.926 0.9605 0.8745 0.8368 0.8449 0.8583 0.9133 0.9589 0.8411 0.9636 0.9112 0.8254 0.9772 0.9583 0.929 0.9814 0.8318 0.8715] 2021-02-23 22:52:23 [INFO] [EVAL] The model with the best validation mIoU (0.8021) was saved at iter 73000. 2021-02-23 22:52:37 [INFO] [TRAIN] epoch=197, iter=73010/80000, loss=0.8271, lr=0.001115, batch_cost=1.3840, reader_cost=0.0001 | ETA 02:41:14 2021-02-23 22:52:51 [INFO] [TRAIN] epoch=197, iter=73020/80000, loss=0.8236, lr=0.001114, batch_cost=1.3690, reader_cost=0.0001 | ETA 02:39:15 2021-02-23 22:53:04 [INFO] [TRAIN] epoch=197, iter=73030/80000, loss=0.7544, lr=0.001112, batch_cost=1.3459, reader_cost=0.0001 | ETA 02:36:21 2021-02-23 22:53:17 [INFO] [TRAIN] epoch=197, iter=73040/80000, loss=0.8133, lr=0.001111, batch_cost=1.3418, reader_cost=0.0001 | ETA 02:35:39 2021-02-23 22:53:31 [INFO] [TRAIN] epoch=197, iter=73050/80000, loss=0.8181, lr=0.001109, batch_cost=1.3635, reader_cost=0.0001 | ETA 02:37:56 2021-02-23 22:53:45 [INFO] [TRAIN] epoch=197, iter=73060/80000, loss=0.8401, lr=0.001108, batch_cost=1.3562, reader_cost=0.0001 | ETA 02:36:51 2021-02-23 22:53:59 [INFO] [TRAIN] epoch=197, iter=73070/80000, loss=0.8116, lr=0.001106, batch_cost=1.3954, reader_cost=0.0001 | ETA 02:41:10 2021-02-23 22:54:12 [INFO] [TRAIN] epoch=197, iter=73080/80000, loss=0.7824, lr=0.001105, batch_cost=1.3750, reader_cost=0.0001 | ETA 02:38:35 2021-02-23 22:54:26 [INFO] [TRAIN] epoch=197, iter=73090/80000, loss=0.7934, lr=0.001104, batch_cost=1.3573, reader_cost=0.0001 | ETA 02:36:19 2021-02-23 22:54:39 [INFO] [TRAIN] epoch=197, iter=73100/80000, loss=0.8542, lr=0.001102, batch_cost=1.3514, reader_cost=0.0001 | ETA 02:35:24 2021-02-23 22:54:53 [INFO] [TRAIN] epoch=197, iter=73110/80000, loss=0.8088, lr=0.001101, batch_cost=1.3617, reader_cost=0.0001 | ETA 02:36:22 2021-02-23 22:55:06 [INFO] [TRAIN] epoch=197, iter=73120/80000, loss=0.7899, lr=0.001099, batch_cost=1.3426, reader_cost=0.0001 | ETA 02:33:57 2021-02-23 22:55:20 [INFO] [TRAIN] epoch=197, iter=73130/80000, loss=0.7886, lr=0.001098, batch_cost=1.3356, reader_cost=0.0001 | ETA 02:32:55 2021-02-23 22:55:33 [INFO] [TRAIN] epoch=197, iter=73140/80000, loss=0.7914, lr=0.001096, batch_cost=1.3216, reader_cost=0.0001 | ETA 02:31:06 2021-02-23 22:55:47 [INFO] [TRAIN] epoch=197, iter=73150/80000, loss=0.7832, lr=0.001095, batch_cost=1.3620, reader_cost=0.0001 | ETA 02:35:29 2021-02-23 22:56:00 [INFO] [TRAIN] epoch=197, iter=73160/80000, loss=0.7691, lr=0.001094, batch_cost=1.3600, reader_cost=0.0001 | ETA 02:35:02 2021-02-23 22:56:14 [INFO] [TRAIN] epoch=197, iter=73170/80000, loss=0.8090, lr=0.001092, batch_cost=1.3567, reader_cost=0.0001 | ETA 02:34:26 2021-02-23 22:56:27 [INFO] [TRAIN] epoch=197, iter=73180/80000, loss=0.7957, lr=0.001091, batch_cost=1.3605, reader_cost=0.0001 | ETA 02:34:38 2021-02-23 22:56:41 [INFO] [TRAIN] epoch=197, iter=73190/80000, loss=0.8361, lr=0.001089, batch_cost=1.3424, reader_cost=0.0001 | ETA 02:32:21 2021-02-23 22:56:54 [INFO] [TRAIN] epoch=197, iter=73200/80000, loss=0.8402, lr=0.001088, batch_cost=1.3617, reader_cost=0.0001 | ETA 02:34:19 2021-02-23 22:57:08 [INFO] [TRAIN] epoch=197, iter=73210/80000, loss=0.7671, lr=0.001086, batch_cost=1.3453, reader_cost=0.0001 | ETA 02:32:14 2021-02-23 22:57:21 [INFO] [TRAIN] epoch=197, iter=73220/80000, loss=0.7971, lr=0.001085, batch_cost=1.3505, reader_cost=0.0001 | ETA 02:32:36 2021-02-23 22:57:35 [INFO] [TRAIN] epoch=197, iter=73230/80000, loss=0.8006, lr=0.001083, batch_cost=1.3652, reader_cost=0.0001 | ETA 02:34:02 2021-02-23 22:57:48 [INFO] [TRAIN] epoch=197, iter=73240/80000, loss=0.7769, lr=0.001082, batch_cost=1.3137, reader_cost=0.0001 | ETA 02:28:00 2021-02-23 22:58:02 [INFO] [TRAIN] epoch=197, iter=73250/80000, loss=0.7860, lr=0.001081, batch_cost=1.3345, reader_cost=0.0001 | ETA 02:30:07 2021-02-23 22:58:15 [INFO] [TRAIN] epoch=197, iter=73260/80000, loss=0.8246, lr=0.001079, batch_cost=1.3344, reader_cost=0.0001 | ETA 02:29:53 2021-02-23 22:58:28 [INFO] [TRAIN] epoch=197, iter=73270/80000, loss=0.7722, lr=0.001078, batch_cost=1.3474, reader_cost=0.0001 | ETA 02:31:08 2021-02-23 22:58:42 [INFO] [TRAIN] epoch=197, iter=73280/80000, loss=0.8596, lr=0.001076, batch_cost=1.3398, reader_cost=0.0001 | ETA 02:30:03 2021-02-23 22:58:56 [INFO] [TRAIN] epoch=198, iter=73290/80000, loss=0.7732, lr=0.001075, batch_cost=1.4135, reader_cost=0.0607 | ETA 02:38:04 2021-02-23 22:59:10 [INFO] [TRAIN] epoch=198, iter=73300/80000, loss=0.7626, lr=0.001073, batch_cost=1.3761, reader_cost=0.0001 | ETA 02:33:40 2021-02-23 22:59:23 [INFO] [TRAIN] epoch=198, iter=73310/80000, loss=0.8271, lr=0.001072, batch_cost=1.3404, reader_cost=0.0001 | ETA 02:29:27 2021-02-23 22:59:37 [INFO] [TRAIN] epoch=198, iter=73320/80000, loss=0.7912, lr=0.001070, batch_cost=1.3529, reader_cost=0.0001 | ETA 02:30:37 2021-02-23 22:59:50 [INFO] [TRAIN] epoch=198, iter=73330/80000, loss=0.8059, lr=0.001069, batch_cost=1.3527, reader_cost=0.0001 | ETA 02:30:22 2021-02-23 23:00:04 [INFO] [TRAIN] epoch=198, iter=73340/80000, loss=0.7703, lr=0.001068, batch_cost=1.3842, reader_cost=0.0001 | ETA 02:33:39 2021-02-23 23:00:18 [INFO] [TRAIN] epoch=198, iter=73350/80000, loss=0.7590, lr=0.001066, batch_cost=1.3757, reader_cost=0.0001 | ETA 02:32:28 2021-02-23 23:00:31 [INFO] [TRAIN] epoch=198, iter=73360/80000, loss=0.7898, lr=0.001065, batch_cost=1.3313, reader_cost=0.0001 | ETA 02:27:19 2021-02-23 23:00:44 [INFO] [TRAIN] epoch=198, iter=73370/80000, loss=0.8224, lr=0.001063, batch_cost=1.3364, reader_cost=0.0001 | ETA 02:27:40 2021-02-23 23:00:58 [INFO] [TRAIN] epoch=198, iter=73380/80000, loss=0.7593, lr=0.001062, batch_cost=1.3566, reader_cost=0.0001 | ETA 02:29:40 2021-02-23 23:01:11 [INFO] [TRAIN] epoch=198, iter=73390/80000, loss=0.7989, lr=0.001060, batch_cost=1.3339, reader_cost=0.0001 | ETA 02:26:57 2021-02-23 23:01:25 [INFO] [TRAIN] epoch=198, iter=73400/80000, loss=0.8004, lr=0.001059, batch_cost=1.3554, reader_cost=0.0001 | ETA 02:29:05 2021-02-23 23:01:38 [INFO] [TRAIN] epoch=198, iter=73410/80000, loss=0.8530, lr=0.001057, batch_cost=1.3336, reader_cost=0.0001 | ETA 02:26:28 2021-02-23 23:01:52 [INFO] [TRAIN] epoch=198, iter=73420/80000, loss=0.7824, lr=0.001056, batch_cost=1.3735, reader_cost=0.0001 | ETA 02:30:37 2021-02-23 23:02:05 [INFO] [TRAIN] epoch=198, iter=73430/80000, loss=0.7787, lr=0.001055, batch_cost=1.3487, reader_cost=0.0001 | ETA 02:27:41 2021-02-23 23:02:19 [INFO] [TRAIN] epoch=198, iter=73440/80000, loss=0.8506, lr=0.001053, batch_cost=1.3531, reader_cost=0.0001 | ETA 02:27:56 2021-02-23 23:02:32 [INFO] [TRAIN] epoch=198, iter=73450/80000, loss=0.8482, lr=0.001052, batch_cost=1.3473, reader_cost=0.0001 | ETA 02:27:04 2021-02-23 23:02:46 [INFO] [TRAIN] epoch=198, iter=73460/80000, loss=0.7994, lr=0.001050, batch_cost=1.3589, reader_cost=0.0001 | ETA 02:28:06 2021-02-23 23:03:00 [INFO] [TRAIN] epoch=198, iter=73470/80000, loss=0.8111, lr=0.001049, batch_cost=1.3695, reader_cost=0.0001 | ETA 02:29:02 2021-02-23 23:03:13 [INFO] [TRAIN] epoch=198, iter=73480/80000, loss=0.8046, lr=0.001047, batch_cost=1.3316, reader_cost=0.0001 | ETA 02:24:41 2021-02-23 23:03:26 [INFO] [TRAIN] epoch=198, iter=73490/80000, loss=0.8053, lr=0.001046, batch_cost=1.3426, reader_cost=0.0001 | ETA 02:25:40 2021-02-23 23:03:40 [INFO] [TRAIN] epoch=198, iter=73500/80000, loss=0.7535, lr=0.001044, batch_cost=1.3556, reader_cost=0.0001 | ETA 02:26:51 2021-02-23 23:03:54 [INFO] [TRAIN] epoch=198, iter=73510/80000, loss=0.7760, lr=0.001043, batch_cost=1.3749, reader_cost=0.0001 | ETA 02:28:43 2021-02-23 23:04:07 [INFO] [TRAIN] epoch=198, iter=73520/80000, loss=0.8312, lr=0.001042, batch_cost=1.3532, reader_cost=0.0001 | ETA 02:26:08 2021-02-23 23:04:21 [INFO] [TRAIN] epoch=198, iter=73530/80000, loss=0.7802, lr=0.001040, batch_cost=1.3287, reader_cost=0.0001 | ETA 02:23:16 2021-02-23 23:04:34 [INFO] [TRAIN] epoch=198, iter=73540/80000, loss=0.8409, lr=0.001039, batch_cost=1.3789, reader_cost=0.0001 | ETA 02:28:27 2021-02-23 23:04:48 [INFO] [TRAIN] epoch=198, iter=73550/80000, loss=0.8151, lr=0.001037, batch_cost=1.3638, reader_cost=0.0001 | ETA 02:26:36 2021-02-23 23:05:01 [INFO] [TRAIN] epoch=198, iter=73560/80000, loss=0.8346, lr=0.001036, batch_cost=1.3200, reader_cost=0.0001 | ETA 02:21:41 2021-02-23 23:05:15 [INFO] [TRAIN] epoch=198, iter=73570/80000, loss=0.7655, lr=0.001034, batch_cost=1.3510, reader_cost=0.0001 | ETA 02:24:47 2021-02-23 23:05:28 [INFO] [TRAIN] epoch=198, iter=73580/80000, loss=0.7989, lr=0.001033, batch_cost=1.3580, reader_cost=0.0001 | ETA 02:25:18 2021-02-23 23:05:42 [INFO] [TRAIN] epoch=198, iter=73590/80000, loss=0.8022, lr=0.001031, batch_cost=1.3485, reader_cost=0.0001 | ETA 02:24:03 2021-02-23 23:05:56 [INFO] [TRAIN] epoch=198, iter=73600/80000, loss=0.8156, lr=0.001030, batch_cost=1.4130, reader_cost=0.0001 | ETA 02:30:43 2021-02-23 23:06:09 [INFO] [TRAIN] epoch=198, iter=73610/80000, loss=0.7881, lr=0.001029, batch_cost=1.3284, reader_cost=0.0001 | ETA 02:21:28 2021-02-23 23:06:23 [INFO] [TRAIN] epoch=198, iter=73620/80000, loss=0.7346, lr=0.001027, batch_cost=1.3525, reader_cost=0.0001 | ETA 02:23:49 2021-02-23 23:06:36 [INFO] [TRAIN] epoch=198, iter=73630/80000, loss=0.8120, lr=0.001026, batch_cost=1.3313, reader_cost=0.0001 | ETA 02:21:20 2021-02-23 23:06:50 [INFO] [TRAIN] epoch=198, iter=73640/80000, loss=0.7685, lr=0.001024, batch_cost=1.3824, reader_cost=0.0001 | ETA 02:26:32 2021-02-23 23:07:04 [INFO] [TRAIN] epoch=198, iter=73650/80000, loss=0.7793, lr=0.001023, batch_cost=1.3886, reader_cost=0.0001 | ETA 02:26:57 2021-02-23 23:07:18 [INFO] [TRAIN] epoch=199, iter=73660/80000, loss=0.8191, lr=0.001021, batch_cost=1.4339, reader_cost=0.0682 | ETA 02:31:30 2021-02-23 23:07:32 [INFO] [TRAIN] epoch=199, iter=73670/80000, loss=0.7978, lr=0.001020, batch_cost=1.3455, reader_cost=0.0001 | ETA 02:21:56 2021-02-23 23:07:45 [INFO] [TRAIN] epoch=199, iter=73680/80000, loss=0.8218, lr=0.001018, batch_cost=1.3453, reader_cost=0.0001 | ETA 02:21:42 2021-02-23 23:07:59 [INFO] [TRAIN] epoch=199, iter=73690/80000, loss=0.8080, lr=0.001017, batch_cost=1.3534, reader_cost=0.0001 | ETA 02:22:20 2021-02-23 23:08:12 [INFO] [TRAIN] epoch=199, iter=73700/80000, loss=0.8122, lr=0.001016, batch_cost=1.3440, reader_cost=0.0001 | ETA 02:21:07 2021-02-23 23:08:26 [INFO] [TRAIN] epoch=199, iter=73710/80000, loss=0.8207, lr=0.001014, batch_cost=1.3655, reader_cost=0.0001 | ETA 02:23:08 2021-02-23 23:08:39 [INFO] [TRAIN] epoch=199, iter=73720/80000, loss=0.8136, lr=0.001013, batch_cost=1.3462, reader_cost=0.0001 | ETA 02:20:53 2021-02-23 23:08:53 [INFO] [TRAIN] epoch=199, iter=73730/80000, loss=0.7785, lr=0.001011, batch_cost=1.3648, reader_cost=0.0001 | ETA 02:22:37 2021-02-23 23:09:06 [INFO] [TRAIN] epoch=199, iter=73740/80000, loss=0.8693, lr=0.001010, batch_cost=1.3539, reader_cost=0.0001 | ETA 02:21:15 2021-02-23 23:09:20 [INFO] [TRAIN] epoch=199, iter=73750/80000, loss=0.7718, lr=0.001008, batch_cost=1.3463, reader_cost=0.0001 | ETA 02:20:14 2021-02-23 23:09:33 [INFO] [TRAIN] epoch=199, iter=73760/80000, loss=0.8226, lr=0.001007, batch_cost=1.3531, reader_cost=0.0001 | ETA 02:20:43 2021-02-23 23:09:47 [INFO] [TRAIN] epoch=199, iter=73770/80000, loss=0.7993, lr=0.001005, batch_cost=1.3306, reader_cost=0.0001 | ETA 02:18:09 2021-02-23 23:10:00 [INFO] [TRAIN] epoch=199, iter=73780/80000, loss=0.7437, lr=0.001004, batch_cost=1.3274, reader_cost=0.0001 | ETA 02:17:36 2021-02-23 23:10:14 [INFO] [TRAIN] epoch=199, iter=73790/80000, loss=0.7996, lr=0.001002, batch_cost=1.3685, reader_cost=0.0001 | ETA 02:21:38 2021-02-23 23:10:27 [INFO] [TRAIN] epoch=199, iter=73800/80000, loss=0.8563, lr=0.001001, batch_cost=1.3753, reader_cost=0.0001 | ETA 02:22:06 2021-02-23 23:10:41 [INFO] [TRAIN] epoch=199, iter=73810/80000, loss=0.7797, lr=0.001000, batch_cost=1.3764, reader_cost=0.0001 | ETA 02:22:00 2021-02-23 23:10:55 [INFO] [TRAIN] epoch=199, iter=73820/80000, loss=0.7882, lr=0.000998, batch_cost=1.3644, reader_cost=0.0001 | ETA 02:20:32 2021-02-23 23:11:08 [INFO] [TRAIN] epoch=199, iter=73830/80000, loss=0.7909, lr=0.000997, batch_cost=1.3428, reader_cost=0.0001 | ETA 02:18:05 2021-02-23 23:11:22 [INFO] [TRAIN] epoch=199, iter=73840/80000, loss=0.8341, lr=0.000995, batch_cost=1.3454, reader_cost=0.0001 | ETA 02:18:07 2021-02-23 23:11:35 [INFO] [TRAIN] epoch=199, iter=73850/80000, loss=0.7549, lr=0.000994, batch_cost=1.3634, reader_cost=0.0001 | ETA 02:19:44 2021-02-23 23:11:49 [INFO] [TRAIN] epoch=199, iter=73860/80000, loss=0.7903, lr=0.000992, batch_cost=1.3876, reader_cost=0.0001 | ETA 02:21:59 2021-02-23 23:12:02 [INFO] [TRAIN] epoch=199, iter=73870/80000, loss=0.8195, lr=0.000991, batch_cost=1.3362, reader_cost=0.0001 | ETA 02:16:30 2021-02-23 23:12:16 [INFO] [TRAIN] epoch=199, iter=73880/80000, loss=0.8054, lr=0.000989, batch_cost=1.3829, reader_cost=0.0001 | ETA 02:21:03 2021-02-23 23:12:30 [INFO] [TRAIN] epoch=199, iter=73890/80000, loss=0.8517, lr=0.000988, batch_cost=1.3470, reader_cost=0.0001 | ETA 02:17:10 2021-02-23 23:12:43 [INFO] [TRAIN] epoch=199, iter=73900/80000, loss=0.7961, lr=0.000986, batch_cost=1.3486, reader_cost=0.0001 | ETA 02:17:06 2021-02-23 23:12:57 [INFO] [TRAIN] epoch=199, iter=73910/80000, loss=0.8339, lr=0.000985, batch_cost=1.3601, reader_cost=0.0001 | ETA 02:18:03 2021-02-23 23:13:11 [INFO] [TRAIN] epoch=199, iter=73920/80000, loss=0.7717, lr=0.000984, batch_cost=1.3651, reader_cost=0.0001 | ETA 02:18:19 2021-02-23 23:13:24 [INFO] [TRAIN] epoch=199, iter=73930/80000, loss=0.7898, lr=0.000982, batch_cost=1.3670, reader_cost=0.0001 | ETA 02:18:17 2021-02-23 23:13:38 [INFO] [TRAIN] epoch=199, iter=73940/80000, loss=0.8101, lr=0.000981, batch_cost=1.3547, reader_cost=0.0001 | ETA 02:16:49 2021-02-23 23:13:51 [INFO] [TRAIN] epoch=199, iter=73950/80000, loss=0.7937, lr=0.000979, batch_cost=1.3446, reader_cost=0.0001 | ETA 02:15:34 2021-02-23 23:14:04 [INFO] [TRAIN] epoch=199, iter=73960/80000, loss=0.7866, lr=0.000978, batch_cost=1.3285, reader_cost=0.0001 | ETA 02:13:43 2021-02-23 23:14:18 [INFO] [TRAIN] epoch=199, iter=73970/80000, loss=0.8484, lr=0.000976, batch_cost=1.3625, reader_cost=0.0001 | ETA 02:16:55 2021-02-23 23:14:32 [INFO] [TRAIN] epoch=199, iter=73980/80000, loss=0.8647, lr=0.000975, batch_cost=1.3507, reader_cost=0.0001 | ETA 02:15:31 2021-02-23 23:14:45 [INFO] [TRAIN] epoch=199, iter=73990/80000, loss=0.7819, lr=0.000973, batch_cost=1.3529, reader_cost=0.0001 | ETA 02:15:30 2021-02-23 23:14:58 [INFO] [TRAIN] epoch=199, iter=74000/80000, loss=0.7736, lr=0.000972, batch_cost=1.3339, reader_cost=0.0001 | ETA 02:13:23 2021-02-23 23:14:59 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:24 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:05 - batch_cost: 0.1897 - reader cost: 0.0643  3/125 [..............................] - ETA: 58s - batch_cost: 0.2536 - reader cost: 0.0870  4/125 [..............................] - ETA: 56s - batch_cost: 0.2972 - reader cost: 0.1100 5/125 [>.............................] - ETA: 54s - batch_cost: 0.3184 - reader cost: 0.1120 6/125 [>.............................] - ETA: 53s - batch_cost: 0.3390 - reader cost: 0.1250 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3519 - reader cost: 0.1329 8/125 [>.............................] - ETA: 52s - batch_cost: 0.3609 - reader cost: 0.1383 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3681 - reader cost: 0.1426 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3736 - reader cost: 0.1455 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3785 - reader cost: 0.1484 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3831 - reader cost: 0.1507 13/125 [==>...........................] - ETA: 49s - batch_cost: 0.3863 - reader cost: 0.1517 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3854 - reader cost: 0.1498 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3881 - reader cost: 0.1517 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3913 - reader cost: 0.1539 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3901 - reader cost: 0.1521 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3908 - reader cost: 0.1522 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3927 - reader cost: 0.1538 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3945 - reader cost: 0.1550 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.3941 - reader cost: 0.1543 22/125 [====>.........................] - ETA: 43s - batch_cost: 0.3939 - reader cost: 0.1538 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.3933 - reader cost: 0.1527 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.3945 - reader cost: 0.1537 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.3956 - reader cost: 0.1545 26/125 [=====>........................] - ETA: 41s - batch_cost: 0.3971 - reader cost: 0.1557 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.3984 - reader cost: 0.1564 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.3995 - reader cost: 0.1572 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4009 - reader cost: 0.1580 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4018 - reader cost: 0.1584 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.4028 - reader cost: 0.1590 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4036 - reader cost: 0.1596 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4044 - reader cost: 0.1603 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4051 - reader cost: 0.1607 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4041 - reader cost: 0.1596 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4031 - reader cost: 0.1585 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4043 - reader cost: 0.1594 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4051 - reader cost: 0.1601 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4062 - reader cost: 0.1611 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4070 - reader cost: 0.1617 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4064 - reader cost: 0.1611 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4071 - reader cost: 0.1617 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4062 - reader cost: 0.1606 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4073 - reader cost: 0.1613 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4074 - reader cost: 0.1614 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4066 - reader cost: 0.1605 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4075 - reader cost: 0.1612 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4078 - reader cost: 0.1615 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4083 - reader cost: 0.1620 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4074 - reader cost: 0.1610 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4079 - reader cost: 0.1615 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4070 - reader cost: 0.1606 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4072 - reader cost: 0.1603 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4078 - reader cost: 0.1610 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4085 - reader cost: 0.1614 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4091 - reader cost: 0.1621 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4094 - reader cost: 0.1623 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4099 - reader cost: 0.1628 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4093 - reader cost: 0.1621 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4093 - reader cost: 0.1621 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4095 - reader cost: 0.1622 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4096 - reader cost: 0.1620 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4097 - reader cost: 0.1621 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4100 - reader cost: 0.1624 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4095 - reader cost: 0.1617 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4104 - reader cost: 0.1625 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4099 - reader cost: 0.1619 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4102 - reader cost: 0.1621 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4103 - reader cost: 0.1622 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4106 - reader cost: 0.1624 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4102 - reader cost: 0.1621 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4096 - reader cost: 0.1614 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4100 - reader cost: 0.1617 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4102 - reader cost: 0.1618 75/125 [=================>............] - ETA: 20s - batch_cost: 0.4105 - reader cost: 0.1621 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4108 - reader cost: 0.1623 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4111 - reader cost: 0.1626 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4114 - reader cost: 0.1629 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4117 - reader cost: 0.1631 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4114 - reader cost: 0.1627 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4108 - reader cost: 0.1619 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4109 - reader cost: 0.1619 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4105 - reader cost: 0.1615 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4107 - reader cost: 0.1617 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4102 - reader cost: 0.1611 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4103 - reader cost: 0.1613 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4105 - reader cost: 0.1615 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4101 - reader cost: 0.1610 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4101 - reader cost: 0.1606 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4104 - reader cost: 0.1609 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4110 - reader cost: 0.1615 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4108 - reader cost: 0.1613 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4111 - reader cost: 0.1616 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4113 - reader cost: 0.1618 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4115 - reader cost: 0.1619 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4112 - reader cost: 0.1616 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4112 - reader cost: 0.1617 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4118 - reader cost: 0.1622 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4113 - reader cost: 0.1618 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4116 - reader cost: 0.1621 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4118 - reader cost: 0.1622 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4119 - reader cost: 0.1623  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4115 - reader cost: 0.1619 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4113 - reader cost: 0.1617 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4114 - reader cost: 0.1618 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4110 - reader cost: 0.1613 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4108 - reader cost: 0.1612 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4110 - reader cost: 0.1614 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4112 - reader cost: 0.1615 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4115 - reader cost: 0.1618 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4112 - reader cost: 0.1615 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4110 - reader cost: 0.1613 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4112 - reader cost: 0.1615 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4108 - reader cost: 0.1611 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4109 - reader cost: 0.1612 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4111 - reader cost: 0.1614 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4110 - reader cost: 0.1613 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4107 - reader cost: 0.1610 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4109 - reader cost: 0.1611 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4109 - reader cost: 0.1612 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4110 - reader cost: 0.1613 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4112 - reader cost: 0.1614 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4108 - reader cost: 0.1611 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4106 - reader cost: 0.1609 125/125 [==============================] - 52s 416ms/step - batch_cost: 0.4104 - reader cost: 0.1606 2021-02-23 23:15:51 [INFO] [EVAL] #Images=500 mIoU=0.7995 Acc=0.9630 Kappa=0.9520 2021-02-23 23:15:51 [INFO] [EVAL] Class IoU: [0.9808 0.8452 0.9308 0.449 0.6317 0.6929 0.7538 0.8265 0.928 0.6346 0.9537 0.8428 0.6606 0.9585 0.8367 0.9045 0.8618 0.7008 0.7986] 2021-02-23 23:15:51 [INFO] [EVAL] Class Acc: [0.9903 0.9116 0.9609 0.8815 0.872 0.8367 0.8636 0.9116 0.9535 0.8289 0.9709 0.8944 0.788 0.975 0.9532 0.9597 0.9375 0.8695 0.8715] 2021-02-23 23:15:55 [INFO] [EVAL] The model with the best validation mIoU (0.8021) was saved at iter 73000. 2021-02-23 23:16:09 [INFO] [TRAIN] epoch=199, iter=74010/80000, loss=0.8210, lr=0.000970, batch_cost=1.3319, reader_cost=0.0001 | ETA 02:12:58 2021-02-23 23:16:22 [INFO] [TRAIN] epoch=199, iter=74020/80000, loss=0.8613, lr=0.000969, batch_cost=1.3273, reader_cost=0.0001 | ETA 02:12:17 2021-02-23 23:16:36 [INFO] [TRAIN] epoch=200, iter=74030/80000, loss=0.7650, lr=0.000968, batch_cost=1.4018, reader_cost=0.0867 | ETA 02:19:28 2021-02-23 23:16:50 [INFO] [TRAIN] epoch=200, iter=74040/80000, loss=0.8005, lr=0.000966, batch_cost=1.3956, reader_cost=0.0001 | ETA 02:18:37 2021-02-23 23:17:03 [INFO] [TRAIN] epoch=200, iter=74050/80000, loss=0.7484, lr=0.000965, batch_cost=1.3565, reader_cost=0.0001 | ETA 02:14:31 2021-02-23 23:17:17 [INFO] [TRAIN] epoch=200, iter=74060/80000, loss=0.8354, lr=0.000963, batch_cost=1.3203, reader_cost=0.0001 | ETA 02:10:42 2021-02-23 23:17:30 [INFO] [TRAIN] epoch=200, iter=74070/80000, loss=0.7539, lr=0.000962, batch_cost=1.3702, reader_cost=0.0001 | ETA 02:15:25 2021-02-23 23:17:44 [INFO] [TRAIN] epoch=200, iter=74080/80000, loss=0.8262, lr=0.000960, batch_cost=1.3998, reader_cost=0.0001 | ETA 02:18:06 2021-02-23 23:17:58 [INFO] [TRAIN] epoch=200, iter=74090/80000, loss=0.8051, lr=0.000959, batch_cost=1.4111, reader_cost=0.0001 | ETA 02:18:59 2021-02-23 23:18:12 [INFO] [TRAIN] epoch=200, iter=74100/80000, loss=0.8154, lr=0.000957, batch_cost=1.3610, reader_cost=0.0001 | ETA 02:13:50 2021-02-23 23:18:25 [INFO] [TRAIN] epoch=200, iter=74110/80000, loss=0.8025, lr=0.000956, batch_cost=1.3306, reader_cost=0.0001 | ETA 02:10:37 2021-02-23 23:18:39 [INFO] [TRAIN] epoch=200, iter=74120/80000, loss=0.7966, lr=0.000954, batch_cost=1.3446, reader_cost=0.0001 | ETA 02:11:46 2021-02-23 23:18:52 [INFO] [TRAIN] epoch=200, iter=74130/80000, loss=0.8581, lr=0.000953, batch_cost=1.3419, reader_cost=0.0001 | ETA 02:11:17 2021-02-23 23:19:06 [INFO] [TRAIN] epoch=200, iter=74140/80000, loss=0.8440, lr=0.000951, batch_cost=1.3460, reader_cost=0.0001 | ETA 02:11:27 2021-02-23 23:19:19 [INFO] [TRAIN] epoch=200, iter=74150/80000, loss=0.8039, lr=0.000950, batch_cost=1.3515, reader_cost=0.0001 | ETA 02:11:46 2021-02-23 23:19:33 [INFO] [TRAIN] epoch=200, iter=74160/80000, loss=0.7590, lr=0.000949, batch_cost=1.3502, reader_cost=0.0001 | ETA 02:11:25 2021-02-23 23:19:46 [INFO] [TRAIN] epoch=200, iter=74170/80000, loss=0.7826, lr=0.000947, batch_cost=1.3518, reader_cost=0.0001 | ETA 02:11:20 2021-02-23 23:20:00 [INFO] [TRAIN] epoch=200, iter=74180/80000, loss=0.7716, lr=0.000946, batch_cost=1.3542, reader_cost=0.0001 | ETA 02:11:21 2021-02-23 23:20:13 [INFO] [TRAIN] epoch=200, iter=74190/80000, loss=0.8113, lr=0.000944, batch_cost=1.3649, reader_cost=0.0001 | ETA 02:12:10 2021-02-23 23:20:27 [INFO] [TRAIN] epoch=200, iter=74200/80000, loss=0.7986, lr=0.000943, batch_cost=1.3361, reader_cost=0.0001 | ETA 02:09:09 2021-02-23 23:20:40 [INFO] [TRAIN] epoch=200, iter=74210/80000, loss=0.8015, lr=0.000941, batch_cost=1.3419, reader_cost=0.0001 | ETA 02:09:29 2021-02-23 23:20:54 [INFO] [TRAIN] epoch=200, iter=74220/80000, loss=0.7812, lr=0.000940, batch_cost=1.3683, reader_cost=0.0001 | ETA 02:11:48 2021-02-23 23:21:07 [INFO] [TRAIN] epoch=200, iter=74230/80000, loss=0.8332, lr=0.000938, batch_cost=1.3425, reader_cost=0.0001 | ETA 02:09:06 2021-02-23 23:21:21 [INFO] [TRAIN] epoch=200, iter=74240/80000, loss=0.7968, lr=0.000937, batch_cost=1.3404, reader_cost=0.0001 | ETA 02:08:40 2021-02-23 23:21:34 [INFO] [TRAIN] epoch=200, iter=74250/80000, loss=0.7784, lr=0.000935, batch_cost=1.3368, reader_cost=0.0001 | ETA 02:08:06 2021-02-23 23:21:48 [INFO] [TRAIN] epoch=200, iter=74260/80000, loss=0.7970, lr=0.000934, batch_cost=1.3577, reader_cost=0.0001 | ETA 02:09:53 2021-02-23 23:22:01 [INFO] [TRAIN] epoch=200, iter=74270/80000, loss=0.7787, lr=0.000932, batch_cost=1.3286, reader_cost=0.0001 | ETA 02:06:52 2021-02-23 23:22:15 [INFO] [TRAIN] epoch=200, iter=74280/80000, loss=0.7868, lr=0.000931, batch_cost=1.3561, reader_cost=0.0001 | ETA 02:09:17 2021-02-23 23:22:28 [INFO] [TRAIN] epoch=200, iter=74290/80000, loss=0.8572, lr=0.000930, batch_cost=1.3695, reader_cost=0.0001 | ETA 02:10:19 2021-02-23 23:22:42 [INFO] [TRAIN] epoch=200, iter=74300/80000, loss=0.7923, lr=0.000928, batch_cost=1.3691, reader_cost=0.0001 | ETA 02:10:04 2021-02-23 23:22:55 [INFO] [TRAIN] epoch=200, iter=74310/80000, loss=0.7580, lr=0.000927, batch_cost=1.3404, reader_cost=0.0001 | ETA 02:07:06 2021-02-23 23:23:09 [INFO] [TRAIN] epoch=200, iter=74320/80000, loss=0.7554, lr=0.000925, batch_cost=1.3401, reader_cost=0.0001 | ETA 02:06:51 2021-02-23 23:23:22 [INFO] [TRAIN] epoch=200, iter=74330/80000, loss=0.8323, lr=0.000924, batch_cost=1.3549, reader_cost=0.0001 | ETA 02:08:02 2021-02-23 23:23:36 [INFO] [TRAIN] epoch=200, iter=74340/80000, loss=0.8003, lr=0.000922, batch_cost=1.3497, reader_cost=0.0001 | ETA 02:07:19 2021-02-23 23:23:49 [INFO] [TRAIN] epoch=200, iter=74350/80000, loss=0.7715, lr=0.000921, batch_cost=1.3429, reader_cost=0.0001 | ETA 02:06:27 2021-02-23 23:24:03 [INFO] [TRAIN] epoch=200, iter=74360/80000, loss=0.7908, lr=0.000919, batch_cost=1.3738, reader_cost=0.0001 | ETA 02:09:08 2021-02-23 23:24:17 [INFO] [TRAIN] epoch=200, iter=74370/80000, loss=0.8033, lr=0.000918, batch_cost=1.3768, reader_cost=0.0001 | ETA 02:09:11 2021-02-23 23:24:30 [INFO] [TRAIN] epoch=200, iter=74380/80000, loss=0.8149, lr=0.000916, batch_cost=1.3578, reader_cost=0.0001 | ETA 02:07:10 2021-02-23 23:24:43 [INFO] [TRAIN] epoch=200, iter=74390/80000, loss=0.8081, lr=0.000915, batch_cost=1.3141, reader_cost=0.0001 | ETA 02:02:51 2021-02-23 23:24:57 [INFO] [TRAIN] epoch=200, iter=74400/80000, loss=0.8113, lr=0.000913, batch_cost=1.3267, reader_cost=0.0001 | ETA 02:03:49 2021-02-23 23:25:12 [INFO] [TRAIN] epoch=201, iter=74410/80000, loss=0.7610, lr=0.000912, batch_cost=1.4861, reader_cost=0.0821 | ETA 02:18:27 2021-02-23 23:25:25 [INFO] [TRAIN] epoch=201, iter=74420/80000, loss=0.7388, lr=0.000910, batch_cost=1.3879, reader_cost=0.0001 | ETA 02:09:04 2021-02-23 23:25:39 [INFO] [TRAIN] epoch=201, iter=74430/80000, loss=0.7985, lr=0.000909, batch_cost=1.3925, reader_cost=0.0001 | ETA 02:09:16 2021-02-23 23:25:53 [INFO] [TRAIN] epoch=201, iter=74440/80000, loss=0.8062, lr=0.000908, batch_cost=1.3379, reader_cost=0.0001 | ETA 02:03:58 2021-02-23 23:26:07 [INFO] [TRAIN] epoch=201, iter=74450/80000, loss=0.8012, lr=0.000906, batch_cost=1.3784, reader_cost=0.0001 | ETA 02:07:30 2021-02-23 23:26:20 [INFO] [TRAIN] epoch=201, iter=74460/80000, loss=0.8535, lr=0.000905, batch_cost=1.3837, reader_cost=0.0001 | ETA 02:07:45 2021-02-23 23:26:34 [INFO] [TRAIN] epoch=201, iter=74470/80000, loss=0.8162, lr=0.000903, batch_cost=1.3165, reader_cost=0.0001 | ETA 02:01:20 2021-02-23 23:26:47 [INFO] [TRAIN] epoch=201, iter=74480/80000, loss=0.7824, lr=0.000902, batch_cost=1.3712, reader_cost=0.0001 | ETA 02:06:08 2021-02-23 23:27:01 [INFO] [TRAIN] epoch=201, iter=74490/80000, loss=0.7833, lr=0.000900, batch_cost=1.3332, reader_cost=0.0001 | ETA 02:02:26 2021-02-23 23:27:14 [INFO] [TRAIN] epoch=201, iter=74500/80000, loss=0.7876, lr=0.000899, batch_cost=1.3361, reader_cost=0.0001 | ETA 02:02:28 2021-02-23 23:27:28 [INFO] [TRAIN] epoch=201, iter=74510/80000, loss=0.7723, lr=0.000897, batch_cost=1.3729, reader_cost=0.0001 | ETA 02:05:37 2021-02-23 23:27:41 [INFO] [TRAIN] epoch=201, iter=74520/80000, loss=0.7877, lr=0.000896, batch_cost=1.3419, reader_cost=0.0001 | ETA 02:02:33 2021-02-23 23:27:55 [INFO] [TRAIN] epoch=201, iter=74530/80000, loss=0.8283, lr=0.000894, batch_cost=1.3755, reader_cost=0.0001 | ETA 02:05:24 2021-02-23 23:28:08 [INFO] [TRAIN] epoch=201, iter=74540/80000, loss=0.8020, lr=0.000893, batch_cost=1.3535, reader_cost=0.0001 | ETA 02:03:10 2021-02-23 23:28:22 [INFO] [TRAIN] epoch=201, iter=74550/80000, loss=0.8033, lr=0.000891, batch_cost=1.3723, reader_cost=0.0001 | ETA 02:04:39 2021-02-23 23:28:36 [INFO] [TRAIN] epoch=201, iter=74560/80000, loss=0.7826, lr=0.000890, batch_cost=1.3579, reader_cost=0.0001 | ETA 02:03:06 2021-02-23 23:28:49 [INFO] [TRAIN] epoch=201, iter=74570/80000, loss=0.7668, lr=0.000888, batch_cost=1.3536, reader_cost=0.0001 | ETA 02:02:29 2021-02-23 23:29:02 [INFO] [TRAIN] epoch=201, iter=74580/80000, loss=0.8252, lr=0.000887, batch_cost=1.3181, reader_cost=0.0001 | ETA 01:59:04 2021-02-23 23:29:16 [INFO] [TRAIN] epoch=201, iter=74590/80000, loss=0.7928, lr=0.000885, batch_cost=1.3532, reader_cost=0.0001 | ETA 02:02:01 2021-02-23 23:29:29 [INFO] [TRAIN] epoch=201, iter=74600/80000, loss=0.8075, lr=0.000884, batch_cost=1.3487, reader_cost=0.0001 | ETA 02:01:22 2021-02-23 23:29:43 [INFO] [TRAIN] epoch=201, iter=74610/80000, loss=0.8094, lr=0.000883, batch_cost=1.3301, reader_cost=0.0001 | ETA 01:59:29 2021-02-23 23:29:56 [INFO] [TRAIN] epoch=201, iter=74620/80000, loss=0.8161, lr=0.000881, batch_cost=1.3403, reader_cost=0.0001 | ETA 02:00:10 2021-02-23 23:30:10 [INFO] [TRAIN] epoch=201, iter=74630/80000, loss=0.7873, lr=0.000880, batch_cost=1.3613, reader_cost=0.0001 | ETA 02:01:50 2021-02-23 23:30:23 [INFO] [TRAIN] epoch=201, iter=74640/80000, loss=0.8484, lr=0.000878, batch_cost=1.3516, reader_cost=0.0001 | ETA 02:00:44 2021-02-23 23:30:37 [INFO] [TRAIN] epoch=201, iter=74650/80000, loss=0.8518, lr=0.000877, batch_cost=1.3465, reader_cost=0.0001 | ETA 02:00:03 2021-02-23 23:30:50 [INFO] [TRAIN] epoch=201, iter=74660/80000, loss=0.7324, lr=0.000875, batch_cost=1.3365, reader_cost=0.0001 | ETA 01:58:56 2021-02-23 23:31:03 [INFO] [TRAIN] epoch=201, iter=74670/80000, loss=0.8175, lr=0.000874, batch_cost=1.3245, reader_cost=0.0001 | ETA 01:57:39 2021-02-23 23:31:17 [INFO] [TRAIN] epoch=201, iter=74680/80000, loss=0.7862, lr=0.000872, batch_cost=1.3434, reader_cost=0.0001 | ETA 01:59:06 2021-02-23 23:31:30 [INFO] [TRAIN] epoch=201, iter=74690/80000, loss=0.7962, lr=0.000871, batch_cost=1.3309, reader_cost=0.0001 | ETA 01:57:47 2021-02-23 23:31:43 [INFO] [TRAIN] epoch=201, iter=74700/80000, loss=0.7388, lr=0.000869, batch_cost=1.3412, reader_cost=0.0001 | ETA 01:58:28 2021-02-23 23:31:57 [INFO] [TRAIN] epoch=201, iter=74710/80000, loss=0.7813, lr=0.000868, batch_cost=1.3806, reader_cost=0.0001 | ETA 02:01:43 2021-02-23 23:32:11 [INFO] [TRAIN] epoch=201, iter=74720/80000, loss=0.7973, lr=0.000866, batch_cost=1.3619, reader_cost=0.0001 | ETA 01:59:50 2021-02-23 23:32:24 [INFO] [TRAIN] epoch=201, iter=74730/80000, loss=0.7909, lr=0.000865, batch_cost=1.3547, reader_cost=0.0001 | ETA 01:58:59 2021-02-23 23:32:38 [INFO] [TRAIN] epoch=201, iter=74740/80000, loss=0.8195, lr=0.000863, batch_cost=1.3592, reader_cost=0.0001 | ETA 01:59:09 2021-02-23 23:32:52 [INFO] [TRAIN] epoch=201, iter=74750/80000, loss=0.8595, lr=0.000862, batch_cost=1.3843, reader_cost=0.0001 | ETA 02:01:07 2021-02-23 23:33:06 [INFO] [TRAIN] epoch=201, iter=74760/80000, loss=0.8362, lr=0.000860, batch_cost=1.3618, reader_cost=0.0001 | ETA 01:58:55 2021-02-23 23:33:19 [INFO] [TRAIN] epoch=201, iter=74770/80000, loss=0.7819, lr=0.000859, batch_cost=1.3203, reader_cost=0.0001 | ETA 01:55:05 2021-02-23 23:33:33 [INFO] [TRAIN] epoch=202, iter=74780/80000, loss=0.7947, lr=0.000857, batch_cost=1.4469, reader_cost=0.0673 | ETA 02:05:53 2021-02-23 23:33:47 [INFO] [TRAIN] epoch=202, iter=74790/80000, loss=0.7951, lr=0.000856, batch_cost=1.3364, reader_cost=0.0001 | ETA 01:56:02 2021-02-23 23:34:00 [INFO] [TRAIN] epoch=202, iter=74800/80000, loss=0.8112, lr=0.000854, batch_cost=1.3618, reader_cost=0.0001 | ETA 01:58:01 2021-02-23 23:34:13 [INFO] [TRAIN] epoch=202, iter=74810/80000, loss=0.7878, lr=0.000853, batch_cost=1.3175, reader_cost=0.0001 | ETA 01:53:57 2021-02-23 23:34:27 [INFO] [TRAIN] epoch=202, iter=74820/80000, loss=0.7885, lr=0.000852, batch_cost=1.3385, reader_cost=0.0001 | ETA 01:55:33 2021-02-23 23:34:40 [INFO] [TRAIN] epoch=202, iter=74830/80000, loss=0.8339, lr=0.000850, batch_cost=1.3613, reader_cost=0.0001 | ETA 01:57:17 2021-02-23 23:34:54 [INFO] [TRAIN] epoch=202, iter=74840/80000, loss=0.7462, lr=0.000849, batch_cost=1.3380, reader_cost=0.0001 | ETA 01:55:03 2021-02-23 23:35:07 [INFO] [TRAIN] epoch=202, iter=74850/80000, loss=0.7874, lr=0.000847, batch_cost=1.3424, reader_cost=0.0001 | ETA 01:55:13 2021-02-23 23:35:21 [INFO] [TRAIN] epoch=202, iter=74860/80000, loss=0.7870, lr=0.000846, batch_cost=1.3862, reader_cost=0.0001 | ETA 01:58:45 2021-02-23 23:35:34 [INFO] [TRAIN] epoch=202, iter=74870/80000, loss=0.8200, lr=0.000844, batch_cost=1.3461, reader_cost=0.0001 | ETA 01:55:05 2021-02-23 23:35:48 [INFO] [TRAIN] epoch=202, iter=74880/80000, loss=0.8341, lr=0.000843, batch_cost=1.3631, reader_cost=0.0001 | ETA 01:56:19 2021-02-23 23:36:02 [INFO] [TRAIN] epoch=202, iter=74890/80000, loss=0.7619, lr=0.000841, batch_cost=1.3602, reader_cost=0.0001 | ETA 01:55:50 2021-02-23 23:36:15 [INFO] [TRAIN] epoch=202, iter=74900/80000, loss=0.8180, lr=0.000840, batch_cost=1.3524, reader_cost=0.0001 | ETA 01:54:57 2021-02-23 23:36:29 [INFO] [TRAIN] epoch=202, iter=74910/80000, loss=0.7272, lr=0.000838, batch_cost=1.3590, reader_cost=0.0001 | ETA 01:55:17 2021-02-23 23:36:42 [INFO] [TRAIN] epoch=202, iter=74920/80000, loss=0.8258, lr=0.000837, batch_cost=1.3290, reader_cost=0.0001 | ETA 01:52:31 2021-02-23 23:36:55 [INFO] [TRAIN] epoch=202, iter=74930/80000, loss=0.7762, lr=0.000835, batch_cost=1.3388, reader_cost=0.0001 | ETA 01:53:07 2021-02-23 23:37:09 [INFO] [TRAIN] epoch=202, iter=74940/80000, loss=0.7513, lr=0.000834, batch_cost=1.3797, reader_cost=0.0001 | ETA 01:56:21 2021-02-23 23:37:23 [INFO] [TRAIN] epoch=202, iter=74950/80000, loss=0.8242, lr=0.000832, batch_cost=1.3509, reader_cost=0.0001 | ETA 01:53:42 2021-02-23 23:37:36 [INFO] [TRAIN] epoch=202, iter=74960/80000, loss=0.8007, lr=0.000831, batch_cost=1.3664, reader_cost=0.0001 | ETA 01:54:46 2021-02-23 23:37:50 [INFO] [TRAIN] epoch=202, iter=74970/80000, loss=0.7927, lr=0.000829, batch_cost=1.3373, reader_cost=0.0001 | ETA 01:52:06 2021-02-23 23:38:03 [INFO] [TRAIN] epoch=202, iter=74980/80000, loss=0.8100, lr=0.000828, batch_cost=1.3595, reader_cost=0.0001 | ETA 01:53:44 2021-02-23 23:38:17 [INFO] [TRAIN] epoch=202, iter=74990/80000, loss=0.7581, lr=0.000826, batch_cost=1.3389, reader_cost=0.0001 | ETA 01:51:47 2021-02-23 23:38:30 [INFO] [TRAIN] epoch=202, iter=75000/80000, loss=0.7613, lr=0.000825, batch_cost=1.3380, reader_cost=0.0001 | ETA 01:51:30 2021-02-23 23:38:30 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:18 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:03 - batch_cost: 0.1993 - reader cost: 0.0756  3/125 [..............................] - ETA: 1:00 - batch_cost: 0.2823 - reader cost: 0.1140 4/125 [..............................] - ETA: 57s - batch_cost: 0.3174 - reader cost: 0.1299  5/125 [>.............................] - ETA: 56s - batch_cost: 0.3422 - reader cost: 0.1415 6/125 [>.............................] - ETA: 54s - batch_cost: 0.3558 - reader cost: 0.1472 7/125 [>.............................] - ETA: 54s - batch_cost: 0.3699 - reader cost: 0.1550 8/125 [>.............................] - ETA: 53s - batch_cost: 0.3785 - reader cost: 0.1584 9/125 [=>............................] - ETA: 53s - batch_cost: 0.3869 - reader cost: 0.1617 10/125 [=>............................] - ETA: 52s - batch_cost: 0.3910 - reader cost: 0.1628 11/125 [=>............................] - ETA: 51s - batch_cost: 0.3944 - reader cost: 0.1640 12/125 [=>............................] - ETA: 50s - batch_cost: 0.3943 - reader cost: 0.1625 13/125 [==>...........................] - ETA: 50s - batch_cost: 0.3991 - reader cost: 0.1657 14/125 [==>...........................] - ETA: 49s - batch_cost: 0.3978 - reader cost: 0.1632 15/125 [==>...........................] - ETA: 48s - batch_cost: 0.4003 - reader cost: 0.1646 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3986 - reader cost: 0.1619 17/125 [===>..........................] - ETA: 47s - batch_cost: 0.4007 - reader cost: 0.1633 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.3989 - reader cost: 0.1606 19/125 [===>..........................] - ETA: 46s - batch_cost: 0.4010 - reader cost: 0.1619 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4028 - reader cost: 0.1629 21/125 [====>.........................] - ETA: 45s - batch_cost: 0.4036 - reader cost: 0.1633 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4056 - reader cost: 0.1643 23/125 [====>.........................] - ETA: 44s - batch_cost: 0.4065 - reader cost: 0.1648 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4079 - reader cost: 0.1656 25/125 [=====>........................] - ETA: 43s - batch_cost: 0.4095 - reader cost: 0.1668 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4099 - reader cost: 0.1670 27/125 [=====>........................] - ETA: 42s - batch_cost: 0.4107 - reader cost: 0.1673 28/125 [=====>........................] - ETA: 42s - batch_cost: 0.4115 - reader cost: 0.1680 29/125 [=====>........................] - ETA: 41s - batch_cost: 0.4105 - reader cost: 0.1669 30/125 [======>.......................] - ETA: 41s - batch_cost: 0.4110 - reader cost: 0.1672 31/125 [======>.......................] - ETA: 40s - batch_cost: 0.4122 - reader cost: 0.1680 32/125 [======>.......................] - ETA: 40s - batch_cost: 0.4127 - reader cost: 0.1684 33/125 [======>.......................] - ETA: 39s - batch_cost: 0.4120 - reader cost: 0.1676 34/125 [=======>......................] - ETA: 39s - batch_cost: 0.4110 - reader cost: 0.1665 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4099 - reader cost: 0.1650 36/125 [=======>......................] - ETA: 38s - batch_cost: 0.4106 - reader cost: 0.1652 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4097 - reader cost: 0.1643 38/125 [========>.....................] - ETA: 37s - batch_cost: 0.4104 - reader cost: 0.1648 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4096 - reader cost: 0.1640 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4102 - reader cost: 0.1645 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4106 - reader cost: 0.1647 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4109 - reader cost: 0.1649 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4112 - reader cost: 0.1650 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4117 - reader cost: 0.1653 45/125 [=========>....................] - ETA: 34s - batch_cost: 0.4130 - reader cost: 0.1664 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4124 - reader cost: 0.1653 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4125 - reader cost: 0.1654 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4118 - reader cost: 0.1646 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4110 - reader cost: 0.1638 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4107 - reader cost: 0.1634 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4100 - reader cost: 0.1626 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4103 - reader cost: 0.1628 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4096 - reader cost: 0.1621 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4102 - reader cost: 0.1625 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4095 - reader cost: 0.1618 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4099 - reader cost: 0.1621 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4103 - reader cost: 0.1623 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4103 - reader cost: 0.1623 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4107 - reader cost: 0.1627 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4111 - reader cost: 0.1630 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4111 - reader cost: 0.1630 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4116 - reader cost: 0.1633 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4113 - reader cost: 0.1629 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4115 - reader cost: 0.1630 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4120 - reader cost: 0.1635 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4116 - reader cost: 0.1631 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4122 - reader cost: 0.1636 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4124 - reader cost: 0.1637 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4127 - reader cost: 0.1639 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4130 - reader cost: 0.1642 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4125 - reader cost: 0.1636 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4127 - reader cost: 0.1638 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4134 - reader cost: 0.1643 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4132 - reader cost: 0.1639 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4128 - reader cost: 0.1633 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4127 - reader cost: 0.1632 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4128 - reader cost: 0.1634 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4131 - reader cost: 0.1636 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4133 - reader cost: 0.1637 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4127 - reader cost: 0.1632 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4121 - reader cost: 0.1626 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4123 - reader cost: 0.1628 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4125 - reader cost: 0.1629 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4132 - reader cost: 0.1636 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4135 - reader cost: 0.1639 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4138 - reader cost: 0.1641 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4135 - reader cost: 0.1638 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4139 - reader cost: 0.1642 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4136 - reader cost: 0.1639 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4135 - reader cost: 0.1637 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4139 - reader cost: 0.1639 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4135 - reader cost: 0.1634 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4132 - reader cost: 0.1631 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4129 - reader cost: 0.1628 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4130 - reader cost: 0.1629 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4130 - reader cost: 0.1629 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4126 - reader cost: 0.1625 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4127 - reader cost: 0.1626 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4123 - reader cost: 0.1622 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4126 - reader cost: 0.1625 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4129 - reader cost: 0.1628 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4134 - reader cost: 0.1633  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4137 - reader cost: 0.1636 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4139 - reader cost: 0.1637 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4139 - reader cost: 0.1637 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4136 - reader cost: 0.1634 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4132 - reader cost: 0.1630 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4136 - reader cost: 0.1633 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4136 - reader cost: 0.1634 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4135 - reader cost: 0.1633 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4137 - reader cost: 0.1634 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4133 - reader cost: 0.1630 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4135 - reader cost: 0.1632 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4133 - reader cost: 0.1629 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4134 - reader cost: 0.1630 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4134 - reader cost: 0.1630 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4137 - reader cost: 0.1632 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4138 - reader cost: 0.1633 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4136 - reader cost: 0.1631 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4137 - reader cost: 0.1631 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4133 - reader cost: 0.1628 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4135 - reader cost: 0.1630 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4131 - reader cost: 0.1626 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4135 - reader cost: 0.1630 125/125 [==============================] - 52s 419ms/step - batch_cost: 0.4136 - reader cost: 0.1630 2021-02-23 23:39:23 [INFO] [EVAL] #Images=500 mIoU=0.8049 Acc=0.9647 Kappa=0.9541 2021-02-23 23:39:23 [INFO] [EVAL] Class IoU: [0.9822 0.8541 0.935 0.567 0.6439 0.699 0.7609 0.8342 0.9288 0.6076 0.9532 0.8449 0.6522 0.9576 0.8053 0.8928 0.863 0.7087 0.8028] 2021-02-23 23:39:23 [INFO] [EVAL] Class Acc: [0.9894 0.9227 0.9626 0.9035 0.8661 0.8465 0.8707 0.917 0.957 0.8431 0.9678 0.8993 0.7985 0.975 0.9564 0.933 0.9341 0.8391 0.8797] 2021-02-23 23:39:30 [INFO] [EVAL] The model with the best validation mIoU (0.8049) was saved at iter 75000. 2021-02-23 23:39:43 [INFO] [TRAIN] epoch=202, iter=75010/80000, loss=0.7757, lr=0.000823, batch_cost=1.3254, reader_cost=0.0001 | ETA 01:50:13 2021-02-23 23:39:57 [INFO] [TRAIN] epoch=202, iter=75020/80000, loss=0.7905, lr=0.000822, batch_cost=1.3400, reader_cost=0.0001 | ETA 01:51:13 2021-02-23 23:40:10 [INFO] [TRAIN] epoch=202, iter=75030/80000, loss=0.8104, lr=0.000820, batch_cost=1.3423, reader_cost=0.0001 | ETA 01:51:11 2021-02-23 23:40:23 [INFO] [TRAIN] epoch=202, iter=75040/80000, loss=0.8192, lr=0.000819, batch_cost=1.3332, reader_cost=0.0001 | ETA 01:50:12 2021-02-23 23:40:37 [INFO] [TRAIN] epoch=202, iter=75050/80000, loss=0.8376, lr=0.000817, batch_cost=1.3633, reader_cost=0.0001 | ETA 01:52:28 2021-02-23 23:40:51 [INFO] [TRAIN] epoch=202, iter=75060/80000, loss=0.7908, lr=0.000816, batch_cost=1.3475, reader_cost=0.0001 | ETA 01:50:56 2021-02-23 23:41:04 [INFO] [TRAIN] epoch=202, iter=75070/80000, loss=0.8174, lr=0.000814, batch_cost=1.3821, reader_cost=0.0001 | ETA 01:53:33 2021-02-23 23:41:18 [INFO] [TRAIN] epoch=202, iter=75080/80000, loss=0.8071, lr=0.000813, batch_cost=1.3494, reader_cost=0.0001 | ETA 01:50:38 2021-02-23 23:41:31 [INFO] [TRAIN] epoch=202, iter=75090/80000, loss=0.7830, lr=0.000811, batch_cost=1.3313, reader_cost=0.0001 | ETA 01:48:56 2021-02-23 23:41:45 [INFO] [TRAIN] epoch=202, iter=75100/80000, loss=0.7995, lr=0.000810, batch_cost=1.3476, reader_cost=0.0001 | ETA 01:50:03 2021-02-23 23:41:58 [INFO] [TRAIN] epoch=202, iter=75110/80000, loss=0.7910, lr=0.000808, batch_cost=1.3555, reader_cost=0.0001 | ETA 01:50:28 2021-02-23 23:42:12 [INFO] [TRAIN] epoch=202, iter=75120/80000, loss=0.7812, lr=0.000807, batch_cost=1.3294, reader_cost=0.0001 | ETA 01:48:07 2021-02-23 23:42:25 [INFO] [TRAIN] epoch=202, iter=75130/80000, loss=0.7892, lr=0.000806, batch_cost=1.3468, reader_cost=0.0001 | ETA 01:49:19 2021-02-23 23:42:39 [INFO] [TRAIN] epoch=202, iter=75140/80000, loss=0.8088, lr=0.000804, batch_cost=1.3596, reader_cost=0.0001 | ETA 01:50:07 2021-02-23 23:42:53 [INFO] [TRAIN] epoch=203, iter=75150/80000, loss=0.8103, lr=0.000803, batch_cost=1.4189, reader_cost=0.0638 | ETA 01:54:41 2021-02-23 23:43:06 [INFO] [TRAIN] epoch=203, iter=75160/80000, loss=0.8028, lr=0.000801, batch_cost=1.3394, reader_cost=0.0001 | ETA 01:48:02 2021-02-23 23:43:20 [INFO] [TRAIN] epoch=203, iter=75170/80000, loss=0.7895, lr=0.000800, batch_cost=1.3747, reader_cost=0.0001 | ETA 01:50:39 2021-02-23 23:43:34 [INFO] [TRAIN] epoch=203, iter=75180/80000, loss=0.8329, lr=0.000798, batch_cost=1.4025, reader_cost=0.0001 | ETA 01:52:40 2021-02-23 23:43:47 [INFO] [TRAIN] epoch=203, iter=75190/80000, loss=0.8438, lr=0.000797, batch_cost=1.3340, reader_cost=0.0001 | ETA 01:46:56 2021-02-23 23:44:01 [INFO] [TRAIN] epoch=203, iter=75200/80000, loss=0.7991, lr=0.000795, batch_cost=1.3621, reader_cost=0.0001 | ETA 01:48:58 2021-02-23 23:44:14 [INFO] [TRAIN] epoch=203, iter=75210/80000, loss=0.7874, lr=0.000794, batch_cost=1.3349, reader_cost=0.0001 | ETA 01:46:34 2021-02-23 23:44:28 [INFO] [TRAIN] epoch=203, iter=75220/80000, loss=0.7685, lr=0.000792, batch_cost=1.3627, reader_cost=0.0001 | ETA 01:48:33 2021-02-23 23:44:41 [INFO] [TRAIN] epoch=203, iter=75230/80000, loss=0.7961, lr=0.000791, batch_cost=1.3385, reader_cost=0.0001 | ETA 01:46:24 2021-02-23 23:44:55 [INFO] [TRAIN] epoch=203, iter=75240/80000, loss=0.8137, lr=0.000789, batch_cost=1.3446, reader_cost=0.0001 | ETA 01:46:40 2021-02-23 23:45:08 [INFO] [TRAIN] epoch=203, iter=75250/80000, loss=0.7711, lr=0.000788, batch_cost=1.3372, reader_cost=0.0001 | ETA 01:45:51 2021-02-23 23:45:21 [INFO] [TRAIN] epoch=203, iter=75260/80000, loss=0.7852, lr=0.000786, batch_cost=1.3260, reader_cost=0.0001 | ETA 01:44:45 2021-02-23 23:45:35 [INFO] [TRAIN] epoch=203, iter=75270/80000, loss=0.7842, lr=0.000785, batch_cost=1.3363, reader_cost=0.0001 | ETA 01:45:20 2021-02-23 23:45:48 [INFO] [TRAIN] epoch=203, iter=75280/80000, loss=0.7778, lr=0.000783, batch_cost=1.3592, reader_cost=0.0001 | ETA 01:46:55 2021-02-23 23:46:02 [INFO] [TRAIN] epoch=203, iter=75290/80000, loss=0.8043, lr=0.000782, batch_cost=1.3360, reader_cost=0.0001 | ETA 01:44:52 2021-02-23 23:46:15 [INFO] [TRAIN] epoch=203, iter=75300/80000, loss=0.7754, lr=0.000780, batch_cost=1.3231, reader_cost=0.0001 | ETA 01:43:38 2021-02-23 23:46:29 [INFO] [TRAIN] epoch=203, iter=75310/80000, loss=0.8003, lr=0.000779, batch_cost=1.3923, reader_cost=0.0001 | ETA 01:48:49 2021-02-23 23:46:42 [INFO] [TRAIN] epoch=203, iter=75320/80000, loss=0.7851, lr=0.000777, batch_cost=1.3513, reader_cost=0.0001 | ETA 01:45:23 2021-02-23 23:46:56 [INFO] [TRAIN] epoch=203, iter=75330/80000, loss=0.8591, lr=0.000776, batch_cost=1.3195, reader_cost=0.0001 | ETA 01:42:42 2021-02-23 23:47:09 [INFO] [TRAIN] epoch=203, iter=75340/80000, loss=0.7842, lr=0.000774, batch_cost=1.3562, reader_cost=0.0001 | ETA 01:45:19 2021-02-23 23:47:23 [INFO] [TRAIN] epoch=203, iter=75350/80000, loss=0.8259, lr=0.000773, batch_cost=1.3396, reader_cost=0.0001 | ETA 01:43:49 2021-02-23 23:47:36 [INFO] [TRAIN] epoch=203, iter=75360/80000, loss=0.7866, lr=0.000771, batch_cost=1.3550, reader_cost=0.0001 | ETA 01:44:47 2021-02-23 23:47:50 [INFO] [TRAIN] epoch=203, iter=75370/80000, loss=0.7745, lr=0.000770, batch_cost=1.3678, reader_cost=0.0001 | ETA 01:45:33 2021-02-23 23:48:03 [INFO] [TRAIN] epoch=203, iter=75380/80000, loss=0.7966, lr=0.000768, batch_cost=1.3462, reader_cost=0.0001 | ETA 01:43:39 2021-02-23 23:48:17 [INFO] [TRAIN] epoch=203, iter=75390/80000, loss=0.7910, lr=0.000767, batch_cost=1.3834, reader_cost=0.0001 | ETA 01:46:17 2021-02-23 23:48:30 [INFO] [TRAIN] epoch=203, iter=75400/80000, loss=0.8007, lr=0.000765, batch_cost=1.3270, reader_cost=0.0001 | ETA 01:41:44 2021-02-23 23:48:44 [INFO] [TRAIN] epoch=203, iter=75410/80000, loss=0.8107, lr=0.000764, batch_cost=1.3544, reader_cost=0.0001 | ETA 01:43:36 2021-02-23 23:48:57 [INFO] [TRAIN] epoch=203, iter=75420/80000, loss=0.8337, lr=0.000762, batch_cost=1.3434, reader_cost=0.0001 | ETA 01:42:32 2021-02-23 23:49:11 [INFO] [TRAIN] epoch=203, iter=75430/80000, loss=0.7970, lr=0.000761, batch_cost=1.3584, reader_cost=0.0001 | ETA 01:43:27 2021-02-23 23:49:25 [INFO] [TRAIN] epoch=203, iter=75440/80000, loss=0.7848, lr=0.000759, batch_cost=1.3769, reader_cost=0.0001 | ETA 01:44:38 2021-02-23 23:49:38 [INFO] [TRAIN] epoch=203, iter=75450/80000, loss=0.7753, lr=0.000758, batch_cost=1.3478, reader_cost=0.0001 | ETA 01:42:12 2021-02-23 23:49:52 [INFO] [TRAIN] epoch=203, iter=75460/80000, loss=0.8167, lr=0.000756, batch_cost=1.3586, reader_cost=0.0001 | ETA 01:42:47 2021-02-23 23:50:05 [INFO] [TRAIN] epoch=203, iter=75470/80000, loss=0.7674, lr=0.000755, batch_cost=1.3797, reader_cost=0.0001 | ETA 01:44:09 2021-02-23 23:50:19 [INFO] [TRAIN] epoch=203, iter=75480/80000, loss=0.8173, lr=0.000753, batch_cost=1.3275, reader_cost=0.0001 | ETA 01:40:00 2021-02-23 23:50:32 [INFO] [TRAIN] epoch=203, iter=75490/80000, loss=0.7676, lr=0.000752, batch_cost=1.3209, reader_cost=0.0001 | ETA 01:39:17 2021-02-23 23:50:46 [INFO] [TRAIN] epoch=203, iter=75500/80000, loss=0.8120, lr=0.000750, batch_cost=1.3998, reader_cost=0.0001 | ETA 01:44:59 2021-02-23 23:50:59 [INFO] [TRAIN] epoch=203, iter=75510/80000, loss=0.7626, lr=0.000749, batch_cost=1.3392, reader_cost=0.0001 | ETA 01:40:12 2021-02-23 23:51:14 [INFO] [TRAIN] epoch=204, iter=75520/80000, loss=0.7817, lr=0.000747, batch_cost=1.4669, reader_cost=0.0630 | ETA 01:49:31 2021-02-23 23:51:27 [INFO] [TRAIN] epoch=204, iter=75530/80000, loss=0.7690, lr=0.000746, batch_cost=1.3320, reader_cost=0.0001 | ETA 01:39:13 2021-02-23 23:51:41 [INFO] [TRAIN] epoch=204, iter=75540/80000, loss=0.7660, lr=0.000744, batch_cost=1.3495, reader_cost=0.0001 | ETA 01:40:18 2021-02-23 23:51:54 [INFO] [TRAIN] epoch=204, iter=75550/80000, loss=0.8109, lr=0.000743, batch_cost=1.3272, reader_cost=0.0001 | ETA 01:38:26 2021-02-23 23:52:08 [INFO] [TRAIN] epoch=204, iter=75560/80000, loss=0.7824, lr=0.000741, batch_cost=1.3604, reader_cost=0.0001 | ETA 01:40:40 2021-02-23 23:52:21 [INFO] [TRAIN] epoch=204, iter=75570/80000, loss=0.7911, lr=0.000740, batch_cost=1.3270, reader_cost=0.0001 | ETA 01:37:58 2021-02-23 23:52:35 [INFO] [TRAIN] epoch=204, iter=75580/80000, loss=0.7825, lr=0.000738, batch_cost=1.3653, reader_cost=0.0001 | ETA 01:40:34 2021-02-23 23:52:48 [INFO] [TRAIN] epoch=204, iter=75590/80000, loss=0.7981, lr=0.000737, batch_cost=1.3682, reader_cost=0.0001 | ETA 01:40:33 2021-02-23 23:53:02 [INFO] [TRAIN] epoch=204, iter=75600/80000, loss=0.7854, lr=0.000735, batch_cost=1.3621, reader_cost=0.0001 | ETA 01:39:53 2021-02-23 23:53:16 [INFO] [TRAIN] epoch=204, iter=75610/80000, loss=0.8022, lr=0.000734, batch_cost=1.3673, reader_cost=0.0001 | ETA 01:40:02 2021-02-23 23:53:29 [INFO] [TRAIN] epoch=204, iter=75620/80000, loss=0.7953, lr=0.000732, batch_cost=1.3581, reader_cost=0.0001 | ETA 01:39:08 2021-02-23 23:53:43 [INFO] [TRAIN] epoch=204, iter=75630/80000, loss=0.7805, lr=0.000731, batch_cost=1.3645, reader_cost=0.0001 | ETA 01:39:22 2021-02-23 23:53:56 [INFO] [TRAIN] epoch=204, iter=75640/80000, loss=0.8035, lr=0.000729, batch_cost=1.3523, reader_cost=0.0001 | ETA 01:38:15 2021-02-23 23:54:10 [INFO] [TRAIN] epoch=204, iter=75650/80000, loss=0.7711, lr=0.000728, batch_cost=1.3537, reader_cost=0.0001 | ETA 01:38:08 2021-02-23 23:54:24 [INFO] [TRAIN] epoch=204, iter=75660/80000, loss=0.7716, lr=0.000726, batch_cost=1.3650, reader_cost=0.0001 | ETA 01:38:44 2021-02-23 23:54:37 [INFO] [TRAIN] epoch=204, iter=75670/80000, loss=0.8256, lr=0.000725, batch_cost=1.3595, reader_cost=0.0001 | ETA 01:38:06 2021-02-23 23:54:51 [INFO] [TRAIN] epoch=204, iter=75680/80000, loss=0.8067, lr=0.000723, batch_cost=1.3466, reader_cost=0.0001 | ETA 01:36:57 2021-02-23 23:55:04 [INFO] [TRAIN] epoch=204, iter=75690/80000, loss=0.8488, lr=0.000722, batch_cost=1.3401, reader_cost=0.0001 | ETA 01:36:15 2021-02-23 23:55:18 [INFO] [TRAIN] epoch=204, iter=75700/80000, loss=0.7678, lr=0.000720, batch_cost=1.3651, reader_cost=0.0001 | ETA 01:37:50 2021-02-23 23:55:31 [INFO] [TRAIN] epoch=204, iter=75710/80000, loss=0.7980, lr=0.000719, batch_cost=1.3453, reader_cost=0.0001 | ETA 01:36:11 2021-02-23 23:55:45 [INFO] [TRAIN] epoch=204, iter=75720/80000, loss=0.7859, lr=0.000717, batch_cost=1.3748, reader_cost=0.0001 | ETA 01:38:04 2021-02-23 23:55:58 [INFO] [TRAIN] epoch=204, iter=75730/80000, loss=0.8591, lr=0.000716, batch_cost=1.3508, reader_cost=0.0001 | ETA 01:36:07 2021-02-23 23:56:12 [INFO] [TRAIN] epoch=204, iter=75740/80000, loss=0.8147, lr=0.000714, batch_cost=1.3496, reader_cost=0.0001 | ETA 01:35:49 2021-02-23 23:56:25 [INFO] [TRAIN] epoch=204, iter=75750/80000, loss=0.7929, lr=0.000713, batch_cost=1.3554, reader_cost=0.0001 | ETA 01:36:00 2021-02-23 23:56:39 [INFO] [TRAIN] epoch=204, iter=75760/80000, loss=0.7658, lr=0.000711, batch_cost=1.3380, reader_cost=0.0001 | ETA 01:34:33 2021-02-23 23:56:52 [INFO] [TRAIN] epoch=204, iter=75770/80000, loss=0.7791, lr=0.000710, batch_cost=1.3397, reader_cost=0.0001 | ETA 01:34:26 2021-02-23 23:57:06 [INFO] [TRAIN] epoch=204, iter=75780/80000, loss=0.8157, lr=0.000708, batch_cost=1.3772, reader_cost=0.0001 | ETA 01:36:51 2021-02-23 23:57:20 [INFO] [TRAIN] epoch=204, iter=75790/80000, loss=0.8709, lr=0.000707, batch_cost=1.3717, reader_cost=0.0001 | ETA 01:36:14 2021-02-23 23:57:33 [INFO] [TRAIN] epoch=204, iter=75800/80000, loss=0.7497, lr=0.000705, batch_cost=1.3679, reader_cost=0.0001 | ETA 01:35:45 2021-02-23 23:57:47 [INFO] [TRAIN] epoch=204, iter=75810/80000, loss=0.7500, lr=0.000704, batch_cost=1.3476, reader_cost=0.0001 | ETA 01:34:06 2021-02-23 23:58:00 [INFO] [TRAIN] epoch=204, iter=75820/80000, loss=0.8146, lr=0.000702, batch_cost=1.3541, reader_cost=0.0001 | ETA 01:34:20 2021-02-23 23:58:14 [INFO] [TRAIN] epoch=204, iter=75830/80000, loss=0.7828, lr=0.000701, batch_cost=1.3824, reader_cost=0.0001 | ETA 01:36:04 2021-02-23 23:58:28 [INFO] [TRAIN] epoch=204, iter=75840/80000, loss=0.8298, lr=0.000699, batch_cost=1.3361, reader_cost=0.0001 | ETA 01:32:38 2021-02-23 23:58:41 [INFO] [TRAIN] epoch=204, iter=75850/80000, loss=0.8540, lr=0.000698, batch_cost=1.3537, reader_cost=0.0001 | ETA 01:33:38 2021-02-23 23:58:54 [INFO] [TRAIN] epoch=204, iter=75860/80000, loss=0.8192, lr=0.000696, batch_cost=1.3235, reader_cost=0.0001 | ETA 01:31:19 2021-02-23 23:59:08 [INFO] [TRAIN] epoch=204, iter=75870/80000, loss=0.7591, lr=0.000694, batch_cost=1.3864, reader_cost=0.0001 | ETA 01:35:25 2021-02-23 23:59:22 [INFO] [TRAIN] epoch=204, iter=75880/80000, loss=0.7785, lr=0.000693, batch_cost=1.3675, reader_cost=0.0001 | ETA 01:33:53 2021-02-23 23:59:36 [INFO] [TRAIN] epoch=205, iter=75890/80000, loss=0.7947, lr=0.000691, batch_cost=1.4052, reader_cost=0.0796 | ETA 01:36:15 2021-02-23 23:59:50 [INFO] [TRAIN] epoch=205, iter=75900/80000, loss=0.7858, lr=0.000690, batch_cost=1.3616, reader_cost=0.0001 | ETA 01:33:02 2021-02-24 00:00:03 [INFO] [TRAIN] epoch=205, iter=75910/80000, loss=0.7767, lr=0.000688, batch_cost=1.3350, reader_cost=0.0001 | ETA 01:31:00 2021-02-24 00:00:17 [INFO] [TRAIN] epoch=205, iter=75920/80000, loss=0.7595, lr=0.000687, batch_cost=1.3655, reader_cost=0.0001 | ETA 01:32:51 2021-02-24 00:00:30 [INFO] [TRAIN] epoch=205, iter=75930/80000, loss=0.7696, lr=0.000685, batch_cost=1.3449, reader_cost=0.0001 | ETA 01:31:13 2021-02-24 00:00:44 [INFO] [TRAIN] epoch=205, iter=75940/80000, loss=0.7653, lr=0.000684, batch_cost=1.3546, reader_cost=0.0001 | ETA 01:31:39 2021-02-24 00:00:57 [INFO] [TRAIN] epoch=205, iter=75950/80000, loss=0.8358, lr=0.000682, batch_cost=1.3385, reader_cost=0.0001 | ETA 01:30:20 2021-02-24 00:01:10 [INFO] [TRAIN] epoch=205, iter=75960/80000, loss=0.8291, lr=0.000681, batch_cost=1.3255, reader_cost=0.0001 | ETA 01:29:15 2021-02-24 00:01:24 [INFO] [TRAIN] epoch=205, iter=75970/80000, loss=0.8464, lr=0.000679, batch_cost=1.3833, reader_cost=0.0001 | ETA 01:32:54 2021-02-24 00:01:38 [INFO] [TRAIN] epoch=205, iter=75980/80000, loss=0.7783, lr=0.000678, batch_cost=1.3912, reader_cost=0.0001 | ETA 01:33:12 2021-02-24 00:01:52 [INFO] [TRAIN] epoch=205, iter=75990/80000, loss=0.7788, lr=0.000676, batch_cost=1.3689, reader_cost=0.0001 | ETA 01:31:29 2021-02-24 00:02:05 [INFO] [TRAIN] epoch=205, iter=76000/80000, loss=0.7762, lr=0.000675, batch_cost=1.3299, reader_cost=0.0001 | ETA 01:28:39 2021-02-24 00:02:05 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:12 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 59s - batch_cost: 0.1900 - reader cost: 0.0657  3/125 [..............................] - ETA: 56s - batch_cost: 0.2680 - reader cost: 0.1027 4/125 [..............................] - ETA: 55s - batch_cost: 0.3087 - reader cost: 0.1220 5/125 [>.............................] - ETA: 53s - batch_cost: 0.3323 - reader cost: 0.1329 6/125 [>.............................] - ETA: 53s - batch_cost: 0.3526 - reader cost: 0.1451 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3603 - reader cost: 0.1458 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3695 - reader cost: 0.1509 9/125 [=>............................] - ETA: 50s - batch_cost: 0.3717 - reader cost: 0.1494 10/125 [=>............................] - ETA: 49s - batch_cost: 0.3728 - reader cost: 0.1479 11/125 [=>............................] - ETA: 49s - batch_cost: 0.3778 - reader cost: 0.1508 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3848 - reader cost: 0.1557 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3843 - reader cost: 0.1532 14/125 [==>...........................] - ETA: 47s - batch_cost: 0.3898 - reader cost: 0.1569 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3926 - reader cost: 0.1581 16/125 [==>...........................] - ETA: 46s - batch_cost: 0.3916 - reader cost: 0.1563 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3940 - reader cost: 0.1580 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3955 - reader cost: 0.1588 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3976 - reader cost: 0.1595 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3973 - reader cost: 0.1581 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.3962 - reader cost: 0.1565 22/125 [====>.........................] - ETA: 43s - batch_cost: 0.3956 - reader cost: 0.1555 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.3965 - reader cost: 0.1562 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.3953 - reader cost: 0.1544 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.3966 - reader cost: 0.1554 26/125 [=====>........................] - ETA: 41s - batch_cost: 0.3963 - reader cost: 0.1549 27/125 [=====>........................] - ETA: 40s - batch_cost: 0.3963 - reader cost: 0.1546 28/125 [=====>........................] - ETA: 40s - batch_cost: 0.3986 - reader cost: 0.1566 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.3999 - reader cost: 0.1574 30/125 [======>.......................] - ETA: 39s - batch_cost: 0.4013 - reader cost: 0.1585 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.4025 - reader cost: 0.1594 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4035 - reader cost: 0.1601 33/125 [======>.......................] - ETA: 38s - batch_cost: 0.4053 - reader cost: 0.1618 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4062 - reader cost: 0.1623 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4069 - reader cost: 0.1628 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4073 - reader cost: 0.1632 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4079 - reader cost: 0.1635 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4070 - reader cost: 0.1623 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4072 - reader cost: 0.1624 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4071 - reader cost: 0.1622 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4074 - reader cost: 0.1624 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4091 - reader cost: 0.1636 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4081 - reader cost: 0.1625 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4090 - reader cost: 0.1633 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4095 - reader cost: 0.1636 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4099 - reader cost: 0.1640 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4108 - reader cost: 0.1647 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4111 - reader cost: 0.1650 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4115 - reader cost: 0.1653 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4116 - reader cost: 0.1654 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4108 - reader cost: 0.1645 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4105 - reader cost: 0.1642 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4114 - reader cost: 0.1650 54/125 [===========>..................] - ETA: 30s - batch_cost: 0.4120 - reader cost: 0.1656 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4125 - reader cost: 0.1660 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4117 - reader cost: 0.1650 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4123 - reader cost: 0.1655 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4124 - reader cost: 0.1657 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4127 - reader cost: 0.1658 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4129 - reader cost: 0.1660 61/125 [=============>................] - ETA: 27s - batch_cost: 0.4133 - reader cost: 0.1662 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4135 - reader cost: 0.1664 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4136 - reader cost: 0.1663 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4138 - reader cost: 0.1665 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4132 - reader cost: 0.1658 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4126 - reader cost: 0.1652 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4131 - reader cost: 0.1655 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4125 - reader cost: 0.1649 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4125 - reader cost: 0.1648 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4128 - reader cost: 0.1651 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4125 - reader cost: 0.1647 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4123 - reader cost: 0.1645 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4118 - reader cost: 0.1640 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4125 - reader cost: 0.1645 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4125 - reader cost: 0.1645 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4122 - reader cost: 0.1639 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4114 - reader cost: 0.1630 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4117 - reader cost: 0.1633 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4122 - reader cost: 0.1638 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4125 - reader cost: 0.1640 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4122 - reader cost: 0.1635 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4123 - reader cost: 0.1635 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4117 - reader cost: 0.1628 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4122 - reader cost: 0.1631 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4123 - reader cost: 0.1631 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4127 - reader cost: 0.1634 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4122 - reader cost: 0.1629 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4123 - reader cost: 0.1630 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4124 - reader cost: 0.1631 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4127 - reader cost: 0.1634 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4130 - reader cost: 0.1636 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4134 - reader cost: 0.1640 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4129 - reader cost: 0.1636 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4132 - reader cost: 0.1639 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4134 - reader cost: 0.1641 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4135 - reader cost: 0.1642 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4132 - reader cost: 0.1639 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4138 - reader cost: 0.1645 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4141 - reader cost: 0.1648 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4143 - reader cost: 0.1649 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4144 - reader cost: 0.1650 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4138 - reader cost: 0.1644  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4140 - reader cost: 0.1645 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4140 - reader cost: 0.1646 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4142 - reader cost: 0.1648 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4143 - reader cost: 0.1648 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4139 - reader cost: 0.1644 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4140 - reader cost: 0.1645 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4140 - reader cost: 0.1644 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4140 - reader cost: 0.1645 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4145 - reader cost: 0.1650 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4147 - reader cost: 0.1651 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4149 - reader cost: 0.1653 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4152 - reader cost: 0.1654 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4146 - reader cost: 0.1649 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4148 - reader cost: 0.1650 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4151 - reader cost: 0.1653 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4153 - reader cost: 0.1654 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4154 - reader cost: 0.1656 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4155 - reader cost: 0.1657 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4156 - reader cost: 0.1658 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4156 - reader cost: 0.1658 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4157 - reader cost: 0.1659 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4155 - reader cost: 0.1657 125/125 [==============================] - 53s 420ms/step - batch_cost: 0.4153 - reader cost: 0.1655 2021-02-24 00:02:58 [INFO] [EVAL] #Images=500 mIoU=0.8095 Acc=0.9654 Kappa=0.9550 2021-02-24 00:02:58 [INFO] [EVAL] Class IoU: [0.9836 0.8636 0.935 0.5246 0.6588 0.6973 0.7614 0.8333 0.9292 0.6202 0.9549 0.8495 0.6713 0.9587 0.8455 0.9104 0.8642 0.712 0.8072] 2021-02-24 00:02:58 [INFO] [EVAL] Class Acc: [0.9914 0.9215 0.9623 0.9071 0.8121 0.8467 0.8493 0.9229 0.9582 0.8362 0.9724 0.9064 0.7942 0.976 0.9631 0.9618 0.9592 0.8563 0.8826] 2021-02-24 00:03:05 [INFO] [EVAL] The model with the best validation mIoU (0.8095) was saved at iter 76000. 2021-02-24 00:03:18 [INFO] [TRAIN] epoch=205, iter=76010/80000, loss=0.7482, lr=0.000673, batch_cost=1.3344, reader_cost=0.0001 | ETA 01:28:44 2021-02-24 00:03:32 [INFO] [TRAIN] epoch=205, iter=76020/80000, loss=0.8151, lr=0.000672, batch_cost=1.3597, reader_cost=0.0001 | ETA 01:30:11 2021-02-24 00:03:46 [INFO] [TRAIN] epoch=205, iter=76030/80000, loss=0.8133, lr=0.000670, batch_cost=1.3898, reader_cost=0.0001 | ETA 01:31:57 2021-02-24 00:04:00 [INFO] [TRAIN] epoch=205, iter=76040/80000, loss=0.7999, lr=0.000669, batch_cost=1.3670, reader_cost=0.0001 | ETA 01:30:13 2021-02-24 00:04:13 [INFO] [TRAIN] epoch=205, iter=76050/80000, loss=0.7899, lr=0.000667, batch_cost=1.3364, reader_cost=0.0001 | ETA 01:27:58 2021-02-24 00:04:26 [INFO] [TRAIN] epoch=205, iter=76060/80000, loss=0.7502, lr=0.000666, batch_cost=1.3473, reader_cost=0.0001 | ETA 01:28:28 2021-02-24 00:04:41 [INFO] [TRAIN] epoch=205, iter=76070/80000, loss=0.7655, lr=0.000664, batch_cost=1.4212, reader_cost=0.0001 | ETA 01:33:05 2021-02-24 00:04:54 [INFO] [TRAIN] epoch=205, iter=76080/80000, loss=0.7687, lr=0.000663, batch_cost=1.3393, reader_cost=0.0001 | ETA 01:27:30 2021-02-24 00:05:08 [INFO] [TRAIN] epoch=205, iter=76090/80000, loss=0.7987, lr=0.000661, batch_cost=1.3510, reader_cost=0.0001 | ETA 01:28:02 2021-02-24 00:05:21 [INFO] [TRAIN] epoch=205, iter=76100/80000, loss=0.8454, lr=0.000660, batch_cost=1.3395, reader_cost=0.0001 | ETA 01:27:03 2021-02-24 00:05:34 [INFO] [TRAIN] epoch=205, iter=76110/80000, loss=0.8094, lr=0.000658, batch_cost=1.3487, reader_cost=0.0001 | ETA 01:27:26 2021-02-24 00:05:48 [INFO] [TRAIN] epoch=205, iter=76120/80000, loss=0.7820, lr=0.000657, batch_cost=1.3554, reader_cost=0.0001 | ETA 01:27:39 2021-02-24 00:06:02 [INFO] [TRAIN] epoch=205, iter=76130/80000, loss=0.8031, lr=0.000655, batch_cost=1.3560, reader_cost=0.0001 | ETA 01:27:27 2021-02-24 00:06:15 [INFO] [TRAIN] epoch=205, iter=76140/80000, loss=0.7742, lr=0.000654, batch_cost=1.3569, reader_cost=0.0001 | ETA 01:27:17 2021-02-24 00:06:29 [INFO] [TRAIN] epoch=205, iter=76150/80000, loss=0.8493, lr=0.000652, batch_cost=1.3379, reader_cost=0.0001 | ETA 01:25:50 2021-02-24 00:06:42 [INFO] [TRAIN] epoch=205, iter=76160/80000, loss=0.7864, lr=0.000650, batch_cost=1.3393, reader_cost=0.0001 | ETA 01:25:43 2021-02-24 00:06:56 [INFO] [TRAIN] epoch=205, iter=76170/80000, loss=0.7838, lr=0.000649, batch_cost=1.3765, reader_cost=0.0001 | ETA 01:27:52 2021-02-24 00:07:09 [INFO] [TRAIN] epoch=205, iter=76180/80000, loss=0.7578, lr=0.000647, batch_cost=1.3586, reader_cost=0.0001 | ETA 01:26:29 2021-02-24 00:07:23 [INFO] [TRAIN] epoch=205, iter=76190/80000, loss=0.8127, lr=0.000646, batch_cost=1.3531, reader_cost=0.0001 | ETA 01:25:55 2021-02-24 00:07:36 [INFO] [TRAIN] epoch=205, iter=76200/80000, loss=0.7811, lr=0.000644, batch_cost=1.3268, reader_cost=0.0001 | ETA 01:24:01 2021-02-24 00:07:50 [INFO] [TRAIN] epoch=205, iter=76210/80000, loss=0.7758, lr=0.000643, batch_cost=1.3731, reader_cost=0.0001 | ETA 01:26:43 2021-02-24 00:08:03 [INFO] [TRAIN] epoch=205, iter=76220/80000, loss=0.8160, lr=0.000641, batch_cost=1.3608, reader_cost=0.0001 | ETA 01:25:43 2021-02-24 00:08:17 [INFO] [TRAIN] epoch=205, iter=76230/80000, loss=0.7715, lr=0.000640, batch_cost=1.3697, reader_cost=0.0001 | ETA 01:26:03 2021-02-24 00:08:30 [INFO] [TRAIN] epoch=205, iter=76240/80000, loss=0.8488, lr=0.000638, batch_cost=1.3335, reader_cost=0.0001 | ETA 01:23:33 2021-02-24 00:08:44 [INFO] [TRAIN] epoch=205, iter=76250/80000, loss=0.8101, lr=0.000637, batch_cost=1.3500, reader_cost=0.0001 | ETA 01:24:22 2021-02-24 00:08:57 [INFO] [TRAIN] epoch=205, iter=76260/80000, loss=0.8185, lr=0.000635, batch_cost=1.3259, reader_cost=0.0001 | ETA 01:22:38 2021-02-24 00:09:12 [INFO] [TRAIN] epoch=206, iter=76270/80000, loss=0.7891, lr=0.000634, batch_cost=1.4997, reader_cost=0.0658 | ETA 01:33:14 2021-02-24 00:09:26 [INFO] [TRAIN] epoch=206, iter=76280/80000, loss=0.7604, lr=0.000632, batch_cost=1.3560, reader_cost=0.0001 | ETA 01:24:04 2021-02-24 00:09:39 [INFO] [TRAIN] epoch=206, iter=76290/80000, loss=0.8040, lr=0.000631, batch_cost=1.3516, reader_cost=0.0001 | ETA 01:23:34 2021-02-24 00:09:52 [INFO] [TRAIN] epoch=206, iter=76300/80000, loss=0.7963, lr=0.000629, batch_cost=1.3007, reader_cost=0.0001 | ETA 01:20:12 2021-02-24 00:10:06 [INFO] [TRAIN] epoch=206, iter=76310/80000, loss=0.8167, lr=0.000628, batch_cost=1.3469, reader_cost=0.0001 | ETA 01:22:50 2021-02-24 00:10:19 [INFO] [TRAIN] epoch=206, iter=76320/80000, loss=0.8055, lr=0.000626, batch_cost=1.3405, reader_cost=0.0001 | ETA 01:22:13 2021-02-24 00:10:32 [INFO] [TRAIN] epoch=206, iter=76330/80000, loss=0.8158, lr=0.000624, batch_cost=1.3287, reader_cost=0.0001 | ETA 01:21:16 2021-02-24 00:10:46 [INFO] [TRAIN] epoch=206, iter=76340/80000, loss=0.8342, lr=0.000623, batch_cost=1.3702, reader_cost=0.0001 | ETA 01:23:35 2021-02-24 00:10:59 [INFO] [TRAIN] epoch=206, iter=76350/80000, loss=0.8002, lr=0.000621, batch_cost=1.3285, reader_cost=0.0001 | ETA 01:20:49 2021-02-24 00:11:13 [INFO] [TRAIN] epoch=206, iter=76360/80000, loss=0.7842, lr=0.000620, batch_cost=1.3548, reader_cost=0.0001 | ETA 01:22:11 2021-02-24 00:11:26 [INFO] [TRAIN] epoch=206, iter=76370/80000, loss=0.7902, lr=0.000618, batch_cost=1.3362, reader_cost=0.0001 | ETA 01:20:50 2021-02-24 00:11:40 [INFO] [TRAIN] epoch=206, iter=76380/80000, loss=0.7659, lr=0.000617, batch_cost=1.3753, reader_cost=0.0001 | ETA 01:22:58 2021-02-24 00:11:54 [INFO] [TRAIN] epoch=206, iter=76390/80000, loss=0.7885, lr=0.000615, batch_cost=1.3486, reader_cost=0.0001 | ETA 01:21:08 2021-02-24 00:12:07 [INFO] [TRAIN] epoch=206, iter=76400/80000, loss=0.7930, lr=0.000614, batch_cost=1.3416, reader_cost=0.0001 | ETA 01:20:29 2021-02-24 00:12:20 [INFO] [TRAIN] epoch=206, iter=76410/80000, loss=0.8108, lr=0.000612, batch_cost=1.3463, reader_cost=0.0001 | ETA 01:20:33 2021-02-24 00:12:34 [INFO] [TRAIN] epoch=206, iter=76420/80000, loss=0.7970, lr=0.000611, batch_cost=1.3490, reader_cost=0.0001 | ETA 01:20:29 2021-02-24 00:12:47 [INFO] [TRAIN] epoch=206, iter=76430/80000, loss=0.7907, lr=0.000609, batch_cost=1.3265, reader_cost=0.0001 | ETA 01:18:55 2021-02-24 00:13:01 [INFO] [TRAIN] epoch=206, iter=76440/80000, loss=0.7977, lr=0.000608, batch_cost=1.3589, reader_cost=0.0001 | ETA 01:20:37 2021-02-24 00:13:14 [INFO] [TRAIN] epoch=206, iter=76450/80000, loss=0.7930, lr=0.000606, batch_cost=1.3319, reader_cost=0.0001 | ETA 01:18:48 2021-02-24 00:13:28 [INFO] [TRAIN] epoch=206, iter=76460/80000, loss=0.8249, lr=0.000605, batch_cost=1.3373, reader_cost=0.0001 | ETA 01:18:54 2021-02-24 00:13:41 [INFO] [TRAIN] epoch=206, iter=76470/80000, loss=0.7848, lr=0.000603, batch_cost=1.3451, reader_cost=0.0001 | ETA 01:19:08 2021-02-24 00:13:55 [INFO] [TRAIN] epoch=206, iter=76480/80000, loss=0.8052, lr=0.000601, batch_cost=1.3769, reader_cost=0.0001 | ETA 01:20:46 2021-02-24 00:14:09 [INFO] [TRAIN] epoch=206, iter=76490/80000, loss=0.7981, lr=0.000600, batch_cost=1.3933, reader_cost=0.0001 | ETA 01:21:30 2021-02-24 00:14:22 [INFO] [TRAIN] epoch=206, iter=76500/80000, loss=0.8115, lr=0.000598, batch_cost=1.3365, reader_cost=0.0001 | ETA 01:17:57 2021-02-24 00:14:36 [INFO] [TRAIN] epoch=206, iter=76510/80000, loss=0.7790, lr=0.000597, batch_cost=1.3713, reader_cost=0.0001 | ETA 01:19:45 2021-02-24 00:14:49 [INFO] [TRAIN] epoch=206, iter=76520/80000, loss=0.7937, lr=0.000595, batch_cost=1.3438, reader_cost=0.0001 | ETA 01:17:56 2021-02-24 00:15:03 [INFO] [TRAIN] epoch=206, iter=76530/80000, loss=0.7839, lr=0.000594, batch_cost=1.3705, reader_cost=0.0001 | ETA 01:19:15 2021-02-24 00:15:16 [INFO] [TRAIN] epoch=206, iter=76540/80000, loss=0.8019, lr=0.000592, batch_cost=1.3524, reader_cost=0.0001 | ETA 01:17:59 2021-02-24 00:15:30 [INFO] [TRAIN] epoch=206, iter=76550/80000, loss=0.8305, lr=0.000591, batch_cost=1.3509, reader_cost=0.0001 | ETA 01:17:40 2021-02-24 00:15:43 [INFO] [TRAIN] epoch=206, iter=76560/80000, loss=0.8061, lr=0.000589, batch_cost=1.3264, reader_cost=0.0001 | ETA 01:16:02 2021-02-24 00:15:57 [INFO] [TRAIN] epoch=206, iter=76570/80000, loss=0.8632, lr=0.000588, batch_cost=1.3443, reader_cost=0.0001 | ETA 01:16:50 2021-02-24 00:16:10 [INFO] [TRAIN] epoch=206, iter=76580/80000, loss=0.8037, lr=0.000586, batch_cost=1.3716, reader_cost=0.0001 | ETA 01:18:11 2021-02-24 00:16:24 [INFO] [TRAIN] epoch=206, iter=76590/80000, loss=0.7621, lr=0.000585, batch_cost=1.3346, reader_cost=0.0001 | ETA 01:15:50 2021-02-24 00:16:37 [INFO] [TRAIN] epoch=206, iter=76600/80000, loss=0.7529, lr=0.000583, batch_cost=1.3340, reader_cost=0.0001 | ETA 01:15:35 2021-02-24 00:16:51 [INFO] [TRAIN] epoch=206, iter=76610/80000, loss=0.8062, lr=0.000581, batch_cost=1.3622, reader_cost=0.0001 | ETA 01:16:57 2021-02-24 00:17:04 [INFO] [TRAIN] epoch=206, iter=76620/80000, loss=0.7763, lr=0.000580, batch_cost=1.3498, reader_cost=0.0001 | ETA 01:16:02 2021-02-24 00:17:17 [INFO] [TRAIN] epoch=206, iter=76630/80000, loss=0.7952, lr=0.000578, batch_cost=1.3227, reader_cost=0.0001 | ETA 01:14:17 2021-02-24 00:17:32 [INFO] [TRAIN] epoch=207, iter=76640/80000, loss=0.8121, lr=0.000577, batch_cost=1.4514, reader_cost=0.0796 | ETA 01:21:16 2021-02-24 00:17:46 [INFO] [TRAIN] epoch=207, iter=76650/80000, loss=0.7568, lr=0.000575, batch_cost=1.3715, reader_cost=0.0001 | ETA 01:16:34 2021-02-24 00:17:59 [INFO] [TRAIN] epoch=207, iter=76660/80000, loss=0.8436, lr=0.000574, batch_cost=1.3629, reader_cost=0.0001 | ETA 01:15:52 2021-02-24 00:18:13 [INFO] [TRAIN] epoch=207, iter=76670/80000, loss=0.7691, lr=0.000572, batch_cost=1.3591, reader_cost=0.0001 | ETA 01:15:25 2021-02-24 00:18:27 [INFO] [TRAIN] epoch=207, iter=76680/80000, loss=0.7951, lr=0.000571, batch_cost=1.3677, reader_cost=0.0001 | ETA 01:15:40 2021-02-24 00:18:40 [INFO] [TRAIN] epoch=207, iter=76690/80000, loss=0.7739, lr=0.000569, batch_cost=1.3308, reader_cost=0.0001 | ETA 01:13:24 2021-02-24 00:18:53 [INFO] [TRAIN] epoch=207, iter=76700/80000, loss=0.7967, lr=0.000568, batch_cost=1.3478, reader_cost=0.0001 | ETA 01:14:07 2021-02-24 00:19:07 [INFO] [TRAIN] epoch=207, iter=76710/80000, loss=0.7819, lr=0.000566, batch_cost=1.3338, reader_cost=0.0001 | ETA 01:13:08 2021-02-24 00:19:21 [INFO] [TRAIN] epoch=207, iter=76720/80000, loss=0.7934, lr=0.000564, batch_cost=1.4096, reader_cost=0.0001 | ETA 01:17:03 2021-02-24 00:19:34 [INFO] [TRAIN] epoch=207, iter=76730/80000, loss=0.8281, lr=0.000563, batch_cost=1.3579, reader_cost=0.0001 | ETA 01:14:00 2021-02-24 00:19:48 [INFO] [TRAIN] epoch=207, iter=76740/80000, loss=0.8150, lr=0.000561, batch_cost=1.3847, reader_cost=0.0001 | ETA 01:15:14 2021-02-24 00:20:02 [INFO] [TRAIN] epoch=207, iter=76750/80000, loss=0.7682, lr=0.000560, batch_cost=1.3381, reader_cost=0.0001 | ETA 01:12:28 2021-02-24 00:20:15 [INFO] [TRAIN] epoch=207, iter=76760/80000, loss=0.8045, lr=0.000558, batch_cost=1.3760, reader_cost=0.0001 | ETA 01:14:18 2021-02-24 00:20:29 [INFO] [TRAIN] epoch=207, iter=76770/80000, loss=0.7448, lr=0.000557, batch_cost=1.3523, reader_cost=0.0001 | ETA 01:12:47 2021-02-24 00:20:42 [INFO] [TRAIN] epoch=207, iter=76780/80000, loss=0.8153, lr=0.000555, batch_cost=1.3616, reader_cost=0.0001 | ETA 01:13:04 2021-02-24 00:20:56 [INFO] [TRAIN] epoch=207, iter=76790/80000, loss=0.8033, lr=0.000554, batch_cost=1.3368, reader_cost=0.0001 | ETA 01:11:31 2021-02-24 00:21:09 [INFO] [TRAIN] epoch=207, iter=76800/80000, loss=0.8085, lr=0.000552, batch_cost=1.3401, reader_cost=0.0001 | ETA 01:11:28 2021-02-24 00:21:23 [INFO] [TRAIN] epoch=207, iter=76810/80000, loss=0.8213, lr=0.000550, batch_cost=1.3864, reader_cost=0.0001 | ETA 01:13:42 2021-02-24 00:21:36 [INFO] [TRAIN] epoch=207, iter=76820/80000, loss=0.8077, lr=0.000549, batch_cost=1.3205, reader_cost=0.0001 | ETA 01:09:59 2021-02-24 00:21:50 [INFO] [TRAIN] epoch=207, iter=76830/80000, loss=0.7975, lr=0.000547, batch_cost=1.3566, reader_cost=0.0001 | ETA 01:11:40 2021-02-24 00:22:03 [INFO] [TRAIN] epoch=207, iter=76840/80000, loss=0.8139, lr=0.000546, batch_cost=1.3616, reader_cost=0.0001 | ETA 01:11:42 2021-02-24 00:22:17 [INFO] [TRAIN] epoch=207, iter=76850/80000, loss=0.7774, lr=0.000544, batch_cost=1.3346, reader_cost=0.0001 | ETA 01:10:04 2021-02-24 00:22:30 [INFO] [TRAIN] epoch=207, iter=76860/80000, loss=0.7781, lr=0.000543, batch_cost=1.3422, reader_cost=0.0001 | ETA 01:10:14 2021-02-24 00:22:44 [INFO] [TRAIN] epoch=207, iter=76870/80000, loss=0.7677, lr=0.000541, batch_cost=1.3544, reader_cost=0.0001 | ETA 01:10:39 2021-02-24 00:22:57 [INFO] [TRAIN] epoch=207, iter=76880/80000, loss=0.7647, lr=0.000540, batch_cost=1.3369, reader_cost=0.0001 | ETA 01:09:31 2021-02-24 00:23:10 [INFO] [TRAIN] epoch=207, iter=76890/80000, loss=0.8127, lr=0.000538, batch_cost=1.3243, reader_cost=0.0001 | ETA 01:08:38 2021-02-24 00:23:24 [INFO] [TRAIN] epoch=207, iter=76900/80000, loss=0.7593, lr=0.000537, batch_cost=1.3338, reader_cost=0.0001 | ETA 01:08:54 2021-02-24 00:23:37 [INFO] [TRAIN] epoch=207, iter=76910/80000, loss=0.7631, lr=0.000535, batch_cost=1.3502, reader_cost=0.0001 | ETA 01:09:32 2021-02-24 00:23:51 [INFO] [TRAIN] epoch=207, iter=76920/80000, loss=0.7540, lr=0.000533, batch_cost=1.3458, reader_cost=0.0001 | ETA 01:09:04 2021-02-24 00:24:05 [INFO] [TRAIN] epoch=207, iter=76930/80000, loss=0.7942, lr=0.000532, batch_cost=1.3792, reader_cost=0.0001 | ETA 01:10:34 2021-02-24 00:24:18 [INFO] [TRAIN] epoch=207, iter=76940/80000, loss=0.8108, lr=0.000530, batch_cost=1.3783, reader_cost=0.0001 | ETA 01:10:17 2021-02-24 00:24:32 [INFO] [TRAIN] epoch=207, iter=76950/80000, loss=0.7808, lr=0.000529, batch_cost=1.3760, reader_cost=0.0001 | ETA 01:09:56 2021-02-24 00:24:46 [INFO] [TRAIN] epoch=207, iter=76960/80000, loss=0.7558, lr=0.000527, batch_cost=1.3607, reader_cost=0.0001 | ETA 01:08:56 2021-02-24 00:24:59 [INFO] [TRAIN] epoch=207, iter=76970/80000, loss=0.7679, lr=0.000526, batch_cost=1.3529, reader_cost=0.0001 | ETA 01:08:19 2021-02-24 00:25:13 [INFO] [TRAIN] epoch=207, iter=76980/80000, loss=0.7721, lr=0.000524, batch_cost=1.3638, reader_cost=0.0001 | ETA 01:08:38 2021-02-24 00:25:26 [INFO] [TRAIN] epoch=207, iter=76990/80000, loss=0.8378, lr=0.000522, batch_cost=1.3401, reader_cost=0.0001 | ETA 01:07:13 2021-02-24 00:25:40 [INFO] [TRAIN] epoch=207, iter=77000/80000, loss=0.7789, lr=0.000521, batch_cost=1.3426, reader_cost=0.0001 | ETA 01:07:07 2021-02-24 00:25:40 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:16 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:04 - batch_cost: 0.2124 - reader cost: 0.0899  3/125 [..............................] - ETA: 1:01 - batch_cost: 0.2970 - reader cost: 0.1307 4/125 [..............................] - ETA: 58s - batch_cost: 0.3274 - reader cost: 0.1401  5/125 [>.............................] - ETA: 56s - batch_cost: 0.3487 - reader cost: 0.1480 6/125 [>.............................] - ETA: 55s - batch_cost: 0.3636 - reader cost: 0.1534 7/125 [>.............................] - ETA: 53s - batch_cost: 0.3647 - reader cost: 0.1492 8/125 [>.............................] - ETA: 53s - batch_cost: 0.3758 - reader cost: 0.1563 9/125 [=>............................] - ETA: 52s - batch_cost: 0.3828 - reader cost: 0.1602 10/125 [=>............................] - ETA: 51s - batch_cost: 0.3829 - reader cost: 0.1575 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3826 - reader cost: 0.1547 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3872 - reader cost: 0.1578 13/125 [==>...........................] - ETA: 49s - batch_cost: 0.3925 - reader cost: 0.1613 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3912 - reader cost: 0.1585 15/125 [==>...........................] - ETA: 47s - batch_cost: 0.3914 - reader cost: 0.1577 16/125 [==>...........................] - ETA: 46s - batch_cost: 0.3911 - reader cost: 0.1564 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3940 - reader cost: 0.1582 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3954 - reader cost: 0.1590 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3976 - reader cost: 0.1604 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.3995 - reader cost: 0.1617 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4008 - reader cost: 0.1622 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4024 - reader cost: 0.1633 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4019 - reader cost: 0.1619 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4000 - reader cost: 0.1598 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.3986 - reader cost: 0.1580 26/125 [=====>........................] - ETA: 41s - batch_cost: 0.4003 - reader cost: 0.1589 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4011 - reader cost: 0.1595 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4021 - reader cost: 0.1602 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4007 - reader cost: 0.1586 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4018 - reader cost: 0.1592 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.4004 - reader cost: 0.1576 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4011 - reader cost: 0.1581 33/125 [======>.......................] - ETA: 38s - batch_cost: 0.4017 - reader cost: 0.1586 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4026 - reader cost: 0.1593 35/125 [=======>......................] - ETA: 37s - batch_cost: 0.4031 - reader cost: 0.1598 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4038 - reader cost: 0.1603 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4055 - reader cost: 0.1617 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4063 - reader cost: 0.1622 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4069 - reader cost: 0.1626 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4062 - reader cost: 0.1617 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4065 - reader cost: 0.1619 42/125 [=========>....................] - ETA: 34s - batch_cost: 0.4057 - reader cost: 0.1609 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4064 - reader cost: 0.1615 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4059 - reader cost: 0.1609 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4054 - reader cost: 0.1602 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4059 - reader cost: 0.1606 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4065 - reader cost: 0.1610 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4069 - reader cost: 0.1614 49/125 [==========>...................] - ETA: 31s - batch_cost: 0.4077 - reader cost: 0.1619 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4084 - reader cost: 0.1626 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4089 - reader cost: 0.1629 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4087 - reader cost: 0.1624 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4093 - reader cost: 0.1626 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4094 - reader cost: 0.1625 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4094 - reader cost: 0.1623 56/125 [============>.................] - ETA: 28s - batch_cost: 0.4088 - reader cost: 0.1617 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4094 - reader cost: 0.1622 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4108 - reader cost: 0.1636 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4105 - reader cost: 0.1631 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4110 - reader cost: 0.1635 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4116 - reader cost: 0.1641 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4114 - reader cost: 0.1638 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4109 - reader cost: 0.1633 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4115 - reader cost: 0.1639 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4120 - reader cost: 0.1642 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4118 - reader cost: 0.1640 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4124 - reader cost: 0.1644 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4129 - reader cost: 0.1648 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4131 - reader cost: 0.1648 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4137 - reader cost: 0.1654 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4132 - reader cost: 0.1649 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4136 - reader cost: 0.1653 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4141 - reader cost: 0.1656 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4142 - reader cost: 0.1657 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4146 - reader cost: 0.1660 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4152 - reader cost: 0.1666 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4159 - reader cost: 0.1672 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4160 - reader cost: 0.1673 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4156 - reader cost: 0.1667 80/125 [==================>...........] - ETA: 19s - batch_cost: 0.4152 - reader cost: 0.1663 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4153 - reader cost: 0.1664 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4151 - reader cost: 0.1662 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4147 - reader cost: 0.1658 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4144 - reader cost: 0.1654 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4142 - reader cost: 0.1651 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4141 - reader cost: 0.1650 87/125 [===================>..........] - ETA: 16s - batch_cost: 0.4146 - reader cost: 0.1655 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4150 - reader cost: 0.1659 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4145 - reader cost: 0.1655 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4147 - reader cost: 0.1656 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4151 - reader cost: 0.1660 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4147 - reader cost: 0.1655 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4147 - reader cost: 0.1654 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4145 - reader cost: 0.1652 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4146 - reader cost: 0.1654 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4140 - reader cost: 0.1648 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4144 - reader cost: 0.1652 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4145 - reader cost: 0.1651 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4138 - reader cost: 0.1643 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4143 - reader cost: 0.1649 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4146 - reader cost: 0.1651 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4147 - reader cost: 0.1652  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4150 - reader cost: 0.1655 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4153 - reader cost: 0.1658 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4151 - reader cost: 0.1656 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4150 - reader cost: 0.1655 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4153 - reader cost: 0.1658 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4153 - reader cost: 0.1658 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4156 - reader cost: 0.1661 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4160 - reader cost: 0.1665 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4160 - reader cost: 0.1665 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4165 - reader cost: 0.1669 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4162 - reader cost: 0.1666 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4158 - reader cost: 0.1662 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4161 - reader cost: 0.1665 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4158 - reader cost: 0.1662 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4154 - reader cost: 0.1657 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4151 - reader cost: 0.1654 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4150 - reader cost: 0.1651 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4152 - reader cost: 0.1654 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4153 - reader cost: 0.1655 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4155 - reader cost: 0.1657 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4153 - reader cost: 0.1655 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4156 - reader cost: 0.1657 125/125 [==============================] - 53s 420ms/step - batch_cost: 0.4153 - reader cost: 0.1653 2021-02-24 00:26:32 [INFO] [EVAL] #Images=500 mIoU=0.8110 Acc=0.9649 Kappa=0.9544 2021-02-24 00:26:32 [INFO] [EVAL] Class IoU: [0.9822 0.8569 0.9337 0.5502 0.6262 0.7022 0.7632 0.8377 0.9296 0.6445 0.9548 0.8487 0.6692 0.9589 0.8441 0.9147 0.8661 0.7175 0.8085] 2021-02-24 00:26:32 [INFO] [EVAL] Class Acc: [0.9889 0.9313 0.9608 0.8427 0.8438 0.841 0.8612 0.9218 0.961 0.8152 0.9721 0.9042 0.8152 0.9758 0.9559 0.9644 0.9771 0.8616 0.8826] 2021-02-24 00:26:39 [INFO] [EVAL] The model with the best validation mIoU (0.8110) was saved at iter 77000. 2021-02-24 00:26:54 [INFO] [TRAIN] epoch=208, iter=77010/80000, loss=0.7633, lr=0.000519, batch_cost=1.4118, reader_cost=0.0644 | ETA 01:10:21 2021-02-24 00:27:07 [INFO] [TRAIN] epoch=208, iter=77020/80000, loss=0.7768, lr=0.000518, batch_cost=1.3518, reader_cost=0.0001 | ETA 01:07:08 2021-02-24 00:27:21 [INFO] [TRAIN] epoch=208, iter=77030/80000, loss=0.8040, lr=0.000516, batch_cost=1.3983, reader_cost=0.0001 | ETA 01:09:12 2021-02-24 00:27:35 [INFO] [TRAIN] epoch=208, iter=77040/80000, loss=0.7731, lr=0.000515, batch_cost=1.4012, reader_cost=0.0001 | ETA 01:09:07 2021-02-24 00:27:49 [INFO] [TRAIN] epoch=208, iter=77050/80000, loss=0.8114, lr=0.000513, batch_cost=1.3770, reader_cost=0.0001 | ETA 01:07:42 2021-02-24 00:28:02 [INFO] [TRAIN] epoch=208, iter=77060/80000, loss=0.8224, lr=0.000512, batch_cost=1.3543, reader_cost=0.0001 | ETA 01:06:21 2021-02-24 00:28:16 [INFO] [TRAIN] epoch=208, iter=77070/80000, loss=0.8276, lr=0.000510, batch_cost=1.3409, reader_cost=0.0001 | ETA 01:05:28 2021-02-24 00:28:29 [INFO] [TRAIN] epoch=208, iter=77080/80000, loss=0.8383, lr=0.000508, batch_cost=1.3562, reader_cost=0.0001 | ETA 01:06:00 2021-02-24 00:28:43 [INFO] [TRAIN] epoch=208, iter=77090/80000, loss=0.7962, lr=0.000507, batch_cost=1.3770, reader_cost=0.0001 | ETA 01:06:46 2021-02-24 00:28:57 [INFO] [TRAIN] epoch=208, iter=77100/80000, loss=0.7882, lr=0.000505, batch_cost=1.3462, reader_cost=0.0001 | ETA 01:05:03 2021-02-24 00:29:10 [INFO] [TRAIN] epoch=208, iter=77110/80000, loss=0.7692, lr=0.000504, batch_cost=1.3526, reader_cost=0.0001 | ETA 01:05:09 2021-02-24 00:29:24 [INFO] [TRAIN] epoch=208, iter=77120/80000, loss=0.7952, lr=0.000502, batch_cost=1.3651, reader_cost=0.0001 | ETA 01:05:31 2021-02-24 00:29:37 [INFO] [TRAIN] epoch=208, iter=77130/80000, loss=0.7937, lr=0.000501, batch_cost=1.3409, reader_cost=0.0001 | ETA 01:04:08 2021-02-24 00:29:51 [INFO] [TRAIN] epoch=208, iter=77140/80000, loss=0.7831, lr=0.000499, batch_cost=1.3654, reader_cost=0.0001 | ETA 01:05:05 2021-02-24 00:30:05 [INFO] [TRAIN] epoch=208, iter=77150/80000, loss=0.8174, lr=0.000497, batch_cost=1.3635, reader_cost=0.0001 | ETA 01:04:45 2021-02-24 00:30:18 [INFO] [TRAIN] epoch=208, iter=77160/80000, loss=0.8535, lr=0.000496, batch_cost=1.3566, reader_cost=0.0001 | ETA 01:04:12 2021-02-24 00:30:32 [INFO] [TRAIN] epoch=208, iter=77170/80000, loss=0.7647, lr=0.000494, batch_cost=1.3608, reader_cost=0.0001 | ETA 01:04:10 2021-02-24 00:30:45 [INFO] [TRAIN] epoch=208, iter=77180/80000, loss=0.8031, lr=0.000493, batch_cost=1.3302, reader_cost=0.0001 | ETA 01:02:31 2021-02-24 00:30:58 [INFO] [TRAIN] epoch=208, iter=77190/80000, loss=0.7810, lr=0.000491, batch_cost=1.3328, reader_cost=0.0001 | ETA 01:02:25 2021-02-24 00:31:12 [INFO] [TRAIN] epoch=208, iter=77200/80000, loss=0.7911, lr=0.000490, batch_cost=1.3457, reader_cost=0.0001 | ETA 01:02:48 2021-02-24 00:31:25 [INFO] [TRAIN] epoch=208, iter=77210/80000, loss=0.7891, lr=0.000488, batch_cost=1.3587, reader_cost=0.0001 | ETA 01:03:10 2021-02-24 00:31:39 [INFO] [TRAIN] epoch=208, iter=77220/80000, loss=0.7644, lr=0.000486, batch_cost=1.3580, reader_cost=0.0001 | ETA 01:02:55 2021-02-24 00:31:52 [INFO] [TRAIN] epoch=208, iter=77230/80000, loss=0.7675, lr=0.000485, batch_cost=1.3259, reader_cost=0.0001 | ETA 01:01:12 2021-02-24 00:32:06 [INFO] [TRAIN] epoch=208, iter=77240/80000, loss=0.8380, lr=0.000483, batch_cost=1.3784, reader_cost=0.0001 | ETA 01:03:24 2021-02-24 00:32:19 [INFO] [TRAIN] epoch=208, iter=77250/80000, loss=0.8109, lr=0.000482, batch_cost=1.3392, reader_cost=0.0001 | ETA 01:01:22 2021-02-24 00:32:33 [INFO] [TRAIN] epoch=208, iter=77260/80000, loss=0.7976, lr=0.000480, batch_cost=1.3613, reader_cost=0.0001 | ETA 01:02:10 2021-02-24 00:32:47 [INFO] [TRAIN] epoch=208, iter=77270/80000, loss=0.7614, lr=0.000479, batch_cost=1.3518, reader_cost=0.0001 | ETA 01:01:30 2021-02-24 00:33:00 [INFO] [TRAIN] epoch=208, iter=77280/80000, loss=0.8102, lr=0.000477, batch_cost=1.3570, reader_cost=0.0001 | ETA 01:01:30 2021-02-24 00:33:14 [INFO] [TRAIN] epoch=208, iter=77290/80000, loss=0.7795, lr=0.000475, batch_cost=1.3575, reader_cost=0.0001 | ETA 01:01:18 2021-02-24 00:33:27 [INFO] [TRAIN] epoch=208, iter=77300/80000, loss=0.8538, lr=0.000474, batch_cost=1.3429, reader_cost=0.0001 | ETA 01:00:25 2021-02-24 00:33:41 [INFO] [TRAIN] epoch=208, iter=77310/80000, loss=0.7697, lr=0.000472, batch_cost=1.3629, reader_cost=0.0001 | ETA 01:01:06 2021-02-24 00:33:55 [INFO] [TRAIN] epoch=208, iter=77320/80000, loss=0.8486, lr=0.000471, batch_cost=1.3962, reader_cost=0.0001 | ETA 01:02:21 2021-02-24 00:34:08 [INFO] [TRAIN] epoch=208, iter=77330/80000, loss=0.7730, lr=0.000469, batch_cost=1.3824, reader_cost=0.0001 | ETA 01:01:30 2021-02-24 00:34:22 [INFO] [TRAIN] epoch=208, iter=77340/80000, loss=0.7563, lr=0.000467, batch_cost=1.3523, reader_cost=0.0001 | ETA 00:59:57 2021-02-24 00:34:36 [INFO] [TRAIN] epoch=208, iter=77350/80000, loss=0.8577, lr=0.000466, batch_cost=1.3528, reader_cost=0.0001 | ETA 00:59:44 2021-02-24 00:34:49 [INFO] [TRAIN] epoch=208, iter=77360/80000, loss=0.7805, lr=0.000464, batch_cost=1.3669, reader_cost=0.0001 | ETA 01:00:08 2021-02-24 00:35:03 [INFO] [TRAIN] epoch=208, iter=77370/80000, loss=0.8558, lr=0.000463, batch_cost=1.3820, reader_cost=0.0001 | ETA 01:00:34 2021-02-24 00:35:17 [INFO] [TRAIN] epoch=209, iter=77380/80000, loss=0.7688, lr=0.000461, batch_cost=1.4198, reader_cost=0.0731 | ETA 01:01:59 2021-02-24 00:35:31 [INFO] [TRAIN] epoch=209, iter=77390/80000, loss=0.7791, lr=0.000460, batch_cost=1.3449, reader_cost=0.0001 | ETA 00:58:30 2021-02-24 00:35:44 [INFO] [TRAIN] epoch=209, iter=77400/80000, loss=0.7797, lr=0.000458, batch_cost=1.3430, reader_cost=0.0001 | ETA 00:58:11 2021-02-24 00:35:58 [INFO] [TRAIN] epoch=209, iter=77410/80000, loss=0.7804, lr=0.000456, batch_cost=1.3448, reader_cost=0.0001 | ETA 00:58:02 2021-02-24 00:36:11 [INFO] [TRAIN] epoch=209, iter=77420/80000, loss=0.8112, lr=0.000455, batch_cost=1.3328, reader_cost=0.0001 | ETA 00:57:18 2021-02-24 00:36:24 [INFO] [TRAIN] epoch=209, iter=77430/80000, loss=0.7863, lr=0.000453, batch_cost=1.3589, reader_cost=0.0001 | ETA 00:58:12 2021-02-24 00:36:38 [INFO] [TRAIN] epoch=209, iter=77440/80000, loss=0.8270, lr=0.000452, batch_cost=1.3781, reader_cost=0.0001 | ETA 00:58:47 2021-02-24 00:36:52 [INFO] [TRAIN] epoch=209, iter=77450/80000, loss=0.8079, lr=0.000450, batch_cost=1.3487, reader_cost=0.0001 | ETA 00:57:19 2021-02-24 00:37:05 [INFO] [TRAIN] epoch=209, iter=77460/80000, loss=0.7743, lr=0.000448, batch_cost=1.3346, reader_cost=0.0001 | ETA 00:56:29 2021-02-24 00:37:19 [INFO] [TRAIN] epoch=209, iter=77470/80000, loss=0.8036, lr=0.000447, batch_cost=1.3683, reader_cost=0.0001 | ETA 00:57:41 2021-02-24 00:37:32 [INFO] [TRAIN] epoch=209, iter=77480/80000, loss=0.7950, lr=0.000445, batch_cost=1.3273, reader_cost=0.0001 | ETA 00:55:44 2021-02-24 00:37:46 [INFO] [TRAIN] epoch=209, iter=77490/80000, loss=0.8120, lr=0.000444, batch_cost=1.3722, reader_cost=0.0001 | ETA 00:57:24 2021-02-24 00:37:59 [INFO] [TRAIN] epoch=209, iter=77500/80000, loss=0.8697, lr=0.000442, batch_cost=1.3344, reader_cost=0.0001 | ETA 00:55:35 2021-02-24 00:38:12 [INFO] [TRAIN] epoch=209, iter=77510/80000, loss=0.7262, lr=0.000441, batch_cost=1.3320, reader_cost=0.0001 | ETA 00:55:16 2021-02-24 00:38:26 [INFO] [TRAIN] epoch=209, iter=77520/80000, loss=0.8206, lr=0.000439, batch_cost=1.3623, reader_cost=0.0001 | ETA 00:56:18 2021-02-24 00:38:39 [INFO] [TRAIN] epoch=209, iter=77530/80000, loss=0.8102, lr=0.000437, batch_cost=1.3383, reader_cost=0.0001 | ETA 00:55:05 2021-02-24 00:38:53 [INFO] [TRAIN] epoch=209, iter=77540/80000, loss=0.7873, lr=0.000436, batch_cost=1.3596, reader_cost=0.0001 | ETA 00:55:44 2021-02-24 00:39:06 [INFO] [TRAIN] epoch=209, iter=77550/80000, loss=0.7728, lr=0.000434, batch_cost=1.3322, reader_cost=0.0001 | ETA 00:54:23 2021-02-24 00:39:20 [INFO] [TRAIN] epoch=209, iter=77560/80000, loss=0.7962, lr=0.000433, batch_cost=1.3681, reader_cost=0.0001 | ETA 00:55:38 2021-02-24 00:39:34 [INFO] [TRAIN] epoch=209, iter=77570/80000, loss=0.7775, lr=0.000431, batch_cost=1.3635, reader_cost=0.0001 | ETA 00:55:13 2021-02-24 00:39:47 [INFO] [TRAIN] epoch=209, iter=77580/80000, loss=0.8356, lr=0.000429, batch_cost=1.3516, reader_cost=0.0001 | ETA 00:54:30 2021-02-24 00:40:01 [INFO] [TRAIN] epoch=209, iter=77590/80000, loss=0.7973, lr=0.000428, batch_cost=1.3762, reader_cost=0.0001 | ETA 00:55:16 2021-02-24 00:40:15 [INFO] [TRAIN] epoch=209, iter=77600/80000, loss=0.8133, lr=0.000426, batch_cost=1.3785, reader_cost=0.0001 | ETA 00:55:08 2021-02-24 00:40:28 [INFO] [TRAIN] epoch=209, iter=77610/80000, loss=0.7890, lr=0.000425, batch_cost=1.3314, reader_cost=0.0001 | ETA 00:53:02 2021-02-24 00:40:42 [INFO] [TRAIN] epoch=209, iter=77620/80000, loss=0.7852, lr=0.000423, batch_cost=1.3521, reader_cost=0.0001 | ETA 00:53:37 2021-02-24 00:40:55 [INFO] [TRAIN] epoch=209, iter=77630/80000, loss=0.8061, lr=0.000421, batch_cost=1.3373, reader_cost=0.0001 | ETA 00:52:49 2021-02-24 00:41:09 [INFO] [TRAIN] epoch=209, iter=77640/80000, loss=0.8332, lr=0.000420, batch_cost=1.3949, reader_cost=0.0001 | ETA 00:54:51 2021-02-24 00:41:23 [INFO] [TRAIN] epoch=209, iter=77650/80000, loss=0.7628, lr=0.000418, batch_cost=1.3651, reader_cost=0.0001 | ETA 00:53:27 2021-02-24 00:41:36 [INFO] [TRAIN] epoch=209, iter=77660/80000, loss=0.7464, lr=0.000417, batch_cost=1.3552, reader_cost=0.0001 | ETA 00:52:51 2021-02-24 00:41:50 [INFO] [TRAIN] epoch=209, iter=77670/80000, loss=0.8166, lr=0.000415, batch_cost=1.3592, reader_cost=0.0001 | ETA 00:52:46 2021-02-24 00:42:04 [INFO] [TRAIN] epoch=209, iter=77680/80000, loss=0.7579, lr=0.000413, batch_cost=1.3812, reader_cost=0.0001 | ETA 00:53:24 2021-02-24 00:42:17 [INFO] [TRAIN] epoch=209, iter=77690/80000, loss=0.7888, lr=0.000412, batch_cost=1.3390, reader_cost=0.0001 | ETA 00:51:33 2021-02-24 00:42:31 [INFO] [TRAIN] epoch=209, iter=77700/80000, loss=0.8310, lr=0.000410, batch_cost=1.3674, reader_cost=0.0001 | ETA 00:52:25 2021-02-24 00:42:44 [INFO] [TRAIN] epoch=209, iter=77710/80000, loss=0.7716, lr=0.000409, batch_cost=1.3371, reader_cost=0.0001 | ETA 00:51:02 2021-02-24 00:42:57 [INFO] [TRAIN] epoch=209, iter=77720/80000, loss=0.7881, lr=0.000407, batch_cost=1.3430, reader_cost=0.0001 | ETA 00:51:02 2021-02-24 00:43:11 [INFO] [TRAIN] epoch=209, iter=77730/80000, loss=0.8055, lr=0.000405, batch_cost=1.3355, reader_cost=0.0001 | ETA 00:50:31 2021-02-24 00:43:24 [INFO] [TRAIN] epoch=209, iter=77740/80000, loss=0.8214, lr=0.000404, batch_cost=1.3508, reader_cost=0.0001 | ETA 00:50:52 2021-02-24 00:43:38 [INFO] [TRAIN] epoch=210, iter=77750/80000, loss=0.8379, lr=0.000402, batch_cost=1.4178, reader_cost=0.0718 | ETA 00:53:10 2021-02-24 00:43:52 [INFO] [TRAIN] epoch=210, iter=77760/80000, loss=0.8004, lr=0.000401, batch_cost=1.3653, reader_cost=0.0001 | ETA 00:50:58 2021-02-24 00:44:06 [INFO] [TRAIN] epoch=210, iter=77770/80000, loss=0.8215, lr=0.000399, batch_cost=1.3745, reader_cost=0.0001 | ETA 00:51:05 2021-02-24 00:44:19 [INFO] [TRAIN] epoch=210, iter=77780/80000, loss=0.7981, lr=0.000397, batch_cost=1.3445, reader_cost=0.0001 | ETA 00:49:44 2021-02-24 00:44:33 [INFO] [TRAIN] epoch=210, iter=77790/80000, loss=0.7312, lr=0.000396, batch_cost=1.3533, reader_cost=0.0001 | ETA 00:49:50 2021-02-24 00:44:47 [INFO] [TRAIN] epoch=210, iter=77800/80000, loss=0.7986, lr=0.000394, batch_cost=1.3714, reader_cost=0.0001 | ETA 00:50:16 2021-02-24 00:45:00 [INFO] [TRAIN] epoch=210, iter=77810/80000, loss=0.7892, lr=0.000392, batch_cost=1.3335, reader_cost=0.0001 | ETA 00:48:40 2021-02-24 00:45:13 [INFO] [TRAIN] epoch=210, iter=77820/80000, loss=0.7782, lr=0.000391, batch_cost=1.3339, reader_cost=0.0001 | ETA 00:48:27 2021-02-24 00:45:27 [INFO] [TRAIN] epoch=210, iter=77830/80000, loss=0.8358, lr=0.000389, batch_cost=1.3457, reader_cost=0.0001 | ETA 00:48:40 2021-02-24 00:45:40 [INFO] [TRAIN] epoch=210, iter=77840/80000, loss=0.8232, lr=0.000388, batch_cost=1.3800, reader_cost=0.0001 | ETA 00:49:40 2021-02-24 00:45:54 [INFO] [TRAIN] epoch=210, iter=77850/80000, loss=0.7902, lr=0.000386, batch_cost=1.3630, reader_cost=0.0001 | ETA 00:48:50 2021-02-24 00:46:08 [INFO] [TRAIN] epoch=210, iter=77860/80000, loss=0.7822, lr=0.000384, batch_cost=1.3558, reader_cost=0.0001 | ETA 00:48:21 2021-02-24 00:46:21 [INFO] [TRAIN] epoch=210, iter=77870/80000, loss=0.7816, lr=0.000383, batch_cost=1.3812, reader_cost=0.0001 | ETA 00:49:02 2021-02-24 00:46:35 [INFO] [TRAIN] epoch=210, iter=77880/80000, loss=0.7556, lr=0.000381, batch_cost=1.3344, reader_cost=0.0001 | ETA 00:47:08 2021-02-24 00:46:48 [INFO] [TRAIN] epoch=210, iter=77890/80000, loss=0.7750, lr=0.000380, batch_cost=1.3620, reader_cost=0.0001 | ETA 00:47:53 2021-02-24 00:47:02 [INFO] [TRAIN] epoch=210, iter=77900/80000, loss=0.8148, lr=0.000378, batch_cost=1.3400, reader_cost=0.0001 | ETA 00:46:54 2021-02-24 00:47:15 [INFO] [TRAIN] epoch=210, iter=77910/80000, loss=0.8182, lr=0.000376, batch_cost=1.3327, reader_cost=0.0001 | ETA 00:46:25 2021-02-24 00:47:29 [INFO] [TRAIN] epoch=210, iter=77920/80000, loss=0.7716, lr=0.000375, batch_cost=1.3578, reader_cost=0.0001 | ETA 00:47:04 2021-02-24 00:47:42 [INFO] [TRAIN] epoch=210, iter=77930/80000, loss=0.7885, lr=0.000373, batch_cost=1.3314, reader_cost=0.0001 | ETA 00:45:56 2021-02-24 00:47:55 [INFO] [TRAIN] epoch=210, iter=77940/80000, loss=0.7807, lr=0.000371, batch_cost=1.3357, reader_cost=0.0001 | ETA 00:45:51 2021-02-24 00:48:09 [INFO] [TRAIN] epoch=210, iter=77950/80000, loss=0.7978, lr=0.000370, batch_cost=1.3382, reader_cost=0.0001 | ETA 00:45:43 2021-02-24 00:48:22 [INFO] [TRAIN] epoch=210, iter=77960/80000, loss=0.8134, lr=0.000368, batch_cost=1.3280, reader_cost=0.0001 | ETA 00:45:09 2021-02-24 00:48:36 [INFO] [TRAIN] epoch=210, iter=77970/80000, loss=0.7997, lr=0.000367, batch_cost=1.3905, reader_cost=0.0001 | ETA 00:47:02 2021-02-24 00:48:50 [INFO] [TRAIN] epoch=210, iter=77980/80000, loss=0.7771, lr=0.000365, batch_cost=1.3697, reader_cost=0.0001 | ETA 00:46:06 2021-02-24 00:49:03 [INFO] [TRAIN] epoch=210, iter=77990/80000, loss=0.7659, lr=0.000363, batch_cost=1.3735, reader_cost=0.0001 | ETA 00:46:00 2021-02-24 00:49:17 [INFO] [TRAIN] epoch=210, iter=78000/80000, loss=0.7725, lr=0.000362, batch_cost=1.3944, reader_cost=0.0001 | ETA 00:46:28 2021-02-24 00:49:17 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:10 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 57s - batch_cost: 0.1845 - reader cost: 0.0606  3/125 [..............................] - ETA: 56s - batch_cost: 0.2788 - reader cost: 0.1134 4/125 [..............................] - ETA: 54s - batch_cost: 0.3123 - reader cost: 0.1264 5/125 [>.............................] - ETA: 53s - batch_cost: 0.3364 - reader cost: 0.1376 6/125 [>.............................] - ETA: 52s - batch_cost: 0.3474 - reader cost: 0.1367 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3608 - reader cost: 0.1429 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3688 - reader cost: 0.1470 9/125 [=>............................] - ETA: 50s - batch_cost: 0.3768 - reader cost: 0.1518 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3813 - reader cost: 0.1540 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3874 - reader cost: 0.1581 12/125 [=>............................] - ETA: 49s - batch_cost: 0.3907 - reader cost: 0.1598 13/125 [==>...........................] - ETA: 48s - batch_cost: 0.3938 - reader cost: 0.1612 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3970 - reader cost: 0.1627 15/125 [==>...........................] - ETA: 48s - batch_cost: 0.3997 - reader cost: 0.1642 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3990 - reader cost: 0.1626 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.4011 - reader cost: 0.1628 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.4019 - reader cost: 0.1630 19/125 [===>..........................] - ETA: 46s - batch_cost: 0.4045 - reader cost: 0.1651 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4037 - reader cost: 0.1638 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4055 - reader cost: 0.1652 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4041 - reader cost: 0.1628 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4018 - reader cost: 0.1601 24/125 [====>.........................] - ETA: 42s - batch_cost: 0.4018 - reader cost: 0.1600 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4029 - reader cost: 0.1608 26/125 [=====>........................] - ETA: 42s - batch_cost: 0.4046 - reader cost: 0.1619 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4024 - reader cost: 0.1593 28/125 [=====>........................] - ETA: 40s - batch_cost: 0.4020 - reader cost: 0.1586 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4031 - reader cost: 0.1595 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4035 - reader cost: 0.1596 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.4029 - reader cost: 0.1589 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4040 - reader cost: 0.1599 33/125 [======>.......................] - ETA: 38s - batch_cost: 0.4028 - reader cost: 0.1586 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4038 - reader cost: 0.1595 35/125 [=======>......................] - ETA: 37s - batch_cost: 0.4044 - reader cost: 0.1600 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4042 - reader cost: 0.1591 37/125 [=======>......................] - ETA: 36s - batch_cost: 0.4047 - reader cost: 0.1594 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4044 - reader cost: 0.1589 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4049 - reader cost: 0.1594 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4056 - reader cost: 0.1599 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4047 - reader cost: 0.1588 42/125 [=========>....................] - ETA: 34s - batch_cost: 0.4057 - reader cost: 0.1598 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4062 - reader cost: 0.1594 44/125 [=========>....................] - ETA: 33s - batch_cost: 0.4068 - reader cost: 0.1584 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4074 - reader cost: 0.1575 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4071 - reader cost: 0.1568 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4077 - reader cost: 0.1573 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4078 - reader cost: 0.1568 49/125 [==========>...................] - ETA: 31s - batch_cost: 0.4086 - reader cost: 0.1563 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4089 - reader cost: 0.1547 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4093 - reader cost: 0.1540 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4088 - reader cost: 0.1531 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4099 - reader cost: 0.1534 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4103 - reader cost: 0.1537 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4098 - reader cost: 0.1530 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4103 - reader cost: 0.1529 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4109 - reader cost: 0.1535 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4117 - reader cost: 0.1538 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4122 - reader cost: 0.1536 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4127 - reader cost: 0.1529 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4123 - reader cost: 0.1523 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4123 - reader cost: 0.1525 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4121 - reader cost: 0.1521 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4121 - reader cost: 0.1523 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4125 - reader cost: 0.1528 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4122 - reader cost: 0.1527 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4125 - reader cost: 0.1532 68/125 [===============>..............] - ETA: 24s - batch_cost: 0.4129 - reader cost: 0.1537 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4133 - reader cost: 0.1542 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4131 - reader cost: 0.1543 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4137 - reader cost: 0.1550 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4140 - reader cost: 0.1554 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4144 - reader cost: 0.1558 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4147 - reader cost: 0.1563 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4150 - reader cost: 0.1565 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4145 - reader cost: 0.1561 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4148 - reader cost: 0.1565 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4156 - reader cost: 0.1573 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4148 - reader cost: 0.1567 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4150 - reader cost: 0.1569 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4144 - reader cost: 0.1565 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4147 - reader cost: 0.1568 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4149 - reader cost: 0.1570 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4145 - reader cost: 0.1567 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4140 - reader cost: 0.1563 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4139 - reader cost: 0.1563 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4140 - reader cost: 0.1565 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4135 - reader cost: 0.1561 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4135 - reader cost: 0.1559 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4137 - reader cost: 0.1562 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4138 - reader cost: 0.1564 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4139 - reader cost: 0.1566 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4141 - reader cost: 0.1568 94/125 [=====================>........] - ETA: 13s - batch_cost: 0.4143 - reader cost: 0.1571 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4144 - reader cost: 0.1573 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4140 - reader cost: 0.1570 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4137 - reader cost: 0.1567 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4132 - reader cost: 0.1561 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4135 - reader cost: 0.1565 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4136 - reader cost: 0.1566 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4136 - reader cost: 0.1568 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4136 - reader cost: 0.1568  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4133 - reader cost: 0.1565 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4135 - reader cost: 0.1568 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4139 - reader cost: 0.1571 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4140 - reader cost: 0.1572 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4142 - reader cost: 0.1574 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4144 - reader cost: 0.1577 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4140 - reader cost: 0.1573 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4142 - reader cost: 0.1575 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4140 - reader cost: 0.1574 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4141 - reader cost: 0.1576 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4137 - reader cost: 0.1572 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4135 - reader cost: 0.1570 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4133 - reader cost: 0.1569 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4130 - reader cost: 0.1566 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4132 - reader cost: 0.1567 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4133 - reader cost: 0.1565 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4133 - reader cost: 0.1567 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4137 - reader cost: 0.1571 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4134 - reader cost: 0.1568 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4134 - reader cost: 0.1570 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4134 - reader cost: 0.1569 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4129 - reader cost: 0.1565 125/125 [==============================] - 52s 418ms/step - batch_cost: 0.4130 - reader cost: 0.1566 2021-02-24 00:50:10 [INFO] [EVAL] #Images=500 mIoU=0.8149 Acc=0.9656 Kappa=0.9554 2021-02-24 00:50:10 [INFO] [EVAL] Class IoU: [0.9825 0.8592 0.9356 0.5806 0.6543 0.7014 0.7656 0.8378 0.9302 0.6582 0.9546 0.8516 0.6757 0.959 0.8336 0.9147 0.8697 0.7115 0.8071] 2021-02-24 00:50:10 [INFO] [EVAL] Class Acc: [0.9908 0.9232 0.9635 0.8927 0.8244 0.8597 0.8641 0.9269 0.9574 0.8253 0.9716 0.9108 0.8164 0.9764 0.9651 0.9568 0.9607 0.8745 0.8816] 2021-02-24 00:50:17 [INFO] [EVAL] The model with the best validation mIoU (0.8149) was saved at iter 78000. 2021-02-24 00:50:30 [INFO] [TRAIN] epoch=210, iter=78010/80000, loss=0.7862, lr=0.000360, batch_cost=1.3568, reader_cost=0.0001 | ETA 00:44:59 2021-02-24 00:50:44 [INFO] [TRAIN] epoch=210, iter=78020/80000, loss=0.7561, lr=0.000358, batch_cost=1.3789, reader_cost=0.0001 | ETA 00:45:30 2021-02-24 00:50:58 [INFO] [TRAIN] epoch=210, iter=78030/80000, loss=0.8612, lr=0.000357, batch_cost=1.3519, reader_cost=0.0001 | ETA 00:44:23 2021-02-24 00:51:11 [INFO] [TRAIN] epoch=210, iter=78040/80000, loss=0.7843, lr=0.000355, batch_cost=1.3220, reader_cost=0.0001 | ETA 00:43:11 2021-02-24 00:51:25 [INFO] [TRAIN] epoch=210, iter=78050/80000, loss=0.8070, lr=0.000354, batch_cost=1.4140, reader_cost=0.0001 | ETA 00:45:57 2021-02-24 00:51:39 [INFO] [TRAIN] epoch=210, iter=78060/80000, loss=0.8034, lr=0.000352, batch_cost=1.3717, reader_cost=0.0001 | ETA 00:44:21 2021-02-24 00:51:52 [INFO] [TRAIN] epoch=210, iter=78070/80000, loss=0.7550, lr=0.000350, batch_cost=1.3338, reader_cost=0.0001 | ETA 00:42:54 2021-02-24 00:52:06 [INFO] [TRAIN] epoch=210, iter=78080/80000, loss=0.7992, lr=0.000349, batch_cost=1.3744, reader_cost=0.0001 | ETA 00:43:58 2021-02-24 00:52:20 [INFO] [TRAIN] epoch=210, iter=78090/80000, loss=0.8254, lr=0.000347, batch_cost=1.3790, reader_cost=0.0001 | ETA 00:43:53 2021-02-24 00:52:33 [INFO] [TRAIN] epoch=210, iter=78100/80000, loss=0.7722, lr=0.000345, batch_cost=1.3484, reader_cost=0.0001 | ETA 00:42:42 2021-02-24 00:52:47 [INFO] [TRAIN] epoch=210, iter=78110/80000, loss=0.8470, lr=0.000344, batch_cost=1.3789, reader_cost=0.0001 | ETA 00:43:26 2021-02-24 00:53:00 [INFO] [TRAIN] epoch=210, iter=78120/80000, loss=0.7732, lr=0.000342, batch_cost=1.2950, reader_cost=0.0001 | ETA 00:40:34 2021-02-24 00:53:15 [INFO] [TRAIN] epoch=211, iter=78130/80000, loss=0.7829, lr=0.000340, batch_cost=1.4726, reader_cost=0.0757 | ETA 00:45:53 2021-02-24 00:53:28 [INFO] [TRAIN] epoch=211, iter=78140/80000, loss=0.8628, lr=0.000339, batch_cost=1.3538, reader_cost=0.0001 | ETA 00:41:58 2021-02-24 00:53:42 [INFO] [TRAIN] epoch=211, iter=78150/80000, loss=0.7331, lr=0.000337, batch_cost=1.3570, reader_cost=0.0001 | ETA 00:41:50 2021-02-24 00:53:55 [INFO] [TRAIN] epoch=211, iter=78160/80000, loss=0.7355, lr=0.000336, batch_cost=1.3480, reader_cost=0.0001 | ETA 00:41:20 2021-02-24 00:54:09 [INFO] [TRAIN] epoch=211, iter=78170/80000, loss=0.7573, lr=0.000334, batch_cost=1.3779, reader_cost=0.0001 | ETA 00:42:01 2021-02-24 00:54:22 [INFO] [TRAIN] epoch=211, iter=78180/80000, loss=0.7989, lr=0.000332, batch_cost=1.3316, reader_cost=0.0001 | ETA 00:40:23 2021-02-24 00:54:36 [INFO] [TRAIN] epoch=211, iter=78190/80000, loss=0.9008, lr=0.000331, batch_cost=1.3733, reader_cost=0.0001 | ETA 00:41:25 2021-02-24 00:54:50 [INFO] [TRAIN] epoch=211, iter=78200/80000, loss=0.7810, lr=0.000329, batch_cost=1.3391, reader_cost=0.0001 | ETA 00:40:10 2021-02-24 00:55:03 [INFO] [TRAIN] epoch=211, iter=78210/80000, loss=0.7617, lr=0.000327, batch_cost=1.3495, reader_cost=0.0001 | ETA 00:40:15 2021-02-24 00:55:17 [INFO] [TRAIN] epoch=211, iter=78220/80000, loss=0.8086, lr=0.000326, batch_cost=1.3564, reader_cost=0.0001 | ETA 00:40:14 2021-02-24 00:55:30 [INFO] [TRAIN] epoch=211, iter=78230/80000, loss=0.7815, lr=0.000324, batch_cost=1.3551, reader_cost=0.0001 | ETA 00:39:58 2021-02-24 00:55:44 [INFO] [TRAIN] epoch=211, iter=78240/80000, loss=0.7502, lr=0.000322, batch_cost=1.3606, reader_cost=0.0001 | ETA 00:39:54 2021-02-24 00:55:57 [INFO] [TRAIN] epoch=211, iter=78250/80000, loss=0.7761, lr=0.000321, batch_cost=1.3597, reader_cost=0.0001 | ETA 00:39:39 2021-02-24 00:56:11 [INFO] [TRAIN] epoch=211, iter=78260/80000, loss=0.7957, lr=0.000319, batch_cost=1.3512, reader_cost=0.0001 | ETA 00:39:11 2021-02-24 00:56:25 [INFO] [TRAIN] epoch=211, iter=78270/80000, loss=0.8005, lr=0.000317, batch_cost=1.3856, reader_cost=0.0001 | ETA 00:39:57 2021-02-24 00:56:38 [INFO] [TRAIN] epoch=211, iter=78280/80000, loss=0.7949, lr=0.000316, batch_cost=1.3284, reader_cost=0.0001 | ETA 00:38:04 2021-02-24 00:56:52 [INFO] [TRAIN] epoch=211, iter=78290/80000, loss=0.7892, lr=0.000314, batch_cost=1.3748, reader_cost=0.0001 | ETA 00:39:10 2021-02-24 00:57:05 [INFO] [TRAIN] epoch=211, iter=78300/80000, loss=0.8144, lr=0.000313, batch_cost=1.3256, reader_cost=0.0001 | ETA 00:37:33 2021-02-24 00:57:19 [INFO] [TRAIN] epoch=211, iter=78310/80000, loss=0.8052, lr=0.000311, batch_cost=1.3692, reader_cost=0.0001 | ETA 00:38:34 2021-02-24 00:57:32 [INFO] [TRAIN] epoch=211, iter=78320/80000, loss=0.7705, lr=0.000309, batch_cost=1.3441, reader_cost=0.0001 | ETA 00:37:38 2021-02-24 00:57:46 [INFO] [TRAIN] epoch=211, iter=78330/80000, loss=0.7950, lr=0.000308, batch_cost=1.3664, reader_cost=0.0001 | ETA 00:38:01 2021-02-24 00:57:59 [INFO] [TRAIN] epoch=211, iter=78340/80000, loss=0.7996, lr=0.000306, batch_cost=1.3496, reader_cost=0.0001 | ETA 00:37:20 2021-02-24 00:58:13 [INFO] [TRAIN] epoch=211, iter=78350/80000, loss=0.8260, lr=0.000304, batch_cost=1.3486, reader_cost=0.0001 | ETA 00:37:05 2021-02-24 00:58:26 [INFO] [TRAIN] epoch=211, iter=78360/80000, loss=0.8223, lr=0.000303, batch_cost=1.3530, reader_cost=0.0001 | ETA 00:36:58 2021-02-24 00:58:40 [INFO] [TRAIN] epoch=211, iter=78370/80000, loss=0.8377, lr=0.000301, batch_cost=1.3560, reader_cost=0.0001 | ETA 00:36:50 2021-02-24 00:58:53 [INFO] [TRAIN] epoch=211, iter=78380/80000, loss=0.8184, lr=0.000299, batch_cost=1.3172, reader_cost=0.0001 | ETA 00:35:33 2021-02-24 00:59:06 [INFO] [TRAIN] epoch=211, iter=78390/80000, loss=0.7563, lr=0.000298, batch_cost=1.3373, reader_cost=0.0001 | ETA 00:35:53 2021-02-24 00:59:20 [INFO] [TRAIN] epoch=211, iter=78400/80000, loss=0.7871, lr=0.000296, batch_cost=1.3698, reader_cost=0.0001 | ETA 00:36:31 2021-02-24 00:59:34 [INFO] [TRAIN] epoch=211, iter=78410/80000, loss=0.7715, lr=0.000294, batch_cost=1.3815, reader_cost=0.0001 | ETA 00:36:36 2021-02-24 00:59:48 [INFO] [TRAIN] epoch=211, iter=78420/80000, loss=0.7671, lr=0.000293, batch_cost=1.3581, reader_cost=0.0001 | ETA 00:35:45 2021-02-24 01:00:01 [INFO] [TRAIN] epoch=211, iter=78430/80000, loss=0.7590, lr=0.000291, batch_cost=1.3861, reader_cost=0.0001 | ETA 00:36:16 2021-02-24 01:00:15 [INFO] [TRAIN] epoch=211, iter=78440/80000, loss=0.7919, lr=0.000289, batch_cost=1.3591, reader_cost=0.0001 | ETA 00:35:20 2021-02-24 01:00:29 [INFO] [TRAIN] epoch=211, iter=78450/80000, loss=0.7530, lr=0.000288, batch_cost=1.3545, reader_cost=0.0001 | ETA 00:34:59 2021-02-24 01:00:42 [INFO] [TRAIN] epoch=211, iter=78460/80000, loss=0.7916, lr=0.000286, batch_cost=1.3372, reader_cost=0.0001 | ETA 00:34:19 2021-02-24 01:00:55 [INFO] [TRAIN] epoch=211, iter=78470/80000, loss=0.7677, lr=0.000284, batch_cost=1.3368, reader_cost=0.0001 | ETA 00:34:05 2021-02-24 01:01:09 [INFO] [TRAIN] epoch=211, iter=78480/80000, loss=0.8107, lr=0.000283, batch_cost=1.3763, reader_cost=0.0001 | ETA 00:34:51 2021-02-24 01:01:22 [INFO] [TRAIN] epoch=211, iter=78490/80000, loss=0.8511, lr=0.000281, batch_cost=1.3268, reader_cost=0.0001 | ETA 00:33:23 2021-02-24 01:01:37 [INFO] [TRAIN] epoch=212, iter=78500/80000, loss=0.7821, lr=0.000279, batch_cost=1.4388, reader_cost=0.0660 | ETA 00:35:58 2021-02-24 01:01:50 [INFO] [TRAIN] epoch=212, iter=78510/80000, loss=0.7780, lr=0.000278, batch_cost=1.3397, reader_cost=0.0001 | ETA 00:33:16 2021-02-24 01:02:03 [INFO] [TRAIN] epoch=212, iter=78520/80000, loss=0.7718, lr=0.000276, batch_cost=1.3342, reader_cost=0.0001 | ETA 00:32:54 2021-02-24 01:02:17 [INFO] [TRAIN] epoch=212, iter=78530/80000, loss=0.8024, lr=0.000274, batch_cost=1.3490, reader_cost=0.0001 | ETA 00:33:03 2021-02-24 01:02:31 [INFO] [TRAIN] epoch=212, iter=78540/80000, loss=0.8265, lr=0.000273, batch_cost=1.3620, reader_cost=0.0001 | ETA 00:33:08 2021-02-24 01:02:44 [INFO] [TRAIN] epoch=212, iter=78550/80000, loss=0.7681, lr=0.000271, batch_cost=1.3806, reader_cost=0.0001 | ETA 00:33:21 2021-02-24 01:02:58 [INFO] [TRAIN] epoch=212, iter=78560/80000, loss=0.7734, lr=0.000269, batch_cost=1.3395, reader_cost=0.0001 | ETA 00:32:08 2021-02-24 01:03:11 [INFO] [TRAIN] epoch=212, iter=78570/80000, loss=0.7878, lr=0.000267, batch_cost=1.3550, reader_cost=0.0001 | ETA 00:32:17 2021-02-24 01:03:25 [INFO] [TRAIN] epoch=212, iter=78580/80000, loss=0.7877, lr=0.000266, batch_cost=1.3701, reader_cost=0.0001 | ETA 00:32:25 2021-02-24 01:03:38 [INFO] [TRAIN] epoch=212, iter=78590/80000, loss=0.7847, lr=0.000264, batch_cost=1.3113, reader_cost=0.0001 | ETA 00:30:48 2021-02-24 01:03:52 [INFO] [TRAIN] epoch=212, iter=78600/80000, loss=0.7779, lr=0.000262, batch_cost=1.3519, reader_cost=0.0001 | ETA 00:31:32 2021-02-24 01:04:05 [INFO] [TRAIN] epoch=212, iter=78610/80000, loss=0.7582, lr=0.000261, batch_cost=1.3295, reader_cost=0.0001 | ETA 00:30:48 2021-02-24 01:04:18 [INFO] [TRAIN] epoch=212, iter=78620/80000, loss=0.8359, lr=0.000259, batch_cost=1.3370, reader_cost=0.0001 | ETA 00:30:45 2021-02-24 01:04:32 [INFO] [TRAIN] epoch=212, iter=78630/80000, loss=0.7869, lr=0.000257, batch_cost=1.3399, reader_cost=0.0001 | ETA 00:30:35 2021-02-24 01:04:45 [INFO] [TRAIN] epoch=212, iter=78640/80000, loss=0.8049, lr=0.000256, batch_cost=1.3493, reader_cost=0.0001 | ETA 00:30:35 2021-02-24 01:04:58 [INFO] [TRAIN] epoch=212, iter=78650/80000, loss=0.8217, lr=0.000254, batch_cost=1.3301, reader_cost=0.0001 | ETA 00:29:55 2021-02-24 01:05:12 [INFO] [TRAIN] epoch=212, iter=78660/80000, loss=0.7715, lr=0.000252, batch_cost=1.3685, reader_cost=0.0001 | ETA 00:30:33 2021-02-24 01:05:26 [INFO] [TRAIN] epoch=212, iter=78670/80000, loss=0.8034, lr=0.000251, batch_cost=1.3397, reader_cost=0.0001 | ETA 00:29:41 2021-02-24 01:05:39 [INFO] [TRAIN] epoch=212, iter=78680/80000, loss=0.7929, lr=0.000249, batch_cost=1.3786, reader_cost=0.0001 | ETA 00:30:19 2021-02-24 01:05:53 [INFO] [TRAIN] epoch=212, iter=78690/80000, loss=0.7835, lr=0.000247, batch_cost=1.3206, reader_cost=0.0001 | ETA 00:28:49 2021-02-24 01:06:06 [INFO] [TRAIN] epoch=212, iter=78700/80000, loss=0.7963, lr=0.000246, batch_cost=1.3868, reader_cost=0.0001 | ETA 00:30:02 2021-02-24 01:06:20 [INFO] [TRAIN] epoch=212, iter=78710/80000, loss=0.8268, lr=0.000244, batch_cost=1.3529, reader_cost=0.0001 | ETA 00:29:05 2021-02-24 01:06:33 [INFO] [TRAIN] epoch=212, iter=78720/80000, loss=0.8071, lr=0.000242, batch_cost=1.3527, reader_cost=0.0001 | ETA 00:28:51 2021-02-24 01:06:47 [INFO] [TRAIN] epoch=212, iter=78730/80000, loss=0.7741, lr=0.000240, batch_cost=1.3604, reader_cost=0.0001 | ETA 00:28:47 2021-02-24 01:07:01 [INFO] [TRAIN] epoch=212, iter=78740/80000, loss=0.8060, lr=0.000239, batch_cost=1.3504, reader_cost=0.0001 | ETA 00:28:21 2021-02-24 01:07:14 [INFO] [TRAIN] epoch=212, iter=78750/80000, loss=0.7744, lr=0.000237, batch_cost=1.3567, reader_cost=0.0001 | ETA 00:28:15 2021-02-24 01:07:28 [INFO] [TRAIN] epoch=212, iter=78760/80000, loss=0.7696, lr=0.000235, batch_cost=1.3642, reader_cost=0.0001 | ETA 00:28:11 2021-02-24 01:07:42 [INFO] [TRAIN] epoch=212, iter=78770/80000, loss=0.8111, lr=0.000234, batch_cost=1.3797, reader_cost=0.0001 | ETA 00:28:17 2021-02-24 01:07:55 [INFO] [TRAIN] epoch=212, iter=78780/80000, loss=0.8059, lr=0.000232, batch_cost=1.3307, reader_cost=0.0001 | ETA 00:27:03 2021-02-24 01:08:09 [INFO] [TRAIN] epoch=212, iter=78790/80000, loss=0.7321, lr=0.000230, batch_cost=1.3818, reader_cost=0.0001 | ETA 00:27:51 2021-02-24 01:08:22 [INFO] [TRAIN] epoch=212, iter=78800/80000, loss=0.7816, lr=0.000228, batch_cost=1.3211, reader_cost=0.0001 | ETA 00:26:25 2021-02-24 01:08:35 [INFO] [TRAIN] epoch=212, iter=78810/80000, loss=0.7919, lr=0.000227, batch_cost=1.3479, reader_cost=0.0001 | ETA 00:26:43 2021-02-24 01:08:49 [INFO] [TRAIN] epoch=212, iter=78820/80000, loss=0.8102, lr=0.000225, batch_cost=1.3575, reader_cost=0.0001 | ETA 00:26:41 2021-02-24 01:09:02 [INFO] [TRAIN] epoch=212, iter=78830/80000, loss=0.8215, lr=0.000223, batch_cost=1.3383, reader_cost=0.0001 | ETA 00:26:05 2021-02-24 01:09:16 [INFO] [TRAIN] epoch=212, iter=78840/80000, loss=0.7991, lr=0.000222, batch_cost=1.3417, reader_cost=0.0001 | ETA 00:25:56 2021-02-24 01:09:30 [INFO] [TRAIN] epoch=212, iter=78850/80000, loss=0.7774, lr=0.000220, batch_cost=1.3796, reader_cost=0.0001 | ETA 00:26:26 2021-02-24 01:09:43 [INFO] [TRAIN] epoch=212, iter=78860/80000, loss=0.7670, lr=0.000218, batch_cost=1.3340, reader_cost=0.0001 | ETA 00:25:20 2021-02-24 01:09:57 [INFO] [TRAIN] epoch=213, iter=78870/80000, loss=0.7680, lr=0.000216, batch_cost=1.4548, reader_cost=0.0822 | ETA 00:27:23 2021-02-24 01:10:12 [INFO] [TRAIN] epoch=213, iter=78880/80000, loss=0.8635, lr=0.000215, batch_cost=1.4037, reader_cost=0.0001 | ETA 00:26:12 2021-02-24 01:10:25 [INFO] [TRAIN] epoch=213, iter=78890/80000, loss=0.7962, lr=0.000213, batch_cost=1.3430, reader_cost=0.0001 | ETA 00:24:50 2021-02-24 01:10:38 [INFO] [TRAIN] epoch=213, iter=78900/80000, loss=0.8431, lr=0.000211, batch_cost=1.3531, reader_cost=0.0001 | ETA 00:24:48 2021-02-24 01:10:52 [INFO] [TRAIN] epoch=213, iter=78910/80000, loss=0.7987, lr=0.000210, batch_cost=1.3556, reader_cost=0.0001 | ETA 00:24:37 2021-02-24 01:11:06 [INFO] [TRAIN] epoch=213, iter=78920/80000, loss=0.8195, lr=0.000208, batch_cost=1.3666, reader_cost=0.0001 | ETA 00:24:35 2021-02-24 01:11:19 [INFO] [TRAIN] epoch=213, iter=78930/80000, loss=0.7706, lr=0.000206, batch_cost=1.3442, reader_cost=0.0001 | ETA 00:23:58 2021-02-24 01:11:33 [INFO] [TRAIN] epoch=213, iter=78940/80000, loss=0.8088, lr=0.000204, batch_cost=1.3413, reader_cost=0.0001 | ETA 00:23:41 2021-02-24 01:11:46 [INFO] [TRAIN] epoch=213, iter=78950/80000, loss=0.7552, lr=0.000203, batch_cost=1.3163, reader_cost=0.0001 | ETA 00:23:02 2021-02-24 01:11:59 [INFO] [TRAIN] epoch=213, iter=78960/80000, loss=0.7944, lr=0.000201, batch_cost=1.3564, reader_cost=0.0001 | ETA 00:23:30 2021-02-24 01:12:13 [INFO] [TRAIN] epoch=213, iter=78970/80000, loss=0.7811, lr=0.000199, batch_cost=1.3436, reader_cost=0.0001 | ETA 00:23:03 2021-02-24 01:12:26 [INFO] [TRAIN] epoch=213, iter=78980/80000, loss=0.7763, lr=0.000197, batch_cost=1.3615, reader_cost=0.0001 | ETA 00:23:08 2021-02-24 01:12:40 [INFO] [TRAIN] epoch=213, iter=78990/80000, loss=0.7718, lr=0.000196, batch_cost=1.3583, reader_cost=0.0001 | ETA 00:22:51 2021-02-24 01:12:53 [INFO] [TRAIN] epoch=213, iter=79000/80000, loss=0.7837, lr=0.000194, batch_cost=1.3491, reader_cost=0.0001 | ETA 00:22:29 2021-02-24 01:12:53 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 59s - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 57s - batch_cost: 0.2289 - reader cost: 0.1069  3/125 [..............................] - ETA: 55s - batch_cost: 0.2925 - reader cost: 0.1175 4/125 [..............................] - ETA: 54s - batch_cost: 0.3318 - reader cost: 0.1377 5/125 [>.............................] - ETA: 54s - batch_cost: 0.3550 - reader cost: 0.1499 6/125 [>.............................] - ETA: 53s - batch_cost: 0.3676 - reader cost: 0.1557 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3753 - reader cost: 0.1584 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3825 - reader cost: 0.1619 9/125 [=>............................] - ETA: 50s - batch_cost: 0.3799 - reader cost: 0.1558 10/125 [=>............................] - ETA: 49s - batch_cost: 0.3819 - reader cost: 0.1540 11/125 [=>............................] - ETA: 48s - batch_cost: 0.3845 - reader cost: 0.1545 12/125 [=>............................] - ETA: 48s - batch_cost: 0.3885 - reader cost: 0.1561 13/125 [==>...........................] - ETA: 47s - batch_cost: 0.3876 - reader cost: 0.1541 14/125 [==>...........................] - ETA: 47s - batch_cost: 0.3901 - reader cost: 0.1557 15/125 [==>...........................] - ETA: 46s - batch_cost: 0.3923 - reader cost: 0.1571 16/125 [==>...........................] - ETA: 46s - batch_cost: 0.3949 - reader cost: 0.1590 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3978 - reader cost: 0.1611 18/125 [===>..........................] - ETA: 45s - batch_cost: 0.3994 - reader cost: 0.1621 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.4025 - reader cost: 0.1644 20/125 [===>..........................] - ETA: 45s - batch_cost: 0.4046 - reader cost: 0.1660 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.4064 - reader cost: 0.1671 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4077 - reader cost: 0.1680 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4087 - reader cost: 0.1686 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4070 - reader cost: 0.1665 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4069 - reader cost: 0.1654 26/125 [=====>........................] - ETA: 41s - batch_cost: 0.4043 - reader cost: 0.1625 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4060 - reader cost: 0.1639 28/125 [=====>........................] - ETA: 40s - batch_cost: 0.4051 - reader cost: 0.1627 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4058 - reader cost: 0.1633 30/125 [======>.......................] - ETA: 39s - batch_cost: 0.4050 - reader cost: 0.1622 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.4059 - reader cost: 0.1630 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4068 - reader cost: 0.1636 33/125 [======>.......................] - ETA: 38s - batch_cost: 0.4055 - reader cost: 0.1623 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4050 - reader cost: 0.1615 35/125 [=======>......................] - ETA: 37s - batch_cost: 0.4053 - reader cost: 0.1604 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4060 - reader cost: 0.1611 37/125 [=======>......................] - ETA: 36s - batch_cost: 0.4066 - reader cost: 0.1615 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4071 - reader cost: 0.1618 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4070 - reader cost: 0.1611 40/125 [========>.....................] - ETA: 35s - batch_cost: 0.4074 - reader cost: 0.1609 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4087 - reader cost: 0.1611 42/125 [=========>....................] - ETA: 34s - batch_cost: 0.4096 - reader cost: 0.1611 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4105 - reader cost: 0.1615 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4115 - reader cost: 0.1626 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4121 - reader cost: 0.1633 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4120 - reader cost: 0.1632 47/125 [==========>...................] - ETA: 32s - batch_cost: 0.4116 - reader cost: 0.1627 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4120 - reader cost: 0.1630 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4119 - reader cost: 0.1629 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4111 - reader cost: 0.1620 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4108 - reader cost: 0.1616 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4112 - reader cost: 0.1620 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4104 - reader cost: 0.1611 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4106 - reader cost: 0.1614 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4108 - reader cost: 0.1616 56/125 [============>.................] - ETA: 28s - batch_cost: 0.4111 - reader cost: 0.1619 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4119 - reader cost: 0.1620 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4121 - reader cost: 0.1622 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4114 - reader cost: 0.1614 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4125 - reader cost: 0.1618 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4123 - reader cost: 0.1617 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4128 - reader cost: 0.1622 63/125 [==============>...............] - ETA: 26s - batch_cost: 0.4135 - reader cost: 0.1630 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4129 - reader cost: 0.1624 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4126 - reader cost: 0.1619 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4129 - reader cost: 0.1622 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4134 - reader cost: 0.1624 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4134 - reader cost: 0.1618 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4130 - reader cost: 0.1606 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4131 - reader cost: 0.1607 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4135 - reader cost: 0.1610 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4132 - reader cost: 0.1607 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4132 - reader cost: 0.1608 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4134 - reader cost: 0.1611 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4138 - reader cost: 0.1615 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4137 - reader cost: 0.1615 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4143 - reader cost: 0.1621 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4139 - reader cost: 0.1618 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4141 - reader cost: 0.1619 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4137 - reader cost: 0.1616 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4139 - reader cost: 0.1618 82/125 [==================>...........] - ETA: 18s - batch_cost: 0.4138 - reader cost: 0.1618 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4133 - reader cost: 0.1612 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4129 - reader cost: 0.1610 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4125 - reader cost: 0.1606 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4128 - reader cost: 0.1609 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4131 - reader cost: 0.1612 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4132 - reader cost: 0.1614 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4136 - reader cost: 0.1616 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4136 - reader cost: 0.1617 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4140 - reader cost: 0.1621 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4141 - reader cost: 0.1623 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4142 - reader cost: 0.1624 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4140 - reader cost: 0.1622 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4141 - reader cost: 0.1624 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4137 - reader cost: 0.1620 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4133 - reader cost: 0.1617 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4136 - reader cost: 0.1620 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4136 - reader cost: 0.1621 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4138 - reader cost: 0.1622 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4138 - reader cost: 0.1623 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4142 - reader cost: 0.1627  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4142 - reader cost: 0.1628 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4146 - reader cost: 0.1631 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4147 - reader cost: 0.1633 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4148 - reader cost: 0.1633 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4152 - reader cost: 0.1637 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4152 - reader cost: 0.1637 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4150 - reader cost: 0.1635 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4144 - reader cost: 0.1630 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4148 - reader cost: 0.1632 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4144 - reader cost: 0.1629 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4146 - reader cost: 0.1631 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4142 - reader cost: 0.1627 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4144 - reader cost: 0.1628 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4143 - reader cost: 0.1627 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4142 - reader cost: 0.1625 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4142 - reader cost: 0.1625 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4144 - reader cost: 0.1626 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4144 - reader cost: 0.1627 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4142 - reader cost: 0.1625 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4145 - reader cost: 0.1627 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4147 - reader cost: 0.1629 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4148 - reader cost: 0.1630 125/125 [==============================] - 52s 419ms/step - batch_cost: 0.4149 - reader cost: 0.1632 2021-02-24 01:13:46 [INFO] [EVAL] #Images=500 mIoU=0.8134 Acc=0.9655 Kappa=0.9552 2021-02-24 01:13:46 [INFO] [EVAL] Class IoU: [0.9826 0.859 0.935 0.5486 0.6483 0.7037 0.7652 0.838 0.9301 0.6479 0.9545 0.8516 0.6797 0.9597 0.8425 0.9159 0.8657 0.7184 0.8088] 2021-02-24 01:13:46 [INFO] [EVAL] Class Acc: [0.9904 0.9233 0.9623 0.8686 0.8642 0.8514 0.8697 0.9258 0.957 0.8427 0.9713 0.9105 0.822 0.9772 0.9622 0.9628 0.9647 0.8528 0.8807] 2021-02-24 01:13:51 [INFO] [EVAL] The model with the best validation mIoU (0.8149) was saved at iter 78000. 2021-02-24 01:14:04 [INFO] [TRAIN] epoch=213, iter=79010/80000, loss=0.7552, lr=0.000192, batch_cost=1.3473, reader_cost=0.0001 | ETA 00:22:13 2021-02-24 01:14:17 [INFO] [TRAIN] epoch=213, iter=79020/80000, loss=0.7772, lr=0.000190, batch_cost=1.3444, reader_cost=0.0001 | ETA 00:21:57 2021-02-24 01:14:31 [INFO] [TRAIN] epoch=213, iter=79030/80000, loss=0.7748, lr=0.000189, batch_cost=1.3447, reader_cost=0.0001 | ETA 00:21:44 2021-02-24 01:14:44 [INFO] [TRAIN] epoch=213, iter=79040/80000, loss=0.7636, lr=0.000187, batch_cost=1.3446, reader_cost=0.0001 | ETA 00:21:30 2021-02-24 01:14:58 [INFO] [TRAIN] epoch=213, iter=79050/80000, loss=0.7884, lr=0.000185, batch_cost=1.3538, reader_cost=0.0001 | ETA 00:21:26 2021-02-24 01:15:11 [INFO] [TRAIN] epoch=213, iter=79060/80000, loss=0.7922, lr=0.000183, batch_cost=1.3490, reader_cost=0.0001 | ETA 00:21:08 2021-02-24 01:15:25 [INFO] [TRAIN] epoch=213, iter=79070/80000, loss=0.7609, lr=0.000182, batch_cost=1.3611, reader_cost=0.0001 | ETA 00:21:05 2021-02-24 01:15:39 [INFO] [TRAIN] epoch=213, iter=79080/80000, loss=0.8360, lr=0.000180, batch_cost=1.3677, reader_cost=0.0001 | ETA 00:20:58 2021-02-24 01:15:53 [INFO] [TRAIN] epoch=213, iter=79090/80000, loss=0.8083, lr=0.000178, batch_cost=1.3887, reader_cost=0.0001 | ETA 00:21:03 2021-02-24 01:16:06 [INFO] [TRAIN] epoch=213, iter=79100/80000, loss=0.7834, lr=0.000176, batch_cost=1.3604, reader_cost=0.0001 | ETA 00:20:24 2021-02-24 01:16:20 [INFO] [TRAIN] epoch=213, iter=79110/80000, loss=0.7696, lr=0.000175, batch_cost=1.3541, reader_cost=0.0001 | ETA 00:20:05 2021-02-24 01:16:33 [INFO] [TRAIN] epoch=213, iter=79120/80000, loss=0.7631, lr=0.000173, batch_cost=1.3533, reader_cost=0.0001 | ETA 00:19:50 2021-02-24 01:16:47 [INFO] [TRAIN] epoch=213, iter=79130/80000, loss=0.7711, lr=0.000171, batch_cost=1.3435, reader_cost=0.0001 | ETA 00:19:28 2021-02-24 01:17:00 [INFO] [TRAIN] epoch=213, iter=79140/80000, loss=0.7760, lr=0.000169, batch_cost=1.3410, reader_cost=0.0001 | ETA 00:19:13 2021-02-24 01:17:13 [INFO] [TRAIN] epoch=213, iter=79150/80000, loss=0.7761, lr=0.000168, batch_cost=1.3449, reader_cost=0.0001 | ETA 00:19:03 2021-02-24 01:17:27 [INFO] [TRAIN] epoch=213, iter=79160/80000, loss=0.7879, lr=0.000166, batch_cost=1.3381, reader_cost=0.0001 | ETA 00:18:44 2021-02-24 01:17:40 [INFO] [TRAIN] epoch=213, iter=79170/80000, loss=0.7622, lr=0.000164, batch_cost=1.3408, reader_cost=0.0001 | ETA 00:18:32 2021-02-24 01:17:54 [INFO] [TRAIN] epoch=213, iter=79180/80000, loss=0.7891, lr=0.000162, batch_cost=1.3595, reader_cost=0.0001 | ETA 00:18:34 2021-02-24 01:18:07 [INFO] [TRAIN] epoch=213, iter=79190/80000, loss=0.7956, lr=0.000160, batch_cost=1.3393, reader_cost=0.0001 | ETA 00:18:04 2021-02-24 01:18:21 [INFO] [TRAIN] epoch=213, iter=79200/80000, loss=0.7593, lr=0.000159, batch_cost=1.3624, reader_cost=0.0001 | ETA 00:18:09 2021-02-24 01:18:35 [INFO] [TRAIN] epoch=213, iter=79210/80000, loss=0.8174, lr=0.000157, batch_cost=1.3767, reader_cost=0.0001 | ETA 00:18:07 2021-02-24 01:18:48 [INFO] [TRAIN] epoch=213, iter=79220/80000, loss=0.7995, lr=0.000155, batch_cost=1.3621, reader_cost=0.0001 | ETA 00:17:42 2021-02-24 01:19:02 [INFO] [TRAIN] epoch=213, iter=79230/80000, loss=0.7813, lr=0.000153, batch_cost=1.3288, reader_cost=0.0001 | ETA 00:17:03 2021-02-24 01:19:16 [INFO] [TRAIN] epoch=214, iter=79240/80000, loss=0.7594, lr=0.000152, batch_cost=1.4478, reader_cost=0.0664 | ETA 00:18:20 2021-02-24 01:19:30 [INFO] [TRAIN] epoch=214, iter=79250/80000, loss=0.8155, lr=0.000150, batch_cost=1.3547, reader_cost=0.0001 | ETA 00:16:56 2021-02-24 01:19:43 [INFO] [TRAIN] epoch=214, iter=79260/80000, loss=0.7651, lr=0.000148, batch_cost=1.3417, reader_cost=0.0001 | ETA 00:16:32 2021-02-24 01:19:57 [INFO] [TRAIN] epoch=214, iter=79270/80000, loss=0.7802, lr=0.000146, batch_cost=1.4197, reader_cost=0.0001 | ETA 00:17:16 2021-02-24 01:20:11 [INFO] [TRAIN] epoch=214, iter=79280/80000, loss=0.7763, lr=0.000144, batch_cost=1.3952, reader_cost=0.0001 | ETA 00:16:44 2021-02-24 01:20:25 [INFO] [TRAIN] epoch=214, iter=79290/80000, loss=0.8197, lr=0.000143, batch_cost=1.3590, reader_cost=0.0001 | ETA 00:16:04 2021-02-24 01:20:38 [INFO] [TRAIN] epoch=214, iter=79300/80000, loss=0.7673, lr=0.000141, batch_cost=1.3520, reader_cost=0.0001 | ETA 00:15:46 2021-02-24 01:20:52 [INFO] [TRAIN] epoch=214, iter=79310/80000, loss=0.7928, lr=0.000139, batch_cost=1.3643, reader_cost=0.0001 | ETA 00:15:41 2021-02-24 01:21:05 [INFO] [TRAIN] epoch=214, iter=79320/80000, loss=0.7482, lr=0.000137, batch_cost=1.3537, reader_cost=0.0001 | ETA 00:15:20 2021-02-24 01:21:19 [INFO] [TRAIN] epoch=214, iter=79330/80000, loss=0.8069, lr=0.000135, batch_cost=1.3894, reader_cost=0.0001 | ETA 00:15:30 2021-02-24 01:21:33 [INFO] [TRAIN] epoch=214, iter=79340/80000, loss=0.8101, lr=0.000133, batch_cost=1.3903, reader_cost=0.0001 | ETA 00:15:17 2021-02-24 01:21:47 [INFO] [TRAIN] epoch=214, iter=79350/80000, loss=0.7681, lr=0.000132, batch_cost=1.3488, reader_cost=0.0001 | ETA 00:14:36 2021-02-24 01:22:00 [INFO] [TRAIN] epoch=214, iter=79360/80000, loss=0.7730, lr=0.000130, batch_cost=1.3455, reader_cost=0.0001 | ETA 00:14:21 2021-02-24 01:22:14 [INFO] [TRAIN] epoch=214, iter=79370/80000, loss=0.7594, lr=0.000128, batch_cost=1.3743, reader_cost=0.0001 | ETA 00:14:25 2021-02-24 01:22:27 [INFO] [TRAIN] epoch=214, iter=79380/80000, loss=0.7844, lr=0.000126, batch_cost=1.3474, reader_cost=0.0001 | ETA 00:13:55 2021-02-24 01:22:41 [INFO] [TRAIN] epoch=214, iter=79390/80000, loss=0.8157, lr=0.000124, batch_cost=1.3545, reader_cost=0.0001 | ETA 00:13:46 2021-02-24 01:22:55 [INFO] [TRAIN] epoch=214, iter=79400/80000, loss=0.7780, lr=0.000123, batch_cost=1.3592, reader_cost=0.0001 | ETA 00:13:35 2021-02-24 01:23:08 [INFO] [TRAIN] epoch=214, iter=79410/80000, loss=0.7962, lr=0.000121, batch_cost=1.3418, reader_cost=0.0001 | ETA 00:13:11 2021-02-24 01:23:21 [INFO] [TRAIN] epoch=214, iter=79420/80000, loss=0.8265, lr=0.000119, batch_cost=1.3287, reader_cost=0.0001 | ETA 00:12:50 2021-02-24 01:23:35 [INFO] [TRAIN] epoch=214, iter=79430/80000, loss=0.7439, lr=0.000117, batch_cost=1.3615, reader_cost=0.0001 | ETA 00:12:56 2021-02-24 01:23:49 [INFO] [TRAIN] epoch=214, iter=79440/80000, loss=0.7694, lr=0.000115, batch_cost=1.3769, reader_cost=0.0001 | ETA 00:12:51 2021-02-24 01:24:02 [INFO] [TRAIN] epoch=214, iter=79450/80000, loss=0.8306, lr=0.000113, batch_cost=1.3307, reader_cost=0.0001 | ETA 00:12:11 2021-02-24 01:24:16 [INFO] [TRAIN] epoch=214, iter=79460/80000, loss=0.7988, lr=0.000111, batch_cost=1.3562, reader_cost=0.0001 | ETA 00:12:12 2021-02-24 01:24:29 [INFO] [TRAIN] epoch=214, iter=79470/80000, loss=0.7666, lr=0.000110, batch_cost=1.3235, reader_cost=0.0001 | ETA 00:11:41 2021-02-24 01:24:42 [INFO] [TRAIN] epoch=214, iter=79480/80000, loss=0.7453, lr=0.000108, batch_cost=1.3223, reader_cost=0.0001 | ETA 00:11:27 2021-02-24 01:24:56 [INFO] [TRAIN] epoch=214, iter=79490/80000, loss=0.7724, lr=0.000106, batch_cost=1.3572, reader_cost=0.0001 | ETA 00:11:32 2021-02-24 01:25:09 [INFO] [TRAIN] epoch=214, iter=79500/80000, loss=0.7645, lr=0.000104, batch_cost=1.3759, reader_cost=0.0001 | ETA 00:11:27 2021-02-24 01:25:23 [INFO] [TRAIN] epoch=214, iter=79510/80000, loss=0.7621, lr=0.000102, batch_cost=1.3540, reader_cost=0.0001 | ETA 00:11:03 2021-02-24 01:25:37 [INFO] [TRAIN] epoch=214, iter=79520/80000, loss=0.7831, lr=0.000100, batch_cost=1.3760, reader_cost=0.0001 | ETA 00:11:00 2021-02-24 01:25:50 [INFO] [TRAIN] epoch=214, iter=79530/80000, loss=0.7837, lr=0.000098, batch_cost=1.3526, reader_cost=0.0001 | ETA 00:10:35 2021-02-24 01:26:04 [INFO] [TRAIN] epoch=214, iter=79540/80000, loss=0.7675, lr=0.000097, batch_cost=1.3420, reader_cost=0.0001 | ETA 00:10:17 2021-02-24 01:26:17 [INFO] [TRAIN] epoch=214, iter=79550/80000, loss=0.7897, lr=0.000095, batch_cost=1.3851, reader_cost=0.0001 | ETA 00:10:23 2021-02-24 01:26:31 [INFO] [TRAIN] epoch=214, iter=79560/80000, loss=0.7730, lr=0.000093, batch_cost=1.3470, reader_cost=0.0001 | ETA 00:09:52 2021-02-24 01:26:44 [INFO] [TRAIN] epoch=214, iter=79570/80000, loss=0.7855, lr=0.000091, batch_cost=1.3556, reader_cost=0.0001 | ETA 00:09:42 2021-02-24 01:26:58 [INFO] [TRAIN] epoch=214, iter=79580/80000, loss=0.7547, lr=0.000089, batch_cost=1.3375, reader_cost=0.0001 | ETA 00:09:21 2021-02-24 01:27:11 [INFO] [TRAIN] epoch=214, iter=79590/80000, loss=0.8116, lr=0.000087, batch_cost=1.3255, reader_cost=0.0001 | ETA 00:09:03 2021-02-24 01:27:25 [INFO] [TRAIN] epoch=214, iter=79600/80000, loss=0.7913, lr=0.000085, batch_cost=1.3531, reader_cost=0.0001 | ETA 00:09:01 2021-02-24 01:27:39 [INFO] [TRAIN] epoch=215, iter=79610/80000, loss=0.7870, lr=0.000083, batch_cost=1.4191, reader_cost=0.0883 | ETA 00:09:13 2021-02-24 01:27:53 [INFO] [TRAIN] epoch=215, iter=79620/80000, loss=0.7927, lr=0.000081, batch_cost=1.3772, reader_cost=0.0004 | ETA 00:08:43 2021-02-24 01:28:06 [INFO] [TRAIN] epoch=215, iter=79630/80000, loss=0.7875, lr=0.000079, batch_cost=1.3651, reader_cost=0.0001 | ETA 00:08:25 2021-02-24 01:28:20 [INFO] [TRAIN] epoch=215, iter=79640/80000, loss=0.8123, lr=0.000077, batch_cost=1.3570, reader_cost=0.0001 | ETA 00:08:08 2021-02-24 01:28:34 [INFO] [TRAIN] epoch=215, iter=79650/80000, loss=0.7605, lr=0.000076, batch_cost=1.3783, reader_cost=0.0001 | ETA 00:08:02 2021-02-24 01:28:47 [INFO] [TRAIN] epoch=215, iter=79660/80000, loss=0.7555, lr=0.000074, batch_cost=1.3561, reader_cost=0.0001 | ETA 00:07:41 2021-02-24 01:29:01 [INFO] [TRAIN] epoch=215, iter=79670/80000, loss=0.7376, lr=0.000072, batch_cost=1.3558, reader_cost=0.0001 | ETA 00:07:27 2021-02-24 01:29:14 [INFO] [TRAIN] epoch=215, iter=79680/80000, loss=0.8248, lr=0.000070, batch_cost=1.3173, reader_cost=0.0001 | ETA 00:07:01 2021-02-24 01:29:27 [INFO] [TRAIN] epoch=215, iter=79690/80000, loss=0.8144, lr=0.000068, batch_cost=1.3434, reader_cost=0.0001 | ETA 00:06:56 2021-02-24 01:29:41 [INFO] [TRAIN] epoch=215, iter=79700/80000, loss=0.7697, lr=0.000066, batch_cost=1.3570, reader_cost=0.0001 | ETA 00:06:47 2021-02-24 01:29:54 [INFO] [TRAIN] epoch=215, iter=79710/80000, loss=0.7747, lr=0.000064, batch_cost=1.3582, reader_cost=0.0001 | ETA 00:06:33 2021-02-24 01:30:08 [INFO] [TRAIN] epoch=215, iter=79720/80000, loss=0.8186, lr=0.000062, batch_cost=1.3367, reader_cost=0.0001 | ETA 00:06:14 2021-02-24 01:30:21 [INFO] [TRAIN] epoch=215, iter=79730/80000, loss=0.7385, lr=0.000060, batch_cost=1.3590, reader_cost=0.0001 | ETA 00:06:06 2021-02-24 01:30:35 [INFO] [TRAIN] epoch=215, iter=79740/80000, loss=0.8150, lr=0.000058, batch_cost=1.3800, reader_cost=0.0001 | ETA 00:05:58 2021-02-24 01:30:49 [INFO] [TRAIN] epoch=215, iter=79750/80000, loss=0.7394, lr=0.000056, batch_cost=1.3590, reader_cost=0.0001 | ETA 00:05:39 2021-02-24 01:31:02 [INFO] [TRAIN] epoch=215, iter=79760/80000, loss=0.7820, lr=0.000054, batch_cost=1.3318, reader_cost=0.0001 | ETA 00:05:19 2021-02-24 01:31:15 [INFO] [TRAIN] epoch=215, iter=79770/80000, loss=0.7681, lr=0.000052, batch_cost=1.3250, reader_cost=0.0001 | ETA 00:05:04 2021-02-24 01:31:29 [INFO] [TRAIN] epoch=215, iter=79780/80000, loss=0.8071, lr=0.000050, batch_cost=1.3857, reader_cost=0.0001 | ETA 00:05:04 2021-02-24 01:31:43 [INFO] [TRAIN] epoch=215, iter=79790/80000, loss=0.7568, lr=0.000048, batch_cost=1.3370, reader_cost=0.0001 | ETA 00:04:40 2021-02-24 01:31:56 [INFO] [TRAIN] epoch=215, iter=79800/80000, loss=0.7694, lr=0.000046, batch_cost=1.3607, reader_cost=0.0001 | ETA 00:04:32 2021-02-24 01:32:10 [INFO] [TRAIN] epoch=215, iter=79810/80000, loss=0.7715, lr=0.000044, batch_cost=1.3463, reader_cost=0.0001 | ETA 00:04:15 2021-02-24 01:32:23 [INFO] [TRAIN] epoch=215, iter=79820/80000, loss=0.7623, lr=0.000042, batch_cost=1.3274, reader_cost=0.0001 | ETA 00:03:58 2021-02-24 01:32:36 [INFO] [TRAIN] epoch=215, iter=79830/80000, loss=0.8304, lr=0.000040, batch_cost=1.3180, reader_cost=0.0001 | ETA 00:03:44 2021-02-24 01:32:50 [INFO] [TRAIN] epoch=215, iter=79840/80000, loss=0.8268, lr=0.000037, batch_cost=1.3899, reader_cost=0.0001 | ETA 00:03:42 2021-02-24 01:33:04 [INFO] [TRAIN] epoch=215, iter=79850/80000, loss=0.7655, lr=0.000035, batch_cost=1.3805, reader_cost=0.0001 | ETA 00:03:27 2021-02-24 01:33:17 [INFO] [TRAIN] epoch=215, iter=79860/80000, loss=0.7435, lr=0.000033, batch_cost=1.3339, reader_cost=0.0001 | ETA 00:03:06 2021-02-24 01:33:31 [INFO] [TRAIN] epoch=215, iter=79870/80000, loss=0.8642, lr=0.000031, batch_cost=1.3727, reader_cost=0.0001 | ETA 00:02:58 2021-02-24 01:33:44 [INFO] [TRAIN] epoch=215, iter=79880/80000, loss=0.8203, lr=0.000029, batch_cost=1.3561, reader_cost=0.0001 | ETA 00:02:42 2021-02-24 01:33:58 [INFO] [TRAIN] epoch=215, iter=79890/80000, loss=0.8117, lr=0.000027, batch_cost=1.3539, reader_cost=0.0001 | ETA 00:02:28 2021-02-24 01:34:12 [INFO] [TRAIN] epoch=215, iter=79900/80000, loss=0.7912, lr=0.000025, batch_cost=1.3950, reader_cost=0.0001 | ETA 00:02:19 2021-02-24 01:34:25 [INFO] [TRAIN] epoch=215, iter=79910/80000, loss=0.7648, lr=0.000022, batch_cost=1.3359, reader_cost=0.0001 | ETA 00:02:00 2021-02-24 01:34:39 [INFO] [TRAIN] epoch=215, iter=79920/80000, loss=0.8109, lr=0.000020, batch_cost=1.3704, reader_cost=0.0001 | ETA 00:01:49 2021-02-24 01:34:52 [INFO] [TRAIN] epoch=215, iter=79930/80000, loss=0.7904, lr=0.000018, batch_cost=1.3464, reader_cost=0.0001 | ETA 00:01:34 2021-02-24 01:35:06 [INFO] [TRAIN] epoch=215, iter=79940/80000, loss=0.7628, lr=0.000016, batch_cost=1.3332, reader_cost=0.0001 | ETA 00:01:19 2021-02-24 01:35:19 [INFO] [TRAIN] epoch=215, iter=79950/80000, loss=0.7877, lr=0.000013, batch_cost=1.3439, reader_cost=0.0001 | ETA 00:01:07 2021-02-24 01:35:33 [INFO] [TRAIN] epoch=215, iter=79960/80000, loss=0.8169, lr=0.000011, batch_cost=1.3490, reader_cost=0.0001 | ETA 00:00:53 2021-02-24 01:35:46 [INFO] [TRAIN] epoch=215, iter=79970/80000, loss=0.7690, lr=0.000009, batch_cost=1.3637, reader_cost=0.0001 | ETA 00:00:40 2021-02-24 01:35:59 [INFO] [TRAIN] epoch=215, iter=79980/80000, loss=0.7892, lr=0.000006, batch_cost=1.3071, reader_cost=0.0001 | ETA 00:00:26 2021-02-24 01:36:14 [INFO] [TRAIN] epoch=216, iter=79990/80000, loss=0.7833, lr=0.000003, batch_cost=1.4817, reader_cost=0.1089 | ETA 00:00:14 2021-02-24 01:36:28 [INFO] [TRAIN] epoch=216, iter=80000/80000, loss=0.8092, lr=0.000000, batch_cost=1.3528, reader_cost=0.0001 | ETA 00:00:00 2021-02-24 01:36:28 [INFO] Start evaluating (total_samples=500, total_iters=125)... 1/125 [..............................] - ETA: 1:12 - batch_cost: 0.0000e+00 - reader cost: 0.0000e+00 2/125 [..............................] - ETA: 1:03 - batch_cost: 0.2223 - reader cost: 0.0986  3/125 [..............................] - ETA: 56s - batch_cost: 0.2713 - reader cost: 0.1053  4/125 [..............................] - ETA: 55s - batch_cost: 0.3102 - reader cost: 0.1239 5/125 [>.............................] - ETA: 54s - batch_cost: 0.3352 - reader cost: 0.1347 6/125 [>.............................] - ETA: 53s - batch_cost: 0.3538 - reader cost: 0.1313 7/125 [>.............................] - ETA: 52s - batch_cost: 0.3571 - reader cost: 0.1293 8/125 [>.............................] - ETA: 51s - batch_cost: 0.3678 - reader cost: 0.1379 9/125 [=>............................] - ETA: 51s - batch_cost: 0.3754 - reader cost: 0.1423 10/125 [=>............................] - ETA: 50s - batch_cost: 0.3836 - reader cost: 0.1490 11/125 [=>............................] - ETA: 50s - batch_cost: 0.3901 - reader cost: 0.1545 12/125 [=>............................] - ETA: 50s - batch_cost: 0.3944 - reader cost: 0.1573 13/125 [==>...........................] - ETA: 49s - batch_cost: 0.3942 - reader cost: 0.1563 14/125 [==>...........................] - ETA: 48s - batch_cost: 0.3964 - reader cost: 0.1578 15/125 [==>...........................] - ETA: 48s - batch_cost: 0.3980 - reader cost: 0.1587 16/125 [==>...........................] - ETA: 47s - batch_cost: 0.3968 - reader cost: 0.1568 17/125 [===>..........................] - ETA: 46s - batch_cost: 0.3987 - reader cost: 0.1585 18/125 [===>..........................] - ETA: 46s - batch_cost: 0.4007 - reader cost: 0.1600 19/125 [===>..........................] - ETA: 45s - batch_cost: 0.3984 - reader cost: 0.1573 20/125 [===>..........................] - ETA: 44s - batch_cost: 0.3977 - reader cost: 0.1559 21/125 [====>.........................] - ETA: 44s - batch_cost: 0.3995 - reader cost: 0.1552 22/125 [====>.........................] - ETA: 44s - batch_cost: 0.4011 - reader cost: 0.1568 23/125 [====>.........................] - ETA: 43s - batch_cost: 0.4027 - reader cost: 0.1575 24/125 [====>.........................] - ETA: 43s - batch_cost: 0.4031 - reader cost: 0.1550 25/125 [=====>........................] - ETA: 42s - batch_cost: 0.4022 - reader cost: 0.1516 26/125 [=====>........................] - ETA: 41s - batch_cost: 0.4016 - reader cost: 0.1488 27/125 [=====>........................] - ETA: 41s - batch_cost: 0.4007 - reader cost: 0.1462 28/125 [=====>........................] - ETA: 41s - batch_cost: 0.4030 - reader cost: 0.1439 29/125 [=====>........................] - ETA: 40s - batch_cost: 0.4025 - reader cost: 0.1390 30/125 [======>.......................] - ETA: 40s - batch_cost: 0.4027 - reader cost: 0.1361 31/125 [======>.......................] - ETA: 39s - batch_cost: 0.4033 - reader cost: 0.1356 32/125 [======>.......................] - ETA: 39s - batch_cost: 0.4041 - reader cost: 0.1369 33/125 [======>.......................] - ETA: 38s - batch_cost: 0.4048 - reader cost: 0.1373 34/125 [=======>......................] - ETA: 38s - batch_cost: 0.4060 - reader cost: 0.1384 35/125 [=======>......................] - ETA: 38s - batch_cost: 0.4070 - reader cost: 0.1398 36/125 [=======>......................] - ETA: 37s - batch_cost: 0.4077 - reader cost: 0.1406 37/125 [=======>......................] - ETA: 37s - batch_cost: 0.4069 - reader cost: 0.1404 38/125 [========>.....................] - ETA: 36s - batch_cost: 0.4081 - reader cost: 0.1407 39/125 [========>.....................] - ETA: 36s - batch_cost: 0.4083 - reader cost: 0.1414 40/125 [========>.....................] - ETA: 36s - batch_cost: 0.4091 - reader cost: 0.1423 41/125 [========>.....................] - ETA: 35s - batch_cost: 0.4091 - reader cost: 0.1428 42/125 [=========>....................] - ETA: 35s - batch_cost: 0.4081 - reader cost: 0.1420 43/125 [=========>....................] - ETA: 34s - batch_cost: 0.4089 - reader cost: 0.1415 44/125 [=========>....................] - ETA: 34s - batch_cost: 0.4094 - reader cost: 0.1409 45/125 [=========>....................] - ETA: 33s - batch_cost: 0.4100 - reader cost: 0.1400 46/125 [==========>...................] - ETA: 33s - batch_cost: 0.4096 - reader cost: 0.1396 47/125 [==========>...................] - ETA: 33s - batch_cost: 0.4107 - reader cost: 0.1412 48/125 [==========>...................] - ETA: 32s - batch_cost: 0.4118 - reader cost: 0.1427 49/125 [==========>...................] - ETA: 32s - batch_cost: 0.4115 - reader cost: 0.1427 50/125 [===========>..................] - ETA: 31s - batch_cost: 0.4111 - reader cost: 0.1428 51/125 [===========>..................] - ETA: 31s - batch_cost: 0.4112 - reader cost: 0.1432 52/125 [===========>..................] - ETA: 30s - batch_cost: 0.4113 - reader cost: 0.1438 53/125 [===========>..................] - ETA: 30s - batch_cost: 0.4118 - reader cost: 0.1447 54/125 [===========>..................] - ETA: 29s - batch_cost: 0.4117 - reader cost: 0.1448 55/125 [============>.................] - ETA: 29s - batch_cost: 0.4120 - reader cost: 0.1455 56/125 [============>.................] - ETA: 29s - batch_cost: 0.4111 - reader cost: 0.1448 57/125 [============>.................] - ETA: 28s - batch_cost: 0.4106 - reader cost: 0.1445 58/125 [============>.................] - ETA: 28s - batch_cost: 0.4098 - reader cost: 0.1440 59/125 [=============>................] - ETA: 27s - batch_cost: 0.4094 - reader cost: 0.1438 60/125 [=============>................] - ETA: 27s - batch_cost: 0.4099 - reader cost: 0.1446 61/125 [=============>................] - ETA: 26s - batch_cost: 0.4106 - reader cost: 0.1453 62/125 [=============>................] - ETA: 26s - batch_cost: 0.4101 - reader cost: 0.1451 63/125 [==============>...............] - ETA: 25s - batch_cost: 0.4097 - reader cost: 0.1450 64/125 [==============>...............] - ETA: 25s - batch_cost: 0.4109 - reader cost: 0.1460 65/125 [==============>...............] - ETA: 25s - batch_cost: 0.4111 - reader cost: 0.1465 66/125 [==============>...............] - ETA: 24s - batch_cost: 0.4107 - reader cost: 0.1463 67/125 [===============>..............] - ETA: 24s - batch_cost: 0.4111 - reader cost: 0.1470 68/125 [===============>..............] - ETA: 23s - batch_cost: 0.4107 - reader cost: 0.1467 69/125 [===============>..............] - ETA: 23s - batch_cost: 0.4113 - reader cost: 0.1475 70/125 [===============>..............] - ETA: 23s - batch_cost: 0.4116 - reader cost: 0.1479 71/125 [================>.............] - ETA: 22s - batch_cost: 0.4120 - reader cost: 0.1484 72/125 [================>.............] - ETA: 22s - batch_cost: 0.4122 - reader cost: 0.1489 73/125 [================>.............] - ETA: 21s - batch_cost: 0.4125 - reader cost: 0.1493 74/125 [================>.............] - ETA: 21s - batch_cost: 0.4120 - reader cost: 0.1490 75/125 [=================>............] - ETA: 21s - batch_cost: 0.4124 - reader cost: 0.1495 76/125 [=================>............] - ETA: 20s - batch_cost: 0.4122 - reader cost: 0.1493 77/125 [=================>............] - ETA: 20s - batch_cost: 0.4122 - reader cost: 0.1494 78/125 [=================>............] - ETA: 19s - batch_cost: 0.4123 - reader cost: 0.1496 79/125 [=================>............] - ETA: 19s - batch_cost: 0.4123 - reader cost: 0.1498 80/125 [==================>...........] - ETA: 18s - batch_cost: 0.4119 - reader cost: 0.1496 81/125 [==================>...........] - ETA: 18s - batch_cost: 0.4116 - reader cost: 0.1494 82/125 [==================>...........] - ETA: 17s - batch_cost: 0.4112 - reader cost: 0.1492 83/125 [==================>...........] - ETA: 17s - batch_cost: 0.4106 - reader cost: 0.1487 84/125 [===================>..........] - ETA: 17s - batch_cost: 0.4106 - reader cost: 0.1485 85/125 [===================>..........] - ETA: 16s - batch_cost: 0.4102 - reader cost: 0.1483 86/125 [===================>..........] - ETA: 16s - batch_cost: 0.4103 - reader cost: 0.1486 87/125 [===================>..........] - ETA: 15s - batch_cost: 0.4100 - reader cost: 0.1484 88/125 [====================>.........] - ETA: 15s - batch_cost: 0.4102 - reader cost: 0.1487 89/125 [====================>.........] - ETA: 15s - batch_cost: 0.4105 - reader cost: 0.1491 90/125 [====================>.........] - ETA: 14s - batch_cost: 0.4107 - reader cost: 0.1495 91/125 [====================>.........] - ETA: 14s - batch_cost: 0.4109 - reader cost: 0.1498 92/125 [=====================>........] - ETA: 13s - batch_cost: 0.4110 - reader cost: 0.1500 93/125 [=====================>........] - ETA: 13s - batch_cost: 0.4110 - reader cost: 0.1495 94/125 [=====================>........] - ETA: 12s - batch_cost: 0.4111 - reader cost: 0.1495 95/125 [=====================>........] - ETA: 12s - batch_cost: 0.4114 - reader cost: 0.1499 96/125 [======================>.......] - ETA: 12s - batch_cost: 0.4116 - reader cost: 0.1503 97/125 [======================>.......] - ETA: 11s - batch_cost: 0.4111 - reader cost: 0.1499 98/125 [======================>.......] - ETA: 11s - batch_cost: 0.4115 - reader cost: 0.1502 99/125 [======================>.......] - ETA: 10s - batch_cost: 0.4117 - reader cost: 0.1504 100/125 [=======================>......] - ETA: 10s - batch_cost: 0.4118 - reader cost: 0.1501 101/125 [=======================>......] - ETA: 10s - batch_cost: 0.4120 - reader cost: 0.1499 102/125 [=======================>......] - ETA: 9s - batch_cost: 0.4122 - reader cost: 0.1502  103/125 [=======================>......] - ETA: 9s - batch_cost: 0.4123 - reader cost: 0.1504 104/125 [=======================>......] - ETA: 8s - batch_cost: 0.4124 - reader cost: 0.1506 105/125 [========================>.....] - ETA: 8s - batch_cost: 0.4118 - reader cost: 0.1502 106/125 [========================>.....] - ETA: 7s - batch_cost: 0.4117 - reader cost: 0.1502 107/125 [========================>.....] - ETA: 7s - batch_cost: 0.4116 - reader cost: 0.1501 108/125 [========================>.....] - ETA: 7s - batch_cost: 0.4118 - reader cost: 0.1504 109/125 [=========================>....] - ETA: 6s - batch_cost: 0.4121 - reader cost: 0.1503 110/125 [=========================>....] - ETA: 6s - batch_cost: 0.4121 - reader cost: 0.1504 111/125 [=========================>....] - ETA: 5s - batch_cost: 0.4117 - reader cost: 0.1500 112/125 [=========================>....] - ETA: 5s - batch_cost: 0.4119 - reader cost: 0.1503 113/125 [==========================>...] - ETA: 5s - batch_cost: 0.4124 - reader cost: 0.1506 114/125 [==========================>...] - ETA: 4s - batch_cost: 0.4121 - reader cost: 0.1503 115/125 [==========================>...] - ETA: 4s - batch_cost: 0.4124 - reader cost: 0.1506 116/125 [==========================>...] - ETA: 3s - batch_cost: 0.4125 - reader cost: 0.1509 117/125 [===========================>..] - ETA: 3s - batch_cost: 0.4124 - reader cost: 0.1509 118/125 [===========================>..] - ETA: 2s - batch_cost: 0.4125 - reader cost: 0.1511 119/125 [===========================>..] - ETA: 2s - batch_cost: 0.4123 - reader cost: 0.1511 120/125 [===========================>..] - ETA: 2s - batch_cost: 0.4122 - reader cost: 0.1510 121/125 [============================>.] - ETA: 1s - batch_cost: 0.4125 - reader cost: 0.1513 122/125 [============================>.] - ETA: 1s - batch_cost: 0.4120 - reader cost: 0.1509 123/125 [============================>.] - ETA: 0s - batch_cost: 0.4121 - reader cost: 0.1511 124/125 [============================>.] - ETA: 0s - batch_cost: 0.4122 - reader cost: 0.1513 125/125 [==============================] - 52s 417ms/step - batch_cost: 0.4119 - reader cost: 0.1511 2021-02-24 01:37:20 [INFO] [EVAL] #Images=500 mIoU=0.8140 Acc=0.9656 Kappa=0.9553 2021-02-24 01:37:20 [INFO] [EVAL] Class IoU: [0.9821 0.857 0.9355 0.5714 0.6549 0.7038 0.7642 0.8389 0.9311 0.6573 0.9546 0.8508 0.6713 0.9593 0.8321 0.9143 0.868 0.7118 0.8085] 2021-02-24 01:37:20 [INFO] [EVAL] Class Acc: [0.9904 0.9223 0.9625 0.8816 0.8444 0.8542 0.8697 0.9276 0.9585 0.8456 0.971 0.9092 0.8143 0.9762 0.9614 0.9598 0.9607 0.8572 0.8809] 2021-02-24 01:37:24 [INFO] [EVAL] The model with the best validation mIoU (0.8149) was saved at iter 78000. terminate called without an active exception -------------------------------------- C++ Traceback (most recent call last): -------------------------------------- 0 paddle::framework::SignalHandle(char const*, int) 1 paddle::platform::GetCurrentTraceBackString() ---------------------- Error Message Summary: ---------------------- FatalError: `Process abort signal` is detected by the operating system. [TimeInfo: *** Aborted at 1614101845 (unix time) try "date -d @1614101845" if you are using GNU date ***] [SignalInfo: *** SIGABRT (@0x3ff000082da) received by PID 33498 (TID 0x7f33755fe700) from PID 33498 ***]