FO CoarseGrainedExecutorBackend: Got assigned task 97
23/09/24 21:30:12 INFO Executor: Running task 97.0 in stage 0.0 (TID 97)
23/09/24 21:30:12 INFO CoarseGrainedExecutorBackend: Got assigned task 98
23/09/24 21:30:12 INFO Executor: Running task 98.0 in stage 0.0 (TID 98)
23/09/24 21:30:12 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13019119616-13153337344, partition values: [empty row]
23/09/24 21:30:12 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13153337344-13287555072, partition values: [empty row]
23/09/24 21:30:12 INFO Executor: Finished task 83.0 in stage 0.0 (TID 83). 2195 bytes result sent to driver
23/09/24 21:30:12 INFO CoarseGrainedExecutorBackend: Got assigned task 99
23/09/24 21:30:12 INFO Executor: Running task 99.0 in stage 0.0 (TID 99)
23/09/24 21:30:12 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13287555072-13421772800, partition values: [empty row]
23/09/24 21:30:13 INFO Executor: Finished task 95.0 in stage 0.0 (TID 95). 2195 bytes result sent to driver
23/09/24 21:30:13 INFO CoarseGrainedExecutorBackend: Got assigned task 105
23/09/24 21:30:13 INFO Executor: Running task 105.0 in stage 0.0 (TID 105)
23/09/24 21:30:13 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14092861440-14227079168, partition values: [empty row]
23/09/24 21:30:13 INFO Executor: Finished task 98.0 in stage 0.0 (TID 98). 2195 bytes result sent to driver
23/09/24 21:30:13 INFO CoarseGrainedExecutorBackend: Got assigned task 106
23/09/24 21:30:13 INFO Executor: Running task 106.0 in stage 0.0 (TID 106)
23/09/24 21:30:13 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14227079168-14361296896, partition values: [empty row]
23/09/24 21:30:13 INFO Executor: Finished task 96.0 in stage 0.0 (TID 96). 2195 bytes result sent to driver
23/09/24 21:30:13 INFO CoarseGrainedExecutorBackend: Got assigned task 107
23/09/24 21:30:13 INFO Executor: Running task 107.0 in stage 0.0 (TID 107)
23/09/24 21:30:13 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14361296896-14495514624, partition values: [empty row]
23/09/24 21:30:13 INFO Executor: Finished task 97.0 in stage 0.0 (TID 97). 2195 bytes result sent to driver
23/09/24 21:30:13 INFO CoarseGrainedExecutorBackend: Got assigned task 110
23/09/24 21:30:13 INFO Executor: Running task 110.0 in stage 0.0 (TID 110)
23/09/24 21:30:13 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14763950080-14898167808, partition values: [empty row]
23/09/24 21:30:13 INFO Executor: Finished task 99.0 in stage 0.0 (TID 99). 2195 bytes result sent to driver
23/09/24 21:30:13 INFO CoarseGrainedExecutorBackend: Got assigned task 112
23/09/24 21:30:13 INFO Executor: Running task 112.0 in stage 0.0 (TID 112)
23/09/24 21:30:13 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15032385536-15166603264, partition values: [empty row]
23/09/24 21:30:14 INFO Executor: Finished task 106.0 in stage 0.0 (TID 106). 2195 bytes result sent to driver
23/09/24 21:30:14 INFO CoarseGrainedExecutorBackend: Got assigned task 119
23/09/24 21:30:14 INFO Executor: Running task 119.0 in stage 0.0 (TID 119)
23/09/24 21:30:14 INFO Executor: Finished task 105.0 in stage 0.0 (TID 105). 2195 bytes result sent to driver
23/09/24 21:30:14 INFO CoarseGrainedExecutorBackend: Got assigned task 120
23/09/24 21:30:14 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15971909632-16106127360, partition values: [empty row]
23/09/24 21:30:14 INFO Executor: Running task 120.0 in stage 0.0 (TID 120)
23/09/24 21:30:14 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16106127360-16240345088, partition values: [empty row]
23/09/24 21:30:14 INFO Executor: Finished task 107.0 in stage 0.0 (TID 107). 2145 bytes result sent to driver
23/09/24 21:30:14 INFO CoarseGrainedExecutorBackend: Got assigned task 121
23/09/24 21:30:14 INFO Executor: Running task 121.0 in stage 0.0 (TID 121)
23/09/24 21:30:14 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16240345088-16374562816, partition values: [empty row]
23/09/24 21:30:14 INFO Executor: Finished task 110.0 in stage 0.0 (TID 110). 2195 bytes result sent to driver
23/09/24 21:30:14 INFO CoarseGrainedExecutorBackend: Got assigned task 122
23/09/24 21:30:14 INFO Executor: Running task 122.0 in stage 0.0 (TID 122)
23/09/24 21:30:14 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16374562816-16508780544, partition values: [empty row]
23/09/24 21:30:14 INFO Executor: Finished task 112.0 in stage 0.0 (TID 112). 2145 bytes result sent to driver
23/09/24 21:30:14 INFO CoarseGrainedExecutorBackend: Got assigned task 124
23/09/24 21:30:14 INFO Executor: Running task 124.0 in stage 0.0 (TID 124)
23/09/24 21:30:14 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16642998272-16777216000, partition values: [empty row]
23/09/24 21:30:15 INFO Executor: Finished task 119.0 in stage 0.0 (TID 119). 2145 bytes result sent to driver
23/09/24 21:30:15 INFO Executor: Finished task 120.0 in stage 0.0 (TID 120). 2145 bytes result sent to driver
23/09/24 21:30:15 INFO CoarseGrainedExecutorBackend: Got assigned task 131
23/09/24 21:30:15 INFO Executor: Running task 131.0 in stage 0.0 (TID 131)
23/09/24 21:30:15 INFO CoarseGrainedExecutorBackend: Got assigned task 132
23/09/24 21:30:15 INFO Executor: Running task 132.0 in stage 0.0 (TID 132)
23/09/24 21:30:15 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17582522368-17716740096, partition values: [empty row]
23/09/24 21:30:15 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17716740096-17850957824, partition values: [empty row]
23/09/24 21:30:15 INFO Executor: Finished task 122.0 in stage 0.0 (TID 122). 2195 bytes result sent to driver
23/09/24 21:30:15 INFO CoarseGrainedExecutorBackend: Got assigned task 133
23/09/24 21:30:15 INFO Executor: Running task 133.0 in stage 0.0 (TID 133)
23/09/24 21:30:15 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17850957824-17985175552, partition values: [empty row]
23/09/24 21:30:15 INFO Executor: Finished task 121.0 in stage 0.0 (TID 121). 2145 bytes result sent to driver
23/09/24 21:30:15 INFO CoarseGrainedExecutorBackend: Got assigned task 134
23/09/24 21:30:15 INFO Executor: Running task 134.0 in stage 0.0 (TID 134)
23/09/24 21:30:15 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17985175552-18119393280, partition values: [empty row]
23/09/24 21:30:15 INFO Executor: Finished task 124.0 in stage 0.0 (TID 124). 2195 bytes result sent to driver
23/09/24 21:30:15 INFO CoarseGrainedExecutorBackend: Got assigned task 135
23/09/24 21:30:15 INFO Executor: Running task 135.0 in stage 0.0 (TID 135)
23/09/24 21:30:15 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18119393280-18253611008, partition values: [empty row]
23/09/24 21:30:16 INFO Executor: Finished task 132.0 in stage 0.0 (TID 132). 2145 bytes result sent to driver
23/09/24 21:30:16 INFO CoarseGrainedExecutorBackend: Got assigned task 144
23/09/24 21:30:16 INFO Executor: Running task 144.0 in stage 0.0 (TID 144)
23/09/24 21:30:16 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19327352832-19461570560, partition values: [empty row]
23/09/24 21:30:16 INFO Executor: Finished task 131.0 in stage 0.0 (TID 131). 2195 bytes result sent to driver
23/09/24 21:30:16 INFO CoarseGrainedExecutorBackend: Got assigned task 146
23/09/24 21:30:16 INFO Executor: Running task 146.0 in stage 0.0 (TID 146)
23/09/24 21:30:16 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19595788288-19730006016, partition values: [empty row]
23/09/24 21:30:16 INFO Executor: Finished task 133.0 in stage 0.0 (TID 133). 2145 bytes result sent to driver
23/09/24 21:30:16 INFO CoarseGrainedExecutorBackend: Got assigned task 147
23/09/24 21:30:16 INFO Executor: Finished task 134.0 in stage 0.0 (TID 134). 2195 bytes result sent to driver
23/09/24 21:30:16 INFO Executor: Running task 147.0 in stage 0.0 (TID 147)
23/09/24 21:30:16 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19730006016-19864223744, partition values: [empty row]
23/09/24 21:30:16 INFO CoarseGrainedExecutorBackend: Got assigned task 148
23/09/24 21:30:16 INFO Executor: Running task 148.0 in stage 0.0 (TID 148)
23/09/24 21:30:16 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19864223744-19998441472, partition values: [empty row]
23/09/24 21:30:16 INFO Executor: Finished task 135.0 in stage 0.0 (TID 135). 2195 bytes result sent to driver
23/09/24 21:30:17 INFO Executor: Finished task 146.0 in stage 0.0 (TID 146). 2145 bytes result sent to driver
23/09/24 21:30:17 INFO Executor: Finished task 144.0 in stage 0.0 (TID 144). 2145 bytes result sent to driver
23/09/24 21:30:17 INFO Executor: Finished task 147.0 in stage 0.0 (TID 147). 2121 bytes result sent to driver
23/09/24 21:30:17 INFO Executor: Finished task 148.0 in stage 0.0 (TID 148). 2121 bytes result sent to driver
23/09/24 21:30:18 INFO CoarseGrainedExecutorBackend: Got assigned task 151
23/09/24 21:30:18 INFO CoarseGrainedExecutorBackend: Got assigned task 154
23/09/24 21:30:18 INFO Executor: Running task 1.0 in stage 1.0 (TID 151)
23/09/24 21:30:18 INFO CoarseGrainedExecutorBackend: Got assigned task 157
23/09/24 21:30:18 INFO CoarseGrainedExecutorBackend: Got assigned task 160
23/09/24 21:30:18 INFO CoarseGrainedExecutorBackend: Got assigned task 163
23/09/24 21:30:18 INFO Executor: Running task 13.0 in stage 1.0 (TID 163)
23/09/24 21:30:18 INFO Executor: Running task 4.0 in stage 1.0 (TID 154)
23/09/24 21:30:18 INFO Executor: Running task 7.0 in stage 1.0 (TID 157)
23/09/24 21:30:18 INFO Executor: Running task 10.0 in stage 1.0 (TID 160)
23/09/24 21:30:18 INFO TorrentBroadcast: Started reading broadcast variable 3 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:30:18 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 7.3 KiB, free 5.2 GiB)
23/09/24 21:30:18 INFO TorrentBroadcast: Reading broadcast variable 3 took 9 ms
23/09/24 21:30:18 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 14.3 KiB, free 5.2 GiB)
23/09/24 21:30:18 INFO CodeGenerator: Code generated in 31.364032 ms
23/09/24 21:30:18 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 134217728-268435456, partition values: [empty row]
23/09/24 21:30:18 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1744830464-1879048192, partition values: [empty row]
23/09/24 21:30:18 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 939524096-1073741824, partition values: [empty row]
23/09/24 21:30:18 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1342177280-1476395008, partition values: [empty row]
23/09/24 21:30:18 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 536870912-671088640, partition values: [empty row]
23/09/24 21:30:18 INFO CodeGenerator: Code generated in 8.962431 ms
23/09/24 21:30:18 INFO TorrentBroadcast: Started reading broadcast variable 2 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:30:18 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 24.8 KiB, free 5.2 GiB)
23/09/24 21:30:18 INFO TorrentBroadcast: Reading broadcast variable 2 took 16 ms
23/09/24 21:30:18 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 394.6 KiB, free 5.2 GiB)
23/09/24 21:30:19 INFO Executor: Finished task 13.0 in stage 1.0 (TID 163). 1844 bytes result sent to driver
23/09/24 21:30:19 INFO Executor: Finished task 7.0 in stage 1.0 (TID 157). 1844 bytes result sent to driver
23/09/24 21:30:19 INFO Executor: Finished task 4.0 in stage 1.0 (TID 154). 1844 bytes result sent to driver
23/09/24 21:30:19 INFO Executor: Finished task 10.0 in stage 1.0 (TID 160). 1844 bytes result sent to driver
23/09/24 21:30:19 INFO Executor: Finished task 1.0 in stage 1.0 (TID 151). 1844 bytes result sent to driver
23/09/24 21:30:19 INFO CoarseGrainedExecutorBackend: Got assigned task 170
23/09/24 21:30:19 INFO Executor: Running task 20.0 in stage 1.0 (TID 170)
23/09/24 21:30:19 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2684354560-2818572288, partition values: [empty row]
23/09/24 21:30:19 INFO CoarseGrainedExecutorBackend: Got assigned task 171
23/09/24 21:30:19 INFO CoarseGrainedExecutorBackend: Got assigned task 172
23/09/24 21:30:19 INFO Executor: Running task 21.0 in stage 1.0 (TID 171)
23/09/24 21:30:19 INFO CoarseGrainedExecutorBackend: Got assigned task 174
23/09/24 21:30:19 INFO CoarseGrainedExecutorBackend: Got assigned task 175
23/09/24 21:30:19 INFO Executor: Running task 25.0 in stage 1.0 (TID 175)
23/09/24 21:30:19 INFO Executor: Running task 22.0 in stage 1.0 (TID 172)
23/09/24 21:30:19 INFO Executor: Running task 24.0 in stage 1.0 (TID 174)
23/09/24 21:30:19 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3355443200-3489660928, partition values: [empty row]
23/09/24 21:30:19 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2818572288-2952790016, partition values: [empty row]
23/09/24 21:30:19 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3221225472-3355443200, partition values: [empty row]
23/09/24 21:30:19 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2952790016-3087007744, partition values: [empty row]
23/09/24 21:30:20 INFO Executor: Finished task 25.0 in stage 1.0 (TID 175). 1887 bytes result sent to driver
23/09/24 21:30:20 INFO CoarseGrainedExecutorBackend: Got assigned task 183
23/09/24 21:30:20 INFO Executor: Running task 33.0 in stage 1.0 (TID 183)
23/09/24 21:30:20 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4429185024-4563402752, partition values: [empty row]
23/09/24 21:30:20 INFO Executor: Finished task 24.0 in stage 1.0 (TID 174). 1887 bytes result sent to driver
23/09/24 21:30:20 INFO CoarseGrainedExecutorBackend: Got assigned task 186
23/09/24 21:30:20 INFO Executor: Running task 36.0 in stage 1.0 (TID 186)
23/09/24 21:30:20 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4831838208-4966055936, partition values: [empty row]
23/09/24 21:30:20 INFO Executor: Finished task 20.0 in stage 1.0 (TID 170). 1887 bytes result sent to driver
23/09/24 21:30:20 INFO Executor: Finished task 22.0 in stage 1.0 (TID 172). 1887 bytes result sent to driver
23/09/24 21:30:20 INFO CoarseGrainedExecutorBackend: Got assigned task 189
23/09/24 21:30:20 INFO CoarseGrainedExecutorBackend: Got assigned task 190
23/09/24 21:30:20 INFO Executor: Running task 39.0 in stage 1.0 (TID 189)
23/09/24 21:30:20 INFO Executor: Running task 40.0 in stage 1.0 (TID 190)
23/09/24 21:30:20 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5234491392-5368709120, partition values: [empty row]
23/09/24 21:30:20 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5368709120-5502926848, partition values: [empty row]
23/09/24 21:30:20 INFO Executor: Finished task 21.0 in stage 1.0 (TID 171). 1887 bytes result sent to driver
23/09/24 21:30:20 INFO CoarseGrainedExecutorBackend: Got assigned task 193
23/09/24 21:30:20 INFO Executor: Running task 43.0 in stage 1.0 (TID 193)
23/09/24 21:30:20 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5771362304-5905580032, partition values: [empty row]
23/09/24 21:30:21 INFO Executor: Finished task 33.0 in stage 1.0 (TID 183). 1844 bytes result sent to driver
23/09/24 21:30:21 INFO CoarseGrainedExecutorBackend: Got assigned task 198
23/09/24 21:30:21 INFO Executor: Running task 48.0 in stage 1.0 (TID 198)
23/09/24 21:30:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6442450944-6576668672, partition values: [empty row]
23/09/24 21:30:21 INFO Executor: Finished task 36.0 in stage 1.0 (TID 186). 1844 bytes result sent to driver
23/09/24 21:30:21 INFO CoarseGrainedExecutorBackend: Got assigned task 200
23/09/24 21:30:21 INFO Executor: Running task 50.0 in stage 1.0 (TID 200)
23/09/24 21:30:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6710886400-6845104128, partition values: [empty row]
23/09/24 21:30:21 INFO Executor: Finished task 39.0 in stage 1.0 (TID 189). 1844 bytes result sent to driver
23/09/24 21:30:21 INFO CoarseGrainedExecutorBackend: Got assigned task 202
23/09/24 21:30:21 INFO Executor: Running task 52.0 in stage 1.0 (TID 202)
23/09/24 21:30:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6979321856-7113539584, partition values: [empty row]
23/09/24 21:30:21 INFO Executor: Finished task 40.0 in stage 1.0 (TID 190). 1844 bytes result sent to driver
23/09/24 21:30:21 INFO CoarseGrainedExecutorBackend: Got assigned task 203
23/09/24 21:30:21 INFO Executor: Running task 53.0 in stage 1.0 (TID 203)
23/09/24 21:30:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7113539584-7247757312, partition values: [empty row]
23/09/24 21:30:21 INFO Executor: Finished task 43.0 in stage 1.0 (TID 193). 1844 bytes result sent to driver
23/09/24 21:30:21 INFO CoarseGrainedExecutorBackend: Got assigned task 207
23/09/24 21:30:21 INFO Executor: Running task 57.0 in stage 1.0 (TID 207)
23/09/24 21:30:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7650410496-7784628224, partition values: [empty row]
23/09/24 21:30:21 INFO Executor: Finished task 48.0 in stage 1.0 (TID 198). 1844 bytes result sent to driver
23/09/24 21:30:21 INFO CoarseGrainedExecutorBackend: Got assigned task 213
23/09/24 21:30:21 INFO Executor: Running task 63.0 in stage 1.0 (TID 213)
23/09/24 21:30:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8455716864-8589934592, partition values: [empty row]
23/09/24 21:30:21 INFO Executor: Finished task 50.0 in stage 1.0 (TID 200). 1844 bytes result sent to driver
23/09/24 21:30:21 INFO CoarseGrainedExecutorBackend: Got assigned task 215
23/09/24 21:30:21 INFO Executor: Running task 65.0 in stage 1.0 (TID 215)
23/09/24 21:30:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8724152320-8858370048, partition values: [empty row]
23/09/24 21:30:22 INFO Executor: Finished task 52.0 in stage 1.0 (TID 202). 1844 bytes result sent to driver
23/09/24 21:30:22 INFO CoarseGrainedExecutorBackend: Got assigned task 217
23/09/24 21:30:22 INFO Executor: Running task 67.0 in stage 1.0 (TID 217)
23/09/24 21:30:22 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8992587776-9126805504, partition values: [empty row]
23/09/24 21:30:22 INFO Executor: Finished task 53.0 in stage 1.0 (TID 203). 1844 bytes result sent to driver
23/09/24 21:30:22 INFO CoarseGrainedExecutorBackend: Got assigned task 218
23/09/24 21:30:22 INFO Executor: Running task 68.0 in stage 1.0 (TID 218)
23/09/24 21:30:22 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9126805504-9261023232, partition values: [empty row]
23/09/24 21:30:22 INFO Executor: Finished task 57.0 in stage 1.0 (TID 207). 1844 bytes result sent to driver
23/09/24 21:30:22 INFO CoarseGrainedExecutorBackend: Got assigned task 219
23/09/24 21:30:22 INFO Executor: Running task 69.0 in stage 1.0 (TID 219)
23/09/24 21:30:22 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9261023232-9395240960, partition values: [empty row]
23/09/24 21:30:22 INFO Executor: Finished task 63.0 in stage 1.0 (TID 213). 1844 bytes result sent to driver
23/09/24 21:30:22 INFO CoarseGrainedExecutorBackend: Got assigned task 228
23/09/24 21:30:22 INFO Executor: Running task 78.0 in stage 1.0 (TID 228)
23/09/24 21:30:22 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10468982784-10603200512, partition values: [empty row]
23/09/24 21:30:22 INFO Executor: Finished task 65.0 in stage 1.0 (TID 215). 1844 bytes result sent to driver
23/09/24 21:30:22 INFO CoarseGrainedExecutorBackend: Got assigned task 231
23/09/24 21:30:22 INFO Executor: Running task 81.0 in stage 1.0 (TID 231)
23/09/24 21:30:22 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10871635968-11005853696, partition values: [empty row]
23/09/24 21:30:22 INFO Executor: Finished task 67.0 in stage 1.0 (TID 217). 1844 bytes result sent to driver
23/09/24 21:30:22 INFO CoarseGrainedExecutorBackend: Got assigned task 232
23/09/24 21:30:22 INFO Executor: Running task 82.0 in stage 1.0 (TID 232)
23/09/24 21:30:22 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11005853696-11140071424, partition values: [empty row]
23/09/24 21:30:22 INFO Executor: Finished task 69.0 in stage 1.0 (TID 219). 1844 bytes result sent to driver
23/09/24 21:30:22 INFO CoarseGrainedExecutorBackend: Got assigned task 233
23/09/24 21:30:22 INFO Executor: Running task 83.0 in stage 1.0 (TID 233)
23/09/24 21:30:22 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11140071424-11274289152, partition values: [empty row]
23/09/24 21:30:22 INFO Executor: Finished task 68.0 in stage 1.0 (TID 218). 1844 bytes result sent to driver
23/09/24 21:30:22 INFO CoarseGrainedExecutorBackend: Got assigned task 234
23/09/24 21:30:22 INFO Executor: Running task 84.0 in stage 1.0 (TID 234)
23/09/24 21:30:22 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11274289152-11408506880, partition values: [empty row]
23/09/24 21:30:23 INFO Executor: Finished task 78.0 in stage 1.0 (TID 228). 1844 bytes result sent to driver
23/09/24 21:30:23 INFO CoarseGrainedExecutorBackend: Got assigned task 244
23/09/24 21:30:23 INFO Executor: Running task 94.0 in stage 1.0 (TID 244)
23/09/24 21:30:23 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12616466432-12750684160, partition values: [empty row]
23/09/24 21:30:23 INFO Executor: Finished task 81.0 in stage 1.0 (TID 231). 1844 bytes result sent to driver
23/09/24 21:30:23 INFO CoarseGrainedExecutorBackend: Got assigned task 246
23/09/24 21:30:23 INFO Executor: Running task 96.0 in stage 1.0 (TID 246)
23/09/24 21:30:23 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12884901888-13019119616, partition values: [empty row]
23/09/24 21:30:23 INFO Executor: Finished task 82.0 in stage 1.0 (TID 232). 1844 bytes result sent to driver
23/09/24 21:30:23 INFO CoarseGrainedExecutorBackend: Got assigned task 247
23/09/24 21:30:23 INFO Executor: Running task 97.0 in stage 1.0 (TID 247)
23/09/24 21:30:23 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13019119616-13153337344, partition values: [empty row]
23/09/24 21:30:23 INFO Executor: Finished task 84.0 in stage 1.0 (TID 234). 1844 bytes result sent to driver
23/09/24 21:30:23 INFO CoarseGrainedExecutorBackend: Got assigned task 248
23/09/24 21:30:23 INFO Executor: Running task 98.0 in stage 1.0 (TID 248)
23/09/24 21:30:23 INFO Executor: Finished task 83.0 in stage 1.0 (TID 233). 1844 bytes result sent to driver
23/09/24 21:30:23 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13153337344-13287555072, partition values: [empty row]
23/09/24 21:30:23 INFO CoarseGrainedExecutorBackend: Got assigned task 249
23/09/24 21:30:23 INFO Executor: Running task 99.0 in stage 1.0 (TID 249)
23/09/24 21:30:23 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13287555072-13421772800, partition values: [empty row]
23/09/24 21:30:23 INFO Executor: Finished task 94.0 in stage 1.0 (TID 244). 1844 bytes result sent to driver
23/09/24 21:30:23 INFO CoarseGrainedExecutorBackend: Got assigned task 259
23/09/24 21:30:23 INFO Executor: Running task 109.0 in stage 1.0 (TID 259)
23/09/24 21:30:23 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14629732352-14763950080, partition values: [empty row]
23/09/24 21:30:24 INFO Executor: Finished task 96.0 in stage 1.0 (TID 246). 1844 bytes result sent to driver
23/09/24 21:30:24 INFO CoarseGrainedExecutorBackend: Got assigned task 261
23/09/24 21:30:24 INFO Executor: Running task 111.0 in stage 1.0 (TID 261)
23/09/24 21:30:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14898167808-15032385536, partition values: [empty row]
23/09/24 21:30:24 INFO Executor: Finished task 97.0 in stage 1.0 (TID 247). 1887 bytes result sent to driver
23/09/24 21:30:24 INFO CoarseGrainedExecutorBackend: Got assigned task 262
23/09/24 21:30:24 INFO Executor: Running task 112.0 in stage 1.0 (TID 262)
23/09/24 21:30:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15032385536-15166603264, partition values: [empty row]
23/09/24 21:30:24 INFO Executor: Finished task 99.0 in stage 1.0 (TID 249). 1887 bytes result sent to driver
23/09/24 21:30:24 INFO CoarseGrainedExecutorBackend: Got assigned task 263
23/09/24 21:30:24 INFO Executor: Running task 113.0 in stage 1.0 (TID 263)
23/09/24 21:30:24 INFO Executor: Finished task 98.0 in stage 1.0 (TID 248). 1887 bytes result sent to driver
23/09/24 21:30:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15166603264-15300820992, partition values: [empty row]
23/09/24 21:30:24 INFO CoarseGrainedExecutorBackend: Got assigned task 264
23/09/24 21:30:24 INFO Executor: Running task 114.0 in stage 1.0 (TID 264)
23/09/24 21:30:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15300820992-15435038720, partition values: [empty row]
23/09/24 21:30:24 INFO Executor: Finished task 109.0 in stage 1.0 (TID 259). 1887 bytes result sent to driver
23/09/24 21:30:24 INFO CoarseGrainedExecutorBackend: Got assigned task 273
23/09/24 21:30:24 INFO Executor: Running task 123.0 in stage 1.0 (TID 273)
23/09/24 21:30:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16508780544-16642998272, partition values: [empty row]
23/09/24 21:30:24 INFO Executor: Finished task 111.0 in stage 1.0 (TID 261). 1887 bytes result sent to driver
23/09/24 21:30:24 INFO CoarseGrainedExecutorBackend: Got assigned task 276
23/09/24 21:30:24 INFO Executor: Running task 126.0 in stage 1.0 (TID 276)
23/09/24 21:30:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16911433728-17045651456, partition values: [empty row]
23/09/24 21:30:24 INFO Executor: Finished task 112.0 in stage 1.0 (TID 262). 1844 bytes result sent to driver
23/09/24 21:30:24 INFO CoarseGrainedExecutorBackend: Got assigned task 277
23/09/24 21:30:24 INFO Executor: Running task 127.0 in stage 1.0 (TID 277)
23/09/24 21:30:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17045651456-17179869184, partition values: [empty row]
23/09/24 21:30:24 INFO Executor: Finished task 114.0 in stage 1.0 (TID 264). 1844 bytes result sent to driver
23/09/24 21:30:24 INFO CoarseGrainedExecutorBackend: Got assigned task 278
23/09/24 21:30:24 INFO Executor: Running task 128.0 in stage 1.0 (TID 278)
23/09/24 21:30:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17179869184-17314086912, partition values: [empty row]
23/09/24 21:30:24 INFO Executor: Finished task 113.0 in stage 1.0 (TID 263). 1844 bytes result sent to driver
23/09/24 21:30:24 INFO CoarseGrainedExecutorBackend: Got assigned task 279
23/09/24 21:30:24 INFO Executor: Running task 129.0 in stage 1.0 (TID 279)
23/09/24 21:30:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17314086912-17448304640, partition values: [empty row]
23/09/24 21:30:25 INFO Executor: Finished task 123.0 in stage 1.0 (TID 273). 1844 bytes result sent to driver
23/09/24 21:30:25 INFO CoarseGrainedExecutorBackend: Got assigned task 287
23/09/24 21:30:25 INFO Executor: Running task 137.0 in stage 1.0 (TID 287)
23/09/24 21:30:25 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18387828736-18522046464, partition values: [empty row]
23/09/24 21:30:25 INFO Executor: Finished task 126.0 in stage 1.0 (TID 276). 1844 bytes result sent to driver
23/09/24 21:30:25 INFO CoarseGrainedExecutorBackend: Got assigned task 291
23/09/24 21:30:25 INFO Executor: Running task 141.0 in stage 1.0 (TID 291)
23/09/24 21:30:25 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18924699648-19058917376, partition values: [empty row]
23/09/24 21:30:25 INFO Executor: Finished task 127.0 in stage 1.0 (TID 277). 1844 bytes result sent to driver
23/09/24 21:30:25 INFO CoarseGrainedExecutorBackend: Got assigned task 292
23/09/24 21:30:25 INFO Executor: Running task 142.0 in stage 1.0 (TID 292)
23/09/24 21:30:25 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19058917376-19193135104, partition values: [empty row]
23/09/24 21:30:25 INFO Executor: Finished task 128.0 in stage 1.0 (TID 278). 1844 bytes result sent to driver
23/09/24 21:30:25 INFO CoarseGrainedExecutorBackend: Got assigned task 293
23/09/24 21:30:25 INFO Executor: Running task 143.0 in stage 1.0 (TID 293)
23/09/24 21:30:25 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19193135104-19327352832, partition values: [empty row]
23/09/24 21:30:25 INFO Executor: Finished task 129.0 in stage 1.0 (TID 279). 1844 bytes result sent to driver
23/09/24 21:30:25 INFO CoarseGrainedExecutorBackend: Got assigned task 294
23/09/24 21:30:25 INFO Executor: Running task 144.0 in stage 1.0 (TID 294)
23/09/24 21:30:25 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19327352832-19461570560, partition values: [empty row]
23/09/24 21:30:26 INFO Executor: Finished task 137.0 in stage 1.0 (TID 287). 1844 bytes result sent to driver
23/09/24 21:30:26 INFO Executor: Finished task 141.0 in stage 1.0 (TID 291). 1844 bytes result sent to driver
23/09/24 21:30:26 INFO Executor: Finished task 142.0 in stage 1.0 (TID 292). 1844 bytes result sent to driver
23/09/24 21:30:26 INFO Executor: Finished task 143.0 in stage 1.0 (TID 293). 1844 bytes result sent to driver
23/09/24 21:30:26 INFO Executor: Finished task 144.0 in stage 1.0 (TID 294). 1844 bytes result sent to driver
23/09/24 21:30:26 INFO CoarseGrainedExecutorBackend: Got assigned task 300
23/09/24 21:30:26 INFO Executor: Running task 0.0 in stage 2.0 (TID 300)
23/09/24 21:30:26 INFO MapOutputTrackerWorker: Updating epoch to 1 and clearing cache
23/09/24 21:30:26 INFO TorrentBroadcast: Started reading broadcast variable 4 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:30:26 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 5.0 KiB, free 5.2 GiB)
23/09/24 21:30:26 INFO TorrentBroadcast: Reading broadcast variable 4 took 7 ms
23/09/24 21:30:26 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 10.1 KiB, free 5.2 GiB)
23/09/24 21:30:26 INFO MapOutputTrackerWorker: Don't have map outputs for shuffle 0, fetching them
23/09/24 21:30:26 INFO MapOutputTrackerWorker: Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@static.154.188.161.5.clients.your-server.de:45295)
23/09/24 21:30:26 INFO MapOutputTrackerWorker: Got the output locations
23/09/24 21:30:26 INFO ShuffleBlockFetcherIterator: Getting 150 (8.8 KiB) non-empty blocks including 50 (2.9 KiB) local and 100 (5.9 KiB) host-local and 0 (0.0 B) remote blocks
23/09/24 21:30:26 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 16 ms
23/09/24 21:30:26 INFO TransportClientFactory: Successfully created connection to /5.161.188.154:43909 after 2 ms (0 ms spent in bootstraps)
23/09/24 21:30:26 INFO TransportClientFactory: Successfully created connection to /5.161.188.154:46709 after 1 ms (0 ms spent in bootstraps)
23/09/24 21:30:26 INFO CodeGenerator: Code generated in 13.290388 ms
23/09/24 21:30:26 INFO Executor: Finished task 0.0 in stage 2.0 (TID 300). 2450 bytes result sent to driver
23/09/24 21:30:27 INFO CoarseGrainedExecutorBackend: Got assigned task 302
23/09/24 21:30:27 INFO CoarseGrainedExecutorBackend: Got assigned task 305
23/09/24 21:30:27 INFO Executor: Running task 1.0 in stage 3.0 (TID 302)
23/09/24 21:30:27 INFO Executor: Running task 4.0 in stage 3.0 (TID 305)
23/09/24 21:30:27 INFO CoarseGrainedExecutorBackend: Got assigned task 308
23/09/24 21:30:27 INFO CoarseGrainedExecutorBackend: Got assigned task 311
23/09/24 21:30:27 INFO Executor: Running task 7.0 in stage 3.0 (TID 308)
23/09/24 21:30:27 INFO CoarseGrainedExecutorBackend: Got assigned task 314
23/09/24 21:30:27 INFO Executor: Running task 10.0 in stage 3.0 (TID 311)
23/09/24 21:30:27 INFO Executor: Running task 13.0 in stage 3.0 (TID 314)
23/09/24 21:30:27 INFO TorrentBroadcast: Started reading broadcast variable 6 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:30:27 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 26.8 KiB, free 5.2 GiB)
23/09/24 21:30:27 INFO TorrentBroadcast: Reading broadcast variable 6 took 8 ms
23/09/24 21:30:27 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 92.6 KiB, free 5.2 GiB)
23/09/24 21:30:27 INFO CodeGenerator: Code generated in 95.399682 ms
23/09/24 21:30:28 INFO CodeGenerator: Code generated in 112.471286 ms
23/09/24 21:30:28 INFO CodeGenerator: Code generated in 21.881017 ms
23/09/24 21:30:28 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 134217728-268435456, partition values: [empty row]
23/09/24 21:30:28 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1342177280-1476395008, partition values: [empty row]
23/09/24 21:30:28 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 536870912-671088640, partition values: [empty row]
23/09/24 21:30:28 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 939524096-1073741824, partition values: [empty row]
23/09/24 21:30:28 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1744830464-1879048192, partition values: [empty row]
23/09/24 21:30:28 INFO CodeGenerator: Code generated in 29.536905 ms
23/09/24 21:30:28 INFO TorrentBroadcast: Started reading broadcast variable 5 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:30:28 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 24.8 KiB, free 5.2 GiB)
23/09/24 21:30:28 INFO TorrentBroadcast: Reading broadcast variable 5 took 7 ms
23/09/24 21:30:28 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 394.6 KiB, free 5.2 GiB)
23/09/24 21:30:29 INFO CodeGenerator: Code generated in 168.500578 ms
23/09/24 21:30:33 INFO MemoryStore: Block rdd_22_10 stored as values in memory (estimated size 86.9 MiB, free 5.1 GiB)
23/09/24 21:30:33 INFO CodeGenerator: Code generated in 5.409587 ms
23/09/24 21:30:33 INFO CodeGenerator: Code generated in 17.905196 ms
23/09/24 21:30:33 INFO Executor: Finished task 10.0 in stage 3.0 (TID 311). 2452 bytes result sent to driver
23/09/24 21:30:33 INFO CoarseGrainedExecutorBackend: Got assigned task 316
23/09/24 21:30:33 INFO Executor: Running task 15.0 in stage 3.0 (TID 316)
23/09/24 21:30:33 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2013265920-2147483648, partition values: [empty row]
23/09/24 21:30:33 INFO MemoryStore: Block rdd_22_7 stored as values in memory (estimated size 116.9 MiB, free 5.0 GiB)
23/09/24 21:30:33 INFO MemoryStore: Block rdd_22_1 stored as values in memory (estimated size 117.0 MiB, free 4.8 GiB)
23/09/24 21:30:33 INFO Executor: Finished task 7.0 in stage 3.0 (TID 308). 2452 bytes result sent to driver
23/09/24 21:30:33 INFO Executor: Finished task 1.0 in stage 3.0 (TID 302). 2452 bytes result sent to driver
23/09/24 21:30:33 INFO CoarseGrainedExecutorBackend: Got assigned task 317
23/09/24 21:30:33 INFO Executor: Running task 16.0 in stage 3.0 (TID 317)
23/09/24 21:30:33 INFO CoarseGrainedExecutorBackend: Got assigned task 318
23/09/24 21:30:33 INFO Executor: Running task 17.0 in stage 3.0 (TID 318)
23/09/24 21:30:33 INFO MemoryStore: Block rdd_22_13 stored as values in memory (estimated size 117.0 MiB, free 4.7 GiB)
23/09/24 21:30:33 INFO Executor: Finished task 13.0 in stage 3.0 (TID 314). 2452 bytes result sent to driver
23/09/24 21:30:33 INFO CoarseGrainedExecutorBackend: Got assigned task 320
23/09/24 21:30:33 INFO Executor: Running task 19.0 in stage 3.0 (TID 320)
23/09/24 21:30:33 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2281701376-2415919104, partition values: [empty row]
23/09/24 21:30:33 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2147483648-2281701376, partition values: [empty row]
23/09/24 21:30:33 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2550136832-2684354560, partition values: [empty row]
23/09/24 21:30:34 INFO MemoryStore: Block rdd_22_4 stored as values in memory (estimated size 116.9 MiB, free 4.6 GiB)
23/09/24 21:30:34 INFO Executor: Finished task 4.0 in stage 3.0 (TID 305). 2452 bytes result sent to driver
23/09/24 21:30:34 INFO CoarseGrainedExecutorBackend: Got assigned task 322
23/09/24 21:30:34 INFO Executor: Running task 21.0 in stage 3.0 (TID 322)
23/09/24 21:30:34 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2818572288-2952790016, partition values: [empty row]
23/09/24 21:30:37 INFO MemoryStore: Block rdd_22_15 stored as values in memory (estimated size 116.6 MiB, free 4.5 GiB)
23/09/24 21:30:37 INFO Executor: Finished task 15.0 in stage 3.0 (TID 316). 2452 bytes result sent to driver
23/09/24 21:30:37 INFO CoarseGrainedExecutorBackend: Got assigned task 331
23/09/24 21:30:37 INFO Executor: Running task 30.0 in stage 3.0 (TID 331)
23/09/24 21:30:37 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4026531840-4160749568, partition values: [empty row]
23/09/24 21:30:37 INFO MemoryStore: Block rdd_22_17 stored as values in memory (estimated size 116.6 MiB, free 4.4 GiB)
23/09/24 21:30:37 INFO Executor: Finished task 17.0 in stage 3.0 (TID 318). 2452 bytes result sent to driver
23/09/24 21:30:37 INFO CoarseGrainedExecutorBackend: Got assigned task 333
23/09/24 21:30:37 INFO Executor: Running task 32.0 in stage 3.0 (TID 333)
23/09/24 21:30:38 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4294967296-4429185024, partition values: [empty row]
23/09/24 21:30:38 INFO MemoryStore: Block rdd_22_19 stored as values in memory (estimated size 116.9 MiB, free 4.3 GiB)
23/09/24 21:30:38 INFO MemoryStore: Block rdd_22_16 stored as values in memory (estimated size 116.6 MiB, free 4.2 GiB)
23/09/24 21:30:38 INFO Executor: Finished task 19.0 in stage 3.0 (TID 320). 2452 bytes result sent to driver
23/09/24 21:30:38 INFO CoarseGrainedExecutorBackend: Got assigned task 334
23/09/24 21:30:38 INFO Executor: Finished task 16.0 in stage 3.0 (TID 317). 2452 bytes result sent to driver
23/09/24 21:30:38 INFO Executor: Running task 33.0 in stage 3.0 (TID 334)
23/09/24 21:30:38 INFO CoarseGrainedExecutorBackend: Got assigned task 335
23/09/24 21:30:38 INFO Executor: Running task 34.0 in stage 3.0 (TID 335)
23/09/24 21:30:38 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4429185024-4563402752, partition values: [empty row]
23/09/24 21:30:38 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4563402752-4697620480, partition values: [empty row]
23/09/24 21:30:38 INFO MemoryStore: Block rdd_22_21 stored as values in memory (estimated size 118.0 MiB, free 4.0 GiB)
23/09/24 21:30:38 INFO Executor: Finished task 21.0 in stage 3.0 (TID 322). 2452 bytes result sent to driver
23/09/24 21:30:38 INFO CoarseGrainedExecutorBackend: Got assigned task 344
23/09/24 21:30:38 INFO Executor: Running task 43.0 in stage 3.0 (TID 344)
23/09/24 21:30:38 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5771362304-5905580032, partition values: [empty row]
23/09/24 21:30:41 INFO MemoryStore: Block rdd_22_30 stored as values in memory (estimated size 117.2 MiB, free 3.9 GiB)
23/09/24 21:30:41 INFO Executor: Finished task 30.0 in stage 3.0 (TID 331). 2452 bytes result sent to driver
23/09/24 21:30:41 INFO CoarseGrainedExecutorBackend: Got assigned task 346
23/09/24 21:30:41 INFO Executor: Running task 45.0 in stage 3.0 (TID 346)
23/09/24 21:30:41 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6039797760-6174015488, partition values: [empty row]
23/09/24 21:30:41 INFO MemoryStore: Block rdd_22_32 stored as values in memory (estimated size 117.0 MiB, free 3.8 GiB)
23/09/24 21:30:41 INFO MemoryStore: Block rdd_22_33 stored as values in memory (estimated size 116.7 MiB, free 3.7 GiB)
23/09/24 21:30:41 INFO Executor: Finished task 32.0 in stage 3.0 (TID 333). 2452 bytes result sent to driver
23/09/24 21:30:41 INFO Executor: Finished task 33.0 in stage 3.0 (TID 334). 2452 bytes result sent to driver
23/09/24 21:30:41 INFO CoarseGrainedExecutorBackend: Got assigned task 348
23/09/24 21:30:41 INFO Executor: Running task 47.0 in stage 3.0 (TID 348)
23/09/24 21:30:41 INFO CoarseGrainedExecutorBackend: Got assigned task 349
23/09/24 21:30:41 INFO Executor: Running task 48.0 in stage 3.0 (TID 349)
23/09/24 21:30:41 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6308233216-6442450944, partition values: [empty row]
23/09/24 21:30:41 INFO MemoryStore: Block rdd_22_34 stored as values in memory (estimated size 116.7 MiB, free 3.6 GiB)
23/09/24 21:30:41 INFO Executor: Finished task 34.0 in stage 3.0 (TID 335). 2452 bytes result sent to driver
23/09/24 21:30:41 INFO CoarseGrainedExecutorBackend: Got assigned task 350
23/09/24 21:30:41 INFO Executor: Running task 49.0 in stage 3.0 (TID 350)
23/09/24 21:30:41 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6442450944-6576668672, partition values: [empty row]
23/09/24 21:30:41 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6576668672-6710886400, partition values: [empty row]
23/09/24 21:30:42 INFO MemoryStore: Block rdd_22_43 stored as values in memory (estimated size 102.3 MiB, free 3.5 GiB)
23/09/24 21:30:42 INFO Executor: Finished task 43.0 in stage 3.0 (TID 344). 2452 bytes result sent to driver
23/09/24 21:30:42 INFO CoarseGrainedExecutorBackend: Got assigned task 360
23/09/24 21:30:42 INFO Executor: Running task 59.0 in stage 3.0 (TID 360)
23/09/24 21:30:42 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7918845952-8053063680, partition values: [empty row]
23/09/24 21:30:45 INFO MemoryStore: Block rdd_22_45 stored as values in memory (estimated size 107.9 MiB, free 3.4 GiB)
23/09/24 21:30:45 INFO Executor: Finished task 45.0 in stage 3.0 (TID 346). 2452 bytes result sent to driver
23/09/24 21:30:45 INFO CoarseGrainedExecutorBackend: Got assigned task 361
23/09/24 21:30:45 INFO Executor: Running task 60.0 in stage 3.0 (TID 361)
23/09/24 21:30:45 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8053063680-8187281408, partition values: [empty row]
23/09/24 21:30:45 INFO MemoryStore: Block rdd_22_47 stored as values in memory (estimated size 115.5 MiB, free 3.3 GiB)
23/09/24 21:30:45 INFO Executor: Finished task 47.0 in stage 3.0 (TID 348). 2495 bytes result sent to driver
23/09/24 21:30:45 INFO MemoryStore: Block rdd_22_49 stored as values in memory (estimated size 113.4 MiB, free 3.2 GiB)
23/09/24 21:30:45 INFO CoarseGrainedExecutorBackend: Got assigned task 364
23/09/24 21:30:45 INFO Executor: Running task 63.0 in stage 3.0 (TID 364)
23/09/24 21:30:45 INFO Executor: Finished task 49.0 in stage 3.0 (TID 350). 2452 bytes result sent to driver
23/09/24 21:30:45 INFO CoarseGrainedExecutorBackend: Got assigned task 365
23/09/24 21:30:45 INFO Executor: Running task 64.0 in stage 3.0 (TID 365)
23/09/24 21:30:45 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8589934592-8724152320, partition values: [empty row]
23/09/24 21:30:45 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8455716864-8589934592, partition values: [empty row]
23/09/24 21:30:45 INFO MemoryStore: Block rdd_22_48 stored as values in memory (estimated size 114.0 MiB, free 3.0 GiB)
23/09/24 21:30:45 INFO Executor: Finished task 48.0 in stage 3.0 (TID 349). 2452 bytes result sent to driver
23/09/24 21:30:45 INFO CoarseGrainedExecutorBackend: Got assigned task 367
23/09/24 21:30:45 INFO Executor: Running task 66.0 in stage 3.0 (TID 367)
23/09/24 21:30:45 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8858370048-8992587776, partition values: [empty row]
23/09/24 21:30:46 INFO MemoryStore: Block rdd_22_59 stored as values in memory (estimated size 116.9 MiB, free 2.9 GiB)
23/09/24 21:30:46 INFO Executor: Finished task 59.0 in stage 3.0 (TID 360). 2452 bytes result sent to driver
23/09/24 21:30:46 INFO CoarseGrainedExecutorBackend: Got assigned task 375
23/09/24 21:30:46 INFO Executor: Running task 74.0 in stage 3.0 (TID 375)
23/09/24 21:30:46 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9932111872-10066329600, partition values: [empty row]
23/09/24 21:30:48 INFO MemoryStore: Block rdd_22_60 stored as values in memory (estimated size 116.8 MiB, free 2.8 GiB)
23/09/24 21:30:49 INFO Executor: Finished task 60.0 in stage 3.0 (TID 361). 2452 bytes result sent to driver
23/09/24 21:30:49 INFO CoarseGrainedExecutorBackend: Got assigned task 378
23/09/24 21:30:49 INFO Executor: Running task 77.0 in stage 3.0 (TID 378)
23/09/24 21:30:49 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10334765056-10468982784, partition values: [empty row]
23/09/24 21:30:49 INFO MemoryStore: Block rdd_22_63 stored as values in memory (estimated size 116.7 MiB, free 2.7 GiB)
23/09/24 21:30:49 INFO Executor: Finished task 63.0 in stage 3.0 (TID 364). 2452 bytes result sent to driver
23/09/24 21:30:49 INFO CoarseGrainedExecutorBackend: Got assigned task 379
23/09/24 21:30:49 INFO Executor: Running task 78.0 in stage 3.0 (TID 379)
23/09/24 21:30:49 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10468982784-10603200512, partition values: [empty row]
23/09/24 21:30:49 INFO MemoryStore: Block rdd_22_64 stored as values in memory (estimated size 116.9 MiB, free 2.6 GiB)
23/09/24 21:30:49 INFO Executor: Finished task 64.0 in stage 3.0 (TID 365). 2452 bytes result sent to driver
23/09/24 21:30:49 INFO CoarseGrainedExecutorBackend: Got assigned task 380
23/09/24 21:30:49 INFO Executor: Running task 79.0 in stage 3.0 (TID 380)
23/09/24 21:30:49 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10603200512-10737418240, partition values: [empty row]
23/09/24 21:30:49 INFO MemoryStore: Block rdd_22_66 stored as values in memory (estimated size 116.9 MiB, free 2.5 GiB)
23/09/24 21:30:49 INFO Executor: Finished task 66.0 in stage 3.0 (TID 367). 2452 bytes result sent to driver
23/09/24 21:30:49 INFO CoarseGrainedExecutorBackend: Got assigned task 382
23/09/24 21:30:49 INFO Executor: Running task 81.0 in stage 3.0 (TID 382)
23/09/24 21:30:49 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10871635968-11005853696, partition values: [empty row]
23/09/24 21:30:50 INFO MemoryStore: Block rdd_22_74 stored as values in memory (estimated size 116.7 MiB, free 2.4 GiB)
23/09/24 21:30:50 INFO Executor: Finished task 74.0 in stage 3.0 (TID 375). 2452 bytes result sent to driver
23/09/24 21:30:50 INFO CoarseGrainedExecutorBackend: Got assigned task 390
23/09/24 21:30:50 INFO Executor: Running task 89.0 in stage 3.0 (TID 390)
23/09/24 21:30:50 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11945377792-12079595520, partition values: [empty row]
23/09/24 21:30:52 INFO MemoryStore: Block rdd_22_78 stored as values in memory (estimated size 116.6 MiB, free 2.2 GiB)
23/09/24 21:30:52 INFO MemoryStore: Block rdd_22_79 stored as values in memory (estimated size 116.9 MiB, free 2.1 GiB)
23/09/24 21:30:52 INFO Executor: Finished task 79.0 in stage 3.0 (TID 380). 2452 bytes result sent to driver
23/09/24 21:30:52 INFO MemoryStore: Block rdd_22_77 stored as values in memory (estimated size 116.8 MiB, free 2.0 GiB)
23/09/24 21:30:52 INFO CoarseGrainedExecutorBackend: Got assigned task 391
23/09/24 21:30:52 INFO Executor: Running task 90.0 in stage 3.0 (TID 391)
23/09/24 21:30:52 INFO Executor: Finished task 77.0 in stage 3.0 (TID 378). 2452 bytes result sent to driver
23/09/24 21:30:52 INFO CoarseGrainedExecutorBackend: Got assigned task 392
23/09/24 21:30:52 INFO Executor: Running task 91.0 in stage 3.0 (TID 392)
23/09/24 21:30:52 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12079595520-12213813248, partition values: [empty row]
23/09/24 21:30:52 INFO Executor: Finished task 78.0 in stage 3.0 (TID 379). 2452 bytes result sent to driver
23/09/24 21:30:52 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12213813248-12348030976, partition values: [empty row]
23/09/24 21:30:52 INFO CoarseGrainedExecutorBackend: Got assigned task 393
23/09/24 21:30:52 INFO Executor: Running task 92.0 in stage 3.0 (TID 393)
23/09/24 21:30:52 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12348030976-12482248704, partition values: [empty row]
23/09/24 21:30:52 INFO MemoryStore: Block rdd_22_81 stored as values in memory (estimated size 116.8 MiB, free 1952.0 MiB)
23/09/24 21:30:52 INFO Executor: Finished task 81.0 in stage 3.0 (TID 382). 2452 bytes result sent to driver
23/09/24 21:30:52 INFO CoarseGrainedExecutorBackend: Got assigned task 396
23/09/24 21:30:52 INFO Executor: Running task 95.0 in stage 3.0 (TID 396)
23/09/24 21:30:53 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12750684160-12884901888, partition values: [empty row]
23/09/24 21:30:53 INFO MemoryStore: Block rdd_22_89 stored as values in memory (estimated size 116.9 MiB, free 1835.1 MiB)
23/09/24 21:30:53 INFO Executor: Finished task 89.0 in stage 3.0 (TID 390). 2452 bytes result sent to driver
23/09/24 21:30:53 INFO CoarseGrainedExecutorBackend: Got assigned task 403
23/09/24 21:30:53 INFO Executor: Running task 102.0 in stage 3.0 (TID 403)
23/09/24 21:30:53 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13690208256-13824425984, partition values: [empty row]
23/09/24 21:30:56 INFO MemoryStore: Block rdd_22_91 stored as values in memory (estimated size 116.9 MiB, free 1718.2 MiB)
23/09/24 21:30:56 INFO Executor: Finished task 91.0 in stage 3.0 (TID 392). 2452 bytes result sent to driver
23/09/24 21:30:56 INFO CoarseGrainedExecutorBackend: Got assigned task 406
23/09/24 21:30:56 INFO Executor: Running task 105.0 in stage 3.0 (TID 406)
23/09/24 21:30:56 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14092861440-14227079168, partition values: [empty row]
23/09/24 21:30:56 INFO MemoryStore: Block rdd_22_92 stored as values in memory (estimated size 116.9 MiB, free 1601.2 MiB)
23/09/24 21:30:56 INFO Executor: Finished task 92.0 in stage 3.0 (TID 393). 2452 bytes result sent to driver
23/09/24 21:30:56 INFO CoarseGrainedExecutorBackend: Got assigned task 407
23/09/24 21:30:56 INFO Executor: Running task 106.0 in stage 3.0 (TID 407)
23/09/24 21:30:56 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14227079168-14361296896, partition values: [empty row]
23/09/24 21:30:56 INFO MemoryStore: Block rdd_22_90 stored as values in memory (estimated size 116.9 MiB, free 1484.3 MiB)
23/09/24 21:30:56 INFO Executor: Finished task 90.0 in stage 3.0 (TID 391). 2452 bytes result sent to driver
23/09/24 21:30:56 INFO CoarseGrainedExecutorBackend: Got assigned task 409
23/09/24 21:30:56 INFO Executor: Running task 108.0 in stage 3.0 (TID 409)
23/09/24 21:30:56 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14495514624-14629732352, partition values: [empty row]
23/09/24 21:30:56 INFO MemoryStore: Block rdd_22_95 stored as values in memory (estimated size 116.9 MiB, free 1367.5 MiB)
23/09/24 21:30:56 INFO Executor: Finished task 95.0 in stage 3.0 (TID 396). 2452 bytes result sent to driver
23/09/24 21:30:56 INFO CoarseGrainedExecutorBackend: Got assigned task 411
23/09/24 21:30:56 INFO Executor: Running task 110.0 in stage 3.0 (TID 411)
23/09/24 21:30:57 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14763950080-14898167808, partition values: [empty row]
23/09/24 21:30:57 INFO MemoryStore: Block rdd_22_102 stored as values in memory (estimated size 116.6 MiB, free 1250.8 MiB)
23/09/24 21:30:57 INFO Executor: Finished task 102.0 in stage 3.0 (TID 403). 2452 bytes result sent to driver
23/09/24 21:30:57 INFO CoarseGrainedExecutorBackend: Got assigned task 418
23/09/24 21:30:57 INFO Executor: Running task 117.0 in stage 3.0 (TID 418)
23/09/24 21:30:57 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15703474176-15837691904, partition values: [empty row]
23/09/24 21:31:00 INFO MemoryStore: Block rdd_22_105 stored as values in memory (estimated size 116.9 MiB, free 1133.9 MiB)
23/09/24 21:31:00 INFO Executor: Finished task 105.0 in stage 3.0 (TID 406). 2452 bytes result sent to driver
23/09/24 21:31:00 INFO CoarseGrainedExecutorBackend: Got assigned task 422
23/09/24 21:31:00 INFO Executor: Running task 121.0 in stage 3.0 (TID 422)
23/09/24 21:31:00 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16240345088-16374562816, partition values: [empty row]
23/09/24 21:31:00 INFO MemoryStore: Block rdd_22_108 stored as values in memory (estimated size 116.9 MiB, free 1017.0 MiB)
23/09/24 21:31:00 INFO Executor: Finished task 108.0 in stage 3.0 (TID 409). 2452 bytes result sent to driver
23/09/24 21:31:00 INFO CoarseGrainedExecutorBackend: Got assigned task 424
23/09/24 21:31:00 INFO Executor: Running task 123.0 in stage 3.0 (TID 424)
23/09/24 21:31:00 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16508780544-16642998272, partition values: [empty row]
23/09/24 21:31:00 INFO MemoryStore: Block rdd_22_106 stored as values in memory (estimated size 116.9 MiB, free 900.1 MiB)
23/09/24 21:31:00 INFO Executor: Finished task 106.0 in stage 3.0 (TID 407). 2452 bytes result sent to driver
23/09/24 21:31:00 INFO CoarseGrainedExecutorBackend: Got assigned task 425
23/09/24 21:31:00 INFO Executor: Running task 124.0 in stage 3.0 (TID 425)
23/09/24 21:31:01 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16642998272-16777216000, partition values: [empty row]
23/09/24 21:31:01 INFO MemoryStore: Block rdd_22_110 stored as values in memory (estimated size 116.9 MiB, free 783.2 MiB)
23/09/24 21:31:01 INFO Executor: Finished task 110.0 in stage 3.0 (TID 411). 2452 bytes result sent to driver
23/09/24 21:31:01 INFO CoarseGrainedExecutorBackend: Got assigned task 426
23/09/24 21:31:01 INFO Executor: Running task 125.0 in stage 3.0 (TID 426)
23/09/24 21:31:01 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16777216000-16911433728, partition values: [empty row]
23/09/24 21:31:01 INFO MemoryStore: Block rdd_22_117 stored as values in memory (estimated size 116.9 MiB, free 666.3 MiB)
23/09/24 21:31:01 INFO Executor: Finished task 117.0 in stage 3.0 (TID 418). 2452 bytes result sent to driver
23/09/24 21:31:01 INFO CoarseGrainedExecutorBackend: Got assigned task 430
23/09/24 21:31:01 INFO Executor: Running task 129.0 in stage 3.0 (TID 430)
23/09/24 21:31:01 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17314086912-17448304640, partition values: [empty row]
23/09/24 21:31:04 INFO MemoryStore: Block rdd_22_121 stored as values in memory (estimated size 116.9 MiB, free 549.3 MiB)
23/09/24 21:31:04 INFO Executor: Finished task 121.0 in stage 3.0 (TID 422). 2452 bytes result sent to driver
23/09/24 21:31:04 INFO CoarseGrainedExecutorBackend: Got assigned task 436
23/09/24 21:31:04 INFO Executor: Running task 135.0 in stage 3.0 (TID 436)
23/09/24 21:31:04 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18119393280-18253611008, partition values: [empty row]
23/09/24 21:31:04 INFO MemoryStore: Block rdd_22_123 stored as values in memory (estimated size 116.9 MiB, free 432.4 MiB)
23/09/24 21:31:04 INFO Executor: Finished task 123.0 in stage 3.0 (TID 424). 2452 bytes result sent to driver
23/09/24 21:31:04 INFO CoarseGrainedExecutorBackend: Got assigned task 437
23/09/24 21:31:04 INFO Executor: Running task 136.0 in stage 3.0 (TID 437)
23/09/24 21:31:04 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18253611008-18387828736, partition values: [empty row]
23/09/24 21:31:04 INFO MemoryStore: Block rdd_22_124 stored as values in memory (estimated size 116.9 MiB, free 315.5 MiB)
23/09/24 21:31:04 INFO Executor: Finished task 124.0 in stage 3.0 (TID 425). 2452 bytes result sent to driver
23/09/24 21:31:04 INFO CoarseGrainedExecutorBackend: Got assigned task 438
23/09/24 21:31:04 INFO Executor: Running task 137.0 in stage 3.0 (TID 438)
23/09/24 21:31:04 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18387828736-18522046464, partition values: [empty row]
23/09/24 21:31:04 INFO MemoryStore: Block rdd_22_125 stored as values in memory (estimated size 116.9 MiB, free 198.6 MiB)
23/09/24 21:31:04 INFO Executor: Finished task 125.0 in stage 3.0 (TID 426). 2452 bytes result sent to driver
23/09/24 21:31:04 INFO CoarseGrainedExecutorBackend: Got assigned task 440
23/09/24 21:31:04 INFO Executor: Running task 139.0 in stage 3.0 (TID 440)
23/09/24 21:31:04 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18656264192-18790481920, partition values: [empty row]
23/09/24 21:31:05 INFO MemoryStore: Block rdd_22_129 stored as values in memory (estimated size 116.9 MiB, free 81.7 MiB)
23/09/24 21:31:05 INFO Executor: Finished task 129.0 in stage 3.0 (TID 430). 2452 bytes result sent to driver
23/09/24 21:31:05 INFO CoarseGrainedExecutorBackend: Got assigned task 445
23/09/24 21:31:05 INFO Executor: Running task 144.0 in stage 3.0 (TID 445)
23/09/24 21:31:05 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19327352832-19461570560, partition values: [empty row]
23/09/24 21:31:07 INFO MemoryStore: Will not store rdd_22_135
23/09/24 21:31:07 INFO MemoryStore: Will not store rdd_22_136
23/09/24 21:31:07 WARN MemoryStore: Not enough space to cache rdd_22_135 in memory! (computed 64.8 MiB so far)
23/09/24 21:31:07 WARN MemoryStore: Not enough space to cache rdd_22_136 in memory! (computed 64.8 MiB so far)
23/09/24 21:31:07 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 28.6 MiB (scratch space shared across 5 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:07 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 28.6 MiB (scratch space shared across 5 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:07 INFO MemoryStore: Will not store rdd_22_139
23/09/24 21:31:07 WARN MemoryStore: Not enough space to cache rdd_22_139 in memory! (computed 64.9 MiB so far)
23/09/24 21:31:07 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 28.6 MiB (scratch space shared across 5 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:07 INFO MemoryStore: Will not store rdd_22_137
23/09/24 21:31:07 WARN MemoryStore: Not enough space to cache rdd_22_137 in memory! (computed 64.8 MiB so far)
23/09/24 21:31:07 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 28.6 MiB (scratch space shared across 5 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:08 WARN BlockManager: Block rdd_22_135 could not be removed as it was not found on disk or in memory
23/09/24 21:31:08 WARN BlockManager: Block rdd_22_139 could not be removed as it was not found on disk or in memory
23/09/24 21:31:08 WARN BlockManager: Putting block rdd_22_135 failed
23/09/24 21:31:08 WARN BlockManager: Block rdd_22_136 could not be removed as it was not found on disk or in memory
23/09/24 21:31:08 WARN BlockManager: Putting block rdd_22_136 failed
23/09/24 21:31:08 WARN BlockManager: Putting block rdd_22_139 failed
23/09/24 21:31:08 WARN BlockManager: Block rdd_22_137 could not be removed as it was not found on disk or in memory
23/09/24 21:31:08 WARN BlockManager: Putting block rdd_22_137 failed
23/09/24 21:31:09 INFO MemoryStore: Will not store rdd_22_144
23/09/24 21:31:09 WARN MemoryStore: Not enough space to cache rdd_22_144 in memory! (computed 64.6 MiB so far)
23/09/24 21:31:09 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 5.7 MiB (scratch space shared across 1 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:09 WARN BlockManager: Block rdd_22_144 could not be removed as it was not found on disk or in memory
23/09/24 21:31:09 WARN BlockManager: Putting block rdd_22_144 failed
23/09/24 21:31:09 INFO Executor: Finished task 135.0 in stage 3.0 (TID 436). 2452 bytes result sent to driver
23/09/24 21:31:09 INFO CoarseGrainedExecutorBackend: Got assigned task 452
23/09/24 21:31:09 INFO Executor: Running task 143.1 in stage 3.0 (TID 452)
23/09/24 21:31:09 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19193135104-19327352832, partition values: [empty row]
23/09/24 21:31:09 INFO Executor: Finished task 139.0 in stage 3.0 (TID 440). 2452 bytes result sent to driver
23/09/24 21:31:09 INFO CoarseGrainedExecutorBackend: Got assigned task 453
23/09/24 21:31:09 INFO Executor: Running task 140.1 in stage 3.0 (TID 453)
23/09/24 21:31:09 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18790481920-18924699648, partition values: [empty row]
23/09/24 21:31:10 INFO Executor: Finished task 137.0 in stage 3.0 (TID 438). 2452 bytes result sent to driver
23/09/24 21:31:10 INFO CoarseGrainedExecutorBackend: Got assigned task 455
23/09/24 21:31:10 INFO Executor: Running task 141.1 in stage 3.0 (TID 455)
23/09/24 21:31:10 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18924699648-19058917376, partition values: [empty row]
23/09/24 21:31:10 INFO Executor: Finished task 136.0 in stage 3.0 (TID 437). 2452 bytes result sent to driver
23/09/24 21:31:10 INFO CoarseGrainedExecutorBackend: Got assigned task 456
23/09/24 21:31:10 INFO Executor: Running task 46.1 in stage 3.0 (TID 456)
23/09/24 21:31:10 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6174015488-6308233216, partition values: [empty row]
23/09/24 21:31:10 INFO Executor: Finished task 144.0 in stage 3.0 (TID 445). 2452 bytes result sent to driver
23/09/24 21:31:11 INFO CoarseGrainedExecutorBackend: Got assigned task 460
23/09/24 21:31:11 INFO Executor: Running task 52.1 in stage 3.0 (TID 460)
23/09/24 21:31:11 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6979321856-7113539584, partition values: [empty row]
23/09/24 21:31:11 INFO MemoryStore: Will not store rdd_22_140
23/09/24 21:31:11 WARN MemoryStore: Not enough space to cache rdd_22_140 in memory! (computed 64.9 MiB so far)
23/09/24 21:31:11 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 28.6 MiB (scratch space shared across 5 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:11 WARN BlockManager: Block rdd_22_140 could not be removed as it was not found on disk or in memory
23/09/24 21:31:11 WARN BlockManager: Putting block rdd_22_140 failed
23/09/24 21:31:12 INFO MemoryStore: Will not store rdd_22_141
23/09/24 21:31:12 WARN MemoryStore: Not enough space to cache rdd_22_141 in memory! (computed 64.9 MiB so far)
23/09/24 21:31:12 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 22.9 MiB (scratch space shared across 4 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:12 WARN BlockManager: Block rdd_22_141 could not be removed as it was not found on disk or in memory
23/09/24 21:31:12 WARN BlockManager: Putting block rdd_22_141 failed
23/09/24 21:31:12 INFO MemoryStore: Will not store rdd_22_46
23/09/24 21:31:12 WARN MemoryStore: Not enough space to cache rdd_22_46 in memory! (computed 65.0 MiB so far)
23/09/24 21:31:12 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 17.1 MiB (scratch space shared across 3 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:12 WARN BlockManager: Block rdd_22_46 could not be removed as it was not found on disk or in memory
23/09/24 21:31:12 WARN BlockManager: Putting block rdd_22_46 failed
23/09/24 21:31:12 INFO MemoryStore: Will not store rdd_22_143
23/09/24 21:31:12 WARN MemoryStore: Not enough space to cache rdd_22_143 in memory! (computed 64.5 MiB so far)
23/09/24 21:31:12 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 11.4 MiB (scratch space shared across 2 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:12 WARN BlockManager: Block rdd_22_143 could not be removed as it was not found on disk or in memory
23/09/24 21:31:12 WARN BlockManager: Putting block rdd_22_143 failed
23/09/24 21:31:12 INFO MemoryStore: Will not store rdd_22_52
23/09/24 21:31:12 WARN MemoryStore: Not enough space to cache rdd_22_52 in memory! (computed 65.0 MiB so far)
23/09/24 21:31:12 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 5.7 MiB (scratch space shared across 1 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:12 WARN BlockManager: Block rdd_22_52 could not be removed as it was not found on disk or in memory
23/09/24 21:31:12 WARN BlockManager: Putting block rdd_22_52 failed
23/09/24 21:31:13 INFO Executor: Finished task 141.1 in stage 3.0 (TID 455). 2452 bytes result sent to driver
23/09/24 21:31:13 INFO CoarseGrainedExecutorBackend: Got assigned task 468
23/09/24 21:31:13 INFO Executor: Running task 127.1 in stage 3.0 (TID 468)
23/09/24 21:31:13 INFO Executor: Finished task 140.1 in stage 3.0 (TID 453). 2452 bytes result sent to driver
23/09/24 21:31:13 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17045651456-17179869184, partition values: [empty row]
23/09/24 21:31:13 INFO CoarseGrainedExecutorBackend: Got assigned task 469
23/09/24 21:31:13 INFO Executor: Running task 82.1 in stage 3.0 (TID 469)
23/09/24 21:31:13 INFO Executor: Finished task 46.1 in stage 3.0 (TID 456). 2452 bytes result sent to driver
23/09/24 21:31:13 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11005853696-11140071424, partition values: [empty row]
23/09/24 21:31:13 INFO CoarseGrainedExecutorBackend: Got assigned task 470
23/09/24 21:31:13 INFO Executor: Running task 14.1 in stage 3.0 (TID 470)
23/09/24 21:31:13 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1879048192-2013265920, partition values: [empty row]
23/09/24 21:31:14 INFO Executor: Finished task 143.1 in stage 3.0 (TID 452). 2452 bytes result sent to driver
23/09/24 21:31:14 INFO CoarseGrainedExecutorBackend: Got assigned task 473
23/09/24 21:31:14 INFO Executor: Running task 5.1 in stage 3.0 (TID 473)
23/09/24 21:31:14 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 671088640-805306368, partition values: [empty row]
23/09/24 21:31:14 INFO Executor: Finished task 52.1 in stage 3.0 (TID 460). 2452 bytes result sent to driver
23/09/24 21:31:14 INFO CoarseGrainedExecutorBackend: Got assigned task 475
23/09/24 21:31:14 INFO Executor: Running task 65.1 in stage 3.0 (TID 475)
23/09/24 21:31:14 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8724152320-8858370048, partition values: [empty row]
23/09/24 21:31:15 INFO MemoryStore: Will not store rdd_22_14
23/09/24 21:31:15 WARN MemoryStore: Not enough space to cache rdd_22_14 in memory! (computed 65.1 MiB so far)
23/09/24 21:31:15 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 28.7 MiB (scratch space shared across 5 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:15 WARN BlockManager: Block rdd_22_14 could not be removed as it was not found on disk or in memory
23/09/24 21:31:15 WARN BlockManager: Putting block rdd_22_14 failed
23/09/24 21:31:15 INFO MemoryStore: Will not store rdd_22_82
23/09/24 21:31:15 WARN MemoryStore: Not enough space to cache rdd_22_82 in memory! (computed 65.0 MiB so far)
23/09/24 21:31:15 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 22.9 MiB (scratch space shared across 4 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:15 WARN BlockManager: Block rdd_22_82 could not be removed as it was not found on disk or in memory
23/09/24 21:31:15 WARN BlockManager: Putting block rdd_22_82 failed
23/09/24 21:31:15 INFO MemoryStore: Will not store rdd_22_127
23/09/24 21:31:15 WARN MemoryStore: Not enough space to cache rdd_22_127 in memory! (computed 64.8 MiB so far)
23/09/24 21:31:15 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 17.2 MiB (scratch space shared across 3 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:15 WARN BlockManager: Block rdd_22_127 could not be removed as it was not found on disk or in memory
23/09/24 21:31:15 WARN BlockManager: Putting block rdd_22_127 failed
23/09/24 21:31:16 INFO MemoryStore: Will not store rdd_22_5
23/09/24 21:31:16 WARN MemoryStore: Not enough space to cache rdd_22_5 in memory! (computed 65.1 MiB so far)
23/09/24 21:31:16 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 11.5 MiB (scratch space shared across 2 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:16 WARN BlockManager: Block rdd_22_5 could not be removed as it was not found on disk or in memory
23/09/24 21:31:16 WARN BlockManager: Putting block rdd_22_5 failed
23/09/24 21:31:16 INFO MemoryStore: Will not store rdd_22_65
23/09/24 21:31:16 WARN MemoryStore: Not enough space to cache rdd_22_65 in memory! (computed 65.0 MiB so far)
23/09/24 21:31:16 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 5.7 MiB (scratch space shared across 1 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:16 WARN BlockManager: Block rdd_22_65 could not be removed as it was not found on disk or in memory
23/09/24 21:31:16 WARN BlockManager: Putting block rdd_22_65 failed
23/09/24 21:31:17 INFO Executor: Finished task 14.1 in stage 3.0 (TID 470). 2452 bytes result sent to driver
23/09/24 21:31:17 INFO CoarseGrainedExecutorBackend: Got assigned task 478
23/09/24 21:31:17 INFO Executor: Running task 11.1 in stage 3.0 (TID 478)
23/09/24 21:31:17 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1476395008-1610612736, partition values: [empty row]
23/09/24 21:31:17 INFO Executor: Finished task 82.1 in stage 3.0 (TID 469). 2452 bytes result sent to driver
23/09/24 21:31:17 INFO CoarseGrainedExecutorBackend: Got assigned task 479
23/09/24 21:31:17 INFO Executor: Running task 56.1 in stage 3.0 (TID 479)
23/09/24 21:31:17 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7516192768-7650410496, partition values: [empty row]
23/09/24 21:31:17 INFO Executor: Finished task 127.1 in stage 3.0 (TID 468). 2452 bytes result sent to driver
23/09/24 21:31:17 INFO CoarseGrainedExecutorBackend: Got assigned task 481
23/09/24 21:31:17 INFO Executor: Running task 26.1 in stage 3.0 (TID 481)
23/09/24 21:31:17 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3489660928-3623878656, partition values: [empty row]
23/09/24 21:31:17 INFO Executor: Finished task 5.1 in stage 3.0 (TID 473). 2452 bytes result sent to driver
23/09/24 21:31:17 INFO CoarseGrainedExecutorBackend: Got assigned task 483
23/09/24 21:31:17 INFO Executor: Running task 62.1 in stage 3.0 (TID 483)
23/09/24 21:31:17 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8321499136-8455716864, partition values: [empty row]
23/09/24 21:31:18 INFO Executor: Finished task 65.1 in stage 3.0 (TID 475). 2452 bytes result sent to driver
23/09/24 21:31:18 INFO CoarseGrainedExecutorBackend: Got assigned task 485
23/09/24 21:31:18 INFO Executor: Running task 80.1 in stage 3.0 (TID 485)
23/09/24 21:31:18 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10737418240-10871635968, partition values: [empty row]
23/09/24 21:31:19 INFO MemoryStore: Will not store rdd_22_56
23/09/24 21:31:19 WARN MemoryStore: Not enough space to cache rdd_22_56 in memory! (computed 65.0 MiB so far)
23/09/24 21:31:19 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 28.7 MiB (scratch space shared across 5 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:19 WARN BlockManager: Block rdd_22_56 could not be removed as it was not found on disk or in memory
23/09/24 21:31:19 WARN BlockManager: Putting block rdd_22_56 failed
23/09/24 21:31:19 INFO MemoryStore: Will not store rdd_22_26
23/09/24 21:31:19 WARN MemoryStore: Not enough space to cache rdd_22_26 in memory! (computed 65.0 MiB so far)
23/09/24 21:31:19 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 22.9 MiB (scratch space shared across 4 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:19 WARN BlockManager: Block rdd_22_26 could not be removed as it was not found on disk or in memory
23/09/24 21:31:19 WARN BlockManager: Putting block rdd_22_26 failed
23/09/24 21:31:19 INFO MemoryStore: Will not store rdd_22_11
23/09/24 21:31:19 WARN MemoryStore: Not enough space to cache rdd_22_11 in memory! (computed 64.6 MiB so far)
23/09/24 21:31:19 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 17.2 MiB (scratch space shared across 3 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:19 WARN BlockManager: Block rdd_22_11 could not be removed as it was not found on disk or in memory
23/09/24 21:31:19 WARN BlockManager: Putting block rdd_22_11 failed
23/09/24 21:31:19 INFO MemoryStore: Will not store rdd_22_62
23/09/24 21:31:19 WARN MemoryStore: Not enough space to cache rdd_22_62 in memory! (computed 65.0 MiB so far)
23/09/24 21:31:19 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 11.5 MiB (scratch space shared across 2 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:19 WARN BlockManager: Block rdd_22_62 could not be removed as it was not found on disk or in memory
23/09/24 21:31:19 WARN BlockManager: Putting block rdd_22_62 failed
23/09/24 21:31:20 INFO MemoryStore: Will not store rdd_22_80
23/09/24 21:31:20 WARN MemoryStore: Not enough space to cache rdd_22_80 in memory! (computed 65.0 MiB so far)
23/09/24 21:31:20 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 5.7 MiB (scratch space shared across 1 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:20 WARN BlockManager: Block rdd_22_80 could not be removed as it was not found on disk or in memory
23/09/24 21:31:20 WARN BlockManager: Putting block rdd_22_80 failed
23/09/24 21:31:20 INFO Executor: Finished task 11.1 in stage 3.0 (TID 478). 2452 bytes result sent to driver
23/09/24 21:31:20 INFO CoarseGrainedExecutorBackend: Got assigned task 488
23/09/24 21:31:20 INFO Executor: Running task 122.1 in stage 3.0 (TID 488)
23/09/24 21:31:20 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16374562816-16508780544, partition values: [empty row]
23/09/24 21:31:20 INFO Executor: Finished task 56.1 in stage 3.0 (TID 479). 2452 bytes result sent to driver
23/09/24 21:31:20 INFO CoarseGrainedExecutorBackend: Got assigned task 489
23/09/24 21:31:20 INFO Executor: Running task 113.1 in stage 3.0 (TID 489)
23/09/24 21:31:20 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15166603264-15300820992, partition values: [empty row]
23/09/24 21:31:21 INFO Executor: Finished task 26.1 in stage 3.0 (TID 481). 2452 bytes result sent to driver
23/09/24 21:31:21 INFO CoarseGrainedExecutorBackend: Got assigned task 491
23/09/24 21:31:21 INFO Executor: Running task 128.1 in stage 3.0 (TID 491)
23/09/24 21:31:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17179869184-17314086912, partition values: [empty row]
23/09/24 21:31:21 INFO Executor: Finished task 62.1 in stage 3.0 (TID 483). 2452 bytes result sent to driver
23/09/24 21:31:21 INFO CoarseGrainedExecutorBackend: Got assigned task 493
23/09/24 21:31:21 INFO Executor: Running task 18.1 in stage 3.0 (TID 493)
23/09/24 21:31:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2415919104-2550136832, partition values: [empty row]
23/09/24 21:31:22 INFO Executor: Finished task 80.1 in stage 3.0 (TID 485). 2452 bytes result sent to driver
23/09/24 21:31:22 INFO CoarseGrainedExecutorBackend: Got assigned task 500
23/09/24 21:31:22 INFO Executor: Running task 126.1 in stage 3.0 (TID 500)
23/09/24 21:31:22 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16911433728-17045651456, partition values: [empty row]
23/09/24 21:31:22 INFO MemoryStore: Will not store rdd_22_122
23/09/24 21:31:22 WARN MemoryStore: Not enough space to cache rdd_22_122 in memory! (computed 64.8 MiB so far)
23/09/24 21:31:22 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 28.6 MiB (scratch space shared across 5 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:22 WARN BlockManager: Block rdd_22_122 could not be removed as it was not found on disk or in memory
23/09/24 21:31:22 WARN BlockManager: Putting block rdd_22_122 failed
23/09/24 21:31:23 INFO MemoryStore: Will not store rdd_22_113
23/09/24 21:31:23 WARN MemoryStore: Not enough space to cache rdd_22_113 in memory! (computed 64.8 MiB so far)
23/09/24 21:31:23 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 22.9 MiB (scratch space shared across 4 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:23 WARN BlockManager: Block rdd_22_113 could not be removed as it was not found on disk or in memory
23/09/24 21:31:23 WARN BlockManager: Putting block rdd_22_113 failed
23/09/24 21:31:23 INFO MemoryStore: Will not store rdd_22_128
23/09/24 21:31:23 WARN MemoryStore: Not enough space to cache rdd_22_128 in memory! (computed 64.8 MiB so far)
23/09/24 21:31:23 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 17.2 MiB (scratch space shared across 3 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:23 WARN BlockManager: Block rdd_22_128 could not be removed as it was not found on disk or in memory
23/09/24 21:31:23 WARN BlockManager: Putting block rdd_22_128 failed
23/09/24 21:31:23 INFO MemoryStore: Will not store rdd_22_18
23/09/24 21:31:23 WARN MemoryStore: Not enough space to cache rdd_22_18 in memory! (computed 65.0 MiB so far)
23/09/24 21:31:23 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 11.5 MiB (scratch space shared across 2 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:23 WARN BlockManager: Block rdd_22_18 could not be removed as it was not found on disk or in memory
23/09/24 21:31:23 WARN BlockManager: Putting block rdd_22_18 failed
23/09/24 21:31:24 INFO MemoryStore: Will not store rdd_22_126
23/09/24 21:31:24 WARN MemoryStore: Not enough space to cache rdd_22_126 in memory! (computed 64.8 MiB so far)
23/09/24 21:31:24 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 5.7 MiB (scratch space shared across 1 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:24 WARN BlockManager: Block rdd_22_126 could not be removed as it was not found on disk or in memory
23/09/24 21:31:24 WARN BlockManager: Putting block rdd_22_126 failed
23/09/24 21:31:24 INFO Executor: Finished task 122.1 in stage 3.0 (TID 488). 2452 bytes result sent to driver
23/09/24 21:31:24 INFO Executor: Finished task 113.1 in stage 3.0 (TID 489). 2452 bytes result sent to driver
23/09/24 21:31:24 INFO Executor: Finished task 18.1 in stage 3.0 (TID 493). 2452 bytes result sent to driver
23/09/24 21:31:25 INFO Executor: Finished task 128.1 in stage 3.0 (TID 491). 2452 bytes result sent to driver
23/09/24 21:31:25 INFO Executor: Finished task 126.1 in stage 3.0 (TID 500). 2452 bytes result sent to driver
23/09/24 21:31:26 INFO CoarseGrainedExecutorBackend: Got assigned task 501
23/09/24 21:31:26 INFO Executor: Running task 0.0 in stage 4.0 (TID 501)
23/09/24 21:31:26 INFO MapOutputTrackerWorker: Updating epoch to 3 and clearing cache
23/09/24 21:31:26 INFO TorrentBroadcast: Started reading broadcast variable 7 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:26 INFO MemoryStore: Block broadcast_7_piece0 stored as bytes in memory (estimated size 5.0 KiB, free 81.7 MiB)
23/09/24 21:31:26 INFO TorrentBroadcast: Reading broadcast variable 7 took 4 ms
23/09/24 21:31:26 INFO MemoryStore: Block broadcast_7 stored as values in memory (estimated size 10.1 KiB, free 81.7 MiB)
23/09/24 21:31:26 INFO MapOutputTrackerWorker: Don't have map outputs for shuffle 1, fetching them
23/09/24 21:31:26 INFO MapOutputTrackerWorker: Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@static.154.188.161.5.clients.your-server.de:45295)
23/09/24 21:31:26 INFO MapOutputTrackerWorker: Got the output locations
23/09/24 21:31:26 INFO ShuffleBlockFetcherIterator: Getting 150 (8.8 KiB) non-empty blocks including 70 (4.1 KiB) local and 80 (4.7 KiB) host-local and 0 (0.0 B) remote blocks
23/09/24 21:31:26 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 2 ms
23/09/24 21:31:26 INFO TransportClientFactory: Successfully created connection to /5.161.188.154:38099 after 1 ms (0 ms spent in bootstraps)
23/09/24 21:31:26 INFO Executor: Finished task 0.0 in stage 4.0 (TID 501). 2450 bytes result sent to driver
23/09/24 21:31:26 INFO CoarseGrainedExecutorBackend: Got assigned task 503
23/09/24 21:31:26 INFO Executor: Running task 0.0 in stage 6.0 (TID 503)
23/09/24 21:31:26 INFO TorrentBroadcast: Started reading broadcast variable 10 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:26 INFO MemoryStore: Block broadcast_10_piece0 stored as bytes in memory (estimated size 7.0 KiB, free 81.7 MiB)
23/09/24 21:31:26 INFO TorrentBroadcast: Reading broadcast variable 10 took 4 ms
23/09/24 21:31:26 INFO MemoryStore: Block broadcast_10 stored as values in memory (estimated size 14.7 KiB, free 81.6 MiB)
23/09/24 21:31:26 INFO CodeGenerator: Code generated in 11.807951 ms
23/09/24 21:31:26 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00056-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4526, partition values: [empty row]
23/09/24 21:31:26 INFO TorrentBroadcast: Started reading broadcast variable 9 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:26 INFO MemoryStore: Block broadcast_9_piece0 stored as bytes in memory (estimated size 25.1 KiB, free 81.6 MiB)
23/09/24 21:31:26 INFO TorrentBroadcast: Reading broadcast variable 9 took 12 ms
23/09/24 21:31:26 INFO MemoryStore: Block broadcast_9 stored as values in memory (estimated size 398.2 KiB, free 81.2 MiB)
23/09/24 21:31:26 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00136-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4489, partition values: [empty row]
23/09/24 21:31:26 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00000-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4486, partition values: [empty row]
23/09/24 21:31:26 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00072-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4485, partition values: [empty row]
23/09/24 21:31:26 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00016-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4480, partition values: [empty row]
23/09/24 21:31:26 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00145-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4447, partition values: [empty row]
23/09/24 21:31:26 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00024-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4420, partition values: [empty row]
23/09/24 21:31:26 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00097-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4419, partition values: [empty row]
23/09/24 21:31:26 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00090-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4387, partition values: [empty row]
23/09/24 21:31:26 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00105-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4380, partition values: [empty row]
23/09/24 21:31:26 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00074-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4364, partition values: [empty row]
23/09/24 21:31:26 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00154-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4340, partition values: [empty row]
23/09/24 21:31:26 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00066-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4281, partition values: [empty row]
23/09/24 21:31:26 INFO Executor: Finished task 0.0 in stage 6.0 (TID 503). 2058 bytes result sent to driver
23/09/24 21:31:27 INFO CoarseGrainedExecutorBackend: Got assigned task 509
23/09/24 21:31:27 INFO Executor: Running task 2.0 in stage 8.0 (TID 509)
23/09/24 21:31:27 INFO MapOutputTrackerWorker: Updating epoch to 4 and clearing cache
23/09/24 21:31:27 INFO TorrentBroadcast: Started reading broadcast variable 13 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:27 INFO MemoryStore: Block broadcast_13_piece0 stored as bytes in memory (estimated size 10.0 KiB, free 81.8 MiB)
23/09/24 21:31:27 INFO TorrentBroadcast: Reading broadcast variable 13 took 5 ms
23/09/24 21:31:27 INFO MemoryStore: Block broadcast_13 stored as values in memory (estimated size 29.8 KiB, free 81.8 MiB)
23/09/24 21:31:27 INFO CodeGenerator: Code generated in 27.708304 ms
23/09/24 21:31:27 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00038-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4078, partition values: [empty row]
23/09/24 21:31:27 INFO TorrentBroadcast: Started reading broadcast variable 12 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:27 INFO MemoryStore: Block broadcast_12_piece0 stored as bytes in memory (estimated size 25.8 KiB, free 82.2 MiB)
23/09/24 21:31:27 INFO TorrentBroadcast: Reading broadcast variable 12 took 8 ms
23/09/24 21:31:27 INFO MemoryStore: Block broadcast_12 stored as values in memory (estimated size 398.2 KiB, free 81.8 MiB)
23/09/24 21:31:27 INFO CodecPool: Got brand-new decompressor [.snappy]
23/09/24 21:31:27 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00044-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4078, partition values: [empty row]
23/09/24 21:31:27 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00015-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4075, partition values: [empty row]
23/09/24 21:31:27 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00009-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4062, partition values: [empty row]
23/09/24 21:31:27 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00085-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4057, partition values: [empty row]
23/09/24 21:31:27 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00105-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4037, partition values: [empty row]
23/09/24 21:31:27 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00004-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4030, partition values: [empty row]
23/09/24 21:31:27 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00064-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4018, partition values: [empty row]
23/09/24 21:31:27 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00082-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4010, partition values: [empty row]
23/09/24 21:31:27 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00071-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4009, partition values: [empty row]
23/09/24 21:31:27 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00101-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-3992, partition values: [empty row]
23/09/24 21:31:27 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00059-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-3992, partition values: [empty row]
23/09/24 21:31:27 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00000-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-1531, partition values: [empty row]
23/09/24 21:31:27 INFO MemoryStore: Block rdd_44_2 stored as values in memory (estimated size 5.3 KiB, free 81.8 MiB)
23/09/24 21:31:27 INFO CodeGenerator: Code generated in 4.690951 ms
23/09/24 21:31:27 INFO CodeGenerator: Code generated in 12.058252 ms
23/09/24 21:31:27 INFO CodeGenerator: Code generated in 7.709336 ms
23/09/24 21:31:27 INFO Executor: Finished task 2.0 in stage 8.0 (TID 509). 2047 bytes result sent to driver
23/09/24 21:31:28 INFO CoarseGrainedExecutorBackend: Got assigned task 512
23/09/24 21:31:28 INFO Executor: Running task 2.0 in stage 9.0 (TID 512)
23/09/24 21:31:28 INFO TorrentBroadcast: Started reading broadcast variable 15 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_15_piece0 stored as bytes in memory (estimated size 13.7 KiB, free 81.8 MiB)
23/09/24 21:31:28 INFO TorrentBroadcast: Reading broadcast variable 15 took 4 ms
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_15 stored as values in memory (estimated size 36.8 KiB, free 81.7 MiB)
23/09/24 21:31:28 INFO BlockManager: Found block rdd_44_2 locally
23/09/24 21:31:28 INFO CodeGenerator: Code generated in 9.66033 ms
23/09/24 21:31:28 INFO CodeGenerator: Code generated in 13.388974 ms
23/09/24 21:31:28 INFO CodeGenerator: Code generated in 10.610961 ms
23/09/24 21:31:28 INFO TorrentBroadcast: Started reading broadcast variable 14 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_14_piece0 stored as bytes in memory (estimated size 1669.0 B, free 81.7 MiB)
23/09/24 21:31:28 INFO TorrentBroadcast: Reading broadcast variable 14 took 4 ms
23/09/24 21:31:28 INFO MemoryStore: 7 blocks selected for dropping (87.8 MiB bytes)
23/09/24 21:31:28 INFO BlockManager: Dropping block broadcast_1_piece0 from memory
23/09/24 21:31:28 INFO BlockManager: Writing block broadcast_1_piece0 to disk
23/09/24 21:31:28 INFO BlockManager: Dropping block broadcast_1 from memory
23/09/24 21:31:28 INFO BlockManager: Writing block broadcast_1 to disk
23/09/24 21:31:28 INFO BlockManager: Dropping block broadcast_0 from memory
23/09/24 21:31:28 INFO BlockManager: Writing block broadcast_0 to disk
23/09/24 21:31:28 INFO BlockManager: Dropping block broadcast_0_piece0 from memory
23/09/24 21:31:28 INFO BlockManager: Writing block broadcast_0_piece0 to disk
23/09/24 21:31:28 INFO BlockManager: Dropping block broadcast_5 from memory
23/09/24 21:31:28 INFO BlockManager: Writing block broadcast_5 to disk
23/09/24 21:31:28 INFO BlockManager: Dropping block broadcast_5_piece0 from memory
23/09/24 21:31:28 INFO BlockManager: Writing block broadcast_5_piece0 to disk
23/09/24 21:31:28 INFO BlockManager: Dropping block rdd_22_10 from memory
23/09/24 21:31:28 INFO MemoryStore: After dropping 7 blocks, free memory is 169.5 MiB
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_14 stored as values in memory (estimated size 64.0 MiB, free 105.5 MiB)
23/09/24 21:31:28 INFO Executor: Finished task 2.0 in stage 9.0 (TID 512). 2435 bytes result sent to driver
23/09/24 21:31:28 INFO CoarseGrainedExecutorBackend: Got assigned task 515
23/09/24 21:31:28 INFO Executor: Running task 2.0 in stage 11.0 (TID 515)
23/09/24 21:31:28 INFO MapOutputTrackerWorker: Updating epoch to 5 and clearing cache
23/09/24 21:31:28 INFO TorrentBroadcast: Started reading broadcast variable 17 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_17_piece0 stored as bytes in memory (estimated size 10.5 KiB, free 105.5 MiB)
23/09/24 21:31:28 INFO TorrentBroadcast: Reading broadcast variable 17 took 4 ms
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_17 stored as values in memory (estimated size 30.5 KiB, free 105.5 MiB)
23/09/24 21:31:28 INFO BlockManager: Found block rdd_44_2 locally
23/09/24 21:31:28 INFO Executor: Finished task 2.0 in stage 11.0 (TID 515). 2047 bytes result sent to driver
23/09/24 21:31:28 INFO CoarseGrainedExecutorBackend: Got assigned task 519
23/09/24 21:31:28 INFO Executor: Running task 2.0 in stage 12.0 (TID 519)
23/09/24 21:31:28 INFO TorrentBroadcast: Started reading broadcast variable 19 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_19_piece0 stored as bytes in memory (estimated size 13.7 KiB, free 105.4 MiB)
23/09/24 21:31:28 INFO TorrentBroadcast: Reading broadcast variable 19 took 4 ms
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_19 stored as values in memory (estimated size 36.8 KiB, free 105.4 MiB)
23/09/24 21:31:28 INFO BlockManager: Found block rdd_44_2 locally
23/09/24 21:31:28 INFO CodeGenerator: Code generated in 6.431376 ms
23/09/24 21:31:28 INFO CodeGenerator: Code generated in 9.610104 ms
23/09/24 21:31:28 INFO TorrentBroadcast: Started reading broadcast variable 18 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_18_piece0 stored as bytes in memory (estimated size 1669.0 B, free 105.4 MiB)
23/09/24 21:31:28 INFO TorrentBroadcast: Reading broadcast variable 18 took 4 ms
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_18 stored as values in memory (estimated size 64.0 MiB, free 41.4 MiB)
23/09/24 21:31:28 INFO Executor: Finished task 2.0 in stage 12.0 (TID 519). 2435 bytes result sent to driver
23/09/24 21:31:28 INFO CoarseGrainedExecutorBackend: Got assigned task 521
23/09/24 21:31:28 INFO Executor: Running task 2.0 in stage 14.0 (TID 521)
23/09/24 21:31:28 INFO MapOutputTrackerWorker: Updating epoch to 6 and clearing cache
23/09/24 21:31:28 INFO TorrentBroadcast: Started reading broadcast variable 21 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_21_piece0 stored as bytes in memory (estimated size 10.5 KiB, free 41.4 MiB)
23/09/24 21:31:28 INFO TorrentBroadcast: Reading broadcast variable 21 took 4 ms
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_21 stored as values in memory (estimated size 30.5 KiB, free 41.4 MiB)
23/09/24 21:31:28 INFO BlockManager: Found block rdd_44_2 locally
23/09/24 21:31:28 INFO Executor: Finished task 2.0 in stage 14.0 (TID 521). 2047 bytes result sent to driver
23/09/24 21:31:28 INFO CoarseGrainedExecutorBackend: Got assigned task 524
23/09/24 21:31:28 INFO Executor: Running task 2.0 in stage 15.0 (TID 524)
23/09/24 21:31:28 INFO TorrentBroadcast: Started reading broadcast variable 23 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_23_piece0 stored as bytes in memory (estimated size 13.7 KiB, free 41.3 MiB)
23/09/24 21:31:28 INFO TorrentBroadcast: Reading broadcast variable 23 took 4 ms
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_23 stored as values in memory (estimated size 36.8 KiB, free 41.3 MiB)
23/09/24 21:31:28 INFO BlockManager: Found block rdd_44_2 locally
23/09/24 21:31:28 INFO TorrentBroadcast: Started reading broadcast variable 22 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_22_piece0 stored as bytes in memory (estimated size 1669.0 B, free 41.3 MiB)
23/09/24 21:31:28 INFO TorrentBroadcast: Reading broadcast variable 22 took 4 ms
23/09/24 21:31:28 INFO MemoryStore: 1 blocks selected for dropping (116.9 MiB bytes)
23/09/24 21:31:28 INFO BlockManager: Dropping block rdd_22_7 from memory
23/09/24 21:31:28 INFO MemoryStore: After dropping 1 blocks, free memory is 158.2 MiB
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_22 stored as values in memory (estimated size 64.0 MiB, free 94.2 MiB)
23/09/24 21:31:28 INFO Executor: Finished task 2.0 in stage 15.0 (TID 524). 2435 bytes result sent to driver
23/09/24 21:31:33 INFO CoarseGrainedExecutorBackend: Driver commanded a shutdown
23/09/24 21:31:33 ERROR CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM
tdown