xecutor: Finished task 56.0 in stage 0.0 (TID 56). 2195 bytes result sent to driver
23/09/24 21:30:10 INFO CoarseGrainedExecutorBackend: Got assigned task 76
23/09/24 21:30:10 INFO Executor: Running task 76.0 in stage 0.0 (TID 76)
23/09/24 21:30:10 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10200547328-10334765056, partition values: [empty row]
23/09/24 21:30:10 INFO Executor: Finished task 55.0 in stage 0.0 (TID 55). 2238 bytes result sent to driver
23/09/24 21:30:10 INFO CoarseGrainedExecutorBackend: Got assigned task 77
23/09/24 21:30:10 INFO Executor: Running task 77.0 in stage 0.0 (TID 77)
23/09/24 21:30:10 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10334765056-10468982784, partition values: [empty row]
23/09/24 21:30:10 INFO Executor: Finished task 60.0 in stage 0.0 (TID 60). 2195 bytes result sent to driver
23/09/24 21:30:10 INFO CoarseGrainedExecutorBackend: Got assigned task 78
23/09/24 21:30:10 INFO Executor: Running task 78.0 in stage 0.0 (TID 78)
23/09/24 21:30:10 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10468982784-10603200512, partition values: [empty row]
23/09/24 21:30:10 INFO Executor: Finished task 62.0 in stage 0.0 (TID 62). 2195 bytes result sent to driver
23/09/24 21:30:10 INFO CoarseGrainedExecutorBackend: Got assigned task 79
23/09/24 21:30:10 INFO Executor: Running task 79.0 in stage 0.0 (TID 79)
23/09/24 21:30:10 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 10603200512-10737418240, partition values: [empty row]
23/09/24 21:30:11 INFO Executor: Finished task 75.0 in stage 0.0 (TID 75). 2195 bytes result sent to driver
23/09/24 21:30:11 INFO CoarseGrainedExecutorBackend: Got assigned task 90
23/09/24 21:30:11 INFO Executor: Running task 90.0 in stage 0.0 (TID 90)
23/09/24 21:30:11 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12079595520-12213813248, partition values: [empty row]
23/09/24 21:30:11 INFO Executor: Finished task 76.0 in stage 0.0 (TID 76). 2195 bytes result sent to driver
23/09/24 21:30:11 INFO CoarseGrainedExecutorBackend: Got assigned task 91
23/09/24 21:30:11 INFO Executor: Running task 91.0 in stage 0.0 (TID 91)
23/09/24 21:30:11 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12213813248-12348030976, partition values: [empty row]
23/09/24 21:30:11 INFO Executor: Finished task 78.0 in stage 0.0 (TID 78). 2145 bytes result sent to driver
23/09/24 21:30:11 INFO CoarseGrainedExecutorBackend: Got assigned task 92
23/09/24 21:30:11 INFO Executor: Running task 92.0 in stage 0.0 (TID 92)
23/09/24 21:30:11 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12348030976-12482248704, partition values: [empty row]
23/09/24 21:30:11 INFO Executor: Finished task 77.0 in stage 0.0 (TID 77). 2195 bytes result sent to driver
23/09/24 21:30:11 INFO CoarseGrainedExecutorBackend: Got assigned task 93
23/09/24 21:30:11 INFO Executor: Running task 93.0 in stage 0.0 (TID 93)
23/09/24 21:30:11 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12482248704-12616466432, partition values: [empty row]
23/09/24 21:30:11 INFO Executor: Finished task 79.0 in stage 0.0 (TID 79). 2195 bytes result sent to driver
23/09/24 21:30:11 INFO CoarseGrainedExecutorBackend: Got assigned task 94
23/09/24 21:30:11 INFO Executor: Running task 94.0 in stage 0.0 (TID 94)
23/09/24 21:30:11 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12616466432-12750684160, partition values: [empty row]
23/09/24 21:30:13 INFO Executor: Finished task 90.0 in stage 0.0 (TID 90). 2195 bytes result sent to driver
23/09/24 21:30:13 INFO Executor: Finished task 91.0 in stage 0.0 (TID 91). 2145 bytes result sent to driver
23/09/24 21:30:13 INFO CoarseGrainedExecutorBackend: Got assigned task 108
23/09/24 21:30:13 INFO CoarseGrainedExecutorBackend: Got assigned task 109
23/09/24 21:30:13 INFO Executor: Running task 108.0 in stage 0.0 (TID 108)
23/09/24 21:30:13 INFO Executor: Running task 109.0 in stage 0.0 (TID 109)
23/09/24 21:30:13 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14495514624-14629732352, partition values: [empty row]
23/09/24 21:30:13 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14629732352-14763950080, partition values: [empty row]
23/09/24 21:30:13 INFO Executor: Finished task 92.0 in stage 0.0 (TID 92). 2195 bytes result sent to driver
23/09/24 21:30:13 INFO CoarseGrainedExecutorBackend: Got assigned task 111
23/09/24 21:30:13 INFO Executor: Running task 111.0 in stage 0.0 (TID 111)
23/09/24 21:30:13 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14898167808-15032385536, partition values: [empty row]
23/09/24 21:30:13 INFO Executor: Finished task 93.0 in stage 0.0 (TID 93). 2195 bytes result sent to driver
23/09/24 21:30:13 INFO CoarseGrainedExecutorBackend: Got assigned task 113
23/09/24 21:30:13 INFO Executor: Running task 113.0 in stage 0.0 (TID 113)
23/09/24 21:30:13 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15166603264-15300820992, partition values: [empty row]
23/09/24 21:30:13 INFO Executor: Finished task 94.0 in stage 0.0 (TID 94). 2195 bytes result sent to driver
23/09/24 21:30:13 INFO CoarseGrainedExecutorBackend: Got assigned task 114
23/09/24 21:30:13 INFO Executor: Running task 114.0 in stage 0.0 (TID 114)
23/09/24 21:30:13 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15300820992-15435038720, partition values: [empty row]
23/09/24 21:30:14 INFO Executor: Finished task 109.0 in stage 0.0 (TID 109). 2195 bytes result sent to driver
23/09/24 21:30:14 INFO CoarseGrainedExecutorBackend: Got assigned task 125
23/09/24 21:30:14 INFO Executor: Running task 125.0 in stage 0.0 (TID 125)
23/09/24 21:30:14 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16777216000-16911433728, partition values: [empty row]
23/09/24 21:30:14 INFO Executor: Finished task 113.0 in stage 0.0 (TID 113). 2145 bytes result sent to driver
23/09/24 21:30:14 INFO Executor: Finished task 108.0 in stage 0.0 (TID 108). 2195 bytes result sent to driver
23/09/24 21:30:14 INFO CoarseGrainedExecutorBackend: Got assigned task 126
23/09/24 21:30:14 INFO CoarseGrainedExecutorBackend: Got assigned task 127
23/09/24 21:30:14 INFO Executor: Running task 126.0 in stage 0.0 (TID 126)
23/09/24 21:30:14 INFO Executor: Running task 127.0 in stage 0.0 (TID 127)
23/09/24 21:30:14 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17045651456-17179869184, partition values: [empty row]
23/09/24 21:30:14 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16911433728-17045651456, partition values: [empty row]
23/09/24 21:30:14 INFO Executor: Finished task 111.0 in stage 0.0 (TID 111). 2145 bytes result sent to driver
23/09/24 21:30:14 INFO CoarseGrainedExecutorBackend: Got assigned task 128
23/09/24 21:30:14 INFO Executor: Running task 128.0 in stage 0.0 (TID 128)
23/09/24 21:30:14 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17179869184-17314086912, partition values: [empty row]
23/09/24 21:30:14 INFO Executor: Finished task 114.0 in stage 0.0 (TID 114). 2195 bytes result sent to driver
23/09/24 21:30:14 INFO CoarseGrainedExecutorBackend: Got assigned task 129
23/09/24 21:30:14 INFO Executor: Running task 129.0 in stage 0.0 (TID 129)
23/09/24 21:30:15 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17314086912-17448304640, partition values: [empty row]
23/09/24 21:30:16 INFO Executor: Finished task 125.0 in stage 0.0 (TID 125). 2145 bytes result sent to driver
23/09/24 21:30:16 INFO CoarseGrainedExecutorBackend: Got assigned task 140
23/09/24 21:30:16 INFO Executor: Running task 140.0 in stage 0.0 (TID 140)
23/09/24 21:30:16 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18790481920-18924699648, partition values: [empty row]
23/09/24 21:30:16 INFO Executor: Finished task 127.0 in stage 0.0 (TID 127). 2195 bytes result sent to driver
23/09/24 21:30:16 INFO CoarseGrainedExecutorBackend: Got assigned task 141
23/09/24 21:30:16 INFO Executor: Running task 141.0 in stage 0.0 (TID 141)
23/09/24 21:30:16 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18924699648-19058917376, partition values: [empty row]
23/09/24 21:30:16 INFO Executor: Finished task 126.0 in stage 0.0 (TID 126). 2195 bytes result sent to driver
23/09/24 21:30:16 INFO CoarseGrainedExecutorBackend: Got assigned task 142
23/09/24 21:30:16 INFO Executor: Running task 142.0 in stage 0.0 (TID 142)
23/09/24 21:30:16 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19058917376-19193135104, partition values: [empty row]
23/09/24 21:30:16 INFO Executor: Finished task 128.0 in stage 0.0 (TID 128). 2145 bytes result sent to driver
23/09/24 21:30:16 INFO CoarseGrainedExecutorBackend: Got assigned task 143
23/09/24 21:30:16 INFO Executor: Running task 143.0 in stage 0.0 (TID 143)
23/09/24 21:30:16 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19193135104-19327352832, partition values: [empty row]
23/09/24 21:30:16 INFO Executor: Finished task 129.0 in stage 0.0 (TID 129). 2195 bytes result sent to driver
23/09/24 21:30:16 INFO CoarseGrainedExecutorBackend: Got assigned task 145
23/09/24 21:30:16 INFO Executor: Running task 145.0 in stage 0.0 (TID 145)
23/09/24 21:30:16 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19461570560-19595788288, partition values: [empty row]
23/09/24 21:30:17 INFO Executor: Finished task 140.0 in stage 0.0 (TID 140). 2195 bytes result sent to driver
23/09/24 21:30:17 INFO Executor: Finished task 141.0 in stage 0.0 (TID 141). 2195 bytes result sent to driver
23/09/24 21:30:17 INFO Executor: Finished task 142.0 in stage 0.0 (TID 142). 2195 bytes result sent to driver
23/09/24 21:30:17 INFO Executor: Finished task 145.0 in stage 0.0 (TID 145). 2195 bytes result sent to driver
23/09/24 21:30:18 INFO Executor: Finished task 143.0 in stage 0.0 (TID 143). 2195 bytes result sent to driver
23/09/24 21:30:18 INFO CoarseGrainedExecutorBackend: Got assigned task 150
23/09/24 21:30:18 INFO CoarseGrainedExecutorBackend: Got assigned task 153
23/09/24 21:30:18 INFO Executor: Running task 0.0 in stage 1.0 (TID 150)
23/09/24 21:30:18 INFO Executor: Running task 3.0 in stage 1.0 (TID 153)
23/09/24 21:30:18 INFO CoarseGrainedExecutorBackend: Got assigned task 156
23/09/24 21:30:18 INFO CoarseGrainedExecutorBackend: Got assigned task 159
23/09/24 21:30:18 INFO CoarseGrainedExecutorBackend: Got assigned task 162
23/09/24 21:30:18 INFO Executor: Running task 9.0 in stage 1.0 (TID 159)
23/09/24 21:30:18 INFO Executor: Running task 12.0 in stage 1.0 (TID 162)
23/09/24 21:30:18 INFO Executor: Running task 6.0 in stage 1.0 (TID 156)
23/09/24 21:30:18 INFO TorrentBroadcast: Started reading broadcast variable 3 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:30:18 INFO MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 7.3 KiB, free 5.2 GiB)
23/09/24 21:30:18 INFO TorrentBroadcast: Reading broadcast variable 3 took 9 ms
23/09/24 21:30:18 INFO MemoryStore: Block broadcast_3 stored as values in memory (estimated size 14.3 KiB, free 5.2 GiB)
23/09/24 21:30:18 INFO CodeGenerator: Code generated in 29.300197 ms
23/09/24 21:30:18 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 805306368-939524096, partition values: [empty row]
23/09/24 21:30:18 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 0-134217728, partition values: [empty row]
23/09/24 21:30:18 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1610612736-1744830464, partition values: [empty row]
23/09/24 21:30:18 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1207959552-1342177280, partition values: [empty row]
23/09/24 21:30:18 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 402653184-536870912, partition values: [empty row]
23/09/24 21:30:18 INFO CodeGenerator: Code generated in 12.139828 ms
23/09/24 21:30:18 INFO TorrentBroadcast: Started reading broadcast variable 2 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:30:18 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 24.8 KiB, free 5.2 GiB)
23/09/24 21:30:18 INFO TorrentBroadcast: Reading broadcast variable 2 took 14 ms
23/09/24 21:30:18 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 394.6 KiB, free 5.2 GiB)
23/09/24 21:30:19 INFO Executor: Finished task 12.0 in stage 1.0 (TID 162). 1887 bytes result sent to driver
23/09/24 21:30:19 INFO Executor: Finished task 0.0 in stage 1.0 (TID 150). 1887 bytes result sent to driver
23/09/24 21:30:19 INFO CoarseGrainedExecutorBackend: Got assigned task 173
23/09/24 21:30:19 INFO Executor: Running task 23.0 in stage 1.0 (TID 173)
23/09/24 21:30:19 INFO CoarseGrainedExecutorBackend: Got assigned task 176
23/09/24 21:30:19 INFO Executor: Running task 26.0 in stage 1.0 (TID 176)
23/09/24 21:30:19 INFO Executor: Finished task 6.0 in stage 1.0 (TID 156). 1887 bytes result sent to driver
23/09/24 21:30:19 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3087007744-3221225472, partition values: [empty row]
23/09/24 21:30:19 INFO CoarseGrainedExecutorBackend: Got assigned task 177
23/09/24 21:30:19 INFO Executor: Running task 27.0 in stage 1.0 (TID 177)
23/09/24 21:30:19 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3489660928-3623878656, partition values: [empty row]
23/09/24 21:30:19 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3623878656-3758096384, partition values: [empty row]
23/09/24 21:30:19 INFO Executor: Finished task 3.0 in stage 1.0 (TID 153). 1887 bytes result sent to driver
23/09/24 21:30:19 INFO CoarseGrainedExecutorBackend: Got assigned task 178
23/09/24 21:30:19 INFO Executor: Running task 28.0 in stage 1.0 (TID 178)
23/09/24 21:30:19 INFO Executor: Finished task 9.0 in stage 1.0 (TID 159). 1887 bytes result sent to driver
23/09/24 21:30:19 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3758096384-3892314112, partition values: [empty row]
23/09/24 21:30:19 INFO CoarseGrainedExecutorBackend: Got assigned task 179
23/09/24 21:30:19 INFO Executor: Running task 29.0 in stage 1.0 (TID 179)
23/09/24 21:30:19 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3892314112-4026531840, partition values: [empty row]
23/09/24 21:30:20 INFO Executor: Finished task 26.0 in stage 1.0 (TID 176). 1844 bytes result sent to driver
23/09/24 21:30:20 INFO CoarseGrainedExecutorBackend: Got assigned task 187
23/09/24 21:30:20 INFO Executor: Running task 37.0 in stage 1.0 (TID 187)
23/09/24 21:30:20 INFO Executor: Finished task 27.0 in stage 1.0 (TID 177). 1844 bytes result sent to driver
23/09/24 21:30:20 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4966055936-5100273664, partition values: [empty row]
23/09/24 21:30:20 INFO CoarseGrainedExecutorBackend: Got assigned task 188
23/09/24 21:30:20 INFO Executor: Running task 38.0 in stage 1.0 (TID 188)
23/09/24 21:30:20 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5100273664-5234491392, partition values: [empty row]
23/09/24 21:30:20 INFO Executor: Finished task 28.0 in stage 1.0 (TID 178). 1844 bytes result sent to driver
23/09/24 21:30:20 INFO CoarseGrainedExecutorBackend: Got assigned task 191
23/09/24 21:30:20 INFO Executor: Running task 41.0 in stage 1.0 (TID 191)
23/09/24 21:30:20 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5502926848-5637144576, partition values: [empty row]
23/09/24 21:30:20 INFO Executor: Finished task 29.0 in stage 1.0 (TID 179). 1844 bytes result sent to driver
23/09/24 21:30:20 INFO CoarseGrainedExecutorBackend: Got assigned task 192
23/09/24 21:30:20 INFO Executor: Running task 42.0 in stage 1.0 (TID 192)
23/09/24 21:30:20 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5637144576-5771362304, partition values: [empty row]
23/09/24 21:30:20 INFO Executor: Finished task 23.0 in stage 1.0 (TID 173). 1844 bytes result sent to driver
23/09/24 21:30:20 INFO CoarseGrainedExecutorBackend: Got assigned task 194
23/09/24 21:30:20 INFO Executor: Running task 44.0 in stage 1.0 (TID 194)
23/09/24 21:30:20 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5905580032-6039797760, partition values: [empty row]
23/09/24 21:30:21 INFO Executor: Finished task 37.0 in stage 1.0 (TID 187). 1844 bytes result sent to driver
23/09/24 21:30:21 INFO CoarseGrainedExecutorBackend: Got assigned task 204
23/09/24 21:30:21 INFO Executor: Finished task 38.0 in stage 1.0 (TID 188). 1844 bytes result sent to driver
23/09/24 21:30:21 INFO Executor: Running task 54.0 in stage 1.0 (TID 204)
23/09/24 21:30:21 INFO CoarseGrainedExecutorBackend: Got assigned task 205
23/09/24 21:30:21 INFO Executor: Running task 55.0 in stage 1.0 (TID 205)
23/09/24 21:30:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7247757312-7381975040, partition values: [empty row]
23/09/24 21:30:21 INFO Executor: Finished task 41.0 in stage 1.0 (TID 191). 1844 bytes result sent to driver
23/09/24 21:30:21 INFO CoarseGrainedExecutorBackend: Got assigned task 206
23/09/24 21:30:21 INFO Executor: Running task 56.0 in stage 1.0 (TID 206)
23/09/24 21:30:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7381975040-7516192768, partition values: [empty row]
23/09/24 21:30:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7516192768-7650410496, partition values: [empty row]
23/09/24 21:30:21 INFO Executor: Finished task 42.0 in stage 1.0 (TID 192). 1844 bytes result sent to driver
23/09/24 21:30:21 INFO CoarseGrainedExecutorBackend: Got assigned task 208
23/09/24 21:30:21 INFO Executor: Running task 58.0 in stage 1.0 (TID 208)
23/09/24 21:30:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7784628224-7918845952, partition values: [empty row]
23/09/24 21:30:21 INFO Executor: Finished task 44.0 in stage 1.0 (TID 194). 1844 bytes result sent to driver
23/09/24 21:30:21 INFO CoarseGrainedExecutorBackend: Got assigned task 209
23/09/24 21:30:21 INFO Executor: Running task 59.0 in stage 1.0 (TID 209)
23/09/24 21:30:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7918845952-8053063680, partition values: [empty row]
23/09/24 21:30:22 INFO Executor: Finished task 56.0 in stage 1.0 (TID 206). 1844 bytes result sent to driver
23/09/24 21:30:22 INFO CoarseGrainedExecutorBackend: Got assigned task 220
23/09/24 21:30:22 INFO Executor: Running task 70.0 in stage 1.0 (TID 220)
23/09/24 21:30:22 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9395240960-9529458688, partition values: [empty row]
23/09/24 21:30:22 INFO Executor: Finished task 55.0 in stage 1.0 (TID 205). 1844 bytes result sent to driver
23/09/24 21:30:22 INFO CoarseGrainedExecutorBackend: Got assigned task 221
23/09/24 21:30:22 INFO Executor: Running task 71.0 in stage 1.0 (TID 221)
23/09/24 21:30:22 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9529458688-9663676416, partition values: [empty row]
23/09/24 21:30:22 INFO Executor: Finished task 54.0 in stage 1.0 (TID 204). 1844 bytes result sent to driver
23/09/24 21:30:22 INFO CoarseGrainedExecutorBackend: Got assigned task 222
23/09/24 21:30:22 INFO Executor: Running task 72.0 in stage 1.0 (TID 222)
23/09/24 21:30:22 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9663676416-9797894144, partition values: [empty row]
23/09/24 21:30:22 INFO Executor: Finished task 58.0 in stage 1.0 (TID 208). 1844 bytes result sent to driver
23/09/24 21:30:22 INFO CoarseGrainedExecutorBackend: Got assigned task 223
23/09/24 21:30:22 INFO Executor: Running task 73.0 in stage 1.0 (TID 223)
23/09/24 21:30:22 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9797894144-9932111872, partition values: [empty row]
23/09/24 21:30:22 INFO Executor: Finished task 59.0 in stage 1.0 (TID 209). 1844 bytes result sent to driver
23/09/24 21:30:22 INFO CoarseGrainedExecutorBackend: Got assigned task 224
23/09/24 21:30:22 INFO Executor: Running task 74.0 in stage 1.0 (TID 224)
23/09/24 21:30:22 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9932111872-10066329600, partition values: [empty row]
23/09/24 21:30:22 INFO Executor: Finished task 71.0 in stage 1.0 (TID 221). 1844 bytes result sent to driver
23/09/24 21:30:22 INFO CoarseGrainedExecutorBackend: Got assigned task 235
23/09/24 21:30:22 INFO Executor: Running task 85.0 in stage 1.0 (TID 235)
23/09/24 21:30:22 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11408506880-11542724608, partition values: [empty row]
23/09/24 21:30:22 INFO Executor: Finished task 70.0 in stage 1.0 (TID 220). 1844 bytes result sent to driver
23/09/24 21:30:22 INFO CoarseGrainedExecutorBackend: Got assigned task 236
23/09/24 21:30:22 INFO Executor: Running task 86.0 in stage 1.0 (TID 236)
23/09/24 21:30:22 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11542724608-11676942336, partition values: [empty row]
23/09/24 21:30:22 INFO Executor: Finished task 72.0 in stage 1.0 (TID 222). 1844 bytes result sent to driver
23/09/24 21:30:22 INFO CoarseGrainedExecutorBackend: Got assigned task 237
23/09/24 21:30:22 INFO Executor: Running task 87.0 in stage 1.0 (TID 237)
23/09/24 21:30:22 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11676942336-11811160064, partition values: [empty row]
23/09/24 21:30:23 INFO Executor: Finished task 73.0 in stage 1.0 (TID 223). 1844 bytes result sent to driver
23/09/24 21:30:23 INFO CoarseGrainedExecutorBackend: Got assigned task 238
23/09/24 21:30:23 INFO Executor: Running task 88.0 in stage 1.0 (TID 238)
23/09/24 21:30:23 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11811160064-11945377792, partition values: [empty row]
23/09/24 21:30:23 INFO Executor: Finished task 74.0 in stage 1.0 (TID 224). 1844 bytes result sent to driver
23/09/24 21:30:23 INFO CoarseGrainedExecutorBackend: Got assigned task 240
23/09/24 21:30:23 INFO Executor: Running task 90.0 in stage 1.0 (TID 240)
23/09/24 21:30:23 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12079595520-12213813248, partition values: [empty row]
23/09/24 21:30:23 INFO Executor: Finished task 85.0 in stage 1.0 (TID 235). 1887 bytes result sent to driver
23/09/24 21:30:23 INFO CoarseGrainedExecutorBackend: Got assigned task 250
23/09/24 21:30:23 INFO Executor: Running task 100.0 in stage 1.0 (TID 250)
23/09/24 21:30:23 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13421772800-13555990528, partition values: [empty row]
23/09/24 21:30:23 INFO Executor: Finished task 87.0 in stage 1.0 (TID 237). 1887 bytes result sent to driver
23/09/24 21:30:23 INFO CoarseGrainedExecutorBackend: Got assigned task 251
23/09/24 21:30:23 INFO Executor: Running task 101.0 in stage 1.0 (TID 251)
23/09/24 21:30:23 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13555990528-13690208256, partition values: [empty row]
23/09/24 21:30:23 INFO Executor: Finished task 86.0 in stage 1.0 (TID 236). 1887 bytes result sent to driver
23/09/24 21:30:23 INFO CoarseGrainedExecutorBackend: Got assigned task 252
23/09/24 21:30:23 INFO Executor: Running task 102.0 in stage 1.0 (TID 252)
23/09/24 21:30:23 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13690208256-13824425984, partition values: [empty row]
23/09/24 21:30:23 INFO Executor: Finished task 88.0 in stage 1.0 (TID 238). 1887 bytes result sent to driver
23/09/24 21:30:23 INFO CoarseGrainedExecutorBackend: Got assigned task 255
23/09/24 21:30:23 INFO Executor: Running task 105.0 in stage 1.0 (TID 255)
23/09/24 21:30:23 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14092861440-14227079168, partition values: [empty row]
23/09/24 21:30:23 INFO Executor: Finished task 90.0 in stage 1.0 (TID 240). 1887 bytes result sent to driver
23/09/24 21:30:23 INFO CoarseGrainedExecutorBackend: Got assigned task 258
23/09/24 21:30:23 INFO Executor: Running task 108.0 in stage 1.0 (TID 258)
23/09/24 21:30:23 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14495514624-14629732352, partition values: [empty row]
23/09/24 21:30:24 INFO Executor: Finished task 100.0 in stage 1.0 (TID 250). 1844 bytes result sent to driver
23/09/24 21:30:24 INFO CoarseGrainedExecutorBackend: Got assigned task 265
23/09/24 21:30:24 INFO Executor: Running task 115.0 in stage 1.0 (TID 265)
23/09/24 21:30:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15435038720-15569256448, partition values: [empty row]
23/09/24 21:30:24 INFO Executor: Finished task 102.0 in stage 1.0 (TID 252). 1844 bytes result sent to driver
23/09/24 21:30:24 INFO CoarseGrainedExecutorBackend: Got assigned task 269
23/09/24 21:30:24 INFO Executor: Running task 119.0 in stage 1.0 (TID 269)
23/09/24 21:30:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15971909632-16106127360, partition values: [empty row]
23/09/24 21:30:24 INFO Executor: Finished task 101.0 in stage 1.0 (TID 251). 1844 bytes result sent to driver
23/09/24 21:30:24 INFO CoarseGrainedExecutorBackend: Got assigned task 270
23/09/24 21:30:24 INFO Executor: Running task 120.0 in stage 1.0 (TID 270)
23/09/24 21:30:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16106127360-16240345088, partition values: [empty row]
23/09/24 21:30:24 INFO Executor: Finished task 105.0 in stage 1.0 (TID 255). 1844 bytes result sent to driver
23/09/24 21:30:24 INFO CoarseGrainedExecutorBackend: Got assigned task 271
23/09/24 21:30:24 INFO Executor: Running task 121.0 in stage 1.0 (TID 271)
23/09/24 21:30:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16240345088-16374562816, partition values: [empty row]
23/09/24 21:30:24 INFO Executor: Finished task 108.0 in stage 1.0 (TID 258). 1844 bytes result sent to driver
23/09/24 21:30:24 INFO CoarseGrainedExecutorBackend: Got assigned task 274
23/09/24 21:30:24 INFO Executor: Running task 124.0 in stage 1.0 (TID 274)
23/09/24 21:30:24 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 16642998272-16777216000, partition values: [empty row]
23/09/24 21:30:25 INFO Executor: Finished task 115.0 in stage 1.0 (TID 265). 1844 bytes result sent to driver
23/09/24 21:30:25 INFO CoarseGrainedExecutorBackend: Got assigned task 283
23/09/24 21:30:25 INFO Executor: Running task 133.0 in stage 1.0 (TID 283)
23/09/24 21:30:25 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17850957824-17985175552, partition values: [empty row]
23/09/24 21:30:25 INFO Executor: Finished task 119.0 in stage 1.0 (TID 269). 1844 bytes result sent to driver
23/09/24 21:30:25 INFO CoarseGrainedExecutorBackend: Got assigned task 284
23/09/24 21:30:25 INFO Executor: Running task 134.0 in stage 1.0 (TID 284)
23/09/24 21:30:25 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17985175552-18119393280, partition values: [empty row]
23/09/24 21:30:25 INFO Executor: Finished task 120.0 in stage 1.0 (TID 270). 1844 bytes result sent to driver
23/09/24 21:30:25 INFO CoarseGrainedExecutorBackend: Got assigned task 285
23/09/24 21:30:25 INFO Executor: Running task 135.0 in stage 1.0 (TID 285)
23/09/24 21:30:25 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18119393280-18253611008, partition values: [empty row]
23/09/24 21:30:25 INFO Executor: Finished task 121.0 in stage 1.0 (TID 271). 1844 bytes result sent to driver
23/09/24 21:30:25 INFO CoarseGrainedExecutorBackend: Got assigned task 288
23/09/24 21:30:25 INFO Executor: Running task 138.0 in stage 1.0 (TID 288)
23/09/24 21:30:25 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18522046464-18656264192, partition values: [empty row]
23/09/24 21:30:25 INFO Executor: Finished task 124.0 in stage 1.0 (TID 274). 1844 bytes result sent to driver
23/09/24 21:30:25 INFO CoarseGrainedExecutorBackend: Got assigned task 290
23/09/24 21:30:25 INFO Executor: Running task 140.0 in stage 1.0 (TID 290)
23/09/24 21:30:25 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18790481920-18924699648, partition values: [empty row]
23/09/24 21:30:25 INFO Executor: Finished task 134.0 in stage 1.0 (TID 284). 1844 bytes result sent to driver
23/09/24 21:30:25 INFO CoarseGrainedExecutorBackend: Got assigned task 298
23/09/24 21:30:25 INFO Executor: Running task 148.0 in stage 1.0 (TID 298)
23/09/24 21:30:25 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19864223744-19998441472, partition values: [empty row]
23/09/24 21:30:25 INFO Executor: Finished task 133.0 in stage 1.0 (TID 283). 1844 bytes result sent to driver
23/09/24 21:30:26 INFO Executor: Finished task 135.0 in stage 1.0 (TID 285). 1844 bytes result sent to driver
23/09/24 21:30:26 INFO Executor: Finished task 138.0 in stage 1.0 (TID 288). 1844 bytes result sent to driver
23/09/24 21:30:26 INFO Executor: Finished task 140.0 in stage 1.0 (TID 290). 1844 bytes result sent to driver
23/09/24 21:30:26 INFO Executor: Finished task 148.0 in stage 1.0 (TID 298). 1844 bytes result sent to driver
23/09/24 21:30:27 INFO CoarseGrainedExecutorBackend: Got assigned task 301
23/09/24 21:30:27 INFO Executor: Running task 0.0 in stage 3.0 (TID 301)
23/09/24 21:30:27 INFO CoarseGrainedExecutorBackend: Got assigned task 304
23/09/24 21:30:27 INFO Executor: Running task 3.0 in stage 3.0 (TID 304)
23/09/24 21:30:27 INFO CoarseGrainedExecutorBackend: Got assigned task 307
23/09/24 21:30:27 INFO CoarseGrainedExecutorBackend: Got assigned task 310
23/09/24 21:30:27 INFO Executor: Running task 6.0 in stage 3.0 (TID 307)
23/09/24 21:30:27 INFO Executor: Running task 9.0 in stage 3.0 (TID 310)
23/09/24 21:30:27 INFO CoarseGrainedExecutorBackend: Got assigned task 313
23/09/24 21:30:27 INFO Executor: Running task 12.0 in stage 3.0 (TID 313)
23/09/24 21:30:27 INFO MapOutputTrackerWorker: Updating epoch to 1 and clearing cache
23/09/24 21:30:27 INFO TorrentBroadcast: Started reading broadcast variable 6 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:30:27 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 26.8 KiB, free 5.2 GiB)
23/09/24 21:30:27 INFO TorrentBroadcast: Reading broadcast variable 6 took 8 ms
23/09/24 21:30:27 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 92.6 KiB, free 5.2 GiB)
23/09/24 21:30:27 INFO CodeGenerator: Code generated in 86.142715 ms
23/09/24 21:30:28 INFO CodeGenerator: Code generated in 124.303131 ms
23/09/24 21:30:28 INFO CodeGenerator: Code generated in 46.676796 ms
23/09/24 21:30:28 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 402653184-536870912, partition values: [empty row]
23/09/24 21:30:28 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1610612736-1744830464, partition values: [empty row]
23/09/24 21:30:28 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 805306368-939524096, partition values: [empty row]
23/09/24 21:30:28 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 0-134217728, partition values: [empty row]
23/09/24 21:30:28 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1207959552-1342177280, partition values: [empty row]
23/09/24 21:30:28 INFO CodeGenerator: Code generated in 27.657158 ms
23/09/24 21:30:28 INFO TorrentBroadcast: Started reading broadcast variable 5 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:30:28 INFO TransportClientFactory: Successfully created connection to /5.161.188.154:43909 after 5 ms (0 ms spent in bootstraps)
23/09/24 21:30:29 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 24.8 KiB, free 5.2 GiB)
23/09/24 21:30:29 INFO TorrentBroadcast: Reading broadcast variable 5 took 39 ms
23/09/24 21:30:29 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 394.6 KiB, free 5.2 GiB)
23/09/24 21:30:29 INFO CodeGenerator: Code generated in 261.255298 ms
23/09/24 21:30:34 INFO MemoryStore: Block rdd_22_12 stored as values in memory (estimated size 110.4 MiB, free 5.0 GiB)
23/09/24 21:30:34 INFO CodeGenerator: Code generated in 6.101974 ms
23/09/24 21:30:34 INFO CodeGenerator: Code generated in 55.076165 ms
23/09/24 21:30:34 INFO Executor: Finished task 12.0 in stage 3.0 (TID 313). 2452 bytes result sent to driver
23/09/24 21:30:34 INFO CoarseGrainedExecutorBackend: Got assigned task 324
23/09/24 21:30:34 INFO Executor: Running task 23.0 in stage 3.0 (TID 324)
23/09/24 21:30:34 INFO MemoryStore: Block rdd_22_9 stored as values in memory (estimated size 102.3 MiB, free 4.9 GiB)
23/09/24 21:30:34 INFO MemoryStore: Block rdd_22_0 stored as values in memory (estimated size 117.0 MiB, free 4.8 GiB)
23/09/24 21:30:34 INFO MemoryStore: Block rdd_22_6 stored as values in memory (estimated size 116.9 MiB, free 4.7 GiB)
23/09/24 21:30:34 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3087007744-3221225472, partition values: [empty row]
23/09/24 21:30:34 INFO Executor: Finished task 6.0 in stage 3.0 (TID 307). 2452 bytes result sent to driver
23/09/24 21:30:34 INFO Executor: Finished task 9.0 in stage 3.0 (TID 310). 2452 bytes result sent to driver
23/09/24 21:30:34 INFO CoarseGrainedExecutorBackend: Got assigned task 326
23/09/24 21:30:34 INFO Executor: Running task 25.0 in stage 3.0 (TID 326)
23/09/24 21:30:34 INFO CoarseGrainedExecutorBackend: Got assigned task 328
23/09/24 21:30:34 INFO Executor: Running task 27.0 in stage 3.0 (TID 328)
23/09/24 21:30:34 INFO Executor: Finished task 0.0 in stage 3.0 (TID 301). 2495 bytes result sent to driver
23/09/24 21:30:34 INFO CoarseGrainedExecutorBackend: Got assigned task 329
23/09/24 21:30:34 INFO Executor: Running task 28.0 in stage 3.0 (TID 329)
23/09/24 21:30:34 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3355443200-3489660928, partition values: [empty row]
23/09/24 21:30:34 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3758096384-3892314112, partition values: [empty row]
23/09/24 21:30:34 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3623878656-3758096384, partition values: [empty row]
23/09/24 21:30:34 INFO MemoryStore: Block rdd_22_3 stored as values in memory (estimated size 116.9 MiB, free 4.6 GiB)
23/09/24 21:30:34 INFO Executor: Finished task 3.0 in stage 3.0 (TID 304). 2452 bytes result sent to driver
23/09/24 21:30:34 INFO CoarseGrainedExecutorBackend: Got assigned task 330
23/09/24 21:30:34 INFO Executor: Running task 29.0 in stage 3.0 (TID 330)
23/09/24 21:30:34 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 3892314112-4026531840, partition values: [empty row]
23/09/24 21:30:38 INFO MemoryStore: Block rdd_22_27 stored as values in memory (estimated size 116.6 MiB, free 4.5 GiB)
23/09/24 21:30:38 INFO Executor: Finished task 27.0 in stage 3.0 (TID 328). 2452 bytes result sent to driver
23/09/24 21:30:38 INFO CoarseGrainedExecutorBackend: Got assigned task 338
23/09/24 21:30:38 INFO Executor: Running task 37.0 in stage 3.0 (TID 338)
23/09/24 21:30:38 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4966055936-5100273664, partition values: [empty row]
23/09/24 21:30:38 INFO MemoryStore: Block rdd_22_28 stored as values in memory (estimated size 116.7 MiB, free 4.4 GiB)
23/09/24 21:30:38 INFO Executor: Finished task 28.0 in stage 3.0 (TID 329). 2452 bytes result sent to driver
23/09/24 21:30:38 INFO CoarseGrainedExecutorBackend: Got assigned task 339
23/09/24 21:30:38 INFO Executor: Running task 38.0 in stage 3.0 (TID 339)
23/09/24 21:30:38 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5100273664-5234491392, partition values: [empty row]
23/09/24 21:30:38 INFO MemoryStore: Block rdd_22_25 stored as values in memory (estimated size 118.4 MiB, free 4.3 GiB)
23/09/24 21:30:38 INFO Executor: Finished task 25.0 in stage 3.0 (TID 326). 2452 bytes result sent to driver
23/09/24 21:30:38 INFO CoarseGrainedExecutorBackend: Got assigned task 341
23/09/24 21:30:38 INFO Executor: Running task 40.0 in stage 3.0 (TID 341)
23/09/24 21:30:38 INFO MemoryStore: Block rdd_22_29 stored as values in memory (estimated size 116.6 MiB, free 4.1 GiB)
23/09/24 21:30:38 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5368709120-5502926848, partition values: [empty row]
23/09/24 21:30:38 INFO Executor: Finished task 29.0 in stage 3.0 (TID 330). 2452 bytes result sent to driver
23/09/24 21:30:38 INFO CoarseGrainedExecutorBackend: Got assigned task 343
23/09/24 21:30:38 INFO Executor: Running task 42.0 in stage 3.0 (TID 343)
23/09/24 21:30:38 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5637144576-5771362304, partition values: [empty row]
23/09/24 21:30:38 INFO MemoryStore: Block rdd_22_23 stored as values in memory (estimated size 119.1 MiB, free 4.0 GiB)
23/09/24 21:30:38 INFO Executor: Finished task 23.0 in stage 3.0 (TID 324). 2452 bytes result sent to driver
23/09/24 21:30:38 INFO CoarseGrainedExecutorBackend: Got assigned task 345
23/09/24 21:30:38 INFO Executor: Running task 44.0 in stage 3.0 (TID 345)
23/09/24 21:30:38 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5905580032-6039797760, partition values: [empty row]
23/09/24 21:30:41 INFO MemoryStore: Block rdd_22_37 stored as values in memory (estimated size 116.8 MiB, free 3.9 GiB)
23/09/24 21:30:41 INFO Executor: Finished task 37.0 in stage 3.0 (TID 338). 2452 bytes result sent to driver
23/09/24 21:30:41 INFO CoarseGrainedExecutorBackend: Got assigned task 352
23/09/24 21:30:41 INFO Executor: Running task 51.0 in stage 3.0 (TID 352)
23/09/24 21:30:41 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6845104128-6979321856, partition values: [empty row]
23/09/24 21:30:41 INFO MemoryStore: Block rdd_22_44 stored as values in memory (estimated size 86.9 MiB, free 3.8 GiB)
23/09/24 21:30:41 INFO Executor: Finished task 44.0 in stage 3.0 (TID 345). 2452 bytes result sent to driver
23/09/24 21:30:41 INFO CoarseGrainedExecutorBackend: Got assigned task 354
23/09/24 21:30:41 INFO Executor: Running task 53.0 in stage 3.0 (TID 354)
23/09/24 21:30:41 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7113539584-7247757312, partition values: [empty row]
23/09/24 21:30:42 INFO MemoryStore: Block rdd_22_40 stored as values in memory (estimated size 116.8 MiB, free 3.7 GiB)
23/09/24 21:30:42 INFO Executor: Finished task 40.0 in stage 3.0 (TID 341). 2452 bytes result sent to driver
23/09/24 21:30:42 INFO CoarseGrainedExecutorBackend: Got assigned task 355
23/09/24 21:30:42 INFO Executor: Running task 54.0 in stage 3.0 (TID 355)
23/09/24 21:30:42 INFO MemoryStore: Block rdd_22_42 stored as values in memory (estimated size 116.7 MiB, free 3.6 GiB)
23/09/24 21:30:42 INFO Executor: Finished task 42.0 in stage 3.0 (TID 343). 2452 bytes result sent to driver
23/09/24 21:30:42 INFO CoarseGrainedExecutorBackend: Got assigned task 356
23/09/24 21:30:42 INFO Executor: Running task 55.0 in stage 3.0 (TID 356)
23/09/24 21:30:42 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7247757312-7381975040, partition values: [empty row]
23/09/24 21:30:42 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7381975040-7516192768, partition values: [empty row]
23/09/24 21:30:42 INFO MemoryStore: Block rdd_22_38 stored as values in memory (estimated size 116.7 MiB, free 3.5 GiB)
23/09/24 21:30:42 INFO Executor: Finished task 38.0 in stage 3.0 (TID 339). 2452 bytes result sent to driver
23/09/24 21:30:42 INFO CoarseGrainedExecutorBackend: Got assigned task 358
23/09/24 21:30:42 INFO Executor: Running task 57.0 in stage 3.0 (TID 358)
23/09/24 21:30:42 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 7650410496-7784628224, partition values: [empty row]
23/09/24 21:30:45 INFO MemoryStore: Block rdd_22_53 stored as values in memory (estimated size 115.7 MiB, free 3.4 GiB)
23/09/24 21:30:45 INFO Executor: Finished task 53.0 in stage 3.0 (TID 354). 2452 bytes result sent to driver
23/09/24 21:30:45 INFO CoarseGrainedExecutorBackend: Got assigned task 368
23/09/24 21:30:45 INFO Executor: Running task 67.0 in stage 3.0 (TID 368)
23/09/24 21:30:45 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 8992587776-9126805504, partition values: [empty row]
23/09/24 21:30:45 INFO MemoryStore: Block rdd_22_54 stored as values in memory (estimated size 115.8 MiB, free 3.3 GiB)
23/09/24 21:30:45 INFO Executor: Finished task 54.0 in stage 3.0 (TID 355). 2452 bytes result sent to driver
23/09/24 21:30:45 INFO CoarseGrainedExecutorBackend: Got assigned task 370
23/09/24 21:30:45 INFO Executor: Running task 69.0 in stage 3.0 (TID 370)
23/09/24 21:30:45 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9261023232-9395240960, partition values: [empty row]
23/09/24 21:30:45 INFO MemoryStore: Block rdd_22_57 stored as values in memory (estimated size 116.8 MiB, free 3.2 GiB)
23/09/24 21:30:45 INFO MemoryStore: Block rdd_22_55 stored as values in memory (estimated size 113.7 MiB, free 3.0 GiB)
23/09/24 21:30:45 INFO MemoryStore: Block rdd_22_51 stored as values in memory (estimated size 115.4 MiB, free 2.9 GiB)
23/09/24 21:30:45 INFO Executor: Finished task 57.0 in stage 3.0 (TID 358). 2452 bytes result sent to driver
23/09/24 21:30:45 INFO CoarseGrainedExecutorBackend: Got assigned task 372
23/09/24 21:30:45 INFO Executor: Finished task 55.0 in stage 3.0 (TID 356). 2452 bytes result sent to driver
23/09/24 21:30:45 INFO Executor: Running task 71.0 in stage 3.0 (TID 372)
23/09/24 21:30:45 INFO CoarseGrainedExecutorBackend: Got assigned task 373
23/09/24 21:30:45 INFO Executor: Finished task 51.0 in stage 3.0 (TID 352). 2452 bytes result sent to driver
23/09/24 21:30:45 INFO Executor: Running task 72.0 in stage 3.0 (TID 373)
23/09/24 21:30:45 INFO CoarseGrainedExecutorBackend: Got assigned task 374
23/09/24 21:30:45 INFO Executor: Running task 73.0 in stage 3.0 (TID 374)
23/09/24 21:30:45 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9663676416-9797894144, partition values: [empty row]
23/09/24 21:30:45 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9529458688-9663676416, partition values: [empty row]
23/09/24 21:30:45 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9797894144-9932111872, partition values: [empty row]
23/09/24 21:30:49 INFO MemoryStore: Block rdd_22_67 stored as values in memory (estimated size 116.9 MiB, free 2.8 GiB)
23/09/24 21:30:49 INFO Executor: Finished task 67.0 in stage 3.0 (TID 368). 2452 bytes result sent to driver
23/09/24 21:30:49 INFO CoarseGrainedExecutorBackend: Got assigned task 385
23/09/24 21:30:49 INFO Executor: Running task 84.0 in stage 3.0 (TID 385)
23/09/24 21:30:49 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11274289152-11408506880, partition values: [empty row]
23/09/24 21:30:49 INFO MemoryStore: Block rdd_22_69 stored as values in memory (estimated size 116.8 MiB, free 2.7 GiB)
23/09/24 21:30:49 INFO Executor: Finished task 69.0 in stage 3.0 (TID 370). 2452 bytes result sent to driver
23/09/24 21:30:49 INFO CoarseGrainedExecutorBackend: Got assigned task 386
23/09/24 21:30:49 INFO Executor: Running task 85.0 in stage 3.0 (TID 386)
23/09/24 21:30:49 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11408506880-11542724608, partition values: [empty row]
23/09/24 21:30:49 INFO MemoryStore: Block rdd_22_71 stored as values in memory (estimated size 116.7 MiB, free 2.6 GiB)
23/09/24 21:30:49 INFO Executor: Finished task 71.0 in stage 3.0 (TID 372). 2452 bytes result sent to driver
23/09/24 21:30:49 INFO CoarseGrainedExecutorBackend: Got assigned task 387
23/09/24 21:30:49 INFO Executor: Running task 86.0 in stage 3.0 (TID 387)
23/09/24 21:30:49 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11542724608-11676942336, partition values: [empty row]
23/09/24 21:30:49 INFO MemoryStore: Block rdd_22_73 stored as values in memory (estimated size 116.7 MiB, free 2.5 GiB)
23/09/24 21:30:49 INFO Executor: Finished task 73.0 in stage 3.0 (TID 374). 2452 bytes result sent to driver
23/09/24 21:30:49 INFO CoarseGrainedExecutorBackend: Got assigned task 388
23/09/24 21:30:49 INFO Executor: Running task 87.0 in stage 3.0 (TID 388)
23/09/24 21:30:50 INFO MemoryStore: Block rdd_22_72 stored as values in memory (estimated size 116.9 MiB, free 2.4 GiB)
23/09/24 21:30:50 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11676942336-11811160064, partition values: [empty row]
23/09/24 21:30:50 INFO Executor: Finished task 72.0 in stage 3.0 (TID 373). 2452 bytes result sent to driver
23/09/24 21:30:50 INFO CoarseGrainedExecutorBackend: Got assigned task 389
23/09/24 21:30:50 INFO Executor: Running task 88.0 in stage 3.0 (TID 389)
23/09/24 21:30:50 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11811160064-11945377792, partition values: [empty row]
23/09/24 21:30:53 INFO MemoryStore: Block rdd_22_84 stored as values in memory (estimated size 116.7 MiB, free 2.2 GiB)
23/09/24 21:30:53 INFO Executor: Finished task 84.0 in stage 3.0 (TID 385). 2452 bytes result sent to driver
23/09/24 21:30:53 INFO CoarseGrainedExecutorBackend: Got assigned task 400
23/09/24 21:30:53 INFO Executor: Running task 99.0 in stage 3.0 (TID 400)
23/09/24 21:30:53 INFO MemoryStore: Block rdd_22_85 stored as values in memory (estimated size 116.9 MiB, free 2.1 GiB)
23/09/24 21:30:53 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13287555072-13421772800, partition values: [empty row]
23/09/24 21:30:53 INFO Executor: Finished task 85.0 in stage 3.0 (TID 386). 2452 bytes result sent to driver
23/09/24 21:30:53 INFO CoarseGrainedExecutorBackend: Got assigned task 401
23/09/24 21:30:53 INFO Executor: Running task 100.0 in stage 3.0 (TID 401)
23/09/24 21:30:53 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13421772800-13555990528, partition values: [empty row]
23/09/24 21:30:53 INFO MemoryStore: Block rdd_22_86 stored as values in memory (estimated size 116.9 MiB, free 2.0 GiB)
23/09/24 21:30:53 INFO Executor: Finished task 86.0 in stage 3.0 (TID 387). 2452 bytes result sent to driver
23/09/24 21:30:53 INFO CoarseGrainedExecutorBackend: Got assigned task 402
23/09/24 21:30:53 INFO Executor: Running task 101.0 in stage 3.0 (TID 402)
23/09/24 21:30:53 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13555990528-13690208256, partition values: [empty row]
23/09/24 21:30:54 INFO MemoryStore: Block rdd_22_87 stored as values in memory (estimated size 116.9 MiB, free 1946.5 MiB)
23/09/24 21:30:54 INFO Executor: Finished task 87.0 in stage 3.0 (TID 388). 2452 bytes result sent to driver
23/09/24 21:30:54 INFO CoarseGrainedExecutorBackend: Got assigned task 404
23/09/24 21:30:54 INFO Executor: Running task 103.0 in stage 3.0 (TID 404)
23/09/24 21:30:54 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13824425984-13958643712, partition values: [empty row]
23/09/24 21:30:54 INFO MemoryStore: Block rdd_22_88 stored as values in memory (estimated size 116.9 MiB, free 1829.6 MiB)
23/09/24 21:30:54 INFO Executor: Finished task 88.0 in stage 3.0 (TID 389). 2452 bytes result sent to driver
23/09/24 21:30:54 INFO CoarseGrainedExecutorBackend: Got assigned task 405
23/09/24 21:30:54 INFO Executor: Running task 104.0 in stage 3.0 (TID 405)
23/09/24 21:30:54 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13958643712-14092861440, partition values: [empty row]
23/09/24 21:30:57 INFO MemoryStore: Block rdd_22_99 stored as values in memory (estimated size 116.8 MiB, free 1712.7 MiB)
23/09/24 21:30:57 INFO Executor: Finished task 99.0 in stage 3.0 (TID 400). 2452 bytes result sent to driver
23/09/24 21:30:57 INFO CoarseGrainedExecutorBackend: Got assigned task 412
23/09/24 21:30:57 INFO Executor: Running task 111.0 in stage 3.0 (TID 412)
23/09/24 21:30:57 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14898167808-15032385536, partition values: [empty row]
23/09/24 21:30:57 INFO MemoryStore: Block rdd_22_100 stored as values in memory (estimated size 116.8 MiB, free 1595.9 MiB)
23/09/24 21:30:57 INFO Executor: Finished task 100.0 in stage 3.0 (TID 401). 2452 bytes result sent to driver
23/09/24 21:30:57 INFO CoarseGrainedExecutorBackend: Got assigned task 413
23/09/24 21:30:57 INFO Executor: Running task 112.0 in stage 3.0 (TID 413)
23/09/24 21:30:57 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15032385536-15166603264, partition values: [empty row]
23/09/24 21:30:57 INFO MemoryStore: Block rdd_22_101 stored as values in memory (estimated size 116.8 MiB, free 1479.1 MiB)
23/09/24 21:30:57 INFO Executor: Finished task 101.0 in stage 3.0 (TID 402). 2452 bytes result sent to driver
23/09/24 21:30:57 INFO CoarseGrainedExecutorBackend: Got assigned task 415
23/09/24 21:30:57 INFO Executor: Running task 114.0 in stage 3.0 (TID 415)
23/09/24 21:30:57 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15300820992-15435038720, partition values: [empty row]
23/09/24 21:30:57 INFO MemoryStore: Block rdd_22_103 stored as values in memory (estimated size 116.9 MiB, free 1362.2 MiB)
23/09/24 21:30:57 INFO Executor: Finished task 103.0 in stage 3.0 (TID 404). 2452 bytes result sent to driver
23/09/24 21:30:57 INFO CoarseGrainedExecutorBackend: Got assigned task 419
23/09/24 21:30:57 INFO Executor: Running task 118.0 in stage 3.0 (TID 419)
23/09/24 21:30:57 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15837691904-15971909632, partition values: [empty row]
23/09/24 21:30:57 INFO MemoryStore: Block rdd_22_104 stored as values in memory (estimated size 116.9 MiB, free 1245.3 MiB)
23/09/24 21:30:57 INFO Executor: Finished task 104.0 in stage 3.0 (TID 405). 2452 bytes result sent to driver
23/09/24 21:30:57 INFO CoarseGrainedExecutorBackend: Got assigned task 420
23/09/24 21:30:57 INFO Executor: Running task 119.0 in stage 3.0 (TID 420)
23/09/24 21:30:57 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15971909632-16106127360, partition values: [empty row]
23/09/24 21:31:01 INFO MemoryStore: Block rdd_22_111 stored as values in memory (estimated size 116.9 MiB, free 1128.3 MiB)
23/09/24 21:31:01 INFO Executor: Finished task 111.0 in stage 3.0 (TID 412). 2452 bytes result sent to driver
23/09/24 21:31:01 INFO CoarseGrainedExecutorBackend: Got assigned task 431
23/09/24 21:31:01 INFO Executor: Running task 130.0 in stage 3.0 (TID 431)
23/09/24 21:31:01 INFO MemoryStore: Block rdd_22_112 stored as values in memory (estimated size 117.0 MiB, free 1011.4 MiB)
23/09/24 21:31:01 INFO Executor: Finished task 112.0 in stage 3.0 (TID 413). 2452 bytes result sent to driver
23/09/24 21:31:01 INFO CoarseGrainedExecutorBackend: Got assigned task 432
23/09/24 21:31:01 INFO Executor: Running task 131.0 in stage 3.0 (TID 432)
23/09/24 21:31:01 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17448304640-17582522368, partition values: [empty row]
23/09/24 21:31:01 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17582522368-17716740096, partition values: [empty row]
23/09/24 21:31:02 INFO MemoryStore: Block rdd_22_114 stored as values in memory (estimated size 116.9 MiB, free 894.4 MiB)
23/09/24 21:31:02 INFO Executor: Finished task 114.0 in stage 3.0 (TID 415). 2452 bytes result sent to driver
23/09/24 21:31:02 INFO CoarseGrainedExecutorBackend: Got assigned task 433
23/09/24 21:31:02 INFO Executor: Running task 132.0 in stage 3.0 (TID 433)
23/09/24 21:31:02 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17716740096-17850957824, partition values: [empty row]
23/09/24 21:31:02 INFO MemoryStore: Block rdd_22_118 stored as values in memory (estimated size 116.9 MiB, free 777.5 MiB)
23/09/24 21:31:02 INFO Executor: Finished task 118.0 in stage 3.0 (TID 419). 2452 bytes result sent to driver
23/09/24 21:31:02 INFO CoarseGrainedExecutorBackend: Got assigned task 434
23/09/24 21:31:02 INFO Executor: Running task 133.0 in stage 3.0 (TID 434)
23/09/24 21:31:02 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17850957824-17985175552, partition values: [empty row]
23/09/24 21:31:02 INFO MemoryStore: Block rdd_22_119 stored as values in memory (estimated size 116.9 MiB, free 660.6 MiB)
23/09/24 21:31:02 INFO Executor: Finished task 119.0 in stage 3.0 (TID 420). 2452 bytes result sent to driver
23/09/24 21:31:02 INFO CoarseGrainedExecutorBackend: Got assigned task 435
23/09/24 21:31:02 INFO Executor: Running task 134.0 in stage 3.0 (TID 435)
23/09/24 21:31:02 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 17985175552-18119393280, partition values: [empty row]
23/09/24 21:31:05 INFO MemoryStore: Block rdd_22_130 stored as values in memory (estimated size 116.9 MiB, free 543.7 MiB)
23/09/24 21:31:05 INFO Executor: Finished task 130.0 in stage 3.0 (TID 431). 2452 bytes result sent to driver
23/09/24 21:31:05 INFO CoarseGrainedExecutorBackend: Got assigned task 446
23/09/24 21:31:05 INFO Executor: Running task 145.0 in stage 3.0 (TID 446)
23/09/24 21:31:05 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19461570560-19595788288, partition values: [empty row]
23/09/24 21:31:05 INFO MemoryStore: Block rdd_22_131 stored as values in memory (estimated size 116.9 MiB, free 426.7 MiB)
23/09/24 21:31:06 INFO Executor: Finished task 131.0 in stage 3.0 (TID 432). 2452 bytes result sent to driver
23/09/24 21:31:06 INFO CoarseGrainedExecutorBackend: Got assigned task 447
23/09/24 21:31:06 INFO Executor: Running task 146.0 in stage 3.0 (TID 447)
23/09/24 21:31:06 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19595788288-19730006016, partition values: [empty row]
23/09/24 21:31:06 INFO MemoryStore: Block rdd_22_132 stored as values in memory (estimated size 116.9 MiB, free 309.8 MiB)
23/09/24 21:31:06 INFO Executor: Finished task 132.0 in stage 3.0 (TID 433). 2452 bytes result sent to driver
23/09/24 21:31:06 INFO CoarseGrainedExecutorBackend: Got assigned task 448
23/09/24 21:31:06 INFO Executor: Running task 147.0 in stage 3.0 (TID 448)
23/09/24 21:31:06 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19730006016-19864223744, partition values: [empty row]
23/09/24 21:31:06 INFO MemoryStore: Block rdd_22_133 stored as values in memory (estimated size 116.9 MiB, free 192.9 MiB)
23/09/24 21:31:06 INFO Executor: Finished task 133.0 in stage 3.0 (TID 434). 2452 bytes result sent to driver
23/09/24 21:31:06 INFO CoarseGrainedExecutorBackend: Got assigned task 449
23/09/24 21:31:06 INFO Executor: Running task 148.0 in stage 3.0 (TID 449)
23/09/24 21:31:06 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19864223744-19998441472, partition values: [empty row]
23/09/24 21:31:06 INFO MemoryStore: Block rdd_22_134 stored as values in memory (estimated size 117.0 MiB, free 75.9 MiB)
23/09/24 21:31:06 INFO Executor: Finished task 134.0 in stage 3.0 (TID 435). 2452 bytes result sent to driver
23/09/24 21:31:06 INFO CoarseGrainedExecutorBackend: Got assigned task 450
23/09/24 21:31:06 INFO Executor: Running task 149.0 in stage 3.0 (TID 450)
23/09/24 21:31:06 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19998441472-20012106932, partition values: [empty row]
23/09/24 21:31:07 INFO MemoryStore: Block rdd_22_149 stored as values in memory (estimated size 8.9 MiB, free 67.0 MiB)
23/09/24 21:31:07 INFO Executor: Finished task 149.0 in stage 3.0 (TID 450). 2452 bytes result sent to driver
23/09/24 21:31:08 INFO MemoryStore: Will not store rdd_22_145
23/09/24 21:31:09 WARN MemoryStore: Not enough space to cache rdd_22_145 in memory! (computed 64.6 MiB so far)
23/09/24 21:31:09 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 22.8 MiB (scratch space shared across 4 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:09 WARN BlockManager: Block rdd_22_145 could not be removed as it was not found on disk or in memory
23/09/24 21:31:09 WARN BlockManager: Putting block rdd_22_145 failed
23/09/24 21:31:09 INFO MemoryStore: Will not store rdd_22_147
23/09/24 21:31:09 WARN MemoryStore: Not enough space to cache rdd_22_147 in memory! (computed 64.6 MiB so far)
23/09/24 21:31:09 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 17.1 MiB (scratch space shared across 3 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:09 WARN BlockManager: Block rdd_22_147 could not be removed as it was not found on disk or in memory
23/09/24 21:31:09 WARN BlockManager: Putting block rdd_22_147 failed
23/09/24 21:31:09 INFO CoarseGrainedExecutorBackend: Got assigned task 451
23/09/24 21:31:09 INFO Executor: Running task 142.1 in stage 3.0 (TID 451)
23/09/24 21:31:09 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 19058917376-19193135104, partition values: [empty row]
23/09/24 21:31:09 INFO MemoryStore: Will not store rdd_22_146
23/09/24 21:31:09 WARN MemoryStore: Not enough space to cache rdd_22_146 in memory! (computed 64.6 MiB so far)
23/09/24 21:31:09 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 12.4 MiB (scratch space shared across 3 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:09 WARN BlockManager: Block rdd_22_146 could not be removed as it was not found on disk or in memory
23/09/24 21:31:09 WARN BlockManager: Putting block rdd_22_146 failed
23/09/24 21:31:09 INFO MemoryStore: Will not store rdd_22_148
23/09/24 21:31:09 WARN MemoryStore: Not enough space to cache rdd_22_148 in memory! (computed 64.6 MiB so far)
23/09/24 21:31:09 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 11.4 MiB (scratch space shared across 2 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:09 WARN BlockManager: Block rdd_22_148 could not be removed as it was not found on disk or in memory
23/09/24 21:31:09 WARN BlockManager: Putting block rdd_22_148 failed
23/09/24 21:31:09 INFO Executor: Finished task 147.0 in stage 3.0 (TID 448). 2452 bytes result sent to driver
23/09/24 21:31:09 INFO CoarseGrainedExecutorBackend: Got assigned task 454
23/09/24 21:31:09 INFO Executor: Running task 138.1 in stage 3.0 (TID 454)
23/09/24 21:31:09 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 18522046464-18656264192, partition values: [empty row]
23/09/24 21:31:10 INFO Executor: Finished task 146.0 in stage 3.0 (TID 447). 2452 bytes result sent to driver
23/09/24 21:31:10 INFO CoarseGrainedExecutorBackend: Got assigned task 457
23/09/24 21:31:10 INFO Executor: Running task 97.1 in stage 3.0 (TID 457)
23/09/24 21:31:10 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13019119616-13153337344, partition values: [empty row]
23/09/24 21:31:10 INFO Executor: Finished task 148.0 in stage 3.0 (TID 449). 2452 bytes result sent to driver
23/09/24 21:31:10 INFO CoarseGrainedExecutorBackend: Got assigned task 458
23/09/24 21:31:10 INFO Executor: Running task 70.1 in stage 3.0 (TID 458)
23/09/24 21:31:10 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9395240960-9529458688, partition values: [empty row]
23/09/24 21:31:10 INFO Executor: Finished task 145.0 in stage 3.0 (TID 446). 2452 bytes result sent to driver
23/09/24 21:31:10 INFO CoarseGrainedExecutorBackend: Got assigned task 459
23/09/24 21:31:10 INFO Executor: Running task 115.1 in stage 3.0 (TID 459)
23/09/24 21:31:10 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15435038720-15569256448, partition values: [empty row]
23/09/24 21:31:11 INFO MemoryStore: Will not store rdd_22_142
23/09/24 21:31:11 WARN MemoryStore: Not enough space to cache rdd_22_142 in memory! (computed 64.9 MiB so far)
23/09/24 21:31:11 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 28.6 MiB (scratch space shared across 5 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:11 WARN BlockManager: Block rdd_22_142 could not be removed as it was not found on disk or in memory
23/09/24 21:31:11 WARN BlockManager: Putting block rdd_22_142 failed
23/09/24 21:31:11 INFO MemoryStore: Will not store rdd_22_138
23/09/24 21:31:11 WARN MemoryStore: Not enough space to cache rdd_22_138 in memory! (computed 64.8 MiB so far)
23/09/24 21:31:11 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 22.9 MiB (scratch space shared across 4 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:11 WARN BlockManager: Block rdd_22_138 could not be removed as it was not found on disk or in memory
23/09/24 21:31:11 WARN BlockManager: Putting block rdd_22_138 failed
23/09/24 21:31:12 INFO MemoryStore: Will not store rdd_22_97
23/09/24 21:31:12 WARN MemoryStore: Not enough space to cache rdd_22_97 in memory! (computed 65.0 MiB so far)
23/09/24 21:31:12 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 17.2 MiB (scratch space shared across 3 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:12 WARN BlockManager: Block rdd_22_97 could not be removed as it was not found on disk or in memory
23/09/24 21:31:12 WARN BlockManager: Putting block rdd_22_97 failed
23/09/24 21:31:12 INFO MemoryStore: Will not store rdd_22_70
23/09/24 21:31:12 WARN MemoryStore: Not enough space to cache rdd_22_70 in memory! (computed 64.9 MiB so far)
23/09/24 21:31:12 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 11.4 MiB (scratch space shared across 2 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:12 WARN BlockManager: Block rdd_22_70 could not be removed as it was not found on disk or in memory
23/09/24 21:31:12 WARN BlockManager: Putting block rdd_22_70 failed
23/09/24 21:31:12 INFO MemoryStore: Will not store rdd_22_115
23/09/24 21:31:12 WARN MemoryStore: Not enough space to cache rdd_22_115 in memory! (computed 64.8 MiB so far)
23/09/24 21:31:12 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 5.7 MiB (scratch space shared across 1 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:12 WARN BlockManager: Block rdd_22_115 could not be removed as it was not found on disk or in memory
23/09/24 21:31:12 WARN BlockManager: Putting block rdd_22_115 failed
23/09/24 21:31:12 INFO Executor: Finished task 142.1 in stage 3.0 (TID 451). 2452 bytes result sent to driver
23/09/24 21:31:12 INFO CoarseGrainedExecutorBackend: Got assigned task 466
23/09/24 21:31:12 INFO Executor: Running task 31.1 in stage 3.0 (TID 466)
23/09/24 21:31:12 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4160749568-4294967296, partition values: [empty row]
23/09/24 21:31:13 INFO Executor: Finished task 138.1 in stage 3.0 (TID 454). 2452 bytes result sent to driver
23/09/24 21:31:13 INFO CoarseGrainedExecutorBackend: Got assigned task 467
23/09/24 21:31:13 INFO Executor: Running task 109.1 in stage 3.0 (TID 467)
23/09/24 21:31:13 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14629732352-14763950080, partition values: [empty row]
23/09/24 21:31:13 INFO Executor: Finished task 97.1 in stage 3.0 (TID 457). 2452 bytes result sent to driver
23/09/24 21:31:13 INFO CoarseGrainedExecutorBackend: Got assigned task 471
23/09/24 21:31:13 INFO Executor: Running task 50.1 in stage 3.0 (TID 471)
23/09/24 21:31:13 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 6710886400-6845104128, partition values: [empty row]
23/09/24 21:31:13 INFO Executor: Finished task 70.1 in stage 3.0 (TID 458). 2452 bytes result sent to driver
23/09/24 21:31:13 INFO CoarseGrainedExecutorBackend: Got assigned task 472
23/09/24 21:31:13 INFO Executor: Running task 41.1 in stage 3.0 (TID 472)
23/09/24 21:31:13 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 5502926848-5637144576, partition values: [empty row]
23/09/24 21:31:14 INFO Executor: Finished task 115.1 in stage 3.0 (TID 459). 2452 bytes result sent to driver
23/09/24 21:31:14 INFO CoarseGrainedExecutorBackend: Got assigned task 474
23/09/24 21:31:14 INFO Executor: Running task 20.1 in stage 3.0 (TID 474)
23/09/24 21:31:14 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 2684354560-2818572288, partition values: [empty row]
23/09/24 21:31:14 INFO MemoryStore: Will not store rdd_22_31
23/09/24 21:31:14 WARN MemoryStore: Not enough space to cache rdd_22_31 in memory! (computed 65.0 MiB so far)
23/09/24 21:31:14 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 28.7 MiB (scratch space shared across 5 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:14 WARN BlockManager: Block rdd_22_31 could not be removed as it was not found on disk or in memory
23/09/24 21:31:14 WARN BlockManager: Putting block rdd_22_31 failed
23/09/24 21:31:15 INFO MemoryStore: Will not store rdd_22_109
23/09/24 21:31:15 WARN MemoryStore: Not enough space to cache rdd_22_109 in memory! (computed 64.8 MiB so far)
23/09/24 21:31:15 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 22.9 MiB (scratch space shared across 4 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:15 WARN BlockManager: Block rdd_22_109 could not be removed as it was not found on disk or in memory
23/09/24 21:31:15 WARN BlockManager: Putting block rdd_22_109 failed
23/09/24 21:31:15 INFO MemoryStore: Will not store rdd_22_50
23/09/24 21:31:15 WARN MemoryStore: Not enough space to cache rdd_22_50 in memory! (computed 65.0 MiB so far)
23/09/24 21:31:15 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 17.2 MiB (scratch space shared across 3 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:15 WARN BlockManager: Block rdd_22_50 could not be removed as it was not found on disk or in memory
23/09/24 21:31:15 WARN BlockManager: Putting block rdd_22_50 failed
23/09/24 21:31:15 INFO MemoryStore: Will not store rdd_22_41
23/09/24 21:31:15 WARN MemoryStore: Not enough space to cache rdd_22_41 in memory! (computed 65.0 MiB so far)
23/09/24 21:31:15 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 11.5 MiB (scratch space shared across 2 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:15 WARN BlockManager: Block rdd_22_41 could not be removed as it was not found on disk or in memory
23/09/24 21:31:15 WARN BlockManager: Putting block rdd_22_41 failed
23/09/24 21:31:16 INFO Executor: Finished task 31.1 in stage 3.0 (TID 466). 2452 bytes result sent to driver
23/09/24 21:31:16 INFO CoarseGrainedExecutorBackend: Got assigned task 476
23/09/24 21:31:16 INFO Executor: Running task 83.1 in stage 3.0 (TID 476)
23/09/24 21:31:16 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 11140071424-11274289152, partition values: [empty row]
23/09/24 21:31:16 INFO MemoryStore: Will not store rdd_22_20
23/09/24 21:31:16 WARN MemoryStore: Not enough space to cache rdd_22_20 in memory! (computed 65.0 MiB so far)
23/09/24 21:31:16 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 6.7 MiB (scratch space shared across 2 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:16 WARN BlockManager: Block rdd_22_20 could not be removed as it was not found on disk or in memory
23/09/24 21:31:16 WARN BlockManager: Putting block rdd_22_20 failed
23/09/24 21:31:17 INFO Executor: Finished task 109.1 in stage 3.0 (TID 467). 2452 bytes result sent to driver
23/09/24 21:31:17 INFO CoarseGrainedExecutorBackend: Got assigned task 477
23/09/24 21:31:17 INFO Executor: Running task 2.1 in stage 3.0 (TID 477)
23/09/24 21:31:17 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 268435456-402653184, partition values: [empty row]
23/09/24 21:31:17 INFO Executor: Finished task 50.1 in stage 3.0 (TID 471). 2452 bytes result sent to driver
23/09/24 21:31:17 INFO CoarseGrainedExecutorBackend: Got assigned task 480
23/09/24 21:31:17 INFO Executor: Running task 8.1 in stage 3.0 (TID 480)
23/09/24 21:31:17 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 1073741824-1207959552, partition values: [empty row]
23/09/24 21:31:17 INFO Executor: Finished task 41.1 in stage 3.0 (TID 472). 2452 bytes result sent to driver
23/09/24 21:31:17 INFO CoarseGrainedExecutorBackend: Got assigned task 482
23/09/24 21:31:17 INFO Executor: Running task 116.1 in stage 3.0 (TID 482)
23/09/24 21:31:17 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 15569256448-15703474176, partition values: [empty row]
23/09/24 21:31:17 INFO Executor: Finished task 20.1 in stage 3.0 (TID 474). 2452 bytes result sent to driver
23/09/24 21:31:17 INFO CoarseGrainedExecutorBackend: Got assigned task 484
23/09/24 21:31:17 INFO Executor: Running task 35.1 in stage 3.0 (TID 484)
23/09/24 21:31:17 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4697620480-4831838208, partition values: [empty row]
23/09/24 21:31:18 INFO MemoryStore: Will not store rdd_22_83
23/09/24 21:31:18 WARN MemoryStore: Not enough space to cache rdd_22_83 in memory! (computed 64.9 MiB so far)
23/09/24 21:31:18 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 28.7 MiB (scratch space shared across 5 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:18 WARN BlockManager: Block rdd_22_83 could not be removed as it was not found on disk or in memory
23/09/24 21:31:18 WARN BlockManager: Putting block rdd_22_83 failed
23/09/24 21:31:19 INFO MemoryStore: Will not store rdd_22_2
23/09/24 21:31:19 WARN MemoryStore: Not enough space to cache rdd_22_2 in memory! (computed 65.4 MiB so far)
23/09/24 21:31:19 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 23.0 MiB (scratch space shared across 4 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:19 WARN BlockManager: Block rdd_22_2 could not be removed as it was not found on disk or in memory
23/09/24 21:31:19 WARN BlockManager: Putting block rdd_22_2 failed
23/09/24 21:31:19 INFO MemoryStore: Will not store rdd_22_8
23/09/24 21:31:19 WARN MemoryStore: Not enough space to cache rdd_22_8 in memory! (computed 65.1 MiB so far)
23/09/24 21:31:19 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 17.2 MiB (scratch space shared across 3 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:19 WARN BlockManager: Block rdd_22_8 could not be removed as it was not found on disk or in memory
23/09/24 21:31:19 WARN BlockManager: Putting block rdd_22_8 failed
23/09/24 21:31:19 INFO MemoryStore: Will not store rdd_22_116
23/09/24 21:31:19 WARN MemoryStore: Not enough space to cache rdd_22_116 in memory! (computed 64.8 MiB so far)
23/09/24 21:31:19 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 11.5 MiB (scratch space shared across 2 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:19 WARN BlockManager: Block rdd_22_116 could not be removed as it was not found on disk or in memory
23/09/24 21:31:19 WARN BlockManager: Putting block rdd_22_116 failed
23/09/24 21:31:19 INFO MemoryStore: Will not store rdd_22_35
23/09/24 21:31:19 WARN MemoryStore: Not enough space to cache rdd_22_35 in memory! (computed 65.0 MiB so far)
23/09/24 21:31:19 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 5.7 MiB (scratch space shared across 1 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:19 WARN BlockManager: Block rdd_22_35 could not be removed as it was not found on disk or in memory
23/09/24 21:31:19 WARN BlockManager: Putting block rdd_22_35 failed
23/09/24 21:31:20 INFO Executor: Finished task 83.1 in stage 3.0 (TID 476). 2452 bytes result sent to driver
23/09/24 21:31:20 INFO CoarseGrainedExecutorBackend: Got assigned task 486
23/09/24 21:31:20 INFO Executor: Running task 98.1 in stage 3.0 (TID 486)
23/09/24 21:31:20 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 13153337344-13287555072, partition values: [empty row]
23/09/24 21:31:20 INFO Executor: Finished task 2.1 in stage 3.0 (TID 477). 2452 bytes result sent to driver
23/09/24 21:31:20 INFO CoarseGrainedExecutorBackend: Got assigned task 487
23/09/24 21:31:20 INFO Executor: Running task 107.1 in stage 3.0 (TID 487)
23/09/24 21:31:20 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 14361296896-14495514624, partition values: [empty row]
23/09/24 21:31:21 INFO Executor: Finished task 8.1 in stage 3.0 (TID 480). 2452 bytes result sent to driver
23/09/24 21:31:21 INFO CoarseGrainedExecutorBackend: Got assigned task 490
23/09/24 21:31:21 INFO Executor: Running task 68.1 in stage 3.0 (TID 490)
23/09/24 21:31:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 9126805504-9261023232, partition values: [empty row]
23/09/24 21:31:21 INFO Executor: Finished task 116.1 in stage 3.0 (TID 482). 2452 bytes result sent to driver
23/09/24 21:31:21 INFO CoarseGrainedExecutorBackend: Got assigned task 492
23/09/24 21:31:21 INFO Executor: Running task 36.1 in stage 3.0 (TID 492)
23/09/24 21:31:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 4831838208-4966055936, partition values: [empty row]
23/09/24 21:31:21 INFO Executor: Finished task 35.1 in stage 3.0 (TID 484). 2452 bytes result sent to driver
23/09/24 21:31:21 INFO CoarseGrainedExecutorBackend: Got assigned task 495
23/09/24 21:31:21 INFO Executor: Running task 96.1 in stage 3.0 (TID 495)
23/09/24 21:31:21 INFO FileScanRDD: Reading File path: file:///root/zingg/examples/blackice/ubo-20230604-mapped.json, range: 12884901888-13019119616, partition values: [empty row]
23/09/24 21:31:22 INFO MemoryStore: Will not store rdd_22_98
23/09/24 21:31:22 WARN MemoryStore: Not enough space to cache rdd_22_98 in memory! (computed 65.0 MiB so far)
23/09/24 21:31:22 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 28.7 MiB (scratch space shared across 5 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:22 WARN BlockManager: Block rdd_22_98 could not be removed as it was not found on disk or in memory
23/09/24 21:31:22 WARN BlockManager: Putting block rdd_22_98 failed
23/09/24 21:31:22 INFO MemoryStore: Will not store rdd_22_107
23/09/24 21:31:22 WARN MemoryStore: Not enough space to cache rdd_22_107 in memory! (computed 64.8 MiB so far)
23/09/24 21:31:22 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 22.9 MiB (scratch space shared across 4 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:22 WARN BlockManager: Block rdd_22_107 could not be removed as it was not found on disk or in memory
23/09/24 21:31:22 WARN BlockManager: Putting block rdd_22_107 failed
23/09/24 21:31:23 INFO MemoryStore: Will not store rdd_22_68
23/09/24 21:31:23 WARN MemoryStore: Not enough space to cache rdd_22_68 in memory! (computed 65.0 MiB so far)
23/09/24 21:31:23 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 17.2 MiB (scratch space shared across 3 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:23 WARN BlockManager: Block rdd_22_68 could not be removed as it was not found on disk or in memory
23/09/24 21:31:23 WARN BlockManager: Putting block rdd_22_68 failed
23/09/24 21:31:23 INFO MemoryStore: Will not store rdd_22_36
23/09/24 21:31:23 WARN MemoryStore: Not enough space to cache rdd_22_36 in memory! (computed 65.0 MiB so far)
23/09/24 21:31:23 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 11.5 MiB (scratch space shared across 2 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:23 WARN BlockManager: Block rdd_22_36 could not be removed as it was not found on disk or in memory
23/09/24 21:31:23 WARN BlockManager: Putting block rdd_22_36 failed
23/09/24 21:31:23 INFO MemoryStore: Will not store rdd_22_96
23/09/24 21:31:23 WARN MemoryStore: Not enough space to cache rdd_22_96 in memory! (computed 64.9 MiB so far)
23/09/24 21:31:23 INFO MemoryStore: Memory use = 5.1 GiB (blocks) + 5.7 MiB (scratch space shared across 1 tasks(s)) = 5.1 GiB. Storage limit = 5.2 GiB.
23/09/24 21:31:23 WARN BlockManager: Block rdd_22_96 could not be removed as it was not found on disk or in memory
23/09/24 21:31:23 WARN BlockManager: Putting block rdd_22_96 failed
23/09/24 21:31:23 INFO Executor: Finished task 98.1 in stage 3.0 (TID 486). 2452 bytes result sent to driver
23/09/24 21:31:24 INFO Executor: Finished task 107.1 in stage 3.0 (TID 487). 2452 bytes result sent to driver
23/09/24 21:31:24 INFO Executor: Finished task 68.1 in stage 3.0 (TID 490). 2452 bytes result sent to driver
23/09/24 21:31:24 INFO Executor: Finished task 36.1 in stage 3.0 (TID 492). 2452 bytes result sent to driver
23/09/24 21:31:25 INFO Executor: Finished task 96.1 in stage 3.0 (TID 495). 2452 bytes result sent to driver
23/09/24 21:31:26 INFO CoarseGrainedExecutorBackend: Got assigned task 505
23/09/24 21:31:26 INFO Executor: Running task 2.0 in stage 6.0 (TID 505)
23/09/24 21:31:26 INFO MapOutputTrackerWorker: Updating epoch to 3 and clearing cache
23/09/24 21:31:26 INFO TorrentBroadcast: Started reading broadcast variable 10 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:26 INFO MemoryStore: Block broadcast_10_piece0 stored as bytes in memory (estimated size 7.0 KiB, free 67.0 MiB)
23/09/24 21:31:26 INFO TorrentBroadcast: Reading broadcast variable 10 took 4 ms
23/09/24 21:31:26 INFO MemoryStore: Block broadcast_10 stored as values in memory (estimated size 14.7 KiB, free 67.0 MiB)
23/09/24 21:31:26 INFO CodeGenerator: Code generated in 10.215677 ms
23/09/24 21:31:26 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00038-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4078, partition values: [empty row]
23/09/24 21:31:26 INFO TorrentBroadcast: Started reading broadcast variable 9 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:26 INFO TransportClientFactory: Successfully created connection to /5.161.188.154:38099 after 1 ms (0 ms spent in bootstraps)
23/09/24 21:31:26 INFO MemoryStore: Block broadcast_9_piece0 stored as bytes in memory (estimated size 25.1 KiB, free 67.0 MiB)
23/09/24 21:31:26 INFO TorrentBroadcast: Reading broadcast variable 9 took 9 ms
23/09/24 21:31:26 INFO MemoryStore: Block broadcast_9 stored as values in memory (estimated size 398.2 KiB, free 66.6 MiB)
23/09/24 21:31:26 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00044-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4078, partition values: [empty row]
23/09/24 21:31:26 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00015-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4075, partition values: [empty row]
23/09/24 21:31:26 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00009-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4062, partition values: [empty row]
23/09/24 21:31:26 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00085-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4057, partition values: [empty row]
23/09/24 21:31:26 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00105-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4037, partition values: [empty row]
23/09/24 21:31:26 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00004-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4030, partition values: [empty row]
23/09/24 21:31:26 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00064-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4018, partition values: [empty row]
23/09/24 21:31:26 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00082-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4010, partition values: [empty row]
23/09/24 21:31:26 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00071-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4009, partition values: [empty row]
23/09/24 21:31:26 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00101-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-3992, partition values: [empty row]
23/09/24 21:31:26 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00059-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-3992, partition values: [empty row]
23/09/24 21:31:26 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00000-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-1531, partition values: [empty row]
23/09/24 21:31:26 INFO Executor: Finished task 2.0 in stage 6.0 (TID 505). 2058 bytes result sent to driver
23/09/24 21:31:27 INFO CoarseGrainedExecutorBackend: Got assigned task 507
23/09/24 21:31:27 INFO Executor: Running task 0.0 in stage 8.0 (TID 507)
23/09/24 21:31:27 INFO MapOutputTrackerWorker: Updating epoch to 4 and clearing cache
23/09/24 21:31:27 INFO TorrentBroadcast: Started reading broadcast variable 13 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:27 INFO MemoryStore: Block broadcast_13_piece0 stored as bytes in memory (estimated size 10.0 KiB, free 67.2 MiB)
23/09/24 21:31:27 INFO TorrentBroadcast: Reading broadcast variable 13 took 5 ms
23/09/24 21:31:27 INFO MemoryStore: Block broadcast_13 stored as values in memory (estimated size 29.8 KiB, free 67.1 MiB)
23/09/24 21:31:27 INFO CodeGenerator: Code generated in 10.197492 ms
23/09/24 21:31:27 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00056-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4526, partition values: [empty row]
23/09/24 21:31:27 INFO TorrentBroadcast: Started reading broadcast variable 12 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:27 INFO MemoryStore: Block broadcast_12_piece0 stored as bytes in memory (estimated size 25.8 KiB, free 67.5 MiB)
23/09/24 21:31:27 INFO TorrentBroadcast: Reading broadcast variable 12 took 8 ms
23/09/24 21:31:27 INFO MemoryStore: Block broadcast_12 stored as values in memory (estimated size 398.2 KiB, free 67.1 MiB)
23/09/24 21:31:27 INFO CodecPool: Got brand-new decompressor [.snappy]
23/09/24 21:31:27 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00136-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4489, partition values: [empty row]
23/09/24 21:31:27 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00000-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4486, partition values: [empty row]
23/09/24 21:31:27 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00072-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4485, partition values: [empty row]
23/09/24 21:31:27 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00016-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4480, partition values: [empty row]
23/09/24 21:31:27 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00145-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4447, partition values: [empty row]
23/09/24 21:31:27 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00024-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4420, partition values: [empty row]
23/09/24 21:31:27 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00097-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4419, partition values: [empty row]
23/09/24 21:31:27 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00090-95d092b2-cf46-43df-84c9-f5a022102ae0-c000.snappy.parquet, range: 0-4387, partition values: [empty row]
23/09/24 21:31:27 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00105-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4380, partition values: [empty row]
23/09/24 21:31:27 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00074-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4364, partition values: [empty row]
23/09/24 21:31:27 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00154-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4340, partition values: [empty row]
23/09/24 21:31:27 INFO FileScanRDD: Reading File path: file:///root/zingg/models/100/trainingData/marked/part-00066-08a344f4-94f9-408b-8983-a293c33c986e-c000.snappy.parquet, range: 0-4281, partition values: [empty row]
23/09/24 21:31:27 INFO MemoryStore: Block rdd_44_0 stored as values in memory (estimated size 5.4 KiB, free 67.1 MiB)
23/09/24 21:31:27 INFO CodeGenerator: Code generated in 4.001751 ms
23/09/24 21:31:27 INFO CodeGenerator: Code generated in 10.168276 ms
23/09/24 21:31:27 INFO CodeGenerator: Code generated in 4.746245 ms
23/09/24 21:31:27 INFO Executor: Finished task 0.0 in stage 8.0 (TID 507). 2124 bytes result sent to driver
23/09/24 21:31:28 INFO CoarseGrainedExecutorBackend: Got assigned task 511
23/09/24 21:31:28 INFO Executor: Running task 0.0 in stage 9.0 (TID 511)
23/09/24 21:31:28 INFO TorrentBroadcast: Started reading broadcast variable 15 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_15_piece0 stored as bytes in memory (estimated size 13.7 KiB, free 67.1 MiB)
23/09/24 21:31:28 INFO TorrentBroadcast: Reading broadcast variable 15 took 4 ms
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_15 stored as values in memory (estimated size 36.8 KiB, free 67.1 MiB)
23/09/24 21:31:28 INFO BlockManager: Found block rdd_44_0 locally
23/09/24 21:31:28 INFO CodeGenerator: Code generated in 6.783149 ms
23/09/24 21:31:28 INFO CodeGenerator: Code generated in 10.382552 ms
23/09/24 21:31:28 INFO CodeGenerator: Code generated in 11.914071 ms
23/09/24 21:31:28 INFO TorrentBroadcast: Started reading broadcast variable 14 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_14_piece0 stored as bytes in memory (estimated size 1669.0 B, free 67.1 MiB)
23/09/24 21:31:28 INFO TorrentBroadcast: Reading broadcast variable 14 took 7 ms
23/09/24 21:31:28 INFO MemoryStore: 6 blocks selected for dropping (111.2 MiB bytes)
23/09/24 21:31:28 INFO BlockManager: Dropping block broadcast_1_piece0 from memory
23/09/24 21:31:28 INFO BlockManager: Writing block broadcast_1_piece0 to disk
23/09/24 21:31:28 INFO BlockManager: Dropping block broadcast_1 from memory
23/09/24 21:31:28 INFO BlockManager: Writing block broadcast_1 to disk
23/09/24 21:31:28 INFO BlockManager: Dropping block broadcast_0_piece0 from memory
23/09/24 21:31:28 INFO BlockManager: Writing block broadcast_0_piece0 to disk
23/09/24 21:31:28 INFO BlockManager: Dropping block broadcast_0 from memory
23/09/24 21:31:28 INFO BlockManager: Writing block broadcast_0 to disk
23/09/24 21:31:28 INFO BlockManager: Dropping block broadcast_5 from memory
23/09/24 21:31:28 INFO BlockManager: Writing block broadcast_5 to disk
23/09/24 21:31:28 INFO BlockManager: Dropping block rdd_22_12 from memory
23/09/24 21:31:28 INFO MemoryStore: After dropping 6 blocks, free memory is 178.3 MiB
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_14 stored as values in memory (estimated size 64.0 MiB, free 114.3 MiB)
23/09/24 21:31:28 INFO Executor: Finished task 0.0 in stage 9.0 (TID 511). 2435 bytes result sent to driver
23/09/24 21:31:28 INFO CoarseGrainedExecutorBackend: Got assigned task 513
23/09/24 21:31:28 INFO Executor: Running task 0.0 in stage 10.0 (TID 513)
23/09/24 21:31:28 INFO MapOutputTrackerWorker: Updating epoch to 5 and clearing cache
23/09/24 21:31:28 INFO TorrentBroadcast: Started reading broadcast variable 16 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_16_piece0 stored as bytes in memory (estimated size 5.0 KiB, free 114.3 MiB)
23/09/24 21:31:28 INFO TorrentBroadcast: Reading broadcast variable 16 took 3 ms
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_16 stored as values in memory (estimated size 10.1 KiB, free 114.2 MiB)
23/09/24 21:31:28 INFO MapOutputTrackerWorker: Don't have map outputs for shuffle 3, fetching them
23/09/24 21:31:28 INFO MapOutputTrackerWorker: Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@static.154.188.161.5.clients.your-server.de:45295)
23/09/24 21:31:28 INFO MapOutputTrackerWorker: Got the output locations
23/09/24 21:31:28 INFO ShuffleBlockFetcherIterator: Getting 3 (180.0 B) non-empty blocks including 1 (60.0 B) local and 2 (120.0 B) host-local and 0 (0.0 B) remote blocks
23/09/24 21:31:28 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 13 ms
23/09/24 21:31:28 INFO CodeGenerator: Code generated in 6.241087 ms
23/09/24 21:31:28 INFO Executor: Finished task 0.0 in stage 10.0 (TID 513). 2450 bytes result sent to driver
23/09/24 21:31:28 INFO CoarseGrainedExecutorBackend: Got assigned task 514
23/09/24 21:31:28 INFO Executor: Running task 0.0 in stage 11.0 (TID 514)
23/09/24 21:31:28 INFO TorrentBroadcast: Started reading broadcast variable 17 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_17_piece0 stored as bytes in memory (estimated size 10.5 KiB, free 114.2 MiB)
23/09/24 21:31:28 INFO TorrentBroadcast: Reading broadcast variable 17 took 4 ms
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_17 stored as values in memory (estimated size 30.5 KiB, free 114.2 MiB)
23/09/24 21:31:28 INFO BlockManager: Found block rdd_44_0 locally
23/09/24 21:31:28 INFO Executor: Finished task 0.0 in stage 11.0 (TID 514). 2124 bytes result sent to driver
23/09/24 21:31:28 INFO CoarseGrainedExecutorBackend: Got assigned task 518
23/09/24 21:31:28 INFO Executor: Running task 0.0 in stage 12.0 (TID 518)
23/09/24 21:31:28 INFO TorrentBroadcast: Started reading broadcast variable 19 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_19_piece0 stored as bytes in memory (estimated size 13.7 KiB, free 114.2 MiB)
23/09/24 21:31:28 INFO TorrentBroadcast: Reading broadcast variable 19 took 4 ms
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_19 stored as values in memory (estimated size 36.8 KiB, free 114.2 MiB)
23/09/24 21:31:28 INFO BlockManager: Found block rdd_44_0 locally
23/09/24 21:31:28 INFO CodeGenerator: Code generated in 6.530082 ms
23/09/24 21:31:28 INFO CodeGenerator: Code generated in 9.087959 ms
23/09/24 21:31:28 INFO TorrentBroadcast: Started reading broadcast variable 18 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_18_piece0 stored as bytes in memory (estimated size 1669.0 B, free 114.2 MiB)
23/09/24 21:31:28 INFO TorrentBroadcast: Reading broadcast variable 18 took 4 ms
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_18 stored as values in memory (estimated size 64.0 MiB, free 50.2 MiB)
23/09/24 21:31:28 INFO Executor: Finished task 0.0 in stage 12.0 (TID 518). 2478 bytes result sent to driver
23/09/24 21:31:28 INFO CoarseGrainedExecutorBackend: Got assigned task 520
23/09/24 21:31:28 INFO Executor: Running task 0.0 in stage 13.0 (TID 520)
23/09/24 21:31:28 INFO MapOutputTrackerWorker: Updating epoch to 6 and clearing cache
23/09/24 21:31:28 INFO TorrentBroadcast: Started reading broadcast variable 20 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_20_piece0 stored as bytes in memory (estimated size 5.0 KiB, free 50.1 MiB)
23/09/24 21:31:28 INFO TorrentBroadcast: Reading broadcast variable 20 took 3 ms
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_20 stored as values in memory (estimated size 10.1 KiB, free 50.1 MiB)
23/09/24 21:31:28 INFO MapOutputTrackerWorker: Don't have map outputs for shuffle 4, fetching them
23/09/24 21:31:28 INFO MapOutputTrackerWorker: Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@static.154.188.161.5.clients.your-server.de:45295)
23/09/24 21:31:28 INFO MapOutputTrackerWorker: Got the output locations
23/09/24 21:31:28 INFO ShuffleBlockFetcherIterator: Getting 3 (180.0 B) non-empty blocks including 1 (60.0 B) local and 2 (120.0 B) host-local and 0 (0.0 B) remote blocks
23/09/24 21:31:28 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
23/09/24 21:31:28 INFO Executor: Finished task 0.0 in stage 13.0 (TID 520). 2450 bytes result sent to driver
23/09/24 21:31:28 INFO CoarseGrainedExecutorBackend: Got assigned task 523
23/09/24 21:31:28 INFO Executor: Running task 0.0 in stage 14.0 (TID 523)
23/09/24 21:31:28 INFO TorrentBroadcast: Started reading broadcast variable 21 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_21_piece0 stored as bytes in memory (estimated size 10.5 KiB, free 50.1 MiB)
23/09/24 21:31:28 INFO TorrentBroadcast: Reading broadcast variable 21 took 4 ms
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_21 stored as values in memory (estimated size 30.5 KiB, free 50.1 MiB)
23/09/24 21:31:28 INFO BlockManager: Found block rdd_44_0 locally
23/09/24 21:31:28 INFO Executor: Finished task 0.0 in stage 14.0 (TID 523). 2124 bytes result sent to driver
23/09/24 21:31:28 INFO CoarseGrainedExecutorBackend: Got assigned task 526
23/09/24 21:31:28 INFO Executor: Running task 0.0 in stage 15.0 (TID 526)
23/09/24 21:31:28 INFO TorrentBroadcast: Started reading broadcast variable 23 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_23_piece0 stored as bytes in memory (estimated size 13.7 KiB, free 50.1 MiB)
23/09/24 21:31:28 INFO TorrentBroadcast: Reading broadcast variable 23 took 4 ms
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_23 stored as values in memory (estimated size 36.8 KiB, free 50.0 MiB)
23/09/24 21:31:28 INFO BlockManager: Found block rdd_44_0 locally
23/09/24 21:31:28 INFO TorrentBroadcast: Started reading broadcast variable 22 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_22_piece0 stored as bytes in memory (estimated size 1669.0 B, free 50.0 MiB)
23/09/24 21:31:28 INFO TorrentBroadcast: Reading broadcast variable 22 took 4 ms
23/09/24 21:31:28 INFO MemoryStore: 1 blocks selected for dropping (102.3 MiB bytes)
23/09/24 21:31:28 INFO BlockManager: Dropping block rdd_22_9 from memory
23/09/24 21:31:28 INFO MemoryStore: After dropping 1 blocks, free memory is 152.3 MiB
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_22 stored as values in memory (estimated size 64.0 MiB, free 88.3 MiB)
23/09/24 21:31:28 INFO Executor: Finished task 0.0 in stage 15.0 (TID 526). 2435 bytes result sent to driver
23/09/24 21:31:28 INFO CoarseGrainedExecutorBackend: Got assigned task 527
23/09/24 21:31:28 INFO Executor: Running task 0.0 in stage 16.0 (TID 527)
23/09/24 21:31:28 INFO MapOutputTrackerWorker: Updating epoch to 7 and clearing cache
23/09/24 21:31:28 INFO TorrentBroadcast: Started reading broadcast variable 24 with 1 pieces (estimated total size 4.0 MiB)
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_24_piece0 stored as bytes in memory (estimated size 5.0 KiB, free 88.3 MiB)
23/09/24 21:31:28 INFO TorrentBroadcast: Reading broadcast variable 24 took 3 ms
23/09/24 21:31:28 INFO MemoryStore: Block broadcast_24 stored as values in memory (estimated size 10.1 KiB, free 88.3 MiB)
23/09/24 21:31:28 INFO MapOutputTrackerWorker: Don't have map outputs for shuffle 5, fetching them
23/09/24 21:31:28 INFO MapOutputTrackerWorker: Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@static.154.188.161.5.clients.your-server.de:45295)
23/09/24 21:31:28 INFO MapOutputTrackerWorker: Got the output locations
23/09/24 21:31:28 INFO ShuffleBlockFetcherIterator: Getting 3 (180.0 B) non-empty blocks including 1 (60.0 B) local and 2 (120.0 B) host-local and 0 (0.0 B) remote blocks
23/09/24 21:31:28 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
23/09/24 21:31:28 INFO Executor: Finished task 0.0 in stage 16.0 (TID 527). 2450 bytes result sent to driver
23/09/24 21:31:33 INFO CoarseGrainedExecutorBackend: Driver commanded a shutdown
23/09/24 21:31:33 ERROR CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM
tdown