Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
19/04/23 18:46:02 INFO SparkContext: Running Spark version 2.1.0
19/04/23 18:46:02 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
19/04/23 18:46:03 INFO SecurityManager: Changing view acls to: ec2-user
19/04/23 18:46:03 INFO SecurityManager: Changing modify acls to: ec2-user
19/04/23 18:46:03 INFO SecurityManager: Changing view acls groups to: 
19/04/23 18:46:03 INFO SecurityManager: Changing modify acls groups to: 
19/04/23 18:46:03 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(ec2-user); groups with view permissions: Set(); users  with modify permissions: Set(ec2-user); groups with modify permissions: Set()
19/04/23 18:46:03 INFO NettyRpcEnv: LAMBDA: 14000: NettyRpcEnv.startServer: 10.10.0.170 0
19/04/23 18:46:03 INFO NettyRpcEnv: LAMBDA: 14001: NettyRpcEnv.address: 10.10.0.170
19/04/23 18:46:03 INFO Utils: Successfully started service 'sparkDriver' on port 34496.
19/04/23 18:46:03 INFO SparkEnv: Registering MapOutputTracker
19/04/23 18:46:03 INFO SparkEnv: Registering BlockManagerMaster
19/04/23 18:46:03 INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information
19/04/23 18:46:03 INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up
19/04/23 18:46:03 INFO DiskBlockManager: Created local directory at /tmp/executor-driver-eca4b200-a312-4531-bf9c-533be87d3be7
19/04/23 18:46:03 INFO MemoryStore: MemoryStore started with capacity 413.9 MB
19/04/23 18:46:03 INFO SparkEnv: Registering OutputCommitCoordinator
19/04/23 18:46:04 INFO Utils: Successfully started service 'SparkUI' on port 4040.
19/04/23 18:46:04 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://10.10.0.170:4040
19/04/23 18:46:04 INFO SparkContext: Added JAR file:/home/ec2-user/spark-2.1.0-bin-spark-lambda-2.1.0/examples/jars/scopt_2.11-3.3.0.jar at spark://10.10.0.170:34496/jars/scopt_2.11-3.3.0.jar with timestamp 1556045164170
19/04/23 18:46:04 INFO SparkContext: Added JAR file:/home/ec2-user/spark-2.1.0-bin-spark-lambda-2.1.0/examples/jars/spark-examples_2.11-2.1.0.jar at spark://10.10.0.170:34496/jars/spark-examples_2.11-2.1.0.jar with timestamp 1556045164171
19/04/23 18:46:04 INFO Executor: Starting executor ID driver on host localhost
19/04/23 18:46:04 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 38427.
19/04/23 18:46:04 INFO NettyBlockTransferService: Server created on 10.10.0.170:38427
19/04/23 18:46:04 INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
19/04/23 18:46:04 INFO BlockManager: LAMBDA: 11000: BlockManager: 10.10.0.170
19/04/23 18:46:04 INFO BlockManager: LAMBDA: 11001: BlockManager: 38427
19/04/23 18:46:04 INFO BlockManager: LAMBDA: 11002: BlockManager: Creating driver BlockManagerId
19/04/23 18:46:04 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, 10.10.0.170, 38427, None)
19/04/23 18:46:04 INFO BlockManagerMasterEndpoint: Registering block manager 10.10.0.170:38427 with 413.9 MB RAM, BlockManagerId(driver, 10.10.0.170, 38427, None)
19/04/23 18:46:04 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, 10.10.0.170, 38427, None)
19/04/23 18:46:04 INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, 10.10.0.170, 38427, None)
19/04/23 18:46:04 INFO SharedState: Warehouse path is 'file:/home/ec2-user/spark-2.1.0-bin-spark-lambda-2.1.0/spark-warehouse/'.
19/04/23 18:46:04 INFO deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS
19/04/23 18:46:05 INFO SparkContext: Starting job: reduce at SparkPi.scala:38
19/04/23 18:46:05 INFO DAGScheduler: Got job 0 (reduce at SparkPi.scala:38) with 100 output partitions
19/04/23 18:46:05 INFO DAGScheduler: Final stage: ResultStage 0 (reduce at SparkPi.scala:38)
19/04/23 18:46:05 INFO DAGScheduler: Parents of final stage: List()
19/04/23 18:46:05 INFO DAGScheduler: Missing parents: List()
19/04/23 18:46:05 INFO DAGScheduler: Submitting ResultStage 0 (MapPartitionsRDD[1] at map at SparkPi.scala:34), which has no missing parents
19/04/23 18:46:05 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 1832.0 B, free 413.9 MB)
19/04/23 18:46:05 INFO DiskBlockManager: Creating a dir s3://achin-dev/tmp/executor-driver-eca4b200-a312-4531-bf9c-533be87d3be7/0e
19/04/23 18:46:05 INFO DiskBlockManager: Creating a dir 0e
19/04/23 18:46:05 INFO S3AFileSystem: Initializing S3A FileSystem...
19/04/23 18:46:06 INFO S3AFileSystem: Using credentials from keys provided
19/04/23 18:46:08 INFO S3AFileSystem: S3AFileSystem{uri=s3://achin-dev, workingDir=s3://achin-dev/user/ec2-user, bucket=achin-dev, partSize=104857600, multiPartThreshold=2147483647, enableMultiObjectsDelete=true, maxEntriesToDelete=1000, requesterPaysEnabled=false, listObjectsV2Enabled=false, fastUploadEnabled=true, readAhead=262144, blockSize=67108864, serverSideEncryptionAlgorithm=NONE, maxPagingKeys=5000, useAwsKms=false, awsKmsCmkId=, minThreads=15, maxThreads=256, queueSize=256000, maxConnections=1000, bucketToEndpointMap=null, cannedAcl=null}
19/04/23 18:46:08 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1172.0 B, free 413.9 MB)
19/04/23 18:46:08 INFO DiskBlockManager: Creating a dir s3://achin-dev/tmp/executor-driver-eca4b200-a312-4531-bf9c-533be87d3be7/11
19/04/23 18:46:08 INFO DiskBlockManager: Creating a dir 11
19/04/23 18:46:08 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on 10.10.0.170:38427 (size: 1172.0 B, free: 413.9 MB)
19/04/23 18:46:08 INFO SparkContext: Created broadcast 0 from broadcast at DAGScheduler.scala:996
19/04/23 18:46:08 INFO DAGScheduler: Submitting 100 missing tasks from ResultStage 0 (MapPartitionsRDD[1] at map at SparkPi.scala:34)
19/04/23 18:46:08 INFO TaskSchedulerImpl: Adding task set 0.0 with 100 tasks
19/04/23 18:46:08 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, localhost, executor driver, partition 0, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:09 INFO Executor: Running task 0.0 in stage 0.0 (TID 0)
19/04/23 18:46:09 INFO Executor: Fetching spark://10.10.0.170:34496/jars/scopt_2.11-3.3.0.jar with timestamp 1556045164170
19/04/23 18:46:09 INFO TransportClientFactory: Successfully created connection to /10.10.0.170:34496 after 80 ms (0 ms spent in bootstraps)
19/04/23 18:46:09 INFO Utils: Fetching spark://10.10.0.170:34496/jars/scopt_2.11-3.3.0.jar to /tmp/spark-802ccecf-d6c4-4e12-8481-a252bfdf62cc/userFiles-3df42b96-2847-4e0b-83c4-f65464cf06c4/fetchFileTemp2073735232182357819.tmp
19/04/23 18:46:09 INFO Executor: Adding file:/tmp/spark-802ccecf-d6c4-4e12-8481-a252bfdf62cc/userFiles-3df42b96-2847-4e0b-83c4-f65464cf06c4/scopt_2.11-3.3.0.jar to class loader
19/04/23 18:46:09 INFO Executor: Fetching spark://10.10.0.170:34496/jars/spark-examples_2.11-2.1.0.jar with timestamp 1556045164171
19/04/23 18:46:09 INFO Utils: Fetching spark://10.10.0.170:34496/jars/spark-examples_2.11-2.1.0.jar to /tmp/spark-802ccecf-d6c4-4e12-8481-a252bfdf62cc/userFiles-3df42b96-2847-4e0b-83c4-f65464cf06c4/fetchFileTemp4485021690179484655.tmp
19/04/23 18:46:09 INFO Executor: Adding file:/tmp/spark-802ccecf-d6c4-4e12-8481-a252bfdf62cc/userFiles-3df42b96-2847-4e0b-83c4-f65464cf06c4/spark-examples_2.11-2.1.0.jar to class loader
19/04/23 18:46:09 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 1201 bytes result sent to driver
19/04/23 18:46:09 INFO TaskSetManager: Starting task 1.0 in stage 0.0 (TID 1, localhost, executor driver, partition 1, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:09 INFO Executor: Running task 1.0 in stage 0.0 (TID 1)
19/04/23 18:46:09 INFO Executor: Finished task 1.0 in stage 0.0 (TID 1). 1041 bytes result sent to driver
19/04/23 18:46:09 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 681 ms on localhost (executor driver) (1/100)
19/04/23 18:46:09 INFO TaskSetManager: Starting task 2.0 in stage 0.0 (TID 2, localhost, executor driver, partition 2, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:09 INFO Executor: Running task 2.0 in stage 0.0 (TID 2)
19/04/23 18:46:09 INFO TaskSetManager: Finished task 1.0 in stage 0.0 (TID 1) in 91 ms on localhost (executor driver) (2/100)
19/04/23 18:46:09 INFO Executor: Finished task 2.0 in stage 0.0 (TID 2). 1041 bytes result sent to driver
19/04/23 18:46:09 INFO TaskSetManager: Starting task 3.0 in stage 0.0 (TID 3, localhost, executor driver, partition 3, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:09 INFO Executor: Running task 3.0 in stage 0.0 (TID 3)
19/04/23 18:46:09 INFO TaskSetManager: Finished task 2.0 in stage 0.0 (TID 2) in 50 ms on localhost (executor driver) (3/100)
19/04/23 18:46:09 INFO Executor: Finished task 3.0 in stage 0.0 (TID 3). 1201 bytes result sent to driver
19/04/23 18:46:09 INFO TaskSetManager: Starting task 4.0 in stage 0.0 (TID 4, localhost, executor driver, partition 4, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:09 INFO Executor: Running task 4.0 in stage 0.0 (TID 4)
19/04/23 18:46:09 INFO Executor: Finished task 4.0 in stage 0.0 (TID 4). 1041 bytes result sent to driver
19/04/23 18:46:09 INFO TaskSetManager: Starting task 5.0 in stage 0.0 (TID 5, localhost, executor driver, partition 5, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:09 INFO TaskSetManager: Finished task 4.0 in stage 0.0 (TID 4) in 32 ms on localhost (executor driver) (4/100)
19/04/23 18:46:09 INFO TaskSetManager: Finished task 3.0 in stage 0.0 (TID 3) in 66 ms on localhost (executor driver) (5/100)
19/04/23 18:46:09 INFO Executor: Running task 5.0 in stage 0.0 (TID 5)
19/04/23 18:46:09 INFO Executor: Finished task 5.0 in stage 0.0 (TID 5). 1041 bytes result sent to driver
19/04/23 18:46:09 INFO TaskSetManager: Starting task 6.0 in stage 0.0 (TID 6, localhost, executor driver, partition 6, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:09 INFO TaskSetManager: Finished task 5.0 in stage 0.0 (TID 5) in 26 ms on localhost (executor driver) (6/100)
19/04/23 18:46:09 INFO Executor: Running task 6.0 in stage 0.0 (TID 6)
19/04/23 18:46:09 INFO Executor: Finished task 6.0 in stage 0.0 (TID 6). 1041 bytes result sent to driver
19/04/23 18:46:09 INFO TaskSetManager: Starting task 7.0 in stage 0.0 (TID 7, localhost, executor driver, partition 7, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:09 INFO TaskSetManager: Finished task 6.0 in stage 0.0 (TID 6) in 30 ms on localhost (executor driver) (7/100)
19/04/23 18:46:09 INFO Executor: Running task 7.0 in stage 0.0 (TID 7)
19/04/23 18:46:09 INFO Executor: Finished task 7.0 in stage 0.0 (TID 7). 1041 bytes result sent to driver
19/04/23 18:46:09 INFO TaskSetManager: Starting task 8.0 in stage 0.0 (TID 8, localhost, executor driver, partition 8, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:09 INFO TaskSetManager: Finished task 7.0 in stage 0.0 (TID 7) in 38 ms on localhost (executor driver) (8/100)
19/04/23 18:46:09 INFO Executor: Running task 8.0 in stage 0.0 (TID 8)
19/04/23 18:46:09 INFO Executor: Finished task 8.0 in stage 0.0 (TID 8). 1114 bytes result sent to driver
19/04/23 18:46:09 INFO TaskSetManager: Starting task 9.0 in stage 0.0 (TID 9, localhost, executor driver, partition 9, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:09 INFO TaskSetManager: Finished task 8.0 in stage 0.0 (TID 8) in 39 ms on localhost (executor driver) (9/100)
19/04/23 18:46:09 INFO Executor: Running task 9.0 in stage 0.0 (TID 9)
19/04/23 18:46:09 INFO Executor: Finished task 9.0 in stage 0.0 (TID 9). 1041 bytes result sent to driver
19/04/23 18:46:09 INFO TaskSetManager: Starting task 10.0 in stage 0.0 (TID 10, localhost, executor driver, partition 10, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:09 INFO TaskSetManager: Finished task 9.0 in stage 0.0 (TID 9) in 35 ms on localhost (executor driver) (10/100)
19/04/23 18:46:09 INFO Executor: Running task 10.0 in stage 0.0 (TID 10)
19/04/23 18:46:09 INFO Executor: Finished task 10.0 in stage 0.0 (TID 10). 1041 bytes result sent to driver
19/04/23 18:46:09 INFO TaskSetManager: Starting task 11.0 in stage 0.0 (TID 11, localhost, executor driver, partition 11, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:09 INFO TaskSetManager: Finished task 10.0 in stage 0.0 (TID 10) in 16 ms on localhost (executor driver) (11/100)
19/04/23 18:46:09 INFO Executor: Running task 11.0 in stage 0.0 (TID 11)
19/04/23 18:46:09 INFO Executor: Finished task 11.0 in stage 0.0 (TID 11). 1041 bytes result sent to driver
19/04/23 18:46:09 INFO TaskSetManager: Starting task 12.0 in stage 0.0 (TID 12, localhost, executor driver, partition 12, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:09 INFO TaskSetManager: Finished task 11.0 in stage 0.0 (TID 11) in 42 ms on localhost (executor driver) (12/100)
19/04/23 18:46:09 INFO Executor: Running task 12.0 in stage 0.0 (TID 12)
19/04/23 18:46:09 INFO Executor: Finished task 12.0 in stage 0.0 (TID 12). 1041 bytes result sent to driver
19/04/23 18:46:09 INFO TaskSetManager: Starting task 13.0 in stage 0.0 (TID 13, localhost, executor driver, partition 13, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:09 INFO TaskSetManager: Finished task 12.0 in stage 0.0 (TID 12) in 15 ms on localhost (executor driver) (13/100)
19/04/23 18:46:09 INFO Executor: Running task 13.0 in stage 0.0 (TID 13)
19/04/23 18:46:09 INFO Executor: Finished task 13.0 in stage 0.0 (TID 13). 1114 bytes result sent to driver
19/04/23 18:46:09 INFO TaskSetManager: Starting task 14.0 in stage 0.0 (TID 14, localhost, executor driver, partition 14, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:09 INFO TaskSetManager: Finished task 13.0 in stage 0.0 (TID 13) in 33 ms on localhost (executor driver) (14/100)
19/04/23 18:46:09 INFO Executor: Running task 14.0 in stage 0.0 (TID 14)
19/04/23 18:46:09 INFO Executor: Finished task 14.0 in stage 0.0 (TID 14). 1041 bytes result sent to driver
19/04/23 18:46:09 INFO TaskSetManager: Starting task 15.0 in stage 0.0 (TID 15, localhost, executor driver, partition 15, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:09 INFO TaskSetManager: Finished task 14.0 in stage 0.0 (TID 14) in 23 ms on localhost (executor driver) (15/100)
19/04/23 18:46:09 INFO Executor: Running task 15.0 in stage 0.0 (TID 15)
19/04/23 18:46:10 INFO Executor: Finished task 15.0 in stage 0.0 (TID 15). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 16.0 in stage 0.0 (TID 16, localhost, executor driver, partition 16, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 15.0 in stage 0.0 (TID 15) in 32 ms on localhost (executor driver) (16/100)
19/04/23 18:46:10 INFO Executor: Running task 16.0 in stage 0.0 (TID 16)
19/04/23 18:46:10 INFO Executor: Finished task 16.0 in stage 0.0 (TID 16). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 17.0 in stage 0.0 (TID 17, localhost, executor driver, partition 17, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 16.0 in stage 0.0 (TID 16) in 18 ms on localhost (executor driver) (17/100)
19/04/23 18:46:10 INFO Executor: Running task 17.0 in stage 0.0 (TID 17)
19/04/23 18:46:10 INFO Executor: Finished task 17.0 in stage 0.0 (TID 17). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 18.0 in stage 0.0 (TID 18, localhost, executor driver, partition 18, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 17.0 in stage 0.0 (TID 17) in 17 ms on localhost (executor driver) (18/100)
19/04/23 18:46:10 INFO Executor: Running task 18.0 in stage 0.0 (TID 18)
19/04/23 18:46:10 INFO Executor: Finished task 18.0 in stage 0.0 (TID 18). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 19.0 in stage 0.0 (TID 19, localhost, executor driver, partition 19, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 18.0 in stage 0.0 (TID 18) in 20 ms on localhost (executor driver) (19/100)
19/04/23 18:46:10 INFO Executor: Running task 19.0 in stage 0.0 (TID 19)
19/04/23 18:46:10 INFO Executor: Finished task 19.0 in stage 0.0 (TID 19). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 20.0 in stage 0.0 (TID 20, localhost, executor driver, partition 20, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 19.0 in stage 0.0 (TID 19) in 25 ms on localhost (executor driver) (20/100)
19/04/23 18:46:10 INFO Executor: Running task 20.0 in stage 0.0 (TID 20)
19/04/23 18:46:10 INFO Executor: Finished task 20.0 in stage 0.0 (TID 20). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 21.0 in stage 0.0 (TID 21, localhost, executor driver, partition 21, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 20.0 in stage 0.0 (TID 20) in 20 ms on localhost (executor driver) (21/100)
19/04/23 18:46:10 INFO Executor: Running task 21.0 in stage 0.0 (TID 21)
19/04/23 18:46:10 INFO Executor: Finished task 21.0 in stage 0.0 (TID 21). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 22.0 in stage 0.0 (TID 22, localhost, executor driver, partition 22, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 21.0 in stage 0.0 (TID 21) in 16 ms on localhost (executor driver) (22/100)
19/04/23 18:46:10 INFO Executor: Running task 22.0 in stage 0.0 (TID 22)
19/04/23 18:46:10 INFO Executor: Finished task 22.0 in stage 0.0 (TID 22). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 23.0 in stage 0.0 (TID 23, localhost, executor driver, partition 23, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 22.0 in stage 0.0 (TID 22) in 18 ms on localhost (executor driver) (23/100)
19/04/23 18:46:10 INFO Executor: Running task 23.0 in stage 0.0 (TID 23)
19/04/23 18:46:10 INFO Executor: Finished task 23.0 in stage 0.0 (TID 23). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 24.0 in stage 0.0 (TID 24, localhost, executor driver, partition 24, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 23.0 in stage 0.0 (TID 23) in 27 ms on localhost (executor driver) (24/100)
19/04/23 18:46:10 INFO Executor: Running task 24.0 in stage 0.0 (TID 24)
19/04/23 18:46:10 INFO Executor: Finished task 24.0 in stage 0.0 (TID 24). 1114 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 25.0 in stage 0.0 (TID 25, localhost, executor driver, partition 25, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 24.0 in stage 0.0 (TID 24) in 26 ms on localhost (executor driver) (25/100)
19/04/23 18:46:10 INFO Executor: Running task 25.0 in stage 0.0 (TID 25)
19/04/23 18:46:10 INFO Executor: Finished task 25.0 in stage 0.0 (TID 25). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 26.0 in stage 0.0 (TID 26, localhost, executor driver, partition 26, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 25.0 in stage 0.0 (TID 25) in 22 ms on localhost (executor driver) (26/100)
19/04/23 18:46:10 INFO Executor: Running task 26.0 in stage 0.0 (TID 26)
19/04/23 18:46:10 INFO Executor: Finished task 26.0 in stage 0.0 (TID 26). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 27.0 in stage 0.0 (TID 27, localhost, executor driver, partition 27, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 26.0 in stage 0.0 (TID 26) in 21 ms on localhost (executor driver) (27/100)
19/04/23 18:46:10 INFO Executor: Running task 27.0 in stage 0.0 (TID 27)
19/04/23 18:46:10 INFO Executor: Finished task 27.0 in stage 0.0 (TID 27). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 28.0 in stage 0.0 (TID 28, localhost, executor driver, partition 28, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 27.0 in stage 0.0 (TID 27) in 17 ms on localhost (executor driver) (28/100)
19/04/23 18:46:10 INFO Executor: Running task 28.0 in stage 0.0 (TID 28)
19/04/23 18:46:10 INFO Executor: Finished task 28.0 in stage 0.0 (TID 28). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 29.0 in stage 0.0 (TID 29, localhost, executor driver, partition 29, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 28.0 in stage 0.0 (TID 28) in 20 ms on localhost (executor driver) (29/100)
19/04/23 18:46:10 INFO Executor: Running task 29.0 in stage 0.0 (TID 29)
19/04/23 18:46:10 INFO Executor: Finished task 29.0 in stage 0.0 (TID 29). 1027 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 30.0 in stage 0.0 (TID 30, localhost, executor driver, partition 30, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 29.0 in stage 0.0 (TID 29) in 28 ms on localhost (executor driver) (30/100)
19/04/23 18:46:10 INFO Executor: Running task 30.0 in stage 0.0 (TID 30)
19/04/23 18:46:10 INFO Executor: Finished task 30.0 in stage 0.0 (TID 30). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 31.0 in stage 0.0 (TID 31, localhost, executor driver, partition 31, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 30.0 in stage 0.0 (TID 30) in 24 ms on localhost (executor driver) (31/100)
19/04/23 18:46:10 INFO Executor: Running task 31.0 in stage 0.0 (TID 31)
19/04/23 18:46:10 INFO Executor: Finished task 31.0 in stage 0.0 (TID 31). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 32.0 in stage 0.0 (TID 32, localhost, executor driver, partition 32, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 31.0 in stage 0.0 (TID 31) in 22 ms on localhost (executor driver) (32/100)
19/04/23 18:46:10 INFO Executor: Running task 32.0 in stage 0.0 (TID 32)
19/04/23 18:46:10 INFO Executor: Finished task 32.0 in stage 0.0 (TID 32). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 33.0 in stage 0.0 (TID 33, localhost, executor driver, partition 33, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 32.0 in stage 0.0 (TID 32) in 24 ms on localhost (executor driver) (33/100)
19/04/23 18:46:10 INFO Executor: Running task 33.0 in stage 0.0 (TID 33)
19/04/23 18:46:10 INFO Executor: Finished task 33.0 in stage 0.0 (TID 33). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 34.0 in stage 0.0 (TID 34, localhost, executor driver, partition 34, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 33.0 in stage 0.0 (TID 33) in 26 ms on localhost (executor driver) (34/100)
19/04/23 18:46:10 INFO Executor: Running task 34.0 in stage 0.0 (TID 34)
19/04/23 18:46:10 INFO Executor: Finished task 34.0 in stage 0.0 (TID 34). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 35.0 in stage 0.0 (TID 35, localhost, executor driver, partition 35, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 34.0 in stage 0.0 (TID 34) in 29 ms on localhost (executor driver) (35/100)
19/04/23 18:46:10 INFO Executor: Running task 35.0 in stage 0.0 (TID 35)
19/04/23 18:46:10 INFO Executor: Finished task 35.0 in stage 0.0 (TID 35). 1114 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 36.0 in stage 0.0 (TID 36, localhost, executor driver, partition 36, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 35.0 in stage 0.0 (TID 35) in 14 ms on localhost (executor driver) (36/100)
19/04/23 18:46:10 INFO Executor: Running task 36.0 in stage 0.0 (TID 36)
19/04/23 18:46:10 INFO Executor: Finished task 36.0 in stage 0.0 (TID 36). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 37.0 in stage 0.0 (TID 37, localhost, executor driver, partition 37, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 36.0 in stage 0.0 (TID 36) in 22 ms on localhost (executor driver) (37/100)
19/04/23 18:46:10 INFO Executor: Running task 37.0 in stage 0.0 (TID 37)
19/04/23 18:46:10 INFO Executor: Finished task 37.0 in stage 0.0 (TID 37). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 38.0 in stage 0.0 (TID 38, localhost, executor driver, partition 38, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 37.0 in stage 0.0 (TID 37) in 26 ms on localhost (executor driver) (38/100)
19/04/23 18:46:10 INFO Executor: Running task 38.0 in stage 0.0 (TID 38)
19/04/23 18:46:10 INFO Executor: Finished task 38.0 in stage 0.0 (TID 38). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 39.0 in stage 0.0 (TID 39, localhost, executor driver, partition 39, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 38.0 in stage 0.0 (TID 38) in 13 ms on localhost (executor driver) (39/100)
19/04/23 18:46:10 INFO Executor: Running task 39.0 in stage 0.0 (TID 39)
19/04/23 18:46:10 INFO Executor: Finished task 39.0 in stage 0.0 (TID 39). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 40.0 in stage 0.0 (TID 40, localhost, executor driver, partition 40, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 39.0 in stage 0.0 (TID 39) in 23 ms on localhost (executor driver) (40/100)
19/04/23 18:46:10 INFO Executor: Running task 40.0 in stage 0.0 (TID 40)
19/04/23 18:46:10 INFO Executor: Finished task 40.0 in stage 0.0 (TID 40). 1114 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 41.0 in stage 0.0 (TID 41, localhost, executor driver, partition 41, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 40.0 in stage 0.0 (TID 40) in 26 ms on localhost (executor driver) (41/100)
19/04/23 18:46:10 INFO Executor: Running task 41.0 in stage 0.0 (TID 41)
19/04/23 18:46:10 INFO Executor: Finished task 41.0 in stage 0.0 (TID 41). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 42.0 in stage 0.0 (TID 42, localhost, executor driver, partition 42, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 41.0 in stage 0.0 (TID 41) in 21 ms on localhost (executor driver) (42/100)
19/04/23 18:46:10 INFO Executor: Running task 42.0 in stage 0.0 (TID 42)
19/04/23 18:46:10 INFO Executor: Finished task 42.0 in stage 0.0 (TID 42). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 43.0 in stage 0.0 (TID 43, localhost, executor driver, partition 43, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 42.0 in stage 0.0 (TID 42) in 18 ms on localhost (executor driver) (43/100)
19/04/23 18:46:10 INFO Executor: Running task 43.0 in stage 0.0 (TID 43)
19/04/23 18:46:10 INFO Executor: Finished task 43.0 in stage 0.0 (TID 43). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 44.0 in stage 0.0 (TID 44, localhost, executor driver, partition 44, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 43.0 in stage 0.0 (TID 43) in 26 ms on localhost (executor driver) (44/100)
19/04/23 18:46:10 INFO Executor: Running task 44.0 in stage 0.0 (TID 44)
19/04/23 18:46:10 INFO Executor: Finished task 44.0 in stage 0.0 (TID 44). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 45.0 in stage 0.0 (TID 45, localhost, executor driver, partition 45, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 44.0 in stage 0.0 (TID 44) in 21 ms on localhost (executor driver) (45/100)
19/04/23 18:46:10 INFO Executor: Running task 45.0 in stage 0.0 (TID 45)
19/04/23 18:46:10 INFO Executor: Finished task 45.0 in stage 0.0 (TID 45). 1114 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 46.0 in stage 0.0 (TID 46, localhost, executor driver, partition 46, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 45.0 in stage 0.0 (TID 45) in 25 ms on localhost (executor driver) (46/100)
19/04/23 18:46:10 INFO Executor: Running task 46.0 in stage 0.0 (TID 46)
19/04/23 18:46:10 INFO Executor: Finished task 46.0 in stage 0.0 (TID 46). 954 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 47.0 in stage 0.0 (TID 47, localhost, executor driver, partition 47, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 46.0 in stage 0.0 (TID 46) in 11 ms on localhost (executor driver) (47/100)
19/04/23 18:46:10 INFO Executor: Running task 47.0 in stage 0.0 (TID 47)
19/04/23 18:46:10 INFO Executor: Finished task 47.0 in stage 0.0 (TID 47). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 48.0 in stage 0.0 (TID 48, localhost, executor driver, partition 48, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 47.0 in stage 0.0 (TID 47) in 24 ms on localhost (executor driver) (48/100)
19/04/23 18:46:10 INFO Executor: Running task 48.0 in stage 0.0 (TID 48)
19/04/23 18:46:10 INFO Executor: Finished task 48.0 in stage 0.0 (TID 48). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 49.0 in stage 0.0 (TID 49, localhost, executor driver, partition 49, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 48.0 in stage 0.0 (TID 48) in 14 ms on localhost (executor driver) (49/100)
19/04/23 18:46:10 INFO Executor: Running task 49.0 in stage 0.0 (TID 49)
19/04/23 18:46:10 INFO Executor: Finished task 49.0 in stage 0.0 (TID 49). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 50.0 in stage 0.0 (TID 50, localhost, executor driver, partition 50, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 49.0 in stage 0.0 (TID 49) in 22 ms on localhost (executor driver) (50/100)
19/04/23 18:46:10 INFO Executor: Running task 50.0 in stage 0.0 (TID 50)
19/04/23 18:46:10 INFO Executor: Finished task 50.0 in stage 0.0 (TID 50). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 51.0 in stage 0.0 (TID 51, localhost, executor driver, partition 51, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 50.0 in stage 0.0 (TID 50) in 22 ms on localhost (executor driver) (51/100)
19/04/23 18:46:10 INFO Executor: Running task 51.0 in stage 0.0 (TID 51)
19/04/23 18:46:10 INFO Executor: Finished task 51.0 in stage 0.0 (TID 51). 1114 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 52.0 in stage 0.0 (TID 52, localhost, executor driver, partition 52, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 51.0 in stage 0.0 (TID 51) in 25 ms on localhost (executor driver) (52/100)
19/04/23 18:46:10 INFO Executor: Running task 52.0 in stage 0.0 (TID 52)
19/04/23 18:46:10 INFO Executor: Finished task 52.0 in stage 0.0 (TID 52). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 53.0 in stage 0.0 (TID 53, localhost, executor driver, partition 53, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 52.0 in stage 0.0 (TID 52) in 11 ms on localhost (executor driver) (53/100)
19/04/23 18:46:10 INFO Executor: Running task 53.0 in stage 0.0 (TID 53)
19/04/23 18:46:10 INFO Executor: Finished task 53.0 in stage 0.0 (TID 53). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 54.0 in stage 0.0 (TID 54, localhost, executor driver, partition 54, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 53.0 in stage 0.0 (TID 53) in 22 ms on localhost (executor driver) (54/100)
19/04/23 18:46:10 INFO Executor: Running task 54.0 in stage 0.0 (TID 54)
19/04/23 18:46:10 INFO Executor: Finished task 54.0 in stage 0.0 (TID 54). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 55.0 in stage 0.0 (TID 55, localhost, executor driver, partition 55, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 54.0 in stage 0.0 (TID 54) in 12 ms on localhost (executor driver) (55/100)
19/04/23 18:46:10 INFO Executor: Running task 55.0 in stage 0.0 (TID 55)
19/04/23 18:46:10 INFO Executor: Finished task 55.0 in stage 0.0 (TID 55). 954 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 56.0 in stage 0.0 (TID 56, localhost, executor driver, partition 56, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 55.0 in stage 0.0 (TID 55) in 22 ms on localhost (executor driver) (56/100)
19/04/23 18:46:10 INFO Executor: Running task 56.0 in stage 0.0 (TID 56)
19/04/23 18:46:10 INFO Executor: Finished task 56.0 in stage 0.0 (TID 56). 1114 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 57.0 in stage 0.0 (TID 57, localhost, executor driver, partition 57, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 56.0 in stage 0.0 (TID 56) in 25 ms on localhost (executor driver) (57/100)
19/04/23 18:46:10 INFO Executor: Running task 57.0 in stage 0.0 (TID 57)
19/04/23 18:46:10 INFO Executor: Finished task 57.0 in stage 0.0 (TID 57). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 58.0 in stage 0.0 (TID 58, localhost, executor driver, partition 58, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 57.0 in stage 0.0 (TID 57) in 10 ms on localhost (executor driver) (58/100)
19/04/23 18:46:10 INFO Executor: Running task 58.0 in stage 0.0 (TID 58)
19/04/23 18:46:10 INFO Executor: Finished task 58.0 in stage 0.0 (TID 58). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 59.0 in stage 0.0 (TID 59, localhost, executor driver, partition 59, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 58.0 in stage 0.0 (TID 58) in 21 ms on localhost (executor driver) (59/100)
19/04/23 18:46:10 INFO Executor: Running task 59.0 in stage 0.0 (TID 59)
19/04/23 18:46:10 INFO Executor: Finished task 59.0 in stage 0.0 (TID 59). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 60.0 in stage 0.0 (TID 60, localhost, executor driver, partition 60, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 59.0 in stage 0.0 (TID 59) in 22 ms on localhost (executor driver) (60/100)
19/04/23 18:46:10 INFO Executor: Running task 60.0 in stage 0.0 (TID 60)
19/04/23 18:46:10 INFO Executor: Finished task 60.0 in stage 0.0 (TID 60). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 61.0 in stage 0.0 (TID 61, localhost, executor driver, partition 61, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 60.0 in stage 0.0 (TID 60) in 10 ms on localhost (executor driver) (61/100)
19/04/23 18:46:10 INFO Executor: Running task 61.0 in stage 0.0 (TID 61)
19/04/23 18:46:10 INFO Executor: Finished task 61.0 in stage 0.0 (TID 61). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 62.0 in stage 0.0 (TID 62, localhost, executor driver, partition 62, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 61.0 in stage 0.0 (TID 61) in 21 ms on localhost (executor driver) (62/100)
19/04/23 18:46:10 INFO Executor: Running task 62.0 in stage 0.0 (TID 62)
19/04/23 18:46:10 INFO Executor: Finished task 62.0 in stage 0.0 (TID 62). 1114 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 63.0 in stage 0.0 (TID 63, localhost, executor driver, partition 63, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 62.0 in stage 0.0 (TID 62) in 27 ms on localhost (executor driver) (63/100)
19/04/23 18:46:10 INFO Executor: Running task 63.0 in stage 0.0 (TID 63)
19/04/23 18:46:10 INFO Executor: Finished task 63.0 in stage 0.0 (TID 63). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 64.0 in stage 0.0 (TID 64, localhost, executor driver, partition 64, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 63.0 in stage 0.0 (TID 63) in 11 ms on localhost (executor driver) (64/100)
19/04/23 18:46:10 INFO Executor: Running task 64.0 in stage 0.0 (TID 64)
19/04/23 18:46:10 INFO Executor: Finished task 64.0 in stage 0.0 (TID 64). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 65.0 in stage 0.0 (TID 65, localhost, executor driver, partition 65, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 64.0 in stage 0.0 (TID 64) in 23 ms on localhost (executor driver) (65/100)
19/04/23 18:46:10 INFO Executor: Running task 65.0 in stage 0.0 (TID 65)
19/04/23 18:46:10 INFO Executor: Finished task 65.0 in stage 0.0 (TID 65). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 66.0 in stage 0.0 (TID 66, localhost, executor driver, partition 66, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 65.0 in stage 0.0 (TID 65) in 21 ms on localhost (executor driver) (66/100)
19/04/23 18:46:10 INFO Executor: Running task 66.0 in stage 0.0 (TID 66)
19/04/23 18:46:10 INFO Executor: Finished task 66.0 in stage 0.0 (TID 66). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 67.0 in stage 0.0 (TID 67, localhost, executor driver, partition 67, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 66.0 in stage 0.0 (TID 66) in 11 ms on localhost (executor driver) (67/100)
19/04/23 18:46:10 INFO Executor: Running task 67.0 in stage 0.0 (TID 67)
19/04/23 18:46:10 INFO Executor: Finished task 67.0 in stage 0.0 (TID 67). 1114 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 68.0 in stage 0.0 (TID 68, localhost, executor driver, partition 68, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 67.0 in stage 0.0 (TID 67) in 25 ms on localhost (executor driver) (68/100)
19/04/23 18:46:10 INFO Executor: Running task 68.0 in stage 0.0 (TID 68)
19/04/23 18:46:10 INFO Executor: Finished task 68.0 in stage 0.0 (TID 68). 1041 bytes result sent to driver
19/04/23 18:46:10 INFO TaskSetManager: Starting task 69.0 in stage 0.0 (TID 69, localhost, executor driver, partition 69, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:10 INFO TaskSetManager: Finished task 68.0 in stage 0.0 (TID 68) in 20 ms on localhost (executor driver) (69/100)
19/04/23 18:46:10 INFO Executor: Running task 69.0 in stage 0.0 (TID 69)
19/04/23 18:46:11 INFO Executor: Finished task 69.0 in stage 0.0 (TID 69). 1041 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 70.0 in stage 0.0 (TID 70, localhost, executor driver, partition 70, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 69.0 in stage 0.0 (TID 69) in 10 ms on localhost (executor driver) (70/100)
19/04/23 18:46:11 INFO Executor: Running task 70.0 in stage 0.0 (TID 70)
19/04/23 18:46:11 INFO Executor: Finished task 70.0 in stage 0.0 (TID 70). 1041 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 71.0 in stage 0.0 (TID 71, localhost, executor driver, partition 71, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 70.0 in stage 0.0 (TID 70) in 22 ms on localhost (executor driver) (71/100)
19/04/23 18:46:11 INFO Executor: Running task 71.0 in stage 0.0 (TID 71)
19/04/23 18:46:11 INFO Executor: Finished task 71.0 in stage 0.0 (TID 71). 1041 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 72.0 in stage 0.0 (TID 72, localhost, executor driver, partition 72, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 71.0 in stage 0.0 (TID 71) in 23 ms on localhost (executor driver) (72/100)
19/04/23 18:46:11 INFO Executor: Running task 72.0 in stage 0.0 (TID 72)
19/04/23 18:46:11 INFO Executor: Finished task 72.0 in stage 0.0 (TID 72). 1114 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 73.0 in stage 0.0 (TID 73, localhost, executor driver, partition 73, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 72.0 in stage 0.0 (TID 72) in 24 ms on localhost (executor driver) (73/100)
19/04/23 18:46:11 INFO Executor: Running task 73.0 in stage 0.0 (TID 73)
19/04/23 18:46:11 INFO Executor: Finished task 73.0 in stage 0.0 (TID 73). 1041 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 74.0 in stage 0.0 (TID 74, localhost, executor driver, partition 74, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 73.0 in stage 0.0 (TID 73) in 12 ms on localhost (executor driver) (74/100)
19/04/23 18:46:11 INFO Executor: Running task 74.0 in stage 0.0 (TID 74)
19/04/23 18:46:11 INFO Executor: Finished task 74.0 in stage 0.0 (TID 74). 1041 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 75.0 in stage 0.0 (TID 75, localhost, executor driver, partition 75, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 74.0 in stage 0.0 (TID 74) in 23 ms on localhost (executor driver) (75/100)
19/04/23 18:46:11 INFO Executor: Running task 75.0 in stage 0.0 (TID 75)
19/04/23 18:46:11 INFO Executor: Finished task 75.0 in stage 0.0 (TID 75). 954 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 76.0 in stage 0.0 (TID 76, localhost, executor driver, partition 76, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 75.0 in stage 0.0 (TID 75) in 12 ms on localhost (executor driver) (76/100)
19/04/23 18:46:11 INFO Executor: Running task 76.0 in stage 0.0 (TID 76)
19/04/23 18:46:11 INFO Executor: Finished task 76.0 in stage 0.0 (TID 76). 1041 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 77.0 in stage 0.0 (TID 77, localhost, executor driver, partition 77, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 76.0 in stage 0.0 (TID 76) in 22 ms on localhost (executor driver) (77/100)
19/04/23 18:46:11 INFO Executor: Running task 77.0 in stage 0.0 (TID 77)
19/04/23 18:46:11 INFO Executor: Finished task 77.0 in stage 0.0 (TID 77). 1041 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 78.0 in stage 0.0 (TID 78, localhost, executor driver, partition 78, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 77.0 in stage 0.0 (TID 77) in 22 ms on localhost (executor driver) (78/100)
19/04/23 18:46:11 INFO Executor: Running task 78.0 in stage 0.0 (TID 78)
19/04/23 18:46:11 INFO Executor: Finished task 78.0 in stage 0.0 (TID 78). 1114 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 79.0 in stage 0.0 (TID 79, localhost, executor driver, partition 79, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 78.0 in stage 0.0 (TID 78) in 29 ms on localhost (executor driver) (79/100)
19/04/23 18:46:11 INFO Executor: Running task 79.0 in stage 0.0 (TID 79)
19/04/23 18:46:11 INFO Executor: Finished task 79.0 in stage 0.0 (TID 79). 1041 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 80.0 in stage 0.0 (TID 80, localhost, executor driver, partition 80, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 79.0 in stage 0.0 (TID 79) in 9 ms on localhost (executor driver) (80/100)
19/04/23 18:46:11 INFO Executor: Running task 80.0 in stage 0.0 (TID 80)
19/04/23 18:46:11 INFO Executor: Finished task 80.0 in stage 0.0 (TID 80). 1041 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 81.0 in stage 0.0 (TID 81, localhost, executor driver, partition 81, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 80.0 in stage 0.0 (TID 80) in 23 ms on localhost (executor driver) (81/100)
19/04/23 18:46:11 INFO Executor: Running task 81.0 in stage 0.0 (TID 81)
19/04/23 18:46:11 INFO Executor: Finished task 81.0 in stage 0.0 (TID 81). 1041 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 82.0 in stage 0.0 (TID 82, localhost, executor driver, partition 82, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 81.0 in stage 0.0 (TID 81) in 13 ms on localhost (executor driver) (82/100)
19/04/23 18:46:11 INFO Executor: Running task 82.0 in stage 0.0 (TID 82)
19/04/23 18:46:11 INFO Executor: Finished task 82.0 in stage 0.0 (TID 82). 1041 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 83.0 in stage 0.0 (TID 83, localhost, executor driver, partition 83, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 82.0 in stage 0.0 (TID 82) in 22 ms on localhost (executor driver) (83/100)
19/04/23 18:46:11 INFO Executor: Running task 83.0 in stage 0.0 (TID 83)
19/04/23 18:46:11 INFO Executor: Finished task 83.0 in stage 0.0 (TID 83). 1114 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 84.0 in stage 0.0 (TID 84, localhost, executor driver, partition 84, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 83.0 in stage 0.0 (TID 83) in 24 ms on localhost (executor driver) (84/100)
19/04/23 18:46:11 INFO Executor: Running task 84.0 in stage 0.0 (TID 84)
19/04/23 18:46:11 INFO Executor: Finished task 84.0 in stage 0.0 (TID 84). 1128 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 85.0 in stage 0.0 (TID 85, localhost, executor driver, partition 85, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 84.0 in stage 0.0 (TID 84) in 22 ms on localhost (executor driver) (85/100)
19/04/23 18:46:11 INFO Executor: Running task 85.0 in stage 0.0 (TID 85)
19/04/23 18:46:11 INFO Executor: Finished task 85.0 in stage 0.0 (TID 85). 1041 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 86.0 in stage 0.0 (TID 86, localhost, executor driver, partition 86, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 85.0 in stage 0.0 (TID 85) in 17 ms on localhost (executor driver) (86/100)
19/04/23 18:46:11 INFO Executor: Running task 86.0 in stage 0.0 (TID 86)
19/04/23 18:46:11 INFO Executor: Finished task 86.0 in stage 0.0 (TID 86). 1041 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 87.0 in stage 0.0 (TID 87, localhost, executor driver, partition 87, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 86.0 in stage 0.0 (TID 86) in 23 ms on localhost (executor driver) (87/100)
19/04/23 18:46:11 INFO Executor: Running task 87.0 in stage 0.0 (TID 87)
19/04/23 18:46:11 INFO Executor: Finished task 87.0 in stage 0.0 (TID 87). 1041 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 88.0 in stage 0.0 (TID 88, localhost, executor driver, partition 88, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 87.0 in stage 0.0 (TID 87) in 23 ms on localhost (executor driver) (88/100)
19/04/23 18:46:11 INFO Executor: Running task 88.0 in stage 0.0 (TID 88)
19/04/23 18:46:11 INFO Executor: Finished task 88.0 in stage 0.0 (TID 88). 1041 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 89.0 in stage 0.0 (TID 89, localhost, executor driver, partition 89, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 88.0 in stage 0.0 (TID 88) in 14 ms on localhost (executor driver) (89/100)
19/04/23 18:46:11 INFO Executor: Running task 89.0 in stage 0.0 (TID 89)
19/04/23 18:46:11 INFO Executor: Finished task 89.0 in stage 0.0 (TID 89). 1128 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 90.0 in stage 0.0 (TID 90, localhost, executor driver, partition 90, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 89.0 in stage 0.0 (TID 89) in 25 ms on localhost (executor driver) (90/100)
19/04/23 18:46:11 INFO Executor: Running task 90.0 in stage 0.0 (TID 90)
19/04/23 18:46:11 INFO Executor: Finished task 90.0 in stage 0.0 (TID 90). 1041 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 91.0 in stage 0.0 (TID 91, localhost, executor driver, partition 91, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 90.0 in stage 0.0 (TID 90) in 21 ms on localhost (executor driver) (91/100)
19/04/23 18:46:11 INFO Executor: Running task 91.0 in stage 0.0 (TID 91)
19/04/23 18:46:11 INFO Executor: Finished task 91.0 in stage 0.0 (TID 91). 1041 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 92.0 in stage 0.0 (TID 92, localhost, executor driver, partition 92, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 91.0 in stage 0.0 (TID 91) in 9 ms on localhost (executor driver) (92/100)
19/04/23 18:46:11 INFO Executor: Running task 92.0 in stage 0.0 (TID 92)
19/04/23 18:46:11 INFO Executor: Finished task 92.0 in stage 0.0 (TID 92). 1041 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 93.0 in stage 0.0 (TID 93, localhost, executor driver, partition 93, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 92.0 in stage 0.0 (TID 92) in 21 ms on localhost (executor driver) (93/100)
19/04/23 18:46:11 INFO Executor: Running task 93.0 in stage 0.0 (TID 93)
19/04/23 18:46:11 INFO Executor: Finished task 93.0 in stage 0.0 (TID 93). 1041 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 94.0 in stage 0.0 (TID 94, localhost, executor driver, partition 94, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 93.0 in stage 0.0 (TID 93) in 10 ms on localhost (executor driver) (94/100)
19/04/23 18:46:11 INFO Executor: Running task 94.0 in stage 0.0 (TID 94)
19/04/23 18:46:11 INFO Executor: Finished task 94.0 in stage 0.0 (TID 94). 1027 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 95.0 in stage 0.0 (TID 95, localhost, executor driver, partition 95, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 94.0 in stage 0.0 (TID 94) in 26 ms on localhost (executor driver) (95/100)
19/04/23 18:46:11 INFO Executor: Running task 95.0 in stage 0.0 (TID 95)
19/04/23 18:46:11 INFO Executor: Finished task 95.0 in stage 0.0 (TID 95). 1041 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 96.0 in stage 0.0 (TID 96, localhost, executor driver, partition 96, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 95.0 in stage 0.0 (TID 95) in 22 ms on localhost (executor driver) (96/100)
19/04/23 18:46:11 INFO Executor: Running task 96.0 in stage 0.0 (TID 96)
19/04/23 18:46:11 INFO Executor: Finished task 96.0 in stage 0.0 (TID 96). 1041 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 97.0 in stage 0.0 (TID 97, localhost, executor driver, partition 97, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 96.0 in stage 0.0 (TID 96) in 12 ms on localhost (executor driver) (97/100)
19/04/23 18:46:11 INFO Executor: Running task 97.0 in stage 0.0 (TID 97)
19/04/23 18:46:11 INFO Executor: Finished task 97.0 in stage 0.0 (TID 97). 954 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 98.0 in stage 0.0 (TID 98, localhost, executor driver, partition 98, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 97.0 in stage 0.0 (TID 97) in 20 ms on localhost (executor driver) (98/100)
19/04/23 18:46:11 INFO Executor: Running task 98.0 in stage 0.0 (TID 98)
19/04/23 18:46:11 INFO Executor: Finished task 98.0 in stage 0.0 (TID 98). 954 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Starting task 99.0 in stage 0.0 (TID 99, localhost, executor driver, partition 99, PROCESS_LOCAL, 6084 bytes)
19/04/23 18:46:11 INFO TaskSetManager: Finished task 98.0 in stage 0.0 (TID 98) in 19 ms on localhost (executor driver) (99/100)
19/04/23 18:46:11 INFO Executor: Running task 99.0 in stage 0.0 (TID 99)
19/04/23 18:46:11 INFO Executor: Finished task 99.0 in stage 0.0 (TID 99). 1114 bytes result sent to driver
19/04/23 18:46:11 INFO TaskSetManager: Finished task 99.0 in stage 0.0 (TID 99) in 23 ms on localhost (executor driver) (100/100)
19/04/23 18:46:11 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool 
19/04/23 18:46:11 INFO DAGScheduler: ResultStage 0 (reduce at SparkPi.scala:38) finished in 2.683 s
19/04/23 18:46:11 INFO DAGScheduler: Job 0 finished: reduce at SparkPi.scala:38, took 6.230047 s
Pi is roughly 3.1419567141956715
19/04/23 18:46:11 INFO SparkUI: Stopped Spark web UI at http://10.10.0.170:4040
19/04/23 18:46:11 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
19/04/23 18:46:11 INFO MemoryStore: MemoryStore cleared
19/04/23 18:46:11 INFO BlockManager: BlockManager stopped
19/04/23 18:46:11 INFO BlockManagerMaster: BlockManagerMaster stopped
19/04/23 18:46:11 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
19/04/23 18:46:11 INFO SparkContext: Successfully stopped SparkContext
19/04/23 18:46:11 INFO ShutdownHookManager: Shutdown hook called
19/04/23 18:46:11 INFO ShutdownHookManager: Deleting directory /tmp/spark-802ccecf-d6c4-4e12-8481-a252bfdf62cc