Orbiter History

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 28.088072ms target: https://us1.storj.io/login FAIL (2025-08-08 05:29:13 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 28.113045ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 1.179479664s FAIL (2025-08-08 05:29:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.179498282s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 198.182846ms FAIL (2025-08-08 05:29:08 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== uestItem_ObjectCommit Aug 8 04:42:16.180307652 (19h2m50.695410219s) [upload=19671]: Done uploading segments... Aug 8 04:42:16.180326351 (19h2m50.695428913s) [upload=19671]: Upload finished. err: <nil> Aug 8 04:42:41.083579476 (19h3m15.598682039s) [upload=19678]: Starting upload Aug 8 04:42:41.083658806 (19h3m15.598761384s) [upload=19678]: Done starting upload Aug 8 04:42:41.083736126 (19h3m15.598838696s) [upload=19678]: Uploading segments... Aug 8 04:42:41.083798735 (19h3m15.59890132s) [upload=19678]: Got next segment. Inline: true Aug 8 04:42:41.083805351 (19h3m15.598907934s) [upload=19678]: Waiting for error group managing segments... Aug 8 04:42:41.083894019 (19h3m15.598996595s) [upload=19678]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:42:41.083899702 (19h3m15.599002278s) [upload=19678]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:42:41.083903543 (19h3m15.59900612s) [upload=19678]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:42:41.147259315 (19h3m15.662361882s) [upload=19678]: Done uploading segments... Aug 8 04:42:41.147276213 (19h3m15.66237879s) [upload=19678]: Upload finished. err: <nil> Aug 8 04:43:54.314265905 (19h4m28.829368481s) [upload=19696]: Starting upload Aug 8 04:43:54.314342572 (19h4m28.829445149s) [upload=19696]: Done starting upload Aug 8 04:43:54.314412786 (19h4m28.829515355s) [upload=19696]: Uploading segments... Aug 8 04:43:54.314461737 (19h4m28.829564323s) [upload=19696]: Got next segment. Inline: true Aug 8 04:43:54.314468588 (19h4m28.829571166s) [upload=19696]: Waiting for error group managing segments... Aug 8 04:43:54.314513835 (19h4m28.829616411s) [upload=19696]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:43:54.314518357 (19h4m28.829620933s) [upload=19696]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:43:54.314521699 (19h4m28.829624275s) [upload=19696]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:43:54.374490000 (19h4m28.889592577s) [upload=19696]: Done uploading segments... Aug 8 04:43:54.374507640 (19h4m28.889610205s) [upload=19696]: Upload finished. err: <nil> Aug 8 04:44:37.820610246 (19h5m12.335712815s) [upload=19708]: Starting upload Aug 8 04:44:37.820681721 (19h5m12.335784288s) [upload=19708]: Done starting upload Aug 8 04:44:37.820750998 (19h5m12.335853567s) [upload=19708]: Uploading segments... Aug 8 04:44:37.820847572 (19h5m12.335950158s) [upload=19708]: Got next segment. Inline: true Aug 8 04:44:37.820871197 (19h5m12.335973778s) [upload=19708]: Waiting for error group managing segments... Aug 8 04:44:37.820923988 (19h5m12.336026577s) [upload=19708]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:44:37.820930149 (19h5m12.33603273s) [upload=19708]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:44:37.820950094 (19h5m12.336052671s) [upload=19708]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:44:37.891304392 (19h5m12.406406974s) [upload=19708]: Done uploading segments... Aug 8 04:44:37.891324719 (19h5m12.406427302s) [upload=19708]: Upload finished. err: <nil> Aug 8 04:45:49.374287050 (19h6m23.889389635s) [upload=19727]: Starting upload Aug 8 04:45:49.374385480 (19h6m23.889488062s) [upload=19727]: Done starting upload Aug 8 04:45:49.374485186 (19h6m23.889587763s) [upload=19727]: Uploading segments... Aug 8 04:45:49.374553702 (19h6m23.889656288s) [upload=19727]: Got next segment. Inline: true Aug 8 04:45:49.374559271 (19h6m23.889661849s) [upload=19727]: Waiting for error group managing segments... Aug 8 04:45:49.374607801 (19h6m23.889710384s) [upload=19727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:45:49.374613021 (19h6m23.889715604s) [upload=19727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:45:49.374616970 (19h6m23.889719552s) [upload=19727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:45:49.440532379 (19h6m23.955634956s) [upload=19727]: Done uploading segments... Aug 8 04:45:49.440553942 (19h6m23.955656506s) [upload=19727]: Upload finished. err: <nil> Aug 8 04:46:22.148691181 (19h6m56.663793758s) [upload=19736]: Starting upload Aug 8 04:46:22.148731264 (19h6m56.66383385s) [upload=19736]: Done starting upload Aug 8 04:46:22.148779839 (19h6m56.663882416s) [upload=19736]: Uploading segments... Aug 8 04:46:22.148815522 (19h6m56.663918108s) [upload=19736]: Got next segment. Inline: true Aug 8 04:46:22.148819611 (19h6m56.663922186s) [upload=19736]: Waiting for error group managing segments... Aug 8 04:46:22.148853347 (19h6m56.663955925s) [upload=19736]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:46:22.148856905 (19h6m56.663959481s) [upload=19736]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:46:22.148859219 (19h6m56.663961798s) [upload=19736]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:46:22.224160590 (19h6m56.739263173s) [upload=19736]: Done uploading segments... Aug 8 04:46:22.224183380 (19h6m56.739285958s) [upload=19736]: Upload finished. err: <nil> Aug 8 04:46:57.599668727 (19h7m32.114771304s) [upload=19750]: Starting upload Aug 8 04:46:57.599733716 (19h7m32.114836292s) [upload=19750]: Done starting upload Aug 8 04:46:57.599831148 (19h7m32.114933716s) [upload=19750]: Uploading segments... Aug 8 04:46:57.599898194 (19h7m32.115000774s) [upload=19750]: Got next segment. Inline: true Aug 8 04:46:57.599902995 (19h7m32.115005571s) [upload=19750]: Waiting for error group managing segments... Aug 8 04:46:57.599955730 (19h7m32.115058297s) [upload=19750]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:46:57.599960210 (19h7m32.115062786s) [upload=19750]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:46:57.599963339 (19h7m32.115065916s) [upload=19750]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:46:57.661947764 (19h7m32.17705034s) [upload=19750]: Done uploading segments... Aug 8 04:46:57.661964723 (19h7m32.1770673s) [upload=19750]: Upload finished. err: <nil> Aug 8 04:48:07.498218136 (19h8m42.013320702s) [upload=19766]: Starting upload Aug 8 04:48:07.498272608 (19h8m42.013375174s) [upload=19766]: Done starting upload Aug 8 04:48:07.498340076 (19h8m42.013442642s) [upload=19766]: Uploading segments... Aug 8 04:48:07.498377092 (19h8m42.013479678s) [upload=19766]: Got next segment. Inline: true Aug 8 04:48:07.498381514 (19h8m42.013484091s) [upload=19766]: Waiting for error group managing segments... Aug 8 04:48:07.498422115 (19h8m42.013524681s) [upload=19766]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:48:07.498426401 (19h8m42.013528979s) [upload=19766]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:48:07.498429474 (19h8m42.01353205s) [upload=19766]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:48:07.573834459 (19h8m42.088937036s) [upload=19766]: Done uploading segments... Aug 8 04:48:07.573849292 (19h8m42.088951861s) [upload=19766]: Upload finished. err: <nil> Aug 8 04:48:24.131081943 (19h8m58.646184521s) [upload=19773]: Starting upload Aug 8 04:48:24.131135304 (19h8m58.646237872s) [upload=19773]: Done starting upload Aug 8 04:48:24.131203832 (19h8m58.646306401s) [upload=19773]: Uploading segments... Aug 8 04:48:24.131242000 (19h8m58.646344585s) [upload=19773]: Got next segment. Inline: true Aug 8 04:48:24.131246356 (19h8m58.646348932s) [upload=19773]: Waiting for error group managing segments... Aug 8 04:48:24.131298903 (19h8m58.646401482s) [upload=19773]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:48:24.131304610 (19h8m58.646407189s) [upload=19773]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:48:24.131307703 (19h8m58.646410279s) [upload=19773]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:48:24.189165262 (19h8m58.704267839s) [upload=19773]: Done uploading segments... Aug 8 04:48:24.189182600 (19h8m58.704285176s) [upload=19773]: Upload finished. err: <nil> Aug 8 04:49:30.179743426 (19h10m4.69484601s) [upload=19792]: Starting upload Aug 8 04:49:30.179830624 (19h10m4.694933205s) [upload=19792]: Done starting upload Aug 8 04:49:30.179932276 (19h10m4.695034844s) [upload=19792]: Uploading segments... Aug 8 04:49:30.180011264 (19h10m4.69511385s) [upload=19792]: Got next segment. Inline: true Aug 8 04:49:30.180031508 (19h10m4.695134094s) [upload=19792]: Waiting for error group managing segments... Aug 8 04:49:30.180083780 (19h10m4.695186362s) [upload=19792]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:49:30.180089451 (19h10m4.695192035s) [upload=19792]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:49:30.180107234 (19h10m4.695209811s) [upload=19792]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:49:30.255066803 (19h10m4.770169372s) [upload=19792]: Done uploading segments... Aug 8 04:49:30.255097834 (19h10m4.770200412s) [upload=19792]: Upload finished. err: <nil> Aug 8 04:49:49.722537438 (19h10m24.237640014s) [upload=19800]: Starting upload Aug 8 04:49:49.722597342 (19h10m24.237699917s) [upload=19800]: Done starting upload Aug 8 04:49:49.722664052 (19h10m24.237766615s) [upload=19800]: Uploading segments... Aug 8 04:49:49.722715327 (19h10m24.23781791s) [upload=19800]: Got next segment. Inline: true Aug 8 04:49:49.722719940 (19h10m24.237822515s) [upload=19800]: Waiting for error group managing segments... Aug 8 04:49:49.722753934 (19h10m24.23785651s) [upload=19800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:49:49.722758369 (19h10m24.237860931s) [upload=19800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:49:49.722815656 (19h10m24.237918234s) [upload=19800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:49:49.824454883 (19h10m24.339557452s) [upload=19800]: Done uploading segments... Aug 8 04:49:49.824470680 (19h10m24.339573247s) [upload=19800]: Upload finished. err: <nil> Duration: 198.231503ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [................................X..........X............X...] duration: 398.441635ms FAIL (2025-08-08 05:29:07 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 47s) [upload=20448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:26:50.904739727 (19h47m25.419842305s) [upload=20448]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:26:50.944882452 (19h47m25.459985035s) [seg_pos={0 0}, upload=20448]: Begin upload segment... Aug 8 05:26:50.945011026 (19h47m25.460113615s) [noise=true , address=104.36.82.46:4499 , piece_id=LFAGIFKLABXXQPM4GPWODPCGYF5ZHIR3BWCQ6SZXDG6AI7EHJTTQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.945383247 (19h47m25.460485843s) [seg_pos={0 0}, upload=20448]: Done begin upload segment. Aug 8 05:26:50.945414178 (19h47m25.460516765s) [noise=true , address=104.36.82.16:4311 , piece_id=OLZR27VUDBCKGY42PZ5WTNIAU5STAWTHSBYZUZ6DAKMLXTGB3ADA, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.945650124 (19h47m25.460752691s) [noise=true , address=64.49.13.155:4913 , piece_id=ELZYJRJ5CR255T3TVDYASWE77EYU74EHSBHGS4L4R4UUHCIJEN3A, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.946353978 (19h47m25.461456567s) [noise=true , address=104.36.82.2:4744 , piece_id=KMD6CPC2SQKLIYCZYK54OFS2KOIH7IV7RDRC3FCVBKF5HRW26NKQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.946423301 (19h47m25.461525877s) [noise=true , address=104.36.82.60:4344 , piece_id=ZOI42ZMPOXK6SC4L7VNTDKJ7EUT7VYPHAUMG6Y3YA5V3NWF6I2JQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.946801022 (19h47m25.461903599s) [noise=true , address=104.36.82.47:4528 , piece_id=EW47FZA76DRQ62Y54OWQIZ7GUZXTJBZ3RZEGLUJKR6HLPDT4IWJQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.947126369 (19h47m25.462228946s) [noise=true , address=104.36.82.44:4901 , piece_id=WBP43PZDBEIN3C6QKY6OHVLWJ7TUJ2BW5DOWSFZ7WOTPICRWFV7A, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.947615054 (19h47m25.462717642s) [noise=true , address=104.36.82.38:4721 , piece_id=RWAVMCG65CWILHWSKXDN5EGLB4KCWQ3E5T2ZAVTKHE2ISWXNZRNQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.947988368 (19h47m25.463090935s) [noise=true , address=104.36.82.62:4413 , piece_id=BGCRMU6TUGIC6HF6IYXOXOGP4IMFJ7THTOKJLRJQIVKP5I75DWUA, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.948347124 (19h47m25.463449701s) [noise=true , address=64.49.13.169:4715 , piece_id=FWDPNSY7M3YAA5DDJFDV2N2VN26JMIMEJLPMI54Z7NKTTYHRXQKA, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.948617355 (19h47m25.463719921s) [noise=true , address=104.36.82.45:4933 , piece_id=COT4SGPHUGM2SZZV44IALVRKFECAK6MWF42WTI7GRXT7BX4WR6VA, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.948917256 (19h47m25.464019832s) [noise=true , address=104.36.82.44:4889 , piece_id=5ZBL5EIFT7VFM7WA6ZTGYBOCL4OJIX4ZKTC4OBFTE3IE2OSTURCQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.949189805 (19h47m25.464292384s) [noise=true , address=45.91.116.6:4001 , piece_id=6RXM6KZQP7IPZDBFVPRCYAT6AK6LHNXNOZIQ2IOFR4K4R4AF35PA, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.951453376 (19h47m25.466555956s) [noise=true , address=64.49.13.170:4724 , piece_id=35RD5PPN2JEIICVPK36SRN6CS3XYT32FFXGKRVEMZAQRFEAVLUZQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.951882862 (19h47m25.466985447s) [noise=true , address=104.36.82.36:4629 , piece_id=JX7CXW7ZVOI6L56ZFW6GCGVHCRWRNWTT5TTF7PZ63SFXD3PKJOGQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.955442371 (19h47m25.470544959s) [noise=true , address=104.36.82.37:4665 , piece_id=RGHW5JKFR2MBO46P3COM2CP7WKAT43JIKPGRENTXZ6FLBL2GLKIA, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.956057025 (19h47m25.471159612s) [noise=true , address=64.49.13.154:4935 , piece_id=VLIIMXGGIOB6FTZZSYG4AEHM5TEHJA5YMLOSSZGMUDOEN7TFUFTQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.956425213 (19h47m25.471527795s) [noise=true , address=104.36.82.59:4327 , piece_id=SURF5YCUDCKJJRE3DIIVH4VK4VUDTAIEAO3EV4M4LBDUHIVYR5TQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:51.046613449 (19h47m25.561716012s) [upload=20448]: Next returned nil segment Aug 8 05:26:51.046634869 (19h47m25.561737432s) [upload=20448]: Waiting for error group managing segments... Aug 8 05:26:51.056698912 (19h47m25.57180149s) [noise=true , address=45.91.116.6:4001 , piece_id=6RXM6KZQP7IPZDBFVPRCYAT6AK6LHNXNOZIQ2IOFR4K4R4AF35PA, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.057335285 (19h47m25.572437848s) [noise=true , address=104.36.82.62:4413 , piece_id=BGCRMU6TUGIC6HF6IYXOXOGP4IMFJ7THTOKJLRJQIVKP5I75DWUA, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.058658577 (19h47m25.573761165s) [noise=true , address=104.36.82.38:4721 , piece_id=RWAVMCG65CWILHWSKXDN5EGLB4KCWQ3E5T2ZAVTKHE2ISWXNZRNQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.060732252 (19h47m25.575834829s) [noise=true , address=104.36.82.36:4629 , piece_id=JX7CXW7ZVOI6L56ZFW6GCGVHCRWRNWTT5TTF7PZ63SFXD3PKJOGQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.060838294 (19h47m25.575940862s) [noise=true , address=104.36.82.44:4901 , piece_id=WBP43PZDBEIN3C6QKY6OHVLWJ7TUJ2BW5DOWSFZ7WOTPICRWFV7A, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.061115678 (19h47m25.576218256s) [noise=true , address=104.36.82.47:4528 , piece_id=EW47FZA76DRQ62Y54OWQIZ7GUZXTJBZ3RZEGLUJKR6HLPDT4IWJQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.061497341 (19h47m25.576599904s) [noise=true , address=104.36.82.44:4889 , piece_id=5ZBL5EIFT7VFM7WA6ZTGYBOCL4OJIX4ZKTC4OBFTE3IE2OSTURCQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.062320455 (19h47m25.577423025s) [noise=true , address=104.36.82.45:4933 , piece_id=COT4SGPHUGM2SZZV44IALVRKFECAK6MWF42WTI7GRXT7BX4WR6VA, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.062471953 (19h47m25.577574524s) [noise=true , address=104.36.82.37:4665 , piece_id=RGHW5JKFR2MBO46P3COM2CP7WKAT43JIKPGRENTXZ6FLBL2GLKIA, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.063867488 (19h47m25.578970057s) [noise=true , address=104.36.82.16:4311 , piece_id=OLZR27VUDBCKGY42PZ5WTNIAU5STAWTHSBYZUZ6DAKMLXTGB3ADA, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.065523830 (19h47m25.580626404s) [noise=true , address=104.36.82.2:4744 , piece_id=KMD6CPC2SQKLIYCZYK54OFS2KOIH7IV7RDRC3FCVBKF5HRW26NKQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.065919623 (19h47m25.5810222s) [noise=true , address=104.36.82.60:4344 , piece_id=ZOI42ZMPOXK6SC4L7VNTDKJ7EUT7VYPHAUMG6Y3YA5V3NWF6I2JQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.066265440 (19h47m25.581368009s) [noise=true , address=104.36.82.59:4327 , piece_id=SURF5YCUDCKJJRE3DIIVH4VK4VUDTAIEAO3EV4M4LBDUHIVYR5TQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.135080005 (19h47m25.650182575s) [noise=true , address=104.36.82.46:4499 , piece_id=LFAGIFKLABXXQPM4GPWODPCGYF5ZHIR3BWCQ6SZXDG6AI7EHJTTQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.135104617 (19h47m25.650207204s) [seg_pos={0 0}, upload=20448]: Segment reached optimal threshold of 14 pieces. Aug 8 05:26:51.135531464 (19h47m25.650634039s) [noise=true , address=64.49.13.155:4913 , piece_id=ELZYJRJ5CR255T3TVDYASWE77EYU74EHSBHGS4L4R4UUHCIJEN3A, seg_pos={0 0}, upload=20448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oyYUnWDyFo1npaKpBxMG5K31oUzJnTpcU1XHFmKux3MCVUPZV): protocol: read tcp 159.223.143.39:50950->64.49.13.155:4913: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:26:51.135612946 (19h47m25.650715521s) [noise=true , address=64.49.13.154:4935 , piece_id=VLIIMXGGIOB6FTZZSYG4AEHM5TEHJA5YMLOSSZGMUDOEN7TFUFTQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GZpRx4CMfeRa5nUrXmBaTUxcRVfLkx6v4StbcVyWpVqeuZdfk): protocol: read tcp 159.223.143.39:51524->64.49.13.154:4935: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:26:51.135689355 (19h47m25.650791931s) [noise=true , address=64.49.13.170:4724 , piece_id=35RD5PPN2JEIICVPK36SRN6CS3XYT32FFXGKRVEMZAQRFEAVLUZQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: read tcp 159.223.143.39:39110->64.49.13.170:4724: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:26:51.135718537 (19h47m25.650821107s) [noise=true , address=64.49.13.169:4715 , piece_id=FWDPNSY7M3YAA5DDJFDV2N2VN26JMIMEJLPMI54Z7NKTTYHRXQKA, seg_pos={0 0}, upload=20448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: read tcp 159.223.143.39:47790->64.49.13.169:4715: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:26:51.135739210 (19h47m25.650841786s) [seg_pos={0 0}, upload=20448]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:26:51.135832384 (19h47m25.65093496s) [upload=20448]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:26:51.135837284 (19h47m25.65093986s) [upload=20448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:26:51.200754247 (19h47m25.715856827s) [upload=20448]: Done uploading segments... Aug 8 05:26:51.200777999 (19h47m25.715880579s) [upload=20448]: Upload finished. err: <nil> Duration: 398.465606ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................................X..........X............X..] duration: 394.177789ms FAIL (2025-08-08 05:28:51 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 47s) [upload=20448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:26:50.904739727 (19h47m25.419842305s) [upload=20448]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:26:50.944882452 (19h47m25.459985035s) [seg_pos={0 0}, upload=20448]: Begin upload segment... Aug 8 05:26:50.945011026 (19h47m25.460113615s) [noise=true , address=104.36.82.46:4499 , piece_id=LFAGIFKLABXXQPM4GPWODPCGYF5ZHIR3BWCQ6SZXDG6AI7EHJTTQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.945383247 (19h47m25.460485843s) [seg_pos={0 0}, upload=20448]: Done begin upload segment. Aug 8 05:26:50.945414178 (19h47m25.460516765s) [noise=true , address=104.36.82.16:4311 , piece_id=OLZR27VUDBCKGY42PZ5WTNIAU5STAWTHSBYZUZ6DAKMLXTGB3ADA, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.945650124 (19h47m25.460752691s) [noise=true , address=64.49.13.155:4913 , piece_id=ELZYJRJ5CR255T3TVDYASWE77EYU74EHSBHGS4L4R4UUHCIJEN3A, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.946353978 (19h47m25.461456567s) [noise=true , address=104.36.82.2:4744 , piece_id=KMD6CPC2SQKLIYCZYK54OFS2KOIH7IV7RDRC3FCVBKF5HRW26NKQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.946423301 (19h47m25.461525877s) [noise=true , address=104.36.82.60:4344 , piece_id=ZOI42ZMPOXK6SC4L7VNTDKJ7EUT7VYPHAUMG6Y3YA5V3NWF6I2JQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.946801022 (19h47m25.461903599s) [noise=true , address=104.36.82.47:4528 , piece_id=EW47FZA76DRQ62Y54OWQIZ7GUZXTJBZ3RZEGLUJKR6HLPDT4IWJQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.947126369 (19h47m25.462228946s) [noise=true , address=104.36.82.44:4901 , piece_id=WBP43PZDBEIN3C6QKY6OHVLWJ7TUJ2BW5DOWSFZ7WOTPICRWFV7A, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.947615054 (19h47m25.462717642s) [noise=true , address=104.36.82.38:4721 , piece_id=RWAVMCG65CWILHWSKXDN5EGLB4KCWQ3E5T2ZAVTKHE2ISWXNZRNQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.947988368 (19h47m25.463090935s) [noise=true , address=104.36.82.62:4413 , piece_id=BGCRMU6TUGIC6HF6IYXOXOGP4IMFJ7THTOKJLRJQIVKP5I75DWUA, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.948347124 (19h47m25.463449701s) [noise=true , address=64.49.13.169:4715 , piece_id=FWDPNSY7M3YAA5DDJFDV2N2VN26JMIMEJLPMI54Z7NKTTYHRXQKA, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.948617355 (19h47m25.463719921s) [noise=true , address=104.36.82.45:4933 , piece_id=COT4SGPHUGM2SZZV44IALVRKFECAK6MWF42WTI7GRXT7BX4WR6VA, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.948917256 (19h47m25.464019832s) [noise=true , address=104.36.82.44:4889 , piece_id=5ZBL5EIFT7VFM7WA6ZTGYBOCL4OJIX4ZKTC4OBFTE3IE2OSTURCQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.949189805 (19h47m25.464292384s) [noise=true , address=45.91.116.6:4001 , piece_id=6RXM6KZQP7IPZDBFVPRCYAT6AK6LHNXNOZIQ2IOFR4K4R4AF35PA, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.951453376 (19h47m25.466555956s) [noise=true , address=64.49.13.170:4724 , piece_id=35RD5PPN2JEIICVPK36SRN6CS3XYT32FFXGKRVEMZAQRFEAVLUZQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.951882862 (19h47m25.466985447s) [noise=true , address=104.36.82.36:4629 , piece_id=JX7CXW7ZVOI6L56ZFW6GCGVHCRWRNWTT5TTF7PZ63SFXD3PKJOGQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.955442371 (19h47m25.470544959s) [noise=true , address=104.36.82.37:4665 , piece_id=RGHW5JKFR2MBO46P3COM2CP7WKAT43JIKPGRENTXZ6FLBL2GLKIA, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.956057025 (19h47m25.471159612s) [noise=true , address=64.49.13.154:4935 , piece_id=VLIIMXGGIOB6FTZZSYG4AEHM5TEHJA5YMLOSSZGMUDOEN7TFUFTQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.956425213 (19h47m25.471527795s) [noise=true , address=104.36.82.59:4327 , piece_id=SURF5YCUDCKJJRE3DIIVH4VK4VUDTAIEAO3EV4M4LBDUHIVYR5TQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:51.046613449 (19h47m25.561716012s) [upload=20448]: Next returned nil segment Aug 8 05:26:51.046634869 (19h47m25.561737432s) [upload=20448]: Waiting for error group managing segments... Aug 8 05:26:51.056698912 (19h47m25.57180149s) [noise=true , address=45.91.116.6:4001 , piece_id=6RXM6KZQP7IPZDBFVPRCYAT6AK6LHNXNOZIQ2IOFR4K4R4AF35PA, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.057335285 (19h47m25.572437848s) [noise=true , address=104.36.82.62:4413 , piece_id=BGCRMU6TUGIC6HF6IYXOXOGP4IMFJ7THTOKJLRJQIVKP5I75DWUA, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.058658577 (19h47m25.573761165s) [noise=true , address=104.36.82.38:4721 , piece_id=RWAVMCG65CWILHWSKXDN5EGLB4KCWQ3E5T2ZAVTKHE2ISWXNZRNQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.060732252 (19h47m25.575834829s) [noise=true , address=104.36.82.36:4629 , piece_id=JX7CXW7ZVOI6L56ZFW6GCGVHCRWRNWTT5TTF7PZ63SFXD3PKJOGQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.060838294 (19h47m25.575940862s) [noise=true , address=104.36.82.44:4901 , piece_id=WBP43PZDBEIN3C6QKY6OHVLWJ7TUJ2BW5DOWSFZ7WOTPICRWFV7A, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.061115678 (19h47m25.576218256s) [noise=true , address=104.36.82.47:4528 , piece_id=EW47FZA76DRQ62Y54OWQIZ7GUZXTJBZ3RZEGLUJKR6HLPDT4IWJQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.061497341 (19h47m25.576599904s) [noise=true , address=104.36.82.44:4889 , piece_id=5ZBL5EIFT7VFM7WA6ZTGYBOCL4OJIX4ZKTC4OBFTE3IE2OSTURCQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.062320455 (19h47m25.577423025s) [noise=true , address=104.36.82.45:4933 , piece_id=COT4SGPHUGM2SZZV44IALVRKFECAK6MWF42WTI7GRXT7BX4WR6VA, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.062471953 (19h47m25.577574524s) [noise=true , address=104.36.82.37:4665 , piece_id=RGHW5JKFR2MBO46P3COM2CP7WKAT43JIKPGRENTXZ6FLBL2GLKIA, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.063867488 (19h47m25.578970057s) [noise=true , address=104.36.82.16:4311 , piece_id=OLZR27VUDBCKGY42PZ5WTNIAU5STAWTHSBYZUZ6DAKMLXTGB3ADA, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.065523830 (19h47m25.580626404s) [noise=true , address=104.36.82.2:4744 , piece_id=KMD6CPC2SQKLIYCZYK54OFS2KOIH7IV7RDRC3FCVBKF5HRW26NKQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.065919623 (19h47m25.5810222s) [noise=true , address=104.36.82.60:4344 , piece_id=ZOI42ZMPOXK6SC4L7VNTDKJ7EUT7VYPHAUMG6Y3YA5V3NWF6I2JQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.066265440 (19h47m25.581368009s) [noise=true , address=104.36.82.59:4327 , piece_id=SURF5YCUDCKJJRE3DIIVH4VK4VUDTAIEAO3EV4M4LBDUHIVYR5TQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.135080005 (19h47m25.650182575s) [noise=true , address=104.36.82.46:4499 , piece_id=LFAGIFKLABXXQPM4GPWODPCGYF5ZHIR3BWCQ6SZXDG6AI7EHJTTQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.135104617 (19h47m25.650207204s) [seg_pos={0 0}, upload=20448]: Segment reached optimal threshold of 14 pieces. Aug 8 05:26:51.135531464 (19h47m25.650634039s) [noise=true , address=64.49.13.155:4913 , piece_id=ELZYJRJ5CR255T3TVDYASWE77EYU74EHSBHGS4L4R4UUHCIJEN3A, seg_pos={0 0}, upload=20448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oyYUnWDyFo1npaKpBxMG5K31oUzJnTpcU1XHFmKux3MCVUPZV): protocol: read tcp 159.223.143.39:50950->64.49.13.155:4913: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:26:51.135612946 (19h47m25.650715521s) [noise=true , address=64.49.13.154:4935 , piece_id=VLIIMXGGIOB6FTZZSYG4AEHM5TEHJA5YMLOSSZGMUDOEN7TFUFTQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GZpRx4CMfeRa5nUrXmBaTUxcRVfLkx6v4StbcVyWpVqeuZdfk): protocol: read tcp 159.223.143.39:51524->64.49.13.154:4935: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:26:51.135689355 (19h47m25.650791931s) [noise=true , address=64.49.13.170:4724 , piece_id=35RD5PPN2JEIICVPK36SRN6CS3XYT32FFXGKRVEMZAQRFEAVLUZQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: read tcp 159.223.143.39:39110->64.49.13.170:4724: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:26:51.135718537 (19h47m25.650821107s) [noise=true , address=64.49.13.169:4715 , piece_id=FWDPNSY7M3YAA5DDJFDV2N2VN26JMIMEJLPMI54Z7NKTTYHRXQKA, seg_pos={0 0}, upload=20448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: read tcp 159.223.143.39:47790->64.49.13.169:4715: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:26:51.135739210 (19h47m25.650841786s) [seg_pos={0 0}, upload=20448]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:26:51.135832384 (19h47m25.65093496s) [upload=20448]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:26:51.135837284 (19h47m25.65093986s) [upload=20448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:26:51.200754247 (19h47m25.715856827s) [upload=20448]: Done uploading segments... Aug 8 05:26:51.200777999 (19h47m25.715880579s) [upload=20448]: Upload finished. err: <nil> Duration: 394.206741ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 42.195887ms target: https://us1.storj.io/login FAIL (2025-08-08 05:28:51 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 42.218242ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 452.276866ms FAIL (2025-08-08 05:28:48 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== uestItem_ObjectCommit Aug 8 04:42:16.180307652 (19h2m50.695410219s) [upload=19671]: Done uploading segments... Aug 8 04:42:16.180326351 (19h2m50.695428913s) [upload=19671]: Upload finished. err: <nil> Aug 8 04:42:41.083579476 (19h3m15.598682039s) [upload=19678]: Starting upload Aug 8 04:42:41.083658806 (19h3m15.598761384s) [upload=19678]: Done starting upload Aug 8 04:42:41.083736126 (19h3m15.598838696s) [upload=19678]: Uploading segments... Aug 8 04:42:41.083798735 (19h3m15.59890132s) [upload=19678]: Got next segment. Inline: true Aug 8 04:42:41.083805351 (19h3m15.598907934s) [upload=19678]: Waiting for error group managing segments... Aug 8 04:42:41.083894019 (19h3m15.598996595s) [upload=19678]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:42:41.083899702 (19h3m15.599002278s) [upload=19678]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:42:41.083903543 (19h3m15.59900612s) [upload=19678]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:42:41.147259315 (19h3m15.662361882s) [upload=19678]: Done uploading segments... Aug 8 04:42:41.147276213 (19h3m15.66237879s) [upload=19678]: Upload finished. err: <nil> Aug 8 04:43:54.314265905 (19h4m28.829368481s) [upload=19696]: Starting upload Aug 8 04:43:54.314342572 (19h4m28.829445149s) [upload=19696]: Done starting upload Aug 8 04:43:54.314412786 (19h4m28.829515355s) [upload=19696]: Uploading segments... Aug 8 04:43:54.314461737 (19h4m28.829564323s) [upload=19696]: Got next segment. Inline: true Aug 8 04:43:54.314468588 (19h4m28.829571166s) [upload=19696]: Waiting for error group managing segments... Aug 8 04:43:54.314513835 (19h4m28.829616411s) [upload=19696]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:43:54.314518357 (19h4m28.829620933s) [upload=19696]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:43:54.314521699 (19h4m28.829624275s) [upload=19696]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:43:54.374490000 (19h4m28.889592577s) [upload=19696]: Done uploading segments... Aug 8 04:43:54.374507640 (19h4m28.889610205s) [upload=19696]: Upload finished. err: <nil> Aug 8 04:44:37.820610246 (19h5m12.335712815s) [upload=19708]: Starting upload Aug 8 04:44:37.820681721 (19h5m12.335784288s) [upload=19708]: Done starting upload Aug 8 04:44:37.820750998 (19h5m12.335853567s) [upload=19708]: Uploading segments... Aug 8 04:44:37.820847572 (19h5m12.335950158s) [upload=19708]: Got next segment. Inline: true Aug 8 04:44:37.820871197 (19h5m12.335973778s) [upload=19708]: Waiting for error group managing segments... Aug 8 04:44:37.820923988 (19h5m12.336026577s) [upload=19708]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:44:37.820930149 (19h5m12.33603273s) [upload=19708]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:44:37.820950094 (19h5m12.336052671s) [upload=19708]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:44:37.891304392 (19h5m12.406406974s) [upload=19708]: Done uploading segments... Aug 8 04:44:37.891324719 (19h5m12.406427302s) [upload=19708]: Upload finished. err: <nil> Aug 8 04:45:49.374287050 (19h6m23.889389635s) [upload=19727]: Starting upload Aug 8 04:45:49.374385480 (19h6m23.889488062s) [upload=19727]: Done starting upload Aug 8 04:45:49.374485186 (19h6m23.889587763s) [upload=19727]: Uploading segments... Aug 8 04:45:49.374553702 (19h6m23.889656288s) [upload=19727]: Got next segment. Inline: true Aug 8 04:45:49.374559271 (19h6m23.889661849s) [upload=19727]: Waiting for error group managing segments... Aug 8 04:45:49.374607801 (19h6m23.889710384s) [upload=19727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:45:49.374613021 (19h6m23.889715604s) [upload=19727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:45:49.374616970 (19h6m23.889719552s) [upload=19727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:45:49.440532379 (19h6m23.955634956s) [upload=19727]: Done uploading segments... Aug 8 04:45:49.440553942 (19h6m23.955656506s) [upload=19727]: Upload finished. err: <nil> Aug 8 04:46:22.148691181 (19h6m56.663793758s) [upload=19736]: Starting upload Aug 8 04:46:22.148731264 (19h6m56.66383385s) [upload=19736]: Done starting upload Aug 8 04:46:22.148779839 (19h6m56.663882416s) [upload=19736]: Uploading segments... Aug 8 04:46:22.148815522 (19h6m56.663918108s) [upload=19736]: Got next segment. Inline: true Aug 8 04:46:22.148819611 (19h6m56.663922186s) [upload=19736]: Waiting for error group managing segments... Aug 8 04:46:22.148853347 (19h6m56.663955925s) [upload=19736]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:46:22.148856905 (19h6m56.663959481s) [upload=19736]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:46:22.148859219 (19h6m56.663961798s) [upload=19736]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:46:22.224160590 (19h6m56.739263173s) [upload=19736]: Done uploading segments... Aug 8 04:46:22.224183380 (19h6m56.739285958s) [upload=19736]: Upload finished. err: <nil> Aug 8 04:46:57.599668727 (19h7m32.114771304s) [upload=19750]: Starting upload Aug 8 04:46:57.599733716 (19h7m32.114836292s) [upload=19750]: Done starting upload Aug 8 04:46:57.599831148 (19h7m32.114933716s) [upload=19750]: Uploading segments... Aug 8 04:46:57.599898194 (19h7m32.115000774s) [upload=19750]: Got next segment. Inline: true Aug 8 04:46:57.599902995 (19h7m32.115005571s) [upload=19750]: Waiting for error group managing segments... Aug 8 04:46:57.599955730 (19h7m32.115058297s) [upload=19750]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:46:57.599960210 (19h7m32.115062786s) [upload=19750]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:46:57.599963339 (19h7m32.115065916s) [upload=19750]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:46:57.661947764 (19h7m32.17705034s) [upload=19750]: Done uploading segments... Aug 8 04:46:57.661964723 (19h7m32.1770673s) [upload=19750]: Upload finished. err: <nil> Aug 8 04:48:07.498218136 (19h8m42.013320702s) [upload=19766]: Starting upload Aug 8 04:48:07.498272608 (19h8m42.013375174s) [upload=19766]: Done starting upload Aug 8 04:48:07.498340076 (19h8m42.013442642s) [upload=19766]: Uploading segments... Aug 8 04:48:07.498377092 (19h8m42.013479678s) [upload=19766]: Got next segment. Inline: true Aug 8 04:48:07.498381514 (19h8m42.013484091s) [upload=19766]: Waiting for error group managing segments... Aug 8 04:48:07.498422115 (19h8m42.013524681s) [upload=19766]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:48:07.498426401 (19h8m42.013528979s) [upload=19766]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:48:07.498429474 (19h8m42.01353205s) [upload=19766]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:48:07.573834459 (19h8m42.088937036s) [upload=19766]: Done uploading segments... Aug 8 04:48:07.573849292 (19h8m42.088951861s) [upload=19766]: Upload finished. err: <nil> Aug 8 04:48:24.131081943 (19h8m58.646184521s) [upload=19773]: Starting upload Aug 8 04:48:24.131135304 (19h8m58.646237872s) [upload=19773]: Done starting upload Aug 8 04:48:24.131203832 (19h8m58.646306401s) [upload=19773]: Uploading segments... Aug 8 04:48:24.131242000 (19h8m58.646344585s) [upload=19773]: Got next segment. Inline: true Aug 8 04:48:24.131246356 (19h8m58.646348932s) [upload=19773]: Waiting for error group managing segments... Aug 8 04:48:24.131298903 (19h8m58.646401482s) [upload=19773]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:48:24.131304610 (19h8m58.646407189s) [upload=19773]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:48:24.131307703 (19h8m58.646410279s) [upload=19773]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:48:24.189165262 (19h8m58.704267839s) [upload=19773]: Done uploading segments... Aug 8 04:48:24.189182600 (19h8m58.704285176s) [upload=19773]: Upload finished. err: <nil> Aug 8 04:49:30.179743426 (19h10m4.69484601s) [upload=19792]: Starting upload Aug 8 04:49:30.179830624 (19h10m4.694933205s) [upload=19792]: Done starting upload Aug 8 04:49:30.179932276 (19h10m4.695034844s) [upload=19792]: Uploading segments... Aug 8 04:49:30.180011264 (19h10m4.69511385s) [upload=19792]: Got next segment. Inline: true Aug 8 04:49:30.180031508 (19h10m4.695134094s) [upload=19792]: Waiting for error group managing segments... Aug 8 04:49:30.180083780 (19h10m4.695186362s) [upload=19792]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:49:30.180089451 (19h10m4.695192035s) [upload=19792]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:49:30.180107234 (19h10m4.695209811s) [upload=19792]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:49:30.255066803 (19h10m4.770169372s) [upload=19792]: Done uploading segments... Aug 8 04:49:30.255097834 (19h10m4.770200412s) [upload=19792]: Upload finished. err: <nil> Aug 8 04:49:49.722537438 (19h10m24.237640014s) [upload=19800]: Starting upload Aug 8 04:49:49.722597342 (19h10m24.237699917s) [upload=19800]: Done starting upload Aug 8 04:49:49.722664052 (19h10m24.237766615s) [upload=19800]: Uploading segments... Aug 8 04:49:49.722715327 (19h10m24.23781791s) [upload=19800]: Got next segment. Inline: true Aug 8 04:49:49.722719940 (19h10m24.237822515s) [upload=19800]: Waiting for error group managing segments... Aug 8 04:49:49.722753934 (19h10m24.23785651s) [upload=19800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:49:49.722758369 (19h10m24.237860931s) [upload=19800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:49:49.722815656 (19h10m24.237918234s) [upload=19800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:49:49.824454883 (19h10m24.339557452s) [upload=19800]: Done uploading segments... Aug 8 04:49:49.824470680 (19h10m24.339573247s) [upload=19800]: Upload finished. err: <nil> Duration: 452.30414ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 194.591416ms FAIL (2025-08-08 05:28:27 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== uestItem_ObjectCommit Aug 8 04:42:16.180307652 (19h2m50.695410219s) [upload=19671]: Done uploading segments... Aug 8 04:42:16.180326351 (19h2m50.695428913s) [upload=19671]: Upload finished. err: <nil> Aug 8 04:42:41.083579476 (19h3m15.598682039s) [upload=19678]: Starting upload Aug 8 04:42:41.083658806 (19h3m15.598761384s) [upload=19678]: Done starting upload Aug 8 04:42:41.083736126 (19h3m15.598838696s) [upload=19678]: Uploading segments... Aug 8 04:42:41.083798735 (19h3m15.59890132s) [upload=19678]: Got next segment. Inline: true Aug 8 04:42:41.083805351 (19h3m15.598907934s) [upload=19678]: Waiting for error group managing segments... Aug 8 04:42:41.083894019 (19h3m15.598996595s) [upload=19678]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:42:41.083899702 (19h3m15.599002278s) [upload=19678]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:42:41.083903543 (19h3m15.59900612s) [upload=19678]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:42:41.147259315 (19h3m15.662361882s) [upload=19678]: Done uploading segments... Aug 8 04:42:41.147276213 (19h3m15.66237879s) [upload=19678]: Upload finished. err: <nil> Aug 8 04:43:54.314265905 (19h4m28.829368481s) [upload=19696]: Starting upload Aug 8 04:43:54.314342572 (19h4m28.829445149s) [upload=19696]: Done starting upload Aug 8 04:43:54.314412786 (19h4m28.829515355s) [upload=19696]: Uploading segments... Aug 8 04:43:54.314461737 (19h4m28.829564323s) [upload=19696]: Got next segment. Inline: true Aug 8 04:43:54.314468588 (19h4m28.829571166s) [upload=19696]: Waiting for error group managing segments... Aug 8 04:43:54.314513835 (19h4m28.829616411s) [upload=19696]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:43:54.314518357 (19h4m28.829620933s) [upload=19696]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:43:54.314521699 (19h4m28.829624275s) [upload=19696]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:43:54.374490000 (19h4m28.889592577s) [upload=19696]: Done uploading segments... Aug 8 04:43:54.374507640 (19h4m28.889610205s) [upload=19696]: Upload finished. err: <nil> Aug 8 04:44:37.820610246 (19h5m12.335712815s) [upload=19708]: Starting upload Aug 8 04:44:37.820681721 (19h5m12.335784288s) [upload=19708]: Done starting upload Aug 8 04:44:37.820750998 (19h5m12.335853567s) [upload=19708]: Uploading segments... Aug 8 04:44:37.820847572 (19h5m12.335950158s) [upload=19708]: Got next segment. Inline: true Aug 8 04:44:37.820871197 (19h5m12.335973778s) [upload=19708]: Waiting for error group managing segments... Aug 8 04:44:37.820923988 (19h5m12.336026577s) [upload=19708]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:44:37.820930149 (19h5m12.33603273s) [upload=19708]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:44:37.820950094 (19h5m12.336052671s) [upload=19708]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:44:37.891304392 (19h5m12.406406974s) [upload=19708]: Done uploading segments... Aug 8 04:44:37.891324719 (19h5m12.406427302s) [upload=19708]: Upload finished. err: <nil> Aug 8 04:45:49.374287050 (19h6m23.889389635s) [upload=19727]: Starting upload Aug 8 04:45:49.374385480 (19h6m23.889488062s) [upload=19727]: Done starting upload Aug 8 04:45:49.374485186 (19h6m23.889587763s) [upload=19727]: Uploading segments... Aug 8 04:45:49.374553702 (19h6m23.889656288s) [upload=19727]: Got next segment. Inline: true Aug 8 04:45:49.374559271 (19h6m23.889661849s) [upload=19727]: Waiting for error group managing segments... Aug 8 04:45:49.374607801 (19h6m23.889710384s) [upload=19727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:45:49.374613021 (19h6m23.889715604s) [upload=19727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:45:49.374616970 (19h6m23.889719552s) [upload=19727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:45:49.440532379 (19h6m23.955634956s) [upload=19727]: Done uploading segments... Aug 8 04:45:49.440553942 (19h6m23.955656506s) [upload=19727]: Upload finished. err: <nil> Aug 8 04:46:22.148691181 (19h6m56.663793758s) [upload=19736]: Starting upload Aug 8 04:46:22.148731264 (19h6m56.66383385s) [upload=19736]: Done starting upload Aug 8 04:46:22.148779839 (19h6m56.663882416s) [upload=19736]: Uploading segments... Aug 8 04:46:22.148815522 (19h6m56.663918108s) [upload=19736]: Got next segment. Inline: true Aug 8 04:46:22.148819611 (19h6m56.663922186s) [upload=19736]: Waiting for error group managing segments... Aug 8 04:46:22.148853347 (19h6m56.663955925s) [upload=19736]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:46:22.148856905 (19h6m56.663959481s) [upload=19736]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:46:22.148859219 (19h6m56.663961798s) [upload=19736]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:46:22.224160590 (19h6m56.739263173s) [upload=19736]: Done uploading segments... Aug 8 04:46:22.224183380 (19h6m56.739285958s) [upload=19736]: Upload finished. err: <nil> Aug 8 04:46:57.599668727 (19h7m32.114771304s) [upload=19750]: Starting upload Aug 8 04:46:57.599733716 (19h7m32.114836292s) [upload=19750]: Done starting upload Aug 8 04:46:57.599831148 (19h7m32.114933716s) [upload=19750]: Uploading segments... Aug 8 04:46:57.599898194 (19h7m32.115000774s) [upload=19750]: Got next segment. Inline: true Aug 8 04:46:57.599902995 (19h7m32.115005571s) [upload=19750]: Waiting for error group managing segments... Aug 8 04:46:57.599955730 (19h7m32.115058297s) [upload=19750]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:46:57.599960210 (19h7m32.115062786s) [upload=19750]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:46:57.599963339 (19h7m32.115065916s) [upload=19750]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:46:57.661947764 (19h7m32.17705034s) [upload=19750]: Done uploading segments... Aug 8 04:46:57.661964723 (19h7m32.1770673s) [upload=19750]: Upload finished. err: <nil> Aug 8 04:48:07.498218136 (19h8m42.013320702s) [upload=19766]: Starting upload Aug 8 04:48:07.498272608 (19h8m42.013375174s) [upload=19766]: Done starting upload Aug 8 04:48:07.498340076 (19h8m42.013442642s) [upload=19766]: Uploading segments... Aug 8 04:48:07.498377092 (19h8m42.013479678s) [upload=19766]: Got next segment. Inline: true Aug 8 04:48:07.498381514 (19h8m42.013484091s) [upload=19766]: Waiting for error group managing segments... Aug 8 04:48:07.498422115 (19h8m42.013524681s) [upload=19766]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:48:07.498426401 (19h8m42.013528979s) [upload=19766]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:48:07.498429474 (19h8m42.01353205s) [upload=19766]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:48:07.573834459 (19h8m42.088937036s) [upload=19766]: Done uploading segments... Aug 8 04:48:07.573849292 (19h8m42.088951861s) [upload=19766]: Upload finished. err: <nil> Aug 8 04:48:24.131081943 (19h8m58.646184521s) [upload=19773]: Starting upload Aug 8 04:48:24.131135304 (19h8m58.646237872s) [upload=19773]: Done starting upload Aug 8 04:48:24.131203832 (19h8m58.646306401s) [upload=19773]: Uploading segments... Aug 8 04:48:24.131242000 (19h8m58.646344585s) [upload=19773]: Got next segment. Inline: true Aug 8 04:48:24.131246356 (19h8m58.646348932s) [upload=19773]: Waiting for error group managing segments... Aug 8 04:48:24.131298903 (19h8m58.646401482s) [upload=19773]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:48:24.131304610 (19h8m58.646407189s) [upload=19773]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:48:24.131307703 (19h8m58.646410279s) [upload=19773]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:48:24.189165262 (19h8m58.704267839s) [upload=19773]: Done uploading segments... Aug 8 04:48:24.189182600 (19h8m58.704285176s) [upload=19773]: Upload finished. err: <nil> Aug 8 04:49:30.179743426 (19h10m4.69484601s) [upload=19792]: Starting upload Aug 8 04:49:30.179830624 (19h10m4.694933205s) [upload=19792]: Done starting upload Aug 8 04:49:30.179932276 (19h10m4.695034844s) [upload=19792]: Uploading segments... Aug 8 04:49:30.180011264 (19h10m4.69511385s) [upload=19792]: Got next segment. Inline: true Aug 8 04:49:30.180031508 (19h10m4.695134094s) [upload=19792]: Waiting for error group managing segments... Aug 8 04:49:30.180083780 (19h10m4.695186362s) [upload=19792]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:49:30.180089451 (19h10m4.695192035s) [upload=19792]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:49:30.180107234 (19h10m4.695209811s) [upload=19792]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:49:30.255066803 (19h10m4.770169372s) [upload=19792]: Done uploading segments... Aug 8 04:49:30.255097834 (19h10m4.770200412s) [upload=19792]: Upload finished. err: <nil> Aug 8 04:49:49.722537438 (19h10m24.237640014s) [upload=19800]: Starting upload Aug 8 04:49:49.722597342 (19h10m24.237699917s) [upload=19800]: Done starting upload Aug 8 04:49:49.722664052 (19h10m24.237766615s) [upload=19800]: Uploading segments... Aug 8 04:49:49.722715327 (19h10m24.23781791s) [upload=19800]: Got next segment. Inline: true Aug 8 04:49:49.722719940 (19h10m24.237822515s) [upload=19800]: Waiting for error group managing segments... Aug 8 04:49:49.722753934 (19h10m24.23785651s) [upload=19800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:49:49.722758369 (19h10m24.237860931s) [upload=19800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:49:49.722815656 (19h10m24.237918234s) [upload=19800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:49:49.824454883 (19h10m24.339557452s) [upload=19800]: Done uploading segments... Aug 8 04:49:49.824470680 (19h10m24.339573247s) [upload=19800]: Upload finished. err: <nil> Duration: 194.646157ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 28.546887ms target: https://us1.storj.io/login FAIL (2025-08-08 05:28:26 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 28.572839ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 458.912071ms FAIL (2025-08-08 05:28:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 458.934253ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 209.731317ms FAIL (2025-08-08 05:28:01 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== uestItem_ObjectCommit Aug 8 04:42:16.180307652 (19h2m50.695410219s) [upload=19671]: Done uploading segments... Aug 8 04:42:16.180326351 (19h2m50.695428913s) [upload=19671]: Upload finished. err: <nil> Aug 8 04:42:41.083579476 (19h3m15.598682039s) [upload=19678]: Starting upload Aug 8 04:42:41.083658806 (19h3m15.598761384s) [upload=19678]: Done starting upload Aug 8 04:42:41.083736126 (19h3m15.598838696s) [upload=19678]: Uploading segments... Aug 8 04:42:41.083798735 (19h3m15.59890132s) [upload=19678]: Got next segment. Inline: true Aug 8 04:42:41.083805351 (19h3m15.598907934s) [upload=19678]: Waiting for error group managing segments... Aug 8 04:42:41.083894019 (19h3m15.598996595s) [upload=19678]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:42:41.083899702 (19h3m15.599002278s) [upload=19678]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:42:41.083903543 (19h3m15.59900612s) [upload=19678]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:42:41.147259315 (19h3m15.662361882s) [upload=19678]: Done uploading segments... Aug 8 04:42:41.147276213 (19h3m15.66237879s) [upload=19678]: Upload finished. err: <nil> Aug 8 04:43:54.314265905 (19h4m28.829368481s) [upload=19696]: Starting upload Aug 8 04:43:54.314342572 (19h4m28.829445149s) [upload=19696]: Done starting upload Aug 8 04:43:54.314412786 (19h4m28.829515355s) [upload=19696]: Uploading segments... Aug 8 04:43:54.314461737 (19h4m28.829564323s) [upload=19696]: Got next segment. Inline: true Aug 8 04:43:54.314468588 (19h4m28.829571166s) [upload=19696]: Waiting for error group managing segments... Aug 8 04:43:54.314513835 (19h4m28.829616411s) [upload=19696]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:43:54.314518357 (19h4m28.829620933s) [upload=19696]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:43:54.314521699 (19h4m28.829624275s) [upload=19696]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:43:54.374490000 (19h4m28.889592577s) [upload=19696]: Done uploading segments... Aug 8 04:43:54.374507640 (19h4m28.889610205s) [upload=19696]: Upload finished. err: <nil> Aug 8 04:44:37.820610246 (19h5m12.335712815s) [upload=19708]: Starting upload Aug 8 04:44:37.820681721 (19h5m12.335784288s) [upload=19708]: Done starting upload Aug 8 04:44:37.820750998 (19h5m12.335853567s) [upload=19708]: Uploading segments... Aug 8 04:44:37.820847572 (19h5m12.335950158s) [upload=19708]: Got next segment. Inline: true Aug 8 04:44:37.820871197 (19h5m12.335973778s) [upload=19708]: Waiting for error group managing segments... Aug 8 04:44:37.820923988 (19h5m12.336026577s) [upload=19708]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:44:37.820930149 (19h5m12.33603273s) [upload=19708]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:44:37.820950094 (19h5m12.336052671s) [upload=19708]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:44:37.891304392 (19h5m12.406406974s) [upload=19708]: Done uploading segments... Aug 8 04:44:37.891324719 (19h5m12.406427302s) [upload=19708]: Upload finished. err: <nil> Aug 8 04:45:49.374287050 (19h6m23.889389635s) [upload=19727]: Starting upload Aug 8 04:45:49.374385480 (19h6m23.889488062s) [upload=19727]: Done starting upload Aug 8 04:45:49.374485186 (19h6m23.889587763s) [upload=19727]: Uploading segments... Aug 8 04:45:49.374553702 (19h6m23.889656288s) [upload=19727]: Got next segment. Inline: true Aug 8 04:45:49.374559271 (19h6m23.889661849s) [upload=19727]: Waiting for error group managing segments... Aug 8 04:45:49.374607801 (19h6m23.889710384s) [upload=19727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:45:49.374613021 (19h6m23.889715604s) [upload=19727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:45:49.374616970 (19h6m23.889719552s) [upload=19727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:45:49.440532379 (19h6m23.955634956s) [upload=19727]: Done uploading segments... Aug 8 04:45:49.440553942 (19h6m23.955656506s) [upload=19727]: Upload finished. err: <nil> Aug 8 04:46:22.148691181 (19h6m56.663793758s) [upload=19736]: Starting upload Aug 8 04:46:22.148731264 (19h6m56.66383385s) [upload=19736]: Done starting upload Aug 8 04:46:22.148779839 (19h6m56.663882416s) [upload=19736]: Uploading segments... Aug 8 04:46:22.148815522 (19h6m56.663918108s) [upload=19736]: Got next segment. Inline: true Aug 8 04:46:22.148819611 (19h6m56.663922186s) [upload=19736]: Waiting for error group managing segments... Aug 8 04:46:22.148853347 (19h6m56.663955925s) [upload=19736]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:46:22.148856905 (19h6m56.663959481s) [upload=19736]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:46:22.148859219 (19h6m56.663961798s) [upload=19736]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:46:22.224160590 (19h6m56.739263173s) [upload=19736]: Done uploading segments... Aug 8 04:46:22.224183380 (19h6m56.739285958s) [upload=19736]: Upload finished. err: <nil> Aug 8 04:46:57.599668727 (19h7m32.114771304s) [upload=19750]: Starting upload Aug 8 04:46:57.599733716 (19h7m32.114836292s) [upload=19750]: Done starting upload Aug 8 04:46:57.599831148 (19h7m32.114933716s) [upload=19750]: Uploading segments... Aug 8 04:46:57.599898194 (19h7m32.115000774s) [upload=19750]: Got next segment. Inline: true Aug 8 04:46:57.599902995 (19h7m32.115005571s) [upload=19750]: Waiting for error group managing segments... Aug 8 04:46:57.599955730 (19h7m32.115058297s) [upload=19750]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:46:57.599960210 (19h7m32.115062786s) [upload=19750]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:46:57.599963339 (19h7m32.115065916s) [upload=19750]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:46:57.661947764 (19h7m32.17705034s) [upload=19750]: Done uploading segments... Aug 8 04:46:57.661964723 (19h7m32.1770673s) [upload=19750]: Upload finished. err: <nil> Aug 8 04:48:07.498218136 (19h8m42.013320702s) [upload=19766]: Starting upload Aug 8 04:48:07.498272608 (19h8m42.013375174s) [upload=19766]: Done starting upload Aug 8 04:48:07.498340076 (19h8m42.013442642s) [upload=19766]: Uploading segments... Aug 8 04:48:07.498377092 (19h8m42.013479678s) [upload=19766]: Got next segment. Inline: true Aug 8 04:48:07.498381514 (19h8m42.013484091s) [upload=19766]: Waiting for error group managing segments... Aug 8 04:48:07.498422115 (19h8m42.013524681s) [upload=19766]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:48:07.498426401 (19h8m42.013528979s) [upload=19766]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:48:07.498429474 (19h8m42.01353205s) [upload=19766]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:48:07.573834459 (19h8m42.088937036s) [upload=19766]: Done uploading segments... Aug 8 04:48:07.573849292 (19h8m42.088951861s) [upload=19766]: Upload finished. err: <nil> Aug 8 04:48:24.131081943 (19h8m58.646184521s) [upload=19773]: Starting upload Aug 8 04:48:24.131135304 (19h8m58.646237872s) [upload=19773]: Done starting upload Aug 8 04:48:24.131203832 (19h8m58.646306401s) [upload=19773]: Uploading segments... Aug 8 04:48:24.131242000 (19h8m58.646344585s) [upload=19773]: Got next segment. Inline: true Aug 8 04:48:24.131246356 (19h8m58.646348932s) [upload=19773]: Waiting for error group managing segments... Aug 8 04:48:24.131298903 (19h8m58.646401482s) [upload=19773]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:48:24.131304610 (19h8m58.646407189s) [upload=19773]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:48:24.131307703 (19h8m58.646410279s) [upload=19773]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:48:24.189165262 (19h8m58.704267839s) [upload=19773]: Done uploading segments... Aug 8 04:48:24.189182600 (19h8m58.704285176s) [upload=19773]: Upload finished. err: <nil> Aug 8 04:49:30.179743426 (19h10m4.69484601s) [upload=19792]: Starting upload Aug 8 04:49:30.179830624 (19h10m4.694933205s) [upload=19792]: Done starting upload Aug 8 04:49:30.179932276 (19h10m4.695034844s) [upload=19792]: Uploading segments... Aug 8 04:49:30.180011264 (19h10m4.69511385s) [upload=19792]: Got next segment. Inline: true Aug 8 04:49:30.180031508 (19h10m4.695134094s) [upload=19792]: Waiting for error group managing segments... Aug 8 04:49:30.180083780 (19h10m4.695186362s) [upload=19792]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:49:30.180089451 (19h10m4.695192035s) [upload=19792]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:49:30.180107234 (19h10m4.695209811s) [upload=19792]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:49:30.255066803 (19h10m4.770169372s) [upload=19792]: Done uploading segments... Aug 8 04:49:30.255097834 (19h10m4.770200412s) [upload=19792]: Upload finished. err: <nil> Aug 8 04:49:49.722537438 (19h10m24.237640014s) [upload=19800]: Starting upload Aug 8 04:49:49.722597342 (19h10m24.237699917s) [upload=19800]: Done starting upload Aug 8 04:49:49.722664052 (19h10m24.237766615s) [upload=19800]: Uploading segments... Aug 8 04:49:49.722715327 (19h10m24.23781791s) [upload=19800]: Got next segment. Inline: true Aug 8 04:49:49.722719940 (19h10m24.237822515s) [upload=19800]: Waiting for error group managing segments... Aug 8 04:49:49.722753934 (19h10m24.23785651s) [upload=19800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:49:49.722758369 (19h10m24.237860931s) [upload=19800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:49:49.722815656 (19h10m24.237918234s) [upload=19800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:49:49.824454883 (19h10m24.339557452s) [upload=19800]: Done uploading segments... Aug 8 04:49:49.824470680 (19h10m24.339573247s) [upload=19800]: Upload finished. err: <nil> Duration: 209.756422ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................................X..........X............X.] duration: 392.781694ms FAIL (2025-08-08 05:27:53 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 47s) [upload=20448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:26:50.904739727 (19h47m25.419842305s) [upload=20448]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:26:50.944882452 (19h47m25.459985035s) [seg_pos={0 0}, upload=20448]: Begin upload segment... Aug 8 05:26:50.945011026 (19h47m25.460113615s) [noise=true , address=104.36.82.46:4499 , piece_id=LFAGIFKLABXXQPM4GPWODPCGYF5ZHIR3BWCQ6SZXDG6AI7EHJTTQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.945383247 (19h47m25.460485843s) [seg_pos={0 0}, upload=20448]: Done begin upload segment. Aug 8 05:26:50.945414178 (19h47m25.460516765s) [noise=true , address=104.36.82.16:4311 , piece_id=OLZR27VUDBCKGY42PZ5WTNIAU5STAWTHSBYZUZ6DAKMLXTGB3ADA, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.945650124 (19h47m25.460752691s) [noise=true , address=64.49.13.155:4913 , piece_id=ELZYJRJ5CR255T3TVDYASWE77EYU74EHSBHGS4L4R4UUHCIJEN3A, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.946353978 (19h47m25.461456567s) [noise=true , address=104.36.82.2:4744 , piece_id=KMD6CPC2SQKLIYCZYK54OFS2KOIH7IV7RDRC3FCVBKF5HRW26NKQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.946423301 (19h47m25.461525877s) [noise=true , address=104.36.82.60:4344 , piece_id=ZOI42ZMPOXK6SC4L7VNTDKJ7EUT7VYPHAUMG6Y3YA5V3NWF6I2JQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.946801022 (19h47m25.461903599s) [noise=true , address=104.36.82.47:4528 , piece_id=EW47FZA76DRQ62Y54OWQIZ7GUZXTJBZ3RZEGLUJKR6HLPDT4IWJQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.947126369 (19h47m25.462228946s) [noise=true , address=104.36.82.44:4901 , piece_id=WBP43PZDBEIN3C6QKY6OHVLWJ7TUJ2BW5DOWSFZ7WOTPICRWFV7A, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.947615054 (19h47m25.462717642s) [noise=true , address=104.36.82.38:4721 , piece_id=RWAVMCG65CWILHWSKXDN5EGLB4KCWQ3E5T2ZAVTKHE2ISWXNZRNQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.947988368 (19h47m25.463090935s) [noise=true , address=104.36.82.62:4413 , piece_id=BGCRMU6TUGIC6HF6IYXOXOGP4IMFJ7THTOKJLRJQIVKP5I75DWUA, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.948347124 (19h47m25.463449701s) [noise=true , address=64.49.13.169:4715 , piece_id=FWDPNSY7M3YAA5DDJFDV2N2VN26JMIMEJLPMI54Z7NKTTYHRXQKA, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.948617355 (19h47m25.463719921s) [noise=true , address=104.36.82.45:4933 , piece_id=COT4SGPHUGM2SZZV44IALVRKFECAK6MWF42WTI7GRXT7BX4WR6VA, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.948917256 (19h47m25.464019832s) [noise=true , address=104.36.82.44:4889 , piece_id=5ZBL5EIFT7VFM7WA6ZTGYBOCL4OJIX4ZKTC4OBFTE3IE2OSTURCQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.949189805 (19h47m25.464292384s) [noise=true , address=45.91.116.6:4001 , piece_id=6RXM6KZQP7IPZDBFVPRCYAT6AK6LHNXNOZIQ2IOFR4K4R4AF35PA, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.951453376 (19h47m25.466555956s) [noise=true , address=64.49.13.170:4724 , piece_id=35RD5PPN2JEIICVPK36SRN6CS3XYT32FFXGKRVEMZAQRFEAVLUZQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.951882862 (19h47m25.466985447s) [noise=true , address=104.36.82.36:4629 , piece_id=JX7CXW7ZVOI6L56ZFW6GCGVHCRWRNWTT5TTF7PZ63SFXD3PKJOGQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.955442371 (19h47m25.470544959s) [noise=true , address=104.36.82.37:4665 , piece_id=RGHW5JKFR2MBO46P3COM2CP7WKAT43JIKPGRENTXZ6FLBL2GLKIA, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.956057025 (19h47m25.471159612s) [noise=true , address=64.49.13.154:4935 , piece_id=VLIIMXGGIOB6FTZZSYG4AEHM5TEHJA5YMLOSSZGMUDOEN7TFUFTQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.956425213 (19h47m25.471527795s) [noise=true , address=104.36.82.59:4327 , piece_id=SURF5YCUDCKJJRE3DIIVH4VK4VUDTAIEAO3EV4M4LBDUHIVYR5TQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:51.046613449 (19h47m25.561716012s) [upload=20448]: Next returned nil segment Aug 8 05:26:51.046634869 (19h47m25.561737432s) [upload=20448]: Waiting for error group managing segments... Aug 8 05:26:51.056698912 (19h47m25.57180149s) [noise=true , address=45.91.116.6:4001 , piece_id=6RXM6KZQP7IPZDBFVPRCYAT6AK6LHNXNOZIQ2IOFR4K4R4AF35PA, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.057335285 (19h47m25.572437848s) [noise=true , address=104.36.82.62:4413 , piece_id=BGCRMU6TUGIC6HF6IYXOXOGP4IMFJ7THTOKJLRJQIVKP5I75DWUA, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.058658577 (19h47m25.573761165s) [noise=true , address=104.36.82.38:4721 , piece_id=RWAVMCG65CWILHWSKXDN5EGLB4KCWQ3E5T2ZAVTKHE2ISWXNZRNQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.060732252 (19h47m25.575834829s) [noise=true , address=104.36.82.36:4629 , piece_id=JX7CXW7ZVOI6L56ZFW6GCGVHCRWRNWTT5TTF7PZ63SFXD3PKJOGQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.060838294 (19h47m25.575940862s) [noise=true , address=104.36.82.44:4901 , piece_id=WBP43PZDBEIN3C6QKY6OHVLWJ7TUJ2BW5DOWSFZ7WOTPICRWFV7A, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.061115678 (19h47m25.576218256s) [noise=true , address=104.36.82.47:4528 , piece_id=EW47FZA76DRQ62Y54OWQIZ7GUZXTJBZ3RZEGLUJKR6HLPDT4IWJQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.061497341 (19h47m25.576599904s) [noise=true , address=104.36.82.44:4889 , piece_id=5ZBL5EIFT7VFM7WA6ZTGYBOCL4OJIX4ZKTC4OBFTE3IE2OSTURCQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.062320455 (19h47m25.577423025s) [noise=true , address=104.36.82.45:4933 , piece_id=COT4SGPHUGM2SZZV44IALVRKFECAK6MWF42WTI7GRXT7BX4WR6VA, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.062471953 (19h47m25.577574524s) [noise=true , address=104.36.82.37:4665 , piece_id=RGHW5JKFR2MBO46P3COM2CP7WKAT43JIKPGRENTXZ6FLBL2GLKIA, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.063867488 (19h47m25.578970057s) [noise=true , address=104.36.82.16:4311 , piece_id=OLZR27VUDBCKGY42PZ5WTNIAU5STAWTHSBYZUZ6DAKMLXTGB3ADA, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.065523830 (19h47m25.580626404s) [noise=true , address=104.36.82.2:4744 , piece_id=KMD6CPC2SQKLIYCZYK54OFS2KOIH7IV7RDRC3FCVBKF5HRW26NKQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.065919623 (19h47m25.5810222s) [noise=true , address=104.36.82.60:4344 , piece_id=ZOI42ZMPOXK6SC4L7VNTDKJ7EUT7VYPHAUMG6Y3YA5V3NWF6I2JQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.066265440 (19h47m25.581368009s) [noise=true , address=104.36.82.59:4327 , piece_id=SURF5YCUDCKJJRE3DIIVH4VK4VUDTAIEAO3EV4M4LBDUHIVYR5TQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.135080005 (19h47m25.650182575s) [noise=true , address=104.36.82.46:4499 , piece_id=LFAGIFKLABXXQPM4GPWODPCGYF5ZHIR3BWCQ6SZXDG6AI7EHJTTQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.135104617 (19h47m25.650207204s) [seg_pos={0 0}, upload=20448]: Segment reached optimal threshold of 14 pieces. Aug 8 05:26:51.135531464 (19h47m25.650634039s) [noise=true , address=64.49.13.155:4913 , piece_id=ELZYJRJ5CR255T3TVDYASWE77EYU74EHSBHGS4L4R4UUHCIJEN3A, seg_pos={0 0}, upload=20448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oyYUnWDyFo1npaKpBxMG5K31oUzJnTpcU1XHFmKux3MCVUPZV): protocol: read tcp 159.223.143.39:50950->64.49.13.155:4913: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:26:51.135612946 (19h47m25.650715521s) [noise=true , address=64.49.13.154:4935 , piece_id=VLIIMXGGIOB6FTZZSYG4AEHM5TEHJA5YMLOSSZGMUDOEN7TFUFTQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GZpRx4CMfeRa5nUrXmBaTUxcRVfLkx6v4StbcVyWpVqeuZdfk): protocol: read tcp 159.223.143.39:51524->64.49.13.154:4935: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:26:51.135689355 (19h47m25.650791931s) [noise=true , address=64.49.13.170:4724 , piece_id=35RD5PPN2JEIICVPK36SRN6CS3XYT32FFXGKRVEMZAQRFEAVLUZQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: read tcp 159.223.143.39:39110->64.49.13.170:4724: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:26:51.135718537 (19h47m25.650821107s) [noise=true , address=64.49.13.169:4715 , piece_id=FWDPNSY7M3YAA5DDJFDV2N2VN26JMIMEJLPMI54Z7NKTTYHRXQKA, seg_pos={0 0}, upload=20448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: read tcp 159.223.143.39:47790->64.49.13.169:4715: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:26:51.135739210 (19h47m25.650841786s) [seg_pos={0 0}, upload=20448]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:26:51.135832384 (19h47m25.65093496s) [upload=20448]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:26:51.135837284 (19h47m25.65093986s) [upload=20448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:26:51.200754247 (19h47m25.715856827s) [upload=20448]: Done uploading segments... Aug 8 05:26:51.200777999 (19h47m25.715880579s) [upload=20448]: Upload finished. err: <nil> Duration: 392.809085ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 182.675684ms FAIL (2025-08-08 05:27:42 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== uestItem_ObjectCommit Aug 8 04:42:16.180307652 (19h2m50.695410219s) [upload=19671]: Done uploading segments... Aug 8 04:42:16.180326351 (19h2m50.695428913s) [upload=19671]: Upload finished. err: <nil> Aug 8 04:42:41.083579476 (19h3m15.598682039s) [upload=19678]: Starting upload Aug 8 04:42:41.083658806 (19h3m15.598761384s) [upload=19678]: Done starting upload Aug 8 04:42:41.083736126 (19h3m15.598838696s) [upload=19678]: Uploading segments... Aug 8 04:42:41.083798735 (19h3m15.59890132s) [upload=19678]: Got next segment. Inline: true Aug 8 04:42:41.083805351 (19h3m15.598907934s) [upload=19678]: Waiting for error group managing segments... Aug 8 04:42:41.083894019 (19h3m15.598996595s) [upload=19678]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:42:41.083899702 (19h3m15.599002278s) [upload=19678]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:42:41.083903543 (19h3m15.59900612s) [upload=19678]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:42:41.147259315 (19h3m15.662361882s) [upload=19678]: Done uploading segments... Aug 8 04:42:41.147276213 (19h3m15.66237879s) [upload=19678]: Upload finished. err: <nil> Aug 8 04:43:54.314265905 (19h4m28.829368481s) [upload=19696]: Starting upload Aug 8 04:43:54.314342572 (19h4m28.829445149s) [upload=19696]: Done starting upload Aug 8 04:43:54.314412786 (19h4m28.829515355s) [upload=19696]: Uploading segments... Aug 8 04:43:54.314461737 (19h4m28.829564323s) [upload=19696]: Got next segment. Inline: true Aug 8 04:43:54.314468588 (19h4m28.829571166s) [upload=19696]: Waiting for error group managing segments... Aug 8 04:43:54.314513835 (19h4m28.829616411s) [upload=19696]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:43:54.314518357 (19h4m28.829620933s) [upload=19696]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:43:54.314521699 (19h4m28.829624275s) [upload=19696]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:43:54.374490000 (19h4m28.889592577s) [upload=19696]: Done uploading segments... Aug 8 04:43:54.374507640 (19h4m28.889610205s) [upload=19696]: Upload finished. err: <nil> Aug 8 04:44:37.820610246 (19h5m12.335712815s) [upload=19708]: Starting upload Aug 8 04:44:37.820681721 (19h5m12.335784288s) [upload=19708]: Done starting upload Aug 8 04:44:37.820750998 (19h5m12.335853567s) [upload=19708]: Uploading segments... Aug 8 04:44:37.820847572 (19h5m12.335950158s) [upload=19708]: Got next segment. Inline: true Aug 8 04:44:37.820871197 (19h5m12.335973778s) [upload=19708]: Waiting for error group managing segments... Aug 8 04:44:37.820923988 (19h5m12.336026577s) [upload=19708]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:44:37.820930149 (19h5m12.33603273s) [upload=19708]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:44:37.820950094 (19h5m12.336052671s) [upload=19708]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:44:37.891304392 (19h5m12.406406974s) [upload=19708]: Done uploading segments... Aug 8 04:44:37.891324719 (19h5m12.406427302s) [upload=19708]: Upload finished. err: <nil> Aug 8 04:45:49.374287050 (19h6m23.889389635s) [upload=19727]: Starting upload Aug 8 04:45:49.374385480 (19h6m23.889488062s) [upload=19727]: Done starting upload Aug 8 04:45:49.374485186 (19h6m23.889587763s) [upload=19727]: Uploading segments... Aug 8 04:45:49.374553702 (19h6m23.889656288s) [upload=19727]: Got next segment. Inline: true Aug 8 04:45:49.374559271 (19h6m23.889661849s) [upload=19727]: Waiting for error group managing segments... Aug 8 04:45:49.374607801 (19h6m23.889710384s) [upload=19727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:45:49.374613021 (19h6m23.889715604s) [upload=19727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:45:49.374616970 (19h6m23.889719552s) [upload=19727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:45:49.440532379 (19h6m23.955634956s) [upload=19727]: Done uploading segments... Aug 8 04:45:49.440553942 (19h6m23.955656506s) [upload=19727]: Upload finished. err: <nil> Aug 8 04:46:22.148691181 (19h6m56.663793758s) [upload=19736]: Starting upload Aug 8 04:46:22.148731264 (19h6m56.66383385s) [upload=19736]: Done starting upload Aug 8 04:46:22.148779839 (19h6m56.663882416s) [upload=19736]: Uploading segments... Aug 8 04:46:22.148815522 (19h6m56.663918108s) [upload=19736]: Got next segment. Inline: true Aug 8 04:46:22.148819611 (19h6m56.663922186s) [upload=19736]: Waiting for error group managing segments... Aug 8 04:46:22.148853347 (19h6m56.663955925s) [upload=19736]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:46:22.148856905 (19h6m56.663959481s) [upload=19736]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:46:22.148859219 (19h6m56.663961798s) [upload=19736]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:46:22.224160590 (19h6m56.739263173s) [upload=19736]: Done uploading segments... Aug 8 04:46:22.224183380 (19h6m56.739285958s) [upload=19736]: Upload finished. err: <nil> Aug 8 04:46:57.599668727 (19h7m32.114771304s) [upload=19750]: Starting upload Aug 8 04:46:57.599733716 (19h7m32.114836292s) [upload=19750]: Done starting upload Aug 8 04:46:57.599831148 (19h7m32.114933716s) [upload=19750]: Uploading segments... Aug 8 04:46:57.599898194 (19h7m32.115000774s) [upload=19750]: Got next segment. Inline: true Aug 8 04:46:57.599902995 (19h7m32.115005571s) [upload=19750]: Waiting for error group managing segments... Aug 8 04:46:57.599955730 (19h7m32.115058297s) [upload=19750]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:46:57.599960210 (19h7m32.115062786s) [upload=19750]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:46:57.599963339 (19h7m32.115065916s) [upload=19750]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:46:57.661947764 (19h7m32.17705034s) [upload=19750]: Done uploading segments... Aug 8 04:46:57.661964723 (19h7m32.1770673s) [upload=19750]: Upload finished. err: <nil> Aug 8 04:48:07.498218136 (19h8m42.013320702s) [upload=19766]: Starting upload Aug 8 04:48:07.498272608 (19h8m42.013375174s) [upload=19766]: Done starting upload Aug 8 04:48:07.498340076 (19h8m42.013442642s) [upload=19766]: Uploading segments... Aug 8 04:48:07.498377092 (19h8m42.013479678s) [upload=19766]: Got next segment. Inline: true Aug 8 04:48:07.498381514 (19h8m42.013484091s) [upload=19766]: Waiting for error group managing segments... Aug 8 04:48:07.498422115 (19h8m42.013524681s) [upload=19766]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:48:07.498426401 (19h8m42.013528979s) [upload=19766]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:48:07.498429474 (19h8m42.01353205s) [upload=19766]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:48:07.573834459 (19h8m42.088937036s) [upload=19766]: Done uploading segments... Aug 8 04:48:07.573849292 (19h8m42.088951861s) [upload=19766]: Upload finished. err: <nil> Aug 8 04:48:24.131081943 (19h8m58.646184521s) [upload=19773]: Starting upload Aug 8 04:48:24.131135304 (19h8m58.646237872s) [upload=19773]: Done starting upload Aug 8 04:48:24.131203832 (19h8m58.646306401s) [upload=19773]: Uploading segments... Aug 8 04:48:24.131242000 (19h8m58.646344585s) [upload=19773]: Got next segment. Inline: true Aug 8 04:48:24.131246356 (19h8m58.646348932s) [upload=19773]: Waiting for error group managing segments... Aug 8 04:48:24.131298903 (19h8m58.646401482s) [upload=19773]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:48:24.131304610 (19h8m58.646407189s) [upload=19773]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:48:24.131307703 (19h8m58.646410279s) [upload=19773]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:48:24.189165262 (19h8m58.704267839s) [upload=19773]: Done uploading segments... Aug 8 04:48:24.189182600 (19h8m58.704285176s) [upload=19773]: Upload finished. err: <nil> Aug 8 04:49:30.179743426 (19h10m4.69484601s) [upload=19792]: Starting upload Aug 8 04:49:30.179830624 (19h10m4.694933205s) [upload=19792]: Done starting upload Aug 8 04:49:30.179932276 (19h10m4.695034844s) [upload=19792]: Uploading segments... Aug 8 04:49:30.180011264 (19h10m4.69511385s) [upload=19792]: Got next segment. Inline: true Aug 8 04:49:30.180031508 (19h10m4.695134094s) [upload=19792]: Waiting for error group managing segments... Aug 8 04:49:30.180083780 (19h10m4.695186362s) [upload=19792]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:49:30.180089451 (19h10m4.695192035s) [upload=19792]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:49:30.180107234 (19h10m4.695209811s) [upload=19792]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:49:30.255066803 (19h10m4.770169372s) [upload=19792]: Done uploading segments... Aug 8 04:49:30.255097834 (19h10m4.770200412s) [upload=19792]: Upload finished. err: <nil> Aug 8 04:49:49.722537438 (19h10m24.237640014s) [upload=19800]: Starting upload Aug 8 04:49:49.722597342 (19h10m24.237699917s) [upload=19800]: Done starting upload Aug 8 04:49:49.722664052 (19h10m24.237766615s) [upload=19800]: Uploading segments... Aug 8 04:49:49.722715327 (19h10m24.23781791s) [upload=19800]: Got next segment. Inline: true Aug 8 04:49:49.722719940 (19h10m24.237822515s) [upload=19800]: Waiting for error group managing segments... Aug 8 04:49:49.722753934 (19h10m24.23785651s) [upload=19800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:49:49.722758369 (19h10m24.237860931s) [upload=19800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:49:49.722815656 (19h10m24.237918234s) [upload=19800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:49:49.824454883 (19h10m24.339557452s) [upload=19800]: Done uploading segments... Aug 8 04:49:49.824470680 (19h10m24.339573247s) [upload=19800]: Upload finished. err: <nil> Duration: 182.700963ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 575.956349ms FAIL (2025-08-08 05:27:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 576.552747ms edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 29.700591ms target: https://us1.storj.io/login FAIL (2025-08-08 05:27:18 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 29.729837ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 1.301661779s FAIL (2025-08-08 05:26:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.301683194s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................................X..........X............X] duration: 383.691744ms FAIL (2025-08-08 05:26:51 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 47s) [upload=20448]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:26:50.904739727 (19h47m25.419842305s) [upload=20448]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:26:50.944882452 (19h47m25.459985035s) [seg_pos={0 0}, upload=20448]: Begin upload segment... Aug 8 05:26:50.945011026 (19h47m25.460113615s) [noise=true , address=104.36.82.46:4499 , piece_id=LFAGIFKLABXXQPM4GPWODPCGYF5ZHIR3BWCQ6SZXDG6AI7EHJTTQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.945383247 (19h47m25.460485843s) [seg_pos={0 0}, upload=20448]: Done begin upload segment. Aug 8 05:26:50.945414178 (19h47m25.460516765s) [noise=true , address=104.36.82.16:4311 , piece_id=OLZR27VUDBCKGY42PZ5WTNIAU5STAWTHSBYZUZ6DAKMLXTGB3ADA, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.945650124 (19h47m25.460752691s) [noise=true , address=64.49.13.155:4913 , piece_id=ELZYJRJ5CR255T3TVDYASWE77EYU74EHSBHGS4L4R4UUHCIJEN3A, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.946353978 (19h47m25.461456567s) [noise=true , address=104.36.82.2:4744 , piece_id=KMD6CPC2SQKLIYCZYK54OFS2KOIH7IV7RDRC3FCVBKF5HRW26NKQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.946423301 (19h47m25.461525877s) [noise=true , address=104.36.82.60:4344 , piece_id=ZOI42ZMPOXK6SC4L7VNTDKJ7EUT7VYPHAUMG6Y3YA5V3NWF6I2JQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.946801022 (19h47m25.461903599s) [noise=true , address=104.36.82.47:4528 , piece_id=EW47FZA76DRQ62Y54OWQIZ7GUZXTJBZ3RZEGLUJKR6HLPDT4IWJQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.947126369 (19h47m25.462228946s) [noise=true , address=104.36.82.44:4901 , piece_id=WBP43PZDBEIN3C6QKY6OHVLWJ7TUJ2BW5DOWSFZ7WOTPICRWFV7A, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.947615054 (19h47m25.462717642s) [noise=true , address=104.36.82.38:4721 , piece_id=RWAVMCG65CWILHWSKXDN5EGLB4KCWQ3E5T2ZAVTKHE2ISWXNZRNQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.947988368 (19h47m25.463090935s) [noise=true , address=104.36.82.62:4413 , piece_id=BGCRMU6TUGIC6HF6IYXOXOGP4IMFJ7THTOKJLRJQIVKP5I75DWUA, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.948347124 (19h47m25.463449701s) [noise=true , address=64.49.13.169:4715 , piece_id=FWDPNSY7M3YAA5DDJFDV2N2VN26JMIMEJLPMI54Z7NKTTYHRXQKA, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.948617355 (19h47m25.463719921s) [noise=true , address=104.36.82.45:4933 , piece_id=COT4SGPHUGM2SZZV44IALVRKFECAK6MWF42WTI7GRXT7BX4WR6VA, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.948917256 (19h47m25.464019832s) [noise=true , address=104.36.82.44:4889 , piece_id=5ZBL5EIFT7VFM7WA6ZTGYBOCL4OJIX4ZKTC4OBFTE3IE2OSTURCQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.949189805 (19h47m25.464292384s) [noise=true , address=45.91.116.6:4001 , piece_id=6RXM6KZQP7IPZDBFVPRCYAT6AK6LHNXNOZIQ2IOFR4K4R4AF35PA, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.951453376 (19h47m25.466555956s) [noise=true , address=64.49.13.170:4724 , piece_id=35RD5PPN2JEIICVPK36SRN6CS3XYT32FFXGKRVEMZAQRFEAVLUZQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.951882862 (19h47m25.466985447s) [noise=true , address=104.36.82.36:4629 , piece_id=JX7CXW7ZVOI6L56ZFW6GCGVHCRWRNWTT5TTF7PZ63SFXD3PKJOGQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.955442371 (19h47m25.470544959s) [noise=true , address=104.36.82.37:4665 , piece_id=RGHW5JKFR2MBO46P3COM2CP7WKAT43JIKPGRENTXZ6FLBL2GLKIA, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.956057025 (19h47m25.471159612s) [noise=true , address=64.49.13.154:4935 , piece_id=VLIIMXGGIOB6FTZZSYG4AEHM5TEHJA5YMLOSSZGMUDOEN7TFUFTQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:50.956425213 (19h47m25.471527795s) [noise=true , address=104.36.82.59:4327 , piece_id=SURF5YCUDCKJJRE3DIIVH4VK4VUDTAIEAO3EV4M4LBDUHIVYR5TQ, seg_pos={0 0}, upload=20448]: Uploading piece... Aug 8 05:26:51.046613449 (19h47m25.561716012s) [upload=20448]: Next returned nil segment Aug 8 05:26:51.046634869 (19h47m25.561737432s) [upload=20448]: Waiting for error group managing segments... Aug 8 05:26:51.056698912 (19h47m25.57180149s) [noise=true , address=45.91.116.6:4001 , piece_id=6RXM6KZQP7IPZDBFVPRCYAT6AK6LHNXNOZIQ2IOFR4K4R4AF35PA, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.057335285 (19h47m25.572437848s) [noise=true , address=104.36.82.62:4413 , piece_id=BGCRMU6TUGIC6HF6IYXOXOGP4IMFJ7THTOKJLRJQIVKP5I75DWUA, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.058658577 (19h47m25.573761165s) [noise=true , address=104.36.82.38:4721 , piece_id=RWAVMCG65CWILHWSKXDN5EGLB4KCWQ3E5T2ZAVTKHE2ISWXNZRNQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.060732252 (19h47m25.575834829s) [noise=true , address=104.36.82.36:4629 , piece_id=JX7CXW7ZVOI6L56ZFW6GCGVHCRWRNWTT5TTF7PZ63SFXD3PKJOGQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.060838294 (19h47m25.575940862s) [noise=true , address=104.36.82.44:4901 , piece_id=WBP43PZDBEIN3C6QKY6OHVLWJ7TUJ2BW5DOWSFZ7WOTPICRWFV7A, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.061115678 (19h47m25.576218256s) [noise=true , address=104.36.82.47:4528 , piece_id=EW47FZA76DRQ62Y54OWQIZ7GUZXTJBZ3RZEGLUJKR6HLPDT4IWJQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.061497341 (19h47m25.576599904s) [noise=true , address=104.36.82.44:4889 , piece_id=5ZBL5EIFT7VFM7WA6ZTGYBOCL4OJIX4ZKTC4OBFTE3IE2OSTURCQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.062320455 (19h47m25.577423025s) [noise=true , address=104.36.82.45:4933 , piece_id=COT4SGPHUGM2SZZV44IALVRKFECAK6MWF42WTI7GRXT7BX4WR6VA, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.062471953 (19h47m25.577574524s) [noise=true , address=104.36.82.37:4665 , piece_id=RGHW5JKFR2MBO46P3COM2CP7WKAT43JIKPGRENTXZ6FLBL2GLKIA, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.063867488 (19h47m25.578970057s) [noise=true , address=104.36.82.16:4311 , piece_id=OLZR27VUDBCKGY42PZ5WTNIAU5STAWTHSBYZUZ6DAKMLXTGB3ADA, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.065523830 (19h47m25.580626404s) [noise=true , address=104.36.82.2:4744 , piece_id=KMD6CPC2SQKLIYCZYK54OFS2KOIH7IV7RDRC3FCVBKF5HRW26NKQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.065919623 (19h47m25.5810222s) [noise=true , address=104.36.82.60:4344 , piece_id=ZOI42ZMPOXK6SC4L7VNTDKJ7EUT7VYPHAUMG6Y3YA5V3NWF6I2JQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.066265440 (19h47m25.581368009s) [noise=true , address=104.36.82.59:4327 , piece_id=SURF5YCUDCKJJRE3DIIVH4VK4VUDTAIEAO3EV4M4LBDUHIVYR5TQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.135080005 (19h47m25.650182575s) [noise=true , address=104.36.82.46:4499 , piece_id=LFAGIFKLABXXQPM4GPWODPCGYF5ZHIR3BWCQ6SZXDG6AI7EHJTTQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: <nil> Aug 8 05:26:51.135104617 (19h47m25.650207204s) [seg_pos={0 0}, upload=20448]: Segment reached optimal threshold of 14 pieces. Aug 8 05:26:51.135531464 (19h47m25.650634039s) [noise=true , address=64.49.13.155:4913 , piece_id=ELZYJRJ5CR255T3TVDYASWE77EYU74EHSBHGS4L4R4UUHCIJEN3A, seg_pos={0 0}, upload=20448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oyYUnWDyFo1npaKpBxMG5K31oUzJnTpcU1XHFmKux3MCVUPZV): protocol: read tcp 159.223.143.39:50950->64.49.13.155:4913: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:26:51.135612946 (19h47m25.650715521s) [noise=true , address=64.49.13.154:4935 , piece_id=VLIIMXGGIOB6FTZZSYG4AEHM5TEHJA5YMLOSSZGMUDOEN7TFUFTQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GZpRx4CMfeRa5nUrXmBaTUxcRVfLkx6v4StbcVyWpVqeuZdfk): protocol: read tcp 159.223.143.39:51524->64.49.13.154:4935: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:26:51.135689355 (19h47m25.650791931s) [noise=true , address=64.49.13.170:4724 , piece_id=35RD5PPN2JEIICVPK36SRN6CS3XYT32FFXGKRVEMZAQRFEAVLUZQ, seg_pos={0 0}, upload=20448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: read tcp 159.223.143.39:39110->64.49.13.170:4724: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:26:51.135718537 (19h47m25.650821107s) [noise=true , address=64.49.13.169:4715 , piece_id=FWDPNSY7M3YAA5DDJFDV2N2VN26JMIMEJLPMI54Z7NKTTYHRXQKA, seg_pos={0 0}, upload=20448]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: read tcp 159.223.143.39:47790->64.49.13.169:4715: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:26:51.135739210 (19h47m25.650841786s) [seg_pos={0 0}, upload=20448]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:26:51.135832384 (19h47m25.65093496s) [upload=20448]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:26:51.135837284 (19h47m25.65093986s) [upload=20448]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:26:51.200754247 (19h47m25.715856827s) [upload=20448]: Done uploading segments... Aug 8 05:26:51.200777999 (19h47m25.715880579s) [upload=20448]: Upload finished. err: <nil> Duration: 383.721958ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 30.841089ms target: https://us1.storj.io/login FAIL (2025-08-08 05:26:46 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 30.929912ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 212.020959ms FAIL (2025-08-08 05:26:33 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== uestItem_ObjectCommit Aug 8 04:42:16.180307652 (19h2m50.695410219s) [upload=19671]: Done uploading segments... Aug 8 04:42:16.180326351 (19h2m50.695428913s) [upload=19671]: Upload finished. err: <nil> Aug 8 04:42:41.083579476 (19h3m15.598682039s) [upload=19678]: Starting upload Aug 8 04:42:41.083658806 (19h3m15.598761384s) [upload=19678]: Done starting upload Aug 8 04:42:41.083736126 (19h3m15.598838696s) [upload=19678]: Uploading segments... Aug 8 04:42:41.083798735 (19h3m15.59890132s) [upload=19678]: Got next segment. Inline: true Aug 8 04:42:41.083805351 (19h3m15.598907934s) [upload=19678]: Waiting for error group managing segments... Aug 8 04:42:41.083894019 (19h3m15.598996595s) [upload=19678]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:42:41.083899702 (19h3m15.599002278s) [upload=19678]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:42:41.083903543 (19h3m15.59900612s) [upload=19678]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:42:41.147259315 (19h3m15.662361882s) [upload=19678]: Done uploading segments... Aug 8 04:42:41.147276213 (19h3m15.66237879s) [upload=19678]: Upload finished. err: <nil> Aug 8 04:43:54.314265905 (19h4m28.829368481s) [upload=19696]: Starting upload Aug 8 04:43:54.314342572 (19h4m28.829445149s) [upload=19696]: Done starting upload Aug 8 04:43:54.314412786 (19h4m28.829515355s) [upload=19696]: Uploading segments... Aug 8 04:43:54.314461737 (19h4m28.829564323s) [upload=19696]: Got next segment. Inline: true Aug 8 04:43:54.314468588 (19h4m28.829571166s) [upload=19696]: Waiting for error group managing segments... Aug 8 04:43:54.314513835 (19h4m28.829616411s) [upload=19696]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:43:54.314518357 (19h4m28.829620933s) [upload=19696]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:43:54.314521699 (19h4m28.829624275s) [upload=19696]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:43:54.374490000 (19h4m28.889592577s) [upload=19696]: Done uploading segments... Aug 8 04:43:54.374507640 (19h4m28.889610205s) [upload=19696]: Upload finished. err: <nil> Aug 8 04:44:37.820610246 (19h5m12.335712815s) [upload=19708]: Starting upload Aug 8 04:44:37.820681721 (19h5m12.335784288s) [upload=19708]: Done starting upload Aug 8 04:44:37.820750998 (19h5m12.335853567s) [upload=19708]: Uploading segments... Aug 8 04:44:37.820847572 (19h5m12.335950158s) [upload=19708]: Got next segment. Inline: true Aug 8 04:44:37.820871197 (19h5m12.335973778s) [upload=19708]: Waiting for error group managing segments... Aug 8 04:44:37.820923988 (19h5m12.336026577s) [upload=19708]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:44:37.820930149 (19h5m12.33603273s) [upload=19708]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:44:37.820950094 (19h5m12.336052671s) [upload=19708]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:44:37.891304392 (19h5m12.406406974s) [upload=19708]: Done uploading segments... Aug 8 04:44:37.891324719 (19h5m12.406427302s) [upload=19708]: Upload finished. err: <nil> Aug 8 04:45:49.374287050 (19h6m23.889389635s) [upload=19727]: Starting upload Aug 8 04:45:49.374385480 (19h6m23.889488062s) [upload=19727]: Done starting upload Aug 8 04:45:49.374485186 (19h6m23.889587763s) [upload=19727]: Uploading segments... Aug 8 04:45:49.374553702 (19h6m23.889656288s) [upload=19727]: Got next segment. Inline: true Aug 8 04:45:49.374559271 (19h6m23.889661849s) [upload=19727]: Waiting for error group managing segments... Aug 8 04:45:49.374607801 (19h6m23.889710384s) [upload=19727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:45:49.374613021 (19h6m23.889715604s) [upload=19727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:45:49.374616970 (19h6m23.889719552s) [upload=19727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:45:49.440532379 (19h6m23.955634956s) [upload=19727]: Done uploading segments... Aug 8 04:45:49.440553942 (19h6m23.955656506s) [upload=19727]: Upload finished. err: <nil> Aug 8 04:46:22.148691181 (19h6m56.663793758s) [upload=19736]: Starting upload Aug 8 04:46:22.148731264 (19h6m56.66383385s) [upload=19736]: Done starting upload Aug 8 04:46:22.148779839 (19h6m56.663882416s) [upload=19736]: Uploading segments... Aug 8 04:46:22.148815522 (19h6m56.663918108s) [upload=19736]: Got next segment. Inline: true Aug 8 04:46:22.148819611 (19h6m56.663922186s) [upload=19736]: Waiting for error group managing segments... Aug 8 04:46:22.148853347 (19h6m56.663955925s) [upload=19736]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:46:22.148856905 (19h6m56.663959481s) [upload=19736]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:46:22.148859219 (19h6m56.663961798s) [upload=19736]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:46:22.224160590 (19h6m56.739263173s) [upload=19736]: Done uploading segments... Aug 8 04:46:22.224183380 (19h6m56.739285958s) [upload=19736]: Upload finished. err: <nil> Aug 8 04:46:57.599668727 (19h7m32.114771304s) [upload=19750]: Starting upload Aug 8 04:46:57.599733716 (19h7m32.114836292s) [upload=19750]: Done starting upload Aug 8 04:46:57.599831148 (19h7m32.114933716s) [upload=19750]: Uploading segments... Aug 8 04:46:57.599898194 (19h7m32.115000774s) [upload=19750]: Got next segment. Inline: true Aug 8 04:46:57.599902995 (19h7m32.115005571s) [upload=19750]: Waiting for error group managing segments... Aug 8 04:46:57.599955730 (19h7m32.115058297s) [upload=19750]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:46:57.599960210 (19h7m32.115062786s) [upload=19750]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:46:57.599963339 (19h7m32.115065916s) [upload=19750]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:46:57.661947764 (19h7m32.17705034s) [upload=19750]: Done uploading segments... Aug 8 04:46:57.661964723 (19h7m32.1770673s) [upload=19750]: Upload finished. err: <nil> Aug 8 04:48:07.498218136 (19h8m42.013320702s) [upload=19766]: Starting upload Aug 8 04:48:07.498272608 (19h8m42.013375174s) [upload=19766]: Done starting upload Aug 8 04:48:07.498340076 (19h8m42.013442642s) [upload=19766]: Uploading segments... Aug 8 04:48:07.498377092 (19h8m42.013479678s) [upload=19766]: Got next segment. Inline: true Aug 8 04:48:07.498381514 (19h8m42.013484091s) [upload=19766]: Waiting for error group managing segments... Aug 8 04:48:07.498422115 (19h8m42.013524681s) [upload=19766]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:48:07.498426401 (19h8m42.013528979s) [upload=19766]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:48:07.498429474 (19h8m42.01353205s) [upload=19766]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:48:07.573834459 (19h8m42.088937036s) [upload=19766]: Done uploading segments... Aug 8 04:48:07.573849292 (19h8m42.088951861s) [upload=19766]: Upload finished. err: <nil> Aug 8 04:48:24.131081943 (19h8m58.646184521s) [upload=19773]: Starting upload Aug 8 04:48:24.131135304 (19h8m58.646237872s) [upload=19773]: Done starting upload Aug 8 04:48:24.131203832 (19h8m58.646306401s) [upload=19773]: Uploading segments... Aug 8 04:48:24.131242000 (19h8m58.646344585s) [upload=19773]: Got next segment. Inline: true Aug 8 04:48:24.131246356 (19h8m58.646348932s) [upload=19773]: Waiting for error group managing segments... Aug 8 04:48:24.131298903 (19h8m58.646401482s) [upload=19773]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:48:24.131304610 (19h8m58.646407189s) [upload=19773]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:48:24.131307703 (19h8m58.646410279s) [upload=19773]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:48:24.189165262 (19h8m58.704267839s) [upload=19773]: Done uploading segments... Aug 8 04:48:24.189182600 (19h8m58.704285176s) [upload=19773]: Upload finished. err: <nil> Aug 8 04:49:30.179743426 (19h10m4.69484601s) [upload=19792]: Starting upload Aug 8 04:49:30.179830624 (19h10m4.694933205s) [upload=19792]: Done starting upload Aug 8 04:49:30.179932276 (19h10m4.695034844s) [upload=19792]: Uploading segments... Aug 8 04:49:30.180011264 (19h10m4.69511385s) [upload=19792]: Got next segment. Inline: true Aug 8 04:49:30.180031508 (19h10m4.695134094s) [upload=19792]: Waiting for error group managing segments... Aug 8 04:49:30.180083780 (19h10m4.695186362s) [upload=19792]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:49:30.180089451 (19h10m4.695192035s) [upload=19792]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:49:30.180107234 (19h10m4.695209811s) [upload=19792]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:49:30.255066803 (19h10m4.770169372s) [upload=19792]: Done uploading segments... Aug 8 04:49:30.255097834 (19h10m4.770200412s) [upload=19792]: Upload finished. err: <nil> Aug 8 04:49:49.722537438 (19h10m24.237640014s) [upload=19800]: Starting upload Aug 8 04:49:49.722597342 (19h10m24.237699917s) [upload=19800]: Done starting upload Aug 8 04:49:49.722664052 (19h10m24.237766615s) [upload=19800]: Uploading segments... Aug 8 04:49:49.722715327 (19h10m24.23781791s) [upload=19800]: Got next segment. Inline: true Aug 8 04:49:49.722719940 (19h10m24.237822515s) [upload=19800]: Waiting for error group managing segments... Aug 8 04:49:49.722753934 (19h10m24.23785651s) [upload=19800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:49:49.722758369 (19h10m24.237860931s) [upload=19800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:49:49.722815656 (19h10m24.237918234s) [upload=19800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:49:49.824454883 (19h10m24.339557452s) [upload=19800]: Done uploading segments... Aug 8 04:49:49.824470680 (19h10m24.339573247s) [upload=19800]: Upload finished. err: <nil> Duration: 212.035856ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................X..........X............] duration: 385.9804ms FAIL (2025-08-08 05:26:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== TNVS3YHCRQE5AP3GTOWQZJD2F2IXHRHIJZCKZAGA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.396619078 (19h36m18.911721655s) [noise=true , address=104.36.82.62:4421 , piece_id=GWLO2QUJEPUYB5SKGXYY32HNVTQTFM7LLJNOO7WIJOSYKYMXDJMQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397045508 (19h36m18.91214809s) [noise=true , address=104.36.82.47:4529 , piece_id=BRL5VAKSFPTIWSBEC3N5ZZFL5YBYA4WTMPG4PN7SPQCLF2KOHDJQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397160558 (19h36m18.912263143s) [noise=true , address=104.36.82.43:4840 , piece_id=R73RV4DJOGZSDDPV3QSXMTKTJ6MQR72XBNXYAEJG5L7I2E43U4HQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397451153 (19h36m18.912553734s) [noise=true , address=104.36.82.34:4573 , piece_id=KEGNFSTAEF5YBDXO32577DD7IFWZNSZG5SDSPJFTDOKPWMU7NVFQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397679365 (19h36m18.912781931s) [noise=true , address=104.36.82.61:4385 , piece_id=XWK5KD27JAWA7MRDIG5OXUUXBLVY72AVDBR2JWOKUNRUON5BC6LA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397898222 (19h36m18.9130008s) [noise=true , address=104.36.82.8:4984 , piece_id=NGMFUDZN4M2ONJQDH5EML2LRX7WBHSZLMLEHU6335YVFJ6TK7CCQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.398125648 (19h36m18.913228218s) [noise=true , address=64.49.13.169:4707 , piece_id=WTQM4UP3B655VDT55DX26KE7WMJP7QYVBWWUHH7PALIX75HBN2ZQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.398278438 (19h36m18.913381022s) [noise=true , address=104.36.82.37:4655 , piece_id=FULT7QYOBIRP5SGZ54HWYDHET74J5UJAYYUOC5AYE5IBWRS6ZBFQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.398652749 (19h36m18.913755329s) [noise=true , address=104.36.82.46:4493 , piece_id=HNGMHYYJCUEF5WGYT356AEKZDY6IZUJX5WN5JVJ36NSC5IEC6AGA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399000971 (19h36m18.914103551s) [noise=true , address=104.36.82.23:4460 , piece_id=3UHZQH52DDCDDWHK6C65ZJHKTKL2YUZUW3V2M7URKGTYOOJIALLA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399455504 (19h36m18.914558137s) [noise=true , address=104.36.82.12:4180 , piece_id=ILG74TZ5BFRDRVYKVPPM2VOVOZ4IXFX4RILK3Y5QFKT7W6J6PXIQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399717456 (19h36m18.914820039s) [noise=true , address=104.36.82.45:4928 , piece_id=KHGBLGWNAAG5722YT6XP6U2FA2GK7WJE7MT2RNMGFPYXSRFEIM3Q, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399736184 (19h36m18.914838767s) [noise=true , address=104.36.82.60:4349 , piece_id=L6BGCU7M6BX74OPTBCSQBJ3PMOBRN3W562T7EVR3DD6UECY67IRQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399780848 (19h36m18.914883425s) [noise=true , address=104.36.82.58:4298 , piece_id=KANX4YVAKK7RYWKQKUXRGMEBPYREPUZECM7OTPP6GBEG6I57XZ7Q, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.400090065 (19h36m18.915192652s) [noise=true , address=104.36.82.53:4123 , piece_id=MDKE7CTOUIFOC4ENQQ6RXJW6FIEMKRHW2GVIRFUBT7G22WUSXCNA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.400430542 (19h36m18.915533108s) [noise=true , address=64.49.13.154:4934 , piece_id=B5JFP2WFQW65PPA6C7SOO6STYYYQKEANV4Z5UDFDGWWIUAWMUN3A, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.401080440 (19h36m18.916183005s) [noise=true , address=104.36.82.17:4360 , piece_id=TVVJIC7A5UTX3TLYJZ4XEEYLUFWK5JRETR4J2MW6SKYISP7J44SA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.492815163 (19h36m19.007917733s) [upload=20259]: Next returned nil segment Aug 8 05:15:44.492830313 (19h36m19.007932879s) [upload=20259]: Waiting for error group managing segments... Aug 8 05:15:44.503634225 (19h36m19.018736809s) [noise=true , address=104.36.82.58:4298 , piece_id=KANX4YVAKK7RYWKQKUXRGMEBPYREPUZECM7OTPP6GBEG6I57XZ7Q, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.504718521 (19h36m19.019821102s) [noise=true , address=104.36.82.23:4460 , piece_id=3UHZQH52DDCDDWHK6C65ZJHKTKL2YUZUW3V2M7URKGTYOOJIALLA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.504983984 (19h36m19.020086552s) [noise=true , address=104.36.82.60:4349 , piece_id=L6BGCU7M6BX74OPTBCSQBJ3PMOBRN3W562T7EVR3DD6UECY67IRQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.505253948 (19h36m19.020356524s) [noise=true , address=104.36.82.45:4928 , piece_id=KHGBLGWNAAG5722YT6XP6U2FA2GK7WJE7MT2RNMGFPYXSRFEIM3Q, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.505859429 (19h36m19.020962003s) [noise=true , address=104.36.82.34:4573 , piece_id=KEGNFSTAEF5YBDXO32577DD7IFWZNSZG5SDSPJFTDOKPWMU7NVFQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.506188048 (19h36m19.021290625s) [noise=true , address=104.36.82.46:4493 , piece_id=HNGMHYYJCUEF5WGYT356AEKZDY6IZUJX5WN5JVJ36NSC5IEC6AGA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.506966629 (19h36m19.022069192s) [noise=true , address=104.36.82.43:4840 , piece_id=R73RV4DJOGZSDDPV3QSXMTKTJ6MQR72XBNXYAEJG5L7I2E43U4HQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.507255656 (19h36m19.022358218s) [noise=true , address=104.36.82.37:4655 , piece_id=FULT7QYOBIRP5SGZ54HWYDHET74J5UJAYYUOC5AYE5IBWRS6ZBFQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.507914747 (19h36m19.02301733s) [noise=true , address=104.36.82.53:4123 , piece_id=MDKE7CTOUIFOC4ENQQ6RXJW6FIEMKRHW2GVIRFUBT7G22WUSXCNA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.508934794 (19h36m19.024037376s) [noise=true , address=104.36.82.8:4984 , piece_id=NGMFUDZN4M2ONJQDH5EML2LRX7WBHSZLMLEHU6335YVFJ6TK7CCQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.509462525 (19h36m19.024565093s) [noise=true , address=104.36.82.12:4180 , piece_id=ILG74TZ5BFRDRVYKVPPM2VOVOZ4IXFX4RILK3Y5QFKT7W6J6PXIQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.509503916 (19h36m19.02460648s) [noise=true , address=104.36.82.62:4421 , piece_id=GWLO2QUJEPUYB5SKGXYY32HNVTQTFM7LLJNOO7WIJOSYKYMXDJMQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.509998107 (19h36m19.025100676s) [noise=true , address=104.36.82.47:4529 , piece_id=BRL5VAKSFPTIWSBEC3N5ZZFL5YBYA4WTMPG4PN7SPQCLF2KOHDJQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.510133131 (19h36m19.025235694s) [noise=true , address=104.36.82.2:4764 , piece_id=4QZF2DZ36ONDTNVS3YHCRQE5AP3GTOWQZJD2F2IXHRHIJZCKZAGA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.510142680 (19h36m19.025245251s) [seg_pos={0 0}, upload=20259]: Segment reached optimal threshold of 14 pieces. Aug 8 05:15:44.510939805 (19h36m19.026042372s) [noise=true , address=104.36.82.61:4385 , piece_id=XWK5KD27JAWA7MRDIG5OXUUXBLVY72AVDBR2JWOKUNRUON5BC6LA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 8 05:15:44.511262091 (19h36m19.026364669s) [noise=true , address=104.36.82.17:4360 , piece_id=TVVJIC7A5UTX3TLYJZ4XEEYLUFWK5JRETR4J2MW6SKYISP7J44SA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.511421518 (19h36m19.026524102s) [noise=true , address=64.49.13.169:4707 , piece_id=WTQM4UP3B655VDT55DX26KE7WMJP7QYVBWWUHH7PALIX75HBN2ZQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: read tcp 159.223.143.39:32802->64.49.13.169:4707: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:15:44.511435693 (19h36m19.026538256s) [noise=true , address=64.49.13.154:4934 , piece_id=B5JFP2WFQW65PPA6C7SOO6STYYYQKEANV4Z5UDFDGWWIUAWMUN3A, seg_pos={0 0}, upload=20259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: read tcp 159.223.143.39:49428->64.49.13.154:4934: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:15:44.511449276 (19h36m19.026551856s) [seg_pos={0 0}, upload=20259]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 05:15:44.511530782 (19h36m19.026633369s) [upload=20259]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:15:44.511536651 (19h36m19.026639235s) [upload=20259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:15:44.590856427 (19h36m19.105959005s) [upload=20259]: Done uploading segments... Aug 8 05:15:44.590921713 (19h36m19.106024292s) [upload=20259]: Upload finished. err: <nil> Aug 8 05:16:32.714498510 (19h37m7.229601094s) [upload=20272]: Starting upload Aug 8 05:16:32.714552893 (19h37m7.229655473s) [upload=20272]: Done starting upload Aug 8 05:16:32.714903852 (19h37m7.230006423s) [upload=20272]: Uploading segments... Aug 8 05:16:32.714955229 (19h37m7.230057809s) [upload=20272]: Got next segment. Inline: false Aug 8 05:16:32.714989454 (19h37m7.230092036s) [upload=20272]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:16:32.714994640 (19h37m7.230097224s) [upload=20272]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:16:32.723976411 (19h37m7.239078998s) [upload=20272]: Next segment err: metaclient: Too Many Requests Aug 8 05:16:32.723996518 (19h37m7.239099103s) [upload=20272]: Done uploading segments... Aug 8 05:16:32.724012336 (19h37m7.239114909s) [upload=20272]: Upload finished. err: metaclient: Too Many Requests Duration: 386.286405ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 189.056907ms FAIL (2025-08-08 05:26:14 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== uestItem_ObjectCommit Aug 8 04:42:16.180307652 (19h2m50.695410219s) [upload=19671]: Done uploading segments... Aug 8 04:42:16.180326351 (19h2m50.695428913s) [upload=19671]: Upload finished. err: <nil> Aug 8 04:42:41.083579476 (19h3m15.598682039s) [upload=19678]: Starting upload Aug 8 04:42:41.083658806 (19h3m15.598761384s) [upload=19678]: Done starting upload Aug 8 04:42:41.083736126 (19h3m15.598838696s) [upload=19678]: Uploading segments... Aug 8 04:42:41.083798735 (19h3m15.59890132s) [upload=19678]: Got next segment. Inline: true Aug 8 04:42:41.083805351 (19h3m15.598907934s) [upload=19678]: Waiting for error group managing segments... Aug 8 04:42:41.083894019 (19h3m15.598996595s) [upload=19678]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:42:41.083899702 (19h3m15.599002278s) [upload=19678]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:42:41.083903543 (19h3m15.59900612s) [upload=19678]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:42:41.147259315 (19h3m15.662361882s) [upload=19678]: Done uploading segments... Aug 8 04:42:41.147276213 (19h3m15.66237879s) [upload=19678]: Upload finished. err: <nil> Aug 8 04:43:54.314265905 (19h4m28.829368481s) [upload=19696]: Starting upload Aug 8 04:43:54.314342572 (19h4m28.829445149s) [upload=19696]: Done starting upload Aug 8 04:43:54.314412786 (19h4m28.829515355s) [upload=19696]: Uploading segments... Aug 8 04:43:54.314461737 (19h4m28.829564323s) [upload=19696]: Got next segment. Inline: true Aug 8 04:43:54.314468588 (19h4m28.829571166s) [upload=19696]: Waiting for error group managing segments... Aug 8 04:43:54.314513835 (19h4m28.829616411s) [upload=19696]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:43:54.314518357 (19h4m28.829620933s) [upload=19696]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:43:54.314521699 (19h4m28.829624275s) [upload=19696]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:43:54.374490000 (19h4m28.889592577s) [upload=19696]: Done uploading segments... Aug 8 04:43:54.374507640 (19h4m28.889610205s) [upload=19696]: Upload finished. err: <nil> Aug 8 04:44:37.820610246 (19h5m12.335712815s) [upload=19708]: Starting upload Aug 8 04:44:37.820681721 (19h5m12.335784288s) [upload=19708]: Done starting upload Aug 8 04:44:37.820750998 (19h5m12.335853567s) [upload=19708]: Uploading segments... Aug 8 04:44:37.820847572 (19h5m12.335950158s) [upload=19708]: Got next segment. Inline: true Aug 8 04:44:37.820871197 (19h5m12.335973778s) [upload=19708]: Waiting for error group managing segments... Aug 8 04:44:37.820923988 (19h5m12.336026577s) [upload=19708]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:44:37.820930149 (19h5m12.33603273s) [upload=19708]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:44:37.820950094 (19h5m12.336052671s) [upload=19708]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:44:37.891304392 (19h5m12.406406974s) [upload=19708]: Done uploading segments... Aug 8 04:44:37.891324719 (19h5m12.406427302s) [upload=19708]: Upload finished. err: <nil> Aug 8 04:45:49.374287050 (19h6m23.889389635s) [upload=19727]: Starting upload Aug 8 04:45:49.374385480 (19h6m23.889488062s) [upload=19727]: Done starting upload Aug 8 04:45:49.374485186 (19h6m23.889587763s) [upload=19727]: Uploading segments... Aug 8 04:45:49.374553702 (19h6m23.889656288s) [upload=19727]: Got next segment. Inline: true Aug 8 04:45:49.374559271 (19h6m23.889661849s) [upload=19727]: Waiting for error group managing segments... Aug 8 04:45:49.374607801 (19h6m23.889710384s) [upload=19727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:45:49.374613021 (19h6m23.889715604s) [upload=19727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:45:49.374616970 (19h6m23.889719552s) [upload=19727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:45:49.440532379 (19h6m23.955634956s) [upload=19727]: Done uploading segments... Aug 8 04:45:49.440553942 (19h6m23.955656506s) [upload=19727]: Upload finished. err: <nil> Aug 8 04:46:22.148691181 (19h6m56.663793758s) [upload=19736]: Starting upload Aug 8 04:46:22.148731264 (19h6m56.66383385s) [upload=19736]: Done starting upload Aug 8 04:46:22.148779839 (19h6m56.663882416s) [upload=19736]: Uploading segments... Aug 8 04:46:22.148815522 (19h6m56.663918108s) [upload=19736]: Got next segment. Inline: true Aug 8 04:46:22.148819611 (19h6m56.663922186s) [upload=19736]: Waiting for error group managing segments... Aug 8 04:46:22.148853347 (19h6m56.663955925s) [upload=19736]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:46:22.148856905 (19h6m56.663959481s) [upload=19736]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:46:22.148859219 (19h6m56.663961798s) [upload=19736]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:46:22.224160590 (19h6m56.739263173s) [upload=19736]: Done uploading segments... Aug 8 04:46:22.224183380 (19h6m56.739285958s) [upload=19736]: Upload finished. err: <nil> Aug 8 04:46:57.599668727 (19h7m32.114771304s) [upload=19750]: Starting upload Aug 8 04:46:57.599733716 (19h7m32.114836292s) [upload=19750]: Done starting upload Aug 8 04:46:57.599831148 (19h7m32.114933716s) [upload=19750]: Uploading segments... Aug 8 04:46:57.599898194 (19h7m32.115000774s) [upload=19750]: Got next segment. Inline: true Aug 8 04:46:57.599902995 (19h7m32.115005571s) [upload=19750]: Waiting for error group managing segments... Aug 8 04:46:57.599955730 (19h7m32.115058297s) [upload=19750]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:46:57.599960210 (19h7m32.115062786s) [upload=19750]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:46:57.599963339 (19h7m32.115065916s) [upload=19750]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:46:57.661947764 (19h7m32.17705034s) [upload=19750]: Done uploading segments... Aug 8 04:46:57.661964723 (19h7m32.1770673s) [upload=19750]: Upload finished. err: <nil> Aug 8 04:48:07.498218136 (19h8m42.013320702s) [upload=19766]: Starting upload Aug 8 04:48:07.498272608 (19h8m42.013375174s) [upload=19766]: Done starting upload Aug 8 04:48:07.498340076 (19h8m42.013442642s) [upload=19766]: Uploading segments... Aug 8 04:48:07.498377092 (19h8m42.013479678s) [upload=19766]: Got next segment. Inline: true Aug 8 04:48:07.498381514 (19h8m42.013484091s) [upload=19766]: Waiting for error group managing segments... Aug 8 04:48:07.498422115 (19h8m42.013524681s) [upload=19766]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:48:07.498426401 (19h8m42.013528979s) [upload=19766]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:48:07.498429474 (19h8m42.01353205s) [upload=19766]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:48:07.573834459 (19h8m42.088937036s) [upload=19766]: Done uploading segments... Aug 8 04:48:07.573849292 (19h8m42.088951861s) [upload=19766]: Upload finished. err: <nil> Aug 8 04:48:24.131081943 (19h8m58.646184521s) [upload=19773]: Starting upload Aug 8 04:48:24.131135304 (19h8m58.646237872s) [upload=19773]: Done starting upload Aug 8 04:48:24.131203832 (19h8m58.646306401s) [upload=19773]: Uploading segments... Aug 8 04:48:24.131242000 (19h8m58.646344585s) [upload=19773]: Got next segment. Inline: true Aug 8 04:48:24.131246356 (19h8m58.646348932s) [upload=19773]: Waiting for error group managing segments... Aug 8 04:48:24.131298903 (19h8m58.646401482s) [upload=19773]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:48:24.131304610 (19h8m58.646407189s) [upload=19773]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:48:24.131307703 (19h8m58.646410279s) [upload=19773]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:48:24.189165262 (19h8m58.704267839s) [upload=19773]: Done uploading segments... Aug 8 04:48:24.189182600 (19h8m58.704285176s) [upload=19773]: Upload finished. err: <nil> Aug 8 04:49:30.179743426 (19h10m4.69484601s) [upload=19792]: Starting upload Aug 8 04:49:30.179830624 (19h10m4.694933205s) [upload=19792]: Done starting upload Aug 8 04:49:30.179932276 (19h10m4.695034844s) [upload=19792]: Uploading segments... Aug 8 04:49:30.180011264 (19h10m4.69511385s) [upload=19792]: Got next segment. Inline: true Aug 8 04:49:30.180031508 (19h10m4.695134094s) [upload=19792]: Waiting for error group managing segments... Aug 8 04:49:30.180083780 (19h10m4.695186362s) [upload=19792]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:49:30.180089451 (19h10m4.695192035s) [upload=19792]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:49:30.180107234 (19h10m4.695209811s) [upload=19792]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:49:30.255066803 (19h10m4.770169372s) [upload=19792]: Done uploading segments... Aug 8 04:49:30.255097834 (19h10m4.770200412s) [upload=19792]: Upload finished. err: <nil> Aug 8 04:49:49.722537438 (19h10m24.237640014s) [upload=19800]: Starting upload Aug 8 04:49:49.722597342 (19h10m24.237699917s) [upload=19800]: Done starting upload Aug 8 04:49:49.722664052 (19h10m24.237766615s) [upload=19800]: Uploading segments... Aug 8 04:49:49.722715327 (19h10m24.23781791s) [upload=19800]: Got next segment. Inline: true Aug 8 04:49:49.722719940 (19h10m24.237822515s) [upload=19800]: Waiting for error group managing segments... Aug 8 04:49:49.722753934 (19h10m24.23785651s) [upload=19800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:49:49.722758369 (19h10m24.237860931s) [upload=19800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:49:49.722815656 (19h10m24.237918234s) [upload=19800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:49:49.824454883 (19h10m24.339557452s) [upload=19800]: Done uploading segments... Aug 8 04:49:49.824470680 (19h10m24.339573247s) [upload=19800]: Upload finished. err: <nil> Duration: 189.110115ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 450.196684ms FAIL (2025-08-08 05:26:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 450.221521ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 633.011826ms FAIL (2025-08-08 05:25:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 633.033071ms edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 31.228ms target: https://us1.storj.io/login FAIL (2025-08-08 05:25:47 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 31.271681ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 575.93262ms FAIL (2025-08-08 05:25:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 575.960935ms edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 27.319914ms target: https://us1.storj.io/login FAIL (2025-08-08 05:25:23 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 27.365312ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 215.421814ms FAIL (2025-08-08 05:25:20 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== uestItem_ObjectCommit Aug 8 04:42:16.180307652 (19h2m50.695410219s) [upload=19671]: Done uploading segments... Aug 8 04:42:16.180326351 (19h2m50.695428913s) [upload=19671]: Upload finished. err: <nil> Aug 8 04:42:41.083579476 (19h3m15.598682039s) [upload=19678]: Starting upload Aug 8 04:42:41.083658806 (19h3m15.598761384s) [upload=19678]: Done starting upload Aug 8 04:42:41.083736126 (19h3m15.598838696s) [upload=19678]: Uploading segments... Aug 8 04:42:41.083798735 (19h3m15.59890132s) [upload=19678]: Got next segment. Inline: true Aug 8 04:42:41.083805351 (19h3m15.598907934s) [upload=19678]: Waiting for error group managing segments... Aug 8 04:42:41.083894019 (19h3m15.598996595s) [upload=19678]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:42:41.083899702 (19h3m15.599002278s) [upload=19678]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:42:41.083903543 (19h3m15.59900612s) [upload=19678]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:42:41.147259315 (19h3m15.662361882s) [upload=19678]: Done uploading segments... Aug 8 04:42:41.147276213 (19h3m15.66237879s) [upload=19678]: Upload finished. err: <nil> Aug 8 04:43:54.314265905 (19h4m28.829368481s) [upload=19696]: Starting upload Aug 8 04:43:54.314342572 (19h4m28.829445149s) [upload=19696]: Done starting upload Aug 8 04:43:54.314412786 (19h4m28.829515355s) [upload=19696]: Uploading segments... Aug 8 04:43:54.314461737 (19h4m28.829564323s) [upload=19696]: Got next segment. Inline: true Aug 8 04:43:54.314468588 (19h4m28.829571166s) [upload=19696]: Waiting for error group managing segments... Aug 8 04:43:54.314513835 (19h4m28.829616411s) [upload=19696]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:43:54.314518357 (19h4m28.829620933s) [upload=19696]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:43:54.314521699 (19h4m28.829624275s) [upload=19696]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:43:54.374490000 (19h4m28.889592577s) [upload=19696]: Done uploading segments... Aug 8 04:43:54.374507640 (19h4m28.889610205s) [upload=19696]: Upload finished. err: <nil> Aug 8 04:44:37.820610246 (19h5m12.335712815s) [upload=19708]: Starting upload Aug 8 04:44:37.820681721 (19h5m12.335784288s) [upload=19708]: Done starting upload Aug 8 04:44:37.820750998 (19h5m12.335853567s) [upload=19708]: Uploading segments... Aug 8 04:44:37.820847572 (19h5m12.335950158s) [upload=19708]: Got next segment. Inline: true Aug 8 04:44:37.820871197 (19h5m12.335973778s) [upload=19708]: Waiting for error group managing segments... Aug 8 04:44:37.820923988 (19h5m12.336026577s) [upload=19708]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:44:37.820930149 (19h5m12.33603273s) [upload=19708]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:44:37.820950094 (19h5m12.336052671s) [upload=19708]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:44:37.891304392 (19h5m12.406406974s) [upload=19708]: Done uploading segments... Aug 8 04:44:37.891324719 (19h5m12.406427302s) [upload=19708]: Upload finished. err: <nil> Aug 8 04:45:49.374287050 (19h6m23.889389635s) [upload=19727]: Starting upload Aug 8 04:45:49.374385480 (19h6m23.889488062s) [upload=19727]: Done starting upload Aug 8 04:45:49.374485186 (19h6m23.889587763s) [upload=19727]: Uploading segments... Aug 8 04:45:49.374553702 (19h6m23.889656288s) [upload=19727]: Got next segment. Inline: true Aug 8 04:45:49.374559271 (19h6m23.889661849s) [upload=19727]: Waiting for error group managing segments... Aug 8 04:45:49.374607801 (19h6m23.889710384s) [upload=19727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:45:49.374613021 (19h6m23.889715604s) [upload=19727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:45:49.374616970 (19h6m23.889719552s) [upload=19727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:45:49.440532379 (19h6m23.955634956s) [upload=19727]: Done uploading segments... Aug 8 04:45:49.440553942 (19h6m23.955656506s) [upload=19727]: Upload finished. err: <nil> Aug 8 04:46:22.148691181 (19h6m56.663793758s) [upload=19736]: Starting upload Aug 8 04:46:22.148731264 (19h6m56.66383385s) [upload=19736]: Done starting upload Aug 8 04:46:22.148779839 (19h6m56.663882416s) [upload=19736]: Uploading segments... Aug 8 04:46:22.148815522 (19h6m56.663918108s) [upload=19736]: Got next segment. Inline: true Aug 8 04:46:22.148819611 (19h6m56.663922186s) [upload=19736]: Waiting for error group managing segments... Aug 8 04:46:22.148853347 (19h6m56.663955925s) [upload=19736]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:46:22.148856905 (19h6m56.663959481s) [upload=19736]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:46:22.148859219 (19h6m56.663961798s) [upload=19736]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:46:22.224160590 (19h6m56.739263173s) [upload=19736]: Done uploading segments... Aug 8 04:46:22.224183380 (19h6m56.739285958s) [upload=19736]: Upload finished. err: <nil> Aug 8 04:46:57.599668727 (19h7m32.114771304s) [upload=19750]: Starting upload Aug 8 04:46:57.599733716 (19h7m32.114836292s) [upload=19750]: Done starting upload Aug 8 04:46:57.599831148 (19h7m32.114933716s) [upload=19750]: Uploading segments... Aug 8 04:46:57.599898194 (19h7m32.115000774s) [upload=19750]: Got next segment. Inline: true Aug 8 04:46:57.599902995 (19h7m32.115005571s) [upload=19750]: Waiting for error group managing segments... Aug 8 04:46:57.599955730 (19h7m32.115058297s) [upload=19750]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:46:57.599960210 (19h7m32.115062786s) [upload=19750]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:46:57.599963339 (19h7m32.115065916s) [upload=19750]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:46:57.661947764 (19h7m32.17705034s) [upload=19750]: Done uploading segments... Aug 8 04:46:57.661964723 (19h7m32.1770673s) [upload=19750]: Upload finished. err: <nil> Aug 8 04:48:07.498218136 (19h8m42.013320702s) [upload=19766]: Starting upload Aug 8 04:48:07.498272608 (19h8m42.013375174s) [upload=19766]: Done starting upload Aug 8 04:48:07.498340076 (19h8m42.013442642s) [upload=19766]: Uploading segments... Aug 8 04:48:07.498377092 (19h8m42.013479678s) [upload=19766]: Got next segment. Inline: true Aug 8 04:48:07.498381514 (19h8m42.013484091s) [upload=19766]: Waiting for error group managing segments... Aug 8 04:48:07.498422115 (19h8m42.013524681s) [upload=19766]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:48:07.498426401 (19h8m42.013528979s) [upload=19766]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:48:07.498429474 (19h8m42.01353205s) [upload=19766]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:48:07.573834459 (19h8m42.088937036s) [upload=19766]: Done uploading segments... Aug 8 04:48:07.573849292 (19h8m42.088951861s) [upload=19766]: Upload finished. err: <nil> Aug 8 04:48:24.131081943 (19h8m58.646184521s) [upload=19773]: Starting upload Aug 8 04:48:24.131135304 (19h8m58.646237872s) [upload=19773]: Done starting upload Aug 8 04:48:24.131203832 (19h8m58.646306401s) [upload=19773]: Uploading segments... Aug 8 04:48:24.131242000 (19h8m58.646344585s) [upload=19773]: Got next segment. Inline: true Aug 8 04:48:24.131246356 (19h8m58.646348932s) [upload=19773]: Waiting for error group managing segments... Aug 8 04:48:24.131298903 (19h8m58.646401482s) [upload=19773]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:48:24.131304610 (19h8m58.646407189s) [upload=19773]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:48:24.131307703 (19h8m58.646410279s) [upload=19773]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:48:24.189165262 (19h8m58.704267839s) [upload=19773]: Done uploading segments... Aug 8 04:48:24.189182600 (19h8m58.704285176s) [upload=19773]: Upload finished. err: <nil> Aug 8 04:49:30.179743426 (19h10m4.69484601s) [upload=19792]: Starting upload Aug 8 04:49:30.179830624 (19h10m4.694933205s) [upload=19792]: Done starting upload Aug 8 04:49:30.179932276 (19h10m4.695034844s) [upload=19792]: Uploading segments... Aug 8 04:49:30.180011264 (19h10m4.69511385s) [upload=19792]: Got next segment. Inline: true Aug 8 04:49:30.180031508 (19h10m4.695134094s) [upload=19792]: Waiting for error group managing segments... Aug 8 04:49:30.180083780 (19h10m4.695186362s) [upload=19792]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:49:30.180089451 (19h10m4.695192035s) [upload=19792]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:49:30.180107234 (19h10m4.695209811s) [upload=19792]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:49:30.255066803 (19h10m4.770169372s) [upload=19792]: Done uploading segments... Aug 8 04:49:30.255097834 (19h10m4.770200412s) [upload=19792]: Upload finished. err: <nil> Aug 8 04:49:49.722537438 (19h10m24.237640014s) [upload=19800]: Starting upload Aug 8 04:49:49.722597342 (19h10m24.237699917s) [upload=19800]: Done starting upload Aug 8 04:49:49.722664052 (19h10m24.237766615s) [upload=19800]: Uploading segments... Aug 8 04:49:49.722715327 (19h10m24.23781791s) [upload=19800]: Got next segment. Inline: true Aug 8 04:49:49.722719940 (19h10m24.237822515s) [upload=19800]: Waiting for error group managing segments... Aug 8 04:49:49.722753934 (19h10m24.23785651s) [upload=19800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:49:49.722758369 (19h10m24.237860931s) [upload=19800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:49:49.722815656 (19h10m24.237918234s) [upload=19800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:49:49.824454883 (19h10m24.339557452s) [upload=19800]: Done uploading segments... Aug 8 04:49:49.824470680 (19h10m24.339573247s) [upload=19800]: Upload finished. err: <nil> Duration: 215.465832ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X..........X...........] duration: 382.055581ms FAIL (2025-08-08 05:25:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== TNVS3YHCRQE5AP3GTOWQZJD2F2IXHRHIJZCKZAGA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.396619078 (19h36m18.911721655s) [noise=true , address=104.36.82.62:4421 , piece_id=GWLO2QUJEPUYB5SKGXYY32HNVTQTFM7LLJNOO7WIJOSYKYMXDJMQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397045508 (19h36m18.91214809s) [noise=true , address=104.36.82.47:4529 , piece_id=BRL5VAKSFPTIWSBEC3N5ZZFL5YBYA4WTMPG4PN7SPQCLF2KOHDJQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397160558 (19h36m18.912263143s) [noise=true , address=104.36.82.43:4840 , piece_id=R73RV4DJOGZSDDPV3QSXMTKTJ6MQR72XBNXYAEJG5L7I2E43U4HQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397451153 (19h36m18.912553734s) [noise=true , address=104.36.82.34:4573 , piece_id=KEGNFSTAEF5YBDXO32577DD7IFWZNSZG5SDSPJFTDOKPWMU7NVFQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397679365 (19h36m18.912781931s) [noise=true , address=104.36.82.61:4385 , piece_id=XWK5KD27JAWA7MRDIG5OXUUXBLVY72AVDBR2JWOKUNRUON5BC6LA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397898222 (19h36m18.9130008s) [noise=true , address=104.36.82.8:4984 , piece_id=NGMFUDZN4M2ONJQDH5EML2LRX7WBHSZLMLEHU6335YVFJ6TK7CCQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.398125648 (19h36m18.913228218s) [noise=true , address=64.49.13.169:4707 , piece_id=WTQM4UP3B655VDT55DX26KE7WMJP7QYVBWWUHH7PALIX75HBN2ZQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.398278438 (19h36m18.913381022s) [noise=true , address=104.36.82.37:4655 , piece_id=FULT7QYOBIRP5SGZ54HWYDHET74J5UJAYYUOC5AYE5IBWRS6ZBFQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.398652749 (19h36m18.913755329s) [noise=true , address=104.36.82.46:4493 , piece_id=HNGMHYYJCUEF5WGYT356AEKZDY6IZUJX5WN5JVJ36NSC5IEC6AGA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399000971 (19h36m18.914103551s) [noise=true , address=104.36.82.23:4460 , piece_id=3UHZQH52DDCDDWHK6C65ZJHKTKL2YUZUW3V2M7URKGTYOOJIALLA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399455504 (19h36m18.914558137s) [noise=true , address=104.36.82.12:4180 , piece_id=ILG74TZ5BFRDRVYKVPPM2VOVOZ4IXFX4RILK3Y5QFKT7W6J6PXIQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399717456 (19h36m18.914820039s) [noise=true , address=104.36.82.45:4928 , piece_id=KHGBLGWNAAG5722YT6XP6U2FA2GK7WJE7MT2RNMGFPYXSRFEIM3Q, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399736184 (19h36m18.914838767s) [noise=true , address=104.36.82.60:4349 , piece_id=L6BGCU7M6BX74OPTBCSQBJ3PMOBRN3W562T7EVR3DD6UECY67IRQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399780848 (19h36m18.914883425s) [noise=true , address=104.36.82.58:4298 , piece_id=KANX4YVAKK7RYWKQKUXRGMEBPYREPUZECM7OTPP6GBEG6I57XZ7Q, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.400090065 (19h36m18.915192652s) [noise=true , address=104.36.82.53:4123 , piece_id=MDKE7CTOUIFOC4ENQQ6RXJW6FIEMKRHW2GVIRFUBT7G22WUSXCNA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.400430542 (19h36m18.915533108s) [noise=true , address=64.49.13.154:4934 , piece_id=B5JFP2WFQW65PPA6C7SOO6STYYYQKEANV4Z5UDFDGWWIUAWMUN3A, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.401080440 (19h36m18.916183005s) [noise=true , address=104.36.82.17:4360 , piece_id=TVVJIC7A5UTX3TLYJZ4XEEYLUFWK5JRETR4J2MW6SKYISP7J44SA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.492815163 (19h36m19.007917733s) [upload=20259]: Next returned nil segment Aug 8 05:15:44.492830313 (19h36m19.007932879s) [upload=20259]: Waiting for error group managing segments... Aug 8 05:15:44.503634225 (19h36m19.018736809s) [noise=true , address=104.36.82.58:4298 , piece_id=KANX4YVAKK7RYWKQKUXRGMEBPYREPUZECM7OTPP6GBEG6I57XZ7Q, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.504718521 (19h36m19.019821102s) [noise=true , address=104.36.82.23:4460 , piece_id=3UHZQH52DDCDDWHK6C65ZJHKTKL2YUZUW3V2M7URKGTYOOJIALLA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.504983984 (19h36m19.020086552s) [noise=true , address=104.36.82.60:4349 , piece_id=L6BGCU7M6BX74OPTBCSQBJ3PMOBRN3W562T7EVR3DD6UECY67IRQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.505253948 (19h36m19.020356524s) [noise=true , address=104.36.82.45:4928 , piece_id=KHGBLGWNAAG5722YT6XP6U2FA2GK7WJE7MT2RNMGFPYXSRFEIM3Q, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.505859429 (19h36m19.020962003s) [noise=true , address=104.36.82.34:4573 , piece_id=KEGNFSTAEF5YBDXO32577DD7IFWZNSZG5SDSPJFTDOKPWMU7NVFQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.506188048 (19h36m19.021290625s) [noise=true , address=104.36.82.46:4493 , piece_id=HNGMHYYJCUEF5WGYT356AEKZDY6IZUJX5WN5JVJ36NSC5IEC6AGA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.506966629 (19h36m19.022069192s) [noise=true , address=104.36.82.43:4840 , piece_id=R73RV4DJOGZSDDPV3QSXMTKTJ6MQR72XBNXYAEJG5L7I2E43U4HQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.507255656 (19h36m19.022358218s) [noise=true , address=104.36.82.37:4655 , piece_id=FULT7QYOBIRP5SGZ54HWYDHET74J5UJAYYUOC5AYE5IBWRS6ZBFQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.507914747 (19h36m19.02301733s) [noise=true , address=104.36.82.53:4123 , piece_id=MDKE7CTOUIFOC4ENQQ6RXJW6FIEMKRHW2GVIRFUBT7G22WUSXCNA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.508934794 (19h36m19.024037376s) [noise=true , address=104.36.82.8:4984 , piece_id=NGMFUDZN4M2ONJQDH5EML2LRX7WBHSZLMLEHU6335YVFJ6TK7CCQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.509462525 (19h36m19.024565093s) [noise=true , address=104.36.82.12:4180 , piece_id=ILG74TZ5BFRDRVYKVPPM2VOVOZ4IXFX4RILK3Y5QFKT7W6J6PXIQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.509503916 (19h36m19.02460648s) [noise=true , address=104.36.82.62:4421 , piece_id=GWLO2QUJEPUYB5SKGXYY32HNVTQTFM7LLJNOO7WIJOSYKYMXDJMQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.509998107 (19h36m19.025100676s) [noise=true , address=104.36.82.47:4529 , piece_id=BRL5VAKSFPTIWSBEC3N5ZZFL5YBYA4WTMPG4PN7SPQCLF2KOHDJQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.510133131 (19h36m19.025235694s) [noise=true , address=104.36.82.2:4764 , piece_id=4QZF2DZ36ONDTNVS3YHCRQE5AP3GTOWQZJD2F2IXHRHIJZCKZAGA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.510142680 (19h36m19.025245251s) [seg_pos={0 0}, upload=20259]: Segment reached optimal threshold of 14 pieces. Aug 8 05:15:44.510939805 (19h36m19.026042372s) [noise=true , address=104.36.82.61:4385 , piece_id=XWK5KD27JAWA7MRDIG5OXUUXBLVY72AVDBR2JWOKUNRUON5BC6LA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 8 05:15:44.511262091 (19h36m19.026364669s) [noise=true , address=104.36.82.17:4360 , piece_id=TVVJIC7A5UTX3TLYJZ4XEEYLUFWK5JRETR4J2MW6SKYISP7J44SA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.511421518 (19h36m19.026524102s) [noise=true , address=64.49.13.169:4707 , piece_id=WTQM4UP3B655VDT55DX26KE7WMJP7QYVBWWUHH7PALIX75HBN2ZQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: read tcp 159.223.143.39:32802->64.49.13.169:4707: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:15:44.511435693 (19h36m19.026538256s) [noise=true , address=64.49.13.154:4934 , piece_id=B5JFP2WFQW65PPA6C7SOO6STYYYQKEANV4Z5UDFDGWWIUAWMUN3A, seg_pos={0 0}, upload=20259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: read tcp 159.223.143.39:49428->64.49.13.154:4934: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:15:44.511449276 (19h36m19.026551856s) [seg_pos={0 0}, upload=20259]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 05:15:44.511530782 (19h36m19.026633369s) [upload=20259]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:15:44.511536651 (19h36m19.026639235s) [upload=20259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:15:44.590856427 (19h36m19.105959005s) [upload=20259]: Done uploading segments... Aug 8 05:15:44.590921713 (19h36m19.106024292s) [upload=20259]: Upload finished. err: <nil> Aug 8 05:16:32.714498510 (19h37m7.229601094s) [upload=20272]: Starting upload Aug 8 05:16:32.714552893 (19h37m7.229655473s) [upload=20272]: Done starting upload Aug 8 05:16:32.714903852 (19h37m7.230006423s) [upload=20272]: Uploading segments... Aug 8 05:16:32.714955229 (19h37m7.230057809s) [upload=20272]: Got next segment. Inline: false Aug 8 05:16:32.714989454 (19h37m7.230092036s) [upload=20272]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:16:32.714994640 (19h37m7.230097224s) [upload=20272]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:16:32.723976411 (19h37m7.239078998s) [upload=20272]: Next segment err: metaclient: Too Many Requests Aug 8 05:16:32.723996518 (19h37m7.239099103s) [upload=20272]: Done uploading segments... Aug 8 05:16:32.724012336 (19h37m7.239114909s) [upload=20272]: Upload finished. err: metaclient: Too Many Requests Duration: 382.08457ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 28.670334ms target: https://us1.storj.io/login FAIL (2025-08-08 05:25:00 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 28.694214ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 481.969ms FAIL (2025-08-08 05:24:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 481.987011ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 190.269326ms FAIL (2025-08-08 05:24:11 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== uestItem_ObjectCommit Aug 8 04:42:16.180307652 (19h2m50.695410219s) [upload=19671]: Done uploading segments... Aug 8 04:42:16.180326351 (19h2m50.695428913s) [upload=19671]: Upload finished. err: <nil> Aug 8 04:42:41.083579476 (19h3m15.598682039s) [upload=19678]: Starting upload Aug 8 04:42:41.083658806 (19h3m15.598761384s) [upload=19678]: Done starting upload Aug 8 04:42:41.083736126 (19h3m15.598838696s) [upload=19678]: Uploading segments... Aug 8 04:42:41.083798735 (19h3m15.59890132s) [upload=19678]: Got next segment. Inline: true Aug 8 04:42:41.083805351 (19h3m15.598907934s) [upload=19678]: Waiting for error group managing segments... Aug 8 04:42:41.083894019 (19h3m15.598996595s) [upload=19678]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:42:41.083899702 (19h3m15.599002278s) [upload=19678]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:42:41.083903543 (19h3m15.59900612s) [upload=19678]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:42:41.147259315 (19h3m15.662361882s) [upload=19678]: Done uploading segments... Aug 8 04:42:41.147276213 (19h3m15.66237879s) [upload=19678]: Upload finished. err: <nil> Aug 8 04:43:54.314265905 (19h4m28.829368481s) [upload=19696]: Starting upload Aug 8 04:43:54.314342572 (19h4m28.829445149s) [upload=19696]: Done starting upload Aug 8 04:43:54.314412786 (19h4m28.829515355s) [upload=19696]: Uploading segments... Aug 8 04:43:54.314461737 (19h4m28.829564323s) [upload=19696]: Got next segment. Inline: true Aug 8 04:43:54.314468588 (19h4m28.829571166s) [upload=19696]: Waiting for error group managing segments... Aug 8 04:43:54.314513835 (19h4m28.829616411s) [upload=19696]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:43:54.314518357 (19h4m28.829620933s) [upload=19696]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:43:54.314521699 (19h4m28.829624275s) [upload=19696]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:43:54.374490000 (19h4m28.889592577s) [upload=19696]: Done uploading segments... Aug 8 04:43:54.374507640 (19h4m28.889610205s) [upload=19696]: Upload finished. err: <nil> Aug 8 04:44:37.820610246 (19h5m12.335712815s) [upload=19708]: Starting upload Aug 8 04:44:37.820681721 (19h5m12.335784288s) [upload=19708]: Done starting upload Aug 8 04:44:37.820750998 (19h5m12.335853567s) [upload=19708]: Uploading segments... Aug 8 04:44:37.820847572 (19h5m12.335950158s) [upload=19708]: Got next segment. Inline: true Aug 8 04:44:37.820871197 (19h5m12.335973778s) [upload=19708]: Waiting for error group managing segments... Aug 8 04:44:37.820923988 (19h5m12.336026577s) [upload=19708]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:44:37.820930149 (19h5m12.33603273s) [upload=19708]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:44:37.820950094 (19h5m12.336052671s) [upload=19708]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:44:37.891304392 (19h5m12.406406974s) [upload=19708]: Done uploading segments... Aug 8 04:44:37.891324719 (19h5m12.406427302s) [upload=19708]: Upload finished. err: <nil> Aug 8 04:45:49.374287050 (19h6m23.889389635s) [upload=19727]: Starting upload Aug 8 04:45:49.374385480 (19h6m23.889488062s) [upload=19727]: Done starting upload Aug 8 04:45:49.374485186 (19h6m23.889587763s) [upload=19727]: Uploading segments... Aug 8 04:45:49.374553702 (19h6m23.889656288s) [upload=19727]: Got next segment. Inline: true Aug 8 04:45:49.374559271 (19h6m23.889661849s) [upload=19727]: Waiting for error group managing segments... Aug 8 04:45:49.374607801 (19h6m23.889710384s) [upload=19727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:45:49.374613021 (19h6m23.889715604s) [upload=19727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:45:49.374616970 (19h6m23.889719552s) [upload=19727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:45:49.440532379 (19h6m23.955634956s) [upload=19727]: Done uploading segments... Aug 8 04:45:49.440553942 (19h6m23.955656506s) [upload=19727]: Upload finished. err: <nil> Aug 8 04:46:22.148691181 (19h6m56.663793758s) [upload=19736]: Starting upload Aug 8 04:46:22.148731264 (19h6m56.66383385s) [upload=19736]: Done starting upload Aug 8 04:46:22.148779839 (19h6m56.663882416s) [upload=19736]: Uploading segments... Aug 8 04:46:22.148815522 (19h6m56.663918108s) [upload=19736]: Got next segment. Inline: true Aug 8 04:46:22.148819611 (19h6m56.663922186s) [upload=19736]: Waiting for error group managing segments... Aug 8 04:46:22.148853347 (19h6m56.663955925s) [upload=19736]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:46:22.148856905 (19h6m56.663959481s) [upload=19736]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:46:22.148859219 (19h6m56.663961798s) [upload=19736]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:46:22.224160590 (19h6m56.739263173s) [upload=19736]: Done uploading segments... Aug 8 04:46:22.224183380 (19h6m56.739285958s) [upload=19736]: Upload finished. err: <nil> Aug 8 04:46:57.599668727 (19h7m32.114771304s) [upload=19750]: Starting upload Aug 8 04:46:57.599733716 (19h7m32.114836292s) [upload=19750]: Done starting upload Aug 8 04:46:57.599831148 (19h7m32.114933716s) [upload=19750]: Uploading segments... Aug 8 04:46:57.599898194 (19h7m32.115000774s) [upload=19750]: Got next segment. Inline: true Aug 8 04:46:57.599902995 (19h7m32.115005571s) [upload=19750]: Waiting for error group managing segments... Aug 8 04:46:57.599955730 (19h7m32.115058297s) [upload=19750]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:46:57.599960210 (19h7m32.115062786s) [upload=19750]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:46:57.599963339 (19h7m32.115065916s) [upload=19750]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:46:57.661947764 (19h7m32.17705034s) [upload=19750]: Done uploading segments... Aug 8 04:46:57.661964723 (19h7m32.1770673s) [upload=19750]: Upload finished. err: <nil> Aug 8 04:48:07.498218136 (19h8m42.013320702s) [upload=19766]: Starting upload Aug 8 04:48:07.498272608 (19h8m42.013375174s) [upload=19766]: Done starting upload Aug 8 04:48:07.498340076 (19h8m42.013442642s) [upload=19766]: Uploading segments... Aug 8 04:48:07.498377092 (19h8m42.013479678s) [upload=19766]: Got next segment. Inline: true Aug 8 04:48:07.498381514 (19h8m42.013484091s) [upload=19766]: Waiting for error group managing segments... Aug 8 04:48:07.498422115 (19h8m42.013524681s) [upload=19766]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:48:07.498426401 (19h8m42.013528979s) [upload=19766]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:48:07.498429474 (19h8m42.01353205s) [upload=19766]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:48:07.573834459 (19h8m42.088937036s) [upload=19766]: Done uploading segments... Aug 8 04:48:07.573849292 (19h8m42.088951861s) [upload=19766]: Upload finished. err: <nil> Aug 8 04:48:24.131081943 (19h8m58.646184521s) [upload=19773]: Starting upload Aug 8 04:48:24.131135304 (19h8m58.646237872s) [upload=19773]: Done starting upload Aug 8 04:48:24.131203832 (19h8m58.646306401s) [upload=19773]: Uploading segments... Aug 8 04:48:24.131242000 (19h8m58.646344585s) [upload=19773]: Got next segment. Inline: true Aug 8 04:48:24.131246356 (19h8m58.646348932s) [upload=19773]: Waiting for error group managing segments... Aug 8 04:48:24.131298903 (19h8m58.646401482s) [upload=19773]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:48:24.131304610 (19h8m58.646407189s) [upload=19773]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:48:24.131307703 (19h8m58.646410279s) [upload=19773]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:48:24.189165262 (19h8m58.704267839s) [upload=19773]: Done uploading segments... Aug 8 04:48:24.189182600 (19h8m58.704285176s) [upload=19773]: Upload finished. err: <nil> Aug 8 04:49:30.179743426 (19h10m4.69484601s) [upload=19792]: Starting upload Aug 8 04:49:30.179830624 (19h10m4.694933205s) [upload=19792]: Done starting upload Aug 8 04:49:30.179932276 (19h10m4.695034844s) [upload=19792]: Uploading segments... Aug 8 04:49:30.180011264 (19h10m4.69511385s) [upload=19792]: Got next segment. Inline: true Aug 8 04:49:30.180031508 (19h10m4.695134094s) [upload=19792]: Waiting for error group managing segments... Aug 8 04:49:30.180083780 (19h10m4.695186362s) [upload=19792]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:49:30.180089451 (19h10m4.695192035s) [upload=19792]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:49:30.180107234 (19h10m4.695209811s) [upload=19792]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:49:30.255066803 (19h10m4.770169372s) [upload=19792]: Done uploading segments... Aug 8 04:49:30.255097834 (19h10m4.770200412s) [upload=19792]: Upload finished. err: <nil> Aug 8 04:49:49.722537438 (19h10m24.237640014s) [upload=19800]: Starting upload Aug 8 04:49:49.722597342 (19h10m24.237699917s) [upload=19800]: Done starting upload Aug 8 04:49:49.722664052 (19h10m24.237766615s) [upload=19800]: Uploading segments... Aug 8 04:49:49.722715327 (19h10m24.23781791s) [upload=19800]: Got next segment. Inline: true Aug 8 04:49:49.722719940 (19h10m24.237822515s) [upload=19800]: Waiting for error group managing segments... Aug 8 04:49:49.722753934 (19h10m24.23785651s) [upload=19800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:49:49.722758369 (19h10m24.237860931s) [upload=19800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:49:49.722815656 (19h10m24.237918234s) [upload=19800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:49:49.824454883 (19h10m24.339557452s) [upload=19800]: Done uploading segments... Aug 8 04:49:49.824470680 (19h10m24.339573247s) [upload=19800]: Upload finished. err: <nil> Duration: 190.296306ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 32.773524ms target: https://us1.storj.io/login FAIL (2025-08-08 05:24:08 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 32.791117ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................X..........X..........] duration: 602.392672ms FAIL (2025-08-08 05:24:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== TNVS3YHCRQE5AP3GTOWQZJD2F2IXHRHIJZCKZAGA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.396619078 (19h36m18.911721655s) [noise=true , address=104.36.82.62:4421 , piece_id=GWLO2QUJEPUYB5SKGXYY32HNVTQTFM7LLJNOO7WIJOSYKYMXDJMQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397045508 (19h36m18.91214809s) [noise=true , address=104.36.82.47:4529 , piece_id=BRL5VAKSFPTIWSBEC3N5ZZFL5YBYA4WTMPG4PN7SPQCLF2KOHDJQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397160558 (19h36m18.912263143s) [noise=true , address=104.36.82.43:4840 , piece_id=R73RV4DJOGZSDDPV3QSXMTKTJ6MQR72XBNXYAEJG5L7I2E43U4HQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397451153 (19h36m18.912553734s) [noise=true , address=104.36.82.34:4573 , piece_id=KEGNFSTAEF5YBDXO32577DD7IFWZNSZG5SDSPJFTDOKPWMU7NVFQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397679365 (19h36m18.912781931s) [noise=true , address=104.36.82.61:4385 , piece_id=XWK5KD27JAWA7MRDIG5OXUUXBLVY72AVDBR2JWOKUNRUON5BC6LA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397898222 (19h36m18.9130008s) [noise=true , address=104.36.82.8:4984 , piece_id=NGMFUDZN4M2ONJQDH5EML2LRX7WBHSZLMLEHU6335YVFJ6TK7CCQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.398125648 (19h36m18.913228218s) [noise=true , address=64.49.13.169:4707 , piece_id=WTQM4UP3B655VDT55DX26KE7WMJP7QYVBWWUHH7PALIX75HBN2ZQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.398278438 (19h36m18.913381022s) [noise=true , address=104.36.82.37:4655 , piece_id=FULT7QYOBIRP5SGZ54HWYDHET74J5UJAYYUOC5AYE5IBWRS6ZBFQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.398652749 (19h36m18.913755329s) [noise=true , address=104.36.82.46:4493 , piece_id=HNGMHYYJCUEF5WGYT356AEKZDY6IZUJX5WN5JVJ36NSC5IEC6AGA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399000971 (19h36m18.914103551s) [noise=true , address=104.36.82.23:4460 , piece_id=3UHZQH52DDCDDWHK6C65ZJHKTKL2YUZUW3V2M7URKGTYOOJIALLA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399455504 (19h36m18.914558137s) [noise=true , address=104.36.82.12:4180 , piece_id=ILG74TZ5BFRDRVYKVPPM2VOVOZ4IXFX4RILK3Y5QFKT7W6J6PXIQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399717456 (19h36m18.914820039s) [noise=true , address=104.36.82.45:4928 , piece_id=KHGBLGWNAAG5722YT6XP6U2FA2GK7WJE7MT2RNMGFPYXSRFEIM3Q, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399736184 (19h36m18.914838767s) [noise=true , address=104.36.82.60:4349 , piece_id=L6BGCU7M6BX74OPTBCSQBJ3PMOBRN3W562T7EVR3DD6UECY67IRQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399780848 (19h36m18.914883425s) [noise=true , address=104.36.82.58:4298 , piece_id=KANX4YVAKK7RYWKQKUXRGMEBPYREPUZECM7OTPP6GBEG6I57XZ7Q, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.400090065 (19h36m18.915192652s) [noise=true , address=104.36.82.53:4123 , piece_id=MDKE7CTOUIFOC4ENQQ6RXJW6FIEMKRHW2GVIRFUBT7G22WUSXCNA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.400430542 (19h36m18.915533108s) [noise=true , address=64.49.13.154:4934 , piece_id=B5JFP2WFQW65PPA6C7SOO6STYYYQKEANV4Z5UDFDGWWIUAWMUN3A, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.401080440 (19h36m18.916183005s) [noise=true , address=104.36.82.17:4360 , piece_id=TVVJIC7A5UTX3TLYJZ4XEEYLUFWK5JRETR4J2MW6SKYISP7J44SA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.492815163 (19h36m19.007917733s) [upload=20259]: Next returned nil segment Aug 8 05:15:44.492830313 (19h36m19.007932879s) [upload=20259]: Waiting for error group managing segments... Aug 8 05:15:44.503634225 (19h36m19.018736809s) [noise=true , address=104.36.82.58:4298 , piece_id=KANX4YVAKK7RYWKQKUXRGMEBPYREPUZECM7OTPP6GBEG6I57XZ7Q, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.504718521 (19h36m19.019821102s) [noise=true , address=104.36.82.23:4460 , piece_id=3UHZQH52DDCDDWHK6C65ZJHKTKL2YUZUW3V2M7URKGTYOOJIALLA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.504983984 (19h36m19.020086552s) [noise=true , address=104.36.82.60:4349 , piece_id=L6BGCU7M6BX74OPTBCSQBJ3PMOBRN3W562T7EVR3DD6UECY67IRQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.505253948 (19h36m19.020356524s) [noise=true , address=104.36.82.45:4928 , piece_id=KHGBLGWNAAG5722YT6XP6U2FA2GK7WJE7MT2RNMGFPYXSRFEIM3Q, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.505859429 (19h36m19.020962003s) [noise=true , address=104.36.82.34:4573 , piece_id=KEGNFSTAEF5YBDXO32577DD7IFWZNSZG5SDSPJFTDOKPWMU7NVFQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.506188048 (19h36m19.021290625s) [noise=true , address=104.36.82.46:4493 , piece_id=HNGMHYYJCUEF5WGYT356AEKZDY6IZUJX5WN5JVJ36NSC5IEC6AGA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.506966629 (19h36m19.022069192s) [noise=true , address=104.36.82.43:4840 , piece_id=R73RV4DJOGZSDDPV3QSXMTKTJ6MQR72XBNXYAEJG5L7I2E43U4HQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.507255656 (19h36m19.022358218s) [noise=true , address=104.36.82.37:4655 , piece_id=FULT7QYOBIRP5SGZ54HWYDHET74J5UJAYYUOC5AYE5IBWRS6ZBFQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.507914747 (19h36m19.02301733s) [noise=true , address=104.36.82.53:4123 , piece_id=MDKE7CTOUIFOC4ENQQ6RXJW6FIEMKRHW2GVIRFUBT7G22WUSXCNA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.508934794 (19h36m19.024037376s) [noise=true , address=104.36.82.8:4984 , piece_id=NGMFUDZN4M2ONJQDH5EML2LRX7WBHSZLMLEHU6335YVFJ6TK7CCQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.509462525 (19h36m19.024565093s) [noise=true , address=104.36.82.12:4180 , piece_id=ILG74TZ5BFRDRVYKVPPM2VOVOZ4IXFX4RILK3Y5QFKT7W6J6PXIQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.509503916 (19h36m19.02460648s) [noise=true , address=104.36.82.62:4421 , piece_id=GWLO2QUJEPUYB5SKGXYY32HNVTQTFM7LLJNOO7WIJOSYKYMXDJMQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.509998107 (19h36m19.025100676s) [noise=true , address=104.36.82.47:4529 , piece_id=BRL5VAKSFPTIWSBEC3N5ZZFL5YBYA4WTMPG4PN7SPQCLF2KOHDJQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.510133131 (19h36m19.025235694s) [noise=true , address=104.36.82.2:4764 , piece_id=4QZF2DZ36ONDTNVS3YHCRQE5AP3GTOWQZJD2F2IXHRHIJZCKZAGA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.510142680 (19h36m19.025245251s) [seg_pos={0 0}, upload=20259]: Segment reached optimal threshold of 14 pieces. Aug 8 05:15:44.510939805 (19h36m19.026042372s) [noise=true , address=104.36.82.61:4385 , piece_id=XWK5KD27JAWA7MRDIG5OXUUXBLVY72AVDBR2JWOKUNRUON5BC6LA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 8 05:15:44.511262091 (19h36m19.026364669s) [noise=true , address=104.36.82.17:4360 , piece_id=TVVJIC7A5UTX3TLYJZ4XEEYLUFWK5JRETR4J2MW6SKYISP7J44SA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.511421518 (19h36m19.026524102s) [noise=true , address=64.49.13.169:4707 , piece_id=WTQM4UP3B655VDT55DX26KE7WMJP7QYVBWWUHH7PALIX75HBN2ZQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: read tcp 159.223.143.39:32802->64.49.13.169:4707: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:15:44.511435693 (19h36m19.026538256s) [noise=true , address=64.49.13.154:4934 , piece_id=B5JFP2WFQW65PPA6C7SOO6STYYYQKEANV4Z5UDFDGWWIUAWMUN3A, seg_pos={0 0}, upload=20259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: read tcp 159.223.143.39:49428->64.49.13.154:4934: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:15:44.511449276 (19h36m19.026551856s) [seg_pos={0 0}, upload=20259]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 05:15:44.511530782 (19h36m19.026633369s) [upload=20259]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:15:44.511536651 (19h36m19.026639235s) [upload=20259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:15:44.590856427 (19h36m19.105959005s) [upload=20259]: Done uploading segments... Aug 8 05:15:44.590921713 (19h36m19.106024292s) [upload=20259]: Upload finished. err: <nil> Aug 8 05:16:32.714498510 (19h37m7.229601094s) [upload=20272]: Starting upload Aug 8 05:16:32.714552893 (19h37m7.229655473s) [upload=20272]: Done starting upload Aug 8 05:16:32.714903852 (19h37m7.230006423s) [upload=20272]: Uploading segments... Aug 8 05:16:32.714955229 (19h37m7.230057809s) [upload=20272]: Got next segment. Inline: false Aug 8 05:16:32.714989454 (19h37m7.230092036s) [upload=20272]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:16:32.714994640 (19h37m7.230097224s) [upload=20272]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:16:32.723976411 (19h37m7.239078998s) [upload=20272]: Next segment err: metaclient: Too Many Requests Aug 8 05:16:32.723996518 (19h37m7.239099103s) [upload=20272]: Done uploading segments... Aug 8 05:16:32.724012336 (19h37m7.239114909s) [upload=20272]: Upload finished. err: metaclient: Too Many Requests Duration: 602.420531ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 671.601151ms FAIL (2025-08-08 05:23:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 671.62163ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X..........X.........] duration: 418.563529ms FAIL (2025-08-08 05:23:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== TNVS3YHCRQE5AP3GTOWQZJD2F2IXHRHIJZCKZAGA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.396619078 (19h36m18.911721655s) [noise=true , address=104.36.82.62:4421 , piece_id=GWLO2QUJEPUYB5SKGXYY32HNVTQTFM7LLJNOO7WIJOSYKYMXDJMQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397045508 (19h36m18.91214809s) [noise=true , address=104.36.82.47:4529 , piece_id=BRL5VAKSFPTIWSBEC3N5ZZFL5YBYA4WTMPG4PN7SPQCLF2KOHDJQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397160558 (19h36m18.912263143s) [noise=true , address=104.36.82.43:4840 , piece_id=R73RV4DJOGZSDDPV3QSXMTKTJ6MQR72XBNXYAEJG5L7I2E43U4HQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397451153 (19h36m18.912553734s) [noise=true , address=104.36.82.34:4573 , piece_id=KEGNFSTAEF5YBDXO32577DD7IFWZNSZG5SDSPJFTDOKPWMU7NVFQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397679365 (19h36m18.912781931s) [noise=true , address=104.36.82.61:4385 , piece_id=XWK5KD27JAWA7MRDIG5OXUUXBLVY72AVDBR2JWOKUNRUON5BC6LA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397898222 (19h36m18.9130008s) [noise=true , address=104.36.82.8:4984 , piece_id=NGMFUDZN4M2ONJQDH5EML2LRX7WBHSZLMLEHU6335YVFJ6TK7CCQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.398125648 (19h36m18.913228218s) [noise=true , address=64.49.13.169:4707 , piece_id=WTQM4UP3B655VDT55DX26KE7WMJP7QYVBWWUHH7PALIX75HBN2ZQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.398278438 (19h36m18.913381022s) [noise=true , address=104.36.82.37:4655 , piece_id=FULT7QYOBIRP5SGZ54HWYDHET74J5UJAYYUOC5AYE5IBWRS6ZBFQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.398652749 (19h36m18.913755329s) [noise=true , address=104.36.82.46:4493 , piece_id=HNGMHYYJCUEF5WGYT356AEKZDY6IZUJX5WN5JVJ36NSC5IEC6AGA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399000971 (19h36m18.914103551s) [noise=true , address=104.36.82.23:4460 , piece_id=3UHZQH52DDCDDWHK6C65ZJHKTKL2YUZUW3V2M7URKGTYOOJIALLA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399455504 (19h36m18.914558137s) [noise=true , address=104.36.82.12:4180 , piece_id=ILG74TZ5BFRDRVYKVPPM2VOVOZ4IXFX4RILK3Y5QFKT7W6J6PXIQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399717456 (19h36m18.914820039s) [noise=true , address=104.36.82.45:4928 , piece_id=KHGBLGWNAAG5722YT6XP6U2FA2GK7WJE7MT2RNMGFPYXSRFEIM3Q, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399736184 (19h36m18.914838767s) [noise=true , address=104.36.82.60:4349 , piece_id=L6BGCU7M6BX74OPTBCSQBJ3PMOBRN3W562T7EVR3DD6UECY67IRQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399780848 (19h36m18.914883425s) [noise=true , address=104.36.82.58:4298 , piece_id=KANX4YVAKK7RYWKQKUXRGMEBPYREPUZECM7OTPP6GBEG6I57XZ7Q, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.400090065 (19h36m18.915192652s) [noise=true , address=104.36.82.53:4123 , piece_id=MDKE7CTOUIFOC4ENQQ6RXJW6FIEMKRHW2GVIRFUBT7G22WUSXCNA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.400430542 (19h36m18.915533108s) [noise=true , address=64.49.13.154:4934 , piece_id=B5JFP2WFQW65PPA6C7SOO6STYYYQKEANV4Z5UDFDGWWIUAWMUN3A, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.401080440 (19h36m18.916183005s) [noise=true , address=104.36.82.17:4360 , piece_id=TVVJIC7A5UTX3TLYJZ4XEEYLUFWK5JRETR4J2MW6SKYISP7J44SA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.492815163 (19h36m19.007917733s) [upload=20259]: Next returned nil segment Aug 8 05:15:44.492830313 (19h36m19.007932879s) [upload=20259]: Waiting for error group managing segments... Aug 8 05:15:44.503634225 (19h36m19.018736809s) [noise=true , address=104.36.82.58:4298 , piece_id=KANX4YVAKK7RYWKQKUXRGMEBPYREPUZECM7OTPP6GBEG6I57XZ7Q, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.504718521 (19h36m19.019821102s) [noise=true , address=104.36.82.23:4460 , piece_id=3UHZQH52DDCDDWHK6C65ZJHKTKL2YUZUW3V2M7URKGTYOOJIALLA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.504983984 (19h36m19.020086552s) [noise=true , address=104.36.82.60:4349 , piece_id=L6BGCU7M6BX74OPTBCSQBJ3PMOBRN3W562T7EVR3DD6UECY67IRQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.505253948 (19h36m19.020356524s) [noise=true , address=104.36.82.45:4928 , piece_id=KHGBLGWNAAG5722YT6XP6U2FA2GK7WJE7MT2RNMGFPYXSRFEIM3Q, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.505859429 (19h36m19.020962003s) [noise=true , address=104.36.82.34:4573 , piece_id=KEGNFSTAEF5YBDXO32577DD7IFWZNSZG5SDSPJFTDOKPWMU7NVFQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.506188048 (19h36m19.021290625s) [noise=true , address=104.36.82.46:4493 , piece_id=HNGMHYYJCUEF5WGYT356AEKZDY6IZUJX5WN5JVJ36NSC5IEC6AGA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.506966629 (19h36m19.022069192s) [noise=true , address=104.36.82.43:4840 , piece_id=R73RV4DJOGZSDDPV3QSXMTKTJ6MQR72XBNXYAEJG5L7I2E43U4HQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.507255656 (19h36m19.022358218s) [noise=true , address=104.36.82.37:4655 , piece_id=FULT7QYOBIRP5SGZ54HWYDHET74J5UJAYYUOC5AYE5IBWRS6ZBFQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.507914747 (19h36m19.02301733s) [noise=true , address=104.36.82.53:4123 , piece_id=MDKE7CTOUIFOC4ENQQ6RXJW6FIEMKRHW2GVIRFUBT7G22WUSXCNA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.508934794 (19h36m19.024037376s) [noise=true , address=104.36.82.8:4984 , piece_id=NGMFUDZN4M2ONJQDH5EML2LRX7WBHSZLMLEHU6335YVFJ6TK7CCQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.509462525 (19h36m19.024565093s) [noise=true , address=104.36.82.12:4180 , piece_id=ILG74TZ5BFRDRVYKVPPM2VOVOZ4IXFX4RILK3Y5QFKT7W6J6PXIQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.509503916 (19h36m19.02460648s) [noise=true , address=104.36.82.62:4421 , piece_id=GWLO2QUJEPUYB5SKGXYY32HNVTQTFM7LLJNOO7WIJOSYKYMXDJMQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.509998107 (19h36m19.025100676s) [noise=true , address=104.36.82.47:4529 , piece_id=BRL5VAKSFPTIWSBEC3N5ZZFL5YBYA4WTMPG4PN7SPQCLF2KOHDJQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.510133131 (19h36m19.025235694s) [noise=true , address=104.36.82.2:4764 , piece_id=4QZF2DZ36ONDTNVS3YHCRQE5AP3GTOWQZJD2F2IXHRHIJZCKZAGA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.510142680 (19h36m19.025245251s) [seg_pos={0 0}, upload=20259]: Segment reached optimal threshold of 14 pieces. Aug 8 05:15:44.510939805 (19h36m19.026042372s) [noise=true , address=104.36.82.61:4385 , piece_id=XWK5KD27JAWA7MRDIG5OXUUXBLVY72AVDBR2JWOKUNRUON5BC6LA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 8 05:15:44.511262091 (19h36m19.026364669s) [noise=true , address=104.36.82.17:4360 , piece_id=TVVJIC7A5UTX3TLYJZ4XEEYLUFWK5JRETR4J2MW6SKYISP7J44SA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.511421518 (19h36m19.026524102s) [noise=true , address=64.49.13.169:4707 , piece_id=WTQM4UP3B655VDT55DX26KE7WMJP7QYVBWWUHH7PALIX75HBN2ZQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: read tcp 159.223.143.39:32802->64.49.13.169:4707: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:15:44.511435693 (19h36m19.026538256s) [noise=true , address=64.49.13.154:4934 , piece_id=B5JFP2WFQW65PPA6C7SOO6STYYYQKEANV4Z5UDFDGWWIUAWMUN3A, seg_pos={0 0}, upload=20259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: read tcp 159.223.143.39:49428->64.49.13.154:4934: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:15:44.511449276 (19h36m19.026551856s) [seg_pos={0 0}, upload=20259]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 05:15:44.511530782 (19h36m19.026633369s) [upload=20259]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:15:44.511536651 (19h36m19.026639235s) [upload=20259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:15:44.590856427 (19h36m19.105959005s) [upload=20259]: Done uploading segments... Aug 8 05:15:44.590921713 (19h36m19.106024292s) [upload=20259]: Upload finished. err: <nil> Aug 8 05:16:32.714498510 (19h37m7.229601094s) [upload=20272]: Starting upload Aug 8 05:16:32.714552893 (19h37m7.229655473s) [upload=20272]: Done starting upload Aug 8 05:16:32.714903852 (19h37m7.230006423s) [upload=20272]: Uploading segments... Aug 8 05:16:32.714955229 (19h37m7.230057809s) [upload=20272]: Got next segment. Inline: false Aug 8 05:16:32.714989454 (19h37m7.230092036s) [upload=20272]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:16:32.714994640 (19h37m7.230097224s) [upload=20272]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:16:32.723976411 (19h37m7.239078998s) [upload=20272]: Next segment err: metaclient: Too Many Requests Aug 8 05:16:32.723996518 (19h37m7.239099103s) [upload=20272]: Done uploading segments... Aug 8 05:16:32.724012336 (19h37m7.239114909s) [upload=20272]: Upload finished. err: metaclient: Too Many Requests Duration: 418.59449ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 28.214757ms target: https://us1.storj.io/login FAIL (2025-08-08 05:23:20 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 28.248423ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 411.231181ms FAIL (2025-08-08 05:23:13 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== uestItem_ObjectCommit Aug 8 04:42:16.180307652 (19h2m50.695410219s) [upload=19671]: Done uploading segments... Aug 8 04:42:16.180326351 (19h2m50.695428913s) [upload=19671]: Upload finished. err: <nil> Aug 8 04:42:41.083579476 (19h3m15.598682039s) [upload=19678]: Starting upload Aug 8 04:42:41.083658806 (19h3m15.598761384s) [upload=19678]: Done starting upload Aug 8 04:42:41.083736126 (19h3m15.598838696s) [upload=19678]: Uploading segments... Aug 8 04:42:41.083798735 (19h3m15.59890132s) [upload=19678]: Got next segment. Inline: true Aug 8 04:42:41.083805351 (19h3m15.598907934s) [upload=19678]: Waiting for error group managing segments... Aug 8 04:42:41.083894019 (19h3m15.598996595s) [upload=19678]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:42:41.083899702 (19h3m15.599002278s) [upload=19678]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:42:41.083903543 (19h3m15.59900612s) [upload=19678]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:42:41.147259315 (19h3m15.662361882s) [upload=19678]: Done uploading segments... Aug 8 04:42:41.147276213 (19h3m15.66237879s) [upload=19678]: Upload finished. err: <nil> Aug 8 04:43:54.314265905 (19h4m28.829368481s) [upload=19696]: Starting upload Aug 8 04:43:54.314342572 (19h4m28.829445149s) [upload=19696]: Done starting upload Aug 8 04:43:54.314412786 (19h4m28.829515355s) [upload=19696]: Uploading segments... Aug 8 04:43:54.314461737 (19h4m28.829564323s) [upload=19696]: Got next segment. Inline: true Aug 8 04:43:54.314468588 (19h4m28.829571166s) [upload=19696]: Waiting for error group managing segments... Aug 8 04:43:54.314513835 (19h4m28.829616411s) [upload=19696]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:43:54.314518357 (19h4m28.829620933s) [upload=19696]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:43:54.314521699 (19h4m28.829624275s) [upload=19696]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:43:54.374490000 (19h4m28.889592577s) [upload=19696]: Done uploading segments... Aug 8 04:43:54.374507640 (19h4m28.889610205s) [upload=19696]: Upload finished. err: <nil> Aug 8 04:44:37.820610246 (19h5m12.335712815s) [upload=19708]: Starting upload Aug 8 04:44:37.820681721 (19h5m12.335784288s) [upload=19708]: Done starting upload Aug 8 04:44:37.820750998 (19h5m12.335853567s) [upload=19708]: Uploading segments... Aug 8 04:44:37.820847572 (19h5m12.335950158s) [upload=19708]: Got next segment. Inline: true Aug 8 04:44:37.820871197 (19h5m12.335973778s) [upload=19708]: Waiting for error group managing segments... Aug 8 04:44:37.820923988 (19h5m12.336026577s) [upload=19708]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:44:37.820930149 (19h5m12.33603273s) [upload=19708]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:44:37.820950094 (19h5m12.336052671s) [upload=19708]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:44:37.891304392 (19h5m12.406406974s) [upload=19708]: Done uploading segments... Aug 8 04:44:37.891324719 (19h5m12.406427302s) [upload=19708]: Upload finished. err: <nil> Aug 8 04:45:49.374287050 (19h6m23.889389635s) [upload=19727]: Starting upload Aug 8 04:45:49.374385480 (19h6m23.889488062s) [upload=19727]: Done starting upload Aug 8 04:45:49.374485186 (19h6m23.889587763s) [upload=19727]: Uploading segments... Aug 8 04:45:49.374553702 (19h6m23.889656288s) [upload=19727]: Got next segment. Inline: true Aug 8 04:45:49.374559271 (19h6m23.889661849s) [upload=19727]: Waiting for error group managing segments... Aug 8 04:45:49.374607801 (19h6m23.889710384s) [upload=19727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:45:49.374613021 (19h6m23.889715604s) [upload=19727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:45:49.374616970 (19h6m23.889719552s) [upload=19727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:45:49.440532379 (19h6m23.955634956s) [upload=19727]: Done uploading segments... Aug 8 04:45:49.440553942 (19h6m23.955656506s) [upload=19727]: Upload finished. err: <nil> Aug 8 04:46:22.148691181 (19h6m56.663793758s) [upload=19736]: Starting upload Aug 8 04:46:22.148731264 (19h6m56.66383385s) [upload=19736]: Done starting upload Aug 8 04:46:22.148779839 (19h6m56.663882416s) [upload=19736]: Uploading segments... Aug 8 04:46:22.148815522 (19h6m56.663918108s) [upload=19736]: Got next segment. Inline: true Aug 8 04:46:22.148819611 (19h6m56.663922186s) [upload=19736]: Waiting for error group managing segments... Aug 8 04:46:22.148853347 (19h6m56.663955925s) [upload=19736]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:46:22.148856905 (19h6m56.663959481s) [upload=19736]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:46:22.148859219 (19h6m56.663961798s) [upload=19736]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:46:22.224160590 (19h6m56.739263173s) [upload=19736]: Done uploading segments... Aug 8 04:46:22.224183380 (19h6m56.739285958s) [upload=19736]: Upload finished. err: <nil> Aug 8 04:46:57.599668727 (19h7m32.114771304s) [upload=19750]: Starting upload Aug 8 04:46:57.599733716 (19h7m32.114836292s) [upload=19750]: Done starting upload Aug 8 04:46:57.599831148 (19h7m32.114933716s) [upload=19750]: Uploading segments... Aug 8 04:46:57.599898194 (19h7m32.115000774s) [upload=19750]: Got next segment. Inline: true Aug 8 04:46:57.599902995 (19h7m32.115005571s) [upload=19750]: Waiting for error group managing segments... Aug 8 04:46:57.599955730 (19h7m32.115058297s) [upload=19750]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:46:57.599960210 (19h7m32.115062786s) [upload=19750]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:46:57.599963339 (19h7m32.115065916s) [upload=19750]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:46:57.661947764 (19h7m32.17705034s) [upload=19750]: Done uploading segments... Aug 8 04:46:57.661964723 (19h7m32.1770673s) [upload=19750]: Upload finished. err: <nil> Aug 8 04:48:07.498218136 (19h8m42.013320702s) [upload=19766]: Starting upload Aug 8 04:48:07.498272608 (19h8m42.013375174s) [upload=19766]: Done starting upload Aug 8 04:48:07.498340076 (19h8m42.013442642s) [upload=19766]: Uploading segments... Aug 8 04:48:07.498377092 (19h8m42.013479678s) [upload=19766]: Got next segment. Inline: true Aug 8 04:48:07.498381514 (19h8m42.013484091s) [upload=19766]: Waiting for error group managing segments... Aug 8 04:48:07.498422115 (19h8m42.013524681s) [upload=19766]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:48:07.498426401 (19h8m42.013528979s) [upload=19766]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:48:07.498429474 (19h8m42.01353205s) [upload=19766]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:48:07.573834459 (19h8m42.088937036s) [upload=19766]: Done uploading segments... Aug 8 04:48:07.573849292 (19h8m42.088951861s) [upload=19766]: Upload finished. err: <nil> Aug 8 04:48:24.131081943 (19h8m58.646184521s) [upload=19773]: Starting upload Aug 8 04:48:24.131135304 (19h8m58.646237872s) [upload=19773]: Done starting upload Aug 8 04:48:24.131203832 (19h8m58.646306401s) [upload=19773]: Uploading segments... Aug 8 04:48:24.131242000 (19h8m58.646344585s) [upload=19773]: Got next segment. Inline: true Aug 8 04:48:24.131246356 (19h8m58.646348932s) [upload=19773]: Waiting for error group managing segments... Aug 8 04:48:24.131298903 (19h8m58.646401482s) [upload=19773]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:48:24.131304610 (19h8m58.646407189s) [upload=19773]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:48:24.131307703 (19h8m58.646410279s) [upload=19773]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:48:24.189165262 (19h8m58.704267839s) [upload=19773]: Done uploading segments... Aug 8 04:48:24.189182600 (19h8m58.704285176s) [upload=19773]: Upload finished. err: <nil> Aug 8 04:49:30.179743426 (19h10m4.69484601s) [upload=19792]: Starting upload Aug 8 04:49:30.179830624 (19h10m4.694933205s) [upload=19792]: Done starting upload Aug 8 04:49:30.179932276 (19h10m4.695034844s) [upload=19792]: Uploading segments... Aug 8 04:49:30.180011264 (19h10m4.69511385s) [upload=19792]: Got next segment. Inline: true Aug 8 04:49:30.180031508 (19h10m4.695134094s) [upload=19792]: Waiting for error group managing segments... Aug 8 04:49:30.180083780 (19h10m4.695186362s) [upload=19792]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:49:30.180089451 (19h10m4.695192035s) [upload=19792]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:49:30.180107234 (19h10m4.695209811s) [upload=19792]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:49:30.255066803 (19h10m4.770169372s) [upload=19792]: Done uploading segments... Aug 8 04:49:30.255097834 (19h10m4.770200412s) [upload=19792]: Upload finished. err: <nil> Aug 8 04:49:49.722537438 (19h10m24.237640014s) [upload=19800]: Starting upload Aug 8 04:49:49.722597342 (19h10m24.237699917s) [upload=19800]: Done starting upload Aug 8 04:49:49.722664052 (19h10m24.237766615s) [upload=19800]: Uploading segments... Aug 8 04:49:49.722715327 (19h10m24.23781791s) [upload=19800]: Got next segment. Inline: true Aug 8 04:49:49.722719940 (19h10m24.237822515s) [upload=19800]: Waiting for error group managing segments... Aug 8 04:49:49.722753934 (19h10m24.23785651s) [upload=19800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:49:49.722758369 (19h10m24.237860931s) [upload=19800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:49:49.722815656 (19h10m24.237918234s) [upload=19800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:49:49.824454883 (19h10m24.339557452s) [upload=19800]: Done uploading segments... Aug 8 04:49:49.824470680 (19h10m24.339573247s) [upload=19800]: Upload finished. err: <nil> Duration: 411.262334ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 480.158076ms FAIL (2025-08-08 05:22:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 480.177111ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................X..........X........] duration: 403.23632ms FAIL (2025-08-08 05:22:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== TNVS3YHCRQE5AP3GTOWQZJD2F2IXHRHIJZCKZAGA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.396619078 (19h36m18.911721655s) [noise=true , address=104.36.82.62:4421 , piece_id=GWLO2QUJEPUYB5SKGXYY32HNVTQTFM7LLJNOO7WIJOSYKYMXDJMQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397045508 (19h36m18.91214809s) [noise=true , address=104.36.82.47:4529 , piece_id=BRL5VAKSFPTIWSBEC3N5ZZFL5YBYA4WTMPG4PN7SPQCLF2KOHDJQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397160558 (19h36m18.912263143s) [noise=true , address=104.36.82.43:4840 , piece_id=R73RV4DJOGZSDDPV3QSXMTKTJ6MQR72XBNXYAEJG5L7I2E43U4HQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397451153 (19h36m18.912553734s) [noise=true , address=104.36.82.34:4573 , piece_id=KEGNFSTAEF5YBDXO32577DD7IFWZNSZG5SDSPJFTDOKPWMU7NVFQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397679365 (19h36m18.912781931s) [noise=true , address=104.36.82.61:4385 , piece_id=XWK5KD27JAWA7MRDIG5OXUUXBLVY72AVDBR2JWOKUNRUON5BC6LA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397898222 (19h36m18.9130008s) [noise=true , address=104.36.82.8:4984 , piece_id=NGMFUDZN4M2ONJQDH5EML2LRX7WBHSZLMLEHU6335YVFJ6TK7CCQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.398125648 (19h36m18.913228218s) [noise=true , address=64.49.13.169:4707 , piece_id=WTQM4UP3B655VDT55DX26KE7WMJP7QYVBWWUHH7PALIX75HBN2ZQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.398278438 (19h36m18.913381022s) [noise=true , address=104.36.82.37:4655 , piece_id=FULT7QYOBIRP5SGZ54HWYDHET74J5UJAYYUOC5AYE5IBWRS6ZBFQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.398652749 (19h36m18.913755329s) [noise=true , address=104.36.82.46:4493 , piece_id=HNGMHYYJCUEF5WGYT356AEKZDY6IZUJX5WN5JVJ36NSC5IEC6AGA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399000971 (19h36m18.914103551s) [noise=true , address=104.36.82.23:4460 , piece_id=3UHZQH52DDCDDWHK6C65ZJHKTKL2YUZUW3V2M7URKGTYOOJIALLA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399455504 (19h36m18.914558137s) [noise=true , address=104.36.82.12:4180 , piece_id=ILG74TZ5BFRDRVYKVPPM2VOVOZ4IXFX4RILK3Y5QFKT7W6J6PXIQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399717456 (19h36m18.914820039s) [noise=true , address=104.36.82.45:4928 , piece_id=KHGBLGWNAAG5722YT6XP6U2FA2GK7WJE7MT2RNMGFPYXSRFEIM3Q, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399736184 (19h36m18.914838767s) [noise=true , address=104.36.82.60:4349 , piece_id=L6BGCU7M6BX74OPTBCSQBJ3PMOBRN3W562T7EVR3DD6UECY67IRQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399780848 (19h36m18.914883425s) [noise=true , address=104.36.82.58:4298 , piece_id=KANX4YVAKK7RYWKQKUXRGMEBPYREPUZECM7OTPP6GBEG6I57XZ7Q, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.400090065 (19h36m18.915192652s) [noise=true , address=104.36.82.53:4123 , piece_id=MDKE7CTOUIFOC4ENQQ6RXJW6FIEMKRHW2GVIRFUBT7G22WUSXCNA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.400430542 (19h36m18.915533108s) [noise=true , address=64.49.13.154:4934 , piece_id=B5JFP2WFQW65PPA6C7SOO6STYYYQKEANV4Z5UDFDGWWIUAWMUN3A, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.401080440 (19h36m18.916183005s) [noise=true , address=104.36.82.17:4360 , piece_id=TVVJIC7A5UTX3TLYJZ4XEEYLUFWK5JRETR4J2MW6SKYISP7J44SA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.492815163 (19h36m19.007917733s) [upload=20259]: Next returned nil segment Aug 8 05:15:44.492830313 (19h36m19.007932879s) [upload=20259]: Waiting for error group managing segments... Aug 8 05:15:44.503634225 (19h36m19.018736809s) [noise=true , address=104.36.82.58:4298 , piece_id=KANX4YVAKK7RYWKQKUXRGMEBPYREPUZECM7OTPP6GBEG6I57XZ7Q, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.504718521 (19h36m19.019821102s) [noise=true , address=104.36.82.23:4460 , piece_id=3UHZQH52DDCDDWHK6C65ZJHKTKL2YUZUW3V2M7URKGTYOOJIALLA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.504983984 (19h36m19.020086552s) [noise=true , address=104.36.82.60:4349 , piece_id=L6BGCU7M6BX74OPTBCSQBJ3PMOBRN3W562T7EVR3DD6UECY67IRQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.505253948 (19h36m19.020356524s) [noise=true , address=104.36.82.45:4928 , piece_id=KHGBLGWNAAG5722YT6XP6U2FA2GK7WJE7MT2RNMGFPYXSRFEIM3Q, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.505859429 (19h36m19.020962003s) [noise=true , address=104.36.82.34:4573 , piece_id=KEGNFSTAEF5YBDXO32577DD7IFWZNSZG5SDSPJFTDOKPWMU7NVFQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.506188048 (19h36m19.021290625s) [noise=true , address=104.36.82.46:4493 , piece_id=HNGMHYYJCUEF5WGYT356AEKZDY6IZUJX5WN5JVJ36NSC5IEC6AGA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.506966629 (19h36m19.022069192s) [noise=true , address=104.36.82.43:4840 , piece_id=R73RV4DJOGZSDDPV3QSXMTKTJ6MQR72XBNXYAEJG5L7I2E43U4HQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.507255656 (19h36m19.022358218s) [noise=true , address=104.36.82.37:4655 , piece_id=FULT7QYOBIRP5SGZ54HWYDHET74J5UJAYYUOC5AYE5IBWRS6ZBFQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.507914747 (19h36m19.02301733s) [noise=true , address=104.36.82.53:4123 , piece_id=MDKE7CTOUIFOC4ENQQ6RXJW6FIEMKRHW2GVIRFUBT7G22WUSXCNA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.508934794 (19h36m19.024037376s) [noise=true , address=104.36.82.8:4984 , piece_id=NGMFUDZN4M2ONJQDH5EML2LRX7WBHSZLMLEHU6335YVFJ6TK7CCQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.509462525 (19h36m19.024565093s) [noise=true , address=104.36.82.12:4180 , piece_id=ILG74TZ5BFRDRVYKVPPM2VOVOZ4IXFX4RILK3Y5QFKT7W6J6PXIQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.509503916 (19h36m19.02460648s) [noise=true , address=104.36.82.62:4421 , piece_id=GWLO2QUJEPUYB5SKGXYY32HNVTQTFM7LLJNOO7WIJOSYKYMXDJMQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.509998107 (19h36m19.025100676s) [noise=true , address=104.36.82.47:4529 , piece_id=BRL5VAKSFPTIWSBEC3N5ZZFL5YBYA4WTMPG4PN7SPQCLF2KOHDJQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.510133131 (19h36m19.025235694s) [noise=true , address=104.36.82.2:4764 , piece_id=4QZF2DZ36ONDTNVS3YHCRQE5AP3GTOWQZJD2F2IXHRHIJZCKZAGA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.510142680 (19h36m19.025245251s) [seg_pos={0 0}, upload=20259]: Segment reached optimal threshold of 14 pieces. Aug 8 05:15:44.510939805 (19h36m19.026042372s) [noise=true , address=104.36.82.61:4385 , piece_id=XWK5KD27JAWA7MRDIG5OXUUXBLVY72AVDBR2JWOKUNRUON5BC6LA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 8 05:15:44.511262091 (19h36m19.026364669s) [noise=true , address=104.36.82.17:4360 , piece_id=TVVJIC7A5UTX3TLYJZ4XEEYLUFWK5JRETR4J2MW6SKYISP7J44SA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.511421518 (19h36m19.026524102s) [noise=true , address=64.49.13.169:4707 , piece_id=WTQM4UP3B655VDT55DX26KE7WMJP7QYVBWWUHH7PALIX75HBN2ZQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: read tcp 159.223.143.39:32802->64.49.13.169:4707: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:15:44.511435693 (19h36m19.026538256s) [noise=true , address=64.49.13.154:4934 , piece_id=B5JFP2WFQW65PPA6C7SOO6STYYYQKEANV4Z5UDFDGWWIUAWMUN3A, seg_pos={0 0}, upload=20259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: read tcp 159.223.143.39:49428->64.49.13.154:4934: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:15:44.511449276 (19h36m19.026551856s) [seg_pos={0 0}, upload=20259]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 05:15:44.511530782 (19h36m19.026633369s) [upload=20259]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:15:44.511536651 (19h36m19.026639235s) [upload=20259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:15:44.590856427 (19h36m19.105959005s) [upload=20259]: Done uploading segments... Aug 8 05:15:44.590921713 (19h36m19.106024292s) [upload=20259]: Upload finished. err: <nil> Aug 8 05:16:32.714498510 (19h37m7.229601094s) [upload=20272]: Starting upload Aug 8 05:16:32.714552893 (19h37m7.229655473s) [upload=20272]: Done starting upload Aug 8 05:16:32.714903852 (19h37m7.230006423s) [upload=20272]: Uploading segments... Aug 8 05:16:32.714955229 (19h37m7.230057809s) [upload=20272]: Got next segment. Inline: false Aug 8 05:16:32.714989454 (19h37m7.230092036s) [upload=20272]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:16:32.714994640 (19h37m7.230097224s) [upload=20272]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:16:32.723976411 (19h37m7.239078998s) [upload=20272]: Next segment err: metaclient: Too Many Requests Aug 8 05:16:32.723996518 (19h37m7.239099103s) [upload=20272]: Done uploading segments... Aug 8 05:16:32.724012336 (19h37m7.239114909s) [upload=20272]: Upload finished. err: metaclient: Too Many Requests Duration: 403.280054ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 34.777419ms target: https://us1.storj.io/login FAIL (2025-08-08 05:22:30 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 34.811519ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 224.153855ms FAIL (2025-08-08 05:22:11 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== uestItem_ObjectCommit Aug 8 04:42:16.180307652 (19h2m50.695410219s) [upload=19671]: Done uploading segments... Aug 8 04:42:16.180326351 (19h2m50.695428913s) [upload=19671]: Upload finished. err: <nil> Aug 8 04:42:41.083579476 (19h3m15.598682039s) [upload=19678]: Starting upload Aug 8 04:42:41.083658806 (19h3m15.598761384s) [upload=19678]: Done starting upload Aug 8 04:42:41.083736126 (19h3m15.598838696s) [upload=19678]: Uploading segments... Aug 8 04:42:41.083798735 (19h3m15.59890132s) [upload=19678]: Got next segment. Inline: true Aug 8 04:42:41.083805351 (19h3m15.598907934s) [upload=19678]: Waiting for error group managing segments... Aug 8 04:42:41.083894019 (19h3m15.598996595s) [upload=19678]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:42:41.083899702 (19h3m15.599002278s) [upload=19678]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:42:41.083903543 (19h3m15.59900612s) [upload=19678]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:42:41.147259315 (19h3m15.662361882s) [upload=19678]: Done uploading segments... Aug 8 04:42:41.147276213 (19h3m15.66237879s) [upload=19678]: Upload finished. err: <nil> Aug 8 04:43:54.314265905 (19h4m28.829368481s) [upload=19696]: Starting upload Aug 8 04:43:54.314342572 (19h4m28.829445149s) [upload=19696]: Done starting upload Aug 8 04:43:54.314412786 (19h4m28.829515355s) [upload=19696]: Uploading segments... Aug 8 04:43:54.314461737 (19h4m28.829564323s) [upload=19696]: Got next segment. Inline: true Aug 8 04:43:54.314468588 (19h4m28.829571166s) [upload=19696]: Waiting for error group managing segments... Aug 8 04:43:54.314513835 (19h4m28.829616411s) [upload=19696]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:43:54.314518357 (19h4m28.829620933s) [upload=19696]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:43:54.314521699 (19h4m28.829624275s) [upload=19696]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:43:54.374490000 (19h4m28.889592577s) [upload=19696]: Done uploading segments... Aug 8 04:43:54.374507640 (19h4m28.889610205s) [upload=19696]: Upload finished. err: <nil> Aug 8 04:44:37.820610246 (19h5m12.335712815s) [upload=19708]: Starting upload Aug 8 04:44:37.820681721 (19h5m12.335784288s) [upload=19708]: Done starting upload Aug 8 04:44:37.820750998 (19h5m12.335853567s) [upload=19708]: Uploading segments... Aug 8 04:44:37.820847572 (19h5m12.335950158s) [upload=19708]: Got next segment. Inline: true Aug 8 04:44:37.820871197 (19h5m12.335973778s) [upload=19708]: Waiting for error group managing segments... Aug 8 04:44:37.820923988 (19h5m12.336026577s) [upload=19708]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:44:37.820930149 (19h5m12.33603273s) [upload=19708]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:44:37.820950094 (19h5m12.336052671s) [upload=19708]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:44:37.891304392 (19h5m12.406406974s) [upload=19708]: Done uploading segments... Aug 8 04:44:37.891324719 (19h5m12.406427302s) [upload=19708]: Upload finished. err: <nil> Aug 8 04:45:49.374287050 (19h6m23.889389635s) [upload=19727]: Starting upload Aug 8 04:45:49.374385480 (19h6m23.889488062s) [upload=19727]: Done starting upload Aug 8 04:45:49.374485186 (19h6m23.889587763s) [upload=19727]: Uploading segments... Aug 8 04:45:49.374553702 (19h6m23.889656288s) [upload=19727]: Got next segment. Inline: true Aug 8 04:45:49.374559271 (19h6m23.889661849s) [upload=19727]: Waiting for error group managing segments... Aug 8 04:45:49.374607801 (19h6m23.889710384s) [upload=19727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:45:49.374613021 (19h6m23.889715604s) [upload=19727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:45:49.374616970 (19h6m23.889719552s) [upload=19727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:45:49.440532379 (19h6m23.955634956s) [upload=19727]: Done uploading segments... Aug 8 04:45:49.440553942 (19h6m23.955656506s) [upload=19727]: Upload finished. err: <nil> Aug 8 04:46:22.148691181 (19h6m56.663793758s) [upload=19736]: Starting upload Aug 8 04:46:22.148731264 (19h6m56.66383385s) [upload=19736]: Done starting upload Aug 8 04:46:22.148779839 (19h6m56.663882416s) [upload=19736]: Uploading segments... Aug 8 04:46:22.148815522 (19h6m56.663918108s) [upload=19736]: Got next segment. Inline: true Aug 8 04:46:22.148819611 (19h6m56.663922186s) [upload=19736]: Waiting for error group managing segments... Aug 8 04:46:22.148853347 (19h6m56.663955925s) [upload=19736]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:46:22.148856905 (19h6m56.663959481s) [upload=19736]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:46:22.148859219 (19h6m56.663961798s) [upload=19736]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:46:22.224160590 (19h6m56.739263173s) [upload=19736]: Done uploading segments... Aug 8 04:46:22.224183380 (19h6m56.739285958s) [upload=19736]: Upload finished. err: <nil> Aug 8 04:46:57.599668727 (19h7m32.114771304s) [upload=19750]: Starting upload Aug 8 04:46:57.599733716 (19h7m32.114836292s) [upload=19750]: Done starting upload Aug 8 04:46:57.599831148 (19h7m32.114933716s) [upload=19750]: Uploading segments... Aug 8 04:46:57.599898194 (19h7m32.115000774s) [upload=19750]: Got next segment. Inline: true Aug 8 04:46:57.599902995 (19h7m32.115005571s) [upload=19750]: Waiting for error group managing segments... Aug 8 04:46:57.599955730 (19h7m32.115058297s) [upload=19750]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:46:57.599960210 (19h7m32.115062786s) [upload=19750]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:46:57.599963339 (19h7m32.115065916s) [upload=19750]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:46:57.661947764 (19h7m32.17705034s) [upload=19750]: Done uploading segments... Aug 8 04:46:57.661964723 (19h7m32.1770673s) [upload=19750]: Upload finished. err: <nil> Aug 8 04:48:07.498218136 (19h8m42.013320702s) [upload=19766]: Starting upload Aug 8 04:48:07.498272608 (19h8m42.013375174s) [upload=19766]: Done starting upload Aug 8 04:48:07.498340076 (19h8m42.013442642s) [upload=19766]: Uploading segments... Aug 8 04:48:07.498377092 (19h8m42.013479678s) [upload=19766]: Got next segment. Inline: true Aug 8 04:48:07.498381514 (19h8m42.013484091s) [upload=19766]: Waiting for error group managing segments... Aug 8 04:48:07.498422115 (19h8m42.013524681s) [upload=19766]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:48:07.498426401 (19h8m42.013528979s) [upload=19766]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:48:07.498429474 (19h8m42.01353205s) [upload=19766]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:48:07.573834459 (19h8m42.088937036s) [upload=19766]: Done uploading segments... Aug 8 04:48:07.573849292 (19h8m42.088951861s) [upload=19766]: Upload finished. err: <nil> Aug 8 04:48:24.131081943 (19h8m58.646184521s) [upload=19773]: Starting upload Aug 8 04:48:24.131135304 (19h8m58.646237872s) [upload=19773]: Done starting upload Aug 8 04:48:24.131203832 (19h8m58.646306401s) [upload=19773]: Uploading segments... Aug 8 04:48:24.131242000 (19h8m58.646344585s) [upload=19773]: Got next segment. Inline: true Aug 8 04:48:24.131246356 (19h8m58.646348932s) [upload=19773]: Waiting for error group managing segments... Aug 8 04:48:24.131298903 (19h8m58.646401482s) [upload=19773]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:48:24.131304610 (19h8m58.646407189s) [upload=19773]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:48:24.131307703 (19h8m58.646410279s) [upload=19773]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:48:24.189165262 (19h8m58.704267839s) [upload=19773]: Done uploading segments... Aug 8 04:48:24.189182600 (19h8m58.704285176s) [upload=19773]: Upload finished. err: <nil> Aug 8 04:49:30.179743426 (19h10m4.69484601s) [upload=19792]: Starting upload Aug 8 04:49:30.179830624 (19h10m4.694933205s) [upload=19792]: Done starting upload Aug 8 04:49:30.179932276 (19h10m4.695034844s) [upload=19792]: Uploading segments... Aug 8 04:49:30.180011264 (19h10m4.69511385s) [upload=19792]: Got next segment. Inline: true Aug 8 04:49:30.180031508 (19h10m4.695134094s) [upload=19792]: Waiting for error group managing segments... Aug 8 04:49:30.180083780 (19h10m4.695186362s) [upload=19792]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:49:30.180089451 (19h10m4.695192035s) [upload=19792]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:49:30.180107234 (19h10m4.695209811s) [upload=19792]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:49:30.255066803 (19h10m4.770169372s) [upload=19792]: Done uploading segments... Aug 8 04:49:30.255097834 (19h10m4.770200412s) [upload=19792]: Upload finished. err: <nil> Aug 8 04:49:49.722537438 (19h10m24.237640014s) [upload=19800]: Starting upload Aug 8 04:49:49.722597342 (19h10m24.237699917s) [upload=19800]: Done starting upload Aug 8 04:49:49.722664052 (19h10m24.237766615s) [upload=19800]: Uploading segments... Aug 8 04:49:49.722715327 (19h10m24.23781791s) [upload=19800]: Got next segment. Inline: true Aug 8 04:49:49.722719940 (19h10m24.237822515s) [upload=19800]: Waiting for error group managing segments... Aug 8 04:49:49.722753934 (19h10m24.23785651s) [upload=19800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:49:49.722758369 (19h10m24.237860931s) [upload=19800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:49:49.722815656 (19h10m24.237918234s) [upload=19800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:49:49.824454883 (19h10m24.339557452s) [upload=19800]: Done uploading segments... Aug 8 04:49:49.824470680 (19h10m24.339573247s) [upload=19800]: Upload finished. err: <nil> Duration: 224.180542ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 29.195199ms target: https://us1.storj.io/login FAIL (2025-08-08 05:22:03 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 29.219021ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X..........X.......] duration: 1.205732197s FAIL (2025-08-08 05:21:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== TNVS3YHCRQE5AP3GTOWQZJD2F2IXHRHIJZCKZAGA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.396619078 (19h36m18.911721655s) [noise=true , address=104.36.82.62:4421 , piece_id=GWLO2QUJEPUYB5SKGXYY32HNVTQTFM7LLJNOO7WIJOSYKYMXDJMQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397045508 (19h36m18.91214809s) [noise=true , address=104.36.82.47:4529 , piece_id=BRL5VAKSFPTIWSBEC3N5ZZFL5YBYA4WTMPG4PN7SPQCLF2KOHDJQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397160558 (19h36m18.912263143s) [noise=true , address=104.36.82.43:4840 , piece_id=R73RV4DJOGZSDDPV3QSXMTKTJ6MQR72XBNXYAEJG5L7I2E43U4HQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397451153 (19h36m18.912553734s) [noise=true , address=104.36.82.34:4573 , piece_id=KEGNFSTAEF5YBDXO32577DD7IFWZNSZG5SDSPJFTDOKPWMU7NVFQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397679365 (19h36m18.912781931s) [noise=true , address=104.36.82.61:4385 , piece_id=XWK5KD27JAWA7MRDIG5OXUUXBLVY72AVDBR2JWOKUNRUON5BC6LA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397898222 (19h36m18.9130008s) [noise=true , address=104.36.82.8:4984 , piece_id=NGMFUDZN4M2ONJQDH5EML2LRX7WBHSZLMLEHU6335YVFJ6TK7CCQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.398125648 (19h36m18.913228218s) [noise=true , address=64.49.13.169:4707 , piece_id=WTQM4UP3B655VDT55DX26KE7WMJP7QYVBWWUHH7PALIX75HBN2ZQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.398278438 (19h36m18.913381022s) [noise=true , address=104.36.82.37:4655 , piece_id=FULT7QYOBIRP5SGZ54HWYDHET74J5UJAYYUOC5AYE5IBWRS6ZBFQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.398652749 (19h36m18.913755329s) [noise=true , address=104.36.82.46:4493 , piece_id=HNGMHYYJCUEF5WGYT356AEKZDY6IZUJX5WN5JVJ36NSC5IEC6AGA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399000971 (19h36m18.914103551s) [noise=true , address=104.36.82.23:4460 , piece_id=3UHZQH52DDCDDWHK6C65ZJHKTKL2YUZUW3V2M7URKGTYOOJIALLA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399455504 (19h36m18.914558137s) [noise=true , address=104.36.82.12:4180 , piece_id=ILG74TZ5BFRDRVYKVPPM2VOVOZ4IXFX4RILK3Y5QFKT7W6J6PXIQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399717456 (19h36m18.914820039s) [noise=true , address=104.36.82.45:4928 , piece_id=KHGBLGWNAAG5722YT6XP6U2FA2GK7WJE7MT2RNMGFPYXSRFEIM3Q, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399736184 (19h36m18.914838767s) [noise=true , address=104.36.82.60:4349 , piece_id=L6BGCU7M6BX74OPTBCSQBJ3PMOBRN3W562T7EVR3DD6UECY67IRQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399780848 (19h36m18.914883425s) [noise=true , address=104.36.82.58:4298 , piece_id=KANX4YVAKK7RYWKQKUXRGMEBPYREPUZECM7OTPP6GBEG6I57XZ7Q, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.400090065 (19h36m18.915192652s) [noise=true , address=104.36.82.53:4123 , piece_id=MDKE7CTOUIFOC4ENQQ6RXJW6FIEMKRHW2GVIRFUBT7G22WUSXCNA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.400430542 (19h36m18.915533108s) [noise=true , address=64.49.13.154:4934 , piece_id=B5JFP2WFQW65PPA6C7SOO6STYYYQKEANV4Z5UDFDGWWIUAWMUN3A, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.401080440 (19h36m18.916183005s) [noise=true , address=104.36.82.17:4360 , piece_id=TVVJIC7A5UTX3TLYJZ4XEEYLUFWK5JRETR4J2MW6SKYISP7J44SA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.492815163 (19h36m19.007917733s) [upload=20259]: Next returned nil segment Aug 8 05:15:44.492830313 (19h36m19.007932879s) [upload=20259]: Waiting for error group managing segments... Aug 8 05:15:44.503634225 (19h36m19.018736809s) [noise=true , address=104.36.82.58:4298 , piece_id=KANX4YVAKK7RYWKQKUXRGMEBPYREPUZECM7OTPP6GBEG6I57XZ7Q, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.504718521 (19h36m19.019821102s) [noise=true , address=104.36.82.23:4460 , piece_id=3UHZQH52DDCDDWHK6C65ZJHKTKL2YUZUW3V2M7URKGTYOOJIALLA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.504983984 (19h36m19.020086552s) [noise=true , address=104.36.82.60:4349 , piece_id=L6BGCU7M6BX74OPTBCSQBJ3PMOBRN3W562T7EVR3DD6UECY67IRQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.505253948 (19h36m19.020356524s) [noise=true , address=104.36.82.45:4928 , piece_id=KHGBLGWNAAG5722YT6XP6U2FA2GK7WJE7MT2RNMGFPYXSRFEIM3Q, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.505859429 (19h36m19.020962003s) [noise=true , address=104.36.82.34:4573 , piece_id=KEGNFSTAEF5YBDXO32577DD7IFWZNSZG5SDSPJFTDOKPWMU7NVFQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.506188048 (19h36m19.021290625s) [noise=true , address=104.36.82.46:4493 , piece_id=HNGMHYYJCUEF5WGYT356AEKZDY6IZUJX5WN5JVJ36NSC5IEC6AGA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.506966629 (19h36m19.022069192s) [noise=true , address=104.36.82.43:4840 , piece_id=R73RV4DJOGZSDDPV3QSXMTKTJ6MQR72XBNXYAEJG5L7I2E43U4HQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.507255656 (19h36m19.022358218s) [noise=true , address=104.36.82.37:4655 , piece_id=FULT7QYOBIRP5SGZ54HWYDHET74J5UJAYYUOC5AYE5IBWRS6ZBFQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.507914747 (19h36m19.02301733s) [noise=true , address=104.36.82.53:4123 , piece_id=MDKE7CTOUIFOC4ENQQ6RXJW6FIEMKRHW2GVIRFUBT7G22WUSXCNA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.508934794 (19h36m19.024037376s) [noise=true , address=104.36.82.8:4984 , piece_id=NGMFUDZN4M2ONJQDH5EML2LRX7WBHSZLMLEHU6335YVFJ6TK7CCQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.509462525 (19h36m19.024565093s) [noise=true , address=104.36.82.12:4180 , piece_id=ILG74TZ5BFRDRVYKVPPM2VOVOZ4IXFX4RILK3Y5QFKT7W6J6PXIQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.509503916 (19h36m19.02460648s) [noise=true , address=104.36.82.62:4421 , piece_id=GWLO2QUJEPUYB5SKGXYY32HNVTQTFM7LLJNOO7WIJOSYKYMXDJMQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.509998107 (19h36m19.025100676s) [noise=true , address=104.36.82.47:4529 , piece_id=BRL5VAKSFPTIWSBEC3N5ZZFL5YBYA4WTMPG4PN7SPQCLF2KOHDJQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.510133131 (19h36m19.025235694s) [noise=true , address=104.36.82.2:4764 , piece_id=4QZF2DZ36ONDTNVS3YHCRQE5AP3GTOWQZJD2F2IXHRHIJZCKZAGA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.510142680 (19h36m19.025245251s) [seg_pos={0 0}, upload=20259]: Segment reached optimal threshold of 14 pieces. Aug 8 05:15:44.510939805 (19h36m19.026042372s) [noise=true , address=104.36.82.61:4385 , piece_id=XWK5KD27JAWA7MRDIG5OXUUXBLVY72AVDBR2JWOKUNRUON5BC6LA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 8 05:15:44.511262091 (19h36m19.026364669s) [noise=true , address=104.36.82.17:4360 , piece_id=TVVJIC7A5UTX3TLYJZ4XEEYLUFWK5JRETR4J2MW6SKYISP7J44SA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.511421518 (19h36m19.026524102s) [noise=true , address=64.49.13.169:4707 , piece_id=WTQM4UP3B655VDT55DX26KE7WMJP7QYVBWWUHH7PALIX75HBN2ZQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: read tcp 159.223.143.39:32802->64.49.13.169:4707: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:15:44.511435693 (19h36m19.026538256s) [noise=true , address=64.49.13.154:4934 , piece_id=B5JFP2WFQW65PPA6C7SOO6STYYYQKEANV4Z5UDFDGWWIUAWMUN3A, seg_pos={0 0}, upload=20259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: read tcp 159.223.143.39:49428->64.49.13.154:4934: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:15:44.511449276 (19h36m19.026551856s) [seg_pos={0 0}, upload=20259]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 05:15:44.511530782 (19h36m19.026633369s) [upload=20259]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:15:44.511536651 (19h36m19.026639235s) [upload=20259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:15:44.590856427 (19h36m19.105959005s) [upload=20259]: Done uploading segments... Aug 8 05:15:44.590921713 (19h36m19.106024292s) [upload=20259]: Upload finished. err: <nil> Aug 8 05:16:32.714498510 (19h37m7.229601094s) [upload=20272]: Starting upload Aug 8 05:16:32.714552893 (19h37m7.229655473s) [upload=20272]: Done starting upload Aug 8 05:16:32.714903852 (19h37m7.230006423s) [upload=20272]: Uploading segments... Aug 8 05:16:32.714955229 (19h37m7.230057809s) [upload=20272]: Got next segment. Inline: false Aug 8 05:16:32.714989454 (19h37m7.230092036s) [upload=20272]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:16:32.714994640 (19h37m7.230097224s) [upload=20272]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:16:32.723976411 (19h37m7.239078998s) [upload=20272]: Next segment err: metaclient: Too Many Requests Aug 8 05:16:32.723996518 (19h37m7.239099103s) [upload=20272]: Done uploading segments... Aug 8 05:16:32.724012336 (19h37m7.239114909s) [upload=20272]: Upload finished. err: metaclient: Too Many Requests Duration: 1.205763428s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 492.291381ms FAIL (2025-08-08 05:21:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 492.317889ms edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 37.229695ms target: https://us1.storj.io/login FAIL (2025-08-08 05:21:33 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 37.263656ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 231.858237ms FAIL (2025-08-08 05:20:58 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== uestItem_ObjectCommit Aug 8 04:42:16.180307652 (19h2m50.695410219s) [upload=19671]: Done uploading segments... Aug 8 04:42:16.180326351 (19h2m50.695428913s) [upload=19671]: Upload finished. err: <nil> Aug 8 04:42:41.083579476 (19h3m15.598682039s) [upload=19678]: Starting upload Aug 8 04:42:41.083658806 (19h3m15.598761384s) [upload=19678]: Done starting upload Aug 8 04:42:41.083736126 (19h3m15.598838696s) [upload=19678]: Uploading segments... Aug 8 04:42:41.083798735 (19h3m15.59890132s) [upload=19678]: Got next segment. Inline: true Aug 8 04:42:41.083805351 (19h3m15.598907934s) [upload=19678]: Waiting for error group managing segments... Aug 8 04:42:41.083894019 (19h3m15.598996595s) [upload=19678]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:42:41.083899702 (19h3m15.599002278s) [upload=19678]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:42:41.083903543 (19h3m15.59900612s) [upload=19678]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:42:41.147259315 (19h3m15.662361882s) [upload=19678]: Done uploading segments... Aug 8 04:42:41.147276213 (19h3m15.66237879s) [upload=19678]: Upload finished. err: <nil> Aug 8 04:43:54.314265905 (19h4m28.829368481s) [upload=19696]: Starting upload Aug 8 04:43:54.314342572 (19h4m28.829445149s) [upload=19696]: Done starting upload Aug 8 04:43:54.314412786 (19h4m28.829515355s) [upload=19696]: Uploading segments... Aug 8 04:43:54.314461737 (19h4m28.829564323s) [upload=19696]: Got next segment. Inline: true Aug 8 04:43:54.314468588 (19h4m28.829571166s) [upload=19696]: Waiting for error group managing segments... Aug 8 04:43:54.314513835 (19h4m28.829616411s) [upload=19696]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:43:54.314518357 (19h4m28.829620933s) [upload=19696]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:43:54.314521699 (19h4m28.829624275s) [upload=19696]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:43:54.374490000 (19h4m28.889592577s) [upload=19696]: Done uploading segments... Aug 8 04:43:54.374507640 (19h4m28.889610205s) [upload=19696]: Upload finished. err: <nil> Aug 8 04:44:37.820610246 (19h5m12.335712815s) [upload=19708]: Starting upload Aug 8 04:44:37.820681721 (19h5m12.335784288s) [upload=19708]: Done starting upload Aug 8 04:44:37.820750998 (19h5m12.335853567s) [upload=19708]: Uploading segments... Aug 8 04:44:37.820847572 (19h5m12.335950158s) [upload=19708]: Got next segment. Inline: true Aug 8 04:44:37.820871197 (19h5m12.335973778s) [upload=19708]: Waiting for error group managing segments... Aug 8 04:44:37.820923988 (19h5m12.336026577s) [upload=19708]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:44:37.820930149 (19h5m12.33603273s) [upload=19708]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:44:37.820950094 (19h5m12.336052671s) [upload=19708]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:44:37.891304392 (19h5m12.406406974s) [upload=19708]: Done uploading segments... Aug 8 04:44:37.891324719 (19h5m12.406427302s) [upload=19708]: Upload finished. err: <nil> Aug 8 04:45:49.374287050 (19h6m23.889389635s) [upload=19727]: Starting upload Aug 8 04:45:49.374385480 (19h6m23.889488062s) [upload=19727]: Done starting upload Aug 8 04:45:49.374485186 (19h6m23.889587763s) [upload=19727]: Uploading segments... Aug 8 04:45:49.374553702 (19h6m23.889656288s) [upload=19727]: Got next segment. Inline: true Aug 8 04:45:49.374559271 (19h6m23.889661849s) [upload=19727]: Waiting for error group managing segments... Aug 8 04:45:49.374607801 (19h6m23.889710384s) [upload=19727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:45:49.374613021 (19h6m23.889715604s) [upload=19727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:45:49.374616970 (19h6m23.889719552s) [upload=19727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:45:49.440532379 (19h6m23.955634956s) [upload=19727]: Done uploading segments... Aug 8 04:45:49.440553942 (19h6m23.955656506s) [upload=19727]: Upload finished. err: <nil> Aug 8 04:46:22.148691181 (19h6m56.663793758s) [upload=19736]: Starting upload Aug 8 04:46:22.148731264 (19h6m56.66383385s) [upload=19736]: Done starting upload Aug 8 04:46:22.148779839 (19h6m56.663882416s) [upload=19736]: Uploading segments... Aug 8 04:46:22.148815522 (19h6m56.663918108s) [upload=19736]: Got next segment. Inline: true Aug 8 04:46:22.148819611 (19h6m56.663922186s) [upload=19736]: Waiting for error group managing segments... Aug 8 04:46:22.148853347 (19h6m56.663955925s) [upload=19736]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:46:22.148856905 (19h6m56.663959481s) [upload=19736]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:46:22.148859219 (19h6m56.663961798s) [upload=19736]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:46:22.224160590 (19h6m56.739263173s) [upload=19736]: Done uploading segments... Aug 8 04:46:22.224183380 (19h6m56.739285958s) [upload=19736]: Upload finished. err: <nil> Aug 8 04:46:57.599668727 (19h7m32.114771304s) [upload=19750]: Starting upload Aug 8 04:46:57.599733716 (19h7m32.114836292s) [upload=19750]: Done starting upload Aug 8 04:46:57.599831148 (19h7m32.114933716s) [upload=19750]: Uploading segments... Aug 8 04:46:57.599898194 (19h7m32.115000774s) [upload=19750]: Got next segment. Inline: true Aug 8 04:46:57.599902995 (19h7m32.115005571s) [upload=19750]: Waiting for error group managing segments... Aug 8 04:46:57.599955730 (19h7m32.115058297s) [upload=19750]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:46:57.599960210 (19h7m32.115062786s) [upload=19750]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:46:57.599963339 (19h7m32.115065916s) [upload=19750]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:46:57.661947764 (19h7m32.17705034s) [upload=19750]: Done uploading segments... Aug 8 04:46:57.661964723 (19h7m32.1770673s) [upload=19750]: Upload finished. err: <nil> Aug 8 04:48:07.498218136 (19h8m42.013320702s) [upload=19766]: Starting upload Aug 8 04:48:07.498272608 (19h8m42.013375174s) [upload=19766]: Done starting upload Aug 8 04:48:07.498340076 (19h8m42.013442642s) [upload=19766]: Uploading segments... Aug 8 04:48:07.498377092 (19h8m42.013479678s) [upload=19766]: Got next segment. Inline: true Aug 8 04:48:07.498381514 (19h8m42.013484091s) [upload=19766]: Waiting for error group managing segments... Aug 8 04:48:07.498422115 (19h8m42.013524681s) [upload=19766]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:48:07.498426401 (19h8m42.013528979s) [upload=19766]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:48:07.498429474 (19h8m42.01353205s) [upload=19766]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:48:07.573834459 (19h8m42.088937036s) [upload=19766]: Done uploading segments... Aug 8 04:48:07.573849292 (19h8m42.088951861s) [upload=19766]: Upload finished. err: <nil> Aug 8 04:48:24.131081943 (19h8m58.646184521s) [upload=19773]: Starting upload Aug 8 04:48:24.131135304 (19h8m58.646237872s) [upload=19773]: Done starting upload Aug 8 04:48:24.131203832 (19h8m58.646306401s) [upload=19773]: Uploading segments... Aug 8 04:48:24.131242000 (19h8m58.646344585s) [upload=19773]: Got next segment. Inline: true Aug 8 04:48:24.131246356 (19h8m58.646348932s) [upload=19773]: Waiting for error group managing segments... Aug 8 04:48:24.131298903 (19h8m58.646401482s) [upload=19773]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:48:24.131304610 (19h8m58.646407189s) [upload=19773]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:48:24.131307703 (19h8m58.646410279s) [upload=19773]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:48:24.189165262 (19h8m58.704267839s) [upload=19773]: Done uploading segments... Aug 8 04:48:24.189182600 (19h8m58.704285176s) [upload=19773]: Upload finished. err: <nil> Aug 8 04:49:30.179743426 (19h10m4.69484601s) [upload=19792]: Starting upload Aug 8 04:49:30.179830624 (19h10m4.694933205s) [upload=19792]: Done starting upload Aug 8 04:49:30.179932276 (19h10m4.695034844s) [upload=19792]: Uploading segments... Aug 8 04:49:30.180011264 (19h10m4.69511385s) [upload=19792]: Got next segment. Inline: true Aug 8 04:49:30.180031508 (19h10m4.695134094s) [upload=19792]: Waiting for error group managing segments... Aug 8 04:49:30.180083780 (19h10m4.695186362s) [upload=19792]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:49:30.180089451 (19h10m4.695192035s) [upload=19792]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:49:30.180107234 (19h10m4.695209811s) [upload=19792]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:49:30.255066803 (19h10m4.770169372s) [upload=19792]: Done uploading segments... Aug 8 04:49:30.255097834 (19h10m4.770200412s) [upload=19792]: Upload finished. err: <nil> Aug 8 04:49:49.722537438 (19h10m24.237640014s) [upload=19800]: Starting upload Aug 8 04:49:49.722597342 (19h10m24.237699917s) [upload=19800]: Done starting upload Aug 8 04:49:49.722664052 (19h10m24.237766615s) [upload=19800]: Uploading segments... Aug 8 04:49:49.722715327 (19h10m24.23781791s) [upload=19800]: Got next segment. Inline: true Aug 8 04:49:49.722719940 (19h10m24.237822515s) [upload=19800]: Waiting for error group managing segments... Aug 8 04:49:49.722753934 (19h10m24.23785651s) [upload=19800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 04:49:49.722758369 (19h10m24.237860931s) [upload=19800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 04:49:49.722815656 (19h10m24.237918234s) [upload=19800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 04:49:49.824454883 (19h10m24.339557452s) [upload=19800]: Done uploading segments... Aug 8 04:49:49.824470680 (19h10m24.339573247s) [upload=19800]: Upload finished. err: <nil> Duration: 231.912176ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X..........X......] duration: 536.897548ms FAIL (2025-08-08 05:20:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== TNVS3YHCRQE5AP3GTOWQZJD2F2IXHRHIJZCKZAGA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.396619078 (19h36m18.911721655s) [noise=true , address=104.36.82.62:4421 , piece_id=GWLO2QUJEPUYB5SKGXYY32HNVTQTFM7LLJNOO7WIJOSYKYMXDJMQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397045508 (19h36m18.91214809s) [noise=true , address=104.36.82.47:4529 , piece_id=BRL5VAKSFPTIWSBEC3N5ZZFL5YBYA4WTMPG4PN7SPQCLF2KOHDJQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397160558 (19h36m18.912263143s) [noise=true , address=104.36.82.43:4840 , piece_id=R73RV4DJOGZSDDPV3QSXMTKTJ6MQR72XBNXYAEJG5L7I2E43U4HQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397451153 (19h36m18.912553734s) [noise=true , address=104.36.82.34:4573 , piece_id=KEGNFSTAEF5YBDXO32577DD7IFWZNSZG5SDSPJFTDOKPWMU7NVFQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397679365 (19h36m18.912781931s) [noise=true , address=104.36.82.61:4385 , piece_id=XWK5KD27JAWA7MRDIG5OXUUXBLVY72AVDBR2JWOKUNRUON5BC6LA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.397898222 (19h36m18.9130008s) [noise=true , address=104.36.82.8:4984 , piece_id=NGMFUDZN4M2ONJQDH5EML2LRX7WBHSZLMLEHU6335YVFJ6TK7CCQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.398125648 (19h36m18.913228218s) [noise=true , address=64.49.13.169:4707 , piece_id=WTQM4UP3B655VDT55DX26KE7WMJP7QYVBWWUHH7PALIX75HBN2ZQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.398278438 (19h36m18.913381022s) [noise=true , address=104.36.82.37:4655 , piece_id=FULT7QYOBIRP5SGZ54HWYDHET74J5UJAYYUOC5AYE5IBWRS6ZBFQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.398652749 (19h36m18.913755329s) [noise=true , address=104.36.82.46:4493 , piece_id=HNGMHYYJCUEF5WGYT356AEKZDY6IZUJX5WN5JVJ36NSC5IEC6AGA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399000971 (19h36m18.914103551s) [noise=true , address=104.36.82.23:4460 , piece_id=3UHZQH52DDCDDWHK6C65ZJHKTKL2YUZUW3V2M7URKGTYOOJIALLA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399455504 (19h36m18.914558137s) [noise=true , address=104.36.82.12:4180 , piece_id=ILG74TZ5BFRDRVYKVPPM2VOVOZ4IXFX4RILK3Y5QFKT7W6J6PXIQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399717456 (19h36m18.914820039s) [noise=true , address=104.36.82.45:4928 , piece_id=KHGBLGWNAAG5722YT6XP6U2FA2GK7WJE7MT2RNMGFPYXSRFEIM3Q, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399736184 (19h36m18.914838767s) [noise=true , address=104.36.82.60:4349 , piece_id=L6BGCU7M6BX74OPTBCSQBJ3PMOBRN3W562T7EVR3DD6UECY67IRQ, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.399780848 (19h36m18.914883425s) [noise=true , address=104.36.82.58:4298 , piece_id=KANX4YVAKK7RYWKQKUXRGMEBPYREPUZECM7OTPP6GBEG6I57XZ7Q, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.400090065 (19h36m18.915192652s) [noise=true , address=104.36.82.53:4123 , piece_id=MDKE7CTOUIFOC4ENQQ6RXJW6FIEMKRHW2GVIRFUBT7G22WUSXCNA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.400430542 (19h36m18.915533108s) [noise=true , address=64.49.13.154:4934 , piece_id=B5JFP2WFQW65PPA6C7SOO6STYYYQKEANV4Z5UDFDGWWIUAWMUN3A, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.401080440 (19h36m18.916183005s) [noise=true , address=104.36.82.17:4360 , piece_id=TVVJIC7A5UTX3TLYJZ4XEEYLUFWK5JRETR4J2MW6SKYISP7J44SA, seg_pos={0 0}, upload=20259]: Uploading piece... Aug 8 05:15:44.492815163 (19h36m19.007917733s) [upload=20259]: Next returned nil segment Aug 8 05:15:44.492830313 (19h36m19.007932879s) [upload=20259]: Waiting for error group managing segments... Aug 8 05:15:44.503634225 (19h36m19.018736809s) [noise=true , address=104.36.82.58:4298 , piece_id=KANX4YVAKK7RYWKQKUXRGMEBPYREPUZECM7OTPP6GBEG6I57XZ7Q, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.504718521 (19h36m19.019821102s) [noise=true , address=104.36.82.23:4460 , piece_id=3UHZQH52DDCDDWHK6C65ZJHKTKL2YUZUW3V2M7URKGTYOOJIALLA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.504983984 (19h36m19.020086552s) [noise=true , address=104.36.82.60:4349 , piece_id=L6BGCU7M6BX74OPTBCSQBJ3PMOBRN3W562T7EVR3DD6UECY67IRQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.505253948 (19h36m19.020356524s) [noise=true , address=104.36.82.45:4928 , piece_id=KHGBLGWNAAG5722YT6XP6U2FA2GK7WJE7MT2RNMGFPYXSRFEIM3Q, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.505859429 (19h36m19.020962003s) [noise=true , address=104.36.82.34:4573 , piece_id=KEGNFSTAEF5YBDXO32577DD7IFWZNSZG5SDSPJFTDOKPWMU7NVFQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.506188048 (19h36m19.021290625s) [noise=true , address=104.36.82.46:4493 , piece_id=HNGMHYYJCUEF5WGYT356AEKZDY6IZUJX5WN5JVJ36NSC5IEC6AGA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.506966629 (19h36m19.022069192s) [noise=true , address=104.36.82.43:4840 , piece_id=R73RV4DJOGZSDDPV3QSXMTKTJ6MQR72XBNXYAEJG5L7I2E43U4HQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.507255656 (19h36m19.022358218s) [noise=true , address=104.36.82.37:4655 , piece_id=FULT7QYOBIRP5SGZ54HWYDHET74J5UJAYYUOC5AYE5IBWRS6ZBFQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.507914747 (19h36m19.02301733s) [noise=true , address=104.36.82.53:4123 , piece_id=MDKE7CTOUIFOC4ENQQ6RXJW6FIEMKRHW2GVIRFUBT7G22WUSXCNA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.508934794 (19h36m19.024037376s) [noise=true , address=104.36.82.8:4984 , piece_id=NGMFUDZN4M2ONJQDH5EML2LRX7WBHSZLMLEHU6335YVFJ6TK7CCQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.509462525 (19h36m19.024565093s) [noise=true , address=104.36.82.12:4180 , piece_id=ILG74TZ5BFRDRVYKVPPM2VOVOZ4IXFX4RILK3Y5QFKT7W6J6PXIQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.509503916 (19h36m19.02460648s) [noise=true , address=104.36.82.62:4421 , piece_id=GWLO2QUJEPUYB5SKGXYY32HNVTQTFM7LLJNOO7WIJOSYKYMXDJMQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.509998107 (19h36m19.025100676s) [noise=true , address=104.36.82.47:4529 , piece_id=BRL5VAKSFPTIWSBEC3N5ZZFL5YBYA4WTMPG4PN7SPQCLF2KOHDJQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.510133131 (19h36m19.025235694s) [noise=true , address=104.36.82.2:4764 , piece_id=4QZF2DZ36ONDTNVS3YHCRQE5AP3GTOWQZJD2F2IXHRHIJZCKZAGA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.510142680 (19h36m19.025245251s) [seg_pos={0 0}, upload=20259]: Segment reached optimal threshold of 14 pieces. Aug 8 05:15:44.510939805 (19h36m19.026042372s) [noise=true , address=104.36.82.61:4385 , piece_id=XWK5KD27JAWA7MRDIG5OXUUXBLVY72AVDBR2JWOKUNRUON5BC6LA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF Aug 8 05:15:44.511262091 (19h36m19.026364669s) [noise=true , address=104.36.82.17:4360 , piece_id=TVVJIC7A5UTX3TLYJZ4XEEYLUFWK5JRETR4J2MW6SKYISP7J44SA, seg_pos={0 0}, upload=20259]: Done uploading piece. err: <nil> Aug 8 05:15:44.511421518 (19h36m19.026524102s) [noise=true , address=64.49.13.169:4707 , piece_id=WTQM4UP3B655VDT55DX26KE7WMJP7QYVBWWUHH7PALIX75HBN2ZQ, seg_pos={0 0}, upload=20259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1C8U9EuxPw2xxuH8rkdoSv4nGaoBB7syRzrZYchYhoQYHxjQSD): protocol: read tcp 159.223.143.39:32802->64.49.13.169:4707: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:15:44.511435693 (19h36m19.026538256s) [noise=true , address=64.49.13.154:4934 , piece_id=B5JFP2WFQW65PPA6C7SOO6STYYYQKEANV4Z5UDFDGWWIUAWMUN3A, seg_pos={0 0}, upload=20259]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: read tcp 159.223.143.39:49428->64.49.13.154:4934: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 05:15:44.511449276 (19h36m19.026551856s) [seg_pos={0 0}, upload=20259]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 05:15:44.511530782 (19h36m19.026633369s) [upload=20259]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:15:44.511536651 (19h36m19.026639235s) [upload=20259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:15:44.590856427 (19h36m19.105959005s) [upload=20259]: Done uploading segments... Aug 8 05:15:44.590921713 (19h36m19.106024292s) [upload=20259]: Upload finished. err: <nil> Aug 8 05:16:32.714498510 (19h37m7.229601094s) [upload=20272]: Starting upload Aug 8 05:16:32.714552893 (19h37m7.229655473s) [upload=20272]: Done starting upload Aug 8 05:16:32.714903852 (19h37m7.230006423s) [upload=20272]: Uploading segments... Aug 8 05:16:32.714955229 (19h37m7.230057809s) [upload=20272]: Got next segment. Inline: false Aug 8 05:16:32.714989454 (19h37m7.230092036s) [upload=20272]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:16:32.714994640 (19h37m7.230097224s) [upload=20272]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:16:32.723976411 (19h37m7.239078998s) [upload=20272]: Next segment err: metaclient: Too Many Requests Aug 8 05:16:32.723996518 (19h37m7.239099103s) [upload=20272]: Done uploading segments... Aug 8 05:16:32.724012336 (19h37m7.239114909s) [upload=20272]: Upload finished. err: metaclient: Too Many Requests Duration: 536.926469ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 33.463155ms target: https://us1.storj.io/login FAIL (2025-08-08 05:20:49 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 33.48715ms core satellite us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 682.281605ms FAIL (2025-08-08 05:20:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 682.329625ms edge gateway us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 30.165142ms target: https://us1.storj.io/login FAIL (2025-08-08 05:20:26 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 30.187857ms core satellite us1

Orbiter Check History

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)