Orbiter History

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 28.90145ms target: https://us1.storj.io/login FAIL (2025-08-08 08:27:56 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 28.938083ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 30.346953ms target: https://us1.storj.io/login FAIL (2025-08-08 08:27:39 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 30.37552ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 30.617725ms target: https://us1.storj.io/login FAIL (2025-08-08 08:26:54 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 30.643258ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 28.280099ms target: https://us1.storj.io/login FAIL (2025-08-08 08:25:50 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 28.318268ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 67.541088ms target: https://us1.storj.io/login FAIL (2025-08-08 08:25:11 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 67.558064ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 29.592635ms target: https://us1.storj.io/login FAIL (2025-08-08 08:24:04 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 29.620992ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 28.602979ms target: https://us1.storj.io/login FAIL (2025-08-08 08:23:33 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 28.628729ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 29.617924ms target: https://us1.storj.io/login FAIL (2025-08-08 08:22:27 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 29.651458ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [X.................................X.........................] duration: 29.397718ms target: https://us1.storj.io/login FAIL (2025-08-08 08:21:33 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 29.421613ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [.X.................................X........................] duration: 102.131011ms target: https://us1.storj.io/login FAIL (2025-08-08 08:20:59 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 102.147306ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [..X.................................X.......................] duration: 27.817564ms target: https://us1.storj.io/login FAIL (2025-08-08 08:20:27 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 27.841273ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [...X.................................X......................] duration: 29.039454ms target: https://us1.storj.io/login FAIL (2025-08-08 08:19:46 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 29.064124ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [....X.................................X.....................] duration: 33.804829ms target: https://us1.storj.io/login FAIL (2025-08-08 08:18:58 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 33.916577ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [.....X.................................X....................] duration: 28.876097ms target: https://us1.storj.io/login FAIL (2025-08-08 08:17:57 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 28.922058ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [......X.................................X...................] duration: 33.438411ms target: https://us1.storj.io/login FAIL (2025-08-08 08:16:59 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 33.464666ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [.......X.................................X..................] duration: 28.050795ms target: https://us1.storj.io/login FAIL (2025-08-08 08:16:44 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 28.075622ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [........X.................................X.................] duration: 31.09485ms target: https://us1.storj.io/login FAIL (2025-08-08 08:16:20 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 31.122856ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [.........X.................................X................] duration: 34.963797ms target: https://us1.storj.io/login FAIL (2025-08-08 08:15:21 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 34.987403ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 233.294932ms FAIL (2025-08-08 08:15:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 233.31689ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 238.92357ms FAIL (2025-08-08 08:14:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 238.954707ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [..........X.................................X...............] duration: 28.301835ms target: https://us1.storj.io/login FAIL (2025-08-08 08:14:20 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 28.325939ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 471.170771ms FAIL (2025-08-08 08:13:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 471.198773ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 192.863542ms FAIL (2025-08-08 08:13:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 192.886141ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [...........X.................................X..............] duration: 30.894776ms target: https://us1.storj.io/login FAIL (2025-08-08 08:13:29 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 30.916234ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 188.809028ms FAIL (2025-08-08 08:13:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 188.835655ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 708.509855ms FAIL (2025-08-08 08:13:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 708.537919ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 208.410645ms FAIL (2025-08-08 08:12:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 208.452693ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [............X.................................X.............] duration: 27.779523ms target: https://us1.storj.io/login FAIL (2025-08-08 08:12:38 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 27.823787ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 586.810441ms FAIL (2025-08-08 08:12:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 586.836544ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 416.706559ms FAIL (2025-08-08 08:12:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 416.737152ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 199.34151ms FAIL (2025-08-08 08:11:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 199.373086ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [.............X.................................X............] duration: 29.276095ms target: https://us1.storj.io/login FAIL (2025-08-08 08:11:36 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 29.300954ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 181.758573ms FAIL (2025-08-08 08:11:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 181.788945ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 185.071176ms FAIL (2025-08-08 08:10:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 185.095611ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 558.11039ms FAIL (2025-08-08 08:10:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 558.137768ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [..............X.................................X...........] duration: 27.471956ms target: https://us1.storj.io/login FAIL (2025-08-08 08:10:36 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 27.49619ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 511.747902ms FAIL (2025-08-08 08:10:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 511.782118ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 923.53781ms FAIL (2025-08-08 08:09:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 923.56901ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 201.376077ms FAIL (2025-08-08 08:09:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 201.490277ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [...............X.................................X..........] duration: 35.115582ms target: https://us1.storj.io/login FAIL (2025-08-08 08:09:44 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 35.132512ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 185.297784ms FAIL (2025-08-08 08:09:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 185.327879ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 415.39085ms FAIL (2025-08-08 08:08:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 415.463045ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [................X.................................X.........] duration: 33.369742ms target: https://us1.storj.io/login FAIL (2025-08-08 08:08:30 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 33.410935ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 385.630884ms FAIL (2025-08-08 08:08:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 385.656672ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 182.537135ms FAIL (2025-08-08 08:08:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 182.565122ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 411.749021ms FAIL (2025-08-08 08:07:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 411.782803ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [.................X.................................X........] duration: 31.485948ms target: https://us1.storj.io/login FAIL (2025-08-08 08:07:43 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 34.150.199.48:443: connect: connection refused Duration: 31.507462ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 451.102777ms FAIL (2025-08-08 08:07:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== g_pos={0 0}, upload=22550]: Begin upload segment... Aug 8 07:28:51.351770179 (21h49m25.866872766s) [seg_pos={0 0}, upload=22550]: Done begin upload segment. Aug 8 07:28:51.351799155 (21h49m25.866901747s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.351816053 (21h49m25.86691864s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352227136 (21h49m25.867329713s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352322195 (21h49m25.867424772s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352611348 (21h49m25.867713924s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.352702579 (21h49m25.867805142s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353022021 (21h49m25.868124597s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.353464633 (21h49m25.868567211s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354418304 (21h49m25.869520884s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.354959848 (21h49m25.87006243s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355461506 (21h49m25.870564086s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.355910519 (21h49m25.871013101s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.357467009 (21h49m25.872569585s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.358628018 (21h49m25.873730598s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.359105086 (21h49m25.874207666s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.360554866 (21h49m25.875657451s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.363015621 (21h49m25.8781182s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.364089235 (21h49m25.87919182s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Uploading piece... Aug 8 07:28:51.467747752 (21h49m25.982850337s) [upload=22550]: Next returned nil segment Aug 8 07:28:51.467767955 (21h49m25.982870543s) [upload=22550]: Waiting for error group managing segments... Aug 8 07:28:51.473577577 (21h49m25.988680143s) [noise=true , address=45.91.116.7:4013 , piece_id=XG4M7HF2E5YIRJ7PVBEGZC2ADPUPAL2QL5TPUAFIYXZUP3BX2Y7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478188638 (21h49m25.993291216s) [noise=true , address=104.36.82.16:4321 , piece_id=MTRDWQYPHECWBAH4ECUGJL2Y2LAUA2RWHX5J6XMR65NZOACBF6PA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478342049 (21h49m25.993444627s) [noise=true , address=104.36.82.53:4139 , piece_id=IGOHVQJMZ3NWLCBKVPVHTVWVHDS43DABQPEMJUTB2TXAQPQOURSQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.478768394 (21h49m25.993870961s) [noise=true , address=104.36.82.36:4648 , piece_id=3WAWCS3XXWVX3ACYJG2OOS2R34SXOWYSHXVF6AMPFXJFCMYH4SZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479336172 (21h49m25.994438735s) [noise=true , address=104.36.82.59:4322 , piece_id=NKCSGWGYWOIJWHSQUN2ZYOVZYIRML5G3DXVRJYDTAMHTEN2VES3Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.479515883 (21h49m25.994618457s) [noise=true , address=104.36.82.58:4286 , piece_id=36LFLTD2YWV3K7LM4M2GY3JIKLUDOZVRINQT3VLIFBRR55UCNA4Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.480474985 (21h49m25.995577567s) [noise=true , address=104.36.82.2:4741 , piece_id=3NWVL6DQCMDO5PQLSFU3VER7RSHGRAB6YRT32XBFUVLAXGEJQN7A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481008628 (21h49m25.996111195s) [noise=true , address=104.36.82.38:4707 , piece_id=WZWQHYDMTUG2FOTZ6JJRVIXXFIPHJ3I2YIRQXMN7B2W7QGKAFY3A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.481589774 (21h49m25.996692358s) [noise=true , address=104.36.82.60:4363 , piece_id=QMR7CM4ASNAKG5PT2XUPFR4MIBHNFYJ7OZMASJ7Q6R2C225L655A, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.482143054 (21h49m25.99724562s) [noise=true , address=104.36.82.46:4487 , piece_id=JOSIX5WT5A36RXKJNWO5KLBEQOCNQCEZ7A2S4KYIBJHRKN3KT6RQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.485172215 (21h49m26.000274779s) [noise=true , address=104.36.82.47:4544 , piece_id=YDG3KOKUS5NVBWMQYJ7JJEO3PAXZKPZPUOUWUDCZ4RAVATW67NKQ, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486088591 (21h49m26.001191172s) [noise=true , address=104.36.82.44:4880 , piece_id=HFXFL7ULX5OTYJFEOC45DI75DGDIHAQA6ZJIXHO22X4GPSEZN75Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.486628345 (21h49m26.001730916s) [noise=true , address=104.36.82.23:4469 , piece_id=CI6CU5IBYK37MBIQW554EW6PPXVYA6ZF2CJPVZCIXMFFLXZ7UO7Q, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487179958 (21h49m26.002282521s) [noise=true , address=104.36.82.62:4420 , piece_id=7S6ALI3DNOM7IURBTYY3DLALDQV7R7LLHPQCA4Q6G4HA2SOZ2YMA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487192580 (21h49m26.002295147s) [seg_pos={0 0}, upload=22550]: Segment reached optimal threshold of 14 pieces. Aug 8 07:28:51.487306760 (21h49m26.002409325s) [noise=true , address=104.36.82.45:4907 , piece_id=ZF2SKF5O2WVNHM7CHQ7E4U7HVKQWCJGOZEVIDXO3OU4XHVUFPIGA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF Aug 8 07:28:51.487325587 (21h49m26.00242815s) [noise=true , address=104.36.82.9:4008 , piece_id=EGIGCEJHELTHOJZWPFWNHCP672MIXAHZIQUK2WDHER77VVJ4NZZA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487748790 (21h49m26.002851367s) [noise=true , address=193.149.164.143:4693 , piece_id=RCLLY6ABOIXYK6BBO5EWKTDDJ4MUH6IP2WGIHSTER4TEPSF2FYVA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: read tcp 159.223.143.39:37688->193.149.164.143:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 07:28:51.487858041 (21h49m26.002960604s) [noise=true , address=45.91.116.11:4120 , piece_id=274GAU5MCZAZOHB3ESPDSJP23Z5FZB636CWGN7ELS2HYY5OFZ7RA, seg_pos={0 0}, upload=22550]: Done uploading piece. err: <nil> Aug 8 07:28:51.487890658 (21h49m26.002993237s) [seg_pos={0 0}, upload=22550]: Done waiting for segment. successful: 16 optimal: 14 errs: <nil> Aug 8 07:28:51.487971404 (21h49m26.00307399s) [upload=22550]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 07:28:51.487976917 (21h49m26.003079481s) [upload=22550]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:51.647177827 (21h49m26.162280406s) [upload=22550]: Done uploading segments... Aug 8 07:28:51.647194442 (21h49m26.162297008s) [upload=22550]: Upload finished. err: <nil> Aug 8 07:29:34.528501362 (21h50m9.043603939s) [upload=22562]: Starting upload Aug 8 07:29:34.528548565 (21h50m9.043651143s) [upload=22562]: Done starting upload Aug 8 07:29:34.528615374 (21h50m9.043717942s) [upload=22562]: Uploading segments... Aug 8 07:29:34.528903298 (21h50m9.044005874s) [upload=22562]: Got next segment. Inline: false Aug 8 07:29:34.528940157 (21h50m9.044042733s) [upload=22562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:34.528944789 (21h50m9.044047366s) [upload=22562]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 07:29:34.536881082 (21h50m9.051983672s) [upload=22562]: Next segment err: metaclient: Too Many Requests Aug 8 07:29:34.536925024 (21h50m9.052027602s) [upload=22562]: Done uploading segments... Aug 8 07:29:34.536943164 (21h50m9.052045741s) [upload=22562]: Upload finished. err: metaclient: Too Many Requests Duration: 451.130573ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 203.854453ms FAIL (2025-08-08 08:07:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 203.914313ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 198.583234ms FAIL (2025-08-08 08:06:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== nts... Aug 8 07:24:18.405184267 (21h44m52.920286834s) [upload=22475]: Upload finished. err: <nil> Aug 8 07:24:44.148856783 (21h45m18.663959349s) [upload=22481]: Starting upload Aug 8 07:24:44.148908040 (21h45m18.664010617s) [upload=22481]: Done starting upload Aug 8 07:24:44.148978727 (21h45m18.664081294s) [upload=22481]: Uploading segments... Aug 8 07:24:44.149031432 (21h45m18.664134016s) [upload=22481]: Got next segment. Inline: true Aug 8 07:24:44.149047929 (21h45m18.664150495s) [upload=22481]: Waiting for error group managing segments... Aug 8 07:24:44.149231742 (21h45m18.664334308s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:24:44.149238484 (21h45m18.664341061s) [upload=22481]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:24:44.149241695 (21h45m18.664344271s) [upload=22481]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:24:44.236175458 (21h45m18.751278039s) [upload=22481]: Done uploading segments... Aug 8 07:24:44.236197562 (21h45m18.75130015s) [upload=22481]: Upload finished. err: <nil> Aug 8 07:25:45.798907959 (21h46m20.31401054s) [upload=22496]: Starting upload Aug 8 07:25:45.798982852 (21h46m20.314085432s) [upload=22496]: Done starting upload Aug 8 07:25:45.799141617 (21h46m20.314244194s) [upload=22496]: Uploading segments... Aug 8 07:25:45.799187034 (21h46m20.314289621s) [upload=22496]: Got next segment. Inline: true Aug 8 07:25:45.799192794 (21h46m20.314295378s) [upload=22496]: Waiting for error group managing segments... Aug 8 07:25:45.799260506 (21h46m20.314363086s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:25:45.799265543 (21h46m20.314368123s) [upload=22496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:25:45.799269614 (21h46m20.314372195s) [upload=22496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:25:45.856873466 (21h46m20.371976033s) [upload=22496]: Done uploading segments... Aug 8 07:25:45.856894517 (21h46m20.371997083s) [upload=22496]: Upload finished. err: <nil> Aug 8 07:26:45.160306388 (21h47m19.67540897s) [upload=22512]: Starting upload Aug 8 07:26:45.160369840 (21h47m19.675472407s) [upload=22512]: Done starting upload Aug 8 07:26:45.160448308 (21h47m19.675550874s) [upload=22512]: Uploading segments... Aug 8 07:26:45.160512759 (21h47m19.675615339s) [upload=22512]: Got next segment. Inline: true Aug 8 07:26:45.160518821 (21h47m19.675621389s) [upload=22512]: Waiting for error group managing segments... Aug 8 07:26:45.160566486 (21h47m19.675669054s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:26:45.160571363 (21h47m19.675673943s) [upload=22512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:26:45.160575116 (21h47m19.675677698s) [upload=22512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:26:45.219521344 (21h47m19.73462392s) [upload=22512]: Done uploading segments... Aug 8 07:26:45.219537755 (21h47m19.73464032s) [upload=22512]: Upload finished. err: <nil> Aug 8 07:27:50.008745364 (21h48m24.523847971s) [upload=22529]: Starting upload Aug 8 07:27:50.008828662 (21h48m24.523931252s) [upload=22529]: Done starting upload Aug 8 07:27:50.008913720 (21h48m24.524016289s) [upload=22529]: Uploading segments... Aug 8 07:27:50.008968901 (21h48m24.524071486s) [upload=22529]: Got next segment. Inline: true Aug 8 07:27:50.008973893 (21h48m24.524076469s) [upload=22529]: Waiting for error group managing segments... Aug 8 07:27:50.009023439 (21h48m24.524126015s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:27:50.009028404 (21h48m24.524130983s) [upload=22529]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:27:50.009032740 (21h48m24.524135324s) [upload=22529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:27:50.072222330 (21h48m24.587324909s) [upload=22529]: Done uploading segments... Aug 8 07:27:50.072260086 (21h48m24.587362652s) [upload=22529]: Upload finished. err: <nil> Aug 8 07:28:08.797868182 (21h48m43.312970759s) [upload=22537]: Starting upload Aug 8 07:28:08.797909617 (21h48m43.313012202s) [upload=22537]: Done starting upload Aug 8 07:28:08.797978107 (21h48m43.313080676s) [upload=22537]: Uploading segments... Aug 8 07:28:08.798028549 (21h48m43.313131134s) [upload=22537]: Got next segment. Inline: true Aug 8 07:28:08.798033746 (21h48m43.313136324s) [upload=22537]: Waiting for error group managing segments... Aug 8 07:28:08.798088133 (21h48m43.313190709s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:08.798092673 (21h48m43.313195249s) [upload=22537]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:08.798096028 (21h48m43.313198604s) [upload=22537]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:08.856181519 (21h48m43.371284096s) [upload=22537]: Done uploading segments... Aug 8 07:28:08.856219288 (21h48m43.371321856s) [upload=22537]: Upload finished. err: <nil> Aug 8 07:28:26.426406302 (21h49m0.941508883s) [upload=22543]: Starting upload Aug 8 07:28:26.426484520 (21h49m0.94158709s) [upload=22543]: Done starting upload Aug 8 07:28:26.426561912 (21h49m0.941664479s) [upload=22543]: Uploading segments... Aug 8 07:28:26.426613562 (21h49m0.941716147s) [upload=22543]: Got next segment. Inline: true Aug 8 07:28:26.426618334 (21h49m0.94172091s) [upload=22543]: Waiting for error group managing segments... Aug 8 07:28:26.426667358 (21h49m0.941769934s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:26.426672477 (21h49m0.941775052s) [upload=22543]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:26.426676980 (21h49m0.941779557s) [upload=22543]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:26.739786156 (21h49m1.254888734s) [upload=22543]: Done uploading segments... Aug 8 07:28:26.739818088 (21h49m1.254920663s) [upload=22543]: Upload finished. err: <nil> Aug 8 07:28:44.768272418 (21h49m19.283374995s) [upload=22547]: Starting upload Aug 8 07:28:44.768352182 (21h49m19.28345476s) [upload=22547]: Done starting upload Aug 8 07:28:44.768463680 (21h49m19.283566246s) [upload=22547]: Uploading segments... Aug 8 07:28:44.768552166 (21h49m19.283654733s) [upload=22547]: Got next segment. Inline: true Aug 8 07:28:44.768558003 (21h49m19.28366057s) [upload=22547]: Waiting for error group managing segments... Aug 8 07:28:44.768617460 (21h49m19.28372004s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:28:44.768622292 (21h49m19.283724868s) [upload=22547]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:28:44.768625505 (21h49m19.283728082s) [upload=22547]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:28:44.832641596 (21h49m19.347744163s) [upload=22547]: Done uploading segments... Aug 8 07:28:44.832661990 (21h49m19.347764559s) [upload=22547]: Upload finished. err: <nil> Aug 8 07:29:19.907807846 (21h49m54.422910428s) [upload=22558]: Starting upload Aug 8 07:29:19.907919209 (21h49m54.423021801s) [upload=22558]: Done starting upload Aug 8 07:29:19.908035700 (21h49m54.423138281s) [upload=22558]: Uploading segments... Aug 8 07:29:19.908115743 (21h49m54.423218334s) [upload=22558]: Got next segment. Inline: true Aug 8 07:29:19.908123216 (21h49m54.423225802s) [upload=22558]: Waiting for error group managing segments... Aug 8 07:29:19.908206488 (21h49m54.423309073s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:29:19.908213079 (21h49m54.423315659s) [upload=22558]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:29:19.908216828 (21h49m54.423319408s) [upload=22558]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:29:19.968416399 (21h49m54.483518987s) [upload=22558]: Done uploading segments... Aug 8 07:29:19.968437892 (21h49m54.48354047s) [upload=22558]: Upload finished. err: <nil> Aug 8 07:30:04.570811298 (21h50m39.085913875s) [upload=22574]: Starting upload Aug 8 07:30:04.570856561 (21h50m39.085959129s) [upload=22574]: Done starting upload Aug 8 07:30:04.570937395 (21h50m39.086039963s) [upload=22574]: Uploading segments... Aug 8 07:30:04.570993290 (21h50m39.086095879s) [upload=22574]: Got next segment. Inline: true Aug 8 07:30:04.570999714 (21h50m39.086102306s) [upload=22574]: Waiting for error group managing segments... Aug 8 07:30:04.571094735 (21h50m39.086197316s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:04.571101887 (21h50m39.086204467s) [upload=22574]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:04.571105790 (21h50m39.086208372s) [upload=22574]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:04.649336948 (21h50m39.164439536s) [upload=22574]: Done uploading segments... Aug 8 07:30:04.649362004 (21h50m39.164464585s) [upload=22574]: Upload finished. err: <nil> Aug 8 07:30:54.851564431 (21h51m29.366666997s) [upload=22587]: Starting upload Aug 8 07:30:54.851618044 (21h51m29.36672062s) [upload=22587]: Done starting upload Aug 8 07:30:54.851712059 (21h51m29.366814635s) [upload=22587]: Uploading segments... Aug 8 07:30:54.851783178 (21h51m29.36688576s) [upload=22587]: Got next segment. Inline: true Aug 8 07:30:54.851789517 (21h51m29.366892093s) [upload=22587]: Waiting for error group managing segments... Aug 8 07:30:54.851854337 (21h51m29.366956924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 07:30:54.851861334 (21h51m29.366963924s) [upload=22587]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 07:30:54.851866059 (21h51m29.366968642s) [upload=22587]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 07:30:54.860593007 (21h51m29.375695595s) [upload=22587]: Done uploading segments... Aug 8 07:30:54.860627519 (21h51m29.375730095s) [upload=22587]: Upload finished. err: metaclient: Too Many Requests Duration: 198.611286ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)