Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.398336ms remote:
"tcp:45.38.24.2:443" response headers:
X-Request-Id=K4TRriRcqJb X-Xss-Protection=1; mode=block Vary=Origin X-Amz-Request-Id=18981C3E73432E4E Date=Fri, 27 Feb 2026 13:05:07 GMT Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/2c63d6788db89707
FAIL (2026-02-27 13:05:07 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C3E73432E4E</RequestId><HostId></HostId></Error>"
Duration: 27.522189ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.684936ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Type=application/xml X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18981C380CC590A4 X-Request-Id=6kDCBHcWEd9 Date=Fri, 27 Feb 2026 13:04:40 GMT Accept-Ranges=bytes Content-Length=284 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/78485a6aa5d6b1f6
FAIL (2026-02-27 13:04:40 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C380CC590A4</RequestId><HostId></HostId></Error>"
Duration: 28.711544ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.533108ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18981C3818619ABA Date=Fri, 27 Feb 2026 13:04:40 GMT Accept-Ranges=bytes Content-Length=274 Server=Storj X-Request-Id=5pgpu4cQY86 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/70df056b71c51774
FAIL (2026-02-27 13:04:40 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C3818619ABA</RequestId><HostId></HostId></Error>"
Duration: 11.678621ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.804439ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981C33D2C915B3 X-Request-Id=hkapCr746zM Date=Fri, 27 Feb 2026 13:04:22 GMT Accept-Ranges=bytes Content-Length=274 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/29d9524704072d20
FAIL (2026-02-27 13:04:22 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C33D2C915B3</RequestId><HostId></HostId></Error>"
Duration: 10.827401ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.449358ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=Uubq2gYf4N9 Content-Security-Policy=block-all-mixed-content X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:04:17 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981C32D2BA5FF7 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/6b659beb556ae646
FAIL (2026-02-27 13:04:17 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C32D2BA5FF7</RequestId><HostId></HostId></Error>"
Duration: 13.475512ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.529412ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18981C3269F93942 Server=Storj X-Request-Id=ajWdEH1YNFw X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:04:16 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/72cef0ea897c80c8
FAIL (2026-02-27 13:04:16 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C3269F93942</RequestId><HostId></HostId></Error>"
Duration: 29.555045ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
1.368620879s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 13:04:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.368643202s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.263683ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18981C2E5E0FCBE7 X-Xss-Protection=1; mode=block Content-Length=274 Content-Type=application/xml Server=Storj X-Request-Id=BZkUV7rnYyP Date=Fri, 27 Feb 2026 13:03:58 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2f971b265a9e0e3a
FAIL (2026-02-27 13:03:58 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C2E5E0FCBE7</RequestId><HostId></HostId></Error>"
Duration: 11.289359ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.105438ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18981C29E1439DC8 X-Request-Id=XhugXYzYJzF X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:03:39 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/2788f728f5bc6ebd
FAIL (2026-02-27 13:03:39 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C29E1439DC8</RequestId><HostId></HostId></Error>"
Duration: 12.134324ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
32.846933ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=18981C299D1DF3F5 X-Request-Id=XeKGf5NdHWC X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:03:38 GMT Accept-Ranges=bytes Server=Storj Vary=Origin target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/74814be790db3d20
FAIL (2026-02-27 13:03:38 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C299D1DF3F5</RequestId><HostId></HostId></Error>"
Duration: 32.881147ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.635881ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=18981C28D8E2E4B9 X-Request-Id=Q7eK3oWu7Lt X-Xss-Protection=1; mode=block Server=Storj Date=Fri, 27 Feb 2026 13:03:35 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/57b59fa3c82edb0a
FAIL (2026-02-27 13:03:35 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C28D8E2E4B9</RequestId><HostId></HostId></Error>"
Duration: 10.668164ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.198541ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml X-Amz-Request-Id=18981C250E3B37BB X-Request-Id=Sf3xgKLqNgH Date=Fri, 27 Feb 2026 13:03:18 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/d2cb34c024024f4
FAIL (2026-02-27 13:03:18 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C250E3B37BB</RequestId><HostId></HostId></Error>"
Duration: 14.223828ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.102919ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Fri, 27 Feb 2026 13:03:06 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981C2224CDC639 X-Request-Id=6THaKxZFeWK X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/799a45c8b6a2193f
FAIL (2026-02-27 13:03:06 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C2224CDC639</RequestId><HostId></HostId></Error>"
Duration: 10.129334ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
1.881422488s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 13:03:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.881470403s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.005143ms remote:
"tcp:45.38.24.2:443" response headers:
Server=Storj Vary=Origin X-Amz-Request-Id=18981C1F9A8F70B2 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=Gd6xcivcQTK Date=Fri, 27 Feb 2026 13:02:55 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/5ec73ccb3f3bca81
FAIL (2026-02-27 13:02:55 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C1F9A8F70B2</RequestId><HostId></HostId></Error>"
Duration: 27.033159ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.049932ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18981C1EDA667FD2 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=jgi6HqtfY6M Date=Fri, 27 Feb 2026 13:02:52 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/33edb7450df6e5d6
FAIL (2026-02-27 13:02:52 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C1EDA667FD2</RequestId><HostId></HostId></Error>"
Duration: 10.084783ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.882913ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18981C1CE91AA7A0 X-Request-Id=Yn2x8JucW7q X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:02:43 GMT Content-Security-Policy=block-all-mixed-content Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/1def48c9821ac34c
FAIL (2026-02-27 13:02:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C1CE91AA7A0</RequestId><HostId></HostId></Error>"
Duration: 10.910667ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
1.245470236s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 13:02:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.245499245s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.196437ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981C1A1D43D82C X-Request-Id=6aYeRxNyhDo Content-Length=274 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:02:31 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/2e1a22f3a77b5bb0
FAIL (2026-02-27 13:02:31 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C1A1D43D82C</RequestId><HostId></HostId></Error>"
Duration: 14.221784ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
31.438152ms remote:
"tcp:45.38.24.2:443" response headers:
X-Request-Id=L6xphxRAfK6 Content-Length=284 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:02:21 GMT Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Amz-Request-Id=18981C17C85C2DAE target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/ab611a278c8bd04
FAIL (2026-02-27 13:02:21 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C17C85C2DAE</RequestId><HostId></HostId></Error>"
Duration: 31.458941ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.681381ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:02:20 GMT Accept-Ranges=bytes Content-Type=application/xml X-Amz-Request-Id=18981C17952DD117 X-Request-Id=C3gosxnWgvz Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/40674e5e2e40b272
FAIL (2026-02-27 13:02:20 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C17952DD117</RequestId><HostId></HostId></Error>"
Duration: 9.750947ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.212639ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Date=Fri, 27 Feb 2026 13:02:15 GMT Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18981C163728682E X-Request-Id=fyFGN25kWmz X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/659291a96c6162f8
FAIL (2026-02-27 13:02:15 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C163728682E</RequestId><HostId></HostId></Error>"
Duration: 10.369959ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.343638ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Fri, 27 Feb 2026 13:02:15 GMT X-Amz-Request-Id=18981C163942E8EA X-Request-Id=hTJeJgmDhXs X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/5e293caa384fc876
FAIL (2026-02-27 13:02:15 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C163942E8EA</RequestId><HostId></HostId></Error>"
Duration: 10.369428ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.288369ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18981C12945020BD Server=Storj X-Request-Id=PS15t4pq7b6 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:01:59 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/3e3482046193f395
FAIL (2026-02-27 13:01:59 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C12945020BD</RequestId><HostId></HostId></Error>"
Duration: 10.391406ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
1.419190575s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 13:01:56 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.419218391s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.559549ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 X-Request-Id=V7DhZ8b4WMA Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981C112AFF46E1 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:01:53 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/77fef9594634b32
FAIL (2026-02-27 13:01:53 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C112AFF46E1</RequestId><HostId></HostId></Error>"
Duration: 11.587243ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.732861ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj Vary=Origin X-Request-Id=c4uN2rEA4Zg X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:01:36 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml X-Amz-Request-Id=18981C0D3A57F14D Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/65060116d892b4f7
FAIL (2026-02-27 13:01:36 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C0D3A57F14D</RequestId><HostId></HostId></Error>"
Duration: 14.75833ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
41.963082ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981C0AD3E91D2B X-Request-Id=HviEW2tDgJr X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=284 Date=Fri, 27 Feb 2026 13:01:26 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/1c453b2e29e76446
FAIL (2026-02-27 13:01:26 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C0AD3E91D2B</RequestId><HostId></HostId></Error>"
Duration: 41.980676ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
1.325774588s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 13:01:21 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.325807232s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.984596ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=UZJvCBdT9Bw Date=Fri, 27 Feb 2026 13:00:59 GMT Accept-Ranges=bytes Content-Length=274 Vary=Origin X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=18981C04B88F7FB8 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/7eecfe57cd6c542f
FAIL (2026-02-27 13:00:59 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C04B88F7FB8</RequestId><HostId></HostId></Error>"
Duration: 10.008653ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
34.168766ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=X64rD7reL61 Date=Fri, 27 Feb 2026 13:00:58 GMT Accept-Ranges=bytes Server=Storj X-Amz-Request-Id=18981C0476BD39CE X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/6565357017deeb1
FAIL (2026-02-27 13:00:58 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C0476BD39CE</RequestId><HostId></HostId></Error>"
Duration: 34.190768ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
1.498290824s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 13:00:49 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.498324435s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.317941ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=18981C0172F2C223 X-Request-Id=76XKrhmuzfa X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Date=Fri, 27 Feb 2026 13:00:45 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/75e43c6e8a60abc1
FAIL (2026-02-27 13:00:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C0172F2C223</RequestId><HostId></HostId></Error>"
Duration: 10.364507ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
16.07169ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:00:38 GMT Vary=Origin X-Amz-Request-Id=18981BFFC8394CBA X-Request-Id=iQVYaWPYdyM target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2fc0e8ca5dcb7364
FAIL (2026-02-27 13:00:38 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BFFC8394CBA</RequestId><HostId></HostId></Error>"
Duration: 16.100139ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
16.216296ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=6dU1p14TnqB Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18981BF90A8E1BA8 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:00:09 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/4212701881581f28
FAIL (2026-02-27 13:00:09 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BF90A8E1BA8</RequestId><HostId></HostId></Error>"
Duration: 16.232661ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.896384ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=18981BF8D0D3C73A X-Xss-Protection=1; mode=block Accept-Ranges=bytes Vary=Origin X-Request-Id=3B6j6sd8LyN Date=Fri, 27 Feb 2026 13:00:08 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/4440e08eb13d8902
FAIL (2026-02-27 13:00:08 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BF8D0D3C73A</RequestId><HostId></HostId></Error>"
Duration: 29.922223ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.203149ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Fri, 27 Feb 2026 13:00:03 GMT Accept-Ranges=bytes Content-Length=274 Vary=Origin X-Amz-Request-Id=18981BF7A3B0B7AB X-Request-Id=HFfzsJ2SGqt Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/335c606952fd9621
FAIL (2026-02-27 13:00:03 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BF7A3B0B7AB</RequestId><HostId></HostId></Error>"
Duration: 26.23533ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.182910931s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 13:00:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 2.183014529s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
17.927422ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=TZEVnnMt4wF X-Xss-Protection=1; mode=block Content-Length=274 Content-Type=application/xml Server=Storj X-Amz-Request-Id=18981BF3F13A2F1A Date=Fri, 27 Feb 2026 12:59:47 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2d1206f768980706
FAIL (2026-02-27 12:59:47 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BF3F13A2F1A</RequestId><HostId></HostId></Error>"
Duration: 17.966837ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.847666ms remote:
"tcp:45.38.24.2:443" response headers:
Date=Fri, 27 Feb 2026 12:59:45 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=18981BF35CE6004A X-Request-Id=P3K9UPvSAFs Accept-Ranges=bytes Content-Length=284 Server=Storj Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/36366ebadd9707e6
FAIL (2026-02-27 12:59:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BF35CE6004A</RequestId><HostId></HostId></Error>"
Duration: 28.899783ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
1.26843942s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 12:59:28 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.268470543s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.559778ms remote:
"tcp:45.38.24.2:443" response headers:
X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Date=Fri, 27 Feb 2026 12:59:26 GMT Content-Length=284 Server=Storj Vary=Origin X-Amz-Request-Id=18981BEED9236ACE X-Request-Id=ASrVkQ9MPUh target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/5581fe7ee6bb82c9
FAIL (2026-02-27 12:59:26 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BEED9236ACE</RequestId><HostId></HostId></Error>"
Duration: 30.575268ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.85496ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin Accept-Ranges=bytes Content-Length=274 X-Amz-Request-Id=18981BECB01245CD X-Request-Id=LYdoS6XX3uR X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:59:16 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/2fa5ccffa94a21cb
FAIL (2026-02-27 12:59:16 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BECB01245CD</RequestId><HostId></HostId></Error>"
Duration: 12.880445ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.442658ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj Date=Fri, 27 Feb 2026 12:59:08 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18981BEAD8C895D9 X-Request-Id=HbM5YJHa74V X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/644bf0b615500dc8
FAIL (2026-02-27 12:59:08 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BEAD8C895D9</RequestId><HostId></HostId></Error>"
Duration: 10.464584ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.185969ms remote:
"tcp:45.38.24.2:443" response headers:
Vary=Origin X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=18981BE42C82D0B8 X-Request-Id=e1rjGR9mxqe Date=Fri, 27 Feb 2026 12:58:40 GMT Content-Length=284 Server=Storj target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3a2264eedb86860b
FAIL (2026-02-27 12:58:40 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BE42C82D0B8</RequestId><HostId></HostId></Error>"
Duration: 27.297046ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
16.044629ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Vary=Origin Date=Fri, 27 Feb 2026 12:58:35 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=18981BE2FF8AC8A2 X-Request-Id=N5Kb3yAHctN X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2ea5debb2683704d
FAIL (2026-02-27 12:58:35 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BE2FF8AC8A2</RequestId><HostId></HostId></Error>"
Duration: 16.073178ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
1.216086147s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 12:58:24 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.216113383s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
36.2209ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981BDEC58F0D51 Date=Fri, 27 Feb 2026 12:58:16 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content X-Request-Id=Zy9MM6KuECs X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/6ed04bf77945c883
FAIL (2026-02-27 12:58:16 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BDEC58F0D51</RequestId><HostId></HostId></Error>"
Duration: 36.26967ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.666555ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=18981BDE1EF6A6E2 X-Request-Id=d48diDPBQVo Date=Fri, 27 Feb 2026 12:58:14 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Accept-Ranges=bytes Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/734e2316afa09d36
FAIL (2026-02-27 12:58:14 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BDE1EF6A6E2</RequestId><HostId></HostId></Error>"
Duration: 9.692878ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.174676ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:58:09 GMT Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Amz-Request-Id=18981BDD14A7118C X-Request-Id=ByC3ZWQzT2m target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/45999ac9ebecf33b
FAIL (2026-02-27 12:58:09 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BDD14A7118C</RequestId><HostId></HostId></Error>"
Duration: 11.199373ms
edge
gateway
vhost
bgp
eu1
|