Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
31.204095ms remote:
"tcp:45.38.24.2:443" response headers:
X-Amz-Request-Id=18981C803BA21347 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=284 X-Request-Id=VnoSLWyGNZh Date=Fri, 27 Feb 2026 13:09:50 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/703530d033acfc77
FAIL (2026-02-27 13:09:50 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C803BA21347</RequestId><HostId></HostId></Error>"
Duration: 31.245409ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.480579ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981C7C0C05BA1E Content-Security-Policy=block-all-mixed-content X-Request-Id=FDN2rpDnRLM X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:09:32 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/6d8f06c478083a1e
FAIL (2026-02-27 13:09:32 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C7C0C05BA1E</RequestId><HostId></HostId></Error>"
Duration: 12.50197ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.816767ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=18981C7810B8E50A X-Request-Id=Yq5eBjfdHeP Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:09:15 GMT Content-Length=274 Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/3ecb098ece1b31b1
FAIL (2026-02-27 13:09:15 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C7810B8E50A</RequestId><HostId></HostId></Error>"
Duration: 10.834285ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.30154ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=18981C7720AC1A69 X-Request-Id=fN7KKSLBCqd X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:09:11 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/277376727d2c583c
FAIL (2026-02-27 13:09:11 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C7720AC1A69</RequestId><HostId></HostId></Error>"
Duration: 12.326271ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.000808ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:08:48 GMT Accept-Ranges=bytes Server=Storj Vary=Origin X-Amz-Request-Id=18981C71D695390D X-Request-Id=A4PmCFg9NSe target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/6760532cbf960376
FAIL (2026-02-27 13:08:48 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C71D695390D</RequestId><HostId></HostId></Error>"
Duration: 12.025876ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
33.993167ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981C7164218061 X-Request-Id=ZUDAibtMjJE Accept-Ranges=bytes Content-Length=284 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:08:46 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/79e34bc724fab0b8
FAIL (2026-02-27 13:08:46 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C7164218061</RequestId><HostId></HostId></Error>"
Duration: 34.039186ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
17.135896ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981C6DEB335DF7 X-Request-Id=YzPaa2Lpm42 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:08:31 GMT Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2b9df19d9349d6e7
FAIL (2026-02-27 13:08:31 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C6DEB335DF7</RequestId><HostId></HostId></Error>"
Duration: 17.148908ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.064592ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:08:29 GMT Accept-Ranges=bytes Content-Length=274 X-Amz-Request-Id=18981C6D6B39FED5 X-Request-Id=Z2scC1vZyTp Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/6cf8c9f5a2d58e8e
FAIL (2026-02-27 13:08:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C6D6B39FED5</RequestId><HostId></HostId></Error>"
Duration: 14.085405ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
1.298195855s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 13:08:27 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.298227409s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.907791ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18981C67CD3B98F3 X-Request-Id=fS1T3Kn5J3G X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:08:05 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/6403ea946003e818
FAIL (2026-02-27 13:08:05 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C67CD3B98F3</RequestId><HostId></HostId></Error>"
Duration: 14.946374ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
1.624804695s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 13:08:03 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.624830597s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.751833ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=18981C650084DF08 Content-Length=284 Vary=Origin X-Request-Id=bT9vDEM3Dya X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:07:53 GMT Accept-Ranges=bytes target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/d0c91e44076bd59
FAIL (2026-02-27 13:07:53 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C650084DF08</RequestId><HostId></HostId></Error>"
Duration: 29.775281ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.640173ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Vary=Origin X-Amz-Request-Id=18981C63FBF6D5F1 Date=Fri, 27 Feb 2026 13:07:49 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=Fn7PZSqno4D X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/6c8c3b20ddc18e01
FAIL (2026-02-27 13:07:49 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C63FBF6D5F1</RequestId><HostId></HostId></Error>"
Duration: 11.73332ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
1.25343921s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 13:07:38 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.253485428s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.101935ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18981C601F2995B2 X-Request-Id=QRhj8DMdvXv X-Xss-Protection=1; mode=block Server=Storj Date=Fri, 27 Feb 2026 13:07:32 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/481d10ca659ce5e5
FAIL (2026-02-27 13:07:32 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C601F2995B2</RequestId><HostId></HostId></Error>"
Duration: 9.129807ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.119157ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18981C5D6B1C748D X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:07:20 GMT Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Request-Id=UMhE1CL1RV7 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/39d602e989730b58
FAIL (2026-02-27 13:07:20 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C5D6B1C748D</RequestId><HostId></HostId></Error>"
Duration: 11.224114ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.212694ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=18981C5C9C710E35 Date=Fri, 27 Feb 2026 13:07:17 GMT Accept-Ranges=bytes Vary=Origin X-Request-Id=HbphHfyVzso X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/1d26f0f4fa8f553e
FAIL (2026-02-27 13:07:17 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C5C9C710E35</RequestId><HostId></HostId></Error>"
Duration: 10.24692ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.494051ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=Sc2XtNGDkGW X-Xss-Protection=1; mode=block Content-Length=274 Server=Storj X-Amz-Request-Id=18981C5C164F5B31 Date=Fri, 27 Feb 2026 13:07:15 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/226df4b3cd3c3163
FAIL (2026-02-27 13:07:15 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C5C164F5B31</RequestId><HostId></HostId></Error>"
Duration: 14.528109ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
1.091567281s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 13:07:13 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.091608104s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.402954ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Server=Storj X-Request-Id=88DPWL2C86r Date=Fri, 27 Feb 2026 13:06:44 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18981C54E55261EB target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/e5b15d3bc50232a
FAIL (2026-02-27 13:06:44 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C54E55261EB</RequestId><HostId></HostId></Error>"
Duration: 10.432098ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.626964ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Server=Storj Date=Fri, 27 Feb 2026 13:06:43 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18981C54A29D5B61 X-Request-Id=chwBe7qeMQh X-Xss-Protection=1; mode=block Accept-Ranges=bytes target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/197915528a6a8aed
FAIL (2026-02-27 13:06:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C54A29D5B61</RequestId><HostId></HostId></Error>"
Duration: 29.65456ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.666091ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Server=Storj X-Amz-Request-Id=18981C53399EAF5A X-Request-Id=Ax8exHn2xLm Date=Fri, 27 Feb 2026 13:06:37 GMT Content-Security-Policy=block-all-mixed-content Vary=Origin X-Xss-Protection=1; mode=block Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/39487de1edcf09cc
FAIL (2026-02-27 13:06:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C53399EAF5A</RequestId><HostId></HostId></Error>"
Duration: 10.688172ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.463134ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18981C532923AD1C X-Request-Id=V1TcX1gc54o Date=Fri, 27 Feb 2026 13:06:36 GMT Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/4063c745a63ff6d3
FAIL (2026-02-27 13:06:36 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C532923AD1C</RequestId><HostId></HostId></Error>"
Duration: 13.532348ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.092141ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Vary=Origin X-Amz-Request-Id=18981C50BC2EA0D1 X-Request-Id=4tSLZ3EQw1F X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:06:26 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3658a41e5350eefb
FAIL (2026-02-27 13:06:26 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C50BC2EA0D1</RequestId><HostId></HostId></Error>"
Duration: 29.333331ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
1.22972423s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 13:06:25 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.229752985s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
15.106246ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj X-Amz-Request-Id=18981C4F1055161E X-Request-Id=BMxiQ7jiUBT X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Vary=Origin Date=Fri, 27 Feb 2026 13:06:19 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/1543f9762b13bb28
FAIL (2026-02-27 13:06:19 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C4F1055161E</RequestId><HostId></HostId></Error>"
Duration: 15.131674ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.464452ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Fri, 27 Feb 2026 13:05:49 GMT Accept-Ranges=bytes X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981C4812C04A88 X-Request-Id=VLDyncNCx1j target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/6b1ec9928e11886d
FAIL (2026-02-27 13:05:49 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C4812C04A88</RequestId><HostId></HostId></Error>"
Duration: 12.492871ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.104916ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18981C4776E06DB0 X-Request-Id=DqtdHbidRXR Content-Type=application/xml X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:05:46 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/807102590869680
FAIL (2026-02-27 13:05:46 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C4776E06DB0</RequestId><HostId></HostId></Error>"
Duration: 30.158437ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.238646ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:05:42 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin Accept-Ranges=bytes Content-Type=application/xml X-Amz-Request-Id=18981C468D5C76C6 X-Request-Id=Zj4VuNSQnPG target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/717d058c78b1197f
FAIL (2026-02-27 13:05:42 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C468D5C76C6</RequestId><HostId></HostId></Error>"
Duration: 10.26439ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.222645ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=18981C41AD448F8C X-Request-Id=D9ZbNoextUi Content-Length=274 Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:05:21 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/43b3a642acee1a02
FAIL (2026-02-27 13:05:21 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C41AD448F8C</RequestId><HostId></HostId></Error>"
Duration: 10.257455ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.368915ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18981C400C0714FF X-Request-Id=Yai8yYmW7My Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:05:14 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/7b3928a3482a2052
FAIL (2026-02-27 13:05:14 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C400C0714FF</RequestId><HostId></HostId></Error>"
Duration: 11.393587ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
1.179524664s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 13:05:10 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.179558071s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.611538ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981C3F0591408F X-Request-Id=8aANKF97Pzo Accept-Ranges=bytes X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:05:10 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2f9d5ff407100a51
FAIL (2026-02-27 13:05:10 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C3F0591408F</RequestId><HostId></HostId></Error>"
Duration: 14.635092ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.398336ms remote:
"tcp:45.38.24.2:443" response headers:
X-Request-Id=K4TRriRcqJb X-Xss-Protection=1; mode=block Vary=Origin X-Amz-Request-Id=18981C3E73432E4E Date=Fri, 27 Feb 2026 13:05:07 GMT Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/2c63d6788db89707
FAIL (2026-02-27 13:05:07 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C3E73432E4E</RequestId><HostId></HostId></Error>"
Duration: 27.522189ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.684936ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Type=application/xml X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18981C380CC590A4 X-Request-Id=6kDCBHcWEd9 Date=Fri, 27 Feb 2026 13:04:40 GMT Accept-Ranges=bytes Content-Length=284 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/78485a6aa5d6b1f6
FAIL (2026-02-27 13:04:40 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C380CC590A4</RequestId><HostId></HostId></Error>"
Duration: 28.711544ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.533108ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18981C3818619ABA Date=Fri, 27 Feb 2026 13:04:40 GMT Accept-Ranges=bytes Content-Length=274 Server=Storj X-Request-Id=5pgpu4cQY86 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/70df056b71c51774
FAIL (2026-02-27 13:04:40 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C3818619ABA</RequestId><HostId></HostId></Error>"
Duration: 11.678621ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.804439ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981C33D2C915B3 X-Request-Id=hkapCr746zM Date=Fri, 27 Feb 2026 13:04:22 GMT Accept-Ranges=bytes Content-Length=274 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/29d9524704072d20
FAIL (2026-02-27 13:04:22 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C33D2C915B3</RequestId><HostId></HostId></Error>"
Duration: 10.827401ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.449358ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=Uubq2gYf4N9 Content-Security-Policy=block-all-mixed-content X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:04:17 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981C32D2BA5FF7 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/6b659beb556ae646
FAIL (2026-02-27 13:04:17 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C32D2BA5FF7</RequestId><HostId></HostId></Error>"
Duration: 13.475512ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.529412ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18981C3269F93942 Server=Storj X-Request-Id=ajWdEH1YNFw X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:04:16 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/72cef0ea897c80c8
FAIL (2026-02-27 13:04:16 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C3269F93942</RequestId><HostId></HostId></Error>"
Duration: 29.555045ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
1.368620879s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 13:04:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.368643202s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.263683ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18981C2E5E0FCBE7 X-Xss-Protection=1; mode=block Content-Length=274 Content-Type=application/xml Server=Storj X-Request-Id=BZkUV7rnYyP Date=Fri, 27 Feb 2026 13:03:58 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2f971b265a9e0e3a
FAIL (2026-02-27 13:03:58 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C2E5E0FCBE7</RequestId><HostId></HostId></Error>"
Duration: 11.289359ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.105438ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18981C29E1439DC8 X-Request-Id=XhugXYzYJzF X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:03:39 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/2788f728f5bc6ebd
FAIL (2026-02-27 13:03:39 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C29E1439DC8</RequestId><HostId></HostId></Error>"
Duration: 12.134324ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
32.846933ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=18981C299D1DF3F5 X-Request-Id=XeKGf5NdHWC X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:03:38 GMT Accept-Ranges=bytes Server=Storj Vary=Origin target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/74814be790db3d20
FAIL (2026-02-27 13:03:38 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C299D1DF3F5</RequestId><HostId></HostId></Error>"
Duration: 32.881147ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.635881ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=18981C28D8E2E4B9 X-Request-Id=Q7eK3oWu7Lt X-Xss-Protection=1; mode=block Server=Storj Date=Fri, 27 Feb 2026 13:03:35 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/57b59fa3c82edb0a
FAIL (2026-02-27 13:03:35 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C28D8E2E4B9</RequestId><HostId></HostId></Error>"
Duration: 10.668164ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.198541ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml X-Amz-Request-Id=18981C250E3B37BB X-Request-Id=Sf3xgKLqNgH Date=Fri, 27 Feb 2026 13:03:18 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/d2cb34c024024f4
FAIL (2026-02-27 13:03:18 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C250E3B37BB</RequestId><HostId></HostId></Error>"
Duration: 14.223828ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.102919ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Fri, 27 Feb 2026 13:03:06 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981C2224CDC639 X-Request-Id=6THaKxZFeWK X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/799a45c8b6a2193f
FAIL (2026-02-27 13:03:06 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C2224CDC639</RequestId><HostId></HostId></Error>"
Duration: 10.129334ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
1.881422488s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 13:03:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.881470403s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.005143ms remote:
"tcp:45.38.24.2:443" response headers:
Server=Storj Vary=Origin X-Amz-Request-Id=18981C1F9A8F70B2 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=Gd6xcivcQTK Date=Fri, 27 Feb 2026 13:02:55 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/5ec73ccb3f3bca81
FAIL (2026-02-27 13:02:55 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C1F9A8F70B2</RequestId><HostId></HostId></Error>"
Duration: 27.033159ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.049932ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18981C1EDA667FD2 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=jgi6HqtfY6M Date=Fri, 27 Feb 2026 13:02:52 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/33edb7450df6e5d6
FAIL (2026-02-27 13:02:52 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C1EDA667FD2</RequestId><HostId></HostId></Error>"
Duration: 10.084783ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.882913ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18981C1CE91AA7A0 X-Request-Id=Yn2x8JucW7q X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 13:02:43 GMT Content-Security-Policy=block-all-mixed-content Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/1def48c9821ac34c
FAIL (2026-02-27 13:02:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981C1CE91AA7A0</RequestId><HostId></HostId></Error>"
Duration: 10.910667ms
edge
gateway
vhost
bgp
ap1
|