Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.213413ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml X-Amz-Request-Id=18981BD987847A60 Date=Fri, 27 Feb 2026 12:57:54 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=gzQ95iRtWpv X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/72ff23062c2a9c30
FAIL (2026-02-27 12:57:54 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BD987847A60</RequestId><HostId></HostId></Error>"
Duration: 9.240315ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.565102ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=hvHCsF8pyMa Content-Length=274 Content-Type=application/xml Server=Storj X-Amz-Request-Id=18981BD7E77F7656 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:57:47 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/4359bac548ea3557
FAIL (2026-02-27 12:57:47 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BD7E77F7656</RequestId><HostId></HostId></Error>"
Duration: 10.59086ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.981628ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=8HsceKc2V28 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18981BD6974CDF54 Date=Fri, 27 Feb 2026 12:57:41 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/50f43655c28ab46f
FAIL (2026-02-27 12:57:41 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BD6974CDF54</RequestId><HostId></HostId></Error>"
Duration: 14.998191ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.776426ms remote:
"tcp:45.38.24.2:443" response headers:
X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:57:37 GMT Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18981BD5878A3310 Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=c4ogiSbJh2L target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/33b98843a7ada3df
FAIL (2026-02-27 12:57:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BD5878A3310</RequestId><HostId></HostId></Error>"
Duration: 26.7987ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.729285ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Date=Fri, 27 Feb 2026 12:57:16 GMT Server=Storj Vary=Origin X-Amz-Request-Id=18981BD0CD732EF8 X-Request-Id=R1PyZD6af6k X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/12ff086cc991c904
FAIL (2026-02-27 12:57:16 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BD0CD732EF8</RequestId><HostId></HostId></Error>"
Duration: 10.782005ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.480064ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18981BD0605CAD38 X-Request-Id=6NrCM9XZxTm Date=Fri, 27 Feb 2026 12:57:15 GMT Accept-Ranges=bytes Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/345906e933e1004d
FAIL (2026-02-27 12:57:15 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BD0605CAD38</RequestId><HostId></HostId></Error>"
Duration: 11.525502ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
1.163106668s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 12:57:13 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.163138222s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
75.076526ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=18981BCEA036F685 X-Request-Id=fcL88YN1yZD X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:57:07 GMT Server=Storj Vary=Origin target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/7875af273104d2bf
FAIL (2026-02-27 12:57:07 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BCEA036F685</RequestId><HostId></HostId></Error>"
Duration: 75.090938ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.342781ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Request-Id=fcWig4h4Fj5 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:57:04 GMT Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981BCDDD3E05EC target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/614f8d5721edfac8
FAIL (2026-02-27 12:57:04 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BCDDD3E05EC</RequestId><HostId></HostId></Error>"
Duration: 12.3721ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.881086ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18981BCA7597C358 X-Request-Id=UytrR9DRvgf X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:56:49 GMT Content-Length=274 Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/21304adb95d6fa85
FAIL (2026-02-27 12:56:49 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BCA7597C358</RequestId><HostId></HostId></Error>"
Duration: 9.90588ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.815024ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=HHnm2aC2ux X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:56:39 GMT Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18981BC80A932218 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/61e87cb7811db2
FAIL (2026-02-27 12:56:39 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BC80A932218</RequestId><HostId></HostId></Error>"
Duration: 10.9365ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
1.673843237s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 12:56:35 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.673881628s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.971861ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18981BC71C0E844E X-Request-Id=N4m3XEzftNU X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Server=Storj Date=Fri, 27 Feb 2026 12:56:35 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/538b63cc982ed0ac
FAIL (2026-02-27 12:56:35 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BC71C0E844E</RequestId><HostId></HostId></Error>"
Duration: 14.993775ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.771671ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=18981BC2183E7EF3 X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=2z5p1auJSwc Date=Fri, 27 Feb 2026 12:56:13 GMT Accept-Ranges=bytes Content-Type=application/xml Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/295d7c21c19df3ec
FAIL (2026-02-27 12:56:13 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BC2183E7EF3</RequestId><HostId></HostId></Error>"
Duration: 9.794758ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
17.665029ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18981BC0064B86C4 X-Request-Id=9Zoa4mna1vY X-Xss-Protection=1; mode=block Accept-Ranges=bytes Server=Storj Date=Fri, 27 Feb 2026 12:56:04 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/44655dda0fce45a0
FAIL (2026-02-27 12:56:04 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BC0064B86C4</RequestId><HostId></HostId></Error>"
Duration: 17.692864ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.178661ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes X-Amz-Request-Id=18981BBEBBDC948F X-Request-Id=E1AvfhgGA1L Date=Fri, 27 Feb 2026 12:55:59 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/5cbf523470a07e80
FAIL (2026-02-27 12:55:59 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BBEBBDC948F</RequestId><HostId></HostId></Error>"
Duration: 30.21471ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
21.620998ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Fri, 27 Feb 2026 12:55:59 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Content-Length=274 X-Amz-Request-Id=18981BBEDF368E4E X-Request-Id=Zy5gFYPxfXE target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/429118352a0a34be
FAIL (2026-02-27 12:55:59 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BBEDF368E4E</RequestId><HostId></HostId></Error>"
Duration: 21.638554ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.062469ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981BBBFA042F1A X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:55:47 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Request-Id=Lf8dkh4aJSC target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2b14330265c40547
FAIL (2026-02-27 12:55:47 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BBBFA042F1A</RequestId><HostId></HostId></Error>"
Duration: 11.086018ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
1.021915277s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 12:55:39 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.021942457s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.287348ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18981BB906209C03 X-Request-Id=5BKQajtCY1E X-Xss-Protection=1; mode=block Content-Type=application/xml Date=Fri, 27 Feb 2026 12:55:34 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/300d945bede9069
FAIL (2026-02-27 12:55:34 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BB906209C03</RequestId><HostId></HostId></Error>"
Duration: 14.312474ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.233362ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18981BB441FE7E94 X-Request-Id=fdAtRtjQE98 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:55:14 GMT Accept-Ranges=bytes Server=Storj Content-Length=284 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/37ec50d06cf67fdd
FAIL (2026-02-27 12:55:14 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BB441FE7E94</RequestId><HostId></HostId></Error>"
Duration: 29.265988ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.910232ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981BB3CF0BDCC2 X-Xss-Protection=1; mode=block Accept-Ranges=bytes X-Request-Id=ZBea8ZjDzbY Date=Fri, 27 Feb 2026 12:55:12 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/899500ea21e1b81
FAIL (2026-02-27 12:55:12 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BB3CF0BDCC2</RequestId><HostId></HostId></Error>"
Duration: 10.939449ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.141617ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=ARC5F48X7yX Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml X-Amz-Request-Id=18981BB0585964A1 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:54:57 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/7271339906234df3
FAIL (2026-02-27 12:54:57 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BB0585964A1</RequestId><HostId></HostId></Error>"
Duration: 14.169696ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.715532ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=LG4KDympRe7 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:54:51 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18981BAEFB1EE7CB Accept-Ranges=bytes Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/16077e6a80f2ef3
FAIL (2026-02-27 12:54:51 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BAEFB1EE7CB</RequestId><HostId></HostId></Error>"
Duration: 9.739021ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
16.497091ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:54:45 GMT Accept-Ranges=bytes Content-Type=application/xml X-Amz-Request-Id=18981BAD99C04EDD X-Request-Id=RZZ3GoNqYY8 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/628f14b1b7c6ba7c
FAIL (2026-02-27 12:54:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BAD99C04EDD</RequestId><HostId></HostId></Error>"
Duration: 16.526707ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
1.425330542s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 12:54:32 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.425412958s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.165884ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Type=application/xml Date=Fri, 27 Feb 2026 12:54:18 GMT Accept-Ranges=bytes Content-Length=284 Server=Storj Vary=Origin X-Amz-Request-Id=18981BA751ECB095 X-Request-Id=W6uMVLiTwWp X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/27be99473015ecd9
FAIL (2026-02-27 12:54:18 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BA751ECB095</RequestId><HostId></HostId></Error>"
Duration: 27.273275ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.091065ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18981BA496255539 Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=VkNoTHCFGYJ X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:54:07 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2e3dcb73f1457eea
FAIL (2026-02-27 12:54:07 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BA496255539</RequestId><HostId></HostId></Error>"
Duration: 11.139512ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.365265ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Amz-Request-Id=18981BA266FBF569 Date=Fri, 27 Feb 2026 12:53:57 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=iVeVE2o2Rsr X-Xss-Protection=1; mode=block Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/3b378bb1f12774
FAIL (2026-02-27 12:53:57 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BA266FBF569</RequestId><HostId></HostId></Error>"
Duration: 13.461081ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.626658ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Vary=Origin X-Request-Id=MC2XXp2hRkZ Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18981BA10C79D014 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:53:51 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/19f613d9098f6dba
FAIL (2026-02-27 12:53:51 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981BA10C79D014</RequestId><HostId></HostId></Error>"
Duration: 13.700451ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.654906ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981B9AF74DE98F X-Request-Id=aa5WtZyrfK8 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Date=Fri, 27 Feb 2026 12:53:25 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3fa43b7a9a1aceb2
FAIL (2026-02-27 12:53:25 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B9AF74DE98F</RequestId><HostId></HostId></Error>"
Duration: 30.680932ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
1.091920387s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 12:53:24 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.091953717s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.526596ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj Date=Fri, 27 Feb 2026 12:53:05 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18981B964D426759 X-Request-Id=7YX827EfvTo X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/31c14ba666e9c29
FAIL (2026-02-27 12:53:05 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B964D426759</RequestId><HostId></HostId></Error>"
Duration: 10.619053ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.734615ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml X-Amz-Request-Id=18981B9508326465 X-Request-Id=BydRVfSRuZ3 Date=Fri, 27 Feb 2026 12:53:00 GMT Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2a716c9837ad6187
FAIL (2026-02-27 12:53:00 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B9508326465</RequestId><HostId></HostId></Error>"
Duration: 14.754152ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.929921ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Amz-Request-Id=18981B933627116E X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:52:52 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Vary=Origin X-Request-Id=hpTvDCYjLFL Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/335c9fbd391b0a6e
FAIL (2026-02-27 12:52:52 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B933627116E</RequestId><HostId></HostId></Error>"
Duration: 11.963382ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
15.56025ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981B8E20C75781 X-Request-Id=GNNqYxWavZP X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Date=Fri, 27 Feb 2026 12:52:30 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/65026e969f5adb1a
FAIL (2026-02-27 12:52:30 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B8E20C75781</RequestId><HostId></HostId></Error>"
Duration: 15.604329ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.069714ms remote:
"tcp:45.38.24.2:443" response headers:
Server=Storj Vary=Origin X-Request-Id=PLVXU8BPD65 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:52:29 GMT Content-Length=284 X-Amz-Request-Id=18981B8DF4AA7771 Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/6c6bc395d36c759c
FAIL (2026-02-27 12:52:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B8DF4AA7771</RequestId><HostId></HostId></Error>"
Duration: 30.09798ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
1.077753605s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 12:52:13 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.077808763s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.817239ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Amz-Request-Id=18981B85A78DAEF2 X-Request-Id=VyyBv59eBA8 Date=Fri, 27 Feb 2026 12:51:54 GMT Content-Length=274 Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/1f5dfea687b4120
FAIL (2026-02-27 12:51:54 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B85A78DAEF2</RequestId><HostId></HostId></Error>"
Duration: 11.928771ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.963197ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin Date=Fri, 27 Feb 2026 12:51:47 GMT Content-Length=274 Content-Type=application/xml Server=Storj X-Amz-Request-Id=18981B8431081C80 X-Request-Id=CxY1pwsbr6p X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/cc5d3cdbaf4fb68
FAIL (2026-02-27 12:51:47 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B8431081C80</RequestId><HostId></HostId></Error>"
Duration: 10.991984ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
1.195348516s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 12:51:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.195449037s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
15.578222ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj Vary=Origin Accept-Ranges=bytes X-Amz-Request-Id=18981B813E8D2C4A X-Request-Id=Q1VuedXSoa X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:51:35 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/4a091f0dacc7e2d1
FAIL (2026-02-27 12:51:35 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B813E8D2C4A</RequestId><HostId></HostId></Error>"
Duration: 15.609665ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.916555ms remote:
"tcp:45.38.24.2:443" response headers:
X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=cVjXEySJVGZ Date=Fri, 27 Feb 2026 12:51:23 GMT Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18981B7E89326FED target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/2c8c8495e4cad042
FAIL (2026-02-27 12:51:23 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B7E89326FED</RequestId><HostId></HostId></Error>"
Duration: 26.94564ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
1.198523086s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 12:51:11 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.198552396s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.068712ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml X-Amz-Request-Id=18981B7BC276E52D X-Request-Id=GwZ3WjNXsJq X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:51:11 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/a895b37ace43efc
FAIL (2026-02-27 12:51:11 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B7BC276E52D</RequestId><HostId></HostId></Error>"
Duration: 10.083153ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.325907ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Amz-Request-Id=18981B783C9F0CC4 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:50:56 GMT Content-Length=274 Content-Type=application/xml Vary=Origin X-Request-Id=PqSjkBfwh8w Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/5b18cbb1a06ddb19
FAIL (2026-02-27 12:50:56 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B783C9F0CC4</RequestId><HostId></HostId></Error>"
Duration: 11.354664ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
31.506296ms remote:
"tcp:45.38.24.2:443" response headers:
X-Request-Id=cV28Wi8itsK Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:50:51 GMT Accept-Ranges=bytes Content-Length=284 X-Amz-Request-Id=18981B77292DC142 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/6eb2fc871dc53d49
FAIL (2026-02-27 12:50:51 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B77292DC142</RequestId><HostId></HostId></Error>"
Duration: 31.5342ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.859919ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981B75C0AD9E5D X-Request-Id=iUPwzGzXaJW Date=Fri, 27 Feb 2026 12:50:45 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/9bade3f6bf58efd
FAIL (2026-02-27 12:50:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B75C0AD9E5D</RequestId><HostId></HostId></Error>"
Duration: 9.883495ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
1.02997603s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 12:50:38 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.030140423s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
15.024777ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Server=Storj X-Request-Id=3Zp9osofjKM Date=Fri, 27 Feb 2026 12:50:34 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18981B73255B0874 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/386d6be6a2c54360
FAIL (2026-02-27 12:50:34 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B73255B0874</RequestId><HostId></HostId></Error>"
Duration: 15.048718ms
edge
gateway
vhost
bgp
ap1
|