Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
87.911688ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj X-Amz-Request-Id=18981B6EE45A7FDA X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=FxfkQsF8Eyb Date=Fri, 27 Feb 2026 12:50:16 GMT Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/88617401264da89
FAIL (2026-02-27 12:50:16 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B6EE45A7FDA</RequestId><HostId></HostId></Error>"
Duration: 87.929568ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
1.17576s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 12:50:11 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.175794609s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.062573ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981B690A68022A X-Request-Id=Rk9WLVAGPcb Content-Security-Policy=block-all-mixed-content X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:49:51 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/1245a1c576cfe2d4
FAIL (2026-02-27 12:49:51 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B690A68022A</RequestId><HostId></HostId></Error>"
Duration: 28.091383ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.385ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:49:51 GMT Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981B68F8066584 X-Request-Id=Pd9oEzUa3ZD Content-Length=274 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/3d47e0d0b05e1ef8
FAIL (2026-02-27 12:49:51 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B68F8066584</RequestId><HostId></HostId></Error>"
Duration: 12.400621ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.839009ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=18981B66A6B6DCE1 X-Request-Id=SjaBZNBSU1h X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:49:41 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/6afe8b11cf62292
FAIL (2026-02-27 12:49:41 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B66A6B6DCE1</RequestId><HostId></HostId></Error>"
Duration: 10.887829ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.365332ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981B6607ABD146 Date=Fri, 27 Feb 2026 12:49:38 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Request-Id=WDJS8V7Z42p X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/1cf806e487ab9d95
FAIL (2026-02-27 12:49:38 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B6607ABD146</RequestId><HostId></HostId></Error>"
Duration: 14.391778ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
1.103958934s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 12:49:23 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.103987599s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.380066ms remote:
"tcp:45.38.24.2:443" response headers:
X-Amz-Request-Id=18981B5D4FC572A8 Vary=Origin X-Request-Id=78CGzWjHnQn X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:49:00 GMT Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/749e64de96ded1b7
FAIL (2026-02-27 12:49:00 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B5D4FC572A8</RequestId><HostId></HostId></Error>"
Duration: 30.406495ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.631097ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=18981B59E71186C7 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Request-Id=DWTbFt1SqJh Date=Fri, 27 Feb 2026 12:48:46 GMT Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/668c2fb8917efa20
FAIL (2026-02-27 12:48:46 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B59E71186C7</RequestId><HostId></HostId></Error>"
Duration: 10.679033ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.522584ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Fri, 27 Feb 2026 12:48:45 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981B59A74CC8C1 X-Request-Id=BBpGHcudrGU X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/6df584b7c59094a2
FAIL (2026-02-27 12:48:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B59A74CC8C1</RequestId><HostId></HostId></Error>"
Duration: 10.759403ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.996901ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18981B57E1821AC7 Date=Fri, 27 Feb 2026 12:48:37 GMT Content-Length=274 Content-Type=application/xml Server=Storj X-Request-Id=WRqn9wnWRWZ X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/32e86d40355c6d8d
FAIL (2026-02-27 12:48:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B57E1821AC7</RequestId><HostId></HostId></Error>"
Duration: 14.022471ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
1.195493521s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 12:48:11 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.195590441s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.956801ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Type=application/xml Server=Storj X-Amz-Request-Id=18981B4D3CBC331C X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=8RFuGxdfhX3 Date=Fri, 27 Feb 2026 12:47:51 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/2b43fab87e0ed3fd
FAIL (2026-02-27 12:47:51 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B4D3CBC331C</RequestId><HostId></HostId></Error>"
Duration: 27.980443ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.934023ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Server=Storj Vary=Origin X-Request-Id=epfL9XGYDuc X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:47:50 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=18981B4CD7088145 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/3a16a4b6e6320901
FAIL (2026-02-27 12:47:50 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B4CD7088145</RequestId><HostId></HostId></Error>"
Duration: 14.984006ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
36.261598ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=18981B4B0FBBEBCC X-Request-Id=WkF7vhJKKWb X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin Date=Fri, 27 Feb 2026 12:47:42 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/619d6de0f948cfde
FAIL (2026-02-27 12:47:42 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B4B0FBBEBCC</RequestId><HostId></HostId></Error>"
Duration: 36.278317ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.508561ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=18981B49E5D1E8D7 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:47:37 GMT Accept-Ranges=bytes Content-Length=274 Vary=Origin X-Request-Id=Ww1tseLNDYt target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/3bddd6b0f5a01adc
FAIL (2026-02-27 12:47:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B49E5D1E8D7</RequestId><HostId></HostId></Error>"
Duration: 11.536143ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
33.183247ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=A9gVixzadnu X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:47:28 GMT Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18981B47BAA360BC target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/2c39484bb79c3461
FAIL (2026-02-27 12:47:28 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B47BAA360BC</RequestId><HostId></HostId></Error>"
Duration: 33.26074ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
1.224210303s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 12:47:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.224240677s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.849849ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Date=Fri, 27 Feb 2026 12:47:17 GMT Vary=Origin X-Amz-Request-Id=18981B4538336560 X-Request-Id=4U3jnfxUHbs X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/3ae244500fa0be61
FAIL (2026-02-27 12:47:17 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B4538336560</RequestId><HostId></HostId></Error>"
Duration: 9.872664ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.099085ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Request-Id=gRfVSHuKW2C X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:46:59 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=18981B40FBF0A636 Accept-Ranges=bytes Content-Length=274 Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/28a043a64f86bf92
FAIL (2026-02-27 12:46:59 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B40FBF0A636</RequestId><HostId></HostId></Error>"
Duration: 13.123547ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.325856ms remote:
"tcp:45.38.24.2:443" response headers:
X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981B3F62603251 Date=Fri, 27 Feb 2026 12:46:52 GMT Content-Security-Policy=block-all-mixed-content X-Request-Id=bbvNgpPXAKj target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/13b4b1823ed5fcf2
FAIL (2026-02-27 12:46:52 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B3F62603251</RequestId><HostId></HostId></Error>"
Duration: 29.351073ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.826361ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=JsNWJPQzVf5 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:46:34 GMT Content-Type=application/xml X-Amz-Request-Id=18981B3B5109ABE8 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/704c444d735c0943
FAIL (2026-02-27 12:46:34 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B3B5109ABE8</RequestId><HostId></HostId></Error>"
Duration: 10.85153ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.030914ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Fri, 27 Feb 2026 12:46:25 GMT Accept-Ranges=bytes Content-Type=application/xml Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18981B3928E51DFA X-Request-Id=BkaTtfngSSB X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/6c5d3cd1fe985c5
FAIL (2026-02-27 12:46:25 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B3928E51DFA</RequestId><HostId></HostId></Error>"
Duration: 10.056723ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
1.214202363s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 12:46:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.214230144s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.817814ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18981B3669B87AC1 Date=Fri, 27 Feb 2026 12:46:13 GMT Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=8V4C6X9TFUo X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/6bca114aa039df8e
FAIL (2026-02-27 12:46:13 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B3669B87AC1</RequestId><HostId></HostId></Error>"
Duration: 9.842394ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
1.176245129s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 12:45:59 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.176282179s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.701056ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=18981B329DCBEBB6 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Vary=Origin X-Request-Id=V8KJbJyzjSR Date=Fri, 27 Feb 2026 12:45:57 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/6e2d5a7ba6e94c5e
FAIL (2026-02-27 12:45:57 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B329DCBEBB6</RequestId><HostId></HostId></Error>"
Duration: 12.732929ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
35.368555ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Accept-Ranges=bytes X-Amz-Request-Id=18981B312DBAAA8A X-Request-Id=e5ZpqCZxLQg Date=Fri, 27 Feb 2026 12:45:51 GMT Content-Length=284 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/486967680679425a
FAIL (2026-02-27 12:45:51 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B312DBAAA8A</RequestId><HostId></HostId></Error>"
Duration: 35.442403ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.782957ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981B2A8736CB8E X-Request-Id=cyig4aJFCmN Date=Fri, 27 Feb 2026 12:45:22 GMT Accept-Ranges=bytes Content-Length=274 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/7a1b55773b39be83
FAIL (2026-02-27 12:45:22 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B2A8736CB8E</RequestId><HostId></HostId></Error>"
Duration: 10.83158ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.803384ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Request-Id=AyJ1p8xjpLk X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=18981B2A752B73CC Date=Fri, 27 Feb 2026 12:45:22 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/53954f609542646
FAIL (2026-02-27 12:45:22 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B2A752B73CC</RequestId><HostId></HostId></Error>"
Duration: 10.830598ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.954493ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18981B26792D31B2 Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=Fet7F5c5QHy X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:45:05 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/187cc268d17c30f6
FAIL (2026-02-27 12:45:05 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B26792D31B2</RequestId><HostId></HostId></Error>"
Duration: 15.228759ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
1.29596576s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 12:44:56 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.295996201s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.028866ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18981B23061B0A49 X-Request-Id=SNJRqutu3q3 Date=Fri, 27 Feb 2026 12:44:50 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/359585d30df3ecfd
FAIL (2026-02-27 12:44:50 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B23061B0A49</RequestId><HostId></HostId></Error>"
Duration: 12.054215ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.473133ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=ND7Dw3GyRYk X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Server=Storj X-Amz-Request-Id=18981B22773235FF Date=Fri, 27 Feb 2026 12:44:48 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/4bd184d0aa28bc83
FAIL (2026-02-27 12:44:48 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B22773235FF</RequestId><HostId></HostId></Error>"
Duration: 9.497605ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.457785ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=BmUToaWNELo X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:44:36 GMT Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18981B1FC07A6BD5 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/fc117a6023be279
FAIL (2026-02-27 12:44:36 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B1FC07A6BD5</RequestId><HostId></HostId></Error>"
Duration: 26.482461ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
1.280414136s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 12:44:24 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.280449029s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.198937ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=18981B1A832E718F X-Request-Id=ee8c2eLQ42U Date=Fri, 27 Feb 2026 12:44:14 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2aed56ffbbee36a4
FAIL (2026-02-27 12:44:14 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B1A832E718F</RequestId><HostId></HostId></Error>"
Duration: 9.225554ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.34497ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:44:12 GMT Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18981B1A0F044666 X-Request-Id=jmmXqTjiDN5 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/3256abfeefffd126
FAIL (2026-02-27 12:44:12 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B1A0F044666</RequestId><HostId></HostId></Error>"
Duration: 10.401679ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.064475ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18981B1983F9CC9C X-Request-Id=Fgx6NffBgtn X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:44:09 GMT Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/62bc89183603956c
FAIL (2026-02-27 12:44:09 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B1983F9CC9C</RequestId><HostId></HostId></Error>"
Duration: 13.087834ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
32.024827ms remote:
"tcp:45.38.24.2:443" response headers:
X-Xss-Protection=1; mode=block Content-Length=284 Content-Type=application/xml Server=Storj X-Request-Id=M4VSzwainiZ Date=Fri, 27 Feb 2026 12:44:05 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18981B18810F57F6 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/68386591df7a7487
FAIL (2026-02-27 12:44:05 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B18810F57F6</RequestId><HostId></HostId></Error>"
Duration: 32.051343ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
1.157284775s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 12:43:59 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.157307503s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.100188ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Fri, 27 Feb 2026 12:43:45 GMT Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18981B13DB2A26BC X-Request-Id=Viu3jfULGZ4 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/7563df5406ea4525
FAIL (2026-02-27 12:43:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B13DB2A26BC</RequestId><HostId></HostId></Error>"
Duration: 10.204593ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
1.355150073s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 12:43:30 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.355194957s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.417308ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:43:21 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Request-Id=TTEgjjnyuSy Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18981B0E5E06E33F target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/74f844f449ab9823
FAIL (2026-02-27 12:43:21 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B0E5E06E33F</RequestId><HostId></HostId></Error>"
Duration: 9.442405ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.130742ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Server=Storj Vary=Origin X-Amz-Request-Id=18981B0DE11451D2 X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:43:19 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=NsmmvTgrRjM target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/4382f2f21d6e756b
FAIL (2026-02-27 12:43:19 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B0DE11451D2</RequestId><HostId></HostId></Error>"
Duration: 29.154019ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
17.045996ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18981B0D464735F1 X-Request-Id=Y4kkHmZU3tN X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:43:17 GMT Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/256e9d26faf75ce9
FAIL (2026-02-27 12:43:17 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B0D464735F1</RequestId><HostId></HostId></Error>"
Duration: 17.063756ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.856257ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=18981B0A7DF88B2B Vary=Origin X-Request-Id=dUwZ4RW1rhe X-Xss-Protection=1; mode=block Date=Fri, 27 Feb 2026 12:43:05 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/3c66b5195d2834d9
FAIL (2026-02-27 12:43:05 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B0A7DF88B2B</RequestId><HostId></HostId></Error>"
Duration: 8.885387ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
31.727853ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Type=application/xml Server=Storj X-Request-Id=GY3tSQQuzhG Date=Fri, 27 Feb 2026 12:43:01 GMT Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18981B0981E007D4 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=284 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/64025540784e5138
FAIL (2026-02-27 12:43:01 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B0981E007D4</RequestId><HostId></HostId></Error>"
Duration: 31.765878ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.443349ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18981B091EF0A43F Date=Fri, 27 Feb 2026 12:42:59 GMT Accept-Ranges=bytes Server=Storj X-Request-Id=iDyqtjdjD6x X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/7286f3a364d0d8c1
FAIL (2026-02-27 12:42:59 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18981B091EF0A43F</RequestId><HostId></HostId></Error>"
Duration: 11.487175ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
1.317852881s trace:
https://jaeger.dev.storj.io/trace/41604b8e737e0644
FAIL (2026-02-27 12:42:51 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
Feb 27 12:24:12.958062237 (232h8m13.761421427s) [upload=241649]: Starting upload
Feb 27 12:24:12.958140898 (232h8m13.761500081s) [upload=241649]: Done starting upload
Feb 27 12:24:12.958361897 (232h8m13.761721063s) [upload=241649]: Uploading segments...
Feb 27 12:24:12.958461336 (232h8m13.761820517s) [upload=241649]: Got next segment. Inline: false
Feb 27 12:24:12.958521453 (232h8m13.761880637s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 27 12:24:12.958527047 (232h8m13.761886222s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 27 12:24:12.996321566 (232h8m13.79968075s) [seg_pos={0 0}, upload=241649]: Begin upload segment...
Feb 27 12:24:12.996448820 (232h8m13.799807999s) [seg_pos={0 0}, upload=241649]: Done begin upload segment.
Feb 27 12:24:12.996528741 (232h8m13.799887926s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.996657536 (232h8m13.800016719s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.998274501 (232h8m13.801633687s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999072752 (232h8m13.802431938s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:12.999746928 (232h8m13.803106112s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000114348 (232h8m13.803473543s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000906074 (232h8m13.804265302s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.000989520 (232h8m13.804348704s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001455955 (232h8m13.804815197s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.001604735 (232h8m13.804963973s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002253164 (232h8m13.805612348s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.002863992 (232h8m13.806223173s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003499182 (232h8m13.806858378s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.003922169 (232h8m13.807281352s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004123035 (232h8m13.807482216s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.004561506 (232h8m13.807920691s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.005503797 (232h8m13.808862985s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.006763318 (232h8m13.810122494s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Uploading piece...
Feb 27 12:24:13.096582917 (232h8m13.899942093s) [upload=241649]: Next returned nil segment
Feb 27 12:24:13.096600442 (232h8m13.899959621s) [upload=241649]: Waiting for error group managing segments...
Feb 27 12:24:13.100656351 (232h8m13.904015632s) [noise=true , address=77.90.31.17:4781 , piece_id=5WPZTO3KADH7PJRDVZHZRHFGPKCRGDUQFFSU2IASGA34WGTKITYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.105829543 (232h8m13.909188724s) [noise=true , address=145.79.227.17:4003 , piece_id=EOOSDAIIZ7SCDQYF6YM7X4KM3IBJ5ZZEUUC6NI7KP5U4SFTYVIGQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.119177670 (232h8m13.922536847s) [noise=true , address=45.91.116.8:4062 , piece_id=OOI4LTYZUSR4XIEWUQUE4I6TKMYCYVB3C4EZQMX3QZXIZ6VP3FRQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.123143490 (232h8m13.92650267s) [noise=true , address=77.90.31.16:4767 , piece_id=HB3F3CCZNCGUVV7GQCSCFKA3O65OD2C675RQ2GBEY7F455UOXX6A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.136750677 (232h8m13.940109854s) [noise=true , address=77.90.31.11:4557 , piece_id=6RGA2LKJU2GPDHZO5ZJAP5JV7FPJHPBP6FGEVUFPRO2DQP5QRRYA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.348804845 (232h8m14.152164027s) [noise=true , address=167.17.72.68:4650 , piece_id=YGUZCA6UR763GM6LLOBW63I3XV5QRLCDPNVPNBVI7CU4PTPJBL5Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.371058396 (232h8m14.17441757s) [noise=true , address=167.17.72.71:4781 , piece_id=4SOK636CRCLWNTDOBZLD6N2K3OG4QAQLORSXN4OYSHYVVCNOOY2A, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.387505238 (232h8m14.190864418s) [noise=true , address=167.17.72.69:4713 , piece_id=XOV243LRSIJ3AO37MWITSBYT56UCERPUAMOVKJYWTVHKQYPTGQBA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.391295708 (232h8m14.194654919s) [noise=true , address=167.17.72.70:4774 , piece_id=WOW24DU7IHJQDUJ7XWUBRRJJBQQAC6PNMAVMIHXSER5AHLQYLPIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.542261626 (232h8m14.345620799s) [noise=true , address=79.127.205.234:4198 , piece_id=P4UI3EJI4CU2ABQVNDKNFKVB6L2EWQYLBXTNHZYFTMWSZP655XLA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.558338658 (232h8m14.36169784s) [noise=true , address=79.127.205.233:4147 , piece_id=W5LZWDTG7UOBNTBMCTVYRI5YMGJXUEYENFY7TKMFIZHCYYXEGNIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.559532458 (232h8m14.362891639s) [noise=true , address=79.127.205.235:4252 , piece_id=4EGUQPE6WXCMZGDWNLLADBI47XVXWMP7323QAWZZZBD2FKVNRAPQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.592708624 (232h8m14.396067801s) [noise=true , address=193.149.164.67:4025 , piece_id=4E74ORPXOWTXYVX77P7JW5ECONNJY56LPH5J6OUZRH2EM2GZFB4Q, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603936163 (232h8m14.407295329s) [noise=true , address=193.149.164.69:4086 , piece_id=AYY5FI42QZRCZHRNP54G4F2X3U5PQ4ORAZZFYC2BV5T2MEDUSRVA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: <nil>
Feb 27 12:24:13.603990680 (232h8m14.407349863s) [seg_pos={0 0}, upload=241649]: Satisfied cohort requirements after 14 pieces
Feb 27 12:24:13.604300419 (232h8m14.407659603s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J7goNH48bnMJyaCAPgUznrX1n6bNFNZXGqpuftNLVLxQxprsF): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604313894 (232h8m14.407673059s) [noise=true , address=145.79.227.43:4187 , piece_id=MDSPZEEVTTDM624JP7RVUT7TT3V7QQLIVZ2IAJNLPSEVSZGC5BIQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604426170 (232h8m14.407785355s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XfehFoLvcivSkVcGttnXVK5VCSWKCpmyPX3E6rtpVdwnUbbZ4): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604545884 (232h8m14.407905074s) [noise=true , address=193.149.164.68:4041 , piece_id=2ONFEAV67QPMJYNRD5DLK4WVHDELCTTVXOVX5U7D5PT4INGN6XIA, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604898398 (232h8m14.408257582s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gozVE5KTcqGagY5veHpMqMQa3QHaNumynNSPvSb6LsKBHALuv): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604908271 (232h8m14.408267455s) [noise=true , address=145.79.227.38:4984 , piece_id=FQVQGMFTD42KOZWHKRVPT5A4XMXPTYGZ6BNK2ETVST3ZKBM4P3HQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604924749 (232h8m14.408283934s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RQz653n137xXR4Dk2iXCDB1uKndLVm7C48VSa8B1J2tj2QvqR): protocol: expected piece hash; context canceled; EOF
Feb 27 12:24:13.604936657 (232h8m14.408295846s) [noise=true , address=193.149.164.66:4963 , piece_id=5XKCRDLGMGAA6GBVVPXXY2K7HH4N5TRM2KAFBO3K5AFCMLNW53AQ, seg_pos={0 0}, upload=241649]: Long tail cancellation due to optimal threshold
Feb 27 12:24:13.604988498 (232h8m14.408347659s) [seg_pos={0 0}, upload=241649]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Feb 27 12:24:13.605271411 (232h8m14.408630597s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 27 12:24:13.605282821 (232h8m14.408642006s) [upload=241649]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 27 12:24:13.658039633 (232h8m14.461398807s) [upload=241649]: Done uploading segments...
Feb 27 12:24:13.658060724 (232h8m14.4614199s) [upload=241649]: Upload finished. err: <nil>
Duration: 1.31787064s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|